2024-09-12T02:14:19.929 INFO:root:teuthology version: 1.2.2.dev2+g3752d38 2024-09-12T02:14:19.955 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-09-12T02:14:20.055 INFO:teuthology.run:Config: archive_path: /home/teuthworker/archive/teuthology-2024-09-11_21:24:17-fs-squid-distro-default-smithi/7901615 branch: squid description: fs/workload/{0-centos_9.stream begin/{0-install 1-cephadm 2-logrotate 3-modules} clusters/1a11s-mds-1c-client-3node conf/{client mds mgr mon osd} mount/kclient/{base/{mount-syntax/{v2} mount overrides/{distro/testing/k-testing ms-die-on-skipped}} ms_mode/legacy wsync/no} objectstore-ec/bluestore-ec-root omap_limit/10 overrides/{cephsqlite-timeout frag ignorelist_health ignorelist_wrongly_marked_down osd-asserts pg_health session_timeout} ranks/multi/{balancer/random export-check n/5 replication/always} standby-replay tasks/{0-subvolume/{with-quota} 1-check-counter 2-scrub/no 3-snaps/yes 4-flush/no 5-quiesce/no 6-workunit/fs/test_o_trunc}} email: ceph-qa@ceph.com first_in_suite: false job_id: '7901615' kernel: client: branch: testing kdb: 1 sha1: distro ktype: upstream last_in_suite: false log-rotate: ceph-mds: 10G ceph-osd: 10G machine_type: smithi mgrmodules: sequential: - print: Enabling mgr modules - exec: mon.a: - ceph mgr module enable snap_schedule name: teuthology-2024-09-11_21:24:17-fs-squid-distro-default-smithi no_nested_subset: false openstack: - volumes: count: 4 size: 20 - machine: disk: 200 os_type: centos os_version: 9.stream overrides: admin_socket: branch: squid ceph: cephfs: ec_profile: - m=2 - k=2 - crush-failure-domain=osd max_mds: 5 session_timeout: 300 standby_replay: true conf: client: client mount timeout: 600 debug client: 20 debug ms: 1 rados mon op timeout: 900 rados osd op timeout: 900 global: ms die on skipped message: false mds: debug mds: 20 debug mds balancer: 20 debug ms: 1 mds bal fragment size max: 10000 mds bal merge size: 5 mds bal split bits: 3 mds bal split size: 100 mds debug frag: true mds debug scatterstat: true mds op complaint time: 180 mds verify scatter: true mds_bal_replicate_threshold: 1 mds_export_ephemeral_random_max: 0.1 osd op complaint time: 180 rados mon op timeout: 900 rados osd op timeout: 900 mgr: cephsqlite lock renewal timeout: 900000 debug cephsqlite: 20 debug client: 20 debug mgr: 20 debug ms: 1 mon: debug mon: 20 debug ms: 1 debug paxos: 20 mon down mkfs grace: 300 mon op complaint time: 120 mon warn on pool no app: false osd: bluestore block size: 96636764160 bluestore fsck on mount: true debug bluefs: 20 debug bluestore: 20 debug ms: 1 debug osd: 20 debug rocksdb: 10 mon osd backfillfull_ratio: 0.85 mon osd full ratio: 0.9 mon osd nearfull ratio: 0.8 osd failsafe full ratio: 0.95 osd objectstore: bluestore osd op complaint time: 180 osd shutdown pgref assert: true osd_max_omap_entries_per_request: 10 flavor: default fs: xfs log-ignorelist: - \(MDS_ALL_DOWN\) - \(MDS_UP_LESS_THAN_MAX\) - FS_DEGRADED - FS_INLINE_DATA_DEPRECATED - FS_WITH_FAILED_MDS - MDS_ALL_DOWN - MDS_DAMAGE - MDS_DEGRADED - MDS_FAILED - MDS_INSUFFICIENT_STANDBY - MDS_UP_LESS_THAN_MAX - online, but wants - filesystem is online with fewer MDS than max_mds - POOL_APP_NOT_ENABLED - do not have an application enabled - overall HEALTH_ - Replacing daemon - deprecated feature inline_data - overall HEALTH_ - \(OSD_DOWN\) - \(OSD_ - but it is still running - is not responding - MON_DOWN - PG_AVAILABILITY - PG_DEGRADED - Reduced data availability - Degraded data redundancy sha1: b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc subvols: create: 2 subvol_options: --size 25000000000 ceph-deploy: bluestore: true conf: client: log file: /var/log/ceph/ceph-$name.$pid.log mon: {} osd: bluestore block size: 96636764160 bluestore fsck on mount: true debug bluefs: 20 debug bluestore: 20 debug rocksdb: 10 mon osd backfillfull_ratio: 0.85 mon osd full ratio: 0.9 mon osd nearfull ratio: 0.8 osd failsafe full ratio: 0.95 osd objectstore: bluestore fs: xfs ceph-fuse: client.0: mount_subvol_num: 0 check-counter: counters: mds: - mds.exported - mds.imported - min: 3 name: mds_cache.dir_update - min: 3 name: mds_cache.dir_update_receipt - mds.root_rsnaps - mds_server.req_mksnap_latency.avgcount - mds_server.req_rmsnap_latency.avgcount dry_run: true install: ceph: flavor: default sha1: b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc kclient: client.0: mount_subvol_num: 1 mntopts: - ms_mode=legacy - nowsync syntax: v2 selinux: allowlist: - scontext=system_u:system_r:logrotate_t:s0 - scontext=system_u:system_r:getty_t:s0 thrashosds: bdev_inject_crash: 2 bdev_inject_crash_probability: 0.5 workunit: branch: squid sha1: 086c737fa75c22d521a3932c59b31c5e1d1c9ef4 owner: scheduled_teuthology@teuthology priority: 100 repo: https://git.ceph.com/ceph.git roles: - - mon.a - mgr.x - mds.a - mds.d - mds.g - mds.j - osd.0 - osd.3 - osd.6 - osd.9 - client.0 - - mon.b - mgr.y - mds.b - mds.e - mds.h - mds.k - osd.1 - osd.4 - osd.7 - osd.10 - - mon.c - mgr.z - mds.c - mds.f - mds.i - mds.l - osd.2 - osd.5 - osd.8 - osd.11 seed: 481 sha1: b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc sleep_before_teardown: 0 subset: 57/512 suite: fs suite_branch: squid suite_path: /home/teuthworker/src/git.ceph.com_ceph_086c737fa75c22d521a3932c59b31c5e1d1c9ef4/qa suite_relpath: qa suite_repo: https://git.ceph.com/ceph.git suite_sha1: 086c737fa75c22d521a3932c59b31c5e1d1c9ef4 syslog: ignorelist: - WARNING*.*check_session_state - WARNING*.*__ceph_remove_cap targets: smithi039.front.sepia.ceph.com: ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBG90rotQhuSl256bbJgZm3oN9Alzr7EIjUfQtzazZ3AvCcFBevpsIgESngGKSdY5jvG1iQsOqkeIUrSgKzWqwec= smithi044.front.sepia.ceph.com: ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBAaY1EjRS69ogQzFzEbmJv944mv5DuqjsJg5Vmlcq1zu3P7/KspVQnXftRxYVYqBSYEJSUZ4Li+IgEKWi/3ZmbY= smithi172.front.sepia.ceph.com: ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBJEFsItE+P/AskwumlVJ8UU0dE7D8YP15t6KtUligs1rcPhoHKPzw6EckrrPEwsV7Oz29pOaTB/CTqRTDVL8FZ8= tasks: - install: extra_packages: deb: - python3-cephfs - cephfs-shell - cephfs-top - cephfs-mirror rpm: - python3-cephfs - cephfs-shell - cephfs-top - cephfs-mirror extra_system_packages: deb: - bison - flex - libelf-dev - libssl-dev - network-manager - iproute2 - util-linux - dump - indent - libaio-dev - libtool-bin - uuid-dev - xfslibs-dev - postgresql - postgresql-client - postgresql-common - postgresql-contrib rpm: - bison - flex - elfutils-libelf-devel - openssl-devel - NetworkManager - iproute - util-linux - libacl-devel - libaio-devel - libattr-devel - libtool - libuuid-devel - xfsdump - xfsprogs - xfsprogs-devel - libaio-devel - libtool - libuuid-devel - xfsprogs-devel - postgresql - postgresql-server - postgresql-contrib - cephadm: roleless: false - cephadm.shell: mon.a: - ceph orch status - ceph orch ps - ceph orch ls - ceph orch host ls - ceph orch device ls - cephadm.shell: mon.a: - ceph fs dump - ceph osd dump - fs.ready: timeout: 300 - sequential: - mgrmodules - kclient: null - exec: mon.a: - ceph fs set cephfs balance_automate false - ceph fs subvolumegroup pin cephfs qa random 0.10 - check-counter: {} - exec: mon.a: - ceph config set mgr mgr/snap_schedule/log_level debug - ceph config set mgr mgr/snap_schedule/allow_m_granularity true - ceph config set mgr mgr/snap_schedule/dump_on_update true - ceph fs snap-schedule add --fs=cephfs --path=/ --snap_schedule=1m - ceph fs snap-schedule retention add --fs=cephfs --path=/ --retention-spec-or-period=6m3h - ceph fs snap-schedule status --fs=cephfs --path=/ - ceph fs snap-schedule list --fs=cephfs --path=/ --recursive=true - date +%s > START_TIME - full_sequential_finally: - exec: mon.a: - date +%s > END_TIME - START_TIME=$(cat START_TIME); END_TIME=$(cat END_TIME); DIFF_TIME=$((600-(END_TIME-START_TIME))); if [ "$DIFF_TIME" -gt 0 ]; then sleep "$DIFF_TIME"; fi - ceph fs snap-schedule status --fs=cephfs --path=/ - ceph fs snap-schedule list --fs=cephfs --path=/ --recursive=true - workunit: clients: all: - fs/test_o_trunc.sh teuthology: fragments_dropped: [] meta: {} postmerge: - local function is_kupstream() return yaml.ktype == 'upstream' end - local function is_kdistro() return yaml.ktype == 'distro' end - local function is_fuse() return false end - local function syntax_version() return yaml.overrides.kclient.syntax end teuthology_branch: main teuthology_sha1: 3752d3834a7b6cd13dc17dfaa6c2fd3658f3439a timestamp: 2024-09-11_21:24:17 tube: smithi user: teuthology verbose: false worker_log: /home/teuthworker/archive/worker_logs/dispatcher.smithi.3401856 2024-09-12T02:14:20.056 INFO:teuthology.run:suite_path is set to /home/teuthworker/src/git.ceph.com_ceph_086c737fa75c22d521a3932c59b31c5e1d1c9ef4/qa; will attempt to use it 2024-09-12T02:14:20.056 INFO:teuthology.run:Found tasks at /home/teuthworker/src/git.ceph.com_ceph_086c737fa75c22d521a3932c59b31c5e1d1c9ef4/qa/tasks 2024-09-12T02:14:20.057 INFO:teuthology.run_tasks:Running task internal.check_packages... 2024-09-12T02:14:20.058 INFO:teuthology.task.internal:Checking packages... 2024-09-12T02:14:20.079 INFO:teuthology.task.internal:Checking packages for os_type 'centos', flavor 'default' and ceph hash 'b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc' 2024-09-12T02:14:20.079 WARNING:teuthology.packaging:More than one of ref, tag, branch, or sha1 supplied; using branch 2024-09-12T02:14:20.079 INFO:teuthology.packaging:ref: None 2024-09-12T02:14:20.079 INFO:teuthology.packaging:tag: None 2024-09-12T02:14:20.079 INFO:teuthology.packaging:branch: squid 2024-09-12T02:14:20.079 INFO:teuthology.packaging:sha1: b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc 2024-09-12T02:14:20.079 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F9%2Fx86_64&ref=squid 2024-09-12T02:14:20.312 INFO:teuthology.task.internal:Found packages for ceph version 19.1.1-314.g086c737f 2024-09-12T02:14:20.313 INFO:teuthology.run_tasks:Running task internal.buildpackages_prep... 2024-09-12T02:14:20.320 INFO:teuthology.task.internal:no buildpackages task found 2024-09-12T02:14:20.320 INFO:teuthology.run_tasks:Running task internal.save_config... 2024-09-12T02:14:20.328 INFO:teuthology.task.internal:Saving configuration 2024-09-12T02:14:20.348 INFO:teuthology.run_tasks:Running task internal.check_lock... 2024-09-12T02:14:20.355 INFO:teuthology.task.internal.check_lock:Checking locks... 2024-09-12T02:14:20.387 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi039.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/teuthology-2024-09-11_21:24:17-fs-squid-distro-default-smithi/7901615', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'centos', 'os_version': '9.stream', 'arch': 'x86_64', 'locked': True, 'locked_since': '2024-09-12 02:08:31.336408', 'locked_by': 'scheduled_teuthology@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBG90rotQhuSl256bbJgZm3oN9Alzr7EIjUfQtzazZ3AvCcFBevpsIgESngGKSdY5jvG1iQsOqkeIUrSgKzWqwec='} 2024-09-12T02:14:20.422 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi044.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/teuthology-2024-09-11_21:24:17-fs-squid-distro-default-smithi/7901615', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'centos', 'os_version': '9.stream', 'arch': 'x86_64', 'locked': True, 'locked_since': '2024-09-12 02:08:31.335015', 'locked_by': 'scheduled_teuthology@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBAaY1EjRS69ogQzFzEbmJv944mv5DuqjsJg5Vmlcq1zu3P7/KspVQnXftRxYVYqBSYEJSUZ4Li+IgEKWi/3ZmbY='} 2024-09-12T02:14:20.454 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi172.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/teuthology-2024-09-11_21:24:17-fs-squid-distro-default-smithi/7901615', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'centos', 'os_version': '9.stream', 'arch': 'x86_64', 'locked': True, 'locked_since': '2024-09-12 02:08:31.333411', 'locked_by': 'scheduled_teuthology@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBJEFsItE+P/AskwumlVJ8UU0dE7D8YP15t6KtUligs1rcPhoHKPzw6EckrrPEwsV7Oz29pOaTB/CTqRTDVL8FZ8='} 2024-09-12T02:14:20.454 INFO:teuthology.run_tasks:Running task internal.add_remotes... 2024-09-12T02:14:20.461 INFO:teuthology.task.internal:roles: ubuntu@smithi039.front.sepia.ceph.com - ['mon.a', 'mgr.x', 'mds.a', 'mds.d', 'mds.g', 'mds.j', 'osd.0', 'osd.3', 'osd.6', 'osd.9', 'client.0'] 2024-09-12T02:14:20.462 INFO:teuthology.task.internal:roles: ubuntu@smithi044.front.sepia.ceph.com - ['mon.b', 'mgr.y', 'mds.b', 'mds.e', 'mds.h', 'mds.k', 'osd.1', 'osd.4', 'osd.7', 'osd.10'] 2024-09-12T02:14:20.462 INFO:teuthology.task.internal:roles: ubuntu@smithi172.front.sepia.ceph.com - ['mon.c', 'mgr.z', 'mds.c', 'mds.f', 'mds.i', 'mds.l', 'osd.2', 'osd.5', 'osd.8', 'osd.11'] 2024-09-12T02:14:20.462 INFO:teuthology.run_tasks:Running task console_log... 2024-09-12T02:14:20.576 DEBUG:teuthology.exit:Installing handler: Handler(exiter=, func=.kill_console_loggers at 0x7f6a19517be0>, signals=[15]) 2024-09-12T02:14:20.576 INFO:teuthology.run_tasks:Running task internal.connect... 2024-09-12T02:14:20.583 INFO:teuthology.task.internal:Opening connections... 2024-09-12T02:14:20.583 DEBUG:teuthology.task.internal:connecting to ubuntu@smithi039.front.sepia.ceph.com 2024-09-12T02:14:20.585 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi039.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-09-12T02:14:20.673 DEBUG:teuthology.task.internal:connecting to ubuntu@smithi044.front.sepia.ceph.com 2024-09-12T02:14:20.674 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi044.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-09-12T02:14:20.755 DEBUG:teuthology.task.internal:connecting to ubuntu@smithi172.front.sepia.ceph.com 2024-09-12T02:14:20.755 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi172.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-09-12T02:14:20.839 INFO:teuthology.run_tasks:Running task internal.push_inventory... 2024-09-12T02:14:20.846 DEBUG:teuthology.orchestra.run.smithi039:> uname -m 2024-09-12T02:14:20.864 INFO:teuthology.orchestra.run.smithi039.stdout:x86_64 2024-09-12T02:14:20.864 DEBUG:teuthology.orchestra.run.smithi039:> cat /etc/os-release 2024-09-12T02:14:20.922 INFO:teuthology.orchestra.run.smithi039.stdout:NAME="CentOS Stream" 2024-09-12T02:14:20.922 INFO:teuthology.orchestra.run.smithi039.stdout:VERSION="9" 2024-09-12T02:14:20.922 INFO:teuthology.orchestra.run.smithi039.stdout:ID="centos" 2024-09-12T02:14:20.922 INFO:teuthology.orchestra.run.smithi039.stdout:ID_LIKE="rhel fedora" 2024-09-12T02:14:20.922 INFO:teuthology.orchestra.run.smithi039.stdout:VERSION_ID="9" 2024-09-12T02:14:20.922 INFO:teuthology.orchestra.run.smithi039.stdout:PLATFORM_ID="platform:el9" 2024-09-12T02:14:20.922 INFO:teuthology.orchestra.run.smithi039.stdout:PRETTY_NAME="CentOS Stream 9" 2024-09-12T02:14:20.922 INFO:teuthology.orchestra.run.smithi039.stdout:ANSI_COLOR="0;31" 2024-09-12T02:14:20.922 INFO:teuthology.orchestra.run.smithi039.stdout:LOGO="fedora-logo-icon" 2024-09-12T02:14:20.923 INFO:teuthology.orchestra.run.smithi039.stdout:CPE_NAME="cpe:/o:centos:centos:9" 2024-09-12T02:14:20.923 INFO:teuthology.orchestra.run.smithi039.stdout:HOME_URL="https://centos.org/" 2024-09-12T02:14:20.923 INFO:teuthology.orchestra.run.smithi039.stdout:BUG_REPORT_URL="https://issues.redhat.com/" 2024-09-12T02:14:20.923 INFO:teuthology.orchestra.run.smithi039.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 9" 2024-09-12T02:14:20.923 INFO:teuthology.orchestra.run.smithi039.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2024-09-12T02:14:20.923 INFO:teuthology.lock.ops:Updating smithi039.front.sepia.ceph.com on lock server 2024-09-12T02:14:20.956 DEBUG:teuthology.orchestra.run.smithi044:> uname -m 2024-09-12T02:14:20.975 INFO:teuthology.orchestra.run.smithi044.stdout:x86_64 2024-09-12T02:14:20.975 DEBUG:teuthology.orchestra.run.smithi044:> cat /etc/os-release 2024-09-12T02:14:21.033 INFO:teuthology.orchestra.run.smithi044.stdout:NAME="CentOS Stream" 2024-09-12T02:14:21.033 INFO:teuthology.orchestra.run.smithi044.stdout:VERSION="9" 2024-09-12T02:14:21.033 INFO:teuthology.orchestra.run.smithi044.stdout:ID="centos" 2024-09-12T02:14:21.033 INFO:teuthology.orchestra.run.smithi044.stdout:ID_LIKE="rhel fedora" 2024-09-12T02:14:21.033 INFO:teuthology.orchestra.run.smithi044.stdout:VERSION_ID="9" 2024-09-12T02:14:21.033 INFO:teuthology.orchestra.run.smithi044.stdout:PLATFORM_ID="platform:el9" 2024-09-12T02:14:21.033 INFO:teuthology.orchestra.run.smithi044.stdout:PRETTY_NAME="CentOS Stream 9" 2024-09-12T02:14:21.033 INFO:teuthology.orchestra.run.smithi044.stdout:ANSI_COLOR="0;31" 2024-09-12T02:14:21.034 INFO:teuthology.orchestra.run.smithi044.stdout:LOGO="fedora-logo-icon" 2024-09-12T02:14:21.034 INFO:teuthology.orchestra.run.smithi044.stdout:CPE_NAME="cpe:/o:centos:centos:9" 2024-09-12T02:14:21.034 INFO:teuthology.orchestra.run.smithi044.stdout:HOME_URL="https://centos.org/" 2024-09-12T02:14:21.034 INFO:teuthology.orchestra.run.smithi044.stdout:BUG_REPORT_URL="https://issues.redhat.com/" 2024-09-12T02:14:21.034 INFO:teuthology.orchestra.run.smithi044.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 9" 2024-09-12T02:14:21.034 INFO:teuthology.orchestra.run.smithi044.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2024-09-12T02:14:21.034 INFO:teuthology.lock.ops:Updating smithi044.front.sepia.ceph.com on lock server 2024-09-12T02:14:21.064 DEBUG:teuthology.orchestra.run.smithi172:> uname -m 2024-09-12T02:14:21.082 INFO:teuthology.orchestra.run.smithi172.stdout:x86_64 2024-09-12T02:14:21.083 DEBUG:teuthology.orchestra.run.smithi172:> cat /etc/os-release 2024-09-12T02:14:21.141 INFO:teuthology.orchestra.run.smithi172.stdout:NAME="CentOS Stream" 2024-09-12T02:14:21.141 INFO:teuthology.orchestra.run.smithi172.stdout:VERSION="9" 2024-09-12T02:14:21.141 INFO:teuthology.orchestra.run.smithi172.stdout:ID="centos" 2024-09-12T02:14:21.141 INFO:teuthology.orchestra.run.smithi172.stdout:ID_LIKE="rhel fedora" 2024-09-12T02:14:21.141 INFO:teuthology.orchestra.run.smithi172.stdout:VERSION_ID="9" 2024-09-12T02:14:21.141 INFO:teuthology.orchestra.run.smithi172.stdout:PLATFORM_ID="platform:el9" 2024-09-12T02:14:21.141 INFO:teuthology.orchestra.run.smithi172.stdout:PRETTY_NAME="CentOS Stream 9" 2024-09-12T02:14:21.141 INFO:teuthology.orchestra.run.smithi172.stdout:ANSI_COLOR="0;31" 2024-09-12T02:14:21.141 INFO:teuthology.orchestra.run.smithi172.stdout:LOGO="fedora-logo-icon" 2024-09-12T02:14:21.142 INFO:teuthology.orchestra.run.smithi172.stdout:CPE_NAME="cpe:/o:centos:centos:9" 2024-09-12T02:14:21.142 INFO:teuthology.orchestra.run.smithi172.stdout:HOME_URL="https://centos.org/" 2024-09-12T02:14:21.142 INFO:teuthology.orchestra.run.smithi172.stdout:BUG_REPORT_URL="https://issues.redhat.com/" 2024-09-12T02:14:21.142 INFO:teuthology.orchestra.run.smithi172.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 9" 2024-09-12T02:14:21.142 INFO:teuthology.orchestra.run.smithi172.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2024-09-12T02:14:21.142 INFO:teuthology.lock.ops:Updating smithi172.front.sepia.ceph.com on lock server 2024-09-12T02:14:21.172 INFO:teuthology.run_tasks:Running task internal.serialize_remote_roles... 2024-09-12T02:14:21.182 INFO:teuthology.run_tasks:Running task internal.check_conflict... 2024-09-12T02:14:21.188 INFO:teuthology.task.internal:Checking for old test directory... 2024-09-12T02:14:21.188 DEBUG:teuthology.orchestra.run.smithi039:> test '!' -e /home/ubuntu/cephtest 2024-09-12T02:14:21.191 DEBUG:teuthology.orchestra.run.smithi044:> test '!' -e /home/ubuntu/cephtest 2024-09-12T02:14:21.194 DEBUG:teuthology.orchestra.run.smithi172:> test '!' -e /home/ubuntu/cephtest 2024-09-12T02:14:21.211 INFO:teuthology.run_tasks:Running task internal.check_ceph_data... 2024-09-12T02:14:21.218 INFO:teuthology.task.internal:Checking for non-empty /var/lib/ceph... 2024-09-12T02:14:21.218 DEBUG:teuthology.orchestra.run.smithi039:> test -z $(ls -A /var/lib/ceph) 2024-09-12T02:14:21.248 DEBUG:teuthology.orchestra.run.smithi044:> test -z $(ls -A /var/lib/ceph) 2024-09-12T02:14:21.250 DEBUG:teuthology.orchestra.run.smithi172:> test -z $(ls -A /var/lib/ceph) 2024-09-12T02:14:21.351 INFO:teuthology.run_tasks:Running task internal.vm_setup... 2024-09-12T02:14:21.462 INFO:teuthology.run_tasks:Running task kernel... 2024-09-12T02:14:21.480 INFO:teuthology.task.kernel:normalize config orig: {'client': {'branch': 'testing'}, 'kdb': 1, 'sha1': 'distro'} 2024-09-12T02:14:21.481 INFO:teuthology.task.kernel:normalize config final: {'client.0': {'branch': 'testing'}} 2024-09-12T02:14:21.481 INFO:teuthology.task.kernel:config {'client.0': {'branch': 'testing'}}, timeout 300 2024-09-12T02:14:21.481 DEBUG:teuthology.orchestra.run.smithi039:> test -f /run/.containerenv -o -f /.dockerenv 2024-09-12T02:14:21.498 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-12T02:14:21.498 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=kernel&flavor=default&distros=centos%2F9%2Fx86_64&ref=testing 2024-09-12T02:14:21.688 DEBUG:teuthology.task.kernel:sha1 for client.0 is 2ca44a2f35ca8f36983aaaa46d49312239ef519a 2024-09-12T02:14:21.688 INFO:teuthology.task.kernel:Checking kernel version of client.0, want "2ca44a2f35ca8f36983aaaa46d49312239ef519a"... 2024-09-12T02:14:21.688 DEBUG:teuthology.orchestra.run.smithi039:> uname -r 2024-09-12T02:14:21.706 INFO:teuthology.orchestra.run.smithi039.stdout:5.14.0-503.el9.x86_64 2024-09-12T02:14:21.706 DEBUG:teuthology.task.kernel:current kernel version is 5.14.0-503.el9.x86_64 vs 2ca44a2f35ca8f36983aaaa46d49312239ef519a 2024-09-12T02:14:21.706 DEBUG:teuthology.task.kernel:failed to parse current kernel version 2024-09-12T02:14:21.707 DEBUG:teuthology.orchestra.run.smithi039:> sudo yum upgrade -y linux-firmware 2024-09-12T02:14:26.065 INFO:teuthology.orchestra.run.smithi039.stdout:CentOS Stream 9 - BaseOS 3.2 MB/s | 8.2 MB 00:02 2024-09-12T02:14:30.133 INFO:teuthology.orchestra.run.smithi039.stdout:CentOS Stream 9 - AppStream 7.1 MB/s | 20 MB 00:02 2024-09-12T02:14:36.516 INFO:teuthology.orchestra.run.smithi039.stdout:CentOS Stream 9 - CRB 2.7 MB/s | 6.5 MB 00:02 2024-09-12T02:14:38.892 INFO:teuthology.orchestra.run.smithi039.stdout:CentOS Stream 9 - Extras packages 17 kB/s | 19 kB 00:01 2024-09-12T02:14:39.804 INFO:teuthology.orchestra.run.smithi039.stdout:Extra Packages for Enterprise Linux 29 MB/s | 23 MB 00:00 2024-09-12T02:14:45.520 INFO:teuthology.orchestra.run.smithi039.stdout:lab-extras 22 kB/s | 1.7 kB 00:00 2024-09-12T02:14:47.692 INFO:teuthology.orchestra.run.smithi039.stdout:Dependencies resolved. 2024-09-12T02:14:47.693 INFO:teuthology.orchestra.run.smithi039.stdout:Nothing to do. 2024-09-12T02:14:47.693 INFO:teuthology.orchestra.run.smithi039.stdout:Complete! 2024-09-12T02:14:47.803 INFO:teuthology.task.kernel:Downloading kernel 2ca44a2f35ca8f36983aaaa46d49312239ef519a on client.0... 2024-09-12T02:14:47.803 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=kernel&flavor=default&distros=centos%2F9%2Fx86_64&sha1=2ca44a2f35ca8f36983aaaa46d49312239ef519a 2024-09-12T02:14:47.965 INFO:teuthology.task.kernel:fetching, builder baseurl is https://3.chacra.ceph.com/r/kernel/testing/2ca44a2f35ca8f36983aaaa46d49312239ef519a/centos/9/flavors/default/x86_64/ 2024-09-12T02:14:47.966 DEBUG:teuthology.orchestra.run.smithi039:> rm -f /tmp/kernel.x86_64.rpm && echo kernel-6.11.0_rc5_g2ca44a2f35ca-1.x86_64.rpm | wget -nv -O /tmp/kernel.x86_64.rpm --base=https://3.chacra.ceph.com/r/kernel/testing/2ca44a2f35ca8f36983aaaa46d49312239ef519a/centos/9/flavors/default/x86_64/ --input-file=- 2024-09-12T02:14:47.968 DEBUG:teuthology.task.kernel:Waiting for download/copy to ubuntu@smithi039.front.sepia.ceph.com to complete... 2024-09-12T02:14:59.157 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12 02:14:59 URL:https://3.chacra.ceph.com/r/kernel/testing/2ca44a2f35ca8f36983aaaa46d49312239ef519a/centos/9/flavors/default/x86_64/kernel-6.11.0_rc5_g2ca44a2f35ca-1.x86_64.rpm [359633503/359633503] -> "/tmp/kernel.x86_64.rpm" [1] 2024-09-12T02:14:59.157 INFO:teuthology.orchestra.run.smithi039.stderr:FINISHED --2024-09-12 02:14:59-- 2024-09-12T02:14:59.157 INFO:teuthology.orchestra.run.smithi039.stderr:Total wall clock time: 11s 2024-09-12T02:14:59.157 INFO:teuthology.orchestra.run.smithi039.stderr:Downloaded: 1 files, 343M in 11s (31.6 MB/s) 2024-09-12T02:14:59.161 INFO:teuthology.task.kernel:Installing kernel 2ca44a2f35ca8f36983aaaa46d49312239ef519a on client.0... 2024-09-12T02:14:59.161 DEBUG:teuthology.orchestra.run.smithi039:> sudo rpm -ivh --oldpackage --replacefiles --replacepkgs /tmp/kernel.x86_64.rpm 2024-09-12T02:15:01.371 INFO:teuthology.orchestra.run.smithi039.stdout:Verifying... ######################################## 2024-09-12T02:15:01.530 INFO:teuthology.orchestra.run.smithi039.stdout:Preparing... ######################################## 2024-09-12T02:15:01.663 INFO:teuthology.orchestra.run.smithi039.stdout:Updating / installing... 2024-09-12T02:15:09.971 INFO:teuthology.orchestra.run.smithi039.stdout:kernel-6.11.0_rc5_g2ca44a2f35ca-1 ######################################## 2024-09-12T02:15:50.536 DEBUG:teuthology.task.kernel:install_kernel(remote=ubuntu@smithi039.front.sepia.ceph.com, path=/tmp/kernel.x86_64.rpm, version=None) 2024-09-12T02:15:50.536 DEBUG:teuthology.orchestra.run.smithi039:> rpm -qlp /tmp/kernel.x86_64.rpm 2024-09-12T02:15:50.633 INFO:teuthology.orchestra.run.smithi039.stdout:/boot/System.map-6.11.0-rc5-g2ca44a2f35ca 2024-09-12T02:15:50.633 INFO:teuthology.orchestra.run.smithi039.stdout:/boot/config-6.11.0-rc5-g2ca44a2f35ca 2024-09-12T02:15:50.634 INFO:teuthology.orchestra.run.smithi039.stdout:/boot/vmlinuz-6.11.0-rc5-g2ca44a2f35ca 2024-09-12T02:15:50.634 INFO:teuthology.orchestra.run.smithi039.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca 2024-09-12T02:15:50.634 INFO:teuthology.orchestra.run.smithi039.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/System.map 2024-09-12T02:15:50.634 INFO:teuthology.orchestra.run.smithi039.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/config 2024-09-12T02:15:50.634 INFO:teuthology.orchestra.run.smithi039.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel 2024-09-12T02:15:50.634 INFO:teuthology.orchestra.run.smithi039.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/arch 2024-09-12T02:15:50.634 INFO:teuthology.orchestra.run.smithi039.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/arch/x86 2024-09-12T02:15:50.634 INFO:teuthology.orchestra.run.smithi039.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/arch/x86/crypto 2024-09-12T02:15:50.634 INFO:teuthology.orchestra.run.smithi039.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/arch/x86/crypto/blowfish-x86_64.ko 2024-09-12T02:15:50.634 INFO:teuthology.orchestra.run.smithi039.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/arch/x86/crypto/camellia-aesni-avx-x86_64.ko 2024-09-12T02:15:50.634 INFO:teuthology.orchestra.run.smithi039.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/arch/x86/crypto/camellia-aesni-avx2.ko 2024-09-12T02:15:50.634 INFO:teuthology.orchestra.run.smithi039.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/arch/x86/crypto/camellia-x86_64.ko 2024-09-12T02:15:50.635 INFO:teuthology.orchestra.run.smithi039.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/arch/x86/crypto/cast5-avx-x86_64.ko 2024-09-12T02:15:50.635 INFO:teuthology.orchestra.run.smithi039.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/arch/x86/crypto/cast6-avx-x86_64.ko 2024-09-12T02:15:50.635 INFO:teuthology.orchestra.run.smithi039.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/arch/x86/crypto/crc32-pclmul.ko 2024-09-12T02:15:50.635 INFO:teuthology.orchestra.run.smithi039.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/arch/x86/crypto/crc32c-intel.ko 2024-09-12T02:15:50.635 INFO:teuthology.orchestra.run.smithi039.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/arch/x86/crypto/crct10dif-pclmul.ko 2024-09-12T02:15:50.635 INFO:teuthology.orchestra.run.smithi039.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/arch/x86/crypto/des3_ede-x86_64.ko 2024-09-12T02:15:50.635 INFO:teuthology.orchestra.run.smithi039.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/arch/x86/crypto/ghash-clmulni-intel.ko 2024-09-12T02:15:50.635 INFO:teuthology.orchestra.run.smithi039.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/arch/x86/crypto/serpent-avx-x86_64.ko 2024-09-12T02:15:50.635 INFO:teuthology.orchestra.run.smithi039.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/arch/x86/crypto/serpent-avx2.ko 2024-09-12T02:15:50.635 INFO:teuthology.orchestra.run.smithi039.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/arch/x86/crypto/serpent-sse2-x86_64.ko 2024-09-12T02:15:50.635 INFO:teuthology.orchestra.run.smithi039.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/arch/x86/crypto/sha1-ssse3.ko 2024-09-12T02:15:50.635 INFO:teuthology.orchestra.run.smithi039.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/arch/x86/crypto/sha256-ssse3.ko 2024-09-12T02:15:50.635 INFO:teuthology.orchestra.run.smithi039.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/arch/x86/crypto/sha512-ssse3.ko 2024-09-12T02:15:50.635 INFO:teuthology.orchestra.run.smithi039.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/arch/x86/crypto/twofish-avx-x86_64.ko 2024-09-12T02:15:50.636 INFO:teuthology.orchestra.run.smithi039.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/arch/x86/crypto/twofish-x86_64-3way.ko 2024-09-12T02:15:50.636 INFO:teuthology.orchestra.run.smithi039.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/arch/x86/crypto/twofish-x86_64.ko 2024-09-12T02:15:50.636 INFO:teuthology.orchestra.run.smithi039.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/arch/x86/kernel 2024-09-12T02:15:50.636 INFO:teuthology.orchestra.run.smithi039.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/arch/x86/kernel/cpu 2024-09-12T02:15:50.636 INFO:teuthology.orchestra.run.smithi039.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/arch/x86/kernel/cpu/mce 2024-09-12T02:15:50.636 INFO:teuthology.orchestra.run.smithi039.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/arch/x86/kernel/cpu/mce/mce-inject.ko 2024-09-12T02:15:50.636 INFO:teuthology.orchestra.run.smithi039.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/arch/x86/kvm 2024-09-12T02:15:50.636 INFO:teuthology.orchestra.run.smithi039.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/arch/x86/kvm/kvm-amd.ko 2024-09-12T02:15:50.636 INFO:teuthology.orchestra.run.smithi039.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/arch/x86/kvm/kvm-intel.ko 2024-09-12T02:15:50.636 INFO:teuthology.orchestra.run.smithi039.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/arch/x86/kvm/kvm.ko 2024-09-12T02:15:50.636 INFO:teuthology.orchestra.run.smithi039.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto 2024-09-12T02:15:50.637 INFO:teuthology.orchestra.run.smithi039.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/ansi_cprng.ko 2024-09-12T02:15:50.637 INFO:teuthology.orchestra.run.smithi039.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/anubis.ko 2024-09-12T02:15:50.637 INFO:teuthology.orchestra.run.smithi039.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/arc4.ko 2024-09-12T02:15:50.637 INFO:teuthology.orchestra.run.smithi039.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/async_tx 2024-09-12T02:15:50.637 INFO:teuthology.orchestra.run.smithi039.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/async_tx/async_memcpy.ko 2024-09-12T02:15:50.637 INFO:teuthology.orchestra.run.smithi039.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/async_tx/async_pq.ko 2024-09-12T02:15:50.637 INFO:teuthology.orchestra.run.smithi039.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/async_tx/async_raid6_recov.ko 2024-09-12T02:15:50.637 INFO:teuthology.orchestra.run.smithi039.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/async_tx/async_tx.ko 2024-09-12T02:15:50.637 INFO:teuthology.orchestra.run.smithi039.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/async_tx/async_xor.ko 2024-09-12T02:15:50.637 INFO:teuthology.orchestra.run.smithi039.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/async_tx/raid6test.ko 2024-09-12T02:15:50.637 INFO:teuthology.orchestra.run.smithi039.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/authenc.ko 2024-09-12T02:15:50.638 INFO:teuthology.orchestra.run.smithi039.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/authencesn.ko 2024-09-12T02:15:50.638 INFO:teuthology.orchestra.run.smithi039.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/blake2b_generic.ko 2024-09-12T02:15:50.638 INFO:teuthology.orchestra.run.smithi039.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/blowfish_common.ko 2024-09-12T02:15:50.638 INFO:teuthology.orchestra.run.smithi039.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/blowfish_generic.ko 2024-09-12T02:15:50.638 INFO:teuthology.orchestra.run.smithi039.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/camellia_generic.ko 2024-09-12T02:15:50.638 INFO:teuthology.orchestra.run.smithi039.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/cast5_generic.ko 2024-09-12T02:15:50.638 INFO:teuthology.orchestra.run.smithi039.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/cast6_generic.ko 2024-09-12T02:15:50.638 INFO:teuthology.orchestra.run.smithi039.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/cast_common.ko 2024-09-12T02:15:50.638 INFO:teuthology.orchestra.run.smithi039.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/ccm.ko 2024-09-12T02:15:50.638 INFO:teuthology.orchestra.run.smithi039.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/cmac.ko 2024-09-12T02:15:50.638 INFO:teuthology.orchestra.run.smithi039.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/crc32_generic.ko 2024-09-12T02:15:50.638 INFO:teuthology.orchestra.run.smithi039.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/crypto_engine.ko 2024-09-12T02:15:50.638 INFO:teuthology.orchestra.run.smithi039.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/crypto_user.ko 2024-09-12T02:15:50.639 INFO:teuthology.orchestra.run.smithi039.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/cts.ko 2024-09-12T02:15:50.639 INFO:teuthology.orchestra.run.smithi039.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/des_generic.ko 2024-09-12T02:15:50.639 INFO:teuthology.orchestra.run.smithi039.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/dh_generic.ko 2024-09-12T02:15:50.639 INFO:teuthology.orchestra.run.smithi039.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/ecc.ko 2024-09-12T02:15:50.639 INFO:teuthology.orchestra.run.smithi039.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/ecdh_generic.ko 2024-09-12T02:15:50.639 INFO:teuthology.orchestra.run.smithi039.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/echainiv.ko 2024-09-12T02:15:50.639 INFO:teuthology.orchestra.run.smithi039.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/essiv.ko 2024-09-12T02:15:50.639 INFO:teuthology.orchestra.run.smithi039.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/fcrypt.ko 2024-09-12T02:15:50.640 INFO:teuthology.orchestra.run.smithi039.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/khazad.ko 2024-09-12T02:15:50.640 INFO:teuthology.orchestra.run.smithi039.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/lz4.ko 2024-09-12T02:15:50.640 INFO:teuthology.orchestra.run.smithi039.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/lz4hc.ko 2024-09-12T02:15:50.640 INFO:teuthology.orchestra.run.smithi039.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/md4.ko 2024-09-12T02:15:50.640 INFO:teuthology.orchestra.run.smithi039.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/michael_mic.ko 2024-09-12T02:15:50.640 INFO:teuthology.orchestra.run.smithi039.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/pcbc.ko 2024-09-12T02:15:50.640 INFO:teuthology.orchestra.run.smithi039.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/pcrypt.ko 2024-09-12T02:15:50.640 INFO:teuthology.orchestra.run.smithi039.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/rmd160.ko 2024-09-12T02:15:50.640 INFO:teuthology.orchestra.run.smithi039.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/seed.ko 2024-09-12T02:15:50.640 INFO:teuthology.orchestra.run.smithi039.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/serpent_generic.ko 2024-09-12T02:15:50.640 INFO:teuthology.orchestra.run.smithi039.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/tcrypt.ko 2024-09-12T02:15:50.640 INFO:teuthology.orchestra.run.smithi039.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/tea.ko 2024-09-12T02:15:50.641 INFO:teuthology.orchestra.run.smithi039.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/twofish_common.ko 2024-09-12T02:15:50.641 INFO:teuthology.orchestra.run.smithi039.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/twofish_generic.ko 2024-09-12T02:15:50.641 INFO:teuthology.orchestra.run.smithi039.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/vmac.ko 2024-09-12T02:15:50.641 INFO:teuthology.orchestra.run.smithi039.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/wp512.ko 2024-09-12T02:15:50.641 INFO:teuthology.orchestra.run.smithi039.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/xcbc.ko 2024-09-12T02:15:50.641 INFO:teuthology.orchestra.run.smithi039.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/xor.ko 2024-09-12T02:15:50.641 INFO:teuthology.orchestra.run.smithi039.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/xxhash_generic.ko 2024-09-12T02:15:50.641 INFO:teuthology.orchestra.run.smithi039.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers 2024-09-12T02:15:50.641 INFO:teuthology.orchestra.run.smithi039.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/acpi 2024-09-12T02:15:50.641 INFO:teuthology.orchestra.run.smithi039.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/acpi/acpi_ipmi.ko 2024-09-12T02:15:50.641 INFO:teuthology.orchestra.run.smithi039.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/acpi/acpi_pad.ko 2024-09-12T02:15:50.641 INFO:teuthology.orchestra.run.smithi039.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/acpi/ec_sys.ko 2024-09-12T02:15:50.641 INFO:teuthology.orchestra.run.smithi039.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/acpi/platform_profile.ko 2024-09-12T02:15:50.642 INFO:teuthology.orchestra.run.smithi039.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/acpi/sbs.ko 2024-09-12T02:15:50.642 INFO:teuthology.orchestra.run.smithi039.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/acpi/sbshc.ko 2024-09-12T02:15:50.642 INFO:teuthology.orchestra.run.smithi039.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/acpi/video.ko 2024-09-12T02:15:50.642 INFO:teuthology.orchestra.run.smithi039.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata 2024-09-12T02:15:50.642 INFO:teuthology.orchestra.run.smithi039.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/acard-ahci.ko 2024-09-12T02:15:50.642 INFO:teuthology.orchestra.run.smithi039.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/ahci_platform.ko 2024-09-12T02:15:50.642 INFO:teuthology.orchestra.run.smithi039.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/ata_generic.ko 2024-09-12T02:15:50.642 INFO:teuthology.orchestra.run.smithi039.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/libahci_platform.ko 2024-09-12T02:15:50.642 INFO:teuthology.orchestra.run.smithi039.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/pata_acpi.ko 2024-09-12T02:15:50.642 INFO:teuthology.orchestra.run.smithi039.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/pata_ali.ko 2024-09-12T02:15:50.642 INFO:teuthology.orchestra.run.smithi039.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/pata_amd.ko 2024-09-12T02:15:50.642 INFO:teuthology.orchestra.run.smithi039.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/pata_artop.ko 2024-09-12T02:15:50.642 INFO:teuthology.orchestra.run.smithi039.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/pata_atiixp.ko 2024-09-12T02:15:50.642 INFO:teuthology.orchestra.run.smithi039.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/pata_atp867x.ko 2024-09-12T02:15:50.643 INFO:teuthology.orchestra.run.smithi039.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/pata_cmd640.ko 2024-09-12T02:15:50.643 INFO:teuthology.orchestra.run.smithi039.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/pata_cmd64x.ko 2024-09-12T02:15:50.643 INFO:teuthology.orchestra.run.smithi039.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/pata_cypress.ko 2024-09-12T02:15:50.643 INFO:teuthology.orchestra.run.smithi039.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/pata_efar.ko 2024-09-12T02:15:50.643 INFO:teuthology.orchestra.run.smithi039.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/pata_hpt366.ko 2024-09-12T02:15:50.643 INFO:teuthology.orchestra.run.smithi039.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/pata_hpt37x.ko 2024-09-12T02:15:50.643 INFO:teuthology.orchestra.run.smithi039.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/pata_hpt3x2n.ko 2024-09-12T02:15:50.643 INFO:teuthology.orchestra.run.smithi039.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/pata_hpt3x3.ko 2024-09-12T02:15:50.643 INFO:teuthology.orchestra.run.smithi039.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/pata_it8213.ko 2024-09-12T02:15:50.643 INFO:teuthology.orchestra.run.smithi039.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/pata_it821x.ko 2024-09-12T02:15:50.643 INFO:teuthology.orchestra.run.smithi039.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/pata_jmicron.ko 2024-09-12T02:15:50.643 INFO:teuthology.orchestra.run.smithi039.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/pata_marvell.ko 2024-09-12T02:15:50.643 INFO:teuthology.orchestra.run.smithi039.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/pata_mpiix.ko 2024-09-12T02:15:50.644 INFO:teuthology.orchestra.run.smithi039.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/pata_netcell.ko 2024-09-12T02:15:50.644 INFO:teuthology.orchestra.run.smithi039.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/pata_ninja32.ko 2024-09-12T02:15:50.644 INFO:teuthology.orchestra.run.smithi039.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/pata_ns87410.ko 2024-09-12T02:15:50.644 INFO:teuthology.orchestra.run.smithi039.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/pata_ns87415.ko 2024-09-12T02:15:50.644 INFO:teuthology.orchestra.run.smithi039.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/pata_oldpiix.ko 2024-09-12T02:15:50.644 INFO:teuthology.orchestra.run.smithi039.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/pata_opti.ko 2024-09-12T02:15:50.644 INFO:teuthology.orchestra.run.smithi039.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/pata_optidma.ko 2024-09-12T02:15:50.644 INFO:teuthology.orchestra.run.smithi039.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/pata_pcmcia.ko 2024-09-12T02:15:50.644 INFO:teuthology.orchestra.run.smithi039.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/pata_pdc2027x.ko 2024-09-12T02:15:50.644 INFO:teuthology.orchestra.run.smithi039.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/pata_pdc202xx_old.ko 2024-09-12T02:15:50.644 INFO:teuthology.orchestra.run.smithi039.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/pata_piccolo.ko 2024-09-12T02:15:50.644 INFO:teuthology.orchestra.run.smithi039.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/pata_rdc.ko 2024-09-12T02:15:50.644 INFO:teuthology.orchestra.run.smithi039.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/pata_sch.ko 2024-09-12T02:15:50.645 INFO:teuthology.orchestra.run.smithi039.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/pata_serverworks.ko 2024-09-12T02:15:50.645 INFO:teuthology.orchestra.run.smithi039.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/pata_sil680.ko 2024-09-12T02:15:50.645 INFO:teuthology.orchestra.run.smithi039.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/pata_sis.ko 2024-09-12T02:15:50.645 INFO:teuthology.orchestra.run.smithi039.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/pata_sl82c105.ko 2024-09-12T02:15:50.645 INFO:teuthology.orchestra.run.smithi039.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/pata_triflex.ko 2024-09-12T02:15:50.645 INFO:teuthology.orchestra.run.smithi039.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/pata_via.ko 2024-09-12T02:15:50.645 INFO:teuthology.orchestra.run.smithi039.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/pdc_adma.ko 2024-09-12T02:15:50.645 INFO:teuthology.orchestra.run.smithi039.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/sata_inic162x.ko 2024-09-12T02:15:50.645 INFO:teuthology.orchestra.run.smithi039.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/sata_mv.ko 2024-09-12T02:15:50.645 INFO:teuthology.orchestra.run.smithi039.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/sata_nv.ko 2024-09-12T02:15:50.646 INFO:teuthology.orchestra.run.smithi039.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/sata_promise.ko 2024-09-12T02:15:50.646 INFO:teuthology.orchestra.run.smithi039.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/sata_qstor.ko 2024-09-12T02:15:50.646 INFO:teuthology.orchestra.run.smithi039.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/sata_sil.ko 2024-09-12T02:15:50.646 INFO:teuthology.orchestra.run.smithi039.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/sata_sil24.ko 2024-09-12T02:15:50.646 INFO:teuthology.orchestra.run.smithi039.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/sata_sis.ko 2024-09-12T02:15:50.646 INFO:teuthology.orchestra.run.smithi039.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/sata_svw.ko 2024-09-12T02:15:50.646 INFO:teuthology.orchestra.run.smithi039.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/sata_sx4.ko 2024-09-12T02:15:50.646 INFO:teuthology.orchestra.run.smithi039.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/sata_uli.ko 2024-09-12T02:15:50.646 INFO:teuthology.orchestra.run.smithi039.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/sata_via.ko 2024-09-12T02:15:50.646 INFO:teuthology.orchestra.run.smithi039.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/sata_vsc.ko 2024-09-12T02:15:50.646 INFO:teuthology.orchestra.run.smithi039.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/auxdisplay 2024-09-12T02:15:50.646 INFO:teuthology.orchestra.run.smithi039.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/auxdisplay/ks0108.ko 2024-09-12T02:15:50.646 INFO:teuthology.orchestra.run.smithi039.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/base 2024-09-12T02:15:50.647 INFO:teuthology.orchestra.run.smithi039.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/base/regmap 2024-09-12T02:15:50.647 INFO:teuthology.orchestra.run.smithi039.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/base/regmap/regmap-i2c.ko 2024-09-12T02:15:50.647 INFO:teuthology.orchestra.run.smithi039.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/base/regmap/regmap-mmio.ko 2024-09-12T02:15:50.647 INFO:teuthology.orchestra.run.smithi039.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/bcma 2024-09-12T02:15:50.647 INFO:teuthology.orchestra.run.smithi039.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/bcma/bcma.ko 2024-09-12T02:15:50.647 INFO:teuthology.orchestra.run.smithi039.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/block 2024-09-12T02:15:50.647 INFO:teuthology.orchestra.run.smithi039.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/block/aoe 2024-09-12T02:15:50.647 INFO:teuthology.orchestra.run.smithi039.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/block/aoe/aoe.ko 2024-09-12T02:15:50.647 INFO:teuthology.orchestra.run.smithi039.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/block/brd.ko 2024-09-12T02:15:50.647 INFO:teuthology.orchestra.run.smithi039.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/block/drbd 2024-09-12T02:15:50.647 INFO:teuthology.orchestra.run.smithi039.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/block/drbd/drbd.ko 2024-09-12T02:15:50.647 INFO:teuthology.orchestra.run.smithi039.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/block/floppy.ko 2024-09-12T02:15:50.647 INFO:teuthology.orchestra.run.smithi039.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/block/loop.ko 2024-09-12T02:15:50.648 INFO:teuthology.orchestra.run.smithi039.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/block/mtip32xx 2024-09-12T02:15:50.648 INFO:teuthology.orchestra.run.smithi039.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/block/mtip32xx/mtip32xx.ko 2024-09-12T02:15:50.648 INFO:teuthology.orchestra.run.smithi039.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/block/nbd.ko 2024-09-12T02:15:50.648 INFO:teuthology.orchestra.run.smithi039.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/block/null_blk 2024-09-12T02:15:50.648 INFO:teuthology.orchestra.run.smithi039.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/block/null_blk/null_blk.ko 2024-09-12T02:15:50.648 INFO:teuthology.orchestra.run.smithi039.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/block/pktcdvd.ko 2024-09-12T02:15:50.648 INFO:teuthology.orchestra.run.smithi039.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/block/rbd.ko 2024-09-12T02:15:50.648 INFO:teuthology.orchestra.run.smithi039.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/block/virtio_blk.ko 2024-09-12T02:15:50.648 INFO:teuthology.orchestra.run.smithi039.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/block/xen-blkback 2024-09-12T02:15:50.648 INFO:teuthology.orchestra.run.smithi039.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/block/xen-blkback/xen-blkback.ko 2024-09-12T02:15:50.648 INFO:teuthology.orchestra.run.smithi039.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/block/xen-blkfront.ko 2024-09-12T02:15:50.648 INFO:teuthology.orchestra.run.smithi039.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/block/zram 2024-09-12T02:15:50.648 INFO:teuthology.orchestra.run.smithi039.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/block/zram/zram.ko 2024-09-12T02:15:50.648 INFO:teuthology.orchestra.run.smithi039.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/char 2024-09-12T02:15:50.649 INFO:teuthology.orchestra.run.smithi039.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/char/hangcheck-timer.ko 2024-09-12T02:15:50.649 INFO:teuthology.orchestra.run.smithi039.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/char/hw_random 2024-09-12T02:15:50.649 INFO:teuthology.orchestra.run.smithi039.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/char/hw_random/amd-rng.ko 2024-09-12T02:15:50.649 INFO:teuthology.orchestra.run.smithi039.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/char/hw_random/intel-rng.ko 2024-09-12T02:15:50.649 INFO:teuthology.orchestra.run.smithi039.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/char/hw_random/timeriomem-rng.ko 2024-09-12T02:15:50.649 INFO:teuthology.orchestra.run.smithi039.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/char/hw_random/via-rng.ko 2024-09-12T02:15:50.649 INFO:teuthology.orchestra.run.smithi039.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/char/hw_random/virtio-rng.ko 2024-09-12T02:15:50.649 INFO:teuthology.orchestra.run.smithi039.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/char/ipmi 2024-09-12T02:15:50.649 INFO:teuthology.orchestra.run.smithi039.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/char/ipmi/ipmi_devintf.ko 2024-09-12T02:15:50.649 INFO:teuthology.orchestra.run.smithi039.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/char/ipmi/ipmi_msghandler.ko 2024-09-12T02:15:50.649 INFO:teuthology.orchestra.run.smithi039.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/char/ipmi/ipmi_poweroff.ko 2024-09-12T02:15:50.649 INFO:teuthology.orchestra.run.smithi039.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/char/ipmi/ipmi_si.ko 2024-09-12T02:15:50.649 INFO:teuthology.orchestra.run.smithi039.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/char/ipmi/ipmi_ssif.ko 2024-09-12T02:15:50.649 INFO:teuthology.orchestra.run.smithi039.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/char/ipmi/ipmi_watchdog.ko 2024-09-12T02:15:50.650 INFO:teuthology.orchestra.run.smithi039.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/char/lp.ko 2024-09-12T02:15:50.650 INFO:teuthology.orchestra.run.smithi039.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/char/mwave 2024-09-12T02:15:50.650 INFO:teuthology.orchestra.run.smithi039.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/char/mwave/mwave.ko 2024-09-12T02:15:50.650 INFO:teuthology.orchestra.run.smithi039.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/char/ppdev.ko 2024-09-12T02:15:50.650 INFO:teuthology.orchestra.run.smithi039.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/char/tlclk.ko 2024-09-12T02:15:50.650 INFO:teuthology.orchestra.run.smithi039.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/char/tpm 2024-09-12T02:15:50.650 INFO:teuthology.orchestra.run.smithi039.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/char/tpm/tpm.ko 2024-09-12T02:15:50.650 INFO:teuthology.orchestra.run.smithi039.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/char/tpm/tpm_atmel.ko 2024-09-12T02:15:50.650 INFO:teuthology.orchestra.run.smithi039.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/char/tpm/tpm_infineon.ko 2024-09-12T02:15:50.650 INFO:teuthology.orchestra.run.smithi039.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/char/tpm/tpm_nsc.ko 2024-09-12T02:15:50.650 INFO:teuthology.orchestra.run.smithi039.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/char/tpm/tpm_tis.ko 2024-09-12T02:15:50.650 INFO:teuthology.orchestra.run.smithi039.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/char/tpm/tpm_tis_core.ko 2024-09-12T02:15:50.650 INFO:teuthology.orchestra.run.smithi039.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/char/uv_mmtimer.ko 2024-09-12T02:15:50.651 INFO:teuthology.orchestra.run.smithi039.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/char/virtio_console.ko 2024-09-12T02:15:50.651 INFO:teuthology.orchestra.run.smithi039.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/cpufreq 2024-09-12T02:15:50.651 INFO:teuthology.orchestra.run.smithi039.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/cpufreq/acpi-cpufreq.ko 2024-09-12T02:15:50.651 INFO:teuthology.orchestra.run.smithi039.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/cpufreq/amd_freq_sensitivity.ko 2024-09-12T02:15:50.651 INFO:teuthology.orchestra.run.smithi039.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/cpufreq/p4-clockmod.ko 2024-09-12T02:15:50.651 INFO:teuthology.orchestra.run.smithi039.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/cpufreq/pcc-cpufreq.ko 2024-09-12T02:15:50.651 INFO:teuthology.orchestra.run.smithi039.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/cpufreq/powernow-k8.ko 2024-09-12T02:15:50.651 INFO:teuthology.orchestra.run.smithi039.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/cpufreq/speedstep-lib.ko 2024-09-12T02:15:50.651 INFO:teuthology.orchestra.run.smithi039.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/crypto 2024-09-12T02:15:50.651 INFO:teuthology.orchestra.run.smithi039.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/crypto/ccp 2024-09-12T02:15:50.651 INFO:teuthology.orchestra.run.smithi039.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/crypto/ccp/ccp-crypto.ko 2024-09-12T02:15:50.652 INFO:teuthology.orchestra.run.smithi039.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/crypto/ccp/ccp.ko 2024-09-12T02:15:50.652 INFO:teuthology.orchestra.run.smithi039.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/crypto/intel 2024-09-12T02:15:50.652 INFO:teuthology.orchestra.run.smithi039.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/crypto/intel/qat 2024-09-12T02:15:50.652 INFO:teuthology.orchestra.run.smithi039.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/crypto/intel/qat/qat_common 2024-09-12T02:15:50.652 INFO:teuthology.orchestra.run.smithi039.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/crypto/intel/qat/qat_common/intel_qat.ko 2024-09-12T02:15:50.652 INFO:teuthology.orchestra.run.smithi039.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/crypto/intel/qat/qat_dh895xcc 2024-09-12T02:15:50.652 INFO:teuthology.orchestra.run.smithi039.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/crypto/intel/qat/qat_dh895xcc/qat_dh895xcc.ko 2024-09-12T02:15:50.652 INFO:teuthology.orchestra.run.smithi039.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/crypto/padlock-aes.ko 2024-09-12T02:15:50.652 INFO:teuthology.orchestra.run.smithi039.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/crypto/padlock-sha.ko 2024-09-12T02:15:50.652 INFO:teuthology.orchestra.run.smithi039.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/crypto/virtio 2024-09-12T02:15:50.652 INFO:teuthology.orchestra.run.smithi039.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/crypto/virtio/virtio_crypto.ko 2024-09-12T02:15:50.652 INFO:teuthology.orchestra.run.smithi039.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/dca 2024-09-12T02:15:50.652 INFO:teuthology.orchestra.run.smithi039.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/dca/dca.ko 2024-09-12T02:15:50.653 INFO:teuthology.orchestra.run.smithi039.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/devfreq 2024-09-12T02:15:50.653 INFO:teuthology.orchestra.run.smithi039.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/devfreq/governor_simpleondemand.ko 2024-09-12T02:15:50.653 INFO:teuthology.orchestra.run.smithi039.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/dma 2024-09-12T02:15:50.653 INFO:teuthology.orchestra.run.smithi039.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/dma/dw 2024-09-12T02:15:50.653 INFO:teuthology.orchestra.run.smithi039.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/dma/dw/dw_dmac.ko 2024-09-12T02:15:50.653 INFO:teuthology.orchestra.run.smithi039.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/dma/ioat 2024-09-12T02:15:50.653 INFO:teuthology.orchestra.run.smithi039.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/dma/ioat/ioatdma.ko 2024-09-12T02:15:50.653 INFO:teuthology.orchestra.run.smithi039.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/edac 2024-09-12T02:15:50.653 INFO:teuthology.orchestra.run.smithi039.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/edac/amd64_edac.ko 2024-09-12T02:15:50.653 INFO:teuthology.orchestra.run.smithi039.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/edac/e752x_edac.ko 2024-09-12T02:15:50.653 INFO:teuthology.orchestra.run.smithi039.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/edac/edac_mce_amd.ko 2024-09-12T02:15:50.653 INFO:teuthology.orchestra.run.smithi039.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/edac/i3000_edac.ko 2024-09-12T02:15:50.653 INFO:teuthology.orchestra.run.smithi039.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/edac/i3200_edac.ko 2024-09-12T02:15:50.653 INFO:teuthology.orchestra.run.smithi039.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/edac/i5100_edac.ko 2024-09-12T02:15:50.654 INFO:teuthology.orchestra.run.smithi039.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/edac/i5400_edac.ko 2024-09-12T02:15:50.654 INFO:teuthology.orchestra.run.smithi039.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/edac/i7300_edac.ko 2024-09-12T02:15:50.654 INFO:teuthology.orchestra.run.smithi039.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/edac/i7core_edac.ko 2024-09-12T02:15:50.654 INFO:teuthology.orchestra.run.smithi039.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/edac/i82975x_edac.ko 2024-09-12T02:15:50.654 INFO:teuthology.orchestra.run.smithi039.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/edac/ie31200_edac.ko 2024-09-12T02:15:50.654 INFO:teuthology.orchestra.run.smithi039.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/edac/sb_edac.ko 2024-09-12T02:15:50.654 INFO:teuthology.orchestra.run.smithi039.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/edac/x38_edac.ko 2024-09-12T02:15:50.654 INFO:teuthology.orchestra.run.smithi039.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/firmware 2024-09-12T02:15:50.654 INFO:teuthology.orchestra.run.smithi039.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/firmware/edd.ko 2024-09-12T02:15:50.654 INFO:teuthology.orchestra.run.smithi039.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/firmware/iscsi_ibft.ko 2024-09-12T02:15:50.654 INFO:teuthology.orchestra.run.smithi039.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/gpio 2024-09-12T02:15:50.654 INFO:teuthology.orchestra.run.smithi039.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/gpio/gpio-ich.ko 2024-09-12T02:15:50.654 INFO:teuthology.orchestra.run.smithi039.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/gpio/gpio-viperboard.ko 2024-09-12T02:15:50.655 INFO:teuthology.orchestra.run.smithi039.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid 2024-09-12T02:15:50.655 INFO:teuthology.orchestra.run.smithi039.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-appleir.ko 2024-09-12T02:15:50.655 INFO:teuthology.orchestra.run.smithi039.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-aureal.ko 2024-09-12T02:15:50.655 INFO:teuthology.orchestra.run.smithi039.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-axff.ko 2024-09-12T02:15:50.655 INFO:teuthology.orchestra.run.smithi039.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-dr.ko 2024-09-12T02:15:50.655 INFO:teuthology.orchestra.run.smithi039.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-elecom.ko 2024-09-12T02:15:50.655 INFO:teuthology.orchestra.run.smithi039.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-elo.ko 2024-09-12T02:15:50.655 INFO:teuthology.orchestra.run.smithi039.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-emsff.ko 2024-09-12T02:15:50.655 INFO:teuthology.orchestra.run.smithi039.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-gaff.ko 2024-09-12T02:15:50.655 INFO:teuthology.orchestra.run.smithi039.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-gt683r.ko 2024-09-12T02:15:50.655 INFO:teuthology.orchestra.run.smithi039.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-gyration.ko 2024-09-12T02:15:50.655 INFO:teuthology.orchestra.run.smithi039.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-holtek-kbd.ko 2024-09-12T02:15:50.655 INFO:teuthology.orchestra.run.smithi039.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-holtek-mouse.ko 2024-09-12T02:15:50.656 INFO:teuthology.orchestra.run.smithi039.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-holtekff.ko 2024-09-12T02:15:50.656 INFO:teuthology.orchestra.run.smithi039.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-hyperv.ko 2024-09-12T02:15:50.656 INFO:teuthology.orchestra.run.smithi039.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-icade.ko 2024-09-12T02:15:50.656 INFO:teuthology.orchestra.run.smithi039.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-keytouch.ko 2024-09-12T02:15:50.656 INFO:teuthology.orchestra.run.smithi039.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-kye.ko 2024-09-12T02:15:50.656 INFO:teuthology.orchestra.run.smithi039.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-lcpower.ko 2024-09-12T02:15:50.656 INFO:teuthology.orchestra.run.smithi039.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-led.ko 2024-09-12T02:15:50.656 INFO:teuthology.orchestra.run.smithi039.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-lenovo.ko 2024-09-12T02:15:50.656 INFO:teuthology.orchestra.run.smithi039.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-logitech-dj.ko 2024-09-12T02:15:50.656 INFO:teuthology.orchestra.run.smithi039.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-logitech-hidpp.ko 2024-09-12T02:15:50.656 INFO:teuthology.orchestra.run.smithi039.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-multitouch.ko 2024-09-12T02:15:50.657 INFO:teuthology.orchestra.run.smithi039.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-ortek.ko 2024-09-12T02:15:50.657 INFO:teuthology.orchestra.run.smithi039.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-penmount.ko 2024-09-12T02:15:50.657 INFO:teuthology.orchestra.run.smithi039.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-petalynx.ko 2024-09-12T02:15:50.657 INFO:teuthology.orchestra.run.smithi039.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-picolcd.ko 2024-09-12T02:15:50.657 INFO:teuthology.orchestra.run.smithi039.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-pl.ko 2024-09-12T02:15:50.657 INFO:teuthology.orchestra.run.smithi039.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-plantronics.ko 2024-09-12T02:15:50.657 INFO:teuthology.orchestra.run.smithi039.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-primax.ko 2024-09-12T02:15:50.657 INFO:teuthology.orchestra.run.smithi039.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-rmi.ko 2024-09-12T02:15:50.657 INFO:teuthology.orchestra.run.smithi039.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-roccat-arvo.ko 2024-09-12T02:15:50.657 INFO:teuthology.orchestra.run.smithi039.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-roccat-common.ko 2024-09-12T02:15:50.658 INFO:teuthology.orchestra.run.smithi039.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-roccat-isku.ko 2024-09-12T02:15:50.658 INFO:teuthology.orchestra.run.smithi039.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-roccat-kone.ko 2024-09-12T02:15:50.658 INFO:teuthology.orchestra.run.smithi039.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-roccat-koneplus.ko 2024-09-12T02:15:50.658 INFO:teuthology.orchestra.run.smithi039.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-roccat-konepure.ko 2024-09-12T02:15:50.658 INFO:teuthology.orchestra.run.smithi039.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-roccat-kovaplus.ko 2024-09-12T02:15:50.658 INFO:teuthology.orchestra.run.smithi039.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-roccat-lua.ko 2024-09-12T02:15:50.659 INFO:teuthology.orchestra.run.smithi039.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-roccat-pyra.ko 2024-09-12T02:15:50.659 INFO:teuthology.orchestra.run.smithi039.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-roccat-ryos.ko 2024-09-12T02:15:50.659 INFO:teuthology.orchestra.run.smithi039.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-roccat-savu.ko 2024-09-12T02:15:50.659 INFO:teuthology.orchestra.run.smithi039.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-roccat.ko 2024-09-12T02:15:50.659 INFO:teuthology.orchestra.run.smithi039.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-saitek.ko 2024-09-12T02:15:50.659 INFO:teuthology.orchestra.run.smithi039.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-samsung.ko 2024-09-12T02:15:50.659 INFO:teuthology.orchestra.run.smithi039.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-sensor-hub.ko 2024-09-12T02:15:50.659 INFO:teuthology.orchestra.run.smithi039.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-sjoy.ko 2024-09-12T02:15:50.659 INFO:teuthology.orchestra.run.smithi039.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-sony.ko 2024-09-12T02:15:50.659 INFO:teuthology.orchestra.run.smithi039.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-speedlink.ko 2024-09-12T02:15:50.659 INFO:teuthology.orchestra.run.smithi039.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-steelseries.ko 2024-09-12T02:15:50.659 INFO:teuthology.orchestra.run.smithi039.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-sunplus.ko 2024-09-12T02:15:50.660 INFO:teuthology.orchestra.run.smithi039.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-thrustmaster.ko 2024-09-12T02:15:50.660 INFO:teuthology.orchestra.run.smithi039.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-tivo.ko 2024-09-12T02:15:50.660 INFO:teuthology.orchestra.run.smithi039.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-tmff.ko 2024-09-12T02:15:50.660 INFO:teuthology.orchestra.run.smithi039.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-topseed.ko 2024-09-12T02:15:50.660 INFO:teuthology.orchestra.run.smithi039.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-twinhan.ko 2024-09-12T02:15:50.660 INFO:teuthology.orchestra.run.smithi039.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-uclogic.ko 2024-09-12T02:15:50.660 INFO:teuthology.orchestra.run.smithi039.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-waltop.ko 2024-09-12T02:15:50.660 INFO:teuthology.orchestra.run.smithi039.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-wiimote.ko 2024-09-12T02:15:50.660 INFO:teuthology.orchestra.run.smithi039.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-xinmo.ko 2024-09-12T02:15:50.660 INFO:teuthology.orchestra.run.smithi039.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-zpff.ko 2024-09-12T02:15:50.660 INFO:teuthology.orchestra.run.smithi039.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-zydacron.ko 2024-09-12T02:15:50.661 INFO:teuthology.orchestra.run.smithi039.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/uhid.ko 2024-09-12T02:15:50.661 INFO:teuthology.orchestra.run.smithi039.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/wacom.ko 2024-09-12T02:15:50.661 INFO:teuthology.orchestra.run.smithi039.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hv 2024-09-12T02:15:50.661 INFO:teuthology.orchestra.run.smithi039.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hv/hv_balloon.ko 2024-09-12T02:15:50.661 INFO:teuthology.orchestra.run.smithi039.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hv/hv_utils.ko 2024-09-12T02:15:50.661 INFO:teuthology.orchestra.run.smithi039.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hv/hv_vmbus.ko 2024-09-12T02:15:50.661 INFO:teuthology.orchestra.run.smithi039.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon 2024-09-12T02:15:50.661 INFO:teuthology.orchestra.run.smithi039.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/abituguru.ko 2024-09-12T02:15:50.661 INFO:teuthology.orchestra.run.smithi039.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/abituguru3.ko 2024-09-12T02:15:50.661 INFO:teuthology.orchestra.run.smithi039.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/acpi_power_meter.ko 2024-09-12T02:15:50.661 INFO:teuthology.orchestra.run.smithi039.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/ad7414.ko 2024-09-12T02:15:50.662 INFO:teuthology.orchestra.run.smithi039.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/ad7418.ko 2024-09-12T02:15:50.662 INFO:teuthology.orchestra.run.smithi039.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/adc128d818.ko 2024-09-12T02:15:50.662 INFO:teuthology.orchestra.run.smithi039.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/adm1025.ko 2024-09-12T02:15:50.662 INFO:teuthology.orchestra.run.smithi039.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/adm1026.ko 2024-09-12T02:15:50.662 INFO:teuthology.orchestra.run.smithi039.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/adm1029.ko 2024-09-12T02:15:50.662 INFO:teuthology.orchestra.run.smithi039.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/adm1031.ko 2024-09-12T02:15:50.662 INFO:teuthology.orchestra.run.smithi039.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/adm9240.ko 2024-09-12T02:15:50.662 INFO:teuthology.orchestra.run.smithi039.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/ads7828.ko 2024-09-12T02:15:50.662 INFO:teuthology.orchestra.run.smithi039.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/adt7410.ko 2024-09-12T02:15:50.662 INFO:teuthology.orchestra.run.smithi039.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/adt7411.ko 2024-09-12T02:15:50.662 INFO:teuthology.orchestra.run.smithi039.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/adt7462.ko 2024-09-12T02:15:50.662 INFO:teuthology.orchestra.run.smithi039.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/adt7470.ko 2024-09-12T02:15:50.663 INFO:teuthology.orchestra.run.smithi039.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/adt7475.ko 2024-09-12T02:15:50.663 INFO:teuthology.orchestra.run.smithi039.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/adt7x10.ko 2024-09-12T02:15:50.663 INFO:teuthology.orchestra.run.smithi039.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/amc6821.ko 2024-09-12T02:15:50.663 INFO:teuthology.orchestra.run.smithi039.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/applesmc.ko 2024-09-12T02:15:50.663 INFO:teuthology.orchestra.run.smithi039.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/asb100.ko 2024-09-12T02:15:50.663 INFO:teuthology.orchestra.run.smithi039.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/asc7621.ko 2024-09-12T02:15:50.663 INFO:teuthology.orchestra.run.smithi039.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/asus_atk0110.ko 2024-09-12T02:15:50.663 INFO:teuthology.orchestra.run.smithi039.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/atxp1.ko 2024-09-12T02:15:50.663 INFO:teuthology.orchestra.run.smithi039.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/coretemp.ko 2024-09-12T02:15:50.663 INFO:teuthology.orchestra.run.smithi039.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/dell-smm-hwmon.ko 2024-09-12T02:15:50.663 INFO:teuthology.orchestra.run.smithi039.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/dme1737.ko 2024-09-12T02:15:50.664 INFO:teuthology.orchestra.run.smithi039.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/ds1621.ko 2024-09-12T02:15:50.664 INFO:teuthology.orchestra.run.smithi039.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/ds620.ko 2024-09-12T02:15:50.664 INFO:teuthology.orchestra.run.smithi039.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/emc1403.ko 2024-09-12T02:15:50.664 INFO:teuthology.orchestra.run.smithi039.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/emc6w201.ko 2024-09-12T02:15:50.664 INFO:teuthology.orchestra.run.smithi039.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/f71805f.ko 2024-09-12T02:15:50.664 INFO:teuthology.orchestra.run.smithi039.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/f71882fg.ko 2024-09-12T02:15:50.664 INFO:teuthology.orchestra.run.smithi039.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/f75375s.ko 2024-09-12T02:15:50.664 INFO:teuthology.orchestra.run.smithi039.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/fam15h_power.ko 2024-09-12T02:15:50.664 INFO:teuthology.orchestra.run.smithi039.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/fschmd.ko 2024-09-12T02:15:50.664 INFO:teuthology.orchestra.run.smithi039.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/g760a.ko 2024-09-12T02:15:50.664 INFO:teuthology.orchestra.run.smithi039.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/g762.ko 2024-09-12T02:15:50.665 INFO:teuthology.orchestra.run.smithi039.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/gl518sm.ko 2024-09-12T02:15:50.665 INFO:teuthology.orchestra.run.smithi039.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/gl520sm.ko 2024-09-12T02:15:50.665 INFO:teuthology.orchestra.run.smithi039.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/hwmon-vid.ko 2024-09-12T02:15:50.665 INFO:teuthology.orchestra.run.smithi039.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/i5500_temp.ko 2024-09-12T02:15:50.665 INFO:teuthology.orchestra.run.smithi039.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/i5k_amb.ko 2024-09-12T02:15:50.665 INFO:teuthology.orchestra.run.smithi039.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/ibmaem.ko 2024-09-12T02:15:50.665 INFO:teuthology.orchestra.run.smithi039.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/ibmpex.ko 2024-09-12T02:15:50.665 INFO:teuthology.orchestra.run.smithi039.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/ina209.ko 2024-09-12T02:15:50.665 INFO:teuthology.orchestra.run.smithi039.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/ina2xx.ko 2024-09-12T02:15:50.665 INFO:teuthology.orchestra.run.smithi039.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/it87.ko 2024-09-12T02:15:50.665 INFO:teuthology.orchestra.run.smithi039.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/k10temp.ko 2024-09-12T02:15:50.666 INFO:teuthology.orchestra.run.smithi039.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/k8temp.ko 2024-09-12T02:15:50.666 INFO:teuthology.orchestra.run.smithi039.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/lineage-pem.ko 2024-09-12T02:15:50.666 INFO:teuthology.orchestra.run.smithi039.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/lm63.ko 2024-09-12T02:15:50.666 INFO:teuthology.orchestra.run.smithi039.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/lm73.ko 2024-09-12T02:15:50.666 INFO:teuthology.orchestra.run.smithi039.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/lm75.ko 2024-09-12T02:15:50.666 INFO:teuthology.orchestra.run.smithi039.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/lm77.ko 2024-09-12T02:15:50.666 INFO:teuthology.orchestra.run.smithi039.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/lm78.ko 2024-09-12T02:15:50.666 INFO:teuthology.orchestra.run.smithi039.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/lm80.ko 2024-09-12T02:15:50.666 INFO:teuthology.orchestra.run.smithi039.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/lm83.ko 2024-09-12T02:15:50.666 INFO:teuthology.orchestra.run.smithi039.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/lm85.ko 2024-09-12T02:15:50.666 INFO:teuthology.orchestra.run.smithi039.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/lm87.ko 2024-09-12T02:15:50.666 INFO:teuthology.orchestra.run.smithi039.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/lm90.ko 2024-09-12T02:15:50.667 INFO:teuthology.orchestra.run.smithi039.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/lm92.ko 2024-09-12T02:15:50.667 INFO:teuthology.orchestra.run.smithi039.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/lm93.ko 2024-09-12T02:15:50.667 INFO:teuthology.orchestra.run.smithi039.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/lm95234.ko 2024-09-12T02:15:50.667 INFO:teuthology.orchestra.run.smithi039.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/lm95241.ko 2024-09-12T02:15:50.667 INFO:teuthology.orchestra.run.smithi039.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/lm95245.ko 2024-09-12T02:15:50.667 INFO:teuthology.orchestra.run.smithi039.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/ltc2945.ko 2024-09-12T02:15:50.667 INFO:teuthology.orchestra.run.smithi039.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/ltc4151.ko 2024-09-12T02:15:50.667 INFO:teuthology.orchestra.run.smithi039.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/ltc4215.ko 2024-09-12T02:15:50.667 INFO:teuthology.orchestra.run.smithi039.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/ltc4222.ko 2024-09-12T02:15:50.667 INFO:teuthology.orchestra.run.smithi039.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/ltc4245.ko 2024-09-12T02:15:50.668 INFO:teuthology.orchestra.run.smithi039.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/ltc4260.ko 2024-09-12T02:15:50.668 INFO:teuthology.orchestra.run.smithi039.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/ltc4261.ko 2024-09-12T02:15:50.668 INFO:teuthology.orchestra.run.smithi039.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/max16065.ko 2024-09-12T02:15:50.668 INFO:teuthology.orchestra.run.smithi039.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/max1619.ko 2024-09-12T02:15:50.668 INFO:teuthology.orchestra.run.smithi039.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/max1668.ko 2024-09-12T02:15:50.668 INFO:teuthology.orchestra.run.smithi039.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/max197.ko 2024-09-12T02:15:50.668 INFO:teuthology.orchestra.run.smithi039.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/max6639.ko 2024-09-12T02:15:50.668 INFO:teuthology.orchestra.run.smithi039.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/max6650.ko 2024-09-12T02:15:50.668 INFO:teuthology.orchestra.run.smithi039.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/max6697.ko 2024-09-12T02:15:50.668 INFO:teuthology.orchestra.run.smithi039.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/mcp3021.ko 2024-09-12T02:15:50.669 INFO:teuthology.orchestra.run.smithi039.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/nct6683.ko 2024-09-12T02:15:50.669 INFO:teuthology.orchestra.run.smithi039.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/nct6775-core.ko 2024-09-12T02:15:50.669 INFO:teuthology.orchestra.run.smithi039.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/nct6775.ko 2024-09-12T02:15:50.669 INFO:teuthology.orchestra.run.smithi039.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/nct7802.ko 2024-09-12T02:15:50.669 INFO:teuthology.orchestra.run.smithi039.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/pc87360.ko 2024-09-12T02:15:50.669 INFO:teuthology.orchestra.run.smithi039.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/pc87427.ko 2024-09-12T02:15:50.669 INFO:teuthology.orchestra.run.smithi039.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/pcf8591.ko 2024-09-12T02:15:50.669 INFO:teuthology.orchestra.run.smithi039.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/pmbus 2024-09-12T02:15:50.669 INFO:teuthology.orchestra.run.smithi039.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/pmbus/adm1275.ko 2024-09-12T02:15:50.669 INFO:teuthology.orchestra.run.smithi039.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/pmbus/lm25066.ko 2024-09-12T02:15:50.669 INFO:teuthology.orchestra.run.smithi039.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/pmbus/ltc2978.ko 2024-09-12T02:15:50.670 INFO:teuthology.orchestra.run.smithi039.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/pmbus/max16064.ko 2024-09-12T02:15:50.670 INFO:teuthology.orchestra.run.smithi039.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/pmbus/max34440.ko 2024-09-12T02:15:50.670 INFO:teuthology.orchestra.run.smithi039.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/pmbus/max8688.ko 2024-09-12T02:15:50.670 INFO:teuthology.orchestra.run.smithi039.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/pmbus/pmbus.ko 2024-09-12T02:15:50.670 INFO:teuthology.orchestra.run.smithi039.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/pmbus/pmbus_core.ko 2024-09-12T02:15:50.670 INFO:teuthology.orchestra.run.smithi039.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/pmbus/tps40422.ko 2024-09-12T02:15:50.670 INFO:teuthology.orchestra.run.smithi039.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/pmbus/ucd9000.ko 2024-09-12T02:15:50.670 INFO:teuthology.orchestra.run.smithi039.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/pmbus/ucd9200.ko 2024-09-12T02:15:50.670 INFO:teuthology.orchestra.run.smithi039.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/pmbus/zl6100.ko 2024-09-12T02:15:50.670 INFO:teuthology.orchestra.run.smithi039.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/powr1220.ko 2024-09-12T02:15:50.670 INFO:teuthology.orchestra.run.smithi039.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/sch5627.ko 2024-09-12T02:15:50.671 INFO:teuthology.orchestra.run.smithi039.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/sch5636.ko 2024-09-12T02:15:50.671 INFO:teuthology.orchestra.run.smithi039.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/sch56xx-common.ko 2024-09-12T02:15:50.671 INFO:teuthology.orchestra.run.smithi039.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/sht15.ko 2024-09-12T02:15:50.671 INFO:teuthology.orchestra.run.smithi039.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/sht21.ko 2024-09-12T02:15:50.671 INFO:teuthology.orchestra.run.smithi039.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/shtc1.ko 2024-09-12T02:15:50.671 INFO:teuthology.orchestra.run.smithi039.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/sis5595.ko 2024-09-12T02:15:50.671 INFO:teuthology.orchestra.run.smithi039.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/smsc47b397.ko 2024-09-12T02:15:50.671 INFO:teuthology.orchestra.run.smithi039.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/smsc47m1.ko 2024-09-12T02:15:50.671 INFO:teuthology.orchestra.run.smithi039.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/smsc47m192.ko 2024-09-12T02:15:50.671 INFO:teuthology.orchestra.run.smithi039.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/thmc50.ko 2024-09-12T02:15:50.671 INFO:teuthology.orchestra.run.smithi039.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/tmp102.ko 2024-09-12T02:15:50.671 INFO:teuthology.orchestra.run.smithi039.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/tmp103.ko 2024-09-12T02:15:50.671 INFO:teuthology.orchestra.run.smithi039.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/tmp401.ko 2024-09-12T02:15:50.672 INFO:teuthology.orchestra.run.smithi039.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/tmp421.ko 2024-09-12T02:15:50.672 INFO:teuthology.orchestra.run.smithi039.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/via-cputemp.ko 2024-09-12T02:15:50.672 INFO:teuthology.orchestra.run.smithi039.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/via686a.ko 2024-09-12T02:15:50.672 INFO:teuthology.orchestra.run.smithi039.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/vt1211.ko 2024-09-12T02:15:50.672 INFO:teuthology.orchestra.run.smithi039.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/vt8231.ko 2024-09-12T02:15:50.672 INFO:teuthology.orchestra.run.smithi039.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/w83627ehf.ko 2024-09-12T02:15:50.672 INFO:teuthology.orchestra.run.smithi039.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/w83627hf.ko 2024-09-12T02:15:50.672 INFO:teuthology.orchestra.run.smithi039.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/w83781d.ko 2024-09-12T02:15:50.672 INFO:teuthology.orchestra.run.smithi039.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/w83791d.ko 2024-09-12T02:15:50.672 INFO:teuthology.orchestra.run.smithi039.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/w83792d.ko 2024-09-12T02:15:50.672 INFO:teuthology.orchestra.run.smithi039.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/w83793.ko 2024-09-12T02:15:50.672 INFO:teuthology.orchestra.run.smithi039.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/w83795.ko 2024-09-12T02:15:50.672 INFO:teuthology.orchestra.run.smithi039.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/w83l785ts.ko 2024-09-12T02:15:50.673 INFO:teuthology.orchestra.run.smithi039.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/w83l786ng.ko 2024-09-12T02:15:50.673 INFO:teuthology.orchestra.run.smithi039.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/i2c 2024-09-12T02:15:50.673 INFO:teuthology.orchestra.run.smithi039.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/i2c/algos 2024-09-12T02:15:50.673 INFO:teuthology.orchestra.run.smithi039.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/i2c/algos/i2c-algo-bit.ko 2024-09-12T02:15:50.673 INFO:teuthology.orchestra.run.smithi039.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/i2c/algos/i2c-algo-pca.ko 2024-09-12T02:15:50.673 INFO:teuthology.orchestra.run.smithi039.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/i2c/busses 2024-09-12T02:15:50.673 INFO:teuthology.orchestra.run.smithi039.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/i2c/busses/i2c-amd756-s4882.ko 2024-09-12T02:15:50.673 INFO:teuthology.orchestra.run.smithi039.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/i2c/busses/i2c-amd756.ko 2024-09-12T02:15:50.673 INFO:teuthology.orchestra.run.smithi039.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/i2c/busses/i2c-amd8111.ko 2024-09-12T02:15:50.673 INFO:teuthology.orchestra.run.smithi039.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/i2c/busses/i2c-ccgx-ucsi.ko 2024-09-12T02:15:50.674 INFO:teuthology.orchestra.run.smithi039.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/i2c/busses/i2c-designware-core.ko 2024-09-12T02:15:50.674 INFO:teuthology.orchestra.run.smithi039.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/i2c/busses/i2c-designware-pci.ko 2024-09-12T02:15:50.674 INFO:teuthology.orchestra.run.smithi039.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/i2c/busses/i2c-designware-platform.ko 2024-09-12T02:15:50.674 INFO:teuthology.orchestra.run.smithi039.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/i2c/busses/i2c-diolan-u2c.ko 2024-09-12T02:15:50.674 INFO:teuthology.orchestra.run.smithi039.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/i2c/busses/i2c-i801.ko 2024-09-12T02:15:50.674 INFO:teuthology.orchestra.run.smithi039.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/i2c/busses/i2c-isch.ko 2024-09-12T02:15:50.674 INFO:teuthology.orchestra.run.smithi039.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/i2c/busses/i2c-ismt.ko 2024-09-12T02:15:50.674 INFO:teuthology.orchestra.run.smithi039.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/i2c/busses/i2c-nforce2-s4985.ko 2024-09-12T02:15:50.674 INFO:teuthology.orchestra.run.smithi039.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/i2c/busses/i2c-nforce2.ko 2024-09-12T02:15:50.674 INFO:teuthology.orchestra.run.smithi039.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/i2c/busses/i2c-parport.ko 2024-09-12T02:15:50.674 INFO:teuthology.orchestra.run.smithi039.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/i2c/busses/i2c-pca-platform.ko 2024-09-12T02:15:50.674 INFO:teuthology.orchestra.run.smithi039.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/i2c/busses/i2c-piix4.ko 2024-09-12T02:15:50.675 INFO:teuthology.orchestra.run.smithi039.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/i2c/busses/i2c-scmi.ko 2024-09-12T02:15:50.675 INFO:teuthology.orchestra.run.smithi039.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/i2c/busses/i2c-simtec.ko 2024-09-12T02:15:50.675 INFO:teuthology.orchestra.run.smithi039.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/i2c/busses/i2c-sis96x.ko 2024-09-12T02:15:50.675 INFO:teuthology.orchestra.run.smithi039.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/i2c/busses/i2c-tiny-usb.ko 2024-09-12T02:15:50.675 INFO:teuthology.orchestra.run.smithi039.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/i2c/busses/i2c-via.ko 2024-09-12T02:15:50.675 INFO:teuthology.orchestra.run.smithi039.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/i2c/busses/i2c-viapro.ko 2024-09-12T02:15:50.675 INFO:teuthology.orchestra.run.smithi039.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/i2c/busses/i2c-viperboard.ko 2024-09-12T02:15:50.675 INFO:teuthology.orchestra.run.smithi039.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/i2c/i2c-dev.ko 2024-09-12T02:15:50.675 INFO:teuthology.orchestra.run.smithi039.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/i2c/i2c-mux.ko 2024-09-12T02:15:50.675 INFO:teuthology.orchestra.run.smithi039.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/i2c/i2c-slave-eeprom.ko 2024-09-12T02:15:50.675 INFO:teuthology.orchestra.run.smithi039.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/i2c/i2c-smbus.ko 2024-09-12T02:15:50.675 INFO:teuthology.orchestra.run.smithi039.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/i2c/i2c-stub.ko 2024-09-12T02:15:50.676 INFO:teuthology.orchestra.run.smithi039.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/infiniband 2024-09-12T02:15:50.676 INFO:teuthology.orchestra.run.smithi039.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/infiniband/core 2024-09-12T02:15:50.676 INFO:teuthology.orchestra.run.smithi039.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/infiniband/core/ib_cm.ko 2024-09-12T02:15:50.676 INFO:teuthology.orchestra.run.smithi039.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/infiniband/core/ib_core.ko 2024-09-12T02:15:50.676 INFO:teuthology.orchestra.run.smithi039.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/infiniband/core/ib_umad.ko 2024-09-12T02:15:50.676 INFO:teuthology.orchestra.run.smithi039.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/infiniband/core/ib_uverbs.ko 2024-09-12T02:15:50.676 INFO:teuthology.orchestra.run.smithi039.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/infiniband/core/iw_cm.ko 2024-09-12T02:15:50.676 INFO:teuthology.orchestra.run.smithi039.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/infiniband/core/rdma_cm.ko 2024-09-12T02:15:50.676 INFO:teuthology.orchestra.run.smithi039.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/infiniband/core/rdma_ucm.ko 2024-09-12T02:15:50.676 INFO:teuthology.orchestra.run.smithi039.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/infiniband/hw 2024-09-12T02:15:50.676 INFO:teuthology.orchestra.run.smithi039.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/infiniband/hw/cxgb4 2024-09-12T02:15:50.676 INFO:teuthology.orchestra.run.smithi039.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/infiniband/hw/cxgb4/iw_cxgb4.ko 2024-09-12T02:15:50.677 INFO:teuthology.orchestra.run.smithi039.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/infiniband/hw/mlx4 2024-09-12T02:15:50.677 INFO:teuthology.orchestra.run.smithi039.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/infiniband/hw/mlx4/mlx4_ib.ko 2024-09-12T02:15:50.677 INFO:teuthology.orchestra.run.smithi039.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/infiniband/hw/mlx5 2024-09-12T02:15:50.677 INFO:teuthology.orchestra.run.smithi039.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/infiniband/hw/mlx5/mlx5_ib.ko 2024-09-12T02:15:50.677 INFO:teuthology.orchestra.run.smithi039.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/infiniband/hw/mthca 2024-09-12T02:15:50.677 INFO:teuthology.orchestra.run.smithi039.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/infiniband/hw/mthca/ib_mthca.ko 2024-09-12T02:15:50.677 INFO:teuthology.orchestra.run.smithi039.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/infiniband/ulp 2024-09-12T02:15:50.677 INFO:teuthology.orchestra.run.smithi039.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/infiniband/ulp/ipoib 2024-09-12T02:15:50.677 INFO:teuthology.orchestra.run.smithi039.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/infiniband/ulp/ipoib/ib_ipoib.ko 2024-09-12T02:15:50.677 INFO:teuthology.orchestra.run.smithi039.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/infiniband/ulp/iser 2024-09-12T02:15:50.677 INFO:teuthology.orchestra.run.smithi039.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/infiniband/ulp/iser/ib_iser.ko 2024-09-12T02:15:50.677 INFO:teuthology.orchestra.run.smithi039.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/infiniband/ulp/isert 2024-09-12T02:15:50.678 INFO:teuthology.orchestra.run.smithi039.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/infiniband/ulp/isert/ib_isert.ko 2024-09-12T02:15:50.678 INFO:teuthology.orchestra.run.smithi039.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/infiniband/ulp/srp 2024-09-12T02:15:50.678 INFO:teuthology.orchestra.run.smithi039.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/infiniband/ulp/srp/ib_srp.ko 2024-09-12T02:15:50.678 INFO:teuthology.orchestra.run.smithi039.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/infiniband/ulp/srpt 2024-09-12T02:15:50.678 INFO:teuthology.orchestra.run.smithi039.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/infiniband/ulp/srpt/ib_srpt.ko 2024-09-12T02:15:50.678 INFO:teuthology.orchestra.run.smithi039.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/input 2024-09-12T02:15:50.678 INFO:teuthology.orchestra.run.smithi039.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/input/gameport 2024-09-12T02:15:50.678 INFO:teuthology.orchestra.run.smithi039.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/input/gameport/emu10k1-gp.ko 2024-09-12T02:15:50.678 INFO:teuthology.orchestra.run.smithi039.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/input/gameport/fm801-gp.ko 2024-09-12T02:15:50.678 INFO:teuthology.orchestra.run.smithi039.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/input/gameport/gameport.ko 2024-09-12T02:15:50.678 INFO:teuthology.orchestra.run.smithi039.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/input/joydev.ko 2024-09-12T02:15:50.678 INFO:teuthology.orchestra.run.smithi039.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/input/keyboard 2024-09-12T02:15:50.679 INFO:teuthology.orchestra.run.smithi039.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/input/keyboard/gpio_keys.ko 2024-09-12T02:15:50.679 INFO:teuthology.orchestra.run.smithi039.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/input/mouse 2024-09-12T02:15:50.679 INFO:teuthology.orchestra.run.smithi039.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/input/mouse/appletouch.ko 2024-09-12T02:15:50.679 INFO:teuthology.orchestra.run.smithi039.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/input/mouse/bcm5974.ko 2024-09-12T02:15:50.679 INFO:teuthology.orchestra.run.smithi039.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/input/mouse/cyapatp.ko 2024-09-12T02:15:50.679 INFO:teuthology.orchestra.run.smithi039.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/input/mouse/elan_i2c.ko 2024-09-12T02:15:50.679 INFO:teuthology.orchestra.run.smithi039.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/input/mouse/sermouse.ko 2024-09-12T02:15:50.679 INFO:teuthology.orchestra.run.smithi039.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/input/mouse/synaptics_i2c.ko 2024-09-12T02:15:50.679 INFO:teuthology.orchestra.run.smithi039.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/input/mouse/synaptics_usb.ko 2024-09-12T02:15:50.679 INFO:teuthology.orchestra.run.smithi039.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/input/mouse/vsxxxaa.ko 2024-09-12T02:15:50.679 INFO:teuthology.orchestra.run.smithi039.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/input/rmi4 2024-09-12T02:15:50.679 INFO:teuthology.orchestra.run.smithi039.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/input/rmi4/rmi_core.ko 2024-09-12T02:15:50.680 INFO:teuthology.orchestra.run.smithi039.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/input/serio 2024-09-12T02:15:50.680 INFO:teuthology.orchestra.run.smithi039.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/input/serio/altera_ps2.ko 2024-09-12T02:15:50.680 INFO:teuthology.orchestra.run.smithi039.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/input/serio/arc_ps2.ko 2024-09-12T02:15:50.680 INFO:teuthology.orchestra.run.smithi039.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/input/serio/hyperv-keyboard.ko 2024-09-12T02:15:50.680 INFO:teuthology.orchestra.run.smithi039.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/input/serio/serio_raw.ko 2024-09-12T02:15:50.680 INFO:teuthology.orchestra.run.smithi039.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/input/sparse-keymap.ko 2024-09-12T02:15:50.680 INFO:teuthology.orchestra.run.smithi039.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/leds 2024-09-12T02:15:50.680 INFO:teuthology.orchestra.run.smithi039.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/leds/leds-blinkm.ko 2024-09-12T02:15:50.680 INFO:teuthology.orchestra.run.smithi039.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/leds/leds-lm3530.ko 2024-09-12T02:15:50.680 INFO:teuthology.orchestra.run.smithi039.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/leds/leds-lp3944.ko 2024-09-12T02:15:50.680 INFO:teuthology.orchestra.run.smithi039.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/leds/leds-ss4200.ko 2024-09-12T02:15:50.681 INFO:teuthology.orchestra.run.smithi039.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/leds/trigger 2024-09-12T02:15:50.681 INFO:teuthology.orchestra.run.smithi039.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/leds/trigger/ledtrig-backlight.ko 2024-09-12T02:15:50.681 INFO:teuthology.orchestra.run.smithi039.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/leds/trigger/ledtrig-camera.ko 2024-09-12T02:15:50.681 INFO:teuthology.orchestra.run.smithi039.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/leds/trigger/ledtrig-default-on.ko 2024-09-12T02:15:50.681 INFO:teuthology.orchestra.run.smithi039.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/leds/trigger/ledtrig-gpio.ko 2024-09-12T02:15:50.682 INFO:teuthology.orchestra.run.smithi039.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/leds/trigger/ledtrig-heartbeat.ko 2024-09-12T02:15:50.682 INFO:teuthology.orchestra.run.smithi039.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/leds/trigger/ledtrig-oneshot.ko 2024-09-12T02:15:50.682 INFO:teuthology.orchestra.run.smithi039.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/leds/trigger/ledtrig-timer.ko 2024-09-12T02:15:50.682 INFO:teuthology.orchestra.run.smithi039.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/leds/trigger/ledtrig-transient.ko 2024-09-12T02:15:50.682 INFO:teuthology.orchestra.run.smithi039.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/md 2024-09-12T02:15:50.682 INFO:teuthology.orchestra.run.smithi039.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/md/bcache 2024-09-12T02:15:50.682 INFO:teuthology.orchestra.run.smithi039.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/md/bcache/bcache.ko 2024-09-12T02:15:50.682 INFO:teuthology.orchestra.run.smithi039.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/md/dm-bio-prison.ko 2024-09-12T02:15:50.682 INFO:teuthology.orchestra.run.smithi039.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/md/dm-cache-smq.ko 2024-09-12T02:15:50.682 INFO:teuthology.orchestra.run.smithi039.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/md/dm-cache.ko 2024-09-12T02:15:50.683 INFO:teuthology.orchestra.run.smithi039.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/md/dm-crypt.ko 2024-09-12T02:15:50.683 INFO:teuthology.orchestra.run.smithi039.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/md/dm-delay.ko 2024-09-12T02:15:50.683 INFO:teuthology.orchestra.run.smithi039.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/md/dm-flakey.ko 2024-09-12T02:15:50.683 INFO:teuthology.orchestra.run.smithi039.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/md/dm-log-userspace.ko 2024-09-12T02:15:50.683 INFO:teuthology.orchestra.run.smithi039.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/md/dm-multipath.ko 2024-09-12T02:15:50.683 INFO:teuthology.orchestra.run.smithi039.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/md/dm-queue-length.ko 2024-09-12T02:15:50.683 INFO:teuthology.orchestra.run.smithi039.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/md/dm-raid.ko 2024-09-12T02:15:50.683 INFO:teuthology.orchestra.run.smithi039.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/md/dm-round-robin.ko 2024-09-12T02:15:50.683 INFO:teuthology.orchestra.run.smithi039.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/md/dm-service-time.ko 2024-09-12T02:15:50.683 INFO:teuthology.orchestra.run.smithi039.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/md/dm-switch.ko 2024-09-12T02:15:50.684 INFO:teuthology.orchestra.run.smithi039.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/md/dm-thin-pool.ko 2024-09-12T02:15:50.684 INFO:teuthology.orchestra.run.smithi039.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/md/dm-verity.ko 2024-09-12T02:15:50.684 INFO:teuthology.orchestra.run.smithi039.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/md/persistent-data 2024-09-12T02:15:50.684 INFO:teuthology.orchestra.run.smithi039.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/md/persistent-data/dm-persistent-data.ko 2024-09-12T02:15:50.684 INFO:teuthology.orchestra.run.smithi039.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/md/raid0.ko 2024-09-12T02:15:50.684 INFO:teuthology.orchestra.run.smithi039.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/md/raid1.ko 2024-09-12T02:15:50.684 INFO:teuthology.orchestra.run.smithi039.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/md/raid10.ko 2024-09-12T02:15:50.684 INFO:teuthology.orchestra.run.smithi039.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/md/raid456.ko 2024-09-12T02:15:50.684 INFO:teuthology.orchestra.run.smithi039.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/message 2024-09-12T02:15:50.684 INFO:teuthology.orchestra.run.smithi039.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/message/fusion 2024-09-12T02:15:50.684 INFO:teuthology.orchestra.run.smithi039.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/message/fusion/mptbase.ko 2024-09-12T02:15:50.685 INFO:teuthology.orchestra.run.smithi039.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/message/fusion/mptctl.ko 2024-09-12T02:15:50.685 INFO:teuthology.orchestra.run.smithi039.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/message/fusion/mptfc.ko 2024-09-12T02:15:50.685 INFO:teuthology.orchestra.run.smithi039.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/message/fusion/mptlan.ko 2024-09-12T02:15:50.685 INFO:teuthology.orchestra.run.smithi039.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/message/fusion/mptsas.ko 2024-09-12T02:15:50.685 INFO:teuthology.orchestra.run.smithi039.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/message/fusion/mptscsih.ko 2024-09-12T02:15:50.685 INFO:teuthology.orchestra.run.smithi039.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/message/fusion/mptspi.ko 2024-09-12T02:15:50.685 INFO:teuthology.orchestra.run.smithi039.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/mfd 2024-09-12T02:15:50.685 INFO:teuthology.orchestra.run.smithi039.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/mfd/lpc_ich.ko 2024-09-12T02:15:50.685 INFO:teuthology.orchestra.run.smithi039.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/mfd/lpc_sch.ko 2024-09-12T02:15:50.685 INFO:teuthology.orchestra.run.smithi039.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/mfd/mfd-core.ko 2024-09-12T02:15:50.685 INFO:teuthology.orchestra.run.smithi039.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/mfd/sm501.ko 2024-09-12T02:15:50.685 INFO:teuthology.orchestra.run.smithi039.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/mfd/viperboard.ko 2024-09-12T02:15:50.686 INFO:teuthology.orchestra.run.smithi039.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/mfd/vx855.ko 2024-09-12T02:15:50.686 INFO:teuthology.orchestra.run.smithi039.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/mfd/wl1273-core.ko 2024-09-12T02:15:50.686 INFO:teuthology.orchestra.run.smithi039.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/misc 2024-09-12T02:15:50.686 INFO:teuthology.orchestra.run.smithi039.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/misc/altera-stapl 2024-09-12T02:15:50.686 INFO:teuthology.orchestra.run.smithi039.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/misc/altera-stapl/altera-stapl.ko 2024-09-12T02:15:50.686 INFO:teuthology.orchestra.run.smithi039.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/misc/apds9802als.ko 2024-09-12T02:15:50.686 INFO:teuthology.orchestra.run.smithi039.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/misc/apds990x.ko 2024-09-12T02:15:50.686 INFO:teuthology.orchestra.run.smithi039.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/misc/bh1770glc.ko 2024-09-12T02:15:50.686 INFO:teuthology.orchestra.run.smithi039.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/misc/cb710 2024-09-12T02:15:50.686 INFO:teuthology.orchestra.run.smithi039.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/misc/cb710/cb710.ko 2024-09-12T02:15:50.686 INFO:teuthology.orchestra.run.smithi039.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/misc/eeprom 2024-09-12T02:15:50.687 INFO:teuthology.orchestra.run.smithi039.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/misc/eeprom/at24.ko 2024-09-12T02:15:50.687 INFO:teuthology.orchestra.run.smithi039.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/misc/eeprom/eeprom_93cx6.ko 2024-09-12T02:15:50.687 INFO:teuthology.orchestra.run.smithi039.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/misc/eeprom/max6875.ko 2024-09-12T02:15:50.687 INFO:teuthology.orchestra.run.smithi039.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/misc/enclosure.ko 2024-09-12T02:15:50.687 INFO:teuthology.orchestra.run.smithi039.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/misc/hpilo.ko 2024-09-12T02:15:50.687 INFO:teuthology.orchestra.run.smithi039.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/misc/isl29003.ko 2024-09-12T02:15:50.687 INFO:teuthology.orchestra.run.smithi039.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/misc/isl29020.ko 2024-09-12T02:15:50.687 INFO:teuthology.orchestra.run.smithi039.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/misc/lis3lv02d 2024-09-12T02:15:50.687 INFO:teuthology.orchestra.run.smithi039.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/misc/lis3lv02d/lis3lv02d.ko 2024-09-12T02:15:50.687 INFO:teuthology.orchestra.run.smithi039.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/misc/lis3lv02d/lis3lv02d_i2c.ko 2024-09-12T02:15:50.687 INFO:teuthology.orchestra.run.smithi039.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/misc/mei 2024-09-12T02:15:50.687 INFO:teuthology.orchestra.run.smithi039.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/misc/mei/mei-me.ko 2024-09-12T02:15:50.688 INFO:teuthology.orchestra.run.smithi039.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/misc/mei/mei-txe.ko 2024-09-12T02:15:50.688 INFO:teuthology.orchestra.run.smithi039.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/misc/mei/mei.ko 2024-09-12T02:15:50.688 INFO:teuthology.orchestra.run.smithi039.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/misc/sgi-gru 2024-09-12T02:15:50.688 INFO:teuthology.orchestra.run.smithi039.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/misc/sgi-gru/gru.ko 2024-09-12T02:15:50.688 INFO:teuthology.orchestra.run.smithi039.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/misc/sgi-xp 2024-09-12T02:15:50.688 INFO:teuthology.orchestra.run.smithi039.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/misc/sgi-xp/xp.ko 2024-09-12T02:15:50.688 INFO:teuthology.orchestra.run.smithi039.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/misc/sgi-xp/xpc.ko 2024-09-12T02:15:50.688 INFO:teuthology.orchestra.run.smithi039.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/misc/sgi-xp/xpnet.ko 2024-09-12T02:15:50.688 INFO:teuthology.orchestra.run.smithi039.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/misc/tifm_7xx1.ko 2024-09-12T02:15:50.688 INFO:teuthology.orchestra.run.smithi039.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/misc/tifm_core.ko 2024-09-12T02:15:50.689 INFO:teuthology.orchestra.run.smithi039.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/misc/tsl2550.ko 2024-09-12T02:15:50.689 INFO:teuthology.orchestra.run.smithi039.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/misc/vmw_balloon.ko 2024-09-12T02:15:50.689 INFO:teuthology.orchestra.run.smithi039.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/misc/vmw_vmci 2024-09-12T02:15:50.689 INFO:teuthology.orchestra.run.smithi039.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/misc/vmw_vmci/vmw_vmci.ko 2024-09-12T02:15:50.689 INFO:teuthology.orchestra.run.smithi039.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net 2024-09-12T02:15:50.689 INFO:teuthology.orchestra.run.smithi039.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/bonding 2024-09-12T02:15:50.689 INFO:teuthology.orchestra.run.smithi039.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/bonding/bonding.ko 2024-09-12T02:15:50.689 INFO:teuthology.orchestra.run.smithi039.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/dsa 2024-09-12T02:15:50.689 INFO:teuthology.orchestra.run.smithi039.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/dsa/b53 2024-09-12T02:15:50.689 INFO:teuthology.orchestra.run.smithi039.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/dsa/b53/b53_common.ko 2024-09-12T02:15:50.689 INFO:teuthology.orchestra.run.smithi039.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/dsa/bcm-sf2.ko 2024-09-12T02:15:50.689 INFO:teuthology.orchestra.run.smithi039.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/dsa/mv88e6060.ko 2024-09-12T02:15:50.689 INFO:teuthology.orchestra.run.smithi039.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/dsa/mv88e6xxx 2024-09-12T02:15:50.690 INFO:teuthology.orchestra.run.smithi039.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/dsa/mv88e6xxx/mv88e6xxx.ko 2024-09-12T02:15:50.690 INFO:teuthology.orchestra.run.smithi039.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/dummy.ko 2024-09-12T02:15:50.690 INFO:teuthology.orchestra.run.smithi039.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/eql.ko 2024-09-12T02:15:50.690 INFO:teuthology.orchestra.run.smithi039.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet 2024-09-12T02:15:50.690 INFO:teuthology.orchestra.run.smithi039.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/3com 2024-09-12T02:15:50.690 INFO:teuthology.orchestra.run.smithi039.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/3com/3c574_cs.ko 2024-09-12T02:15:50.690 INFO:teuthology.orchestra.run.smithi039.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/3com/3c589_cs.ko 2024-09-12T02:15:50.690 INFO:teuthology.orchestra.run.smithi039.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/3com/3c59x.ko 2024-09-12T02:15:50.690 INFO:teuthology.orchestra.run.smithi039.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/3com/typhoon.ko 2024-09-12T02:15:50.690 INFO:teuthology.orchestra.run.smithi039.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/8390 2024-09-12T02:15:50.690 INFO:teuthology.orchestra.run.smithi039.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/8390/8390.ko 2024-09-12T02:15:50.690 INFO:teuthology.orchestra.run.smithi039.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/8390/axnet_cs.ko 2024-09-12T02:15:50.691 INFO:teuthology.orchestra.run.smithi039.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/8390/ne2k-pci.ko 2024-09-12T02:15:50.691 INFO:teuthology.orchestra.run.smithi039.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/8390/pcnet_cs.ko 2024-09-12T02:15:50.691 INFO:teuthology.orchestra.run.smithi039.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/adaptec 2024-09-12T02:15:50.691 INFO:teuthology.orchestra.run.smithi039.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/adaptec/starfire.ko 2024-09-12T02:15:50.691 INFO:teuthology.orchestra.run.smithi039.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/agere 2024-09-12T02:15:50.691 INFO:teuthology.orchestra.run.smithi039.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/agere/et131x.ko 2024-09-12T02:15:50.691 INFO:teuthology.orchestra.run.smithi039.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/alteon 2024-09-12T02:15:50.691 INFO:teuthology.orchestra.run.smithi039.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/alteon/acenic.ko 2024-09-12T02:15:50.691 INFO:teuthology.orchestra.run.smithi039.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/altera 2024-09-12T02:15:50.691 INFO:teuthology.orchestra.run.smithi039.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/altera/altera_tse.ko 2024-09-12T02:15:50.691 INFO:teuthology.orchestra.run.smithi039.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/amd 2024-09-12T02:15:50.691 INFO:teuthology.orchestra.run.smithi039.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/amd/amd8111e.ko 2024-09-12T02:15:50.692 INFO:teuthology.orchestra.run.smithi039.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/amd/nmclan_cs.ko 2024-09-12T02:15:50.692 INFO:teuthology.orchestra.run.smithi039.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/amd/pcnet32.ko 2024-09-12T02:15:50.692 INFO:teuthology.orchestra.run.smithi039.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/atheros 2024-09-12T02:15:50.692 INFO:teuthology.orchestra.run.smithi039.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/atheros/alx 2024-09-12T02:15:50.692 INFO:teuthology.orchestra.run.smithi039.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/atheros/alx/alx.ko 2024-09-12T02:15:50.692 INFO:teuthology.orchestra.run.smithi039.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/atheros/atl1c 2024-09-12T02:15:50.692 INFO:teuthology.orchestra.run.smithi039.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/atheros/atl1c/atl1c.ko 2024-09-12T02:15:50.692 INFO:teuthology.orchestra.run.smithi039.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/atheros/atl1e 2024-09-12T02:15:50.692 INFO:teuthology.orchestra.run.smithi039.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/atheros/atl1e/atl1e.ko 2024-09-12T02:15:50.692 INFO:teuthology.orchestra.run.smithi039.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/atheros/atlx 2024-09-12T02:15:50.692 INFO:teuthology.orchestra.run.smithi039.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/atheros/atlx/atl1.ko 2024-09-12T02:15:50.693 INFO:teuthology.orchestra.run.smithi039.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/atheros/atlx/atl2.ko 2024-09-12T02:15:50.693 INFO:teuthology.orchestra.run.smithi039.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/broadcom 2024-09-12T02:15:50.693 INFO:teuthology.orchestra.run.smithi039.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/broadcom/b44.ko 2024-09-12T02:15:50.693 INFO:teuthology.orchestra.run.smithi039.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/broadcom/bnx2.ko 2024-09-12T02:15:50.693 INFO:teuthology.orchestra.run.smithi039.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/broadcom/bnx2x 2024-09-12T02:15:50.693 INFO:teuthology.orchestra.run.smithi039.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/broadcom/bnx2x/bnx2x.ko 2024-09-12T02:15:50.693 INFO:teuthology.orchestra.run.smithi039.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/broadcom/cnic.ko 2024-09-12T02:15:50.693 INFO:teuthology.orchestra.run.smithi039.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/broadcom/genet 2024-09-12T02:15:50.693 INFO:teuthology.orchestra.run.smithi039.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/broadcom/genet/genet.ko 2024-09-12T02:15:50.693 INFO:teuthology.orchestra.run.smithi039.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/broadcom/tg3.ko 2024-09-12T02:15:50.693 INFO:teuthology.orchestra.run.smithi039.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/brocade 2024-09-12T02:15:50.693 INFO:teuthology.orchestra.run.smithi039.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/brocade/bna 2024-09-12T02:15:50.694 INFO:teuthology.orchestra.run.smithi039.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/brocade/bna/bna.ko 2024-09-12T02:15:50.694 INFO:teuthology.orchestra.run.smithi039.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/chelsio 2024-09-12T02:15:50.694 INFO:teuthology.orchestra.run.smithi039.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/chelsio/cxgb 2024-09-12T02:15:50.694 INFO:teuthology.orchestra.run.smithi039.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/chelsio/cxgb/cxgb.ko 2024-09-12T02:15:50.694 INFO:teuthology.orchestra.run.smithi039.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/chelsio/cxgb3 2024-09-12T02:15:50.694 INFO:teuthology.orchestra.run.smithi039.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/chelsio/cxgb3/cxgb3.ko 2024-09-12T02:15:50.694 INFO:teuthology.orchestra.run.smithi039.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/chelsio/cxgb4 2024-09-12T02:15:50.694 INFO:teuthology.orchestra.run.smithi039.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/chelsio/cxgb4/cxgb4.ko 2024-09-12T02:15:50.694 INFO:teuthology.orchestra.run.smithi039.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/chelsio/cxgb4vf 2024-09-12T02:15:50.694 INFO:teuthology.orchestra.run.smithi039.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/chelsio/cxgb4vf/cxgb4vf.ko 2024-09-12T02:15:50.694 INFO:teuthology.orchestra.run.smithi039.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/chelsio/libcxgb 2024-09-12T02:15:50.694 INFO:teuthology.orchestra.run.smithi039.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/chelsio/libcxgb/libcxgb.ko 2024-09-12T02:15:50.694 INFO:teuthology.orchestra.run.smithi039.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/cisco 2024-09-12T02:15:50.695 INFO:teuthology.orchestra.run.smithi039.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/cisco/enic 2024-09-12T02:15:50.695 INFO:teuthology.orchestra.run.smithi039.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/cisco/enic/enic.ko 2024-09-12T02:15:50.695 INFO:teuthology.orchestra.run.smithi039.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/dec 2024-09-12T02:15:50.695 INFO:teuthology.orchestra.run.smithi039.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/dec/tulip 2024-09-12T02:15:50.695 INFO:teuthology.orchestra.run.smithi039.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/dec/tulip/de2104x.ko 2024-09-12T02:15:50.695 INFO:teuthology.orchestra.run.smithi039.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/dec/tulip/dmfe.ko 2024-09-12T02:15:50.695 INFO:teuthology.orchestra.run.smithi039.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/dec/tulip/tulip.ko 2024-09-12T02:15:50.695 INFO:teuthology.orchestra.run.smithi039.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/dec/tulip/uli526x.ko 2024-09-12T02:15:50.695 INFO:teuthology.orchestra.run.smithi039.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/dec/tulip/winbond-840.ko 2024-09-12T02:15:50.695 INFO:teuthology.orchestra.run.smithi039.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/dec/tulip/xircom_cb.ko 2024-09-12T02:15:50.695 INFO:teuthology.orchestra.run.smithi039.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/dlink 2024-09-12T02:15:50.695 INFO:teuthology.orchestra.run.smithi039.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/dlink/dl2k.ko 2024-09-12T02:15:50.695 INFO:teuthology.orchestra.run.smithi039.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/dlink/sundance.ko 2024-09-12T02:15:50.696 INFO:teuthology.orchestra.run.smithi039.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/dnet.ko 2024-09-12T02:15:50.696 INFO:teuthology.orchestra.run.smithi039.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/emulex 2024-09-12T02:15:50.696 INFO:teuthology.orchestra.run.smithi039.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/emulex/benet 2024-09-12T02:15:50.696 INFO:teuthology.orchestra.run.smithi039.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/emulex/benet/be2net.ko 2024-09-12T02:15:50.696 INFO:teuthology.orchestra.run.smithi039.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/ethoc.ko 2024-09-12T02:15:50.696 INFO:teuthology.orchestra.run.smithi039.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/fealnx.ko 2024-09-12T02:15:50.696 INFO:teuthology.orchestra.run.smithi039.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/intel 2024-09-12T02:15:50.696 INFO:teuthology.orchestra.run.smithi039.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/intel/e100.ko 2024-09-12T02:15:50.696 INFO:teuthology.orchestra.run.smithi039.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/intel/e1000 2024-09-12T02:15:50.696 INFO:teuthology.orchestra.run.smithi039.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/intel/e1000/e1000.ko 2024-09-12T02:15:50.696 INFO:teuthology.orchestra.run.smithi039.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/intel/e1000e 2024-09-12T02:15:50.697 INFO:teuthology.orchestra.run.smithi039.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/intel/e1000e/e1000e.ko 2024-09-12T02:15:50.697 INFO:teuthology.orchestra.run.smithi039.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/intel/fm10k 2024-09-12T02:15:50.697 INFO:teuthology.orchestra.run.smithi039.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/intel/fm10k/fm10k.ko 2024-09-12T02:15:50.697 INFO:teuthology.orchestra.run.smithi039.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/intel/i40e 2024-09-12T02:15:50.697 INFO:teuthology.orchestra.run.smithi039.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/intel/i40e/i40e.ko 2024-09-12T02:15:50.697 INFO:teuthology.orchestra.run.smithi039.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/intel/iavf 2024-09-12T02:15:50.697 INFO:teuthology.orchestra.run.smithi039.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/intel/iavf/iavf.ko 2024-09-12T02:15:50.697 INFO:teuthology.orchestra.run.smithi039.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/intel/igb 2024-09-12T02:15:50.697 INFO:teuthology.orchestra.run.smithi039.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/intel/igb/igb.ko 2024-09-12T02:15:50.697 INFO:teuthology.orchestra.run.smithi039.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/intel/igbvf 2024-09-12T02:15:50.697 INFO:teuthology.orchestra.run.smithi039.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/intel/igbvf/igbvf.ko 2024-09-12T02:15:50.698 INFO:teuthology.orchestra.run.smithi039.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/intel/ixgbe 2024-09-12T02:15:50.698 INFO:teuthology.orchestra.run.smithi039.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/intel/ixgbe/ixgbe.ko 2024-09-12T02:15:50.698 INFO:teuthology.orchestra.run.smithi039.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/intel/ixgbevf 2024-09-12T02:15:50.698 INFO:teuthology.orchestra.run.smithi039.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/intel/ixgbevf/ixgbevf.ko 2024-09-12T02:15:50.698 INFO:teuthology.orchestra.run.smithi039.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/intel/libeth 2024-09-12T02:15:50.698 INFO:teuthology.orchestra.run.smithi039.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/intel/libeth/libeth.ko 2024-09-12T02:15:50.698 INFO:teuthology.orchestra.run.smithi039.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/intel/libie 2024-09-12T02:15:50.698 INFO:teuthology.orchestra.run.smithi039.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/intel/libie/libie.ko 2024-09-12T02:15:50.698 INFO:teuthology.orchestra.run.smithi039.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/jme.ko 2024-09-12T02:15:50.698 INFO:teuthology.orchestra.run.smithi039.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/marvell 2024-09-12T02:15:50.698 INFO:teuthology.orchestra.run.smithi039.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/marvell/mvmdio.ko 2024-09-12T02:15:50.698 INFO:teuthology.orchestra.run.smithi039.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/marvell/skge.ko 2024-09-12T02:15:50.698 INFO:teuthology.orchestra.run.smithi039.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/marvell/sky2.ko 2024-09-12T02:15:50.699 INFO:teuthology.orchestra.run.smithi039.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/mellanox 2024-09-12T02:15:50.699 INFO:teuthology.orchestra.run.smithi039.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/mellanox/mlx4 2024-09-12T02:15:50.699 INFO:teuthology.orchestra.run.smithi039.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/mellanox/mlx4/mlx4_core.ko 2024-09-12T02:15:50.699 INFO:teuthology.orchestra.run.smithi039.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/mellanox/mlx4/mlx4_en.ko 2024-09-12T02:15:50.699 INFO:teuthology.orchestra.run.smithi039.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/mellanox/mlx5 2024-09-12T02:15:50.699 INFO:teuthology.orchestra.run.smithi039.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/mellanox/mlx5/core 2024-09-12T02:15:50.699 INFO:teuthology.orchestra.run.smithi039.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/mellanox/mlx5/core/mlx5_core.ko 2024-09-12T02:15:50.699 INFO:teuthology.orchestra.run.smithi039.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/micrel 2024-09-12T02:15:50.699 INFO:teuthology.orchestra.run.smithi039.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/micrel/ksz884x.ko 2024-09-12T02:15:50.699 INFO:teuthology.orchestra.run.smithi039.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/myricom 2024-09-12T02:15:50.699 INFO:teuthology.orchestra.run.smithi039.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/myricom/myri10ge 2024-09-12T02:15:50.699 INFO:teuthology.orchestra.run.smithi039.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/myricom/myri10ge/myri10ge.ko 2024-09-12T02:15:50.700 INFO:teuthology.orchestra.run.smithi039.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/natsemi 2024-09-12T02:15:50.700 INFO:teuthology.orchestra.run.smithi039.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/natsemi/natsemi.ko 2024-09-12T02:15:50.700 INFO:teuthology.orchestra.run.smithi039.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/natsemi/ns83820.ko 2024-09-12T02:15:50.700 INFO:teuthology.orchestra.run.smithi039.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/neterion 2024-09-12T02:15:50.700 INFO:teuthology.orchestra.run.smithi039.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/neterion/s2io.ko 2024-09-12T02:15:50.700 INFO:teuthology.orchestra.run.smithi039.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/nvidia 2024-09-12T02:15:50.700 INFO:teuthology.orchestra.run.smithi039.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/nvidia/forcedeth.ko 2024-09-12T02:15:50.700 INFO:teuthology.orchestra.run.smithi039.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/packetengines 2024-09-12T02:15:50.700 INFO:teuthology.orchestra.run.smithi039.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/packetengines/hamachi.ko 2024-09-12T02:15:50.700 INFO:teuthology.orchestra.run.smithi039.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/packetengines/yellowfin.ko 2024-09-12T02:15:50.700 INFO:teuthology.orchestra.run.smithi039.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/qlogic 2024-09-12T02:15:50.700 INFO:teuthology.orchestra.run.smithi039.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/qlogic/netxen 2024-09-12T02:15:50.701 INFO:teuthology.orchestra.run.smithi039.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/qlogic/netxen/netxen_nic.ko 2024-09-12T02:15:50.701 INFO:teuthology.orchestra.run.smithi039.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/qlogic/qla3xxx.ko 2024-09-12T02:15:50.701 INFO:teuthology.orchestra.run.smithi039.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/qlogic/qlcnic 2024-09-12T02:15:50.701 INFO:teuthology.orchestra.run.smithi039.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/qlogic/qlcnic/qlcnic.ko 2024-09-12T02:15:50.701 INFO:teuthology.orchestra.run.smithi039.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/rdc 2024-09-12T02:15:50.701 INFO:teuthology.orchestra.run.smithi039.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/rdc/r6040.ko 2024-09-12T02:15:50.701 INFO:teuthology.orchestra.run.smithi039.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/realtek 2024-09-12T02:15:50.701 INFO:teuthology.orchestra.run.smithi039.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/realtek/8139cp.ko 2024-09-12T02:15:50.701 INFO:teuthology.orchestra.run.smithi039.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/realtek/8139too.ko 2024-09-12T02:15:50.701 INFO:teuthology.orchestra.run.smithi039.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/realtek/atp.ko 2024-09-12T02:15:50.701 INFO:teuthology.orchestra.run.smithi039.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/realtek/r8169.ko 2024-09-12T02:15:50.702 INFO:teuthology.orchestra.run.smithi039.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/rocker 2024-09-12T02:15:50.702 INFO:teuthology.orchestra.run.smithi039.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/rocker/rocker.ko 2024-09-12T02:15:50.702 INFO:teuthology.orchestra.run.smithi039.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/sfc 2024-09-12T02:15:50.702 INFO:teuthology.orchestra.run.smithi039.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/sfc/sfc.ko 2024-09-12T02:15:50.702 INFO:teuthology.orchestra.run.smithi039.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/silan 2024-09-12T02:15:50.702 INFO:teuthology.orchestra.run.smithi039.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/silan/sc92031.ko 2024-09-12T02:15:50.702 INFO:teuthology.orchestra.run.smithi039.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/sis 2024-09-12T02:15:50.702 INFO:teuthology.orchestra.run.smithi039.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/sis/sis190.ko 2024-09-12T02:15:50.702 INFO:teuthology.orchestra.run.smithi039.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/sis/sis900.ko 2024-09-12T02:15:50.702 INFO:teuthology.orchestra.run.smithi039.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/smsc 2024-09-12T02:15:50.702 INFO:teuthology.orchestra.run.smithi039.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/smsc/epic100.ko 2024-09-12T02:15:50.703 INFO:teuthology.orchestra.run.smithi039.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/smsc/smc91c92_cs.ko 2024-09-12T02:15:50.703 INFO:teuthology.orchestra.run.smithi039.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/smsc/smsc911x.ko 2024-09-12T02:15:50.703 INFO:teuthology.orchestra.run.smithi039.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/smsc/smsc9420.ko 2024-09-12T02:15:50.703 INFO:teuthology.orchestra.run.smithi039.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/stmicro 2024-09-12T02:15:50.703 INFO:teuthology.orchestra.run.smithi039.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/stmicro/stmmac 2024-09-12T02:15:50.703 INFO:teuthology.orchestra.run.smithi039.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/stmicro/stmmac/dwmac-intel.ko 2024-09-12T02:15:50.703 INFO:teuthology.orchestra.run.smithi039.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/stmicro/stmmac/stmmac.ko 2024-09-12T02:15:50.703 INFO:teuthology.orchestra.run.smithi039.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/sun 2024-09-12T02:15:50.703 INFO:teuthology.orchestra.run.smithi039.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/sun/cassini.ko 2024-09-12T02:15:50.703 INFO:teuthology.orchestra.run.smithi039.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/sun/niu.ko 2024-09-12T02:15:50.703 INFO:teuthology.orchestra.run.smithi039.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/sun/sungem.ko 2024-09-12T02:15:50.703 INFO:teuthology.orchestra.run.smithi039.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/sun/sunhme.ko 2024-09-12T02:15:50.703 INFO:teuthology.orchestra.run.smithi039.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/tehuti 2024-09-12T02:15:50.704 INFO:teuthology.orchestra.run.smithi039.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/tehuti/tehuti.ko 2024-09-12T02:15:50.704 INFO:teuthology.orchestra.run.smithi039.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/ti 2024-09-12T02:15:50.704 INFO:teuthology.orchestra.run.smithi039.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/ti/tlan.ko 2024-09-12T02:15:50.704 INFO:teuthology.orchestra.run.smithi039.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/via 2024-09-12T02:15:50.704 INFO:teuthology.orchestra.run.smithi039.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/via/via-rhine.ko 2024-09-12T02:15:50.704 INFO:teuthology.orchestra.run.smithi039.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/via/via-velocity.ko 2024-09-12T02:15:50.704 INFO:teuthology.orchestra.run.smithi039.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/wiznet 2024-09-12T02:15:50.704 INFO:teuthology.orchestra.run.smithi039.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/wiznet/w5100.ko 2024-09-12T02:15:50.704 INFO:teuthology.orchestra.run.smithi039.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/wiznet/w5300.ko 2024-09-12T02:15:50.704 INFO:teuthology.orchestra.run.smithi039.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/xircom 2024-09-12T02:15:50.704 INFO:teuthology.orchestra.run.smithi039.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/xircom/xirc2ps_cs.ko 2024-09-12T02:15:50.704 INFO:teuthology.orchestra.run.smithi039.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/geneve.ko 2024-09-12T02:15:50.705 INFO:teuthology.orchestra.run.smithi039.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/hyperv 2024-09-12T02:15:50.705 INFO:teuthology.orchestra.run.smithi039.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/hyperv/hv_netvsc.ko 2024-09-12T02:15:50.705 INFO:teuthology.orchestra.run.smithi039.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ieee802154 2024-09-12T02:15:50.705 INFO:teuthology.orchestra.run.smithi039.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ieee802154/fakelb.ko 2024-09-12T02:15:50.705 INFO:teuthology.orchestra.run.smithi039.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ifb.ko 2024-09-12T02:15:50.705 INFO:teuthology.orchestra.run.smithi039.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ipvlan 2024-09-12T02:15:50.705 INFO:teuthology.orchestra.run.smithi039.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ipvlan/ipvlan.ko 2024-09-12T02:15:50.705 INFO:teuthology.orchestra.run.smithi039.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/macvlan.ko 2024-09-12T02:15:50.705 INFO:teuthology.orchestra.run.smithi039.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/macvtap.ko 2024-09-12T02:15:50.705 INFO:teuthology.orchestra.run.smithi039.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/mdio 2024-09-12T02:15:50.705 INFO:teuthology.orchestra.run.smithi039.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/mdio.ko 2024-09-12T02:15:50.705 INFO:teuthology.orchestra.run.smithi039.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/mdio/mdio-bcm-unimac.ko 2024-09-12T02:15:50.706 INFO:teuthology.orchestra.run.smithi039.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/mdio/mdio-bitbang.ko 2024-09-12T02:15:50.706 INFO:teuthology.orchestra.run.smithi039.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/mdio/mdio-regmap.ko 2024-09-12T02:15:50.706 INFO:teuthology.orchestra.run.smithi039.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/mii.ko 2024-09-12T02:15:50.706 INFO:teuthology.orchestra.run.smithi039.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/net_failover.ko 2024-09-12T02:15:50.706 INFO:teuthology.orchestra.run.smithi039.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/netconsole.ko 2024-09-12T02:15:50.706 INFO:teuthology.orchestra.run.smithi039.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/nlmon.ko 2024-09-12T02:15:50.706 INFO:teuthology.orchestra.run.smithi039.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/pcs 2024-09-12T02:15:50.706 INFO:teuthology.orchestra.run.smithi039.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/pcs/pcs-lynx.ko 2024-09-12T02:15:50.706 INFO:teuthology.orchestra.run.smithi039.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/pcs/pcs_xpcs.ko 2024-09-12T02:15:50.706 INFO:teuthology.orchestra.run.smithi039.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/phy 2024-09-12T02:15:50.706 INFO:teuthology.orchestra.run.smithi039.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/phy/amd.ko 2024-09-12T02:15:50.706 INFO:teuthology.orchestra.run.smithi039.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/phy/bcm-phy-lib.ko 2024-09-12T02:15:50.707 INFO:teuthology.orchestra.run.smithi039.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/phy/bcm-phy-ptp.ko 2024-09-12T02:15:50.707 INFO:teuthology.orchestra.run.smithi039.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/phy/bcm7xxx.ko 2024-09-12T02:15:50.707 INFO:teuthology.orchestra.run.smithi039.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/phy/bcm87xx.ko 2024-09-12T02:15:50.707 INFO:teuthology.orchestra.run.smithi039.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/phy/broadcom.ko 2024-09-12T02:15:50.707 INFO:teuthology.orchestra.run.smithi039.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/phy/cicada.ko 2024-09-12T02:15:50.707 INFO:teuthology.orchestra.run.smithi039.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/phy/davicom.ko 2024-09-12T02:15:50.707 INFO:teuthology.orchestra.run.smithi039.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/phy/dp83640.ko 2024-09-12T02:15:50.707 INFO:teuthology.orchestra.run.smithi039.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/phy/et1011c.ko 2024-09-12T02:15:50.707 INFO:teuthology.orchestra.run.smithi039.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/phy/icplus.ko 2024-09-12T02:15:50.707 INFO:teuthology.orchestra.run.smithi039.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/phy/lxt.ko 2024-09-12T02:15:50.707 INFO:teuthology.orchestra.run.smithi039.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/phy/marvell.ko 2024-09-12T02:15:50.708 INFO:teuthology.orchestra.run.smithi039.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/phy/micrel.ko 2024-09-12T02:15:50.708 INFO:teuthology.orchestra.run.smithi039.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/phy/national.ko 2024-09-12T02:15:50.708 INFO:teuthology.orchestra.run.smithi039.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/phy/phylink.ko 2024-09-12T02:15:50.708 INFO:teuthology.orchestra.run.smithi039.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/phy/qsemi.ko 2024-09-12T02:15:50.708 INFO:teuthology.orchestra.run.smithi039.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/phy/realtek.ko 2024-09-12T02:15:50.708 INFO:teuthology.orchestra.run.smithi039.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/phy/smsc.ko 2024-09-12T02:15:50.708 INFO:teuthology.orchestra.run.smithi039.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/phy/ste10Xp.ko 2024-09-12T02:15:50.708 INFO:teuthology.orchestra.run.smithi039.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/phy/vitesse.ko 2024-09-12T02:15:50.708 INFO:teuthology.orchestra.run.smithi039.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ppp 2024-09-12T02:15:50.708 INFO:teuthology.orchestra.run.smithi039.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ppp/bsd_comp.ko 2024-09-12T02:15:50.708 INFO:teuthology.orchestra.run.smithi039.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ppp/ppp_async.ko 2024-09-12T02:15:50.708 INFO:teuthology.orchestra.run.smithi039.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ppp/ppp_deflate.ko 2024-09-12T02:15:50.709 INFO:teuthology.orchestra.run.smithi039.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ppp/ppp_generic.ko 2024-09-12T02:15:50.709 INFO:teuthology.orchestra.run.smithi039.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ppp/ppp_mppe.ko 2024-09-12T02:15:50.709 INFO:teuthology.orchestra.run.smithi039.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ppp/ppp_synctty.ko 2024-09-12T02:15:50.709 INFO:teuthology.orchestra.run.smithi039.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ppp/pppoe.ko 2024-09-12T02:15:50.709 INFO:teuthology.orchestra.run.smithi039.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ppp/pppox.ko 2024-09-12T02:15:50.709 INFO:teuthology.orchestra.run.smithi039.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ppp/pptp.ko 2024-09-12T02:15:50.709 INFO:teuthology.orchestra.run.smithi039.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/slip 2024-09-12T02:15:50.709 INFO:teuthology.orchestra.run.smithi039.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/slip/slhc.ko 2024-09-12T02:15:50.709 INFO:teuthology.orchestra.run.smithi039.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/slip/slip.ko 2024-09-12T02:15:50.709 INFO:teuthology.orchestra.run.smithi039.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/sungem_phy.ko 2024-09-12T02:15:50.710 INFO:teuthology.orchestra.run.smithi039.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/tap.ko 2024-09-12T02:15:50.710 INFO:teuthology.orchestra.run.smithi039.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/team 2024-09-12T02:15:50.710 INFO:teuthology.orchestra.run.smithi039.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/team/team.ko 2024-09-12T02:15:50.710 INFO:teuthology.orchestra.run.smithi039.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/team/team_mode_activebackup.ko 2024-09-12T02:15:50.710 INFO:teuthology.orchestra.run.smithi039.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/team/team_mode_broadcast.ko 2024-09-12T02:15:50.710 INFO:teuthology.orchestra.run.smithi039.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/team/team_mode_loadbalance.ko 2024-09-12T02:15:50.710 INFO:teuthology.orchestra.run.smithi039.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/team/team_mode_random.ko 2024-09-12T02:15:50.710 INFO:teuthology.orchestra.run.smithi039.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/team/team_mode_roundrobin.ko 2024-09-12T02:15:50.710 INFO:teuthology.orchestra.run.smithi039.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/tun.ko 2024-09-12T02:15:50.710 INFO:teuthology.orchestra.run.smithi039.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/veth.ko 2024-09-12T02:15:50.710 INFO:teuthology.orchestra.run.smithi039.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/virtio_net.ko 2024-09-12T02:15:50.711 INFO:teuthology.orchestra.run.smithi039.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/vmxnet3 2024-09-12T02:15:50.711 INFO:teuthology.orchestra.run.smithi039.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/vmxnet3/vmxnet3.ko 2024-09-12T02:15:50.711 INFO:teuthology.orchestra.run.smithi039.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/vxlan 2024-09-12T02:15:50.711 INFO:teuthology.orchestra.run.smithi039.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/vxlan/vxlan.ko 2024-09-12T02:15:50.711 INFO:teuthology.orchestra.run.smithi039.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/xen-netback 2024-09-12T02:15:50.711 INFO:teuthology.orchestra.run.smithi039.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/xen-netback/xen-netback.ko 2024-09-12T02:15:50.711 INFO:teuthology.orchestra.run.smithi039.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/xen-netfront.ko 2024-09-12T02:15:50.711 INFO:teuthology.orchestra.run.smithi039.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ntb 2024-09-12T02:15:50.711 INFO:teuthology.orchestra.run.smithi039.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ntb/ntb.ko 2024-09-12T02:15:50.711 INFO:teuthology.orchestra.run.smithi039.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/nvme 2024-09-12T02:15:50.711 INFO:teuthology.orchestra.run.smithi039.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/nvme/host 2024-09-12T02:15:50.711 INFO:teuthology.orchestra.run.smithi039.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/nvme/host/nvme-core.ko 2024-09-12T02:15:50.711 INFO:teuthology.orchestra.run.smithi039.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/nvme/host/nvme.ko 2024-09-12T02:15:50.712 INFO:teuthology.orchestra.run.smithi039.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/parport 2024-09-12T02:15:50.712 INFO:teuthology.orchestra.run.smithi039.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/parport/parport.ko 2024-09-12T02:15:50.712 INFO:teuthology.orchestra.run.smithi039.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/parport/parport_cs.ko 2024-09-12T02:15:50.712 INFO:teuthology.orchestra.run.smithi039.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/parport/parport_pc.ko 2024-09-12T02:15:50.712 INFO:teuthology.orchestra.run.smithi039.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/parport/parport_serial.ko 2024-09-12T02:15:50.712 INFO:teuthology.orchestra.run.smithi039.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/pci 2024-09-12T02:15:50.712 INFO:teuthology.orchestra.run.smithi039.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/pci/hotplug 2024-09-12T02:15:50.712 INFO:teuthology.orchestra.run.smithi039.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/pci/hotplug/acpiphp_ibm.ko 2024-09-12T02:15:50.712 INFO:teuthology.orchestra.run.smithi039.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/pci/pcie 2024-09-12T02:15:50.712 INFO:teuthology.orchestra.run.smithi039.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/pci/pcie/aer_inject.ko 2024-09-12T02:15:50.712 INFO:teuthology.orchestra.run.smithi039.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/pci/xen-pcifront.ko 2024-09-12T02:15:50.712 INFO:teuthology.orchestra.run.smithi039.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/pcmcia 2024-09-12T02:15:50.712 INFO:teuthology.orchestra.run.smithi039.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/pcmcia/i82092.ko 2024-09-12T02:15:50.713 INFO:teuthology.orchestra.run.smithi039.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/pcmcia/pd6729.ko 2024-09-12T02:15:50.713 INFO:teuthology.orchestra.run.smithi039.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/pcmcia/yenta_socket.ko 2024-09-12T02:15:50.713 INFO:teuthology.orchestra.run.smithi039.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/pinctrl 2024-09-12T02:15:50.713 INFO:teuthology.orchestra.run.smithi039.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/pinctrl/intel 2024-09-12T02:15:50.713 INFO:teuthology.orchestra.run.smithi039.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/pinctrl/intel/pinctrl-cherryview.ko 2024-09-12T02:15:50.713 INFO:teuthology.orchestra.run.smithi039.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/platform 2024-09-12T02:15:50.713 INFO:teuthology.orchestra.run.smithi039.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/platform/x86 2024-09-12T02:15:50.713 INFO:teuthology.orchestra.run.smithi039.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/platform/x86/acer-wmi.ko 2024-09-12T02:15:50.713 INFO:teuthology.orchestra.run.smithi039.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/platform/x86/acerhdf.ko 2024-09-12T02:15:50.713 INFO:teuthology.orchestra.run.smithi039.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/platform/x86/apple-gmux.ko 2024-09-12T02:15:50.713 INFO:teuthology.orchestra.run.smithi039.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/platform/x86/asus-laptop.ko 2024-09-12T02:15:50.713 INFO:teuthology.orchestra.run.smithi039.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/platform/x86/asus-nb-wmi.ko 2024-09-12T02:15:50.713 INFO:teuthology.orchestra.run.smithi039.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/platform/x86/asus-wmi.ko 2024-09-12T02:15:50.714 INFO:teuthology.orchestra.run.smithi039.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/platform/x86/classmate-laptop.ko 2024-09-12T02:15:50.714 INFO:teuthology.orchestra.run.smithi039.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/platform/x86/eeepc-laptop.ko 2024-09-12T02:15:50.714 INFO:teuthology.orchestra.run.smithi039.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/platform/x86/eeepc-wmi.ko 2024-09-12T02:15:50.714 INFO:teuthology.orchestra.run.smithi039.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/platform/x86/fujitsu-laptop.ko 2024-09-12T02:15:50.714 INFO:teuthology.orchestra.run.smithi039.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/platform/x86/fujitsu-tablet.ko 2024-09-12T02:15:50.714 INFO:teuthology.orchestra.run.smithi039.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/platform/x86/hdaps.ko 2024-09-12T02:15:50.714 INFO:teuthology.orchestra.run.smithi039.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/platform/x86/intel 2024-09-12T02:15:50.714 INFO:teuthology.orchestra.run.smithi039.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/platform/x86/intel/intel-rst.ko 2024-09-12T02:15:50.714 INFO:teuthology.orchestra.run.smithi039.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/platform/x86/intel_ips.ko 2024-09-12T02:15:50.714 INFO:teuthology.orchestra.run.smithi039.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/platform/x86/msi-wmi.ko 2024-09-12T02:15:50.714 INFO:teuthology.orchestra.run.smithi039.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/platform/x86/mxm-wmi.ko 2024-09-12T02:15:50.714 INFO:teuthology.orchestra.run.smithi039.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/platform/x86/panasonic-laptop.ko 2024-09-12T02:15:50.714 INFO:teuthology.orchestra.run.smithi039.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/platform/x86/samsung-laptop.ko 2024-09-12T02:15:50.715 INFO:teuthology.orchestra.run.smithi039.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/platform/x86/samsung-q10.ko 2024-09-12T02:15:50.715 INFO:teuthology.orchestra.run.smithi039.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/platform/x86/topstar-laptop.ko 2024-09-12T02:15:50.715 INFO:teuthology.orchestra.run.smithi039.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/platform/x86/toshiba_bluetooth.ko 2024-09-12T02:15:50.715 INFO:teuthology.orchestra.run.smithi039.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/platform/x86/toshiba_haps.ko 2024-09-12T02:15:50.715 INFO:teuthology.orchestra.run.smithi039.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/platform/x86/wmi-bmof.ko 2024-09-12T02:15:50.715 INFO:teuthology.orchestra.run.smithi039.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/platform/x86/wmi.ko 2024-09-12T02:15:50.715 INFO:teuthology.orchestra.run.smithi039.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/powercap 2024-09-12T02:15:50.715 INFO:teuthology.orchestra.run.smithi039.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/powercap/intel_rapl_common.ko 2024-09-12T02:15:50.715 INFO:teuthology.orchestra.run.smithi039.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/powercap/intel_rapl_msr.ko 2024-09-12T02:15:50.715 INFO:teuthology.orchestra.run.smithi039.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/pps 2024-09-12T02:15:50.715 INFO:teuthology.orchestra.run.smithi039.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/pps/clients 2024-09-12T02:15:50.715 INFO:teuthology.orchestra.run.smithi039.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/pps/clients/pps-gpio.ko 2024-09-12T02:15:50.715 INFO:teuthology.orchestra.run.smithi039.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/pps/clients/pps-ldisc.ko 2024-09-12T02:15:50.716 INFO:teuthology.orchestra.run.smithi039.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/pps/clients/pps_parport.ko 2024-09-12T02:15:50.716 INFO:teuthology.orchestra.run.smithi039.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/pps/pps_core.ko 2024-09-12T02:15:50.716 INFO:teuthology.orchestra.run.smithi039.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ptp 2024-09-12T02:15:50.716 INFO:teuthology.orchestra.run.smithi039.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ptp/ptp.ko 2024-09-12T02:15:50.716 INFO:teuthology.orchestra.run.smithi039.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ptp/ptp_kvm.ko 2024-09-12T02:15:50.716 INFO:teuthology.orchestra.run.smithi039.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ras 2024-09-12T02:15:50.716 INFO:teuthology.orchestra.run.smithi039.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ras/amd 2024-09-12T02:15:50.716 INFO:teuthology.orchestra.run.smithi039.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ras/amd/atl 2024-09-12T02:15:50.716 INFO:teuthology.orchestra.run.smithi039.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ras/amd/atl/amd_atl.ko 2024-09-12T02:15:50.716 INFO:teuthology.orchestra.run.smithi039.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ras/amd/fmpm.ko 2024-09-12T02:15:50.716 INFO:teuthology.orchestra.run.smithi039.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/rtc 2024-09-12T02:15:50.716 INFO:teuthology.orchestra.run.smithi039.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/rtc/rtc-bq32k.ko 2024-09-12T02:15:50.716 INFO:teuthology.orchestra.run.smithi039.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/rtc/rtc-ds1286.ko 2024-09-12T02:15:50.717 INFO:teuthology.orchestra.run.smithi039.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/rtc/rtc-ds1307.ko 2024-09-12T02:15:50.717 INFO:teuthology.orchestra.run.smithi039.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/rtc/rtc-ds1374.ko 2024-09-12T02:15:50.717 INFO:teuthology.orchestra.run.smithi039.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/rtc/rtc-ds1511.ko 2024-09-12T02:15:50.717 INFO:teuthology.orchestra.run.smithi039.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/rtc/rtc-ds1553.ko 2024-09-12T02:15:50.717 INFO:teuthology.orchestra.run.smithi039.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/rtc/rtc-ds1672.ko 2024-09-12T02:15:50.717 INFO:teuthology.orchestra.run.smithi039.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/rtc/rtc-ds1742.ko 2024-09-12T02:15:50.717 INFO:teuthology.orchestra.run.smithi039.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/rtc/rtc-ds2404.ko 2024-09-12T02:15:50.717 INFO:teuthology.orchestra.run.smithi039.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/rtc/rtc-ds3232.ko 2024-09-12T02:15:50.717 INFO:teuthology.orchestra.run.smithi039.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/rtc/rtc-em3027.ko 2024-09-12T02:15:50.717 INFO:teuthology.orchestra.run.smithi039.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/rtc/rtc-fm3130.ko 2024-09-12T02:15:50.717 INFO:teuthology.orchestra.run.smithi039.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/rtc/rtc-isl12022.ko 2024-09-12T02:15:50.717 INFO:teuthology.orchestra.run.smithi039.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/rtc/rtc-isl1208.ko 2024-09-12T02:15:50.717 INFO:teuthology.orchestra.run.smithi039.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/rtc/rtc-m41t80.ko 2024-09-12T02:15:50.718 INFO:teuthology.orchestra.run.smithi039.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/rtc/rtc-m48t35.ko 2024-09-12T02:15:50.718 INFO:teuthology.orchestra.run.smithi039.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/rtc/rtc-m48t59.ko 2024-09-12T02:15:50.718 INFO:teuthology.orchestra.run.smithi039.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/rtc/rtc-max6900.ko 2024-09-12T02:15:50.718 INFO:teuthology.orchestra.run.smithi039.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/rtc/rtc-msm6242.ko 2024-09-12T02:15:50.718 INFO:teuthology.orchestra.run.smithi039.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/rtc/rtc-pcf2127.ko 2024-09-12T02:15:50.718 INFO:teuthology.orchestra.run.smithi039.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/rtc/rtc-pcf85063.ko 2024-09-12T02:15:50.718 INFO:teuthology.orchestra.run.smithi039.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/rtc/rtc-pcf8523.ko 2024-09-12T02:15:50.718 INFO:teuthology.orchestra.run.smithi039.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/rtc/rtc-pcf8563.ko 2024-09-12T02:15:50.718 INFO:teuthology.orchestra.run.smithi039.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/rtc/rtc-pcf8583.ko 2024-09-12T02:15:50.718 INFO:teuthology.orchestra.run.smithi039.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/rtc/rtc-rp5c01.ko 2024-09-12T02:15:50.718 INFO:teuthology.orchestra.run.smithi039.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/rtc/rtc-rs5c372.ko 2024-09-12T02:15:50.718 INFO:teuthology.orchestra.run.smithi039.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/rtc/rtc-rv3029c2.ko 2024-09-12T02:15:50.719 INFO:teuthology.orchestra.run.smithi039.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/rtc/rtc-rx8025.ko 2024-09-12T02:15:50.719 INFO:teuthology.orchestra.run.smithi039.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/rtc/rtc-rx8581.ko 2024-09-12T02:15:50.719 INFO:teuthology.orchestra.run.smithi039.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/rtc/rtc-stk17ta8.ko 2024-09-12T02:15:50.719 INFO:teuthology.orchestra.run.smithi039.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/rtc/rtc-x1205.ko 2024-09-12T02:15:50.719 INFO:teuthology.orchestra.run.smithi039.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi 2024-09-12T02:15:50.719 INFO:teuthology.orchestra.run.smithi039.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/3w-9xxx.ko 2024-09-12T02:15:50.719 INFO:teuthology.orchestra.run.smithi039.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/3w-sas.ko 2024-09-12T02:15:50.719 INFO:teuthology.orchestra.run.smithi039.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/3w-xxxx.ko 2024-09-12T02:15:50.719 INFO:teuthology.orchestra.run.smithi039.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/BusLogic.ko 2024-09-12T02:15:50.719 INFO:teuthology.orchestra.run.smithi039.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/a100u2w.ko 2024-09-12T02:15:50.719 INFO:teuthology.orchestra.run.smithi039.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/aacraid 2024-09-12T02:15:50.719 INFO:teuthology.orchestra.run.smithi039.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/aacraid/aacraid.ko 2024-09-12T02:15:50.719 INFO:teuthology.orchestra.run.smithi039.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/advansys.ko 2024-09-12T02:15:50.720 INFO:teuthology.orchestra.run.smithi039.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/aic7xxx 2024-09-12T02:15:50.720 INFO:teuthology.orchestra.run.smithi039.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/aic7xxx/aic79xx.ko 2024-09-12T02:15:50.720 INFO:teuthology.orchestra.run.smithi039.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/aic7xxx/aic7xxx.ko 2024-09-12T02:15:50.720 INFO:teuthology.orchestra.run.smithi039.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/am53c974.ko 2024-09-12T02:15:50.720 INFO:teuthology.orchestra.run.smithi039.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/arcmsr 2024-09-12T02:15:50.720 INFO:teuthology.orchestra.run.smithi039.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/arcmsr/arcmsr.ko 2024-09-12T02:15:50.720 INFO:teuthology.orchestra.run.smithi039.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/atp870u.ko 2024-09-12T02:15:50.720 INFO:teuthology.orchestra.run.smithi039.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/be2iscsi 2024-09-12T02:15:50.720 INFO:teuthology.orchestra.run.smithi039.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/be2iscsi/be2iscsi.ko 2024-09-12T02:15:50.720 INFO:teuthology.orchestra.run.smithi039.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/bfa 2024-09-12T02:15:50.720 INFO:teuthology.orchestra.run.smithi039.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/bfa/bfa.ko 2024-09-12T02:15:50.720 INFO:teuthology.orchestra.run.smithi039.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/bnx2fc 2024-09-12T02:15:50.720 INFO:teuthology.orchestra.run.smithi039.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/bnx2fc/bnx2fc.ko 2024-09-12T02:15:50.721 INFO:teuthology.orchestra.run.smithi039.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/bnx2i 2024-09-12T02:15:50.721 INFO:teuthology.orchestra.run.smithi039.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/bnx2i/bnx2i.ko 2024-09-12T02:15:50.721 INFO:teuthology.orchestra.run.smithi039.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/ch.ko 2024-09-12T02:15:50.721 INFO:teuthology.orchestra.run.smithi039.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/csiostor 2024-09-12T02:15:50.721 INFO:teuthology.orchestra.run.smithi039.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/csiostor/csiostor.ko 2024-09-12T02:15:50.721 INFO:teuthology.orchestra.run.smithi039.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/cxgbi 2024-09-12T02:15:50.721 INFO:teuthology.orchestra.run.smithi039.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/cxgbi/cxgb3i 2024-09-12T02:15:50.721 INFO:teuthology.orchestra.run.smithi039.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/cxgbi/cxgb3i/cxgb3i.ko 2024-09-12T02:15:50.721 INFO:teuthology.orchestra.run.smithi039.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/cxgbi/cxgb4i 2024-09-12T02:15:50.721 INFO:teuthology.orchestra.run.smithi039.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/cxgbi/cxgb4i/cxgb4i.ko 2024-09-12T02:15:50.721 INFO:teuthology.orchestra.run.smithi039.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/cxgbi/libcxgbi.ko 2024-09-12T02:15:50.721 INFO:teuthology.orchestra.run.smithi039.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/dc395x.ko 2024-09-12T02:15:50.722 INFO:teuthology.orchestra.run.smithi039.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/device_handler 2024-09-12T02:15:50.722 INFO:teuthology.orchestra.run.smithi039.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/device_handler/scsi_dh_alua.ko 2024-09-12T02:15:50.722 INFO:teuthology.orchestra.run.smithi039.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/device_handler/scsi_dh_emc.ko 2024-09-12T02:15:50.722 INFO:teuthology.orchestra.run.smithi039.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/device_handler/scsi_dh_hp_sw.ko 2024-09-12T02:15:50.722 INFO:teuthology.orchestra.run.smithi039.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/device_handler/scsi_dh_rdac.ko 2024-09-12T02:15:50.722 INFO:teuthology.orchestra.run.smithi039.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/dmx3191d.ko 2024-09-12T02:15:50.722 INFO:teuthology.orchestra.run.smithi039.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/esas2r 2024-09-12T02:15:50.722 INFO:teuthology.orchestra.run.smithi039.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/esas2r/esas2r.ko 2024-09-12T02:15:50.722 INFO:teuthology.orchestra.run.smithi039.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/esp_scsi.ko 2024-09-12T02:15:50.722 INFO:teuthology.orchestra.run.smithi039.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/fcoe 2024-09-12T02:15:50.722 INFO:teuthology.orchestra.run.smithi039.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/fcoe/fcoe.ko 2024-09-12T02:15:50.723 INFO:teuthology.orchestra.run.smithi039.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/fcoe/libfcoe.ko 2024-09-12T02:15:50.723 INFO:teuthology.orchestra.run.smithi039.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/fnic 2024-09-12T02:15:50.723 INFO:teuthology.orchestra.run.smithi039.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/fnic/fnic.ko 2024-09-12T02:15:50.723 INFO:teuthology.orchestra.run.smithi039.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/hpsa.ko 2024-09-12T02:15:50.723 INFO:teuthology.orchestra.run.smithi039.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/hptiop.ko 2024-09-12T02:15:50.723 INFO:teuthology.orchestra.run.smithi039.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/hv_storvsc.ko 2024-09-12T02:15:50.723 INFO:teuthology.orchestra.run.smithi039.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/initio.ko 2024-09-12T02:15:50.723 INFO:teuthology.orchestra.run.smithi039.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/ipr.ko 2024-09-12T02:15:50.723 INFO:teuthology.orchestra.run.smithi039.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/ips.ko 2024-09-12T02:15:50.723 INFO:teuthology.orchestra.run.smithi039.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/isci 2024-09-12T02:15:50.723 INFO:teuthology.orchestra.run.smithi039.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/isci/isci.ko 2024-09-12T02:15:50.723 INFO:teuthology.orchestra.run.smithi039.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/iscsi_boot_sysfs.ko 2024-09-12T02:15:50.723 INFO:teuthology.orchestra.run.smithi039.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/iscsi_tcp.ko 2024-09-12T02:15:50.724 INFO:teuthology.orchestra.run.smithi039.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/libfc 2024-09-12T02:15:50.724 INFO:teuthology.orchestra.run.smithi039.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/libfc/libfc.ko 2024-09-12T02:15:50.724 INFO:teuthology.orchestra.run.smithi039.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/libiscsi.ko 2024-09-12T02:15:50.724 INFO:teuthology.orchestra.run.smithi039.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/libiscsi_tcp.ko 2024-09-12T02:15:50.724 INFO:teuthology.orchestra.run.smithi039.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/libsas 2024-09-12T02:15:50.724 INFO:teuthology.orchestra.run.smithi039.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/libsas/libsas.ko 2024-09-12T02:15:50.724 INFO:teuthology.orchestra.run.smithi039.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/lpfc 2024-09-12T02:15:50.724 INFO:teuthology.orchestra.run.smithi039.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/lpfc/lpfc.ko 2024-09-12T02:15:50.724 INFO:teuthology.orchestra.run.smithi039.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/megaraid 2024-09-12T02:15:50.724 INFO:teuthology.orchestra.run.smithi039.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/megaraid.ko 2024-09-12T02:15:50.724 INFO:teuthology.orchestra.run.smithi039.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/megaraid/megaraid_mbox.ko 2024-09-12T02:15:50.724 INFO:teuthology.orchestra.run.smithi039.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/megaraid/megaraid_mm.ko 2024-09-12T02:15:50.725 INFO:teuthology.orchestra.run.smithi039.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/megaraid/megaraid_sas.ko 2024-09-12T02:15:50.725 INFO:teuthology.orchestra.run.smithi039.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/mpt3sas 2024-09-12T02:15:50.725 INFO:teuthology.orchestra.run.smithi039.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/mpt3sas/mpt3sas.ko 2024-09-12T02:15:50.725 INFO:teuthology.orchestra.run.smithi039.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/mvsas 2024-09-12T02:15:50.725 INFO:teuthology.orchestra.run.smithi039.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/mvsas/mvsas.ko 2024-09-12T02:15:50.725 INFO:teuthology.orchestra.run.smithi039.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/mvumi.ko 2024-09-12T02:15:50.725 INFO:teuthology.orchestra.run.smithi039.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/pm8001 2024-09-12T02:15:50.725 INFO:teuthology.orchestra.run.smithi039.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/pm8001/pm80xx.ko 2024-09-12T02:15:50.725 INFO:teuthology.orchestra.run.smithi039.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/pmcraid.ko 2024-09-12T02:15:50.725 INFO:teuthology.orchestra.run.smithi039.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/qla1280.ko 2024-09-12T02:15:50.725 INFO:teuthology.orchestra.run.smithi039.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/qla2xxx 2024-09-12T02:15:50.726 INFO:teuthology.orchestra.run.smithi039.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/qla2xxx/qla2xxx.ko 2024-09-12T02:15:50.726 INFO:teuthology.orchestra.run.smithi039.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/qla2xxx/tcm_qla2xxx.ko 2024-09-12T02:15:50.726 INFO:teuthology.orchestra.run.smithi039.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/qla4xxx 2024-09-12T02:15:50.726 INFO:teuthology.orchestra.run.smithi039.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/qla4xxx/qla4xxx.ko 2024-09-12T02:15:50.726 INFO:teuthology.orchestra.run.smithi039.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/raid_class.ko 2024-09-12T02:15:50.726 INFO:teuthology.orchestra.run.smithi039.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/scsi_debug.ko 2024-09-12T02:15:50.726 INFO:teuthology.orchestra.run.smithi039.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/scsi_transport_fc.ko 2024-09-12T02:15:50.726 INFO:teuthology.orchestra.run.smithi039.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/scsi_transport_iscsi.ko 2024-09-12T02:15:50.726 INFO:teuthology.orchestra.run.smithi039.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/scsi_transport_sas.ko 2024-09-12T02:15:50.726 INFO:teuthology.orchestra.run.smithi039.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/scsi_transport_spi.ko 2024-09-12T02:15:50.726 INFO:teuthology.orchestra.run.smithi039.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/scsi_transport_srp.ko 2024-09-12T02:15:50.726 INFO:teuthology.orchestra.run.smithi039.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/ses.ko 2024-09-12T02:15:50.727 INFO:teuthology.orchestra.run.smithi039.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/st.ko 2024-09-12T02:15:50.727 INFO:teuthology.orchestra.run.smithi039.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/stex.ko 2024-09-12T02:15:50.727 INFO:teuthology.orchestra.run.smithi039.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/sym53c8xx_2 2024-09-12T02:15:50.727 INFO:teuthology.orchestra.run.smithi039.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/sym53c8xx_2/sym53c8xx.ko 2024-09-12T02:15:50.727 INFO:teuthology.orchestra.run.smithi039.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/virtio_scsi.ko 2024-09-12T02:15:50.727 INFO:teuthology.orchestra.run.smithi039.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/vmw_pvscsi.ko 2024-09-12T02:15:50.727 INFO:teuthology.orchestra.run.smithi039.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/wd719x.ko 2024-09-12T02:15:50.727 INFO:teuthology.orchestra.run.smithi039.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ssb 2024-09-12T02:15:50.727 INFO:teuthology.orchestra.run.smithi039.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ssb/ssb.ko 2024-09-12T02:15:50.727 INFO:teuthology.orchestra.run.smithi039.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/target 2024-09-12T02:15:50.727 INFO:teuthology.orchestra.run.smithi039.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/target/iscsi 2024-09-12T02:15:50.727 INFO:teuthology.orchestra.run.smithi039.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/target/iscsi/iscsi_target_mod.ko 2024-09-12T02:15:50.728 INFO:teuthology.orchestra.run.smithi039.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/target/loopback 2024-09-12T02:15:50.728 INFO:teuthology.orchestra.run.smithi039.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/target/loopback/tcm_loop.ko 2024-09-12T02:15:50.728 INFO:teuthology.orchestra.run.smithi039.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/target/target_core_file.ko 2024-09-12T02:15:50.728 INFO:teuthology.orchestra.run.smithi039.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/target/target_core_iblock.ko 2024-09-12T02:15:50.728 INFO:teuthology.orchestra.run.smithi039.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/target/target_core_mod.ko 2024-09-12T02:15:50.728 INFO:teuthology.orchestra.run.smithi039.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/target/target_core_pscsi.ko 2024-09-12T02:15:50.728 INFO:teuthology.orchestra.run.smithi039.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/target/target_core_user.ko 2024-09-12T02:15:50.728 INFO:teuthology.orchestra.run.smithi039.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/target/tcm_fc 2024-09-12T02:15:50.728 INFO:teuthology.orchestra.run.smithi039.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/target/tcm_fc/tcm_fc.ko 2024-09-12T02:15:50.728 INFO:teuthology.orchestra.run.smithi039.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/thermal 2024-09-12T02:15:50.728 INFO:teuthology.orchestra.run.smithi039.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/thermal/intel 2024-09-12T02:15:50.728 INFO:teuthology.orchestra.run.smithi039.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/thermal/intel/int340x_thermal 2024-09-12T02:15:50.729 INFO:teuthology.orchestra.run.smithi039.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/thermal/intel/int340x_thermal/acpi_thermal_rel.ko 2024-09-12T02:15:50.729 INFO:teuthology.orchestra.run.smithi039.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/thermal/intel/int340x_thermal/int3400_thermal.ko 2024-09-12T02:15:50.729 INFO:teuthology.orchestra.run.smithi039.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/thermal/intel/int340x_thermal/int3401_thermal.ko 2024-09-12T02:15:50.729 INFO:teuthology.orchestra.run.smithi039.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/thermal/intel/int340x_thermal/int3402_thermal.ko 2024-09-12T02:15:50.729 INFO:teuthology.orchestra.run.smithi039.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/thermal/intel/int340x_thermal/int3403_thermal.ko 2024-09-12T02:15:50.729 INFO:teuthology.orchestra.run.smithi039.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/thermal/intel/int340x_thermal/int340x_thermal_zone.ko 2024-09-12T02:15:50.729 INFO:teuthology.orchestra.run.smithi039.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_device.ko 2024-09-12T02:15:50.729 INFO:teuthology.orchestra.run.smithi039.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_device_pci.ko 2024-09-12T02:15:50.729 INFO:teuthology.orchestra.run.smithi039.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_device_pci_legacy.ko 2024-09-12T02:15:50.729 INFO:teuthology.orchestra.run.smithi039.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_mbox.ko 2024-09-12T02:15:50.729 INFO:teuthology.orchestra.run.smithi039.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_power_floor.ko 2024-09-12T02:15:50.729 INFO:teuthology.orchestra.run.smithi039.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_rapl.ko 2024-09-12T02:15:50.729 INFO:teuthology.orchestra.run.smithi039.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_rfim.ko 2024-09-12T02:15:50.730 INFO:teuthology.orchestra.run.smithi039.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_wt_hint.ko 2024-09-12T02:15:50.730 INFO:teuthology.orchestra.run.smithi039.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_wt_req.ko 2024-09-12T02:15:50.730 INFO:teuthology.orchestra.run.smithi039.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/thermal/intel/intel_soc_dts_iosf.ko 2024-09-12T02:15:50.730 INFO:teuthology.orchestra.run.smithi039.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/thermal/intel/intel_soc_dts_thermal.ko 2024-09-12T02:15:50.730 INFO:teuthology.orchestra.run.smithi039.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/thermal/intel/x86_pkg_temp_thermal.ko 2024-09-12T02:15:50.730 INFO:teuthology.orchestra.run.smithi039.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/tty 2024-09-12T02:15:50.730 INFO:teuthology.orchestra.run.smithi039.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/tty/ipwireless 2024-09-12T02:15:50.730 INFO:teuthology.orchestra.run.smithi039.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/tty/ipwireless/ipwireless.ko 2024-09-12T02:15:50.730 INFO:teuthology.orchestra.run.smithi039.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/tty/n_gsm.ko 2024-09-12T02:15:50.730 INFO:teuthology.orchestra.run.smithi039.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/tty/n_hdlc.ko 2024-09-12T02:15:50.730 INFO:teuthology.orchestra.run.smithi039.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/tty/nozomi.ko 2024-09-12T02:15:50.730 INFO:teuthology.orchestra.run.smithi039.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/tty/serial 2024-09-12T02:15:50.731 INFO:teuthology.orchestra.run.smithi039.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/tty/serial/8250 2024-09-12T02:15:50.731 INFO:teuthology.orchestra.run.smithi039.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/tty/serial/8250/serial_cs.ko 2024-09-12T02:15:50.731 INFO:teuthology.orchestra.run.smithi039.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/tty/serial/arc_uart.ko 2024-09-12T02:15:50.731 INFO:teuthology.orchestra.run.smithi039.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/tty/serial/jsm 2024-09-12T02:15:50.731 INFO:teuthology.orchestra.run.smithi039.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/tty/serial/jsm/jsm.ko 2024-09-12T02:15:50.731 INFO:teuthology.orchestra.run.smithi039.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ufs 2024-09-12T02:15:50.731 INFO:teuthology.orchestra.run.smithi039.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ufs/core 2024-09-12T02:15:50.731 INFO:teuthology.orchestra.run.smithi039.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ufs/core/ufshcd-core.ko 2024-09-12T02:15:50.731 INFO:teuthology.orchestra.run.smithi039.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ufs/host 2024-09-12T02:15:50.731 INFO:teuthology.orchestra.run.smithi039.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ufs/host/ufshcd-pci.ko 2024-09-12T02:15:50.731 INFO:teuthology.orchestra.run.smithi039.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/uio 2024-09-12T02:15:50.731 INFO:teuthology.orchestra.run.smithi039.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/uio/uio.ko 2024-09-12T02:15:50.731 INFO:teuthology.orchestra.run.smithi039.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/uio/uio_aec.ko 2024-09-12T02:15:50.732 INFO:teuthology.orchestra.run.smithi039.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/uio/uio_cif.ko 2024-09-12T02:15:50.732 INFO:teuthology.orchestra.run.smithi039.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/uio/uio_pci_generic.ko 2024-09-12T02:15:50.732 INFO:teuthology.orchestra.run.smithi039.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/uio/uio_sercos3.ko 2024-09-12T02:15:50.732 INFO:teuthology.orchestra.run.smithi039.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb 2024-09-12T02:15:50.732 INFO:teuthology.orchestra.run.smithi039.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/class 2024-09-12T02:15:50.732 INFO:teuthology.orchestra.run.smithi039.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/class/cdc-acm.ko 2024-09-12T02:15:50.732 INFO:teuthology.orchestra.run.smithi039.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/class/cdc-wdm.ko 2024-09-12T02:15:50.732 INFO:teuthology.orchestra.run.smithi039.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/class/usblp.ko 2024-09-12T02:15:50.732 INFO:teuthology.orchestra.run.smithi039.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/class/usbtmc.ko 2024-09-12T02:15:50.732 INFO:teuthology.orchestra.run.smithi039.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/host 2024-09-12T02:15:50.732 INFO:teuthology.orchestra.run.smithi039.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/host/sl811-hcd.ko 2024-09-12T02:15:50.732 INFO:teuthology.orchestra.run.smithi039.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/image 2024-09-12T02:15:50.733 INFO:teuthology.orchestra.run.smithi039.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/image/mdc800.ko 2024-09-12T02:15:50.733 INFO:teuthology.orchestra.run.smithi039.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/image/microtek.ko 2024-09-12T02:15:50.733 INFO:teuthology.orchestra.run.smithi039.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/misc 2024-09-12T02:15:50.733 INFO:teuthology.orchestra.run.smithi039.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/misc/adutux.ko 2024-09-12T02:15:50.733 INFO:teuthology.orchestra.run.smithi039.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/misc/appledisplay.ko 2024-09-12T02:15:50.733 INFO:teuthology.orchestra.run.smithi039.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/misc/emi26.ko 2024-09-12T02:15:50.733 INFO:teuthology.orchestra.run.smithi039.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/misc/emi62.ko 2024-09-12T02:15:50.733 INFO:teuthology.orchestra.run.smithi039.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/misc/ezusb.ko 2024-09-12T02:15:50.733 INFO:teuthology.orchestra.run.smithi039.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/misc/idmouse.ko 2024-09-12T02:15:50.733 INFO:teuthology.orchestra.run.smithi039.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/misc/iowarrior.ko 2024-09-12T02:15:50.733 INFO:teuthology.orchestra.run.smithi039.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/misc/isight_firmware.ko 2024-09-12T02:15:50.733 INFO:teuthology.orchestra.run.smithi039.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/misc/ldusb.ko 2024-09-12T02:15:50.733 INFO:teuthology.orchestra.run.smithi039.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/misc/legousbtower.ko 2024-09-12T02:15:50.734 INFO:teuthology.orchestra.run.smithi039.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/misc/sisusbvga 2024-09-12T02:15:50.734 INFO:teuthology.orchestra.run.smithi039.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/misc/sisusbvga/sisusbvga.ko 2024-09-12T02:15:50.734 INFO:teuthology.orchestra.run.smithi039.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/misc/trancevibrator.ko 2024-09-12T02:15:50.734 INFO:teuthology.orchestra.run.smithi039.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/misc/usb3503.ko 2024-09-12T02:15:50.734 INFO:teuthology.orchestra.run.smithi039.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/misc/usblcd.ko 2024-09-12T02:15:50.734 INFO:teuthology.orchestra.run.smithi039.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/misc/usbsevseg.ko 2024-09-12T02:15:50.734 INFO:teuthology.orchestra.run.smithi039.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/misc/uss720.ko 2024-09-12T02:15:50.734 INFO:teuthology.orchestra.run.smithi039.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/misc/yurex.ko 2024-09-12T02:15:50.734 INFO:teuthology.orchestra.run.smithi039.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/phy 2024-09-12T02:15:50.734 INFO:teuthology.orchestra.run.smithi039.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/phy/phy-generic.ko 2024-09-12T02:15:50.735 INFO:teuthology.orchestra.run.smithi039.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial 2024-09-12T02:15:50.735 INFO:teuthology.orchestra.run.smithi039.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/aircable.ko 2024-09-12T02:15:50.735 INFO:teuthology.orchestra.run.smithi039.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/ark3116.ko 2024-09-12T02:15:50.735 INFO:teuthology.orchestra.run.smithi039.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/belkin_sa.ko 2024-09-12T02:15:50.735 INFO:teuthology.orchestra.run.smithi039.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/ch341.ko 2024-09-12T02:15:50.735 INFO:teuthology.orchestra.run.smithi039.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/cp210x.ko 2024-09-12T02:15:50.735 INFO:teuthology.orchestra.run.smithi039.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/cyberjack.ko 2024-09-12T02:15:50.735 INFO:teuthology.orchestra.run.smithi039.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/cypress_m8.ko 2024-09-12T02:15:50.735 INFO:teuthology.orchestra.run.smithi039.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/digi_acceleport.ko 2024-09-12T02:15:50.735 INFO:teuthology.orchestra.run.smithi039.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/empeg.ko 2024-09-12T02:15:50.735 INFO:teuthology.orchestra.run.smithi039.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/ftdi_sio.ko 2024-09-12T02:15:50.736 INFO:teuthology.orchestra.run.smithi039.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/garmin_gps.ko 2024-09-12T02:15:50.736 INFO:teuthology.orchestra.run.smithi039.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/io_edgeport.ko 2024-09-12T02:15:50.736 INFO:teuthology.orchestra.run.smithi039.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/io_ti.ko 2024-09-12T02:15:50.736 INFO:teuthology.orchestra.run.smithi039.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/ipaq.ko 2024-09-12T02:15:50.736 INFO:teuthology.orchestra.run.smithi039.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/ipw.ko 2024-09-12T02:15:50.736 INFO:teuthology.orchestra.run.smithi039.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/ir-usb.ko 2024-09-12T02:15:50.736 INFO:teuthology.orchestra.run.smithi039.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/iuu_phoenix.ko 2024-09-12T02:15:50.736 INFO:teuthology.orchestra.run.smithi039.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/keyspan.ko 2024-09-12T02:15:50.736 INFO:teuthology.orchestra.run.smithi039.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/keyspan_pda.ko 2024-09-12T02:15:50.736 INFO:teuthology.orchestra.run.smithi039.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/kl5kusb105.ko 2024-09-12T02:15:50.736 INFO:teuthology.orchestra.run.smithi039.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/kobil_sct.ko 2024-09-12T02:15:50.736 INFO:teuthology.orchestra.run.smithi039.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/mct_u232.ko 2024-09-12T02:15:50.737 INFO:teuthology.orchestra.run.smithi039.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/mos7720.ko 2024-09-12T02:15:50.737 INFO:teuthology.orchestra.run.smithi039.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/mos7840.ko 2024-09-12T02:15:50.737 INFO:teuthology.orchestra.run.smithi039.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/navman.ko 2024-09-12T02:15:50.737 INFO:teuthology.orchestra.run.smithi039.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/omninet.ko 2024-09-12T02:15:50.737 INFO:teuthology.orchestra.run.smithi039.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/opticon.ko 2024-09-12T02:15:50.737 INFO:teuthology.orchestra.run.smithi039.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/option.ko 2024-09-12T02:15:50.737 INFO:teuthology.orchestra.run.smithi039.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/oti6858.ko 2024-09-12T02:15:50.737 INFO:teuthology.orchestra.run.smithi039.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/pl2303.ko 2024-09-12T02:15:50.737 INFO:teuthology.orchestra.run.smithi039.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/qcaux.ko 2024-09-12T02:15:50.737 INFO:teuthology.orchestra.run.smithi039.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/qcserial.ko 2024-09-12T02:15:50.737 INFO:teuthology.orchestra.run.smithi039.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/quatech2.ko 2024-09-12T02:15:50.738 INFO:teuthology.orchestra.run.smithi039.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/safe_serial.ko 2024-09-12T02:15:50.738 INFO:teuthology.orchestra.run.smithi039.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/sierra.ko 2024-09-12T02:15:50.738 INFO:teuthology.orchestra.run.smithi039.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/spcp8x5.ko 2024-09-12T02:15:50.738 INFO:teuthology.orchestra.run.smithi039.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/ssu100.ko 2024-09-12T02:15:50.738 INFO:teuthology.orchestra.run.smithi039.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/symbolserial.ko 2024-09-12T02:15:50.738 INFO:teuthology.orchestra.run.smithi039.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/ti_usb_3410_5052.ko 2024-09-12T02:15:50.738 INFO:teuthology.orchestra.run.smithi039.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/usb-serial-simple.ko 2024-09-12T02:15:50.738 INFO:teuthology.orchestra.run.smithi039.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/usb_debug.ko 2024-09-12T02:15:50.738 INFO:teuthology.orchestra.run.smithi039.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/usb_wwan.ko 2024-09-12T02:15:50.738 INFO:teuthology.orchestra.run.smithi039.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/visor.ko 2024-09-12T02:15:50.738 INFO:teuthology.orchestra.run.smithi039.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/whiteheat.ko 2024-09-12T02:15:50.738 INFO:teuthology.orchestra.run.smithi039.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/xsens_mt.ko 2024-09-12T02:15:50.738 INFO:teuthology.orchestra.run.smithi039.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/storage 2024-09-12T02:15:50.739 INFO:teuthology.orchestra.run.smithi039.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/storage/uas.ko 2024-09-12T02:15:50.739 INFO:teuthology.orchestra.run.smithi039.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/storage/ums-alauda.ko 2024-09-12T02:15:50.739 INFO:teuthology.orchestra.run.smithi039.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/storage/ums-cypress.ko 2024-09-12T02:15:50.739 INFO:teuthology.orchestra.run.smithi039.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/storage/ums-datafab.ko 2024-09-12T02:15:50.739 INFO:teuthology.orchestra.run.smithi039.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/storage/ums-eneub6250.ko 2024-09-12T02:15:50.739 INFO:teuthology.orchestra.run.smithi039.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/storage/ums-freecom.ko 2024-09-12T02:15:50.739 INFO:teuthology.orchestra.run.smithi039.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/storage/ums-isd200.ko 2024-09-12T02:15:50.739 INFO:teuthology.orchestra.run.smithi039.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/storage/ums-jumpshot.ko 2024-09-12T02:15:50.739 INFO:teuthology.orchestra.run.smithi039.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/storage/ums-karma.ko 2024-09-12T02:15:50.739 INFO:teuthology.orchestra.run.smithi039.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/storage/ums-onetouch.ko 2024-09-12T02:15:50.739 INFO:teuthology.orchestra.run.smithi039.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/storage/ums-realtek.ko 2024-09-12T02:15:50.740 INFO:teuthology.orchestra.run.smithi039.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/storage/ums-sddr09.ko 2024-09-12T02:15:50.740 INFO:teuthology.orchestra.run.smithi039.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/storage/ums-sddr55.ko 2024-09-12T02:15:50.740 INFO:teuthology.orchestra.run.smithi039.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/storage/ums-usbat.ko 2024-09-12T02:15:50.740 INFO:teuthology.orchestra.run.smithi039.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/storage/usb-storage.ko 2024-09-12T02:15:50.740 INFO:teuthology.orchestra.run.smithi039.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/usbip 2024-09-12T02:15:50.740 INFO:teuthology.orchestra.run.smithi039.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/usbip/usbip-core.ko 2024-09-12T02:15:50.740 INFO:teuthology.orchestra.run.smithi039.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/usbip/usbip-host.ko 2024-09-12T02:15:50.740 INFO:teuthology.orchestra.run.smithi039.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/usbip/vhci-hcd.ko 2024-09-12T02:15:50.740 INFO:teuthology.orchestra.run.smithi039.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/vfio 2024-09-12T02:15:50.740 INFO:teuthology.orchestra.run.smithi039.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/vfio/pci 2024-09-12T02:15:50.740 INFO:teuthology.orchestra.run.smithi039.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/vfio/pci/vfio-pci-core.ko 2024-09-12T02:15:50.740 INFO:teuthology.orchestra.run.smithi039.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/vfio/pci/vfio-pci.ko 2024-09-12T02:15:50.741 INFO:teuthology.orchestra.run.smithi039.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/vfio/vfio.ko 2024-09-12T02:15:50.741 INFO:teuthology.orchestra.run.smithi039.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/vfio/vfio_iommu_type1.ko 2024-09-12T02:15:50.741 INFO:teuthology.orchestra.run.smithi039.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/vhost 2024-09-12T02:15:50.741 INFO:teuthology.orchestra.run.smithi039.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/vhost/vhost.ko 2024-09-12T02:15:50.741 INFO:teuthology.orchestra.run.smithi039.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/vhost/vhost_iotlb.ko 2024-09-12T02:15:50.741 INFO:teuthology.orchestra.run.smithi039.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/vhost/vhost_net.ko 2024-09-12T02:15:50.741 INFO:teuthology.orchestra.run.smithi039.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/vhost/vhost_scsi.ko 2024-09-12T02:15:50.741 INFO:teuthology.orchestra.run.smithi039.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/video 2024-09-12T02:15:50.741 INFO:teuthology.orchestra.run.smithi039.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/video/backlight 2024-09-12T02:15:50.741 INFO:teuthology.orchestra.run.smithi039.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/video/backlight/apple_bl.ko 2024-09-12T02:15:50.741 INFO:teuthology.orchestra.run.smithi039.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/video/backlight/lcd.ko 2024-09-12T02:15:50.741 INFO:teuthology.orchestra.run.smithi039.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/video/backlight/platform_lcd.ko 2024-09-12T02:15:50.741 INFO:teuthology.orchestra.run.smithi039.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/virtio 2024-09-12T02:15:50.741 INFO:teuthology.orchestra.run.smithi039.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/virtio/virtio.ko 2024-09-12T02:15:50.742 INFO:teuthology.orchestra.run.smithi039.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/virtio/virtio_balloon.ko 2024-09-12T02:15:50.742 INFO:teuthology.orchestra.run.smithi039.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/virtio/virtio_mmio.ko 2024-09-12T02:15:50.742 INFO:teuthology.orchestra.run.smithi039.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/virtio/virtio_pci.ko 2024-09-12T02:15:50.742 INFO:teuthology.orchestra.run.smithi039.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/virtio/virtio_pci_legacy_dev.ko 2024-09-12T02:15:50.742 INFO:teuthology.orchestra.run.smithi039.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/virtio/virtio_pci_modern_dev.ko 2024-09-12T02:15:50.742 INFO:teuthology.orchestra.run.smithi039.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/virtio/virtio_ring.ko 2024-09-12T02:15:50.742 INFO:teuthology.orchestra.run.smithi039.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/w1 2024-09-12T02:15:50.742 INFO:teuthology.orchestra.run.smithi039.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/w1/masters 2024-09-12T02:15:50.742 INFO:teuthology.orchestra.run.smithi039.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/w1/masters/ds2482.ko 2024-09-12T02:15:50.742 INFO:teuthology.orchestra.run.smithi039.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/w1/masters/ds2490.ko 2024-09-12T02:15:50.742 INFO:teuthology.orchestra.run.smithi039.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/w1/slaves 2024-09-12T02:15:50.742 INFO:teuthology.orchestra.run.smithi039.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/w1/slaves/w1_ds2406.ko 2024-09-12T02:15:50.743 INFO:teuthology.orchestra.run.smithi039.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/w1/slaves/w1_ds2408.ko 2024-09-12T02:15:50.743 INFO:teuthology.orchestra.run.smithi039.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/w1/slaves/w1_ds2413.ko 2024-09-12T02:15:50.743 INFO:teuthology.orchestra.run.smithi039.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/w1/slaves/w1_ds2423.ko 2024-09-12T02:15:50.743 INFO:teuthology.orchestra.run.smithi039.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/w1/slaves/w1_ds2431.ko 2024-09-12T02:15:50.743 INFO:teuthology.orchestra.run.smithi039.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/w1/slaves/w1_ds2433.ko 2024-09-12T02:15:50.743 INFO:teuthology.orchestra.run.smithi039.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/w1/slaves/w1_ds2780.ko 2024-09-12T02:15:50.743 INFO:teuthology.orchestra.run.smithi039.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/w1/slaves/w1_ds2781.ko 2024-09-12T02:15:50.743 INFO:teuthology.orchestra.run.smithi039.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/w1/slaves/w1_ds28e04.ko 2024-09-12T02:15:50.743 INFO:teuthology.orchestra.run.smithi039.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/w1/slaves/w1_smem.ko 2024-09-12T02:15:50.743 INFO:teuthology.orchestra.run.smithi039.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/w1/slaves/w1_therm.ko 2024-09-12T02:15:50.743 INFO:teuthology.orchestra.run.smithi039.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/w1/wire.ko 2024-09-12T02:15:50.744 INFO:teuthology.orchestra.run.smithi039.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/watchdog 2024-09-12T02:15:50.744 INFO:teuthology.orchestra.run.smithi039.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/watchdog/alim1535_wdt.ko 2024-09-12T02:15:50.744 INFO:teuthology.orchestra.run.smithi039.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/watchdog/alim7101_wdt.ko 2024-09-12T02:15:50.744 INFO:teuthology.orchestra.run.smithi039.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/watchdog/f71808e_wdt.ko 2024-09-12T02:15:50.744 INFO:teuthology.orchestra.run.smithi039.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/watchdog/hpwdt.ko 2024-09-12T02:15:50.744 INFO:teuthology.orchestra.run.smithi039.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/watchdog/i6300esb.ko 2024-09-12T02:15:50.744 INFO:teuthology.orchestra.run.smithi039.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/watchdog/iTCO_vendor_support.ko 2024-09-12T02:15:50.744 INFO:teuthology.orchestra.run.smithi039.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/watchdog/iTCO_wdt.ko 2024-09-12T02:15:50.744 INFO:teuthology.orchestra.run.smithi039.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/watchdog/ib700wdt.ko 2024-09-12T02:15:50.744 INFO:teuthology.orchestra.run.smithi039.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/watchdog/ibmasr.ko 2024-09-12T02:15:50.744 INFO:teuthology.orchestra.run.smithi039.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/watchdog/ie6xx_wdt.ko 2024-09-12T02:15:50.744 INFO:teuthology.orchestra.run.smithi039.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/watchdog/it8712f_wdt.ko 2024-09-12T02:15:50.745 INFO:teuthology.orchestra.run.smithi039.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/watchdog/it87_wdt.ko 2024-09-12T02:15:50.745 INFO:teuthology.orchestra.run.smithi039.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/watchdog/machzwd.ko 2024-09-12T02:15:50.745 INFO:teuthology.orchestra.run.smithi039.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/watchdog/nv_tco.ko 2024-09-12T02:15:50.745 INFO:teuthology.orchestra.run.smithi039.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/watchdog/pcwd_pci.ko 2024-09-12T02:15:50.745 INFO:teuthology.orchestra.run.smithi039.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/watchdog/pcwd_usb.ko 2024-09-12T02:15:50.745 INFO:teuthology.orchestra.run.smithi039.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/watchdog/sbc_fitpc2_wdt.ko 2024-09-12T02:15:50.745 INFO:teuthology.orchestra.run.smithi039.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/watchdog/sch311x_wdt.ko 2024-09-12T02:15:50.745 INFO:teuthology.orchestra.run.smithi039.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/watchdog/softdog.ko 2024-09-12T02:15:50.745 INFO:teuthology.orchestra.run.smithi039.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/watchdog/sp5100_tco.ko 2024-09-12T02:15:50.745 INFO:teuthology.orchestra.run.smithi039.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/watchdog/via_wdt.ko 2024-09-12T02:15:50.745 INFO:teuthology.orchestra.run.smithi039.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/watchdog/w83627hf_wdt.ko 2024-09-12T02:15:50.746 INFO:teuthology.orchestra.run.smithi039.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/watchdog/w83877f_wdt.ko 2024-09-12T02:15:50.746 INFO:teuthology.orchestra.run.smithi039.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/watchdog/w83977f_wdt.ko 2024-09-12T02:15:50.746 INFO:teuthology.orchestra.run.smithi039.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/watchdog/wdt_pci.ko 2024-09-12T02:15:50.746 INFO:teuthology.orchestra.run.smithi039.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/watchdog/xen_wdt.ko 2024-09-12T02:15:50.746 INFO:teuthology.orchestra.run.smithi039.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/xen 2024-09-12T02:15:50.746 INFO:teuthology.orchestra.run.smithi039.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/xen/xen-acpi-processor.ko 2024-09-12T02:15:50.746 INFO:teuthology.orchestra.run.smithi039.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/xen/xen-evtchn.ko 2024-09-12T02:15:50.746 INFO:teuthology.orchestra.run.smithi039.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/xen/xen-gntalloc.ko 2024-09-12T02:15:50.746 INFO:teuthology.orchestra.run.smithi039.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/xen/xen-gntdev.ko 2024-09-12T02:15:50.746 INFO:teuthology.orchestra.run.smithi039.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/xen/xen-pciback 2024-09-12T02:15:50.746 INFO:teuthology.orchestra.run.smithi039.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/xen/xen-pciback/xen-pciback.ko 2024-09-12T02:15:50.746 INFO:teuthology.orchestra.run.smithi039.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/xen/xen-privcmd.ko 2024-09-12T02:15:50.746 INFO:teuthology.orchestra.run.smithi039.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/xen/xenfs 2024-09-12T02:15:50.747 INFO:teuthology.orchestra.run.smithi039.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/xen/xenfs/xenfs.ko 2024-09-12T02:15:50.747 INFO:teuthology.orchestra.run.smithi039.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs 2024-09-12T02:15:50.747 INFO:teuthology.orchestra.run.smithi039.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/9p 2024-09-12T02:15:50.747 INFO:teuthology.orchestra.run.smithi039.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/9p/9p.ko 2024-09-12T02:15:50.747 INFO:teuthology.orchestra.run.smithi039.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/affs 2024-09-12T02:15:50.747 INFO:teuthology.orchestra.run.smithi039.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/affs/affs.ko 2024-09-12T02:15:50.747 INFO:teuthology.orchestra.run.smithi039.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/befs 2024-09-12T02:15:50.747 INFO:teuthology.orchestra.run.smithi039.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/befs/befs.ko 2024-09-12T02:15:50.747 INFO:teuthology.orchestra.run.smithi039.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/binfmt_misc.ko 2024-09-12T02:15:50.747 INFO:teuthology.orchestra.run.smithi039.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/btrfs 2024-09-12T02:15:50.747 INFO:teuthology.orchestra.run.smithi039.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/btrfs/btrfs.ko 2024-09-12T02:15:50.747 INFO:teuthology.orchestra.run.smithi039.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/cachefiles 2024-09-12T02:15:50.747 INFO:teuthology.orchestra.run.smithi039.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/cachefiles/cachefiles.ko 2024-09-12T02:15:50.748 INFO:teuthology.orchestra.run.smithi039.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/ceph 2024-09-12T02:15:50.748 INFO:teuthology.orchestra.run.smithi039.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/ceph/ceph.ko 2024-09-12T02:15:50.748 INFO:teuthology.orchestra.run.smithi039.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/coda 2024-09-12T02:15:50.748 INFO:teuthology.orchestra.run.smithi039.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/coda/coda.ko 2024-09-12T02:15:50.748 INFO:teuthology.orchestra.run.smithi039.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/cramfs 2024-09-12T02:15:50.748 INFO:teuthology.orchestra.run.smithi039.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/cramfs/cramfs.ko 2024-09-12T02:15:50.748 INFO:teuthology.orchestra.run.smithi039.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/dlm 2024-09-12T02:15:50.748 INFO:teuthology.orchestra.run.smithi039.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/dlm/dlm.ko 2024-09-12T02:15:50.748 INFO:teuthology.orchestra.run.smithi039.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/ecryptfs 2024-09-12T02:15:50.748 INFO:teuthology.orchestra.run.smithi039.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/ecryptfs/ecryptfs.ko 2024-09-12T02:15:50.748 INFO:teuthology.orchestra.run.smithi039.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/f2fs 2024-09-12T02:15:50.748 INFO:teuthology.orchestra.run.smithi039.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/f2fs/f2fs.ko 2024-09-12T02:15:50.749 INFO:teuthology.orchestra.run.smithi039.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/fat 2024-09-12T02:15:50.749 INFO:teuthology.orchestra.run.smithi039.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/fat/fat.ko 2024-09-12T02:15:50.749 INFO:teuthology.orchestra.run.smithi039.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/fat/msdos.ko 2024-09-12T02:15:50.749 INFO:teuthology.orchestra.run.smithi039.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/fat/vfat.ko 2024-09-12T02:15:50.749 INFO:teuthology.orchestra.run.smithi039.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/fuse 2024-09-12T02:15:50.749 INFO:teuthology.orchestra.run.smithi039.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/fuse/cuse.ko 2024-09-12T02:15:50.749 INFO:teuthology.orchestra.run.smithi039.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/fuse/fuse.ko 2024-09-12T02:15:50.749 INFO:teuthology.orchestra.run.smithi039.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/gfs2 2024-09-12T02:15:50.749 INFO:teuthology.orchestra.run.smithi039.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/gfs2/gfs2.ko 2024-09-12T02:15:50.749 INFO:teuthology.orchestra.run.smithi039.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/hfs 2024-09-12T02:15:50.749 INFO:teuthology.orchestra.run.smithi039.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/hfs/hfs.ko 2024-09-12T02:15:50.749 INFO:teuthology.orchestra.run.smithi039.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/hfsplus 2024-09-12T02:15:50.750 INFO:teuthology.orchestra.run.smithi039.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/hfsplus/hfsplus.ko 2024-09-12T02:15:50.750 INFO:teuthology.orchestra.run.smithi039.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/isofs 2024-09-12T02:15:50.750 INFO:teuthology.orchestra.run.smithi039.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/isofs/isofs.ko 2024-09-12T02:15:50.750 INFO:teuthology.orchestra.run.smithi039.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/jfs 2024-09-12T02:15:50.750 INFO:teuthology.orchestra.run.smithi039.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/jfs/jfs.ko 2024-09-12T02:15:50.750 INFO:teuthology.orchestra.run.smithi039.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/lockd 2024-09-12T02:15:50.750 INFO:teuthology.orchestra.run.smithi039.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/lockd/lockd.ko 2024-09-12T02:15:50.750 INFO:teuthology.orchestra.run.smithi039.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/minix 2024-09-12T02:15:50.750 INFO:teuthology.orchestra.run.smithi039.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/minix/minix.ko 2024-09-12T02:15:50.750 INFO:teuthology.orchestra.run.smithi039.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/netfs 2024-09-12T02:15:50.750 INFO:teuthology.orchestra.run.smithi039.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/netfs/netfs.ko 2024-09-12T02:15:50.750 INFO:teuthology.orchestra.run.smithi039.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nfs 2024-09-12T02:15:50.751 INFO:teuthology.orchestra.run.smithi039.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nfs/blocklayout 2024-09-12T02:15:50.751 INFO:teuthology.orchestra.run.smithi039.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nfs/blocklayout/blocklayoutdriver.ko 2024-09-12T02:15:50.751 INFO:teuthology.orchestra.run.smithi039.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nfs/filelayout 2024-09-12T02:15:50.751 INFO:teuthology.orchestra.run.smithi039.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nfs/filelayout/nfs_layout_nfsv41_files.ko 2024-09-12T02:15:50.751 INFO:teuthology.orchestra.run.smithi039.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nfs/flexfilelayout 2024-09-12T02:15:50.751 INFO:teuthology.orchestra.run.smithi039.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nfs/flexfilelayout/nfs_layout_flexfiles.ko 2024-09-12T02:15:50.751 INFO:teuthology.orchestra.run.smithi039.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nfs/nfs.ko 2024-09-12T02:15:50.751 INFO:teuthology.orchestra.run.smithi039.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nfs/nfsv3.ko 2024-09-12T02:15:50.751 INFO:teuthology.orchestra.run.smithi039.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nfs/nfsv4.ko 2024-09-12T02:15:50.751 INFO:teuthology.orchestra.run.smithi039.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nfs_common 2024-09-12T02:15:50.751 INFO:teuthology.orchestra.run.smithi039.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nfs_common/grace.ko 2024-09-12T02:15:50.751 INFO:teuthology.orchestra.run.smithi039.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nfs_common/nfs_acl.ko 2024-09-12T02:15:50.751 INFO:teuthology.orchestra.run.smithi039.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nfsd 2024-09-12T02:15:50.752 INFO:teuthology.orchestra.run.smithi039.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nfsd/nfsd.ko 2024-09-12T02:15:50.752 INFO:teuthology.orchestra.run.smithi039.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nilfs2 2024-09-12T02:15:50.752 INFO:teuthology.orchestra.run.smithi039.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nilfs2/nilfs2.ko 2024-09-12T02:15:50.752 INFO:teuthology.orchestra.run.smithi039.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls 2024-09-12T02:15:50.752 INFO:teuthology.orchestra.run.smithi039.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/mac-celtic.ko 2024-09-12T02:15:50.752 INFO:teuthology.orchestra.run.smithi039.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/mac-centeuro.ko 2024-09-12T02:15:50.752 INFO:teuthology.orchestra.run.smithi039.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/mac-croatian.ko 2024-09-12T02:15:50.752 INFO:teuthology.orchestra.run.smithi039.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/mac-cyrillic.ko 2024-09-12T02:15:50.752 INFO:teuthology.orchestra.run.smithi039.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/mac-gaelic.ko 2024-09-12T02:15:50.752 INFO:teuthology.orchestra.run.smithi039.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/mac-greek.ko 2024-09-12T02:15:50.752 INFO:teuthology.orchestra.run.smithi039.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/mac-iceland.ko 2024-09-12T02:15:50.752 INFO:teuthology.orchestra.run.smithi039.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/mac-inuit.ko 2024-09-12T02:15:50.752 INFO:teuthology.orchestra.run.smithi039.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/mac-roman.ko 2024-09-12T02:15:50.753 INFO:teuthology.orchestra.run.smithi039.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/mac-romanian.ko 2024-09-12T02:15:50.753 INFO:teuthology.orchestra.run.smithi039.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/mac-turkish.ko 2024-09-12T02:15:50.753 INFO:teuthology.orchestra.run.smithi039.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/nls_cp1250.ko 2024-09-12T02:15:50.753 INFO:teuthology.orchestra.run.smithi039.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/nls_cp1251.ko 2024-09-12T02:15:50.753 INFO:teuthology.orchestra.run.smithi039.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/nls_cp1255.ko 2024-09-12T02:15:50.753 INFO:teuthology.orchestra.run.smithi039.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/nls_cp737.ko 2024-09-12T02:15:50.753 INFO:teuthology.orchestra.run.smithi039.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/nls_cp775.ko 2024-09-12T02:15:50.753 INFO:teuthology.orchestra.run.smithi039.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/nls_cp850.ko 2024-09-12T02:15:50.753 INFO:teuthology.orchestra.run.smithi039.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/nls_cp852.ko 2024-09-12T02:15:50.753 INFO:teuthology.orchestra.run.smithi039.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/nls_cp855.ko 2024-09-12T02:15:50.753 INFO:teuthology.orchestra.run.smithi039.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/nls_cp857.ko 2024-09-12T02:15:50.753 INFO:teuthology.orchestra.run.smithi039.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/nls_cp860.ko 2024-09-12T02:15:50.753 INFO:teuthology.orchestra.run.smithi039.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/nls_cp861.ko 2024-09-12T02:15:50.754 INFO:teuthology.orchestra.run.smithi039.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/nls_cp862.ko 2024-09-12T02:15:50.754 INFO:teuthology.orchestra.run.smithi039.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/nls_cp863.ko 2024-09-12T02:15:50.754 INFO:teuthology.orchestra.run.smithi039.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/nls_cp864.ko 2024-09-12T02:15:50.754 INFO:teuthology.orchestra.run.smithi039.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/nls_cp865.ko 2024-09-12T02:15:50.754 INFO:teuthology.orchestra.run.smithi039.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/nls_cp866.ko 2024-09-12T02:15:50.754 INFO:teuthology.orchestra.run.smithi039.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/nls_cp869.ko 2024-09-12T02:15:50.754 INFO:teuthology.orchestra.run.smithi039.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/nls_cp874.ko 2024-09-12T02:15:50.754 INFO:teuthology.orchestra.run.smithi039.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/nls_cp932.ko 2024-09-12T02:15:50.754 INFO:teuthology.orchestra.run.smithi039.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/nls_cp936.ko 2024-09-12T02:15:50.754 INFO:teuthology.orchestra.run.smithi039.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/nls_cp949.ko 2024-09-12T02:15:50.754 INFO:teuthology.orchestra.run.smithi039.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/nls_cp950.ko 2024-09-12T02:15:50.754 INFO:teuthology.orchestra.run.smithi039.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/nls_euc-jp.ko 2024-09-12T02:15:50.754 INFO:teuthology.orchestra.run.smithi039.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/nls_iso8859-1.ko 2024-09-12T02:15:50.755 INFO:teuthology.orchestra.run.smithi039.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/nls_iso8859-13.ko 2024-09-12T02:15:50.755 INFO:teuthology.orchestra.run.smithi039.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/nls_iso8859-14.ko 2024-09-12T02:15:50.755 INFO:teuthology.orchestra.run.smithi039.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/nls_iso8859-15.ko 2024-09-12T02:15:50.755 INFO:teuthology.orchestra.run.smithi039.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/nls_iso8859-2.ko 2024-09-12T02:15:50.755 INFO:teuthology.orchestra.run.smithi039.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/nls_iso8859-3.ko 2024-09-12T02:15:50.755 INFO:teuthology.orchestra.run.smithi039.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/nls_iso8859-4.ko 2024-09-12T02:15:50.755 INFO:teuthology.orchestra.run.smithi039.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/nls_iso8859-5.ko 2024-09-12T02:15:50.755 INFO:teuthology.orchestra.run.smithi039.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/nls_iso8859-6.ko 2024-09-12T02:15:50.755 INFO:teuthology.orchestra.run.smithi039.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/nls_iso8859-7.ko 2024-09-12T02:15:50.755 INFO:teuthology.orchestra.run.smithi039.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/nls_iso8859-9.ko 2024-09-12T02:15:50.755 INFO:teuthology.orchestra.run.smithi039.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/nls_koi8-r.ko 2024-09-12T02:15:50.755 INFO:teuthology.orchestra.run.smithi039.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/nls_koi8-ru.ko 2024-09-12T02:15:50.755 INFO:teuthology.orchestra.run.smithi039.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/nls_koi8-u.ko 2024-09-12T02:15:50.756 INFO:teuthology.orchestra.run.smithi039.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/nls_ucs2_utils.ko 2024-09-12T02:15:50.756 INFO:teuthology.orchestra.run.smithi039.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/nls_utf8.ko 2024-09-12T02:15:50.756 INFO:teuthology.orchestra.run.smithi039.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/ocfs2 2024-09-12T02:15:50.756 INFO:teuthology.orchestra.run.smithi039.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/ocfs2/cluster 2024-09-12T02:15:50.756 INFO:teuthology.orchestra.run.smithi039.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/ocfs2/cluster/ocfs2_nodemanager.ko 2024-09-12T02:15:50.756 INFO:teuthology.orchestra.run.smithi039.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/ocfs2/dlm 2024-09-12T02:15:50.756 INFO:teuthology.orchestra.run.smithi039.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/ocfs2/dlm/ocfs2_dlm.ko 2024-09-12T02:15:50.756 INFO:teuthology.orchestra.run.smithi039.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/ocfs2/dlmfs 2024-09-12T02:15:50.756 INFO:teuthology.orchestra.run.smithi039.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/ocfs2/dlmfs/ocfs2_dlmfs.ko 2024-09-12T02:15:50.756 INFO:teuthology.orchestra.run.smithi039.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/ocfs2/ocfs2.ko 2024-09-12T02:15:50.756 INFO:teuthology.orchestra.run.smithi039.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/ocfs2/ocfs2_stack_o2cb.ko 2024-09-12T02:15:50.757 INFO:teuthology.orchestra.run.smithi039.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/ocfs2/ocfs2_stack_user.ko 2024-09-12T02:15:50.757 INFO:teuthology.orchestra.run.smithi039.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/ocfs2/ocfs2_stackglue.ko 2024-09-12T02:15:50.757 INFO:teuthology.orchestra.run.smithi039.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/overlayfs 2024-09-12T02:15:50.757 INFO:teuthology.orchestra.run.smithi039.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/overlayfs/overlay.ko 2024-09-12T02:15:50.757 INFO:teuthology.orchestra.run.smithi039.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/pstore 2024-09-12T02:15:50.757 INFO:teuthology.orchestra.run.smithi039.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/pstore/ramoops.ko 2024-09-12T02:15:50.757 INFO:teuthology.orchestra.run.smithi039.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/reiserfs 2024-09-12T02:15:50.757 INFO:teuthology.orchestra.run.smithi039.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/reiserfs/reiserfs.ko 2024-09-12T02:15:50.757 INFO:teuthology.orchestra.run.smithi039.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/romfs 2024-09-12T02:15:50.757 INFO:teuthology.orchestra.run.smithi039.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/romfs/romfs.ko 2024-09-12T02:15:50.757 INFO:teuthology.orchestra.run.smithi039.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/smb 2024-09-12T02:15:50.758 INFO:teuthology.orchestra.run.smithi039.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/smb/client 2024-09-12T02:15:50.758 INFO:teuthology.orchestra.run.smithi039.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/smb/client/cifs.ko 2024-09-12T02:15:50.758 INFO:teuthology.orchestra.run.smithi039.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/smb/common 2024-09-12T02:15:50.758 INFO:teuthology.orchestra.run.smithi039.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/smb/common/cifs_arc4.ko 2024-09-12T02:15:50.758 INFO:teuthology.orchestra.run.smithi039.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/smb/common/cifs_md4.ko 2024-09-12T02:15:50.758 INFO:teuthology.orchestra.run.smithi039.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/squashfs 2024-09-12T02:15:50.758 INFO:teuthology.orchestra.run.smithi039.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/squashfs/squashfs.ko 2024-09-12T02:15:50.758 INFO:teuthology.orchestra.run.smithi039.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/sysv 2024-09-12T02:15:50.758 INFO:teuthology.orchestra.run.smithi039.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/sysv/sysv.ko 2024-09-12T02:15:50.758 INFO:teuthology.orchestra.run.smithi039.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/udf 2024-09-12T02:15:50.758 INFO:teuthology.orchestra.run.smithi039.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/udf/udf.ko 2024-09-12T02:15:50.758 INFO:teuthology.orchestra.run.smithi039.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/ufs 2024-09-12T02:15:50.759 INFO:teuthology.orchestra.run.smithi039.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/ufs/ufs.ko 2024-09-12T02:15:50.759 INFO:teuthology.orchestra.run.smithi039.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/xfs 2024-09-12T02:15:50.759 INFO:teuthology.orchestra.run.smithi039.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/xfs/xfs.ko 2024-09-12T02:15:50.759 INFO:teuthology.orchestra.run.smithi039.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/kernel 2024-09-12T02:15:50.759 INFO:teuthology.orchestra.run.smithi039.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/kernel/rcu 2024-09-12T02:15:50.759 INFO:teuthology.orchestra.run.smithi039.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/kernel/rcu/rcutorture.ko 2024-09-12T02:15:50.759 INFO:teuthology.orchestra.run.smithi039.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/kernel/torture.ko 2024-09-12T02:15:50.759 INFO:teuthology.orchestra.run.smithi039.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/kernel/trace 2024-09-12T02:15:50.759 INFO:teuthology.orchestra.run.smithi039.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/kernel/trace/ring_buffer_benchmark.ko 2024-09-12T02:15:50.759 INFO:teuthology.orchestra.run.smithi039.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/lib 2024-09-12T02:15:50.759 INFO:teuthology.orchestra.run.smithi039.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/lib/asn1_encoder.ko 2024-09-12T02:15:50.759 INFO:teuthology.orchestra.run.smithi039.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/lib/crc-itu-t.ko 2024-09-12T02:15:50.759 INFO:teuthology.orchestra.run.smithi039.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/lib/crc8.ko 2024-09-12T02:15:50.759 INFO:teuthology.orchestra.run.smithi039.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/lib/crypto 2024-09-12T02:15:50.760 INFO:teuthology.orchestra.run.smithi039.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/lib/crypto/libaescfb.ko 2024-09-12T02:15:50.760 INFO:teuthology.orchestra.run.smithi039.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/lib/crypto/libarc4.ko 2024-09-12T02:15:50.760 INFO:teuthology.orchestra.run.smithi039.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/lib/crypto/libdes.ko 2024-09-12T02:15:50.760 INFO:teuthology.orchestra.run.smithi039.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/lib/libcrc32c.ko 2024-09-12T02:15:50.760 INFO:teuthology.orchestra.run.smithi039.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/lib/lru_cache.ko 2024-09-12T02:15:50.760 INFO:teuthology.orchestra.run.smithi039.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/lib/lz4 2024-09-12T02:15:50.760 INFO:teuthology.orchestra.run.smithi039.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/lib/lz4/lz4_compress.ko 2024-09-12T02:15:50.760 INFO:teuthology.orchestra.run.smithi039.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/lib/lz4/lz4hc_compress.ko 2024-09-12T02:15:50.760 INFO:teuthology.orchestra.run.smithi039.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/lib/math 2024-09-12T02:15:50.760 INFO:teuthology.orchestra.run.smithi039.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/lib/math/cordic.ko 2024-09-12T02:15:50.760 INFO:teuthology.orchestra.run.smithi039.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/lib/raid6 2024-09-12T02:15:50.760 INFO:teuthology.orchestra.run.smithi039.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/lib/raid6/raid6_pq.ko 2024-09-12T02:15:50.760 INFO:teuthology.orchestra.run.smithi039.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/lib/reed_solomon 2024-09-12T02:15:50.761 INFO:teuthology.orchestra.run.smithi039.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/lib/reed_solomon/reed_solomon.ko 2024-09-12T02:15:50.761 INFO:teuthology.orchestra.run.smithi039.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/lib/ts_bm.ko 2024-09-12T02:15:50.761 INFO:teuthology.orchestra.run.smithi039.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/lib/ts_fsm.ko 2024-09-12T02:15:50.761 INFO:teuthology.orchestra.run.smithi039.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/lib/ts_kmp.ko 2024-09-12T02:15:50.761 INFO:teuthology.orchestra.run.smithi039.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/lib/zstd 2024-09-12T02:15:50.761 INFO:teuthology.orchestra.run.smithi039.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/lib/zstd/zstd_compress.ko 2024-09-12T02:15:50.761 INFO:teuthology.orchestra.run.smithi039.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/mm 2024-09-12T02:15:50.761 INFO:teuthology.orchestra.run.smithi039.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/mm/hwpoison-inject.ko 2024-09-12T02:15:50.761 INFO:teuthology.orchestra.run.smithi039.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net 2024-09-12T02:15:50.761 INFO:teuthology.orchestra.run.smithi039.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/6lowpan 2024-09-12T02:15:50.761 INFO:teuthology.orchestra.run.smithi039.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/6lowpan/6lowpan.ko 2024-09-12T02:15:50.761 INFO:teuthology.orchestra.run.smithi039.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/6lowpan/nhc_dest.ko 2024-09-12T02:15:50.761 INFO:teuthology.orchestra.run.smithi039.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/6lowpan/nhc_fragment.ko 2024-09-12T02:15:50.762 INFO:teuthology.orchestra.run.smithi039.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/6lowpan/nhc_hop.ko 2024-09-12T02:15:50.762 INFO:teuthology.orchestra.run.smithi039.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/6lowpan/nhc_ipv6.ko 2024-09-12T02:15:50.762 INFO:teuthology.orchestra.run.smithi039.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/6lowpan/nhc_mobility.ko 2024-09-12T02:15:50.762 INFO:teuthology.orchestra.run.smithi039.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/6lowpan/nhc_routing.ko 2024-09-12T02:15:50.762 INFO:teuthology.orchestra.run.smithi039.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/6lowpan/nhc_udp.ko 2024-09-12T02:15:50.762 INFO:teuthology.orchestra.run.smithi039.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/802 2024-09-12T02:15:50.762 INFO:teuthology.orchestra.run.smithi039.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/802/garp.ko 2024-09-12T02:15:50.762 INFO:teuthology.orchestra.run.smithi039.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/802/mrp.ko 2024-09-12T02:15:50.762 INFO:teuthology.orchestra.run.smithi039.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/802/p8022.ko 2024-09-12T02:15:50.762 INFO:teuthology.orchestra.run.smithi039.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/802/psnap.ko 2024-09-12T02:15:50.762 INFO:teuthology.orchestra.run.smithi039.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/802/stp.ko 2024-09-12T02:15:50.762 INFO:teuthology.orchestra.run.smithi039.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/8021q 2024-09-12T02:15:50.762 INFO:teuthology.orchestra.run.smithi039.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/8021q/8021q.ko 2024-09-12T02:15:50.762 INFO:teuthology.orchestra.run.smithi039.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/9p 2024-09-12T02:15:50.763 INFO:teuthology.orchestra.run.smithi039.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/9p/9pnet.ko 2024-09-12T02:15:50.763 INFO:teuthology.orchestra.run.smithi039.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/9p/9pnet_fd.ko 2024-09-12T02:15:50.763 INFO:teuthology.orchestra.run.smithi039.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/9p/9pnet_rdma.ko 2024-09-12T02:15:50.763 INFO:teuthology.orchestra.run.smithi039.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/9p/9pnet_virtio.ko 2024-09-12T02:15:50.763 INFO:teuthology.orchestra.run.smithi039.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/batman-adv 2024-09-12T02:15:50.763 INFO:teuthology.orchestra.run.smithi039.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/batman-adv/batman-adv.ko 2024-09-12T02:15:50.763 INFO:teuthology.orchestra.run.smithi039.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/bridge 2024-09-12T02:15:50.763 INFO:teuthology.orchestra.run.smithi039.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/bridge/br_netfilter.ko 2024-09-12T02:15:50.763 INFO:teuthology.orchestra.run.smithi039.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/bridge/bridge.ko 2024-09-12T02:15:50.763 INFO:teuthology.orchestra.run.smithi039.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/bridge/netfilter 2024-09-12T02:15:50.763 INFO:teuthology.orchestra.run.smithi039.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/bridge/netfilter/ebt_802_3.ko 2024-09-12T02:15:50.763 INFO:teuthology.orchestra.run.smithi039.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/bridge/netfilter/ebt_among.ko 2024-09-12T02:15:50.763 INFO:teuthology.orchestra.run.smithi039.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/bridge/netfilter/ebt_arp.ko 2024-09-12T02:15:50.764 INFO:teuthology.orchestra.run.smithi039.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/bridge/netfilter/ebt_arpreply.ko 2024-09-12T02:15:50.764 INFO:teuthology.orchestra.run.smithi039.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/bridge/netfilter/ebt_dnat.ko 2024-09-12T02:15:50.764 INFO:teuthology.orchestra.run.smithi039.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/bridge/netfilter/ebt_ip.ko 2024-09-12T02:15:50.764 INFO:teuthology.orchestra.run.smithi039.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/bridge/netfilter/ebt_ip6.ko 2024-09-12T02:15:50.764 INFO:teuthology.orchestra.run.smithi039.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/bridge/netfilter/ebt_limit.ko 2024-09-12T02:15:50.764 INFO:teuthology.orchestra.run.smithi039.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/bridge/netfilter/ebt_log.ko 2024-09-12T02:15:50.764 INFO:teuthology.orchestra.run.smithi039.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/bridge/netfilter/ebt_mark.ko 2024-09-12T02:15:50.764 INFO:teuthology.orchestra.run.smithi039.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/bridge/netfilter/ebt_mark_m.ko 2024-09-12T02:15:50.764 INFO:teuthology.orchestra.run.smithi039.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/bridge/netfilter/ebt_nflog.ko 2024-09-12T02:15:50.764 INFO:teuthology.orchestra.run.smithi039.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/bridge/netfilter/ebt_pkttype.ko 2024-09-12T02:15:50.764 INFO:teuthology.orchestra.run.smithi039.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/bridge/netfilter/ebt_redirect.ko 2024-09-12T02:15:50.764 INFO:teuthology.orchestra.run.smithi039.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/bridge/netfilter/ebt_snat.ko 2024-09-12T02:15:50.765 INFO:teuthology.orchestra.run.smithi039.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/bridge/netfilter/ebt_stp.ko 2024-09-12T02:15:50.765 INFO:teuthology.orchestra.run.smithi039.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/bridge/netfilter/ebt_vlan.ko 2024-09-12T02:15:50.765 INFO:teuthology.orchestra.run.smithi039.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/bridge/netfilter/ebtable_broute.ko 2024-09-12T02:15:50.765 INFO:teuthology.orchestra.run.smithi039.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/bridge/netfilter/ebtable_filter.ko 2024-09-12T02:15:50.765 INFO:teuthology.orchestra.run.smithi039.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/bridge/netfilter/ebtable_nat.ko 2024-09-12T02:15:50.765 INFO:teuthology.orchestra.run.smithi039.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/bridge/netfilter/ebtables.ko 2024-09-12T02:15:50.765 INFO:teuthology.orchestra.run.smithi039.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/bridge/netfilter/nf_conntrack_bridge.ko 2024-09-12T02:15:50.765 INFO:teuthology.orchestra.run.smithi039.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/bridge/netfilter/nft_meta_bridge.ko 2024-09-12T02:15:50.765 INFO:teuthology.orchestra.run.smithi039.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/bridge/netfilter/nft_reject_bridge.ko 2024-09-12T02:15:50.765 INFO:teuthology.orchestra.run.smithi039.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ceph 2024-09-12T02:15:50.765 INFO:teuthology.orchestra.run.smithi039.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ceph/libceph.ko 2024-09-12T02:15:50.766 INFO:teuthology.orchestra.run.smithi039.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/core 2024-09-12T02:15:50.766 INFO:teuthology.orchestra.run.smithi039.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/core/failover.ko 2024-09-12T02:15:50.766 INFO:teuthology.orchestra.run.smithi039.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/core/pktgen.ko 2024-09-12T02:15:50.766 INFO:teuthology.orchestra.run.smithi039.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/dccp 2024-09-12T02:15:50.766 INFO:teuthology.orchestra.run.smithi039.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/dccp/dccp.ko 2024-09-12T02:15:50.766 INFO:teuthology.orchestra.run.smithi039.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/dccp/dccp_diag.ko 2024-09-12T02:15:50.766 INFO:teuthology.orchestra.run.smithi039.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/dccp/dccp_ipv4.ko 2024-09-12T02:15:50.766 INFO:teuthology.orchestra.run.smithi039.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/dccp/dccp_ipv6.ko 2024-09-12T02:15:50.766 INFO:teuthology.orchestra.run.smithi039.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/dns_resolver 2024-09-12T02:15:50.766 INFO:teuthology.orchestra.run.smithi039.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/dns_resolver/dns_resolver.ko 2024-09-12T02:15:50.766 INFO:teuthology.orchestra.run.smithi039.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/dsa 2024-09-12T02:15:50.766 INFO:teuthology.orchestra.run.smithi039.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/dsa/dsa_core.ko 2024-09-12T02:15:50.766 INFO:teuthology.orchestra.run.smithi039.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/dsa/tag_brcm.ko 2024-09-12T02:15:50.766 INFO:teuthology.orchestra.run.smithi039.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/dsa/tag_dsa.ko 2024-09-12T02:15:50.767 INFO:teuthology.orchestra.run.smithi039.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/dsa/tag_none.ko 2024-09-12T02:15:50.767 INFO:teuthology.orchestra.run.smithi039.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/dsa/tag_trailer.ko 2024-09-12T02:15:50.767 INFO:teuthology.orchestra.run.smithi039.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ieee802154 2024-09-12T02:15:50.767 INFO:teuthology.orchestra.run.smithi039.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ieee802154/6lowpan 2024-09-12T02:15:50.767 INFO:teuthology.orchestra.run.smithi039.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ieee802154/6lowpan/ieee802154_6lowpan.ko 2024-09-12T02:15:50.767 INFO:teuthology.orchestra.run.smithi039.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ieee802154/ieee802154.ko 2024-09-12T02:15:50.767 INFO:teuthology.orchestra.run.smithi039.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ieee802154/ieee802154_socket.ko 2024-09-12T02:15:50.767 INFO:teuthology.orchestra.run.smithi039.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4 2024-09-12T02:15:50.767 INFO:teuthology.orchestra.run.smithi039.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/ah4.ko 2024-09-12T02:15:50.767 INFO:teuthology.orchestra.run.smithi039.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/esp4.ko 2024-09-12T02:15:50.767 INFO:teuthology.orchestra.run.smithi039.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/fou.ko 2024-09-12T02:15:50.767 INFO:teuthology.orchestra.run.smithi039.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/gre.ko 2024-09-12T02:15:50.768 INFO:teuthology.orchestra.run.smithi039.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/inet_diag.ko 2024-09-12T02:15:50.768 INFO:teuthology.orchestra.run.smithi039.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/ip_gre.ko 2024-09-12T02:15:50.768 INFO:teuthology.orchestra.run.smithi039.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/ip_tunnel.ko 2024-09-12T02:15:50.768 INFO:teuthology.orchestra.run.smithi039.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/ip_vti.ko 2024-09-12T02:15:50.768 INFO:teuthology.orchestra.run.smithi039.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/ipcomp.ko 2024-09-12T02:15:50.768 INFO:teuthology.orchestra.run.smithi039.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/ipip.ko 2024-09-12T02:15:50.768 INFO:teuthology.orchestra.run.smithi039.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/netfilter 2024-09-12T02:15:50.768 INFO:teuthology.orchestra.run.smithi039.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/netfilter/arp_tables.ko 2024-09-12T02:15:50.768 INFO:teuthology.orchestra.run.smithi039.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/netfilter/arpt_mangle.ko 2024-09-12T02:15:50.768 INFO:teuthology.orchestra.run.smithi039.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/netfilter/arptable_filter.ko 2024-09-12T02:15:50.768 INFO:teuthology.orchestra.run.smithi039.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/netfilter/ipt_ECN.ko 2024-09-12T02:15:50.768 INFO:teuthology.orchestra.run.smithi039.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/netfilter/ipt_SYNPROXY.ko 2024-09-12T02:15:50.768 INFO:teuthology.orchestra.run.smithi039.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/netfilter/ipt_ah.ko 2024-09-12T02:15:50.769 INFO:teuthology.orchestra.run.smithi039.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/netfilter/ipt_rpfilter.ko 2024-09-12T02:15:50.769 INFO:teuthology.orchestra.run.smithi039.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/netfilter/iptable_mangle.ko 2024-09-12T02:15:50.769 INFO:teuthology.orchestra.run.smithi039.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/netfilter/iptable_nat.ko 2024-09-12T02:15:50.769 INFO:teuthology.orchestra.run.smithi039.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/netfilter/iptable_raw.ko 2024-09-12T02:15:50.769 INFO:teuthology.orchestra.run.smithi039.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/netfilter/iptable_security.ko 2024-09-12T02:15:50.769 INFO:teuthology.orchestra.run.smithi039.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/netfilter/nf_defrag_ipv4.ko 2024-09-12T02:15:50.769 INFO:teuthology.orchestra.run.smithi039.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/netfilter/nf_dup_ipv4.ko 2024-09-12T02:15:50.769 INFO:teuthology.orchestra.run.smithi039.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/netfilter/nf_nat_h323.ko 2024-09-12T02:15:50.769 INFO:teuthology.orchestra.run.smithi039.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/netfilter/nf_nat_pptp.ko 2024-09-12T02:15:50.769 INFO:teuthology.orchestra.run.smithi039.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/netfilter/nf_nat_snmp_basic.ko 2024-09-12T02:15:50.769 INFO:teuthology.orchestra.run.smithi039.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/netfilter/nf_socket_ipv4.ko 2024-09-12T02:15:50.769 INFO:teuthology.orchestra.run.smithi039.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/netfilter/nf_tproxy_ipv4.ko 2024-09-12T02:15:50.769 INFO:teuthology.orchestra.run.smithi039.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/netfilter/nft_dup_ipv4.ko 2024-09-12T02:15:50.770 INFO:teuthology.orchestra.run.smithi039.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/netfilter/nft_fib_ipv4.ko 2024-09-12T02:15:50.770 INFO:teuthology.orchestra.run.smithi039.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/netfilter/nft_reject_ipv4.ko 2024-09-12T02:15:50.770 INFO:teuthology.orchestra.run.smithi039.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/tcp_bic.ko 2024-09-12T02:15:50.770 INFO:teuthology.orchestra.run.smithi039.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/tcp_dctcp.ko 2024-09-12T02:15:50.770 INFO:teuthology.orchestra.run.smithi039.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/tcp_diag.ko 2024-09-12T02:15:50.770 INFO:teuthology.orchestra.run.smithi039.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/tcp_highspeed.ko 2024-09-12T02:15:50.770 INFO:teuthology.orchestra.run.smithi039.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/tcp_htcp.ko 2024-09-12T02:15:50.770 INFO:teuthology.orchestra.run.smithi039.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/tcp_hybla.ko 2024-09-12T02:15:50.770 INFO:teuthology.orchestra.run.smithi039.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/tcp_illinois.ko 2024-09-12T02:15:50.770 INFO:teuthology.orchestra.run.smithi039.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/tcp_lp.ko 2024-09-12T02:15:50.770 INFO:teuthology.orchestra.run.smithi039.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/tcp_scalable.ko 2024-09-12T02:15:50.770 INFO:teuthology.orchestra.run.smithi039.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/tcp_vegas.ko 2024-09-12T02:15:50.771 INFO:teuthology.orchestra.run.smithi039.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/tcp_veno.ko 2024-09-12T02:15:50.771 INFO:teuthology.orchestra.run.smithi039.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/tcp_westwood.ko 2024-09-12T02:15:50.771 INFO:teuthology.orchestra.run.smithi039.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/tcp_yeah.ko 2024-09-12T02:15:50.771 INFO:teuthology.orchestra.run.smithi039.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/tunnel4.ko 2024-09-12T02:15:50.771 INFO:teuthology.orchestra.run.smithi039.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/udp_diag.ko 2024-09-12T02:15:50.771 INFO:teuthology.orchestra.run.smithi039.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/udp_tunnel.ko 2024-09-12T02:15:50.771 INFO:teuthology.orchestra.run.smithi039.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/xfrm4_tunnel.ko 2024-09-12T02:15:50.771 INFO:teuthology.orchestra.run.smithi039.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv6 2024-09-12T02:15:50.771 INFO:teuthology.orchestra.run.smithi039.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv6/ah6.ko 2024-09-12T02:15:50.771 INFO:teuthology.orchestra.run.smithi039.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv6/esp6.ko 2024-09-12T02:15:50.771 INFO:teuthology.orchestra.run.smithi039.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv6/fou6.ko 2024-09-12T02:15:50.771 INFO:teuthology.orchestra.run.smithi039.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv6/ip6_tunnel.ko 2024-09-12T02:15:50.772 INFO:teuthology.orchestra.run.smithi039.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv6/ip6_udp_tunnel.ko 2024-09-12T02:15:50.772 INFO:teuthology.orchestra.run.smithi039.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv6/ip6_vti.ko 2024-09-12T02:15:50.772 INFO:teuthology.orchestra.run.smithi039.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv6/ipcomp6.ko 2024-09-12T02:15:50.772 INFO:teuthology.orchestra.run.smithi039.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv6/netfilter 2024-09-12T02:15:50.772 INFO:teuthology.orchestra.run.smithi039.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv6/netfilter/ip6_tables.ko 2024-09-12T02:15:50.772 INFO:teuthology.orchestra.run.smithi039.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv6/netfilter/ip6t_REJECT.ko 2024-09-12T02:15:50.772 INFO:teuthology.orchestra.run.smithi039.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv6/netfilter/ip6t_SYNPROXY.ko 2024-09-12T02:15:50.772 INFO:teuthology.orchestra.run.smithi039.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv6/netfilter/ip6t_ah.ko 2024-09-12T02:15:50.772 INFO:teuthology.orchestra.run.smithi039.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv6/netfilter/ip6t_eui64.ko 2024-09-12T02:15:50.772 INFO:teuthology.orchestra.run.smithi039.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv6/netfilter/ip6t_frag.ko 2024-09-12T02:15:50.772 INFO:teuthology.orchestra.run.smithi039.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv6/netfilter/ip6t_hbh.ko 2024-09-12T02:15:50.772 INFO:teuthology.orchestra.run.smithi039.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv6/netfilter/ip6t_ipv6header.ko 2024-09-12T02:15:50.773 INFO:teuthology.orchestra.run.smithi039.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv6/netfilter/ip6t_mh.ko 2024-09-12T02:15:50.773 INFO:teuthology.orchestra.run.smithi039.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv6/netfilter/ip6t_rpfilter.ko 2024-09-12T02:15:50.773 INFO:teuthology.orchestra.run.smithi039.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv6/netfilter/ip6t_rt.ko 2024-09-12T02:15:50.773 INFO:teuthology.orchestra.run.smithi039.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv6/netfilter/ip6table_filter.ko 2024-09-12T02:15:50.773 INFO:teuthology.orchestra.run.smithi039.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv6/netfilter/ip6table_mangle.ko 2024-09-12T02:15:50.773 INFO:teuthology.orchestra.run.smithi039.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv6/netfilter/ip6table_nat.ko 2024-09-12T02:15:50.773 INFO:teuthology.orchestra.run.smithi039.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv6/netfilter/ip6table_raw.ko 2024-09-12T02:15:50.773 INFO:teuthology.orchestra.run.smithi039.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv6/netfilter/ip6table_security.ko 2024-09-12T02:15:50.773 INFO:teuthology.orchestra.run.smithi039.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv6/netfilter/nf_defrag_ipv6.ko 2024-09-12T02:15:50.773 INFO:teuthology.orchestra.run.smithi039.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv6/netfilter/nf_dup_ipv6.ko 2024-09-12T02:15:50.773 INFO:teuthology.orchestra.run.smithi039.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv6/netfilter/nf_reject_ipv6.ko 2024-09-12T02:15:50.773 INFO:teuthology.orchestra.run.smithi039.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv6/netfilter/nf_socket_ipv6.ko 2024-09-12T02:15:50.773 INFO:teuthology.orchestra.run.smithi039.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv6/netfilter/nf_tproxy_ipv6.ko 2024-09-12T02:15:50.774 INFO:teuthology.orchestra.run.smithi039.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv6/netfilter/nft_dup_ipv6.ko 2024-09-12T02:15:50.774 INFO:teuthology.orchestra.run.smithi039.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv6/netfilter/nft_fib_ipv6.ko 2024-09-12T02:15:50.774 INFO:teuthology.orchestra.run.smithi039.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv6/netfilter/nft_reject_ipv6.ko 2024-09-12T02:15:50.774 INFO:teuthology.orchestra.run.smithi039.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv6/sit.ko 2024-09-12T02:15:50.774 INFO:teuthology.orchestra.run.smithi039.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv6/tunnel6.ko 2024-09-12T02:15:50.774 INFO:teuthology.orchestra.run.smithi039.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv6/xfrm6_tunnel.ko 2024-09-12T02:15:50.774 INFO:teuthology.orchestra.run.smithi039.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/key 2024-09-12T02:15:50.774 INFO:teuthology.orchestra.run.smithi039.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/key/af_key.ko 2024-09-12T02:15:50.774 INFO:teuthology.orchestra.run.smithi039.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/l2tp 2024-09-12T02:15:50.774 INFO:teuthology.orchestra.run.smithi039.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/l2tp/l2tp_core.ko 2024-09-12T02:15:50.774 INFO:teuthology.orchestra.run.smithi039.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/l2tp/l2tp_debugfs.ko 2024-09-12T02:15:50.775 INFO:teuthology.orchestra.run.smithi039.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/l2tp/l2tp_eth.ko 2024-09-12T02:15:50.775 INFO:teuthology.orchestra.run.smithi039.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/l2tp/l2tp_ip.ko 2024-09-12T02:15:50.775 INFO:teuthology.orchestra.run.smithi039.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/l2tp/l2tp_ip6.ko 2024-09-12T02:15:50.775 INFO:teuthology.orchestra.run.smithi039.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/l2tp/l2tp_netlink.ko 2024-09-12T02:15:50.775 INFO:teuthology.orchestra.run.smithi039.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/l2tp/l2tp_ppp.ko 2024-09-12T02:15:50.775 INFO:teuthology.orchestra.run.smithi039.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/llc 2024-09-12T02:15:50.775 INFO:teuthology.orchestra.run.smithi039.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/llc/llc.ko 2024-09-12T02:15:50.775 INFO:teuthology.orchestra.run.smithi039.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/mac802154 2024-09-12T02:15:50.775 INFO:teuthology.orchestra.run.smithi039.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/mac802154/mac802154.ko 2024-09-12T02:15:50.775 INFO:teuthology.orchestra.run.smithi039.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/mpls 2024-09-12T02:15:50.775 INFO:teuthology.orchestra.run.smithi039.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/mpls/mpls_gso.ko 2024-09-12T02:15:50.776 INFO:teuthology.orchestra.run.smithi039.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter 2024-09-12T02:15:50.776 INFO:teuthology.orchestra.run.smithi039.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/ipset 2024-09-12T02:15:50.776 INFO:teuthology.orchestra.run.smithi039.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/ipset/ip_set.ko 2024-09-12T02:15:50.776 INFO:teuthology.orchestra.run.smithi039.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/ipset/ip_set_bitmap_ip.ko 2024-09-12T02:15:50.776 INFO:teuthology.orchestra.run.smithi039.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/ipset/ip_set_bitmap_ipmac.ko 2024-09-12T02:15:50.776 INFO:teuthology.orchestra.run.smithi039.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/ipset/ip_set_bitmap_port.ko 2024-09-12T02:15:50.776 INFO:teuthology.orchestra.run.smithi039.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/ipset/ip_set_hash_ip.ko 2024-09-12T02:15:50.776 INFO:teuthology.orchestra.run.smithi039.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/ipset/ip_set_hash_ipmark.ko 2024-09-12T02:15:50.776 INFO:teuthology.orchestra.run.smithi039.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/ipset/ip_set_hash_ipport.ko 2024-09-12T02:15:50.776 INFO:teuthology.orchestra.run.smithi039.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/ipset/ip_set_hash_ipportip.ko 2024-09-12T02:15:50.776 INFO:teuthology.orchestra.run.smithi039.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/ipset/ip_set_hash_ipportnet.ko 2024-09-12T02:15:50.776 INFO:teuthology.orchestra.run.smithi039.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/ipset/ip_set_hash_mac.ko 2024-09-12T02:15:50.777 INFO:teuthology.orchestra.run.smithi039.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/ipset/ip_set_hash_net.ko 2024-09-12T02:15:50.777 INFO:teuthology.orchestra.run.smithi039.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/ipset/ip_set_hash_netiface.ko 2024-09-12T02:15:50.777 INFO:teuthology.orchestra.run.smithi039.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/ipset/ip_set_hash_netnet.ko 2024-09-12T02:15:50.777 INFO:teuthology.orchestra.run.smithi039.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/ipset/ip_set_hash_netport.ko 2024-09-12T02:15:50.777 INFO:teuthology.orchestra.run.smithi039.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/ipset/ip_set_hash_netportnet.ko 2024-09-12T02:15:50.777 INFO:teuthology.orchestra.run.smithi039.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/ipset/ip_set_list_set.ko 2024-09-12T02:15:50.777 INFO:teuthology.orchestra.run.smithi039.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/ipvs 2024-09-12T02:15:50.777 INFO:teuthology.orchestra.run.smithi039.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/ipvs/ip_vs.ko 2024-09-12T02:15:50.777 INFO:teuthology.orchestra.run.smithi039.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/ipvs/ip_vs_dh.ko 2024-09-12T02:15:50.777 INFO:teuthology.orchestra.run.smithi039.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/ipvs/ip_vs_fo.ko 2024-09-12T02:15:50.777 INFO:teuthology.orchestra.run.smithi039.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/ipvs/ip_vs_ftp.ko 2024-09-12T02:15:50.777 INFO:teuthology.orchestra.run.smithi039.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/ipvs/ip_vs_lblc.ko 2024-09-12T02:15:50.778 INFO:teuthology.orchestra.run.smithi039.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/ipvs/ip_vs_lblcr.ko 2024-09-12T02:15:50.778 INFO:teuthology.orchestra.run.smithi039.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/ipvs/ip_vs_lc.ko 2024-09-12T02:15:50.778 INFO:teuthology.orchestra.run.smithi039.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/ipvs/ip_vs_nq.ko 2024-09-12T02:15:50.778 INFO:teuthology.orchestra.run.smithi039.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/ipvs/ip_vs_pe_sip.ko 2024-09-12T02:15:50.778 INFO:teuthology.orchestra.run.smithi039.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/ipvs/ip_vs_rr.ko 2024-09-12T02:15:50.778 INFO:teuthology.orchestra.run.smithi039.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/ipvs/ip_vs_sed.ko 2024-09-12T02:15:50.778 INFO:teuthology.orchestra.run.smithi039.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/ipvs/ip_vs_sh.ko 2024-09-12T02:15:50.778 INFO:teuthology.orchestra.run.smithi039.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/ipvs/ip_vs_wlc.ko 2024-09-12T02:15:50.778 INFO:teuthology.orchestra.run.smithi039.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/ipvs/ip_vs_wrr.ko 2024-09-12T02:15:50.778 INFO:teuthology.orchestra.run.smithi039.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nf_conncount.ko 2024-09-12T02:15:50.779 INFO:teuthology.orchestra.run.smithi039.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nf_conntrack.ko 2024-09-12T02:15:50.779 INFO:teuthology.orchestra.run.smithi039.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nf_conntrack_amanda.ko 2024-09-12T02:15:50.779 INFO:teuthology.orchestra.run.smithi039.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nf_conntrack_broadcast.ko 2024-09-12T02:15:50.779 INFO:teuthology.orchestra.run.smithi039.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nf_conntrack_ftp.ko 2024-09-12T02:15:50.779 INFO:teuthology.orchestra.run.smithi039.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nf_conntrack_h323.ko 2024-09-12T02:15:50.779 INFO:teuthology.orchestra.run.smithi039.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nf_conntrack_irc.ko 2024-09-12T02:15:50.779 INFO:teuthology.orchestra.run.smithi039.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nf_conntrack_netbios_ns.ko 2024-09-12T02:15:50.779 INFO:teuthology.orchestra.run.smithi039.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nf_conntrack_netlink.ko 2024-09-12T02:15:50.779 INFO:teuthology.orchestra.run.smithi039.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nf_conntrack_pptp.ko 2024-09-12T02:15:50.779 INFO:teuthology.orchestra.run.smithi039.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nf_conntrack_sane.ko 2024-09-12T02:15:50.779 INFO:teuthology.orchestra.run.smithi039.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nf_conntrack_sip.ko 2024-09-12T02:15:50.780 INFO:teuthology.orchestra.run.smithi039.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nf_conntrack_snmp.ko 2024-09-12T02:15:50.780 INFO:teuthology.orchestra.run.smithi039.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nf_conntrack_tftp.ko 2024-09-12T02:15:50.780 INFO:teuthology.orchestra.run.smithi039.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nf_dup_netdev.ko 2024-09-12T02:15:50.780 INFO:teuthology.orchestra.run.smithi039.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nf_flow_table.ko 2024-09-12T02:15:50.780 INFO:teuthology.orchestra.run.smithi039.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nf_flow_table_inet.ko 2024-09-12T02:15:50.780 INFO:teuthology.orchestra.run.smithi039.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nf_log_syslog.ko 2024-09-12T02:15:50.780 INFO:teuthology.orchestra.run.smithi039.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nf_nat.ko 2024-09-12T02:15:50.780 INFO:teuthology.orchestra.run.smithi039.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nf_nat_amanda.ko 2024-09-12T02:15:50.780 INFO:teuthology.orchestra.run.smithi039.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nf_nat_ftp.ko 2024-09-12T02:15:50.780 INFO:teuthology.orchestra.run.smithi039.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nf_nat_irc.ko 2024-09-12T02:15:50.780 INFO:teuthology.orchestra.run.smithi039.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nf_nat_sip.ko 2024-09-12T02:15:50.780 INFO:teuthology.orchestra.run.smithi039.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nf_nat_tftp.ko 2024-09-12T02:15:50.781 INFO:teuthology.orchestra.run.smithi039.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nf_synproxy_core.ko 2024-09-12T02:15:50.781 INFO:teuthology.orchestra.run.smithi039.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nf_tables.ko 2024-09-12T02:15:50.781 INFO:teuthology.orchestra.run.smithi039.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nfnetlink.ko 2024-09-12T02:15:50.781 INFO:teuthology.orchestra.run.smithi039.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nfnetlink_acct.ko 2024-09-12T02:15:50.781 INFO:teuthology.orchestra.run.smithi039.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nfnetlink_log.ko 2024-09-12T02:15:50.781 INFO:teuthology.orchestra.run.smithi039.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nfnetlink_osf.ko 2024-09-12T02:15:50.781 INFO:teuthology.orchestra.run.smithi039.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nfnetlink_queue.ko 2024-09-12T02:15:50.781 INFO:teuthology.orchestra.run.smithi039.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nft_chain_nat.ko 2024-09-12T02:15:50.782 INFO:teuthology.orchestra.run.smithi039.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nft_compat.ko 2024-09-12T02:15:50.782 INFO:teuthology.orchestra.run.smithi039.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nft_ct.ko 2024-09-12T02:15:50.782 INFO:teuthology.orchestra.run.smithi039.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nft_dup_netdev.ko 2024-09-12T02:15:50.782 INFO:teuthology.orchestra.run.smithi039.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nft_fib.ko 2024-09-12T02:15:50.782 INFO:teuthology.orchestra.run.smithi039.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nft_fwd_netdev.ko 2024-09-12T02:15:50.782 INFO:teuthology.orchestra.run.smithi039.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nft_hash.ko 2024-09-12T02:15:50.782 INFO:teuthology.orchestra.run.smithi039.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nft_limit.ko 2024-09-12T02:15:50.782 INFO:teuthology.orchestra.run.smithi039.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nft_log.ko 2024-09-12T02:15:50.782 INFO:teuthology.orchestra.run.smithi039.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nft_masq.ko 2024-09-12T02:15:50.782 INFO:teuthology.orchestra.run.smithi039.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nft_nat.ko 2024-09-12T02:15:50.782 INFO:teuthology.orchestra.run.smithi039.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nft_numgen.ko 2024-09-12T02:15:50.782 INFO:teuthology.orchestra.run.smithi039.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nft_queue.ko 2024-09-12T02:15:50.783 INFO:teuthology.orchestra.run.smithi039.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nft_quota.ko 2024-09-12T02:15:50.783 INFO:teuthology.orchestra.run.smithi039.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nft_redir.ko 2024-09-12T02:15:50.783 INFO:teuthology.orchestra.run.smithi039.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nft_reject.ko 2024-09-12T02:15:50.783 INFO:teuthology.orchestra.run.smithi039.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nft_reject_inet.ko 2024-09-12T02:15:50.783 INFO:teuthology.orchestra.run.smithi039.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nft_socket.ko 2024-09-12T02:15:50.783 INFO:teuthology.orchestra.run.smithi039.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nft_tunnel.ko 2024-09-12T02:15:50.783 INFO:teuthology.orchestra.run.smithi039.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_AUDIT.ko 2024-09-12T02:15:50.783 INFO:teuthology.orchestra.run.smithi039.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_CHECKSUM.ko 2024-09-12T02:15:50.783 INFO:teuthology.orchestra.run.smithi039.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_CLASSIFY.ko 2024-09-12T02:15:50.783 INFO:teuthology.orchestra.run.smithi039.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_CONNSECMARK.ko 2024-09-12T02:15:50.783 INFO:teuthology.orchestra.run.smithi039.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_CT.ko 2024-09-12T02:15:50.783 INFO:teuthology.orchestra.run.smithi039.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_DSCP.ko 2024-09-12T02:15:50.784 INFO:teuthology.orchestra.run.smithi039.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_HL.ko 2024-09-12T02:15:50.784 INFO:teuthology.orchestra.run.smithi039.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_HMARK.ko 2024-09-12T02:15:50.784 INFO:teuthology.orchestra.run.smithi039.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_IDLETIMER.ko 2024-09-12T02:15:50.784 INFO:teuthology.orchestra.run.smithi039.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_LED.ko 2024-09-12T02:15:50.784 INFO:teuthology.orchestra.run.smithi039.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_LOG.ko 2024-09-12T02:15:50.784 INFO:teuthology.orchestra.run.smithi039.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_MASQUERADE.ko 2024-09-12T02:15:50.784 INFO:teuthology.orchestra.run.smithi039.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_NETMAP.ko 2024-09-12T02:15:50.784 INFO:teuthology.orchestra.run.smithi039.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_NFLOG.ko 2024-09-12T02:15:50.784 INFO:teuthology.orchestra.run.smithi039.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_NFQUEUE.ko 2024-09-12T02:15:50.784 INFO:teuthology.orchestra.run.smithi039.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_RATEEST.ko 2024-09-12T02:15:50.784 INFO:teuthology.orchestra.run.smithi039.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_REDIRECT.ko 2024-09-12T02:15:50.785 INFO:teuthology.orchestra.run.smithi039.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_SECMARK.ko 2024-09-12T02:15:50.785 INFO:teuthology.orchestra.run.smithi039.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_TCPMSS.ko 2024-09-12T02:15:50.785 INFO:teuthology.orchestra.run.smithi039.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_TCPOPTSTRIP.ko 2024-09-12T02:15:50.785 INFO:teuthology.orchestra.run.smithi039.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_TEE.ko 2024-09-12T02:15:50.785 INFO:teuthology.orchestra.run.smithi039.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_TPROXY.ko 2024-09-12T02:15:50.785 INFO:teuthology.orchestra.run.smithi039.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_TRACE.ko 2024-09-12T02:15:50.785 INFO:teuthology.orchestra.run.smithi039.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_addrtype.ko 2024-09-12T02:15:50.785 INFO:teuthology.orchestra.run.smithi039.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_bpf.ko 2024-09-12T02:15:50.785 INFO:teuthology.orchestra.run.smithi039.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_cgroup.ko 2024-09-12T02:15:50.785 INFO:teuthology.orchestra.run.smithi039.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_cluster.ko 2024-09-12T02:15:50.785 INFO:teuthology.orchestra.run.smithi039.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_comment.ko 2024-09-12T02:15:50.786 INFO:teuthology.orchestra.run.smithi039.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_connbytes.ko 2024-09-12T02:15:50.786 INFO:teuthology.orchestra.run.smithi039.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_connlabel.ko 2024-09-12T02:15:50.786 INFO:teuthology.orchestra.run.smithi039.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_connlimit.ko 2024-09-12T02:15:50.786 INFO:teuthology.orchestra.run.smithi039.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_connmark.ko 2024-09-12T02:15:50.786 INFO:teuthology.orchestra.run.smithi039.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_conntrack.ko 2024-09-12T02:15:50.786 INFO:teuthology.orchestra.run.smithi039.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_cpu.ko 2024-09-12T02:15:50.786 INFO:teuthology.orchestra.run.smithi039.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_dccp.ko 2024-09-12T02:15:50.786 INFO:teuthology.orchestra.run.smithi039.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_devgroup.ko 2024-09-12T02:15:50.786 INFO:teuthology.orchestra.run.smithi039.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_dscp.ko 2024-09-12T02:15:50.786 INFO:teuthology.orchestra.run.smithi039.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_ecn.ko 2024-09-12T02:15:50.786 INFO:teuthology.orchestra.run.smithi039.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_esp.ko 2024-09-12T02:15:50.786 INFO:teuthology.orchestra.run.smithi039.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_hashlimit.ko 2024-09-12T02:15:50.787 INFO:teuthology.orchestra.run.smithi039.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_helper.ko 2024-09-12T02:15:50.787 INFO:teuthology.orchestra.run.smithi039.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_hl.ko 2024-09-12T02:15:50.787 INFO:teuthology.orchestra.run.smithi039.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_ipcomp.ko 2024-09-12T02:15:50.787 INFO:teuthology.orchestra.run.smithi039.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_iprange.ko 2024-09-12T02:15:50.787 INFO:teuthology.orchestra.run.smithi039.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_ipvs.ko 2024-09-12T02:15:50.787 INFO:teuthology.orchestra.run.smithi039.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_l2tp.ko 2024-09-12T02:15:50.787 INFO:teuthology.orchestra.run.smithi039.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_length.ko 2024-09-12T02:15:50.787 INFO:teuthology.orchestra.run.smithi039.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_limit.ko 2024-09-12T02:15:50.787 INFO:teuthology.orchestra.run.smithi039.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_mac.ko 2024-09-12T02:15:50.787 INFO:teuthology.orchestra.run.smithi039.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_mark.ko 2024-09-12T02:15:50.787 INFO:teuthology.orchestra.run.smithi039.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_multiport.ko 2024-09-12T02:15:50.787 INFO:teuthology.orchestra.run.smithi039.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_nat.ko 2024-09-12T02:15:50.787 INFO:teuthology.orchestra.run.smithi039.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_nfacct.ko 2024-09-12T02:15:50.788 INFO:teuthology.orchestra.run.smithi039.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_osf.ko 2024-09-12T02:15:50.788 INFO:teuthology.orchestra.run.smithi039.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_owner.ko 2024-09-12T02:15:50.788 INFO:teuthology.orchestra.run.smithi039.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_physdev.ko 2024-09-12T02:15:50.788 INFO:teuthology.orchestra.run.smithi039.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_pkttype.ko 2024-09-12T02:15:50.788 INFO:teuthology.orchestra.run.smithi039.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_policy.ko 2024-09-12T02:15:50.788 INFO:teuthology.orchestra.run.smithi039.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_quota.ko 2024-09-12T02:15:50.788 INFO:teuthology.orchestra.run.smithi039.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_rateest.ko 2024-09-12T02:15:50.788 INFO:teuthology.orchestra.run.smithi039.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_realm.ko 2024-09-12T02:15:50.788 INFO:teuthology.orchestra.run.smithi039.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_recent.ko 2024-09-12T02:15:50.788 INFO:teuthology.orchestra.run.smithi039.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_sctp.ko 2024-09-12T02:15:50.788 INFO:teuthology.orchestra.run.smithi039.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_set.ko 2024-09-12T02:15:50.788 INFO:teuthology.orchestra.run.smithi039.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_socket.ko 2024-09-12T02:15:50.789 INFO:teuthology.orchestra.run.smithi039.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_state.ko 2024-09-12T02:15:50.789 INFO:teuthology.orchestra.run.smithi039.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_statistic.ko 2024-09-12T02:15:50.789 INFO:teuthology.orchestra.run.smithi039.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_string.ko 2024-09-12T02:15:50.789 INFO:teuthology.orchestra.run.smithi039.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_tcpmss.ko 2024-09-12T02:15:50.789 INFO:teuthology.orchestra.run.smithi039.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_time.ko 2024-09-12T02:15:50.789 INFO:teuthology.orchestra.run.smithi039.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_u32.ko 2024-09-12T02:15:50.789 INFO:teuthology.orchestra.run.smithi039.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netlink 2024-09-12T02:15:50.789 INFO:teuthology.orchestra.run.smithi039.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netlink/netlink_diag.ko 2024-09-12T02:15:50.789 INFO:teuthology.orchestra.run.smithi039.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/nsh 2024-09-12T02:15:50.789 INFO:teuthology.orchestra.run.smithi039.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/nsh/nsh.ko 2024-09-12T02:15:50.789 INFO:teuthology.orchestra.run.smithi039.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/openvswitch 2024-09-12T02:15:50.789 INFO:teuthology.orchestra.run.smithi039.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/openvswitch/openvswitch.ko 2024-09-12T02:15:50.790 INFO:teuthology.orchestra.run.smithi039.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/openvswitch/vport-geneve.ko 2024-09-12T02:15:50.790 INFO:teuthology.orchestra.run.smithi039.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/openvswitch/vport-gre.ko 2024-09-12T02:15:50.790 INFO:teuthology.orchestra.run.smithi039.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/openvswitch/vport-vxlan.ko 2024-09-12T02:15:50.790 INFO:teuthology.orchestra.run.smithi039.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/packet 2024-09-12T02:15:50.790 INFO:teuthology.orchestra.run.smithi039.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/packet/af_packet_diag.ko 2024-09-12T02:15:50.790 INFO:teuthology.orchestra.run.smithi039.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/rds 2024-09-12T02:15:50.790 INFO:teuthology.orchestra.run.smithi039.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/rds/rds.ko 2024-09-12T02:15:50.790 INFO:teuthology.orchestra.run.smithi039.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/rds/rds_rdma.ko 2024-09-12T02:15:50.790 INFO:teuthology.orchestra.run.smithi039.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/rds/rds_tcp.ko 2024-09-12T02:15:50.790 INFO:teuthology.orchestra.run.smithi039.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sched 2024-09-12T02:15:50.790 INFO:teuthology.orchestra.run.smithi039.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sched/act_csum.ko 2024-09-12T02:15:50.790 INFO:teuthology.orchestra.run.smithi039.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sched/act_gact.ko 2024-09-12T02:15:50.790 INFO:teuthology.orchestra.run.smithi039.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sched/act_mirred.ko 2024-09-12T02:15:50.791 INFO:teuthology.orchestra.run.smithi039.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sched/act_nat.ko 2024-09-12T02:15:50.791 INFO:teuthology.orchestra.run.smithi039.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sched/act_pedit.ko 2024-09-12T02:15:50.791 INFO:teuthology.orchestra.run.smithi039.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sched/act_police.ko 2024-09-12T02:15:50.791 INFO:teuthology.orchestra.run.smithi039.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sched/act_simple.ko 2024-09-12T02:15:50.791 INFO:teuthology.orchestra.run.smithi039.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sched/act_skbedit.ko 2024-09-12T02:15:50.791 INFO:teuthology.orchestra.run.smithi039.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sched/act_vlan.ko 2024-09-12T02:15:50.791 INFO:teuthology.orchestra.run.smithi039.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sched/cls_basic.ko 2024-09-12T02:15:50.791 INFO:teuthology.orchestra.run.smithi039.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sched/cls_bpf.ko 2024-09-12T02:15:50.791 INFO:teuthology.orchestra.run.smithi039.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sched/cls_flow.ko 2024-09-12T02:15:50.791 INFO:teuthology.orchestra.run.smithi039.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sched/cls_fw.ko 2024-09-12T02:15:50.791 INFO:teuthology.orchestra.run.smithi039.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sched/cls_route.ko 2024-09-12T02:15:50.791 INFO:teuthology.orchestra.run.smithi039.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sched/cls_u32.ko 2024-09-12T02:15:50.792 INFO:teuthology.orchestra.run.smithi039.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sched/em_cmp.ko 2024-09-12T02:15:50.792 INFO:teuthology.orchestra.run.smithi039.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sched/em_ipset.ko 2024-09-12T02:15:50.792 INFO:teuthology.orchestra.run.smithi039.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sched/em_meta.ko 2024-09-12T02:15:50.792 INFO:teuthology.orchestra.run.smithi039.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sched/em_nbyte.ko 2024-09-12T02:15:50.792 INFO:teuthology.orchestra.run.smithi039.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sched/em_text.ko 2024-09-12T02:15:50.792 INFO:teuthology.orchestra.run.smithi039.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sched/em_u32.ko 2024-09-12T02:15:50.792 INFO:teuthology.orchestra.run.smithi039.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sched/sch_choke.ko 2024-09-12T02:15:50.792 INFO:teuthology.orchestra.run.smithi039.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sched/sch_codel.ko 2024-09-12T02:15:50.792 INFO:teuthology.orchestra.run.smithi039.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sched/sch_drr.ko 2024-09-12T02:15:50.792 INFO:teuthology.orchestra.run.smithi039.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sched/sch_fq.ko 2024-09-12T02:15:50.792 INFO:teuthology.orchestra.run.smithi039.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sched/sch_gred.ko 2024-09-12T02:15:50.792 INFO:teuthology.orchestra.run.smithi039.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sched/sch_hfsc.ko 2024-09-12T02:15:50.792 INFO:teuthology.orchestra.run.smithi039.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sched/sch_hhf.ko 2024-09-12T02:15:50.793 INFO:teuthology.orchestra.run.smithi039.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sched/sch_htb.ko 2024-09-12T02:15:50.793 INFO:teuthology.orchestra.run.smithi039.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sched/sch_ingress.ko 2024-09-12T02:15:50.793 INFO:teuthology.orchestra.run.smithi039.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sched/sch_mqprio.ko 2024-09-12T02:15:50.793 INFO:teuthology.orchestra.run.smithi039.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sched/sch_mqprio_lib.ko 2024-09-12T02:15:50.793 INFO:teuthology.orchestra.run.smithi039.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sched/sch_multiq.ko 2024-09-12T02:15:50.793 INFO:teuthology.orchestra.run.smithi039.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sched/sch_netem.ko 2024-09-12T02:15:50.793 INFO:teuthology.orchestra.run.smithi039.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sched/sch_pie.ko 2024-09-12T02:15:50.793 INFO:teuthology.orchestra.run.smithi039.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sched/sch_plug.ko 2024-09-12T02:15:50.793 INFO:teuthology.orchestra.run.smithi039.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sched/sch_prio.ko 2024-09-12T02:15:50.793 INFO:teuthology.orchestra.run.smithi039.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sched/sch_qfq.ko 2024-09-12T02:15:50.793 INFO:teuthology.orchestra.run.smithi039.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sched/sch_red.ko 2024-09-12T02:15:50.794 INFO:teuthology.orchestra.run.smithi039.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sched/sch_sfb.ko 2024-09-12T02:15:50.794 INFO:teuthology.orchestra.run.smithi039.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sched/sch_sfq.ko 2024-09-12T02:15:50.794 INFO:teuthology.orchestra.run.smithi039.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sched/sch_tbf.ko 2024-09-12T02:15:50.794 INFO:teuthology.orchestra.run.smithi039.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sched/sch_teql.ko 2024-09-12T02:15:50.794 INFO:teuthology.orchestra.run.smithi039.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sctp 2024-09-12T02:15:50.794 INFO:teuthology.orchestra.run.smithi039.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sctp/sctp.ko 2024-09-12T02:15:50.794 INFO:teuthology.orchestra.run.smithi039.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sctp/sctp_diag.ko 2024-09-12T02:15:50.794 INFO:teuthology.orchestra.run.smithi039.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sunrpc 2024-09-12T02:15:50.794 INFO:teuthology.orchestra.run.smithi039.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sunrpc/auth_gss 2024-09-12T02:15:50.794 INFO:teuthology.orchestra.run.smithi039.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sunrpc/auth_gss/auth_rpcgss.ko 2024-09-12T02:15:50.794 INFO:teuthology.orchestra.run.smithi039.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sunrpc/auth_gss/rpcsec_gss_krb5.ko 2024-09-12T02:15:50.794 INFO:teuthology.orchestra.run.smithi039.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sunrpc/sunrpc.ko 2024-09-12T02:15:50.794 INFO:teuthology.orchestra.run.smithi039.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sunrpc/xprtrdma 2024-09-12T02:15:50.795 INFO:teuthology.orchestra.run.smithi039.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sunrpc/xprtrdma/rpcrdma.ko 2024-09-12T02:15:50.795 INFO:teuthology.orchestra.run.smithi039.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/tipc 2024-09-12T02:15:50.795 INFO:teuthology.orchestra.run.smithi039.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/tipc/tipc.ko 2024-09-12T02:15:50.795 INFO:teuthology.orchestra.run.smithi039.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/tipc/tipc_diag.ko 2024-09-12T02:15:50.795 INFO:teuthology.orchestra.run.smithi039.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/unix 2024-09-12T02:15:50.795 INFO:teuthology.orchestra.run.smithi039.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/unix/unix_diag.ko 2024-09-12T02:15:50.795 INFO:teuthology.orchestra.run.smithi039.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/vmw_vsock 2024-09-12T02:15:50.795 INFO:teuthology.orchestra.run.smithi039.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/vmw_vsock/vmw_vsock_virtio_transport_common.ko 2024-09-12T02:15:50.795 INFO:teuthology.orchestra.run.smithi039.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/vmw_vsock/vmw_vsock_vmci_transport.ko 2024-09-12T02:15:50.795 INFO:teuthology.orchestra.run.smithi039.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/vmw_vsock/vsock.ko 2024-09-12T02:15:50.795 INFO:teuthology.orchestra.run.smithi039.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/vmw_vsock/vsock_diag.ko 2024-09-12T02:15:50.796 INFO:teuthology.orchestra.run.smithi039.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/vmw_vsock/vsock_loopback.ko 2024-09-12T02:15:50.796 INFO:teuthology.orchestra.run.smithi039.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/xfrm 2024-09-12T02:15:50.796 INFO:teuthology.orchestra.run.smithi039.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/xfrm/xfrm_ipcomp.ko 2024-09-12T02:15:50.796 INFO:teuthology.orchestra.run.smithi039.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/security 2024-09-12T02:15:50.796 INFO:teuthology.orchestra.run.smithi039.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/security/keys 2024-09-12T02:15:50.796 INFO:teuthology.orchestra.run.smithi039.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/security/keys/encrypted-keys 2024-09-12T02:15:50.796 INFO:teuthology.orchestra.run.smithi039.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/security/keys/encrypted-keys/encrypted-keys.ko 2024-09-12T02:15:50.796 INFO:teuthology.orchestra.run.smithi039.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/security/keys/trusted-keys 2024-09-12T02:15:50.796 INFO:teuthology.orchestra.run.smithi039.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/security/keys/trusted-keys/trusted.ko 2024-09-12T02:15:50.796 INFO:teuthology.orchestra.run.smithi039.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/modules.alias 2024-09-12T02:15:50.796 INFO:teuthology.orchestra.run.smithi039.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/modules.alias.bin 2024-09-12T02:15:50.796 INFO:teuthology.orchestra.run.smithi039.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/modules.builtin 2024-09-12T02:15:50.797 INFO:teuthology.orchestra.run.smithi039.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/modules.builtin.alias.bin 2024-09-12T02:15:50.797 INFO:teuthology.orchestra.run.smithi039.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/modules.builtin.bin 2024-09-12T02:15:50.797 INFO:teuthology.orchestra.run.smithi039.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/modules.builtin.modinfo 2024-09-12T02:15:50.797 INFO:teuthology.orchestra.run.smithi039.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/modules.dep 2024-09-12T02:15:50.797 INFO:teuthology.orchestra.run.smithi039.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/modules.dep.bin 2024-09-12T02:15:50.797 INFO:teuthology.orchestra.run.smithi039.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/modules.devname 2024-09-12T02:15:50.797 INFO:teuthology.orchestra.run.smithi039.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/modules.order 2024-09-12T02:15:50.797 INFO:teuthology.orchestra.run.smithi039.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/modules.softdep 2024-09-12T02:15:50.797 INFO:teuthology.orchestra.run.smithi039.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/modules.symbols 2024-09-12T02:15:50.797 INFO:teuthology.orchestra.run.smithi039.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/modules.symbols.bin 2024-09-12T02:15:50.797 INFO:teuthology.orchestra.run.smithi039.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/modules.weakdep 2024-09-12T02:15:50.798 INFO:teuthology.orchestra.run.smithi039.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/vmlinuz 2024-09-12T02:15:50.801 DEBUG:teuthology.task.kernel:get_image_version: 6.11.0-rc5-g2ca44a2f35ca 2024-09-12T02:15:50.802 DEBUG:teuthology.orchestra.run.smithi039:> rpm --scripts -qp /tmp/kernel.x86_64.rpm 2024-09-12T02:15:50.827 INFO:teuthology.orchestra.run.smithi039.stdout:postinstall scriptlet (using /bin/sh): 2024-09-12T02:15:50.828 INFO:teuthology.orchestra.run.smithi039.stdout:if [ -x /usr/bin/kernel-install ]; then 2024-09-12T02:15:50.828 INFO:teuthology.orchestra.run.smithi039.stdout: /usr/bin/kernel-install add 6.11.0-rc5-g2ca44a2f35ca /lib/modules/6.11.0-rc5-g2ca44a2f35ca/vmlinuz 2024-09-12T02:15:50.828 INFO:teuthology.orchestra.run.smithi039.stdout:fi 2024-09-12T02:15:50.828 INFO:teuthology.orchestra.run.smithi039.stdout:for file in vmlinuz System.map config; do 2024-09-12T02:15:50.828 INFO:teuthology.orchestra.run.smithi039.stdout: if ! cmp --silent "/lib/modules/6.11.0-rc5-g2ca44a2f35ca/${file}" "/boot/${file}-6.11.0-rc5-g2ca44a2f35ca"; then 2024-09-12T02:15:50.828 INFO:teuthology.orchestra.run.smithi039.stdout: cp "/lib/modules/6.11.0-rc5-g2ca44a2f35ca/${file}" "/boot/${file}-6.11.0-rc5-g2ca44a2f35ca" 2024-09-12T02:15:50.828 INFO:teuthology.orchestra.run.smithi039.stdout: fi 2024-09-12T02:15:50.828 INFO:teuthology.orchestra.run.smithi039.stdout:done 2024-09-12T02:15:50.828 INFO:teuthology.orchestra.run.smithi039.stdout:if [ -d "/lib/modules/6.11.0-rc5-g2ca44a2f35ca/dtb" ] && \ 2024-09-12T02:15:50.828 INFO:teuthology.orchestra.run.smithi039.stdout: ! diff -rq "/lib/modules/6.11.0-rc5-g2ca44a2f35ca/dtb" "/boot/dtb-6.11.0-rc5-g2ca44a2f35ca" >/dev/null 2>&1; then 2024-09-12T02:15:50.828 INFO:teuthology.orchestra.run.smithi039.stdout: rm -rf "/boot/dtb-6.11.0-rc5-g2ca44a2f35ca" 2024-09-12T02:15:50.829 INFO:teuthology.orchestra.run.smithi039.stdout: cp -r "/lib/modules/6.11.0-rc5-g2ca44a2f35ca/dtb" "/boot/dtb-6.11.0-rc5-g2ca44a2f35ca" 2024-09-12T02:15:50.829 INFO:teuthology.orchestra.run.smithi039.stdout:fi 2024-09-12T02:15:50.829 INFO:teuthology.orchestra.run.smithi039.stdout:if [ ! -e "/lib/modules/6.11.0-rc5-g2ca44a2f35ca/modules.dep" ]; then 2024-09-12T02:15:50.829 INFO:teuthology.orchestra.run.smithi039.stdout: /usr/sbin/depmod 6.11.0-rc5-g2ca44a2f35ca 2024-09-12T02:15:50.829 INFO:teuthology.orchestra.run.smithi039.stdout:fi 2024-09-12T02:15:50.829 INFO:teuthology.orchestra.run.smithi039.stdout:preuninstall scriptlet (using /bin/sh): 2024-09-12T02:15:50.829 INFO:teuthology.orchestra.run.smithi039.stdout:if [ -x /usr/bin/kernel-install ]; then 2024-09-12T02:15:50.829 INFO:teuthology.orchestra.run.smithi039.stdout:kernel-install remove 6.11.0-rc5-g2ca44a2f35ca 2024-09-12T02:15:50.829 INFO:teuthology.orchestra.run.smithi039.stdout:fi 2024-09-12T02:15:50.830 DEBUG:teuthology.orchestra.run.smithi039:> sudo rpm -qi grub2-tools 2024-09-12T02:15:50.913 INFO:teuthology.orchestra.run.smithi039.stdout:Name : grub2-tools 2024-09-12T02:15:50.913 INFO:teuthology.orchestra.run.smithi039.stdout:Epoch : 1 2024-09-12T02:15:50.913 INFO:teuthology.orchestra.run.smithi039.stdout:Version : 2.06 2024-09-12T02:15:50.913 INFO:teuthology.orchestra.run.smithi039.stdout:Release : 82.el9 2024-09-12T02:15:50.913 INFO:teuthology.orchestra.run.smithi039.stdout:Architecture: x86_64 2024-09-12T02:15:50.913 INFO:teuthology.orchestra.run.smithi039.stdout:Install Date: Wed 28 Aug 2024 09:06:27 PM UTC 2024-09-12T02:15:50.913 INFO:teuthology.orchestra.run.smithi039.stdout:Group : Unspecified 2024-09-12T02:15:50.913 INFO:teuthology.orchestra.run.smithi039.stdout:Size : 8274670 2024-09-12T02:15:50.914 INFO:teuthology.orchestra.run.smithi039.stdout:License : GPLv3+ 2024-09-12T02:15:50.914 INFO:teuthology.orchestra.run.smithi039.stdout:Signature : RSA/SHA256, Mon 01 Jul 2024 07:46:42 AM UTC, Key ID 05b555b38483c65d 2024-09-12T02:15:50.914 INFO:teuthology.orchestra.run.smithi039.stdout:Source RPM : grub2-2.06-82.el9.src.rpm 2024-09-12T02:15:50.914 INFO:teuthology.orchestra.run.smithi039.stdout:Build Date : Fri 28 Jun 2024 09:24:44 AM UTC 2024-09-12T02:15:50.914 INFO:teuthology.orchestra.run.smithi039.stdout:Build Host : x86-05.stream.rdu2.redhat.com 2024-09-12T02:15:50.914 INFO:teuthology.orchestra.run.smithi039.stdout:Packager : builder@centos.org 2024-09-12T02:15:50.914 INFO:teuthology.orchestra.run.smithi039.stdout:Vendor : CentOS 2024-09-12T02:15:50.914 INFO:teuthology.orchestra.run.smithi039.stdout:URL : http://www.gnu.org/software/grub/ 2024-09-12T02:15:50.914 INFO:teuthology.orchestra.run.smithi039.stdout:Summary : Support tools for GRUB. 2024-09-12T02:15:50.914 INFO:teuthology.orchestra.run.smithi039.stdout:Description : 2024-09-12T02:15:50.914 INFO:teuthology.orchestra.run.smithi039.stdout: 2024-09-12T02:15:50.914 INFO:teuthology.orchestra.run.smithi039.stdout:The GRand Unified Bootloader (GRUB) is a highly configurable and 2024-09-12T02:15:50.914 INFO:teuthology.orchestra.run.smithi039.stdout:customizable bootloader with modular architecture. It supports a rich 2024-09-12T02:15:50.914 INFO:teuthology.orchestra.run.smithi039.stdout:variety of kernel formats, file systems, computer architectures and 2024-09-12T02:15:50.914 INFO:teuthology.orchestra.run.smithi039.stdout:hardware devices. 2024-09-12T02:15:50.915 INFO:teuthology.orchestra.run.smithi039.stdout: 2024-09-12T02:15:50.915 INFO:teuthology.orchestra.run.smithi039.stdout:This subpackage provides tools for support of all platforms. 2024-09-12T02:15:50.915 INFO:teuthology.task.kernel:Updating Grub Version: grub2 2024-09-12T02:15:50.916 INFO:teuthology.task.kernel:Updating grub on smithi039 to boot 6.11.0-rc5-g2ca44a2f35ca 2024-09-12T02:15:50.916 DEBUG:teuthology.orchestra.run.smithi039:> sudo grub2-mkconfig -o /boot/grub2/grub.cfg 2024-09-12T02:15:51.501 INFO:teuthology.orchestra.run.smithi039.stderr:Generating grub configuration file ... 2024-09-12T02:15:52.864 INFO:teuthology.orchestra.run.smithi039.stderr:Adding boot menu entry for UEFI Firmware Settings ... 2024-09-12T02:15:52.899 INFO:teuthology.orchestra.run.smithi039.stderr:done 2024-09-12T02:15:52.901 DEBUG:teuthology.orchestra.run.smithi039:> mktemp 2024-09-12T02:15:52.916 INFO:teuthology.orchestra.run.smithi039.stdout:/tmp/tmp.vuwa2fSo6f 2024-09-12T02:15:52.916 DEBUG:teuthology.orchestra.run.smithi039:> sudo cp /boot/grub2/grub.cfg /tmp/tmp.vuwa2fSo6f 2024-09-12T02:15:53.014 DEBUG:teuthology.orchestra.run.smithi039:> sudo chmod 0666 /tmp/tmp.vuwa2fSo6f 2024-09-12T02:15:53.125 DEBUG:teuthology.orchestra.remote:smithi039:/tmp/tmp.vuwa2fSo6f is 6KB 2024-09-12T02:15:53.174 DEBUG:teuthology.orchestra.run.smithi039:> rm -fr /tmp/tmp.vuwa2fSo6f 2024-09-12T02:15:53.189 DEBUG:teuthology.orchestra.run.smithi039:> sudo /bin/ls /boot/loader/entries || true 2024-09-12T02:15:53.260 INFO:teuthology.orchestra.run.smithi039.stdout:fbf6b6fa6cf04654a0e563f30ecbf43a-0-rescue.conf 2024-09-12T02:15:53.260 INFO:teuthology.orchestra.run.smithi039.stdout:fbf6b6fa6cf04654a0e563f30ecbf43a-5.14.0-239.el9.x86_64.conf 2024-09-12T02:15:53.260 INFO:teuthology.orchestra.run.smithi039.stdout:fbf6b6fa6cf04654a0e563f30ecbf43a-5.14.0-503.el9.x86_64.conf 2024-09-12T02:15:53.260 INFO:teuthology.orchestra.run.smithi039.stdout:fbf6b6fa6cf04654a0e563f30ecbf43a-6.11.0-rc5-g2ca44a2f35ca.conf 2024-09-12T02:15:53.261 DEBUG:teuthology.orchestra.run.smithi039:> sudo grub2-set-default fbf6b6fa6cf04654a0e563f30ecbf43a-6.11.0-rc5-g2ca44a2f35ca 2024-09-12T02:15:53.410 DEBUG:teuthology.orchestra.run.smithi039:> sudo shutdown -r now 2024-09-12T02:16:23.413 INFO:teuthology.task.kernel:Checking client client.0 for new kernel version... 2024-09-12T02:16:23.413 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi039.front.sepia.ceph.com' 2024-09-12T02:16:23.414 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi039.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-09-12T02:16:41.789 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.39 2024-09-12T02:16:50.790 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi039.front.sepia.ceph.com' 2024-09-12T02:16:50.791 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi039.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-09-12T02:16:53.853 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.39 2024-09-12T02:17:05.854 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi039.front.sepia.ceph.com' 2024-09-12T02:17:05.855 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi039.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-09-12T02:17:08.925 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.39 2024-09-12T02:17:23.926 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi039.front.sepia.ceph.com' 2024-09-12T02:17:23.927 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi039.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-09-12T02:18:23.930 DEBUG:teuthology.orchestra.remote:timed out 2024-09-12T02:18:41.931 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi039.front.sepia.ceph.com' 2024-09-12T02:18:41.932 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi039.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-09-12T02:18:42.308 DEBUG:teuthology.orchestra.run.smithi039:> true 2024-09-12T02:18:42.821 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi039.front.sepia.ceph.com' 2024-09-12T02:18:42.821 INFO:teuthology.task.kernel:Checking kernel version of client.0, want "6.11.0-rc5-g2ca44a2f35ca"... 2024-09-12T02:18:42.822 DEBUG:teuthology.orchestra.run.smithi039:> uname -r 2024-09-12T02:18:42.856 INFO:teuthology.orchestra.run.smithi039.stdout:6.11.0-rc5-g2ca44a2f35ca 2024-09-12T02:18:42.856 DEBUG:teuthology.task.kernel:current kernel version is 6.11.0-rc5-g2ca44a2f35ca vs 6.11.0-rc5-g2ca44a2f35ca 2024-09-12T02:18:42.856 DEBUG:teuthology.task.kernel:utsrelease strings match, do not need to install 2024-09-12T02:18:42.856 DEBUG:teuthology.task.kernel:Distro of this test job: centos 2024-09-12T02:18:43.858 DEBUG:teuthology.parallel:result is None 2024-09-12T02:18:43.858 INFO:teuthology.run_tasks:Running task internal.base... 2024-09-12T02:18:43.865 INFO:teuthology.task.internal:Creating test directory... 2024-09-12T02:18:43.865 DEBUG:teuthology.orchestra.run.smithi039:> mkdir -p -m0755 -- /home/ubuntu/cephtest 2024-09-12T02:18:43.870 DEBUG:teuthology.orchestra.run.smithi044:> mkdir -p -m0755 -- /home/ubuntu/cephtest 2024-09-12T02:18:43.872 DEBUG:teuthology.orchestra.run.smithi172:> mkdir -p -m0755 -- /home/ubuntu/cephtest 2024-09-12T02:18:43.904 INFO:teuthology.run_tasks:Running task internal.archive_upload... 2024-09-12T02:18:43.912 INFO:teuthology.run_tasks:Running task internal.archive... 2024-09-12T02:18:43.917 INFO:teuthology.task.internal:Creating archive directory... 2024-09-12T02:18:43.917 DEBUG:teuthology.orchestra.run.smithi039:> install -d -m0755 -- /home/ubuntu/cephtest/archive 2024-09-12T02:18:43.949 DEBUG:teuthology.orchestra.run.smithi044:> install -d -m0755 -- /home/ubuntu/cephtest/archive 2024-09-12T02:18:43.951 DEBUG:teuthology.orchestra.run.smithi172:> install -d -m0755 -- /home/ubuntu/cephtest/archive 2024-09-12T02:18:44.053 INFO:teuthology.run_tasks:Running task internal.coredump... 2024-09-12T02:18:44.060 INFO:teuthology.task.internal:Enabling coredump saving... 2024-09-12T02:18:44.060 DEBUG:teuthology.orchestra.run.smithi044:> test -f /run/.containerenv -o -f /.dockerenv 2024-09-12T02:18:44.077 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-12T02:18:44.077 DEBUG:teuthology.orchestra.run.smithi172:> test -f /run/.containerenv -o -f /.dockerenv 2024-09-12T02:18:44.097 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-12T02:18:44.098 DEBUG:teuthology.orchestra.run.smithi039:> install -d -m0755 -- /home/ubuntu/cephtest/archive/coredump && sudo sysctl -w kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core && echo kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core | sudo tee -a /etc/sysctl.conf 2024-09-12T02:18:44.103 DEBUG:teuthology.orchestra.run.smithi044:> install -d -m0755 -- /home/ubuntu/cephtest/archive/coredump && sudo sysctl -w kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core && echo kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core | sudo tee -a /etc/sysctl.conf 2024-09-12T02:18:44.120 DEBUG:teuthology.orchestra.run.smithi172:> install -d -m0755 -- /home/ubuntu/cephtest/archive/coredump && sudo sysctl -w kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core && echo kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core | sudo tee -a /etc/sysctl.conf 2024-09-12T02:18:44.161 INFO:teuthology.orchestra.run.smithi044.stdout:kernel.core_pattern = /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-09-12T02:18:44.179 INFO:teuthology.orchestra.run.smithi172.stdout:kernel.core_pattern = /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-09-12T02:18:44.183 INFO:teuthology.orchestra.run.smithi044.stdout:kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-09-12T02:18:44.194 INFO:teuthology.orchestra.run.smithi172.stdout:kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-09-12T02:18:44.211 INFO:teuthology.orchestra.run.smithi039.stdout:kernel.core_pattern = /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-09-12T02:18:44.243 INFO:teuthology.orchestra.run.smithi039.stdout:kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-09-12T02:18:44.246 INFO:teuthology.run_tasks:Running task internal.sudo... 2024-09-12T02:18:44.253 INFO:teuthology.task.internal:Configuring sudo... 2024-09-12T02:18:44.253 DEBUG:teuthology.orchestra.run.smithi039:> sudo sed -i.orig.teuthology -e 's/^\([^#]*\) \(requiretty\)/\1 !\2/g' -e 's/^\([^#]*\) !\(visiblepw\)/\1 \2/g' /etc/sudoers 2024-09-12T02:18:44.257 DEBUG:teuthology.orchestra.run.smithi044:> sudo sed -i.orig.teuthology -e 's/^\([^#]*\) \(requiretty\)/\1 !\2/g' -e 's/^\([^#]*\) !\(visiblepw\)/\1 \2/g' /etc/sudoers 2024-09-12T02:18:44.260 DEBUG:teuthology.orchestra.run.smithi172:> sudo sed -i.orig.teuthology -e 's/^\([^#]*\) \(requiretty\)/\1 !\2/g' -e 's/^\([^#]*\) !\(visiblepw\)/\1 \2/g' /etc/sudoers 2024-09-12T02:18:44.311 INFO:teuthology.run_tasks:Running task internal.syslog... 2024-09-12T02:18:44.321 INFO:teuthology.task.internal.syslog:Starting syslog monitoring... 2024-09-12T02:18:44.321 DEBUG:teuthology.orchestra.run.smithi039:> mkdir -p -m0755 -- /home/ubuntu/cephtest/archive/syslog 2024-09-12T02:18:44.325 DEBUG:teuthology.orchestra.run.smithi044:> mkdir -p -m0755 -- /home/ubuntu/cephtest/archive/syslog 2024-09-12T02:18:44.328 DEBUG:teuthology.orchestra.run.smithi172:> mkdir -p -m0755 -- /home/ubuntu/cephtest/archive/syslog 2024-09-12T02:18:44.356 DEBUG:teuthology.orchestra.run.smithi039:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/kern.log 2024-09-12T02:18:44.461 DEBUG:teuthology.orchestra.run.smithi039:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/kern.log 2024-09-12T02:18:44.561 DEBUG:teuthology.orchestra.run.smithi039:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/misc.log 2024-09-12T02:18:44.623 DEBUG:teuthology.orchestra.run.smithi039:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/misc.log 2024-09-12T02:18:44.694 DEBUG:teuthology.orchestra.run.smithi039:> set -ex 2024-09-12T02:18:44.695 DEBUG:teuthology.orchestra.run.smithi039:> sudo dd of=/etc/rsyslog.d/80-cephtest.conf 2024-09-12T02:18:44.749 DEBUG:teuthology.orchestra.run.smithi044:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/kern.log 2024-09-12T02:18:44.795 DEBUG:teuthology.orchestra.run.smithi044:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/kern.log 2024-09-12T02:18:44.850 DEBUG:teuthology.orchestra.run.smithi044:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/misc.log 2024-09-12T02:18:44.939 DEBUG:teuthology.orchestra.run.smithi044:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/misc.log 2024-09-12T02:18:44.983 DEBUG:teuthology.orchestra.run.smithi044:> set -ex 2024-09-12T02:18:44.983 DEBUG:teuthology.orchestra.run.smithi044:> sudo dd of=/etc/rsyslog.d/80-cephtest.conf 2024-09-12T02:18:45.051 DEBUG:teuthology.orchestra.run.smithi172:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/kern.log 2024-09-12T02:18:45.097 DEBUG:teuthology.orchestra.run.smithi172:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/kern.log 2024-09-12T02:18:45.152 DEBUG:teuthology.orchestra.run.smithi172:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/misc.log 2024-09-12T02:18:45.237 DEBUG:teuthology.orchestra.run.smithi172:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/misc.log 2024-09-12T02:18:45.280 DEBUG:teuthology.orchestra.run.smithi172:> set -ex 2024-09-12T02:18:45.280 DEBUG:teuthology.orchestra.run.smithi172:> sudo dd of=/etc/rsyslog.d/80-cephtest.conf 2024-09-12T02:18:45.348 DEBUG:teuthology.orchestra.run.smithi039:> sudo service rsyslog restart 2024-09-12T02:18:45.352 DEBUG:teuthology.orchestra.run.smithi044:> sudo service rsyslog restart 2024-09-12T02:18:45.354 DEBUG:teuthology.orchestra.run.smithi172:> sudo service rsyslog restart 2024-09-12T02:18:45.401 INFO:teuthology.orchestra.run.smithi044.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2024-09-12T02:18:45.424 INFO:teuthology.orchestra.run.smithi172.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2024-09-12T02:18:45.443 INFO:teuthology.orchestra.run.smithi039.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2024-09-12T02:18:45.903 INFO:teuthology.run_tasks:Running task internal.timer... 2024-09-12T02:18:45.911 INFO:teuthology.task.internal:Starting timer... 2024-09-12T02:18:45.911 INFO:teuthology.run_tasks:Running task pcp... 2024-09-12T02:18:45.922 INFO:teuthology.run_tasks:Running task selinux... 2024-09-12T02:18:45.934 DEBUG:teuthology.task:Applying overrides for task selinux: {'allowlist': ['scontext=system_u:system_r:logrotate_t:s0', 'scontext=system_u:system_r:getty_t:s0']} 2024-09-12T02:18:45.934 DEBUG:teuthology.orchestra.run.smithi039:> sudo service auditd rotate 2024-09-12T02:18:46.027 INFO:teuthology.orchestra.run.smithi039.stdout:Rotating logs: 2024-09-12T02:18:46.031 DEBUG:teuthology.orchestra.run.smithi044:> sudo service auditd rotate 2024-09-12T02:18:46.101 INFO:teuthology.orchestra.run.smithi044.stdout:Rotating logs: 2024-09-12T02:18:46.103 DEBUG:teuthology.orchestra.run.smithi172:> sudo service auditd rotate 2024-09-12T02:18:46.171 INFO:teuthology.orchestra.run.smithi172.stdout:Rotating logs: 2024-09-12T02:18:46.173 DEBUG:teuthology.task.selinux:Getting current SELinux state 2024-09-12T02:18:46.173 DEBUG:teuthology.orchestra.run.smithi039:> /usr/sbin/getenforce 2024-09-12T02:18:46.227 INFO:teuthology.orchestra.run.smithi039.stdout:Permissive 2024-09-12T02:18:46.227 DEBUG:teuthology.orchestra.run.smithi044:> /usr/sbin/getenforce 2024-09-12T02:18:46.253 INFO:teuthology.orchestra.run.smithi044.stdout:Permissive 2024-09-12T02:18:46.253 DEBUG:teuthology.orchestra.run.smithi172:> /usr/sbin/getenforce 2024-09-12T02:18:46.281 INFO:teuthology.orchestra.run.smithi172.stdout:Permissive 2024-09-12T02:18:46.281 DEBUG:teuthology.task.selinux:Existing SELinux modes: {'ubuntu@smithi039.front.sepia.ceph.com': 'permissive', 'ubuntu@smithi044.front.sepia.ceph.com': 'permissive', 'ubuntu@smithi172.front.sepia.ceph.com': 'permissive'} 2024-09-12T02:18:46.281 DEBUG:teuthology.orchestra.run.smithi039:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av -e 'comm="dmidecode"' -e chronyd.service -e 'name="cephtest"' -e scontext=system_u:system_r:nrpe_t:s0 -e scontext=system_u:system_r:pcp_pmlogger_t -e scontext=system_u:system_r:pcp_pmcd_t:s0 -e 'comm="rhsmd"' -e scontext=system_u:system_r:syslogd_t:s0 -e tcontext=system_u:system_r:nrpe_t:s0 -e 'comm="updatedb"' -e 'comm="smartd"' -e 'comm="rhsmcertd-worke"' -e 'comm="setroubleshootd"' -e 'comm="rpm"' -e tcontext=system_u:object_r:container_runtime_exec_t:s0 -e 'comm="ksmtuned"' -e 'comm="sssd"' -e 'comm="sss_cache"' -e context=system_u:system_r:NetworkManager_dispatcher_t:s0 -e context=system_u:system_r:getty_t:s0 -e scontext=system_u:system_r:logrotate_t:s0 -e scontext=system_u:system_r:getty_t:s0 2024-09-12T02:18:46.338 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-12T02:18:46.339 DEBUG:teuthology.orchestra.run.smithi044:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av -e 'comm="dmidecode"' -e chronyd.service -e 'name="cephtest"' -e scontext=system_u:system_r:nrpe_t:s0 -e scontext=system_u:system_r:pcp_pmlogger_t -e scontext=system_u:system_r:pcp_pmcd_t:s0 -e 'comm="rhsmd"' -e scontext=system_u:system_r:syslogd_t:s0 -e tcontext=system_u:system_r:nrpe_t:s0 -e 'comm="updatedb"' -e 'comm="smartd"' -e 'comm="rhsmcertd-worke"' -e 'comm="setroubleshootd"' -e 'comm="rpm"' -e tcontext=system_u:object_r:container_runtime_exec_t:s0 -e 'comm="ksmtuned"' -e 'comm="sssd"' -e 'comm="sss_cache"' -e context=system_u:system_r:NetworkManager_dispatcher_t:s0 -e context=system_u:system_r:getty_t:s0 -e scontext=system_u:system_r:logrotate_t:s0 -e scontext=system_u:system_r:getty_t:s0 2024-09-12T02:18:46.366 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-12T02:18:46.367 DEBUG:teuthology.orchestra.run.smithi172:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av -e 'comm="dmidecode"' -e chronyd.service -e 'name="cephtest"' -e scontext=system_u:system_r:nrpe_t:s0 -e scontext=system_u:system_r:pcp_pmlogger_t -e scontext=system_u:system_r:pcp_pmcd_t:s0 -e 'comm="rhsmd"' -e scontext=system_u:system_r:syslogd_t:s0 -e tcontext=system_u:system_r:nrpe_t:s0 -e 'comm="updatedb"' -e 'comm="smartd"' -e 'comm="rhsmcertd-worke"' -e 'comm="setroubleshootd"' -e 'comm="rpm"' -e tcontext=system_u:object_r:container_runtime_exec_t:s0 -e 'comm="ksmtuned"' -e 'comm="sssd"' -e 'comm="sss_cache"' -e context=system_u:system_r:NetworkManager_dispatcher_t:s0 -e context=system_u:system_r:getty_t:s0 -e scontext=system_u:system_r:logrotate_t:s0 -e scontext=system_u:system_r:getty_t:s0 2024-09-12T02:18:46.395 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-12T02:18:46.396 INFO:teuthology.task.selinux:Putting SELinux into permissive mode 2024-09-12T02:18:46.396 DEBUG:teuthology.orchestra.run.smithi039:> sudo /usr/sbin/setenforce permissive 2024-09-12T02:18:46.460 DEBUG:teuthology.orchestra.run.smithi044:> sudo /usr/sbin/setenforce permissive 2024-09-12T02:18:46.500 DEBUG:teuthology.orchestra.run.smithi172:> sudo /usr/sbin/setenforce permissive 2024-09-12T02:18:46.542 INFO:teuthology.run_tasks:Running task ansible.cephlab... 2024-09-12T02:18:46.554 DEBUG:teuthology.repo_utils:Setting repo remote to https://git.ceph.com/ceph-cm-ansible.git 2024-09-12T02:18:46.557 INFO:teuthology.repo_utils:Fetching git.ceph.com_ceph-cm-ansible_main from origin 2024-09-12T02:18:46.680 DEBUG:teuthology.repo_utils:Resetting repo at /home/teuthworker/src/git.ceph.com_ceph-cm-ansible_main to origin/main 2024-09-12T02:18:46.691 INFO:teuthology.task.ansible:Playbook: [{'import_playbook': 'ansible_managed.yml'}, {'import_playbook': 'teuthology.yml'}, {'hosts': 'testnodes', 'tasks': [{'set_fact': {'ran_from_cephlab_playbook': True}}]}, {'import_playbook': 'testnodes.yml'}, {'import_playbook': 'container-host.yml'}, {'import_playbook': 'cobbler.yml'}, {'import_playbook': 'paddles.yml'}, {'import_playbook': 'pulpito.yml'}, {'hosts': 'testnodes', 'become': True, 'tasks': [{'name': 'Touch /ceph-qa-ready', 'file': {'path': '/ceph-qa-ready', 'state': 'touch'}, 'when': 'ran_from_cephlab_playbook|bool'}]}] 2024-09-12T02:18:46.717 DEBUG:teuthology.task.ansible:Running ansible-playbook -v --extra-vars '{"ansible_ssh_user": "ubuntu"}' -i /etc/ansible/hosts --limit smithi039.front.sepia.ceph.com,smithi044.front.sepia.ceph.com,smithi172.front.sepia.ceph.com /home/teuthworker/src/git.ceph.com_ceph-cm-ansible_main/cephlab.yml 2024-09-12T02:23:34.638 DEBUG:teuthology.task.ansible:Reconnecting to [Remote(name='ubuntu@smithi039.front.sepia.ceph.com'), Remote(name='ubuntu@smithi044.front.sepia.ceph.com'), Remote(name='ubuntu@smithi172.front.sepia.ceph.com')] 2024-09-12T02:23:34.639 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi039.front.sepia.ceph.com' 2024-09-12T02:23:34.641 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi039.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-09-12T02:23:34.733 DEBUG:teuthology.orchestra.run.smithi039:> true 2024-09-12T02:23:34.839 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi039.front.sepia.ceph.com' 2024-09-12T02:23:34.839 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi044.front.sepia.ceph.com' 2024-09-12T02:23:34.840 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi044.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-09-12T02:23:34.916 DEBUG:teuthology.orchestra.run.smithi044:> true 2024-09-12T02:23:35.001 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi044.front.sepia.ceph.com' 2024-09-12T02:23:35.002 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi172.front.sepia.ceph.com' 2024-09-12T02:23:35.002 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi172.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-09-12T02:23:35.084 DEBUG:teuthology.orchestra.run.smithi172:> true 2024-09-12T02:23:35.166 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi172.front.sepia.ceph.com' 2024-09-12T02:23:35.167 INFO:teuthology.run_tasks:Running task clock... 2024-09-12T02:23:35.180 INFO:teuthology.task.clock:Syncing clocks and checking initial clock skew... 2024-09-12T02:23:35.180 INFO:teuthology.orchestra.run:Running command with timeout 360 2024-09-12T02:23:35.181 DEBUG:teuthology.orchestra.run.smithi039:> sudo systemctl stop ntp.service || sudo systemctl stop ntpd.service || sudo systemctl stop chronyd.service ; sudo ntpd -gq || sudo chronyc makestep ; sudo systemctl start ntp.service || sudo systemctl start ntpd.service || sudo systemctl start chronyd.service ; PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2024-09-12T02:23:35.184 INFO:teuthology.orchestra.run:Running command with timeout 360 2024-09-12T02:23:35.185 DEBUG:teuthology.orchestra.run.smithi044:> sudo systemctl stop ntp.service || sudo systemctl stop ntpd.service || sudo systemctl stop chronyd.service ; sudo ntpd -gq || sudo chronyc makestep ; sudo systemctl start ntp.service || sudo systemctl start ntpd.service || sudo systemctl start chronyd.service ; PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2024-09-12T02:23:35.187 INFO:teuthology.orchestra.run:Running command with timeout 360 2024-09-12T02:23:35.187 DEBUG:teuthology.orchestra.run.smithi172:> sudo systemctl stop ntp.service || sudo systemctl stop ntpd.service || sudo systemctl stop chronyd.service ; sudo ntpd -gq || sudo chronyc makestep ; sudo systemctl start ntp.service || sudo systemctl start ntpd.service || sudo systemctl start chronyd.service ; PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2024-09-12T02:23:35.217 INFO:teuthology.orchestra.run.smithi044.stderr:Failed to stop ntp.service: Unit ntp.service not loaded. 2024-09-12T02:23:35.233 INFO:teuthology.orchestra.run.smithi044.stderr:Failed to stop ntpd.service: Unit ntpd.service not loaded. 2024-09-12T02:23:35.239 INFO:teuthology.orchestra.run.smithi172.stderr:Failed to stop ntp.service: Unit ntp.service not loaded. 2024-09-12T02:23:35.241 INFO:teuthology.orchestra.run.smithi039.stderr:Failed to stop ntp.service: Unit ntp.service not loaded. 2024-09-12T02:23:35.255 INFO:teuthology.orchestra.run.smithi172.stderr:Failed to stop ntpd.service: Unit ntpd.service not loaded. 2024-09-12T02:23:35.258 INFO:teuthology.orchestra.run.smithi044.stderr:sudo: ntpd: command not found 2024-09-12T02:23:35.270 INFO:teuthology.orchestra.run.smithi044.stdout:506 Cannot talk to daemon 2024-09-12T02:23:35.271 INFO:teuthology.orchestra.run.smithi039.stderr:Failed to stop ntpd.service: Unit ntpd.service not loaded. 2024-09-12T02:23:35.281 INFO:teuthology.orchestra.run.smithi172.stderr:sudo: ntpd: command not found 2024-09-12T02:23:35.285 INFO:teuthology.orchestra.run.smithi044.stderr:Failed to start ntp.service: Unit ntp.service not found. 2024-09-12T02:23:35.293 INFO:teuthology.orchestra.run.smithi172.stdout:506 Cannot talk to daemon 2024-09-12T02:23:35.299 INFO:teuthology.orchestra.run.smithi044.stderr:Failed to start ntpd.service: Unit ntpd.service not found. 2024-09-12T02:23:35.307 INFO:teuthology.orchestra.run.smithi172.stderr:Failed to start ntp.service: Unit ntp.service not found. 2024-09-12T02:23:35.322 INFO:teuthology.orchestra.run.smithi172.stderr:Failed to start ntpd.service: Unit ntpd.service not found. 2024-09-12T02:23:35.322 INFO:teuthology.orchestra.run.smithi039.stderr:sudo: ntpd: command not found 2024-09-12T02:23:35.347 INFO:teuthology.orchestra.run.smithi039.stdout:506 Cannot talk to daemon 2024-09-12T02:23:35.359 INFO:teuthology.orchestra.run.smithi044.stderr:bash: line 1: ntpq: command not found 2024-09-12T02:23:35.363 INFO:teuthology.orchestra.run.smithi044.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2024-09-12T02:23:35.363 INFO:teuthology.orchestra.run.smithi044.stdout:=============================================================================== 2024-09-12T02:23:35.363 INFO:teuthology.orchestra.run.smithi044.stdout:^? hv01.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-09-12T02:23:35.363 INFO:teuthology.orchestra.run.smithi044.stdout:^? hv02.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-09-12T02:23:35.363 INFO:teuthology.orchestra.run.smithi044.stdout:^? hv03.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-09-12T02:23:35.363 INFO:teuthology.orchestra.run.smithi044.stdout:^? hv04.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-09-12T02:23:35.376 INFO:teuthology.orchestra.run.smithi039.stderr:Failed to start ntp.service: Unit ntp.service not found. 2024-09-12T02:23:35.380 INFO:teuthology.orchestra.run.smithi172.stderr:bash: line 1: ntpq: command not found 2024-09-12T02:23:35.385 INFO:teuthology.orchestra.run.smithi172.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2024-09-12T02:23:35.385 INFO:teuthology.orchestra.run.smithi172.stdout:=============================================================================== 2024-09-12T02:23:35.385 INFO:teuthology.orchestra.run.smithi172.stdout:^? hv01.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-09-12T02:23:35.385 INFO:teuthology.orchestra.run.smithi172.stdout:^? hv02.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-09-12T02:23:35.385 INFO:teuthology.orchestra.run.smithi172.stdout:^? hv03.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-09-12T02:23:35.385 INFO:teuthology.orchestra.run.smithi172.stdout:^? hv04.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-09-12T02:23:35.405 INFO:teuthology.orchestra.run.smithi039.stderr:Failed to start ntpd.service: Unit ntpd.service not found. 2024-09-12T02:23:35.506 INFO:teuthology.orchestra.run.smithi039.stderr:bash: line 1: ntpq: command not found 2024-09-12T02:23:35.512 INFO:teuthology.orchestra.run.smithi039.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2024-09-12T02:23:35.512 INFO:teuthology.orchestra.run.smithi039.stdout:=============================================================================== 2024-09-12T02:23:35.512 INFO:teuthology.orchestra.run.smithi039.stdout:^? hv01.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-09-12T02:23:35.512 INFO:teuthology.orchestra.run.smithi039.stdout:^? hv02.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-09-12T02:23:35.512 INFO:teuthology.orchestra.run.smithi039.stdout:^? hv03.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-09-12T02:23:35.512 INFO:teuthology.orchestra.run.smithi039.stdout:^? hv04.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-09-12T02:23:35.513 INFO:teuthology.run_tasks:Running task install... 2024-09-12T02:23:35.521 DEBUG:teuthology.task.install:project ceph 2024-09-12T02:23:35.522 DEBUG:teuthology.task.install:INSTALL overrides: {'ceph': {'flavor': 'default', 'sha1': 'b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc'}} 2024-09-12T02:23:35.522 DEBUG:teuthology.task.install:config {'extra_packages': {'deb': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror'], 'rpm': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror']}, 'extra_system_packages': {'deb': ['bison', 'flex', 'libelf-dev', 'libssl-dev', 'network-manager', 'iproute2', 'util-linux', 'dump', 'indent', 'libaio-dev', 'libtool-bin', 'uuid-dev', 'xfslibs-dev', 'postgresql', 'postgresql-client', 'postgresql-common', 'postgresql-contrib'], 'rpm': ['bison', 'flex', 'elfutils-libelf-devel', 'openssl-devel', 'NetworkManager', 'iproute', 'util-linux', 'libacl-devel', 'libaio-devel', 'libattr-devel', 'libtool', 'libuuid-devel', 'xfsdump', 'xfsprogs', 'xfsprogs-devel', 'libaio-devel', 'libtool', 'libuuid-devel', 'xfsprogs-devel', 'postgresql', 'postgresql-server', 'postgresql-contrib']}, 'flavor': 'default', 'sha1': 'b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc'} 2024-09-12T02:23:35.522 INFO:teuthology.task.install:Using flavor: default 2024-09-12T02:23:35.528 DEBUG:teuthology.task.install:Package list is: {'deb': ['ceph', 'cephadm', 'ceph-mds', 'ceph-mgr', 'ceph-common', 'ceph-fuse', 'ceph-test', 'ceph-volume', 'radosgw', 'python3-rados', 'python3-rgw', 'python3-cephfs', 'python3-rbd', 'libcephfs2', 'libcephfs-dev', 'librados2', 'librbd1', 'rbd-fuse'], 'rpm': ['ceph-radosgw', 'ceph-test', 'ceph', 'ceph-base', 'cephadm', 'ceph-immutable-object-cache', 'ceph-mgr', 'ceph-mgr-dashboard', 'ceph-mgr-diskprediction-local', 'ceph-mgr-rook', 'ceph-mgr-cephadm', 'ceph-fuse', 'ceph-volume', 'librados-devel', 'libcephfs2', 'libcephfs-devel', 'librados2', 'librbd1', 'python3-rados', 'python3-rgw', 'python3-cephfs', 'python3-rbd', 'rbd-fuse', 'rbd-mirror', 'rbd-nbd']} 2024-09-12T02:23:35.528 INFO:teuthology.task.install:extra packages: {'deb': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror'], 'rpm': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror']} 2024-09-12T02:23:35.528 DEBUG:teuthology.task.install.rpm:_update_package_list_and_install: config is {'branch': None, 'cleanup': None, 'debuginfo': None, 'downgrade_packages': [], 'exclude_packages': [], 'extra_packages': {'deb': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror'], 'rpm': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror']}, 'extra_system_packages': {'deb': ['bison', 'flex', 'libelf-dev', 'libssl-dev', 'network-manager', 'iproute2', 'util-linux', 'dump', 'indent', 'libaio-dev', 'libtool-bin', 'uuid-dev', 'xfslibs-dev', 'postgresql', 'postgresql-client', 'postgresql-common', 'postgresql-contrib'], 'rpm': ['bison', 'flex', 'elfutils-libelf-devel', 'openssl-devel', 'NetworkManager', 'iproute', 'util-linux', 'libacl-devel', 'libaio-devel', 'libattr-devel', 'libtool', 'libuuid-devel', 'xfsdump', 'xfsprogs', 'xfsprogs-devel', 'libaio-devel', 'libtool', 'libuuid-devel', 'xfsprogs-devel', 'postgresql', 'postgresql-server', 'postgresql-contrib']}, 'extras': None, 'enable_coprs': [], 'flavor': 'default', 'install_ceph_packages': True, 'packages': {}, 'project': 'ceph', 'repos_only': False, 'sha1': 'b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc', 'tag': None, 'wait_for_package': False} 2024-09-12T02:23:35.529 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F9%2Fx86_64&sha1=b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc 2024-09-12T02:23:35.531 DEBUG:teuthology.task.install.rpm:_update_package_list_and_install: config is {'branch': None, 'cleanup': None, 'debuginfo': None, 'downgrade_packages': [], 'exclude_packages': [], 'extra_packages': {'deb': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror'], 'rpm': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror']}, 'extra_system_packages': {'deb': ['bison', 'flex', 'libelf-dev', 'libssl-dev', 'network-manager', 'iproute2', 'util-linux', 'dump', 'indent', 'libaio-dev', 'libtool-bin', 'uuid-dev', 'xfslibs-dev', 'postgresql', 'postgresql-client', 'postgresql-common', 'postgresql-contrib'], 'rpm': ['bison', 'flex', 'elfutils-libelf-devel', 'openssl-devel', 'NetworkManager', 'iproute', 'util-linux', 'libacl-devel', 'libaio-devel', 'libattr-devel', 'libtool', 'libuuid-devel', 'xfsdump', 'xfsprogs', 'xfsprogs-devel', 'libaio-devel', 'libtool', 'libuuid-devel', 'xfsprogs-devel', 'postgresql', 'postgresql-server', 'postgresql-contrib']}, 'extras': None, 'enable_coprs': [], 'flavor': 'default', 'install_ceph_packages': True, 'packages': {}, 'project': 'ceph', 'repos_only': False, 'sha1': 'b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc', 'tag': None, 'wait_for_package': False} 2024-09-12T02:23:35.531 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F9%2Fx86_64&sha1=b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc 2024-09-12T02:23:35.532 DEBUG:teuthology.task.install.rpm:_update_package_list_and_install: config is {'branch': None, 'cleanup': None, 'debuginfo': None, 'downgrade_packages': [], 'exclude_packages': [], 'extra_packages': {'deb': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror'], 'rpm': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror']}, 'extra_system_packages': {'deb': ['bison', 'flex', 'libelf-dev', 'libssl-dev', 'network-manager', 'iproute2', 'util-linux', 'dump', 'indent', 'libaio-dev', 'libtool-bin', 'uuid-dev', 'xfslibs-dev', 'postgresql', 'postgresql-client', 'postgresql-common', 'postgresql-contrib'], 'rpm': ['bison', 'flex', 'elfutils-libelf-devel', 'openssl-devel', 'NetworkManager', 'iproute', 'util-linux', 'libacl-devel', 'libaio-devel', 'libattr-devel', 'libtool', 'libuuid-devel', 'xfsdump', 'xfsprogs', 'xfsprogs-devel', 'libaio-devel', 'libtool', 'libuuid-devel', 'xfsprogs-devel', 'postgresql', 'postgresql-server', 'postgresql-contrib']}, 'extras': None, 'enable_coprs': [], 'flavor': 'default', 'install_ceph_packages': True, 'packages': {}, 'project': 'ceph', 'repos_only': False, 'sha1': 'b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc', 'tag': None, 'wait_for_package': False} 2024-09-12T02:23:35.532 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F9%2Fx86_64&sha1=b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc 2024-09-12T02:23:35.675 INFO:teuthology.task.install.rpm:Pulling from https://2.chacra.ceph.com/r/ceph/squid/b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc/centos/9/flavors/default/ 2024-09-12T02:23:35.675 INFO:teuthology.task.install.rpm:Package version is 19.1.1-298.gb53b6d3e 2024-09-12T02:23:35.683 INFO:teuthology.task.install.rpm:Pulling from https://2.chacra.ceph.com/r/ceph/squid/b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc/centos/9/flavors/default/ 2024-09-12T02:23:35.683 INFO:teuthology.task.install.rpm:Package version is 19.1.1-298.gb53b6d3e 2024-09-12T02:23:35.693 INFO:teuthology.task.install.rpm:Pulling from https://2.chacra.ceph.com/r/ceph/squid/b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc/centos/9/flavors/default/ 2024-09-12T02:23:35.693 INFO:teuthology.task.install.rpm:Package version is 19.1.1-298.gb53b6d3e 2024-09-12T02:23:35.789 INFO:teuthology.packaging:Writing yum repo: [ceph] name=ceph packages for $basearch baseurl=https://2.chacra.ceph.com/r/ceph/squid/b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc/centos/9/flavors/default/$basearch enabled=1 gpgcheck=0 type=rpm-md [ceph-noarch] name=ceph noarch packages baseurl=https://2.chacra.ceph.com/r/ceph/squid/b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc/centos/9/flavors/default/noarch enabled=1 gpgcheck=0 type=rpm-md [ceph-source] name=ceph source packages baseurl=https://2.chacra.ceph.com/r/ceph/squid/b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc/centos/9/flavors/default/SRPMS enabled=1 gpgcheck=0 type=rpm-md 2024-09-12T02:23:35.790 DEBUG:teuthology.orchestra.run.smithi039:> set -ex 2024-09-12T02:23:35.790 DEBUG:teuthology.orchestra.run.smithi039:> sudo dd of=/etc/yum.repos.d/ceph.repo 2024-09-12T02:23:35.796 INFO:teuthology.packaging:Writing yum repo: [ceph] name=ceph packages for $basearch baseurl=https://2.chacra.ceph.com/r/ceph/squid/b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc/centos/9/flavors/default/$basearch enabled=1 gpgcheck=0 type=rpm-md [ceph-noarch] name=ceph noarch packages baseurl=https://2.chacra.ceph.com/r/ceph/squid/b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc/centos/9/flavors/default/noarch enabled=1 gpgcheck=0 type=rpm-md [ceph-source] name=ceph source packages baseurl=https://2.chacra.ceph.com/r/ceph/squid/b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc/centos/9/flavors/default/SRPMS enabled=1 gpgcheck=0 type=rpm-md 2024-09-12T02:23:35.796 DEBUG:teuthology.orchestra.run.smithi172:> set -ex 2024-09-12T02:23:35.796 DEBUG:teuthology.orchestra.run.smithi172:> sudo dd of=/etc/yum.repos.d/ceph.repo 2024-09-12T02:23:35.801 INFO:teuthology.packaging:Writing yum repo: [ceph] name=ceph packages for $basearch baseurl=https://2.chacra.ceph.com/r/ceph/squid/b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc/centos/9/flavors/default/$basearch enabled=1 gpgcheck=0 type=rpm-md [ceph-noarch] name=ceph noarch packages baseurl=https://2.chacra.ceph.com/r/ceph/squid/b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc/centos/9/flavors/default/noarch enabled=1 gpgcheck=0 type=rpm-md [ceph-source] name=ceph source packages baseurl=https://2.chacra.ceph.com/r/ceph/squid/b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc/centos/9/flavors/default/SRPMS enabled=1 gpgcheck=0 type=rpm-md 2024-09-12T02:23:35.801 DEBUG:teuthology.orchestra.run.smithi044:> set -ex 2024-09-12T02:23:35.801 DEBUG:teuthology.orchestra.run.smithi044:> sudo dd of=/etc/yum.repos.d/ceph.repo 2024-09-12T02:23:35.822 INFO:teuthology.task.install.rpm:Installing packages: ceph-radosgw, ceph-test, ceph, ceph-base, cephadm, ceph-immutable-object-cache, ceph-mgr, ceph-mgr-dashboard, ceph-mgr-diskprediction-local, ceph-mgr-rook, ceph-mgr-cephadm, ceph-fuse, ceph-volume, librados-devel, libcephfs2, libcephfs-devel, librados2, librbd1, python3-rados, python3-rgw, python3-cephfs, python3-rbd, rbd-fuse, rbd-mirror, rbd-nbd, python3-cephfs, cephfs-shell, cephfs-top, cephfs-mirror, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib on remote rpm x86_64 2024-09-12T02:23:35.823 DEBUG:teuthology.orchestra.run.smithi172:> if test -f /etc/yum.repos.d/ceph.repo ; then sudo sed -i -e ':a;N;$!ba;s/enabled=1\ngpg/enabled=1\npriority=1\ngpg/g' -e 's;ref/[a-zA-Z0-9_-]*/;sha1/b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc/;g' /etc/yum.repos.d/ceph.repo ; fi 2024-09-12T02:23:35.826 INFO:teuthology.task.install.rpm:Installing packages: ceph-radosgw, ceph-test, ceph, ceph-base, cephadm, ceph-immutable-object-cache, ceph-mgr, ceph-mgr-dashboard, ceph-mgr-diskprediction-local, ceph-mgr-rook, ceph-mgr-cephadm, ceph-fuse, ceph-volume, librados-devel, libcephfs2, libcephfs-devel, librados2, librbd1, python3-rados, python3-rgw, python3-cephfs, python3-rbd, rbd-fuse, rbd-mirror, rbd-nbd, python3-cephfs, cephfs-shell, cephfs-top, cephfs-mirror, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib on remote rpm x86_64 2024-09-12T02:23:35.826 DEBUG:teuthology.orchestra.run.smithi044:> if test -f /etc/yum.repos.d/ceph.repo ; then sudo sed -i -e ':a;N;$!ba;s/enabled=1\ngpg/enabled=1\npriority=1\ngpg/g' -e 's;ref/[a-zA-Z0-9_-]*/;sha1/b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc/;g' /etc/yum.repos.d/ceph.repo ; fi 2024-09-12T02:23:35.847 INFO:teuthology.task.install.rpm:Installing packages: ceph-radosgw, ceph-test, ceph, ceph-base, cephadm, ceph-immutable-object-cache, ceph-mgr, ceph-mgr-dashboard, ceph-mgr-diskprediction-local, ceph-mgr-rook, ceph-mgr-cephadm, ceph-fuse, ceph-volume, librados-devel, libcephfs2, libcephfs-devel, librados2, librbd1, python3-rados, python3-rgw, python3-cephfs, python3-rbd, rbd-fuse, rbd-mirror, rbd-nbd, python3-cephfs, cephfs-shell, cephfs-top, cephfs-mirror, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib on remote rpm x86_64 2024-09-12T02:23:35.847 DEBUG:teuthology.orchestra.run.smithi039:> if test -f /etc/yum.repos.d/ceph.repo ; then sudo sed -i -e ':a;N;$!ba;s/enabled=1\ngpg/enabled=1\npriority=1\ngpg/g' -e 's;ref/[a-zA-Z0-9_-]*/;sha1/b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc/;g' /etc/yum.repos.d/ceph.repo ; fi 2024-09-12T02:23:35.889 DEBUG:teuthology.orchestra.run.smithi172:> sudo touch -a /etc/yum/pluginconf.d/priorities.conf ; test -e /etc/yum/pluginconf.d/priorities.conf.orig || sudo cp -af /etc/yum/pluginconf.d/priorities.conf /etc/yum/pluginconf.d/priorities.conf.orig 2024-09-12T02:23:35.892 DEBUG:teuthology.orchestra.run.smithi044:> sudo touch -a /etc/yum/pluginconf.d/priorities.conf ; test -e /etc/yum/pluginconf.d/priorities.conf.orig || sudo cp -af /etc/yum/pluginconf.d/priorities.conf /etc/yum/pluginconf.d/priorities.conf.orig 2024-09-12T02:23:35.944 DEBUG:teuthology.orchestra.run.smithi039:> sudo touch -a /etc/yum/pluginconf.d/priorities.conf ; test -e /etc/yum/pluginconf.d/priorities.conf.orig || sudo cp -af /etc/yum/pluginconf.d/priorities.conf /etc/yum/pluginconf.d/priorities.conf.orig 2024-09-12T02:23:35.965 DEBUG:teuthology.orchestra.run.smithi172:> grep check_obsoletes /etc/yum/pluginconf.d/priorities.conf && sudo sed -i 's/check_obsoletes.*0/check_obsoletes = 1/g' /etc/yum/pluginconf.d/priorities.conf || echo 'check_obsoletes = 1' | sudo tee -a /etc/yum/pluginconf.d/priorities.conf 2024-09-12T02:23:35.966 DEBUG:teuthology.orchestra.run.smithi044:> grep check_obsoletes /etc/yum/pluginconf.d/priorities.conf && sudo sed -i 's/check_obsoletes.*0/check_obsoletes = 1/g' /etc/yum/pluginconf.d/priorities.conf || echo 'check_obsoletes = 1' | sudo tee -a /etc/yum/pluginconf.d/priorities.conf 2024-09-12T02:23:36.023 DEBUG:teuthology.orchestra.run.smithi039:> grep check_obsoletes /etc/yum/pluginconf.d/priorities.conf && sudo sed -i 's/check_obsoletes.*0/check_obsoletes = 1/g' /etc/yum/pluginconf.d/priorities.conf || echo 'check_obsoletes = 1' | sudo tee -a /etc/yum/pluginconf.d/priorities.conf 2024-09-12T02:23:36.029 INFO:teuthology.orchestra.run.smithi172.stdout:check_obsoletes = 1 2024-09-12T02:23:36.030 INFO:teuthology.orchestra.run.smithi044.stdout:check_obsoletes = 1 2024-09-12T02:23:36.031 DEBUG:teuthology.orchestra.run.smithi172:> sudo yum clean all 2024-09-12T02:23:36.032 DEBUG:teuthology.orchestra.run.smithi044:> sudo yum clean all 2024-09-12T02:23:36.081 INFO:teuthology.orchestra.run.smithi039.stdout:check_obsoletes = 1 2024-09-12T02:23:36.082 DEBUG:teuthology.orchestra.run.smithi039:> sudo yum clean all 2024-09-12T02:23:36.259 INFO:teuthology.orchestra.run.smithi172.stdout:45 files removed 2024-09-12T02:23:36.262 INFO:teuthology.orchestra.run.smithi044.stdout:45 files removed 2024-09-12T02:23:36.285 DEBUG:teuthology.orchestra.run.smithi172:> sudo yum -y install ceph-radosgw ceph-test ceph ceph-base cephadm ceph-immutable-object-cache ceph-mgr ceph-mgr-dashboard ceph-mgr-diskprediction-local ceph-mgr-rook ceph-mgr-cephadm ceph-fuse ceph-volume librados-devel libcephfs2 libcephfs-devel librados2 librbd1 python3-rados python3-rgw python3-cephfs python3-rbd rbd-fuse rbd-mirror rbd-nbd python3-cephfs cephfs-shell cephfs-top cephfs-mirror bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib 2024-09-12T02:23:36.290 DEBUG:teuthology.orchestra.run.smithi044:> sudo yum -y install ceph-radosgw ceph-test ceph ceph-base cephadm ceph-immutable-object-cache ceph-mgr ceph-mgr-dashboard ceph-mgr-diskprediction-local ceph-mgr-rook ceph-mgr-cephadm ceph-fuse ceph-volume librados-devel libcephfs2 libcephfs-devel librados2 librbd1 python3-rados python3-rgw python3-cephfs python3-rbd rbd-fuse rbd-mirror rbd-nbd python3-cephfs cephfs-shell cephfs-top cephfs-mirror bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib 2024-09-12T02:23:36.360 INFO:teuthology.orchestra.run.smithi039.stdout:45 files removed 2024-09-12T02:23:36.393 DEBUG:teuthology.orchestra.run.smithi039:> sudo yum -y install ceph-radosgw ceph-test ceph ceph-base cephadm ceph-immutable-object-cache ceph-mgr ceph-mgr-dashboard ceph-mgr-diskprediction-local ceph-mgr-rook ceph-mgr-cephadm ceph-fuse ceph-volume librados-devel libcephfs2 libcephfs-devel librados2 librbd1 python3-rados python3-rgw python3-cephfs python3-rbd rbd-fuse rbd-mirror rbd-nbd python3-cephfs cephfs-shell cephfs-top cephfs-mirror bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib 2024-09-12T02:23:36.832 INFO:teuthology.orchestra.run.smithi172.stdout:ceph packages for x86_64 314 kB/s | 84 kB 00:00 2024-09-12T02:23:36.837 INFO:teuthology.orchestra.run.smithi044.stdout:ceph packages for x86_64 314 kB/s | 84 kB 00:00 2024-09-12T02:23:37.086 INFO:teuthology.orchestra.run.smithi039.stdout:ceph packages for x86_64 293 kB/s | 84 kB 00:00 2024-09-12T02:23:37.116 INFO:teuthology.orchestra.run.smithi172.stdout:ceph noarch packages 49 kB/s | 12 kB 00:00 2024-09-12T02:23:37.122 INFO:teuthology.orchestra.run.smithi044.stdout:ceph noarch packages 49 kB/s | 12 kB 00:00 2024-09-12T02:23:37.370 INFO:teuthology.orchestra.run.smithi039.stdout:ceph noarch packages 49 kB/s | 12 kB 00:00 2024-09-12T02:23:37.391 INFO:teuthology.orchestra.run.smithi172.stdout:ceph source packages 7.9 kB/s | 1.9 kB 00:00 2024-09-12T02:23:37.406 INFO:teuthology.orchestra.run.smithi044.stdout:ceph source packages 7.7 kB/s | 1.9 kB 00:00 2024-09-12T02:23:37.645 INFO:teuthology.orchestra.run.smithi039.stdout:ceph source packages 8.0 kB/s | 1.9 kB 00:00 2024-09-12T02:23:38.279 INFO:teuthology.orchestra.run.smithi039.stdout:CentOS Stream 9 - BaseOS 14 MB/s | 8.2 MB 00:00 2024-09-12T02:23:39.491 INFO:teuthology.orchestra.run.smithi172.stdout:CentOS Stream 9 - BaseOS 4.0 MB/s | 8.2 MB 00:02 2024-09-12T02:23:40.371 INFO:teuthology.orchestra.run.smithi039.stdout:CentOS Stream 9 - AppStream 22 MB/s | 20 MB 00:00 2024-09-12T02:23:42.106 INFO:teuthology.orchestra.run.smithi044.stdout:CentOS Stream 9 - BaseOS 1.8 MB/s | 8.2 MB 00:04 2024-09-12T02:23:44.358 INFO:teuthology.orchestra.run.smithi172.stdout:CentOS Stream 9 - AppStream 5.4 MB/s | 20 MB 00:03 2024-09-12T02:23:45.331 INFO:teuthology.orchestra.run.smithi039.stdout:CentOS Stream 9 - CRB 7.9 MB/s | 6.5 MB 00:00 2024-09-12T02:23:46.455 INFO:teuthology.orchestra.run.smithi044.stdout:CentOS Stream 9 - AppStream 6.4 MB/s | 20 MB 00:03 2024-09-12T02:23:46.889 INFO:teuthology.orchestra.run.smithi039.stdout:CentOS Stream 9 - Extras packages 91 kB/s | 19 kB 00:00 2024-09-12T02:23:47.869 INFO:teuthology.orchestra.run.smithi039.stdout:Extra Packages for Enterprise Linux 27 MB/s | 23 MB 00:00 2024-09-12T02:23:50.051 INFO:teuthology.orchestra.run.smithi172.stdout:CentOS Stream 9 - CRB 3.5 MB/s | 6.5 MB 00:01 2024-09-12T02:23:50.874 INFO:teuthology.orchestra.run.smithi044.stdout:CentOS Stream 9 - CRB 14 MB/s | 6.5 MB 00:00 2024-09-12T02:23:51.534 INFO:teuthology.orchestra.run.smithi172.stdout:CentOS Stream 9 - Extras packages 69 kB/s | 19 kB 00:00 2024-09-12T02:23:52.441 INFO:teuthology.orchestra.run.smithi044.stdout:CentOS Stream 9 - Extras packages 62 kB/s | 19 kB 00:00 2024-09-12T02:23:52.680 INFO:teuthology.orchestra.run.smithi172.stdout:Extra Packages for Enterprise Linux 22 MB/s | 23 MB 00:01 2024-09-12T02:23:53.220 INFO:teuthology.orchestra.run.smithi044.stdout:Extra Packages for Enterprise Linux 35 MB/s | 23 MB 00:00 2024-09-12T02:23:54.491 INFO:teuthology.orchestra.run.smithi039.stdout:lab-extras 30 kB/s | 1.7 kB 00:00 2024-09-12T02:23:57.064 INFO:teuthology.orchestra.run.smithi039.stdout:Package librados2-2:16.2.4-5.el9.x86_64 is already installed. 2024-09-12T02:23:57.065 INFO:teuthology.orchestra.run.smithi039.stdout:Package librbd1-2:16.2.4-5.el9.x86_64 is already installed. 2024-09-12T02:23:57.078 INFO:teuthology.orchestra.run.smithi039.stdout:Package NetworkManager-1:1.48.8-1.el9.x86_64 is already installed. 2024-09-12T02:23:57.079 INFO:teuthology.orchestra.run.smithi039.stdout:Package iproute-6.2.0-5.el9.x86_64 is already installed. 2024-09-12T02:23:57.080 INFO:teuthology.orchestra.run.smithi039.stdout:Package util-linux-2.37.4-20.el9.x86_64 is already installed. 2024-09-12T02:23:57.081 INFO:teuthology.orchestra.run.smithi039.stdout:Package libacl-devel-2.3.1-4.el9.x86_64 is already installed. 2024-09-12T02:23:57.083 INFO:teuthology.orchestra.run.smithi039.stdout:Package libattr-devel-2.5.1-3.el9.x86_64 is already installed. 2024-09-12T02:23:57.086 INFO:teuthology.orchestra.run.smithi039.stdout:Package xfsdump-3.1.12-4.el9.x86_64 is already installed. 2024-09-12T02:23:57.087 INFO:teuthology.orchestra.run.smithi039.stdout:Package xfsprogs-6.4.0-4.el9.x86_64 is already installed. 2024-09-12T02:23:57.158 INFO:teuthology.orchestra.run.smithi039.stdout:Dependencies resolved. 2024-09-12T02:23:57.180 INFO:teuthology.orchestra.run.smithi039.stdout:====================================================================================== 2024-09-12T02:23:57.180 INFO:teuthology.orchestra.run.smithi039.stdout: Package Arch Version Repository Size 2024-09-12T02:23:57.180 INFO:teuthology.orchestra.run.smithi039.stdout:====================================================================================== 2024-09-12T02:23:57.180 INFO:teuthology.orchestra.run.smithi039.stdout:Installing: 2024-09-12T02:23:57.180 INFO:teuthology.orchestra.run.smithi039.stdout: bison x86_64 3.7.4-5.el9 appstream 943 k 2024-09-12T02:23:57.180 INFO:teuthology.orchestra.run.smithi039.stdout: ceph x86_64 2:19.1.1-298.gb53b6d3e.el9 ceph 6.5 k 2024-09-12T02:23:57.180 INFO:teuthology.orchestra.run.smithi039.stdout: ceph-base x86_64 2:19.1.1-298.gb53b6d3e.el9 ceph 5.4 M 2024-09-12T02:23:57.181 INFO:teuthology.orchestra.run.smithi039.stdout: ceph-fuse x86_64 2:19.1.1-298.gb53b6d3e.el9 ceph 897 k 2024-09-12T02:23:57.181 INFO:teuthology.orchestra.run.smithi039.stdout: ceph-immutable-object-cache x86_64 2:19.1.1-298.gb53b6d3e.el9 ceph 145 k 2024-09-12T02:23:57.181 INFO:teuthology.orchestra.run.smithi039.stdout: ceph-mgr x86_64 2:19.1.1-298.gb53b6d3e.el9 ceph 1.5 M 2024-09-12T02:23:57.181 INFO:teuthology.orchestra.run.smithi039.stdout: ceph-mgr-cephadm noarch 2:19.1.1-298.gb53b6d3e.el9 ceph-noarch 146 k 2024-09-12T02:23:57.181 INFO:teuthology.orchestra.run.smithi039.stdout: ceph-mgr-dashboard noarch 2:19.1.1-298.gb53b6d3e.el9 ceph-noarch 3.6 M 2024-09-12T02:23:57.181 INFO:teuthology.orchestra.run.smithi039.stdout: ceph-mgr-diskprediction-local noarch 2:19.1.1-298.gb53b6d3e.el9 ceph-noarch 7.4 M 2024-09-12T02:23:57.181 INFO:teuthology.orchestra.run.smithi039.stdout: ceph-mgr-rook noarch 2:19.1.1-298.gb53b6d3e.el9 ceph-noarch 49 k 2024-09-12T02:23:57.181 INFO:teuthology.orchestra.run.smithi039.stdout: ceph-radosgw x86_64 2:19.1.1-298.gb53b6d3e.el9 ceph 11 M 2024-09-12T02:23:57.181 INFO:teuthology.orchestra.run.smithi039.stdout: ceph-test x86_64 2:19.1.1-298.gb53b6d3e.el9 ceph 49 M 2024-09-12T02:23:57.181 INFO:teuthology.orchestra.run.smithi039.stdout: ceph-volume noarch 2:19.1.1-298.gb53b6d3e.el9 ceph-noarch 285 k 2024-09-12T02:23:57.181 INFO:teuthology.orchestra.run.smithi039.stdout: cephadm noarch 2:19.1.1-298.gb53b6d3e.el9 ceph-noarch 765 k 2024-09-12T02:23:57.182 INFO:teuthology.orchestra.run.smithi039.stdout: cephfs-mirror x86_64 2:19.1.1-298.gb53b6d3e.el9 ceph 228 k 2024-09-12T02:23:57.182 INFO:teuthology.orchestra.run.smithi039.stdout: cephfs-shell x86_64 2:19.1.1-298.gb53b6d3e.el9 ceph 27 k 2024-09-12T02:23:57.182 INFO:teuthology.orchestra.run.smithi039.stdout: cephfs-top noarch 2:19.1.1-298.gb53b6d3e.el9 ceph-noarch 18 k 2024-09-12T02:23:57.182 INFO:teuthology.orchestra.run.smithi039.stdout: elfutils-libelf-devel x86_64 0.191-4.el9 appstream 22 k 2024-09-12T02:23:57.182 INFO:teuthology.orchestra.run.smithi039.stdout: flex x86_64 2.6.4-9.el9 appstream 313 k 2024-09-12T02:23:57.182 INFO:teuthology.orchestra.run.smithi039.stdout: libaio-devel x86_64 0.3.111-13.el9 appstream 11 k 2024-09-12T02:23:57.182 INFO:teuthology.orchestra.run.smithi039.stdout: libcephfs-devel x86_64 2:19.1.1-298.gb53b6d3e.el9 ceph 32 k 2024-09-12T02:23:57.182 INFO:teuthology.orchestra.run.smithi039.stdout: libcephfs2 x86_64 2:19.1.1-298.gb53b6d3e.el9 ceph 752 k 2024-09-12T02:23:57.182 INFO:teuthology.orchestra.run.smithi039.stdout: librados-devel x86_64 2:19.1.1-298.gb53b6d3e.el9 ceph 127 k 2024-09-12T02:23:57.182 INFO:teuthology.orchestra.run.smithi039.stdout: libtool x86_64 2.4.6-46.el9 appstream 581 k 2024-09-12T02:23:57.182 INFO:teuthology.orchestra.run.smithi039.stdout: libuuid-devel x86_64 2.37.4-20.el9 appstream 24 k 2024-09-12T02:23:57.182 INFO:teuthology.orchestra.run.smithi039.stdout: openssl-devel x86_64 1:3.2.2-6.el9 appstream 4.4 M 2024-09-12T02:23:57.183 INFO:teuthology.orchestra.run.smithi039.stdout: postgresql x86_64 13.16-1.el9 appstream 1.6 M 2024-09-12T02:23:57.183 INFO:teuthology.orchestra.run.smithi039.stdout: postgresql-contrib x86_64 13.16-1.el9 appstream 910 k 2024-09-12T02:23:57.183 INFO:teuthology.orchestra.run.smithi039.stdout: postgresql-server x86_64 13.16-1.el9 appstream 5.8 M 2024-09-12T02:23:57.183 INFO:teuthology.orchestra.run.smithi039.stdout: python3-cephfs x86_64 2:19.1.1-298.gb53b6d3e.el9 ceph 162 k 2024-09-12T02:23:57.183 INFO:teuthology.orchestra.run.smithi039.stdout: python3-rados x86_64 2:19.1.1-298.gb53b6d3e.el9 ceph 321 k 2024-09-12T02:23:57.183 INFO:teuthology.orchestra.run.smithi039.stdout: python3-rbd x86_64 2:19.1.1-298.gb53b6d3e.el9 ceph 301 k 2024-09-12T02:23:57.183 INFO:teuthology.orchestra.run.smithi039.stdout: python3-rgw x86_64 2:19.1.1-298.gb53b6d3e.el9 ceph 100 k 2024-09-12T02:23:57.183 INFO:teuthology.orchestra.run.smithi039.stdout: rbd-fuse x86_64 2:19.1.1-298.gb53b6d3e.el9 ceph 85 k 2024-09-12T02:23:57.183 INFO:teuthology.orchestra.run.smithi039.stdout: rbd-mirror x86_64 2:19.1.1-298.gb53b6d3e.el9 ceph 3.1 M 2024-09-12T02:23:57.183 INFO:teuthology.orchestra.run.smithi039.stdout: rbd-nbd x86_64 2:19.1.1-298.gb53b6d3e.el9 ceph 171 k 2024-09-12T02:23:57.183 INFO:teuthology.orchestra.run.smithi039.stdout: xfsprogs-devel x86_64 6.4.0-4.el9 appstream 96 k 2024-09-12T02:23:57.183 INFO:teuthology.orchestra.run.smithi039.stdout:Upgrading: 2024-09-12T02:23:57.184 INFO:teuthology.orchestra.run.smithi039.stdout: NetworkManager x86_64 1:1.49.90-1.el9 baseos 2.3 M 2024-09-12T02:23:57.184 INFO:teuthology.orchestra.run.smithi039.stdout: NetworkManager-libnm x86_64 1:1.49.90-1.el9 baseos 1.8 M 2024-09-12T02:23:57.184 INFO:teuthology.orchestra.run.smithi039.stdout: NetworkManager-team x86_64 1:1.49.90-1.el9 baseos 41 k 2024-09-12T02:23:57.184 INFO:teuthology.orchestra.run.smithi039.stdout: NetworkManager-tui x86_64 1:1.49.90-1.el9 baseos 249 k 2024-09-12T02:23:57.184 INFO:teuthology.orchestra.run.smithi039.stdout: librados2 x86_64 2:19.1.1-298.gb53b6d3e.el9 ceph 3.4 M 2024-09-12T02:23:57.184 INFO:teuthology.orchestra.run.smithi039.stdout: librbd1 x86_64 2:19.1.1-298.gb53b6d3e.el9 ceph 3.2 M 2024-09-12T02:23:57.185 INFO:teuthology.orchestra.run.smithi039.stdout: openssl x86_64 1:3.2.2-6.el9 baseos 1.4 M 2024-09-12T02:23:57.185 INFO:teuthology.orchestra.run.smithi039.stdout: openssl-libs x86_64 1:3.2.2-6.el9 baseos 2.4 M 2024-09-12T02:23:57.185 INFO:teuthology.orchestra.run.smithi039.stdout:Installing dependencies: 2024-09-12T02:23:57.185 INFO:teuthology.orchestra.run.smithi039.stdout: abseil-cpp x86_64 20211102.0-3.el9 epel 548 k 2024-09-12T02:23:57.185 INFO:teuthology.orchestra.run.smithi039.stdout: automake noarch 1.16.2-8.el9 appstream 689 k 2024-09-12T02:23:57.185 INFO:teuthology.orchestra.run.smithi039.stdout: boost-program-options x86_64 1.75.0-8.el9 appstream 107 k 2024-09-12T02:23:57.186 INFO:teuthology.orchestra.run.smithi039.stdout: ceph-common x86_64 2:19.1.1-298.gb53b6d3e.el9 ceph 21 M 2024-09-12T02:23:57.186 INFO:teuthology.orchestra.run.smithi039.stdout: ceph-grafana-dashboards noarch 2:19.1.1-298.gb53b6d3e.el9 ceph-noarch 32 k 2024-09-12T02:23:57.186 INFO:teuthology.orchestra.run.smithi039.stdout: ceph-mds x86_64 2:19.1.1-298.gb53b6d3e.el9 ceph 2.4 M 2024-09-12T02:23:57.186 INFO:teuthology.orchestra.run.smithi039.stdout: ceph-mgr-modules-core noarch 2:19.1.1-298.gb53b6d3e.el9 ceph-noarch 249 k 2024-09-12T02:23:57.186 INFO:teuthology.orchestra.run.smithi039.stdout: ceph-mon x86_64 2:19.1.1-298.gb53b6d3e.el9 ceph 4.7 M 2024-09-12T02:23:57.186 INFO:teuthology.orchestra.run.smithi039.stdout: ceph-osd x86_64 2:19.1.1-298.gb53b6d3e.el9 ceph 17 M 2024-09-12T02:23:57.187 INFO:teuthology.orchestra.run.smithi039.stdout: ceph-prometheus-alerts noarch 2:19.1.1-298.gb53b6d3e.el9 ceph-noarch 16 k 2024-09-12T02:23:57.187 INFO:teuthology.orchestra.run.smithi039.stdout: ceph-selinux x86_64 2:19.1.1-298.gb53b6d3e.el9 ceph 25 k 2024-09-12T02:23:57.187 INFO:teuthology.orchestra.run.smithi039.stdout: flexiblas x86_64 3.0.4-8.el9 appstream 33 k 2024-09-12T02:23:57.187 INFO:teuthology.orchestra.run.smithi039.stdout: flexiblas-netlib x86_64 3.0.4-8.el9 appstream 3.0 M 2024-09-12T02:23:57.187 INFO:teuthology.orchestra.run.smithi039.stdout: flexiblas-openblas-openmp x86_64 3.0.4-8.el9 appstream 18 k 2024-09-12T02:23:57.188 INFO:teuthology.orchestra.run.smithi039.stdout: fuse x86_64 2.9.9-16.el9 baseos 80 k 2024-09-12T02:23:57.188 INFO:teuthology.orchestra.run.smithi039.stdout: gperftools-libs x86_64 2.9.1-2.el9 epel 309 k 2024-09-12T02:23:57.188 INFO:teuthology.orchestra.run.smithi039.stdout: grpc-data noarch 1.46.7-10.el9 epel 19 k 2024-09-12T02:23:57.188 INFO:teuthology.orchestra.run.smithi039.stdout: libarrow x86_64 9.0.0-11.el9 epel 4.4 M 2024-09-12T02:23:57.188 INFO:teuthology.orchestra.run.smithi039.stdout: libarrow-doc noarch 9.0.0-11.el9 epel 26 k 2024-09-12T02:23:57.188 INFO:teuthology.orchestra.run.smithi039.stdout: libcephsqlite x86_64 2:19.1.1-298.gb53b6d3e.el9 ceph 163 k 2024-09-12T02:23:57.189 INFO:teuthology.orchestra.run.smithi039.stdout: libgfortran x86_64 11.5.0-2.el9 baseos 801 k 2024-09-12T02:23:57.189 INFO:teuthology.orchestra.run.smithi039.stdout: liboath x86_64 2.6.7-2.el9 epel 49 k 2024-09-12T02:23:57.189 INFO:teuthology.orchestra.run.smithi039.stdout: libpmemobj x86_64 1.12.1-1.el9 appstream 160 k 2024-09-12T02:23:57.189 INFO:teuthology.orchestra.run.smithi039.stdout: libquadmath x86_64 11.5.0-2.el9 baseos 191 k 2024-09-12T02:23:57.189 INFO:teuthology.orchestra.run.smithi039.stdout: librabbitmq x86_64 0.11.0-7.el9 appstream 45 k 2024-09-12T02:23:57.189 INFO:teuthology.orchestra.run.smithi039.stdout: libradosstriper1 x86_64 2:19.1.1-298.gb53b6d3e.el9 ceph 506 k 2024-09-12T02:23:57.190 INFO:teuthology.orchestra.run.smithi039.stdout: librdkafka x86_64 1.6.1-102.el9 appstream 662 k 2024-09-12T02:23:57.190 INFO:teuthology.orchestra.run.smithi039.stdout: librgw2 x86_64 2:19.1.1-298.gb53b6d3e.el9 ceph 5.3 M 2024-09-12T02:23:57.190 INFO:teuthology.orchestra.run.smithi039.stdout: libunwind x86_64 1.6.2-1.el9 epel 67 k 2024-09-12T02:23:57.190 INFO:teuthology.orchestra.run.smithi039.stdout: libzstd-devel x86_64 1.5.1-2.el9 appstream 47 k 2024-09-12T02:23:57.190 INFO:teuthology.orchestra.run.smithi039.stdout: lttng-ust x86_64 2.12.0-6.el9 appstream 292 k 2024-09-12T02:23:57.190 INFO:teuthology.orchestra.run.smithi039.stdout: lua x86_64 5.4.4-4.el9 appstream 188 k 2024-09-12T02:23:57.190 INFO:teuthology.orchestra.run.smithi039.stdout: lua-devel x86_64 5.4.4-4.el9 crb 22 k 2024-09-12T02:23:57.191 INFO:teuthology.orchestra.run.smithi039.stdout: luarocks noarch 3.9.2-5.el9 epel 151 k 2024-09-12T02:23:57.191 INFO:teuthology.orchestra.run.smithi039.stdout: openblas x86_64 0.3.26-2.el9 appstream 38 k 2024-09-12T02:23:57.191 INFO:teuthology.orchestra.run.smithi039.stdout: openblas-openmp x86_64 0.3.26-2.el9 appstream 4.9 M 2024-09-12T02:23:57.191 INFO:teuthology.orchestra.run.smithi039.stdout: parquet-libs x86_64 9.0.0-11.el9 epel 839 k 2024-09-12T02:23:57.191 INFO:teuthology.orchestra.run.smithi039.stdout: postgresql-private-libs x86_64 13.16-1.el9 appstream 137 k 2024-09-12T02:23:57.191 INFO:teuthology.orchestra.run.smithi039.stdout: protobuf x86_64 3.14.0-13.el9 appstream 1.0 M 2024-09-12T02:23:57.192 INFO:teuthology.orchestra.run.smithi039.stdout: protobuf-compiler x86_64 3.14.0-13.el9 crb 863 k 2024-09-12T02:23:57.192 INFO:teuthology.orchestra.run.smithi039.stdout: python3-asyncssh noarch 2.13.2-5.el9 epel 548 k 2024-09-12T02:23:57.192 INFO:teuthology.orchestra.run.smithi039.stdout: python3-attrs noarch 20.3.0-7.el9 appstream 87 k 2024-09-12T02:23:57.192 INFO:teuthology.orchestra.run.smithi039.stdout: python3-babel noarch 2.9.1-2.el9 appstream 6.0 M 2024-09-12T02:23:57.192 INFO:teuthology.orchestra.run.smithi039.stdout: python3-bcrypt x86_64 3.2.2-1.el9 epel 43 k 2024-09-12T02:23:57.192 INFO:teuthology.orchestra.run.smithi039.stdout: python3-cachetools noarch 4.2.4-1.el9 epel 32 k 2024-09-12T02:23:57.193 INFO:teuthology.orchestra.run.smithi039.stdout: python3-ceph-argparse x86_64 2:19.1.1-298.gb53b6d3e.el9 ceph 45 k 2024-09-12T02:23:57.193 INFO:teuthology.orchestra.run.smithi039.stdout: python3-ceph-common x86_64 2:19.1.1-298.gb53b6d3e.el9 ceph 136 k 2024-09-12T02:23:57.193 INFO:teuthology.orchestra.run.smithi039.stdout: python3-certifi noarch 2023.05.07-4.el9 epel 14 k 2024-09-12T02:23:57.193 INFO:teuthology.orchestra.run.smithi039.stdout: python3-cffi x86_64 1.14.5-5.el9 baseos 253 k 2024-09-12T02:23:57.193 INFO:teuthology.orchestra.run.smithi039.stdout: python3-cheroot noarch 8.6.0-4.el9 epel 172 k 2024-09-12T02:23:57.194 INFO:teuthology.orchestra.run.smithi039.stdout: python3-cherrypy noarch 18.6.1-2.el9 epel 358 k 2024-09-12T02:23:57.194 INFO:teuthology.orchestra.run.smithi039.stdout: python3-cmd2 noarch 2.4.2-2.el9 epel 303 k 2024-09-12T02:23:57.194 INFO:teuthology.orchestra.run.smithi039.stdout: python3-colorama noarch 0.4.6-3.el9 appstream 61 k 2024-09-12T02:23:57.194 INFO:teuthology.orchestra.run.smithi039.stdout: python3-cryptography x86_64 36.0.1-4.el9 baseos 1.2 M 2024-09-12T02:23:57.194 INFO:teuthology.orchestra.run.smithi039.stdout: python3-devel x86_64 3.9.19-8.el9 appstream 245 k 2024-09-12T02:23:57.194 INFO:teuthology.orchestra.run.smithi039.stdout: python3-google-auth noarch 1:2.34.0-1.el9 epel 220 k 2024-09-12T02:23:57.195 INFO:teuthology.orchestra.run.smithi039.stdout: python3-grpcio x86_64 1.46.7-10.el9 epel 2.0 M 2024-09-12T02:23:57.195 INFO:teuthology.orchestra.run.smithi039.stdout: python3-grpcio-tools x86_64 1.46.7-10.el9 epel 144 k 2024-09-12T02:23:57.195 INFO:teuthology.orchestra.run.smithi039.stdout: python3-jaraco noarch 8.2.1-3.el9 epel 11 k 2024-09-12T02:23:57.195 INFO:teuthology.orchestra.run.smithi039.stdout: python3-jaraco-classes noarch 3.2.1-5.el9 epel 18 k 2024-09-12T02:23:57.195 INFO:teuthology.orchestra.run.smithi039.stdout: python3-jaraco-collections noarch 3.0.0-8.el9 epel 23 k 2024-09-12T02:23:57.195 INFO:teuthology.orchestra.run.smithi039.stdout: python3-jaraco-functools noarch 3.5.0-2.el9 epel 19 k 2024-09-12T02:23:57.196 INFO:teuthology.orchestra.run.smithi039.stdout: python3-jaraco-text noarch 3.2.0-6.el9 epel 20 k 2024-09-12T02:23:57.196 INFO:teuthology.orchestra.run.smithi039.stdout: python3-jinja2 noarch 2.11.3-6.el9 appstream 248 k 2024-09-12T02:23:57.196 INFO:teuthology.orchestra.run.smithi039.stdout: python3-jsonpatch noarch 1.21-16.el9 appstream 26 k 2024-09-12T02:23:57.196 INFO:teuthology.orchestra.run.smithi039.stdout: python3-jsonpointer noarch 2.0-4.el9 appstream 19 k 2024-09-12T02:23:57.196 INFO:teuthology.orchestra.run.smithi039.stdout: python3-kubernetes noarch 1:26.1.0-2.el9 epel 1.0 M 2024-09-12T02:23:57.196 INFO:teuthology.orchestra.run.smithi039.stdout: python3-logutils noarch 0.3.5-21.el9 epel 46 k 2024-09-12T02:23:57.197 INFO:teuthology.orchestra.run.smithi039.stdout: python3-mako noarch 1.1.4-6.el9 appstream 172 k 2024-09-12T02:23:57.197 INFO:teuthology.orchestra.run.smithi039.stdout: python3-markupsafe x86_64 1.1.1-12.el9 appstream 35 k 2024-09-12T02:23:57.197 INFO:teuthology.orchestra.run.smithi039.stdout: python3-more-itertools noarch 8.12.0-2.el9 epel 79 k 2024-09-12T02:23:57.197 INFO:teuthology.orchestra.run.smithi039.stdout: python3-natsort noarch 7.1.1-5.el9 epel 58 k 2024-09-12T02:23:57.197 INFO:teuthology.orchestra.run.smithi039.stdout: python3-numpy x86_64 1:1.20.1-5.el9 appstream 5.1 M 2024-09-12T02:23:57.197 INFO:teuthology.orchestra.run.smithi039.stdout: python3-numpy-f2py x86_64 1:1.20.1-5.el9 appstream 250 k 2024-09-12T02:23:57.198 INFO:teuthology.orchestra.run.smithi039.stdout: python3-oauthlib noarch 3.1.1-5.el9 appstream 222 k 2024-09-12T02:23:57.198 INFO:teuthology.orchestra.run.smithi039.stdout: python3-packaging noarch 20.9-5.el9 appstream 77 k 2024-09-12T02:23:57.198 INFO:teuthology.orchestra.run.smithi039.stdout: python3-pecan noarch 1.4.2-3.el9 epel 272 k 2024-09-12T02:23:57.198 INFO:teuthology.orchestra.run.smithi039.stdout: python3-ply noarch 3.11-14.el9 baseos 106 k 2024-09-12T02:23:57.198 INFO:teuthology.orchestra.run.smithi039.stdout: python3-portend noarch 3.1.0-2.el9 epel 16 k 2024-09-12T02:23:57.199 INFO:teuthology.orchestra.run.smithi039.stdout: python3-prettytable noarch 0.7.2-27.el9 appstream 42 k 2024-09-12T02:23:57.199 INFO:teuthology.orchestra.run.smithi039.stdout: python3-protobuf noarch 3.14.0-13.el9 appstream 269 k 2024-09-12T02:23:57.199 INFO:teuthology.orchestra.run.smithi039.stdout: python3-pyOpenSSL noarch 21.0.0-1.el9 epel 90 k 2024-09-12T02:23:57.199 INFO:teuthology.orchestra.run.smithi039.stdout: python3-pyasn1 noarch 0.4.8-6.el9 appstream 159 k 2024-09-12T02:23:57.199 INFO:teuthology.orchestra.run.smithi039.stdout: python3-pyasn1-modules noarch 0.4.8-6.el9 appstream 279 k 2024-09-12T02:23:57.199 INFO:teuthology.orchestra.run.smithi039.stdout: python3-pycparser noarch 2.20-6.el9 baseos 135 k 2024-09-12T02:23:57.200 INFO:teuthology.orchestra.run.smithi039.stdout: python3-pyperclip noarch 1.8.2-2.el9 epel 28 k 2024-09-12T02:23:57.200 INFO:teuthology.orchestra.run.smithi039.stdout: python3-pytz noarch 2021.1-5.el9 appstream 51 k 2024-09-12T02:23:57.200 INFO:teuthology.orchestra.run.smithi039.stdout: python3-repoze-lru noarch 0.7-16.el9 epel 31 k 2024-09-12T02:23:57.200 INFO:teuthology.orchestra.run.smithi039.stdout: python3-requests noarch 2.25.1-8.el9 baseos 125 k 2024-09-12T02:23:57.200 INFO:teuthology.orchestra.run.smithi039.stdout: python3-requests-oauthlib noarch 1.3.0-12.el9 appstream 54 k 2024-09-12T02:23:57.200 INFO:teuthology.orchestra.run.smithi039.stdout: python3-routes noarch 2.5.1-5.el9 epel 188 k 2024-09-12T02:23:57.201 INFO:teuthology.orchestra.run.smithi039.stdout: python3-rsa noarch 4.9-2.el9 epel 59 k 2024-09-12T02:23:57.201 INFO:teuthology.orchestra.run.smithi039.stdout: python3-scipy x86_64 1.6.2-8.el9 appstream 16 M 2024-09-12T02:23:57.201 INFO:teuthology.orchestra.run.smithi039.stdout: python3-tempora noarch 5.0.0-2.el9 epel 36 k 2024-09-12T02:23:57.201 INFO:teuthology.orchestra.run.smithi039.stdout: python3-toml noarch 0.10.2-6.el9 appstream 42 k 2024-09-12T02:23:57.201 INFO:teuthology.orchestra.run.smithi039.stdout: python3-typing-extensions noarch 4.12.2-2.el9 epel 74 k 2024-09-12T02:23:57.202 INFO:teuthology.orchestra.run.smithi039.stdout: python3-urllib3 noarch 1.26.5-6.el9 baseos 215 k 2024-09-12T02:23:57.202 INFO:teuthology.orchestra.run.smithi039.stdout: python3-wcwidth noarch 0.2.5-8.el9 appstream 44 k 2024-09-12T02:23:57.202 INFO:teuthology.orchestra.run.smithi039.stdout: python3-webob noarch 1.8.8-2.el9 epel 230 k 2024-09-12T02:23:57.202 INFO:teuthology.orchestra.run.smithi039.stdout: python3-websocket-client noarch 1.2.3-2.el9 epel 90 k 2024-09-12T02:23:57.202 INFO:teuthology.orchestra.run.smithi039.stdout: python3-werkzeug noarch 2.0.3-3.el9.1 epel 427 k 2024-09-12T02:23:57.202 INFO:teuthology.orchestra.run.smithi039.stdout: python3-zc-lockfile noarch 2.0-10.el9 epel 20 k 2024-09-12T02:23:57.203 INFO:teuthology.orchestra.run.smithi039.stdout: qatlib x86_64 24.02.0-1.el9 appstream 221 k 2024-09-12T02:23:57.203 INFO:teuthology.orchestra.run.smithi039.stdout: qatzip-libs x86_64 1.2.0-1.el9 appstream 47 k 2024-09-12T02:23:57.203 INFO:teuthology.orchestra.run.smithi039.stdout: re2 x86_64 1:20211101-20.el9 epel 191 k 2024-09-12T02:23:57.203 INFO:teuthology.orchestra.run.smithi039.stdout: socat x86_64 1.7.4.1-6.el9 appstream 304 k 2024-09-12T02:23:57.203 INFO:teuthology.orchestra.run.smithi039.stdout: thrift x86_64 0.15.0-2.el9 epel 1.6 M 2024-09-12T02:23:57.203 INFO:teuthology.orchestra.run.smithi039.stdout: uuid x86_64 1.6.2-55.el9 appstream 58 k 2024-09-12T02:23:57.204 INFO:teuthology.orchestra.run.smithi039.stdout: xmlstarlet x86_64 1.6.1-20.el9 appstream 64 k 2024-09-12T02:23:57.204 INFO:teuthology.orchestra.run.smithi039.stdout: zlib-devel x86_64 1.2.11-41.el9 appstream 45 k 2024-09-12T02:23:57.204 INFO:teuthology.orchestra.run.smithi039.stdout:Installing weak dependencies: 2024-09-12T02:23:57.204 INFO:teuthology.orchestra.run.smithi039.stdout: qatlib-service x86_64 24.02.0-1.el9 appstream 36 k 2024-09-12T02:23:57.204 INFO:teuthology.orchestra.run.smithi039.stdout: 2024-09-12T02:23:57.204 INFO:teuthology.orchestra.run.smithi039.stdout:Transaction Summary 2024-09-12T02:23:57.205 INFO:teuthology.orchestra.run.smithi039.stdout:====================================================================================== 2024-09-12T02:23:57.205 INFO:teuthology.orchestra.run.smithi039.stdout:Install 148 Packages 2024-09-12T02:23:57.205 INFO:teuthology.orchestra.run.smithi039.stdout:Upgrade 8 Packages 2024-09-12T02:23:57.205 INFO:teuthology.orchestra.run.smithi039.stdout: 2024-09-12T02:23:57.206 INFO:teuthology.orchestra.run.smithi039.stdout:Total download size: 226 M 2024-09-12T02:23:57.206 INFO:teuthology.orchestra.run.smithi039.stdout:Downloading Packages: 2024-09-12T02:23:57.751 INFO:teuthology.orchestra.run.smithi039.stdout:(1/156): ceph-19.1.1-298.gb53b6d3e.el9.x86_64.r 50 kB/s | 6.5 kB 00:00 2024-09-12T02:23:57.918 INFO:teuthology.orchestra.run.smithi039.stdout:(2/156): ceph-fuse-19.1.1-298.gb53b6d3e.el9.x86 5.3 MB/s | 897 kB 00:00 2024-09-12T02:23:58.010 INFO:teuthology.orchestra.run.smithi039.stdout:(3/156): ceph-immutable-object-cache-19.1.1-298 1.5 MB/s | 145 kB 00:00 2024-09-12T02:23:58.135 INFO:teuthology.orchestra.run.smithi039.stdout:(4/156): ceph-base-19.1.1-298.gb53b6d3e.el9.x86 10 MB/s | 5.4 MB 00:00 2024-09-12T02:23:58.235 INFO:teuthology.orchestra.run.smithi039.stdout:(5/156): ceph-mgr-19.1.1-298.gb53b6d3e.el9.x86_ 15 MB/s | 1.5 MB 00:00 2024-09-12T02:23:58.236 INFO:teuthology.orchestra.run.smithi172.stdout:lab-extras 31 kB/s | 1.7 kB 00:00 2024-09-12T02:23:58.286 INFO:teuthology.orchestra.run.smithi039.stdout:(6/156): ceph-mds-19.1.1-298.gb53b6d3e.el9.x86_ 8.7 MB/s | 2.4 MB 00:00 2024-09-12T02:23:58.453 INFO:teuthology.orchestra.run.smithi039.stdout:(7/156): ceph-mon-19.1.1-298.gb53b6d3e.el9.x86_ 22 MB/s | 4.7 MB 00:00 2024-09-12T02:23:58.851 INFO:teuthology.orchestra.run.smithi044.stdout:lab-extras 39 kB/s | 1.7 kB 00:00 2024-09-12T02:23:58.861 INFO:teuthology.orchestra.run.smithi039.stdout:(8/156): ceph-common-19.1.1-298.gb53b6d3e.el9.x 17 MB/s | 21 MB 00:01 2024-09-12T02:23:58.895 INFO:teuthology.orchestra.run.smithi039.stdout:(9/156): ceph-selinux-19.1.1-298.gb53b6d3e.el9. 764 kB/s | 25 kB 00:00 2024-09-12T02:23:59.037 INFO:teuthology.orchestra.run.smithi039.stdout:(10/156): ceph-radosgw-19.1.1-298.gb53b6d3e.el9 18 MB/s | 11 MB 00:00 2024-09-12T02:23:59.095 INFO:teuthology.orchestra.run.smithi039.stdout:(11/156): cephfs-mirror-19.1.1-298.gb53b6d3e.el 3.9 MB/s | 228 kB 00:00 2024-09-12T02:23:59.154 INFO:teuthology.orchestra.run.smithi039.stdout:(12/156): cephfs-shell-19.1.1-298.gb53b6d3e.el9 466 kB/s | 27 kB 00:00 2024-09-12T02:23:59.213 INFO:teuthology.orchestra.run.smithi039.stdout:(13/156): libcephfs-devel-19.1.1-298.gb53b6d3e. 545 kB/s | 32 kB 00:00 2024-09-12T02:23:59.430 INFO:teuthology.orchestra.run.smithi039.stdout:(14/156): ceph-osd-19.1.1-298.gb53b6d3e.el9.x86 15 MB/s | 17 MB 00:01 2024-09-12T02:23:59.472 INFO:teuthology.orchestra.run.smithi039.stdout:(15/156): libcephfs2-19.1.1-298.gb53b6d3e.el9.x 2.8 MB/s | 752 kB 00:00 2024-09-12T02:23:59.497 INFO:teuthology.orchestra.run.smithi039.stdout:(16/156): libcephsqlite-19.1.1-298.gb53b6d3e.el 2.4 MB/s | 163 kB 00:00 2024-09-12T02:23:59.522 INFO:teuthology.orchestra.run.smithi039.stdout:(17/156): librados-devel-19.1.1-298.gb53b6d3e.e 2.5 MB/s | 127 kB 00:00 2024-09-12T02:23:59.564 INFO:teuthology.orchestra.run.smithi039.stdout:(18/156): libradosstriper1-19.1.1-298.gb53b6d3e 7.4 MB/s | 506 kB 00:00 2024-09-12T02:23:59.631 INFO:teuthology.orchestra.run.smithi039.stdout:(19/156): python3-ceph-argparse-19.1.1-298.gb53 678 kB/s | 45 kB 00:00 2024-09-12T02:23:59.748 INFO:teuthology.orchestra.run.smithi039.stdout:(20/156): librgw2-19.1.1-298.gb53b6d3e.el9.x86_ 24 MB/s | 5.3 MB 00:00 2024-09-12T02:23:59.798 INFO:teuthology.orchestra.run.smithi039.stdout:(21/156): python3-ceph-common-19.1.1-298.gb53b6 813 kB/s | 136 kB 00:00 2024-09-12T02:23:59.824 INFO:teuthology.orchestra.run.smithi039.stdout:(22/156): python3-cephfs-19.1.1-298.gb53b6d3e.e 2.1 MB/s | 162 kB 00:00 2024-09-12T02:23:59.849 INFO:teuthology.orchestra.run.smithi039.stdout:(23/156): python3-rados-19.1.1-298.gb53b6d3e.el 6.3 MB/s | 321 kB 00:00 2024-09-12T02:23:59.874 INFO:teuthology.orchestra.run.smithi039.stdout:(24/156): python3-rbd-19.1.1-298.gb53b6d3e.el9. 5.9 MB/s | 301 kB 00:00 2024-09-12T02:23:59.900 INFO:teuthology.orchestra.run.smithi039.stdout:(25/156): python3-rgw-19.1.1-298.gb53b6d3e.el9. 1.9 MB/s | 100 kB 00:00 2024-09-12T02:23:59.925 INFO:teuthology.orchestra.run.smithi039.stdout:(26/156): rbd-fuse-19.1.1-298.gb53b6d3e.el9.x86 1.7 MB/s | 85 kB 00:00 2024-09-12T02:23:59.975 INFO:teuthology.orchestra.run.smithi039.stdout:(27/156): rbd-nbd-19.1.1-298.gb53b6d3e.el9.x86_ 3.3 MB/s | 171 kB 00:00 2024-09-12T02:24:00.076 INFO:teuthology.orchestra.run.smithi039.stdout:(28/156): rbd-mirror-19.1.1-298.gb53b6d3e.el9.x 18 MB/s | 3.1 MB 00:00 2024-09-12T02:24:00.101 INFO:teuthology.orchestra.run.smithi039.stdout:(29/156): ceph-grafana-dashboards-19.1.1-298.gb 254 kB/s | 32 kB 00:00 2024-09-12T02:24:00.126 INFO:teuthology.orchestra.run.smithi039.stdout:(30/156): ceph-mgr-cephadm-19.1.1-298.gb53b6d3e 2.9 MB/s | 146 kB 00:00 2024-09-12T02:24:00.301 INFO:teuthology.orchestra.run.smithi039.stdout:(31/156): ceph-mgr-dashboard-19.1.1-298.gb53b6d 18 MB/s | 3.6 MB 00:00 2024-09-12T02:24:00.368 INFO:teuthology.orchestra.run.smithi039.stdout:(32/156): ceph-mgr-modules-core-19.1.1-298.gb53 3.7 MB/s | 249 kB 00:00 2024-09-12T02:24:00.443 INFO:teuthology.orchestra.run.smithi039.stdout:(33/156): ceph-mgr-rook-19.1.1-298.gb53b6d3e.el 658 kB/s | 49 kB 00:00 2024-09-12T02:24:00.510 INFO:teuthology.orchestra.run.smithi039.stdout:(34/156): ceph-prometheus-alerts-19.1.1-298.gb5 247 kB/s | 16 kB 00:00 2024-09-12T02:24:00.515 INFO:teuthology.orchestra.run.smithi172.stdout:Package librados2-2:16.2.4-5.el9.x86_64 is already installed. 2024-09-12T02:24:00.516 INFO:teuthology.orchestra.run.smithi172.stdout:Package librbd1-2:16.2.4-5.el9.x86_64 is already installed. 2024-09-12T02:24:00.530 INFO:teuthology.orchestra.run.smithi172.stdout:Package NetworkManager-1:1.48.8-1.el9.x86_64 is already installed. 2024-09-12T02:24:00.530 INFO:teuthology.orchestra.run.smithi172.stdout:Package iproute-6.2.0-5.el9.x86_64 is already installed. 2024-09-12T02:24:00.533 INFO:teuthology.orchestra.run.smithi172.stdout:Package util-linux-2.37.4-20.el9.x86_64 is already installed. 2024-09-12T02:24:00.533 INFO:teuthology.orchestra.run.smithi172.stdout:Package libacl-devel-2.3.1-4.el9.x86_64 is already installed. 2024-09-12T02:24:00.534 INFO:teuthology.orchestra.run.smithi172.stdout:Package libattr-devel-2.5.1-3.el9.x86_64 is already installed. 2024-09-12T02:24:00.537 INFO:teuthology.orchestra.run.smithi172.stdout:Package xfsdump-3.1.12-4.el9.x86_64 is already installed. 2024-09-12T02:24:00.539 INFO:teuthology.orchestra.run.smithi172.stdout:Package xfsprogs-6.4.0-4.el9.x86_64 is already installed. 2024-09-12T02:24:00.603 INFO:teuthology.orchestra.run.smithi172.stdout:Dependencies resolved. 2024-09-12T02:24:00.624 INFO:teuthology.orchestra.run.smithi172.stdout:====================================================================================== 2024-09-12T02:24:00.624 INFO:teuthology.orchestra.run.smithi172.stdout: Package Arch Version Repository Size 2024-09-12T02:24:00.624 INFO:teuthology.orchestra.run.smithi172.stdout:====================================================================================== 2024-09-12T02:24:00.624 INFO:teuthology.orchestra.run.smithi172.stdout:Installing: 2024-09-12T02:24:00.624 INFO:teuthology.orchestra.run.smithi172.stdout: bison x86_64 3.7.4-5.el9 appstream 943 k 2024-09-12T02:24:00.624 INFO:teuthology.orchestra.run.smithi172.stdout: ceph x86_64 2:19.1.1-298.gb53b6d3e.el9 ceph 6.5 k 2024-09-12T02:24:00.625 INFO:teuthology.orchestra.run.smithi172.stdout: ceph-base x86_64 2:19.1.1-298.gb53b6d3e.el9 ceph 5.4 M 2024-09-12T02:24:00.625 INFO:teuthology.orchestra.run.smithi172.stdout: ceph-fuse x86_64 2:19.1.1-298.gb53b6d3e.el9 ceph 897 k 2024-09-12T02:24:00.625 INFO:teuthology.orchestra.run.smithi172.stdout: ceph-immutable-object-cache x86_64 2:19.1.1-298.gb53b6d3e.el9 ceph 145 k 2024-09-12T02:24:00.625 INFO:teuthology.orchestra.run.smithi172.stdout: ceph-mgr x86_64 2:19.1.1-298.gb53b6d3e.el9 ceph 1.5 M 2024-09-12T02:24:00.625 INFO:teuthology.orchestra.run.smithi172.stdout: ceph-mgr-cephadm noarch 2:19.1.1-298.gb53b6d3e.el9 ceph-noarch 146 k 2024-09-12T02:24:00.625 INFO:teuthology.orchestra.run.smithi172.stdout: ceph-mgr-dashboard noarch 2:19.1.1-298.gb53b6d3e.el9 ceph-noarch 3.6 M 2024-09-12T02:24:00.626 INFO:teuthology.orchestra.run.smithi172.stdout: ceph-mgr-diskprediction-local noarch 2:19.1.1-298.gb53b6d3e.el9 ceph-noarch 7.4 M 2024-09-12T02:24:00.626 INFO:teuthology.orchestra.run.smithi172.stdout: ceph-mgr-rook noarch 2:19.1.1-298.gb53b6d3e.el9 ceph-noarch 49 k 2024-09-12T02:24:00.626 INFO:teuthology.orchestra.run.smithi172.stdout: ceph-radosgw x86_64 2:19.1.1-298.gb53b6d3e.el9 ceph 11 M 2024-09-12T02:24:00.626 INFO:teuthology.orchestra.run.smithi172.stdout: ceph-test x86_64 2:19.1.1-298.gb53b6d3e.el9 ceph 49 M 2024-09-12T02:24:00.626 INFO:teuthology.orchestra.run.smithi172.stdout: ceph-volume noarch 2:19.1.1-298.gb53b6d3e.el9 ceph-noarch 285 k 2024-09-12T02:24:00.626 INFO:teuthology.orchestra.run.smithi172.stdout: cephadm noarch 2:19.1.1-298.gb53b6d3e.el9 ceph-noarch 765 k 2024-09-12T02:24:00.627 INFO:teuthology.orchestra.run.smithi172.stdout: cephfs-mirror x86_64 2:19.1.1-298.gb53b6d3e.el9 ceph 228 k 2024-09-12T02:24:00.627 INFO:teuthology.orchestra.run.smithi172.stdout: cephfs-shell x86_64 2:19.1.1-298.gb53b6d3e.el9 ceph 27 k 2024-09-12T02:24:00.627 INFO:teuthology.orchestra.run.smithi172.stdout: cephfs-top noarch 2:19.1.1-298.gb53b6d3e.el9 ceph-noarch 18 k 2024-09-12T02:24:00.627 INFO:teuthology.orchestra.run.smithi172.stdout: elfutils-libelf-devel x86_64 0.191-4.el9 appstream 22 k 2024-09-12T02:24:00.627 INFO:teuthology.orchestra.run.smithi172.stdout: flex x86_64 2.6.4-9.el9 appstream 313 k 2024-09-12T02:24:00.627 INFO:teuthology.orchestra.run.smithi172.stdout: libaio-devel x86_64 0.3.111-13.el9 appstream 11 k 2024-09-12T02:24:00.627 INFO:teuthology.orchestra.run.smithi172.stdout: libcephfs-devel x86_64 2:19.1.1-298.gb53b6d3e.el9 ceph 32 k 2024-09-12T02:24:00.628 INFO:teuthology.orchestra.run.smithi172.stdout: libcephfs2 x86_64 2:19.1.1-298.gb53b6d3e.el9 ceph 752 k 2024-09-12T02:24:00.628 INFO:teuthology.orchestra.run.smithi172.stdout: librados-devel x86_64 2:19.1.1-298.gb53b6d3e.el9 ceph 127 k 2024-09-12T02:24:00.628 INFO:teuthology.orchestra.run.smithi172.stdout: libtool x86_64 2.4.6-46.el9 appstream 581 k 2024-09-12T02:24:00.628 INFO:teuthology.orchestra.run.smithi172.stdout: libuuid-devel x86_64 2.37.4-20.el9 appstream 24 k 2024-09-12T02:24:00.628 INFO:teuthology.orchestra.run.smithi172.stdout: openssl-devel x86_64 1:3.2.2-6.el9 appstream 4.4 M 2024-09-12T02:24:00.628 INFO:teuthology.orchestra.run.smithi172.stdout: postgresql x86_64 13.16-1.el9 appstream 1.6 M 2024-09-12T02:24:00.628 INFO:teuthology.orchestra.run.smithi172.stdout: postgresql-contrib x86_64 13.16-1.el9 appstream 910 k 2024-09-12T02:24:00.628 INFO:teuthology.orchestra.run.smithi172.stdout: postgresql-server x86_64 13.16-1.el9 appstream 5.8 M 2024-09-12T02:24:00.628 INFO:teuthology.orchestra.run.smithi172.stdout: python3-cephfs x86_64 2:19.1.1-298.gb53b6d3e.el9 ceph 162 k 2024-09-12T02:24:00.629 INFO:teuthology.orchestra.run.smithi172.stdout: python3-rados x86_64 2:19.1.1-298.gb53b6d3e.el9 ceph 321 k 2024-09-12T02:24:00.629 INFO:teuthology.orchestra.run.smithi172.stdout: python3-rbd x86_64 2:19.1.1-298.gb53b6d3e.el9 ceph 301 k 2024-09-12T02:24:00.629 INFO:teuthology.orchestra.run.smithi172.stdout: python3-rgw x86_64 2:19.1.1-298.gb53b6d3e.el9 ceph 100 k 2024-09-12T02:24:00.629 INFO:teuthology.orchestra.run.smithi172.stdout: rbd-fuse x86_64 2:19.1.1-298.gb53b6d3e.el9 ceph 85 k 2024-09-12T02:24:00.629 INFO:teuthology.orchestra.run.smithi172.stdout: rbd-mirror x86_64 2:19.1.1-298.gb53b6d3e.el9 ceph 3.1 M 2024-09-12T02:24:00.629 INFO:teuthology.orchestra.run.smithi172.stdout: rbd-nbd x86_64 2:19.1.1-298.gb53b6d3e.el9 ceph 171 k 2024-09-12T02:24:00.629 INFO:teuthology.orchestra.run.smithi172.stdout: xfsprogs-devel x86_64 6.4.0-4.el9 appstream 96 k 2024-09-12T02:24:00.629 INFO:teuthology.orchestra.run.smithi172.stdout:Upgrading: 2024-09-12T02:24:00.629 INFO:teuthology.orchestra.run.smithi172.stdout: NetworkManager x86_64 1:1.49.90-1.el9 baseos 2.3 M 2024-09-12T02:24:00.629 INFO:teuthology.orchestra.run.smithi172.stdout: NetworkManager-libnm x86_64 1:1.49.90-1.el9 baseos 1.8 M 2024-09-12T02:24:00.629 INFO:teuthology.orchestra.run.smithi172.stdout: NetworkManager-team x86_64 1:1.49.90-1.el9 baseos 41 k 2024-09-12T02:24:00.630 INFO:teuthology.orchestra.run.smithi172.stdout: NetworkManager-tui x86_64 1:1.49.90-1.el9 baseos 249 k 2024-09-12T02:24:00.630 INFO:teuthology.orchestra.run.smithi172.stdout: librados2 x86_64 2:19.1.1-298.gb53b6d3e.el9 ceph 3.4 M 2024-09-12T02:24:00.630 INFO:teuthology.orchestra.run.smithi172.stdout: librbd1 x86_64 2:19.1.1-298.gb53b6d3e.el9 ceph 3.2 M 2024-09-12T02:24:00.630 INFO:teuthology.orchestra.run.smithi172.stdout: openssl x86_64 1:3.2.2-6.el9 baseos 1.4 M 2024-09-12T02:24:00.630 INFO:teuthology.orchestra.run.smithi172.stdout: openssl-libs x86_64 1:3.2.2-6.el9 baseos 2.4 M 2024-09-12T02:24:00.630 INFO:teuthology.orchestra.run.smithi172.stdout:Installing dependencies: 2024-09-12T02:24:00.630 INFO:teuthology.orchestra.run.smithi172.stdout: abseil-cpp x86_64 20211102.0-3.el9 epel 548 k 2024-09-12T02:24:00.630 INFO:teuthology.orchestra.run.smithi172.stdout: automake noarch 1.16.2-8.el9 appstream 689 k 2024-09-12T02:24:00.630 INFO:teuthology.orchestra.run.smithi172.stdout: boost-program-options x86_64 1.75.0-8.el9 appstream 107 k 2024-09-12T02:24:00.630 INFO:teuthology.orchestra.run.smithi172.stdout: ceph-common x86_64 2:19.1.1-298.gb53b6d3e.el9 ceph 21 M 2024-09-12T02:24:00.631 INFO:teuthology.orchestra.run.smithi172.stdout: ceph-grafana-dashboards noarch 2:19.1.1-298.gb53b6d3e.el9 ceph-noarch 32 k 2024-09-12T02:24:00.631 INFO:teuthology.orchestra.run.smithi172.stdout: ceph-mds x86_64 2:19.1.1-298.gb53b6d3e.el9 ceph 2.4 M 2024-09-12T02:24:00.631 INFO:teuthology.orchestra.run.smithi172.stdout: ceph-mgr-modules-core noarch 2:19.1.1-298.gb53b6d3e.el9 ceph-noarch 249 k 2024-09-12T02:24:00.631 INFO:teuthology.orchestra.run.smithi172.stdout: ceph-mon x86_64 2:19.1.1-298.gb53b6d3e.el9 ceph 4.7 M 2024-09-12T02:24:00.631 INFO:teuthology.orchestra.run.smithi172.stdout: ceph-osd x86_64 2:19.1.1-298.gb53b6d3e.el9 ceph 17 M 2024-09-12T02:24:00.631 INFO:teuthology.orchestra.run.smithi172.stdout: ceph-prometheus-alerts noarch 2:19.1.1-298.gb53b6d3e.el9 ceph-noarch 16 k 2024-09-12T02:24:00.631 INFO:teuthology.orchestra.run.smithi172.stdout: ceph-selinux x86_64 2:19.1.1-298.gb53b6d3e.el9 ceph 25 k 2024-09-12T02:24:00.631 INFO:teuthology.orchestra.run.smithi172.stdout: flexiblas x86_64 3.0.4-8.el9 appstream 33 k 2024-09-12T02:24:00.631 INFO:teuthology.orchestra.run.smithi172.stdout: flexiblas-netlib x86_64 3.0.4-8.el9 appstream 3.0 M 2024-09-12T02:24:00.631 INFO:teuthology.orchestra.run.smithi172.stdout: flexiblas-openblas-openmp x86_64 3.0.4-8.el9 appstream 18 k 2024-09-12T02:24:00.631 INFO:teuthology.orchestra.run.smithi172.stdout: fuse x86_64 2.9.9-16.el9 baseos 80 k 2024-09-12T02:24:00.632 INFO:teuthology.orchestra.run.smithi172.stdout: gperftools-libs x86_64 2.9.1-2.el9 epel 309 k 2024-09-12T02:24:00.632 INFO:teuthology.orchestra.run.smithi172.stdout: grpc-data noarch 1.46.7-10.el9 epel 19 k 2024-09-12T02:24:00.632 INFO:teuthology.orchestra.run.smithi172.stdout: libarrow x86_64 9.0.0-11.el9 epel 4.4 M 2024-09-12T02:24:00.632 INFO:teuthology.orchestra.run.smithi172.stdout: libarrow-doc noarch 9.0.0-11.el9 epel 26 k 2024-09-12T02:24:00.632 INFO:teuthology.orchestra.run.smithi172.stdout: libcephsqlite x86_64 2:19.1.1-298.gb53b6d3e.el9 ceph 163 k 2024-09-12T02:24:00.632 INFO:teuthology.orchestra.run.smithi172.stdout: libgfortran x86_64 11.5.0-2.el9 baseos 801 k 2024-09-12T02:24:00.632 INFO:teuthology.orchestra.run.smithi172.stdout: liboath x86_64 2.6.7-2.el9 epel 49 k 2024-09-12T02:24:00.632 INFO:teuthology.orchestra.run.smithi172.stdout: libpmemobj x86_64 1.12.1-1.el9 appstream 160 k 2024-09-12T02:24:00.632 INFO:teuthology.orchestra.run.smithi172.stdout: libquadmath x86_64 11.5.0-2.el9 baseos 191 k 2024-09-12T02:24:00.632 INFO:teuthology.orchestra.run.smithi172.stdout: librabbitmq x86_64 0.11.0-7.el9 appstream 45 k 2024-09-12T02:24:00.632 INFO:teuthology.orchestra.run.smithi172.stdout: libradosstriper1 x86_64 2:19.1.1-298.gb53b6d3e.el9 ceph 506 k 2024-09-12T02:24:00.632 INFO:teuthology.orchestra.run.smithi172.stdout: librdkafka x86_64 1.6.1-102.el9 appstream 662 k 2024-09-12T02:24:00.632 INFO:teuthology.orchestra.run.smithi172.stdout: librgw2 x86_64 2:19.1.1-298.gb53b6d3e.el9 ceph 5.3 M 2024-09-12T02:24:00.633 INFO:teuthology.orchestra.run.smithi172.stdout: libunwind x86_64 1.6.2-1.el9 epel 67 k 2024-09-12T02:24:00.633 INFO:teuthology.orchestra.run.smithi172.stdout: libzstd-devel x86_64 1.5.1-2.el9 appstream 47 k 2024-09-12T02:24:00.633 INFO:teuthology.orchestra.run.smithi172.stdout: lttng-ust x86_64 2.12.0-6.el9 appstream 292 k 2024-09-12T02:24:00.633 INFO:teuthology.orchestra.run.smithi172.stdout: lua x86_64 5.4.4-4.el9 appstream 188 k 2024-09-12T02:24:00.633 INFO:teuthology.orchestra.run.smithi172.stdout: lua-devel x86_64 5.4.4-4.el9 crb 22 k 2024-09-12T02:24:00.633 INFO:teuthology.orchestra.run.smithi172.stdout: luarocks noarch 3.9.2-5.el9 epel 151 k 2024-09-12T02:24:00.633 INFO:teuthology.orchestra.run.smithi172.stdout: openblas x86_64 0.3.26-2.el9 appstream 38 k 2024-09-12T02:24:00.633 INFO:teuthology.orchestra.run.smithi172.stdout: openblas-openmp x86_64 0.3.26-2.el9 appstream 4.9 M 2024-09-12T02:24:00.633 INFO:teuthology.orchestra.run.smithi172.stdout: parquet-libs x86_64 9.0.0-11.el9 epel 839 k 2024-09-12T02:24:00.633 INFO:teuthology.orchestra.run.smithi172.stdout: postgresql-private-libs x86_64 13.16-1.el9 appstream 137 k 2024-09-12T02:24:00.633 INFO:teuthology.orchestra.run.smithi172.stdout: protobuf x86_64 3.14.0-13.el9 appstream 1.0 M 2024-09-12T02:24:00.633 INFO:teuthology.orchestra.run.smithi172.stdout: protobuf-compiler x86_64 3.14.0-13.el9 crb 863 k 2024-09-12T02:24:00.633 INFO:teuthology.orchestra.run.smithi172.stdout: python3-asyncssh noarch 2.13.2-5.el9 epel 548 k 2024-09-12T02:24:00.634 INFO:teuthology.orchestra.run.smithi172.stdout: python3-attrs noarch 20.3.0-7.el9 appstream 87 k 2024-09-12T02:24:00.634 INFO:teuthology.orchestra.run.smithi172.stdout: python3-babel noarch 2.9.1-2.el9 appstream 6.0 M 2024-09-12T02:24:00.634 INFO:teuthology.orchestra.run.smithi172.stdout: python3-bcrypt x86_64 3.2.2-1.el9 epel 43 k 2024-09-12T02:24:00.634 INFO:teuthology.orchestra.run.smithi172.stdout: python3-cachetools noarch 4.2.4-1.el9 epel 32 k 2024-09-12T02:24:00.634 INFO:teuthology.orchestra.run.smithi172.stdout: python3-ceph-argparse x86_64 2:19.1.1-298.gb53b6d3e.el9 ceph 45 k 2024-09-12T02:24:00.634 INFO:teuthology.orchestra.run.smithi172.stdout: python3-ceph-common x86_64 2:19.1.1-298.gb53b6d3e.el9 ceph 136 k 2024-09-12T02:24:00.634 INFO:teuthology.orchestra.run.smithi172.stdout: python3-certifi noarch 2023.05.07-4.el9 epel 14 k 2024-09-12T02:24:00.634 INFO:teuthology.orchestra.run.smithi172.stdout: python3-cffi x86_64 1.14.5-5.el9 baseos 253 k 2024-09-12T02:24:00.634 INFO:teuthology.orchestra.run.smithi172.stdout: python3-cheroot noarch 8.6.0-4.el9 epel 172 k 2024-09-12T02:24:00.634 INFO:teuthology.orchestra.run.smithi172.stdout: python3-cherrypy noarch 18.6.1-2.el9 epel 358 k 2024-09-12T02:24:00.634 INFO:teuthology.orchestra.run.smithi172.stdout: python3-cmd2 noarch 2.4.2-2.el9 epel 303 k 2024-09-12T02:24:00.634 INFO:teuthology.orchestra.run.smithi172.stdout: python3-colorama noarch 0.4.6-3.el9 appstream 61 k 2024-09-12T02:24:00.634 INFO:teuthology.orchestra.run.smithi172.stdout: python3-cryptography x86_64 36.0.1-4.el9 baseos 1.2 M 2024-09-12T02:24:00.635 INFO:teuthology.orchestra.run.smithi172.stdout: python3-devel x86_64 3.9.19-8.el9 appstream 245 k 2024-09-12T02:24:00.635 INFO:teuthology.orchestra.run.smithi172.stdout: python3-google-auth noarch 1:2.34.0-1.el9 epel 220 k 2024-09-12T02:24:00.635 INFO:teuthology.orchestra.run.smithi172.stdout: python3-grpcio x86_64 1.46.7-10.el9 epel 2.0 M 2024-09-12T02:24:00.635 INFO:teuthology.orchestra.run.smithi172.stdout: python3-grpcio-tools x86_64 1.46.7-10.el9 epel 144 k 2024-09-12T02:24:00.635 INFO:teuthology.orchestra.run.smithi172.stdout: python3-jaraco noarch 8.2.1-3.el9 epel 11 k 2024-09-12T02:24:00.635 INFO:teuthology.orchestra.run.smithi172.stdout: python3-jaraco-classes noarch 3.2.1-5.el9 epel 18 k 2024-09-12T02:24:00.635 INFO:teuthology.orchestra.run.smithi172.stdout: python3-jaraco-collections noarch 3.0.0-8.el9 epel 23 k 2024-09-12T02:24:00.635 INFO:teuthology.orchestra.run.smithi172.stdout: python3-jaraco-functools noarch 3.5.0-2.el9 epel 19 k 2024-09-12T02:24:00.635 INFO:teuthology.orchestra.run.smithi172.stdout: python3-jaraco-text noarch 3.2.0-6.el9 epel 20 k 2024-09-12T02:24:00.635 INFO:teuthology.orchestra.run.smithi172.stdout: python3-jinja2 noarch 2.11.3-6.el9 appstream 248 k 2024-09-12T02:24:00.636 INFO:teuthology.orchestra.run.smithi172.stdout: python3-jsonpatch noarch 1.21-16.el9 appstream 26 k 2024-09-12T02:24:00.636 INFO:teuthology.orchestra.run.smithi172.stdout: python3-jsonpointer noarch 2.0-4.el9 appstream 19 k 2024-09-12T02:24:00.636 INFO:teuthology.orchestra.run.smithi172.stdout: python3-kubernetes noarch 1:26.1.0-2.el9 epel 1.0 M 2024-09-12T02:24:00.636 INFO:teuthology.orchestra.run.smithi172.stdout: python3-logutils noarch 0.3.5-21.el9 epel 46 k 2024-09-12T02:24:00.636 INFO:teuthology.orchestra.run.smithi172.stdout: python3-mako noarch 1.1.4-6.el9 appstream 172 k 2024-09-12T02:24:00.636 INFO:teuthology.orchestra.run.smithi172.stdout: python3-markupsafe x86_64 1.1.1-12.el9 appstream 35 k 2024-09-12T02:24:00.636 INFO:teuthology.orchestra.run.smithi172.stdout: python3-more-itertools noarch 8.12.0-2.el9 epel 79 k 2024-09-12T02:24:00.636 INFO:teuthology.orchestra.run.smithi172.stdout: python3-natsort noarch 7.1.1-5.el9 epel 58 k 2024-09-12T02:24:00.636 INFO:teuthology.orchestra.run.smithi172.stdout: python3-numpy x86_64 1:1.20.1-5.el9 appstream 5.1 M 2024-09-12T02:24:00.636 INFO:teuthology.orchestra.run.smithi172.stdout: python3-numpy-f2py x86_64 1:1.20.1-5.el9 appstream 250 k 2024-09-12T02:24:00.637 INFO:teuthology.orchestra.run.smithi172.stdout: python3-oauthlib noarch 3.1.1-5.el9 appstream 222 k 2024-09-12T02:24:00.637 INFO:teuthology.orchestra.run.smithi172.stdout: python3-packaging noarch 20.9-5.el9 appstream 77 k 2024-09-12T02:24:00.637 INFO:teuthology.orchestra.run.smithi172.stdout: python3-pecan noarch 1.4.2-3.el9 epel 272 k 2024-09-12T02:24:00.637 INFO:teuthology.orchestra.run.smithi172.stdout: python3-ply noarch 3.11-14.el9 baseos 106 k 2024-09-12T02:24:00.637 INFO:teuthology.orchestra.run.smithi172.stdout: python3-portend noarch 3.1.0-2.el9 epel 16 k 2024-09-12T02:24:00.637 INFO:teuthology.orchestra.run.smithi172.stdout: python3-prettytable noarch 0.7.2-27.el9 appstream 42 k 2024-09-12T02:24:00.637 INFO:teuthology.orchestra.run.smithi172.stdout: python3-protobuf noarch 3.14.0-13.el9 appstream 269 k 2024-09-12T02:24:00.637 INFO:teuthology.orchestra.run.smithi172.stdout: python3-pyOpenSSL noarch 21.0.0-1.el9 epel 90 k 2024-09-12T02:24:00.637 INFO:teuthology.orchestra.run.smithi172.stdout: python3-pyasn1 noarch 0.4.8-6.el9 appstream 159 k 2024-09-12T02:24:00.637 INFO:teuthology.orchestra.run.smithi172.stdout: python3-pyasn1-modules noarch 0.4.8-6.el9 appstream 279 k 2024-09-12T02:24:00.637 INFO:teuthology.orchestra.run.smithi172.stdout: python3-pycparser noarch 2.20-6.el9 baseos 135 k 2024-09-12T02:24:00.637 INFO:teuthology.orchestra.run.smithi172.stdout: python3-pyperclip noarch 1.8.2-2.el9 epel 28 k 2024-09-12T02:24:00.638 INFO:teuthology.orchestra.run.smithi172.stdout: python3-pytz noarch 2021.1-5.el9 appstream 51 k 2024-09-12T02:24:00.638 INFO:teuthology.orchestra.run.smithi172.stdout: python3-repoze-lru noarch 0.7-16.el9 epel 31 k 2024-09-12T02:24:00.638 INFO:teuthology.orchestra.run.smithi172.stdout: python3-requests noarch 2.25.1-8.el9 baseos 125 k 2024-09-12T02:24:00.638 INFO:teuthology.orchestra.run.smithi172.stdout: python3-requests-oauthlib noarch 1.3.0-12.el9 appstream 54 k 2024-09-12T02:24:00.638 INFO:teuthology.orchestra.run.smithi172.stdout: python3-routes noarch 2.5.1-5.el9 epel 188 k 2024-09-12T02:24:00.639 INFO:teuthology.orchestra.run.smithi172.stdout: python3-rsa noarch 4.9-2.el9 epel 59 k 2024-09-12T02:24:00.639 INFO:teuthology.orchestra.run.smithi172.stdout: python3-scipy x86_64 1.6.2-8.el9 appstream 16 M 2024-09-12T02:24:00.639 INFO:teuthology.orchestra.run.smithi172.stdout: python3-tempora noarch 5.0.0-2.el9 epel 36 k 2024-09-12T02:24:00.639 INFO:teuthology.orchestra.run.smithi172.stdout: python3-toml noarch 0.10.2-6.el9 appstream 42 k 2024-09-12T02:24:00.639 INFO:teuthology.orchestra.run.smithi172.stdout: python3-typing-extensions noarch 4.12.2-2.el9 epel 74 k 2024-09-12T02:24:00.640 INFO:teuthology.orchestra.run.smithi172.stdout: python3-urllib3 noarch 1.26.5-6.el9 baseos 215 k 2024-09-12T02:24:00.640 INFO:teuthology.orchestra.run.smithi172.stdout: python3-wcwidth noarch 0.2.5-8.el9 appstream 44 k 2024-09-12T02:24:00.640 INFO:teuthology.orchestra.run.smithi172.stdout: python3-webob noarch 1.8.8-2.el9 epel 230 k 2024-09-12T02:24:00.640 INFO:teuthology.orchestra.run.smithi172.stdout: python3-websocket-client noarch 1.2.3-2.el9 epel 90 k 2024-09-12T02:24:00.640 INFO:teuthology.orchestra.run.smithi172.stdout: python3-werkzeug noarch 2.0.3-3.el9.1 epel 427 k 2024-09-12T02:24:00.640 INFO:teuthology.orchestra.run.smithi172.stdout: python3-zc-lockfile noarch 2.0-10.el9 epel 20 k 2024-09-12T02:24:00.640 INFO:teuthology.orchestra.run.smithi172.stdout: qatlib x86_64 24.02.0-1.el9 appstream 221 k 2024-09-12T02:24:00.640 INFO:teuthology.orchestra.run.smithi172.stdout: qatzip-libs x86_64 1.2.0-1.el9 appstream 47 k 2024-09-12T02:24:00.640 INFO:teuthology.orchestra.run.smithi172.stdout: re2 x86_64 1:20211101-20.el9 epel 191 k 2024-09-12T02:24:00.640 INFO:teuthology.orchestra.run.smithi172.stdout: socat x86_64 1.7.4.1-6.el9 appstream 304 k 2024-09-12T02:24:00.641 INFO:teuthology.orchestra.run.smithi172.stdout: thrift x86_64 0.15.0-2.el9 epel 1.6 M 2024-09-12T02:24:00.641 INFO:teuthology.orchestra.run.smithi172.stdout: uuid x86_64 1.6.2-55.el9 appstream 58 k 2024-09-12T02:24:00.641 INFO:teuthology.orchestra.run.smithi172.stdout: xmlstarlet x86_64 1.6.1-20.el9 appstream 64 k 2024-09-12T02:24:00.641 INFO:teuthology.orchestra.run.smithi172.stdout: zlib-devel x86_64 1.2.11-41.el9 appstream 45 k 2024-09-12T02:24:00.641 INFO:teuthology.orchestra.run.smithi172.stdout:Installing weak dependencies: 2024-09-12T02:24:00.641 INFO:teuthology.orchestra.run.smithi172.stdout: qatlib-service x86_64 24.02.0-1.el9 appstream 36 k 2024-09-12T02:24:00.641 INFO:teuthology.orchestra.run.smithi172.stdout: 2024-09-12T02:24:00.641 INFO:teuthology.orchestra.run.smithi172.stdout:Transaction Summary 2024-09-12T02:24:00.641 INFO:teuthology.orchestra.run.smithi172.stdout:====================================================================================== 2024-09-12T02:24:00.641 INFO:teuthology.orchestra.run.smithi172.stdout:Install 148 Packages 2024-09-12T02:24:00.641 INFO:teuthology.orchestra.run.smithi172.stdout:Upgrade 8 Packages 2024-09-12T02:24:00.641 INFO:teuthology.orchestra.run.smithi172.stdout: 2024-09-12T02:24:00.642 INFO:teuthology.orchestra.run.smithi039.stdout:(35/156): ceph-mgr-diskprediction-local-19.1.1- 15 MB/s | 7.4 MB 00:00 2024-09-12T02:24:00.642 INFO:teuthology.orchestra.run.smithi172.stdout:Total download size: 226 M 2024-09-12T02:24:00.642 INFO:teuthology.orchestra.run.smithi172.stdout:Downloading Packages: 2024-09-12T02:24:00.652 INFO:teuthology.orchestra.run.smithi039.stdout:(36/156): ceph-volume-19.1.1-298.gb53b6d3e.el9. 2.0 MB/s | 285 kB 00:00 2024-09-12T02:24:00.695 INFO:teuthology.orchestra.run.smithi039.stdout:(37/156): cephadm-19.1.1-298.gb53b6d3e.el9.noar 11 MB/s | 765 kB 00:00 2024-09-12T02:24:00.720 INFO:teuthology.orchestra.run.smithi039.stdout:(38/156): cephfs-top-19.1.1-298.gb53b6d3e.el9.n 273 kB/s | 18 kB 00:00 2024-09-12T02:24:01.221 INFO:teuthology.orchestra.run.smithi044.stdout:Package librados2-2:16.2.4-5.el9.x86_64 is already installed. 2024-09-12T02:24:01.222 INFO:teuthology.orchestra.run.smithi044.stdout:Package librbd1-2:16.2.4-5.el9.x86_64 is already installed. 2024-09-12T02:24:01.234 INFO:teuthology.orchestra.run.smithi044.stdout:Package NetworkManager-1:1.48.8-1.el9.x86_64 is already installed. 2024-09-12T02:24:01.235 INFO:teuthology.orchestra.run.smithi044.stdout:Package iproute-6.2.0-5.el9.x86_64 is already installed. 2024-09-12T02:24:01.236 INFO:teuthology.orchestra.run.smithi044.stdout:Package util-linux-2.37.4-20.el9.x86_64 is already installed. 2024-09-12T02:24:01.237 INFO:teuthology.orchestra.run.smithi044.stdout:Package libacl-devel-2.3.1-4.el9.x86_64 is already installed. 2024-09-12T02:24:01.239 INFO:teuthology.orchestra.run.smithi044.stdout:Package libattr-devel-2.5.1-3.el9.x86_64 is already installed. 2024-09-12T02:24:01.241 INFO:teuthology.orchestra.run.smithi044.stdout:Package xfsdump-3.1.12-4.el9.x86_64 is already installed. 2024-09-12T02:24:01.242 INFO:teuthology.orchestra.run.smithi044.stdout:Package xfsprogs-6.4.0-4.el9.x86_64 is already installed. 2024-09-12T02:24:01.295 INFO:teuthology.orchestra.run.smithi172.stdout:(1/156): ceph-19.1.1-298.gb53b6d3e.el9.x86_64.r 49 kB/s | 6.5 kB 00:00 2024-09-12T02:24:01.308 INFO:teuthology.orchestra.run.smithi044.stdout:Dependencies resolved. 2024-09-12T02:24:01.326 INFO:teuthology.orchestra.run.smithi044.stdout:====================================================================================== 2024-09-12T02:24:01.326 INFO:teuthology.orchestra.run.smithi044.stdout: Package Arch Version Repository Size 2024-09-12T02:24:01.326 INFO:teuthology.orchestra.run.smithi044.stdout:====================================================================================== 2024-09-12T02:24:01.326 INFO:teuthology.orchestra.run.smithi044.stdout:Installing: 2024-09-12T02:24:01.326 INFO:teuthology.orchestra.run.smithi044.stdout: bison x86_64 3.7.4-5.el9 appstream 943 k 2024-09-12T02:24:01.326 INFO:teuthology.orchestra.run.smithi044.stdout: ceph x86_64 2:19.1.1-298.gb53b6d3e.el9 ceph 6.5 k 2024-09-12T02:24:01.326 INFO:teuthology.orchestra.run.smithi044.stdout: ceph-base x86_64 2:19.1.1-298.gb53b6d3e.el9 ceph 5.4 M 2024-09-12T02:24:01.326 INFO:teuthology.orchestra.run.smithi044.stdout: ceph-fuse x86_64 2:19.1.1-298.gb53b6d3e.el9 ceph 897 k 2024-09-12T02:24:01.326 INFO:teuthology.orchestra.run.smithi044.stdout: ceph-immutable-object-cache x86_64 2:19.1.1-298.gb53b6d3e.el9 ceph 145 k 2024-09-12T02:24:01.327 INFO:teuthology.orchestra.run.smithi044.stdout: ceph-mgr x86_64 2:19.1.1-298.gb53b6d3e.el9 ceph 1.5 M 2024-09-12T02:24:01.327 INFO:teuthology.orchestra.run.smithi044.stdout: ceph-mgr-cephadm noarch 2:19.1.1-298.gb53b6d3e.el9 ceph-noarch 146 k 2024-09-12T02:24:01.327 INFO:teuthology.orchestra.run.smithi044.stdout: ceph-mgr-dashboard noarch 2:19.1.1-298.gb53b6d3e.el9 ceph-noarch 3.6 M 2024-09-12T02:24:01.327 INFO:teuthology.orchestra.run.smithi044.stdout: ceph-mgr-diskprediction-local noarch 2:19.1.1-298.gb53b6d3e.el9 ceph-noarch 7.4 M 2024-09-12T02:24:01.327 INFO:teuthology.orchestra.run.smithi044.stdout: ceph-mgr-rook noarch 2:19.1.1-298.gb53b6d3e.el9 ceph-noarch 49 k 2024-09-12T02:24:01.327 INFO:teuthology.orchestra.run.smithi044.stdout: ceph-radosgw x86_64 2:19.1.1-298.gb53b6d3e.el9 ceph 11 M 2024-09-12T02:24:01.327 INFO:teuthology.orchestra.run.smithi044.stdout: ceph-test x86_64 2:19.1.1-298.gb53b6d3e.el9 ceph 49 M 2024-09-12T02:24:01.327 INFO:teuthology.orchestra.run.smithi044.stdout: ceph-volume noarch 2:19.1.1-298.gb53b6d3e.el9 ceph-noarch 285 k 2024-09-12T02:24:01.327 INFO:teuthology.orchestra.run.smithi044.stdout: cephadm noarch 2:19.1.1-298.gb53b6d3e.el9 ceph-noarch 765 k 2024-09-12T02:24:01.327 INFO:teuthology.orchestra.run.smithi044.stdout: cephfs-mirror x86_64 2:19.1.1-298.gb53b6d3e.el9 ceph 228 k 2024-09-12T02:24:01.327 INFO:teuthology.orchestra.run.smithi044.stdout: cephfs-shell x86_64 2:19.1.1-298.gb53b6d3e.el9 ceph 27 k 2024-09-12T02:24:01.327 INFO:teuthology.orchestra.run.smithi044.stdout: cephfs-top noarch 2:19.1.1-298.gb53b6d3e.el9 ceph-noarch 18 k 2024-09-12T02:24:01.327 INFO:teuthology.orchestra.run.smithi044.stdout: elfutils-libelf-devel x86_64 0.191-4.el9 appstream 22 k 2024-09-12T02:24:01.327 INFO:teuthology.orchestra.run.smithi044.stdout: flex x86_64 2.6.4-9.el9 appstream 313 k 2024-09-12T02:24:01.328 INFO:teuthology.orchestra.run.smithi044.stdout: libaio-devel x86_64 0.3.111-13.el9 appstream 11 k 2024-09-12T02:24:01.328 INFO:teuthology.orchestra.run.smithi044.stdout: libcephfs-devel x86_64 2:19.1.1-298.gb53b6d3e.el9 ceph 32 k 2024-09-12T02:24:01.328 INFO:teuthology.orchestra.run.smithi044.stdout: libcephfs2 x86_64 2:19.1.1-298.gb53b6d3e.el9 ceph 752 k 2024-09-12T02:24:01.328 INFO:teuthology.orchestra.run.smithi044.stdout: librados-devel x86_64 2:19.1.1-298.gb53b6d3e.el9 ceph 127 k 2024-09-12T02:24:01.328 INFO:teuthology.orchestra.run.smithi044.stdout: libtool x86_64 2.4.6-46.el9 appstream 581 k 2024-09-12T02:24:01.328 INFO:teuthology.orchestra.run.smithi044.stdout: libuuid-devel x86_64 2.37.4-20.el9 appstream 24 k 2024-09-12T02:24:01.328 INFO:teuthology.orchestra.run.smithi044.stdout: openssl-devel x86_64 1:3.2.2-6.el9 appstream 4.4 M 2024-09-12T02:24:01.328 INFO:teuthology.orchestra.run.smithi044.stdout: postgresql x86_64 13.16-1.el9 appstream 1.6 M 2024-09-12T02:24:01.328 INFO:teuthology.orchestra.run.smithi044.stdout: postgresql-contrib x86_64 13.16-1.el9 appstream 910 k 2024-09-12T02:24:01.328 INFO:teuthology.orchestra.run.smithi044.stdout: postgresql-server x86_64 13.16-1.el9 appstream 5.8 M 2024-09-12T02:24:01.328 INFO:teuthology.orchestra.run.smithi044.stdout: python3-cephfs x86_64 2:19.1.1-298.gb53b6d3e.el9 ceph 162 k 2024-09-12T02:24:01.328 INFO:teuthology.orchestra.run.smithi044.stdout: python3-rados x86_64 2:19.1.1-298.gb53b6d3e.el9 ceph 321 k 2024-09-12T02:24:01.329 INFO:teuthology.orchestra.run.smithi044.stdout: python3-rbd x86_64 2:19.1.1-298.gb53b6d3e.el9 ceph 301 k 2024-09-12T02:24:01.329 INFO:teuthology.orchestra.run.smithi044.stdout: python3-rgw x86_64 2:19.1.1-298.gb53b6d3e.el9 ceph 100 k 2024-09-12T02:24:01.329 INFO:teuthology.orchestra.run.smithi044.stdout: rbd-fuse x86_64 2:19.1.1-298.gb53b6d3e.el9 ceph 85 k 2024-09-12T02:24:01.329 INFO:teuthology.orchestra.run.smithi044.stdout: rbd-mirror x86_64 2:19.1.1-298.gb53b6d3e.el9 ceph 3.1 M 2024-09-12T02:24:01.329 INFO:teuthology.orchestra.run.smithi044.stdout: rbd-nbd x86_64 2:19.1.1-298.gb53b6d3e.el9 ceph 171 k 2024-09-12T02:24:01.329 INFO:teuthology.orchestra.run.smithi044.stdout: xfsprogs-devel x86_64 6.4.0-4.el9 appstream 96 k 2024-09-12T02:24:01.329 INFO:teuthology.orchestra.run.smithi044.stdout:Upgrading: 2024-09-12T02:24:01.329 INFO:teuthology.orchestra.run.smithi044.stdout: NetworkManager x86_64 1:1.49.90-1.el9 baseos 2.3 M 2024-09-12T02:24:01.329 INFO:teuthology.orchestra.run.smithi044.stdout: NetworkManager-libnm x86_64 1:1.49.90-1.el9 baseos 1.8 M 2024-09-12T02:24:01.329 INFO:teuthology.orchestra.run.smithi044.stdout: NetworkManager-team x86_64 1:1.49.90-1.el9 baseos 41 k 2024-09-12T02:24:01.329 INFO:teuthology.orchestra.run.smithi044.stdout: NetworkManager-tui x86_64 1:1.49.90-1.el9 baseos 249 k 2024-09-12T02:24:01.329 INFO:teuthology.orchestra.run.smithi044.stdout: librados2 x86_64 2:19.1.1-298.gb53b6d3e.el9 ceph 3.4 M 2024-09-12T02:24:01.329 INFO:teuthology.orchestra.run.smithi044.stdout: librbd1 x86_64 2:19.1.1-298.gb53b6d3e.el9 ceph 3.2 M 2024-09-12T02:24:01.330 INFO:teuthology.orchestra.run.smithi044.stdout: openssl x86_64 1:3.2.2-6.el9 baseos 1.4 M 2024-09-12T02:24:01.330 INFO:teuthology.orchestra.run.smithi044.stdout: openssl-libs x86_64 1:3.2.2-6.el9 baseos 2.4 M 2024-09-12T02:24:01.330 INFO:teuthology.orchestra.run.smithi044.stdout:Installing dependencies: 2024-09-12T02:24:01.330 INFO:teuthology.orchestra.run.smithi044.stdout: abseil-cpp x86_64 20211102.0-3.el9 epel 548 k 2024-09-12T02:24:01.330 INFO:teuthology.orchestra.run.smithi044.stdout: automake noarch 1.16.2-8.el9 appstream 689 k 2024-09-12T02:24:01.330 INFO:teuthology.orchestra.run.smithi044.stdout: boost-program-options x86_64 1.75.0-8.el9 appstream 107 k 2024-09-12T02:24:01.330 INFO:teuthology.orchestra.run.smithi044.stdout: ceph-common x86_64 2:19.1.1-298.gb53b6d3e.el9 ceph 21 M 2024-09-12T02:24:01.330 INFO:teuthology.orchestra.run.smithi044.stdout: ceph-grafana-dashboards noarch 2:19.1.1-298.gb53b6d3e.el9 ceph-noarch 32 k 2024-09-12T02:24:01.330 INFO:teuthology.orchestra.run.smithi044.stdout: ceph-mds x86_64 2:19.1.1-298.gb53b6d3e.el9 ceph 2.4 M 2024-09-12T02:24:01.330 INFO:teuthology.orchestra.run.smithi044.stdout: ceph-mgr-modules-core noarch 2:19.1.1-298.gb53b6d3e.el9 ceph-noarch 249 k 2024-09-12T02:24:01.331 INFO:teuthology.orchestra.run.smithi044.stdout: ceph-mon x86_64 2:19.1.1-298.gb53b6d3e.el9 ceph 4.7 M 2024-09-12T02:24:01.331 INFO:teuthology.orchestra.run.smithi044.stdout: ceph-osd x86_64 2:19.1.1-298.gb53b6d3e.el9 ceph 17 M 2024-09-12T02:24:01.331 INFO:teuthology.orchestra.run.smithi044.stdout: ceph-prometheus-alerts noarch 2:19.1.1-298.gb53b6d3e.el9 ceph-noarch 16 k 2024-09-12T02:24:01.331 INFO:teuthology.orchestra.run.smithi044.stdout: ceph-selinux x86_64 2:19.1.1-298.gb53b6d3e.el9 ceph 25 k 2024-09-12T02:24:01.331 INFO:teuthology.orchestra.run.smithi044.stdout: flexiblas x86_64 3.0.4-8.el9 appstream 33 k 2024-09-12T02:24:01.331 INFO:teuthology.orchestra.run.smithi044.stdout: flexiblas-netlib x86_64 3.0.4-8.el9 appstream 3.0 M 2024-09-12T02:24:01.331 INFO:teuthology.orchestra.run.smithi044.stdout: flexiblas-openblas-openmp x86_64 3.0.4-8.el9 appstream 18 k 2024-09-12T02:24:01.331 INFO:teuthology.orchestra.run.smithi044.stdout: fuse x86_64 2.9.9-16.el9 baseos 80 k 2024-09-12T02:24:01.331 INFO:teuthology.orchestra.run.smithi044.stdout: gperftools-libs x86_64 2.9.1-2.el9 epel 309 k 2024-09-12T02:24:01.331 INFO:teuthology.orchestra.run.smithi044.stdout: grpc-data noarch 1.46.7-10.el9 epel 19 k 2024-09-12T02:24:01.331 INFO:teuthology.orchestra.run.smithi044.stdout: libarrow x86_64 9.0.0-11.el9 epel 4.4 M 2024-09-12T02:24:01.331 INFO:teuthology.orchestra.run.smithi044.stdout: libarrow-doc noarch 9.0.0-11.el9 epel 26 k 2024-09-12T02:24:01.331 INFO:teuthology.orchestra.run.smithi044.stdout: libcephsqlite x86_64 2:19.1.1-298.gb53b6d3e.el9 ceph 163 k 2024-09-12T02:24:01.332 INFO:teuthology.orchestra.run.smithi044.stdout: libgfortran x86_64 11.5.0-2.el9 baseos 801 k 2024-09-12T02:24:01.332 INFO:teuthology.orchestra.run.smithi044.stdout: liboath x86_64 2.6.7-2.el9 epel 49 k 2024-09-12T02:24:01.332 INFO:teuthology.orchestra.run.smithi044.stdout: libpmemobj x86_64 1.12.1-1.el9 appstream 160 k 2024-09-12T02:24:01.332 INFO:teuthology.orchestra.run.smithi044.stdout: libquadmath x86_64 11.5.0-2.el9 baseos 191 k 2024-09-12T02:24:01.332 INFO:teuthology.orchestra.run.smithi044.stdout: librabbitmq x86_64 0.11.0-7.el9 appstream 45 k 2024-09-12T02:24:01.332 INFO:teuthology.orchestra.run.smithi044.stdout: libradosstriper1 x86_64 2:19.1.1-298.gb53b6d3e.el9 ceph 506 k 2024-09-12T02:24:01.332 INFO:teuthology.orchestra.run.smithi044.stdout: librdkafka x86_64 1.6.1-102.el9 appstream 662 k 2024-09-12T02:24:01.332 INFO:teuthology.orchestra.run.smithi044.stdout: librgw2 x86_64 2:19.1.1-298.gb53b6d3e.el9 ceph 5.3 M 2024-09-12T02:24:01.332 INFO:teuthology.orchestra.run.smithi044.stdout: libunwind x86_64 1.6.2-1.el9 epel 67 k 2024-09-12T02:24:01.332 INFO:teuthology.orchestra.run.smithi044.stdout: libzstd-devel x86_64 1.5.1-2.el9 appstream 47 k 2024-09-12T02:24:01.332 INFO:teuthology.orchestra.run.smithi044.stdout: lttng-ust x86_64 2.12.0-6.el9 appstream 292 k 2024-09-12T02:24:01.332 INFO:teuthology.orchestra.run.smithi044.stdout: lua x86_64 5.4.4-4.el9 appstream 188 k 2024-09-12T02:24:01.332 INFO:teuthology.orchestra.run.smithi044.stdout: lua-devel x86_64 5.4.4-4.el9 crb 22 k 2024-09-12T02:24:01.333 INFO:teuthology.orchestra.run.smithi044.stdout: luarocks noarch 3.9.2-5.el9 epel 151 k 2024-09-12T02:24:01.333 INFO:teuthology.orchestra.run.smithi044.stdout: openblas x86_64 0.3.26-2.el9 appstream 38 k 2024-09-12T02:24:01.333 INFO:teuthology.orchestra.run.smithi044.stdout: openblas-openmp x86_64 0.3.26-2.el9 appstream 4.9 M 2024-09-12T02:24:01.333 INFO:teuthology.orchestra.run.smithi044.stdout: parquet-libs x86_64 9.0.0-11.el9 epel 839 k 2024-09-12T02:24:01.333 INFO:teuthology.orchestra.run.smithi044.stdout: postgresql-private-libs x86_64 13.16-1.el9 appstream 137 k 2024-09-12T02:24:01.333 INFO:teuthology.orchestra.run.smithi044.stdout: protobuf x86_64 3.14.0-13.el9 appstream 1.0 M 2024-09-12T02:24:01.333 INFO:teuthology.orchestra.run.smithi044.stdout: protobuf-compiler x86_64 3.14.0-13.el9 crb 863 k 2024-09-12T02:24:01.333 INFO:teuthology.orchestra.run.smithi044.stdout: python3-asyncssh noarch 2.13.2-5.el9 epel 548 k 2024-09-12T02:24:01.333 INFO:teuthology.orchestra.run.smithi044.stdout: python3-attrs noarch 20.3.0-7.el9 appstream 87 k 2024-09-12T02:24:01.333 INFO:teuthology.orchestra.run.smithi044.stdout: python3-babel noarch 2.9.1-2.el9 appstream 6.0 M 2024-09-12T02:24:01.333 INFO:teuthology.orchestra.run.smithi044.stdout: python3-bcrypt x86_64 3.2.2-1.el9 epel 43 k 2024-09-12T02:24:01.333 INFO:teuthology.orchestra.run.smithi044.stdout: python3-cachetools noarch 4.2.4-1.el9 epel 32 k 2024-09-12T02:24:01.333 INFO:teuthology.orchestra.run.smithi044.stdout: python3-ceph-argparse x86_64 2:19.1.1-298.gb53b6d3e.el9 ceph 45 k 2024-09-12T02:24:01.334 INFO:teuthology.orchestra.run.smithi044.stdout: python3-ceph-common x86_64 2:19.1.1-298.gb53b6d3e.el9 ceph 136 k 2024-09-12T02:24:01.334 INFO:teuthology.orchestra.run.smithi044.stdout: python3-certifi noarch 2023.05.07-4.el9 epel 14 k 2024-09-12T02:24:01.334 INFO:teuthology.orchestra.run.smithi044.stdout: python3-cffi x86_64 1.14.5-5.el9 baseos 253 k 2024-09-12T02:24:01.334 INFO:teuthology.orchestra.run.smithi044.stdout: python3-cheroot noarch 8.6.0-4.el9 epel 172 k 2024-09-12T02:24:01.334 INFO:teuthology.orchestra.run.smithi044.stdout: python3-cherrypy noarch 18.6.1-2.el9 epel 358 k 2024-09-12T02:24:01.334 INFO:teuthology.orchestra.run.smithi044.stdout: python3-cmd2 noarch 2.4.2-2.el9 epel 303 k 2024-09-12T02:24:01.334 INFO:teuthology.orchestra.run.smithi044.stdout: python3-colorama noarch 0.4.6-3.el9 appstream 61 k 2024-09-12T02:24:01.334 INFO:teuthology.orchestra.run.smithi044.stdout: python3-cryptography x86_64 36.0.1-4.el9 baseos 1.2 M 2024-09-12T02:24:01.334 INFO:teuthology.orchestra.run.smithi044.stdout: python3-devel x86_64 3.9.19-8.el9 appstream 245 k 2024-09-12T02:24:01.334 INFO:teuthology.orchestra.run.smithi044.stdout: python3-google-auth noarch 1:2.34.0-1.el9 epel 220 k 2024-09-12T02:24:01.334 INFO:teuthology.orchestra.run.smithi044.stdout: python3-grpcio x86_64 1.46.7-10.el9 epel 2.0 M 2024-09-12T02:24:01.334 INFO:teuthology.orchestra.run.smithi044.stdout: python3-grpcio-tools x86_64 1.46.7-10.el9 epel 144 k 2024-09-12T02:24:01.334 INFO:teuthology.orchestra.run.smithi044.stdout: python3-jaraco noarch 8.2.1-3.el9 epel 11 k 2024-09-12T02:24:01.334 INFO:teuthology.orchestra.run.smithi044.stdout: python3-jaraco-classes noarch 3.2.1-5.el9 epel 18 k 2024-09-12T02:24:01.335 INFO:teuthology.orchestra.run.smithi044.stdout: python3-jaraco-collections noarch 3.0.0-8.el9 epel 23 k 2024-09-12T02:24:01.335 INFO:teuthology.orchestra.run.smithi044.stdout: python3-jaraco-functools noarch 3.5.0-2.el9 epel 19 k 2024-09-12T02:24:01.335 INFO:teuthology.orchestra.run.smithi044.stdout: python3-jaraco-text noarch 3.2.0-6.el9 epel 20 k 2024-09-12T02:24:01.335 INFO:teuthology.orchestra.run.smithi044.stdout: python3-jinja2 noarch 2.11.3-6.el9 appstream 248 k 2024-09-12T02:24:01.335 INFO:teuthology.orchestra.run.smithi044.stdout: python3-jsonpatch noarch 1.21-16.el9 appstream 26 k 2024-09-12T02:24:01.335 INFO:teuthology.orchestra.run.smithi044.stdout: python3-jsonpointer noarch 2.0-4.el9 appstream 19 k 2024-09-12T02:24:01.335 INFO:teuthology.orchestra.run.smithi044.stdout: python3-kubernetes noarch 1:26.1.0-2.el9 epel 1.0 M 2024-09-12T02:24:01.335 INFO:teuthology.orchestra.run.smithi044.stdout: python3-logutils noarch 0.3.5-21.el9 epel 46 k 2024-09-12T02:24:01.335 INFO:teuthology.orchestra.run.smithi044.stdout: python3-mako noarch 1.1.4-6.el9 appstream 172 k 2024-09-12T02:24:01.335 INFO:teuthology.orchestra.run.smithi044.stdout: python3-markupsafe x86_64 1.1.1-12.el9 appstream 35 k 2024-09-12T02:24:01.335 INFO:teuthology.orchestra.run.smithi044.stdout: python3-more-itertools noarch 8.12.0-2.el9 epel 79 k 2024-09-12T02:24:01.335 INFO:teuthology.orchestra.run.smithi044.stdout: python3-natsort noarch 7.1.1-5.el9 epel 58 k 2024-09-12T02:24:01.335 INFO:teuthology.orchestra.run.smithi044.stdout: python3-numpy x86_64 1:1.20.1-5.el9 appstream 5.1 M 2024-09-12T02:24:01.335 INFO:teuthology.orchestra.run.smithi044.stdout: python3-numpy-f2py x86_64 1:1.20.1-5.el9 appstream 250 k 2024-09-12T02:24:01.336 INFO:teuthology.orchestra.run.smithi044.stdout: python3-oauthlib noarch 3.1.1-5.el9 appstream 222 k 2024-09-12T02:24:01.336 INFO:teuthology.orchestra.run.smithi044.stdout: python3-packaging noarch 20.9-5.el9 appstream 77 k 2024-09-12T02:24:01.336 INFO:teuthology.orchestra.run.smithi044.stdout: python3-pecan noarch 1.4.2-3.el9 epel 272 k 2024-09-12T02:24:01.336 INFO:teuthology.orchestra.run.smithi044.stdout: python3-ply noarch 3.11-14.el9 baseos 106 k 2024-09-12T02:24:01.336 INFO:teuthology.orchestra.run.smithi044.stdout: python3-portend noarch 3.1.0-2.el9 epel 16 k 2024-09-12T02:24:01.336 INFO:teuthology.orchestra.run.smithi044.stdout: python3-prettytable noarch 0.7.2-27.el9 appstream 42 k 2024-09-12T02:24:01.336 INFO:teuthology.orchestra.run.smithi044.stdout: python3-protobuf noarch 3.14.0-13.el9 appstream 269 k 2024-09-12T02:24:01.336 INFO:teuthology.orchestra.run.smithi044.stdout: python3-pyOpenSSL noarch 21.0.0-1.el9 epel 90 k 2024-09-12T02:24:01.336 INFO:teuthology.orchestra.run.smithi044.stdout: python3-pyasn1 noarch 0.4.8-6.el9 appstream 159 k 2024-09-12T02:24:01.336 INFO:teuthology.orchestra.run.smithi044.stdout: python3-pyasn1-modules noarch 0.4.8-6.el9 appstream 279 k 2024-09-12T02:24:01.336 INFO:teuthology.orchestra.run.smithi044.stdout: python3-pycparser noarch 2.20-6.el9 baseos 135 k 2024-09-12T02:24:01.336 INFO:teuthology.orchestra.run.smithi044.stdout: python3-pyperclip noarch 1.8.2-2.el9 epel 28 k 2024-09-12T02:24:01.336 INFO:teuthology.orchestra.run.smithi044.stdout: python3-pytz noarch 2021.1-5.el9 appstream 51 k 2024-09-12T02:24:01.337 INFO:teuthology.orchestra.run.smithi044.stdout: python3-repoze-lru noarch 0.7-16.el9 epel 31 k 2024-09-12T02:24:01.337 INFO:teuthology.orchestra.run.smithi044.stdout: python3-requests noarch 2.25.1-8.el9 baseos 125 k 2024-09-12T02:24:01.337 INFO:teuthology.orchestra.run.smithi044.stdout: python3-requests-oauthlib noarch 1.3.0-12.el9 appstream 54 k 2024-09-12T02:24:01.337 INFO:teuthology.orchestra.run.smithi044.stdout: python3-routes noarch 2.5.1-5.el9 epel 188 k 2024-09-12T02:24:01.337 INFO:teuthology.orchestra.run.smithi044.stdout: python3-rsa noarch 4.9-2.el9 epel 59 k 2024-09-12T02:24:01.337 INFO:teuthology.orchestra.run.smithi044.stdout: python3-scipy x86_64 1.6.2-8.el9 appstream 16 M 2024-09-12T02:24:01.337 INFO:teuthology.orchestra.run.smithi044.stdout: python3-tempora noarch 5.0.0-2.el9 epel 36 k 2024-09-12T02:24:01.337 INFO:teuthology.orchestra.run.smithi044.stdout: python3-toml noarch 0.10.2-6.el9 appstream 42 k 2024-09-12T02:24:01.337 INFO:teuthology.orchestra.run.smithi044.stdout: python3-typing-extensions noarch 4.12.2-2.el9 epel 74 k 2024-09-12T02:24:01.337 INFO:teuthology.orchestra.run.smithi044.stdout: python3-urllib3 noarch 1.26.5-6.el9 baseos 215 k 2024-09-12T02:24:01.337 INFO:teuthology.orchestra.run.smithi044.stdout: python3-wcwidth noarch 0.2.5-8.el9 appstream 44 k 2024-09-12T02:24:01.337 INFO:teuthology.orchestra.run.smithi044.stdout: python3-webob noarch 1.8.8-2.el9 epel 230 k 2024-09-12T02:24:01.337 INFO:teuthology.orchestra.run.smithi044.stdout: python3-websocket-client noarch 1.2.3-2.el9 epel 90 k 2024-09-12T02:24:01.338 INFO:teuthology.orchestra.run.smithi044.stdout: python3-werkzeug noarch 2.0.3-3.el9.1 epel 427 k 2024-09-12T02:24:01.338 INFO:teuthology.orchestra.run.smithi044.stdout: python3-zc-lockfile noarch 2.0-10.el9 epel 20 k 2024-09-12T02:24:01.338 INFO:teuthology.orchestra.run.smithi044.stdout: qatlib x86_64 24.02.0-1.el9 appstream 221 k 2024-09-12T02:24:01.338 INFO:teuthology.orchestra.run.smithi044.stdout: qatzip-libs x86_64 1.2.0-1.el9 appstream 47 k 2024-09-12T02:24:01.339 INFO:teuthology.orchestra.run.smithi044.stdout: re2 x86_64 1:20211101-20.el9 epel 191 k 2024-09-12T02:24:01.339 INFO:teuthology.orchestra.run.smithi044.stdout: socat x86_64 1.7.4.1-6.el9 appstream 304 k 2024-09-12T02:24:01.340 INFO:teuthology.orchestra.run.smithi044.stdout: thrift x86_64 0.15.0-2.el9 epel 1.6 M 2024-09-12T02:24:01.340 INFO:teuthology.orchestra.run.smithi044.stdout: uuid x86_64 1.6.2-55.el9 appstream 58 k 2024-09-12T02:24:01.340 INFO:teuthology.orchestra.run.smithi044.stdout: xmlstarlet x86_64 1.6.1-20.el9 appstream 64 k 2024-09-12T02:24:01.340 INFO:teuthology.orchestra.run.smithi044.stdout: zlib-devel x86_64 1.2.11-41.el9 appstream 45 k 2024-09-12T02:24:01.340 INFO:teuthology.orchestra.run.smithi044.stdout:Installing weak dependencies: 2024-09-12T02:24:01.340 INFO:teuthology.orchestra.run.smithi044.stdout: qatlib-service x86_64 24.02.0-1.el9 appstream 36 k 2024-09-12T02:24:01.340 INFO:teuthology.orchestra.run.smithi044.stdout: 2024-09-12T02:24:01.340 INFO:teuthology.orchestra.run.smithi044.stdout:Transaction Summary 2024-09-12T02:24:01.340 INFO:teuthology.orchestra.run.smithi044.stdout:====================================================================================== 2024-09-12T02:24:01.340 INFO:teuthology.orchestra.run.smithi044.stdout:Install 148 Packages 2024-09-12T02:24:01.340 INFO:teuthology.orchestra.run.smithi044.stdout:Upgrade 8 Packages 2024-09-12T02:24:01.340 INFO:teuthology.orchestra.run.smithi044.stdout: 2024-09-12T02:24:01.341 INFO:teuthology.orchestra.run.smithi039.stdout:(39/156): ceph-test-19.1.1-298.gb53b6d3e.el9.x8 20 MB/s | 49 MB 00:02 2024-09-12T02:24:01.341 INFO:teuthology.orchestra.run.smithi044.stdout:Total download size: 226 M 2024-09-12T02:24:01.341 INFO:teuthology.orchestra.run.smithi044.stdout:Downloading Packages: 2024-09-12T02:24:01.537 INFO:teuthology.orchestra.run.smithi172.stdout:(2/156): ceph-fuse-19.1.1-298.gb53b6d3e.el9.x86 3.6 MB/s | 897 kB 00:00 2024-09-12T02:24:01.621 INFO:teuthology.orchestra.run.smithi172.stdout:(3/156): ceph-base-19.1.1-298.gb53b6d3e.el9.x86 12 MB/s | 5.4 MB 00:00 2024-09-12T02:24:01.646 INFO:teuthology.orchestra.run.smithi172.stdout:(4/156): ceph-immutable-object-cache-19.1.1-298 1.3 MB/s | 145 kB 00:00 2024-09-12T02:24:01.763 INFO:teuthology.orchestra.run.smithi172.stdout:(5/156): ceph-mds-19.1.1-298.gb53b6d3e.el9.x86_ 17 MB/s | 2.4 MB 00:00 2024-09-12T02:24:01.846 INFO:teuthology.orchestra.run.smithi039.stdout:(40/156): fuse-2.9.9-16.el9.x86_64.rpm 69 kB/s | 80 kB 00:01 2024-09-12T02:24:02.063 INFO:teuthology.orchestra.run.smithi172.stdout:(6/156): ceph-mon-19.1.1-298.gb53b6d3e.el9.x86_ 16 MB/s | 4.7 MB 00:00 2024-09-12T02:24:02.071 INFO:teuthology.orchestra.run.smithi039.stdout:(41/156): libgfortran-11.5.0-2.el9.x86_64.rpm 593 kB/s | 801 kB 00:01 2024-09-12T02:24:02.086 INFO:teuthology.orchestra.run.smithi044.stdout:(1/156): ceph-19.1.1-298.gb53b6d3e.el9.x86_64.r 34 kB/s | 6.5 kB 00:00 2024-09-12T02:24:02.113 INFO:teuthology.orchestra.run.smithi039.stdout:(42/156): libquadmath-11.5.0-2.el9.x86_64.rpm 254 kB/s | 191 kB 00:00 2024-09-12T02:24:02.147 INFO:teuthology.orchestra.run.smithi172.stdout:(7/156): ceph-mgr-19.1.1-298.gb53b6d3e.el9.x86_ 3.0 MB/s | 1.5 MB 00:00 2024-09-12T02:24:02.556 INFO:teuthology.orchestra.run.smithi172.stdout:(8/156): ceph-common-19.1.1-298.gb53b6d3e.el9.x 15 MB/s | 21 MB 00:01 2024-09-12T02:24:02.606 INFO:teuthology.orchestra.run.smithi172.stdout:(9/156): ceph-selinux-19.1.1-298.gb53b6d3e.el9. 505 kB/s | 25 kB 00:00 2024-09-12T02:24:02.613 INFO:teuthology.orchestra.run.smithi039.stdout:(43/156): python3-cffi-1.14.5-5.el9.x86_64.rpm 330 kB/s | 253 kB 00:00 2024-09-12T02:24:02.772 INFO:teuthology.orchestra.run.smithi039.stdout:(44/156): python3-ply-3.11-14.el9.noarch.rpm 162 kB/s | 106 kB 00:00 2024-09-12T02:24:02.894 INFO:teuthology.orchestra.run.smithi044.stdout:(2/156): ceph-fuse-19.1.1-298.gb53b6d3e.el9.x86 1.1 MB/s | 897 kB 00:00 2024-09-12T02:24:02.987 INFO:teuthology.orchestra.run.smithi044.stdout:(3/156): ceph-immutable-object-cache-19.1.1-298 1.5 MB/s | 145 kB 00:00 2024-09-12T02:24:03.023 INFO:teuthology.orchestra.run.smithi172.stdout:(10/156): ceph-osd-19.1.1-298.gb53b6d3e.el9.x86 18 MB/s | 17 MB 00:00 2024-09-12T02:24:03.064 INFO:teuthology.orchestra.run.smithi039.stdout:(45/156): python3-cryptography-36.0.1-4.el9.x86 1.3 MB/s | 1.2 MB 00:00 2024-09-12T02:24:03.127 INFO:teuthology.orchestra.run.smithi172.stdout:(11/156): cephfs-mirror-19.1.1-298.gb53b6d3e.el 2.1 MB/s | 228 kB 00:00 2024-09-12T02:24:03.182 INFO:teuthology.orchestra.run.smithi172.stdout:(12/156): cephfs-shell-19.1.1-298.gb53b6d3e.el9 500 kB/s | 27 kB 00:00 2024-09-12T02:24:03.240 INFO:teuthology.orchestra.run.smithi172.stdout:(13/156): libcephfs-devel-19.1.1-298.gb53b6d3e. 545 kB/s | 32 kB 00:00 2024-09-12T02:24:03.315 INFO:teuthology.orchestra.run.smithi172.stdout:(14/156): libcephfs2-19.1.1-298.gb53b6d3e.el9.x 9.8 MB/s | 752 kB 00:00 2024-09-12T02:24:03.374 INFO:teuthology.orchestra.run.smithi172.stdout:(15/156): libcephsqlite-19.1.1-298.gb53b6d3e.el 2.7 MB/s | 163 kB 00:00 2024-09-12T02:24:03.389 INFO:teuthology.orchestra.run.smithi039.stdout:(46/156): python3-pycparser-2.20-6.el9.noarch.r 174 kB/s | 135 kB 00:00 2024-09-12T02:24:03.432 INFO:teuthology.orchestra.run.smithi172.stdout:(16/156): librados-devel-19.1.1-298.gb53b6d3e.e 2.1 MB/s | 127 kB 00:00 2024-09-12T02:24:03.448 INFO:teuthology.orchestra.run.smithi039.stdout:(47/156): python3-requests-2.25.1-8.el9.noarch. 185 kB/s | 125 kB 00:00 2024-09-12T02:24:03.499 INFO:teuthology.orchestra.run.smithi172.stdout:(17/156): libradosstriper1-19.1.1-298.gb53b6d3e 7.4 MB/s | 506 kB 00:00 2024-09-12T02:24:03.783 INFO:teuthology.orchestra.run.smithi172.stdout:(18/156): librgw2-19.1.1-298.gb53b6d3e.el9.x86_ 19 MB/s | 5.3 MB 00:00 2024-09-12T02:24:03.833 INFO:teuthology.orchestra.run.smithi172.stdout:(19/156): python3-ceph-argparse-19.1.1-298.gb53 906 kB/s | 45 kB 00:00 2024-09-12T02:24:03.873 INFO:teuthology.orchestra.run.smithi039.stdout:(48/156): python3-urllib3-1.26.5-6.el9.noarch.r 266 kB/s | 215 kB 00:00 2024-09-12T02:24:03.892 INFO:teuthology.orchestra.run.smithi172.stdout:(20/156): python3-ceph-common-19.1.1-298.gb53b6 2.3 MB/s | 136 kB 00:00 2024-09-12T02:24:03.978 INFO:teuthology.orchestra.run.smithi044.stdout:(4/156): ceph-mds-19.1.1-298.gb53b6d3e.el9.x86_ 2.4 MB/s | 2.4 MB 00:00 2024-09-12T02:24:04.042 INFO:teuthology.orchestra.run.smithi172.stdout:(21/156): ceph-radosgw-19.1.1-298.gb53b6d3e.el9 5.6 MB/s | 11 MB 00:01 2024-09-12T02:24:04.067 INFO:teuthology.orchestra.run.smithi172.stdout:(22/156): python3-cephfs-19.1.1-298.gb53b6d3e.e 926 kB/s | 162 kB 00:00 2024-09-12T02:24:04.118 INFO:teuthology.orchestra.run.smithi172.stdout:(23/156): python3-rados-19.1.1-298.gb53b6d3e.el 4.2 MB/s | 321 kB 00:00 2024-09-12T02:24:04.123 INFO:teuthology.orchestra.run.smithi039.stdout:(49/156): automake-1.16.2-8.el9.noarch.rpm 941 kB/s | 689 kB 00:00 2024-09-12T02:24:04.143 INFO:teuthology.orchestra.run.smithi172.stdout:(24/156): python3-rbd-19.1.1-298.gb53b6d3e.el9. 3.9 MB/s | 301 kB 00:00 2024-09-12T02:24:04.168 INFO:teuthology.orchestra.run.smithi172.stdout:(25/156): python3-rgw-19.1.1-298.gb53b6d3e.el9. 1.9 MB/s | 100 kB 00:00 2024-09-12T02:24:04.170 INFO:teuthology.orchestra.run.smithi044.stdout:(5/156): ceph-base-19.1.1-298.gb53b6d3e.el9.x86 2.4 MB/s | 5.4 MB 00:02 2024-09-12T02:24:04.194 INFO:teuthology.orchestra.run.smithi172.stdout:(26/156): rbd-fuse-19.1.1-298.gb53b6d3e.el9.x86 1.7 MB/s | 85 kB 00:00 2024-09-12T02:24:04.240 INFO:teuthology.orchestra.run.smithi039.stdout:(50/156): elfutils-libelf-devel-0.191-4.el9.x86 186 kB/s | 22 kB 00:00 2024-09-12T02:24:04.244 INFO:teuthology.orchestra.run.smithi172.stdout:(27/156): rbd-nbd-19.1.1-298.gb53b6d3e.el9.x86_ 3.3 MB/s | 171 kB 00:00 2024-09-12T02:24:04.282 INFO:teuthology.orchestra.run.smithi039.stdout:(51/156): bison-3.7.4-5.el9.x86_64.rpm 1.1 MB/s | 943 kB 00:00 2024-09-12T02:24:04.302 INFO:teuthology.orchestra.run.smithi172.stdout:(28/156): ceph-grafana-dashboards-19.1.1-298.gb 548 kB/s | 32 kB 00:00 2024-09-12T02:24:04.332 INFO:teuthology.orchestra.run.smithi039.stdout:(52/156): boost-program-options-1.75.0-8.el9.x8 233 kB/s | 107 kB 00:00 2024-09-12T02:24:04.357 INFO:teuthology.orchestra.run.smithi039.stdout:(53/156): flex-2.6.4-9.el9.x86_64.rpm 2.6 MB/s | 313 kB 00:00 2024-09-12T02:24:04.361 INFO:teuthology.orchestra.run.smithi172.stdout:(29/156): ceph-mgr-cephadm-19.1.1-298.gb53b6d3e 2.4 MB/s | 146 kB 00:00 2024-09-12T02:24:04.391 INFO:teuthology.orchestra.run.smithi039.stdout:(54/156): flexiblas-3.0.4-8.el9.x86_64.rpm 301 kB/s | 33 kB 00:00 2024-09-12T02:24:04.475 INFO:teuthology.orchestra.run.smithi039.stdout:(55/156): flexiblas-openblas-openmp-3.0.4-8.el9 155 kB/s | 18 kB 00:00 2024-09-12T02:24:04.500 INFO:teuthology.orchestra.run.smithi039.stdout:(56/156): libaio-devel-0.3.111-13.el9.x86_64.rp 103 kB/s | 11 kB 00:00 2024-09-12T02:24:04.561 INFO:teuthology.orchestra.run.smithi172.stdout:(30/156): ceph-mgr-dashboard-19.1.1-298.gb53b6d 18 MB/s | 3.6 MB 00:00 2024-09-12T02:24:04.562 INFO:teuthology.orchestra.run.smithi044.stdout:(6/156): ceph-mgr-19.1.1-298.gb53b6d3e.el9.x86_ 2.6 MB/s | 1.5 MB 00:00 2024-09-12T02:24:04.592 INFO:teuthology.orchestra.run.smithi039.stdout:(57/156): libpmemobj-1.12.1-1.el9.x86_64.rpm 1.3 MB/s | 160 kB 00:00 2024-09-12T02:24:04.617 INFO:teuthology.orchestra.run.smithi039.stdout:(58/156): librabbitmq-0.11.0-7.el9.x86_64.rpm 387 kB/s | 45 kB 00:00 2024-09-12T02:24:04.687 INFO:teuthology.orchestra.run.smithi172.stdout:(31/156): rbd-mirror-19.1.1-298.gb53b6d3e.el9.x 6.0 MB/s | 3.1 MB 00:00 2024-09-12T02:24:04.718 INFO:teuthology.orchestra.run.smithi039.stdout:(59/156): librdkafka-1.6.1-102.el9.x86_64.rpm 5.2 MB/s | 662 kB 00:00 2024-09-12T02:24:04.760 INFO:teuthology.orchestra.run.smithi039.stdout:(60/156): libtool-2.4.6-46.el9.x86_64.rpm 4.0 MB/s | 581 kB 00:00 2024-09-12T02:24:04.770 INFO:teuthology.orchestra.run.smithi172.stdout:(32/156): ceph-mgr-modules-core-19.1.1-298.gb53 2.9 MB/s | 249 kB 00:00 2024-09-12T02:24:04.826 INFO:teuthology.orchestra.run.smithi039.stdout:(61/156): libuuid-devel-2.37.4-20.el9.x86_64.rp 226 kB/s | 24 kB 00:00 2024-09-12T02:24:04.868 INFO:teuthology.orchestra.run.smithi039.stdout:(62/156): libzstd-devel-1.5.1-2.el9.x86_64.rpm 437 kB/s | 47 kB 00:00 2024-09-12T02:24:04.944 INFO:teuthology.orchestra.run.smithi039.stdout:(63/156): lttng-ust-2.12.0-6.el9.x86_64.rpm 2.4 MB/s | 292 kB 00:00 2024-09-12T02:24:04.994 INFO:teuthology.orchestra.run.smithi039.stdout:(64/156): lua-5.4.4-4.el9.x86_64.rpm 1.5 MB/s | 188 kB 00:00 2024-09-12T02:24:05.053 INFO:teuthology.orchestra.run.smithi039.stdout:(65/156): openblas-0.3.26-2.el9.x86_64.rpm 354 kB/s | 38 kB 00:00 2024-09-12T02:24:05.103 INFO:teuthology.orchestra.run.smithi039.stdout:(66/156): flexiblas-netlib-3.0.4-8.el9.x86_64.r 3.9 MB/s | 3.0 MB 00:00 2024-09-12T02:24:05.212 INFO:teuthology.orchestra.run.smithi172.stdout:(33/156): ceph-test-19.1.1-298.gb53b6d3e.el9.x8 19 MB/s | 49 MB 00:02 2024-09-12T02:24:05.238 INFO:teuthology.orchestra.run.smithi172.stdout:(34/156): ceph-mgr-rook-19.1.1-298.gb53b6d3e.el 106 kB/s | 49 kB 00:00 2024-09-12T02:24:05.263 INFO:teuthology.orchestra.run.smithi172.stdout:(35/156): ceph-prometheus-alerts-19.1.1-298.gb5 329 kB/s | 16 kB 00:00 2024-09-12T02:24:05.280 INFO:teuthology.orchestra.run.smithi039.stdout:(67/156): postgresql-13.16-1.el9.x86_64.rpm 9.0 MB/s | 1.6 MB 00:00 2024-09-12T02:24:05.363 INFO:teuthology.orchestra.run.smithi172.stdout:(36/156): ceph-mgr-diskprediction-local-19.1.1- 9.2 MB/s | 7.4 MB 00:00 2024-09-12T02:24:05.370 INFO:teuthology.orchestra.run.smithi044.stdout:(7/156): ceph-mon-19.1.1-298.gb53b6d3e.el9.x86_ 3.9 MB/s | 4.7 MB 00:01 2024-09-12T02:24:05.412 INFO:teuthology.orchestra.run.smithi039.stdout:(68/156): postgresql-contrib-13.16-1.el9.x86_64 6.7 MB/s | 910 kB 00:00 2024-09-12T02:24:05.422 INFO:teuthology.orchestra.run.smithi172.stdout:(37/156): ceph-volume-19.1.1-298.gb53b6d3e.el9. 1.5 MB/s | 285 kB 00:00 2024-09-12T02:24:05.447 INFO:teuthology.orchestra.run.smithi172.stdout:(38/156): cephfs-top-19.1.1-298.gb53b6d3e.el9.n 218 kB/s | 18 kB 00:00 2024-09-12T02:24:05.472 INFO:teuthology.orchestra.run.smithi172.stdout:(39/156): cephadm-19.1.1-298.gb53b6d3e.el9.noar 3.6 MB/s | 765 kB 00:00 2024-09-12T02:24:05.695 INFO:teuthology.orchestra.run.smithi039.stdout:(69/156): postgresql-private-libs-13.16-1.el9.x 485 kB/s | 137 kB 00:00 2024-09-12T02:24:05.914 INFO:teuthology.orchestra.run.smithi172.stdout:(40/156): fuse-2.9.9-16.el9.x86_64.rpm 162 kB/s | 80 kB 00:00 2024-09-12T02:24:06.115 INFO:teuthology.orchestra.run.smithi172.stdout:(41/156): libquadmath-11.5.0-2.el9.x86_64.rpm 297 kB/s | 191 kB 00:00 2024-09-12T02:24:06.290 INFO:teuthology.orchestra.run.smithi172.stdout:(42/156): python3-cffi-1.14.5-5.el9.x86_64.rpm 674 kB/s | 253 kB 00:00 2024-09-12T02:24:06.407 INFO:teuthology.orchestra.run.smithi172.stdout:(43/156): python3-ply-3.11-14.el9.noarch.rpm 914 kB/s | 106 kB 00:00 2024-09-12T02:24:06.421 INFO:teuthology.orchestra.run.smithi039.stdout:(70/156): openblas-openmp-0.3.26-2.el9.x86_64.r 3.5 MB/s | 4.9 MB 00:01 2024-09-12T02:24:06.440 INFO:teuthology.orchestra.run.smithi172.stdout:(44/156): libgfortran-11.5.0-2.el9.x86_64.rpm 807 kB/s | 801 kB 00:00 2024-09-12T02:24:06.524 INFO:teuthology.orchestra.run.smithi172.stdout:(45/156): python3-pycparser-2.20-6.el9.noarch.r 1.1 MB/s | 135 kB 00:00 2024-09-12T02:24:06.558 INFO:teuthology.orchestra.run.smithi172.stdout:(46/156): python3-requests-2.25.1-8.el9.noarch. 1.0 MB/s | 125 kB 00:00 2024-09-12T02:24:06.641 INFO:teuthology.orchestra.run.smithi172.stdout:(47/156): python3-urllib3-1.26.5-6.el9.noarch.r 1.8 MB/s | 215 kB 00:00 2024-09-12T02:24:06.708 INFO:teuthology.orchestra.run.smithi172.stdout:(48/156): python3-cryptography-36.0.1-4.el9.x86 2.1 MB/s | 1.2 MB 00:00 2024-09-12T02:24:06.733 INFO:teuthology.orchestra.run.smithi172.stdout:(49/156): automake-1.16.2-8.el9.noarch.rpm 3.8 MB/s | 689 kB 00:00 2024-09-12T02:24:06.775 INFO:teuthology.orchestra.run.smithi172.stdout:(50/156): elfutils-libelf-devel-0.191-4.el9.x86 522 kB/s | 22 kB 00:00 2024-09-12T02:24:06.809 INFO:teuthology.orchestra.run.smithi172.stdout:(51/156): bison-3.7.4-5.el9.x86_64.rpm 5.5 MB/s | 943 kB 00:00 2024-09-12T02:24:06.834 INFO:teuthology.orchestra.run.smithi172.stdout:(52/156): boost-program-options-1.75.0-8.el9.x8 850 kB/s | 107 kB 00:00 2024-09-12T02:24:06.887 INFO:teuthology.orchestra.run.smithi172.stdout:(53/156): flexiblas-3.0.4-8.el9.x86_64.rpm 423 kB/s | 33 kB 00:00 2024-09-12T02:24:06.918 INFO:teuthology.orchestra.run.smithi172.stdout:(54/156): flex-2.6.4-9.el9.x86_64.rpm 2.2 MB/s | 313 kB 00:00 2024-09-12T02:24:06.943 INFO:teuthology.orchestra.run.smithi172.stdout:(55/156): flexiblas-openblas-openmp-3.0.4-8.el9 324 kB/s | 18 kB 00:00 2024-09-12T02:24:06.969 INFO:teuthology.orchestra.run.smithi172.stdout:(56/156): libaio-devel-0.3.111-13.el9.x86_64.rp 222 kB/s | 11 kB 00:00 2024-09-12T02:24:06.994 INFO:teuthology.orchestra.run.smithi172.stdout:(57/156): libpmemobj-1.12.1-1.el9.x86_64.rpm 3.1 MB/s | 160 kB 00:00 2024-09-12T02:24:07.019 INFO:teuthology.orchestra.run.smithi172.stdout:(58/156): librabbitmq-0.11.0-7.el9.x86_64.rpm 901 kB/s | 45 kB 00:00 2024-09-12T02:24:07.053 INFO:teuthology.orchestra.run.smithi172.stdout:(59/156): librdkafka-1.6.1-102.el9.x86_64.rpm 11 MB/s | 662 kB 00:00 2024-09-12T02:24:07.094 INFO:teuthology.orchestra.run.smithi172.stdout:(60/156): libtool-2.4.6-46.el9.x86_64.rpm 7.6 MB/s | 581 kB 00:00 2024-09-12T02:24:07.120 INFO:teuthology.orchestra.run.smithi172.stdout:(61/156): libuuid-devel-2.37.4-20.el9.x86_64.rp 365 kB/s | 24 kB 00:00 2024-09-12T02:24:07.145 INFO:teuthology.orchestra.run.smithi172.stdout:(62/156): libzstd-devel-1.5.1-2.el9.x86_64.rpm 943 kB/s | 47 kB 00:00 2024-09-12T02:24:07.179 INFO:teuthology.orchestra.run.smithi172.stdout:(63/156): lttng-ust-2.12.0-6.el9.x86_64.rpm 4.9 MB/s | 292 kB 00:00 2024-09-12T02:24:07.204 INFO:teuthology.orchestra.run.smithi172.stdout:(64/156): lua-5.4.4-4.el9.x86_64.rpm 3.1 MB/s | 188 kB 00:00 2024-09-12T02:24:07.229 INFO:teuthology.orchestra.run.smithi172.stdout:(65/156): openblas-0.3.26-2.el9.x86_64.rpm 769 kB/s | 38 kB 00:00 2024-09-12T02:24:07.279 INFO:teuthology.orchestra.run.smithi172.stdout:(66/156): flexiblas-netlib-3.0.4-8.el9.x86_64.r 6.7 MB/s | 3.0 MB 00:00 2024-09-12T02:24:07.354 INFO:teuthology.orchestra.run.smithi039.stdout:(71/156): openssl-devel-3.2.2-6.el9.x86_64.rpm 1.9 MB/s | 4.4 MB 00:02 2024-09-12T02:24:07.372 INFO:teuthology.orchestra.run.smithi172.stdout:(67/156): postgresql-13.16-1.el9.x86_64.rpm 17 MB/s | 1.6 MB 00:00 2024-09-12T02:24:07.439 INFO:teuthology.orchestra.run.smithi172.stdout:(68/156): openblas-openmp-0.3.26-2.el9.x86_64.r 21 MB/s | 4.9 MB 00:00 2024-09-12T02:24:07.472 INFO:teuthology.orchestra.run.smithi172.stdout:(69/156): postgresql-contrib-13.16-1.el9.x86_64 8.9 MB/s | 910 kB 00:00 2024-09-12T02:24:07.539 INFO:teuthology.orchestra.run.smithi172.stdout:(70/156): openssl-devel-3.2.2-6.el9.x86_64.rpm 14 MB/s | 4.4 MB 00:00 2024-09-12T02:24:07.563 INFO:teuthology.orchestra.run.smithi039.stdout:(72/156): python3-attrs-20.3.0-7.el9.noarch.rpm 420 kB/s | 87 kB 00:00 2024-09-12T02:24:07.564 INFO:teuthology.orchestra.run.smithi172.stdout:(71/156): postgresql-private-libs-13.16-1.el9.x 1.1 MB/s | 137 kB 00:00 2024-09-12T02:24:07.598 INFO:teuthology.orchestra.run.smithi172.stdout:(72/156): protobuf-3.14.0-13.el9.x86_64.rpm 17 MB/s | 1.0 MB 00:00 2024-09-12T02:24:07.623 INFO:teuthology.orchestra.run.smithi172.stdout:(73/156): python3-attrs-20.3.0-7.el9.noarch.rpm 1.5 MB/s | 87 kB 00:00 2024-09-12T02:24:07.665 INFO:teuthology.orchestra.run.smithi172.stdout:(74/156): python3-colorama-0.4.6-3.el9.noarch.r 1.4 MB/s | 61 kB 00:00 2024-09-12T02:24:07.741 INFO:teuthology.orchestra.run.smithi172.stdout:(75/156): postgresql-server-13.16-1.el9.x86_64. 22 MB/s | 5.8 MB 00:00 2024-09-12T02:24:07.766 INFO:teuthology.orchestra.run.smithi172.stdout:(76/156): python3-devel-3.9.19-8.el9.x86_64.rpm 2.4 MB/s | 245 kB 00:00 2024-09-12T02:24:07.791 INFO:teuthology.orchestra.run.smithi172.stdout:(77/156): python3-jinja2-2.11.3-6.el9.noarch.rp 4.8 MB/s | 248 kB 00:00 2024-09-12T02:24:07.816 INFO:teuthology.orchestra.run.smithi172.stdout:(78/156): python3-jsonpatch-1.21-16.el9.noarch. 511 kB/s | 26 kB 00:00 2024-09-12T02:24:07.841 INFO:teuthology.orchestra.run.smithi172.stdout:(79/156): python3-jsonpointer-2.0-4.el9.noarch. 382 kB/s | 19 kB 00:00 2024-09-12T02:24:07.875 INFO:teuthology.orchestra.run.smithi172.stdout:(80/156): python3-mako-1.1.4-6.el9.noarch.rpm 2.9 MB/s | 172 kB 00:00 2024-09-12T02:24:07.892 INFO:teuthology.orchestra.run.smithi172.stdout:(81/156): python3-markupsafe-1.1.1-12.el9.x86_6 691 kB/s | 35 kB 00:00 2024-09-12T02:24:07.976 INFO:teuthology.orchestra.run.smithi172.stdout:(82/156): python3-babel-2.9.1-2.el9.noarch.rpm 16 MB/s | 6.0 MB 00:00 2024-09-12T02:24:07.996 INFO:teuthology.orchestra.run.smithi039.stdout:(73/156): protobuf-3.14.0-13.el9.x86_64.rpm 656 kB/s | 1.0 MB 00:01 2024-09-12T02:24:08.001 INFO:teuthology.orchestra.run.smithi172.stdout:(83/156): python3-numpy-f2py-1.20.1-5.el9.x86_6 2.3 MB/s | 250 kB 00:00 2024-09-12T02:24:08.026 INFO:teuthology.orchestra.run.smithi172.stdout:(84/156): python3-oauthlib-3.1.1-5.el9.noarch.r 4.3 MB/s | 222 kB 00:00 2024-09-12T02:24:08.060 INFO:teuthology.orchestra.run.smithi172.stdout:(85/156): python3-packaging-20.9-5.el9.noarch.r 1.3 MB/s | 77 kB 00:00 2024-09-12T02:24:08.077 INFO:teuthology.orchestra.run.smithi172.stdout:(86/156): python3-prettytable-0.7.2-27.el9.noar 842 kB/s | 42 kB 00:00 2024-09-12T02:24:08.102 INFO:teuthology.orchestra.run.smithi172.stdout:(87/156): python3-protobuf-3.14.0-13.el9.noarch 6.3 MB/s | 269 kB 00:00 2024-09-12T02:24:08.113 INFO:teuthology.orchestra.run.smithi039.stdout:(74/156): python3-colorama-0.4.6-3.el9.noarch.r 525 kB/s | 61 kB 00:00 2024-09-12T02:24:08.127 INFO:teuthology.orchestra.run.smithi172.stdout:(88/156): python3-pyasn1-0.4.8-6.el9.noarch.rpm 3.1 MB/s | 159 kB 00:00 2024-09-12T02:24:08.161 INFO:teuthology.orchestra.run.smithi172.stdout:(89/156): python3-pyasn1-modules-0.4.8-6.el9.no 4.7 MB/s | 279 kB 00:00 2024-09-12T02:24:08.186 INFO:teuthology.orchestra.run.smithi172.stdout:(90/156): python3-pytz-2021.1-5.el9.noarch.rpm 870 kB/s | 51 kB 00:00 2024-09-12T02:24:08.256 INFO:teuthology.orchestra.run.smithi172.stdout:(91/156): python3-requests-oauthlib-1.3.0-12.el 569 kB/s | 54 kB 00:00 2024-09-12T02:24:08.337 INFO:teuthology.orchestra.run.smithi172.stdout:(92/156): python3-numpy-1.20.1-5.el9.x86_64.rpm 11 MB/s | 5.1 MB 00:00 2024-09-12T02:24:08.362 INFO:teuthology.orchestra.run.smithi172.stdout:(93/156): python3-toml-0.10.2-6.el9.noarch.rpm 393 kB/s | 42 kB 00:00 2024-09-12T02:24:08.387 INFO:teuthology.orchestra.run.smithi172.stdout:(94/156): python3-wcwidth-0.2.5-8.el9.noarch.rp 882 kB/s | 44 kB 00:00 2024-09-12T02:24:08.413 INFO:teuthology.orchestra.run.smithi172.stdout:(95/156): qatlib-24.02.0-1.el9.x86_64.rpm 4.3 MB/s | 221 kB 00:00 2024-09-12T02:24:08.438 INFO:teuthology.orchestra.run.smithi172.stdout:(96/156): qatlib-service-24.02.0-1.el9.x86_64.r 716 kB/s | 36 kB 00:00 2024-09-12T02:24:08.463 INFO:teuthology.orchestra.run.smithi172.stdout:(97/156): qatzip-libs-1.2.0-1.el9.x86_64.rpm 945 kB/s | 47 kB 00:00 2024-09-12T02:24:08.489 INFO:teuthology.orchestra.run.smithi039.stdout:(75/156): python3-devel-3.9.19-8.el9.x86_64.rpm 653 kB/s | 245 kB 00:00 2024-09-12T02:24:08.489 INFO:teuthology.orchestra.run.smithi172.stdout:(98/156): socat-1.7.4.1-6.el9.x86_64.rpm 5.9 MB/s | 304 kB 00:00 2024-09-12T02:24:08.514 INFO:teuthology.orchestra.run.smithi172.stdout:(99/156): uuid-1.6.2-55.el9.x86_64.rpm 1.1 MB/s | 58 kB 00:00 2024-09-12T02:24:08.539 INFO:teuthology.orchestra.run.smithi172.stdout:(100/156): xfsprogs-devel-6.4.0-4.el9.x86_64.rp 1.9 MB/s | 96 kB 00:00 2024-09-12T02:24:08.564 INFO:teuthology.orchestra.run.smithi172.stdout:(101/156): xmlstarlet-1.6.1-20.el9.x86_64.rpm 1.2 MB/s | 64 kB 00:00 2024-09-12T02:24:08.590 INFO:teuthology.orchestra.run.smithi172.stdout:(102/156): zlib-devel-1.2.11-41.el9.x86_64.rpm 886 kB/s | 45 kB 00:00 2024-09-12T02:24:08.665 INFO:teuthology.orchestra.run.smithi172.stdout:(103/156): lua-devel-5.4.4-4.el9.x86_64.rpm 223 kB/s | 22 kB 00:00 2024-09-12T02:24:08.723 INFO:teuthology.orchestra.run.smithi172.stdout:(104/156): abseil-cpp-20211102.0-3.el9.x86_64.r 9.2 MB/s | 548 kB 00:00 2024-09-12T02:24:08.765 INFO:teuthology.orchestra.run.smithi172.stdout:(105/156): gperftools-libs-2.9.1-2.el9.x86_64.r 7.3 MB/s | 309 kB 00:00 2024-09-12T02:24:08.791 INFO:teuthology.orchestra.run.smithi172.stdout:(106/156): grpc-data-1.46.7-10.el9.noarch.rpm 778 kB/s | 19 kB 00:00 2024-09-12T02:24:08.816 INFO:teuthology.orchestra.run.smithi172.stdout:(107/156): protobuf-compiler-3.14.0-13.el9.x86_ 3.7 MB/s | 863 kB 00:00 2024-09-12T02:24:08.872 INFO:teuthology.orchestra.run.smithi039.stdout:(76/156): python3-jinja2-2.11.3-6.el9.noarch.rp 648 kB/s | 248 kB 00:00 2024-09-12T02:24:08.981 INFO:teuthology.orchestra.run.smithi039.stdout:(77/156): python3-jsonpatch-1.21-16.el9.noarch. 237 kB/s | 26 kB 00:00 2024-09-12T02:24:08.991 INFO:teuthology.orchestra.run.smithi172.stdout:(108/156): python3-scipy-1.6.2-8.el9.x86_64.rpm 20 MB/s | 16 MB 00:00 2024-09-12T02:24:09.025 INFO:teuthology.orchestra.run.smithi172.stdout:(109/156): libarrow-doc-9.0.0-11.el9.noarch.rpm 125 kB/s | 26 kB 00:00 2024-09-12T02:24:09.059 INFO:teuthology.orchestra.run.smithi172.stdout:(110/156): liboath-2.6.7-2.el9.x86_64.rpm 750 kB/s | 49 kB 00:00 2024-09-12T02:24:09.084 INFO:teuthology.orchestra.run.smithi172.stdout:(111/156): libunwind-1.6.2-1.el9.x86_64.rpm 1.2 MB/s | 67 kB 00:00 2024-09-12T02:24:09.089 INFO:teuthology.orchestra.run.smithi039.stdout:(78/156): python3-jsonpointer-2.0-4.el9.noarch. 177 kB/s | 19 kB 00:00 2024-09-12T02:24:09.117 INFO:teuthology.orchestra.run.smithi172.stdout:(112/156): luarocks-3.9.2-5.el9.noarch.rpm 2.5 MB/s | 151 kB 00:00 2024-09-12T02:24:09.176 INFO:teuthology.orchestra.run.smithi172.stdout:(113/156): python3-asyncssh-2.13.2-5.el9.noarch 9.2 MB/s | 548 kB 00:00 2024-09-12T02:24:09.210 INFO:teuthology.orchestra.run.smithi172.stdout:(114/156): parquet-libs-9.0.0-11.el9.x86_64.rpm 6.5 MB/s | 839 kB 00:00 2024-09-12T02:24:09.226 INFO:teuthology.orchestra.run.smithi172.stdout:(115/156): python3-bcrypt-3.2.2-1.el9.x86_64.rp 866 kB/s | 43 kB 00:00 2024-09-12T02:24:09.243 INFO:teuthology.orchestra.run.smithi172.stdout:(116/156): python3-cachetools-4.2.4-1.el9.noarc 960 kB/s | 32 kB 00:00 2024-09-12T02:24:09.260 INFO:teuthology.orchestra.run.smithi172.stdout:(117/156): python3-certifi-2023.05.07-4.el9.noa 421 kB/s | 14 kB 00:00 2024-09-12T02:24:09.286 INFO:teuthology.orchestra.run.smithi172.stdout:(118/156): python3-cheroot-8.6.0-4.el9.noarch.r 4.0 MB/s | 172 kB 00:00 2024-09-12T02:24:09.353 INFO:teuthology.orchestra.run.smithi172.stdout:(119/156): libarrow-9.0.0-11.el9.x86_64.rpm 7.9 MB/s | 4.4 MB 00:00 2024-09-12T02:24:09.381 INFO:teuthology.orchestra.run.smithi039.stdout:(79/156): python3-mako-1.1.4-6.el9.noarch.rpm 591 kB/s | 172 kB 00:00 2024-09-12T02:24:09.386 INFO:teuthology.orchestra.run.smithi172.stdout:(120/156): python3-cherrypy-18.6.1-2.el9.noarch 2.8 MB/s | 358 kB 00:00 2024-09-12T02:24:09.411 INFO:teuthology.orchestra.run.smithi172.stdout:(121/156): python3-cmd2-2.4.2-2.el9.noarch.rpm 2.4 MB/s | 303 kB 00:00 2024-09-12T02:24:09.437 INFO:teuthology.orchestra.run.smithi172.stdout:(122/156): python3-google-auth-2.34.0-1.el9.noa 2.6 MB/s | 220 kB 00:00 2024-09-12T02:24:09.462 INFO:teuthology.orchestra.run.smithi172.stdout:(123/156): python3-grpcio-tools-1.46.7-10.el9.x 2.8 MB/s | 144 kB 00:00 2024-09-12T02:24:09.487 INFO:teuthology.orchestra.run.smithi172.stdout:(124/156): python3-jaraco-8.2.1-3.el9.noarch.rp 213 kB/s | 11 kB 00:00 2024-09-12T02:24:09.498 INFO:teuthology.orchestra.run.smithi039.stdout:(80/156): python3-markupsafe-1.1.1-12.el9.x86_6 298 kB/s | 35 kB 00:00 2024-09-12T02:24:09.513 INFO:teuthology.orchestra.run.smithi172.stdout:(125/156): python3-jaraco-classes-3.2.1-5.el9.n 352 kB/s | 18 kB 00:00 2024-09-12T02:24:09.538 INFO:teuthology.orchestra.run.smithi172.stdout:(126/156): python3-jaraco-collections-3.0.0-8.e 462 kB/s | 23 kB 00:00 2024-09-12T02:24:09.563 INFO:teuthology.orchestra.run.smithi172.stdout:(127/156): python3-jaraco-functools-3.5.0-2.el9 388 kB/s | 19 kB 00:00 2024-09-12T02:24:09.588 INFO:teuthology.orchestra.run.smithi172.stdout:(128/156): python3-jaraco-text-3.2.0-6.el9.noar 393 kB/s | 20 kB 00:00 2024-09-12T02:24:09.614 INFO:teuthology.orchestra.run.smithi172.stdout:(129/156): python3-logutils-0.3.5-21.el9.noarch 1.8 MB/s | 46 kB 00:00 2024-09-12T02:24:09.656 INFO:teuthology.orchestra.run.smithi172.stdout:(130/156): python3-more-itertools-8.12.0-2.el9. 1.8 MB/s | 79 kB 00:00 2024-09-12T02:24:09.681 INFO:teuthology.orchestra.run.smithi172.stdout:(131/156): python3-natsort-7.1.1-5.el9.noarch.r 2.3 MB/s | 58 kB 00:00 2024-09-12T02:24:09.732 INFO:teuthology.orchestra.run.smithi172.stdout:(132/156): python3-kubernetes-26.1.0-2.el9.noar 6.1 MB/s | 1.0 MB 00:00 2024-09-12T02:24:09.757 INFO:teuthology.orchestra.run.smithi172.stdout:(133/156): python3-pecan-1.4.2-3.el9.noarch.rpm 3.5 MB/s | 272 kB 00:00 2024-09-12T02:24:09.782 INFO:teuthology.orchestra.run.smithi172.stdout:(134/156): python3-portend-3.1.0-2.el9.noarch.r 327 kB/s | 16 kB 00:00 2024-09-12T02:24:09.807 INFO:teuthology.orchestra.run.smithi172.stdout:(135/156): python3-pyOpenSSL-21.0.0-1.el9.noarc 1.8 MB/s | 90 kB 00:00 2024-09-12T02:24:09.832 INFO:teuthology.orchestra.run.smithi172.stdout:(136/156): python3-pyperclip-1.8.2-2.el9.noarch 563 kB/s | 28 kB 00:00 2024-09-12T02:24:09.858 INFO:teuthology.orchestra.run.smithi172.stdout:(137/156): python3-repoze-lru-0.7-16.el9.noarch 614 kB/s | 31 kB 00:00 2024-09-12T02:24:09.908 INFO:teuthology.orchestra.run.smithi172.stdout:(138/156): python3-grpcio-1.46.7-10.el9.x86_64. 3.9 MB/s | 2.0 MB 00:00 2024-09-12T02:24:09.933 INFO:teuthology.orchestra.run.smithi172.stdout:(139/156): python3-rsa-4.9-2.el9.noarch.rpm 788 kB/s | 59 kB 00:00 2024-09-12T02:24:09.958 INFO:teuthology.orchestra.run.smithi172.stdout:(140/156): python3-tempora-5.0.0-2.el9.noarch.r 713 kB/s | 36 kB 00:00 2024-09-12T02:24:09.984 INFO:teuthology.orchestra.run.smithi172.stdout:(141/156): python3-routes-2.5.1-5.el9.noarch.rp 1.2 MB/s | 188 kB 00:00 2024-09-12T02:24:10.009 INFO:teuthology.orchestra.run.smithi172.stdout:(142/156): python3-typing-extensions-4.12.2-2.e 986 kB/s | 74 kB 00:00 2024-09-12T02:24:10.035 INFO:teuthology.orchestra.run.smithi172.stdout:(143/156): python3-websocket-client-1.2.3-2.el9 1.7 MB/s | 90 kB 00:00 2024-09-12T02:24:10.060 INFO:teuthology.orchestra.run.smithi172.stdout:(144/156): python3-webob-1.8.8-2.el9.noarch.rpm 2.2 MB/s | 230 kB 00:00 2024-09-12T02:24:10.085 INFO:teuthology.orchestra.run.smithi172.stdout:(145/156): python3-zc-lockfile-2.0-10.el9.noarc 399 kB/s | 20 kB 00:00 2024-09-12T02:24:10.110 INFO:teuthology.orchestra.run.smithi172.stdout:(146/156): re2-20211101-20.el9.x86_64.rpm 3.7 MB/s | 191 kB 00:00 2024-09-12T02:24:10.136 INFO:teuthology.orchestra.run.smithi172.stdout:(147/156): python3-werkzeug-2.0.3-3.el9.1.noarc 3.3 MB/s | 427 kB 00:00 2024-09-12T02:24:10.186 INFO:teuthology.orchestra.run.smithi172.stdout:(148/156): thrift-0.15.0-2.el9.x86_64.rpm 16 MB/s | 1.6 MB 00:00 2024-09-12T02:24:10.912 INFO:teuthology.orchestra.run.smithi044.stdout:(8/156): ceph-radosgw-19.1.1-298.gb53b6d3e.el9. 1.9 MB/s | 11 MB 00:05 2024-09-12T02:24:11.171 INFO:teuthology.orchestra.run.smithi044.stdout:(9/156): ceph-common-19.1.1-298.gb53b6d3e.el9.x 2.3 MB/s | 21 MB 00:09 2024-09-12T02:24:11.196 INFO:teuthology.orchestra.run.smithi044.stdout:(10/156): ceph-selinux-19.1.1-298.gb53b6d3e.el9 89 kB/s | 25 kB 00:00 2024-09-12T02:24:11.211 INFO:teuthology.orchestra.run.smithi172.stdout:(149/156): NetworkManager-1.49.90-1.el9.x86_64. 2.3 MB/s | 2.3 MB 00:01 2024-09-12T02:24:11.270 INFO:teuthology.orchestra.run.smithi172.stdout:(150/156): librbd1-19.1.1-298.gb53b6d3e.el9.x86 2.8 MB/s | 3.2 MB 00:01 2024-09-12T02:24:11.363 INFO:teuthology.orchestra.run.smithi044.stdout:(11/156): cephfs-mirror-19.1.1-298.gb53b6d3e.el 1.3 MB/s | 228 kB 00:00 2024-09-12T02:24:11.438 INFO:teuthology.orchestra.run.smithi044.stdout:(12/156): cephfs-shell-19.1.1-298.gb53b6d3e.el9 360 kB/s | 27 kB 00:00 2024-09-12T02:24:11.445 INFO:teuthology.orchestra.run.smithi172.stdout:(151/156): NetworkManager-libnm-1.49.90-1.el9.x 7.7 MB/s | 1.8 MB 00:00 2024-09-12T02:24:11.462 INFO:teuthology.orchestra.run.smithi172.stdout:(152/156): NetworkManager-team-1.49.90-1.el9.x8 212 kB/s | 41 kB 00:00 2024-09-12T02:24:11.505 INFO:teuthology.orchestra.run.smithi044.stdout:(13/156): libcephfs-devel-19.1.1-298.gb53b6d3e. 476 kB/s | 32 kB 00:00 2024-09-12T02:24:11.512 INFO:teuthology.orchestra.run.smithi172.stdout:(153/156): librados2-19.1.1-298.gb53b6d3e.el9.x 2.4 MB/s | 3.4 MB 00:01 2024-09-12T02:24:11.571 INFO:teuthology.orchestra.run.smithi172.stdout:(154/156): NetworkManager-tui-1.49.90-1.el9.x86 1.9 MB/s | 249 kB 00:00 2024-09-12T02:24:11.838 INFO:teuthology.orchestra.run.smithi044.stdout:(14/156): libcephfs2-19.1.1-298.gb53b6d3e.el9.x 2.2 MB/s | 752 kB 00:00 2024-09-12T02:24:11.980 INFO:teuthology.orchestra.run.smithi044.stdout:(15/156): libcephsqlite-19.1.1-298.gb53b6d3e.el 1.1 MB/s | 163 kB 00:00 2024-09-12T02:24:12.029 INFO:teuthology.orchestra.run.smithi172.stdout:(155/156): openssl-3.2.2-6.el9.x86_64.rpm 2.4 MB/s | 1.4 MB 00:00 2024-09-12T02:24:12.064 INFO:teuthology.orchestra.run.smithi044.stdout:(16/156): librados-devel-19.1.1-298.gb53b6d3e.e 1.5 MB/s | 127 kB 00:00 2024-09-12T02:24:12.231 INFO:teuthology.orchestra.run.smithi044.stdout:(17/156): ceph-osd-19.1.1-298.gb53b6d3e.el9.x86 2.2 MB/s | 17 MB 00:07 2024-09-12T02:24:12.389 INFO:teuthology.orchestra.run.smithi044.stdout:(18/156): libradosstriper1-19.1.1-298.gb53b6d3e 1.5 MB/s | 506 kB 00:00 2024-09-12T02:24:12.465 INFO:teuthology.orchestra.run.smithi044.stdout:(19/156): python3-ceph-argparse-19.1.1-298.gb53 602 kB/s | 45 kB 00:00 2024-09-12T02:24:12.615 INFO:teuthology.orchestra.run.smithi044.stdout:(20/156): python3-ceph-common-19.1.1-298.gb53b6 904 kB/s | 136 kB 00:00 2024-09-12T02:24:12.621 INFO:teuthology.orchestra.run.smithi172.stdout:(156/156): openssl-libs-3.2.2-6.el9.x86_64.rpm 2.2 MB/s | 2.4 MB 00:01 2024-09-12T02:24:12.627 INFO:teuthology.orchestra.run.smithi172.stdout:-------------------------------------------------------------------------------- 2024-09-12T02:24:12.628 INFO:teuthology.orchestra.run.smithi172.stdout:Total 19 MB/s | 226 MB 00:11 2024-09-12T02:24:12.800 INFO:teuthology.orchestra.run.smithi044.stdout:(21/156): python3-cephfs-19.1.1-298.gb53b6d3e.e 884 kB/s | 162 kB 00:00 2024-09-12T02:24:13.049 INFO:teuthology.orchestra.run.smithi044.stdout:(22/156): python3-rados-19.1.1-298.gb53b6d3e.el 1.3 MB/s | 321 kB 00:00 2024-09-12T02:24:13.449 INFO:teuthology.orchestra.run.smithi044.stdout:(23/156): python3-rbd-19.1.1-298.gb53b6d3e.el9. 753 kB/s | 301 kB 00:00 2024-09-12T02:24:13.575 INFO:teuthology.orchestra.run.smithi044.stdout:(24/156): python3-rgw-19.1.1-298.gb53b6d3e.el9. 797 kB/s | 100 kB 00:00 2024-09-12T02:24:13.733 INFO:teuthology.orchestra.run.smithi044.stdout:(25/156): rbd-fuse-19.1.1-298.gb53b6d3e.el9.x86 538 kB/s | 85 kB 00:00 2024-09-12T02:24:13.871 INFO:teuthology.orchestra.run.smithi172.stdout:Running transaction check 2024-09-12T02:24:14.023 INFO:teuthology.orchestra.run.smithi172.stdout:Transaction check succeeded. 2024-09-12T02:24:14.023 INFO:teuthology.orchestra.run.smithi172.stdout:Running transaction test 2024-09-12T02:24:14.122 INFO:teuthology.orchestra.run.smithi039.stdout:(81/156): postgresql-server-13.16-1.el9.x86_64. 702 kB/s | 5.8 MB 00:08 2024-09-12T02:24:14.432 INFO:teuthology.orchestra.run.smithi039.stdout:(82/156): python3-numpy-1.20.1-5.el9.x86_64.rpm 1.0 MB/s | 5.1 MB 00:04 2024-09-12T02:24:14.540 INFO:teuthology.orchestra.run.smithi039.stdout:(83/156): python3-numpy-f2py-1.20.1-5.el9.x86_6 599 kB/s | 250 kB 00:00 2024-09-12T02:24:14.565 INFO:teuthology.orchestra.run.smithi039.stdout:(84/156): python3-oauthlib-3.1.1-5.el9.noarch.r 1.6 MB/s | 222 kB 00:00 2024-09-12T02:24:14.683 INFO:teuthology.orchestra.run.smithi039.stdout:(85/156): python3-prettytable-0.7.2-27.el9.noar 362 kB/s | 42 kB 00:00 2024-09-12T02:24:14.741 INFO:teuthology.orchestra.run.smithi039.stdout:(86/156): python3-packaging-20.9-5.el9.noarch.r 386 kB/s | 77 kB 00:00 2024-09-12T02:24:14.800 INFO:teuthology.orchestra.run.smithi039.stdout:(87/156): python3-protobuf-3.14.0-13.el9.noarch 2.3 MB/s | 269 kB 00:00 2024-09-12T02:24:14.918 INFO:teuthology.orchestra.run.smithi039.stdout:(88/156): python3-pyasn1-modules-0.4.8-6.el9.no 2.3 MB/s | 279 kB 00:00 2024-09-12T02:24:15.025 INFO:teuthology.orchestra.run.smithi039.stdout:(89/156): python3-pyasn1-0.4.8-6.el9.noarch.rpm 559 kB/s | 159 kB 00:00 2024-09-12T02:24:15.033 INFO:teuthology.orchestra.run.smithi044.stdout:(26/156): librgw2-19.1.1-298.gb53b6d3e.el9.x86_ 1.9 MB/s | 5.3 MB 00:02 2024-09-12T02:24:15.051 INFO:teuthology.orchestra.run.smithi039.stdout:(90/156): python3-pytz-2021.1-5.el9.noarch.rpm 383 kB/s | 51 kB 00:00 2024-09-12T02:24:15.134 INFO:teuthology.orchestra.run.smithi039.stdout:(91/156): python3-requests-oauthlib-1.3.0-12.el 495 kB/s | 54 kB 00:00 2024-09-12T02:24:15.192 INFO:teuthology.orchestra.run.smithi044.stdout:(27/156): rbd-nbd-19.1.1-298.gb53b6d3e.el9.x86_ 1.1 MB/s | 171 kB 00:00 2024-09-12T02:24:15.251 INFO:teuthology.orchestra.run.smithi039.stdout:(92/156): python3-toml-0.10.2-6.el9.noarch.rpm 357 kB/s | 42 kB 00:00 2024-09-12T02:24:15.284 INFO:teuthology.orchestra.run.smithi044.stdout:(28/156): ceph-grafana-dashboards-19.1.1-298.gb 348 kB/s | 32 kB 00:00 2024-09-12T02:24:15.368 INFO:teuthology.orchestra.run.smithi039.stdout:(93/156): python3-wcwidth-0.2.5-8.el9.noarch.rp 379 kB/s | 44 kB 00:00 2024-09-12T02:24:15.451 INFO:teuthology.orchestra.run.smithi044.stdout:(29/156): ceph-mgr-cephadm-19.1.1-298.gb53b6d3e 878 kB/s | 146 kB 00:00 2024-09-12T02:24:15.718 INFO:teuthology.orchestra.run.smithi039.stdout:(94/156): python3-scipy-1.6.2-8.el9.x86_64.rpm 24 MB/s | 16 MB 00:00 2024-09-12T02:24:15.777 INFO:teuthology.orchestra.run.smithi039.stdout:(95/156): qatlib-24.02.0-1.el9.x86_64.rpm 540 kB/s | 221 kB 00:00 2024-09-12T02:24:15.827 INFO:teuthology.orchestra.run.smithi039.stdout:(96/156): qatlib-service-24.02.0-1.el9.x86_64.r 331 kB/s | 36 kB 00:00 2024-09-12T02:24:15.868 INFO:teuthology.orchestra.run.smithi044.stdout:(30/156): rbd-mirror-19.1.1-298.gb53b6d3e.el9.x 1.5 MB/s | 3.1 MB 00:02 2024-09-12T02:24:15.886 INFO:teuthology.orchestra.run.smithi039.stdout:(97/156): qatzip-libs-1.2.0-1.el9.x86_64.rpm 437 kB/s | 47 kB 00:00 2024-09-12T02:24:15.924 INFO:teuthology.orchestra.run.smithi172.stdout:Transaction test succeeded. 2024-09-12T02:24:15.925 INFO:teuthology.orchestra.run.smithi172.stdout:Running transaction 2024-09-12T02:24:15.945 INFO:teuthology.orchestra.run.smithi039.stdout:(98/156): socat-1.7.4.1-6.el9.x86_64.rpm 2.5 MB/s | 304 kB 00:00 2024-09-12T02:24:16.004 INFO:teuthology.orchestra.run.smithi039.stdout:(99/156): uuid-1.6.2-55.el9.x86_64.rpm 492 kB/s | 58 kB 00:00 2024-09-12T02:24:16.054 INFO:teuthology.orchestra.run.smithi039.stdout:(100/156): xfsprogs-devel-6.4.0-4.el9.x86_64.rp 877 kB/s | 96 kB 00:00 2024-09-12T02:24:16.171 INFO:teuthology.orchestra.run.smithi039.stdout:(101/156): zlib-devel-1.2.11-41.el9.x86_64.rpm 384 kB/s | 45 kB 00:00 2024-09-12T02:24:16.205 INFO:teuthology.orchestra.run.smithi039.stdout:(102/156): xmlstarlet-1.6.1-20.el9.x86_64.rpm 317 kB/s | 64 kB 00:00 2024-09-12T02:24:16.388 INFO:teuthology.orchestra.run.smithi039.stdout:(103/156): python3-babel-2.9.1-2.el9.noarch.rpm 692 kB/s | 6.0 MB 00:08 2024-09-12T02:24:16.489 INFO:teuthology.orchestra.run.smithi039.stdout:(104/156): abseil-cpp-20211102.0-3.el9.x86_64.r 6.1 MB/s | 548 kB 00:00 2024-09-12T02:24:16.531 INFO:teuthology.orchestra.run.smithi039.stdout:(105/156): gperftools-libs-2.9.1-2.el9.x86_64.r 10 MB/s | 309 kB 00:00 2024-09-12T02:24:16.548 INFO:teuthology.orchestra.run.smithi039.stdout:(106/156): grpc-data-1.46.7-10.el9.noarch.rpm 1.2 MB/s | 19 kB 00:00 2024-09-12T02:24:16.681 INFO:teuthology.orchestra.run.smithi039.stdout:(107/156): libarrow-9.0.0-11.el9.x86_64.rpm 33 MB/s | 4.4 MB 00:00 2024-09-12T02:24:16.706 INFO:teuthology.orchestra.run.smithi039.stdout:(108/156): libarrow-doc-9.0.0-11.el9.noarch.rpm 1.0 MB/s | 26 kB 00:00 2024-09-12T02:24:16.723 INFO:teuthology.orchestra.run.smithi039.stdout:(109/156): lua-devel-5.4.4-4.el9.x86_64.rpm 40 kB/s | 22 kB 00:00 2024-09-12T02:24:16.740 INFO:teuthology.orchestra.run.smithi039.stdout:(110/156): liboath-2.6.7-2.el9.x86_64.rpm 1.5 MB/s | 49 kB 00:00 2024-09-12T02:24:16.774 INFO:teuthology.orchestra.run.smithi039.stdout:(111/156): luarocks-3.9.2-5.el9.noarch.rpm 6.7 MB/s | 151 kB 00:00 2024-09-12T02:24:16.808 INFO:teuthology.orchestra.run.smithi039.stdout:(112/156): libunwind-1.6.2-1.el9.x86_64.rpm 803 kB/s | 67 kB 00:00 2024-09-12T02:24:16.841 INFO:teuthology.orchestra.run.smithi039.stdout:(113/156): parquet-libs-9.0.0-11.el9.x86_64.rpm 13 MB/s | 839 kB 00:00 2024-09-12T02:24:16.875 INFO:teuthology.orchestra.run.smithi039.stdout:(114/156): python3-asyncssh-2.13.2-5.el9.noarch 8.0 MB/s | 548 kB 00:00 2024-09-12T02:24:16.900 INFO:teuthology.orchestra.run.smithi039.stdout:(115/156): python3-bcrypt-3.2.2-1.el9.x86_64.rp 745 kB/s | 43 kB 00:00 2024-09-12T02:24:17.093 INFO:teuthology.orchestra.run.smithi044.stdout:(31/156): ceph-mgr-dashboard-19.1.1-298.gb53b6d 2.2 MB/s | 3.6 MB 00:01 2024-09-12T02:24:17.126 INFO:teuthology.orchestra.run.smithi039.stdout:(116/156): python3-certifi-2023.05.07-4.el9.noa 62 kB/s | 14 kB 00:00 2024-09-12T02:24:17.151 INFO:teuthology.orchestra.run.smithi039.stdout:(117/156): python3-cachetools-4.2.4-1.el9.noarc 128 kB/s | 32 kB 00:00 2024-09-12T02:24:17.184 INFO:teuthology.orchestra.run.smithi039.stdout:(118/156): python3-cheroot-8.6.0-4.el9.noarch.r 2.9 MB/s | 172 kB 00:00 2024-09-12T02:24:17.218 INFO:teuthology.orchestra.run.smithi039.stdout:(119/156): python3-cherrypy-18.6.1-2.el9.noarch 5.2 MB/s | 358 kB 00:00 2024-09-12T02:24:17.243 INFO:teuthology.orchestra.run.smithi044.stdout:(32/156): ceph-mgr-modules-core-19.1.1-298.gb53 1.6 MB/s | 249 kB 00:00 2024-09-12T02:24:17.260 INFO:teuthology.orchestra.run.smithi039.stdout:(120/156): python3-cmd2-2.4.2-2.el9.noarch.rpm 4.0 MB/s | 303 kB 00:00 2024-09-12T02:24:17.285 INFO:teuthology.orchestra.run.smithi039.stdout:(121/156): python3-google-auth-2.34.0-1.el9.noa 3.2 MB/s | 220 kB 00:00 2024-09-12T02:24:17.319 INFO:teuthology.orchestra.run.smithi039.stdout:(122/156): python3-grpcio-tools-1.46.7-10.el9.x 4.2 MB/s | 144 kB 00:00 2024-09-12T02:24:17.327 INFO:teuthology.orchestra.run.smithi044.stdout:(33/156): ceph-mgr-rook-19.1.1-298.gb53b6d3e.el 593 kB/s | 49 kB 00:00 2024-09-12T02:24:17.344 INFO:teuthology.orchestra.run.smithi039.stdout:(123/156): python3-jaraco-8.2.1-3.el9.noarch.rp 434 kB/s | 11 kB 00:00 2024-09-12T02:24:17.394 INFO:teuthology.orchestra.run.smithi044.stdout:(34/156): ceph-prometheus-alerts-19.1.1-298.gb5 247 kB/s | 16 kB 00:00 2024-09-12T02:24:17.402 INFO:teuthology.orchestra.run.smithi039.stdout:(124/156): protobuf-compiler-3.14.0-13.el9.x86_ 721 kB/s | 863 kB 00:01 2024-09-12T02:24:17.428 INFO:teuthology.orchestra.run.smithi039.stdout:(125/156): python3-jaraco-classes-3.2.1-5.el9.n 212 kB/s | 18 kB 00:00 2024-09-12T02:24:17.462 INFO:teuthology.orchestra.run.smithi039.stdout:(126/156): python3-jaraco-functools-3.5.0-2.el9 899 kB/s | 19 kB 00:00 2024-09-12T02:24:17.487 INFO:teuthology.orchestra.run.smithi039.stdout:(127/156): python3-jaraco-text-3.2.0-6.el9.noar 867 kB/s | 20 kB 00:00 2024-09-12T02:24:17.502 INFO:teuthology.orchestra.run.smithi044.stdout:(35/156): ceph-volume-19.1.1-298.gb53b6d3e.el9. 2.6 MB/s | 285 kB 00:00 2024-09-12T02:24:17.512 INFO:teuthology.orchestra.run.smithi039.stdout:(128/156): python3-jaraco-collections-3.0.0-8.e 213 kB/s | 23 kB 00:00 2024-09-12T02:24:17.546 INFO:teuthology.orchestra.run.smithi039.stdout:(129/156): python3-logutils-0.3.5-21.el9.noarch 1.4 MB/s | 46 kB 00:00 2024-09-12T02:24:17.571 INFO:teuthology.orchestra.run.smithi039.stdout:(130/156): python3-more-itertools-8.12.0-2.el9. 3.1 MB/s | 79 kB 00:00 2024-09-12T02:24:17.596 INFO:teuthology.orchestra.run.smithi039.stdout:(131/156): python3-natsort-7.1.1-5.el9.noarch.r 2.3 MB/s | 58 kB 00:00 2024-09-12T02:24:17.630 INFO:teuthology.orchestra.run.smithi039.stdout:(132/156): python3-pecan-1.4.2-3.el9.noarch.rpm 8.0 MB/s | 272 kB 00:00 2024-09-12T02:24:17.672 INFO:teuthology.orchestra.run.smithi039.stdout:(133/156): python3-kubernetes-26.1.0-2.el9.noar 5.5 MB/s | 1.0 MB 00:00 2024-09-12T02:24:17.706 INFO:teuthology.orchestra.run.smithi039.stdout:(134/156): python3-portend-3.1.0-2.el9.noarch.r 218 kB/s | 16 kB 00:00 2024-09-12T02:24:17.731 INFO:teuthology.orchestra.run.smithi039.stdout:(135/156): python3-pyOpenSSL-21.0.0-1.el9.noarc 1.5 MB/s | 90 kB 00:00 2024-09-12T02:24:17.756 INFO:teuthology.orchestra.run.smithi039.stdout:(136/156): python3-pyperclip-1.8.2-2.el9.noarch 564 kB/s | 28 kB 00:00 2024-09-12T02:24:17.761 INFO:teuthology.orchestra.run.smithi044.stdout:(36/156): cephadm-19.1.1-298.gb53b6d3e.el9.noar 2.9 MB/s | 765 kB 00:00 2024-09-12T02:24:17.798 INFO:teuthology.orchestra.run.smithi039.stdout:(137/156): python3-grpcio-1.46.7-10.el9.x86_64. 3.8 MB/s | 2.0 MB 00:00 2024-09-12T02:24:17.820 INFO:teuthology.orchestra.run.smithi044.stdout:(37/156): cephfs-top-19.1.1-298.gb53b6d3e.el9.n 313 kB/s | 18 kB 00:00 2024-09-12T02:24:17.823 INFO:teuthology.orchestra.run.smithi039.stdout:(138/156): python3-repoze-lru-0.7-16.el9.noarch 335 kB/s | 31 kB 00:00 2024-09-12T02:24:17.849 INFO:teuthology.orchestra.run.smithi039.stdout:(139/156): python3-rsa-4.9-2.el9.noarch.rpm 1.2 MB/s | 59 kB 00:00 2024-09-12T02:24:17.874 INFO:teuthology.orchestra.run.smithi039.stdout:(140/156): python3-tempora-5.0.0-2.el9.noarch.r 714 kB/s | 36 kB 00:00 2024-09-12T02:24:17.899 INFO:teuthology.orchestra.run.smithi039.stdout:(141/156): python3-typing-extensions-4.12.2-2.e 1.5 MB/s | 74 kB 00:00 2024-09-12T02:24:17.925 INFO:teuthology.orchestra.run.smithi039.stdout:(142/156): python3-routes-2.5.1-5.el9.noarch.rp 1.1 MB/s | 188 kB 00:00 2024-09-12T02:24:17.950 INFO:teuthology.orchestra.run.smithi039.stdout:(143/156): python3-websocket-client-1.2.3-2.el9 1.8 MB/s | 90 kB 00:00 2024-09-12T02:24:17.961 INFO:teuthology.orchestra.run.smithi044.stdout:(38/156): fuse-2.9.9-16.el9.x86_64.rpm 564 kB/s | 80 kB 00:00 2024-09-12T02:24:17.983 INFO:teuthology.orchestra.run.smithi039.stdout:(144/156): python3-webob-1.8.8-2.el9.noarch.rpm 2.1 MB/s | 230 kB 00:00 2024-09-12T02:24:18.009 INFO:teuthology.orchestra.run.smithi039.stdout:(145/156): python3-zc-lockfile-2.0-10.el9.noarc 342 kB/s | 20 kB 00:00 2024-09-12T02:24:18.042 INFO:teuthology.orchestra.run.smithi039.stdout:(146/156): re2-20211101-20.el9.x86_64.rpm 3.2 MB/s | 191 kB 00:00 2024-09-12T02:24:18.067 INFO:teuthology.orchestra.run.smithi039.stdout:(147/156): python3-werkzeug-2.0.3-3.el9.1.noarc 2.9 MB/s | 427 kB 00:00 2024-09-12T02:24:18.126 INFO:teuthology.orchestra.run.smithi039.stdout:(148/156): thrift-0.15.0-2.el9.x86_64.rpm 14 MB/s | 1.6 MB 00:00 2024-09-12T02:24:18.179 INFO:teuthology.orchestra.run.smithi044.stdout:(39/156): libgfortran-11.5.0-2.el9.x86_64.rpm 3.6 MB/s | 801 kB 00:00 2024-09-12T02:24:18.237 INFO:teuthology.orchestra.run.smithi044.stdout:(40/156): libquadmath-11.5.0-2.el9.x86_64.rpm 3.2 MB/s | 191 kB 00:00 2024-09-12T02:24:18.305 INFO:teuthology.orchestra.run.smithi044.stdout:(41/156): python3-cffi-1.14.5-5.el9.x86_64.rpm 3.7 MB/s | 253 kB 00:00 2024-09-12T02:24:18.463 INFO:teuthology.orchestra.run.smithi044.stdout:(42/156): python3-cryptography-36.0.1-4.el9.x86 7.8 MB/s | 1.2 MB 00:00 2024-09-12T02:24:18.539 INFO:teuthology.orchestra.run.smithi044.stdout:(43/156): python3-ply-3.11-14.el9.noarch.rpm 1.4 MB/s | 106 kB 00:00 2024-09-12T02:24:18.560 INFO:teuthology.orchestra.run.smithi039.stdout:(149/156): librados2-19.1.1-298.gb53b6d3e.el9.x 6.6 MB/s | 3.4 MB 00:00 2024-09-12T02:24:18.597 INFO:teuthology.orchestra.run.smithi044.stdout:(44/156): python3-pycparser-2.20-6.el9.noarch.r 2.3 MB/s | 135 kB 00:00 2024-09-12T02:24:18.648 INFO:teuthology.orchestra.run.smithi044.stdout:(45/156): python3-requests-2.25.1-8.el9.noarch. 2.4 MB/s | 125 kB 00:00 2024-09-12T02:24:18.706 INFO:teuthology.orchestra.run.smithi044.stdout:(46/156): python3-urllib3-1.26.5-6.el9.noarch.r 3.6 MB/s | 215 kB 00:00 2024-09-12T02:24:18.882 INFO:teuthology.orchestra.run.smithi044.stdout:(47/156): automake-1.16.2-8.el9.noarch.rpm 3.8 MB/s | 689 kB 00:00 2024-09-12T02:24:19.007 INFO:teuthology.orchestra.run.smithi044.stdout:(48/156): bison-3.7.4-5.el9.x86_64.rpm 7.4 MB/s | 943 kB 00:00 2024-09-12T02:24:19.082 INFO:teuthology.orchestra.run.smithi044.stdout:(49/156): boost-program-options-1.75.0-8.el9.x8 1.4 MB/s | 107 kB 00:00 2024-09-12T02:24:19.166 INFO:teuthology.orchestra.run.smithi044.stdout:(50/156): ceph-mgr-diskprediction-local-19.1.1- 2.2 MB/s | 7.4 MB 00:03 2024-09-12T02:24:19.185 INFO:teuthology.orchestra.run.smithi039.stdout:(150/156): NetworkManager-1.49.90-1.el9.x86_64. 2.2 MB/s | 2.3 MB 00:01 2024-09-12T02:24:19.191 INFO:teuthology.orchestra.run.smithi044.stdout:(51/156): elfutils-libelf-devel-0.191-4.el9.x86 200 kB/s | 22 kB 00:00 2024-09-12T02:24:19.252 INFO:teuthology.orchestra.run.smithi039.stdout:(151/156): librbd1-19.1.1-298.gb53b6d3e.el9.x86 2.7 MB/s | 3.2 MB 00:01 2024-09-12T02:24:19.266 INFO:teuthology.orchestra.run.smithi044.stdout:(52/156): flexiblas-3.0.4-8.el9.x86_64.rpm 436 kB/s | 33 kB 00:00 2024-09-12T02:24:19.334 INFO:teuthology.orchestra.run.smithi044.stdout:(53/156): flex-2.6.4-9.el9.x86_64.rpm 1.8 MB/s | 313 kB 00:00 2024-09-12T02:24:19.409 INFO:teuthology.orchestra.run.smithi044.stdout:(54/156): flexiblas-netlib-3.0.4-8.el9.x86_64.r 21 MB/s | 3.0 MB 00:00 2024-09-12T02:24:19.443 INFO:teuthology.orchestra.run.smithi044.stdout:(55/156): flexiblas-openblas-openmp-3.0.4-8.el9 167 kB/s | 18 kB 00:00 2024-09-12T02:24:19.476 INFO:teuthology.orchestra.run.smithi044.stdout:(56/156): libaio-devel-0.3.111-13.el9.x86_64.rp 166 kB/s | 11 kB 00:00 2024-09-12T02:24:19.518 INFO:teuthology.orchestra.run.smithi044.stdout:(57/156): libpmemobj-1.12.1-1.el9.x86_64.rpm 2.1 MB/s | 160 kB 00:00 2024-09-12T02:24:19.552 INFO:teuthology.orchestra.run.smithi044.stdout:(58/156): librabbitmq-0.11.0-7.el9.x86_64.rpm 601 kB/s | 45 kB 00:00 2024-09-12T02:24:19.585 INFO:teuthology.orchestra.run.smithi039.stdout:(152/156): NetworkManager-libnm-1.49.90-1.el9.x 1.8 MB/s | 1.8 MB 00:01 2024-09-12T02:24:19.635 INFO:teuthology.orchestra.run.smithi044.stdout:(59/156): librdkafka-1.6.1-102.el9.x86_64.rpm 5.5 MB/s | 662 kB 00:00 2024-09-12T02:24:19.677 INFO:teuthology.orchestra.run.smithi044.stdout:(60/156): libtool-2.4.6-46.el9.x86_64.rpm 4.5 MB/s | 581 kB 00:00 2024-09-12T02:24:19.703 INFO:teuthology.orchestra.run.smithi044.stdout:(61/156): libuuid-devel-2.37.4-20.el9.x86_64.rp 366 kB/s | 24 kB 00:00 2024-09-12T02:24:19.761 INFO:teuthology.orchestra.run.smithi044.stdout:(62/156): libzstd-devel-1.5.1-2.el9.x86_64.rpm 567 kB/s | 47 kB 00:00 2024-09-12T02:24:19.786 INFO:teuthology.orchestra.run.smithi044.stdout:(63/156): lttng-ust-2.12.0-6.el9.x86_64.rpm 3.4 MB/s | 292 kB 00:00 2024-09-12T02:24:19.794 INFO:teuthology.orchestra.run.smithi039.stdout:(153/156): NetworkManager-team-1.49.90-1.el9.x8 67 kB/s | 41 kB 00:00 2024-09-12T02:24:19.837 INFO:teuthology.orchestra.run.smithi044.stdout:(64/156): lua-5.4.4-4.el9.x86_64.rpm 2.5 MB/s | 188 kB 00:00 2024-09-12T02:24:19.862 INFO:teuthology.orchestra.run.smithi044.stdout:(65/156): openblas-0.3.26-2.el9.x86_64.rpm 512 kB/s | 38 kB 00:00 2024-09-12T02:24:20.029 INFO:teuthology.orchestra.run.smithi044.stdout:(66/156): openblas-openmp-0.3.26-2.el9.x86_64.r 26 MB/s | 4.9 MB 00:00 2024-09-12T02:24:20.036 INFO:teuthology.orchestra.run.smithi039.stdout:(154/156): NetworkManager-tui-1.49.90-1.el9.x86 317 kB/s | 249 kB 00:00 2024-09-12T02:24:20.171 INFO:teuthology.orchestra.run.smithi044.stdout:(67/156): openssl-devel-3.2.2-6.el9.x86_64.rpm 14 MB/s | 4.4 MB 00:00 2024-09-12T02:24:20.246 INFO:teuthology.orchestra.run.smithi044.stdout:(68/156): postgresql-13.16-1.el9.x86_64.rpm 7.3 MB/s | 1.6 MB 00:00 2024-09-12T02:24:20.280 INFO:teuthology.orchestra.run.smithi044.stdout:(69/156): postgresql-contrib-13.16-1.el9.x86_64 8.2 MB/s | 910 kB 00:00 2024-09-12T02:24:20.330 INFO:teuthology.orchestra.run.smithi044.stdout:(70/156): postgresql-private-libs-13.16-1.el9.x 1.6 MB/s | 137 kB 00:00 2024-09-12T02:24:20.414 INFO:teuthology.orchestra.run.smithi044.stdout:(71/156): protobuf-3.14.0-13.el9.x86_64.rpm 12 MB/s | 1.0 MB 00:00 2024-09-12T02:24:20.514 INFO:teuthology.orchestra.run.smithi044.stdout:(72/156): postgresql-server-13.16-1.el9.x86_64. 25 MB/s | 5.8 MB 00:00 2024-09-12T02:24:20.528 INFO:teuthology.orchestra.run.smithi039.stdout:(155/156): openssl-3.2.2-6.el9.x86_64.rpm 1.4 MB/s | 1.4 MB 00:00 2024-09-12T02:24:20.531 INFO:teuthology.orchestra.run.smithi044.stdout:(73/156): python3-attrs-20.3.0-7.el9.noarch.rpm 748 kB/s | 87 kB 00:00 2024-09-12T02:24:20.598 INFO:teuthology.orchestra.run.smithi044.stdout:(74/156): python3-colorama-0.4.6-3.el9.noarch.r 921 kB/s | 61 kB 00:00 2024-09-12T02:24:20.673 INFO:teuthology.orchestra.run.smithi044.stdout:(75/156): python3-devel-3.9.19-8.el9.x86_64.rpm 3.2 MB/s | 245 kB 00:00 2024-09-12T02:24:20.748 INFO:teuthology.orchestra.run.smithi044.stdout:(76/156): python3-babel-2.9.1-2.el9.noarch.rpm 26 MB/s | 6.0 MB 00:00 2024-09-12T02:24:20.774 INFO:teuthology.orchestra.run.smithi044.stdout:(77/156): python3-jinja2-2.11.3-6.el9.noarch.rp 2.4 MB/s | 248 kB 00:00 2024-09-12T02:24:20.791 INFO:teuthology.orchestra.run.smithi044.stdout:(78/156): python3-jsonpatch-1.21-16.el9.noarch. 614 kB/s | 26 kB 00:00 2024-09-12T02:24:20.832 INFO:teuthology.orchestra.run.smithi044.stdout:(79/156): python3-jsonpointer-2.0-4.el9.noarch. 328 kB/s | 19 kB 00:00 2024-09-12T02:24:20.853 INFO:teuthology.orchestra.run.smithi039.stdout:(156/156): openssl-libs-3.2.2-6.el9.x86_64.rpm 2.3 MB/s | 2.4 MB 00:01 2024-09-12T02:24:20.857 INFO:teuthology.orchestra.run.smithi044.stdout:(80/156): python3-mako-1.1.4-6.el9.noarch.rpm 2.5 MB/s | 172 kB 00:00 2024-09-12T02:24:20.859 INFO:teuthology.orchestra.run.smithi039.stdout:-------------------------------------------------------------------------------- 2024-09-12T02:24:20.860 INFO:teuthology.orchestra.run.smithi039.stdout:Total 9.6 MB/s | 226 MB 00:23 2024-09-12T02:24:20.900 INFO:teuthology.orchestra.run.smithi044.stdout:(81/156): python3-markupsafe-1.1.1-12.el9.x86_6 520 kB/s | 35 kB 00:00 2024-09-12T02:24:21.001 INFO:teuthology.orchestra.run.smithi044.stdout:(82/156): python3-numpy-f2py-1.20.1-5.el9.x86_6 2.4 MB/s | 250 kB 00:00 2024-09-12T02:24:21.075 INFO:teuthology.orchestra.run.smithi044.stdout:(83/156): python3-numpy-1.20.1-5.el9.x86_64.rpm 23 MB/s | 5.1 MB 00:00 2024-09-12T02:24:21.100 INFO:teuthology.orchestra.run.smithi044.stdout:(84/156): python3-oauthlib-3.1.1-5.el9.noarch.r 2.2 MB/s | 222 kB 00:00 2024-09-12T02:24:21.134 INFO:teuthology.orchestra.run.smithi044.stdout:(85/156): python3-packaging-20.9-5.el9.noarch.r 1.3 MB/s | 77 kB 00:00 2024-09-12T02:24:21.176 INFO:teuthology.orchestra.run.smithi044.stdout:(86/156): python3-prettytable-0.7.2-27.el9.noar 560 kB/s | 42 kB 00:00 2024-09-12T02:24:21.202 INFO:teuthology.orchestra.run.smithi044.stdout:(87/156): python3-protobuf-3.14.0-13.el9.noarch 3.9 MB/s | 269 kB 00:00 2024-09-12T02:24:21.252 INFO:teuthology.orchestra.run.smithi044.stdout:(88/156): python3-pyasn1-0.4.8-6.el9.noarch.rpm 2.1 MB/s | 159 kB 00:00 2024-09-12T02:24:21.277 INFO:teuthology.orchestra.run.smithi044.stdout:(89/156): python3-pyasn1-modules-0.4.8-6.el9.no 3.6 MB/s | 279 kB 00:00 2024-09-12T02:24:21.328 INFO:teuthology.orchestra.run.smithi044.stdout:(90/156): python3-pytz-2021.1-5.el9.noarch.rpm 677 kB/s | 51 kB 00:00 2024-09-12T02:24:21.353 INFO:teuthology.orchestra.run.smithi044.stdout:(91/156): python3-requests-oauthlib-1.3.0-12.el 712 kB/s | 54 kB 00:00 2024-09-12T02:24:21.411 INFO:teuthology.orchestra.run.smithi044.stdout:(92/156): python3-toml-0.10.2-6.el9.noarch.rpm 717 kB/s | 42 kB 00:00 2024-09-12T02:24:21.470 INFO:teuthology.orchestra.run.smithi044.stdout:(93/156): python3-wcwidth-0.2.5-8.el9.noarch.rp 756 kB/s | 44 kB 00:00 2024-09-12T02:24:21.537 INFO:teuthology.orchestra.run.smithi044.stdout:(94/156): qatlib-24.02.0-1.el9.x86_64.rpm 3.2 MB/s | 221 kB 00:00 2024-09-12T02:24:21.604 INFO:teuthology.orchestra.run.smithi044.stdout:(95/156): qatlib-service-24.02.0-1.el9.x86_64.r 540 kB/s | 36 kB 00:00 2024-09-12T02:24:21.787 INFO:teuthology.orchestra.run.smithi044.stdout:(96/156): python3-scipy-1.6.2-8.el9.x86_64.rpm 35 MB/s | 16 MB 00:00 2024-09-12T02:24:21.821 INFO:teuthology.orchestra.run.smithi044.stdout:(97/156): qatzip-libs-1.2.0-1.el9.x86_64.rpm 218 kB/s | 47 kB 00:00 2024-09-12T02:24:21.863 INFO:teuthology.orchestra.run.smithi044.stdout:(98/156): socat-1.7.4.1-6.el9.x86_64.rpm 4.0 MB/s | 304 kB 00:00 2024-09-12T02:24:21.888 INFO:teuthology.orchestra.run.smithi044.stdout:(99/156): uuid-1.6.2-55.el9.x86_64.rpm 863 kB/s | 58 kB 00:00 2024-09-12T02:24:22.362 INFO:teuthology.orchestra.run.smithi172.stdout: Preparing : 1/1 2024-09-12T02:24:22.483 INFO:teuthology.orchestra.run.smithi172.stdout: Upgrading : openssl-libs-1:3.2.2-6.el9.x86_64 1/164 2024-09-12T02:24:22.521 INFO:teuthology.orchestra.run.smithi172.stdout: Installing : librabbitmq-0.11.0-7.el9.x86_64 2/164 2024-09-12T02:24:22.574 INFO:teuthology.orchestra.run.smithi172.stdout: Installing : librdkafka-1.6.1-102.el9.x86_64 3/164 2024-09-12T02:24:22.580 INFO:teuthology.orchestra.run.smithi044.stdout:(100/156): ceph-test-19.1.1-298.gb53b6d3e.el9.x 4.3 MB/s | 49 MB 00:11 2024-09-12T02:24:22.605 INFO:teuthology.orchestra.run.smithi044.stdout:(101/156): xmlstarlet-1.6.1-20.el9.x86_64.rpm 89 kB/s | 64 kB 00:00 2024-09-12T02:24:22.608 INFO:teuthology.orchestra.run.smithi172.stdout: Installing : thrift-0.15.0-2.el9.x86_64 4/164 2024-09-12T02:24:22.631 INFO:teuthology.orchestra.run.smithi044.stdout:(102/156): xfsprogs-devel-6.4.0-4.el9.x86_64.rp 125 kB/s | 96 kB 00:00 2024-09-12T02:24:22.642 INFO:teuthology.orchestra.run.smithi172.stdout: Installing : python3-more-itertools-8.12.0-2.el9.noarch 5/164 2024-09-12T02:24:22.684 INFO:teuthology.orchestra.run.smithi172.stdout: Installing : python3-jaraco-8.2.1-3.el9.noarch 6/164 2024-09-12T02:24:22.715 INFO:teuthology.orchestra.run.smithi044.stdout:(103/156): zlib-devel-1.2.11-41.el9.x86_64.rpm 336 kB/s | 45 kB 00:00 2024-09-12T02:24:22.740 INFO:teuthology.orchestra.run.smithi044.stdout:(104/156): lua-devel-5.4.4-4.el9.x86_64.rpm 166 kB/s | 22 kB 00:00 2024-09-12T02:24:22.790 INFO:teuthology.orchestra.run.smithi044.stdout:(105/156): abseil-cpp-20211102.0-3.el9.x86_64.r 7.1 MB/s | 548 kB 00:00 2024-09-12T02:24:22.807 INFO:teuthology.orchestra.run.smithi044.stdout:(106/156): grpc-data-1.46.7-10.el9.noarch.rpm 1.3 MB/s | 19 kB 00:00 2024-09-12T02:24:22.841 INFO:teuthology.orchestra.run.smithi044.stdout:(107/156): gperftools-libs-2.9.1-2.el9.x86_64.r 3.1 MB/s | 309 kB 00:00 2024-09-12T02:24:22.866 INFO:teuthology.orchestra.run.smithi044.stdout:(108/156): libarrow-doc-9.0.0-11.el9.noarch.rpm 1.0 MB/s | 26 kB 00:00 2024-09-12T02:24:22.891 INFO:teuthology.orchestra.run.smithi044.stdout:(109/156): liboath-2.6.7-2.el9.x86_64.rpm 1.9 MB/s | 49 kB 00:00 2024-09-12T02:24:22.916 INFO:teuthology.orchestra.run.smithi044.stdout:(110/156): libunwind-1.6.2-1.el9.x86_64.rpm 2.6 MB/s | 67 kB 00:00 2024-09-12T02:24:22.941 INFO:teuthology.orchestra.run.smithi044.stdout:(111/156): luarocks-3.9.2-5.el9.noarch.rpm 6.0 MB/s | 151 kB 00:00 2024-09-12T02:24:22.962 INFO:teuthology.orchestra.run.smithi039.stdout:Running transaction check 2024-09-12T02:24:22.983 INFO:teuthology.orchestra.run.smithi044.stdout:(112/156): parquet-libs-9.0.0-11.el9.x86_64.rpm 20 MB/s | 839 kB 00:00 2024-09-12T02:24:23.018 INFO:teuthology.orchestra.run.smithi172.stdout: Installing : lttng-ust-2.12.0-6.el9.x86_64 7/164 2024-09-12T02:24:23.051 INFO:teuthology.orchestra.run.smithi044.stdout:(113/156): python3-asyncssh-2.13.2-5.el9.noarch 8.0 MB/s | 548 kB 00:00 2024-09-12T02:24:23.084 INFO:teuthology.orchestra.run.smithi044.stdout:(114/156): python3-bcrypt-3.2.2-1.el9.x86_64.rp 1.3 MB/s | 43 kB 00:00 2024-09-12T02:24:23.110 INFO:teuthology.orchestra.run.smithi044.stdout:(115/156): python3-cachetools-4.2.4-1.el9.noarc 1.3 MB/s | 32 kB 00:00 2024-09-12T02:24:23.126 INFO:teuthology.orchestra.run.smithi172.stdout: Upgrading : librados2-2:19.1.1-298.gb53b6d3e.el9.x86_64 8/164 2024-09-12T02:24:23.135 INFO:teuthology.orchestra.run.smithi044.stdout:(116/156): python3-certifi-2023.05.07-4.el9.noa 567 kB/s | 14 kB 00:00 2024-09-12T02:24:23.161 INFO:teuthology.orchestra.run.smithi039.stdout:Transaction check succeeded. 2024-09-12T02:24:23.161 INFO:teuthology.orchestra.run.smithi039.stdout:Running transaction test 2024-09-12T02:24:23.168 INFO:teuthology.orchestra.run.smithi044.stdout:(117/156): protobuf-compiler-3.14.0-13.el9.x86_ 1.6 MB/s | 863 kB 00:00 2024-09-12T02:24:23.202 INFO:teuthology.orchestra.run.smithi044.stdout:(118/156): python3-cheroot-8.6.0-4.el9.noarch.r 2.5 MB/s | 172 kB 00:00 2024-09-12T02:24:23.249 INFO:teuthology.orchestra.run.smithi172.stdout: Running scriptlet: librados2-2:19.1.1-298.gb53b6d3e.el9.x86_64 8/164 2024-09-12T02:24:23.277 INFO:teuthology.orchestra.run.smithi172.stdout: Installing : libcephfs2-2:19.1.1-298.gb53b6d3e.el9.x86_64 9/164 2024-09-12T02:24:23.278 INFO:teuthology.orchestra.run.smithi044.stdout:(119/156): libarrow-9.0.0-11.el9.x86_64.rpm 9.4 MB/s | 4.4 MB 00:00 2024-09-12T02:24:23.302 INFO:teuthology.orchestra.run.smithi044.stdout:(120/156): python3-cmd2-2.4.2-2.el9.noarch.rpm 3.0 MB/s | 303 kB 00:00 2024-09-12T02:24:23.328 INFO:teuthology.orchestra.run.smithi044.stdout:(121/156): python3-google-auth-2.34.0-1.el9.noa 4.3 MB/s | 220 kB 00:00 2024-09-12T02:24:23.353 INFO:teuthology.orchestra.run.smithi044.stdout:(122/156): python3-cherrypy-18.6.1-2.el9.noarch 1.9 MB/s | 358 kB 00:00 2024-09-12T02:24:23.369 INFO:teuthology.orchestra.run.smithi172.stdout: Running scriptlet: libcephfs2-2:19.1.1-298.gb53b6d3e.el9.x86_64 9/164 2024-09-12T02:24:23.378 INFO:teuthology.orchestra.run.smithi044.stdout:(123/156): python3-grpcio-tools-1.46.7-10.el9.x 2.8 MB/s | 144 kB 00:00 2024-09-12T02:24:23.398 INFO:teuthology.orchestra.run.smithi172.stdout: Installing : python3-rados-2:19.1.1-298.gb53b6d3e.el9.x86_64 10/164 2024-09-12T02:24:23.403 INFO:teuthology.orchestra.run.smithi044.stdout:(124/156): python3-jaraco-8.2.1-3.el9.noarch.rp 214 kB/s | 11 kB 00:00 2024-09-12T02:24:23.429 INFO:teuthology.orchestra.run.smithi044.stdout:(125/156): python3-jaraco-classes-3.2.1-5.el9.n 352 kB/s | 18 kB 00:00 2024-09-12T02:24:23.454 INFO:teuthology.orchestra.run.smithi044.stdout:(126/156): python3-jaraco-collections-3.0.0-8.e 462 kB/s | 23 kB 00:00 2024-09-12T02:24:23.479 INFO:teuthology.orchestra.run.smithi044.stdout:(127/156): python3-jaraco-functools-3.5.0-2.el9 388 kB/s | 19 kB 00:00 2024-09-12T02:24:23.505 INFO:teuthology.orchestra.run.smithi044.stdout:(128/156): python3-jaraco-text-3.2.0-6.el9.noar 392 kB/s | 20 kB 00:00 2024-09-12T02:24:23.530 INFO:teuthology.orchestra.run.smithi044.stdout:(129/156): python3-logutils-0.3.5-21.el9.noarch 1.8 MB/s | 46 kB 00:00 2024-09-12T02:24:23.548 INFO:teuthology.orchestra.run.smithi172.stdout: Installing : postgresql-private-libs-13.16-1.el9.x86_64 11/164 2024-09-12T02:24:23.564 INFO:teuthology.orchestra.run.smithi044.stdout:(130/156): python3-more-itertools-8.12.0-2.el9. 2.3 MB/s | 79 kB 00:00 2024-09-12T02:24:23.589 INFO:teuthology.orchestra.run.smithi044.stdout:(131/156): python3-natsort-7.1.1-5.el9.noarch.r 2.3 MB/s | 58 kB 00:00 2024-09-12T02:24:23.603 INFO:teuthology.orchestra.run.smithi172.stdout: Installing : postgresql-13.16-1.el9.x86_64 12/164 2024-09-12T02:24:23.622 INFO:teuthology.orchestra.run.smithi044.stdout:(132/156): python3-kubernetes-26.1.0-2.el9.noar 7.2 MB/s | 1.0 MB 00:00 2024-09-12T02:24:23.631 INFO:teuthology.orchestra.run.smithi172.stdout: Installing : libcephsqlite-2:19.1.1-298.gb53b6d3e.el9.x86_64 13/164 2024-09-12T02:24:23.649 INFO:teuthology.orchestra.run.smithi044.stdout:(133/156): python3-portend-3.1.0-2.el9.noarch.r 663 kB/s | 16 kB 00:00 2024-09-12T02:24:23.673 INFO:teuthology.orchestra.run.smithi044.stdout:(134/156): python3-pecan-1.4.2-3.el9.noarch.rpm 3.2 MB/s | 272 kB 00:00 2024-09-12T02:24:23.698 INFO:teuthology.orchestra.run.smithi044.stdout:(135/156): python3-pyOpenSSL-21.0.0-1.el9.noarc 1.7 MB/s | 90 kB 00:00 2024-09-12T02:24:23.723 INFO:teuthology.orchestra.run.smithi044.stdout:(136/156): python3-pyperclip-1.8.2-2.el9.noarch 562 kB/s | 28 kB 00:00 2024-09-12T02:24:23.736 INFO:teuthology.orchestra.run.smithi172.stdout: Running scriptlet: libcephsqlite-2:19.1.1-298.gb53b6d3e.el9.x86_64 13/164 2024-09-12T02:24:23.749 INFO:teuthology.orchestra.run.smithi044.stdout:(137/156): python3-repoze-lru-0.7-16.el9.noarch 613 kB/s | 31 kB 00:00 2024-09-12T02:24:23.765 INFO:teuthology.orchestra.run.smithi172.stdout: Installing : libradosstriper1-2:19.1.1-298.gb53b6d3e.el9.x86_ 14/164 2024-09-12T02:24:23.774 INFO:teuthology.orchestra.run.smithi044.stdout:(138/156): python3-rsa-4.9-2.el9.noarch.rpm 2.3 MB/s | 59 kB 00:00 2024-09-12T02:24:23.799 INFO:teuthology.orchestra.run.smithi044.stdout:(139/156): python3-routes-2.5.1-5.el9.noarch.rp 2.4 MB/s | 188 kB 00:00 2024-09-12T02:24:23.825 INFO:teuthology.orchestra.run.smithi044.stdout:(140/156): python3-tempora-5.0.0-2.el9.noarch.r 714 kB/s | 36 kB 00:00 2024-09-12T02:24:23.828 INFO:teuthology.orchestra.run.smithi172.stdout: Running scriptlet: libradosstriper1-2:19.1.1-298.gb53b6d3e.el9.x86_ 14/164 2024-09-12T02:24:23.850 INFO:teuthology.orchestra.run.smithi172.stdout: Installing : qatlib-service-24.02.0-1.el9.x86_64 15/164 2024-09-12T02:24:23.870 INFO:teuthology.orchestra.run.smithi172.stdout: Running scriptlet: qatlib-service-24.02.0-1.el9.x86_64 15/164 2024-09-12T02:24:23.888 INFO:teuthology.orchestra.run.smithi044.stdout:(141/156): python3-grpcio-1.46.7-10.el9.x86_64. 3.5 MB/s | 2.0 MB 00:00 2024-09-12T02:24:23.917 INFO:teuthology.orchestra.run.smithi044.stdout:(142/156): python3-typing-extensions-4.12.2-2.e 635 kB/s | 74 kB 00:00 2024-09-12T02:24:23.942 INFO:teuthology.orchestra.run.smithi044.stdout:(143/156): python3-websocket-client-1.2.3-2.el9 1.6 MB/s | 90 kB 00:00 2024-09-12T02:24:23.967 INFO:teuthology.orchestra.run.smithi044.stdout:(144/156): python3-webob-1.8.8-2.el9.noarch.rpm 1.6 MB/s | 230 kB 00:00 2024-09-12T02:24:23.984 INFO:teuthology.orchestra.run.smithi044.stdout:(145/156): python3-zc-lockfile-2.0-10.el9.noarc 474 kB/s | 20 kB 00:00 2024-09-12T02:24:24.010 INFO:teuthology.orchestra.run.smithi044.stdout:(146/156): re2-20211101-20.el9.x86_64.rpm 4.4 MB/s | 191 kB 00:00 2024-09-12T02:24:24.026 INFO:teuthology.orchestra.run.smithi172.stdout: Running scriptlet: qatlib-24.02.0-1.el9.x86_64 16/164 2024-09-12T02:24:24.035 INFO:teuthology.orchestra.run.smithi044.stdout:(147/156): python3-werkzeug-2.0.3-3.el9.1.noarc 3.5 MB/s | 427 kB 00:00 2024-09-12T02:24:24.085 INFO:teuthology.orchestra.run.smithi044.stdout:(148/156): thrift-0.15.0-2.el9.x86_64.rpm 16 MB/s | 1.6 MB 00:00 2024-09-12T02:24:24.176 INFO:teuthology.orchestra.run.smithi172.stdout: Installing : qatlib-24.02.0-1.el9.x86_64 16/164 2024-09-12T02:24:24.298 INFO:teuthology.orchestra.run.smithi172.stdout: Upgrading : NetworkManager-libnm-1:1.49.90-1.el9.x86_64 17/164 2024-09-12T02:24:24.402 INFO:teuthology.orchestra.run.smithi044.stdout:(149/156): NetworkManager-1.49.90-1.el9.x86_64. 7.3 MB/s | 2.3 MB 00:00 2024-09-12T02:24:24.407 INFO:teuthology.orchestra.run.smithi172.stdout: Running scriptlet: NetworkManager-1:1.49.90-1.el9.x86_64 18/164 2024-09-12T02:24:24.488 INFO:teuthology.orchestra.run.smithi044.stdout:(150/156): NetworkManager-libnm-1.49.90-1.el9.x 22 MB/s | 1.8 MB 00:00 2024-09-12T02:24:24.489 INFO:teuthology.orchestra.run.smithi172.stdout: Upgrading : NetworkManager-1:1.49.90-1.el9.x86_64 18/164 2024-09-12T02:24:24.536 INFO:teuthology.orchestra.run.smithi044.stdout:(151/156): NetworkManager-team-1.49.90-1.el9.x8 819 kB/s | 41 kB 00:00 2024-09-12T02:24:24.595 INFO:teuthology.orchestra.run.smithi044.stdout:(152/156): NetworkManager-tui-1.49.90-1.el9.x86 4.2 MB/s | 249 kB 00:00 2024-09-12T02:24:24.670 INFO:teuthology.orchestra.run.smithi044.stdout:(153/156): librados2-19.1.1-298.gb53b6d3e.el9.x 5.2 MB/s | 3.4 MB 00:00 2024-09-12T02:24:24.719 INFO:teuthology.orchestra.run.smithi172.stdout: Running scriptlet: NetworkManager-1:1.49.90-1.el9.x86_64 18/164 2024-09-12T02:24:24.720 INFO:teuthology.orchestra.run.smithi044.stdout:(154/156): librbd1-19.1.1-298.gb53b6d3e.el9.x86 4.6 MB/s | 3.2 MB 00:00 2024-09-12T02:24:24.762 INFO:teuthology.orchestra.run.smithi044.stdout:(155/156): openssl-3.2.2-6.el9.x86_64.rpm 8.1 MB/s | 1.4 MB 00:00 2024-09-12T02:24:24.829 INFO:teuthology.orchestra.run.smithi172.stdout: Installing : re2-1:20211101-20.el9.x86_64 19/164 2024-09-12T02:24:24.922 INFO:teuthology.orchestra.run.smithi172.stdout: Installing : libarrow-9.0.0-11.el9.x86_64 20/164 2024-09-12T02:24:24.950 INFO:teuthology.orchestra.run.smithi172.stdout: Installing : python3-werkzeug-2.0.3-3.el9.1.noarch 21/164 2024-09-12T02:24:24.984 INFO:teuthology.orchestra.run.smithi172.stdout: Installing : liboath-2.6.7-2.el9.x86_64 22/164 2024-09-12T02:24:25.029 INFO:teuthology.orchestra.run.smithi044.stdout:(156/156): openssl-libs-3.2.2-6.el9.x86_64.rpm 6.7 MB/s | 2.4 MB 00:00 2024-09-12T02:24:25.034 INFO:teuthology.orchestra.run.smithi044.stdout:-------------------------------------------------------------------------------- 2024-09-12T02:24:25.035 INFO:teuthology.orchestra.run.smithi044.stdout:Total 9.5 MB/s | 226 MB 00:23 2024-09-12T02:24:25.058 INFO:teuthology.orchestra.run.smithi172.stdout: Installing : python3-pytz-2021.1-5.el9.noarch 23/164 2024-09-12T02:24:25.119 INFO:teuthology.orchestra.run.smithi172.stdout: Installing : python3-pyasn1-0.4.8-6.el9.noarch 24/164 2024-09-12T02:24:25.167 INFO:teuthology.orchestra.run.smithi172.stdout: Installing : python3-packaging-20.9-5.el9.noarch 25/164 2024-09-12T02:24:25.211 INFO:teuthology.orchestra.run.smithi172.stdout: Installing : python3-markupsafe-1.1.1-12.el9.x86_64 26/164 2024-09-12T02:24:25.243 INFO:teuthology.orchestra.run.smithi172.stdout: Installing : protobuf-3.14.0-13.el9.x86_64 27/164 2024-09-12T02:24:25.271 INFO:teuthology.orchestra.run.smithi172.stdout: Installing : lua-5.4.4-4.el9.x86_64 28/164 2024-09-12T02:24:25.340 INFO:teuthology.orchestra.run.smithi172.stdout: Installing : flexiblas-3.0.4-8.el9.x86_64 29/164 2024-09-12T02:24:25.393 INFO:teuthology.orchestra.run.smithi172.stdout: Installing : python3-urllib3-1.26.5-6.el9.noarch 30/164 2024-09-12T02:24:25.424 INFO:teuthology.orchestra.run.smithi172.stdout: Installing : python3-requests-2.25.1-8.el9.noarch 31/164 2024-09-12T02:24:25.468 INFO:teuthology.orchestra.run.smithi172.stdout: Installing : libquadmath-11.5.0-2.el9.x86_64 32/164 2024-09-12T02:24:25.551 INFO:teuthology.orchestra.run.smithi172.stdout: Installing : libgfortran-11.5.0-2.el9.x86_64 33/164 2024-09-12T02:24:25.586 INFO:teuthology.orchestra.run.smithi172.stdout: Installing : python3-ceph-common-2:19.1.1-298.gb53b6d3e.el9.x 34/164 2024-09-12T02:24:25.641 INFO:teuthology.orchestra.run.smithi039.stdout:Transaction test succeeded. 2024-09-12T02:24:25.641 INFO:teuthology.orchestra.run.smithi039.stdout:Running transaction 2024-09-12T02:24:25.657 INFO:teuthology.orchestra.run.smithi172.stdout: Installing : python3-ceph-argparse-2:19.1.1-298.gb53b6d3e.el9 35/164 2024-09-12T02:24:25.813 INFO:teuthology.orchestra.run.smithi172.stdout: Installing : python3-cephfs-2:19.1.1-298.gb53b6d3e.el9.x86_64 36/164 2024-09-12T02:24:26.010 INFO:teuthology.orchestra.run.smithi172.stdout: Installing : lua-devel-5.4.4-4.el9.x86_64 37/164 2024-09-12T02:24:26.057 INFO:teuthology.orchestra.run.smithi172.stdout: Installing : luarocks-3.9.2-5.el9.noarch 38/164 2024-09-12T02:24:26.133 INFO:teuthology.orchestra.run.smithi172.stdout: Installing : protobuf-compiler-3.14.0-13.el9.x86_64 39/164 2024-09-12T02:24:26.265 INFO:teuthology.orchestra.run.smithi044.stdout:Running transaction check 2024-09-12T02:24:26.266 INFO:teuthology.orchestra.run.smithi172.stdout: Installing : python3-mako-1.1.4-6.el9.noarch 40/164 2024-09-12T02:24:26.325 INFO:teuthology.orchestra.run.smithi172.stdout: Installing : python3-pyasn1-modules-0.4.8-6.el9.noarch 41/164 2024-09-12T02:24:26.429 INFO:teuthology.orchestra.run.smithi044.stdout:Transaction check succeeded. 2024-09-12T02:24:26.429 INFO:teuthology.orchestra.run.smithi044.stdout:Running transaction test 2024-09-12T02:24:26.847 INFO:teuthology.orchestra.run.smithi172.stdout: Installing : python3-rsa-4.9-2.el9.noarch 42/164 2024-09-12T02:24:26.929 INFO:teuthology.orchestra.run.smithi172.stdout: Installing : python3-babel-2.9.1-2.el9.noarch 43/164 2024-09-12T02:24:26.967 INFO:teuthology.orchestra.run.smithi172.stdout: Installing : python3-jinja2-2.11.3-6.el9.noarch 44/164 2024-09-12T02:24:27.018 INFO:teuthology.orchestra.run.smithi172.stdout: Installing : qatzip-libs-1.2.0-1.el9.x86_64 45/164 2024-09-12T02:24:27.055 INFO:teuthology.orchestra.run.smithi172.stdout: Installing : librados-devel-2:19.1.1-298.gb53b6d3e.el9.x86_64 46/164 2024-09-12T02:24:27.097 INFO:teuthology.orchestra.run.smithi172.stdout: Installing : python3-jaraco-classes-3.2.1-5.el9.noarch 47/164 2024-09-12T02:24:27.255 INFO:teuthology.orchestra.run.smithi172.stdout: Installing : socat-1.7.4.1-6.el9.x86_64 48/164 2024-09-12T02:24:27.309 INFO:teuthology.orchestra.run.smithi172.stdout: Upgrading : openssl-1:3.2.2-6.el9.x86_64 49/164 2024-09-12T02:24:27.365 INFO:teuthology.orchestra.run.smithi172.stdout: Installing : python3-zc-lockfile-2.0-10.el9.noarch 50/164 2024-09-12T02:24:27.436 INFO:teuthology.orchestra.run.smithi172.stdout: Installing : python3-websocket-client-1.2.3-2.el9.noarch 51/164 2024-09-12T02:24:27.476 INFO:teuthology.orchestra.run.smithi172.stdout: Installing : python3-webob-1.8.8-2.el9.noarch 52/164 2024-09-12T02:24:27.513 INFO:teuthology.orchestra.run.smithi172.stdout: Installing : python3-typing-extensions-4.12.2-2.el9.noarch 53/164 2024-09-12T02:24:27.558 INFO:teuthology.orchestra.run.smithi172.stdout: Installing : python3-repoze-lru-0.7-16.el9.noarch 54/164 2024-09-12T02:24:27.595 INFO:teuthology.orchestra.run.smithi172.stdout: Installing : python3-routes-2.5.1-5.el9.noarch 55/164 2024-09-12T02:24:27.638 INFO:teuthology.orchestra.run.smithi172.stdout: Installing : python3-pyperclip-1.8.2-2.el9.noarch 56/164 2024-09-12T02:24:27.757 INFO:teuthology.orchestra.run.smithi172.stdout: Installing : python3-natsort-7.1.1-5.el9.noarch 57/164 2024-09-12T02:24:28.030 INFO:teuthology.orchestra.run.smithi172.stdout: Installing : python3-logutils-0.3.5-21.el9.noarch 58/164 2024-09-12T02:24:28.073 INFO:teuthology.orchestra.run.smithi172.stdout: Installing : python3-pecan-1.4.2-3.el9.noarch 59/164 2024-09-12T02:24:28.115 INFO:teuthology.orchestra.run.smithi172.stdout: Installing : python3-certifi-2023.05.07-4.el9.noarch 60/164 2024-09-12T02:24:28.217 INFO:teuthology.orchestra.run.smithi172.stdout: Installing : python3-cachetools-4.2.4-1.el9.noarch 61/164 2024-09-12T02:24:28.257 INFO:teuthology.orchestra.run.smithi172.stdout: Installing : python3-google-auth-1:2.34.0-1.el9.noarch 62/164 2024-09-12T02:24:28.296 INFO:teuthology.orchestra.run.smithi172.stdout: Installing : libunwind-1.6.2-1.el9.x86_64 63/164 2024-09-12T02:24:28.314 INFO:teuthology.orchestra.run.smithi044.stdout:Transaction test succeeded. 2024-09-12T02:24:28.316 INFO:teuthology.orchestra.run.smithi044.stdout:Running transaction 2024-09-12T02:24:28.322 INFO:teuthology.orchestra.run.smithi172.stdout: Installing : gperftools-libs-2.9.1-2.el9.x86_64 64/164 2024-09-12T02:24:28.347 INFO:teuthology.orchestra.run.smithi172.stdout: Installing : libarrow-doc-9.0.0-11.el9.noarch 65/164 2024-09-12T02:24:28.422 INFO:teuthology.orchestra.run.smithi172.stdout: Installing : grpc-data-1.46.7-10.el9.noarch 66/164 2024-09-12T02:24:28.550 INFO:teuthology.orchestra.run.smithi172.stdout: Installing : abseil-cpp-20211102.0-3.el9.x86_64 67/164 2024-09-12T02:24:28.589 INFO:teuthology.orchestra.run.smithi172.stdout: Installing : python3-grpcio-1.46.7-10.el9.x86_64 68/164 2024-09-12T02:24:28.617 INFO:teuthology.orchestra.run.smithi172.stdout: Installing : zlib-devel-1.2.11-41.el9.x86_64 69/164 2024-09-12T02:24:28.651 INFO:teuthology.orchestra.run.smithi172.stdout: Installing : xmlstarlet-1.6.1-20.el9.x86_64 70/164 2024-09-12T02:24:28.690 INFO:teuthology.orchestra.run.smithi172.stdout: Installing : uuid-1.6.2-55.el9.x86_64 71/164 2024-09-12T02:24:28.722 INFO:teuthology.orchestra.run.smithi172.stdout: Installing : python3-wcwidth-0.2.5-8.el9.noarch 72/164 2024-09-12T02:24:28.783 INFO:teuthology.orchestra.run.smithi172.stdout: Installing : python3-toml-0.10.2-6.el9.noarch 73/164 2024-09-12T02:24:28.820 INFO:teuthology.orchestra.run.smithi172.stdout: Installing : python3-jaraco-functools-3.5.0-2.el9.noarch 74/164 2024-09-12T02:24:28.861 INFO:teuthology.orchestra.run.smithi172.stdout: Installing : python3-jaraco-text-3.2.0-6.el9.noarch 75/164 2024-09-12T02:24:28.911 INFO:teuthology.orchestra.run.smithi172.stdout: Installing : python3-jaraco-collections-3.0.0-8.el9.noarch 76/164 2024-09-12T02:24:28.946 INFO:teuthology.orchestra.run.smithi172.stdout: Installing : python3-tempora-5.0.0-2.el9.noarch 77/164 2024-09-12T02:24:29.033 INFO:teuthology.orchestra.run.smithi172.stdout: Installing : python3-portend-3.1.0-2.el9.noarch 78/164 2024-09-12T02:24:29.093 INFO:teuthology.orchestra.run.smithi172.stdout: Installing : python3-protobuf-3.14.0-13.el9.noarch 79/164 2024-09-12T02:24:29.124 INFO:teuthology.orchestra.run.smithi172.stdout: Installing : python3-grpcio-tools-1.46.7-10.el9.x86_64 80/164 2024-09-12T02:24:29.227 INFO:teuthology.orchestra.run.smithi172.stdout: Installing : python3-prettytable-0.7.2-27.el9.noarch 81/164 2024-09-12T02:24:29.275 INFO:teuthology.orchestra.run.smithi172.stdout: Installing : python3-oauthlib-3.1.1-5.el9.noarch 82/164 2024-09-12T02:24:30.013 INFO:teuthology.orchestra.run.smithi172.stdout: Installing : python3-requests-oauthlib-1.3.0-12.el9.noarch 83/164 2024-09-12T02:24:30.055 INFO:teuthology.orchestra.run.smithi172.stdout: Installing : python3-kubernetes-1:26.1.0-2.el9.noarch 84/164 2024-09-12T02:24:30.089 INFO:teuthology.orchestra.run.smithi172.stdout: Installing : python3-jsonpointer-2.0-4.el9.noarch 85/164 2024-09-12T02:24:30.188 INFO:teuthology.orchestra.run.smithi172.stdout: Installing : python3-jsonpatch-1.21-16.el9.noarch 86/164 2024-09-12T02:24:30.236 INFO:teuthology.orchestra.run.smithi172.stdout: Installing : python3-devel-3.9.19-8.el9.x86_64 87/164 2024-09-12T02:24:30.281 INFO:teuthology.orchestra.run.smithi172.stdout: Installing : python3-colorama-0.4.6-3.el9.noarch 88/164 2024-09-12T02:24:30.368 INFO:teuthology.orchestra.run.smithi172.stdout: Installing : python3-attrs-20.3.0-7.el9.noarch 89/164 2024-09-12T02:24:30.409 INFO:teuthology.orchestra.run.smithi172.stdout: Installing : python3-cmd2-2.4.2-2.el9.noarch 90/164 2024-09-12T02:24:30.597 INFO:teuthology.orchestra.run.smithi172.stdout: Installing : openblas-0.3.26-2.el9.x86_64 91/164 2024-09-12T02:24:30.623 INFO:teuthology.orchestra.run.smithi172.stdout: Installing : openblas-openmp-0.3.26-2.el9.x86_64 92/164 2024-09-12T02:24:30.701 INFO:teuthology.orchestra.run.smithi172.stdout: Installing : flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 93/164 2024-09-12T02:24:31.366 INFO:teuthology.orchestra.run.smithi172.stdout: Installing : flexiblas-netlib-3.0.4-8.el9.x86_64 94/164 2024-09-12T02:24:31.487 INFO:teuthology.orchestra.run.smithi172.stdout: Installing : python3-numpy-1:1.20.1-5.el9.x86_64 95/164 2024-09-12T02:24:32.375 INFO:teuthology.orchestra.run.smithi039.stdout: Preparing : 1/1 2024-09-12T02:24:32.517 INFO:teuthology.orchestra.run.smithi039.stdout: Upgrading : openssl-libs-1:3.2.2-6.el9.x86_64 1/164 2024-09-12T02:24:32.575 INFO:teuthology.orchestra.run.smithi039.stdout: Installing : librabbitmq-0.11.0-7.el9.x86_64 2/164 2024-09-12T02:24:32.679 INFO:teuthology.orchestra.run.smithi039.stdout: Installing : librdkafka-1.6.1-102.el9.x86_64 3/164 2024-09-12T02:24:32.720 INFO:teuthology.orchestra.run.smithi039.stdout: Installing : thrift-0.15.0-2.el9.x86_64 4/164 2024-09-12T02:24:32.722 INFO:teuthology.orchestra.run.smithi172.stdout: Installing : python3-numpy-f2py-1:1.20.1-5.el9.x86_64 96/164 2024-09-12T02:24:32.751 INFO:teuthology.orchestra.run.smithi039.stdout: Installing : python3-more-itertools-8.12.0-2.el9.noarch 5/164 2024-09-12T02:24:32.793 INFO:teuthology.orchestra.run.smithi172.stdout: Installing : python3-scipy-1.6.2-8.el9.x86_64 97/164 2024-09-12T02:24:32.810 INFO:teuthology.orchestra.run.smithi039.stdout: Installing : python3-jaraco-8.2.1-3.el9.noarch 6/164 2024-09-12T02:24:32.829 INFO:teuthology.orchestra.run.smithi172.stdout: Installing : libzstd-devel-1.5.1-2.el9.x86_64 98/164 2024-09-12T02:24:32.862 INFO:teuthology.orchestra.run.smithi172.stdout: Installing : libuuid-devel-2.37.4-20.el9.x86_64 99/164 2024-09-12T02:24:33.174 INFO:teuthology.orchestra.run.smithi172.stdout: Installing : libpmemobj-1.12.1-1.el9.x86_64 100/164 2024-09-12T02:24:33.193 INFO:teuthology.orchestra.run.smithi039.stdout: Installing : lttng-ust-2.12.0-6.el9.x86_64 7/164 2024-09-12T02:24:33.217 INFO:teuthology.orchestra.run.smithi172.stdout: Upgrading : librbd1-2:19.1.1-298.gb53b6d3e.el9.x86_64 101/164 2024-09-12T02:24:33.301 INFO:teuthology.orchestra.run.smithi039.stdout: Upgrading : librados2-2:19.1.1-298.gb53b6d3e.el9.x86_64 8/164 2024-09-12T02:24:33.315 INFO:teuthology.orchestra.run.smithi172.stdout: Running scriptlet: librbd1-2:19.1.1-298.gb53b6d3e.el9.x86_64 101/164 2024-09-12T02:24:33.405 INFO:teuthology.orchestra.run.smithi172.stdout: Installing : python3-rbd-2:19.1.1-298.gb53b6d3e.el9.x86_64 102/164 2024-09-12T02:24:33.433 INFO:teuthology.orchestra.run.smithi039.stdout: Running scriptlet: librados2-2:19.1.1-298.gb53b6d3e.el9.x86_64 8/164 2024-09-12T02:24:33.442 INFO:teuthology.orchestra.run.smithi172.stdout: Installing : boost-program-options-1.75.0-8.el9.x86_64 103/164 2024-09-12T02:24:33.460 INFO:teuthology.orchestra.run.smithi039.stdout: Installing : libcephfs2-2:19.1.1-298.gb53b6d3e.el9.x86_64 9/164 2024-09-12T02:24:33.574 INFO:teuthology.orchestra.run.smithi039.stdout: Running scriptlet: libcephfs2-2:19.1.1-298.gb53b6d3e.el9.x86_64 9/164 2024-09-12T02:24:33.608 INFO:teuthology.orchestra.run.smithi039.stdout: Installing : python3-rados-2:19.1.1-298.gb53b6d3e.el9.x86_64 10/164 2024-09-12T02:24:33.827 INFO:teuthology.orchestra.run.smithi039.stdout: Installing : postgresql-private-libs-13.16-1.el9.x86_64 11/164 2024-09-12T02:24:33.889 INFO:teuthology.orchestra.run.smithi039.stdout: Installing : postgresql-13.16-1.el9.x86_64 12/164 2024-09-12T02:24:33.914 INFO:teuthology.orchestra.run.smithi039.stdout: Installing : libcephsqlite-2:19.1.1-298.gb53b6d3e.el9.x86_64 13/164 2024-09-12T02:24:33.930 INFO:teuthology.orchestra.run.smithi172.stdout: Installing : parquet-libs-9.0.0-11.el9.x86_64 104/164 2024-09-12T02:24:33.970 INFO:teuthology.orchestra.run.smithi172.stdout: Installing : librgw2-2:19.1.1-298.gb53b6d3e.el9.x86_64 105/164 2024-09-12T02:24:34.033 INFO:teuthology.orchestra.run.smithi172.stdout: Running scriptlet: librgw2-2:19.1.1-298.gb53b6d3e.el9.x86_64 105/164 2024-09-12T02:24:34.043 INFO:teuthology.orchestra.run.smithi039.stdout: Running scriptlet: libcephsqlite-2:19.1.1-298.gb53b6d3e.el9.x86_64 13/164 2024-09-12T02:24:34.071 INFO:teuthology.orchestra.run.smithi172.stdout: Installing : python3-rgw-2:19.1.1-298.gb53b6d3e.el9.x86_64 106/164 2024-09-12T02:24:34.074 INFO:teuthology.orchestra.run.smithi039.stdout: Installing : libradosstriper1-2:19.1.1-298.gb53b6d3e.el9.x86_ 14/164 2024-09-12T02:24:34.156 INFO:teuthology.orchestra.run.smithi039.stdout: Running scriptlet: libradosstriper1-2:19.1.1-298.gb53b6d3e.el9.x86_ 14/164 2024-09-12T02:24:34.183 INFO:teuthology.orchestra.run.smithi039.stdout: Installing : qatlib-service-24.02.0-1.el9.x86_64 15/164 2024-09-12T02:24:34.229 INFO:teuthology.orchestra.run.smithi039.stdout: Running scriptlet: qatlib-service-24.02.0-1.el9.x86_64 15/164 2024-09-12T02:24:34.460 INFO:teuthology.orchestra.run.smithi039.stdout: Running scriptlet: qatlib-24.02.0-1.el9.x86_64 16/164 2024-09-12T02:24:34.634 INFO:teuthology.orchestra.run.smithi039.stdout: Installing : qatlib-24.02.0-1.el9.x86_64 16/164 2024-09-12T02:24:34.747 INFO:teuthology.orchestra.run.smithi044.stdout: Preparing : 1/1 2024-09-12T02:24:34.840 INFO:teuthology.orchestra.run.smithi039.stdout: Upgrading : NetworkManager-libnm-1:1.49.90-1.el9.x86_64 17/164 2024-09-12T02:24:34.883 INFO:teuthology.orchestra.run.smithi044.stdout: Upgrading : openssl-libs-1:3.2.2-6.el9.x86_64 1/164 2024-09-12T02:24:34.932 INFO:teuthology.orchestra.run.smithi044.stdout: Installing : librabbitmq-0.11.0-7.el9.x86_64 2/164 2024-09-12T02:24:34.959 INFO:teuthology.orchestra.run.smithi039.stdout: Running scriptlet: NetworkManager-1:1.49.90-1.el9.x86_64 18/164 2024-09-12T02:24:34.992 INFO:teuthology.orchestra.run.smithi044.stdout: Installing : librdkafka-1.6.1-102.el9.x86_64 3/164 2024-09-12T02:24:35.025 INFO:teuthology.orchestra.run.smithi044.stdout: Installing : thrift-0.15.0-2.el9.x86_64 4/164 2024-09-12T02:24:35.050 INFO:teuthology.orchestra.run.smithi044.stdout: Installing : python3-more-itertools-8.12.0-2.el9.noarch 5/164 2024-09-12T02:24:35.074 INFO:teuthology.orchestra.run.smithi039.stdout: Upgrading : NetworkManager-1:1.49.90-1.el9.x86_64 18/164 2024-09-12T02:24:35.094 INFO:teuthology.orchestra.run.smithi044.stdout: Installing : python3-jaraco-8.2.1-3.el9.noarch 6/164 2024-09-12T02:24:35.363 INFO:teuthology.orchestra.run.smithi039.stdout: Running scriptlet: NetworkManager-1:1.49.90-1.el9.x86_64 18/164 2024-09-12T02:24:35.522 INFO:teuthology.orchestra.run.smithi039.stdout: Installing : re2-1:20211101-20.el9.x86_64 19/164 2024-09-12T02:24:35.602 INFO:teuthology.orchestra.run.smithi044.stdout: Installing : lttng-ust-2.12.0-6.el9.x86_64 7/164 2024-09-12T02:24:35.647 INFO:teuthology.orchestra.run.smithi039.stdout: Installing : libarrow-9.0.0-11.el9.x86_64 20/164 2024-09-12T02:24:35.689 INFO:teuthology.orchestra.run.smithi039.stdout: Installing : python3-werkzeug-2.0.3-3.el9.1.noarch 21/164 2024-09-12T02:24:35.693 INFO:teuthology.orchestra.run.smithi044.stdout: Upgrading : librados2-2:19.1.1-298.gb53b6d3e.el9.x86_64 8/164 2024-09-12T02:24:35.735 INFO:teuthology.orchestra.run.smithi039.stdout: Installing : liboath-2.6.7-2.el9.x86_64 22/164 2024-09-12T02:24:35.802 INFO:teuthology.orchestra.run.smithi044.stdout: Running scriptlet: librados2-2:19.1.1-298.gb53b6d3e.el9.x86_64 8/164 2024-09-12T02:24:35.821 INFO:teuthology.orchestra.run.smithi039.stdout: Installing : python3-pytz-2021.1-5.el9.noarch 23/164 2024-09-12T02:24:35.836 INFO:teuthology.orchestra.run.smithi044.stdout: Installing : libcephfs2-2:19.1.1-298.gb53b6d3e.el9.x86_64 9/164 2024-09-12T02:24:35.893 INFO:teuthology.orchestra.run.smithi039.stdout: Installing : python3-pyasn1-0.4.8-6.el9.noarch 24/164 2024-09-12T02:24:35.928 INFO:teuthology.orchestra.run.smithi044.stdout: Running scriptlet: libcephfs2-2:19.1.1-298.gb53b6d3e.el9.x86_64 9/164 2024-09-12T02:24:35.954 INFO:teuthology.orchestra.run.smithi039.stdout: Installing : python3-packaging-20.9-5.el9.noarch 25/164 2024-09-12T02:24:35.957 INFO:teuthology.orchestra.run.smithi044.stdout: Installing : python3-rados-2:19.1.1-298.gb53b6d3e.el9.x86_64 10/164 2024-09-12T02:24:36.015 INFO:teuthology.orchestra.run.smithi039.stdout: Installing : python3-markupsafe-1.1.1-12.el9.x86_64 26/164 2024-09-12T02:24:36.052 INFO:teuthology.orchestra.run.smithi039.stdout: Installing : protobuf-3.14.0-13.el9.x86_64 27/164 2024-09-12T02:24:36.086 INFO:teuthology.orchestra.run.smithi039.stdout: Installing : lua-5.4.4-4.el9.x86_64 28/164 2024-09-12T02:24:36.115 INFO:teuthology.orchestra.run.smithi044.stdout: Installing : postgresql-private-libs-13.16-1.el9.x86_64 11/164 2024-09-12T02:24:36.162 INFO:teuthology.orchestra.run.smithi044.stdout: Installing : postgresql-13.16-1.el9.x86_64 12/164 2024-09-12T02:24:36.179 INFO:teuthology.orchestra.run.smithi039.stdout: Installing : flexiblas-3.0.4-8.el9.x86_64 29/164 2024-09-12T02:24:36.190 INFO:teuthology.orchestra.run.smithi044.stdout: Installing : libcephsqlite-2:19.1.1-298.gb53b6d3e.el9.x86_64 13/164 2024-09-12T02:24:36.248 INFO:teuthology.orchestra.run.smithi039.stdout: Installing : python3-urllib3-1.26.5-6.el9.noarch 30/164 2024-09-12T02:24:36.281 INFO:teuthology.orchestra.run.smithi039.stdout: Installing : python3-requests-2.25.1-8.el9.noarch 31/164 2024-09-12T02:24:36.287 INFO:teuthology.orchestra.run.smithi044.stdout: Running scriptlet: libcephsqlite-2:19.1.1-298.gb53b6d3e.el9.x86_64 13/164 2024-09-12T02:24:36.316 INFO:teuthology.orchestra.run.smithi044.stdout: Installing : libradosstriper1-2:19.1.1-298.gb53b6d3e.el9.x86_ 14/164 2024-09-12T02:24:36.328 INFO:teuthology.orchestra.run.smithi039.stdout: Installing : libquadmath-11.5.0-2.el9.x86_64 32/164 2024-09-12T02:24:36.362 INFO:teuthology.orchestra.run.smithi044.stdout: Running scriptlet: libradosstriper1-2:19.1.1-298.gb53b6d3e.el9.x86_ 14/164 2024-09-12T02:24:36.363 INFO:teuthology.orchestra.run.smithi172.stdout: Running scriptlet: ceph-common-2:19.1.1-298.gb53b6d3e.el9.x86_64 107/164 2024-09-12T02:24:36.384 INFO:teuthology.orchestra.run.smithi044.stdout: Installing : qatlib-service-24.02.0-1.el9.x86_64 15/164 2024-09-12T02:24:36.410 INFO:teuthology.orchestra.run.smithi172.stdout: Installing : ceph-common-2:19.1.1-298.gb53b6d3e.el9.x86_64 107/164 2024-09-12T02:24:36.410 INFO:teuthology.orchestra.run.smithi044.stdout: Running scriptlet: qatlib-service-24.02.0-1.el9.x86_64 15/164 2024-09-12T02:24:36.420 INFO:teuthology.orchestra.run.smithi039.stdout: Installing : libgfortran-11.5.0-2.el9.x86_64 33/164 2024-09-12T02:24:36.460 INFO:teuthology.orchestra.run.smithi039.stdout: Installing : python3-ceph-common-2:19.1.1-298.gb53b6d3e.el9.x 34/164 2024-09-12T02:24:36.505 INFO:teuthology.orchestra.run.smithi039.stdout: Installing : python3-ceph-argparse-2:19.1.1-298.gb53b6d3e.el9 35/164 2024-09-12T02:24:36.532 INFO:teuthology.orchestra.run.smithi039.stdout: Installing : python3-cephfs-2:19.1.1-298.gb53b6d3e.el9.x86_64 36/164 2024-09-12T02:24:36.601 INFO:teuthology.orchestra.run.smithi044.stdout: Running scriptlet: qatlib-24.02.0-1.el9.x86_64 16/164 2024-09-12T02:24:36.626 INFO:teuthology.orchestra.run.smithi039.stdout: Installing : lua-devel-5.4.4-4.el9.x86_64 37/164 2024-09-12T02:24:36.677 INFO:teuthology.orchestra.run.smithi039.stdout: Installing : luarocks-3.9.2-5.el9.noarch 38/164 2024-09-12T02:24:36.738 INFO:teuthology.orchestra.run.smithi044.stdout: Installing : qatlib-24.02.0-1.el9.x86_64 16/164 2024-09-12T02:24:36.772 INFO:teuthology.orchestra.run.smithi039.stdout: Installing : protobuf-compiler-3.14.0-13.el9.x86_64 39/164 2024-09-12T02:24:36.848 INFO:teuthology.orchestra.run.smithi044.stdout: Upgrading : NetworkManager-libnm-1:1.49.90-1.el9.x86_64 17/164 2024-09-12T02:24:36.948 INFO:teuthology.orchestra.run.smithi044.stdout: Running scriptlet: NetworkManager-1:1.49.90-1.el9.x86_64 18/164 2024-09-12T02:24:36.960 INFO:teuthology.orchestra.run.smithi172.stdout: Running scriptlet: ceph-common-2:19.1.1-298.gb53b6d3e.el9.x86_64 107/164 2024-09-12T02:24:36.962 INFO:teuthology.orchestra.run.smithi039.stdout: Installing : python3-mako-1.1.4-6.el9.noarch 40/164 2024-09-12T02:24:36.996 INFO:teuthology.orchestra.run.smithi172.stdout: Installing : ceph-base-2:19.1.1-298.gb53b6d3e.el9.x86_64 108/164 2024-09-12T02:24:37.024 INFO:teuthology.orchestra.run.smithi044.stdout: Upgrading : NetworkManager-1:1.49.90-1.el9.x86_64 18/164 2024-09-12T02:24:37.030 INFO:teuthology.orchestra.run.smithi039.stdout: Installing : python3-pyasn1-modules-0.4.8-6.el9.noarch 41/164 2024-09-12T02:24:37.093 INFO:teuthology.orchestra.run.smithi172.stdout: Running scriptlet: ceph-base-2:19.1.1-298.gb53b6d3e.el9.x86_64 108/164 2024-09-12T02:24:37.093 INFO:teuthology.orchestra.run.smithi172.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph.target → /usr/lib/systemd/system/ceph.target. 2024-09-12T02:24:37.093 INFO:teuthology.orchestra.run.smithi172.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-crash.service → /usr/lib/systemd/system/ceph-crash.service. 2024-09-12T02:24:37.094 INFO:teuthology.orchestra.run.smithi172.stdout: 2024-09-12T02:24:37.122 INFO:teuthology.orchestra.run.smithi172.stdout: Installing : ceph-selinux-2:19.1.1-298.gb53b6d3e.el9.x86_64 109/164 2024-09-12T02:24:37.248 INFO:teuthology.orchestra.run.smithi044.stdout: Running scriptlet: NetworkManager-1:1.49.90-1.el9.x86_64 18/164 2024-09-12T02:24:37.358 INFO:teuthology.orchestra.run.smithi044.stdout: Installing : re2-1:20211101-20.el9.x86_64 19/164 2024-09-12T02:24:37.463 INFO:teuthology.orchestra.run.smithi044.stdout: Installing : libarrow-9.0.0-11.el9.x86_64 20/164 2024-09-12T02:24:37.497 INFO:teuthology.orchestra.run.smithi044.stdout: Installing : python3-werkzeug-2.0.3-3.el9.1.noarch 21/164 2024-09-12T02:24:37.540 INFO:teuthology.orchestra.run.smithi044.stdout: Installing : liboath-2.6.7-2.el9.x86_64 22/164 2024-09-12T02:24:37.616 INFO:teuthology.orchestra.run.smithi044.stdout: Installing : python3-pytz-2021.1-5.el9.noarch 23/164 2024-09-12T02:24:37.667 INFO:teuthology.orchestra.run.smithi044.stdout: Installing : python3-pyasn1-0.4.8-6.el9.noarch 24/164 2024-09-12T02:24:37.706 INFO:teuthology.orchestra.run.smithi044.stdout: Installing : python3-packaging-20.9-5.el9.noarch 25/164 2024-09-12T02:24:37.713 INFO:teuthology.orchestra.run.smithi039.stdout: Installing : python3-rsa-4.9-2.el9.noarch 42/164 2024-09-12T02:24:37.750 INFO:teuthology.orchestra.run.smithi044.stdout: Installing : python3-markupsafe-1.1.1-12.el9.x86_64 26/164 2024-09-12T02:24:37.786 INFO:teuthology.orchestra.run.smithi044.stdout: Installing : protobuf-3.14.0-13.el9.x86_64 27/164 2024-09-12T02:24:37.813 INFO:teuthology.orchestra.run.smithi044.stdout: Installing : lua-5.4.4-4.el9.x86_64 28/164 2024-09-12T02:24:37.816 INFO:teuthology.orchestra.run.smithi039.stdout: Installing : python3-babel-2.9.1-2.el9.noarch 43/164 2024-09-12T02:24:37.858 INFO:teuthology.orchestra.run.smithi039.stdout: Installing : python3-jinja2-2.11.3-6.el9.noarch 44/164 2024-09-12T02:24:37.886 INFO:teuthology.orchestra.run.smithi044.stdout: Installing : flexiblas-3.0.4-8.el9.x86_64 29/164 2024-09-12T02:24:37.901 INFO:teuthology.orchestra.run.smithi039.stdout: Installing : qatzip-libs-1.2.0-1.el9.x86_64 45/164 2024-09-12T02:24:37.937 INFO:teuthology.orchestra.run.smithi044.stdout: Installing : python3-urllib3-1.26.5-6.el9.noarch 30/164 2024-09-12T02:24:37.940 INFO:teuthology.orchestra.run.smithi039.stdout: Installing : librados-devel-2:19.1.1-298.gb53b6d3e.el9.x86_64 46/164 2024-09-12T02:24:37.966 INFO:teuthology.orchestra.run.smithi044.stdout: Installing : python3-requests-2.25.1-8.el9.noarch 31/164 2024-09-12T02:24:37.997 INFO:teuthology.orchestra.run.smithi039.stdout: Installing : python3-jaraco-classes-3.2.1-5.el9.noarch 47/164 2024-09-12T02:24:38.002 INFO:teuthology.orchestra.run.smithi044.stdout: Installing : libquadmath-11.5.0-2.el9.x86_64 32/164 2024-09-12T02:24:38.089 INFO:teuthology.orchestra.run.smithi044.stdout: Installing : libgfortran-11.5.0-2.el9.x86_64 33/164 2024-09-12T02:24:38.121 INFO:teuthology.orchestra.run.smithi044.stdout: Installing : python3-ceph-common-2:19.1.1-298.gb53b6d3e.el9.x 34/164 2024-09-12T02:24:38.165 INFO:teuthology.orchestra.run.smithi044.stdout: Installing : python3-ceph-argparse-2:19.1.1-298.gb53b6d3e.el9 35/164 2024-09-12T02:24:38.193 INFO:teuthology.orchestra.run.smithi044.stdout: Installing : python3-cephfs-2:19.1.1-298.gb53b6d3e.el9.x86_64 36/164 2024-09-12T02:24:38.201 INFO:teuthology.orchestra.run.smithi039.stdout: Installing : socat-1.7.4.1-6.el9.x86_64 48/164 2024-09-12T02:24:38.267 INFO:teuthology.orchestra.run.smithi044.stdout: Installing : lua-devel-5.4.4-4.el9.x86_64 37/164 2024-09-12T02:24:38.280 INFO:teuthology.orchestra.run.smithi039.stdout: Upgrading : openssl-1:3.2.2-6.el9.x86_64 49/164 2024-09-12T02:24:38.316 INFO:teuthology.orchestra.run.smithi044.stdout: Installing : luarocks-3.9.2-5.el9.noarch 38/164 2024-09-12T02:24:38.349 INFO:teuthology.orchestra.run.smithi039.stdout: Installing : python3-zc-lockfile-2.0-10.el9.noarch 50/164 2024-09-12T02:24:38.395 INFO:teuthology.orchestra.run.smithi044.stdout: Installing : protobuf-compiler-3.14.0-13.el9.x86_64 39/164 2024-09-12T02:24:38.440 INFO:teuthology.orchestra.run.smithi039.stdout: Installing : python3-websocket-client-1.2.3-2.el9.noarch 51/164 2024-09-12T02:24:38.472 INFO:teuthology.orchestra.run.smithi039.stdout: Installing : python3-webob-1.8.8-2.el9.noarch 52/164 2024-09-12T02:24:38.509 INFO:teuthology.orchestra.run.smithi039.stdout: Installing : python3-typing-extensions-4.12.2-2.el9.noarch 53/164 2024-09-12T02:24:38.540 INFO:teuthology.orchestra.run.smithi044.stdout: Installing : python3-mako-1.1.4-6.el9.noarch 40/164 2024-09-12T02:24:38.568 INFO:teuthology.orchestra.run.smithi039.stdout: Installing : python3-repoze-lru-0.7-16.el9.noarch 54/164 2024-09-12T02:24:38.603 INFO:teuthology.orchestra.run.smithi044.stdout: Installing : python3-pyasn1-modules-0.4.8-6.el9.noarch 41/164 2024-09-12T02:24:38.608 INFO:teuthology.orchestra.run.smithi039.stdout: Installing : python3-routes-2.5.1-5.el9.noarch 55/164 2024-09-12T02:24:38.655 INFO:teuthology.orchestra.run.smithi039.stdout: Installing : python3-pyperclip-1.8.2-2.el9.noarch 56/164 2024-09-12T02:24:38.713 INFO:teuthology.orchestra.run.smithi039.stdout: Installing : python3-natsort-7.1.1-5.el9.noarch 57/164 2024-09-12T02:24:38.896 INFO:teuthology.orchestra.run.smithi039.stdout: Installing : python3-logutils-0.3.5-21.el9.noarch 58/164 2024-09-12T02:24:38.953 INFO:teuthology.orchestra.run.smithi039.stdout: Installing : python3-pecan-1.4.2-3.el9.noarch 59/164 2024-09-12T02:24:38.997 INFO:teuthology.orchestra.run.smithi039.stdout: Installing : python3-certifi-2023.05.07-4.el9.noarch 60/164 2024-09-12T02:24:39.131 INFO:teuthology.orchestra.run.smithi039.stdout: Installing : python3-cachetools-4.2.4-1.el9.noarch 61/164 2024-09-12T02:24:39.159 INFO:teuthology.orchestra.run.smithi044.stdout: Installing : python3-rsa-4.9-2.el9.noarch 42/164 2024-09-12T02:24:39.170 INFO:teuthology.orchestra.run.smithi039.stdout: Installing : python3-google-auth-1:2.34.0-1.el9.noarch 62/164 2024-09-12T02:24:39.238 INFO:teuthology.orchestra.run.smithi039.stdout: Installing : libunwind-1.6.2-1.el9.x86_64 63/164 2024-09-12T02:24:39.242 INFO:teuthology.orchestra.run.smithi044.stdout: Installing : python3-babel-2.9.1-2.el9.noarch 43/164 2024-09-12T02:24:39.268 INFO:teuthology.orchestra.run.smithi039.stdout: Installing : gperftools-libs-2.9.1-2.el9.x86_64 64/164 2024-09-12T02:24:39.277 INFO:teuthology.orchestra.run.smithi044.stdout: Installing : python3-jinja2-2.11.3-6.el9.noarch 44/164 2024-09-12T02:24:39.292 INFO:teuthology.orchestra.run.smithi039.stdout: Installing : libarrow-doc-9.0.0-11.el9.noarch 65/164 2024-09-12T02:24:39.311 INFO:teuthology.orchestra.run.smithi044.stdout: Installing : qatzip-libs-1.2.0-1.el9.x86_64 45/164 2024-09-12T02:24:39.341 INFO:teuthology.orchestra.run.smithi044.stdout: Installing : librados-devel-2:19.1.1-298.gb53b6d3e.el9.x86_64 46/164 2024-09-12T02:24:39.383 INFO:teuthology.orchestra.run.smithi044.stdout: Installing : python3-jaraco-classes-3.2.1-5.el9.noarch 47/164 2024-09-12T02:24:39.408 INFO:teuthology.orchestra.run.smithi039.stdout: Installing : grpc-data-1.46.7-10.el9.noarch 66/164 2024-09-12T02:24:39.545 INFO:teuthology.orchestra.run.smithi044.stdout: Installing : socat-1.7.4.1-6.el9.x86_64 48/164 2024-09-12T02:24:39.575 INFO:teuthology.orchestra.run.smithi039.stdout: Installing : abseil-cpp-20211102.0-3.el9.x86_64 67/164 2024-09-12T02:24:39.602 INFO:teuthology.orchestra.run.smithi044.stdout: Upgrading : openssl-1:3.2.2-6.el9.x86_64 49/164 2024-09-12T02:24:39.617 INFO:teuthology.orchestra.run.smithi039.stdout: Installing : python3-grpcio-1.46.7-10.el9.x86_64 68/164 2024-09-12T02:24:39.654 INFO:teuthology.orchestra.run.smithi039.stdout: Installing : zlib-devel-1.2.11-41.el9.x86_64 69/164 2024-09-12T02:24:39.658 INFO:teuthology.orchestra.run.smithi044.stdout: Installing : python3-zc-lockfile-2.0-10.el9.noarch 50/164 2024-09-12T02:24:39.698 INFO:teuthology.orchestra.run.smithi039.stdout: Installing : xmlstarlet-1.6.1-20.el9.x86_64 70/164 2024-09-12T02:24:39.734 INFO:teuthology.orchestra.run.smithi044.stdout: Installing : python3-websocket-client-1.2.3-2.el9.noarch 51/164 2024-09-12T02:24:39.746 INFO:teuthology.orchestra.run.smithi039.stdout: Installing : uuid-1.6.2-55.el9.x86_64 71/164 2024-09-12T02:24:39.779 INFO:teuthology.orchestra.run.smithi044.stdout: Installing : python3-webob-1.8.8-2.el9.noarch 52/164 2024-09-12T02:24:39.785 INFO:teuthology.orchestra.run.smithi039.stdout: Installing : python3-wcwidth-0.2.5-8.el9.noarch 72/164 2024-09-12T02:24:39.815 INFO:teuthology.orchestra.run.smithi044.stdout: Installing : python3-typing-extensions-4.12.2-2.el9.noarch 53/164 2024-09-12T02:24:39.822 INFO:teuthology.orchestra.run.smithi039.stdout: Installing : python3-toml-0.10.2-6.el9.noarch 73/164 2024-09-12T02:24:39.857 INFO:teuthology.orchestra.run.smithi039.stdout: Installing : python3-jaraco-functools-3.5.0-2.el9.noarch 74/164 2024-09-12T02:24:39.863 INFO:teuthology.orchestra.run.smithi044.stdout: Installing : python3-repoze-lru-0.7-16.el9.noarch 54/164 2024-09-12T02:24:39.890 INFO:teuthology.orchestra.run.smithi039.stdout: Installing : python3-jaraco-text-3.2.0-6.el9.noarch 75/164 2024-09-12T02:24:39.897 INFO:teuthology.orchestra.run.smithi044.stdout: Installing : python3-routes-2.5.1-5.el9.noarch 55/164 2024-09-12T02:24:39.934 INFO:teuthology.orchestra.run.smithi039.stdout: Installing : python3-jaraco-collections-3.0.0-8.el9.noarch 76/164 2024-09-12T02:24:39.941 INFO:teuthology.orchestra.run.smithi044.stdout: Installing : python3-pyperclip-1.8.2-2.el9.noarch 56/164 2024-09-12T02:24:39.966 INFO:teuthology.orchestra.run.smithi039.stdout: Installing : python3-tempora-5.0.0-2.el9.noarch 77/164 2024-09-12T02:24:39.983 INFO:teuthology.orchestra.run.smithi044.stdout: Installing : python3-natsort-7.1.1-5.el9.noarch 57/164 2024-09-12T02:24:40.071 INFO:teuthology.orchestra.run.smithi039.stdout: Installing : python3-portend-3.1.0-2.el9.noarch 78/164 2024-09-12T02:24:40.127 INFO:teuthology.orchestra.run.smithi044.stdout: Installing : python3-logutils-0.3.5-21.el9.noarch 58/164 2024-09-12T02:24:40.134 INFO:teuthology.orchestra.run.smithi039.stdout: Installing : python3-protobuf-3.14.0-13.el9.noarch 79/164 2024-09-12T02:24:40.168 INFO:teuthology.orchestra.run.smithi044.stdout: Installing : python3-pecan-1.4.2-3.el9.noarch 59/164 2024-09-12T02:24:40.169 INFO:teuthology.orchestra.run.smithi039.stdout: Installing : python3-grpcio-tools-1.46.7-10.el9.x86_64 80/164 2024-09-12T02:24:40.218 INFO:teuthology.orchestra.run.smithi044.stdout: Installing : python3-certifi-2023.05.07-4.el9.noarch 60/164 2024-09-12T02:24:40.298 INFO:teuthology.orchestra.run.smithi039.stdout: Installing : python3-prettytable-0.7.2-27.el9.noarch 81/164 2024-09-12T02:24:40.326 INFO:teuthology.orchestra.run.smithi044.stdout: Installing : python3-cachetools-4.2.4-1.el9.noarch 61/164 2024-09-12T02:24:40.359 INFO:teuthology.orchestra.run.smithi044.stdout: Installing : python3-google-auth-1:2.34.0-1.el9.noarch 62/164 2024-09-12T02:24:40.376 INFO:teuthology.orchestra.run.smithi039.stdout: Installing : python3-oauthlib-3.1.1-5.el9.noarch 82/164 2024-09-12T02:24:40.399 INFO:teuthology.orchestra.run.smithi044.stdout: Installing : libunwind-1.6.2-1.el9.x86_64 63/164 2024-09-12T02:24:40.425 INFO:teuthology.orchestra.run.smithi044.stdout: Installing : gperftools-libs-2.9.1-2.el9.x86_64 64/164 2024-09-12T02:24:40.449 INFO:teuthology.orchestra.run.smithi044.stdout: Installing : libarrow-doc-9.0.0-11.el9.noarch 65/164 2024-09-12T02:24:40.527 INFO:teuthology.orchestra.run.smithi044.stdout: Installing : grpc-data-1.46.7-10.el9.noarch 66/164 2024-09-12T02:24:40.657 INFO:teuthology.orchestra.run.smithi044.stdout: Installing : abseil-cpp-20211102.0-3.el9.x86_64 67/164 2024-09-12T02:24:40.693 INFO:teuthology.orchestra.run.smithi044.stdout: Installing : python3-grpcio-1.46.7-10.el9.x86_64 68/164 2024-09-12T02:24:40.718 INFO:teuthology.orchestra.run.smithi044.stdout: Installing : zlib-devel-1.2.11-41.el9.x86_64 69/164 2024-09-12T02:24:40.752 INFO:teuthology.orchestra.run.smithi044.stdout: Installing : xmlstarlet-1.6.1-20.el9.x86_64 70/164 2024-09-12T02:24:40.792 INFO:teuthology.orchestra.run.smithi044.stdout: Installing : uuid-1.6.2-55.el9.x86_64 71/164 2024-09-12T02:24:40.832 INFO:teuthology.orchestra.run.smithi044.stdout: Installing : python3-wcwidth-0.2.5-8.el9.noarch 72/164 2024-09-12T02:24:40.853 INFO:teuthology.orchestra.run.smithi044.stdout: Installing : python3-toml-0.10.2-6.el9.noarch 73/164 2024-09-12T02:24:40.887 INFO:teuthology.orchestra.run.smithi044.stdout: Installing : python3-jaraco-functools-3.5.0-2.el9.noarch 74/164 2024-09-12T02:24:40.920 INFO:teuthology.orchestra.run.smithi044.stdout: Installing : python3-jaraco-text-3.2.0-6.el9.noarch 75/164 2024-09-12T02:24:40.962 INFO:teuthology.orchestra.run.smithi044.stdout: Installing : python3-jaraco-collections-3.0.0-8.el9.noarch 76/164 2024-09-12T02:24:40.996 INFO:teuthology.orchestra.run.smithi044.stdout: Installing : python3-tempora-5.0.0-2.el9.noarch 77/164 2024-09-12T02:24:41.087 INFO:teuthology.orchestra.run.smithi044.stdout: Installing : python3-portend-3.1.0-2.el9.noarch 78/164 2024-09-12T02:24:41.136 INFO:teuthology.orchestra.run.smithi044.stdout: Installing : python3-protobuf-3.14.0-13.el9.noarch 79/164 2024-09-12T02:24:41.183 INFO:teuthology.orchestra.run.smithi044.stdout: Installing : python3-grpcio-tools-1.46.7-10.el9.x86_64 80/164 2024-09-12T02:24:41.291 INFO:teuthology.orchestra.run.smithi044.stdout: Installing : python3-prettytable-0.7.2-27.el9.noarch 81/164 2024-09-12T02:24:41.325 INFO:teuthology.orchestra.run.smithi039.stdout: Installing : python3-requests-oauthlib-1.3.0-12.el9.noarch 83/164 2024-09-12T02:24:41.345 INFO:teuthology.orchestra.run.smithi044.stdout: Installing : python3-oauthlib-3.1.1-5.el9.noarch 82/164 2024-09-12T02:24:41.407 INFO:teuthology.orchestra.run.smithi039.stdout: Installing : python3-kubernetes-1:26.1.0-2.el9.noarch 84/164 2024-09-12T02:24:41.452 INFO:teuthology.orchestra.run.smithi039.stdout: Installing : python3-jsonpointer-2.0-4.el9.noarch 85/164 2024-09-12T02:24:41.571 INFO:teuthology.orchestra.run.smithi039.stdout: Installing : python3-jsonpatch-1.21-16.el9.noarch 86/164 2024-09-12T02:24:41.627 INFO:teuthology.orchestra.run.smithi039.stdout: Installing : python3-devel-3.9.19-8.el9.x86_64 87/164 2024-09-12T02:24:41.682 INFO:teuthology.orchestra.run.smithi039.stdout: Installing : python3-colorama-0.4.6-3.el9.noarch 88/164 2024-09-12T02:24:41.790 INFO:teuthology.orchestra.run.smithi039.stdout: Installing : python3-attrs-20.3.0-7.el9.noarch 89/164 2024-09-12T02:24:41.829 INFO:teuthology.orchestra.run.smithi039.stdout: Installing : python3-cmd2-2.4.2-2.el9.noarch 90/164 2024-09-12T02:24:42.078 INFO:teuthology.orchestra.run.smithi039.stdout: Installing : openblas-0.3.26-2.el9.x86_64 91/164 2024-09-12T02:24:42.109 INFO:teuthology.orchestra.run.smithi039.stdout: Installing : openblas-openmp-0.3.26-2.el9.x86_64 92/164 2024-09-12T02:24:42.113 INFO:teuthology.orchestra.run.smithi044.stdout: Installing : python3-requests-oauthlib-1.3.0-12.el9.noarch 83/164 2024-09-12T02:24:42.166 INFO:teuthology.orchestra.run.smithi044.stdout: Installing : python3-kubernetes-1:26.1.0-2.el9.noarch 84/164 2024-09-12T02:24:42.200 INFO:teuthology.orchestra.run.smithi044.stdout: Installing : python3-jsonpointer-2.0-4.el9.noarch 85/164 2024-09-12T02:24:42.207 INFO:teuthology.orchestra.run.smithi039.stdout: Installing : flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 93/164 2024-09-12T02:24:42.304 INFO:teuthology.orchestra.run.smithi044.stdout: Installing : python3-jsonpatch-1.21-16.el9.noarch 86/164 2024-09-12T02:24:42.356 INFO:teuthology.orchestra.run.smithi044.stdout: Installing : python3-devel-3.9.19-8.el9.x86_64 87/164 2024-09-12T02:24:42.401 INFO:teuthology.orchestra.run.smithi044.stdout: Installing : python3-colorama-0.4.6-3.el9.noarch 88/164 2024-09-12T02:24:42.491 INFO:teuthology.orchestra.run.smithi044.stdout: Installing : python3-attrs-20.3.0-7.el9.noarch 89/164 2024-09-12T02:24:42.527 INFO:teuthology.orchestra.run.smithi044.stdout: Installing : python3-cmd2-2.4.2-2.el9.noarch 90/164 2024-09-12T02:24:42.720 INFO:teuthology.orchestra.run.smithi044.stdout: Installing : openblas-0.3.26-2.el9.x86_64 91/164 2024-09-12T02:24:42.750 INFO:teuthology.orchestra.run.smithi044.stdout: Installing : openblas-openmp-0.3.26-2.el9.x86_64 92/164 2024-09-12T02:24:42.830 INFO:teuthology.orchestra.run.smithi044.stdout: Installing : flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 93/164 2024-09-12T02:24:43.079 INFO:teuthology.orchestra.run.smithi039.stdout: Installing : flexiblas-netlib-3.0.4-8.el9.x86_64 94/164 2024-09-12T02:24:43.228 INFO:teuthology.orchestra.run.smithi039.stdout: Installing : python3-numpy-1:1.20.1-5.el9.x86_64 95/164 2024-09-12T02:24:43.512 INFO:teuthology.orchestra.run.smithi044.stdout: Installing : flexiblas-netlib-3.0.4-8.el9.x86_64 94/164 2024-09-12T02:24:43.627 INFO:teuthology.orchestra.run.smithi044.stdout: Installing : python3-numpy-1:1.20.1-5.el9.x86_64 95/164 2024-09-12T02:24:44.888 INFO:teuthology.orchestra.run.smithi039.stdout: Installing : python3-numpy-f2py-1:1.20.1-5.el9.x86_64 96/164 2024-09-12T02:24:44.930 INFO:teuthology.orchestra.run.smithi044.stdout: Installing : python3-numpy-f2py-1:1.20.1-5.el9.x86_64 96/164 2024-09-12T02:24:44.990 INFO:teuthology.orchestra.run.smithi039.stdout: Installing : python3-scipy-1.6.2-8.el9.x86_64 97/164 2024-09-12T02:24:45.012 INFO:teuthology.orchestra.run.smithi044.stdout: Installing : python3-scipy-1.6.2-8.el9.x86_64 97/164 2024-09-12T02:24:45.027 INFO:teuthology.orchestra.run.smithi039.stdout: Installing : libzstd-devel-1.5.1-2.el9.x86_64 98/164 2024-09-12T02:24:45.040 INFO:teuthology.orchestra.run.smithi044.stdout: Installing : libzstd-devel-1.5.1-2.el9.x86_64 98/164 2024-09-12T02:24:45.060 INFO:teuthology.orchestra.run.smithi039.stdout: Installing : libuuid-devel-2.37.4-20.el9.x86_64 99/164 2024-09-12T02:24:45.073 INFO:teuthology.orchestra.run.smithi044.stdout: Installing : libuuid-devel-2.37.4-20.el9.x86_64 99/164 2024-09-12T02:24:45.392 INFO:teuthology.orchestra.run.smithi044.stdout: Installing : libpmemobj-1.12.1-1.el9.x86_64 100/164 2024-09-12T02:24:45.423 INFO:teuthology.orchestra.run.smithi039.stdout: Installing : libpmemobj-1.12.1-1.el9.x86_64 100/164 2024-09-12T02:24:45.435 INFO:teuthology.orchestra.run.smithi044.stdout: Upgrading : librbd1-2:19.1.1-298.gb53b6d3e.el9.x86_64 101/164 2024-09-12T02:24:45.462 INFO:teuthology.orchestra.run.smithi039.stdout: Upgrading : librbd1-2:19.1.1-298.gb53b6d3e.el9.x86_64 101/164 2024-09-12T02:24:45.527 INFO:teuthology.orchestra.run.smithi044.stdout: Running scriptlet: librbd1-2:19.1.1-298.gb53b6d3e.el9.x86_64 101/164 2024-09-12T02:24:45.557 INFO:teuthology.orchestra.run.smithi044.stdout: Installing : python3-rbd-2:19.1.1-298.gb53b6d3e.el9.x86_64 102/164 2024-09-12T02:24:45.559 INFO:teuthology.orchestra.run.smithi039.stdout: Running scriptlet: librbd1-2:19.1.1-298.gb53b6d3e.el9.x86_64 101/164 2024-09-12T02:24:45.594 INFO:teuthology.orchestra.run.smithi044.stdout: Installing : boost-program-options-1.75.0-8.el9.x86_64 103/164 2024-09-12T02:24:45.651 INFO:teuthology.orchestra.run.smithi039.stdout: Installing : python3-rbd-2:19.1.1-298.gb53b6d3e.el9.x86_64 102/164 2024-09-12T02:24:46.010 INFO:teuthology.orchestra.run.smithi039.stdout: Installing : boost-program-options-1.75.0-8.el9.x86_64 103/164 2024-09-12T02:24:46.099 INFO:teuthology.orchestra.run.smithi044.stdout: Installing : parquet-libs-9.0.0-11.el9.x86_64 104/164 2024-09-12T02:24:46.147 INFO:teuthology.orchestra.run.smithi044.stdout: Installing : librgw2-2:19.1.1-298.gb53b6d3e.el9.x86_64 105/164 2024-09-12T02:24:46.202 INFO:teuthology.orchestra.run.smithi044.stdout: Running scriptlet: librgw2-2:19.1.1-298.gb53b6d3e.el9.x86_64 105/164 2024-09-12T02:24:46.232 INFO:teuthology.orchestra.run.smithi044.stdout: Installing : python3-rgw-2:19.1.1-298.gb53b6d3e.el9.x86_64 106/164 2024-09-12T02:24:46.562 INFO:teuthology.orchestra.run.smithi039.stdout: Installing : parquet-libs-9.0.0-11.el9.x86_64 104/164 2024-09-12T02:24:46.591 INFO:teuthology.orchestra.run.smithi039.stdout: Installing : librgw2-2:19.1.1-298.gb53b6d3e.el9.x86_64 105/164 2024-09-12T02:24:46.682 INFO:teuthology.orchestra.run.smithi039.stdout: Running scriptlet: librgw2-2:19.1.1-298.gb53b6d3e.el9.x86_64 105/164 2024-09-12T02:24:46.709 INFO:teuthology.orchestra.run.smithi039.stdout: Installing : python3-rgw-2:19.1.1-298.gb53b6d3e.el9.x86_64 106/164 2024-09-12T02:24:48.640 INFO:teuthology.orchestra.run.smithi044.stdout: Running scriptlet: ceph-common-2:19.1.1-298.gb53b6d3e.el9.x86_64 107/164 2024-09-12T02:24:48.678 INFO:teuthology.orchestra.run.smithi044.stdout: Installing : ceph-common-2:19.1.1-298.gb53b6d3e.el9.x86_64 107/164 2024-09-12T02:24:48.894 INFO:teuthology.orchestra.run.smithi172.stdout: Running scriptlet: ceph-selinux-2:19.1.1-298.gb53b6d3e.el9.x86_64 109/164 2024-09-12T02:24:48.895 INFO:teuthology.orchestra.run.smithi172.stdout:skipping the directory /sys 2024-09-12T02:24:48.895 INFO:teuthology.orchestra.run.smithi172.stdout:skipping the directory /proc 2024-09-12T02:24:48.895 INFO:teuthology.orchestra.run.smithi172.stdout:skipping the directory /mnt 2024-09-12T02:24:48.895 INFO:teuthology.orchestra.run.smithi172.stdout:skipping the directory /var/tmp 2024-09-12T02:24:48.895 INFO:teuthology.orchestra.run.smithi172.stdout:skipping the directory /home 2024-09-12T02:24:48.895 INFO:teuthology.orchestra.run.smithi172.stdout:skipping the directory /root 2024-09-12T02:24:48.895 INFO:teuthology.orchestra.run.smithi172.stdout:skipping the directory /tmp 2024-09-12T02:24:48.895 INFO:teuthology.orchestra.run.smithi172.stdout: 2024-09-12T02:24:49.076 INFO:teuthology.orchestra.run.smithi172.stdout: Installing : ceph-volume-2:19.1.1-298.gb53b6d3e.el9.noarch 110/164 2024-09-12T02:24:49.093 INFO:teuthology.orchestra.run.smithi172.stdout: Running scriptlet: ceph-volume-2:19.1.1-298.gb53b6d3e.el9.noarch 110/164 2024-09-12T02:24:49.093 INFO:teuthology.orchestra.run.smithi172.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-12T02:24:49.093 INFO:teuthology.orchestra.run.smithi172.stdout:Invalid unit name "ceph-volume@*.service" escaped as "ceph-volume@\x2a.service". 2024-09-12T02:24:49.093 INFO:teuthology.orchestra.run.smithi172.stdout: 2024-09-12T02:24:49.253 INFO:teuthology.orchestra.run.smithi044.stdout: Running scriptlet: ceph-common-2:19.1.1-298.gb53b6d3e.el9.x86_64 107/164 2024-09-12T02:24:49.290 INFO:teuthology.orchestra.run.smithi044.stdout: Installing : ceph-base-2:19.1.1-298.gb53b6d3e.el9.x86_64 108/164 2024-09-12T02:24:49.364 INFO:teuthology.orchestra.run.smithi044.stdout: Running scriptlet: ceph-base-2:19.1.1-298.gb53b6d3e.el9.x86_64 108/164 2024-09-12T02:24:49.365 INFO:teuthology.orchestra.run.smithi044.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph.target → /usr/lib/systemd/system/ceph.target. 2024-09-12T02:24:49.365 INFO:teuthology.orchestra.run.smithi044.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-crash.service → /usr/lib/systemd/system/ceph-crash.service. 2024-09-12T02:24:49.365 INFO:teuthology.orchestra.run.smithi044.stdout: 2024-09-12T02:24:49.399 INFO:teuthology.orchestra.run.smithi044.stdout: Installing : ceph-selinux-2:19.1.1-298.gb53b6d3e.el9.x86_64 109/164 2024-09-12T02:24:49.416 INFO:teuthology.orchestra.run.smithi039.stdout: Running scriptlet: ceph-common-2:19.1.1-298.gb53b6d3e.el9.x86_64 107/164 2024-09-12T02:24:49.455 INFO:teuthology.orchestra.run.smithi039.stdout: Installing : ceph-common-2:19.1.1-298.gb53b6d3e.el9.x86_64 107/164 2024-09-12T02:24:50.119 INFO:teuthology.orchestra.run.smithi039.stdout: Running scriptlet: ceph-common-2:19.1.1-298.gb53b6d3e.el9.x86_64 107/164 2024-09-12T02:24:50.159 INFO:teuthology.orchestra.run.smithi039.stdout: Installing : ceph-base-2:19.1.1-298.gb53b6d3e.el9.x86_64 108/164 2024-09-12T02:24:50.306 INFO:teuthology.orchestra.run.smithi039.stdout: Running scriptlet: ceph-base-2:19.1.1-298.gb53b6d3e.el9.x86_64 108/164 2024-09-12T02:24:50.306 INFO:teuthology.orchestra.run.smithi039.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph.target → /usr/lib/systemd/system/ceph.target. 2024-09-12T02:24:50.306 INFO:teuthology.orchestra.run.smithi039.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-crash.service → /usr/lib/systemd/system/ceph-crash.service. 2024-09-12T02:24:50.306 INFO:teuthology.orchestra.run.smithi039.stdout: 2024-09-12T02:24:50.352 INFO:teuthology.orchestra.run.smithi039.stdout: Installing : ceph-selinux-2:19.1.1-298.gb53b6d3e.el9.x86_64 109/164 2024-09-12T02:24:50.586 INFO:teuthology.orchestra.run.smithi172.stdout: Installing : ceph-osd-2:19.1.1-298.gb53b6d3e.el9.x86_64 111/164 2024-09-12T02:24:50.613 INFO:teuthology.orchestra.run.smithi172.stdout: Running scriptlet: ceph-osd-2:19.1.1-298.gb53b6d3e.el9.x86_64 111/164 2024-09-12T02:24:50.613 INFO:teuthology.orchestra.run.smithi172.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-12T02:24:50.613 INFO:teuthology.orchestra.run.smithi172.stdout:Invalid unit name "ceph-osd@*.service" escaped as "ceph-osd@\x2a.service". 2024-09-12T02:24:50.614 INFO:teuthology.orchestra.run.smithi172.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-osd.target → /usr/lib/systemd/system/ceph-osd.target. 2024-09-12T02:24:50.614 INFO:teuthology.orchestra.run.smithi172.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-osd.target → /usr/lib/systemd/system/ceph-osd.target. 2024-09-12T02:24:50.614 INFO:teuthology.orchestra.run.smithi172.stdout: 2024-09-12T02:24:50.870 INFO:teuthology.orchestra.run.smithi172.stdout: Installing : ceph-mds-2:19.1.1-298.gb53b6d3e.el9.x86_64 112/164 2024-09-12T02:24:50.894 INFO:teuthology.orchestra.run.smithi172.stdout: Running scriptlet: ceph-mds-2:19.1.1-298.gb53b6d3e.el9.x86_64 112/164 2024-09-12T02:24:50.894 INFO:teuthology.orchestra.run.smithi172.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-12T02:24:50.894 INFO:teuthology.orchestra.run.smithi172.stdout:Invalid unit name "ceph-mds@*.service" escaped as "ceph-mds@\x2a.service". 2024-09-12T02:24:50.894 INFO:teuthology.orchestra.run.smithi172.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mds.target → /usr/lib/systemd/system/ceph-mds.target. 2024-09-12T02:24:50.894 INFO:teuthology.orchestra.run.smithi172.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mds.target → /usr/lib/systemd/system/ceph-mds.target. 2024-09-12T02:24:50.895 INFO:teuthology.orchestra.run.smithi172.stdout: 2024-09-12T02:24:51.329 INFO:teuthology.orchestra.run.smithi172.stdout: Installing : ceph-mon-2:19.1.1-298.gb53b6d3e.el9.x86_64 113/164 2024-09-12T02:24:51.353 INFO:teuthology.orchestra.run.smithi172.stdout: Running scriptlet: ceph-mon-2:19.1.1-298.gb53b6d3e.el9.x86_64 113/164 2024-09-12T02:24:51.353 INFO:teuthology.orchestra.run.smithi172.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-12T02:24:51.353 INFO:teuthology.orchestra.run.smithi172.stdout:Invalid unit name "ceph-mon@*.service" escaped as "ceph-mon@\x2a.service". 2024-09-12T02:24:51.353 INFO:teuthology.orchestra.run.smithi172.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mon.target → /usr/lib/systemd/system/ceph-mon.target. 2024-09-12T02:24:51.353 INFO:teuthology.orchestra.run.smithi172.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mon.target → /usr/lib/systemd/system/ceph-mon.target. 2024-09-12T02:24:51.353 INFO:teuthology.orchestra.run.smithi172.stdout: 2024-09-12T02:24:51.451 INFO:teuthology.orchestra.run.smithi172.stdout: Installing : automake-1.16.2-8.el9.noarch 114/164 2024-09-12T02:24:51.507 INFO:teuthology.orchestra.run.smithi172.stdout: Installing : python3-ply-3.11-14.el9.noarch 115/164 2024-09-12T02:24:51.571 INFO:teuthology.orchestra.run.smithi172.stdout: Installing : python3-pycparser-2.20-6.el9.noarch 116/164 2024-09-12T02:24:51.759 INFO:teuthology.orchestra.run.smithi172.stdout: Installing : python3-cffi-1.14.5-5.el9.x86_64 117/164 2024-09-12T02:24:51.805 INFO:teuthology.orchestra.run.smithi172.stdout: Installing : python3-cryptography-36.0.1-4.el9.x86_64 118/164 2024-09-12T02:24:51.882 INFO:teuthology.orchestra.run.smithi172.stdout: Installing : python3-pyOpenSSL-21.0.0-1.el9.noarch 119/164 2024-09-12T02:24:51.979 INFO:teuthology.orchestra.run.smithi172.stdout: Installing : python3-cheroot-8.6.0-4.el9.noarch 120/164 2024-09-12T02:24:52.127 INFO:teuthology.orchestra.run.smithi172.stdout: Installing : python3-cherrypy-18.6.1-2.el9.noarch 121/164 2024-09-12T02:24:52.179 INFO:teuthology.orchestra.run.smithi172.stdout: Installing : python3-asyncssh-2.13.2-5.el9.noarch 122/164 2024-09-12T02:24:52.211 INFO:teuthology.orchestra.run.smithi172.stdout: Installing : python3-bcrypt-3.2.2-1.el9.x86_64 123/164 2024-09-12T02:24:52.239 INFO:teuthology.orchestra.run.smithi172.stdout: Installing : fuse-2.9.9-16.el9.x86_64 124/164 2024-09-12T02:24:52.656 INFO:teuthology.orchestra.run.smithi172.stdout: Running scriptlet: cephadm-2:19.1.1-298.gb53b6d3e.el9.noarch 125/164 2024-09-12T02:24:52.696 INFO:teuthology.orchestra.run.smithi172.stdout: Installing : cephadm-2:19.1.1-298.gb53b6d3e.el9.noarch 125/164 2024-09-12T02:24:52.727 INFO:teuthology.orchestra.run.smithi172.stdout: Installing : ceph-prometheus-alerts-2:19.1.1-298.gb53b6d3e.el 126/164 2024-09-12T02:24:52.789 INFO:teuthology.orchestra.run.smithi172.stdout: Installing : ceph-grafana-dashboards-2:19.1.1-298.gb53b6d3e.e 127/164 2024-09-12T02:24:52.819 INFO:teuthology.orchestra.run.smithi172.stdout: Installing : ceph-mgr-cephadm-2:19.1.1-298.gb53b6d3e.el9.noar 128/164 2024-09-12T02:24:53.874 INFO:teuthology.orchestra.run.smithi172.stdout: Running scriptlet: ceph-mgr-cephadm-2:19.1.1-298.gb53b6d3e.el9.noar 128/164 2024-09-12T02:24:53.912 INFO:teuthology.orchestra.run.smithi172.stdout: Installing : ceph-mgr-dashboard-2:19.1.1-298.gb53b6d3e.el9.no 129/164 2024-09-12T02:24:54.881 INFO:teuthology.orchestra.run.smithi172.stdout: Running scriptlet: ceph-mgr-dashboard-2:19.1.1-298.gb53b6d3e.el9.no 129/164 2024-09-12T02:24:54.912 INFO:teuthology.orchestra.run.smithi172.stdout: Installing : ceph-mgr-diskprediction-local-2:19.1.1-298.gb53b 130/164 2024-09-12T02:24:55.016 INFO:teuthology.orchestra.run.smithi172.stdout: Running scriptlet: ceph-mgr-diskprediction-local-2:19.1.1-298.gb53b 130/164 2024-09-12T02:24:55.174 INFO:teuthology.orchestra.run.smithi172.stdout: Installing : ceph-mgr-modules-core-2:19.1.1-298.gb53b6d3e.el9 131/164 2024-09-12T02:24:55.198 INFO:teuthology.orchestra.run.smithi172.stdout: Installing : ceph-mgr-2:19.1.1-298.gb53b6d3e.el9.x86_64 132/164 2024-09-12T02:24:55.222 INFO:teuthology.orchestra.run.smithi172.stdout: Running scriptlet: ceph-mgr-2:19.1.1-298.gb53b6d3e.el9.x86_64 132/164 2024-09-12T02:24:55.222 INFO:teuthology.orchestra.run.smithi172.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-12T02:24:55.222 INFO:teuthology.orchestra.run.smithi172.stdout:Invalid unit name "ceph-mgr@*.service" escaped as "ceph-mgr@\x2a.service". 2024-09-12T02:24:55.222 INFO:teuthology.orchestra.run.smithi172.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mgr.target → /usr/lib/systemd/system/ceph-mgr.target. 2024-09-12T02:24:55.222 INFO:teuthology.orchestra.run.smithi172.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mgr.target → /usr/lib/systemd/system/ceph-mgr.target. 2024-09-12T02:24:55.222 INFO:teuthology.orchestra.run.smithi172.stdout: 2024-09-12T02:24:55.274 INFO:teuthology.orchestra.run.smithi172.stdout: Installing : ceph-mgr-rook-2:19.1.1-298.gb53b6d3e.el9.noarch 133/164 2024-09-12T02:24:55.286 INFO:teuthology.orchestra.run.smithi172.stdout: Running scriptlet: ceph-mgr-rook-2:19.1.1-298.gb53b6d3e.el9.noarch 133/164 2024-09-12T02:24:55.383 INFO:teuthology.orchestra.run.smithi172.stdout: Installing : ceph-2:19.1.1-298.gb53b6d3e.el9.x86_64 134/164 2024-09-12T02:24:55.430 INFO:teuthology.orchestra.run.smithi172.stdout: Installing : ceph-fuse-2:19.1.1-298.gb53b6d3e.el9.x86_64 135/164 2024-09-12T02:24:56.357 INFO:teuthology.orchestra.run.smithi172.stdout: Installing : libtool-2.4.6-46.el9.x86_64 136/164 2024-09-12T02:24:56.401 INFO:teuthology.orchestra.run.smithi172.stdout: Installing : ceph-radosgw-2:19.1.1-298.gb53b6d3e.el9.x86_64 137/164 2024-09-12T02:24:56.634 INFO:teuthology.orchestra.run.smithi172.stdout: Running scriptlet: ceph-radosgw-2:19.1.1-298.gb53b6d3e.el9.x86_64 137/164 2024-09-12T02:24:56.634 INFO:teuthology.orchestra.run.smithi172.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-12T02:24:56.634 INFO:teuthology.orchestra.run.smithi172.stdout:Invalid unit name "ceph-radosgw@*.service" escaped as "ceph-radosgw@\x2a.service". 2024-09-12T02:24:56.634 INFO:teuthology.orchestra.run.smithi172.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-radosgw.target → /usr/lib/systemd/system/ceph-radosgw.target. 2024-09-12T02:24:56.634 INFO:teuthology.orchestra.run.smithi172.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-radosgw.target → /usr/lib/systemd/system/ceph-radosgw.target. 2024-09-12T02:24:56.635 INFO:teuthology.orchestra.run.smithi172.stdout: 2024-09-12T02:24:56.635 INFO:teuthology.orchestra.run.smithi172.stdout: Installing : ceph-immutable-object-cache-2:19.1.1-298.gb53b6d 138/164 2024-09-12T02:24:56.635 INFO:teuthology.orchestra.run.smithi172.stdout: Running scriptlet: ceph-immutable-object-cache-2:19.1.1-298.gb53b6d 138/164 2024-09-12T02:24:56.635 INFO:teuthology.orchestra.run.smithi172.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-12T02:24:56.635 INFO:teuthology.orchestra.run.smithi172.stdout:Invalid unit name "ceph-immutable-object-cache@*.service" escaped as "ceph-immutable-object-cache@\x2a.service". 2024-09-12T02:24:56.635 INFO:teuthology.orchestra.run.smithi172.stdout: 2024-09-12T02:24:56.635 INFO:teuthology.orchestra.run.smithi172.stdout: Installing : cephfs-mirror-2:19.1.1-298.gb53b6d3e.el9.x86_64 139/164 2024-09-12T02:24:56.635 INFO:teuthology.orchestra.run.smithi172.stdout: Running scriptlet: cephfs-mirror-2:19.1.1-298.gb53b6d3e.el9.x86_64 139/164 2024-09-12T02:24:56.635 INFO:teuthology.orchestra.run.smithi172.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-12T02:24:56.635 INFO:teuthology.orchestra.run.smithi172.stdout:Invalid unit name "cephfs-mirror@*.service" escaped as "cephfs-mirror@\x2a.service". 2024-09-12T02:24:56.635 INFO:teuthology.orchestra.run.smithi172.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/cephfs-mirror.target → /usr/lib/systemd/system/cephfs-mirror.target. 2024-09-12T02:24:56.635 INFO:teuthology.orchestra.run.smithi172.stdout:Created symlink /etc/systemd/system/ceph.target.wants/cephfs-mirror.target → /usr/lib/systemd/system/cephfs-mirror.target. 2024-09-12T02:24:56.636 INFO:teuthology.orchestra.run.smithi172.stdout: 2024-09-12T02:24:56.861 INFO:teuthology.orchestra.run.smithi172.stdout: Installing : rbd-mirror-2:19.1.1-298.gb53b6d3e.el9.x86_64 140/164 2024-09-12T02:24:56.884 INFO:teuthology.orchestra.run.smithi172.stdout: Running scriptlet: rbd-mirror-2:19.1.1-298.gb53b6d3e.el9.x86_64 140/164 2024-09-12T02:24:56.884 INFO:teuthology.orchestra.run.smithi172.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-12T02:24:56.885 INFO:teuthology.orchestra.run.smithi172.stdout:Invalid unit name "ceph-rbd-mirror@*.service" escaped as "ceph-rbd-mirror@\x2a.service". 2024-09-12T02:24:56.885 INFO:teuthology.orchestra.run.smithi172.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-rbd-mirror.target → /usr/lib/systemd/system/ceph-rbd-mirror.target. 2024-09-12T02:24:56.885 INFO:teuthology.orchestra.run.smithi172.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-rbd-mirror.target → /usr/lib/systemd/system/ceph-rbd-mirror.target. 2024-09-12T02:24:56.885 INFO:teuthology.orchestra.run.smithi172.stdout: 2024-09-12T02:25:01.431 INFO:teuthology.orchestra.run.smithi172.stdout: Installing : ceph-test-2:19.1.1-298.gb53b6d3e.el9.x86_64 141/164 2024-09-12T02:25:01.472 INFO:teuthology.orchestra.run.smithi172.stdout: Installing : rbd-fuse-2:19.1.1-298.gb53b6d3e.el9.x86_64 142/164 2024-09-12T02:25:01.513 INFO:teuthology.orchestra.run.smithi172.stdout: Installing : rbd-nbd-2:19.1.1-298.gb53b6d3e.el9.x86_64 143/164 2024-09-12T02:25:01.545 INFO:teuthology.orchestra.run.smithi172.stdout: Installing : xfsprogs-devel-6.4.0-4.el9.x86_64 144/164 2024-09-12T02:25:01.572 INFO:teuthology.orchestra.run.smithi172.stdout: Installing : elfutils-libelf-devel-0.191-4.el9.x86_64 145/164 2024-09-12T02:25:01.715 INFO:teuthology.orchestra.run.smithi044.stdout: Running scriptlet: ceph-selinux-2:19.1.1-298.gb53b6d3e.el9.x86_64 109/164 2024-09-12T02:25:01.715 INFO:teuthology.orchestra.run.smithi044.stdout:skipping the directory /sys 2024-09-12T02:25:01.715 INFO:teuthology.orchestra.run.smithi044.stdout:skipping the directory /proc 2024-09-12T02:25:01.715 INFO:teuthology.orchestra.run.smithi044.stdout:skipping the directory /mnt 2024-09-12T02:25:01.715 INFO:teuthology.orchestra.run.smithi044.stdout:skipping the directory /var/tmp 2024-09-12T02:25:01.715 INFO:teuthology.orchestra.run.smithi044.stdout:skipping the directory /home 2024-09-12T02:25:01.715 INFO:teuthology.orchestra.run.smithi044.stdout:skipping the directory /root 2024-09-12T02:25:01.716 INFO:teuthology.orchestra.run.smithi044.stdout:skipping the directory /tmp 2024-09-12T02:25:01.716 INFO:teuthology.orchestra.run.smithi044.stdout: 2024-09-12T02:25:01.755 INFO:teuthology.orchestra.run.smithi172.stdout: Installing : cephfs-shell-2:19.1.1-298.gb53b6d3e.el9.x86_64 146/164 2024-09-12T02:25:01.819 INFO:teuthology.orchestra.run.smithi172.stdout: Installing : postgresql-contrib-13.16-1.el9.x86_64 147/164 2024-09-12T02:25:01.849 INFO:teuthology.orchestra.run.smithi172.stdout: Installing : libcephfs-devel-2:19.1.1-298.gb53b6d3e.el9.x86_6 148/164 2024-09-12T02:25:01.879 INFO:teuthology.orchestra.run.smithi172.stdout: Upgrading : NetworkManager-team-1:1.49.90-1.el9.x86_64 149/164 2024-09-12T02:25:01.886 INFO:teuthology.orchestra.run.smithi044.stdout: Installing : ceph-volume-2:19.1.1-298.gb53b6d3e.el9.noarch 110/164 2024-09-12T02:25:01.908 INFO:teuthology.orchestra.run.smithi044.stdout: Running scriptlet: ceph-volume-2:19.1.1-298.gb53b6d3e.el9.noarch 110/164 2024-09-12T02:25:01.908 INFO:teuthology.orchestra.run.smithi044.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-12T02:25:01.908 INFO:teuthology.orchestra.run.smithi044.stdout:Invalid unit name "ceph-volume@*.service" escaped as "ceph-volume@\x2a.service". 2024-09-12T02:25:01.908 INFO:teuthology.orchestra.run.smithi044.stdout: 2024-09-12T02:25:01.916 INFO:teuthology.orchestra.run.smithi172.stdout: Upgrading : NetworkManager-tui-1:1.49.90-1.el9.x86_64 150/164 2024-09-12T02:25:02.556 INFO:teuthology.orchestra.run.smithi172.stdout: Running scriptlet: postgresql-server-13.16-1.el9.x86_64 151/164 2024-09-12T02:25:02.597 INFO:teuthology.orchestra.run.smithi172.stdout: Installing : postgresql-server-13.16-1.el9.x86_64 151/164 2024-09-12T02:25:02.617 INFO:teuthology.orchestra.run.smithi172.stdout: Running scriptlet: postgresql-server-13.16-1.el9.x86_64 151/164 2024-09-12T02:25:03.448 INFO:teuthology.orchestra.run.smithi044.stdout: Installing : ceph-osd-2:19.1.1-298.gb53b6d3e.el9.x86_64 111/164 2024-09-12T02:25:03.462 INFO:teuthology.orchestra.run.smithi172.stdout: Installing : cephfs-top-2:19.1.1-298.gb53b6d3e.el9.noarch 152/164 2024-09-12T02:25:03.474 INFO:teuthology.orchestra.run.smithi044.stdout: Running scriptlet: ceph-osd-2:19.1.1-298.gb53b6d3e.el9.x86_64 111/164 2024-09-12T02:25:03.474 INFO:teuthology.orchestra.run.smithi044.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-12T02:25:03.474 INFO:teuthology.orchestra.run.smithi044.stdout:Invalid unit name "ceph-osd@*.service" escaped as "ceph-osd@\x2a.service". 2024-09-12T02:25:03.474 INFO:teuthology.orchestra.run.smithi044.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-osd.target → /usr/lib/systemd/system/ceph-osd.target. 2024-09-12T02:25:03.474 INFO:teuthology.orchestra.run.smithi044.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-osd.target → /usr/lib/systemd/system/ceph-osd.target. 2024-09-12T02:25:03.474 INFO:teuthology.orchestra.run.smithi044.stdout: 2024-09-12T02:25:03.560 INFO:teuthology.orchestra.run.smithi172.stdout: Installing : openssl-devel-1:3.2.2-6.el9.x86_64 153/164 2024-09-12T02:25:03.601 INFO:teuthology.orchestra.run.smithi172.stdout: Installing : libaio-devel-0.3.111-13.el9.x86_64 154/164 2024-09-12T02:25:03.635 INFO:teuthology.orchestra.run.smithi039.stdout: Running scriptlet: ceph-selinux-2:19.1.1-298.gb53b6d3e.el9.x86_64 109/164 2024-09-12T02:25:03.635 INFO:teuthology.orchestra.run.smithi039.stdout:skipping the directory /sys 2024-09-12T02:25:03.635 INFO:teuthology.orchestra.run.smithi039.stdout:skipping the directory /proc 2024-09-12T02:25:03.635 INFO:teuthology.orchestra.run.smithi039.stdout:skipping the directory /mnt 2024-09-12T02:25:03.635 INFO:teuthology.orchestra.run.smithi039.stdout:skipping the directory /var/tmp 2024-09-12T02:25:03.635 INFO:teuthology.orchestra.run.smithi039.stdout:skipping the directory /home 2024-09-12T02:25:03.635 INFO:teuthology.orchestra.run.smithi039.stdout:skipping the directory /root 2024-09-12T02:25:03.635 INFO:teuthology.orchestra.run.smithi039.stdout:skipping the directory /tmp 2024-09-12T02:25:03.636 INFO:teuthology.orchestra.run.smithi039.stdout: 2024-09-12T02:25:03.682 INFO:teuthology.orchestra.run.smithi172.stdout: Installing : flex-2.6.4-9.el9.x86_64 155/164 2024-09-12T02:25:03.713 INFO:teuthology.orchestra.run.smithi172.stdout: Installing : bison-3.7.4-5.el9.x86_64 156/164 2024-09-12T02:25:03.715 INFO:teuthology.orchestra.run.smithi044.stdout: Installing : ceph-mds-2:19.1.1-298.gb53b6d3e.el9.x86_64 112/164 2024-09-12T02:25:03.738 INFO:teuthology.orchestra.run.smithi044.stdout: Running scriptlet: ceph-mds-2:19.1.1-298.gb53b6d3e.el9.x86_64 112/164 2024-09-12T02:25:03.738 INFO:teuthology.orchestra.run.smithi044.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-12T02:25:03.738 INFO:teuthology.orchestra.run.smithi044.stdout:Invalid unit name "ceph-mds@*.service" escaped as "ceph-mds@\x2a.service". 2024-09-12T02:25:03.738 INFO:teuthology.orchestra.run.smithi044.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mds.target → /usr/lib/systemd/system/ceph-mds.target. 2024-09-12T02:25:03.738 INFO:teuthology.orchestra.run.smithi044.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mds.target → /usr/lib/systemd/system/ceph-mds.target. 2024-09-12T02:25:03.738 INFO:teuthology.orchestra.run.smithi044.stdout: 2024-09-12T02:25:03.746 INFO:teuthology.orchestra.run.smithi172.stdout: Cleanup : NetworkManager-tui-1:1.48.8-1.el9.x86_64 157/164 2024-09-12T02:25:03.772 INFO:teuthology.orchestra.run.smithi172.stdout: Cleanup : openssl-1:3.2.2-4.el9.x86_64 158/164 2024-09-12T02:25:03.773 INFO:teuthology.orchestra.run.smithi172.stdout: Cleanup : librbd1-2:16.2.4-5.el9.x86_64 159/164 2024-09-12T02:25:03.849 INFO:teuthology.orchestra.run.smithi039.stdout: Installing : ceph-volume-2:19.1.1-298.gb53b6d3e.el9.noarch 110/164 2024-09-12T02:25:03.865 INFO:teuthology.orchestra.run.smithi172.stdout: Running scriptlet: librbd1-2:16.2.4-5.el9.x86_64 159/164 2024-09-12T02:25:03.865 INFO:teuthology.orchestra.run.smithi172.stdout: Cleanup : librados2-2:16.2.4-5.el9.x86_64 160/164 2024-09-12T02:25:03.885 INFO:teuthology.orchestra.run.smithi039.stdout: Running scriptlet: ceph-volume-2:19.1.1-298.gb53b6d3e.el9.noarch 110/164 2024-09-12T02:25:03.885 INFO:teuthology.orchestra.run.smithi039.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-12T02:25:03.885 INFO:teuthology.orchestra.run.smithi039.stdout:Invalid unit name "ceph-volume@*.service" escaped as "ceph-volume@\x2a.service". 2024-09-12T02:25:03.885 INFO:teuthology.orchestra.run.smithi039.stdout: 2024-09-12T02:25:03.949 INFO:teuthology.orchestra.run.smithi172.stdout: Running scriptlet: librados2-2:16.2.4-5.el9.x86_64 160/164 2024-09-12T02:25:03.965 INFO:teuthology.orchestra.run.smithi172.stdout: Cleanup : NetworkManager-team-1:1.48.8-1.el9.x86_64 161/164 2024-09-12T02:25:03.971 INFO:teuthology.orchestra.run.smithi172.stdout: Running scriptlet: NetworkManager-1:1.48.8-1.el9.x86_64 162/164 2024-09-12T02:25:03.971 INFO:teuthology.orchestra.run.smithi172.stdout: Cleanup : NetworkManager-1:1.48.8-1.el9.x86_64 162/164 2024-09-12T02:25:04.151 INFO:teuthology.orchestra.run.smithi172.stdout: Running scriptlet: NetworkManager-1:1.48.8-1.el9.x86_64 162/164 2024-09-12T02:25:04.151 INFO:teuthology.orchestra.run.smithi172.stdout: Cleanup : NetworkManager-libnm-1:1.48.8-1.el9.x86_64 163/164 2024-09-12T02:25:04.199 INFO:teuthology.orchestra.run.smithi044.stdout: Installing : ceph-mon-2:19.1.1-298.gb53b6d3e.el9.x86_64 113/164 2024-09-12T02:25:04.222 INFO:teuthology.orchestra.run.smithi044.stdout: Running scriptlet: ceph-mon-2:19.1.1-298.gb53b6d3e.el9.x86_64 113/164 2024-09-12T02:25:04.222 INFO:teuthology.orchestra.run.smithi044.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-12T02:25:04.222 INFO:teuthology.orchestra.run.smithi044.stdout:Invalid unit name "ceph-mon@*.service" escaped as "ceph-mon@\x2a.service". 2024-09-12T02:25:04.222 INFO:teuthology.orchestra.run.smithi044.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mon.target → /usr/lib/systemd/system/ceph-mon.target. 2024-09-12T02:25:04.222 INFO:teuthology.orchestra.run.smithi044.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mon.target → /usr/lib/systemd/system/ceph-mon.target. 2024-09-12T02:25:04.222 INFO:teuthology.orchestra.run.smithi044.stdout: 2024-09-12T02:25:04.236 INFO:teuthology.orchestra.run.smithi172.stdout: Running scriptlet: NetworkManager-libnm-1:1.48.8-1.el9.x86_64 163/164 2024-09-12T02:25:04.298 INFO:teuthology.orchestra.run.smithi172.stdout: Cleanup : openssl-libs-1:3.2.2-4.el9.x86_64 164/164 2024-09-12T02:25:04.346 INFO:teuthology.orchestra.run.smithi044.stdout: Installing : automake-1.16.2-8.el9.noarch 114/164 2024-09-12T02:25:04.405 INFO:teuthology.orchestra.run.smithi044.stdout: Installing : python3-ply-3.11-14.el9.noarch 115/164 2024-09-12T02:25:04.469 INFO:teuthology.orchestra.run.smithi044.stdout: Installing : python3-pycparser-2.20-6.el9.noarch 116/164 2024-09-12T02:25:04.664 INFO:teuthology.orchestra.run.smithi044.stdout: Installing : python3-cffi-1.14.5-5.el9.x86_64 117/164 2024-09-12T02:25:04.717 INFO:teuthology.orchestra.run.smithi044.stdout: Installing : python3-cryptography-36.0.1-4.el9.x86_64 118/164 2024-09-12T02:25:04.798 INFO:teuthology.orchestra.run.smithi044.stdout: Installing : python3-pyOpenSSL-21.0.0-1.el9.noarch 119/164 2024-09-12T02:25:04.897 INFO:teuthology.orchestra.run.smithi044.stdout: Installing : python3-cheroot-8.6.0-4.el9.noarch 120/164 2024-09-12T02:25:05.040 INFO:teuthology.orchestra.run.smithi044.stdout: Installing : python3-cherrypy-18.6.1-2.el9.noarch 121/164 2024-09-12T02:25:05.084 INFO:teuthology.orchestra.run.smithi044.stdout: Installing : python3-asyncssh-2.13.2-5.el9.noarch 122/164 2024-09-12T02:25:05.115 INFO:teuthology.orchestra.run.smithi044.stdout: Installing : python3-bcrypt-3.2.2-1.el9.x86_64 123/164 2024-09-12T02:25:05.143 INFO:teuthology.orchestra.run.smithi044.stdout: Installing : fuse-2.9.9-16.el9.x86_64 124/164 2024-09-12T02:25:05.533 INFO:teuthology.orchestra.run.smithi039.stdout: Installing : ceph-osd-2:19.1.1-298.gb53b6d3e.el9.x86_64 111/164 2024-09-12T02:25:05.592 INFO:teuthology.orchestra.run.smithi039.stdout: Running scriptlet: ceph-osd-2:19.1.1-298.gb53b6d3e.el9.x86_64 111/164 2024-09-12T02:25:05.593 INFO:teuthology.orchestra.run.smithi039.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-12T02:25:05.593 INFO:teuthology.orchestra.run.smithi039.stdout:Invalid unit name "ceph-osd@*.service" escaped as "ceph-osd@\x2a.service". 2024-09-12T02:25:05.593 INFO:teuthology.orchestra.run.smithi039.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-osd.target → /usr/lib/systemd/system/ceph-osd.target. 2024-09-12T02:25:05.593 INFO:teuthology.orchestra.run.smithi039.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-osd.target → /usr/lib/systemd/system/ceph-osd.target. 2024-09-12T02:25:05.593 INFO:teuthology.orchestra.run.smithi039.stdout: 2024-09-12T02:25:05.594 INFO:teuthology.orchestra.run.smithi044.stdout: Running scriptlet: cephadm-2:19.1.1-298.gb53b6d3e.el9.noarch 125/164 2024-09-12T02:25:05.625 INFO:teuthology.orchestra.run.smithi044.stdout: Installing : cephadm-2:19.1.1-298.gb53b6d3e.el9.noarch 125/164 2024-09-12T02:25:05.657 INFO:teuthology.orchestra.run.smithi044.stdout: Installing : ceph-prometheus-alerts-2:19.1.1-298.gb53b6d3e.el 126/164 2024-09-12T02:25:05.721 INFO:teuthology.orchestra.run.smithi044.stdout: Installing : ceph-grafana-dashboards-2:19.1.1-298.gb53b6d3e.e 127/164 2024-09-12T02:25:05.748 INFO:teuthology.orchestra.run.smithi044.stdout: Installing : ceph-mgr-cephadm-2:19.1.1-298.gb53b6d3e.el9.noar 128/164 2024-09-12T02:25:05.859 INFO:teuthology.orchestra.run.smithi039.stdout: Installing : ceph-mds-2:19.1.1-298.gb53b6d3e.el9.x86_64 112/164 2024-09-12T02:25:05.911 INFO:teuthology.orchestra.run.smithi039.stdout: Running scriptlet: ceph-mds-2:19.1.1-298.gb53b6d3e.el9.x86_64 112/164 2024-09-12T02:25:05.911 INFO:teuthology.orchestra.run.smithi039.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-12T02:25:05.911 INFO:teuthology.orchestra.run.smithi039.stdout:Invalid unit name "ceph-mds@*.service" escaped as "ceph-mds@\x2a.service". 2024-09-12T02:25:05.911 INFO:teuthology.orchestra.run.smithi039.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mds.target → /usr/lib/systemd/system/ceph-mds.target. 2024-09-12T02:25:05.911 INFO:teuthology.orchestra.run.smithi039.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mds.target → /usr/lib/systemd/system/ceph-mds.target. 2024-09-12T02:25:05.911 INFO:teuthology.orchestra.run.smithi039.stdout: 2024-09-12T02:25:06.418 INFO:teuthology.orchestra.run.smithi039.stdout: Installing : ceph-mon-2:19.1.1-298.gb53b6d3e.el9.x86_64 113/164 2024-09-12T02:25:06.469 INFO:teuthology.orchestra.run.smithi039.stdout: Running scriptlet: ceph-mon-2:19.1.1-298.gb53b6d3e.el9.x86_64 113/164 2024-09-12T02:25:06.470 INFO:teuthology.orchestra.run.smithi039.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-12T02:25:06.470 INFO:teuthology.orchestra.run.smithi039.stdout:Invalid unit name "ceph-mon@*.service" escaped as "ceph-mon@\x2a.service". 2024-09-12T02:25:06.470 INFO:teuthology.orchestra.run.smithi039.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mon.target → /usr/lib/systemd/system/ceph-mon.target. 2024-09-12T02:25:06.470 INFO:teuthology.orchestra.run.smithi039.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mon.target → /usr/lib/systemd/system/ceph-mon.target. 2024-09-12T02:25:06.470 INFO:teuthology.orchestra.run.smithi039.stdout: 2024-09-12T02:25:06.602 INFO:teuthology.orchestra.run.smithi039.stdout: Installing : automake-1.16.2-8.el9.noarch 114/164 2024-09-12T02:25:06.664 INFO:teuthology.orchestra.run.smithi039.stdout: Installing : python3-ply-3.11-14.el9.noarch 115/164 2024-09-12T02:25:06.745 INFO:teuthology.orchestra.run.smithi039.stdout: Installing : python3-pycparser-2.20-6.el9.noarch 116/164 2024-09-12T02:25:06.857 INFO:teuthology.orchestra.run.smithi044.stdout: Running scriptlet: ceph-mgr-cephadm-2:19.1.1-298.gb53b6d3e.el9.noar 128/164 2024-09-12T02:25:06.891 INFO:teuthology.orchestra.run.smithi044.stdout: Installing : ceph-mgr-dashboard-2:19.1.1-298.gb53b6d3e.el9.no 129/164 2024-09-12T02:25:06.982 INFO:teuthology.orchestra.run.smithi039.stdout: Installing : python3-cffi-1.14.5-5.el9.x86_64 117/164 2024-09-12T02:25:07.048 INFO:teuthology.orchestra.run.smithi039.stdout: Installing : python3-cryptography-36.0.1-4.el9.x86_64 118/164 2024-09-12T02:25:07.138 INFO:teuthology.orchestra.run.smithi039.stdout: Installing : python3-pyOpenSSL-21.0.0-1.el9.noarch 119/164 2024-09-12T02:25:07.247 INFO:teuthology.orchestra.run.smithi039.stdout: Installing : python3-cheroot-8.6.0-4.el9.noarch 120/164 2024-09-12T02:25:07.425 INFO:teuthology.orchestra.run.smithi039.stdout: Installing : python3-cherrypy-18.6.1-2.el9.noarch 121/164 2024-09-12T02:25:07.490 INFO:teuthology.orchestra.run.smithi039.stdout: Installing : python3-asyncssh-2.13.2-5.el9.noarch 122/164 2024-09-12T02:25:07.528 INFO:teuthology.orchestra.run.smithi039.stdout: Installing : python3-bcrypt-3.2.2-1.el9.x86_64 123/164 2024-09-12T02:25:07.553 INFO:teuthology.orchestra.run.smithi039.stdout: Installing : fuse-2.9.9-16.el9.x86_64 124/164 2024-09-12T02:25:07.912 INFO:teuthology.orchestra.run.smithi044.stdout: Running scriptlet: ceph-mgr-dashboard-2:19.1.1-298.gb53b6d3e.el9.no 129/164 2024-09-12T02:25:07.933 INFO:teuthology.orchestra.run.smithi044.stdout: Installing : ceph-mgr-diskprediction-local-2:19.1.1-298.gb53b 130/164 2024-09-12T02:25:08.041 INFO:teuthology.orchestra.run.smithi044.stdout: Running scriptlet: ceph-mgr-diskprediction-local-2:19.1.1-298.gb53b 130/164 2024-09-12T02:25:08.057 INFO:teuthology.orchestra.run.smithi039.stdout: Running scriptlet: cephadm-2:19.1.1-298.gb53b6d3e.el9.noarch 125/164 2024-09-12T02:25:08.095 INFO:teuthology.orchestra.run.smithi039.stdout: Installing : cephadm-2:19.1.1-298.gb53b6d3e.el9.noarch 125/164 2024-09-12T02:25:08.172 INFO:teuthology.orchestra.run.smithi039.stdout: Installing : ceph-prometheus-alerts-2:19.1.1-298.gb53b6d3e.el 126/164 2024-09-12T02:25:08.211 INFO:teuthology.orchestra.run.smithi044.stdout: Installing : ceph-mgr-modules-core-2:19.1.1-298.gb53b6d3e.el9 131/164 2024-09-12T02:25:08.243 INFO:teuthology.orchestra.run.smithi044.stdout: Installing : ceph-mgr-2:19.1.1-298.gb53b6d3e.el9.x86_64 132/164 2024-09-12T02:25:08.257 INFO:teuthology.orchestra.run.smithi039.stdout: Installing : ceph-grafana-dashboards-2:19.1.1-298.gb53b6d3e.e 127/164 2024-09-12T02:25:08.266 INFO:teuthology.orchestra.run.smithi044.stdout: Running scriptlet: ceph-mgr-2:19.1.1-298.gb53b6d3e.el9.x86_64 132/164 2024-09-12T02:25:08.267 INFO:teuthology.orchestra.run.smithi044.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-12T02:25:08.267 INFO:teuthology.orchestra.run.smithi044.stdout:Invalid unit name "ceph-mgr@*.service" escaped as "ceph-mgr@\x2a.service". 2024-09-12T02:25:08.267 INFO:teuthology.orchestra.run.smithi044.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mgr.target → /usr/lib/systemd/system/ceph-mgr.target. 2024-09-12T02:25:08.267 INFO:teuthology.orchestra.run.smithi044.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mgr.target → /usr/lib/systemd/system/ceph-mgr.target. 2024-09-12T02:25:08.267 INFO:teuthology.orchestra.run.smithi044.stdout: 2024-09-12T02:25:08.292 INFO:teuthology.orchestra.run.smithi039.stdout: Installing : ceph-mgr-cephadm-2:19.1.1-298.gb53b6d3e.el9.noar 128/164 2024-09-12T02:25:08.319 INFO:teuthology.orchestra.run.smithi044.stdout: Installing : ceph-mgr-rook-2:19.1.1-298.gb53b6d3e.el9.noarch 133/164 2024-09-12T02:25:08.331 INFO:teuthology.orchestra.run.smithi044.stdout: Running scriptlet: ceph-mgr-rook-2:19.1.1-298.gb53b6d3e.el9.noarch 133/164 2024-09-12T02:25:08.433 INFO:teuthology.orchestra.run.smithi044.stdout: Installing : ceph-2:19.1.1-298.gb53b6d3e.el9.x86_64 134/164 2024-09-12T02:25:08.485 INFO:teuthology.orchestra.run.smithi044.stdout: Installing : ceph-fuse-2:19.1.1-298.gb53b6d3e.el9.x86_64 135/164 2024-09-12T02:25:09.462 INFO:teuthology.orchestra.run.smithi044.stdout: Installing : libtool-2.4.6-46.el9.x86_64 136/164 2024-09-12T02:25:09.497 INFO:teuthology.orchestra.run.smithi044.stdout: Installing : ceph-radosgw-2:19.1.1-298.gb53b6d3e.el9.x86_64 137/164 2024-09-12T02:25:09.520 INFO:teuthology.orchestra.run.smithi044.stdout: Running scriptlet: ceph-radosgw-2:19.1.1-298.gb53b6d3e.el9.x86_64 137/164 2024-09-12T02:25:09.520 INFO:teuthology.orchestra.run.smithi044.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-12T02:25:09.520 INFO:teuthology.orchestra.run.smithi044.stdout:Invalid unit name "ceph-radosgw@*.service" escaped as "ceph-radosgw@\x2a.service". 2024-09-12T02:25:09.520 INFO:teuthology.orchestra.run.smithi044.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-radosgw.target → /usr/lib/systemd/system/ceph-radosgw.target. 2024-09-12T02:25:09.520 INFO:teuthology.orchestra.run.smithi044.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-radosgw.target → /usr/lib/systemd/system/ceph-radosgw.target. 2024-09-12T02:25:09.520 INFO:teuthology.orchestra.run.smithi044.stdout: 2024-09-12T02:25:09.564 INFO:teuthology.orchestra.run.smithi044.stdout: Installing : ceph-immutable-object-cache-2:19.1.1-298.gb53b6d 138/164 2024-09-12T02:25:09.586 INFO:teuthology.orchestra.run.smithi044.stdout: Running scriptlet: ceph-immutable-object-cache-2:19.1.1-298.gb53b6d 138/164 2024-09-12T02:25:09.586 INFO:teuthology.orchestra.run.smithi044.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-12T02:25:09.586 INFO:teuthology.orchestra.run.smithi044.stdout:Invalid unit name "ceph-immutable-object-cache@*.service" escaped as "ceph-immutable-object-cache@\x2a.service". 2024-09-12T02:25:09.587 INFO:teuthology.orchestra.run.smithi044.stdout: 2024-09-12T02:25:09.595 INFO:teuthology.orchestra.run.smithi039.stdout: Running scriptlet: ceph-mgr-cephadm-2:19.1.1-298.gb53b6d3e.el9.noar 128/164 2024-09-12T02:25:09.631 INFO:teuthology.orchestra.run.smithi044.stdout: Installing : cephfs-mirror-2:19.1.1-298.gb53b6d3e.el9.x86_64 139/164 2024-09-12T02:25:09.644 INFO:teuthology.orchestra.run.smithi039.stdout: Installing : ceph-mgr-dashboard-2:19.1.1-298.gb53b6d3e.el9.no 129/164 2024-09-12T02:25:09.654 INFO:teuthology.orchestra.run.smithi044.stdout: Running scriptlet: cephfs-mirror-2:19.1.1-298.gb53b6d3e.el9.x86_64 139/164 2024-09-12T02:25:09.654 INFO:teuthology.orchestra.run.smithi044.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-12T02:25:09.654 INFO:teuthology.orchestra.run.smithi044.stdout:Invalid unit name "cephfs-mirror@*.service" escaped as "cephfs-mirror@\x2a.service". 2024-09-12T02:25:09.654 INFO:teuthology.orchestra.run.smithi044.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/cephfs-mirror.target → /usr/lib/systemd/system/cephfs-mirror.target. 2024-09-12T02:25:09.654 INFO:teuthology.orchestra.run.smithi044.stdout:Created symlink /etc/systemd/system/ceph.target.wants/cephfs-mirror.target → /usr/lib/systemd/system/cephfs-mirror.target. 2024-09-12T02:25:09.654 INFO:teuthology.orchestra.run.smithi044.stdout: 2024-09-12T02:25:09.981 INFO:teuthology.orchestra.run.smithi172.stdout: Running scriptlet: openssl-libs-1:3.2.2-4.el9.x86_64 164/164 2024-09-12T02:25:09.982 INFO:teuthology.orchestra.run.smithi172.stdout: Verifying : ceph-2:19.1.1-298.gb53b6d3e.el9.x86_64 1/164 2024-09-12T02:25:09.982 INFO:teuthology.orchestra.run.smithi172.stdout: Verifying : ceph-base-2:19.1.1-298.gb53b6d3e.el9.x86_64 2/164 2024-09-12T02:25:09.982 INFO:teuthology.orchestra.run.smithi172.stdout: Verifying : ceph-common-2:19.1.1-298.gb53b6d3e.el9.x86_64 3/164 2024-09-12T02:25:09.982 INFO:teuthology.orchestra.run.smithi172.stdout: Verifying : ceph-fuse-2:19.1.1-298.gb53b6d3e.el9.x86_64 4/164 2024-09-12T02:25:09.982 INFO:teuthology.orchestra.run.smithi172.stdout: Verifying : ceph-immutable-object-cache-2:19.1.1-298.gb53b6d 5/164 2024-09-12T02:25:09.983 INFO:teuthology.orchestra.run.smithi172.stdout: Verifying : ceph-mds-2:19.1.1-298.gb53b6d3e.el9.x86_64 6/164 2024-09-12T02:25:09.983 INFO:teuthology.orchestra.run.smithi172.stdout: Verifying : ceph-mgr-2:19.1.1-298.gb53b6d3e.el9.x86_64 7/164 2024-09-12T02:25:09.983 INFO:teuthology.orchestra.run.smithi172.stdout: Verifying : ceph-mon-2:19.1.1-298.gb53b6d3e.el9.x86_64 8/164 2024-09-12T02:25:09.983 INFO:teuthology.orchestra.run.smithi172.stdout: Verifying : ceph-osd-2:19.1.1-298.gb53b6d3e.el9.x86_64 9/164 2024-09-12T02:25:09.983 INFO:teuthology.orchestra.run.smithi172.stdout: Verifying : ceph-radosgw-2:19.1.1-298.gb53b6d3e.el9.x86_64 10/164 2024-09-12T02:25:09.984 INFO:teuthology.orchestra.run.smithi172.stdout: Verifying : ceph-selinux-2:19.1.1-298.gb53b6d3e.el9.x86_64 11/164 2024-09-12T02:25:09.984 INFO:teuthology.orchestra.run.smithi172.stdout: Verifying : ceph-test-2:19.1.1-298.gb53b6d3e.el9.x86_64 12/164 2024-09-12T02:25:09.984 INFO:teuthology.orchestra.run.smithi172.stdout: Verifying : cephfs-mirror-2:19.1.1-298.gb53b6d3e.el9.x86_64 13/164 2024-09-12T02:25:09.984 INFO:teuthology.orchestra.run.smithi172.stdout: Verifying : cephfs-shell-2:19.1.1-298.gb53b6d3e.el9.x86_64 14/164 2024-09-12T02:25:09.984 INFO:teuthology.orchestra.run.smithi172.stdout: Verifying : libcephfs-devel-2:19.1.1-298.gb53b6d3e.el9.x86_6 15/164 2024-09-12T02:25:09.984 INFO:teuthology.orchestra.run.smithi172.stdout: Verifying : libcephfs2-2:19.1.1-298.gb53b6d3e.el9.x86_64 16/164 2024-09-12T02:25:09.984 INFO:teuthology.orchestra.run.smithi172.stdout: Verifying : libcephsqlite-2:19.1.1-298.gb53b6d3e.el9.x86_64 17/164 2024-09-12T02:25:09.985 INFO:teuthology.orchestra.run.smithi172.stdout: Verifying : librados-devel-2:19.1.1-298.gb53b6d3e.el9.x86_64 18/164 2024-09-12T02:25:09.985 INFO:teuthology.orchestra.run.smithi172.stdout: Verifying : libradosstriper1-2:19.1.1-298.gb53b6d3e.el9.x86_ 19/164 2024-09-12T02:25:09.985 INFO:teuthology.orchestra.run.smithi172.stdout: Verifying : librgw2-2:19.1.1-298.gb53b6d3e.el9.x86_64 20/164 2024-09-12T02:25:09.985 INFO:teuthology.orchestra.run.smithi172.stdout: Verifying : python3-ceph-argparse-2:19.1.1-298.gb53b6d3e.el9 21/164 2024-09-12T02:25:09.985 INFO:teuthology.orchestra.run.smithi172.stdout: Verifying : python3-ceph-common-2:19.1.1-298.gb53b6d3e.el9.x 22/164 2024-09-12T02:25:09.986 INFO:teuthology.orchestra.run.smithi172.stdout: Verifying : python3-cephfs-2:19.1.1-298.gb53b6d3e.el9.x86_64 23/164 2024-09-12T02:25:09.986 INFO:teuthology.orchestra.run.smithi172.stdout: Verifying : python3-rados-2:19.1.1-298.gb53b6d3e.el9.x86_64 24/164 2024-09-12T02:25:09.986 INFO:teuthology.orchestra.run.smithi172.stdout: Verifying : python3-rbd-2:19.1.1-298.gb53b6d3e.el9.x86_64 25/164 2024-09-12T02:25:09.986 INFO:teuthology.orchestra.run.smithi172.stdout: Verifying : python3-rgw-2:19.1.1-298.gb53b6d3e.el9.x86_64 26/164 2024-09-12T02:25:09.986 INFO:teuthology.orchestra.run.smithi172.stdout: Verifying : rbd-fuse-2:19.1.1-298.gb53b6d3e.el9.x86_64 27/164 2024-09-12T02:25:09.986 INFO:teuthology.orchestra.run.smithi172.stdout: Verifying : rbd-mirror-2:19.1.1-298.gb53b6d3e.el9.x86_64 28/164 2024-09-12T02:25:09.986 INFO:teuthology.orchestra.run.smithi172.stdout: Verifying : rbd-nbd-2:19.1.1-298.gb53b6d3e.el9.x86_64 29/164 2024-09-12T02:25:09.987 INFO:teuthology.orchestra.run.smithi172.stdout: Verifying : ceph-grafana-dashboards-2:19.1.1-298.gb53b6d3e.e 30/164 2024-09-12T02:25:09.987 INFO:teuthology.orchestra.run.smithi172.stdout: Verifying : ceph-mgr-cephadm-2:19.1.1-298.gb53b6d3e.el9.noar 31/164 2024-09-12T02:25:09.987 INFO:teuthology.orchestra.run.smithi172.stdout: Verifying : ceph-mgr-dashboard-2:19.1.1-298.gb53b6d3e.el9.no 32/164 2024-09-12T02:25:09.987 INFO:teuthology.orchestra.run.smithi172.stdout: Verifying : ceph-mgr-diskprediction-local-2:19.1.1-298.gb53b 33/164 2024-09-12T02:25:09.987 INFO:teuthology.orchestra.run.smithi172.stdout: Verifying : ceph-mgr-modules-core-2:19.1.1-298.gb53b6d3e.el9 34/164 2024-09-12T02:25:09.987 INFO:teuthology.orchestra.run.smithi172.stdout: Verifying : ceph-mgr-rook-2:19.1.1-298.gb53b6d3e.el9.noarch 35/164 2024-09-12T02:25:09.987 INFO:teuthology.orchestra.run.smithi172.stdout: Verifying : ceph-prometheus-alerts-2:19.1.1-298.gb53b6d3e.el 36/164 2024-09-12T02:25:09.987 INFO:teuthology.orchestra.run.smithi172.stdout: Verifying : ceph-volume-2:19.1.1-298.gb53b6d3e.el9.noarch 37/164 2024-09-12T02:25:09.988 INFO:teuthology.orchestra.run.smithi172.stdout: Verifying : cephadm-2:19.1.1-298.gb53b6d3e.el9.noarch 38/164 2024-09-12T02:25:09.988 INFO:teuthology.orchestra.run.smithi172.stdout: Verifying : cephfs-top-2:19.1.1-298.gb53b6d3e.el9.noarch 39/164 2024-09-12T02:25:09.988 INFO:teuthology.orchestra.run.smithi172.stdout: Verifying : fuse-2.9.9-16.el9.x86_64 40/164 2024-09-12T02:25:09.988 INFO:teuthology.orchestra.run.smithi172.stdout: Verifying : libgfortran-11.5.0-2.el9.x86_64 41/164 2024-09-12T02:25:09.988 INFO:teuthology.orchestra.run.smithi172.stdout: Verifying : libquadmath-11.5.0-2.el9.x86_64 42/164 2024-09-12T02:25:09.989 INFO:teuthology.orchestra.run.smithi172.stdout: Verifying : python3-cffi-1.14.5-5.el9.x86_64 43/164 2024-09-12T02:25:09.989 INFO:teuthology.orchestra.run.smithi172.stdout: Verifying : python3-cryptography-36.0.1-4.el9.x86_64 44/164 2024-09-12T02:25:09.989 INFO:teuthology.orchestra.run.smithi172.stdout: Verifying : python3-ply-3.11-14.el9.noarch 45/164 2024-09-12T02:25:09.989 INFO:teuthology.orchestra.run.smithi172.stdout: Verifying : python3-pycparser-2.20-6.el9.noarch 46/164 2024-09-12T02:25:09.989 INFO:teuthology.orchestra.run.smithi172.stdout: Verifying : python3-requests-2.25.1-8.el9.noarch 47/164 2024-09-12T02:25:09.989 INFO:teuthology.orchestra.run.smithi172.stdout: Verifying : python3-urllib3-1.26.5-6.el9.noarch 48/164 2024-09-12T02:25:09.990 INFO:teuthology.orchestra.run.smithi172.stdout: Verifying : automake-1.16.2-8.el9.noarch 49/164 2024-09-12T02:25:09.990 INFO:teuthology.orchestra.run.smithi172.stdout: Verifying : bison-3.7.4-5.el9.x86_64 50/164 2024-09-12T02:25:09.990 INFO:teuthology.orchestra.run.smithi172.stdout: Verifying : boost-program-options-1.75.0-8.el9.x86_64 51/164 2024-09-12T02:25:09.990 INFO:teuthology.orchestra.run.smithi172.stdout: Verifying : elfutils-libelf-devel-0.191-4.el9.x86_64 52/164 2024-09-12T02:25:09.990 INFO:teuthology.orchestra.run.smithi172.stdout: Verifying : flex-2.6.4-9.el9.x86_64 53/164 2024-09-12T02:25:09.990 INFO:teuthology.orchestra.run.smithi172.stdout: Verifying : flexiblas-3.0.4-8.el9.x86_64 54/164 2024-09-12T02:25:09.991 INFO:teuthology.orchestra.run.smithi172.stdout: Verifying : flexiblas-netlib-3.0.4-8.el9.x86_64 55/164 2024-09-12T02:25:09.991 INFO:teuthology.orchestra.run.smithi172.stdout: Verifying : flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 56/164 2024-09-12T02:25:09.991 INFO:teuthology.orchestra.run.smithi172.stdout: Verifying : libaio-devel-0.3.111-13.el9.x86_64 57/164 2024-09-12T02:25:09.991 INFO:teuthology.orchestra.run.smithi172.stdout: Verifying : libpmemobj-1.12.1-1.el9.x86_64 58/164 2024-09-12T02:25:09.991 INFO:teuthology.orchestra.run.smithi172.stdout: Verifying : librabbitmq-0.11.0-7.el9.x86_64 59/164 2024-09-12T02:25:09.991 INFO:teuthology.orchestra.run.smithi172.stdout: Verifying : librdkafka-1.6.1-102.el9.x86_64 60/164 2024-09-12T02:25:09.991 INFO:teuthology.orchestra.run.smithi172.stdout: Verifying : libtool-2.4.6-46.el9.x86_64 61/164 2024-09-12T02:25:09.991 INFO:teuthology.orchestra.run.smithi172.stdout: Verifying : libuuid-devel-2.37.4-20.el9.x86_64 62/164 2024-09-12T02:25:09.992 INFO:teuthology.orchestra.run.smithi172.stdout: Verifying : libzstd-devel-1.5.1-2.el9.x86_64 63/164 2024-09-12T02:25:09.992 INFO:teuthology.orchestra.run.smithi172.stdout: Verifying : lttng-ust-2.12.0-6.el9.x86_64 64/164 2024-09-12T02:25:09.992 INFO:teuthology.orchestra.run.smithi172.stdout: Verifying : lua-5.4.4-4.el9.x86_64 65/164 2024-09-12T02:25:09.992 INFO:teuthology.orchestra.run.smithi172.stdout: Verifying : openblas-0.3.26-2.el9.x86_64 66/164 2024-09-12T02:25:09.992 INFO:teuthology.orchestra.run.smithi172.stdout: Verifying : openblas-openmp-0.3.26-2.el9.x86_64 67/164 2024-09-12T02:25:09.992 INFO:teuthology.orchestra.run.smithi172.stdout: Verifying : openssl-devel-1:3.2.2-6.el9.x86_64 68/164 2024-09-12T02:25:09.992 INFO:teuthology.orchestra.run.smithi172.stdout: Verifying : postgresql-13.16-1.el9.x86_64 69/164 2024-09-12T02:25:09.992 INFO:teuthology.orchestra.run.smithi172.stdout: Verifying : postgresql-contrib-13.16-1.el9.x86_64 70/164 2024-09-12T02:25:09.992 INFO:teuthology.orchestra.run.smithi172.stdout: Verifying : postgresql-private-libs-13.16-1.el9.x86_64 71/164 2024-09-12T02:25:09.992 INFO:teuthology.orchestra.run.smithi172.stdout: Verifying : postgresql-server-13.16-1.el9.x86_64 72/164 2024-09-12T02:25:09.992 INFO:teuthology.orchestra.run.smithi172.stdout: Verifying : protobuf-3.14.0-13.el9.x86_64 73/164 2024-09-12T02:25:09.993 INFO:teuthology.orchestra.run.smithi172.stdout: Verifying : python3-attrs-20.3.0-7.el9.noarch 74/164 2024-09-12T02:25:09.993 INFO:teuthology.orchestra.run.smithi172.stdout: Verifying : python3-babel-2.9.1-2.el9.noarch 75/164 2024-09-12T02:25:09.993 INFO:teuthology.orchestra.run.smithi172.stdout: Verifying : python3-colorama-0.4.6-3.el9.noarch 76/164 2024-09-12T02:25:09.993 INFO:teuthology.orchestra.run.smithi172.stdout: Verifying : python3-devel-3.9.19-8.el9.x86_64 77/164 2024-09-12T02:25:09.993 INFO:teuthology.orchestra.run.smithi172.stdout: Verifying : python3-jinja2-2.11.3-6.el9.noarch 78/164 2024-09-12T02:25:09.993 INFO:teuthology.orchestra.run.smithi172.stdout: Verifying : python3-jsonpatch-1.21-16.el9.noarch 79/164 2024-09-12T02:25:09.993 INFO:teuthology.orchestra.run.smithi172.stdout: Verifying : python3-jsonpointer-2.0-4.el9.noarch 80/164 2024-09-12T02:25:09.993 INFO:teuthology.orchestra.run.smithi172.stdout: Verifying : python3-mako-1.1.4-6.el9.noarch 81/164 2024-09-12T02:25:09.993 INFO:teuthology.orchestra.run.smithi172.stdout: Verifying : python3-markupsafe-1.1.1-12.el9.x86_64 82/164 2024-09-12T02:25:09.993 INFO:teuthology.orchestra.run.smithi172.stdout: Verifying : python3-numpy-1:1.20.1-5.el9.x86_64 83/164 2024-09-12T02:25:09.993 INFO:teuthology.orchestra.run.smithi172.stdout: Verifying : python3-numpy-f2py-1:1.20.1-5.el9.x86_64 84/164 2024-09-12T02:25:09.993 INFO:teuthology.orchestra.run.smithi172.stdout: Verifying : python3-oauthlib-3.1.1-5.el9.noarch 85/164 2024-09-12T02:25:09.994 INFO:teuthology.orchestra.run.smithi172.stdout: Verifying : python3-packaging-20.9-5.el9.noarch 86/164 2024-09-12T02:25:09.994 INFO:teuthology.orchestra.run.smithi172.stdout: Verifying : python3-prettytable-0.7.2-27.el9.noarch 87/164 2024-09-12T02:25:09.994 INFO:teuthology.orchestra.run.smithi172.stdout: Verifying : python3-protobuf-3.14.0-13.el9.noarch 88/164 2024-09-12T02:25:09.994 INFO:teuthology.orchestra.run.smithi172.stdout: Verifying : python3-pyasn1-0.4.8-6.el9.noarch 89/164 2024-09-12T02:25:09.994 INFO:teuthology.orchestra.run.smithi172.stdout: Verifying : python3-pyasn1-modules-0.4.8-6.el9.noarch 90/164 2024-09-12T02:25:09.994 INFO:teuthology.orchestra.run.smithi172.stdout: Verifying : python3-pytz-2021.1-5.el9.noarch 91/164 2024-09-12T02:25:09.994 INFO:teuthology.orchestra.run.smithi172.stdout: Verifying : python3-requests-oauthlib-1.3.0-12.el9.noarch 92/164 2024-09-12T02:25:09.994 INFO:teuthology.orchestra.run.smithi172.stdout: Verifying : python3-scipy-1.6.2-8.el9.x86_64 93/164 2024-09-12T02:25:09.994 INFO:teuthology.orchestra.run.smithi172.stdout: Verifying : python3-toml-0.10.2-6.el9.noarch 94/164 2024-09-12T02:25:09.994 INFO:teuthology.orchestra.run.smithi172.stdout: Verifying : python3-wcwidth-0.2.5-8.el9.noarch 95/164 2024-09-12T02:25:09.994 INFO:teuthology.orchestra.run.smithi172.stdout: Verifying : qatlib-24.02.0-1.el9.x86_64 96/164 2024-09-12T02:25:09.994 INFO:teuthology.orchestra.run.smithi172.stdout: Verifying : qatlib-service-24.02.0-1.el9.x86_64 97/164 2024-09-12T02:25:09.994 INFO:teuthology.orchestra.run.smithi172.stdout: Verifying : qatzip-libs-1.2.0-1.el9.x86_64 98/164 2024-09-12T02:25:09.995 INFO:teuthology.orchestra.run.smithi172.stdout: Verifying : socat-1.7.4.1-6.el9.x86_64 99/164 2024-09-12T02:25:09.995 INFO:teuthology.orchestra.run.smithi172.stdout: Verifying : uuid-1.6.2-55.el9.x86_64 100/164 2024-09-12T02:25:09.995 INFO:teuthology.orchestra.run.smithi172.stdout: Verifying : xfsprogs-devel-6.4.0-4.el9.x86_64 101/164 2024-09-12T02:25:09.995 INFO:teuthology.orchestra.run.smithi172.stdout: Verifying : xmlstarlet-1.6.1-20.el9.x86_64 102/164 2024-09-12T02:25:09.995 INFO:teuthology.orchestra.run.smithi172.stdout: Verifying : zlib-devel-1.2.11-41.el9.x86_64 103/164 2024-09-12T02:25:09.995 INFO:teuthology.orchestra.run.smithi172.stdout: Verifying : lua-devel-5.4.4-4.el9.x86_64 104/164 2024-09-12T02:25:09.995 INFO:teuthology.orchestra.run.smithi172.stdout: Verifying : protobuf-compiler-3.14.0-13.el9.x86_64 105/164 2024-09-12T02:25:09.995 INFO:teuthology.orchestra.run.smithi172.stdout: Verifying : abseil-cpp-20211102.0-3.el9.x86_64 106/164 2024-09-12T02:25:09.995 INFO:teuthology.orchestra.run.smithi172.stdout: Verifying : gperftools-libs-2.9.1-2.el9.x86_64 107/164 2024-09-12T02:25:09.995 INFO:teuthology.orchestra.run.smithi172.stdout: Verifying : grpc-data-1.46.7-10.el9.noarch 108/164 2024-09-12T02:25:09.995 INFO:teuthology.orchestra.run.smithi172.stdout: Verifying : libarrow-9.0.0-11.el9.x86_64 109/164 2024-09-12T02:25:09.995 INFO:teuthology.orchestra.run.smithi172.stdout: Verifying : libarrow-doc-9.0.0-11.el9.noarch 110/164 2024-09-12T02:25:09.996 INFO:teuthology.orchestra.run.smithi172.stdout: Verifying : liboath-2.6.7-2.el9.x86_64 111/164 2024-09-12T02:25:09.996 INFO:teuthology.orchestra.run.smithi172.stdout: Verifying : libunwind-1.6.2-1.el9.x86_64 112/164 2024-09-12T02:25:09.996 INFO:teuthology.orchestra.run.smithi172.stdout: Verifying : luarocks-3.9.2-5.el9.noarch 113/164 2024-09-12T02:25:09.996 INFO:teuthology.orchestra.run.smithi172.stdout: Verifying : parquet-libs-9.0.0-11.el9.x86_64 114/164 2024-09-12T02:25:09.996 INFO:teuthology.orchestra.run.smithi172.stdout: Verifying : python3-asyncssh-2.13.2-5.el9.noarch 115/164 2024-09-12T02:25:09.996 INFO:teuthology.orchestra.run.smithi172.stdout: Verifying : python3-bcrypt-3.2.2-1.el9.x86_64 116/164 2024-09-12T02:25:09.996 INFO:teuthology.orchestra.run.smithi172.stdout: Verifying : python3-cachetools-4.2.4-1.el9.noarch 117/164 2024-09-12T02:25:09.996 INFO:teuthology.orchestra.run.smithi172.stdout: Verifying : python3-certifi-2023.05.07-4.el9.noarch 118/164 2024-09-12T02:25:09.996 INFO:teuthology.orchestra.run.smithi172.stdout: Verifying : python3-cheroot-8.6.0-4.el9.noarch 119/164 2024-09-12T02:25:09.996 INFO:teuthology.orchestra.run.smithi172.stdout: Verifying : python3-cherrypy-18.6.1-2.el9.noarch 120/164 2024-09-12T02:25:09.996 INFO:teuthology.orchestra.run.smithi172.stdout: Verifying : python3-cmd2-2.4.2-2.el9.noarch 121/164 2024-09-12T02:25:09.996 INFO:teuthology.orchestra.run.smithi172.stdout: Verifying : python3-google-auth-1:2.34.0-1.el9.noarch 122/164 2024-09-12T02:25:09.996 INFO:teuthology.orchestra.run.smithi172.stdout: Verifying : python3-grpcio-1.46.7-10.el9.x86_64 123/164 2024-09-12T02:25:09.997 INFO:teuthology.orchestra.run.smithi172.stdout: Verifying : python3-grpcio-tools-1.46.7-10.el9.x86_64 124/164 2024-09-12T02:25:09.997 INFO:teuthology.orchestra.run.smithi172.stdout: Verifying : python3-jaraco-8.2.1-3.el9.noarch 125/164 2024-09-12T02:25:09.997 INFO:teuthology.orchestra.run.smithi172.stdout: Verifying : python3-jaraco-classes-3.2.1-5.el9.noarch 126/164 2024-09-12T02:25:09.997 INFO:teuthology.orchestra.run.smithi172.stdout: Verifying : python3-jaraco-collections-3.0.0-8.el9.noarch 127/164 2024-09-12T02:25:09.997 INFO:teuthology.orchestra.run.smithi172.stdout: Verifying : python3-jaraco-functools-3.5.0-2.el9.noarch 128/164 2024-09-12T02:25:09.997 INFO:teuthology.orchestra.run.smithi172.stdout: Verifying : python3-jaraco-text-3.2.0-6.el9.noarch 129/164 2024-09-12T02:25:09.997 INFO:teuthology.orchestra.run.smithi172.stdout: Verifying : python3-kubernetes-1:26.1.0-2.el9.noarch 130/164 2024-09-12T02:25:09.997 INFO:teuthology.orchestra.run.smithi172.stdout: Verifying : python3-logutils-0.3.5-21.el9.noarch 131/164 2024-09-12T02:25:09.997 INFO:teuthology.orchestra.run.smithi172.stdout: Verifying : python3-more-itertools-8.12.0-2.el9.noarch 132/164 2024-09-12T02:25:09.997 INFO:teuthology.orchestra.run.smithi172.stdout: Verifying : python3-natsort-7.1.1-5.el9.noarch 133/164 2024-09-12T02:25:09.997 INFO:teuthology.orchestra.run.smithi172.stdout: Verifying : python3-pecan-1.4.2-3.el9.noarch 134/164 2024-09-12T02:25:09.997 INFO:teuthology.orchestra.run.smithi172.stdout: Verifying : python3-portend-3.1.0-2.el9.noarch 135/164 2024-09-12T02:25:09.997 INFO:teuthology.orchestra.run.smithi172.stdout: Verifying : python3-pyOpenSSL-21.0.0-1.el9.noarch 136/164 2024-09-12T02:25:09.997 INFO:teuthology.orchestra.run.smithi172.stdout: Verifying : python3-pyperclip-1.8.2-2.el9.noarch 137/164 2024-09-12T02:25:09.998 INFO:teuthology.orchestra.run.smithi172.stdout: Verifying : python3-repoze-lru-0.7-16.el9.noarch 138/164 2024-09-12T02:25:09.998 INFO:teuthology.orchestra.run.smithi172.stdout: Verifying : python3-routes-2.5.1-5.el9.noarch 139/164 2024-09-12T02:25:09.998 INFO:teuthology.orchestra.run.smithi172.stdout: Verifying : python3-rsa-4.9-2.el9.noarch 140/164 2024-09-12T02:25:09.998 INFO:teuthology.orchestra.run.smithi172.stdout: Verifying : python3-tempora-5.0.0-2.el9.noarch 141/164 2024-09-12T02:25:09.998 INFO:teuthology.orchestra.run.smithi172.stdout: Verifying : python3-typing-extensions-4.12.2-2.el9.noarch 142/164 2024-09-12T02:25:09.998 INFO:teuthology.orchestra.run.smithi172.stdout: Verifying : python3-webob-1.8.8-2.el9.noarch 143/164 2024-09-12T02:25:09.998 INFO:teuthology.orchestra.run.smithi172.stdout: Verifying : python3-websocket-client-1.2.3-2.el9.noarch 144/164 2024-09-12T02:25:09.998 INFO:teuthology.orchestra.run.smithi172.stdout: Verifying : python3-werkzeug-2.0.3-3.el9.1.noarch 145/164 2024-09-12T02:25:09.998 INFO:teuthology.orchestra.run.smithi172.stdout: Verifying : python3-zc-lockfile-2.0-10.el9.noarch 146/164 2024-09-12T02:25:09.999 INFO:teuthology.orchestra.run.smithi172.stdout: Verifying : re2-1:20211101-20.el9.x86_64 147/164 2024-09-12T02:25:09.999 INFO:teuthology.orchestra.run.smithi172.stdout: Verifying : thrift-0.15.0-2.el9.x86_64 148/164 2024-09-12T02:25:09.999 INFO:teuthology.orchestra.run.smithi172.stdout: Verifying : librados2-2:19.1.1-298.gb53b6d3e.el9.x86_64 149/164 2024-09-12T02:25:09.999 INFO:teuthology.orchestra.run.smithi172.stdout: Verifying : librados2-2:16.2.4-5.el9.x86_64 150/164 2024-09-12T02:25:09.999 INFO:teuthology.orchestra.run.smithi172.stdout: Verifying : librbd1-2:19.1.1-298.gb53b6d3e.el9.x86_64 151/164 2024-09-12T02:25:09.999 INFO:teuthology.orchestra.run.smithi172.stdout: Verifying : librbd1-2:16.2.4-5.el9.x86_64 152/164 2024-09-12T02:25:09.999 INFO:teuthology.orchestra.run.smithi172.stdout: Verifying : NetworkManager-1:1.49.90-1.el9.x86_64 153/164 2024-09-12T02:25:09.999 INFO:teuthology.orchestra.run.smithi172.stdout: Verifying : NetworkManager-1:1.48.8-1.el9.x86_64 154/164 2024-09-12T02:25:09.999 INFO:teuthology.orchestra.run.smithi172.stdout: Verifying : NetworkManager-libnm-1:1.49.90-1.el9.x86_64 155/164 2024-09-12T02:25:09.999 INFO:teuthology.orchestra.run.smithi172.stdout: Verifying : NetworkManager-libnm-1:1.48.8-1.el9.x86_64 156/164 2024-09-12T02:25:09.999 INFO:teuthology.orchestra.run.smithi172.stdout: Verifying : NetworkManager-team-1:1.49.90-1.el9.x86_64 157/164 2024-09-12T02:25:09.999 INFO:teuthology.orchestra.run.smithi172.stdout: Verifying : NetworkManager-team-1:1.48.8-1.el9.x86_64 158/164 2024-09-12T02:25:09.999 INFO:teuthology.orchestra.run.smithi172.stdout: Verifying : NetworkManager-tui-1:1.49.90-1.el9.x86_64 159/164 2024-09-12T02:25:09.999 INFO:teuthology.orchestra.run.smithi172.stdout: Verifying : NetworkManager-tui-1:1.48.8-1.el9.x86_64 160/164 2024-09-12T02:25:10.000 INFO:teuthology.orchestra.run.smithi172.stdout: Verifying : openssl-1:3.2.2-6.el9.x86_64 161/164 2024-09-12T02:25:10.000 INFO:teuthology.orchestra.run.smithi172.stdout: Verifying : openssl-1:3.2.2-4.el9.x86_64 162/164 2024-09-12T02:25:10.000 INFO:teuthology.orchestra.run.smithi172.stdout: Verifying : openssl-libs-1:3.2.2-6.el9.x86_64 163/164 2024-09-12T02:25:10.000 INFO:teuthology.orchestra.run.smithi044.stdout: Installing : rbd-mirror-2:19.1.1-298.gb53b6d3e.el9.x86_64 140/164 2024-09-12T02:25:10.005 INFO:teuthology.orchestra.run.smithi044.stdout: Running scriptlet: rbd-mirror-2:19.1.1-298.gb53b6d3e.el9.x86_64 140/164 2024-09-12T02:25:10.005 INFO:teuthology.orchestra.run.smithi044.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-12T02:25:10.005 INFO:teuthology.orchestra.run.smithi044.stdout:Invalid unit name "ceph-rbd-mirror@*.service" escaped as "ceph-rbd-mirror@\x2a.service". 2024-09-12T02:25:10.005 INFO:teuthology.orchestra.run.smithi044.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-rbd-mirror.target → /usr/lib/systemd/system/ceph-rbd-mirror.target. 2024-09-12T02:25:10.006 INFO:teuthology.orchestra.run.smithi044.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-rbd-mirror.target → /usr/lib/systemd/system/ceph-rbd-mirror.target. 2024-09-12T02:25:10.006 INFO:teuthology.orchestra.run.smithi044.stdout: 2024-09-12T02:25:10.797 INFO:teuthology.orchestra.run.smithi039.stdout: Running scriptlet: ceph-mgr-dashboard-2:19.1.1-298.gb53b6d3e.el9.no 129/164 2024-09-12T02:25:10.836 INFO:teuthology.orchestra.run.smithi039.stdout: Installing : ceph-mgr-diskprediction-local-2:19.1.1-298.gb53b 130/164 2024-09-12T02:25:10.981 INFO:teuthology.orchestra.run.smithi039.stdout: Running scriptlet: ceph-mgr-diskprediction-local-2:19.1.1-298.gb53b 130/164 2024-09-12T02:25:11.166 INFO:teuthology.orchestra.run.smithi039.stdout: Installing : ceph-mgr-modules-core-2:19.1.1-298.gb53b6d3e.el9 131/164 2024-09-12T02:25:11.196 INFO:teuthology.orchestra.run.smithi039.stdout: Installing : ceph-mgr-2:19.1.1-298.gb53b6d3e.el9.x86_64 132/164 2024-09-12T02:25:11.248 INFO:teuthology.orchestra.run.smithi039.stdout: Running scriptlet: ceph-mgr-2:19.1.1-298.gb53b6d3e.el9.x86_64 132/164 2024-09-12T02:25:11.248 INFO:teuthology.orchestra.run.smithi039.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-12T02:25:11.248 INFO:teuthology.orchestra.run.smithi039.stdout:Invalid unit name "ceph-mgr@*.service" escaped as "ceph-mgr@\x2a.service". 2024-09-12T02:25:11.248 INFO:teuthology.orchestra.run.smithi039.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mgr.target → /usr/lib/systemd/system/ceph-mgr.target. 2024-09-12T02:25:11.248 INFO:teuthology.orchestra.run.smithi039.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mgr.target → /usr/lib/systemd/system/ceph-mgr.target. 2024-09-12T02:25:11.249 INFO:teuthology.orchestra.run.smithi039.stdout: 2024-09-12T02:25:11.305 INFO:teuthology.orchestra.run.smithi039.stdout: Installing : ceph-mgr-rook-2:19.1.1-298.gb53b6d3e.el9.noarch 133/164 2024-09-12T02:25:11.332 INFO:teuthology.orchestra.run.smithi039.stdout: Running scriptlet: ceph-mgr-rook-2:19.1.1-298.gb53b6d3e.el9.noarch 133/164 2024-09-12T02:25:11.443 INFO:teuthology.orchestra.run.smithi039.stdout: Installing : ceph-2:19.1.1-298.gb53b6d3e.el9.x86_64 134/164 2024-09-12T02:25:11.508 INFO:teuthology.orchestra.run.smithi039.stdout: Installing : ceph-fuse-2:19.1.1-298.gb53b6d3e.el9.x86_64 135/164 2024-09-12T02:25:12.567 INFO:teuthology.orchestra.run.smithi039.stdout: Installing : libtool-2.4.6-46.el9.x86_64 136/164 2024-09-12T02:25:12.608 INFO:teuthology.orchestra.run.smithi039.stdout: Installing : ceph-radosgw-2:19.1.1-298.gb53b6d3e.el9.x86_64 137/164 2024-09-12T02:25:12.660 INFO:teuthology.orchestra.run.smithi039.stdout: Running scriptlet: ceph-radosgw-2:19.1.1-298.gb53b6d3e.el9.x86_64 137/164 2024-09-12T02:25:12.660 INFO:teuthology.orchestra.run.smithi039.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-12T02:25:12.660 INFO:teuthology.orchestra.run.smithi039.stdout:Invalid unit name "ceph-radosgw@*.service" escaped as "ceph-radosgw@\x2a.service". 2024-09-12T02:25:12.660 INFO:teuthology.orchestra.run.smithi039.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-radosgw.target → /usr/lib/systemd/system/ceph-radosgw.target. 2024-09-12T02:25:12.660 INFO:teuthology.orchestra.run.smithi039.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-radosgw.target → /usr/lib/systemd/system/ceph-radosgw.target. 2024-09-12T02:25:12.661 INFO:teuthology.orchestra.run.smithi039.stdout: 2024-09-12T02:25:12.709 INFO:teuthology.orchestra.run.smithi039.stdout: Installing : ceph-immutable-object-cache-2:19.1.1-298.gb53b6d 138/164 2024-09-12T02:25:12.752 INFO:teuthology.orchestra.run.smithi172.stdout: Verifying : openssl-libs-1:3.2.2-4.el9.x86_64 164/164 2024-09-12T02:25:12.753 INFO:teuthology.orchestra.run.smithi172.stdout: 2024-09-12T02:25:12.753 INFO:teuthology.orchestra.run.smithi172.stdout:Upgraded: 2024-09-12T02:25:12.753 INFO:teuthology.orchestra.run.smithi172.stdout: NetworkManager-1:1.49.90-1.el9.x86_64 2024-09-12T02:25:12.753 INFO:teuthology.orchestra.run.smithi172.stdout: NetworkManager-libnm-1:1.49.90-1.el9.x86_64 2024-09-12T02:25:12.753 INFO:teuthology.orchestra.run.smithi172.stdout: NetworkManager-team-1:1.49.90-1.el9.x86_64 2024-09-12T02:25:12.753 INFO:teuthology.orchestra.run.smithi172.stdout: NetworkManager-tui-1:1.49.90-1.el9.x86_64 2024-09-12T02:25:12.753 INFO:teuthology.orchestra.run.smithi172.stdout: librados2-2:19.1.1-298.gb53b6d3e.el9.x86_64 2024-09-12T02:25:12.753 INFO:teuthology.orchestra.run.smithi172.stdout: librbd1-2:19.1.1-298.gb53b6d3e.el9.x86_64 2024-09-12T02:25:12.753 INFO:teuthology.orchestra.run.smithi172.stdout: openssl-1:3.2.2-6.el9.x86_64 2024-09-12T02:25:12.753 INFO:teuthology.orchestra.run.smithi172.stdout: openssl-libs-1:3.2.2-6.el9.x86_64 2024-09-12T02:25:12.753 INFO:teuthology.orchestra.run.smithi172.stdout:Installed: 2024-09-12T02:25:12.753 INFO:teuthology.orchestra.run.smithi172.stdout: abseil-cpp-20211102.0-3.el9.x86_64 2024-09-12T02:25:12.754 INFO:teuthology.orchestra.run.smithi172.stdout: automake-1.16.2-8.el9.noarch 2024-09-12T02:25:12.754 INFO:teuthology.orchestra.run.smithi172.stdout: bison-3.7.4-5.el9.x86_64 2024-09-12T02:25:12.754 INFO:teuthology.orchestra.run.smithi172.stdout: boost-program-options-1.75.0-8.el9.x86_64 2024-09-12T02:25:12.754 INFO:teuthology.orchestra.run.smithi172.stdout: ceph-2:19.1.1-298.gb53b6d3e.el9.x86_64 2024-09-12T02:25:12.754 INFO:teuthology.orchestra.run.smithi172.stdout: ceph-base-2:19.1.1-298.gb53b6d3e.el9.x86_64 2024-09-12T02:25:12.754 INFO:teuthology.orchestra.run.smithi172.stdout: ceph-common-2:19.1.1-298.gb53b6d3e.el9.x86_64 2024-09-12T02:25:12.754 INFO:teuthology.orchestra.run.smithi172.stdout: ceph-fuse-2:19.1.1-298.gb53b6d3e.el9.x86_64 2024-09-12T02:25:12.754 INFO:teuthology.orchestra.run.smithi172.stdout: ceph-grafana-dashboards-2:19.1.1-298.gb53b6d3e.el9.noarch 2024-09-12T02:25:12.754 INFO:teuthology.orchestra.run.smithi172.stdout: ceph-immutable-object-cache-2:19.1.1-298.gb53b6d3e.el9.x86_64 2024-09-12T02:25:12.754 INFO:teuthology.orchestra.run.smithi172.stdout: ceph-mds-2:19.1.1-298.gb53b6d3e.el9.x86_64 2024-09-12T02:25:12.754 INFO:teuthology.orchestra.run.smithi172.stdout: ceph-mgr-2:19.1.1-298.gb53b6d3e.el9.x86_64 2024-09-12T02:25:12.754 INFO:teuthology.orchestra.run.smithi172.stdout: ceph-mgr-cephadm-2:19.1.1-298.gb53b6d3e.el9.noarch 2024-09-12T02:25:12.754 INFO:teuthology.orchestra.run.smithi172.stdout: ceph-mgr-dashboard-2:19.1.1-298.gb53b6d3e.el9.noarch 2024-09-12T02:25:12.754 INFO:teuthology.orchestra.run.smithi172.stdout: ceph-mgr-diskprediction-local-2:19.1.1-298.gb53b6d3e.el9.noarch 2024-09-12T02:25:12.755 INFO:teuthology.orchestra.run.smithi172.stdout: ceph-mgr-modules-core-2:19.1.1-298.gb53b6d3e.el9.noarch 2024-09-12T02:25:12.755 INFO:teuthology.orchestra.run.smithi172.stdout: ceph-mgr-rook-2:19.1.1-298.gb53b6d3e.el9.noarch 2024-09-12T02:25:12.755 INFO:teuthology.orchestra.run.smithi172.stdout: ceph-mon-2:19.1.1-298.gb53b6d3e.el9.x86_64 2024-09-12T02:25:12.755 INFO:teuthology.orchestra.run.smithi172.stdout: ceph-osd-2:19.1.1-298.gb53b6d3e.el9.x86_64 2024-09-12T02:25:12.755 INFO:teuthology.orchestra.run.smithi172.stdout: ceph-prometheus-alerts-2:19.1.1-298.gb53b6d3e.el9.noarch 2024-09-12T02:25:12.755 INFO:teuthology.orchestra.run.smithi172.stdout: ceph-radosgw-2:19.1.1-298.gb53b6d3e.el9.x86_64 2024-09-12T02:25:12.755 INFO:teuthology.orchestra.run.smithi172.stdout: ceph-selinux-2:19.1.1-298.gb53b6d3e.el9.x86_64 2024-09-12T02:25:12.755 INFO:teuthology.orchestra.run.smithi172.stdout: ceph-test-2:19.1.1-298.gb53b6d3e.el9.x86_64 2024-09-12T02:25:12.755 INFO:teuthology.orchestra.run.smithi172.stdout: ceph-volume-2:19.1.1-298.gb53b6d3e.el9.noarch 2024-09-12T02:25:12.755 INFO:teuthology.orchestra.run.smithi172.stdout: cephadm-2:19.1.1-298.gb53b6d3e.el9.noarch 2024-09-12T02:25:12.755 INFO:teuthology.orchestra.run.smithi172.stdout: cephfs-mirror-2:19.1.1-298.gb53b6d3e.el9.x86_64 2024-09-12T02:25:12.755 INFO:teuthology.orchestra.run.smithi172.stdout: cephfs-shell-2:19.1.1-298.gb53b6d3e.el9.x86_64 2024-09-12T02:25:12.755 INFO:teuthology.orchestra.run.smithi172.stdout: cephfs-top-2:19.1.1-298.gb53b6d3e.el9.noarch 2024-09-12T02:25:12.756 INFO:teuthology.orchestra.run.smithi172.stdout: elfutils-libelf-devel-0.191-4.el9.x86_64 2024-09-12T02:25:12.756 INFO:teuthology.orchestra.run.smithi172.stdout: flex-2.6.4-9.el9.x86_64 2024-09-12T02:25:12.756 INFO:teuthology.orchestra.run.smithi172.stdout: flexiblas-3.0.4-8.el9.x86_64 2024-09-12T02:25:12.756 INFO:teuthology.orchestra.run.smithi172.stdout: flexiblas-netlib-3.0.4-8.el9.x86_64 2024-09-12T02:25:12.756 INFO:teuthology.orchestra.run.smithi172.stdout: flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 2024-09-12T02:25:12.756 INFO:teuthology.orchestra.run.smithi172.stdout: fuse-2.9.9-16.el9.x86_64 2024-09-12T02:25:12.756 INFO:teuthology.orchestra.run.smithi172.stdout: gperftools-libs-2.9.1-2.el9.x86_64 2024-09-12T02:25:12.756 INFO:teuthology.orchestra.run.smithi172.stdout: grpc-data-1.46.7-10.el9.noarch 2024-09-12T02:25:12.756 INFO:teuthology.orchestra.run.smithi172.stdout: libaio-devel-0.3.111-13.el9.x86_64 2024-09-12T02:25:12.756 INFO:teuthology.orchestra.run.smithi172.stdout: libarrow-9.0.0-11.el9.x86_64 2024-09-12T02:25:12.756 INFO:teuthology.orchestra.run.smithi172.stdout: libarrow-doc-9.0.0-11.el9.noarch 2024-09-12T02:25:12.756 INFO:teuthology.orchestra.run.smithi172.stdout: libcephfs-devel-2:19.1.1-298.gb53b6d3e.el9.x86_64 2024-09-12T02:25:12.757 INFO:teuthology.orchestra.run.smithi172.stdout: libcephfs2-2:19.1.1-298.gb53b6d3e.el9.x86_64 2024-09-12T02:25:12.757 INFO:teuthology.orchestra.run.smithi172.stdout: libcephsqlite-2:19.1.1-298.gb53b6d3e.el9.x86_64 2024-09-12T02:25:12.757 INFO:teuthology.orchestra.run.smithi172.stdout: libgfortran-11.5.0-2.el9.x86_64 2024-09-12T02:25:12.757 INFO:teuthology.orchestra.run.smithi172.stdout: liboath-2.6.7-2.el9.x86_64 2024-09-12T02:25:12.757 INFO:teuthology.orchestra.run.smithi172.stdout: libpmemobj-1.12.1-1.el9.x86_64 2024-09-12T02:25:12.757 INFO:teuthology.orchestra.run.smithi172.stdout: libquadmath-11.5.0-2.el9.x86_64 2024-09-12T02:25:12.757 INFO:teuthology.orchestra.run.smithi172.stdout: librabbitmq-0.11.0-7.el9.x86_64 2024-09-12T02:25:12.757 INFO:teuthology.orchestra.run.smithi172.stdout: librados-devel-2:19.1.1-298.gb53b6d3e.el9.x86_64 2024-09-12T02:25:12.757 INFO:teuthology.orchestra.run.smithi172.stdout: libradosstriper1-2:19.1.1-298.gb53b6d3e.el9.x86_64 2024-09-12T02:25:12.757 INFO:teuthology.orchestra.run.smithi172.stdout: librdkafka-1.6.1-102.el9.x86_64 2024-09-12T02:25:12.757 INFO:teuthology.orchestra.run.smithi172.stdout: librgw2-2:19.1.1-298.gb53b6d3e.el9.x86_64 2024-09-12T02:25:12.757 INFO:teuthology.orchestra.run.smithi172.stdout: libtool-2.4.6-46.el9.x86_64 2024-09-12T02:25:12.758 INFO:teuthology.orchestra.run.smithi172.stdout: libunwind-1.6.2-1.el9.x86_64 2024-09-12T02:25:12.758 INFO:teuthology.orchestra.run.smithi172.stdout: libuuid-devel-2.37.4-20.el9.x86_64 2024-09-12T02:25:12.758 INFO:teuthology.orchestra.run.smithi172.stdout: libzstd-devel-1.5.1-2.el9.x86_64 2024-09-12T02:25:12.758 INFO:teuthology.orchestra.run.smithi172.stdout: lttng-ust-2.12.0-6.el9.x86_64 2024-09-12T02:25:12.758 INFO:teuthology.orchestra.run.smithi172.stdout: lua-5.4.4-4.el9.x86_64 2024-09-12T02:25:12.758 INFO:teuthology.orchestra.run.smithi172.stdout: lua-devel-5.4.4-4.el9.x86_64 2024-09-12T02:25:12.758 INFO:teuthology.orchestra.run.smithi172.stdout: luarocks-3.9.2-5.el9.noarch 2024-09-12T02:25:12.758 INFO:teuthology.orchestra.run.smithi172.stdout: openblas-0.3.26-2.el9.x86_64 2024-09-12T02:25:12.758 INFO:teuthology.orchestra.run.smithi172.stdout: openblas-openmp-0.3.26-2.el9.x86_64 2024-09-12T02:25:12.758 INFO:teuthology.orchestra.run.smithi172.stdout: openssl-devel-1:3.2.2-6.el9.x86_64 2024-09-12T02:25:12.758 INFO:teuthology.orchestra.run.smithi172.stdout: parquet-libs-9.0.0-11.el9.x86_64 2024-09-12T02:25:12.758 INFO:teuthology.orchestra.run.smithi172.stdout: postgresql-13.16-1.el9.x86_64 2024-09-12T02:25:12.758 INFO:teuthology.orchestra.run.smithi172.stdout: postgresql-contrib-13.16-1.el9.x86_64 2024-09-12T02:25:12.758 INFO:teuthology.orchestra.run.smithi172.stdout: postgresql-private-libs-13.16-1.el9.x86_64 2024-09-12T02:25:12.758 INFO:teuthology.orchestra.run.smithi172.stdout: postgresql-server-13.16-1.el9.x86_64 2024-09-12T02:25:12.759 INFO:teuthology.orchestra.run.smithi172.stdout: protobuf-3.14.0-13.el9.x86_64 2024-09-12T02:25:12.759 INFO:teuthology.orchestra.run.smithi172.stdout: protobuf-compiler-3.14.0-13.el9.x86_64 2024-09-12T02:25:12.759 INFO:teuthology.orchestra.run.smithi172.stdout: python3-asyncssh-2.13.2-5.el9.noarch 2024-09-12T02:25:12.759 INFO:teuthology.orchestra.run.smithi172.stdout: python3-attrs-20.3.0-7.el9.noarch 2024-09-12T02:25:12.759 INFO:teuthology.orchestra.run.smithi172.stdout: python3-babel-2.9.1-2.el9.noarch 2024-09-12T02:25:12.759 INFO:teuthology.orchestra.run.smithi172.stdout: python3-bcrypt-3.2.2-1.el9.x86_64 2024-09-12T02:25:12.759 INFO:teuthology.orchestra.run.smithi172.stdout: python3-cachetools-4.2.4-1.el9.noarch 2024-09-12T02:25:12.759 INFO:teuthology.orchestra.run.smithi172.stdout: python3-ceph-argparse-2:19.1.1-298.gb53b6d3e.el9.x86_64 2024-09-12T02:25:12.759 INFO:teuthology.orchestra.run.smithi172.stdout: python3-ceph-common-2:19.1.1-298.gb53b6d3e.el9.x86_64 2024-09-12T02:25:12.759 INFO:teuthology.orchestra.run.smithi172.stdout: python3-cephfs-2:19.1.1-298.gb53b6d3e.el9.x86_64 2024-09-12T02:25:12.759 INFO:teuthology.orchestra.run.smithi172.stdout: python3-certifi-2023.05.07-4.el9.noarch 2024-09-12T02:25:12.759 INFO:teuthology.orchestra.run.smithi172.stdout: python3-cffi-1.14.5-5.el9.x86_64 2024-09-12T02:25:12.759 INFO:teuthology.orchestra.run.smithi172.stdout: python3-cheroot-8.6.0-4.el9.noarch 2024-09-12T02:25:12.759 INFO:teuthology.orchestra.run.smithi172.stdout: python3-cherrypy-18.6.1-2.el9.noarch 2024-09-12T02:25:12.760 INFO:teuthology.orchestra.run.smithi172.stdout: python3-cmd2-2.4.2-2.el9.noarch 2024-09-12T02:25:12.760 INFO:teuthology.orchestra.run.smithi172.stdout: python3-colorama-0.4.6-3.el9.noarch 2024-09-12T02:25:12.760 INFO:teuthology.orchestra.run.smithi172.stdout: python3-cryptography-36.0.1-4.el9.x86_64 2024-09-12T02:25:12.760 INFO:teuthology.orchestra.run.smithi172.stdout: python3-devel-3.9.19-8.el9.x86_64 2024-09-12T02:25:12.760 INFO:teuthology.orchestra.run.smithi172.stdout: python3-google-auth-1:2.34.0-1.el9.noarch 2024-09-12T02:25:12.760 INFO:teuthology.orchestra.run.smithi172.stdout: python3-grpcio-1.46.7-10.el9.x86_64 2024-09-12T02:25:12.760 INFO:teuthology.orchestra.run.smithi172.stdout: python3-grpcio-tools-1.46.7-10.el9.x86_64 2024-09-12T02:25:12.760 INFO:teuthology.orchestra.run.smithi172.stdout: python3-jaraco-8.2.1-3.el9.noarch 2024-09-12T02:25:12.760 INFO:teuthology.orchestra.run.smithi172.stdout: python3-jaraco-classes-3.2.1-5.el9.noarch 2024-09-12T02:25:12.760 INFO:teuthology.orchestra.run.smithi172.stdout: python3-jaraco-collections-3.0.0-8.el9.noarch 2024-09-12T02:25:12.760 INFO:teuthology.orchestra.run.smithi172.stdout: python3-jaraco-functools-3.5.0-2.el9.noarch 2024-09-12T02:25:12.760 INFO:teuthology.orchestra.run.smithi172.stdout: python3-jaraco-text-3.2.0-6.el9.noarch 2024-09-12T02:25:12.761 INFO:teuthology.orchestra.run.smithi172.stdout: python3-jinja2-2.11.3-6.el9.noarch 2024-09-12T02:25:12.761 INFO:teuthology.orchestra.run.smithi172.stdout: python3-jsonpatch-1.21-16.el9.noarch 2024-09-12T02:25:12.761 INFO:teuthology.orchestra.run.smithi172.stdout: python3-jsonpointer-2.0-4.el9.noarch 2024-09-12T02:25:12.761 INFO:teuthology.orchestra.run.smithi172.stdout: python3-kubernetes-1:26.1.0-2.el9.noarch 2024-09-12T02:25:12.761 INFO:teuthology.orchestra.run.smithi172.stdout: python3-logutils-0.3.5-21.el9.noarch 2024-09-12T02:25:12.761 INFO:teuthology.orchestra.run.smithi172.stdout: python3-mako-1.1.4-6.el9.noarch 2024-09-12T02:25:12.761 INFO:teuthology.orchestra.run.smithi172.stdout: python3-markupsafe-1.1.1-12.el9.x86_64 2024-09-12T02:25:12.761 INFO:teuthology.orchestra.run.smithi172.stdout: python3-more-itertools-8.12.0-2.el9.noarch 2024-09-12T02:25:12.761 INFO:teuthology.orchestra.run.smithi172.stdout: python3-natsort-7.1.1-5.el9.noarch 2024-09-12T02:25:12.761 INFO:teuthology.orchestra.run.smithi172.stdout: python3-numpy-1:1.20.1-5.el9.x86_64 2024-09-12T02:25:12.761 INFO:teuthology.orchestra.run.smithi172.stdout: python3-numpy-f2py-1:1.20.1-5.el9.x86_64 2024-09-12T02:25:12.761 INFO:teuthology.orchestra.run.smithi172.stdout: python3-oauthlib-3.1.1-5.el9.noarch 2024-09-12T02:25:12.761 INFO:teuthology.orchestra.run.smithi172.stdout: python3-packaging-20.9-5.el9.noarch 2024-09-12T02:25:12.762 INFO:teuthology.orchestra.run.smithi172.stdout: python3-pecan-1.4.2-3.el9.noarch 2024-09-12T02:25:12.762 INFO:teuthology.orchestra.run.smithi172.stdout: python3-ply-3.11-14.el9.noarch 2024-09-12T02:25:12.762 INFO:teuthology.orchestra.run.smithi172.stdout: python3-portend-3.1.0-2.el9.noarch 2024-09-12T02:25:12.762 INFO:teuthology.orchestra.run.smithi172.stdout: python3-prettytable-0.7.2-27.el9.noarch 2024-09-12T02:25:12.762 INFO:teuthology.orchestra.run.smithi172.stdout: python3-protobuf-3.14.0-13.el9.noarch 2024-09-12T02:25:12.762 INFO:teuthology.orchestra.run.smithi172.stdout: python3-pyOpenSSL-21.0.0-1.el9.noarch 2024-09-12T02:25:12.762 INFO:teuthology.orchestra.run.smithi172.stdout: python3-pyasn1-0.4.8-6.el9.noarch 2024-09-12T02:25:12.762 INFO:teuthology.orchestra.run.smithi172.stdout: python3-pyasn1-modules-0.4.8-6.el9.noarch 2024-09-12T02:25:12.762 INFO:teuthology.orchestra.run.smithi172.stdout: python3-pycparser-2.20-6.el9.noarch 2024-09-12T02:25:12.762 INFO:teuthology.orchestra.run.smithi172.stdout: python3-pyperclip-1.8.2-2.el9.noarch 2024-09-12T02:25:12.762 INFO:teuthology.orchestra.run.smithi172.stdout: python3-pytz-2021.1-5.el9.noarch 2024-09-12T02:25:12.762 INFO:teuthology.orchestra.run.smithi172.stdout: python3-rados-2:19.1.1-298.gb53b6d3e.el9.x86_64 2024-09-12T02:25:12.762 INFO:teuthology.orchestra.run.smithi172.stdout: python3-rbd-2:19.1.1-298.gb53b6d3e.el9.x86_64 2024-09-12T02:25:12.763 INFO:teuthology.orchestra.run.smithi172.stdout: python3-repoze-lru-0.7-16.el9.noarch 2024-09-12T02:25:12.763 INFO:teuthology.orchestra.run.smithi172.stdout: python3-requests-2.25.1-8.el9.noarch 2024-09-12T02:25:12.763 INFO:teuthology.orchestra.run.smithi172.stdout: python3-requests-oauthlib-1.3.0-12.el9.noarch 2024-09-12T02:25:12.763 INFO:teuthology.orchestra.run.smithi172.stdout: python3-rgw-2:19.1.1-298.gb53b6d3e.el9.x86_64 2024-09-12T02:25:12.763 INFO:teuthology.orchestra.run.smithi172.stdout: python3-routes-2.5.1-5.el9.noarch 2024-09-12T02:25:12.763 INFO:teuthology.orchestra.run.smithi172.stdout: python3-rsa-4.9-2.el9.noarch 2024-09-12T02:25:12.763 INFO:teuthology.orchestra.run.smithi172.stdout: python3-scipy-1.6.2-8.el9.x86_64 2024-09-12T02:25:12.763 INFO:teuthology.orchestra.run.smithi172.stdout: python3-tempora-5.0.0-2.el9.noarch 2024-09-12T02:25:12.763 INFO:teuthology.orchestra.run.smithi172.stdout: python3-toml-0.10.2-6.el9.noarch 2024-09-12T02:25:12.763 INFO:teuthology.orchestra.run.smithi172.stdout: python3-typing-extensions-4.12.2-2.el9.noarch 2024-09-12T02:25:12.763 INFO:teuthology.orchestra.run.smithi172.stdout: python3-urllib3-1.26.5-6.el9.noarch 2024-09-12T02:25:12.763 INFO:teuthology.orchestra.run.smithi172.stdout: python3-wcwidth-0.2.5-8.el9.noarch 2024-09-12T02:25:12.763 INFO:teuthology.orchestra.run.smithi172.stdout: python3-webob-1.8.8-2.el9.noarch 2024-09-12T02:25:12.764 INFO:teuthology.orchestra.run.smithi172.stdout: python3-websocket-client-1.2.3-2.el9.noarch 2024-09-12T02:25:12.764 INFO:teuthology.orchestra.run.smithi172.stdout: python3-werkzeug-2.0.3-3.el9.1.noarch 2024-09-12T02:25:12.764 INFO:teuthology.orchestra.run.smithi172.stdout: python3-zc-lockfile-2.0-10.el9.noarch 2024-09-12T02:25:12.764 INFO:teuthology.orchestra.run.smithi172.stdout: qatlib-24.02.0-1.el9.x86_64 2024-09-12T02:25:12.764 INFO:teuthology.orchestra.run.smithi172.stdout: qatlib-service-24.02.0-1.el9.x86_64 2024-09-12T02:25:12.764 INFO:teuthology.orchestra.run.smithi172.stdout: qatzip-libs-1.2.0-1.el9.x86_64 2024-09-12T02:25:12.764 INFO:teuthology.orchestra.run.smithi172.stdout: rbd-fuse-2:19.1.1-298.gb53b6d3e.el9.x86_64 2024-09-12T02:25:12.764 INFO:teuthology.orchestra.run.smithi172.stdout: rbd-mirror-2:19.1.1-298.gb53b6d3e.el9.x86_64 2024-09-12T02:25:12.764 INFO:teuthology.orchestra.run.smithi172.stdout: rbd-nbd-2:19.1.1-298.gb53b6d3e.el9.x86_64 2024-09-12T02:25:12.764 INFO:teuthology.orchestra.run.smithi172.stdout: re2-1:20211101-20.el9.x86_64 2024-09-12T02:25:12.764 INFO:teuthology.orchestra.run.smithi172.stdout: socat-1.7.4.1-6.el9.x86_64 2024-09-12T02:25:12.764 INFO:teuthology.orchestra.run.smithi172.stdout: thrift-0.15.0-2.el9.x86_64 2024-09-12T02:25:12.764 INFO:teuthology.orchestra.run.smithi172.stdout: uuid-1.6.2-55.el9.x86_64 2024-09-12T02:25:12.765 INFO:teuthology.orchestra.run.smithi172.stdout: xfsprogs-devel-6.4.0-4.el9.x86_64 2024-09-12T02:25:12.765 INFO:teuthology.orchestra.run.smithi172.stdout: xmlstarlet-1.6.1-20.el9.x86_64 2024-09-12T02:25:12.765 INFO:teuthology.orchestra.run.smithi039.stdout: Running scriptlet: ceph-immutable-object-cache-2:19.1.1-298.gb53b6d 138/164 2024-09-12T02:25:12.765 INFO:teuthology.orchestra.run.smithi039.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-12T02:25:12.765 INFO:teuthology.orchestra.run.smithi039.stdout:Invalid unit name "ceph-immutable-object-cache@*.service" escaped as "ceph-immutable-object-cache@\x2a.service". 2024-09-12T02:25:12.765 INFO:teuthology.orchestra.run.smithi039.stdout: 2024-09-12T02:25:12.766 INFO:teuthology.orchestra.run.smithi172.stdout: zlib-devel-1.2.11-41.el9.x86_64 2024-09-12T02:25:12.766 INFO:teuthology.orchestra.run.smithi172.stdout: 2024-09-12T02:25:12.766 INFO:teuthology.orchestra.run.smithi172.stdout:Complete! 2024-09-12T02:25:12.818 INFO:teuthology.orchestra.run.smithi039.stdout: Installing : cephfs-mirror-2:19.1.1-298.gb53b6d3e.el9.x86_64 139/164 2024-09-12T02:25:12.869 INFO:teuthology.orchestra.run.smithi039.stdout: Running scriptlet: cephfs-mirror-2:19.1.1-298.gb53b6d3e.el9.x86_64 139/164 2024-09-12T02:25:12.869 INFO:teuthology.orchestra.run.smithi039.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-12T02:25:12.869 INFO:teuthology.orchestra.run.smithi039.stdout:Invalid unit name "cephfs-mirror@*.service" escaped as "cephfs-mirror@\x2a.service". 2024-09-12T02:25:12.869 INFO:teuthology.orchestra.run.smithi039.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/cephfs-mirror.target → /usr/lib/systemd/system/cephfs-mirror.target. 2024-09-12T02:25:12.870 INFO:teuthology.orchestra.run.smithi039.stdout:Created symlink /etc/systemd/system/ceph.target.wants/cephfs-mirror.target → /usr/lib/systemd/system/cephfs-mirror.target. 2024-09-12T02:25:12.870 INFO:teuthology.orchestra.run.smithi039.stdout: 2024-09-12T02:25:13.207 DEBUG:teuthology.parallel:result is None 2024-09-12T02:25:13.218 INFO:teuthology.orchestra.run.smithi039.stdout: Installing : rbd-mirror-2:19.1.1-298.gb53b6d3e.el9.x86_64 140/164 2024-09-12T02:25:13.270 INFO:teuthology.orchestra.run.smithi039.stdout: Running scriptlet: rbd-mirror-2:19.1.1-298.gb53b6d3e.el9.x86_64 140/164 2024-09-12T02:25:13.270 INFO:teuthology.orchestra.run.smithi039.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-12T02:25:13.270 INFO:teuthology.orchestra.run.smithi039.stdout:Invalid unit name "ceph-rbd-mirror@*.service" escaped as "ceph-rbd-mirror@\x2a.service". 2024-09-12T02:25:13.270 INFO:teuthology.orchestra.run.smithi039.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-rbd-mirror.target → /usr/lib/systemd/system/ceph-rbd-mirror.target. 2024-09-12T02:25:13.271 INFO:teuthology.orchestra.run.smithi039.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-rbd-mirror.target → /usr/lib/systemd/system/ceph-rbd-mirror.target. 2024-09-12T02:25:13.271 INFO:teuthology.orchestra.run.smithi039.stdout: 2024-09-12T02:25:14.844 INFO:teuthology.orchestra.run.smithi044.stdout: Installing : ceph-test-2:19.1.1-298.gb53b6d3e.el9.x86_64 141/164 2024-09-12T02:25:14.886 INFO:teuthology.orchestra.run.smithi044.stdout: Installing : rbd-fuse-2:19.1.1-298.gb53b6d3e.el9.x86_64 142/164 2024-09-12T02:25:14.927 INFO:teuthology.orchestra.run.smithi044.stdout: Installing : rbd-nbd-2:19.1.1-298.gb53b6d3e.el9.x86_64 143/164 2024-09-12T02:25:14.958 INFO:teuthology.orchestra.run.smithi044.stdout: Installing : xfsprogs-devel-6.4.0-4.el9.x86_64 144/164 2024-09-12T02:25:14.985 INFO:teuthology.orchestra.run.smithi044.stdout: Installing : elfutils-libelf-devel-0.191-4.el9.x86_64 145/164 2024-09-12T02:25:15.179 INFO:teuthology.orchestra.run.smithi044.stdout: Installing : cephfs-shell-2:19.1.1-298.gb53b6d3e.el9.x86_64 146/164 2024-09-12T02:25:15.232 INFO:teuthology.orchestra.run.smithi044.stdout: Installing : postgresql-contrib-13.16-1.el9.x86_64 147/164 2024-09-12T02:25:15.262 INFO:teuthology.orchestra.run.smithi044.stdout: Installing : libcephfs-devel-2:19.1.1-298.gb53b6d3e.el9.x86_6 148/164 2024-09-12T02:25:15.292 INFO:teuthology.orchestra.run.smithi044.stdout: Upgrading : NetworkManager-team-1:1.49.90-1.el9.x86_64 149/164 2024-09-12T02:25:15.321 INFO:teuthology.orchestra.run.smithi044.stdout: Upgrading : NetworkManager-tui-1:1.49.90-1.el9.x86_64 150/164 2024-09-12T02:25:15.907 INFO:teuthology.orchestra.run.smithi044.stdout: Running scriptlet: postgresql-server-13.16-1.el9.x86_64 151/164 2024-09-12T02:25:15.960 INFO:teuthology.orchestra.run.smithi044.stdout: Installing : postgresql-server-13.16-1.el9.x86_64 151/164 2024-09-12T02:25:15.981 INFO:teuthology.orchestra.run.smithi044.stdout: Running scriptlet: postgresql-server-13.16-1.el9.x86_64 151/164 2024-09-12T02:25:16.887 INFO:teuthology.orchestra.run.smithi044.stdout: Installing : cephfs-top-2:19.1.1-298.gb53b6d3e.el9.noarch 152/164 2024-09-12T02:25:16.974 INFO:teuthology.orchestra.run.smithi044.stdout: Installing : openssl-devel-1:3.2.2-6.el9.x86_64 153/164 2024-09-12T02:25:17.016 INFO:teuthology.orchestra.run.smithi044.stdout: Installing : libaio-devel-0.3.111-13.el9.x86_64 154/164 2024-09-12T02:25:17.101 INFO:teuthology.orchestra.run.smithi044.stdout: Installing : flex-2.6.4-9.el9.x86_64 155/164 2024-09-12T02:25:17.135 INFO:teuthology.orchestra.run.smithi044.stdout: Installing : bison-3.7.4-5.el9.x86_64 156/164 2024-09-12T02:25:17.161 INFO:teuthology.orchestra.run.smithi044.stdout: Cleanup : NetworkManager-tui-1:1.48.8-1.el9.x86_64 157/164 2024-09-12T02:25:17.186 INFO:teuthology.orchestra.run.smithi044.stdout: Cleanup : openssl-1:3.2.2-4.el9.x86_64 158/164 2024-09-12T02:25:17.186 INFO:teuthology.orchestra.run.smithi044.stdout: Cleanup : librbd1-2:16.2.4-5.el9.x86_64 159/164 2024-09-12T02:25:17.270 INFO:teuthology.orchestra.run.smithi044.stdout: Running scriptlet: librbd1-2:16.2.4-5.el9.x86_64 159/164 2024-09-12T02:25:17.270 INFO:teuthology.orchestra.run.smithi044.stdout: Cleanup : librados2-2:16.2.4-5.el9.x86_64 160/164 2024-09-12T02:25:17.346 INFO:teuthology.orchestra.run.smithi044.stdout: Running scriptlet: librados2-2:16.2.4-5.el9.x86_64 160/164 2024-09-12T02:25:17.371 INFO:teuthology.orchestra.run.smithi044.stdout: Cleanup : NetworkManager-team-1:1.48.8-1.el9.x86_64 161/164 2024-09-12T02:25:17.376 INFO:teuthology.orchestra.run.smithi044.stdout: Running scriptlet: NetworkManager-1:1.48.8-1.el9.x86_64 162/164 2024-09-12T02:25:17.376 INFO:teuthology.orchestra.run.smithi044.stdout: Cleanup : NetworkManager-1:1.48.8-1.el9.x86_64 162/164 2024-09-12T02:25:17.565 INFO:teuthology.orchestra.run.smithi044.stdout: Running scriptlet: NetworkManager-1:1.48.8-1.el9.x86_64 162/164 2024-09-12T02:25:17.565 INFO:teuthology.orchestra.run.smithi044.stdout: Cleanup : NetworkManager-libnm-1:1.48.8-1.el9.x86_64 163/164 2024-09-12T02:25:17.649 INFO:teuthology.orchestra.run.smithi044.stdout: Running scriptlet: NetworkManager-libnm-1:1.48.8-1.el9.x86_64 163/164 2024-09-12T02:25:17.716 INFO:teuthology.orchestra.run.smithi044.stdout: Cleanup : openssl-libs-1:3.2.2-4.el9.x86_64 164/164 2024-09-12T02:25:18.533 INFO:teuthology.orchestra.run.smithi039.stdout: Installing : ceph-test-2:19.1.1-298.gb53b6d3e.el9.x86_64 141/164 2024-09-12T02:25:18.575 INFO:teuthology.orchestra.run.smithi039.stdout: Installing : rbd-fuse-2:19.1.1-298.gb53b6d3e.el9.x86_64 142/164 2024-09-12T02:25:18.627 INFO:teuthology.orchestra.run.smithi039.stdout: Installing : rbd-nbd-2:19.1.1-298.gb53b6d3e.el9.x86_64 143/164 2024-09-12T02:25:18.663 INFO:teuthology.orchestra.run.smithi039.stdout: Installing : xfsprogs-devel-6.4.0-4.el9.x86_64 144/164 2024-09-12T02:25:18.699 INFO:teuthology.orchestra.run.smithi039.stdout: Installing : elfutils-libelf-devel-0.191-4.el9.x86_64 145/164 2024-09-12T02:25:18.952 INFO:teuthology.orchestra.run.smithi039.stdout: Installing : cephfs-shell-2:19.1.1-298.gb53b6d3e.el9.x86_64 146/164 2024-09-12T02:25:19.004 INFO:teuthology.orchestra.run.smithi039.stdout: Installing : postgresql-contrib-13.16-1.el9.x86_64 147/164 2024-09-12T02:25:19.034 INFO:teuthology.orchestra.run.smithi039.stdout: Installing : libcephfs-devel-2:19.1.1-298.gb53b6d3e.el9.x86_6 148/164 2024-09-12T02:25:19.074 INFO:teuthology.orchestra.run.smithi039.stdout: Upgrading : NetworkManager-team-1:1.49.90-1.el9.x86_64 149/164 2024-09-12T02:25:19.117 INFO:teuthology.orchestra.run.smithi039.stdout: Upgrading : NetworkManager-tui-1:1.49.90-1.el9.x86_64 150/164 2024-09-12T02:25:19.868 INFO:teuthology.orchestra.run.smithi039.stdout: Running scriptlet: postgresql-server-13.16-1.el9.x86_64 151/164 2024-09-12T02:25:19.923 INFO:teuthology.orchestra.run.smithi039.stdout: Installing : postgresql-server-13.16-1.el9.x86_64 151/164 2024-09-12T02:25:19.965 INFO:teuthology.orchestra.run.smithi039.stdout: Running scriptlet: postgresql-server-13.16-1.el9.x86_64 151/164 2024-09-12T02:25:21.346 INFO:teuthology.orchestra.run.smithi039.stdout: Installing : cephfs-top-2:19.1.1-298.gb53b6d3e.el9.noarch 152/164 2024-09-12T02:25:21.454 INFO:teuthology.orchestra.run.smithi039.stdout: Installing : openssl-devel-1:3.2.2-6.el9.x86_64 153/164 2024-09-12T02:25:21.507 INFO:teuthology.orchestra.run.smithi039.stdout: Installing : libaio-devel-0.3.111-13.el9.x86_64 154/164 2024-09-12T02:25:21.617 INFO:teuthology.orchestra.run.smithi039.stdout: Installing : flex-2.6.4-9.el9.x86_64 155/164 2024-09-12T02:25:21.656 INFO:teuthology.orchestra.run.smithi039.stdout: Installing : bison-3.7.4-5.el9.x86_64 156/164 2024-09-12T02:25:21.690 INFO:teuthology.orchestra.run.smithi039.stdout: Cleanup : NetworkManager-tui-1:1.48.8-1.el9.x86_64 157/164 2024-09-12T02:25:21.726 INFO:teuthology.orchestra.run.smithi039.stdout: Cleanup : openssl-1:3.2.2-4.el9.x86_64 158/164 2024-09-12T02:25:21.727 INFO:teuthology.orchestra.run.smithi039.stdout: Cleanup : librbd1-2:16.2.4-5.el9.x86_64 159/164 2024-09-12T02:25:21.851 INFO:teuthology.orchestra.run.smithi039.stdout: Running scriptlet: librbd1-2:16.2.4-5.el9.x86_64 159/164 2024-09-12T02:25:21.851 INFO:teuthology.orchestra.run.smithi039.stdout: Cleanup : librados2-2:16.2.4-5.el9.x86_64 160/164 2024-09-12T02:25:21.968 INFO:teuthology.orchestra.run.smithi039.stdout: Running scriptlet: librados2-2:16.2.4-5.el9.x86_64 160/164 2024-09-12T02:25:21.992 INFO:teuthology.orchestra.run.smithi039.stdout: Cleanup : NetworkManager-team-1:1.48.8-1.el9.x86_64 161/164 2024-09-12T02:25:22.009 INFO:teuthology.orchestra.run.smithi039.stdout: Running scriptlet: NetworkManager-1:1.48.8-1.el9.x86_64 162/164 2024-09-12T02:25:22.009 INFO:teuthology.orchestra.run.smithi039.stdout: Cleanup : NetworkManager-1:1.48.8-1.el9.x86_64 162/164 2024-09-12T02:25:22.261 INFO:teuthology.orchestra.run.smithi039.stdout: Running scriptlet: NetworkManager-1:1.48.8-1.el9.x86_64 162/164 2024-09-12T02:25:22.261 INFO:teuthology.orchestra.run.smithi039.stdout: Cleanup : NetworkManager-libnm-1:1.48.8-1.el9.x86_64 163/164 2024-09-12T02:25:22.354 INFO:teuthology.orchestra.run.smithi039.stdout: Running scriptlet: NetworkManager-libnm-1:1.48.8-1.el9.x86_64 163/164 2024-09-12T02:25:22.430 INFO:teuthology.orchestra.run.smithi039.stdout: Cleanup : openssl-libs-1:3.2.2-4.el9.x86_64 164/164 2024-09-12T02:25:22.640 INFO:teuthology.orchestra.run.smithi039.stdout: Running scriptlet: openssl-libs-1:3.2.2-4.el9.x86_64 164/164 2024-09-12T02:25:22.640 INFO:teuthology.orchestra.run.smithi039.stdout:Couldn't write '0' to 'kernel/yama/ptrace_scope', ignoring: No such file or directory 2024-09-12T02:25:22.640 INFO:teuthology.orchestra.run.smithi039.stdout: 2024-09-12T02:25:23.294 INFO:teuthology.orchestra.run.smithi044.stdout: Running scriptlet: openssl-libs-1:3.2.2-4.el9.x86_64 164/164 2024-09-12T02:25:23.294 INFO:teuthology.orchestra.run.smithi044.stdout: Verifying : ceph-2:19.1.1-298.gb53b6d3e.el9.x86_64 1/164 2024-09-12T02:25:23.294 INFO:teuthology.orchestra.run.smithi044.stdout: Verifying : ceph-base-2:19.1.1-298.gb53b6d3e.el9.x86_64 2/164 2024-09-12T02:25:23.294 INFO:teuthology.orchestra.run.smithi044.stdout: Verifying : ceph-common-2:19.1.1-298.gb53b6d3e.el9.x86_64 3/164 2024-09-12T02:25:23.294 INFO:teuthology.orchestra.run.smithi044.stdout: Verifying : ceph-fuse-2:19.1.1-298.gb53b6d3e.el9.x86_64 4/164 2024-09-12T02:25:23.294 INFO:teuthology.orchestra.run.smithi044.stdout: Verifying : ceph-immutable-object-cache-2:19.1.1-298.gb53b6d 5/164 2024-09-12T02:25:23.294 INFO:teuthology.orchestra.run.smithi044.stdout: Verifying : ceph-mds-2:19.1.1-298.gb53b6d3e.el9.x86_64 6/164 2024-09-12T02:25:23.294 INFO:teuthology.orchestra.run.smithi044.stdout: Verifying : ceph-mgr-2:19.1.1-298.gb53b6d3e.el9.x86_64 7/164 2024-09-12T02:25:23.294 INFO:teuthology.orchestra.run.smithi044.stdout: Verifying : ceph-mon-2:19.1.1-298.gb53b6d3e.el9.x86_64 8/164 2024-09-12T02:25:23.294 INFO:teuthology.orchestra.run.smithi044.stdout: Verifying : ceph-osd-2:19.1.1-298.gb53b6d3e.el9.x86_64 9/164 2024-09-12T02:25:23.295 INFO:teuthology.orchestra.run.smithi044.stdout: Verifying : ceph-radosgw-2:19.1.1-298.gb53b6d3e.el9.x86_64 10/164 2024-09-12T02:25:23.295 INFO:teuthology.orchestra.run.smithi044.stdout: Verifying : ceph-selinux-2:19.1.1-298.gb53b6d3e.el9.x86_64 11/164 2024-09-12T02:25:23.295 INFO:teuthology.orchestra.run.smithi044.stdout: Verifying : ceph-test-2:19.1.1-298.gb53b6d3e.el9.x86_64 12/164 2024-09-12T02:25:23.295 INFO:teuthology.orchestra.run.smithi044.stdout: Verifying : cephfs-mirror-2:19.1.1-298.gb53b6d3e.el9.x86_64 13/164 2024-09-12T02:25:23.295 INFO:teuthology.orchestra.run.smithi044.stdout: Verifying : cephfs-shell-2:19.1.1-298.gb53b6d3e.el9.x86_64 14/164 2024-09-12T02:25:23.295 INFO:teuthology.orchestra.run.smithi044.stdout: Verifying : libcephfs-devel-2:19.1.1-298.gb53b6d3e.el9.x86_6 15/164 2024-09-12T02:25:23.295 INFO:teuthology.orchestra.run.smithi044.stdout: Verifying : libcephfs2-2:19.1.1-298.gb53b6d3e.el9.x86_64 16/164 2024-09-12T02:25:23.295 INFO:teuthology.orchestra.run.smithi044.stdout: Verifying : libcephsqlite-2:19.1.1-298.gb53b6d3e.el9.x86_64 17/164 2024-09-12T02:25:23.295 INFO:teuthology.orchestra.run.smithi044.stdout: Verifying : librados-devel-2:19.1.1-298.gb53b6d3e.el9.x86_64 18/164 2024-09-12T02:25:23.295 INFO:teuthology.orchestra.run.smithi044.stdout: Verifying : libradosstriper1-2:19.1.1-298.gb53b6d3e.el9.x86_ 19/164 2024-09-12T02:25:23.295 INFO:teuthology.orchestra.run.smithi044.stdout: Verifying : librgw2-2:19.1.1-298.gb53b6d3e.el9.x86_64 20/164 2024-09-12T02:25:23.295 INFO:teuthology.orchestra.run.smithi044.stdout: Verifying : python3-ceph-argparse-2:19.1.1-298.gb53b6d3e.el9 21/164 2024-09-12T02:25:23.295 INFO:teuthology.orchestra.run.smithi044.stdout: Verifying : python3-ceph-common-2:19.1.1-298.gb53b6d3e.el9.x 22/164 2024-09-12T02:25:23.295 INFO:teuthology.orchestra.run.smithi044.stdout: Verifying : python3-cephfs-2:19.1.1-298.gb53b6d3e.el9.x86_64 23/164 2024-09-12T02:25:23.296 INFO:teuthology.orchestra.run.smithi044.stdout: Verifying : python3-rados-2:19.1.1-298.gb53b6d3e.el9.x86_64 24/164 2024-09-12T02:25:23.296 INFO:teuthology.orchestra.run.smithi044.stdout: Verifying : python3-rbd-2:19.1.1-298.gb53b6d3e.el9.x86_64 25/164 2024-09-12T02:25:23.296 INFO:teuthology.orchestra.run.smithi044.stdout: Verifying : python3-rgw-2:19.1.1-298.gb53b6d3e.el9.x86_64 26/164 2024-09-12T02:25:23.296 INFO:teuthology.orchestra.run.smithi044.stdout: Verifying : rbd-fuse-2:19.1.1-298.gb53b6d3e.el9.x86_64 27/164 2024-09-12T02:25:23.296 INFO:teuthology.orchestra.run.smithi044.stdout: Verifying : rbd-mirror-2:19.1.1-298.gb53b6d3e.el9.x86_64 28/164 2024-09-12T02:25:23.308 INFO:teuthology.orchestra.run.smithi044.stdout: Verifying : rbd-nbd-2:19.1.1-298.gb53b6d3e.el9.x86_64 29/164 2024-09-12T02:25:23.308 INFO:teuthology.orchestra.run.smithi044.stdout: Verifying : ceph-grafana-dashboards-2:19.1.1-298.gb53b6d3e.e 30/164 2024-09-12T02:25:23.308 INFO:teuthology.orchestra.run.smithi044.stdout: Verifying : ceph-mgr-cephadm-2:19.1.1-298.gb53b6d3e.el9.noar 31/164 2024-09-12T02:25:23.308 INFO:teuthology.orchestra.run.smithi044.stdout: Verifying : ceph-mgr-dashboard-2:19.1.1-298.gb53b6d3e.el9.no 32/164 2024-09-12T02:25:23.308 INFO:teuthology.orchestra.run.smithi044.stdout: Verifying : ceph-mgr-diskprediction-local-2:19.1.1-298.gb53b 33/164 2024-09-12T02:25:23.308 INFO:teuthology.orchestra.run.smithi044.stdout: Verifying : ceph-mgr-modules-core-2:19.1.1-298.gb53b6d3e.el9 34/164 2024-09-12T02:25:23.309 INFO:teuthology.orchestra.run.smithi044.stdout: Verifying : ceph-mgr-rook-2:19.1.1-298.gb53b6d3e.el9.noarch 35/164 2024-09-12T02:25:23.309 INFO:teuthology.orchestra.run.smithi044.stdout: Verifying : ceph-prometheus-alerts-2:19.1.1-298.gb53b6d3e.el 36/164 2024-09-12T02:25:23.309 INFO:teuthology.orchestra.run.smithi044.stdout: Verifying : ceph-volume-2:19.1.1-298.gb53b6d3e.el9.noarch 37/164 2024-09-12T02:25:23.309 INFO:teuthology.orchestra.run.smithi044.stdout: Verifying : cephadm-2:19.1.1-298.gb53b6d3e.el9.noarch 38/164 2024-09-12T02:25:23.309 INFO:teuthology.orchestra.run.smithi044.stdout: Verifying : cephfs-top-2:19.1.1-298.gb53b6d3e.el9.noarch 39/164 2024-09-12T02:25:23.309 INFO:teuthology.orchestra.run.smithi044.stdout: Verifying : fuse-2.9.9-16.el9.x86_64 40/164 2024-09-12T02:25:23.309 INFO:teuthology.orchestra.run.smithi044.stdout: Verifying : libgfortran-11.5.0-2.el9.x86_64 41/164 2024-09-12T02:25:23.309 INFO:teuthology.orchestra.run.smithi044.stdout: Verifying : libquadmath-11.5.0-2.el9.x86_64 42/164 2024-09-12T02:25:23.309 INFO:teuthology.orchestra.run.smithi044.stdout: Verifying : python3-cffi-1.14.5-5.el9.x86_64 43/164 2024-09-12T02:25:23.309 INFO:teuthology.orchestra.run.smithi044.stdout: Verifying : python3-cryptography-36.0.1-4.el9.x86_64 44/164 2024-09-12T02:25:23.309 INFO:teuthology.orchestra.run.smithi044.stdout: Verifying : python3-ply-3.11-14.el9.noarch 45/164 2024-09-12T02:25:23.309 INFO:teuthology.orchestra.run.smithi044.stdout: Verifying : python3-pycparser-2.20-6.el9.noarch 46/164 2024-09-12T02:25:23.310 INFO:teuthology.orchestra.run.smithi044.stdout: Verifying : python3-requests-2.25.1-8.el9.noarch 47/164 2024-09-12T02:25:23.310 INFO:teuthology.orchestra.run.smithi044.stdout: Verifying : python3-urllib3-1.26.5-6.el9.noarch 48/164 2024-09-12T02:25:23.310 INFO:teuthology.orchestra.run.smithi044.stdout: Verifying : automake-1.16.2-8.el9.noarch 49/164 2024-09-12T02:25:23.310 INFO:teuthology.orchestra.run.smithi044.stdout: Verifying : bison-3.7.4-5.el9.x86_64 50/164 2024-09-12T02:25:23.310 INFO:teuthology.orchestra.run.smithi044.stdout: Verifying : boost-program-options-1.75.0-8.el9.x86_64 51/164 2024-09-12T02:25:23.310 INFO:teuthology.orchestra.run.smithi044.stdout: Verifying : elfutils-libelf-devel-0.191-4.el9.x86_64 52/164 2024-09-12T02:25:23.310 INFO:teuthology.orchestra.run.smithi044.stdout: Verifying : flex-2.6.4-9.el9.x86_64 53/164 2024-09-12T02:25:23.310 INFO:teuthology.orchestra.run.smithi044.stdout: Verifying : flexiblas-3.0.4-8.el9.x86_64 54/164 2024-09-12T02:25:23.310 INFO:teuthology.orchestra.run.smithi044.stdout: Verifying : flexiblas-netlib-3.0.4-8.el9.x86_64 55/164 2024-09-12T02:25:23.310 INFO:teuthology.orchestra.run.smithi044.stdout: Verifying : flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 56/164 2024-09-12T02:25:23.310 INFO:teuthology.orchestra.run.smithi044.stdout: Verifying : libaio-devel-0.3.111-13.el9.x86_64 57/164 2024-09-12T02:25:23.310 INFO:teuthology.orchestra.run.smithi044.stdout: Verifying : libpmemobj-1.12.1-1.el9.x86_64 58/164 2024-09-12T02:25:23.310 INFO:teuthology.orchestra.run.smithi044.stdout: Verifying : librabbitmq-0.11.0-7.el9.x86_64 59/164 2024-09-12T02:25:23.311 INFO:teuthology.orchestra.run.smithi044.stdout: Verifying : librdkafka-1.6.1-102.el9.x86_64 60/164 2024-09-12T02:25:23.311 INFO:teuthology.orchestra.run.smithi044.stdout: Verifying : libtool-2.4.6-46.el9.x86_64 61/164 2024-09-12T02:25:23.311 INFO:teuthology.orchestra.run.smithi044.stdout: Verifying : libuuid-devel-2.37.4-20.el9.x86_64 62/164 2024-09-12T02:25:23.311 INFO:teuthology.orchestra.run.smithi044.stdout: Verifying : libzstd-devel-1.5.1-2.el9.x86_64 63/164 2024-09-12T02:25:23.311 INFO:teuthology.orchestra.run.smithi044.stdout: Verifying : lttng-ust-2.12.0-6.el9.x86_64 64/164 2024-09-12T02:25:23.311 INFO:teuthology.orchestra.run.smithi044.stdout: Verifying : lua-5.4.4-4.el9.x86_64 65/164 2024-09-12T02:25:23.311 INFO:teuthology.orchestra.run.smithi044.stdout: Verifying : openblas-0.3.26-2.el9.x86_64 66/164 2024-09-12T02:25:23.311 INFO:teuthology.orchestra.run.smithi044.stdout: Verifying : openblas-openmp-0.3.26-2.el9.x86_64 67/164 2024-09-12T02:25:23.311 INFO:teuthology.orchestra.run.smithi044.stdout: Verifying : openssl-devel-1:3.2.2-6.el9.x86_64 68/164 2024-09-12T02:25:23.311 INFO:teuthology.orchestra.run.smithi044.stdout: Verifying : postgresql-13.16-1.el9.x86_64 69/164 2024-09-12T02:25:23.311 INFO:teuthology.orchestra.run.smithi044.stdout: Verifying : postgresql-contrib-13.16-1.el9.x86_64 70/164 2024-09-12T02:25:23.311 INFO:teuthology.orchestra.run.smithi044.stdout: Verifying : postgresql-private-libs-13.16-1.el9.x86_64 71/164 2024-09-12T02:25:23.311 INFO:teuthology.orchestra.run.smithi044.stdout: Verifying : postgresql-server-13.16-1.el9.x86_64 72/164 2024-09-12T02:25:23.312 INFO:teuthology.orchestra.run.smithi044.stdout: Verifying : protobuf-3.14.0-13.el9.x86_64 73/164 2024-09-12T02:25:23.312 INFO:teuthology.orchestra.run.smithi044.stdout: Verifying : python3-attrs-20.3.0-7.el9.noarch 74/164 2024-09-12T02:25:23.312 INFO:teuthology.orchestra.run.smithi044.stdout: Verifying : python3-babel-2.9.1-2.el9.noarch 75/164 2024-09-12T02:25:23.312 INFO:teuthology.orchestra.run.smithi044.stdout: Verifying : python3-colorama-0.4.6-3.el9.noarch 76/164 2024-09-12T02:25:23.312 INFO:teuthology.orchestra.run.smithi044.stdout: Verifying : python3-devel-3.9.19-8.el9.x86_64 77/164 2024-09-12T02:25:23.312 INFO:teuthology.orchestra.run.smithi044.stdout: Verifying : python3-jinja2-2.11.3-6.el9.noarch 78/164 2024-09-12T02:25:23.312 INFO:teuthology.orchestra.run.smithi044.stdout: Verifying : python3-jsonpatch-1.21-16.el9.noarch 79/164 2024-09-12T02:25:23.312 INFO:teuthology.orchestra.run.smithi044.stdout: Verifying : python3-jsonpointer-2.0-4.el9.noarch 80/164 2024-09-12T02:25:23.312 INFO:teuthology.orchestra.run.smithi044.stdout: Verifying : python3-mako-1.1.4-6.el9.noarch 81/164 2024-09-12T02:25:23.312 INFO:teuthology.orchestra.run.smithi044.stdout: Verifying : python3-markupsafe-1.1.1-12.el9.x86_64 82/164 2024-09-12T02:25:23.312 INFO:teuthology.orchestra.run.smithi044.stdout: Verifying : python3-numpy-1:1.20.1-5.el9.x86_64 83/164 2024-09-12T02:25:23.312 INFO:teuthology.orchestra.run.smithi044.stdout: Verifying : python3-numpy-f2py-1:1.20.1-5.el9.x86_64 84/164 2024-09-12T02:25:23.312 INFO:teuthology.orchestra.run.smithi044.stdout: Verifying : python3-oauthlib-3.1.1-5.el9.noarch 85/164 2024-09-12T02:25:23.313 INFO:teuthology.orchestra.run.smithi044.stdout: Verifying : python3-packaging-20.9-5.el9.noarch 86/164 2024-09-12T02:25:23.313 INFO:teuthology.orchestra.run.smithi044.stdout: Verifying : python3-prettytable-0.7.2-27.el9.noarch 87/164 2024-09-12T02:25:23.313 INFO:teuthology.orchestra.run.smithi044.stdout: Verifying : python3-protobuf-3.14.0-13.el9.noarch 88/164 2024-09-12T02:25:23.313 INFO:teuthology.orchestra.run.smithi044.stdout: Verifying : python3-pyasn1-0.4.8-6.el9.noarch 89/164 2024-09-12T02:25:23.313 INFO:teuthology.orchestra.run.smithi044.stdout: Verifying : python3-pyasn1-modules-0.4.8-6.el9.noarch 90/164 2024-09-12T02:25:23.313 INFO:teuthology.orchestra.run.smithi044.stdout: Verifying : python3-pytz-2021.1-5.el9.noarch 91/164 2024-09-12T02:25:23.313 INFO:teuthology.orchestra.run.smithi044.stdout: Verifying : python3-requests-oauthlib-1.3.0-12.el9.noarch 92/164 2024-09-12T02:25:23.313 INFO:teuthology.orchestra.run.smithi044.stdout: Verifying : python3-scipy-1.6.2-8.el9.x86_64 93/164 2024-09-12T02:25:23.313 INFO:teuthology.orchestra.run.smithi044.stdout: Verifying : python3-toml-0.10.2-6.el9.noarch 94/164 2024-09-12T02:25:23.313 INFO:teuthology.orchestra.run.smithi044.stdout: Verifying : python3-wcwidth-0.2.5-8.el9.noarch 95/164 2024-09-12T02:25:23.313 INFO:teuthology.orchestra.run.smithi044.stdout: Verifying : qatlib-24.02.0-1.el9.x86_64 96/164 2024-09-12T02:25:23.314 INFO:teuthology.orchestra.run.smithi044.stdout: Verifying : qatlib-service-24.02.0-1.el9.x86_64 97/164 2024-09-12T02:25:23.314 INFO:teuthology.orchestra.run.smithi044.stdout: Verifying : qatzip-libs-1.2.0-1.el9.x86_64 98/164 2024-09-12T02:25:23.314 INFO:teuthology.orchestra.run.smithi044.stdout: Verifying : socat-1.7.4.1-6.el9.x86_64 99/164 2024-09-12T02:25:23.314 INFO:teuthology.orchestra.run.smithi044.stdout: Verifying : uuid-1.6.2-55.el9.x86_64 100/164 2024-09-12T02:25:23.314 INFO:teuthology.orchestra.run.smithi044.stdout: Verifying : xfsprogs-devel-6.4.0-4.el9.x86_64 101/164 2024-09-12T02:25:23.314 INFO:teuthology.orchestra.run.smithi044.stdout: Verifying : xmlstarlet-1.6.1-20.el9.x86_64 102/164 2024-09-12T02:25:23.314 INFO:teuthology.orchestra.run.smithi044.stdout: Verifying : zlib-devel-1.2.11-41.el9.x86_64 103/164 2024-09-12T02:25:23.314 INFO:teuthology.orchestra.run.smithi044.stdout: Verifying : lua-devel-5.4.4-4.el9.x86_64 104/164 2024-09-12T02:25:23.314 INFO:teuthology.orchestra.run.smithi044.stdout: Verifying : protobuf-compiler-3.14.0-13.el9.x86_64 105/164 2024-09-12T02:25:23.314 INFO:teuthology.orchestra.run.smithi044.stdout: Verifying : abseil-cpp-20211102.0-3.el9.x86_64 106/164 2024-09-12T02:25:23.314 INFO:teuthology.orchestra.run.smithi044.stdout: Verifying : gperftools-libs-2.9.1-2.el9.x86_64 107/164 2024-09-12T02:25:23.314 INFO:teuthology.orchestra.run.smithi044.stdout: Verifying : grpc-data-1.46.7-10.el9.noarch 108/164 2024-09-12T02:25:23.315 INFO:teuthology.orchestra.run.smithi044.stdout: Verifying : libarrow-9.0.0-11.el9.x86_64 109/164 2024-09-12T02:25:23.315 INFO:teuthology.orchestra.run.smithi044.stdout: Verifying : libarrow-doc-9.0.0-11.el9.noarch 110/164 2024-09-12T02:25:23.315 INFO:teuthology.orchestra.run.smithi044.stdout: Verifying : liboath-2.6.7-2.el9.x86_64 111/164 2024-09-12T02:25:23.315 INFO:teuthology.orchestra.run.smithi044.stdout: Verifying : libunwind-1.6.2-1.el9.x86_64 112/164 2024-09-12T02:25:23.315 INFO:teuthology.orchestra.run.smithi044.stdout: Verifying : luarocks-3.9.2-5.el9.noarch 113/164 2024-09-12T02:25:23.315 INFO:teuthology.orchestra.run.smithi044.stdout: Verifying : parquet-libs-9.0.0-11.el9.x86_64 114/164 2024-09-12T02:25:23.315 INFO:teuthology.orchestra.run.smithi044.stdout: Verifying : python3-asyncssh-2.13.2-5.el9.noarch 115/164 2024-09-12T02:25:23.315 INFO:teuthology.orchestra.run.smithi044.stdout: Verifying : python3-bcrypt-3.2.2-1.el9.x86_64 116/164 2024-09-12T02:25:23.315 INFO:teuthology.orchestra.run.smithi044.stdout: Verifying : python3-cachetools-4.2.4-1.el9.noarch 117/164 2024-09-12T02:25:23.315 INFO:teuthology.orchestra.run.smithi044.stdout: Verifying : python3-certifi-2023.05.07-4.el9.noarch 118/164 2024-09-12T02:25:23.315 INFO:teuthology.orchestra.run.smithi044.stdout: Verifying : python3-cheroot-8.6.0-4.el9.noarch 119/164 2024-09-12T02:25:23.315 INFO:teuthology.orchestra.run.smithi044.stdout: Verifying : python3-cherrypy-18.6.1-2.el9.noarch 120/164 2024-09-12T02:25:23.315 INFO:teuthology.orchestra.run.smithi044.stdout: Verifying : python3-cmd2-2.4.2-2.el9.noarch 121/164 2024-09-12T02:25:23.316 INFO:teuthology.orchestra.run.smithi044.stdout: Verifying : python3-google-auth-1:2.34.0-1.el9.noarch 122/164 2024-09-12T02:25:23.316 INFO:teuthology.orchestra.run.smithi044.stdout: Verifying : python3-grpcio-1.46.7-10.el9.x86_64 123/164 2024-09-12T02:25:23.316 INFO:teuthology.orchestra.run.smithi044.stdout: Verifying : python3-grpcio-tools-1.46.7-10.el9.x86_64 124/164 2024-09-12T02:25:23.316 INFO:teuthology.orchestra.run.smithi044.stdout: Verifying : python3-jaraco-8.2.1-3.el9.noarch 125/164 2024-09-12T02:25:23.316 INFO:teuthology.orchestra.run.smithi044.stdout: Verifying : python3-jaraco-classes-3.2.1-5.el9.noarch 126/164 2024-09-12T02:25:23.316 INFO:teuthology.orchestra.run.smithi044.stdout: Verifying : python3-jaraco-collections-3.0.0-8.el9.noarch 127/164 2024-09-12T02:25:23.316 INFO:teuthology.orchestra.run.smithi044.stdout: Verifying : python3-jaraco-functools-3.5.0-2.el9.noarch 128/164 2024-09-12T02:25:23.316 INFO:teuthology.orchestra.run.smithi044.stdout: Verifying : python3-jaraco-text-3.2.0-6.el9.noarch 129/164 2024-09-12T02:25:23.316 INFO:teuthology.orchestra.run.smithi044.stdout: Verifying : python3-kubernetes-1:26.1.0-2.el9.noarch 130/164 2024-09-12T02:25:23.316 INFO:teuthology.orchestra.run.smithi044.stdout: Verifying : python3-logutils-0.3.5-21.el9.noarch 131/164 2024-09-12T02:25:23.316 INFO:teuthology.orchestra.run.smithi044.stdout: Verifying : python3-more-itertools-8.12.0-2.el9.noarch 132/164 2024-09-12T02:25:23.316 INFO:teuthology.orchestra.run.smithi044.stdout: Verifying : python3-natsort-7.1.1-5.el9.noarch 133/164 2024-09-12T02:25:23.316 INFO:teuthology.orchestra.run.smithi044.stdout: Verifying : python3-pecan-1.4.2-3.el9.noarch 134/164 2024-09-12T02:25:23.317 INFO:teuthology.orchestra.run.smithi044.stdout: Verifying : python3-portend-3.1.0-2.el9.noarch 135/164 2024-09-12T02:25:23.317 INFO:teuthology.orchestra.run.smithi044.stdout: Verifying : python3-pyOpenSSL-21.0.0-1.el9.noarch 136/164 2024-09-12T02:25:23.317 INFO:teuthology.orchestra.run.smithi044.stdout: Verifying : python3-pyperclip-1.8.2-2.el9.noarch 137/164 2024-09-12T02:25:23.317 INFO:teuthology.orchestra.run.smithi044.stdout: Verifying : python3-repoze-lru-0.7-16.el9.noarch 138/164 2024-09-12T02:25:23.317 INFO:teuthology.orchestra.run.smithi044.stdout: Verifying : python3-routes-2.5.1-5.el9.noarch 139/164 2024-09-12T02:25:23.317 INFO:teuthology.orchestra.run.smithi044.stdout: Verifying : python3-rsa-4.9-2.el9.noarch 140/164 2024-09-12T02:25:23.317 INFO:teuthology.orchestra.run.smithi044.stdout: Verifying : python3-tempora-5.0.0-2.el9.noarch 141/164 2024-09-12T02:25:23.317 INFO:teuthology.orchestra.run.smithi044.stdout: Verifying : python3-typing-extensions-4.12.2-2.el9.noarch 142/164 2024-09-12T02:25:23.317 INFO:teuthology.orchestra.run.smithi044.stdout: Verifying : python3-webob-1.8.8-2.el9.noarch 143/164 2024-09-12T02:25:23.317 INFO:teuthology.orchestra.run.smithi044.stdout: Verifying : python3-websocket-client-1.2.3-2.el9.noarch 144/164 2024-09-12T02:25:23.317 INFO:teuthology.orchestra.run.smithi044.stdout: Verifying : python3-werkzeug-2.0.3-3.el9.1.noarch 145/164 2024-09-12T02:25:23.317 INFO:teuthology.orchestra.run.smithi044.stdout: Verifying : python3-zc-lockfile-2.0-10.el9.noarch 146/164 2024-09-12T02:25:23.317 INFO:teuthology.orchestra.run.smithi044.stdout: Verifying : re2-1:20211101-20.el9.x86_64 147/164 2024-09-12T02:25:23.318 INFO:teuthology.orchestra.run.smithi044.stdout: Verifying : thrift-0.15.0-2.el9.x86_64 148/164 2024-09-12T02:25:23.318 INFO:teuthology.orchestra.run.smithi044.stdout: Verifying : librados2-2:19.1.1-298.gb53b6d3e.el9.x86_64 149/164 2024-09-12T02:25:23.318 INFO:teuthology.orchestra.run.smithi044.stdout: Verifying : librados2-2:16.2.4-5.el9.x86_64 150/164 2024-09-12T02:25:23.318 INFO:teuthology.orchestra.run.smithi044.stdout: Verifying : librbd1-2:19.1.1-298.gb53b6d3e.el9.x86_64 151/164 2024-09-12T02:25:23.318 INFO:teuthology.orchestra.run.smithi044.stdout: Verifying : librbd1-2:16.2.4-5.el9.x86_64 152/164 2024-09-12T02:25:23.318 INFO:teuthology.orchestra.run.smithi044.stdout: Verifying : NetworkManager-1:1.49.90-1.el9.x86_64 153/164 2024-09-12T02:25:23.318 INFO:teuthology.orchestra.run.smithi044.stdout: Verifying : NetworkManager-1:1.48.8-1.el9.x86_64 154/164 2024-09-12T02:25:23.318 INFO:teuthology.orchestra.run.smithi044.stdout: Verifying : NetworkManager-libnm-1:1.49.90-1.el9.x86_64 155/164 2024-09-12T02:25:23.318 INFO:teuthology.orchestra.run.smithi044.stdout: Verifying : NetworkManager-libnm-1:1.48.8-1.el9.x86_64 156/164 2024-09-12T02:25:23.318 INFO:teuthology.orchestra.run.smithi044.stdout: Verifying : NetworkManager-team-1:1.49.90-1.el9.x86_64 157/164 2024-09-12T02:25:23.318 INFO:teuthology.orchestra.run.smithi044.stdout: Verifying : NetworkManager-team-1:1.48.8-1.el9.x86_64 158/164 2024-09-12T02:25:23.318 INFO:teuthology.orchestra.run.smithi044.stdout: Verifying : NetworkManager-tui-1:1.49.90-1.el9.x86_64 159/164 2024-09-12T02:25:23.318 INFO:teuthology.orchestra.run.smithi044.stdout: Verifying : NetworkManager-tui-1:1.48.8-1.el9.x86_64 160/164 2024-09-12T02:25:23.319 INFO:teuthology.orchestra.run.smithi044.stdout: Verifying : openssl-1:3.2.2-6.el9.x86_64 161/164 2024-09-12T02:25:23.319 INFO:teuthology.orchestra.run.smithi044.stdout: Verifying : openssl-1:3.2.2-4.el9.x86_64 162/164 2024-09-12T02:25:23.319 INFO:teuthology.orchestra.run.smithi044.stdout: Verifying : openssl-libs-1:3.2.2-6.el9.x86_64 163/164 2024-09-12T02:25:25.995 INFO:teuthology.orchestra.run.smithi044.stdout: Verifying : openssl-libs-1:3.2.2-4.el9.x86_64 164/164 2024-09-12T02:25:25.995 INFO:teuthology.orchestra.run.smithi044.stdout: 2024-09-12T02:25:25.995 INFO:teuthology.orchestra.run.smithi044.stdout:Upgraded: 2024-09-12T02:25:25.995 INFO:teuthology.orchestra.run.smithi044.stdout: NetworkManager-1:1.49.90-1.el9.x86_64 2024-09-12T02:25:25.995 INFO:teuthology.orchestra.run.smithi044.stdout: NetworkManager-libnm-1:1.49.90-1.el9.x86_64 2024-09-12T02:25:25.995 INFO:teuthology.orchestra.run.smithi044.stdout: NetworkManager-team-1:1.49.90-1.el9.x86_64 2024-09-12T02:25:25.996 INFO:teuthology.orchestra.run.smithi044.stdout: NetworkManager-tui-1:1.49.90-1.el9.x86_64 2024-09-12T02:25:25.996 INFO:teuthology.orchestra.run.smithi044.stdout: librados2-2:19.1.1-298.gb53b6d3e.el9.x86_64 2024-09-12T02:25:25.996 INFO:teuthology.orchestra.run.smithi044.stdout: librbd1-2:19.1.1-298.gb53b6d3e.el9.x86_64 2024-09-12T02:25:25.996 INFO:teuthology.orchestra.run.smithi044.stdout: openssl-1:3.2.2-6.el9.x86_64 2024-09-12T02:25:25.996 INFO:teuthology.orchestra.run.smithi044.stdout: openssl-libs-1:3.2.2-6.el9.x86_64 2024-09-12T02:25:25.996 INFO:teuthology.orchestra.run.smithi044.stdout:Installed: 2024-09-12T02:25:25.996 INFO:teuthology.orchestra.run.smithi044.stdout: abseil-cpp-20211102.0-3.el9.x86_64 2024-09-12T02:25:25.996 INFO:teuthology.orchestra.run.smithi044.stdout: automake-1.16.2-8.el9.noarch 2024-09-12T02:25:25.996 INFO:teuthology.orchestra.run.smithi044.stdout: bison-3.7.4-5.el9.x86_64 2024-09-12T02:25:25.996 INFO:teuthology.orchestra.run.smithi044.stdout: boost-program-options-1.75.0-8.el9.x86_64 2024-09-12T02:25:25.996 INFO:teuthology.orchestra.run.smithi044.stdout: ceph-2:19.1.1-298.gb53b6d3e.el9.x86_64 2024-09-12T02:25:25.996 INFO:teuthology.orchestra.run.smithi044.stdout: ceph-base-2:19.1.1-298.gb53b6d3e.el9.x86_64 2024-09-12T02:25:25.996 INFO:teuthology.orchestra.run.smithi044.stdout: ceph-common-2:19.1.1-298.gb53b6d3e.el9.x86_64 2024-09-12T02:25:25.997 INFO:teuthology.orchestra.run.smithi044.stdout: ceph-fuse-2:19.1.1-298.gb53b6d3e.el9.x86_64 2024-09-12T02:25:25.997 INFO:teuthology.orchestra.run.smithi044.stdout: ceph-grafana-dashboards-2:19.1.1-298.gb53b6d3e.el9.noarch 2024-09-12T02:25:25.997 INFO:teuthology.orchestra.run.smithi044.stdout: ceph-immutable-object-cache-2:19.1.1-298.gb53b6d3e.el9.x86_64 2024-09-12T02:25:25.997 INFO:teuthology.orchestra.run.smithi044.stdout: ceph-mds-2:19.1.1-298.gb53b6d3e.el9.x86_64 2024-09-12T02:25:25.997 INFO:teuthology.orchestra.run.smithi044.stdout: ceph-mgr-2:19.1.1-298.gb53b6d3e.el9.x86_64 2024-09-12T02:25:25.997 INFO:teuthology.orchestra.run.smithi044.stdout: ceph-mgr-cephadm-2:19.1.1-298.gb53b6d3e.el9.noarch 2024-09-12T02:25:25.997 INFO:teuthology.orchestra.run.smithi044.stdout: ceph-mgr-dashboard-2:19.1.1-298.gb53b6d3e.el9.noarch 2024-09-12T02:25:25.997 INFO:teuthology.orchestra.run.smithi044.stdout: ceph-mgr-diskprediction-local-2:19.1.1-298.gb53b6d3e.el9.noarch 2024-09-12T02:25:25.997 INFO:teuthology.orchestra.run.smithi044.stdout: ceph-mgr-modules-core-2:19.1.1-298.gb53b6d3e.el9.noarch 2024-09-12T02:25:25.997 INFO:teuthology.orchestra.run.smithi044.stdout: ceph-mgr-rook-2:19.1.1-298.gb53b6d3e.el9.noarch 2024-09-12T02:25:25.997 INFO:teuthology.orchestra.run.smithi044.stdout: ceph-mon-2:19.1.1-298.gb53b6d3e.el9.x86_64 2024-09-12T02:25:25.997 INFO:teuthology.orchestra.run.smithi044.stdout: ceph-osd-2:19.1.1-298.gb53b6d3e.el9.x86_64 2024-09-12T02:25:25.997 INFO:teuthology.orchestra.run.smithi044.stdout: ceph-prometheus-alerts-2:19.1.1-298.gb53b6d3e.el9.noarch 2024-09-12T02:25:25.997 INFO:teuthology.orchestra.run.smithi044.stdout: ceph-radosgw-2:19.1.1-298.gb53b6d3e.el9.x86_64 2024-09-12T02:25:25.998 INFO:teuthology.orchestra.run.smithi044.stdout: ceph-selinux-2:19.1.1-298.gb53b6d3e.el9.x86_64 2024-09-12T02:25:25.998 INFO:teuthology.orchestra.run.smithi044.stdout: ceph-test-2:19.1.1-298.gb53b6d3e.el9.x86_64 2024-09-12T02:25:25.998 INFO:teuthology.orchestra.run.smithi044.stdout: ceph-volume-2:19.1.1-298.gb53b6d3e.el9.noarch 2024-09-12T02:25:25.998 INFO:teuthology.orchestra.run.smithi044.stdout: cephadm-2:19.1.1-298.gb53b6d3e.el9.noarch 2024-09-12T02:25:25.998 INFO:teuthology.orchestra.run.smithi044.stdout: cephfs-mirror-2:19.1.1-298.gb53b6d3e.el9.x86_64 2024-09-12T02:25:25.998 INFO:teuthology.orchestra.run.smithi044.stdout: cephfs-shell-2:19.1.1-298.gb53b6d3e.el9.x86_64 2024-09-12T02:25:25.998 INFO:teuthology.orchestra.run.smithi044.stdout: cephfs-top-2:19.1.1-298.gb53b6d3e.el9.noarch 2024-09-12T02:25:25.998 INFO:teuthology.orchestra.run.smithi044.stdout: elfutils-libelf-devel-0.191-4.el9.x86_64 2024-09-12T02:25:25.998 INFO:teuthology.orchestra.run.smithi044.stdout: flex-2.6.4-9.el9.x86_64 2024-09-12T02:25:25.998 INFO:teuthology.orchestra.run.smithi044.stdout: flexiblas-3.0.4-8.el9.x86_64 2024-09-12T02:25:25.998 INFO:teuthology.orchestra.run.smithi044.stdout: flexiblas-netlib-3.0.4-8.el9.x86_64 2024-09-12T02:25:25.998 INFO:teuthology.orchestra.run.smithi044.stdout: flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 2024-09-12T02:25:25.998 INFO:teuthology.orchestra.run.smithi044.stdout: fuse-2.9.9-16.el9.x86_64 2024-09-12T02:25:25.999 INFO:teuthology.orchestra.run.smithi044.stdout: gperftools-libs-2.9.1-2.el9.x86_64 2024-09-12T02:25:25.999 INFO:teuthology.orchestra.run.smithi044.stdout: grpc-data-1.46.7-10.el9.noarch 2024-09-12T02:25:25.999 INFO:teuthology.orchestra.run.smithi044.stdout: libaio-devel-0.3.111-13.el9.x86_64 2024-09-12T02:25:25.999 INFO:teuthology.orchestra.run.smithi044.stdout: libarrow-9.0.0-11.el9.x86_64 2024-09-12T02:25:25.999 INFO:teuthology.orchestra.run.smithi044.stdout: libarrow-doc-9.0.0-11.el9.noarch 2024-09-12T02:25:25.999 INFO:teuthology.orchestra.run.smithi044.stdout: libcephfs-devel-2:19.1.1-298.gb53b6d3e.el9.x86_64 2024-09-12T02:25:25.999 INFO:teuthology.orchestra.run.smithi044.stdout: libcephfs2-2:19.1.1-298.gb53b6d3e.el9.x86_64 2024-09-12T02:25:25.999 INFO:teuthology.orchestra.run.smithi044.stdout: libcephsqlite-2:19.1.1-298.gb53b6d3e.el9.x86_64 2024-09-12T02:25:25.999 INFO:teuthology.orchestra.run.smithi044.stdout: libgfortran-11.5.0-2.el9.x86_64 2024-09-12T02:25:25.999 INFO:teuthology.orchestra.run.smithi044.stdout: liboath-2.6.7-2.el9.x86_64 2024-09-12T02:25:25.999 INFO:teuthology.orchestra.run.smithi044.stdout: libpmemobj-1.12.1-1.el9.x86_64 2024-09-12T02:25:25.999 INFO:teuthology.orchestra.run.smithi044.stdout: libquadmath-11.5.0-2.el9.x86_64 2024-09-12T02:25:25.999 INFO:teuthology.orchestra.run.smithi044.stdout: librabbitmq-0.11.0-7.el9.x86_64 2024-09-12T02:25:25.999 INFO:teuthology.orchestra.run.smithi044.stdout: librados-devel-2:19.1.1-298.gb53b6d3e.el9.x86_64 2024-09-12T02:25:26.000 INFO:teuthology.orchestra.run.smithi044.stdout: libradosstriper1-2:19.1.1-298.gb53b6d3e.el9.x86_64 2024-09-12T02:25:26.000 INFO:teuthology.orchestra.run.smithi044.stdout: librdkafka-1.6.1-102.el9.x86_64 2024-09-12T02:25:26.000 INFO:teuthology.orchestra.run.smithi044.stdout: librgw2-2:19.1.1-298.gb53b6d3e.el9.x86_64 2024-09-12T02:25:26.000 INFO:teuthology.orchestra.run.smithi044.stdout: libtool-2.4.6-46.el9.x86_64 2024-09-12T02:25:26.000 INFO:teuthology.orchestra.run.smithi044.stdout: libunwind-1.6.2-1.el9.x86_64 2024-09-12T02:25:26.000 INFO:teuthology.orchestra.run.smithi044.stdout: libuuid-devel-2.37.4-20.el9.x86_64 2024-09-12T02:25:26.000 INFO:teuthology.orchestra.run.smithi044.stdout: libzstd-devel-1.5.1-2.el9.x86_64 2024-09-12T02:25:26.000 INFO:teuthology.orchestra.run.smithi044.stdout: lttng-ust-2.12.0-6.el9.x86_64 2024-09-12T02:25:26.000 INFO:teuthology.orchestra.run.smithi044.stdout: lua-5.4.4-4.el9.x86_64 2024-09-12T02:25:26.000 INFO:teuthology.orchestra.run.smithi044.stdout: lua-devel-5.4.4-4.el9.x86_64 2024-09-12T02:25:26.000 INFO:teuthology.orchestra.run.smithi044.stdout: luarocks-3.9.2-5.el9.noarch 2024-09-12T02:25:26.000 INFO:teuthology.orchestra.run.smithi044.stdout: openblas-0.3.26-2.el9.x86_64 2024-09-12T02:25:26.000 INFO:teuthology.orchestra.run.smithi044.stdout: openblas-openmp-0.3.26-2.el9.x86_64 2024-09-12T02:25:26.000 INFO:teuthology.orchestra.run.smithi044.stdout: openssl-devel-1:3.2.2-6.el9.x86_64 2024-09-12T02:25:26.001 INFO:teuthology.orchestra.run.smithi044.stdout: parquet-libs-9.0.0-11.el9.x86_64 2024-09-12T02:25:26.001 INFO:teuthology.orchestra.run.smithi044.stdout: postgresql-13.16-1.el9.x86_64 2024-09-12T02:25:26.001 INFO:teuthology.orchestra.run.smithi044.stdout: postgresql-contrib-13.16-1.el9.x86_64 2024-09-12T02:25:26.001 INFO:teuthology.orchestra.run.smithi044.stdout: postgresql-private-libs-13.16-1.el9.x86_64 2024-09-12T02:25:26.001 INFO:teuthology.orchestra.run.smithi044.stdout: postgresql-server-13.16-1.el9.x86_64 2024-09-12T02:25:26.001 INFO:teuthology.orchestra.run.smithi044.stdout: protobuf-3.14.0-13.el9.x86_64 2024-09-12T02:25:26.001 INFO:teuthology.orchestra.run.smithi044.stdout: protobuf-compiler-3.14.0-13.el9.x86_64 2024-09-12T02:25:26.001 INFO:teuthology.orchestra.run.smithi044.stdout: python3-asyncssh-2.13.2-5.el9.noarch 2024-09-12T02:25:26.001 INFO:teuthology.orchestra.run.smithi044.stdout: python3-attrs-20.3.0-7.el9.noarch 2024-09-12T02:25:26.001 INFO:teuthology.orchestra.run.smithi044.stdout: python3-babel-2.9.1-2.el9.noarch 2024-09-12T02:25:26.001 INFO:teuthology.orchestra.run.smithi044.stdout: python3-bcrypt-3.2.2-1.el9.x86_64 2024-09-12T02:25:26.001 INFO:teuthology.orchestra.run.smithi044.stdout: python3-cachetools-4.2.4-1.el9.noarch 2024-09-12T02:25:26.001 INFO:teuthology.orchestra.run.smithi044.stdout: python3-ceph-argparse-2:19.1.1-298.gb53b6d3e.el9.x86_64 2024-09-12T02:25:26.001 INFO:teuthology.orchestra.run.smithi044.stdout: python3-ceph-common-2:19.1.1-298.gb53b6d3e.el9.x86_64 2024-09-12T02:25:26.002 INFO:teuthology.orchestra.run.smithi044.stdout: python3-cephfs-2:19.1.1-298.gb53b6d3e.el9.x86_64 2024-09-12T02:25:26.002 INFO:teuthology.orchestra.run.smithi044.stdout: python3-certifi-2023.05.07-4.el9.noarch 2024-09-12T02:25:26.002 INFO:teuthology.orchestra.run.smithi044.stdout: python3-cffi-1.14.5-5.el9.x86_64 2024-09-12T02:25:26.002 INFO:teuthology.orchestra.run.smithi044.stdout: python3-cheroot-8.6.0-4.el9.noarch 2024-09-12T02:25:26.002 INFO:teuthology.orchestra.run.smithi044.stdout: python3-cherrypy-18.6.1-2.el9.noarch 2024-09-12T02:25:26.002 INFO:teuthology.orchestra.run.smithi044.stdout: python3-cmd2-2.4.2-2.el9.noarch 2024-09-12T02:25:26.002 INFO:teuthology.orchestra.run.smithi044.stdout: python3-colorama-0.4.6-3.el9.noarch 2024-09-12T02:25:26.002 INFO:teuthology.orchestra.run.smithi044.stdout: python3-cryptography-36.0.1-4.el9.x86_64 2024-09-12T02:25:26.002 INFO:teuthology.orchestra.run.smithi044.stdout: python3-devel-3.9.19-8.el9.x86_64 2024-09-12T02:25:26.002 INFO:teuthology.orchestra.run.smithi044.stdout: python3-google-auth-1:2.34.0-1.el9.noarch 2024-09-12T02:25:26.002 INFO:teuthology.orchestra.run.smithi044.stdout: python3-grpcio-1.46.7-10.el9.x86_64 2024-09-12T02:25:26.002 INFO:teuthology.orchestra.run.smithi044.stdout: python3-grpcio-tools-1.46.7-10.el9.x86_64 2024-09-12T02:25:26.002 INFO:teuthology.orchestra.run.smithi044.stdout: python3-jaraco-8.2.1-3.el9.noarch 2024-09-12T02:25:26.002 INFO:teuthology.orchestra.run.smithi044.stdout: python3-jaraco-classes-3.2.1-5.el9.noarch 2024-09-12T02:25:26.002 INFO:teuthology.orchestra.run.smithi044.stdout: python3-jaraco-collections-3.0.0-8.el9.noarch 2024-09-12T02:25:26.003 INFO:teuthology.orchestra.run.smithi044.stdout: python3-jaraco-functools-3.5.0-2.el9.noarch 2024-09-12T02:25:26.003 INFO:teuthology.orchestra.run.smithi044.stdout: python3-jaraco-text-3.2.0-6.el9.noarch 2024-09-12T02:25:26.003 INFO:teuthology.orchestra.run.smithi044.stdout: python3-jinja2-2.11.3-6.el9.noarch 2024-09-12T02:25:26.003 INFO:teuthology.orchestra.run.smithi044.stdout: python3-jsonpatch-1.21-16.el9.noarch 2024-09-12T02:25:26.003 INFO:teuthology.orchestra.run.smithi044.stdout: python3-jsonpointer-2.0-4.el9.noarch 2024-09-12T02:25:26.003 INFO:teuthology.orchestra.run.smithi044.stdout: python3-kubernetes-1:26.1.0-2.el9.noarch 2024-09-12T02:25:26.003 INFO:teuthology.orchestra.run.smithi044.stdout: python3-logutils-0.3.5-21.el9.noarch 2024-09-12T02:25:26.003 INFO:teuthology.orchestra.run.smithi044.stdout: python3-mako-1.1.4-6.el9.noarch 2024-09-12T02:25:26.003 INFO:teuthology.orchestra.run.smithi044.stdout: python3-markupsafe-1.1.1-12.el9.x86_64 2024-09-12T02:25:26.003 INFO:teuthology.orchestra.run.smithi044.stdout: python3-more-itertools-8.12.0-2.el9.noarch 2024-09-12T02:25:26.003 INFO:teuthology.orchestra.run.smithi044.stdout: python3-natsort-7.1.1-5.el9.noarch 2024-09-12T02:25:26.003 INFO:teuthology.orchestra.run.smithi044.stdout: python3-numpy-1:1.20.1-5.el9.x86_64 2024-09-12T02:25:26.003 INFO:teuthology.orchestra.run.smithi044.stdout: python3-numpy-f2py-1:1.20.1-5.el9.x86_64 2024-09-12T02:25:26.003 INFO:teuthology.orchestra.run.smithi044.stdout: python3-oauthlib-3.1.1-5.el9.noarch 2024-09-12T02:25:26.004 INFO:teuthology.orchestra.run.smithi044.stdout: python3-packaging-20.9-5.el9.noarch 2024-09-12T02:25:26.004 INFO:teuthology.orchestra.run.smithi044.stdout: python3-pecan-1.4.2-3.el9.noarch 2024-09-12T02:25:26.004 INFO:teuthology.orchestra.run.smithi044.stdout: python3-ply-3.11-14.el9.noarch 2024-09-12T02:25:26.004 INFO:teuthology.orchestra.run.smithi044.stdout: python3-portend-3.1.0-2.el9.noarch 2024-09-12T02:25:26.004 INFO:teuthology.orchestra.run.smithi044.stdout: python3-prettytable-0.7.2-27.el9.noarch 2024-09-12T02:25:26.004 INFO:teuthology.orchestra.run.smithi044.stdout: python3-protobuf-3.14.0-13.el9.noarch 2024-09-12T02:25:26.004 INFO:teuthology.orchestra.run.smithi044.stdout: python3-pyOpenSSL-21.0.0-1.el9.noarch 2024-09-12T02:25:26.004 INFO:teuthology.orchestra.run.smithi044.stdout: python3-pyasn1-0.4.8-6.el9.noarch 2024-09-12T02:25:26.004 INFO:teuthology.orchestra.run.smithi044.stdout: python3-pyasn1-modules-0.4.8-6.el9.noarch 2024-09-12T02:25:26.004 INFO:teuthology.orchestra.run.smithi044.stdout: python3-pycparser-2.20-6.el9.noarch 2024-09-12T02:25:26.004 INFO:teuthology.orchestra.run.smithi044.stdout: python3-pyperclip-1.8.2-2.el9.noarch 2024-09-12T02:25:26.004 INFO:teuthology.orchestra.run.smithi044.stdout: python3-pytz-2021.1-5.el9.noarch 2024-09-12T02:25:26.004 INFO:teuthology.orchestra.run.smithi044.stdout: python3-rados-2:19.1.1-298.gb53b6d3e.el9.x86_64 2024-09-12T02:25:26.004 INFO:teuthology.orchestra.run.smithi044.stdout: python3-rbd-2:19.1.1-298.gb53b6d3e.el9.x86_64 2024-09-12T02:25:26.005 INFO:teuthology.orchestra.run.smithi044.stdout: python3-repoze-lru-0.7-16.el9.noarch 2024-09-12T02:25:26.005 INFO:teuthology.orchestra.run.smithi044.stdout: python3-requests-2.25.1-8.el9.noarch 2024-09-12T02:25:26.005 INFO:teuthology.orchestra.run.smithi044.stdout: python3-requests-oauthlib-1.3.0-12.el9.noarch 2024-09-12T02:25:26.005 INFO:teuthology.orchestra.run.smithi044.stdout: python3-rgw-2:19.1.1-298.gb53b6d3e.el9.x86_64 2024-09-12T02:25:26.005 INFO:teuthology.orchestra.run.smithi044.stdout: python3-routes-2.5.1-5.el9.noarch 2024-09-12T02:25:26.005 INFO:teuthology.orchestra.run.smithi044.stdout: python3-rsa-4.9-2.el9.noarch 2024-09-12T02:25:26.005 INFO:teuthology.orchestra.run.smithi044.stdout: python3-scipy-1.6.2-8.el9.x86_64 2024-09-12T02:25:26.005 INFO:teuthology.orchestra.run.smithi044.stdout: python3-tempora-5.0.0-2.el9.noarch 2024-09-12T02:25:26.005 INFO:teuthology.orchestra.run.smithi044.stdout: python3-toml-0.10.2-6.el9.noarch 2024-09-12T02:25:26.005 INFO:teuthology.orchestra.run.smithi044.stdout: python3-typing-extensions-4.12.2-2.el9.noarch 2024-09-12T02:25:26.005 INFO:teuthology.orchestra.run.smithi044.stdout: python3-urllib3-1.26.5-6.el9.noarch 2024-09-12T02:25:26.005 INFO:teuthology.orchestra.run.smithi044.stdout: python3-wcwidth-0.2.5-8.el9.noarch 2024-09-12T02:25:26.005 INFO:teuthology.orchestra.run.smithi044.stdout: python3-webob-1.8.8-2.el9.noarch 2024-09-12T02:25:26.006 INFO:teuthology.orchestra.run.smithi044.stdout: python3-websocket-client-1.2.3-2.el9.noarch 2024-09-12T02:25:26.006 INFO:teuthology.orchestra.run.smithi044.stdout: python3-werkzeug-2.0.3-3.el9.1.noarch 2024-09-12T02:25:26.006 INFO:teuthology.orchestra.run.smithi044.stdout: python3-zc-lockfile-2.0-10.el9.noarch 2024-09-12T02:25:26.006 INFO:teuthology.orchestra.run.smithi044.stdout: qatlib-24.02.0-1.el9.x86_64 2024-09-12T02:25:26.006 INFO:teuthology.orchestra.run.smithi044.stdout: qatlib-service-24.02.0-1.el9.x86_64 2024-09-12T02:25:26.006 INFO:teuthology.orchestra.run.smithi044.stdout: qatzip-libs-1.2.0-1.el9.x86_64 2024-09-12T02:25:26.006 INFO:teuthology.orchestra.run.smithi044.stdout: rbd-fuse-2:19.1.1-298.gb53b6d3e.el9.x86_64 2024-09-12T02:25:26.006 INFO:teuthology.orchestra.run.smithi044.stdout: rbd-mirror-2:19.1.1-298.gb53b6d3e.el9.x86_64 2024-09-12T02:25:26.006 INFO:teuthology.orchestra.run.smithi044.stdout: rbd-nbd-2:19.1.1-298.gb53b6d3e.el9.x86_64 2024-09-12T02:25:26.006 INFO:teuthology.orchestra.run.smithi044.stdout: re2-1:20211101-20.el9.x86_64 2024-09-12T02:25:26.006 INFO:teuthology.orchestra.run.smithi044.stdout: socat-1.7.4.1-6.el9.x86_64 2024-09-12T02:25:26.006 INFO:teuthology.orchestra.run.smithi044.stdout: thrift-0.15.0-2.el9.x86_64 2024-09-12T02:25:26.006 INFO:teuthology.orchestra.run.smithi044.stdout: uuid-1.6.2-55.el9.x86_64 2024-09-12T02:25:26.007 INFO:teuthology.orchestra.run.smithi044.stdout: xfsprogs-devel-6.4.0-4.el9.x86_64 2024-09-12T02:25:26.007 INFO:teuthology.orchestra.run.smithi044.stdout: xmlstarlet-1.6.1-20.el9.x86_64 2024-09-12T02:25:26.007 INFO:teuthology.orchestra.run.smithi044.stdout: zlib-devel-1.2.11-41.el9.x86_64 2024-09-12T02:25:26.007 INFO:teuthology.orchestra.run.smithi044.stdout: 2024-09-12T02:25:26.007 INFO:teuthology.orchestra.run.smithi044.stdout:Complete! 2024-09-12T02:25:26.504 DEBUG:teuthology.parallel:result is None 2024-09-12T02:25:28.267 INFO:teuthology.orchestra.run.smithi039.stdout: Verifying : ceph-2:19.1.1-298.gb53b6d3e.el9.x86_64 1/164 2024-09-12T02:25:28.267 INFO:teuthology.orchestra.run.smithi039.stdout: Verifying : ceph-base-2:19.1.1-298.gb53b6d3e.el9.x86_64 2/164 2024-09-12T02:25:28.267 INFO:teuthology.orchestra.run.smithi039.stdout: Verifying : ceph-common-2:19.1.1-298.gb53b6d3e.el9.x86_64 3/164 2024-09-12T02:25:28.268 INFO:teuthology.orchestra.run.smithi039.stdout: Verifying : ceph-fuse-2:19.1.1-298.gb53b6d3e.el9.x86_64 4/164 2024-09-12T02:25:28.268 INFO:teuthology.orchestra.run.smithi039.stdout: Verifying : ceph-immutable-object-cache-2:19.1.1-298.gb53b6d 5/164 2024-09-12T02:25:28.268 INFO:teuthology.orchestra.run.smithi039.stdout: Verifying : ceph-mds-2:19.1.1-298.gb53b6d3e.el9.x86_64 6/164 2024-09-12T02:25:28.268 INFO:teuthology.orchestra.run.smithi039.stdout: Verifying : ceph-mgr-2:19.1.1-298.gb53b6d3e.el9.x86_64 7/164 2024-09-12T02:25:28.268 INFO:teuthology.orchestra.run.smithi039.stdout: Verifying : ceph-mon-2:19.1.1-298.gb53b6d3e.el9.x86_64 8/164 2024-09-12T02:25:28.268 INFO:teuthology.orchestra.run.smithi039.stdout: Verifying : ceph-osd-2:19.1.1-298.gb53b6d3e.el9.x86_64 9/164 2024-09-12T02:25:28.269 INFO:teuthology.orchestra.run.smithi039.stdout: Verifying : ceph-radosgw-2:19.1.1-298.gb53b6d3e.el9.x86_64 10/164 2024-09-12T02:25:28.269 INFO:teuthology.orchestra.run.smithi039.stdout: Verifying : ceph-selinux-2:19.1.1-298.gb53b6d3e.el9.x86_64 11/164 2024-09-12T02:25:28.269 INFO:teuthology.orchestra.run.smithi039.stdout: Verifying : ceph-test-2:19.1.1-298.gb53b6d3e.el9.x86_64 12/164 2024-09-12T02:25:28.269 INFO:teuthology.orchestra.run.smithi039.stdout: Verifying : cephfs-mirror-2:19.1.1-298.gb53b6d3e.el9.x86_64 13/164 2024-09-12T02:25:28.269 INFO:teuthology.orchestra.run.smithi039.stdout: Verifying : cephfs-shell-2:19.1.1-298.gb53b6d3e.el9.x86_64 14/164 2024-09-12T02:25:28.269 INFO:teuthology.orchestra.run.smithi039.stdout: Verifying : libcephfs-devel-2:19.1.1-298.gb53b6d3e.el9.x86_6 15/164 2024-09-12T02:25:28.270 INFO:teuthology.orchestra.run.smithi039.stdout: Verifying : libcephfs2-2:19.1.1-298.gb53b6d3e.el9.x86_64 16/164 2024-09-12T02:25:28.270 INFO:teuthology.orchestra.run.smithi039.stdout: Verifying : libcephsqlite-2:19.1.1-298.gb53b6d3e.el9.x86_64 17/164 2024-09-12T02:25:28.270 INFO:teuthology.orchestra.run.smithi039.stdout: Verifying : librados-devel-2:19.1.1-298.gb53b6d3e.el9.x86_64 18/164 2024-09-12T02:25:28.270 INFO:teuthology.orchestra.run.smithi039.stdout: Verifying : libradosstriper1-2:19.1.1-298.gb53b6d3e.el9.x86_ 19/164 2024-09-12T02:25:28.270 INFO:teuthology.orchestra.run.smithi039.stdout: Verifying : librgw2-2:19.1.1-298.gb53b6d3e.el9.x86_64 20/164 2024-09-12T02:25:28.271 INFO:teuthology.orchestra.run.smithi039.stdout: Verifying : python3-ceph-argparse-2:19.1.1-298.gb53b6d3e.el9 21/164 2024-09-12T02:25:28.271 INFO:teuthology.orchestra.run.smithi039.stdout: Verifying : python3-ceph-common-2:19.1.1-298.gb53b6d3e.el9.x 22/164 2024-09-12T02:25:28.271 INFO:teuthology.orchestra.run.smithi039.stdout: Verifying : python3-cephfs-2:19.1.1-298.gb53b6d3e.el9.x86_64 23/164 2024-09-12T02:25:28.271 INFO:teuthology.orchestra.run.smithi039.stdout: Verifying : python3-rados-2:19.1.1-298.gb53b6d3e.el9.x86_64 24/164 2024-09-12T02:25:28.271 INFO:teuthology.orchestra.run.smithi039.stdout: Verifying : python3-rbd-2:19.1.1-298.gb53b6d3e.el9.x86_64 25/164 2024-09-12T02:25:28.271 INFO:teuthology.orchestra.run.smithi039.stdout: Verifying : python3-rgw-2:19.1.1-298.gb53b6d3e.el9.x86_64 26/164 2024-09-12T02:25:28.272 INFO:teuthology.orchestra.run.smithi039.stdout: Verifying : rbd-fuse-2:19.1.1-298.gb53b6d3e.el9.x86_64 27/164 2024-09-12T02:25:28.272 INFO:teuthology.orchestra.run.smithi039.stdout: Verifying : rbd-mirror-2:19.1.1-298.gb53b6d3e.el9.x86_64 28/164 2024-09-12T02:25:28.272 INFO:teuthology.orchestra.run.smithi039.stdout: Verifying : rbd-nbd-2:19.1.1-298.gb53b6d3e.el9.x86_64 29/164 2024-09-12T02:25:28.272 INFO:teuthology.orchestra.run.smithi039.stdout: Verifying : ceph-grafana-dashboards-2:19.1.1-298.gb53b6d3e.e 30/164 2024-09-12T02:25:28.272 INFO:teuthology.orchestra.run.smithi039.stdout: Verifying : ceph-mgr-cephadm-2:19.1.1-298.gb53b6d3e.el9.noar 31/164 2024-09-12T02:25:28.272 INFO:teuthology.orchestra.run.smithi039.stdout: Verifying : ceph-mgr-dashboard-2:19.1.1-298.gb53b6d3e.el9.no 32/164 2024-09-12T02:25:28.273 INFO:teuthology.orchestra.run.smithi039.stdout: Verifying : ceph-mgr-diskprediction-local-2:19.1.1-298.gb53b 33/164 2024-09-12T02:25:28.273 INFO:teuthology.orchestra.run.smithi039.stdout: Verifying : ceph-mgr-modules-core-2:19.1.1-298.gb53b6d3e.el9 34/164 2024-09-12T02:25:28.273 INFO:teuthology.orchestra.run.smithi039.stdout: Verifying : ceph-mgr-rook-2:19.1.1-298.gb53b6d3e.el9.noarch 35/164 2024-09-12T02:25:28.273 INFO:teuthology.orchestra.run.smithi039.stdout: Verifying : ceph-prometheus-alerts-2:19.1.1-298.gb53b6d3e.el 36/164 2024-09-12T02:25:28.273 INFO:teuthology.orchestra.run.smithi039.stdout: Verifying : ceph-volume-2:19.1.1-298.gb53b6d3e.el9.noarch 37/164 2024-09-12T02:25:28.274 INFO:teuthology.orchestra.run.smithi039.stdout: Verifying : cephadm-2:19.1.1-298.gb53b6d3e.el9.noarch 38/164 2024-09-12T02:25:28.274 INFO:teuthology.orchestra.run.smithi039.stdout: Verifying : cephfs-top-2:19.1.1-298.gb53b6d3e.el9.noarch 39/164 2024-09-12T02:25:28.274 INFO:teuthology.orchestra.run.smithi039.stdout: Verifying : fuse-2.9.9-16.el9.x86_64 40/164 2024-09-12T02:25:28.274 INFO:teuthology.orchestra.run.smithi039.stdout: Verifying : libgfortran-11.5.0-2.el9.x86_64 41/164 2024-09-12T02:25:28.274 INFO:teuthology.orchestra.run.smithi039.stdout: Verifying : libquadmath-11.5.0-2.el9.x86_64 42/164 2024-09-12T02:25:28.274 INFO:teuthology.orchestra.run.smithi039.stdout: Verifying : python3-cffi-1.14.5-5.el9.x86_64 43/164 2024-09-12T02:25:28.275 INFO:teuthology.orchestra.run.smithi039.stdout: Verifying : python3-cryptography-36.0.1-4.el9.x86_64 44/164 2024-09-12T02:25:28.275 INFO:teuthology.orchestra.run.smithi039.stdout: Verifying : python3-ply-3.11-14.el9.noarch 45/164 2024-09-12T02:25:28.275 INFO:teuthology.orchestra.run.smithi039.stdout: Verifying : python3-pycparser-2.20-6.el9.noarch 46/164 2024-09-12T02:25:28.275 INFO:teuthology.orchestra.run.smithi039.stdout: Verifying : python3-requests-2.25.1-8.el9.noarch 47/164 2024-09-12T02:25:28.275 INFO:teuthology.orchestra.run.smithi039.stdout: Verifying : python3-urllib3-1.26.5-6.el9.noarch 48/164 2024-09-12T02:25:28.276 INFO:teuthology.orchestra.run.smithi039.stdout: Verifying : automake-1.16.2-8.el9.noarch 49/164 2024-09-12T02:25:28.276 INFO:teuthology.orchestra.run.smithi039.stdout: Verifying : bison-3.7.4-5.el9.x86_64 50/164 2024-09-12T02:25:28.276 INFO:teuthology.orchestra.run.smithi039.stdout: Verifying : boost-program-options-1.75.0-8.el9.x86_64 51/164 2024-09-12T02:25:28.276 INFO:teuthology.orchestra.run.smithi039.stdout: Verifying : elfutils-libelf-devel-0.191-4.el9.x86_64 52/164 2024-09-12T02:25:28.276 INFO:teuthology.orchestra.run.smithi039.stdout: Verifying : flex-2.6.4-9.el9.x86_64 53/164 2024-09-12T02:25:28.276 INFO:teuthology.orchestra.run.smithi039.stdout: Verifying : flexiblas-3.0.4-8.el9.x86_64 54/164 2024-09-12T02:25:28.277 INFO:teuthology.orchestra.run.smithi039.stdout: Verifying : flexiblas-netlib-3.0.4-8.el9.x86_64 55/164 2024-09-12T02:25:28.277 INFO:teuthology.orchestra.run.smithi039.stdout: Verifying : flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 56/164 2024-09-12T02:25:28.277 INFO:teuthology.orchestra.run.smithi039.stdout: Verifying : libaio-devel-0.3.111-13.el9.x86_64 57/164 2024-09-12T02:25:28.277 INFO:teuthology.orchestra.run.smithi039.stdout: Verifying : libpmemobj-1.12.1-1.el9.x86_64 58/164 2024-09-12T02:25:28.277 INFO:teuthology.orchestra.run.smithi039.stdout: Verifying : librabbitmq-0.11.0-7.el9.x86_64 59/164 2024-09-12T02:25:28.278 INFO:teuthology.orchestra.run.smithi039.stdout: Verifying : librdkafka-1.6.1-102.el9.x86_64 60/164 2024-09-12T02:25:28.278 INFO:teuthology.orchestra.run.smithi039.stdout: Verifying : libtool-2.4.6-46.el9.x86_64 61/164 2024-09-12T02:25:28.278 INFO:teuthology.orchestra.run.smithi039.stdout: Verifying : libuuid-devel-2.37.4-20.el9.x86_64 62/164 2024-09-12T02:25:28.278 INFO:teuthology.orchestra.run.smithi039.stdout: Verifying : libzstd-devel-1.5.1-2.el9.x86_64 63/164 2024-09-12T02:25:28.278 INFO:teuthology.orchestra.run.smithi039.stdout: Verifying : lttng-ust-2.12.0-6.el9.x86_64 64/164 2024-09-12T02:25:28.279 INFO:teuthology.orchestra.run.smithi039.stdout: Verifying : lua-5.4.4-4.el9.x86_64 65/164 2024-09-12T02:25:28.279 INFO:teuthology.orchestra.run.smithi039.stdout: Verifying : openblas-0.3.26-2.el9.x86_64 66/164 2024-09-12T02:25:28.279 INFO:teuthology.orchestra.run.smithi039.stdout: Verifying : openblas-openmp-0.3.26-2.el9.x86_64 67/164 2024-09-12T02:25:28.279 INFO:teuthology.orchestra.run.smithi039.stdout: Verifying : openssl-devel-1:3.2.2-6.el9.x86_64 68/164 2024-09-12T02:25:28.280 INFO:teuthology.orchestra.run.smithi039.stdout: Verifying : postgresql-13.16-1.el9.x86_64 69/164 2024-09-12T02:25:28.280 INFO:teuthology.orchestra.run.smithi039.stdout: Verifying : postgresql-contrib-13.16-1.el9.x86_64 70/164 2024-09-12T02:25:28.280 INFO:teuthology.orchestra.run.smithi039.stdout: Verifying : postgresql-private-libs-13.16-1.el9.x86_64 71/164 2024-09-12T02:25:28.280 INFO:teuthology.orchestra.run.smithi039.stdout: Verifying : postgresql-server-13.16-1.el9.x86_64 72/164 2024-09-12T02:25:28.280 INFO:teuthology.orchestra.run.smithi039.stdout: Verifying : protobuf-3.14.0-13.el9.x86_64 73/164 2024-09-12T02:25:28.281 INFO:teuthology.orchestra.run.smithi039.stdout: Verifying : python3-attrs-20.3.0-7.el9.noarch 74/164 2024-09-12T02:25:28.281 INFO:teuthology.orchestra.run.smithi039.stdout: Verifying : python3-babel-2.9.1-2.el9.noarch 75/164 2024-09-12T02:25:28.281 INFO:teuthology.orchestra.run.smithi039.stdout: Verifying : python3-colorama-0.4.6-3.el9.noarch 76/164 2024-09-12T02:25:28.281 INFO:teuthology.orchestra.run.smithi039.stdout: Verifying : python3-devel-3.9.19-8.el9.x86_64 77/164 2024-09-12T02:25:28.281 INFO:teuthology.orchestra.run.smithi039.stdout: Verifying : python3-jinja2-2.11.3-6.el9.noarch 78/164 2024-09-12T02:25:28.282 INFO:teuthology.orchestra.run.smithi039.stdout: Verifying : python3-jsonpatch-1.21-16.el9.noarch 79/164 2024-09-12T02:25:28.282 INFO:teuthology.orchestra.run.smithi039.stdout: Verifying : python3-jsonpointer-2.0-4.el9.noarch 80/164 2024-09-12T02:25:28.282 INFO:teuthology.orchestra.run.smithi039.stdout: Verifying : python3-mako-1.1.4-6.el9.noarch 81/164 2024-09-12T02:25:28.282 INFO:teuthology.orchestra.run.smithi039.stdout: Verifying : python3-markupsafe-1.1.1-12.el9.x86_64 82/164 2024-09-12T02:25:28.282 INFO:teuthology.orchestra.run.smithi039.stdout: Verifying : python3-numpy-1:1.20.1-5.el9.x86_64 83/164 2024-09-12T02:25:28.283 INFO:teuthology.orchestra.run.smithi039.stdout: Verifying : python3-numpy-f2py-1:1.20.1-5.el9.x86_64 84/164 2024-09-12T02:25:28.283 INFO:teuthology.orchestra.run.smithi039.stdout: Verifying : python3-oauthlib-3.1.1-5.el9.noarch 85/164 2024-09-12T02:25:28.283 INFO:teuthology.orchestra.run.smithi039.stdout: Verifying : python3-packaging-20.9-5.el9.noarch 86/164 2024-09-12T02:25:28.283 INFO:teuthology.orchestra.run.smithi039.stdout: Verifying : python3-prettytable-0.7.2-27.el9.noarch 87/164 2024-09-12T02:25:28.283 INFO:teuthology.orchestra.run.smithi039.stdout: Verifying : python3-protobuf-3.14.0-13.el9.noarch 88/164 2024-09-12T02:25:28.283 INFO:teuthology.orchestra.run.smithi039.stdout: Verifying : python3-pyasn1-0.4.8-6.el9.noarch 89/164 2024-09-12T02:25:28.284 INFO:teuthology.orchestra.run.smithi039.stdout: Verifying : python3-pyasn1-modules-0.4.8-6.el9.noarch 90/164 2024-09-12T02:25:28.284 INFO:teuthology.orchestra.run.smithi039.stdout: Verifying : python3-pytz-2021.1-5.el9.noarch 91/164 2024-09-12T02:25:28.284 INFO:teuthology.orchestra.run.smithi039.stdout: Verifying : python3-requests-oauthlib-1.3.0-12.el9.noarch 92/164 2024-09-12T02:25:28.285 INFO:teuthology.orchestra.run.smithi039.stdout: Verifying : python3-scipy-1.6.2-8.el9.x86_64 93/164 2024-09-12T02:25:28.285 INFO:teuthology.orchestra.run.smithi039.stdout: Verifying : python3-toml-0.10.2-6.el9.noarch 94/164 2024-09-12T02:25:28.285 INFO:teuthology.orchestra.run.smithi039.stdout: Verifying : python3-wcwidth-0.2.5-8.el9.noarch 95/164 2024-09-12T02:25:28.285 INFO:teuthology.orchestra.run.smithi039.stdout: Verifying : qatlib-24.02.0-1.el9.x86_64 96/164 2024-09-12T02:25:28.285 INFO:teuthology.orchestra.run.smithi039.stdout: Verifying : qatlib-service-24.02.0-1.el9.x86_64 97/164 2024-09-12T02:25:28.286 INFO:teuthology.orchestra.run.smithi039.stdout: Verifying : qatzip-libs-1.2.0-1.el9.x86_64 98/164 2024-09-12T02:25:28.286 INFO:teuthology.orchestra.run.smithi039.stdout: Verifying : socat-1.7.4.1-6.el9.x86_64 99/164 2024-09-12T02:25:28.286 INFO:teuthology.orchestra.run.smithi039.stdout: Verifying : uuid-1.6.2-55.el9.x86_64 100/164 2024-09-12T02:25:28.287 INFO:teuthology.orchestra.run.smithi039.stdout: Verifying : xfsprogs-devel-6.4.0-4.el9.x86_64 101/164 2024-09-12T02:25:28.287 INFO:teuthology.orchestra.run.smithi039.stdout: Verifying : xmlstarlet-1.6.1-20.el9.x86_64 102/164 2024-09-12T02:25:28.287 INFO:teuthology.orchestra.run.smithi039.stdout: Verifying : zlib-devel-1.2.11-41.el9.x86_64 103/164 2024-09-12T02:25:28.287 INFO:teuthology.orchestra.run.smithi039.stdout: Verifying : lua-devel-5.4.4-4.el9.x86_64 104/164 2024-09-12T02:25:28.288 INFO:teuthology.orchestra.run.smithi039.stdout: Verifying : protobuf-compiler-3.14.0-13.el9.x86_64 105/164 2024-09-12T02:25:28.288 INFO:teuthology.orchestra.run.smithi039.stdout: Verifying : abseil-cpp-20211102.0-3.el9.x86_64 106/164 2024-09-12T02:25:28.288 INFO:teuthology.orchestra.run.smithi039.stdout: Verifying : gperftools-libs-2.9.1-2.el9.x86_64 107/164 2024-09-12T02:25:28.288 INFO:teuthology.orchestra.run.smithi039.stdout: Verifying : grpc-data-1.46.7-10.el9.noarch 108/164 2024-09-12T02:25:28.288 INFO:teuthology.orchestra.run.smithi039.stdout: Verifying : libarrow-9.0.0-11.el9.x86_64 109/164 2024-09-12T02:25:28.289 INFO:teuthology.orchestra.run.smithi039.stdout: Verifying : libarrow-doc-9.0.0-11.el9.noarch 110/164 2024-09-12T02:25:28.289 INFO:teuthology.orchestra.run.smithi039.stdout: Verifying : liboath-2.6.7-2.el9.x86_64 111/164 2024-09-12T02:25:28.289 INFO:teuthology.orchestra.run.smithi039.stdout: Verifying : libunwind-1.6.2-1.el9.x86_64 112/164 2024-09-12T02:25:28.289 INFO:teuthology.orchestra.run.smithi039.stdout: Verifying : luarocks-3.9.2-5.el9.noarch 113/164 2024-09-12T02:25:28.289 INFO:teuthology.orchestra.run.smithi039.stdout: Verifying : parquet-libs-9.0.0-11.el9.x86_64 114/164 2024-09-12T02:25:28.290 INFO:teuthology.orchestra.run.smithi039.stdout: Verifying : python3-asyncssh-2.13.2-5.el9.noarch 115/164 2024-09-12T02:25:28.290 INFO:teuthology.orchestra.run.smithi039.stdout: Verifying : python3-bcrypt-3.2.2-1.el9.x86_64 116/164 2024-09-12T02:25:28.290 INFO:teuthology.orchestra.run.smithi039.stdout: Verifying : python3-cachetools-4.2.4-1.el9.noarch 117/164 2024-09-12T02:25:28.290 INFO:teuthology.orchestra.run.smithi039.stdout: Verifying : python3-certifi-2023.05.07-4.el9.noarch 118/164 2024-09-12T02:25:28.291 INFO:teuthology.orchestra.run.smithi039.stdout: Verifying : python3-cheroot-8.6.0-4.el9.noarch 119/164 2024-09-12T02:25:28.291 INFO:teuthology.orchestra.run.smithi039.stdout: Verifying : python3-cherrypy-18.6.1-2.el9.noarch 120/164 2024-09-12T02:25:28.291 INFO:teuthology.orchestra.run.smithi039.stdout: Verifying : python3-cmd2-2.4.2-2.el9.noarch 121/164 2024-09-12T02:25:28.291 INFO:teuthology.orchestra.run.smithi039.stdout: Verifying : python3-google-auth-1:2.34.0-1.el9.noarch 122/164 2024-09-12T02:25:28.291 INFO:teuthology.orchestra.run.smithi039.stdout: Verifying : python3-grpcio-1.46.7-10.el9.x86_64 123/164 2024-09-12T02:25:28.292 INFO:teuthology.orchestra.run.smithi039.stdout: Verifying : python3-grpcio-tools-1.46.7-10.el9.x86_64 124/164 2024-09-12T02:25:28.292 INFO:teuthology.orchestra.run.smithi039.stdout: Verifying : python3-jaraco-8.2.1-3.el9.noarch 125/164 2024-09-12T02:25:28.292 INFO:teuthology.orchestra.run.smithi039.stdout: Verifying : python3-jaraco-classes-3.2.1-5.el9.noarch 126/164 2024-09-12T02:25:28.292 INFO:teuthology.orchestra.run.smithi039.stdout: Verifying : python3-jaraco-collections-3.0.0-8.el9.noarch 127/164 2024-09-12T02:25:28.292 INFO:teuthology.orchestra.run.smithi039.stdout: Verifying : python3-jaraco-functools-3.5.0-2.el9.noarch 128/164 2024-09-12T02:25:28.293 INFO:teuthology.orchestra.run.smithi039.stdout: Verifying : python3-jaraco-text-3.2.0-6.el9.noarch 129/164 2024-09-12T02:25:28.293 INFO:teuthology.orchestra.run.smithi039.stdout: Verifying : python3-kubernetes-1:26.1.0-2.el9.noarch 130/164 2024-09-12T02:25:28.293 INFO:teuthology.orchestra.run.smithi039.stdout: Verifying : python3-logutils-0.3.5-21.el9.noarch 131/164 2024-09-12T02:25:28.293 INFO:teuthology.orchestra.run.smithi039.stdout: Verifying : python3-more-itertools-8.12.0-2.el9.noarch 132/164 2024-09-12T02:25:28.293 INFO:teuthology.orchestra.run.smithi039.stdout: Verifying : python3-natsort-7.1.1-5.el9.noarch 133/164 2024-09-12T02:25:28.293 INFO:teuthology.orchestra.run.smithi039.stdout: Verifying : python3-pecan-1.4.2-3.el9.noarch 134/164 2024-09-12T02:25:28.294 INFO:teuthology.orchestra.run.smithi039.stdout: Verifying : python3-portend-3.1.0-2.el9.noarch 135/164 2024-09-12T02:25:28.294 INFO:teuthology.orchestra.run.smithi039.stdout: Verifying : python3-pyOpenSSL-21.0.0-1.el9.noarch 136/164 2024-09-12T02:25:28.294 INFO:teuthology.orchestra.run.smithi039.stdout: Verifying : python3-pyperclip-1.8.2-2.el9.noarch 137/164 2024-09-12T02:25:28.294 INFO:teuthology.orchestra.run.smithi039.stdout: Verifying : python3-repoze-lru-0.7-16.el9.noarch 138/164 2024-09-12T02:25:28.294 INFO:teuthology.orchestra.run.smithi039.stdout: Verifying : python3-routes-2.5.1-5.el9.noarch 139/164 2024-09-12T02:25:28.294 INFO:teuthology.orchestra.run.smithi039.stdout: Verifying : python3-rsa-4.9-2.el9.noarch 140/164 2024-09-12T02:25:28.295 INFO:teuthology.orchestra.run.smithi039.stdout: Verifying : python3-tempora-5.0.0-2.el9.noarch 141/164 2024-09-12T02:25:28.295 INFO:teuthology.orchestra.run.smithi039.stdout: Verifying : python3-typing-extensions-4.12.2-2.el9.noarch 142/164 2024-09-12T02:25:28.295 INFO:teuthology.orchestra.run.smithi039.stdout: Verifying : python3-webob-1.8.8-2.el9.noarch 143/164 2024-09-12T02:25:28.295 INFO:teuthology.orchestra.run.smithi039.stdout: Verifying : python3-websocket-client-1.2.3-2.el9.noarch 144/164 2024-09-12T02:25:28.295 INFO:teuthology.orchestra.run.smithi039.stdout: Verifying : python3-werkzeug-2.0.3-3.el9.1.noarch 145/164 2024-09-12T02:25:28.296 INFO:teuthology.orchestra.run.smithi039.stdout: Verifying : python3-zc-lockfile-2.0-10.el9.noarch 146/164 2024-09-12T02:25:28.296 INFO:teuthology.orchestra.run.smithi039.stdout: Verifying : re2-1:20211101-20.el9.x86_64 147/164 2024-09-12T02:25:28.296 INFO:teuthology.orchestra.run.smithi039.stdout: Verifying : thrift-0.15.0-2.el9.x86_64 148/164 2024-09-12T02:25:28.296 INFO:teuthology.orchestra.run.smithi039.stdout: Verifying : librados2-2:19.1.1-298.gb53b6d3e.el9.x86_64 149/164 2024-09-12T02:25:28.296 INFO:teuthology.orchestra.run.smithi039.stdout: Verifying : librados2-2:16.2.4-5.el9.x86_64 150/164 2024-09-12T02:25:28.297 INFO:teuthology.orchestra.run.smithi039.stdout: Verifying : librbd1-2:19.1.1-298.gb53b6d3e.el9.x86_64 151/164 2024-09-12T02:25:28.297 INFO:teuthology.orchestra.run.smithi039.stdout: Verifying : librbd1-2:16.2.4-5.el9.x86_64 152/164 2024-09-12T02:25:28.297 INFO:teuthology.orchestra.run.smithi039.stdout: Verifying : NetworkManager-1:1.49.90-1.el9.x86_64 153/164 2024-09-12T02:25:28.297 INFO:teuthology.orchestra.run.smithi039.stdout: Verifying : NetworkManager-1:1.48.8-1.el9.x86_64 154/164 2024-09-12T02:25:28.297 INFO:teuthology.orchestra.run.smithi039.stdout: Verifying : NetworkManager-libnm-1:1.49.90-1.el9.x86_64 155/164 2024-09-12T02:25:28.297 INFO:teuthology.orchestra.run.smithi039.stdout: Verifying : NetworkManager-libnm-1:1.48.8-1.el9.x86_64 156/164 2024-09-12T02:25:28.298 INFO:teuthology.orchestra.run.smithi039.stdout: Verifying : NetworkManager-team-1:1.49.90-1.el9.x86_64 157/164 2024-09-12T02:25:28.298 INFO:teuthology.orchestra.run.smithi039.stdout: Verifying : NetworkManager-team-1:1.48.8-1.el9.x86_64 158/164 2024-09-12T02:25:28.298 INFO:teuthology.orchestra.run.smithi039.stdout: Verifying : NetworkManager-tui-1:1.49.90-1.el9.x86_64 159/164 2024-09-12T02:25:28.298 INFO:teuthology.orchestra.run.smithi039.stdout: Verifying : NetworkManager-tui-1:1.48.8-1.el9.x86_64 160/164 2024-09-12T02:25:28.298 INFO:teuthology.orchestra.run.smithi039.stdout: Verifying : openssl-1:3.2.2-6.el9.x86_64 161/164 2024-09-12T02:25:28.298 INFO:teuthology.orchestra.run.smithi039.stdout: Verifying : openssl-1:3.2.2-4.el9.x86_64 162/164 2024-09-12T02:25:28.299 INFO:teuthology.orchestra.run.smithi039.stdout: Verifying : openssl-libs-1:3.2.2-6.el9.x86_64 163/164 2024-09-12T02:25:30.407 INFO:teuthology.orchestra.run.smithi039.stdout: Verifying : openssl-libs-1:3.2.2-4.el9.x86_64 164/164 2024-09-12T02:25:30.407 INFO:teuthology.orchestra.run.smithi039.stdout: 2024-09-12T02:25:30.407 INFO:teuthology.orchestra.run.smithi039.stdout:Upgraded: 2024-09-12T02:25:30.407 INFO:teuthology.orchestra.run.smithi039.stdout: NetworkManager-1:1.49.90-1.el9.x86_64 2024-09-12T02:25:30.407 INFO:teuthology.orchestra.run.smithi039.stdout: NetworkManager-libnm-1:1.49.90-1.el9.x86_64 2024-09-12T02:25:30.407 INFO:teuthology.orchestra.run.smithi039.stdout: NetworkManager-team-1:1.49.90-1.el9.x86_64 2024-09-12T02:25:30.408 INFO:teuthology.orchestra.run.smithi039.stdout: NetworkManager-tui-1:1.49.90-1.el9.x86_64 2024-09-12T02:25:30.408 INFO:teuthology.orchestra.run.smithi039.stdout: librados2-2:19.1.1-298.gb53b6d3e.el9.x86_64 2024-09-12T02:25:30.408 INFO:teuthology.orchestra.run.smithi039.stdout: librbd1-2:19.1.1-298.gb53b6d3e.el9.x86_64 2024-09-12T02:25:30.408 INFO:teuthology.orchestra.run.smithi039.stdout: openssl-1:3.2.2-6.el9.x86_64 2024-09-12T02:25:30.408 INFO:teuthology.orchestra.run.smithi039.stdout: openssl-libs-1:3.2.2-6.el9.x86_64 2024-09-12T02:25:30.408 INFO:teuthology.orchestra.run.smithi039.stdout:Installed: 2024-09-12T02:25:30.408 INFO:teuthology.orchestra.run.smithi039.stdout: abseil-cpp-20211102.0-3.el9.x86_64 2024-09-12T02:25:30.408 INFO:teuthology.orchestra.run.smithi039.stdout: automake-1.16.2-8.el9.noarch 2024-09-12T02:25:30.408 INFO:teuthology.orchestra.run.smithi039.stdout: bison-3.7.4-5.el9.x86_64 2024-09-12T02:25:30.408 INFO:teuthology.orchestra.run.smithi039.stdout: boost-program-options-1.75.0-8.el9.x86_64 2024-09-12T02:25:30.408 INFO:teuthology.orchestra.run.smithi039.stdout: ceph-2:19.1.1-298.gb53b6d3e.el9.x86_64 2024-09-12T02:25:30.409 INFO:teuthology.orchestra.run.smithi039.stdout: ceph-base-2:19.1.1-298.gb53b6d3e.el9.x86_64 2024-09-12T02:25:30.409 INFO:teuthology.orchestra.run.smithi039.stdout: ceph-common-2:19.1.1-298.gb53b6d3e.el9.x86_64 2024-09-12T02:25:30.409 INFO:teuthology.orchestra.run.smithi039.stdout: ceph-fuse-2:19.1.1-298.gb53b6d3e.el9.x86_64 2024-09-12T02:25:30.409 INFO:teuthology.orchestra.run.smithi039.stdout: ceph-grafana-dashboards-2:19.1.1-298.gb53b6d3e.el9.noarch 2024-09-12T02:25:30.409 INFO:teuthology.orchestra.run.smithi039.stdout: ceph-immutable-object-cache-2:19.1.1-298.gb53b6d3e.el9.x86_64 2024-09-12T02:25:30.409 INFO:teuthology.orchestra.run.smithi039.stdout: ceph-mds-2:19.1.1-298.gb53b6d3e.el9.x86_64 2024-09-12T02:25:30.409 INFO:teuthology.orchestra.run.smithi039.stdout: ceph-mgr-2:19.1.1-298.gb53b6d3e.el9.x86_64 2024-09-12T02:25:30.409 INFO:teuthology.orchestra.run.smithi039.stdout: ceph-mgr-cephadm-2:19.1.1-298.gb53b6d3e.el9.noarch 2024-09-12T02:25:30.409 INFO:teuthology.orchestra.run.smithi039.stdout: ceph-mgr-dashboard-2:19.1.1-298.gb53b6d3e.el9.noarch 2024-09-12T02:25:30.409 INFO:teuthology.orchestra.run.smithi039.stdout: ceph-mgr-diskprediction-local-2:19.1.1-298.gb53b6d3e.el9.noarch 2024-09-12T02:25:30.409 INFO:teuthology.orchestra.run.smithi039.stdout: ceph-mgr-modules-core-2:19.1.1-298.gb53b6d3e.el9.noarch 2024-09-12T02:25:30.410 INFO:teuthology.orchestra.run.smithi039.stdout: ceph-mgr-rook-2:19.1.1-298.gb53b6d3e.el9.noarch 2024-09-12T02:25:30.410 INFO:teuthology.orchestra.run.smithi039.stdout: ceph-mon-2:19.1.1-298.gb53b6d3e.el9.x86_64 2024-09-12T02:25:30.410 INFO:teuthology.orchestra.run.smithi039.stdout: ceph-osd-2:19.1.1-298.gb53b6d3e.el9.x86_64 2024-09-12T02:25:30.410 INFO:teuthology.orchestra.run.smithi039.stdout: ceph-prometheus-alerts-2:19.1.1-298.gb53b6d3e.el9.noarch 2024-09-12T02:25:30.410 INFO:teuthology.orchestra.run.smithi039.stdout: ceph-radosgw-2:19.1.1-298.gb53b6d3e.el9.x86_64 2024-09-12T02:25:30.410 INFO:teuthology.orchestra.run.smithi039.stdout: ceph-selinux-2:19.1.1-298.gb53b6d3e.el9.x86_64 2024-09-12T02:25:30.410 INFO:teuthology.orchestra.run.smithi039.stdout: ceph-test-2:19.1.1-298.gb53b6d3e.el9.x86_64 2024-09-12T02:25:30.410 INFO:teuthology.orchestra.run.smithi039.stdout: ceph-volume-2:19.1.1-298.gb53b6d3e.el9.noarch 2024-09-12T02:25:30.410 INFO:teuthology.orchestra.run.smithi039.stdout: cephadm-2:19.1.1-298.gb53b6d3e.el9.noarch 2024-09-12T02:25:30.410 INFO:teuthology.orchestra.run.smithi039.stdout: cephfs-mirror-2:19.1.1-298.gb53b6d3e.el9.x86_64 2024-09-12T02:25:30.411 INFO:teuthology.orchestra.run.smithi039.stdout: cephfs-shell-2:19.1.1-298.gb53b6d3e.el9.x86_64 2024-09-12T02:25:30.411 INFO:teuthology.orchestra.run.smithi039.stdout: cephfs-top-2:19.1.1-298.gb53b6d3e.el9.noarch 2024-09-12T02:25:30.411 INFO:teuthology.orchestra.run.smithi039.stdout: elfutils-libelf-devel-0.191-4.el9.x86_64 2024-09-12T02:25:30.411 INFO:teuthology.orchestra.run.smithi039.stdout: flex-2.6.4-9.el9.x86_64 2024-09-12T02:25:30.411 INFO:teuthology.orchestra.run.smithi039.stdout: flexiblas-3.0.4-8.el9.x86_64 2024-09-12T02:25:30.411 INFO:teuthology.orchestra.run.smithi039.stdout: flexiblas-netlib-3.0.4-8.el9.x86_64 2024-09-12T02:25:30.411 INFO:teuthology.orchestra.run.smithi039.stdout: flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 2024-09-12T02:25:30.411 INFO:teuthology.orchestra.run.smithi039.stdout: fuse-2.9.9-16.el9.x86_64 2024-09-12T02:25:30.411 INFO:teuthology.orchestra.run.smithi039.stdout: gperftools-libs-2.9.1-2.el9.x86_64 2024-09-12T02:25:30.411 INFO:teuthology.orchestra.run.smithi039.stdout: grpc-data-1.46.7-10.el9.noarch 2024-09-12T02:25:30.411 INFO:teuthology.orchestra.run.smithi039.stdout: libaio-devel-0.3.111-13.el9.x86_64 2024-09-12T02:25:30.411 INFO:teuthology.orchestra.run.smithi039.stdout: libarrow-9.0.0-11.el9.x86_64 2024-09-12T02:25:30.412 INFO:teuthology.orchestra.run.smithi039.stdout: libarrow-doc-9.0.0-11.el9.noarch 2024-09-12T02:25:30.412 INFO:teuthology.orchestra.run.smithi039.stdout: libcephfs-devel-2:19.1.1-298.gb53b6d3e.el9.x86_64 2024-09-12T02:25:30.412 INFO:teuthology.orchestra.run.smithi039.stdout: libcephfs2-2:19.1.1-298.gb53b6d3e.el9.x86_64 2024-09-12T02:25:30.412 INFO:teuthology.orchestra.run.smithi039.stdout: libcephsqlite-2:19.1.1-298.gb53b6d3e.el9.x86_64 2024-09-12T02:25:30.412 INFO:teuthology.orchestra.run.smithi039.stdout: libgfortran-11.5.0-2.el9.x86_64 2024-09-12T02:25:30.412 INFO:teuthology.orchestra.run.smithi039.stdout: liboath-2.6.7-2.el9.x86_64 2024-09-12T02:25:30.412 INFO:teuthology.orchestra.run.smithi039.stdout: libpmemobj-1.12.1-1.el9.x86_64 2024-09-12T02:25:30.412 INFO:teuthology.orchestra.run.smithi039.stdout: libquadmath-11.5.0-2.el9.x86_64 2024-09-12T02:25:30.412 INFO:teuthology.orchestra.run.smithi039.stdout: librabbitmq-0.11.0-7.el9.x86_64 2024-09-12T02:25:30.412 INFO:teuthology.orchestra.run.smithi039.stdout: librados-devel-2:19.1.1-298.gb53b6d3e.el9.x86_64 2024-09-12T02:25:30.412 INFO:teuthology.orchestra.run.smithi039.stdout: libradosstriper1-2:19.1.1-298.gb53b6d3e.el9.x86_64 2024-09-12T02:25:30.412 INFO:teuthology.orchestra.run.smithi039.stdout: librdkafka-1.6.1-102.el9.x86_64 2024-09-12T02:25:30.412 INFO:teuthology.orchestra.run.smithi039.stdout: librgw2-2:19.1.1-298.gb53b6d3e.el9.x86_64 2024-09-12T02:25:30.413 INFO:teuthology.orchestra.run.smithi039.stdout: libtool-2.4.6-46.el9.x86_64 2024-09-12T02:25:30.413 INFO:teuthology.orchestra.run.smithi039.stdout: libunwind-1.6.2-1.el9.x86_64 2024-09-12T02:25:30.413 INFO:teuthology.orchestra.run.smithi039.stdout: libuuid-devel-2.37.4-20.el9.x86_64 2024-09-12T02:25:30.413 INFO:teuthology.orchestra.run.smithi039.stdout: libzstd-devel-1.5.1-2.el9.x86_64 2024-09-12T02:25:30.413 INFO:teuthology.orchestra.run.smithi039.stdout: lttng-ust-2.12.0-6.el9.x86_64 2024-09-12T02:25:30.413 INFO:teuthology.orchestra.run.smithi039.stdout: lua-5.4.4-4.el9.x86_64 2024-09-12T02:25:30.413 INFO:teuthology.orchestra.run.smithi039.stdout: lua-devel-5.4.4-4.el9.x86_64 2024-09-12T02:25:30.413 INFO:teuthology.orchestra.run.smithi039.stdout: luarocks-3.9.2-5.el9.noarch 2024-09-12T02:25:30.413 INFO:teuthology.orchestra.run.smithi039.stdout: openblas-0.3.26-2.el9.x86_64 2024-09-12T02:25:30.413 INFO:teuthology.orchestra.run.smithi039.stdout: openblas-openmp-0.3.26-2.el9.x86_64 2024-09-12T02:25:30.413 INFO:teuthology.orchestra.run.smithi039.stdout: openssl-devel-1:3.2.2-6.el9.x86_64 2024-09-12T02:25:30.414 INFO:teuthology.orchestra.run.smithi039.stdout: parquet-libs-9.0.0-11.el9.x86_64 2024-09-12T02:25:30.414 INFO:teuthology.orchestra.run.smithi039.stdout: postgresql-13.16-1.el9.x86_64 2024-09-12T02:25:30.414 INFO:teuthology.orchestra.run.smithi039.stdout: postgresql-contrib-13.16-1.el9.x86_64 2024-09-12T02:25:30.414 INFO:teuthology.orchestra.run.smithi039.stdout: postgresql-private-libs-13.16-1.el9.x86_64 2024-09-12T02:25:30.414 INFO:teuthology.orchestra.run.smithi039.stdout: postgresql-server-13.16-1.el9.x86_64 2024-09-12T02:25:30.414 INFO:teuthology.orchestra.run.smithi039.stdout: protobuf-3.14.0-13.el9.x86_64 2024-09-12T02:25:30.414 INFO:teuthology.orchestra.run.smithi039.stdout: protobuf-compiler-3.14.0-13.el9.x86_64 2024-09-12T02:25:30.414 INFO:teuthology.orchestra.run.smithi039.stdout: python3-asyncssh-2.13.2-5.el9.noarch 2024-09-12T02:25:30.414 INFO:teuthology.orchestra.run.smithi039.stdout: python3-attrs-20.3.0-7.el9.noarch 2024-09-12T02:25:30.414 INFO:teuthology.orchestra.run.smithi039.stdout: python3-babel-2.9.1-2.el9.noarch 2024-09-12T02:25:30.414 INFO:teuthology.orchestra.run.smithi039.stdout: python3-bcrypt-3.2.2-1.el9.x86_64 2024-09-12T02:25:30.414 INFO:teuthology.orchestra.run.smithi039.stdout: python3-cachetools-4.2.4-1.el9.noarch 2024-09-12T02:25:30.414 INFO:teuthology.orchestra.run.smithi039.stdout: python3-ceph-argparse-2:19.1.1-298.gb53b6d3e.el9.x86_64 2024-09-12T02:25:30.415 INFO:teuthology.orchestra.run.smithi039.stdout: python3-ceph-common-2:19.1.1-298.gb53b6d3e.el9.x86_64 2024-09-12T02:25:30.415 INFO:teuthology.orchestra.run.smithi039.stdout: python3-cephfs-2:19.1.1-298.gb53b6d3e.el9.x86_64 2024-09-12T02:25:30.415 INFO:teuthology.orchestra.run.smithi039.stdout: python3-certifi-2023.05.07-4.el9.noarch 2024-09-12T02:25:30.415 INFO:teuthology.orchestra.run.smithi039.stdout: python3-cffi-1.14.5-5.el9.x86_64 2024-09-12T02:25:30.415 INFO:teuthology.orchestra.run.smithi039.stdout: python3-cheroot-8.6.0-4.el9.noarch 2024-09-12T02:25:30.415 INFO:teuthology.orchestra.run.smithi039.stdout: python3-cherrypy-18.6.1-2.el9.noarch 2024-09-12T02:25:30.415 INFO:teuthology.orchestra.run.smithi039.stdout: python3-cmd2-2.4.2-2.el9.noarch 2024-09-12T02:25:30.415 INFO:teuthology.orchestra.run.smithi039.stdout: python3-colorama-0.4.6-3.el9.noarch 2024-09-12T02:25:30.415 INFO:teuthology.orchestra.run.smithi039.stdout: python3-cryptography-36.0.1-4.el9.x86_64 2024-09-12T02:25:30.415 INFO:teuthology.orchestra.run.smithi039.stdout: python3-devel-3.9.19-8.el9.x86_64 2024-09-12T02:25:30.415 INFO:teuthology.orchestra.run.smithi039.stdout: python3-google-auth-1:2.34.0-1.el9.noarch 2024-09-12T02:25:30.415 INFO:teuthology.orchestra.run.smithi039.stdout: python3-grpcio-1.46.7-10.el9.x86_64 2024-09-12T02:25:30.415 INFO:teuthology.orchestra.run.smithi039.stdout: python3-grpcio-tools-1.46.7-10.el9.x86_64 2024-09-12T02:25:30.416 INFO:teuthology.orchestra.run.smithi039.stdout: python3-jaraco-8.2.1-3.el9.noarch 2024-09-12T02:25:30.416 INFO:teuthology.orchestra.run.smithi039.stdout: python3-jaraco-classes-3.2.1-5.el9.noarch 2024-09-12T02:25:30.416 INFO:teuthology.orchestra.run.smithi039.stdout: python3-jaraco-collections-3.0.0-8.el9.noarch 2024-09-12T02:25:30.416 INFO:teuthology.orchestra.run.smithi039.stdout: python3-jaraco-functools-3.5.0-2.el9.noarch 2024-09-12T02:25:30.416 INFO:teuthology.orchestra.run.smithi039.stdout: python3-jaraco-text-3.2.0-6.el9.noarch 2024-09-12T02:25:30.416 INFO:teuthology.orchestra.run.smithi039.stdout: python3-jinja2-2.11.3-6.el9.noarch 2024-09-12T02:25:30.416 INFO:teuthology.orchestra.run.smithi039.stdout: python3-jsonpatch-1.21-16.el9.noarch 2024-09-12T02:25:30.416 INFO:teuthology.orchestra.run.smithi039.stdout: python3-jsonpointer-2.0-4.el9.noarch 2024-09-12T02:25:30.416 INFO:teuthology.orchestra.run.smithi039.stdout: python3-kubernetes-1:26.1.0-2.el9.noarch 2024-09-12T02:25:30.416 INFO:teuthology.orchestra.run.smithi039.stdout: python3-logutils-0.3.5-21.el9.noarch 2024-09-12T02:25:30.416 INFO:teuthology.orchestra.run.smithi039.stdout: python3-mako-1.1.4-6.el9.noarch 2024-09-12T02:25:30.416 INFO:teuthology.orchestra.run.smithi039.stdout: python3-markupsafe-1.1.1-12.el9.x86_64 2024-09-12T02:25:30.416 INFO:teuthology.orchestra.run.smithi039.stdout: python3-more-itertools-8.12.0-2.el9.noarch 2024-09-12T02:25:30.417 INFO:teuthology.orchestra.run.smithi039.stdout: python3-natsort-7.1.1-5.el9.noarch 2024-09-12T02:25:30.417 INFO:teuthology.orchestra.run.smithi039.stdout: python3-numpy-1:1.20.1-5.el9.x86_64 2024-09-12T02:25:30.417 INFO:teuthology.orchestra.run.smithi039.stdout: python3-numpy-f2py-1:1.20.1-5.el9.x86_64 2024-09-12T02:25:30.417 INFO:teuthology.orchestra.run.smithi039.stdout: python3-oauthlib-3.1.1-5.el9.noarch 2024-09-12T02:25:30.417 INFO:teuthology.orchestra.run.smithi039.stdout: python3-packaging-20.9-5.el9.noarch 2024-09-12T02:25:30.417 INFO:teuthology.orchestra.run.smithi039.stdout: python3-pecan-1.4.2-3.el9.noarch 2024-09-12T02:25:30.417 INFO:teuthology.orchestra.run.smithi039.stdout: python3-ply-3.11-14.el9.noarch 2024-09-12T02:25:30.417 INFO:teuthology.orchestra.run.smithi039.stdout: python3-portend-3.1.0-2.el9.noarch 2024-09-12T02:25:30.417 INFO:teuthology.orchestra.run.smithi039.stdout: python3-prettytable-0.7.2-27.el9.noarch 2024-09-12T02:25:30.417 INFO:teuthology.orchestra.run.smithi039.stdout: python3-protobuf-3.14.0-13.el9.noarch 2024-09-12T02:25:30.417 INFO:teuthology.orchestra.run.smithi039.stdout: python3-pyOpenSSL-21.0.0-1.el9.noarch 2024-09-12T02:25:30.417 INFO:teuthology.orchestra.run.smithi039.stdout: python3-pyasn1-0.4.8-6.el9.noarch 2024-09-12T02:25:30.417 INFO:teuthology.orchestra.run.smithi039.stdout: python3-pyasn1-modules-0.4.8-6.el9.noarch 2024-09-12T02:25:30.418 INFO:teuthology.orchestra.run.smithi039.stdout: python3-pycparser-2.20-6.el9.noarch 2024-09-12T02:25:30.418 INFO:teuthology.orchestra.run.smithi039.stdout: python3-pyperclip-1.8.2-2.el9.noarch 2024-09-12T02:25:30.418 INFO:teuthology.orchestra.run.smithi039.stdout: python3-pytz-2021.1-5.el9.noarch 2024-09-12T02:25:30.418 INFO:teuthology.orchestra.run.smithi039.stdout: python3-rados-2:19.1.1-298.gb53b6d3e.el9.x86_64 2024-09-12T02:25:30.418 INFO:teuthology.orchestra.run.smithi039.stdout: python3-rbd-2:19.1.1-298.gb53b6d3e.el9.x86_64 2024-09-12T02:25:30.418 INFO:teuthology.orchestra.run.smithi039.stdout: python3-repoze-lru-0.7-16.el9.noarch 2024-09-12T02:25:30.418 INFO:teuthology.orchestra.run.smithi039.stdout: python3-requests-2.25.1-8.el9.noarch 2024-09-12T02:25:30.418 INFO:teuthology.orchestra.run.smithi039.stdout: python3-requests-oauthlib-1.3.0-12.el9.noarch 2024-09-12T02:25:30.418 INFO:teuthology.orchestra.run.smithi039.stdout: python3-rgw-2:19.1.1-298.gb53b6d3e.el9.x86_64 2024-09-12T02:25:30.418 INFO:teuthology.orchestra.run.smithi039.stdout: python3-routes-2.5.1-5.el9.noarch 2024-09-12T02:25:30.418 INFO:teuthology.orchestra.run.smithi039.stdout: python3-rsa-4.9-2.el9.noarch 2024-09-12T02:25:30.419 INFO:teuthology.orchestra.run.smithi039.stdout: python3-scipy-1.6.2-8.el9.x86_64 2024-09-12T02:25:30.419 INFO:teuthology.orchestra.run.smithi039.stdout: python3-tempora-5.0.0-2.el9.noarch 2024-09-12T02:25:30.419 INFO:teuthology.orchestra.run.smithi039.stdout: python3-toml-0.10.2-6.el9.noarch 2024-09-12T02:25:30.419 INFO:teuthology.orchestra.run.smithi039.stdout: python3-typing-extensions-4.12.2-2.el9.noarch 2024-09-12T02:25:30.419 INFO:teuthology.orchestra.run.smithi039.stdout: python3-urllib3-1.26.5-6.el9.noarch 2024-09-12T02:25:30.419 INFO:teuthology.orchestra.run.smithi039.stdout: python3-wcwidth-0.2.5-8.el9.noarch 2024-09-12T02:25:30.419 INFO:teuthology.orchestra.run.smithi039.stdout: python3-webob-1.8.8-2.el9.noarch 2024-09-12T02:25:30.419 INFO:teuthology.orchestra.run.smithi039.stdout: python3-websocket-client-1.2.3-2.el9.noarch 2024-09-12T02:25:30.419 INFO:teuthology.orchestra.run.smithi039.stdout: python3-werkzeug-2.0.3-3.el9.1.noarch 2024-09-12T02:25:30.419 INFO:teuthology.orchestra.run.smithi039.stdout: python3-zc-lockfile-2.0-10.el9.noarch 2024-09-12T02:25:30.419 INFO:teuthology.orchestra.run.smithi039.stdout: qatlib-24.02.0-1.el9.x86_64 2024-09-12T02:25:30.419 INFO:teuthology.orchestra.run.smithi039.stdout: qatlib-service-24.02.0-1.el9.x86_64 2024-09-12T02:25:30.419 INFO:teuthology.orchestra.run.smithi039.stdout: qatzip-libs-1.2.0-1.el9.x86_64 2024-09-12T02:25:30.420 INFO:teuthology.orchestra.run.smithi039.stdout: rbd-fuse-2:19.1.1-298.gb53b6d3e.el9.x86_64 2024-09-12T02:25:30.420 INFO:teuthology.orchestra.run.smithi039.stdout: rbd-mirror-2:19.1.1-298.gb53b6d3e.el9.x86_64 2024-09-12T02:25:30.420 INFO:teuthology.orchestra.run.smithi039.stdout: rbd-nbd-2:19.1.1-298.gb53b6d3e.el9.x86_64 2024-09-12T02:25:30.420 INFO:teuthology.orchestra.run.smithi039.stdout: re2-1:20211101-20.el9.x86_64 2024-09-12T02:25:30.420 INFO:teuthology.orchestra.run.smithi039.stdout: socat-1.7.4.1-6.el9.x86_64 2024-09-12T02:25:30.420 INFO:teuthology.orchestra.run.smithi039.stdout: thrift-0.15.0-2.el9.x86_64 2024-09-12T02:25:30.420 INFO:teuthology.orchestra.run.smithi039.stdout: uuid-1.6.2-55.el9.x86_64 2024-09-12T02:25:30.420 INFO:teuthology.orchestra.run.smithi039.stdout: xfsprogs-devel-6.4.0-4.el9.x86_64 2024-09-12T02:25:30.420 INFO:teuthology.orchestra.run.smithi039.stdout: xmlstarlet-1.6.1-20.el9.x86_64 2024-09-12T02:25:30.420 INFO:teuthology.orchestra.run.smithi039.stdout: zlib-devel-1.2.11-41.el9.x86_64 2024-09-12T02:25:30.421 INFO:teuthology.orchestra.run.smithi039.stdout: 2024-09-12T02:25:30.421 INFO:teuthology.orchestra.run.smithi039.stdout:Complete! 2024-09-12T02:25:31.037 DEBUG:teuthology.parallel:result is None 2024-09-12T02:25:31.038 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F9%2Fx86_64&sha1=b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc 2024-09-12T02:25:31.182 DEBUG:teuthology.orchestra.run.smithi039:> rpm -q ceph --qf '%{VERSION}-%{RELEASE}' 2024-09-12T02:25:31.233 INFO:teuthology.orchestra.run.smithi039.stdout:19.1.1-298.gb53b6d3e.el9 2024-09-12T02:25:31.234 INFO:teuthology.packaging:The installed version of ceph is 19.1.1-298.gb53b6d3e.el9 2024-09-12T02:25:31.234 INFO:teuthology.task.install:The correct ceph version 19.1.1-298.gb53b6d3e is installed. 2024-09-12T02:25:31.236 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F9%2Fx86_64&sha1=b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc 2024-09-12T02:25:31.375 DEBUG:teuthology.orchestra.run.smithi044:> rpm -q ceph --qf '%{VERSION}-%{RELEASE}' 2024-09-12T02:25:31.402 INFO:teuthology.orchestra.run.smithi044.stdout:19.1.1-298.gb53b6d3e.el9 2024-09-12T02:25:31.402 INFO:teuthology.packaging:The installed version of ceph is 19.1.1-298.gb53b6d3e.el9 2024-09-12T02:25:31.402 INFO:teuthology.task.install:The correct ceph version 19.1.1-298.gb53b6d3e is installed. 2024-09-12T02:25:31.404 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F9%2Fx86_64&sha1=b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc 2024-09-12T02:25:31.547 DEBUG:teuthology.orchestra.run.smithi172:> rpm -q ceph --qf '%{VERSION}-%{RELEASE}' 2024-09-12T02:25:31.574 INFO:teuthology.orchestra.run.smithi172.stdout:19.1.1-298.gb53b6d3e.el9 2024-09-12T02:25:31.574 INFO:teuthology.packaging:The installed version of ceph is 19.1.1-298.gb53b6d3e.el9 2024-09-12T02:25:31.574 INFO:teuthology.task.install:The correct ceph version 19.1.1-298.gb53b6d3e is installed. 2024-09-12T02:25:31.576 INFO:teuthology.task.install.util:Shipping valgrind.supp... 2024-09-12T02:25:31.576 DEBUG:teuthology.orchestra.run.smithi039:> set -ex 2024-09-12T02:25:31.576 DEBUG:teuthology.orchestra.run.smithi039:> sudo dd of=/home/ubuntu/cephtest/valgrind.supp 2024-09-12T02:25:31.636 DEBUG:teuthology.orchestra.run.smithi044:> set -ex 2024-09-12T02:25:31.636 DEBUG:teuthology.orchestra.run.smithi044:> sudo dd of=/home/ubuntu/cephtest/valgrind.supp 2024-09-12T02:25:31.668 DEBUG:teuthology.orchestra.run.smithi172:> set -ex 2024-09-12T02:25:31.668 DEBUG:teuthology.orchestra.run.smithi172:> sudo dd of=/home/ubuntu/cephtest/valgrind.supp 2024-09-12T02:25:31.699 INFO:teuthology.task.install.util:Shipping 'daemon-helper'... 2024-09-12T02:25:31.700 DEBUG:teuthology.orchestra.run.smithi039:> set -ex 2024-09-12T02:25:31.700 DEBUG:teuthology.orchestra.run.smithi039:> sudo dd of=/usr/bin/daemon-helper 2024-09-12T02:25:31.756 DEBUG:teuthology.orchestra.run.smithi039:> sudo chmod a=rx -- /usr/bin/daemon-helper 2024-09-12T02:25:31.855 DEBUG:teuthology.orchestra.run.smithi044:> set -ex 2024-09-12T02:25:31.855 DEBUG:teuthology.orchestra.run.smithi044:> sudo dd of=/usr/bin/daemon-helper 2024-09-12T02:25:31.885 DEBUG:teuthology.orchestra.run.smithi044:> sudo chmod a=rx -- /usr/bin/daemon-helper 2024-09-12T02:25:31.954 DEBUG:teuthology.orchestra.run.smithi172:> set -ex 2024-09-12T02:25:31.954 DEBUG:teuthology.orchestra.run.smithi172:> sudo dd of=/usr/bin/daemon-helper 2024-09-12T02:25:31.984 DEBUG:teuthology.orchestra.run.smithi172:> sudo chmod a=rx -- /usr/bin/daemon-helper 2024-09-12T02:25:32.053 INFO:teuthology.task.install.util:Shipping 'adjust-ulimits'... 2024-09-12T02:25:32.054 DEBUG:teuthology.orchestra.run.smithi039:> set -ex 2024-09-12T02:25:32.054 DEBUG:teuthology.orchestra.run.smithi039:> sudo dd of=/usr/bin/adjust-ulimits 2024-09-12T02:25:32.112 DEBUG:teuthology.orchestra.run.smithi039:> sudo chmod a=rx -- /usr/bin/adjust-ulimits 2024-09-12T02:25:32.209 DEBUG:teuthology.orchestra.run.smithi044:> set -ex 2024-09-12T02:25:32.209 DEBUG:teuthology.orchestra.run.smithi044:> sudo dd of=/usr/bin/adjust-ulimits 2024-09-12T02:25:32.238 DEBUG:teuthology.orchestra.run.smithi044:> sudo chmod a=rx -- /usr/bin/adjust-ulimits 2024-09-12T02:25:32.309 DEBUG:teuthology.orchestra.run.smithi172:> set -ex 2024-09-12T02:25:32.309 DEBUG:teuthology.orchestra.run.smithi172:> sudo dd of=/usr/bin/adjust-ulimits 2024-09-12T02:25:32.339 DEBUG:teuthology.orchestra.run.smithi172:> sudo chmod a=rx -- /usr/bin/adjust-ulimits 2024-09-12T02:25:32.407 INFO:teuthology.task.install.util:Shipping 'stdin-killer'... 2024-09-12T02:25:32.408 DEBUG:teuthology.orchestra.run.smithi039:> set -ex 2024-09-12T02:25:32.408 DEBUG:teuthology.orchestra.run.smithi039:> sudo dd of=/usr/bin/stdin-killer 2024-09-12T02:25:32.464 DEBUG:teuthology.orchestra.run.smithi039:> sudo chmod a=rx -- /usr/bin/stdin-killer 2024-09-12T02:25:32.565 DEBUG:teuthology.orchestra.run.smithi044:> set -ex 2024-09-12T02:25:32.566 DEBUG:teuthology.orchestra.run.smithi044:> sudo dd of=/usr/bin/stdin-killer 2024-09-12T02:25:32.595 DEBUG:teuthology.orchestra.run.smithi044:> sudo chmod a=rx -- /usr/bin/stdin-killer 2024-09-12T02:25:32.665 DEBUG:teuthology.orchestra.run.smithi172:> set -ex 2024-09-12T02:25:32.665 DEBUG:teuthology.orchestra.run.smithi172:> sudo dd of=/usr/bin/stdin-killer 2024-09-12T02:25:32.695 DEBUG:teuthology.orchestra.run.smithi172:> sudo chmod a=rx -- /usr/bin/stdin-killer 2024-09-12T02:25:32.766 INFO:teuthology.run_tasks:Running task cephadm... 2024-09-12T02:25:32.869 INFO:tasks.cephadm:Config: {'roleless': False, 'cephfs': {'ec_profile': ['m=2', 'k=2', 'crush-failure-domain=osd'], 'max_mds': 5, 'session_timeout': 300, 'standby_replay': True}, 'conf': {'client': {'client mount timeout': 600, 'debug client': 20, 'debug ms': 1, 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'global': {'ms die on skipped message': False}, 'mds': {'debug mds': 20, 'debug mds balancer': 20, 'debug ms': 1, 'mds bal fragment size max': 10000, 'mds bal merge size': 5, 'mds bal split bits': 3, 'mds bal split size': 100, 'mds debug frag': True, 'mds debug scatterstat': True, 'mds op complaint time': 180, 'mds verify scatter': True, 'mds_bal_replicate_threshold': 1, 'mds_export_ephemeral_random_max': 0.1, 'osd op complaint time': 180, 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'mgr': {'cephsqlite lock renewal timeout': 900000, 'debug cephsqlite': 20, 'debug client': 20, 'debug mgr': 20, 'debug ms': 1}, 'mon': {'debug mon': 20, 'debug ms': 1, 'debug paxos': 20, 'mon down mkfs grace': 300, 'mon op complaint time': 120, 'mon warn on pool no app': False}, 'osd': {'bluestore block size': 96636764160, 'bluestore fsck on mount': True, 'debug bluefs': 20, 'debug bluestore': 20, 'debug ms': 1, 'debug osd': 20, 'debug rocksdb': 10, 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd failsafe full ratio': 0.95, 'osd objectstore': 'bluestore', 'osd op complaint time': 180, 'osd shutdown pgref assert': True, 'osd_max_omap_entries_per_request': 10}}, 'flavor': 'default', 'fs': 'xfs', 'log-ignorelist': ['\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)', 'FS_DEGRADED', 'FS_INLINE_DATA_DEPRECATED', 'FS_WITH_FAILED_MDS', 'MDS_ALL_DOWN', 'MDS_DAMAGE', 'MDS_DEGRADED', 'MDS_FAILED', 'MDS_INSUFFICIENT_STANDBY', 'MDS_UP_LESS_THAN_MAX', 'online, but wants', 'filesystem is online with fewer MDS than max_mds', 'POOL_APP_NOT_ENABLED', 'do not have an application enabled', 'overall HEALTH_', 'Replacing daemon', 'deprecated feature inline_data', 'overall HEALTH_', '\\(OSD_DOWN\\)', '\\(OSD_', 'but it is still running', 'is not responding', 'MON_DOWN', 'PG_AVAILABILITY', 'PG_DEGRADED', 'Reduced data availability', 'Degraded data redundancy'], 'sha1': 'b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc', 'subvols': {'create': 2, 'subvol_options': '--size 25000000000'}} 2024-09-12T02:25:32.869 INFO:tasks.cephadm:Cluster image is quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc 2024-09-12T02:25:32.869 INFO:tasks.cephadm:Cluster fsid is 4954ed46-70ae-11ef-bcea-c7b262605968 2024-09-12T02:25:32.870 INFO:tasks.cephadm:Choosing monitor IPs and ports... 2024-09-12T02:25:32.870 INFO:tasks.cephadm:Monitor IPs: {'mon.a': '172.21.15.39', 'mon.b': '172.21.15.44', 'mon.c': '172.21.15.172'} 2024-09-12T02:25:32.870 INFO:tasks.cephadm:First mon is mon.a on smithi039 2024-09-12T02:25:32.870 INFO:tasks.cephadm:First mgr is x 2024-09-12T02:25:32.870 INFO:tasks.cephadm:Normalizing hostnames... 2024-09-12T02:25:32.870 DEBUG:teuthology.orchestra.run.smithi039:> sudo hostname $(hostname -s) 2024-09-12T02:25:32.928 DEBUG:teuthology.orchestra.run.smithi044:> sudo hostname $(hostname -s) 2024-09-12T02:25:32.958 DEBUG:teuthology.orchestra.run.smithi172:> sudo hostname $(hostname -s) 2024-09-12T02:25:32.988 INFO:tasks.cephadm:Downloading "compiled" cephadm from cachra 2024-09-12T02:25:32.989 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F9%2Fx86_64&sha1=b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc 2024-09-12T02:25:33.131 INFO:tasks.cephadm:builder_project result: [{'status': 'ready', 'sha1': 'b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc', 'extra': {'build_url': 'https://jenkins.ceph.com/job/ceph-dev-build/ARCH=x86_64,AVAILABLE_ARCH=x86_64,AVAILABLE_DIST=centos9,DIST=centos9,MACHINE_SIZE=gigantic/56038/', 'root_build_cause': 'SCMTRIGGER', 'version': '19.1.1-298-gb53b6d3e', 'node_name': '172.21.5.36+adami06', 'job_name': 'ceph-dev-build/ARCH=x86_64,AVAILABLE_ARCH=x86_64,AVAILABLE_DIST=centos9,DIST=centos9,MACHINE_SIZE=gigantic', 'package_manager_version': '19.1.1-298.gb53b6d3e'}, 'url': 'https://2.chacra.ceph.com/r/ceph/squid/b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc/centos/9/flavors/default/', 'distro_codename': None, 'modified': '2024-09-09 17:24:58.599585', 'distro_version': '9', 'project': 'ceph', 'flavor': 'default', 'ref': 'squid', 'chacra_url': 'https://2.chacra.ceph.com/repos/ceph/squid/b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc/centos/9/flavors/default/', 'archs': ['x86_64', 'source'], 'distro': 'centos'}] 2024-09-12T02:25:33.264 INFO:tasks.util.chacra:got chacra host 2.chacra.ceph.com, ref squid, sha1 b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc from https://shaman.ceph.com/api/search/?project=ceph&distros=centos%2F9%2Fx86_64&flavor=default&sha1=b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc 2024-09-12T02:25:33.266 INFO:tasks.cephadm:Discovered cachra url: https://2.chacra.ceph.com/binaries/ceph/squid/b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc/centos/9/x86_64/flavors/default/cephadm 2024-09-12T02:25:33.266 INFO:tasks.cephadm:Downloading cephadm from url: https://2.chacra.ceph.com/binaries/ceph/squid/b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc/centos/9/x86_64/flavors/default/cephadm 2024-09-12T02:25:33.266 DEBUG:teuthology.orchestra.run.smithi039:> curl --silent -L https://2.chacra.ceph.com/binaries/ceph/squid/b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc/centos/9/x86_64/flavors/default/cephadm > /home/ubuntu/cephtest/cephadm && ls -l /home/ubuntu/cephtest/cephadm 2024-09-12T02:25:33.666 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r--. 1 ubuntu ubuntu 784498 Sep 12 02:25 /home/ubuntu/cephtest/cephadm 2024-09-12T02:25:33.666 DEBUG:teuthology.orchestra.run.smithi044:> curl --silent -L https://2.chacra.ceph.com/binaries/ceph/squid/b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc/centos/9/x86_64/flavors/default/cephadm > /home/ubuntu/cephtest/cephadm && ls -l /home/ubuntu/cephtest/cephadm 2024-09-12T02:25:34.039 INFO:teuthology.orchestra.run.smithi044.stdout:-rw-r--r--. 1 ubuntu ubuntu 784498 Sep 12 02:25 /home/ubuntu/cephtest/cephadm 2024-09-12T02:25:34.039 DEBUG:teuthology.orchestra.run.smithi172:> curl --silent -L https://2.chacra.ceph.com/binaries/ceph/squid/b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc/centos/9/x86_64/flavors/default/cephadm > /home/ubuntu/cephtest/cephadm && ls -l /home/ubuntu/cephtest/cephadm 2024-09-12T02:25:34.437 INFO:teuthology.orchestra.run.smithi172.stdout:-rw-r--r--. 1 ubuntu ubuntu 784498 Sep 12 02:25 /home/ubuntu/cephtest/cephadm 2024-09-12T02:25:34.437 DEBUG:teuthology.orchestra.run.smithi039:> test -s /home/ubuntu/cephtest/cephadm && test $(stat -c%s /home/ubuntu/cephtest/cephadm) -gt 1000 && chmod +x /home/ubuntu/cephtest/cephadm 2024-09-12T02:25:34.479 DEBUG:teuthology.orchestra.run.smithi044:> test -s /home/ubuntu/cephtest/cephadm && test $(stat -c%s /home/ubuntu/cephtest/cephadm) -gt 1000 && chmod +x /home/ubuntu/cephtest/cephadm 2024-09-12T02:25:34.498 DEBUG:teuthology.orchestra.run.smithi172:> test -s /home/ubuntu/cephtest/cephadm && test $(stat -c%s /home/ubuntu/cephtest/cephadm) -gt 1000 && chmod +x /home/ubuntu/cephtest/cephadm 2024-09-12T02:25:34.535 INFO:tasks.cephadm:Pulling image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc on all hosts... 2024-09-12T02:25:34.535 DEBUG:teuthology.orchestra.run.smithi039:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc pull 2024-09-12T02:25:34.539 DEBUG:teuthology.orchestra.run.smithi044:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc pull 2024-09-12T02:25:34.542 DEBUG:teuthology.orchestra.run.smithi172:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc pull 2024-09-12T02:25:36.013 INFO:teuthology.orchestra.run.smithi172.stderr:Pulling container image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc... 2024-09-12T02:25:36.187 INFO:teuthology.orchestra.run.smithi044.stderr:Pulling container image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc... 2024-09-12T02:25:36.334 INFO:teuthology.orchestra.run.smithi039.stderr:Pulling container image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc... 2024-09-12T02:26:10.357 INFO:teuthology.orchestra.run.smithi172.stdout:{ 2024-09-12T02:26:10.357 INFO:teuthology.orchestra.run.smithi172.stdout: "ceph_version": "ceph version 19.1.1-298-gb53b6d3e (b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc) squid (stable)", 2024-09-12T02:26:10.357 INFO:teuthology.orchestra.run.smithi172.stdout: "image_id": "54467abc55f864c4f73dfaf9c6ac3bb3e87b773123d5badaf790bee57321d594", 2024-09-12T02:26:10.357 INFO:teuthology.orchestra.run.smithi172.stdout: "repo_digests": [ 2024-09-12T02:26:10.357 INFO:teuthology.orchestra.run.smithi172.stdout: "quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:3be30d720e37ec4df7f667e60f22b4d221c4ce7b408e68b90f9ac10220535e66" 2024-09-12T02:26:10.357 INFO:teuthology.orchestra.run.smithi172.stdout: ] 2024-09-12T02:26:10.357 INFO:teuthology.orchestra.run.smithi172.stdout:} 2024-09-12T02:26:31.445 INFO:teuthology.orchestra.run.smithi044.stdout:{ 2024-09-12T02:26:31.445 INFO:teuthology.orchestra.run.smithi044.stdout: "ceph_version": "ceph version 19.1.1-298-gb53b6d3e (b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc) squid (stable)", 2024-09-12T02:26:31.445 INFO:teuthology.orchestra.run.smithi044.stdout: "image_id": "54467abc55f864c4f73dfaf9c6ac3bb3e87b773123d5badaf790bee57321d594", 2024-09-12T02:26:31.445 INFO:teuthology.orchestra.run.smithi044.stdout: "repo_digests": [ 2024-09-12T02:26:31.445 INFO:teuthology.orchestra.run.smithi044.stdout: "quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:3be30d720e37ec4df7f667e60f22b4d221c4ce7b408e68b90f9ac10220535e66" 2024-09-12T02:26:31.445 INFO:teuthology.orchestra.run.smithi044.stdout: ] 2024-09-12T02:26:31.445 INFO:teuthology.orchestra.run.smithi044.stdout:} 2024-09-12T02:26:32.239 INFO:teuthology.orchestra.run.smithi039.stdout:{ 2024-09-12T02:26:32.239 INFO:teuthology.orchestra.run.smithi039.stdout: "ceph_version": "ceph version 19.1.1-298-gb53b6d3e (b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc) squid (stable)", 2024-09-12T02:26:32.239 INFO:teuthology.orchestra.run.smithi039.stdout: "image_id": "54467abc55f864c4f73dfaf9c6ac3bb3e87b773123d5badaf790bee57321d594", 2024-09-12T02:26:32.239 INFO:teuthology.orchestra.run.smithi039.stdout: "repo_digests": [ 2024-09-12T02:26:32.239 INFO:teuthology.orchestra.run.smithi039.stdout: "quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:3be30d720e37ec4df7f667e60f22b4d221c4ce7b408e68b90f9ac10220535e66" 2024-09-12T02:26:32.240 INFO:teuthology.orchestra.run.smithi039.stdout: ] 2024-09-12T02:26:32.240 INFO:teuthology.orchestra.run.smithi039.stdout:} 2024-09-12T02:26:32.270 DEBUG:teuthology.orchestra.run.smithi039:> sudo mkdir -p /etc/ceph 2024-09-12T02:26:32.346 DEBUG:teuthology.orchestra.run.smithi044:> sudo mkdir -p /etc/ceph 2024-09-12T02:26:32.378 DEBUG:teuthology.orchestra.run.smithi172:> sudo mkdir -p /etc/ceph 2024-09-12T02:26:32.413 DEBUG:teuthology.orchestra.run.smithi039:> sudo chmod 777 /etc/ceph 2024-09-12T02:26:32.468 DEBUG:teuthology.orchestra.run.smithi044:> sudo chmod 777 /etc/ceph 2024-09-12T02:26:32.497 DEBUG:teuthology.orchestra.run.smithi172:> sudo chmod 777 /etc/ceph 2024-09-12T02:26:32.526 INFO:tasks.cephadm:Writing seed config... 2024-09-12T02:26:32.527 INFO:tasks.cephadm: override: [client] client mount timeout = 600 2024-09-12T02:26:32.527 INFO:tasks.cephadm: override: [client] debug client = 20 2024-09-12T02:26:32.527 INFO:tasks.cephadm: override: [client] debug ms = 1 2024-09-12T02:26:32.527 INFO:tasks.cephadm: override: [client] rados mon op timeout = 900 2024-09-12T02:26:32.527 INFO:tasks.cephadm: override: [client] rados osd op timeout = 900 2024-09-12T02:26:32.527 INFO:tasks.cephadm: override: [global] ms die on skipped message = False 2024-09-12T02:26:32.527 INFO:tasks.cephadm: override: [mds] debug mds = 20 2024-09-12T02:26:32.527 INFO:tasks.cephadm: override: [mds] debug mds balancer = 20 2024-09-12T02:26:32.527 INFO:tasks.cephadm: override: [mds] debug ms = 1 2024-09-12T02:26:32.527 INFO:tasks.cephadm: override: [mds] mds bal fragment size max = 10000 2024-09-12T02:26:32.528 INFO:tasks.cephadm: override: [mds] mds bal merge size = 5 2024-09-12T02:26:32.528 INFO:tasks.cephadm: override: [mds] mds bal split bits = 3 2024-09-12T02:26:32.528 INFO:tasks.cephadm: override: [mds] mds bal split size = 100 2024-09-12T02:26:32.528 INFO:tasks.cephadm: override: [mds] mds debug frag = True 2024-09-12T02:26:32.528 INFO:tasks.cephadm: override: [mds] mds debug scatterstat = True 2024-09-12T02:26:32.528 INFO:tasks.cephadm: override: [mds] mds op complaint time = 180 2024-09-12T02:26:32.528 INFO:tasks.cephadm: override: [mds] mds verify scatter = True 2024-09-12T02:26:32.528 INFO:tasks.cephadm: override: [mds] mds_bal_replicate_threshold = 1 2024-09-12T02:26:32.528 INFO:tasks.cephadm: override: [mds] mds_export_ephemeral_random_max = 0.1 2024-09-12T02:26:32.528 INFO:tasks.cephadm: override: [mds] osd op complaint time = 180 2024-09-12T02:26:32.528 INFO:tasks.cephadm: override: [mds] rados mon op timeout = 900 2024-09-12T02:26:32.528 INFO:tasks.cephadm: override: [mds] rados osd op timeout = 900 2024-09-12T02:26:32.528 INFO:tasks.cephadm: override: [mgr] cephsqlite lock renewal timeout = 900000 2024-09-12T02:26:32.528 INFO:tasks.cephadm: override: [mgr] debug cephsqlite = 20 2024-09-12T02:26:32.528 INFO:tasks.cephadm: override: [mgr] debug client = 20 2024-09-12T02:26:32.528 INFO:tasks.cephadm: override: [mgr] debug mgr = 20 2024-09-12T02:26:32.529 INFO:tasks.cephadm: override: [mgr] debug ms = 1 2024-09-12T02:26:32.529 INFO:tasks.cephadm: override: [mon] debug mon = 20 2024-09-12T02:26:32.529 INFO:tasks.cephadm: override: [mon] debug ms = 1 2024-09-12T02:26:32.529 INFO:tasks.cephadm: override: [mon] debug paxos = 20 2024-09-12T02:26:32.529 INFO:tasks.cephadm: override: [mon] mon down mkfs grace = 300 2024-09-12T02:26:32.529 INFO:tasks.cephadm: override: [mon] mon op complaint time = 120 2024-09-12T02:26:32.529 INFO:tasks.cephadm: override: [mon] mon warn on pool no app = False 2024-09-12T02:26:32.529 INFO:tasks.cephadm: override: [osd] bluestore block size = 96636764160 2024-09-12T02:26:32.529 INFO:tasks.cephadm: override: [osd] bluestore fsck on mount = True 2024-09-12T02:26:32.529 INFO:tasks.cephadm: override: [osd] debug bluefs = 20 2024-09-12T02:26:32.529 INFO:tasks.cephadm: override: [osd] debug bluestore = 20 2024-09-12T02:26:32.529 INFO:tasks.cephadm: override: [osd] debug ms = 1 2024-09-12T02:26:32.529 INFO:tasks.cephadm: override: [osd] debug osd = 20 2024-09-12T02:26:32.529 INFO:tasks.cephadm: override: [osd] debug rocksdb = 10 2024-09-12T02:26:32.529 INFO:tasks.cephadm: override: [osd] mon osd backfillfull_ratio = 0.85 2024-09-12T02:26:32.530 INFO:tasks.cephadm: override: [osd] mon osd full ratio = 0.9 2024-09-12T02:26:32.530 INFO:tasks.cephadm: override: [osd] mon osd nearfull ratio = 0.8 2024-09-12T02:26:32.530 INFO:tasks.cephadm: override: [osd] osd failsafe full ratio = 0.95 2024-09-12T02:26:32.530 INFO:tasks.cephadm: override: [osd] osd objectstore = bluestore 2024-09-12T02:26:32.530 INFO:tasks.cephadm: override: [osd] osd op complaint time = 180 2024-09-12T02:26:32.530 INFO:tasks.cephadm: override: [osd] osd shutdown pgref assert = True 2024-09-12T02:26:32.530 INFO:tasks.cephadm: override: [osd] osd_max_omap_entries_per_request = 10 2024-09-12T02:26:32.531 DEBUG:teuthology.orchestra.run.smithi039:> set -ex 2024-09-12T02:26:32.531 DEBUG:teuthology.orchestra.run.smithi039:> dd of=/home/ubuntu/cephtest/seed.ceph.conf 2024-09-12T02:26:32.565 DEBUG:tasks.cephadm:Final config: [global] # make logging friendly to teuthology log_to_file = true log_to_stderr = false log to journald = false mon cluster log to file = true mon cluster log file level = debug mon clock drift allowed = 1.000 # replicate across OSDs, not hosts osd crush chooseleaf type = 0 #osd pool default size = 2 osd pool default erasure code profile = plugin=jerasure technique=reed_sol_van k=2 m=1 crush-failure-domain=osd # enable some debugging auth debug = true ms die on old message = true ms die on bug = true debug asserts on shutdown = true # adjust warnings mon max pg per osd = 10000# >= luminous mon pg warn max object skew = 0 mon osd allow primary affinity = true mon osd allow pg remap = true mon warn on legacy crush tunables = false mon warn on crush straw calc version zero = false mon warn on no sortbitwise = false mon warn on osd down out interval zero = false mon warn on too few osds = false mon_warn_on_pool_pg_num_not_power_of_two = false # disable pg_autoscaler by default for new pools osd_pool_default_pg_autoscale_mode = off # tests delete pools mon allow pool delete = true fsid = 4954ed46-70ae-11ef-bcea-c7b262605968 ms die on skipped message = False [osd] osd scrub load threshold = 5.0 osd scrub max interval = 600 osd mclock profile = high_recovery_ops osd recover clone overlap = true osd recovery max chunk = 1048576 osd deep scrub update digest min age = 30 osd map max advance = 10 osd memory target autotune = true # debugging osd debug shutdown = true osd debug op order = true osd debug verify stray on activate = true osd debug pg log writeout = true osd debug verify cached snaps = true osd debug verify missing on start = true osd debug misdirected ops = true osd op queue = debug_random osd op queue cut off = debug_random osd shutdown pgref assert = True bdev debug aio = true osd sloppy crc = true bluestore block size = 96636764160 bluestore fsck on mount = True debug bluefs = 20 debug bluestore = 20 debug ms = 1 debug osd = 20 debug rocksdb = 10 mon osd backfillfull_ratio = 0.85 mon osd full ratio = 0.9 mon osd nearfull ratio = 0.8 osd failsafe full ratio = 0.95 osd objectstore = bluestore osd op complaint time = 180 osd_max_omap_entries_per_request = 10 [mgr] mon reweight min pgs per osd = 4 mon reweight min bytes per osd = 10 mgr/telemetry/nag = false cephsqlite lock renewal timeout = 900000 debug cephsqlite = 20 debug client = 20 debug mgr = 20 debug ms = 1 [mon] mon data avail warn = 5 mon mgr mkfs grace = 240 mon reweight min pgs per osd = 4 mon osd reporter subtree level = osd mon osd prime pg temp = true mon reweight min bytes per osd = 10 # rotate auth tickets quickly to exercise renewal paths auth mon ticket ttl = 660# 11m auth service ticket ttl = 240# 4m # don't complain about global id reclaim mon_warn_on_insecure_global_id_reclaim = false mon_warn_on_insecure_global_id_reclaim_allowed = false debug mon = 20 debug ms = 1 debug paxos = 20 mon down mkfs grace = 300 mon op complaint time = 120 mon warn on pool no app = False [client.rgw] rgw cache enabled = true rgw enable ops log = true rgw enable usage log = true [client] client mount timeout = 600 debug client = 20 debug ms = 1 rados mon op timeout = 900 rados osd op timeout = 900 [mds] debug mds = 20 debug mds balancer = 20 debug ms = 1 mds bal fragment size max = 10000 mds bal merge size = 5 mds bal split bits = 3 mds bal split size = 100 mds debug frag = True mds debug scatterstat = True mds op complaint time = 180 mds verify scatter = True mds_bal_replicate_threshold = 1 mds_export_ephemeral_random_max = 0.1 osd op complaint time = 180 rados mon op timeout = 900 rados osd op timeout = 900 2024-09-12T02:26:32.566 DEBUG:teuthology.orchestra.run.smithi039:mon.a> sudo journalctl -f -n 0 -u ceph-4954ed46-70ae-11ef-bcea-c7b262605968@mon.a.service 2024-09-12T02:26:32.609 DEBUG:teuthology.orchestra.run.smithi039:mgr.x> sudo journalctl -f -n 0 -u ceph-4954ed46-70ae-11ef-bcea-c7b262605968@mgr.x.service 2024-09-12T02:26:32.655 INFO:tasks.cephadm:Bootstrapping... 2024-09-12T02:26:32.655 DEBUG:teuthology.orchestra.run.smithi039:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc -v bootstrap --fsid 4954ed46-70ae-11ef-bcea-c7b262605968 --config /home/ubuntu/cephtest/seed.ceph.conf --output-config /etc/ceph/ceph.conf --output-keyring /etc/ceph/ceph.client.admin.keyring --output-pub-ssh-key /home/ubuntu/cephtest/ceph.pub --mon-id a --mgr-id x --orphan-initial-daemons --skip-monitoring-stack --mon-ip 172.21.15.39 --skip-admin-label && sudo chmod +r /etc/ceph/ceph.client.admin.keyring 2024-09-12T02:26:32.919 INFO:teuthology.orchestra.run.smithi039.stdout:-------------------------------------------------------------------------------- 2024-09-12T02:26:32.919 INFO:teuthology.orchestra.run.smithi039.stdout:cephadm ['--image', 'quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc', '-v', 'bootstrap', '--fsid', '4954ed46-70ae-11ef-bcea-c7b262605968', '--config', '/home/ubuntu/cephtest/seed.ceph.conf', '--output-config', '/etc/ceph/ceph.conf', '--output-keyring', '/etc/ceph/ceph.client.admin.keyring', '--output-pub-ssh-key', '/home/ubuntu/cephtest/ceph.pub', '--mon-id', 'a', '--mgr-id', 'x', '--orphan-initial-daemons', '--skip-monitoring-stack', '--mon-ip', '172.21.15.39', '--skip-admin-label'] 2024-09-12T02:26:32.920 INFO:teuthology.orchestra.run.smithi039.stderr:Specifying an fsid for your cluster offers no advantages and may increase the likelihood of fsid conflicts. 2024-09-12T02:26:32.920 INFO:teuthology.orchestra.run.smithi039.stdout:Verifying podman|docker is present... 2024-09-12T02:26:32.977 INFO:teuthology.orchestra.run.smithi039.stdout:/bin/podman: stdout 5.2.2 2024-09-12T02:26:32.978 INFO:teuthology.orchestra.run.smithi039.stdout:Verifying lvm2 is present... 2024-09-12T02:26:32.978 INFO:teuthology.orchestra.run.smithi039.stdout:Verifying time synchronization is in place... 2024-09-12T02:26:32.992 INFO:teuthology.orchestra.run.smithi039.stdout:Non-zero exit code 1 from systemctl is-enabled chrony.service 2024-09-12T02:26:32.992 INFO:teuthology.orchestra.run.smithi039.stdout:systemctl: stderr Failed to get unit file state for chrony.service: No such file or directory 2024-09-12T02:26:33.004 INFO:teuthology.orchestra.run.smithi039.stdout:Non-zero exit code 3 from systemctl is-active chrony.service 2024-09-12T02:26:33.004 INFO:teuthology.orchestra.run.smithi039.stdout:systemctl: stdout inactive 2024-09-12T02:26:33.018 INFO:teuthology.orchestra.run.smithi039.stdout:systemctl: stdout enabled 2024-09-12T02:26:33.030 INFO:teuthology.orchestra.run.smithi039.stdout:systemctl: stdout active 2024-09-12T02:26:33.030 INFO:teuthology.orchestra.run.smithi039.stdout:Unit chronyd.service is enabled and running 2024-09-12T02:26:33.030 INFO:teuthology.orchestra.run.smithi039.stdout:Repeating the final host check... 2024-09-12T02:26:33.074 INFO:teuthology.orchestra.run.smithi039.stdout:/bin/podman: stdout 5.2.2 2024-09-12T02:26:33.074 INFO:teuthology.orchestra.run.smithi039.stdout:podman (/bin/podman) version 5.2.2 is present 2024-09-12T02:26:33.074 INFO:teuthology.orchestra.run.smithi039.stdout:systemctl is present 2024-09-12T02:26:33.075 INFO:teuthology.orchestra.run.smithi039.stdout:lvcreate is present 2024-09-12T02:26:33.087 INFO:teuthology.orchestra.run.smithi039.stdout:Non-zero exit code 1 from systemctl is-enabled chrony.service 2024-09-12T02:26:33.088 INFO:teuthology.orchestra.run.smithi039.stdout:systemctl: stderr Failed to get unit file state for chrony.service: No such file or directory 2024-09-12T02:26:33.099 INFO:teuthology.orchestra.run.smithi039.stdout:Non-zero exit code 3 from systemctl is-active chrony.service 2024-09-12T02:26:33.100 INFO:teuthology.orchestra.run.smithi039.stdout:systemctl: stdout inactive 2024-09-12T02:26:33.113 INFO:teuthology.orchestra.run.smithi039.stdout:systemctl: stdout enabled 2024-09-12T02:26:33.126 INFO:teuthology.orchestra.run.smithi039.stdout:systemctl: stdout active 2024-09-12T02:26:33.126 INFO:teuthology.orchestra.run.smithi039.stdout:Unit chronyd.service is enabled and running 2024-09-12T02:26:33.126 INFO:teuthology.orchestra.run.smithi039.stdout:Host looks OK 2024-09-12T02:26:33.126 INFO:teuthology.orchestra.run.smithi039.stdout:Cluster fsid: 4954ed46-70ae-11ef-bcea-c7b262605968 2024-09-12T02:26:33.126 INFO:teuthology.orchestra.run.smithi039.stdout:Acquiring lock 140393754195760 on /run/cephadm/4954ed46-70ae-11ef-bcea-c7b262605968.lock 2024-09-12T02:26:33.127 INFO:teuthology.orchestra.run.smithi039.stdout:Lock 140393754195760 acquired on /run/cephadm/4954ed46-70ae-11ef-bcea-c7b262605968.lock 2024-09-12T02:26:33.127 INFO:teuthology.orchestra.run.smithi039.stdout:Verifying IP 172.21.15.39 port 3300 ... 2024-09-12T02:26:33.127 INFO:teuthology.orchestra.run.smithi039.stdout:Verifying IP 172.21.15.39 port 6789 ... 2024-09-12T02:26:33.127 INFO:teuthology.orchestra.run.smithi039.stdout:Base mon IP(s) is [172.21.15.39:3300, 172.21.15.39:6789], mon addrv is [v2:172.21.15.39:3300,v1:172.21.15.39:6789] 2024-09-12T02:26:33.134 INFO:teuthology.orchestra.run.smithi039.stdout:/sbin/ip: stdout default via 172.21.15.254 dev ens1f0 proto dhcp src 172.21.15.39 metric 100 2024-09-12T02:26:33.134 INFO:teuthology.orchestra.run.smithi039.stdout:/sbin/ip: stdout 172.21.0.0/20 dev ens1f0 proto kernel scope link src 172.21.15.39 metric 100 2024-09-12T02:26:33.140 INFO:teuthology.orchestra.run.smithi039.stdout:/sbin/ip: stdout ::1 dev lo proto kernel metric 256 pref medium 2024-09-12T02:26:33.140 INFO:teuthology.orchestra.run.smithi039.stdout:/sbin/ip: stdout fe80::/64 dev ens1f0 proto kernel metric 256 pref medium 2024-09-12T02:26:33.140 INFO:teuthology.orchestra.run.smithi039.stdout:/sbin/ip: stdout default via fe80::327c:5e00:6487:71e0 dev ens1f0 proto ra metric 1024 expires 1795sec hoplimit 64 pref medium 2024-09-12T02:26:33.146 INFO:teuthology.orchestra.run.smithi039.stdout:/sbin/ip: stdout 1: lo: mtu 65536 state UNKNOWN qlen 1000 2024-09-12T02:26:33.146 INFO:teuthology.orchestra.run.smithi039.stdout:/sbin/ip: stdout inet6 ::1/128 scope host 2024-09-12T02:26:33.146 INFO:teuthology.orchestra.run.smithi039.stdout:/sbin/ip: stdout valid_lft forever preferred_lft forever 2024-09-12T02:26:33.146 INFO:teuthology.orchestra.run.smithi039.stdout:/sbin/ip: stdout 4: ens1f0: mtu 1500 state UP qlen 1000 2024-09-12T02:26:33.146 INFO:teuthology.orchestra.run.smithi039.stdout:/sbin/ip: stdout inet6 fe80::ec4:7aff:febd:1370/64 scope link 2024-09-12T02:26:33.146 INFO:teuthology.orchestra.run.smithi039.stdout:/sbin/ip: stdout valid_lft forever preferred_lft forever 2024-09-12T02:26:33.147 INFO:teuthology.orchestra.run.smithi039.stdout:Mon IP `172.21.15.39` is in CIDR network `172.21.0.0/20` 2024-09-12T02:26:33.147 INFO:teuthology.orchestra.run.smithi039.stdout:Mon IP `172.21.15.39` is in CIDR network `172.21.0.0/20` 2024-09-12T02:26:33.147 INFO:teuthology.orchestra.run.smithi039.stdout:Inferred mon public CIDR from local network configuration ['172.21.0.0/20', '172.21.0.0/20'] 2024-09-12T02:26:33.148 INFO:teuthology.orchestra.run.smithi039.stdout:Internal network (--cluster-network) has not been provided, OSD replication will default to the public_network 2024-09-12T02:26:33.149 INFO:teuthology.orchestra.run.smithi039.stdout:Pulling container image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc... 2024-09-12T02:26:33.684 INFO:teuthology.orchestra.run.smithi039.stdout:/bin/podman: stdout 54467abc55f864c4f73dfaf9c6ac3bb3e87b773123d5badaf790bee57321d594 2024-09-12T02:26:33.684 INFO:teuthology.orchestra.run.smithi039.stdout:/bin/podman: stderr Trying to pull quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc... 2024-09-12T02:26:33.684 INFO:teuthology.orchestra.run.smithi039.stdout:/bin/podman: stderr Getting image source signatures 2024-09-12T02:26:33.684 INFO:teuthology.orchestra.run.smithi039.stdout:/bin/podman: stderr Copying blob sha256:60180723200353b4e13b39fd162aecaf1bc097c859c7c6537324229e97c78567 2024-09-12T02:26:33.684 INFO:teuthology.orchestra.run.smithi039.stdout:/bin/podman: stderr Copying blob sha256:e8b54c863393b7a8216a71737771b73b16a8e43ec7acf927c7faa175c255e551 2024-09-12T02:26:33.684 INFO:teuthology.orchestra.run.smithi039.stdout:/bin/podman: stderr Copying config sha256:54467abc55f864c4f73dfaf9c6ac3bb3e87b773123d5badaf790bee57321d594 2024-09-12T02:26:33.684 INFO:teuthology.orchestra.run.smithi039.stdout:/bin/podman: stderr Writing manifest to image destination 2024-09-12T02:26:34.746 INFO:teuthology.orchestra.run.smithi039.stdout:ceph: stdout ceph version 19.1.1-298-gb53b6d3e (b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc) squid (stable) 2024-09-12T02:26:34.746 INFO:teuthology.orchestra.run.smithi039.stdout:Ceph version: ceph version 19.1.1-298-gb53b6d3e (b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc) squid (stable) 2024-09-12T02:26:34.746 INFO:teuthology.orchestra.run.smithi039.stdout:Extracting ceph user uid/gid from container image... 2024-09-12T02:26:35.786 INFO:teuthology.orchestra.run.smithi039.stdout:stat: stdout 167 167 2024-09-12T02:26:35.786 INFO:teuthology.orchestra.run.smithi039.stdout:Creating initial keys... 2024-09-12T02:26:36.926 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph-authtool: stdout AQBcUeJmVQ2LCRAALxbpnZ4wG9jdTnaxoFza5w== 2024-09-12T02:26:37.973 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph-authtool: stdout AQBdUeJmq1tREhAAF6RDrdjHEjtBfs0iWi8Ndg== 2024-09-12T02:26:38.953 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph-authtool: stdout AQBeUeJmzFgxEhAApmDTlhNd51PPi7koYi+BRQ== 2024-09-12T02:26:38.954 INFO:teuthology.orchestra.run.smithi039.stdout:Creating initial monmap... 2024-09-12T02:26:40.087 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/monmaptool: stdout /usr/bin/monmaptool: monmap file /tmp/monmap 2024-09-12T02:26:40.088 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/monmaptool: stdout setting min_mon_release = quincy 2024-09-12T02:26:40.088 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/monmaptool: stdout /usr/bin/monmaptool: set fsid to 4954ed46-70ae-11ef-bcea-c7b262605968 2024-09-12T02:26:40.088 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/monmaptool: stdout /usr/bin/monmaptool: writing epoch 0 to /tmp/monmap (1 monitors) 2024-09-12T02:26:40.088 INFO:teuthology.orchestra.run.smithi039.stdout:monmaptool for a [v2:172.21.15.39:3300,v1:172.21.15.39:6789] on /usr/bin/monmaptool: monmap file /tmp/monmap 2024-09-12T02:26:40.088 INFO:teuthology.orchestra.run.smithi039.stdout:setting min_mon_release = quincy 2024-09-12T02:26:40.088 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/monmaptool: set fsid to 4954ed46-70ae-11ef-bcea-c7b262605968 2024-09-12T02:26:40.088 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/monmaptool: writing epoch 0 to /tmp/monmap (1 monitors) 2024-09-12T02:26:40.088 INFO:teuthology.orchestra.run.smithi039.stdout: 2024-09-12T02:26:40.089 INFO:teuthology.orchestra.run.smithi039.stdout:Creating mon... 2024-09-12T02:26:41.058 INFO:teuthology.orchestra.run.smithi039.stdout:create mon.a on 2024-09-12T02:26:41.354 INFO:teuthology.orchestra.run.smithi039.stdout:systemctl: stderr Removed "/etc/systemd/system/multi-user.target.wants/ceph.target". 2024-09-12T02:26:41.579 INFO:teuthology.orchestra.run.smithi039.stdout:systemctl: stderr Created symlink /etc/systemd/system/multi-user.target.wants/ceph.target → /etc/systemd/system/ceph.target. 2024-09-12T02:26:41.832 INFO:teuthology.orchestra.run.smithi039.stdout:systemctl: stderr Created symlink /etc/systemd/system/multi-user.target.wants/ceph-4954ed46-70ae-11ef-bcea-c7b262605968.target → /etc/systemd/system/ceph-4954ed46-70ae-11ef-bcea-c7b262605968.target. 2024-09-12T02:26:41.833 INFO:teuthology.orchestra.run.smithi039.stdout:systemctl: stderr Created symlink /etc/systemd/system/ceph.target.wants/ceph-4954ed46-70ae-11ef-bcea-c7b262605968.target → /etc/systemd/system/ceph-4954ed46-70ae-11ef-bcea-c7b262605968.target. 2024-09-12T02:26:42.167 INFO:teuthology.orchestra.run.smithi039.stdout:Non-zero exit code 1 from systemctl reset-failed ceph-4954ed46-70ae-11ef-bcea-c7b262605968@mon.a 2024-09-12T02:26:42.168 INFO:teuthology.orchestra.run.smithi039.stdout:systemctl: stderr Failed to reset failed state of unit ceph-4954ed46-70ae-11ef-bcea-c7b262605968@mon.a.service: Unit ceph-4954ed46-70ae-11ef-bcea-c7b262605968@mon.a.service not loaded. 2024-09-12T02:26:42.451 INFO:teuthology.orchestra.run.smithi039.stdout:systemctl: stderr Created symlink /etc/systemd/system/ceph-4954ed46-70ae-11ef-bcea-c7b262605968.target.wants/ceph-4954ed46-70ae-11ef-bcea-c7b262605968@mon.a.service → /etc/systemd/system/ceph-4954ed46-70ae-11ef-bcea-c7b262605968@.service. 2024-09-12T02:26:43.095 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 02:26:43 smithi039 podman[30140]: 2024-09-12 02:26:43.02257037 +0000 UTC m=+0.347769368 container start 08b5d6c9fcf34ff8b908e6d37259924bbd7b3d6e871bb2c27cff1f0c35852ce1 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc, name=ceph-4954ed46-70ae-11ef-bcea-c7b262605968-mon-a, org.label-schema.name=CentOS Stream 9 Base Image, GIT_CLEAN=True, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, maintainer=Guillaume Abrioux , org.label-schema.license=GPLv2, org.label-schema.schema-version=1.0, io.buildah.version=1.37.2, GIT_BRANCH=HEAD, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.vendor=CentOS, RELEASE=squid-b53b6d3, CEPH_POINT_RELEASE=, ceph=True, org.label-schema.build-date=20240731) 2024-09-12T02:26:43.095 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 02:26:43 smithi039 ceph-mon[30158]: mkfs 4954ed46-70ae-11ef-bcea-c7b262605968 2024-09-12T02:26:43.167 INFO:teuthology.orchestra.run.smithi039.stdout:Non-zero exit code 1 from systemctl is-enabled firewalld.service 2024-09-12T02:26:43.168 INFO:teuthology.orchestra.run.smithi039.stdout:systemctl: stdout disabled 2024-09-12T02:26:43.181 INFO:teuthology.orchestra.run.smithi039.stdout:Non-zero exit code 3 from systemctl is-active firewalld.service 2024-09-12T02:26:43.181 INFO:teuthology.orchestra.run.smithi039.stdout:systemctl: stdout inactive 2024-09-12T02:26:43.181 INFO:teuthology.orchestra.run.smithi039.stdout:firewalld.service is not enabled 2024-09-12T02:26:43.181 INFO:teuthology.orchestra.run.smithi039.stdout:Not possible to enable service . firewalld.service is not available 2024-09-12T02:26:43.182 INFO:teuthology.orchestra.run.smithi039.stdout:Waiting for mon to start... 2024-09-12T02:26:43.182 INFO:teuthology.orchestra.run.smithi039.stdout:Waiting for mon... 2024-09-12T02:26:43.350 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 02:26:43 smithi039 ceph-mon[30158]: mon.a is new leader, mons a in quorum (ranks 0) 2024-09-12T02:26:43.350 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 02:26:43 smithi039 bash[30140]: 08b5d6c9fcf34ff8b908e6d37259924bbd7b3d6e871bb2c27cff1f0c35852ce1 2024-09-12T02:26:43.350 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 02:26:43 smithi039 systemd[1]: Started Ceph mon.a for 4954ed46-70ae-11ef-bcea-c7b262605968. 2024-09-12T02:26:44.298 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 02:26:44 smithi039 ceph-mon[30158]: mon.a is new leader, mons a in quorum (ranks 0) 2024-09-12T02:26:44.298 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 02:26:44 smithi039 ceph-mon[30158]: monmap epoch 1 2024-09-12T02:26:44.298 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 02:26:44 smithi039 ceph-mon[30158]: fsid 4954ed46-70ae-11ef-bcea-c7b262605968 2024-09-12T02:26:44.298 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 02:26:44 smithi039 ceph-mon[30158]: last_changed 2024-09-12T02:26:39.333323+0000 2024-09-12T02:26:44.298 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 02:26:44 smithi039 ceph-mon[30158]: created 2024-09-12T02:26:39.333323+0000 2024-09-12T02:26:44.298 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 02:26:44 smithi039 ceph-mon[30158]: min_mon_release 19 (squid) 2024-09-12T02:26:44.298 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 02:26:44 smithi039 ceph-mon[30158]: election_strategy: 1 2024-09-12T02:26:44.299 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 02:26:44 smithi039 ceph-mon[30158]: 0: [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] mon.a 2024-09-12T02:26:44.299 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 02:26:44 smithi039 ceph-mon[30158]: fsmap 2024-09-12T02:26:44.299 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 02:26:44 smithi039 ceph-mon[30158]: osdmap e1: 0 total, 0 up, 0 in 2024-09-12T02:26:44.299 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 02:26:44 smithi039 ceph-mon[30158]: mgrmap e1: no daemons active 2024-09-12T02:26:44.299 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 02:26:44 smithi039 ceph-mon[30158]: from='client.? 172.21.15.39:0/986441058' entity='client.admin' cmd=[{"prefix": "status"}]: dispatch 2024-09-12T02:26:44.312 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stdout cluster: 2024-09-12T02:26:44.312 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stdout id: 4954ed46-70ae-11ef-bcea-c7b262605968 2024-09-12T02:26:44.312 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stdout health: HEALTH_OK 2024-09-12T02:26:44.312 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stdout 2024-09-12T02:26:44.312 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stdout services: 2024-09-12T02:26:44.312 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stdout mon: 1 daemons, quorum a (age 0.646071s) 2024-09-12T02:26:44.312 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stdout mgr: no daemons active 2024-09-12T02:26:44.312 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stdout osd: 0 osds: 0 up, 0 in 2024-09-12T02:26:44.312 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stdout 2024-09-12T02:26:44.312 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stdout data: 2024-09-12T02:26:44.313 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stdout pools: 0 pools, 0 pgs 2024-09-12T02:26:44.313 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stdout objects: 0 objects, 0 B 2024-09-12T02:26:44.313 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stdout usage: 0 B used, 0 B / 0 B avail 2024-09-12T02:26:44.313 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stdout pgs: 2024-09-12T02:26:44.313 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stdout 2024-09-12T02:26:44.313 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stderr 2024-09-12T02:26:43.652+0000 7f1614a00640 1 Processor -- start 2024-09-12T02:26:44.313 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stderr 2024-09-12T02:26:43.652+0000 7f1614a00640 1 -- start start 2024-09-12T02:26:44.313 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stderr 2024-09-12T02:26:43.653+0000 7f1614a00640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f16101076a0 0x7f1610107aa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:26:44.313 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stderr 2024-09-12T02:26:43.653+0000 7f1614a00640 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 -- 0x7f1610108070 con 0x7f16101076a0 2024-09-12T02:26:44.313 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stderr 2024-09-12T02:26:43.653+0000 7f160de00640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f16101076a0 0x7f1610107aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:26:44.313 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stderr 2024-09-12T02:26:43.653+0000 7f160de00640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f16101076a0 0x7f1610107aa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.39:3300/0 says I am v2:172.21.15.39:37972/0 (socket says 172.21.15.39:37972) 2024-09-12T02:26:44.313 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stderr 2024-09-12T02:26:43.653+0000 7f160de00640 1 -- 172.21.15.39:0/2433371141 learned_addr learned my addr 172.21.15.39:0/2433371141 (peer_addr_for_me v2:172.21.15.39:0/0) 2024-09-12T02:26:44.313 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stderr 2024-09-12T02:26:43.654+0000 7f160de00640 1 -- 172.21.15.39:0/2433371141 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1610108850 con 0x7f16101076a0 2024-09-12T02:26:44.314 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stderr 2024-09-12T02:26:43.656+0000 7f160de00640 1 --2- 172.21.15.39:0/2433371141 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f16101076a0 0x7f1610107aa0 secure :-1 s=READY pgs=1 cs=0 l=1 rev1=1 crypto rx=0x7f1600009820 tx=0x7f160002a270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d91414cd0676596a server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:26:44.314 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stderr 2024-09-12T02:26:43.657+0000 7f160d400640 1 -- 172.21.15.39:0/2433371141 <== mon.0 v2:172.21.15.39:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f1600037070 con 0x7f16101076a0 2024-09-12T02:26:44.314 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stderr 2024-09-12T02:26:43.657+0000 7f160d400640 1 -- 172.21.15.39:0/2433371141 <== mon.0 v2:172.21.15.39:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f1600032440 con 0x7f16101076a0 2024-09-12T02:26:44.314 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stderr 2024-09-12T02:26:43.657+0000 7f160d400640 1 -- 172.21.15.39:0/2433371141 <== mon.0 v2:172.21.15.39:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f1600032740 con 0x7f16101076a0 2024-09-12T02:26:44.314 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stderr 2024-09-12T02:26:43.657+0000 7f1614a00640 1 -- 172.21.15.39:0/2433371141 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f16101076a0 msgr2=0x7f1610107aa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:26:44.314 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stderr 2024-09-12T02:26:43.657+0000 7f1614a00640 1 --2- 172.21.15.39:0/2433371141 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f16101076a0 0x7f1610107aa0 secure :-1 s=READY pgs=1 cs=0 l=1 rev1=1 crypto rx=0x7f1600009820 tx=0x7f160002a270 comp rx=0 tx=0).stop 2024-09-12T02:26:44.314 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stderr 2024-09-12T02:26:43.657+0000 7f1614a00640 1 -- 172.21.15.39:0/2433371141 shutdown_connections 2024-09-12T02:26:44.314 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stderr 2024-09-12T02:26:43.657+0000 7f1614a00640 1 --2- 172.21.15.39:0/2433371141 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f16101076a0 0x7f1610107aa0 unknown :-1 s=CLOSED pgs=1 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:26:44.314 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stderr 2024-09-12T02:26:43.657+0000 7f1614a00640 1 -- 172.21.15.39:0/2433371141 >> 172.21.15.39:0/2433371141 conn(0x7f1610102e30 msgr2=0x7f1610105270 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:26:44.314 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stderr 2024-09-12T02:26:43.657+0000 7f1614a00640 1 -- 172.21.15.39:0/2433371141 shutdown_connections 2024-09-12T02:26:44.314 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stderr 2024-09-12T02:26:43.658+0000 7f1614a00640 1 -- 172.21.15.39:0/2433371141 wait complete. 2024-09-12T02:26:44.314 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stderr 2024-09-12T02:26:43.658+0000 7f1614a00640 1 Processor -- start 2024-09-12T02:26:44.314 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stderr 2024-09-12T02:26:43.659+0000 7f1614a00640 1 -- start start 2024-09-12T02:26:44.315 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stderr 2024-09-12T02:26:43.659+0000 7f1614a00640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f16101076a0 0x7f161019d060 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:26:44.315 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stderr 2024-09-12T02:26:43.659+0000 7f1614a00640 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 -- 0x7f1610108df0 con 0x7f16101076a0 2024-09-12T02:26:44.315 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stderr 2024-09-12T02:26:43.659+0000 7f160de00640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f16101076a0 0x7f161019d060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:26:44.315 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stderr 2024-09-12T02:26:43.659+0000 7f160de00640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f16101076a0 0x7f161019d060 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.39:3300/0 says I am v2:172.21.15.39:37986/0 (socket says 172.21.15.39:37986) 2024-09-12T02:26:44.315 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stderr 2024-09-12T02:26:43.659+0000 7f160de00640 1 -- 172.21.15.39:0/986441058 learned_addr learned my addr 172.21.15.39:0/986441058 (peer_addr_for_me v2:172.21.15.39:0/0) 2024-09-12T02:26:44.315 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stderr 2024-09-12T02:26:43.660+0000 7f160de00640 1 -- 172.21.15.39:0/986441058 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f161019d5a0 con 0x7f16101076a0 2024-09-12T02:26:44.315 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stderr 2024-09-12T02:26:43.660+0000 7f160de00640 1 --2- 172.21.15.39:0/986441058 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f16101076a0 0x7f161019d060 secure :-1 s=READY pgs=2 cs=0 l=1 rev1=1 crypto rx=0x7f16000090b0 tx=0x7f16000046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:26:44.315 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stderr 2024-09-12T02:26:43.660+0000 7f1606a00640 1 -- 172.21.15.39:0/986441058 <== mon.0 v2:172.21.15.39:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f1600041070 con 0x7f16101076a0 2024-09-12T02:26:44.315 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stderr 2024-09-12T02:26:43.660+0000 7f1606a00640 1 -- 172.21.15.39:0/986441058 <== mon.0 v2:172.21.15.39:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f160003c7a0 con 0x7f16101076a0 2024-09-12T02:26:44.315 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stderr 2024-09-12T02:26:43.660+0000 7f1606a00640 1 -- 172.21.15.39:0/986441058 <== mon.0 v2:172.21.15.39:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f1600037040 con 0x7f16101076a0 2024-09-12T02:26:44.315 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stderr 2024-09-12T02:26:43.660+0000 7f1614a00640 1 -- 172.21.15.39:0/986441058 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f161019d830 con 0x7f16101076a0 2024-09-12T02:26:44.315 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stderr 2024-09-12T02:26:43.660+0000 7f1614a00640 1 -- 172.21.15.39:0/986441058 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f16101a0520 con 0x7f16101076a0 2024-09-12T02:26:44.315 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stderr 2024-09-12T02:26:43.661+0000 7f1606a00640 1 -- 172.21.15.39:0/986441058 <== mon.0 v2:172.21.15.39:3300/0 4 ==== mgrmap(e 1) ==== 807+0+0 (secure 0 0 0) 0x7f1600044070 con 0x7f16101076a0 2024-09-12T02:26:44.316 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stderr 2024-09-12T02:26:43.661+0000 7f1606a00640 1 -- 172.21.15.39:0/986441058 <== mon.0 v2:172.21.15.39:3300/0 5 ==== osd_map(1..1 src has 1..1) ==== 725+0+0 (secure 0 0 0) 0x7f160003d3f0 con 0x7f16101076a0 2024-09-12T02:26:44.316 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stderr 2024-09-12T02:26:43.661+0000 7f1614a00640 1 -- 172.21.15.39:0/986441058 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f1610109440 con 0x7f16101076a0 2024-09-12T02:26:44.316 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stderr 2024-09-12T02:26:43.664+0000 7f1606a00640 1 -- 172.21.15.39:0/986441058 <== mon.0 v2:172.21.15.39:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+74432 (secure 0 0 0) 0x7f1600046450 con 0x7f16101076a0 2024-09-12T02:26:44.316 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stderr 2024-09-12T02:26:43.729+0000 7f1614a00640 1 -- 172.21.15.39:0/986441058 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_command({"prefix": "status"} v 0) -- 0x7f16101a0a70 con 0x7f16101076a0 2024-09-12T02:26:44.316 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stderr 2024-09-12T02:26:43.730+0000 7f1606a00640 1 -- 172.21.15.39:0/986441058 <== mon.0 v2:172.21.15.39:3300/0 7 ==== mon_command_ack([{"prefix": "status"}]=0 v0) ==== 54+0+317 (secure 0 0 0) 0x7f1600046630 con 0x7f16101076a0 2024-09-12T02:26:44.316 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stderr 2024-09-12T02:26:43.731+0000 7f1614a00640 1 -- 172.21.15.39:0/986441058 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f16101076a0 msgr2=0x7f161019d060 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:26:44.316 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stderr 2024-09-12T02:26:43.731+0000 7f1614a00640 1 --2- 172.21.15.39:0/986441058 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f16101076a0 0x7f161019d060 secure :-1 s=READY pgs=2 cs=0 l=1 rev1=1 crypto rx=0x7f16000090b0 tx=0x7f16000046c0 comp rx=0 tx=0).stop 2024-09-12T02:26:44.316 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stderr 2024-09-12T02:26:43.731+0000 7f1614a00640 1 -- 172.21.15.39:0/986441058 shutdown_connections 2024-09-12T02:26:44.316 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stderr 2024-09-12T02:26:43.731+0000 7f1614a00640 1 --2- 172.21.15.39:0/986441058 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f16101076a0 0x7f161019d060 unknown :-1 s=CLOSED pgs=2 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:26:44.316 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stderr 2024-09-12T02:26:43.731+0000 7f1614a00640 1 -- 172.21.15.39:0/986441058 >> 172.21.15.39:0/986441058 conn(0x7f1610102e30 msgr2=0x7f161007c8f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:26:44.316 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stderr 2024-09-12T02:26:43.731+0000 7f1614a00640 1 -- 172.21.15.39:0/986441058 shutdown_connections 2024-09-12T02:26:44.316 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stderr 2024-09-12T02:26:43.731+0000 7f1614a00640 1 -- 172.21.15.39:0/986441058 wait complete. 2024-09-12T02:26:44.316 INFO:teuthology.orchestra.run.smithi039.stdout:mon is available 2024-09-12T02:26:44.316 INFO:teuthology.orchestra.run.smithi039.stdout:Assimilating anything we can from ceph.conf... 2024-09-12T02:26:45.462 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 02:26:45 smithi039 ceph-mon[30158]: from='client.? 172.21.15.39:0/4120034209' entity='client.admin' cmd=[{"prefix": "config assimilate-conf"}]: dispatch 2024-09-12T02:26:45.463 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 02:26:45 smithi039 ceph-mon[30158]: from='client.? 172.21.15.39:0/4120034209' entity='client.admin' cmd='[{"prefix": "config assimilate-conf"}]': finished 2024-09-12T02:26:45.475 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stdout 2024-09-12T02:26:45.475 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stdout [global] 2024-09-12T02:26:45.475 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stdout fsid = 4954ed46-70ae-11ef-bcea-c7b262605968 2024-09-12T02:26:45.475 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stdout mon_host = [v2:172.21.15.39:3300,v1:172.21.15.39:6789] 2024-09-12T02:26:45.475 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stdout mon_osd_allow_pg_remap = true 2024-09-12T02:26:45.475 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stdout mon_osd_allow_primary_affinity = true 2024-09-12T02:26:45.475 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stdout mon_warn_on_no_sortbitwise = false 2024-09-12T02:26:45.475 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stdout osd_crush_chooseleaf_type = 0 2024-09-12T02:26:45.475 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stdout 2024-09-12T02:26:45.475 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stdout [mgr] 2024-09-12T02:26:45.476 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stdout mgr/telemetry/nag = false 2024-09-12T02:26:45.476 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stdout 2024-09-12T02:26:45.476 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stdout [osd] 2024-09-12T02:26:45.476 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stdout mon_osd_backfillfull_ratio = 0.85 2024-09-12T02:26:45.476 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stdout mon_osd_full_ratio = 0.9 2024-09-12T02:26:45.476 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stdout mon_osd_nearfull_ratio = 0.8 2024-09-12T02:26:45.476 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stdout osd_map_max_advance = 10 2024-09-12T02:26:45.476 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stdout osd_sloppy_crc = true 2024-09-12T02:26:45.476 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stderr 2024-09-12T02:26:44.807+0000 7f714aa00640 1 Processor -- start 2024-09-12T02:26:45.476 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stderr 2024-09-12T02:26:44.807+0000 7f714aa00640 1 -- start start 2024-09-12T02:26:45.476 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stderr 2024-09-12T02:26:44.808+0000 7f714aa00640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f7144105910 0x7f7144105d10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:26:45.476 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stderr 2024-09-12T02:26:44.808+0000 7f714aa00640 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 -- 0x7f7144106250 con 0x7f7144105910 2024-09-12T02:26:45.476 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stderr 2024-09-12T02:26:44.808+0000 7f7143e00640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f7144105910 0x7f7144105d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:26:45.477 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stderr 2024-09-12T02:26:44.809+0000 7f7143e00640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f7144105910 0x7f7144105d10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.39:3300/0 says I am v2:172.21.15.39:37988/0 (socket says 172.21.15.39:37988) 2024-09-12T02:26:45.477 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stderr 2024-09-12T02:26:44.809+0000 7f7143e00640 1 -- 172.21.15.39:0/1274944362 learned_addr learned my addr 172.21.15.39:0/1274944362 (peer_addr_for_me v2:172.21.15.39:0/0) 2024-09-12T02:26:45.477 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stderr 2024-09-12T02:26:44.809+0000 7f7143e00640 1 -- 172.21.15.39:0/1274944362 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f71441063d0 con 0x7f7144105910 2024-09-12T02:26:45.477 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stderr 2024-09-12T02:26:44.810+0000 7f7143e00640 1 --2- 172.21.15.39:0/1274944362 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f7144105910 0x7f7144105d10 secure :-1 s=READY pgs=3 cs=0 l=1 rev1=1 crypto rx=0x7f7134009820 tx=0x7f713402a270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5f33a23b70f2bff3 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:26:45.477 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stderr 2024-09-12T02:26:44.810+0000 7f7143400640 1 -- 172.21.15.39:0/1274944362 <== mon.0 v2:172.21.15.39:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f7134037070 con 0x7f7144105910 2024-09-12T02:26:45.477 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stderr 2024-09-12T02:26:44.810+0000 7f7143400640 1 -- 172.21.15.39:0/1274944362 <== mon.0 v2:172.21.15.39:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f7134032440 con 0x7f7144105910 2024-09-12T02:26:45.477 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stderr 2024-09-12T02:26:44.810+0000 7f7143400640 1 -- 172.21.15.39:0/1274944362 <== mon.0 v2:172.21.15.39:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f7134032740 con 0x7f7144105910 2024-09-12T02:26:45.477 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stderr 2024-09-12T02:26:44.811+0000 7f714aa00640 1 -- 172.21.15.39:0/1274944362 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f7144105910 msgr2=0x7f7144105d10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:26:45.477 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stderr 2024-09-12T02:26:44.811+0000 7f714aa00640 1 --2- 172.21.15.39:0/1274944362 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f7144105910 0x7f7144105d10 secure :-1 s=READY pgs=3 cs=0 l=1 rev1=1 crypto rx=0x7f7134009820 tx=0x7f713402a270 comp rx=0 tx=0).stop 2024-09-12T02:26:45.477 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stderr 2024-09-12T02:26:44.811+0000 7f714aa00640 1 -- 172.21.15.39:0/1274944362 shutdown_connections 2024-09-12T02:26:45.477 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stderr 2024-09-12T02:26:44.811+0000 7f714aa00640 1 --2- 172.21.15.39:0/1274944362 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f7144105910 0x7f7144105d10 unknown :-1 s=CLOSED pgs=3 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:26:45.477 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stderr 2024-09-12T02:26:44.811+0000 7f714aa00640 1 -- 172.21.15.39:0/1274944362 >> 172.21.15.39:0/1274944362 conn(0x7f71441014b0 msgr2=0x7f71441038f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:26:45.478 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stderr 2024-09-12T02:26:44.811+0000 7f714aa00640 1 -- 172.21.15.39:0/1274944362 shutdown_connections 2024-09-12T02:26:45.478 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stderr 2024-09-12T02:26:44.811+0000 7f714aa00640 1 -- 172.21.15.39:0/1274944362 wait complete. 2024-09-12T02:26:45.478 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stderr 2024-09-12T02:26:44.812+0000 7f714aa00640 1 Processor -- start 2024-09-12T02:26:45.478 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stderr 2024-09-12T02:26:44.812+0000 7f714aa00640 1 -- start start 2024-09-12T02:26:45.478 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stderr 2024-09-12T02:26:44.812+0000 7f714aa00640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f7144105910 0x7f71441a1440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:26:45.478 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stderr 2024-09-12T02:26:44.812+0000 7f714aa00640 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 -- 0x7f71441069e0 con 0x7f7144105910 2024-09-12T02:26:45.478 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stderr 2024-09-12T02:26:44.813+0000 7f7143e00640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f7144105910 0x7f71441a1440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:26:45.478 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stderr 2024-09-12T02:26:44.813+0000 7f7143e00640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f7144105910 0x7f71441a1440 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.39:3300/0 says I am v2:172.21.15.39:37994/0 (socket says 172.21.15.39:37994) 2024-09-12T02:26:45.478 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stderr 2024-09-12T02:26:44.813+0000 7f7143e00640 1 -- 172.21.15.39:0/4120034209 learned_addr learned my addr 172.21.15.39:0/4120034209 (peer_addr_for_me v2:172.21.15.39:0/0) 2024-09-12T02:26:45.478 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stderr 2024-09-12T02:26:44.813+0000 7f7143e00640 1 -- 172.21.15.39:0/4120034209 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f71441a1980 con 0x7f7144105910 2024-09-12T02:26:45.478 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stderr 2024-09-12T02:26:44.814+0000 7f7143e00640 1 --2- 172.21.15.39:0/4120034209 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f7144105910 0x7f71441a1440 secure :-1 s=READY pgs=4 cs=0 l=1 rev1=1 crypto rx=0x7f71340090b0 tx=0x7f71340046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:26:45.478 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stderr 2024-09-12T02:26:44.814+0000 7f7141600640 1 -- 172.21.15.39:0/4120034209 <== mon.0 v2:172.21.15.39:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f7134041070 con 0x7f7144105910 2024-09-12T02:26:45.478 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stderr 2024-09-12T02:26:44.814+0000 7f7141600640 1 -- 172.21.15.39:0/4120034209 <== mon.0 v2:172.21.15.39:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f713403c7a0 con 0x7f7144105910 2024-09-12T02:26:45.479 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stderr 2024-09-12T02:26:44.814+0000 7f714aa00640 1 -- 172.21.15.39:0/4120034209 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f71441a1c10 con 0x7f7144105910 2024-09-12T02:26:45.479 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stderr 2024-09-12T02:26:44.814+0000 7f7141600640 1 -- 172.21.15.39:0/4120034209 <== mon.0 v2:172.21.15.39:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f7134037040 con 0x7f7144105910 2024-09-12T02:26:45.479 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stderr 2024-09-12T02:26:44.814+0000 7f714aa00640 1 -- 172.21.15.39:0/4120034209 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f71441a4900 con 0x7f7144105910 2024-09-12T02:26:45.479 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stderr 2024-09-12T02:26:44.815+0000 7f714aa00640 1 -- 172.21.15.39:0/4120034209 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f7144105d90 con 0x7f7144105910 2024-09-12T02:26:45.479 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stderr 2024-09-12T02:26:44.815+0000 7f7141600640 1 -- 172.21.15.39:0/4120034209 <== mon.0 v2:172.21.15.39:3300/0 4 ==== mgrmap(e 1) ==== 807+0+0 (secure 0 0 0) 0x7f7134044070 con 0x7f7144105910 2024-09-12T02:26:45.479 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stderr 2024-09-12T02:26:44.815+0000 7f7141600640 1 -- 172.21.15.39:0/4120034209 <== mon.0 v2:172.21.15.39:3300/0 5 ==== osd_map(1..1 src has 1..1) ==== 725+0+0 (secure 0 0 0) 0x7f713403d3f0 con 0x7f7144105910 2024-09-12T02:26:45.479 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stderr 2024-09-12T02:26:44.818+0000 7f7141600640 1 -- 172.21.15.39:0/4120034209 <== mon.0 v2:172.21.15.39:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+74432 (secure 0 0 0) 0x7f7134046450 con 0x7f7144105910 2024-09-12T02:26:45.479 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stderr 2024-09-12T02:26:44.880+0000 7f714aa00640 1 -- 172.21.15.39:0/4120034209 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_command({"prefix": "config assimilate-conf"} v 0) -- 0x7f71441a20f0 con 0x7f7144105910 2024-09-12T02:26:45.479 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stderr 2024-09-12T02:26:44.889+0000 7f7141600640 1 -- 172.21.15.39:0/4120034209 <== mon.0 v2:172.21.15.39:3300/0 7 ==== mon_command_ack([{"prefix": "config assimilate-conf"}]=0 v2) ==== 70+0+429 (secure 0 0 0) 0x7f71441a20f0 con 0x7f7144105910 2024-09-12T02:26:45.479 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stderr 2024-09-12T02:26:44.889+0000 7f7141600640 1 -- 172.21.15.39:0/4120034209 <== mon.0 v2:172.21.15.39:3300/0 8 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7f7134032440 con 0x7f7144105910 2024-09-12T02:26:45.479 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stderr 2024-09-12T02:26:44.890+0000 7f714aa00640 1 -- 172.21.15.39:0/4120034209 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f7144105910 msgr2=0x7f71441a1440 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:26:45.479 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stderr 2024-09-12T02:26:44.890+0000 7f714aa00640 1 --2- 172.21.15.39:0/4120034209 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f7144105910 0x7f71441a1440 secure :-1 s=READY pgs=4 cs=0 l=1 rev1=1 crypto rx=0x7f71340090b0 tx=0x7f71340046c0 comp rx=0 tx=0).stop 2024-09-12T02:26:45.479 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stderr 2024-09-12T02:26:44.890+0000 7f714aa00640 1 -- 172.21.15.39:0/4120034209 shutdown_connections 2024-09-12T02:26:45.479 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stderr 2024-09-12T02:26:44.890+0000 7f714aa00640 1 --2- 172.21.15.39:0/4120034209 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f7144105910 0x7f71441a1440 unknown :-1 s=CLOSED pgs=4 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:26:45.480 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stderr 2024-09-12T02:26:44.890+0000 7f714aa00640 1 -- 172.21.15.39:0/4120034209 >> 172.21.15.39:0/4120034209 conn(0x7f71441014b0 msgr2=0x7f71441082b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:26:45.480 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stderr 2024-09-12T02:26:44.891+0000 7f714aa00640 1 -- 172.21.15.39:0/4120034209 shutdown_connections 2024-09-12T02:26:45.480 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stderr 2024-09-12T02:26:44.891+0000 7f714aa00640 1 -- 172.21.15.39:0/4120034209 wait complete. 2024-09-12T02:26:45.480 INFO:teuthology.orchestra.run.smithi039.stdout:Generating new minimal ceph.conf... 2024-09-12T02:26:46.308 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 02:26:46 smithi039 ceph-mon[30158]: from='client.? 172.21.15.39:0/2460794338' entity='client.admin' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-12T02:26:46.642 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stderr 2024-09-12T02:26:45.966+0000 7f5f52800640 1 Processor -- start 2024-09-12T02:26:46.646 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stderr 2024-09-12T02:26:45.966+0000 7f5f52800640 1 -- start start 2024-09-12T02:26:46.647 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stderr 2024-09-12T02:26:45.966+0000 7f5f52800640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f5f4c109880 0x7f5f4c109c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:26:46.647 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stderr 2024-09-12T02:26:45.966+0000 7f5f52800640 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 -- 0x7f5f4c10a250 con 0x7f5f4c109880 2024-09-12T02:26:46.647 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stderr 2024-09-12T02:26:45.967+0000 7f5f4b400640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f5f4c109880 0x7f5f4c109c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:26:46.647 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stderr 2024-09-12T02:26:45.967+0000 7f5f4b400640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f5f4c109880 0x7f5f4c109c80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.39:3300/0 says I am v2:172.21.15.39:38000/0 (socket says 172.21.15.39:38000) 2024-09-12T02:26:46.647 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stderr 2024-09-12T02:26:45.967+0000 7f5f4b400640 1 -- 172.21.15.39:0/1923459228 learned_addr learned my addr 172.21.15.39:0/1923459228 (peer_addr_for_me v2:172.21.15.39:0/0) 2024-09-12T02:26:46.647 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stderr 2024-09-12T02:26:45.967+0000 7f5f4b400640 1 -- 172.21.15.39:0/1923459228 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5f4c10aa80 con 0x7f5f4c109880 2024-09-12T02:26:46.647 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stderr 2024-09-12T02:26:45.968+0000 7f5f4b400640 1 --2- 172.21.15.39:0/1923459228 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f5f4c109880 0x7f5f4c109c80 secure :-1 s=READY pgs=5 cs=0 l=1 rev1=1 crypto rx=0x7f5f3c009820 tx=0x7f5f3c02a270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e0fda55354eefbe9 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:26:46.647 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stderr 2024-09-12T02:26:45.968+0000 7f5f4a000640 1 -- 172.21.15.39:0/1923459228 <== mon.0 v2:172.21.15.39:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f5f3c037070 con 0x7f5f4c109880 2024-09-12T02:26:46.647 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stderr 2024-09-12T02:26:45.968+0000 7f5f4a000640 1 -- 172.21.15.39:0/1923459228 <== mon.0 v2:172.21.15.39:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7f5f3c032900 con 0x7f5f4c109880 2024-09-12T02:26:46.647 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stderr 2024-09-12T02:26:45.968+0000 7f5f4a000640 1 -- 172.21.15.39:0/1923459228 <== mon.0 v2:172.21.15.39:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f5f3c030850 con 0x7f5f4c109880 2024-09-12T02:26:46.647 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stderr 2024-09-12T02:26:45.969+0000 7f5f52800640 1 -- 172.21.15.39:0/1923459228 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f5f4c109880 msgr2=0x7f5f4c109c80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:26:46.648 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stderr 2024-09-12T02:26:45.969+0000 7f5f52800640 1 --2- 172.21.15.39:0/1923459228 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f5f4c109880 0x7f5f4c109c80 secure :-1 s=READY pgs=5 cs=0 l=1 rev1=1 crypto rx=0x7f5f3c009820 tx=0x7f5f3c02a270 comp rx=0 tx=0).stop 2024-09-12T02:26:46.648 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stderr 2024-09-12T02:26:45.969+0000 7f5f52800640 1 -- 172.21.15.39:0/1923459228 shutdown_connections 2024-09-12T02:26:46.648 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stderr 2024-09-12T02:26:45.969+0000 7f5f52800640 1 --2- 172.21.15.39:0/1923459228 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f5f4c109880 0x7f5f4c109c80 unknown :-1 s=CLOSED pgs=5 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:26:46.648 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stderr 2024-09-12T02:26:45.969+0000 7f5f52800640 1 -- 172.21.15.39:0/1923459228 >> 172.21.15.39:0/1923459228 conn(0x7f5f4c07ce60 msgr2=0x7f5f4c07d270 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:26:46.648 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stderr 2024-09-12T02:26:45.969+0000 7f5f52800640 1 -- 172.21.15.39:0/1923459228 shutdown_connections 2024-09-12T02:26:46.648 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stderr 2024-09-12T02:26:45.969+0000 7f5f52800640 1 -- 172.21.15.39:0/1923459228 wait complete. 2024-09-12T02:26:46.648 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stderr 2024-09-12T02:26:45.970+0000 7f5f52800640 1 Processor -- start 2024-09-12T02:26:46.648 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stderr 2024-09-12T02:26:45.970+0000 7f5f52800640 1 -- start start 2024-09-12T02:26:46.648 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stderr 2024-09-12T02:26:45.970+0000 7f5f52800640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f5f4c109880 0x7f5f4c19d880 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:26:46.648 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stderr 2024-09-12T02:26:45.971+0000 7f5f52800640 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 -- 0x7f5f4c10de30 con 0x7f5f4c109880 2024-09-12T02:26:46.648 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stderr 2024-09-12T02:26:45.971+0000 7f5f4b400640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f5f4c109880 0x7f5f4c19d880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:26:46.648 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stderr 2024-09-12T02:26:45.971+0000 7f5f4b400640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f5f4c109880 0x7f5f4c19d880 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.39:3300/0 says I am v2:172.21.15.39:38010/0 (socket says 172.21.15.39:38010) 2024-09-12T02:26:46.648 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stderr 2024-09-12T02:26:45.971+0000 7f5f4b400640 1 -- 172.21.15.39:0/2460794338 learned_addr learned my addr 172.21.15.39:0/2460794338 (peer_addr_for_me v2:172.21.15.39:0/0) 2024-09-12T02:26:46.649 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stderr 2024-09-12T02:26:45.971+0000 7f5f4b400640 1 -- 172.21.15.39:0/2460794338 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5f4c19ddc0 con 0x7f5f4c109880 2024-09-12T02:26:46.649 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stderr 2024-09-12T02:26:45.971+0000 7f5f4b400640 1 --2- 172.21.15.39:0/2460794338 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f5f4c109880 0x7f5f4c19d880 secure :-1 s=READY pgs=6 cs=0 l=1 rev1=1 crypto rx=0x7f5f3c009940 tx=0x7f5f3c032ce0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:26:46.649 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stderr 2024-09-12T02:26:45.972+0000 7f5f43e00640 1 -- 172.21.15.39:0/2460794338 <== mon.0 v2:172.21.15.39:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f5f3c042070 con 0x7f5f4c109880 2024-09-12T02:26:46.649 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stderr 2024-09-12T02:26:45.972+0000 7f5f43e00640 1 -- 172.21.15.39:0/2460794338 <== mon.0 v2:172.21.15.39:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7f5f3c0308c0 con 0x7f5f4c109880 2024-09-12T02:26:46.649 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stderr 2024-09-12T02:26:45.972+0000 7f5f43e00640 1 -- 172.21.15.39:0/2460794338 <== mon.0 v2:172.21.15.39:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f5f3c037040 con 0x7f5f4c109880 2024-09-12T02:26:46.649 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stderr 2024-09-12T02:26:45.972+0000 7f5f52800640 1 -- 172.21.15.39:0/2460794338 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f5f4c19e050 con 0x7f5f4c109880 2024-09-12T02:26:46.649 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stderr 2024-09-12T02:26:45.972+0000 7f5f52800640 1 -- 172.21.15.39:0/2460794338 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f5f4c1a0d40 con 0x7f5f4c109880 2024-09-12T02:26:46.649 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stderr 2024-09-12T02:26:45.972+0000 7f5f43e00640 1 -- 172.21.15.39:0/2460794338 <== mon.0 v2:172.21.15.39:3300/0 4 ==== mgrmap(e 1) ==== 807+0+0 (secure 0 0 0) 0x7f5f3c045070 con 0x7f5f4c109880 2024-09-12T02:26:46.649 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stderr 2024-09-12T02:26:45.972+0000 7f5f43e00640 1 -- 172.21.15.39:0/2460794338 <== mon.0 v2:172.21.15.39:3300/0 5 ==== osd_map(1..1 src has 1..1) ==== 725+0+0 (secure 0 0 0) 0x7f5f3c047bc0 con 0x7f5f4c109880 2024-09-12T02:26:46.649 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stderr 2024-09-12T02:26:45.973+0000 7f5f52800640 1 -- 172.21.15.39:0/2460794338 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f5f4c10dfb0 con 0x7f5f4c109880 2024-09-12T02:26:46.649 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stderr 2024-09-12T02:26:45.976+0000 7f5f43e00640 1 -- 172.21.15.39:0/2460794338 <== mon.0 v2:172.21.15.39:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+74432 (secure 0 0 0) 0x7f5f3c0327b0 con 0x7f5f4c109880 2024-09-12T02:26:46.649 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stderr 2024-09-12T02:26:46.039+0000 7f5f52800640 1 -- 172.21.15.39:0/2460794338 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_command({"prefix": "config generate-minimal-conf"} v 0) -- 0x7f5f4c1a1220 con 0x7f5f4c109880 2024-09-12T02:26:46.650 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stderr 2024-09-12T02:26:46.040+0000 7f5f43e00640 1 -- 172.21.15.39:0/2460794338 <== mon.0 v2:172.21.15.39:3300/0 7 ==== mon_command_ack([{"prefix": "config generate-minimal-conf"}]=0 v2) ==== 76+0+175 (secure 0 0 0) 0x7f5f3c03c870 con 0x7f5f4c109880 2024-09-12T02:26:46.650 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stderr 2024-09-12T02:26:46.041+0000 7f5f52800640 1 -- 172.21.15.39:0/2460794338 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f5f4c109880 msgr2=0x7f5f4c19d880 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:26:46.650 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stderr 2024-09-12T02:26:46.041+0000 7f5f52800640 1 --2- 172.21.15.39:0/2460794338 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f5f4c109880 0x7f5f4c19d880 secure :-1 s=READY pgs=6 cs=0 l=1 rev1=1 crypto rx=0x7f5f3c009940 tx=0x7f5f3c032ce0 comp rx=0 tx=0).stop 2024-09-12T02:26:46.650 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stderr 2024-09-12T02:26:46.041+0000 7f5f52800640 1 -- 172.21.15.39:0/2460794338 shutdown_connections 2024-09-12T02:26:46.650 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stderr 2024-09-12T02:26:46.041+0000 7f5f52800640 1 --2- 172.21.15.39:0/2460794338 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f5f4c109880 0x7f5f4c19d880 unknown :-1 s=CLOSED pgs=6 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:26:46.650 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stderr 2024-09-12T02:26:46.041+0000 7f5f52800640 1 -- 172.21.15.39:0/2460794338 >> 172.21.15.39:0/2460794338 conn(0x7f5f4c07ce60 msgr2=0x7f5f4c106cd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:26:46.650 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stderr 2024-09-12T02:26:46.041+0000 7f5f52800640 1 -- 172.21.15.39:0/2460794338 shutdown_connections 2024-09-12T02:26:46.650 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stderr 2024-09-12T02:26:46.041+0000 7f5f52800640 1 -- 172.21.15.39:0/2460794338 wait complete. 2024-09-12T02:26:46.650 INFO:teuthology.orchestra.run.smithi039.stdout:Restarting the monitor... 2024-09-12T02:26:47.100 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 02:26:46 smithi039 systemd[1]: Stopping Ceph mon.a for 4954ed46-70ae-11ef-bcea-c7b262605968... 2024-09-12T02:26:51.100 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 02:26:50 smithi039 ceph-4954ed46-70ae-11ef-bcea-c7b262605968-mon-a[30154]: 2024-09-12T02:26:50.711+0000 7feb11400640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-mon -n mon.a -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false --default-mon-cluster-log-to-file=false --default-mon-cluster-log-to-journald=true --default-mon-cluster-log-to-stderr=false (PID: 1) UID: 0 2024-09-12T02:26:51.100 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 02:26:50 smithi039 ceph-4954ed46-70ae-11ef-bcea-c7b262605968-mon-a[30154]: 2024-09-12T02:26:50.711+0000 7feb11400640 -1 mon.a@0(leader) e1 *** Got Signal Terminated *** 2024-09-12T02:26:51.100 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 02:26:50 smithi039 podman[30397]: 2024-09-12 02:26:50.865862718 +0000 UTC m=+3.987041346 container died 08b5d6c9fcf34ff8b908e6d37259924bbd7b3d6e871bb2c27cff1f0c35852ce1 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc, name=ceph-4954ed46-70ae-11ef-bcea-c7b262605968-mon-a, org.label-schema.license=GPLv2, GIT_CLEAN=True, org.label-schema.vendor=CentOS, org.label-schema.schema-version=1.0, CEPH_POINT_RELEASE=, io.buildah.version=1.37.2, org.label-schema.name=CentOS Stream 9 Base Image, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, RELEASE=squid-b53b6d3, maintainer=Guillaume Abrioux , GIT_BRANCH=HEAD, ceph=True, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.build-date=20240731) 2024-09-12T02:26:56.050 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 02:26:55 smithi039 podman[30397]: 2024-09-12 02:26:55.882273392 +0000 UTC m=+9.003452023 container cleanup 08b5d6c9fcf34ff8b908e6d37259924bbd7b3d6e871bb2c27cff1f0c35852ce1 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc, name=ceph-4954ed46-70ae-11ef-bcea-c7b262605968-mon-a, CEPH_POINT_RELEASE=, org.label-schema.name=CentOS Stream 9 Base Image, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.schema-version=1.0, GIT_BRANCH=HEAD, GIT_CLEAN=True, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.build-date=20240731, org.label-schema.license=GPLv2, ceph=True, io.buildah.version=1.37.2, org.label-schema.vendor=CentOS, RELEASE=squid-b53b6d3, maintainer=Guillaume Abrioux ) 2024-09-12T02:26:56.050 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 02:26:55 smithi039 bash[30397]: ceph-4954ed46-70ae-11ef-bcea-c7b262605968-mon-a 2024-09-12T02:26:56.300 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 02:26:56 smithi039 podman[30408]: 2024-09-12 02:26:56.049974709 +0000 UTC m=+5.172250546 container remove 08b5d6c9fcf34ff8b908e6d37259924bbd7b3d6e871bb2c27cff1f0c35852ce1 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc, name=ceph-4954ed46-70ae-11ef-bcea-c7b262605968-mon-a, io.buildah.version=1.37.2, org.label-schema.schema-version=1.0, maintainer=Guillaume Abrioux , CEPH_POINT_RELEASE=, org.label-schema.license=GPLv2, org.label-schema.name=CentOS Stream 9 Base Image, GIT_CLEAN=True, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.build-date=20240731, ceph=True, org.label-schema.vendor=CentOS, RELEASE=squid-b53b6d3, GIT_BRANCH=HEAD) 2024-09-12T02:26:56.300 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 02:26:56 smithi039 systemd[1]: ceph-4954ed46-70ae-11ef-bcea-c7b262605968@mon.a.service: Deactivated successfully. 2024-09-12T02:26:56.300 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 02:26:56 smithi039 systemd[1]: Stopped Ceph mon.a for 4954ed46-70ae-11ef-bcea-c7b262605968. 2024-09-12T02:26:56.301 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 02:26:56 smithi039 systemd[1]: ceph-4954ed46-70ae-11ef-bcea-c7b262605968@mon.a.service: Consumed 1.248s CPU time. 2024-09-12T02:26:56.599 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 02:26:56 smithi039 systemd[1]: Starting Ceph mon.a for 4954ed46-70ae-11ef-bcea-c7b262605968... 2024-09-12T02:26:56.878 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 02:26:56 smithi039 podman[30496]: 2024-09-12 02:26:56.617796447 +0000 UTC m=+0.117123446 container create aa6e01b76020ab1785ea97ec82bd174a8c7eaf3009a8decf95b4d521220b1f61 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc, name=ceph-4954ed46-70ae-11ef-bcea-c7b262605968-mon-a, org.label-schema.build-date=20240731, io.buildah.version=1.37.2, maintainer=Guillaume Abrioux , org.label-schema.license=GPLv2, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_CLEAN=True, CEPH_POINT_RELEASE=, RELEASE=squid-b53b6d3, org.label-schema.vendor=CentOS, ceph=True, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.schema-version=1.0, GIT_BRANCH=HEAD) 2024-09-12T02:26:56.878 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 02:26:56 smithi039 podman[30496]: 2024-09-12 02:26:56.527808477 +0000 UTC m=+0.027135454 image pull 54467abc55f864c4f73dfaf9c6ac3bb3e87b773123d5badaf790bee57321d594 quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc 2024-09-12T02:26:56.878 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 02:26:56 smithi039 podman[30496]: 2024-09-12 02:26:56.794964622 +0000 UTC m=+0.294291605 container init aa6e01b76020ab1785ea97ec82bd174a8c7eaf3009a8decf95b4d521220b1f61 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc, name=ceph-4954ed46-70ae-11ef-bcea-c7b262605968-mon-a, GIT_CLEAN=True, org.label-schema.build-date=20240731, CEPH_POINT_RELEASE=, org.label-schema.schema-version=1.0, maintainer=Guillaume Abrioux , GIT_BRANCH=HEAD, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, ceph=True, io.buildah.version=1.37.2, org.label-schema.name=CentOS Stream 9 Base Image, RELEASE=squid-b53b6d3, org.label-schema.license=GPLv2, org.label-schema.vendor=CentOS) 2024-09-12T02:26:56.879 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 02:26:56 smithi039 podman[30496]: 2024-09-12 02:26:56.801438916 +0000 UTC m=+0.300765875 container start aa6e01b76020ab1785ea97ec82bd174a8c7eaf3009a8decf95b4d521220b1f61 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc, name=ceph-4954ed46-70ae-11ef-bcea-c7b262605968-mon-a, org.label-schema.schema-version=1.0, RELEASE=squid-b53b6d3, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.vendor=CentOS, GIT_BRANCH=HEAD, io.buildah.version=1.37.2, org.label-schema.license=GPLv2, CEPH_POINT_RELEASE=, ceph=True, org.label-schema.build-date=20240731, maintainer=Guillaume Abrioux , GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_CLEAN=True, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7) 2024-09-12T02:26:56.879 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 02:26:56 smithi039 ceph-mon[30515]: set uid:gid to 167:167 (ceph:ceph) 2024-09-12T02:26:56.879 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 02:26:56 smithi039 ceph-mon[30515]: ceph version 19.1.1-298-gb53b6d3e (b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc) squid (stable), process ceph-mon, pid 2 2024-09-12T02:26:56.879 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 02:26:56 smithi039 ceph-mon[30515]: pidfile_write: ignore empty --pid-file 2024-09-12T02:26:56.879 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 02:26:56 smithi039 ceph-mon[30515]: load: jerasure load: lrc 2024-09-12T02:26:56.879 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 02:26:56 smithi039 ceph-mon[30515]: rocksdb: RocksDB version: 7.9.2 2024-09-12T02:26:56.879 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 02:26:56 smithi039 ceph-mon[30515]: rocksdb: Git sha 0 2024-09-12T02:26:56.879 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 02:26:56 smithi039 ceph-mon[30515]: rocksdb: Compile date 2024-09-09 16:23:28 2024-09-12T02:26:56.879 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 02:26:56 smithi039 ceph-mon[30515]: rocksdb: DB SUMMARY 2024-09-12T02:26:56.879 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 02:26:56 smithi039 ceph-mon[30515]: rocksdb: DB Session ID: H3S9KH73XZ0B9T895C6E 2024-09-12T02:26:56.879 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 02:26:56 smithi039 ceph-mon[30515]: rocksdb: CURRENT file: CURRENT 2024-09-12T02:26:56.879 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 02:26:56 smithi039 ceph-mon[30515]: rocksdb: IDENTITY file: IDENTITY 2024-09-12T02:26:56.879 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 02:26:56 smithi039 ceph-mon[30515]: rocksdb: MANIFEST file: MANIFEST-000010 size: 179 Bytes 2024-09-12T02:26:56.879 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 02:26:56 smithi039 ceph-mon[30515]: rocksdb: SST files in /var/lib/ceph/mon/ceph-a/store.db dir, Total Num: 1, files: 000008.sst 2024-09-12T02:26:56.880 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 02:26:56 smithi039 ceph-mon[30515]: rocksdb: Write Ahead Log file in /var/lib/ceph/mon/ceph-a/store.db: 000009.log size: 105832 ; 2024-09-12T02:26:56.880 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 02:26:56 smithi039 ceph-mon[30515]: rocksdb: Options.error_if_exists: 0 2024-09-12T02:26:56.880 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 02:26:56 smithi039 ceph-mon[30515]: rocksdb: Options.create_if_missing: 0 2024-09-12T02:26:56.880 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 02:26:56 smithi039 ceph-mon[30515]: rocksdb: Options.paranoid_checks: 1 2024-09-12T02:26:56.880 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 02:26:56 smithi039 ceph-mon[30515]: rocksdb: Options.flush_verify_memtable_count: 1 2024-09-12T02:26:56.881 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 02:26:56 smithi039 ceph-mon[30515]: rocksdb: Options.track_and_verify_wals_in_manifest: 0 2024-09-12T02:26:56.881 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 02:26:56 smithi039 ceph-mon[30515]: rocksdb: Options.verify_sst_unique_id_in_manifest: 1 2024-09-12T02:26:56.881 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 02:26:56 smithi039 ceph-mon[30515]: rocksdb: Options.env: 0x55d4ea3f3940 2024-09-12T02:26:56.881 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 02:26:56 smithi039 ceph-mon[30515]: rocksdb: Options.fs: PosixFileSystem 2024-09-12T02:26:56.881 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 02:26:56 smithi039 ceph-mon[30515]: rocksdb: Options.info_log: 0x55d50d9356a0 2024-09-12T02:26:56.881 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 02:26:56 smithi039 ceph-mon[30515]: rocksdb: Options.max_file_opening_threads: 16 2024-09-12T02:26:56.881 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 02:26:56 smithi039 ceph-mon[30515]: rocksdb: Options.statistics: (nil) 2024-09-12T02:26:56.881 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 02:26:56 smithi039 ceph-mon[30515]: rocksdb: Options.use_fsync: 0 2024-09-12T02:26:56.881 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 02:26:56 smithi039 ceph-mon[30515]: rocksdb: Options.max_log_file_size: 0 2024-09-12T02:26:56.881 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 02:26:56 smithi039 ceph-mon[30515]: rocksdb: Options.max_manifest_file_size: 1073741824 2024-09-12T02:26:56.881 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 02:26:56 smithi039 ceph-mon[30515]: rocksdb: Options.log_file_time_to_roll: 0 2024-09-12T02:26:56.881 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 02:26:56 smithi039 ceph-mon[30515]: rocksdb: Options.keep_log_file_num: 1000 2024-09-12T02:26:56.881 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 02:26:56 smithi039 ceph-mon[30515]: rocksdb: Options.recycle_log_file_num: 0 2024-09-12T02:26:56.882 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 02:26:56 smithi039 ceph-mon[30515]: rocksdb: Options.allow_fallocate: 1 2024-09-12T02:26:56.882 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 02:26:56 smithi039 ceph-mon[30515]: rocksdb: Options.allow_mmap_reads: 0 2024-09-12T02:26:56.882 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 02:26:56 smithi039 ceph-mon[30515]: rocksdb: Options.allow_mmap_writes: 0 2024-09-12T02:26:56.882 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 02:26:56 smithi039 ceph-mon[30515]: rocksdb: Options.use_direct_reads: 0 2024-09-12T02:26:56.882 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 02:26:56 smithi039 ceph-mon[30515]: rocksdb: Options.use_direct_io_for_flush_and_compaction: 0 2024-09-12T02:26:56.882 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 02:26:56 smithi039 ceph-mon[30515]: rocksdb: Options.create_missing_column_families: 0 2024-09-12T02:26:56.882 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 02:26:56 smithi039 ceph-mon[30515]: rocksdb: Options.db_log_dir: 2024-09-12T02:26:56.882 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 02:26:56 smithi039 ceph-mon[30515]: rocksdb: Options.wal_dir: 2024-09-12T02:26:56.882 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 02:26:56 smithi039 ceph-mon[30515]: rocksdb: Options.table_cache_numshardbits: 6 2024-09-12T02:26:56.882 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 02:26:56 smithi039 ceph-mon[30515]: rocksdb: Options.WAL_ttl_seconds: 0 2024-09-12T02:26:56.882 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 02:26:56 smithi039 ceph-mon[30515]: rocksdb: Options.WAL_size_limit_MB: 0 2024-09-12T02:26:56.882 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 02:26:56 smithi039 ceph-mon[30515]: rocksdb: Options.max_write_batch_group_size_bytes: 1048576 2024-09-12T02:26:56.882 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 02:26:56 smithi039 ceph-mon[30515]: rocksdb: Options.manifest_preallocation_size: 4194304 2024-09-12T02:26:56.883 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 02:26:56 smithi039 ceph-mon[30515]: rocksdb: Options.is_fd_close_on_exec: 1 2024-09-12T02:26:56.883 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 02:26:56 smithi039 ceph-mon[30515]: rocksdb: Options.advise_random_on_open: 1 2024-09-12T02:26:56.883 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 02:26:56 smithi039 ceph-mon[30515]: rocksdb: Options.db_write_buffer_size: 0 2024-09-12T02:26:56.883 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 02:26:56 smithi039 ceph-mon[30515]: rocksdb: Options.write_buffer_manager: 0x55d50d944dc0 2024-09-12T02:26:56.883 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 02:26:56 smithi039 ceph-mon[30515]: rocksdb: Options.access_hint_on_compaction_start: 1 2024-09-12T02:26:56.883 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 02:26:56 smithi039 ceph-mon[30515]: rocksdb: Options.random_access_max_buffer_size: 1048576 2024-09-12T02:26:56.883 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 02:26:56 smithi039 ceph-mon[30515]: rocksdb: Options.use_adaptive_mutex: 0 2024-09-12T02:26:56.883 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 02:26:56 smithi039 ceph-mon[30515]: rocksdb: Options.rate_limiter: (nil) 2024-09-12T02:26:56.883 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 02:26:56 smithi039 ceph-mon[30515]: rocksdb: Options.sst_file_manager.rate_bytes_per_sec: 0 2024-09-12T02:26:56.883 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 02:26:56 smithi039 ceph-mon[30515]: rocksdb: Options.wal_recovery_mode: 2 2024-09-12T02:26:56.883 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 02:26:56 smithi039 ceph-mon[30515]: rocksdb: Options.enable_thread_tracking: 0 2024-09-12T02:26:56.883 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 02:26:56 smithi039 ceph-mon[30515]: rocksdb: Options.enable_pipelined_write: 0 2024-09-12T02:26:56.884 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 02:26:56 smithi039 ceph-mon[30515]: rocksdb: Options.unordered_write: 0 2024-09-12T02:26:56.884 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 02:26:56 smithi039 ceph-mon[30515]: rocksdb: Options.allow_concurrent_memtable_write: 1 2024-09-12T02:26:56.884 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 02:26:56 smithi039 ceph-mon[30515]: rocksdb: Options.enable_write_thread_adaptive_yield: 1 2024-09-12T02:26:56.884 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 02:26:56 smithi039 ceph-mon[30515]: rocksdb: Options.write_thread_max_yield_usec: 100 2024-09-12T02:26:56.884 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 02:26:56 smithi039 ceph-mon[30515]: rocksdb: Options.write_thread_slow_yield_usec: 3 2024-09-12T02:26:56.884 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 02:26:56 smithi039 ceph-mon[30515]: rocksdb: Options.row_cache: None 2024-09-12T02:26:56.884 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 02:26:56 smithi039 ceph-mon[30515]: rocksdb: Options.wal_filter: None 2024-09-12T02:26:56.884 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 02:26:56 smithi039 ceph-mon[30515]: rocksdb: Options.avoid_flush_during_recovery: 0 2024-09-12T02:26:56.884 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 02:26:56 smithi039 ceph-mon[30515]: rocksdb: Options.allow_ingest_behind: 0 2024-09-12T02:26:56.884 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 02:26:56 smithi039 ceph-mon[30515]: rocksdb: Options.two_write_queues: 0 2024-09-12T02:26:56.884 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 02:26:56 smithi039 ceph-mon[30515]: rocksdb: Options.manual_wal_flush: 0 2024-09-12T02:26:56.884 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 02:26:56 smithi039 ceph-mon[30515]: rocksdb: Options.wal_compression: 0 2024-09-12T02:26:56.884 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 02:26:56 smithi039 ceph-mon[30515]: rocksdb: Options.atomic_flush: 0 2024-09-12T02:26:56.885 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 02:26:56 smithi039 ceph-mon[30515]: rocksdb: Options.avoid_unnecessary_blocking_io: 0 2024-09-12T02:26:56.885 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 02:26:56 smithi039 ceph-mon[30515]: rocksdb: Options.persist_stats_to_disk: 0 2024-09-12T02:26:56.885 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 02:26:56 smithi039 ceph-mon[30515]: rocksdb: Options.write_dbid_to_manifest: 0 2024-09-12T02:26:56.885 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 02:26:56 smithi039 ceph-mon[30515]: rocksdb: Options.log_readahead_size: 0 2024-09-12T02:26:56.885 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 02:26:56 smithi039 ceph-mon[30515]: rocksdb: Options.file_checksum_gen_factory: Unknown 2024-09-12T02:26:56.885 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 02:26:56 smithi039 ceph-mon[30515]: rocksdb: Options.best_efforts_recovery: 0 2024-09-12T02:26:56.885 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 02:26:56 smithi039 ceph-mon[30515]: rocksdb: Options.max_bgerror_resume_count: 2147483647 2024-09-12T02:26:56.885 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 02:26:56 smithi039 ceph-mon[30515]: rocksdb: Options.bgerror_resume_retry_interval: 1000000 2024-09-12T02:26:56.885 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 02:26:56 smithi039 ceph-mon[30515]: rocksdb: Options.allow_data_in_errors: 0 2024-09-12T02:26:56.885 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 02:26:56 smithi039 ceph-mon[30515]: rocksdb: Options.db_host_id: __hostname__ 2024-09-12T02:26:56.885 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 02:26:56 smithi039 ceph-mon[30515]: rocksdb: Options.enforce_single_del_contracts: true 2024-09-12T02:26:56.885 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 02:26:56 smithi039 ceph-mon[30515]: rocksdb: Options.max_background_jobs: 2 2024-09-12T02:26:56.885 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 02:26:56 smithi039 ceph-mon[30515]: rocksdb: Options.max_background_compactions: -1 2024-09-12T02:26:56.885 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 02:26:56 smithi039 ceph-mon[30515]: rocksdb: Options.max_subcompactions: 1 2024-09-12T02:26:56.886 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 02:26:56 smithi039 ceph-mon[30515]: rocksdb: Options.avoid_flush_during_shutdown: 0 2024-09-12T02:26:56.886 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 02:26:56 smithi039 ceph-mon[30515]: rocksdb: Options.writable_file_max_buffer_size: 1048576 2024-09-12T02:26:56.886 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 02:26:56 smithi039 ceph-mon[30515]: rocksdb: Options.delayed_write_rate : 16777216 2024-09-12T02:26:56.886 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 02:26:56 smithi039 ceph-mon[30515]: rocksdb: Options.max_total_wal_size: 0 2024-09-12T02:26:56.886 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 02:26:56 smithi039 ceph-mon[30515]: rocksdb: Options.delete_obsolete_files_period_micros: 21600000000 2024-09-12T02:26:56.886 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 02:26:56 smithi039 ceph-mon[30515]: rocksdb: Options.stats_dump_period_sec: 600 2024-09-12T02:26:56.886 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 02:26:56 smithi039 ceph-mon[30515]: rocksdb: Options.stats_persist_period_sec: 600 2024-09-12T02:26:56.886 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 02:26:56 smithi039 ceph-mon[30515]: rocksdb: Options.stats_history_buffer_size: 1048576 2024-09-12T02:26:56.886 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 02:26:56 smithi039 ceph-mon[30515]: rocksdb: Options.max_open_files: -1 2024-09-12T02:26:56.886 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 02:26:56 smithi039 ceph-mon[30515]: rocksdb: Options.bytes_per_sync: 0 2024-09-12T02:26:56.886 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 02:26:56 smithi039 ceph-mon[30515]: rocksdb: Options.wal_bytes_per_sync: 0 2024-09-12T02:26:56.886 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 02:26:56 smithi039 ceph-mon[30515]: rocksdb: Options.strict_bytes_per_sync: 0 2024-09-12T02:26:56.886 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 02:26:56 smithi039 ceph-mon[30515]: rocksdb: Options.compaction_readahead_size: 0 2024-09-12T02:26:56.887 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 02:26:56 smithi039 ceph-mon[30515]: rocksdb: Options.max_background_flushes: -1 2024-09-12T02:26:56.887 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 02:26:56 smithi039 ceph-mon[30515]: rocksdb: Compression algorithms supported: 2024-09-12T02:26:56.887 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 02:26:56 smithi039 ceph-mon[30515]: rocksdb: kZSTD supported: 0 2024-09-12T02:26:56.887 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 02:26:56 smithi039 ceph-mon[30515]: rocksdb: kXpressCompression supported: 0 2024-09-12T02:26:56.887 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 02:26:56 smithi039 ceph-mon[30515]: rocksdb: kBZip2Compression supported: 0 2024-09-12T02:26:56.887 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 02:26:56 smithi039 ceph-mon[30515]: rocksdb: kZSTDNotFinalCompression supported: 0 2024-09-12T02:26:56.887 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 02:26:56 smithi039 ceph-mon[30515]: rocksdb: kLZ4Compression supported: 1 2024-09-12T02:26:56.887 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 02:26:56 smithi039 ceph-mon[30515]: rocksdb: kZlibCompression supported: 1 2024-09-12T02:26:56.887 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 02:26:56 smithi039 ceph-mon[30515]: rocksdb: kLZ4HCCompression supported: 1 2024-09-12T02:26:56.887 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 02:26:56 smithi039 ceph-mon[30515]: rocksdb: kSnappyCompression supported: 1 2024-09-12T02:26:56.887 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 02:26:56 smithi039 ceph-mon[30515]: rocksdb: Fast CRC32 supported: Supported on x86 2024-09-12T02:26:56.887 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 02:26:56 smithi039 ceph-mon[30515]: rocksdb: DMutex implementation: pthread_mutex_t 2024-09-12T02:26:56.887 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 02:26:56 smithi039 ceph-mon[30515]: rocksdb: [db/version_set.cc:5527] Recovering from manifest file: /var/lib/ceph/mon/ceph-a/store.db/MANIFEST-000010 2024-09-12T02:26:56.887 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 02:26:56 smithi039 ceph-mon[30515]: rocksdb: [db/column_family.cc:630] --------------- Options for column family [default]: 2024-09-12T02:26:56.888 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 02:26:56 smithi039 ceph-mon[30515]: rocksdb: Options.comparator: leveldb.BytewiseComparator 2024-09-12T02:26:56.888 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 02:26:56 smithi039 ceph-mon[30515]: rocksdb: Options.merge_operator: 2024-09-12T02:26:56.888 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 02:26:56 smithi039 ceph-mon[30515]: rocksdb: Options.compaction_filter: None 2024-09-12T02:26:56.888 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 02:26:56 smithi039 ceph-mon[30515]: rocksdb: Options.compaction_filter_factory: None 2024-09-12T02:26:56.888 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 02:26:56 smithi039 ceph-mon[30515]: rocksdb: Options.sst_partitioner_factory: None 2024-09-12T02:26:56.888 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 02:26:56 smithi039 ceph-mon[30515]: rocksdb: Options.memtable_factory: SkipListFactory 2024-09-12T02:26:56.888 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 02:26:56 smithi039 ceph-mon[30515]: rocksdb: Options.table_factory: BlockBasedTable 2024-09-12T02:26:56.888 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 02:26:56 smithi039 ceph-mon[30515]: rocksdb: table_factory options: flush_block_policy_factory: FlushBlockBySizePolicyFactory (0x55d50d935300) 2024-09-12T02:26:56.888 INFO:journalctl@ceph.mon.a.smithi039.stdout: cache_index_and_filter_blocks: 1 2024-09-12T02:26:56.888 INFO:journalctl@ceph.mon.a.smithi039.stdout: cache_index_and_filter_blocks_with_high_priority: 0 2024-09-12T02:26:56.888 INFO:journalctl@ceph.mon.a.smithi039.stdout: pin_l0_filter_and_index_blocks_in_cache: 0 2024-09-12T02:26:56.888 INFO:journalctl@ceph.mon.a.smithi039.stdout: pin_top_level_index_and_filter: 1 2024-09-12T02:26:56.888 INFO:journalctl@ceph.mon.a.smithi039.stdout: index_type: 0 2024-09-12T02:26:56.889 INFO:journalctl@ceph.mon.a.smithi039.stdout: data_block_index_type: 0 2024-09-12T02:26:56.889 INFO:journalctl@ceph.mon.a.smithi039.stdout: index_shortening: 1 2024-09-12T02:26:56.889 INFO:journalctl@ceph.mon.a.smithi039.stdout: data_block_hash_table_util_ratio: 0.750000 2024-09-12T02:26:56.889 INFO:journalctl@ceph.mon.a.smithi039.stdout: checksum: 4 2024-09-12T02:26:56.889 INFO:journalctl@ceph.mon.a.smithi039.stdout: no_block_cache: 0 2024-09-12T02:26:56.889 INFO:journalctl@ceph.mon.a.smithi039.stdout: block_cache: 0x55d50d9291f0 2024-09-12T02:26:56.889 INFO:journalctl@ceph.mon.a.smithi039.stdout: block_cache_name: BinnedLRUCache 2024-09-12T02:26:56.889 INFO:journalctl@ceph.mon.a.smithi039.stdout: block_cache_options: 2024-09-12T02:26:56.889 INFO:journalctl@ceph.mon.a.smithi039.stdout: capacity : 536870912 2024-09-12T02:26:56.889 INFO:journalctl@ceph.mon.a.smithi039.stdout: num_shard_bits : 4 2024-09-12T02:26:56.889 INFO:journalctl@ceph.mon.a.smithi039.stdout: strict_capacity_limit : 0 2024-09-12T02:26:56.890 INFO:journalctl@ceph.mon.a.smithi039.stdout: high_pri_pool_ratio: 0.000 2024-09-12T02:26:56.890 INFO:journalctl@ceph.mon.a.smithi039.stdout: block_cache_compressed: (nil) 2024-09-12T02:26:56.890 INFO:journalctl@ceph.mon.a.smithi039.stdout: persistent_cache: (nil) 2024-09-12T02:26:56.890 INFO:journalctl@ceph.mon.a.smithi039.stdout: block_size: 4096 2024-09-12T02:26:56.890 INFO:journalctl@ceph.mon.a.smithi039.stdout: block_size_deviation: 10 2024-09-12T02:26:56.890 INFO:journalctl@ceph.mon.a.smithi039.stdout: block_restart_interval: 16 2024-09-12T02:26:56.890 INFO:journalctl@ceph.mon.a.smithi039.stdout: index_block_restart_interval: 1 2024-09-12T02:26:56.891 INFO:journalctl@ceph.mon.a.smithi039.stdout: metadata_block_size: 4096 2024-09-12T02:26:56.891 INFO:journalctl@ceph.mon.a.smithi039.stdout: partition_filters: 0 2024-09-12T02:26:56.891 INFO:journalctl@ceph.mon.a.smithi039.stdout: use_delta_encoding: 1 2024-09-12T02:26:56.891 INFO:journalctl@ceph.mon.a.smithi039.stdout: filter_policy: bloomfilter 2024-09-12T02:26:56.891 INFO:journalctl@ceph.mon.a.smithi039.stdout: whole_key_filtering: 1 2024-09-12T02:26:56.891 INFO:journalctl@ceph.mon.a.smithi039.stdout: verify_compression: 0 2024-09-12T02:26:56.891 INFO:journalctl@ceph.mon.a.smithi039.stdout: read_amp_bytes_per_bit: 0 2024-09-12T02:26:56.892 INFO:journalctl@ceph.mon.a.smithi039.stdout: format_version: 5 2024-09-12T02:26:56.892 INFO:journalctl@ceph.mon.a.smithi039.stdout: enable_index_compression: 1 2024-09-12T02:26:56.892 INFO:journalctl@ceph.mon.a.smithi039.stdout: block_align: 0 2024-09-12T02:26:56.892 INFO:journalctl@ceph.mon.a.smithi039.stdout: max_auto_readahead_size: 262144 2024-09-12T02:26:56.892 INFO:journalctl@ceph.mon.a.smithi039.stdout: prepopulate_block_cache: 0 2024-09-12T02:26:56.892 INFO:journalctl@ceph.mon.a.smithi039.stdout: initial_auto_readahead_size: 8192 2024-09-12T02:26:56.892 INFO:journalctl@ceph.mon.a.smithi039.stdout: num_file_reads_for_auto_readahead: 2 2024-09-12T02:26:56.892 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 02:26:56 smithi039 ceph-mon[30515]: rocksdb: Options.write_buffer_size: 33554432 2024-09-12T02:26:56.892 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 02:26:56 smithi039 ceph-mon[30515]: rocksdb: Options.max_write_buffer_number: 2 2024-09-12T02:26:56.892 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 02:26:56 smithi039 ceph-mon[30515]: rocksdb: Options.compression: NoCompression 2024-09-12T02:26:56.892 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 02:26:56 smithi039 ceph-mon[30515]: rocksdb: Options.bottommost_compression: Disabled 2024-09-12T02:26:56.892 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 02:26:56 smithi039 ceph-mon[30515]: rocksdb: Options.prefix_extractor: nullptr 2024-09-12T02:26:56.892 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 02:26:56 smithi039 ceph-mon[30515]: rocksdb: Options.memtable_insert_with_hint_prefix_extractor: nullptr 2024-09-12T02:26:56.892 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 02:26:56 smithi039 ceph-mon[30515]: rocksdb: Options.num_levels: 7 2024-09-12T02:26:56.893 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 02:26:56 smithi039 ceph-mon[30515]: rocksdb: Options.min_write_buffer_number_to_merge: 1 2024-09-12T02:26:56.893 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 02:26:56 smithi039 ceph-mon[30515]: rocksdb: Options.max_write_buffer_number_to_maintain: 0 2024-09-12T02:26:56.893 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 02:26:56 smithi039 ceph-mon[30515]: rocksdb: Options.max_write_buffer_size_to_maintain: 0 2024-09-12T02:26:56.893 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 02:26:56 smithi039 ceph-mon[30515]: rocksdb: Options.bottommost_compression_opts.window_bits: -14 2024-09-12T02:26:56.893 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 02:26:56 smithi039 ceph-mon[30515]: rocksdb: Options.bottommost_compression_opts.level: 32767 2024-09-12T02:26:56.893 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 02:26:56 smithi039 ceph-mon[30515]: rocksdb: Options.bottommost_compression_opts.strategy: 0 2024-09-12T02:26:56.893 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 02:26:56 smithi039 ceph-mon[30515]: rocksdb: Options.bottommost_compression_opts.max_dict_bytes: 0 2024-09-12T02:26:56.893 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 02:26:56 smithi039 ceph-mon[30515]: rocksdb: Options.bottommost_compression_opts.zstd_max_train_bytes: 0 2024-09-12T02:26:56.893 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 02:26:56 smithi039 ceph-mon[30515]: rocksdb: Options.bottommost_compression_opts.parallel_threads: 1 2024-09-12T02:26:56.893 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 02:26:56 smithi039 ceph-mon[30515]: rocksdb: Options.bottommost_compression_opts.enabled: false 2024-09-12T02:26:56.893 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 02:26:56 smithi039 ceph-mon[30515]: rocksdb: Options.bottommost_compression_opts.max_dict_buffer_bytes: 0 2024-09-12T02:26:56.893 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 02:26:56 smithi039 ceph-mon[30515]: rocksdb: Options.bottommost_compression_opts.use_zstd_dict_trainer: true 2024-09-12T02:26:56.893 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 02:26:56 smithi039 ceph-mon[30515]: rocksdb: Options.compression_opts.window_bits: -14 2024-09-12T02:26:56.894 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 02:26:56 smithi039 ceph-mon[30515]: rocksdb: Options.compression_opts.level: 32767 2024-09-12T02:26:56.894 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 02:26:56 smithi039 ceph-mon[30515]: rocksdb: Options.compression_opts.strategy: 0 2024-09-12T02:26:56.894 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 02:26:56 smithi039 ceph-mon[30515]: rocksdb: Options.compression_opts.max_dict_bytes: 0 2024-09-12T02:26:56.894 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 02:26:56 smithi039 ceph-mon[30515]: rocksdb: Options.compression_opts.zstd_max_train_bytes: 0 2024-09-12T02:26:56.894 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 02:26:56 smithi039 ceph-mon[30515]: rocksdb: Options.compression_opts.use_zstd_dict_trainer: true 2024-09-12T02:26:56.894 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 02:26:56 smithi039 ceph-mon[30515]: rocksdb: Options.compression_opts.parallel_threads: 1 2024-09-12T02:26:56.894 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 02:26:56 smithi039 ceph-mon[30515]: rocksdb: Options.compression_opts.enabled: false 2024-09-12T02:26:56.894 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 02:26:56 smithi039 ceph-mon[30515]: rocksdb: Options.compression_opts.max_dict_buffer_bytes: 0 2024-09-12T02:26:56.894 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 02:26:56 smithi039 ceph-mon[30515]: rocksdb: Options.level0_file_num_compaction_trigger: 4 2024-09-12T02:26:56.894 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 02:26:56 smithi039 ceph-mon[30515]: rocksdb: Options.level0_slowdown_writes_trigger: 20 2024-09-12T02:26:56.894 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 02:26:56 smithi039 ceph-mon[30515]: rocksdb: Options.level0_stop_writes_trigger: 36 2024-09-12T02:26:56.894 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 02:26:56 smithi039 ceph-mon[30515]: rocksdb: Options.target_file_size_base: 67108864 2024-09-12T02:26:56.894 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 02:26:56 smithi039 ceph-mon[30515]: rocksdb: Options.target_file_size_multiplier: 1 2024-09-12T02:26:56.894 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 02:26:56 smithi039 ceph-mon[30515]: rocksdb: Options.max_bytes_for_level_base: 268435456 2024-09-12T02:26:56.895 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 02:26:56 smithi039 ceph-mon[30515]: rocksdb: Options.level_compaction_dynamic_level_bytes: 1 2024-09-12T02:26:56.895 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 02:26:56 smithi039 ceph-mon[30515]: rocksdb: Options.max_bytes_for_level_multiplier: 10.000000 2024-09-12T02:26:56.895 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 02:26:56 smithi039 ceph-mon[30515]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[0]: 1 2024-09-12T02:26:56.895 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 02:26:56 smithi039 ceph-mon[30515]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[1]: 1 2024-09-12T02:26:56.895 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 02:26:56 smithi039 ceph-mon[30515]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[2]: 1 2024-09-12T02:26:56.895 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 02:26:56 smithi039 ceph-mon[30515]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[3]: 1 2024-09-12T02:26:56.895 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 02:26:56 smithi039 ceph-mon[30515]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[4]: 1 2024-09-12T02:26:56.895 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 02:26:56 smithi039 ceph-mon[30515]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[5]: 1 2024-09-12T02:26:56.895 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 02:26:56 smithi039 ceph-mon[30515]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[6]: 1 2024-09-12T02:26:56.895 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 02:26:56 smithi039 ceph-mon[30515]: rocksdb: Options.max_sequential_skip_in_iterations: 8 2024-09-12T02:26:56.895 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 02:26:56 smithi039 ceph-mon[30515]: rocksdb: Options.max_compaction_bytes: 1677721600 2024-09-12T02:26:56.895 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 02:26:56 smithi039 ceph-mon[30515]: rocksdb: Options.ignore_max_compaction_bytes_for_input: true 2024-09-12T02:26:56.895 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 02:26:56 smithi039 ceph-mon[30515]: rocksdb: Options.arena_block_size: 1048576 2024-09-12T02:26:56.895 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 02:26:56 smithi039 ceph-mon[30515]: rocksdb: Options.soft_pending_compaction_bytes_limit: 68719476736 2024-09-12T02:26:56.896 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 02:26:56 smithi039 ceph-mon[30515]: rocksdb: Options.hard_pending_compaction_bytes_limit: 274877906944 2024-09-12T02:26:56.896 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 02:26:56 smithi039 ceph-mon[30515]: rocksdb: Options.disable_auto_compactions: 0 2024-09-12T02:26:56.896 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 02:26:56 smithi039 ceph-mon[30515]: rocksdb: Options.compaction_style: kCompactionStyleLevel 2024-09-12T02:26:56.896 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 02:26:56 smithi039 ceph-mon[30515]: rocksdb: Options.compaction_pri: kMinOverlappingRatio 2024-09-12T02:26:56.896 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 02:26:56 smithi039 ceph-mon[30515]: rocksdb: Options.compaction_options_universal.size_ratio: 1 2024-09-12T02:26:56.896 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 02:26:56 smithi039 ceph-mon[30515]: rocksdb: Options.compaction_options_universal.min_merge_width: 2 2024-09-12T02:26:56.896 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 02:26:56 smithi039 ceph-mon[30515]: rocksdb: Options.compaction_options_universal.max_merge_width: 4294967295 2024-09-12T02:26:56.896 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 02:26:56 smithi039 ceph-mon[30515]: rocksdb: Options.compaction_options_universal.max_size_amplification_percent: 200 2024-09-12T02:26:56.896 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 02:26:56 smithi039 ceph-mon[30515]: rocksdb: Options.compaction_options_universal.compression_size_percent: -1 2024-09-12T02:26:56.896 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 02:26:56 smithi039 ceph-mon[30515]: rocksdb: Options.compaction_options_universal.stop_style: kCompactionStopStyleTotalSize 2024-09-12T02:26:56.896 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 02:26:56 smithi039 ceph-mon[30515]: rocksdb: Options.compaction_options_fifo.max_table_files_size: 1073741824 2024-09-12T02:26:56.896 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 02:26:56 smithi039 ceph-mon[30515]: rocksdb: Options.compaction_options_fifo.allow_compaction: 0 2024-09-12T02:26:56.896 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 02:26:56 smithi039 ceph-mon[30515]: rocksdb: Options.table_properties_collectors: CompactOnDeletionCollector (Sliding window size = 32768 Deletion trigger = 16384 Deletion ratio = 0); 2024-09-12T02:26:56.896 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 02:26:56 smithi039 ceph-mon[30515]: rocksdb: Options.inplace_update_support: 0 2024-09-12T02:26:56.897 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 02:26:56 smithi039 ceph-mon[30515]: rocksdb: Options.inplace_update_num_locks: 10000 2024-09-12T02:26:56.897 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 02:26:56 smithi039 ceph-mon[30515]: rocksdb: Options.memtable_prefix_bloom_size_ratio: 0.000000 2024-09-12T02:26:56.897 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 02:26:56 smithi039 ceph-mon[30515]: rocksdb: Options.memtable_whole_key_filtering: 0 2024-09-12T02:26:56.897 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 02:26:56 smithi039 ceph-mon[30515]: rocksdb: Options.memtable_huge_page_size: 0 2024-09-12T02:26:56.897 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 02:26:56 smithi039 ceph-mon[30515]: rocksdb: Options.bloom_locality: 0 2024-09-12T02:26:56.897 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 02:26:56 smithi039 ceph-mon[30515]: rocksdb: Options.max_successive_merges: 0 2024-09-12T02:26:56.897 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 02:26:56 smithi039 ceph-mon[30515]: rocksdb: Options.optimize_filters_for_hits: 0 2024-09-12T02:26:56.897 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 02:26:56 smithi039 ceph-mon[30515]: rocksdb: Options.paranoid_file_checks: 0 2024-09-12T02:26:56.897 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 02:26:56 smithi039 ceph-mon[30515]: rocksdb: Options.force_consistency_checks: 1 2024-09-12T02:26:56.897 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 02:26:56 smithi039 ceph-mon[30515]: rocksdb: Options.report_bg_io_stats: 0 2024-09-12T02:26:56.897 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 02:26:56 smithi039 ceph-mon[30515]: rocksdb: Options.ttl: 2592000 2024-09-12T02:26:56.897 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 02:26:56 smithi039 ceph-mon[30515]: rocksdb: Options.periodic_compaction_seconds: 0 2024-09-12T02:26:56.897 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 02:26:56 smithi039 ceph-mon[30515]: rocksdb: Options.preclude_last_level_data_seconds: 0 2024-09-12T02:26:56.898 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 02:26:56 smithi039 ceph-mon[30515]: rocksdb: Options.preserve_internal_time_seconds: 0 2024-09-12T02:26:56.898 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 02:26:56 smithi039 ceph-mon[30515]: rocksdb: Options.enable_blob_files: false 2024-09-12T02:26:56.898 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 02:26:56 smithi039 ceph-mon[30515]: rocksdb: Options.min_blob_size: 0 2024-09-12T02:26:56.898 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 02:26:56 smithi039 ceph-mon[30515]: rocksdb: Options.blob_file_size: 268435456 2024-09-12T02:26:56.898 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 02:26:56 smithi039 ceph-mon[30515]: rocksdb: Options.blob_compression_type: NoCompression 2024-09-12T02:26:56.898 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 02:26:56 smithi039 ceph-mon[30515]: rocksdb: Options.enable_blob_garbage_collection: false 2024-09-12T02:26:56.898 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 02:26:56 smithi039 ceph-mon[30515]: rocksdb: Options.blob_garbage_collection_age_cutoff: 0.250000 2024-09-12T02:26:56.898 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 02:26:56 smithi039 ceph-mon[30515]: rocksdb: Options.blob_garbage_collection_force_threshold: 1.000000 2024-09-12T02:26:56.898 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 02:26:56 smithi039 ceph-mon[30515]: rocksdb: Options.blob_compaction_readahead_size: 0 2024-09-12T02:26:56.898 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 02:26:56 smithi039 ceph-mon[30515]: rocksdb: Options.blob_file_starting_level: 0 2024-09-12T02:26:56.898 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 02:26:56 smithi039 ceph-mon[30515]: rocksdb: Options.experimental_mempurge_threshold: 0.000000 2024-09-12T02:26:56.898 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 02:26:56 smithi039 ceph-mon[30515]: rocksdb: [db/version_set.cc:5566] Recovered from manifest file:/var/lib/ceph/mon/ceph-a/store.db/MANIFEST-000010 succeeded,manifest_file_number is 10, next_file_number is 12, last_sequence is 5, log_number is 5,prev_log_number is 0,max_column_family is 0,min_log_number_to_keep is 5 2024-09-12T02:26:56.898 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 02:26:56 smithi039 ceph-mon[30515]: rocksdb: [db/version_set.cc:5581] Column family [default] (ID 0), log number is 5 2024-09-12T02:26:56.898 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 02:26:56 smithi039 ceph-mon[30515]: rocksdb: [db/db_impl/db_impl_open.cc:539] DB ID: 1e73b03a-8a28-4cf1-8454-129d658b6f10 2024-09-12T02:26:56.899 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 02:26:56 smithi039 ceph-mon[30515]: rocksdb: EVENT_LOG_v1 {"time_micros": 1726108016843899, "job": 1, "event": "recovery_started", "wal_files": [9]} 2024-09-12T02:26:56.899 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 02:26:56 smithi039 ceph-mon[30515]: rocksdb: [db/db_impl/db_impl_open.cc:1043] Recovering log #9 mode 2 2024-09-12T02:26:56.899 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 02:26:56 smithi039 ceph-mon[30515]: rocksdb: EVENT_LOG_v1 {"time_micros": 1726108016845586, "cf_name": "default", "job": 1, "event": "table_file_creation", "file_number": 13, "file_size": 100864, "file_checksum": "", "file_checksum_func_name": "Unknown", "smallest_seqno": 8, "largest_seqno": 330, "table_properties": {"data_size": 98749, "index_size": 307, "index_partitions": 0, "top_level_index_size": 0, "index_key_is_user_key": 1, "index_value_is_delta_encoded": 1, "filter_size": 773, "raw_key_size": 14433, "raw_average_key_size": 49, "raw_value_size": 90924, "raw_average_value_size": 314, "num_data_blocks": 12, "num_entries": 289, "num_filter_entries": 289, "num_deletions": 3, "num_merge_operands": 0, "num_range_deletions": 0, "format_version": 0, "fixed_key_len": 0, "filter_policy": "bloomfilter", "column_family_name": "default", "column_family_id": 0, "comparator": "leveldb.BytewiseComparator", "merge_operator": "", "prefix_extractor_name": "nullptr", "property_collectors": "[CompactOnDeletionCollector]", "compression": "NoCompression", "compression_options": "window_bits=-14; level=32767; strategy=0; max_dict_bytes=0; zstd_max_train_bytes=0; enabled=0; max_dict_buffer_bytes=0; use_zstd_dict_trainer=1; ", "creation_time": 1726108016, "oldest_key_time": 0, "file_creation_time": 0, "slow_compression_estimated_data_size": 0, "fast_compression_estimated_data_size": 0, "db_id": "1e73b03a-8a28-4cf1-8454-129d658b6f10", "db_session_id": "H3S9KH73XZ0B9T895C6E", "orig_file_number": 13, "seqno_to_time_mapping": "N/A"}} 2024-09-12T02:26:56.899 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 02:26:56 smithi039 ceph-mon[30515]: rocksdb: EVENT_LOG_v1 {"time_micros": 1726108016845762, "job": 1, "event": "recovery_finished"} 2024-09-12T02:26:56.899 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 02:26:56 smithi039 ceph-mon[30515]: rocksdb: [db/version_set.cc:5047] Creating manifest 15 2024-09-12T02:26:56.899 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 02:26:56 smithi039 ceph-mon[30515]: rocksdb: [file/delete_scheduler.cc:74] Deleted file /var/lib/ceph/mon/ceph-a/store.db/000009.log immediately, rate_bytes_per_sec 0, total_trash_size 0 max_trash_db_ratio 0.250000 2024-09-12T02:26:56.899 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 02:26:56 smithi039 ceph-mon[30515]: rocksdb: [db/db_impl/db_impl_open.cc:1987] SstFileManager instance 0x55d50d958e00 2024-09-12T02:26:56.899 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 02:26:56 smithi039 ceph-mon[30515]: rocksdb: DB pointer 0x55d50da54000 2024-09-12T02:26:56.899 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 02:26:56 smithi039 ceph-mon[30515]: rocksdb: [db/db_impl/db_impl.cc:1109] ------- DUMPING STATS ------- 2024-09-12T02:26:56.899 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 02:26:56 smithi039 ceph-mon[30515]: rocksdb: [db/db_impl/db_impl.cc:1111] 2024-09-12T02:26:56.899 INFO:journalctl@ceph.mon.a.smithi039.stdout: ** DB Stats ** 2024-09-12T02:26:56.899 INFO:journalctl@ceph.mon.a.smithi039.stdout: Uptime(secs): 0.0 total, 0.0 interval 2024-09-12T02:26:56.899 INFO:journalctl@ceph.mon.a.smithi039.stdout: Cumulative writes: 0 writes, 0 keys, 0 commit groups, 0.0 writes per commit group, ingest: 0.00 GB, 0.00 MB/s 2024-09-12T02:26:56.900 INFO:journalctl@ceph.mon.a.smithi039.stdout: Cumulative WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s 2024-09-12T02:26:56.900 INFO:journalctl@ceph.mon.a.smithi039.stdout: Cumulative stall: 00:00:0.000 H:M:S, 0.0 percent 2024-09-12T02:26:56.900 INFO:journalctl@ceph.mon.a.smithi039.stdout: Interval writes: 0 writes, 0 keys, 0 commit groups, 0.0 writes per commit group, ingest: 0.00 MB, 0.00 MB/s 2024-09-12T02:26:56.900 INFO:journalctl@ceph.mon.a.smithi039.stdout: Interval WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s 2024-09-12T02:26:56.900 INFO:journalctl@ceph.mon.a.smithi039.stdout: Interval stall: 00:00:0.000 H:M:S, 0.0 percent 2024-09-12T02:26:56.900 INFO:journalctl@ceph.mon.a.smithi039.stdout: 2024-09-12T02:26:56.900 INFO:journalctl@ceph.mon.a.smithi039.stdout: ** Compaction Stats [default] ** 2024-09-12T02:26:56.900 INFO:journalctl@ceph.mon.a.smithi039.stdout: Level Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) 2024-09-12T02:26:56.900 INFO:journalctl@ceph.mon.a.smithi039.stdout: ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------ 2024-09-12T02:26:56.900 INFO:journalctl@ceph.mon.a.smithi039.stdout: L0 2/0 100.36 KB 0.5 0.0 0.0 0.0 0.0 0.0 0.0 1.0 0.0 94.1 0.00 0.00 1 0.001 0 0 0.0 0.0 2024-09-12T02:26:56.900 INFO:journalctl@ceph.mon.a.smithi039.stdout: Sum 2/0 100.36 KB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 1.0 0.0 94.1 0.00 0.00 1 0.001 0 0 0.0 0.0 2024-09-12T02:26:56.900 INFO:journalctl@ceph.mon.a.smithi039.stdout: Int 0/0 0.00 KB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 1.0 0.0 94.1 0.00 0.00 1 0.001 0 0 0.0 0.0 2024-09-12T02:26:56.900 INFO:journalctl@ceph.mon.a.smithi039.stdout: 2024-09-12T02:26:56.901 INFO:journalctl@ceph.mon.a.smithi039.stdout: ** Compaction Stats [default] ** 2024-09-12T02:26:56.901 INFO:journalctl@ceph.mon.a.smithi039.stdout: Priority Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) 2024-09-12T02:26:56.901 INFO:journalctl@ceph.mon.a.smithi039.stdout: --------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- 2024-09-12T02:26:56.901 INFO:journalctl@ceph.mon.a.smithi039.stdout: User 0/0 0.00 KB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 94.1 0.00 0.00 1 0.001 0 0 0.0 0.0 2024-09-12T02:26:56.901 INFO:journalctl@ceph.mon.a.smithi039.stdout: 2024-09-12T02:26:56.901 INFO:journalctl@ceph.mon.a.smithi039.stdout: Blob file count: 0, total size: 0.0 GB, garbage size: 0.0 GB, space amp: 0.0 2024-09-12T02:26:56.901 INFO:journalctl@ceph.mon.a.smithi039.stdout: 2024-09-12T02:26:56.901 INFO:journalctl@ceph.mon.a.smithi039.stdout: Uptime(secs): 0.0 total, 0.0 interval 2024-09-12T02:26:56.901 INFO:journalctl@ceph.mon.a.smithi039.stdout: Flush(GB): cumulative 0.000, interval 0.000 2024-09-12T02:26:56.901 INFO:journalctl@ceph.mon.a.smithi039.stdout: AddFile(GB): cumulative 0.000, interval 0.000 2024-09-12T02:26:56.901 INFO:journalctl@ceph.mon.a.smithi039.stdout: AddFile(Total Files): cumulative 0, interval 0 2024-09-12T02:26:56.901 INFO:journalctl@ceph.mon.a.smithi039.stdout: AddFile(L0 Files): cumulative 0, interval 0 2024-09-12T02:26:56.901 INFO:journalctl@ceph.mon.a.smithi039.stdout: AddFile(Keys): cumulative 0, interval 0 2024-09-12T02:26:56.902 INFO:journalctl@ceph.mon.a.smithi039.stdout: Cumulative compaction: 0.00 GB write, 9.01 MB/s write, 0.00 GB read, 0.00 MB/s read, 0.0 seconds 2024-09-12T02:26:56.902 INFO:journalctl@ceph.mon.a.smithi039.stdout: Interval compaction: 0.00 GB write, 9.01 MB/s write, 0.00 GB read, 0.00 MB/s read, 0.0 seconds 2024-09-12T02:26:56.902 INFO:journalctl@ceph.mon.a.smithi039.stdout: Stalls(count): 0 level0_slowdown, 0 level0_slowdown_with_compaction, 0 level0_numfiles, 0 level0_numfiles_with_compaction, 0 stop for pending_compaction_bytes, 0 slowdown for pending_compaction_bytes, 0 memtable_compaction, 0 memtable_slowdown, interval 0 total count 2024-09-12T02:26:56.902 INFO:journalctl@ceph.mon.a.smithi039.stdout: Block cache BinnedLRUCache@0x55d50d9291f0#2 capacity: 512.00 MB usage: 1.52 KB table_size: 0 occupancy: 18446744073709551615 collections: 1 last_copies: 0 last_secs: 1e-05 secs_since: 0 2024-09-12T02:26:56.902 INFO:journalctl@ceph.mon.a.smithi039.stdout: Block cache entry stats(count,size,portion): FilterBlock(2,1.02 KB,0.000193715%) IndexBlock(2,0.50 KB,9.53674e-05%) Misc(1,0.00 KB,0%) 2024-09-12T02:26:56.902 INFO:journalctl@ceph.mon.a.smithi039.stdout: 2024-09-12T02:26:56.902 INFO:journalctl@ceph.mon.a.smithi039.stdout: ** File Read Latency Histogram By Level [default] ** 2024-09-12T02:26:56.902 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 02:26:56 smithi039 ceph-mon[30515]: starting mon.a rank 0 at public addrs [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] at bind addrs [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] mon_data /var/lib/ceph/mon/ceph-a fsid 4954ed46-70ae-11ef-bcea-c7b262605968 2024-09-12T02:26:56.902 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 02:26:56 smithi039 ceph-mon[30515]: mon.a@-1(???) e1 preinit fsid 4954ed46-70ae-11ef-bcea-c7b262605968 2024-09-12T02:26:56.902 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 02:26:56 smithi039 ceph-mon[30515]: mon.a@-1(???).mds e1 new map 2024-09-12T02:26:56.902 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 02:26:56 smithi039 ceph-mon[30515]: mon.a@-1(???).mds e1 print_map 2024-09-12T02:26:56.902 INFO:journalctl@ceph.mon.a.smithi039.stdout: e1 2024-09-12T02:26:56.902 INFO:journalctl@ceph.mon.a.smithi039.stdout: btime 2024-09-12T02:26:43:086025+0000 2024-09-12T02:26:56.902 INFO:journalctl@ceph.mon.a.smithi039.stdout: enable_multiple, ever_enabled_multiple: 1,1 2024-09-12T02:26:56.902 INFO:journalctl@ceph.mon.a.smithi039.stdout: default compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2,11=minor log segments,12=quiesce subvolumes} 2024-09-12T02:26:56.903 INFO:journalctl@ceph.mon.a.smithi039.stdout: legacy client fscid: -1 2024-09-12T02:26:56.903 INFO:journalctl@ceph.mon.a.smithi039.stdout: 2024-09-12T02:26:56.903 INFO:journalctl@ceph.mon.a.smithi039.stdout: No filesystems configured 2024-09-12T02:26:56.903 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 02:26:56 smithi039 ceph-mon[30515]: mon.a@-1(???).osd e1 crush map has features 3314932999778484224, adjusting msgr requires 2024-09-12T02:26:56.903 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 02:26:56 smithi039 ceph-mon[30515]: mon.a@-1(???).osd e1 crush map has features 288514050185494528, adjusting msgr requires 2024-09-12T02:26:56.903 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 02:26:56 smithi039 ceph-mon[30515]: mon.a@-1(???).osd e1 crush map has features 288514050185494528, adjusting msgr requires 2024-09-12T02:26:56.903 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 02:26:56 smithi039 ceph-mon[30515]: mon.a@-1(???).osd e1 crush map has features 288514050185494528, adjusting msgr requires 2024-09-12T02:26:56.903 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 02:26:56 smithi039 ceph-mon[30515]: mon.a@-1(???).paxosservice(auth 1..2) refresh upgraded, format 0 -> 3 2024-09-12T02:26:56.903 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 02:26:56 smithi039 bash[30496]: aa6e01b76020ab1785ea97ec82bd174a8c7eaf3009a8decf95b4d521220b1f61 2024-09-12T02:26:56.903 INFO:teuthology.orchestra.run.smithi039.stdout:Setting public_network to 172.21.0.0/20 in mon config section 2024-09-12T02:26:57.152 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 02:26:56 smithi039 systemd[1]: Started Ceph mon.a for 4954ed46-70ae-11ef-bcea-c7b262605968. 2024-09-12T02:26:57.152 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 02:26:56 smithi039 ceph-mon[30515]: mon.a is new leader, mons a in quorum (ranks 0) 2024-09-12T02:26:57.152 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 02:26:56 smithi039 ceph-mon[30515]: monmap epoch 1 2024-09-12T02:26:57.152 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 02:26:56 smithi039 ceph-mon[30515]: fsid 4954ed46-70ae-11ef-bcea-c7b262605968 2024-09-12T02:26:57.152 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 02:26:56 smithi039 ceph-mon[30515]: last_changed 2024-09-12T02:26:39.333323+0000 2024-09-12T02:26:57.152 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 02:26:56 smithi039 ceph-mon[30515]: created 2024-09-12T02:26:39.333323+0000 2024-09-12T02:26:57.152 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 02:26:56 smithi039 ceph-mon[30515]: min_mon_release 19 (squid) 2024-09-12T02:26:57.152 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 02:26:56 smithi039 ceph-mon[30515]: election_strategy: 1 2024-09-12T02:26:57.152 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 02:26:56 smithi039 ceph-mon[30515]: 0: [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] mon.a 2024-09-12T02:26:57.152 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 02:26:56 smithi039 ceph-mon[30515]: fsmap 2024-09-12T02:26:57.152 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 02:26:56 smithi039 ceph-mon[30515]: osdmap e1: 0 total, 0 up, 0 in 2024-09-12T02:26:57.153 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 02:26:56 smithi039 ceph-mon[30515]: mgrmap e1: no daemons active 2024-09-12T02:26:58.077 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stderr 2024-09-12T02:26:57.401+0000 7f395ee00640 1 Processor -- start 2024-09-12T02:26:58.077 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stderr 2024-09-12T02:26:57.402+0000 7f395ee00640 1 -- start start 2024-09-12T02:26:58.077 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stderr 2024-09-12T02:26:57.402+0000 7f395ee00640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f395807e680 0x7f395807cb30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:26:58.077 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stderr 2024-09-12T02:26:57.402+0000 7f395ee00640 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 -- 0x7f395807d100 con 0x7f395807e680 2024-09-12T02:26:58.077 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stderr 2024-09-12T02:26:57.403+0000 7f3957e00640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f395807e680 0x7f395807cb30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:26:58.077 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stderr 2024-09-12T02:26:57.403+0000 7f3957e00640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f395807e680 0x7f395807cb30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.39:3300/0 says I am v2:172.21.15.39:48784/0 (socket says 172.21.15.39:48784) 2024-09-12T02:26:58.077 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stderr 2024-09-12T02:26:57.403+0000 7f3957e00640 1 -- 172.21.15.39:0/2425594962 learned_addr learned my addr 172.21.15.39:0/2425594962 (peer_addr_for_me v2:172.21.15.39:0/0) 2024-09-12T02:26:58.077 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stderr 2024-09-12T02:26:57.403+0000 7f3957e00640 1 -- 172.21.15.39:0/2425594962 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f395807d280 con 0x7f395807e680 2024-09-12T02:26:58.077 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stderr 2024-09-12T02:26:57.406+0000 7f3957e00640 1 --2- 172.21.15.39:0/2425594962 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f395807e680 0x7f395807cb30 secure :-1 s=READY pgs=1 cs=0 l=1 rev1=1 crypto rx=0x7f3948009820 tx=0x7f394802a270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b84afe9125f4d4ca server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:26:58.077 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stderr 2024-09-12T02:26:57.406+0000 7f3957400640 1 -- 172.21.15.39:0/2425594962 <== mon.0 v2:172.21.15.39:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f3948037070 con 0x7f395807e680 2024-09-12T02:26:58.077 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stderr 2024-09-12T02:26:57.406+0000 7f3957400640 1 -- 172.21.15.39:0/2425594962 <== mon.0 v2:172.21.15.39:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7f3948032900 con 0x7f395807e680 2024-09-12T02:26:58.078 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stderr 2024-09-12T02:26:57.406+0000 7f3957400640 1 -- 172.21.15.39:0/2425594962 <== mon.0 v2:172.21.15.39:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f3948030850 con 0x7f395807e680 2024-09-12T02:26:58.078 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stderr 2024-09-12T02:26:57.407+0000 7f395ee00640 1 -- 172.21.15.39:0/2425594962 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f395807e680 msgr2=0x7f395807cb30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:26:58.078 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stderr 2024-09-12T02:26:57.407+0000 7f395ee00640 1 --2- 172.21.15.39:0/2425594962 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f395807e680 0x7f395807cb30 secure :-1 s=READY pgs=1 cs=0 l=1 rev1=1 crypto rx=0x7f3948009820 tx=0x7f394802a270 comp rx=0 tx=0).stop 2024-09-12T02:26:58.078 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stderr 2024-09-12T02:26:57.407+0000 7f395ee00640 1 -- 172.21.15.39:0/2425594962 shutdown_connections 2024-09-12T02:26:58.078 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stderr 2024-09-12T02:26:57.407+0000 7f395ee00640 1 --2- 172.21.15.39:0/2425594962 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f395807e680 0x7f395807cb30 unknown :-1 s=CLOSED pgs=1 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:26:58.078 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stderr 2024-09-12T02:26:57.407+0000 7f395ee00640 1 -- 172.21.15.39:0/2425594962 >> 172.21.15.39:0/2425594962 conn(0x7f3958102ef0 msgr2=0x7f3958105310 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:26:58.078 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stderr 2024-09-12T02:26:57.407+0000 7f395ee00640 1 -- 172.21.15.39:0/2425594962 shutdown_connections 2024-09-12T02:26:58.078 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stderr 2024-09-12T02:26:57.407+0000 7f395ee00640 1 -- 172.21.15.39:0/2425594962 wait complete. 2024-09-12T02:26:58.078 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stderr 2024-09-12T02:26:57.408+0000 7f395ee00640 1 Processor -- start 2024-09-12T02:26:58.078 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stderr 2024-09-12T02:26:57.408+0000 7f395ee00640 1 -- start start 2024-09-12T02:26:58.078 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stderr 2024-09-12T02:26:57.408+0000 7f395ee00640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f395807e680 0x7f395819d850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:26:58.078 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stderr 2024-09-12T02:26:57.408+0000 7f395ee00640 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 -- 0x7f395810dcb0 con 0x7f395807e680 2024-09-12T02:26:58.078 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stderr 2024-09-12T02:26:57.408+0000 7f3957e00640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f395807e680 0x7f395819d850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:26:58.079 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stderr 2024-09-12T02:26:57.408+0000 7f3957e00640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f395807e680 0x7f395819d850 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.39:3300/0 says I am v2:172.21.15.39:48788/0 (socket says 172.21.15.39:48788) 2024-09-12T02:26:58.079 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stderr 2024-09-12T02:26:57.408+0000 7f3957e00640 1 -- 172.21.15.39:0/3841874360 learned_addr learned my addr 172.21.15.39:0/3841874360 (peer_addr_for_me v2:172.21.15.39:0/0) 2024-09-12T02:26:58.079 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stderr 2024-09-12T02:26:57.409+0000 7f3957e00640 1 -- 172.21.15.39:0/3841874360 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f395819dd90 con 0x7f395807e680 2024-09-12T02:26:58.079 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stderr 2024-09-12T02:26:57.409+0000 7f3957e00640 1 --2- 172.21.15.39:0/3841874360 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f395807e680 0x7f395819d850 secure :-1 s=READY pgs=2 cs=0 l=1 rev1=1 crypto rx=0x7f39480097f0 tx=0x7f3948030d80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:26:58.079 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stderr 2024-09-12T02:26:57.409+0000 7f3955600640 1 -- 172.21.15.39:0/3841874360 <== mon.0 v2:172.21.15.39:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f3948037040 con 0x7f395807e680 2024-09-12T02:26:58.079 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stderr 2024-09-12T02:26:57.409+0000 7f3955600640 1 -- 172.21.15.39:0/3841874360 <== mon.0 v2:172.21.15.39:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7f3948040070 con 0x7f395807e680 2024-09-12T02:26:58.079 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stderr 2024-09-12T02:26:57.409+0000 7f395ee00640 1 -- 172.21.15.39:0/3841874360 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f395819e020 con 0x7f395807e680 2024-09-12T02:26:58.079 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stderr 2024-09-12T02:26:57.409+0000 7f3955600640 1 -- 172.21.15.39:0/3841874360 <== mon.0 v2:172.21.15.39:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f394803a390 con 0x7f395807e680 2024-09-12T02:26:58.079 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stderr 2024-09-12T02:26:57.410+0000 7f395ee00640 1 -- 172.21.15.39:0/3841874360 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f39581a0d10 con 0x7f395807e680 2024-09-12T02:26:58.079 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stderr 2024-09-12T02:26:57.410+0000 7f3955600640 1 -- 172.21.15.39:0/3841874360 <== mon.0 v2:172.21.15.39:3300/0 4 ==== mgrmap(e 1) ==== 807+0+0 (secure 0 0 0) 0x7f394803a650 con 0x7f395807e680 2024-09-12T02:26:58.079 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stderr 2024-09-12T02:26:57.410+0000 7f3955600640 1 -- 172.21.15.39:0/3841874360 <== mon.0 v2:172.21.15.39:3300/0 5 ==== osd_map(1..1 src has 1..1) ==== 725+0+0 (secure 0 0 0) 0x7f39480459b0 con 0x7f395807e680 2024-09-12T02:26:58.079 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stderr 2024-09-12T02:26:57.411+0000 7f395ee00640 1 -- 172.21.15.39:0/3841874360 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f395807cbb0 con 0x7f395807e680 2024-09-12T02:26:58.079 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stderr 2024-09-12T02:26:57.414+0000 7f3955600640 1 -- 172.21.15.39:0/3841874360 <== mon.0 v2:172.21.15.39:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+74432 (secure 0 0 0) 0x7f3948045460 con 0x7f395807e680 2024-09-12T02:26:58.079 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stderr 2024-09-12T02:26:57.476+0000 7f395ee00640 1 -- 172.21.15.39:0/3841874360 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_command([{prefix=config set, name=public_network}] v 0) -- 0x7f39581a0ee0 con 0x7f395807e680 2024-09-12T02:26:58.080 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stderr 2024-09-12T02:26:57.478+0000 7f3955600640 1 -- 172.21.15.39:0/3841874360 <== mon.0 v2:172.21.15.39:3300/0 7 ==== mon_command_ack([{prefix=config set, name=public_network}]=0 v3)=0 v3) ==== 124+0+0 (secure 0 0 0) 0x7f394803b430 con 0x7f395807e680 2024-09-12T02:26:58.080 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stderr 2024-09-12T02:26:57.479+0000 7f395ee00640 1 -- 172.21.15.39:0/3841874360 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f395807e680 msgr2=0x7f395819d850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:26:58.080 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stderr 2024-09-12T02:26:57.479+0000 7f395ee00640 1 --2- 172.21.15.39:0/3841874360 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f395807e680 0x7f395819d850 secure :-1 s=READY pgs=2 cs=0 l=1 rev1=1 crypto rx=0x7f39480097f0 tx=0x7f3948030d80 comp rx=0 tx=0).stop 2024-09-12T02:26:58.080 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stderr 2024-09-12T02:26:57.479+0000 7f395ee00640 1 -- 172.21.15.39:0/3841874360 shutdown_connections 2024-09-12T02:26:58.080 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stderr 2024-09-12T02:26:57.479+0000 7f395ee00640 1 --2- 172.21.15.39:0/3841874360 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f395807e680 0x7f395819d850 unknown :-1 s=CLOSED pgs=2 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:26:58.080 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stderr 2024-09-12T02:26:57.479+0000 7f395ee00640 1 -- 172.21.15.39:0/3841874360 >> 172.21.15.39:0/3841874360 conn(0x7f3958102ef0 msgr2=0x7f3958103a70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:26:58.080 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stderr 2024-09-12T02:26:57.480+0000 7f395ee00640 1 -- 172.21.15.39:0/3841874360 shutdown_connections 2024-09-12T02:26:58.080 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stderr 2024-09-12T02:26:57.480+0000 7f395ee00640 1 -- 172.21.15.39:0/3841874360 wait complete. 2024-09-12T02:26:58.080 INFO:teuthology.orchestra.run.smithi039.stdout:Wrote config to /etc/ceph/ceph.conf 2024-09-12T02:26:58.092 INFO:teuthology.orchestra.run.smithi039.stdout:Wrote keyring to /etc/ceph/ceph.client.admin.keyring 2024-09-12T02:26:58.092 INFO:teuthology.orchestra.run.smithi039.stdout:Creating mgr... 2024-09-12T02:26:58.093 INFO:teuthology.orchestra.run.smithi039.stdout:Verifying port 0.0.0.0:9283 ... 2024-09-12T02:26:58.093 INFO:teuthology.orchestra.run.smithi039.stdout:Verifying port 0.0.0.0:8765 ... 2024-09-12T02:26:58.463 INFO:teuthology.orchestra.run.smithi039.stdout:Non-zero exit code 1 from systemctl reset-failed ceph-4954ed46-70ae-11ef-bcea-c7b262605968@mgr.x 2024-09-12T02:26:58.463 INFO:teuthology.orchestra.run.smithi039.stdout:systemctl: stderr Failed to reset failed state of unit ceph-4954ed46-70ae-11ef-bcea-c7b262605968@mgr.x.service: Unit ceph-4954ed46-70ae-11ef-bcea-c7b262605968@mgr.x.service not loaded. 2024-09-12T02:26:58.708 INFO:teuthology.orchestra.run.smithi039.stdout:systemctl: stderr Created symlink /etc/systemd/system/ceph-4954ed46-70ae-11ef-bcea-c7b262605968.target.wants/ceph-4954ed46-70ae-11ef-bcea-c7b262605968@mgr.x.service → /etc/systemd/system/ceph-4954ed46-70ae-11ef-bcea-c7b262605968@.service. 2024-09-12T02:26:58.732 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 02:26:58 smithi039 ceph-mon[30515]: from='client.? 172.21.15.39:0/3841874360' entity='client.admin' 2024-09-12T02:26:59.046 INFO:journalctl@ceph.mgr.x.smithi039.stdout:Sep 12 02:26:58 smithi039 systemd[1]: Starting Ceph mgr.x for 4954ed46-70ae-11ef-bcea-c7b262605968... 2024-09-12T02:26:59.349 INFO:journalctl@ceph.mgr.x.smithi039.stdout:Sep 12 02:26:59 smithi039 podman[30722]: 2024-09-12 02:26:58.951755871 +0000 UTC m=+0.027539179 image pull 54467abc55f864c4f73dfaf9c6ac3bb3e87b773123d5badaf790bee57321d594 quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc 2024-09-12T02:26:59.350 INFO:journalctl@ceph.mgr.x.smithi039.stdout:Sep 12 02:26:59 smithi039 podman[30722]: 2024-09-12 02:26:59.070416143 +0000 UTC m=+0.146199428 container create 3e91a1d13a6a4a2fd71d7e803e4a5d774aa3752b5d25b32347c1cb6d848abef9 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc, name=ceph-4954ed46-70ae-11ef-bcea-c7b262605968-mgr-x, RELEASE=squid-b53b6d3, maintainer=Guillaume Abrioux , GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, GIT_CLEAN=True, org.label-schema.build-date=20240731, org.label-schema.schema-version=1.0, org.label-schema.license=GPLv2, org.label-schema.vendor=CentOS, org.label-schema.name=CentOS Stream 9 Base Image, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_BRANCH=HEAD, ceph=True, io.buildah.version=1.37.2, CEPH_POINT_RELEASE=) 2024-09-12T02:26:59.350 INFO:journalctl@ceph.mgr.x.smithi039.stdout:Sep 12 02:26:59 smithi039 podman[30722]: 2024-09-12 02:26:59.287443281 +0000 UTC m=+0.363226568 container init 3e91a1d13a6a4a2fd71d7e803e4a5d774aa3752b5d25b32347c1cb6d848abef9 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc, name=ceph-4954ed46-70ae-11ef-bcea-c7b262605968-mgr-x, GIT_CLEAN=True, io.buildah.version=1.37.2, org.label-schema.build-date=20240731, maintainer=Guillaume Abrioux , GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.vendor=CentOS, GIT_BRANCH=HEAD, org.label-schema.license=GPLv2, RELEASE=squid-b53b6d3, ceph=True, org.label-schema.schema-version=1.0, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.name=CentOS Stream 9 Base Image, CEPH_POINT_RELEASE=) 2024-09-12T02:26:59.350 INFO:journalctl@ceph.mgr.x.smithi039.stdout:Sep 12 02:26:59 smithi039 podman[30722]: 2024-09-12 02:26:59.293465399 +0000 UTC m=+0.369248695 container start 3e91a1d13a6a4a2fd71d7e803e4a5d774aa3752b5d25b32347c1cb6d848abef9 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc, name=ceph-4954ed46-70ae-11ef-bcea-c7b262605968-mgr-x, CEPH_POINT_RELEASE=, org.label-schema.name=CentOS Stream 9 Base Image, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.schema-version=1.0, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, RELEASE=squid-b53b6d3, ceph=True, maintainer=Guillaume Abrioux , org.label-schema.license=GPLv2, org.label-schema.build-date=20240731, GIT_BRANCH=HEAD, io.buildah.version=1.37.2, org.label-schema.vendor=CentOS, GIT_CLEAN=True) 2024-09-12T02:26:59.425 INFO:teuthology.orchestra.run.smithi039.stdout:Non-zero exit code 1 from systemctl is-enabled firewalld.service 2024-09-12T02:26:59.425 INFO:teuthology.orchestra.run.smithi039.stdout:systemctl: stdout disabled 2024-09-12T02:26:59.439 INFO:teuthology.orchestra.run.smithi039.stdout:Non-zero exit code 3 from systemctl is-active firewalld.service 2024-09-12T02:26:59.439 INFO:teuthology.orchestra.run.smithi039.stdout:systemctl: stdout inactive 2024-09-12T02:26:59.439 INFO:teuthology.orchestra.run.smithi039.stdout:firewalld.service is not enabled 2024-09-12T02:26:59.439 INFO:teuthology.orchestra.run.smithi039.stdout:Not possible to enable service . firewalld.service is not available 2024-09-12T02:26:59.457 INFO:teuthology.orchestra.run.smithi039.stdout:Non-zero exit code 1 from systemctl is-enabled firewalld.service 2024-09-12T02:26:59.457 INFO:teuthology.orchestra.run.smithi039.stdout:systemctl: stdout disabled 2024-09-12T02:26:59.471 INFO:teuthology.orchestra.run.smithi039.stdout:Non-zero exit code 3 from systemctl is-active firewalld.service 2024-09-12T02:26:59.471 INFO:teuthology.orchestra.run.smithi039.stdout:systemctl: stdout inactive 2024-09-12T02:26:59.471 INFO:teuthology.orchestra.run.smithi039.stdout:firewalld.service is not enabled 2024-09-12T02:26:59.471 INFO:teuthology.orchestra.run.smithi039.stdout:Not possible to open ports <[9283, 8765]>. firewalld.service is not available 2024-09-12T02:26:59.471 INFO:teuthology.orchestra.run.smithi039.stdout:Waiting for mgr to start... 2024-09-12T02:26:59.471 INFO:teuthology.orchestra.run.smithi039.stdout:Waiting for mgr... 2024-09-12T02:26:59.738 INFO:journalctl@ceph.mgr.x.smithi039.stdout:Sep 12 02:26:59 smithi039 bash[30722]: 3e91a1d13a6a4a2fd71d7e803e4a5d774aa3752b5d25b32347c1cb6d848abef9 2024-09-12T02:26:59.738 INFO:journalctl@ceph.mgr.x.smithi039.stdout:Sep 12 02:26:59 smithi039 systemd[1]: Started Ceph mgr.x for 4954ed46-70ae-11ef-bcea-c7b262605968. 2024-09-12T02:26:59.739 INFO:journalctl@ceph.mgr.x.smithi039.stdout:Sep 12 02:26:59 smithi039 ceph-4954ed46-70ae-11ef-bcea-c7b262605968-mgr-x[30736]: 2024-09-12T02:26:59.463+0000 7f18fd22d040 -1 mgr[py] Module osd_perf_query has missing NOTIFY_TYPES member 2024-09-12T02:26:59.739 INFO:journalctl@ceph.mgr.x.smithi039.stdout:Sep 12 02:26:59 smithi039 ceph-4954ed46-70ae-11ef-bcea-c7b262605968-mgr-x[30736]: 2024-09-12T02:26:59.539+0000 7f18fd22d040 -1 mgr[py] Module osd_support has missing NOTIFY_TYPES member 2024-09-12T02:26:59.739 INFO:journalctl@ceph.mgr.x.smithi039.stdout:Sep 12 02:26:59 smithi039 ceph-4954ed46-70ae-11ef-bcea-c7b262605968-mgr-x[30736]: 2024-09-12T02:26:59.737+0000 7f18fd22d040 -1 mgr[py] Module diskprediction_local has missing NOTIFY_TYPES member 2024-09-12T02:26:59.989 INFO:journalctl@ceph.mgr.x.smithi039.stdout:Sep 12 02:26:59 smithi039 ceph-4954ed46-70ae-11ef-bcea-c7b262605968-mgr-x[30736]: 2024-09-12T02:26:59.823+0000 7f18fd22d040 -1 mgr[py] Module crash has missing NOTIFY_TYPES member 2024-09-12T02:27:00.349 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 02:27:00 smithi039 ceph-mon[30515]: from='client.? 172.21.15.39:0/3866168909' entity='client.admin' cmd=[{"prefix": "status", "format": "json-pretty"}]: dispatch 2024-09-12T02:27:00.349 INFO:journalctl@ceph.mgr.x.smithi039.stdout:Sep 12 02:27:00 smithi039 ceph-4954ed46-70ae-11ef-bcea-c7b262605968-mgr-x[30736]: 2024-09-12T02:27:00.010+0000 7f18fd22d040 -1 mgr[py] Module test_orchestrator has missing NOTIFY_TYPES member 2024-09-12T02:27:00.350 INFO:journalctl@ceph.mgr.x.smithi039.stdout:Sep 12 02:27:00 smithi039 ceph-4954ed46-70ae-11ef-bcea-c7b262605968-mgr-x[30736]: 2024-09-12T02:27:00.186+0000 7f18fd22d040 -1 mgr[py] Module snap_schedule has missing NOTIFY_TYPES member 2024-09-12T02:27:00.848 INFO:journalctl@ceph.mgr.x.smithi039.stdout:Sep 12 02:27:00 smithi039 ceph-4954ed46-70ae-11ef-bcea-c7b262605968-mgr-x[30736]: 2024-09-12T02:27:00.580+0000 7f18fd22d040 -1 mgr[py] Module prometheus has missing NOTIFY_TYPES member 2024-09-12T02:27:00.848 INFO:journalctl@ceph.mgr.x.smithi039.stdout:Sep 12 02:27:00 smithi039 ceph-4954ed46-70ae-11ef-bcea-c7b262605968-mgr-x[30736]: 2024-09-12T02:27:00.654+0000 7f18fd22d040 -1 mgr[py] Module selftest has missing NOTIFY_TYPES member 2024-09-12T02:27:01.099 INFO:journalctl@ceph.mgr.x.smithi039.stdout:Sep 12 02:27:00 smithi039 ceph-4954ed46-70ae-11ef-bcea-c7b262605968-mgr-x[30736]: 2024-09-12T02:27:00.876+0000 7f18fd22d040 -1 mgr[py] Module volumes has missing NOTIFY_TYPES member 2024-09-12T02:27:01.130 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stdout 2024-09-12T02:27:01.132 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stdout { 2024-09-12T02:27:01.133 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stdout "fsid": "4954ed46-70ae-11ef-bcea-c7b262605968", 2024-09-12T02:27:01.133 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stdout "health": { 2024-09-12T02:27:01.133 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stdout "status": "HEALTH_OK", 2024-09-12T02:27:01.133 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stdout "checks": {}, 2024-09-12T02:27:01.133 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stdout "mutes": [] 2024-09-12T02:27:01.133 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stdout }, 2024-09-12T02:27:01.133 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stdout "election_epoch": 5, 2024-09-12T02:27:01.133 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stdout "quorum": [ 2024-09-12T02:27:01.133 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stdout 0 2024-09-12T02:27:01.133 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stdout ], 2024-09-12T02:27:01.133 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stdout "quorum_names": [ 2024-09-12T02:27:01.133 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stdout "a" 2024-09-12T02:27:01.133 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stdout ], 2024-09-12T02:27:01.133 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stdout "quorum_age": 3, 2024-09-12T02:27:01.134 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stdout "monmap": { 2024-09-12T02:27:01.134 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stdout "epoch": 1, 2024-09-12T02:27:01.134 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stdout "min_mon_release_name": "squid", 2024-09-12T02:27:01.134 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stdout "num_mons": 1 2024-09-12T02:27:01.134 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stdout }, 2024-09-12T02:27:01.134 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stdout "osdmap": { 2024-09-12T02:27:01.134 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stdout "epoch": 1, 2024-09-12T02:27:01.134 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stdout "num_osds": 0, 2024-09-12T02:27:01.134 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stdout "num_up_osds": 0, 2024-09-12T02:27:01.134 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stdout "osd_up_since": 0, 2024-09-12T02:27:01.141 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stdout "num_in_osds": 0, 2024-09-12T02:27:01.141 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stdout "osd_in_since": 0, 2024-09-12T02:27:01.141 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stdout "num_remapped_pgs": 0 2024-09-12T02:27:01.141 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stdout }, 2024-09-12T02:27:01.141 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stdout "pgmap": { 2024-09-12T02:27:01.141 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stdout "pgs_by_state": [], 2024-09-12T02:27:01.141 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stdout "num_pgs": 0, 2024-09-12T02:27:01.141 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stdout "num_pools": 0, 2024-09-12T02:27:01.142 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stdout "num_objects": 0, 2024-09-12T02:27:01.142 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stdout "data_bytes": 0, 2024-09-12T02:27:01.142 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stdout "bytes_used": 0, 2024-09-12T02:27:01.142 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stdout "bytes_avail": 0, 2024-09-12T02:27:01.142 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stdout "bytes_total": 0 2024-09-12T02:27:01.142 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stdout }, 2024-09-12T02:27:01.142 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stdout "fsmap": { 2024-09-12T02:27:01.142 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stdout "epoch": 1, 2024-09-12T02:27:01.142 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stdout "btime": "2024-09-12T02:26:43:086025+0000", 2024-09-12T02:27:01.142 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stdout "by_rank": [], 2024-09-12T02:27:01.142 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stdout "up:standby": 0 2024-09-12T02:27:01.142 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stdout }, 2024-09-12T02:27:01.142 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stdout "mgrmap": { 2024-09-12T02:27:01.142 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stdout "available": false, 2024-09-12T02:27:01.142 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stdout "num_standbys": 0, 2024-09-12T02:27:01.142 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stdout "modules": [ 2024-09-12T02:27:01.143 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stdout "iostat", 2024-09-12T02:27:01.143 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stdout "nfs", 2024-09-12T02:27:01.143 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stdout "restful" 2024-09-12T02:27:01.143 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stdout ], 2024-09-12T02:27:01.143 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stdout "services": {} 2024-09-12T02:27:01.143 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stdout }, 2024-09-12T02:27:01.143 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stdout "servicemap": { 2024-09-12T02:27:01.143 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stdout "epoch": 1, 2024-09-12T02:27:01.143 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stdout "modified": "2024-09-12T02:26:43.087007+0000", 2024-09-12T02:27:01.143 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stdout "services": {} 2024-09-12T02:27:01.143 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stdout }, 2024-09-12T02:27:01.143 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stdout "progress_events": {} 2024-09-12T02:27:01.143 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stdout } 2024-09-12T02:27:01.143 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stderr 2024-09-12T02:26:59.986+0000 7fb623e00640 1 Processor -- start 2024-09-12T02:27:01.144 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stderr 2024-09-12T02:26:59.987+0000 7fb623e00640 1 -- start start 2024-09-12T02:27:01.144 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stderr 2024-09-12T02:26:59.987+0000 7fb623e00640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fb6241074e0 0x7fb6241078e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:27:01.144 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stderr 2024-09-12T02:26:59.987+0000 7fb623e00640 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 -- 0x7fb624107eb0 con 0x7fb6241074e0 2024-09-12T02:27:01.144 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stderr 2024-09-12T02:26:59.988+0000 7fb622a00640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fb6241074e0 0x7fb6241078e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:27:01.144 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stderr 2024-09-12T02:26:59.988+0000 7fb622a00640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fb6241074e0 0x7fb6241078e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.39:3300/0 says I am v2:172.21.15.39:34546/0 (socket says 172.21.15.39:34546) 2024-09-12T02:27:01.144 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stderr 2024-09-12T02:26:59.988+0000 7fb622a00640 1 -- 172.21.15.39:0/2032231456 learned_addr learned my addr 172.21.15.39:0/2032231456 (peer_addr_for_me v2:172.21.15.39:0/0) 2024-09-12T02:27:01.144 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stderr 2024-09-12T02:26:59.988+0000 7fb622a00640 1 -- 172.21.15.39:0/2032231456 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb6241086e0 con 0x7fb6241074e0 2024-09-12T02:27:01.144 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stderr 2024-09-12T02:26:59.990+0000 7fb622a00640 1 --2- 172.21.15.39:0/2032231456 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fb6241074e0 0x7fb6241078e0 secure :-1 s=READY pgs=5 cs=0 l=1 rev1=1 crypto rx=0x7fb614009820 tx=0x7fb61402a270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=62ee7be4225729a1 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:27:01.144 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stderr 2024-09-12T02:26:59.990+0000 7fb621600640 1 -- 172.21.15.39:0/2032231456 <== mon.0 v2:172.21.15.39:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fb614037070 con 0x7fb6241074e0 2024-09-12T02:27:01.144 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stderr 2024-09-12T02:26:59.990+0000 7fb621600640 1 -- 172.21.15.39:0/2032231456 <== mon.0 v2:172.21.15.39:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7fb614032900 con 0x7fb6241074e0 2024-09-12T02:27:01.144 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stderr 2024-09-12T02:26:59.990+0000 7fb621600640 1 -- 172.21.15.39:0/2032231456 <== mon.0 v2:172.21.15.39:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fb614030850 con 0x7fb6241074e0 2024-09-12T02:27:01.144 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stderr 2024-09-12T02:26:59.991+0000 7fb623e00640 1 -- 172.21.15.39:0/2032231456 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fb6241074e0 msgr2=0x7fb6241078e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:27:01.144 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stderr 2024-09-12T02:26:59.991+0000 7fb623e00640 1 --2- 172.21.15.39:0/2032231456 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fb6241074e0 0x7fb6241078e0 secure :-1 s=READY pgs=5 cs=0 l=1 rev1=1 crypto rx=0x7fb614009820 tx=0x7fb61402a270 comp rx=0 tx=0).stop 2024-09-12T02:27:01.144 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stderr 2024-09-12T02:26:59.991+0000 7fb623e00640 1 -- 172.21.15.39:0/2032231456 shutdown_connections 2024-09-12T02:27:01.145 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stderr 2024-09-12T02:26:59.991+0000 7fb623e00640 1 --2- 172.21.15.39:0/2032231456 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fb6241074e0 0x7fb6241078e0 unknown :-1 s=CLOSED pgs=5 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:27:01.145 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stderr 2024-09-12T02:26:59.991+0000 7fb623e00640 1 -- 172.21.15.39:0/2032231456 >> 172.21.15.39:0/2032231456 conn(0x7fb624102d10 msgr2=0x7fb624105130 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:27:01.145 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stderr 2024-09-12T02:26:59.991+0000 7fb623e00640 1 -- 172.21.15.39:0/2032231456 shutdown_connections 2024-09-12T02:27:01.145 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stderr 2024-09-12T02:26:59.991+0000 7fb623e00640 1 -- 172.21.15.39:0/2032231456 wait complete. 2024-09-12T02:27:01.145 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stderr 2024-09-12T02:26:59.992+0000 7fb623e00640 1 Processor -- start 2024-09-12T02:27:01.145 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stderr 2024-09-12T02:26:59.993+0000 7fb623e00640 1 -- start start 2024-09-12T02:27:01.145 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stderr 2024-09-12T02:26:59.993+0000 7fb623e00640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fb6241074e0 0x7fb62419b4d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:27:01.145 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stderr 2024-09-12T02:26:59.993+0000 7fb623e00640 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 -- 0x7fb62410ba90 con 0x7fb6241074e0 2024-09-12T02:27:01.145 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stderr 2024-09-12T02:26:59.993+0000 7fb622a00640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fb6241074e0 0x7fb62419b4d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:27:01.145 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stderr 2024-09-12T02:26:59.993+0000 7fb622a00640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fb6241074e0 0x7fb62419b4d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.39:3300/0 says I am v2:172.21.15.39:34560/0 (socket says 172.21.15.39:34560) 2024-09-12T02:27:01.145 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stderr 2024-09-12T02:26:59.993+0000 7fb622a00640 1 -- 172.21.15.39:0/3866168909 learned_addr learned my addr 172.21.15.39:0/3866168909 (peer_addr_for_me v2:172.21.15.39:0/0) 2024-09-12T02:27:01.145 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stderr 2024-09-12T02:26:59.994+0000 7fb622a00640 1 -- 172.21.15.39:0/3866168909 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb62419ba10 con 0x7fb6241074e0 2024-09-12T02:27:01.145 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stderr 2024-09-12T02:26:59.994+0000 7fb622a00640 1 --2- 172.21.15.39:0/3866168909 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fb6241074e0 0x7fb62419b4d0 secure :-1 s=READY pgs=6 cs=0 l=1 rev1=1 crypto rx=0x7fb6140097f0 tx=0x7fb614030d80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:27:01.145 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stderr 2024-09-12T02:26:59.994+0000 7fb61b400640 1 -- 172.21.15.39:0/3866168909 <== mon.0 v2:172.21.15.39:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fb614037040 con 0x7fb6241074e0 2024-09-12T02:27:01.146 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stderr 2024-09-12T02:26:59.994+0000 7fb61b400640 1 -- 172.21.15.39:0/3866168909 <== mon.0 v2:172.21.15.39:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7fb614040070 con 0x7fb6241074e0 2024-09-12T02:27:01.146 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stderr 2024-09-12T02:26:59.994+0000 7fb623e00640 1 -- 172.21.15.39:0/3866168909 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb62419bca0 con 0x7fb6241074e0 2024-09-12T02:27:01.146 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stderr 2024-09-12T02:26:59.994+0000 7fb61b400640 1 -- 172.21.15.39:0/3866168909 <== mon.0 v2:172.21.15.39:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fb61403a390 con 0x7fb6241074e0 2024-09-12T02:27:01.146 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stderr 2024-09-12T02:26:59.994+0000 7fb623e00640 1 -- 172.21.15.39:0/3866168909 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb62419e990 con 0x7fb6241074e0 2024-09-12T02:27:01.146 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stderr 2024-09-12T02:26:59.995+0000 7fb61b400640 1 -- 172.21.15.39:0/3866168909 <== mon.0 v2:172.21.15.39:3300/0 4 ==== mgrmap(e 1) ==== 807+0+0 (secure 0 0 0) 0x7fb61403a5e0 con 0x7fb6241074e0 2024-09-12T02:27:01.146 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stderr 2024-09-12T02:26:59.995+0000 7fb61b400640 1 -- 172.21.15.39:0/3866168909 <== mon.0 v2:172.21.15.39:3300/0 5 ==== osd_map(1..1 src has 1..1) ==== 725+0+0 (secure 0 0 0) 0x7fb614045950 con 0x7fb6241074e0 2024-09-12T02:27:01.146 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stderr 2024-09-12T02:26:59.996+0000 7fb623e00640 1 -- 172.21.15.39:0/3866168909 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fb624107960 con 0x7fb6241074e0 2024-09-12T02:27:01.146 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stderr 2024-09-12T02:27:00.000+0000 7fb61b400640 1 -- 172.21.15.39:0/3866168909 <== mon.0 v2:172.21.15.39:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+74432 (secure 0 0 0) 0x7fb614045460 con 0x7fb6241074e0 2024-09-12T02:27:01.146 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stderr 2024-09-12T02:27:00.066+0000 7fb623e00640 1 -- 172.21.15.39:0/3866168909 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_command({"prefix": "status", "format": "json-pretty"} v 0) -- 0x7fb62407c060 con 0x7fb6241074e0 2024-09-12T02:27:01.146 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stderr 2024-09-12T02:27:00.066+0000 7fb61b400640 1 -- 172.21.15.39:0/3866168909 <== mon.0 v2:172.21.15.39:3300/0 7 ==== mon_command_ack([{"prefix": "status", "format": "json-pretty"}]=0 v0) ==== 79+0+1291 (secure 0 0 0) 0x7fb61403b430 con 0x7fb6241074e0 2024-09-12T02:27:01.146 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stderr 2024-09-12T02:27:00.068+0000 7fb623e00640 1 -- 172.21.15.39:0/3866168909 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fb6241074e0 msgr2=0x7fb62419b4d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:27:01.146 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stderr 2024-09-12T02:27:00.068+0000 7fb623e00640 1 --2- 172.21.15.39:0/3866168909 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fb6241074e0 0x7fb62419b4d0 secure :-1 s=READY pgs=6 cs=0 l=1 rev1=1 crypto rx=0x7fb6140097f0 tx=0x7fb614030d80 comp rx=0 tx=0).stop 2024-09-12T02:27:01.146 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stderr 2024-09-12T02:27:00.068+0000 7fb623e00640 1 -- 172.21.15.39:0/3866168909 shutdown_connections 2024-09-12T02:27:01.146 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stderr 2024-09-12T02:27:00.068+0000 7fb623e00640 1 --2- 172.21.15.39:0/3866168909 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fb6241074e0 0x7fb62419b4d0 unknown :-1 s=CLOSED pgs=6 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:27:01.147 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stderr 2024-09-12T02:27:00.068+0000 7fb623e00640 1 -- 172.21.15.39:0/3866168909 >> 172.21.15.39:0/3866168909 conn(0x7fb624102d10 msgr2=0x7fb624103820 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:27:01.147 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stderr 2024-09-12T02:27:00.068+0000 7fb623e00640 1 -- 172.21.15.39:0/3866168909 shutdown_connections 2024-09-12T02:27:01.147 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stderr 2024-09-12T02:27:00.068+0000 7fb623e00640 1 -- 172.21.15.39:0/3866168909 wait complete. 2024-09-12T02:27:01.147 INFO:teuthology.orchestra.run.smithi039.stdout:mgr not available, waiting (1/15)... 2024-09-12T02:27:02.349 INFO:journalctl@ceph.mgr.x.smithi039.stdout:Sep 12 02:27:02 smithi039 ceph-4954ed46-70ae-11ef-bcea-c7b262605968-mgr-x[30736]: 2024-09-12T02:27:02.036+0000 7f18fd22d040 -1 mgr[py] Module telemetry has missing NOTIFY_TYPES member 2024-09-12T02:27:02.350 INFO:journalctl@ceph.mgr.x.smithi039.stdout:Sep 12 02:27:02 smithi039 ceph-4954ed46-70ae-11ef-bcea-c7b262605968-mgr-x[30736]: 2024-09-12T02:27:02.120+0000 7f18fd22d040 -1 mgr[py] Module balancer has missing NOTIFY_TYPES member 2024-09-12T02:27:03.444 INFO:journalctl@ceph.mgr.x.smithi039.stdout:Sep 12 02:27:03 smithi039 ceph-4954ed46-70ae-11ef-bcea-c7b262605968-mgr-x[30736]: 2024-09-12T02:27:03.113+0000 7f18fd22d040 -1 mgr[py] Module rook has missing NOTIFY_TYPES member 2024-09-12T02:27:03.445 INFO:journalctl@ceph.mgr.x.smithi039.stdout:Sep 12 02:27:03 smithi039 ceph-4954ed46-70ae-11ef-bcea-c7b262605968-mgr-x[30736]: 2024-09-12T02:27:03.268+0000 7f18fd22d040 -1 mgr[py] Module iostat has missing NOTIFY_TYPES member 2024-09-12T02:27:03.445 INFO:journalctl@ceph.mgr.x.smithi039.stdout:Sep 12 02:27:03 smithi039 ceph-4954ed46-70ae-11ef-bcea-c7b262605968-mgr-x[30736]: 2024-09-12T02:27:03.443+0000 7f18fd22d040 -1 mgr[py] Module orchestrator has missing NOTIFY_TYPES member 2024-09-12T02:27:03.696 INFO:journalctl@ceph.mgr.x.smithi039.stdout:Sep 12 02:27:03 smithi039 ceph-4954ed46-70ae-11ef-bcea-c7b262605968-mgr-x[30736]: 2024-09-12T02:27:03.521+0000 7f18fd22d040 -1 mgr[py] Module devicehealth has missing NOTIFY_TYPES member 2024-09-12T02:27:04.072 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 02:27:03 smithi039 ceph-mon[30515]: from='client.? 172.21.15.39:0/3222601242' entity='client.admin' cmd=[{"prefix": "status", "format": "json-pretty"}]: dispatch 2024-09-12T02:27:04.072 INFO:journalctl@ceph.mgr.x.smithi039.stdout:Sep 12 02:27:03 smithi039 ceph-4954ed46-70ae-11ef-bcea-c7b262605968-mgr-x[30736]: 2024-09-12T02:27:03.709+0000 7f18fd22d040 -1 mgr[py] Module rgw has missing NOTIFY_TYPES member 2024-09-12T02:27:04.072 INFO:journalctl@ceph.mgr.x.smithi039.stdout:Sep 12 02:27:03 smithi039 ceph-4954ed46-70ae-11ef-bcea-c7b262605968-mgr-x[30736]: 2024-09-12T02:27:03.796+0000 7f18fd22d040 -1 mgr[py] Module alerts has missing NOTIFY_TYPES member 2024-09-12T02:27:04.072 INFO:journalctl@ceph.mgr.x.smithi039.stdout:Sep 12 02:27:03 smithi039 ceph-4954ed46-70ae-11ef-bcea-c7b262605968-mgr-x[30736]: 2024-09-12T02:27:03.882+0000 7f18fd22d040 -1 mgr[py] Module progress has missing NOTIFY_TYPES member 2024-09-12T02:27:04.073 INFO:journalctl@ceph.mgr.x.smithi039.stdout:Sep 12 02:27:04 smithi039 ceph-4954ed46-70ae-11ef-bcea-c7b262605968-mgr-x[30736]: 2024-09-12T02:27:04.071+0000 7f18fd22d040 -1 mgr[py] Module nfs has missing NOTIFY_TYPES member 2024-09-12T02:27:04.327 INFO:journalctl@ceph.mgr.x.smithi039.stdout:Sep 12 02:27:04 smithi039 ceph-4954ed46-70ae-11ef-bcea-c7b262605968-mgr-x[30736]: 2024-09-12T02:27:04.152+0000 7f18fd22d040 -1 mgr[py] Module status has missing NOTIFY_TYPES member 2024-09-12T02:27:04.327 INFO:journalctl@ceph.mgr.x.smithi039.stdout:Sep 12 02:27:04 smithi039 ceph-4954ed46-70ae-11ef-bcea-c7b262605968-mgr-x[30736]: 2024-09-12T02:27:04.235+0000 7f18fd22d040 -1 mgr[py] Module pg_autoscaler has missing NOTIFY_TYPES member 2024-09-12T02:27:04.469 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stdout 2024-09-12T02:27:04.472 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stdout { 2024-09-12T02:27:04.472 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stdout "fsid": "4954ed46-70ae-11ef-bcea-c7b262605968", 2024-09-12T02:27:04.472 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stdout "health": { 2024-09-12T02:27:04.472 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stdout "status": "HEALTH_OK", 2024-09-12T02:27:04.472 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stdout "checks": {}, 2024-09-12T02:27:04.472 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stdout "mutes": [] 2024-09-12T02:27:04.472 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stdout }, 2024-09-12T02:27:04.473 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stdout "election_epoch": 5, 2024-09-12T02:27:04.473 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stdout "quorum": [ 2024-09-12T02:27:04.473 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stdout 0 2024-09-12T02:27:04.473 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stdout ], 2024-09-12T02:27:04.473 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stdout "quorum_names": [ 2024-09-12T02:27:04.473 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stdout "a" 2024-09-12T02:27:04.473 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stdout ], 2024-09-12T02:27:04.473 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stdout "quorum_age": 6, 2024-09-12T02:27:04.473 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stdout "monmap": { 2024-09-12T02:27:04.473 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stdout "epoch": 1, 2024-09-12T02:27:04.473 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stdout "min_mon_release_name": "squid", 2024-09-12T02:27:04.473 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stdout "num_mons": 1 2024-09-12T02:27:04.473 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stdout }, 2024-09-12T02:27:04.473 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stdout "osdmap": { 2024-09-12T02:27:04.474 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stdout "epoch": 1, 2024-09-12T02:27:04.474 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stdout "num_osds": 0, 2024-09-12T02:27:04.474 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stdout "num_up_osds": 0, 2024-09-12T02:27:04.474 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stdout "osd_up_since": 0, 2024-09-12T02:27:04.481 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stdout "num_in_osds": 0, 2024-09-12T02:27:04.481 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stdout "osd_in_since": 0, 2024-09-12T02:27:04.481 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stdout "num_remapped_pgs": 0 2024-09-12T02:27:04.481 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stdout }, 2024-09-12T02:27:04.481 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stdout "pgmap": { 2024-09-12T02:27:04.481 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stdout "pgs_by_state": [], 2024-09-12T02:27:04.481 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stdout "num_pgs": 0, 2024-09-12T02:27:04.482 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stdout "num_pools": 0, 2024-09-12T02:27:04.482 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stdout "num_objects": 0, 2024-09-12T02:27:04.482 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stdout "data_bytes": 0, 2024-09-12T02:27:04.482 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stdout "bytes_used": 0, 2024-09-12T02:27:04.482 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stdout "bytes_avail": 0, 2024-09-12T02:27:04.482 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stdout "bytes_total": 0 2024-09-12T02:27:04.482 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stdout }, 2024-09-12T02:27:04.482 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stdout "fsmap": { 2024-09-12T02:27:04.482 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stdout "epoch": 1, 2024-09-12T02:27:04.482 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stdout "btime": "2024-09-12T02:26:43:086025+0000", 2024-09-12T02:27:04.482 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stdout "by_rank": [], 2024-09-12T02:27:04.482 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stdout "up:standby": 0 2024-09-12T02:27:04.482 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stdout }, 2024-09-12T02:27:04.482 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stdout "mgrmap": { 2024-09-12T02:27:04.483 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stdout "available": false, 2024-09-12T02:27:04.483 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stdout "num_standbys": 0, 2024-09-12T02:27:04.483 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stdout "modules": [ 2024-09-12T02:27:04.483 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stdout "iostat", 2024-09-12T02:27:04.483 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stdout "nfs", 2024-09-12T02:27:04.483 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stdout "restful" 2024-09-12T02:27:04.483 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stdout ], 2024-09-12T02:27:04.483 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stdout "services": {} 2024-09-12T02:27:04.483 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stdout }, 2024-09-12T02:27:04.483 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stdout "servicemap": { 2024-09-12T02:27:04.483 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stdout "epoch": 1, 2024-09-12T02:27:04.483 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stdout "modified": "2024-09-12T02:26:43.087007+0000", 2024-09-12T02:27:04.483 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stdout "services": {} 2024-09-12T02:27:04.483 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stdout }, 2024-09-12T02:27:04.484 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stdout "progress_events": {} 2024-09-12T02:27:04.484 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stdout } 2024-09-12T02:27:04.484 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stderr 2024-09-12T02:27:03.695+0000 7fc2f1600640 1 Processor -- start 2024-09-12T02:27:04.484 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stderr 2024-09-12T02:27:03.695+0000 7fc2f1600640 1 -- start start 2024-09-12T02:27:04.484 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stderr 2024-09-12T02:27:03.696+0000 7fc2f1600640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fc2ec109880 0x7fc2ec109c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:27:04.484 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stderr 2024-09-12T02:27:03.696+0000 7fc2f1600640 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 -- 0x7fc2ec10a250 con 0x7fc2ec109880 2024-09-12T02:27:04.484 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stderr 2024-09-12T02:27:03.696+0000 7fc2eaa00640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fc2ec109880 0x7fc2ec109c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:27:04.484 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stderr 2024-09-12T02:27:03.696+0000 7fc2eaa00640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fc2ec109880 0x7fc2ec109c80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.39:3300/0 says I am v2:172.21.15.39:34564/0 (socket says 172.21.15.39:34564) 2024-09-12T02:27:04.484 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stderr 2024-09-12T02:27:03.696+0000 7fc2eaa00640 1 -- 172.21.15.39:0/944373474 learned_addr learned my addr 172.21.15.39:0/944373474 (peer_addr_for_me v2:172.21.15.39:0/0) 2024-09-12T02:27:04.484 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stderr 2024-09-12T02:27:03.697+0000 7fc2eaa00640 1 -- 172.21.15.39:0/944373474 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc2ec10aa80 con 0x7fc2ec109880 2024-09-12T02:27:04.484 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stderr 2024-09-12T02:27:03.698+0000 7fc2eaa00640 1 --2- 172.21.15.39:0/944373474 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fc2ec109880 0x7fc2ec109c80 secure :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0x7fc2dc009820 tx=0x7fc2dc02a270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7f0c4a8d03b57e52 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:27:04.484 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stderr 2024-09-12T02:27:03.698+0000 7fc2e9600640 1 -- 172.21.15.39:0/944373474 <== mon.0 v2:172.21.15.39:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fc2dc037070 con 0x7fc2ec109880 2024-09-12T02:27:04.484 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stderr 2024-09-12T02:27:03.698+0000 7fc2e9600640 1 -- 172.21.15.39:0/944373474 <== mon.0 v2:172.21.15.39:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7fc2dc032900 con 0x7fc2ec109880 2024-09-12T02:27:04.484 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stderr 2024-09-12T02:27:03.698+0000 7fc2e9600640 1 -- 172.21.15.39:0/944373474 <== mon.0 v2:172.21.15.39:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fc2dc030850 con 0x7fc2ec109880 2024-09-12T02:27:04.484 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stderr 2024-09-12T02:27:03.699+0000 7fc2f1600640 1 -- 172.21.15.39:0/944373474 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fc2ec109880 msgr2=0x7fc2ec109c80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:27:04.485 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stderr 2024-09-12T02:27:03.699+0000 7fc2f1600640 1 --2- 172.21.15.39:0/944373474 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fc2ec109880 0x7fc2ec109c80 secure :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0x7fc2dc009820 tx=0x7fc2dc02a270 comp rx=0 tx=0).stop 2024-09-12T02:27:04.485 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stderr 2024-09-12T02:27:03.699+0000 7fc2f1600640 1 -- 172.21.15.39:0/944373474 shutdown_connections 2024-09-12T02:27:04.485 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stderr 2024-09-12T02:27:03.699+0000 7fc2f1600640 1 --2- 172.21.15.39:0/944373474 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fc2ec109880 0x7fc2ec109c80 unknown :-1 s=CLOSED pgs=7 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:27:04.485 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stderr 2024-09-12T02:27:03.699+0000 7fc2f1600640 1 -- 172.21.15.39:0/944373474 >> 172.21.15.39:0/944373474 conn(0x7fc2ec07ce60 msgr2=0x7fc2ec07d270 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:27:04.485 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stderr 2024-09-12T02:27:03.699+0000 7fc2f1600640 1 -- 172.21.15.39:0/944373474 shutdown_connections 2024-09-12T02:27:04.485 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stderr 2024-09-12T02:27:03.699+0000 7fc2f1600640 1 -- 172.21.15.39:0/944373474 wait complete. 2024-09-12T02:27:04.485 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stderr 2024-09-12T02:27:03.700+0000 7fc2f1600640 1 Processor -- start 2024-09-12T02:27:04.485 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stderr 2024-09-12T02:27:03.700+0000 7fc2f1600640 1 -- start start 2024-09-12T02:27:04.485 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stderr 2024-09-12T02:27:03.700+0000 7fc2f1600640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fc2ec109880 0x7fc2ec19d880 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:27:04.485 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stderr 2024-09-12T02:27:03.700+0000 7fc2f1600640 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 -- 0x7fc2ec10de30 con 0x7fc2ec109880 2024-09-12T02:27:04.485 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stderr 2024-09-12T02:27:03.701+0000 7fc2eaa00640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fc2ec109880 0x7fc2ec19d880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:27:04.485 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stderr 2024-09-12T02:27:03.701+0000 7fc2eaa00640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fc2ec109880 0x7fc2ec19d880 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.39:3300/0 says I am v2:172.21.15.39:34576/0 (socket says 172.21.15.39:34576) 2024-09-12T02:27:04.485 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stderr 2024-09-12T02:27:03.701+0000 7fc2eaa00640 1 -- 172.21.15.39:0/3222601242 learned_addr learned my addr 172.21.15.39:0/3222601242 (peer_addr_for_me v2:172.21.15.39:0/0) 2024-09-12T02:27:04.485 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stderr 2024-09-12T02:27:03.701+0000 7fc2eaa00640 1 -- 172.21.15.39:0/3222601242 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc2ec19ddc0 con 0x7fc2ec109880 2024-09-12T02:27:04.486 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stderr 2024-09-12T02:27:03.702+0000 7fc2eaa00640 1 --2- 172.21.15.39:0/3222601242 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fc2ec109880 0x7fc2ec19d880 secure :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0x7fc2dc0097f0 tx=0x7fc2dc030d80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:27:04.486 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stderr 2024-09-12T02:27:03.702+0000 7fc2e3400640 1 -- 172.21.15.39:0/3222601242 <== mon.0 v2:172.21.15.39:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fc2dc037040 con 0x7fc2ec109880 2024-09-12T02:27:04.486 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stderr 2024-09-12T02:27:03.702+0000 7fc2e3400640 1 -- 172.21.15.39:0/3222601242 <== mon.0 v2:172.21.15.39:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7fc2dc040070 con 0x7fc2ec109880 2024-09-12T02:27:04.486 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stderr 2024-09-12T02:27:03.702+0000 7fc2e3400640 1 -- 172.21.15.39:0/3222601242 <== mon.0 v2:172.21.15.39:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fc2dc03a390 con 0x7fc2ec109880 2024-09-12T02:27:04.486 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stderr 2024-09-12T02:27:03.702+0000 7fc2f1600640 1 -- 172.21.15.39:0/3222601242 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc2ec19e050 con 0x7fc2ec109880 2024-09-12T02:27:04.486 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stderr 2024-09-12T02:27:03.702+0000 7fc2f1600640 1 -- 172.21.15.39:0/3222601242 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc2ec1a0d40 con 0x7fc2ec109880 2024-09-12T02:27:04.486 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stderr 2024-09-12T02:27:03.702+0000 7fc2e3400640 1 -- 172.21.15.39:0/3222601242 <== mon.0 v2:172.21.15.39:3300/0 4 ==== mgrmap(e 1) ==== 807+0+0 (secure 0 0 0) 0x7fc2dc03a630 con 0x7fc2ec109880 2024-09-12T02:27:04.486 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stderr 2024-09-12T02:27:03.703+0000 7fc2e3400640 1 -- 172.21.15.39:0/3222601242 <== mon.0 v2:172.21.15.39:3300/0 5 ==== osd_map(1..1 src has 1..1) ==== 725+0+0 (secure 0 0 0) 0x7fc2dc0459a0 con 0x7fc2ec109880 2024-09-12T02:27:04.486 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stderr 2024-09-12T02:27:03.703+0000 7fc2f1600640 1 -- 172.21.15.39:0/3222601242 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fc2ec109d00 con 0x7fc2ec109880 2024-09-12T02:27:04.486 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stderr 2024-09-12T02:27:03.708+0000 7fc2e3400640 1 -- 172.21.15.39:0/3222601242 <== mon.0 v2:172.21.15.39:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+74432 (secure 0 0 0) 0x7fc2dc045460 con 0x7fc2ec109880 2024-09-12T02:27:04.486 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stderr 2024-09-12T02:27:03.774+0000 7fc2f1600640 1 -- 172.21.15.39:0/3222601242 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_command({"prefix": "status", "format": "json-pretty"} v 0) -- 0x7fc2ec1a0f10 con 0x7fc2ec109880 2024-09-12T02:27:04.486 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stderr 2024-09-12T02:27:03.774+0000 7fc2e3400640 1 -- 172.21.15.39:0/3222601242 <== mon.0 v2:172.21.15.39:3300/0 7 ==== mon_command_ack([{"prefix": "status", "format": "json-pretty"}]=0 v0) ==== 79+0+1291 (secure 0 0 0) 0x7fc2dc03b430 con 0x7fc2ec109880 2024-09-12T02:27:04.486 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stderr 2024-09-12T02:27:03.775+0000 7fc2f1600640 1 -- 172.21.15.39:0/3222601242 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fc2ec109880 msgr2=0x7fc2ec19d880 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:27:04.486 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stderr 2024-09-12T02:27:03.775+0000 7fc2f1600640 1 --2- 172.21.15.39:0/3222601242 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fc2ec109880 0x7fc2ec19d880 secure :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0x7fc2dc0097f0 tx=0x7fc2dc030d80 comp rx=0 tx=0).stop 2024-09-12T02:27:04.487 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stderr 2024-09-12T02:27:03.775+0000 7fc2f1600640 1 -- 172.21.15.39:0/3222601242 shutdown_connections 2024-09-12T02:27:04.487 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stderr 2024-09-12T02:27:03.775+0000 7fc2f1600640 1 --2- 172.21.15.39:0/3222601242 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fc2ec109880 0x7fc2ec19d880 unknown :-1 s=CLOSED pgs=8 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:27:04.487 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stderr 2024-09-12T02:27:03.775+0000 7fc2f1600640 1 -- 172.21.15.39:0/3222601242 >> 172.21.15.39:0/3222601242 conn(0x7fc2ec07ce60 msgr2=0x7fc2ec106cd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:27:04.487 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stderr 2024-09-12T02:27:03.776+0000 7fc2f1600640 1 -- 172.21.15.39:0/3222601242 shutdown_connections 2024-09-12T02:27:04.487 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stderr 2024-09-12T02:27:03.776+0000 7fc2f1600640 1 -- 172.21.15.39:0/3222601242 wait complete. 2024-09-12T02:27:04.487 INFO:teuthology.orchestra.run.smithi039.stdout:mgr not available, waiting (2/15)... 2024-09-12T02:27:04.599 INFO:journalctl@ceph.mgr.x.smithi039.stdout:Sep 12 02:27:04 smithi039 ceph-4954ed46-70ae-11ef-bcea-c7b262605968-mgr-x[30736]: 2024-09-12T02:27:04.336+0000 7f18fd22d040 -1 mgr[py] Module rbd_support has missing NOTIFY_TYPES member 2024-09-12T02:27:04.599 INFO:journalctl@ceph.mgr.x.smithi039.stdout:Sep 12 02:27:04 smithi039 ceph-4954ed46-70ae-11ef-bcea-c7b262605968-mgr-x[30736]: 2024-09-12T02:27:04.410+0000 7f18fd22d040 -1 mgr[py] Module influx has missing NOTIFY_TYPES member 2024-09-12T02:27:04.599 INFO:journalctl@ceph.mgr.x.smithi039.stdout:Sep 12 02:27:04 smithi039 ceph-4954ed46-70ae-11ef-bcea-c7b262605968-mgr-x[30736]: 2024-09-12T02:27:04.487+0000 7f18fd22d040 -1 mgr[py] Module zabbix has missing NOTIFY_TYPES member 2024-09-12T02:27:05.849 INFO:journalctl@ceph.mgr.x.smithi039.stdout:Sep 12 02:27:05 smithi039 ceph-4954ed46-70ae-11ef-bcea-c7b262605968-mgr-x[30736]: 2024-09-12T02:27:05.440+0000 7f18fd22d040 -1 mgr[py] Module telegraf has missing NOTIFY_TYPES member 2024-09-12T02:27:05.850 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 02:27:05 smithi039 ceph-mon[30515]: Activating manager daemon x 2024-09-12T02:27:05.850 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 02:27:05 smithi039 ceph-mon[30515]: mgrmap e2: x(active, starting, since 0.00460718s) 2024-09-12T02:27:05.850 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 02:27:05 smithi039 ceph-mon[30515]: from='mgr.14100 172.21.15.39:0/2464160670' entity='mgr.x' cmd=[{"prefix": "mds metadata"}]: dispatch 2024-09-12T02:27:05.850 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 02:27:05 smithi039 ceph-mon[30515]: from='mgr.14100 172.21.15.39:0/2464160670' entity='mgr.x' cmd=[{"prefix": "osd metadata"}]: dispatch 2024-09-12T02:27:05.850 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 02:27:05 smithi039 ceph-mon[30515]: from='mgr.14100 172.21.15.39:0/2464160670' entity='mgr.x' cmd=[{"prefix": "mon metadata"}]: dispatch 2024-09-12T02:27:05.850 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 02:27:05 smithi039 ceph-mon[30515]: from='mgr.14100 172.21.15.39:0/2464160670' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2024-09-12T02:27:05.850 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 02:27:05 smithi039 ceph-mon[30515]: from='mgr.14100 172.21.15.39:0/2464160670' entity='mgr.x' cmd=[{"prefix": "mgr metadata", "who": "x", "id": "x"}]: dispatch 2024-09-12T02:27:05.850 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 02:27:05 smithi039 ceph-mon[30515]: Manager daemon x is now available 2024-09-12T02:27:05.850 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 02:27:05 smithi039 ceph-mon[30515]: from='mgr.14100 172.21.15.39:0/2464160670' entity='mgr.x' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/x/mirror_snapshot_schedule"}]: dispatch 2024-09-12T02:27:05.851 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 02:27:05 smithi039 ceph-mon[30515]: from='mgr.14100 172.21.15.39:0/2464160670' entity='mgr.x' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/x/trash_purge_schedule"}]: dispatch 2024-09-12T02:27:05.851 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 02:27:05 smithi039 ceph-mon[30515]: from='mgr.14100 172.21.15.39:0/2464160670' entity='mgr.x' 2024-09-12T02:27:05.851 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 02:27:05 smithi039 ceph-mon[30515]: from='mgr.14100 172.21.15.39:0/2464160670' entity='mgr.x' 2024-09-12T02:27:05.851 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 02:27:05 smithi039 ceph-mon[30515]: from='mgr.14100 172.21.15.39:0/2464160670' entity='mgr.x' 2024-09-12T02:27:07.574 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 02:27:07 smithi039 ceph-mon[30515]: mgrmap e3: x(active, since 1.01046s) 2024-09-12T02:27:07.575 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 02:27:07 smithi039 ceph-mon[30515]: from='client.? 172.21.15.39:0/2644411814' entity='client.admin' cmd=[{"prefix": "status", "format": "json-pretty"}]: dispatch 2024-09-12T02:27:07.860 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stdout 2024-09-12T02:27:07.860 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stdout { 2024-09-12T02:27:07.860 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stdout "fsid": "4954ed46-70ae-11ef-bcea-c7b262605968", 2024-09-12T02:27:07.861 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stdout "health": { 2024-09-12T02:27:07.861 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stdout "status": "HEALTH_OK", 2024-09-12T02:27:07.861 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stdout "checks": {}, 2024-09-12T02:27:07.861 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stdout "mutes": [] 2024-09-12T02:27:07.861 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stdout }, 2024-09-12T02:27:07.861 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stdout "election_epoch": 5, 2024-09-12T02:27:07.861 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stdout "quorum": [ 2024-09-12T02:27:07.861 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stdout 0 2024-09-12T02:27:07.861 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stdout ], 2024-09-12T02:27:07.861 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stdout "quorum_names": [ 2024-09-12T02:27:07.861 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stdout "a" 2024-09-12T02:27:07.861 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stdout ], 2024-09-12T02:27:07.861 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stdout "quorum_age": 10, 2024-09-12T02:27:07.861 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stdout "monmap": { 2024-09-12T02:27:07.862 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stdout "epoch": 1, 2024-09-12T02:27:07.862 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stdout "min_mon_release_name": "squid", 2024-09-12T02:27:07.862 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stdout "num_mons": 1 2024-09-12T02:27:07.862 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stdout }, 2024-09-12T02:27:07.862 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stdout "osdmap": { 2024-09-12T02:27:07.862 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stdout "epoch": 1, 2024-09-12T02:27:07.862 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stdout "num_osds": 0, 2024-09-12T02:27:07.862 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stdout "num_up_osds": 0, 2024-09-12T02:27:07.862 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stdout "osd_up_since": 0, 2024-09-12T02:27:07.871 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stdout "num_in_osds": 0, 2024-09-12T02:27:07.871 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stdout "osd_in_since": 0, 2024-09-12T02:27:07.871 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stdout "num_remapped_pgs": 0 2024-09-12T02:27:07.871 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stdout }, 2024-09-12T02:27:07.871 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stdout "pgmap": { 2024-09-12T02:27:07.871 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stdout "pgs_by_state": [], 2024-09-12T02:27:07.871 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stdout "num_pgs": 0, 2024-09-12T02:27:07.871 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stdout "num_pools": 0, 2024-09-12T02:27:07.871 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stdout "num_objects": 0, 2024-09-12T02:27:07.871 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stdout "data_bytes": 0, 2024-09-12T02:27:07.872 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stdout "bytes_used": 0, 2024-09-12T02:27:07.872 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stdout "bytes_avail": 0, 2024-09-12T02:27:07.872 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stdout "bytes_total": 0 2024-09-12T02:27:07.872 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stdout }, 2024-09-12T02:27:07.872 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stdout "fsmap": { 2024-09-12T02:27:07.872 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stdout "epoch": 1, 2024-09-12T02:27:07.872 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stdout "btime": "2024-09-12T02:26:43:086025+0000", 2024-09-12T02:27:07.872 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stdout "by_rank": [], 2024-09-12T02:27:07.872 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stdout "up:standby": 0 2024-09-12T02:27:07.872 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stdout }, 2024-09-12T02:27:07.872 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stdout "mgrmap": { 2024-09-12T02:27:07.872 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stdout "available": true, 2024-09-12T02:27:07.872 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stdout "num_standbys": 0, 2024-09-12T02:27:07.873 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stdout "modules": [ 2024-09-12T02:27:07.873 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stdout "iostat", 2024-09-12T02:27:07.873 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stdout "nfs", 2024-09-12T02:27:07.873 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stdout "restful" 2024-09-12T02:27:07.873 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stdout ], 2024-09-12T02:27:07.873 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stdout "services": {} 2024-09-12T02:27:07.873 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stdout }, 2024-09-12T02:27:07.873 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stdout "servicemap": { 2024-09-12T02:27:07.873 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stdout "epoch": 1, 2024-09-12T02:27:07.873 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stdout "modified": "2024-09-12T02:26:43.087007+0000", 2024-09-12T02:27:07.873 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stdout "services": {} 2024-09-12T02:27:07.874 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stdout }, 2024-09-12T02:27:07.874 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stdout "progress_events": {} 2024-09-12T02:27:07.874 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stdout } 2024-09-12T02:27:07.874 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stderr 2024-09-12T02:27:06.962+0000 7f080f400640 1 Processor -- start 2024-09-12T02:27:07.874 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stderr 2024-09-12T02:27:06.962+0000 7f080f400640 1 -- start start 2024-09-12T02:27:07.874 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stderr 2024-09-12T02:27:06.962+0000 7f080f400640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f0808109930 0x7f0808109d30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:27:07.874 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stderr 2024-09-12T02:27:06.962+0000 7f080f400640 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 -- 0x7f080810a300 con 0x7f0808109930 2024-09-12T02:27:07.874 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stderr 2024-09-12T02:27:06.963+0000 7f080ca00640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f0808109930 0x7f0808109d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:27:07.874 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stderr 2024-09-12T02:27:06.963+0000 7f080ca00640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f0808109930 0x7f0808109d30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.39:3300/0 says I am v2:172.21.15.39:34638/0 (socket says 172.21.15.39:34638) 2024-09-12T02:27:07.874 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stderr 2024-09-12T02:27:06.963+0000 7f080ca00640 1 -- 172.21.15.39:0/1226788979 learned_addr learned my addr 172.21.15.39:0/1226788979 (peer_addr_for_me v2:172.21.15.39:0/0) 2024-09-12T02:27:07.874 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stderr 2024-09-12T02:27:06.963+0000 7f080ca00640 1 -- 172.21.15.39:0/1226788979 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f080810aae0 con 0x7f0808109930 2024-09-12T02:27:07.874 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stderr 2024-09-12T02:27:06.964+0000 7f080ca00640 1 --2- 172.21.15.39:0/1226788979 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f0808109930 0x7f0808109d30 secure :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0x7f07fc009820 tx=0x7f07fc02a270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=90373f1f7547bd14 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:27:07.874 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stderr 2024-09-12T02:27:06.965+0000 7f0807400640 1 -- 172.21.15.39:0/1226788979 <== mon.0 v2:172.21.15.39:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f07fc037070 con 0x7f0808109930 2024-09-12T02:27:07.875 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stderr 2024-09-12T02:27:06.965+0000 7f0807400640 1 -- 172.21.15.39:0/1226788979 <== mon.0 v2:172.21.15.39:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7f07fc032900 con 0x7f0808109930 2024-09-12T02:27:07.875 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stderr 2024-09-12T02:27:06.965+0000 7f0807400640 1 -- 172.21.15.39:0/1226788979 <== mon.0 v2:172.21.15.39:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f07fc030850 con 0x7f0808109930 2024-09-12T02:27:07.875 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stderr 2024-09-12T02:27:06.965+0000 7f080f400640 1 -- 172.21.15.39:0/1226788979 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f0808109930 msgr2=0x7f0808109d30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:27:07.875 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stderr 2024-09-12T02:27:06.965+0000 7f080f400640 1 --2- 172.21.15.39:0/1226788979 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f0808109930 0x7f0808109d30 secure :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0x7f07fc009820 tx=0x7f07fc02a270 comp rx=0 tx=0).stop 2024-09-12T02:27:07.875 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stderr 2024-09-12T02:27:06.965+0000 7f080f400640 1 -- 172.21.15.39:0/1226788979 shutdown_connections 2024-09-12T02:27:07.875 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stderr 2024-09-12T02:27:06.965+0000 7f080f400640 1 --2- 172.21.15.39:0/1226788979 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f0808109930 0x7f0808109d30 unknown :-1 s=CLOSED pgs=16 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:27:07.875 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stderr 2024-09-12T02:27:06.965+0000 7f080f400640 1 -- 172.21.15.39:0/1226788979 >> 172.21.15.39:0/1226788979 conn(0x7f080807cf00 msgr2=0x7f080807d310 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:27:07.875 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stderr 2024-09-12T02:27:06.965+0000 7f080f400640 1 -- 172.21.15.39:0/1226788979 shutdown_connections 2024-09-12T02:27:07.875 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stderr 2024-09-12T02:27:06.965+0000 7f080f400640 1 -- 172.21.15.39:0/1226788979 wait complete. 2024-09-12T02:27:07.875 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stderr 2024-09-12T02:27:06.966+0000 7f080f400640 1 Processor -- start 2024-09-12T02:27:07.876 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stderr 2024-09-12T02:27:06.967+0000 7f080f400640 1 -- start start 2024-09-12T02:27:07.876 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stderr 2024-09-12T02:27:06.967+0000 7f080f400640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f0808109930 0x7f080819d8c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:27:07.876 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stderr 2024-09-12T02:27:06.967+0000 7f080f400640 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 -- 0x7f080810de90 con 0x7f0808109930 2024-09-12T02:27:07.876 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stderr 2024-09-12T02:27:06.967+0000 7f080ca00640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f0808109930 0x7f080819d8c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:27:07.876 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stderr 2024-09-12T02:27:06.967+0000 7f080ca00640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f0808109930 0x7f080819d8c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.39:3300/0 says I am v2:172.21.15.39:34654/0 (socket says 172.21.15.39:34654) 2024-09-12T02:27:07.876 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stderr 2024-09-12T02:27:06.967+0000 7f080ca00640 1 -- 172.21.15.39:0/2644411814 learned_addr learned my addr 172.21.15.39:0/2644411814 (peer_addr_for_me v2:172.21.15.39:0/0) 2024-09-12T02:27:07.876 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stderr 2024-09-12T02:27:06.967+0000 7f080ca00640 1 -- 172.21.15.39:0/2644411814 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f080819de00 con 0x7f0808109930 2024-09-12T02:27:07.876 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stderr 2024-09-12T02:27:06.968+0000 7f080ca00640 1 --2- 172.21.15.39:0/2644411814 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f0808109930 0x7f080819d8c0 secure :-1 s=READY pgs=17 cs=0 l=1 rev1=1 crypto rx=0x7f07fc0097f0 tx=0x7f07fc030d80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:27:07.876 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stderr 2024-09-12T02:27:06.968+0000 7f0805600640 1 -- 172.21.15.39:0/2644411814 <== mon.0 v2:172.21.15.39:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f07fc037040 con 0x7f0808109930 2024-09-12T02:27:07.876 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stderr 2024-09-12T02:27:06.968+0000 7f0805600640 1 -- 172.21.15.39:0/2644411814 <== mon.0 v2:172.21.15.39:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7f07fc040070 con 0x7f0808109930 2024-09-12T02:27:07.876 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stderr 2024-09-12T02:27:06.968+0000 7f0805600640 1 -- 172.21.15.39:0/2644411814 <== mon.0 v2:172.21.15.39:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f07fc03a390 con 0x7f0808109930 2024-09-12T02:27:07.877 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stderr 2024-09-12T02:27:06.968+0000 7f080f400640 1 -- 172.21.15.39:0/2644411814 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f080819e090 con 0x7f0808109930 2024-09-12T02:27:07.877 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stderr 2024-09-12T02:27:06.968+0000 7f080f400640 1 -- 172.21.15.39:0/2644411814 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f08081a0d80 con 0x7f0808109930 2024-09-12T02:27:07.877 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stderr 2024-09-12T02:27:06.969+0000 7f0805600640 1 -- 172.21.15.39:0/2644411814 <== mon.0 v2:172.21.15.39:3300/0 4 ==== mgrmap(e 3) ==== 46170+0+0 (secure 0 0 0) 0x7f07fc03b430 con 0x7f0808109930 2024-09-12T02:27:07.877 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stderr 2024-09-12T02:27:06.969+0000 7f080f400640 1 -- 172.21.15.39:0/2644411814 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f0808109db0 con 0x7f0808109930 2024-09-12T02:27:07.877 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stderr 2024-09-12T02:27:06.970+0000 7f0805600640 1 --2- 172.21.15.39:0/2644411814 >> [v2:172.21.15.39:6800/1074685700,v1:172.21.15.39:6801/1074685700] conn(0x7f07f0038e60 0x7f07f003b320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:27:07.877 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stderr 2024-09-12T02:27:06.970+0000 7f0805600640 1 -- 172.21.15.39:0/2644411814 <== mon.0 v2:172.21.15.39:3300/0 5 ==== osd_map(1..1 src has 1..1) ==== 725+0+0 (secure 0 0 0) 0x7f07fc06be70 con 0x7f0808109930 2024-09-12T02:27:07.877 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stderr 2024-09-12T02:27:06.970+0000 7f0807e00640 1 --2- 172.21.15.39:0/2644411814 >> [v2:172.21.15.39:6800/1074685700,v1:172.21.15.39:6801/1074685700] conn(0x7f07f0038e60 0x7f07f003b320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:27:07.877 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stderr 2024-09-12T02:27:06.971+0000 7f0807e00640 1 --2- 172.21.15.39:0/2644411814 >> [v2:172.21.15.39:6800/1074685700,v1:172.21.15.39:6801/1074685700] conn(0x7f07f0038e60 0x7f07f003b320 secure :-1 s=READY pgs=6 cs=0 l=1 rev1=1 crypto rx=0x7f07f40098c0 tx=0x7f07f4006db0 comp rx=0 tx=0).ready entity=mgr.14100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:27:07.877 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stderr 2024-09-12T02:27:06.976+0000 7f0805600640 1 -- 172.21.15.39:0/2644411814 <== mon.0 v2:172.21.15.39:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7f07fc032900 con 0x7f0808109930 2024-09-12T02:27:07.877 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stderr 2024-09-12T02:27:07.231+0000 7f080f400640 1 -- 172.21.15.39:0/2644411814 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_command({"prefix": "status", "format": "json-pretty"} v 0) -- 0x7f08081a0f50 con 0x7f0808109930 2024-09-12T02:27:07.877 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stderr 2024-09-12T02:27:07.232+0000 7f0805600640 1 -- 172.21.15.39:0/2644411814 <== mon.0 v2:172.21.15.39:3300/0 7 ==== mon_command_ack([{"prefix": "status", "format": "json-pretty"}]=0 v0) ==== 79+0+1291 (secure 0 0 0) 0x7f07fc043c30 con 0x7f0808109930 2024-09-12T02:27:07.877 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stderr 2024-09-12T02:27:07.234+0000 7f080f400640 1 -- 172.21.15.39:0/2644411814 >> [v2:172.21.15.39:6800/1074685700,v1:172.21.15.39:6801/1074685700] conn(0x7f07f0038e60 msgr2=0x7f07f003b320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:27:07.878 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stderr 2024-09-12T02:27:07.234+0000 7f080f400640 1 --2- 172.21.15.39:0/2644411814 >> [v2:172.21.15.39:6800/1074685700,v1:172.21.15.39:6801/1074685700] conn(0x7f07f0038e60 0x7f07f003b320 secure :-1 s=READY pgs=6 cs=0 l=1 rev1=1 crypto rx=0x7f07f40098c0 tx=0x7f07f4006db0 comp rx=0 tx=0).stop 2024-09-12T02:27:07.878 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stderr 2024-09-12T02:27:07.234+0000 7f080f400640 1 -- 172.21.15.39:0/2644411814 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f0808109930 msgr2=0x7f080819d8c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:27:07.878 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stderr 2024-09-12T02:27:07.234+0000 7f080f400640 1 --2- 172.21.15.39:0/2644411814 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f0808109930 0x7f080819d8c0 secure :-1 s=READY pgs=17 cs=0 l=1 rev1=1 crypto rx=0x7f07fc0097f0 tx=0x7f07fc030d80 comp rx=0 tx=0).stop 2024-09-12T02:27:07.878 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stderr 2024-09-12T02:27:07.234+0000 7f080f400640 1 -- 172.21.15.39:0/2644411814 shutdown_connections 2024-09-12T02:27:07.878 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stderr 2024-09-12T02:27:07.234+0000 7f080f400640 1 --2- 172.21.15.39:0/2644411814 >> [v2:172.21.15.39:6800/1074685700,v1:172.21.15.39:6801/1074685700] conn(0x7f07f0038e60 0x7f07f003b320 unknown :-1 s=CLOSED pgs=6 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:27:07.878 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stderr 2024-09-12T02:27:07.234+0000 7f080f400640 1 --2- 172.21.15.39:0/2644411814 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f0808109930 0x7f080819d8c0 unknown :-1 s=CLOSED pgs=17 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:27:07.878 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stderr 2024-09-12T02:27:07.234+0000 7f080f400640 1 -- 172.21.15.39:0/2644411814 >> 172.21.15.39:0/2644411814 conn(0x7f080807cf00 msgr2=0x7f0808106d00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:27:07.878 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stderr 2024-09-12T02:27:07.235+0000 7f080f400640 1 -- 172.21.15.39:0/2644411814 shutdown_connections 2024-09-12T02:27:07.878 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stderr 2024-09-12T02:27:07.235+0000 7f080f400640 1 -- 172.21.15.39:0/2644411814 wait complete. 2024-09-12T02:27:07.878 INFO:teuthology.orchestra.run.smithi039.stdout:mgr is available 2024-09-12T02:27:08.849 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 02:27:08 smithi039 ceph-mon[30515]: mgrmap e4: x(active, since 2s) 2024-09-12T02:27:09.266 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stdout 2024-09-12T02:27:09.266 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stdout [global] 2024-09-12T02:27:09.266 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stdout fsid = 4954ed46-70ae-11ef-bcea-c7b262605968 2024-09-12T02:27:09.266 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stdout mon_host = [v2:172.21.15.39:3300,v1:172.21.15.39:6789] 2024-09-12T02:27:09.266 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stdout mon_osd_allow_pg_remap = true 2024-09-12T02:27:09.266 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stdout mon_osd_allow_primary_affinity = true 2024-09-12T02:27:09.266 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stdout mon_warn_on_no_sortbitwise = false 2024-09-12T02:27:09.266 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stdout osd_crush_chooseleaf_type = 0 2024-09-12T02:27:09.266 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stdout 2024-09-12T02:27:09.266 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stdout [mgr] 2024-09-12T02:27:09.266 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stdout mgr/telemetry/nag = false 2024-09-12T02:27:09.267 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stdout 2024-09-12T02:27:09.267 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stdout [osd] 2024-09-12T02:27:09.267 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stdout mon_osd_backfillfull_ratio = 0.85 2024-09-12T02:27:09.267 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stdout mon_osd_full_ratio = 0.9 2024-09-12T02:27:09.267 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stdout mon_osd_nearfull_ratio = 0.8 2024-09-12T02:27:09.267 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stdout osd_map_max_advance = 10 2024-09-12T02:27:09.267 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stdout osd_sloppy_crc = true 2024-09-12T02:27:09.267 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stderr 2024-09-12T02:27:08.387+0000 7fea57200640 1 Processor -- start 2024-09-12T02:27:09.267 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stderr 2024-09-12T02:27:08.387+0000 7fea57200640 1 -- start start 2024-09-12T02:27:09.267 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stderr 2024-09-12T02:27:08.387+0000 7fea57200640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fea581096a0 0x7fea58109aa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:27:09.267 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stderr 2024-09-12T02:27:08.387+0000 7fea57200640 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 -- 0x7fea5810a070 con 0x7fea581096a0 2024-09-12T02:27:09.267 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stderr 2024-09-12T02:27:08.388+0000 7fea55e00640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fea581096a0 0x7fea58109aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:27:09.267 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stderr 2024-09-12T02:27:08.388+0000 7fea55e00640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fea581096a0 0x7fea58109aa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.39:3300/0 says I am v2:172.21.15.39:54392/0 (socket says 172.21.15.39:54392) 2024-09-12T02:27:09.267 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stderr 2024-09-12T02:27:08.388+0000 7fea55e00640 1 -- 172.21.15.39:0/3095203102 learned_addr learned my addr 172.21.15.39:0/3095203102 (peer_addr_for_me v2:172.21.15.39:0/0) 2024-09-12T02:27:09.268 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stderr 2024-09-12T02:27:08.388+0000 7fea55e00640 1 -- 172.21.15.39:0/3095203102 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fea5810a8a0 con 0x7fea581096a0 2024-09-12T02:27:09.268 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stderr 2024-09-12T02:27:08.389+0000 7fea55e00640 1 --2- 172.21.15.39:0/3095203102 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fea581096a0 0x7fea58109aa0 secure :-1 s=READY pgs=18 cs=0 l=1 rev1=1 crypto rx=0x7fea48009820 tx=0x7fea4802a270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=492998a56f2421fc server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:27:09.268 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stderr 2024-09-12T02:27:08.389+0000 7fea54a00640 1 -- 172.21.15.39:0/3095203102 <== mon.0 v2:172.21.15.39:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fea48037070 con 0x7fea581096a0 2024-09-12T02:27:09.268 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stderr 2024-09-12T02:27:08.389+0000 7fea54a00640 1 -- 172.21.15.39:0/3095203102 <== mon.0 v2:172.21.15.39:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7fea48032900 con 0x7fea581096a0 2024-09-12T02:27:09.268 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stderr 2024-09-12T02:27:08.389+0000 7fea54a00640 1 -- 172.21.15.39:0/3095203102 <== mon.0 v2:172.21.15.39:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fea48030850 con 0x7fea581096a0 2024-09-12T02:27:09.268 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stderr 2024-09-12T02:27:08.390+0000 7fea57200640 1 -- 172.21.15.39:0/3095203102 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fea581096a0 msgr2=0x7fea58109aa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:27:09.268 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stderr 2024-09-12T02:27:08.390+0000 7fea57200640 1 --2- 172.21.15.39:0/3095203102 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fea581096a0 0x7fea58109aa0 secure :-1 s=READY pgs=18 cs=0 l=1 rev1=1 crypto rx=0x7fea48009820 tx=0x7fea4802a270 comp rx=0 tx=0).stop 2024-09-12T02:27:09.268 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stderr 2024-09-12T02:27:08.390+0000 7fea57200640 1 -- 172.21.15.39:0/3095203102 shutdown_connections 2024-09-12T02:27:09.268 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stderr 2024-09-12T02:27:08.390+0000 7fea57200640 1 --2- 172.21.15.39:0/3095203102 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fea581096a0 0x7fea58109aa0 unknown :-1 s=CLOSED pgs=18 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:27:09.268 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stderr 2024-09-12T02:27:08.390+0000 7fea57200640 1 -- 172.21.15.39:0/3095203102 >> 172.21.15.39:0/3095203102 conn(0x7fea5807cd10 msgr2=0x7fea5807d120 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:27:09.268 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stderr 2024-09-12T02:27:08.390+0000 7fea57200640 1 -- 172.21.15.39:0/3095203102 shutdown_connections 2024-09-12T02:27:09.268 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stderr 2024-09-12T02:27:08.390+0000 7fea57200640 1 -- 172.21.15.39:0/3095203102 wait complete. 2024-09-12T02:27:09.268 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stderr 2024-09-12T02:27:08.391+0000 7fea57200640 1 Processor -- start 2024-09-12T02:27:09.269 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stderr 2024-09-12T02:27:08.391+0000 7fea57200640 1 -- start start 2024-09-12T02:27:09.269 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stderr 2024-09-12T02:27:08.392+0000 7fea57200640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fea581096a0 0x7fea5819d6a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:27:09.269 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stderr 2024-09-12T02:27:08.392+0000 7fea57200640 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 -- 0x7fea5810dc50 con 0x7fea581096a0 2024-09-12T02:27:09.269 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stderr 2024-09-12T02:27:08.392+0000 7fea55e00640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fea581096a0 0x7fea5819d6a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:27:09.269 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stderr 2024-09-12T02:27:08.392+0000 7fea55e00640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fea581096a0 0x7fea5819d6a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.39:3300/0 says I am v2:172.21.15.39:54400/0 (socket says 172.21.15.39:54400) 2024-09-12T02:27:09.269 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stderr 2024-09-12T02:27:08.392+0000 7fea55e00640 1 -- 172.21.15.39:0/1362719365 learned_addr learned my addr 172.21.15.39:0/1362719365 (peer_addr_for_me v2:172.21.15.39:0/0) 2024-09-12T02:27:09.269 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stderr 2024-09-12T02:27:08.392+0000 7fea55e00640 1 -- 172.21.15.39:0/1362719365 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fea5819dbe0 con 0x7fea581096a0 2024-09-12T02:27:09.269 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stderr 2024-09-12T02:27:08.392+0000 7fea55e00640 1 --2- 172.21.15.39:0/1362719365 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fea581096a0 0x7fea5819d6a0 secure :-1 s=READY pgs=19 cs=0 l=1 rev1=1 crypto rx=0x7fea480097f0 tx=0x7fea48030d80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:27:09.269 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stderr 2024-09-12T02:27:08.393+0000 7fea4ea00640 1 -- 172.21.15.39:0/1362719365 <== mon.0 v2:172.21.15.39:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fea48037040 con 0x7fea581096a0 2024-09-12T02:27:09.269 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stderr 2024-09-12T02:27:08.393+0000 7fea4ea00640 1 -- 172.21.15.39:0/1362719365 <== mon.0 v2:172.21.15.39:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7fea48040070 con 0x7fea581096a0 2024-09-12T02:27:09.269 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stderr 2024-09-12T02:27:08.393+0000 7fea4ea00640 1 -- 172.21.15.39:0/1362719365 <== mon.0 v2:172.21.15.39:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fea4803a390 con 0x7fea581096a0 2024-09-12T02:27:09.269 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stderr 2024-09-12T02:27:08.393+0000 7fea57200640 1 -- 172.21.15.39:0/1362719365 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fea5819de70 con 0x7fea581096a0 2024-09-12T02:27:09.269 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stderr 2024-09-12T02:27:08.393+0000 7fea57200640 1 -- 172.21.15.39:0/1362719365 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fea581a0b60 con 0x7fea581096a0 2024-09-12T02:27:09.269 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stderr 2024-09-12T02:27:08.394+0000 7fea57200640 1 -- 172.21.15.39:0/1362719365 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fea5810ddd0 con 0x7fea581096a0 2024-09-12T02:27:09.270 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stderr 2024-09-12T02:27:08.394+0000 7fea4ea00640 1 -- 172.21.15.39:0/1362719365 <== mon.0 v2:172.21.15.39:3300/0 4 ==== mgrmap(e 4) ==== 46276+0+0 (secure 0 0 0) 0x7fea4803b430 con 0x7fea581096a0 2024-09-12T02:27:09.270 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stderr 2024-09-12T02:27:08.394+0000 7fea4ea00640 1 --2- 172.21.15.39:0/1362719365 >> [v2:172.21.15.39:6800/1074685700,v1:172.21.15.39:6801/1074685700] conn(0x7fea3c038f70 0x7fea3c03b430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:27:09.270 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stderr 2024-09-12T02:27:08.394+0000 7fea4ea00640 1 -- 172.21.15.39:0/1362719365 <== mon.0 v2:172.21.15.39:3300/0 5 ==== osd_map(1..1 src has 1..1) ==== 725+0+0 (secure 0 0 0) 0x7fea4806c080 con 0x7fea581096a0 2024-09-12T02:27:09.270 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stderr 2024-09-12T02:27:08.395+0000 7fea55400640 1 --2- 172.21.15.39:0/1362719365 >> [v2:172.21.15.39:6800/1074685700,v1:172.21.15.39:6801/1074685700] conn(0x7fea3c038f70 0x7fea3c03b430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:27:09.270 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stderr 2024-09-12T02:27:08.395+0000 7fea55400640 1 --2- 172.21.15.39:0/1362719365 >> [v2:172.21.15.39:6800/1074685700,v1:172.21.15.39:6801/1074685700] conn(0x7fea3c038f70 0x7fea3c03b430 secure :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0x7fea440098c0 tx=0x7fea44006db0 comp rx=0 tx=0).ready entity=mgr.14100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:27:09.270 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stderr 2024-09-12T02:27:08.399+0000 7fea4ea00640 1 -- 172.21.15.39:0/1362719365 <== mon.0 v2:172.21.15.39:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7fea4806bde0 con 0x7fea581096a0 2024-09-12T02:27:09.270 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stderr 2024-09-12T02:27:08.586+0000 7fea57200640 1 -- 172.21.15.39:0/1362719365 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_command({"prefix": "config assimilate-conf"} v 0) -- 0x7fea58109b20 con 0x7fea581096a0 2024-09-12T02:27:09.270 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stderr 2024-09-12T02:27:08.587+0000 7fea4ea00640 1 -- 172.21.15.39:0/1362719365 <== mon.0 v2:172.21.15.39:3300/0 7 ==== mon_command_ack([{"prefix": "config assimilate-conf"}]=0 v3) ==== 70+0+429 (secure 0 0 0) 0x7fea48032900 con 0x7fea581096a0 2024-09-12T02:27:09.270 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stderr 2024-09-12T02:27:08.589+0000 7fea57200640 1 -- 172.21.15.39:0/1362719365 >> [v2:172.21.15.39:6800/1074685700,v1:172.21.15.39:6801/1074685700] conn(0x7fea3c038f70 msgr2=0x7fea3c03b430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:27:09.270 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stderr 2024-09-12T02:27:08.589+0000 7fea57200640 1 --2- 172.21.15.39:0/1362719365 >> [v2:172.21.15.39:6800/1074685700,v1:172.21.15.39:6801/1074685700] conn(0x7fea3c038f70 0x7fea3c03b430 secure :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0x7fea440098c0 tx=0x7fea44006db0 comp rx=0 tx=0).stop 2024-09-12T02:27:09.270 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stderr 2024-09-12T02:27:08.589+0000 7fea57200640 1 -- 172.21.15.39:0/1362719365 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fea581096a0 msgr2=0x7fea5819d6a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:27:09.270 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stderr 2024-09-12T02:27:08.589+0000 7fea57200640 1 --2- 172.21.15.39:0/1362719365 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fea581096a0 0x7fea5819d6a0 secure :-1 s=READY pgs=19 cs=0 l=1 rev1=1 crypto rx=0x7fea480097f0 tx=0x7fea48030d80 comp rx=0 tx=0).stop 2024-09-12T02:27:09.270 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stderr 2024-09-12T02:27:08.590+0000 7fea57200640 1 -- 172.21.15.39:0/1362719365 shutdown_connections 2024-09-12T02:27:09.270 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stderr 2024-09-12T02:27:08.590+0000 7fea57200640 1 --2- 172.21.15.39:0/1362719365 >> [v2:172.21.15.39:6800/1074685700,v1:172.21.15.39:6801/1074685700] conn(0x7fea3c038f70 0x7fea3c03b430 unknown :-1 s=CLOSED pgs=7 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:27:09.270 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stderr 2024-09-12T02:27:08.590+0000 7fea57200640 1 --2- 172.21.15.39:0/1362719365 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fea581096a0 0x7fea5819d6a0 unknown :-1 s=CLOSED pgs=19 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:27:09.271 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stderr 2024-09-12T02:27:08.590+0000 7fea57200640 1 -- 172.21.15.39:0/1362719365 >> 172.21.15.39:0/1362719365 conn(0x7fea5807cd10 msgr2=0x7fea5810bac0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:27:09.271 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stderr 2024-09-12T02:27:08.590+0000 7fea57200640 1 -- 172.21.15.39:0/1362719365 shutdown_connections 2024-09-12T02:27:09.271 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stderr 2024-09-12T02:27:08.590+0000 7fea57200640 1 -- 172.21.15.39:0/1362719365 wait complete. 2024-09-12T02:27:09.271 INFO:teuthology.orchestra.run.smithi039.stdout:Enabling cephadm module... 2024-09-12T02:27:09.599 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 02:27:09 smithi039 ceph-mon[30515]: from='client.? 172.21.15.39:0/1362719365' entity='client.admin' cmd=[{"prefix": "config assimilate-conf"}]: dispatch 2024-09-12T02:27:10.490 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 02:27:10 smithi039 ceph-mon[30515]: from='client.? 172.21.15.39:0/1771091582' entity='client.admin' cmd=[{"prefix": "mgr module enable", "module": "cephadm"}]: dispatch 2024-09-12T02:27:10.772 INFO:journalctl@ceph.mgr.x.smithi039.stdout:Sep 12 02:27:10 smithi039 ceph-4954ed46-70ae-11ef-bcea-c7b262605968-mgr-x[30736]: ignoring --setuser ceph since I am not root 2024-09-12T02:27:10.772 INFO:journalctl@ceph.mgr.x.smithi039.stdout:Sep 12 02:27:10 smithi039 ceph-4954ed46-70ae-11ef-bcea-c7b262605968-mgr-x[30736]: ignoring --setgroup ceph since I am not root 2024-09-12T02:27:10.772 INFO:journalctl@ceph.mgr.x.smithi039.stdout:Sep 12 02:27:10 smithi039 ceph-4954ed46-70ae-11ef-bcea-c7b262605968-mgr-x[30736]: 2024-09-12T02:27:10.699+0000 7f007da0b040 -1 mgr[py] Module osd_perf_query has missing NOTIFY_TYPES member 2024-09-12T02:27:10.772 INFO:journalctl@ceph.mgr.x.smithi039.stdout:Sep 12 02:27:10 smithi039 ceph-4954ed46-70ae-11ef-bcea-c7b262605968-mgr-x[30736]: 2024-09-12T02:27:10.771+0000 7f007da0b040 -1 mgr[py] Module osd_support has missing NOTIFY_TYPES member 2024-09-12T02:27:11.045 INFO:journalctl@ceph.mgr.x.smithi039.stdout:Sep 12 02:27:10 smithi039 ceph-4954ed46-70ae-11ef-bcea-c7b262605968-mgr-x[30736]: 2024-09-12T02:27:10.961+0000 7f007da0b040 -1 mgr[py] Module diskprediction_local has missing NOTIFY_TYPES member 2024-09-12T02:27:11.046 INFO:journalctl@ceph.mgr.x.smithi039.stdout:Sep 12 02:27:11 smithi039 ceph-4954ed46-70ae-11ef-bcea-c7b262605968-mgr-x[30736]: 2024-09-12T02:27:11.044+0000 7f007da0b040 -1 mgr[py] Module crash has missing NOTIFY_TYPES member 2024-09-12T02:27:11.206 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stderr 2024-09-12T02:27:09.988+0000 7f2e2c800640 1 Processor -- start 2024-09-12T02:27:11.206 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stderr 2024-09-12T02:27:09.988+0000 7f2e2c800640 1 -- start start 2024-09-12T02:27:11.206 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stderr 2024-09-12T02:27:09.988+0000 7f2e2c800640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f2e24107720 0x7f2e24107b20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:27:11.206 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stderr 2024-09-12T02:27:09.988+0000 7f2e2c800640 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 -- 0x7f2e241080f0 con 0x7f2e24107720 2024-09-12T02:27:11.206 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stderr 2024-09-12T02:27:09.989+0000 7f2e29e00640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f2e24107720 0x7f2e24107b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:27:11.206 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stderr 2024-09-12T02:27:09.989+0000 7f2e29e00640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f2e24107720 0x7f2e24107b20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.39:3300/0 says I am v2:172.21.15.39:54416/0 (socket says 172.21.15.39:54416) 2024-09-12T02:27:11.207 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stderr 2024-09-12T02:27:09.989+0000 7f2e29e00640 1 -- 172.21.15.39:0/2655493355 learned_addr learned my addr 172.21.15.39:0/2655493355 (peer_addr_for_me v2:172.21.15.39:0/0) 2024-09-12T02:27:11.207 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stderr 2024-09-12T02:27:09.989+0000 7f2e29e00640 1 -- 172.21.15.39:0/2655493355 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2e241088d0 con 0x7f2e24107720 2024-09-12T02:27:11.207 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stderr 2024-09-12T02:27:09.990+0000 7f2e29e00640 1 --2- 172.21.15.39:0/2655493355 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f2e24107720 0x7f2e24107b20 secure :-1 s=READY pgs=20 cs=0 l=1 rev1=1 crypto rx=0x7f2e18009820 tx=0x7f2e1802a270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=93627b43ff8dd061 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:27:11.207 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stderr 2024-09-12T02:27:09.990+0000 7f2e28a00640 1 -- 172.21.15.39:0/2655493355 <== mon.0 v2:172.21.15.39:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f2e18037070 con 0x7f2e24107720 2024-09-12T02:27:11.207 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stderr 2024-09-12T02:27:09.990+0000 7f2e28a00640 1 -- 172.21.15.39:0/2655493355 <== mon.0 v2:172.21.15.39:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7f2e18032900 con 0x7f2e24107720 2024-09-12T02:27:11.207 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stderr 2024-09-12T02:27:09.990+0000 7f2e28a00640 1 -- 172.21.15.39:0/2655493355 <== mon.0 v2:172.21.15.39:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f2e18030850 con 0x7f2e24107720 2024-09-12T02:27:11.207 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stderr 2024-09-12T02:27:09.991+0000 7f2e2c800640 1 -- 172.21.15.39:0/2655493355 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f2e24107720 msgr2=0x7f2e24107b20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:27:11.207 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stderr 2024-09-12T02:27:09.991+0000 7f2e2c800640 1 --2- 172.21.15.39:0/2655493355 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f2e24107720 0x7f2e24107b20 secure :-1 s=READY pgs=20 cs=0 l=1 rev1=1 crypto rx=0x7f2e18009820 tx=0x7f2e1802a270 comp rx=0 tx=0).stop 2024-09-12T02:27:11.207 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stderr 2024-09-12T02:27:09.991+0000 7f2e2c800640 1 -- 172.21.15.39:0/2655493355 shutdown_connections 2024-09-12T02:27:11.207 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stderr 2024-09-12T02:27:09.991+0000 7f2e2c800640 1 --2- 172.21.15.39:0/2655493355 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f2e24107720 0x7f2e24107b20 unknown :-1 s=CLOSED pgs=20 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:27:11.207 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stderr 2024-09-12T02:27:09.991+0000 7f2e2c800640 1 -- 172.21.15.39:0/2655493355 >> 172.21.15.39:0/2655493355 conn(0x7f2e24102ef0 msgr2=0x7f2e24105310 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:27:11.207 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stderr 2024-09-12T02:27:09.991+0000 7f2e2c800640 1 -- 172.21.15.39:0/2655493355 shutdown_connections 2024-09-12T02:27:11.207 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stderr 2024-09-12T02:27:09.991+0000 7f2e2c800640 1 -- 172.21.15.39:0/2655493355 wait complete. 2024-09-12T02:27:11.208 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stderr 2024-09-12T02:27:09.992+0000 7f2e2c800640 1 Processor -- start 2024-09-12T02:27:11.208 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stderr 2024-09-12T02:27:09.992+0000 7f2e2c800640 1 -- start start 2024-09-12T02:27:11.208 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stderr 2024-09-12T02:27:09.993+0000 7f2e2c800640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f2e24107720 0x7f2e2419d890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:27:11.208 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stderr 2024-09-12T02:27:09.993+0000 7f2e2c800640 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 -- 0x7f2e2410bc80 con 0x7f2e24107720 2024-09-12T02:27:11.208 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stderr 2024-09-12T02:27:09.993+0000 7f2e29e00640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f2e24107720 0x7f2e2419d890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:27:11.208 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stderr 2024-09-12T02:27:09.993+0000 7f2e29e00640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f2e24107720 0x7f2e2419d890 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.39:3300/0 says I am v2:172.21.15.39:54428/0 (socket says 172.21.15.39:54428) 2024-09-12T02:27:11.208 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stderr 2024-09-12T02:27:09.993+0000 7f2e29e00640 1 -- 172.21.15.39:0/1771091582 learned_addr learned my addr 172.21.15.39:0/1771091582 (peer_addr_for_me v2:172.21.15.39:0/0) 2024-09-12T02:27:11.208 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stderr 2024-09-12T02:27:09.993+0000 7f2e29e00640 1 -- 172.21.15.39:0/1771091582 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2e2419ddd0 con 0x7f2e24107720 2024-09-12T02:27:11.208 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stderr 2024-09-12T02:27:09.994+0000 7f2e29e00640 1 --2- 172.21.15.39:0/1771091582 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f2e24107720 0x7f2e2419d890 secure :-1 s=READY pgs=21 cs=0 l=1 rev1=1 crypto rx=0x7f2e180097f0 tx=0x7f2e18030d80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:27:11.208 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stderr 2024-09-12T02:27:09.994+0000 7f2e1ea00640 1 -- 172.21.15.39:0/1771091582 <== mon.0 v2:172.21.15.39:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f2e18037040 con 0x7f2e24107720 2024-09-12T02:27:11.208 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stderr 2024-09-12T02:27:09.994+0000 7f2e1ea00640 1 -- 172.21.15.39:0/1771091582 <== mon.0 v2:172.21.15.39:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7f2e18040070 con 0x7f2e24107720 2024-09-12T02:27:11.208 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stderr 2024-09-12T02:27:09.994+0000 7f2e1ea00640 1 -- 172.21.15.39:0/1771091582 <== mon.0 v2:172.21.15.39:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f2e1803a390 con 0x7f2e24107720 2024-09-12T02:27:11.208 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stderr 2024-09-12T02:27:09.994+0000 7f2e2c800640 1 -- 172.21.15.39:0/1771091582 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f2e2419e060 con 0x7f2e24107720 2024-09-12T02:27:11.209 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stderr 2024-09-12T02:27:09.994+0000 7f2e2c800640 1 -- 172.21.15.39:0/1771091582 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f2e241a0d50 con 0x7f2e24107720 2024-09-12T02:27:11.209 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stderr 2024-09-12T02:27:09.995+0000 7f2e1ea00640 1 -- 172.21.15.39:0/1771091582 <== mon.0 v2:172.21.15.39:3300/0 4 ==== mgrmap(e 4) ==== 46276+0+0 (secure 0 0 0) 0x7f2e1803b430 con 0x7f2e24107720 2024-09-12T02:27:11.209 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stderr 2024-09-12T02:27:09.995+0000 7f2e2c800640 1 -- 172.21.15.39:0/1771091582 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f2e24107ba0 con 0x7f2e24107720 2024-09-12T02:27:11.209 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stderr 2024-09-12T02:27:09.995+0000 7f2e1ea00640 1 --2- 172.21.15.39:0/1771091582 >> [v2:172.21.15.39:6800/1074685700,v1:172.21.15.39:6801/1074685700] conn(0x7f2e0c038f70 0x7f2e0c03b430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:27:11.209 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stderr 2024-09-12T02:27:09.996+0000 7f2e1ea00640 1 -- 172.21.15.39:0/1771091582 <== mon.0 v2:172.21.15.39:3300/0 5 ==== osd_map(1..1 src has 1..1) ==== 725+0+0 (secure 0 0 0) 0x7f2e1806c0d0 con 0x7f2e24107720 2024-09-12T02:27:11.209 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stderr 2024-09-12T02:27:09.996+0000 7f2e29400640 1 --2- 172.21.15.39:0/1771091582 >> [v2:172.21.15.39:6800/1074685700,v1:172.21.15.39:6801/1074685700] conn(0x7f2e0c038f70 0x7f2e0c03b430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:27:11.209 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stderr 2024-09-12T02:27:09.996+0000 7f2e29400640 1 --2- 172.21.15.39:0/1771091582 >> [v2:172.21.15.39:6800/1074685700,v1:172.21.15.39:6801/1074685700] conn(0x7f2e0c038f70 0x7f2e0c03b430 secure :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0x7f2e140098c0 tx=0x7f2e14006db0 comp rx=0 tx=0).ready entity=mgr.14100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:27:11.209 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stderr 2024-09-12T02:27:10.000+0000 7f2e1ea00640 1 -- 172.21.15.39:0/1771091582 <== mon.0 v2:172.21.15.39:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7f2e180371e0 con 0x7f2e24107720 2024-09-12T02:27:11.209 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stderr 2024-09-12T02:27:10.233+0000 7f2e2c800640 1 -- 172.21.15.39:0/1771091582 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_command({"prefix": "mgr module enable", "module": "cephadm"} v 0) -- 0x7f2e2419e4e0 con 0x7f2e24107720 2024-09-12T02:27:11.209 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stderr 2024-09-12T02:27:10.473+0000 7f2e1ea00640 1 -- 172.21.15.39:0/1771091582 <== mon.0 v2:172.21.15.39:3300/0 7 ==== mon_command_ack([{"prefix": "mgr module enable", "module": "cephadm"}]=0 v5) ==== 86+0+0 (secure 0 0 0) 0x7f2e18032dd0 con 0x7f2e24107720 2024-09-12T02:27:11.209 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stderr 2024-09-12T02:27:10.474+0000 7f2e1ea00640 1 -- 172.21.15.39:0/1771091582 <== mon.0 v2:172.21.15.39:3300/0 8 ==== mgrmap(e 5) ==== 46287+0+0 (secure 0 0 0) 0x7f2e18032900 con 0x7f2e24107720 2024-09-12T02:27:11.209 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stderr 2024-09-12T02:27:10.476+0000 7f2e2c800640 1 -- 172.21.15.39:0/1771091582 >> [v2:172.21.15.39:6800/1074685700,v1:172.21.15.39:6801/1074685700] conn(0x7f2e0c038f70 msgr2=0x7f2e0c03b430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:27:11.209 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stderr 2024-09-12T02:27:10.476+0000 7f2e2c800640 1 --2- 172.21.15.39:0/1771091582 >> [v2:172.21.15.39:6800/1074685700,v1:172.21.15.39:6801/1074685700] conn(0x7f2e0c038f70 0x7f2e0c03b430 secure :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0x7f2e140098c0 tx=0x7f2e14006db0 comp rx=0 tx=0).stop 2024-09-12T02:27:11.209 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stderr 2024-09-12T02:27:10.476+0000 7f2e2c800640 1 -- 172.21.15.39:0/1771091582 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f2e24107720 msgr2=0x7f2e2419d890 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:27:11.210 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stderr 2024-09-12T02:27:10.476+0000 7f2e2c800640 1 --2- 172.21.15.39:0/1771091582 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f2e24107720 0x7f2e2419d890 secure :-1 s=READY pgs=21 cs=0 l=1 rev1=1 crypto rx=0x7f2e180097f0 tx=0x7f2e18030d80 comp rx=0 tx=0).stop 2024-09-12T02:27:11.210 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stderr 2024-09-12T02:27:10.477+0000 7f2e2c800640 1 -- 172.21.15.39:0/1771091582 shutdown_connections 2024-09-12T02:27:11.210 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stderr 2024-09-12T02:27:10.477+0000 7f2e2c800640 1 --2- 172.21.15.39:0/1771091582 >> [v2:172.21.15.39:6800/1074685700,v1:172.21.15.39:6801/1074685700] conn(0x7f2e0c038f70 0x7f2e0c03b430 unknown :-1 s=CLOSED pgs=8 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:27:11.210 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stderr 2024-09-12T02:27:10.477+0000 7f2e2c800640 1 --2- 172.21.15.39:0/1771091582 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f2e24107720 0x7f2e2419d890 unknown :-1 s=CLOSED pgs=21 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:27:11.210 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stderr 2024-09-12T02:27:10.477+0000 7f2e2c800640 1 -- 172.21.15.39:0/1771091582 >> 172.21.15.39:0/1771091582 conn(0x7f2e24102ef0 msgr2=0x7f2e24103aa0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:27:11.210 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stderr 2024-09-12T02:27:10.477+0000 7f2e2c800640 1 -- 172.21.15.39:0/1771091582 shutdown_connections 2024-09-12T02:27:11.210 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stderr 2024-09-12T02:27:10.477+0000 7f2e2c800640 1 -- 172.21.15.39:0/1771091582 wait complete. 2024-09-12T02:27:11.343 INFO:journalctl@ceph.mgr.x.smithi039.stdout:Sep 12 02:27:11 smithi039 ceph-4954ed46-70ae-11ef-bcea-c7b262605968-mgr-x[30736]: 2024-09-12T02:27:11.228+0000 7f007da0b040 -1 mgr[py] Module test_orchestrator has missing NOTIFY_TYPES member 2024-09-12T02:27:11.599 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 02:27:11 smithi039 ceph-mon[30515]: from='client.? 172.21.15.39:0/1771091582' entity='client.admin' cmd='[{"prefix": "mgr module enable", "module": "cephadm"}]': finished 2024-09-12T02:27:11.599 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 02:27:11 smithi039 ceph-mon[30515]: mgrmap e5: x(active, since 5s) 2024-09-12T02:27:11.600 INFO:journalctl@ceph.mgr.x.smithi039.stdout:Sep 12 02:27:11 smithi039 ceph-4954ed46-70ae-11ef-bcea-c7b262605968-mgr-x[30736]: 2024-09-12T02:27:11.401+0000 7f007da0b040 -1 mgr[py] Module snap_schedule has missing NOTIFY_TYPES member 2024-09-12T02:27:11.945 INFO:journalctl@ceph.mgr.x.smithi039.stdout:Sep 12 02:27:11 smithi039 ceph-4954ed46-70ae-11ef-bcea-c7b262605968-mgr-x[30736]: 2024-09-12T02:27:11.792+0000 7f007da0b040 -1 mgr[py] Module prometheus has missing NOTIFY_TYPES member 2024-09-12T02:27:11.945 INFO:journalctl@ceph.mgr.x.smithi039.stdout:Sep 12 02:27:11 smithi039 ceph-4954ed46-70ae-11ef-bcea-c7b262605968-mgr-x[30736]: 2024-09-12T02:27:11.866+0000 7f007da0b040 -1 mgr[py] Module selftest has missing NOTIFY_TYPES member 2024-09-12T02:27:12.266 INFO:journalctl@ceph.mgr.x.smithi039.stdout:Sep 12 02:27:12 smithi039 ceph-4954ed46-70ae-11ef-bcea-c7b262605968-mgr-x[30736]: 2024-09-12T02:27:12.089+0000 7f007da0b040 -1 mgr[py] Module volumes has missing NOTIFY_TYPES member 2024-09-12T02:27:12.599 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 02:27:12 smithi039 ceph-mon[30515]: from='client.? 172.21.15.39:0/3338170559' entity='client.admin' cmd=[{"prefix": "mgr stat"}]: dispatch 2024-09-12T02:27:12.688 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stdout { 2024-09-12T02:27:12.688 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stdout "epoch": 5, 2024-09-12T02:27:12.688 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stdout "available": true, 2024-09-12T02:27:12.688 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stdout "active_name": "x", 2024-09-12T02:27:12.688 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stdout "num_standby": 0 2024-09-12T02:27:12.688 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stdout } 2024-09-12T02:27:12.689 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stderr 2024-09-12T02:27:11.694+0000 7fbb3e600640 1 Processor -- start 2024-09-12T02:27:12.689 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stderr 2024-09-12T02:27:11.694+0000 7fbb3e600640 1 -- start start 2024-09-12T02:27:12.689 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stderr 2024-09-12T02:27:11.694+0000 7fbb3e600640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fbb3807de00 0x7fbb3807c260 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:27:12.689 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stderr 2024-09-12T02:27:11.694+0000 7fbb3e600640 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 -- 0x7fbb3807c830 con 0x7fbb3807de00 2024-09-12T02:27:12.689 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stderr 2024-09-12T02:27:11.694+0000 7fbb3d200640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fbb3807de00 0x7fbb3807c260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:27:12.689 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stderr 2024-09-12T02:27:11.694+0000 7fbb3d200640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fbb3807de00 0x7fbb3807c260 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.39:3300/0 says I am v2:172.21.15.39:54454/0 (socket says 172.21.15.39:54454) 2024-09-12T02:27:12.689 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stderr 2024-09-12T02:27:11.694+0000 7fbb3d200640 1 -- 172.21.15.39:0/2078578038 learned_addr learned my addr 172.21.15.39:0/2078578038 (peer_addr_for_me v2:172.21.15.39:0/0) 2024-09-12T02:27:12.689 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stderr 2024-09-12T02:27:11.695+0000 7fbb3d200640 1 -- 172.21.15.39:0/2078578038 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fbb3807c9b0 con 0x7fbb3807de00 2024-09-12T02:27:12.689 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stderr 2024-09-12T02:27:11.696+0000 7fbb3d200640 1 --2- 172.21.15.39:0/2078578038 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fbb3807de00 0x7fbb3807c260 secure :-1 s=READY pgs=24 cs=0 l=1 rev1=1 crypto rx=0x7fbb2c009820 tx=0x7fbb2c02a270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f648f1d684dc878 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:27:12.689 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stderr 2024-09-12T02:27:11.696+0000 7fbb37400640 1 -- 172.21.15.39:0/2078578038 <== mon.0 v2:172.21.15.39:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fbb2c037070 con 0x7fbb3807de00 2024-09-12T02:27:12.689 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stderr 2024-09-12T02:27:11.696+0000 7fbb37400640 1 -- 172.21.15.39:0/2078578038 <== mon.0 v2:172.21.15.39:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7fbb2c032900 con 0x7fbb3807de00 2024-09-12T02:27:12.689 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stderr 2024-09-12T02:27:11.696+0000 7fbb37400640 1 -- 172.21.15.39:0/2078578038 <== mon.0 v2:172.21.15.39:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fbb2c030850 con 0x7fbb3807de00 2024-09-12T02:27:12.690 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stderr 2024-09-12T02:27:11.697+0000 7fbb3e600640 1 -- 172.21.15.39:0/2078578038 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fbb3807de00 msgr2=0x7fbb3807c260 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:27:12.690 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stderr 2024-09-12T02:27:11.697+0000 7fbb3e600640 1 --2- 172.21.15.39:0/2078578038 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fbb3807de00 0x7fbb3807c260 secure :-1 s=READY pgs=24 cs=0 l=1 rev1=1 crypto rx=0x7fbb2c009820 tx=0x7fbb2c02a270 comp rx=0 tx=0).stop 2024-09-12T02:27:12.690 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stderr 2024-09-12T02:27:11.697+0000 7fbb3e600640 1 -- 172.21.15.39:0/2078578038 shutdown_connections 2024-09-12T02:27:12.690 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stderr 2024-09-12T02:27:11.697+0000 7fbb3e600640 1 --2- 172.21.15.39:0/2078578038 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fbb3807de00 0x7fbb3807c260 unknown :-1 s=CLOSED pgs=24 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:27:12.690 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stderr 2024-09-12T02:27:11.697+0000 7fbb3e600640 1 -- 172.21.15.39:0/2078578038 >> 172.21.15.39:0/2078578038 conn(0x7fbb38102d10 msgr2=0x7fbb38105130 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:27:12.690 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stderr 2024-09-12T02:27:11.697+0000 7fbb3e600640 1 -- 172.21.15.39:0/2078578038 shutdown_connections 2024-09-12T02:27:12.691 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stderr 2024-09-12T02:27:11.697+0000 7fbb3e600640 1 -- 172.21.15.39:0/2078578038 wait complete. 2024-09-12T02:27:12.691 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stderr 2024-09-12T02:27:11.698+0000 7fbb3e600640 1 Processor -- start 2024-09-12T02:27:12.691 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stderr 2024-09-12T02:27:11.698+0000 7fbb3e600640 1 -- start start 2024-09-12T02:27:12.691 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stderr 2024-09-12T02:27:11.699+0000 7fbb3e600640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fbb3807de00 0x7fbb3819d6a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:27:12.691 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stderr 2024-09-12T02:27:11.699+0000 7fbb3e600640 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 -- 0x7fbb3810db10 con 0x7fbb3807de00 2024-09-12T02:27:12.692 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stderr 2024-09-12T02:27:11.699+0000 7fbb3d200640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fbb3807de00 0x7fbb3819d6a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:27:12.692 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stderr 2024-09-12T02:27:11.699+0000 7fbb3d200640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fbb3807de00 0x7fbb3819d6a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.39:3300/0 says I am v2:172.21.15.39:54462/0 (socket says 172.21.15.39:54462) 2024-09-12T02:27:12.692 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stderr 2024-09-12T02:27:11.699+0000 7fbb3d200640 1 -- 172.21.15.39:0/3338170559 learned_addr learned my addr 172.21.15.39:0/3338170559 (peer_addr_for_me v2:172.21.15.39:0/0) 2024-09-12T02:27:12.692 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stderr 2024-09-12T02:27:11.699+0000 7fbb3d200640 1 -- 172.21.15.39:0/3338170559 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fbb3819dbe0 con 0x7fbb3807de00 2024-09-12T02:27:12.692 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stderr 2024-09-12T02:27:11.700+0000 7fbb3d200640 1 --2- 172.21.15.39:0/3338170559 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fbb3807de00 0x7fbb3819d6a0 secure :-1 s=READY pgs=25 cs=0 l=1 rev1=1 crypto rx=0x7fbb2c0097f0 tx=0x7fbb2c030d80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:27:12.692 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stderr 2024-09-12T02:27:11.700+0000 7fbb35600640 1 -- 172.21.15.39:0/3338170559 <== mon.0 v2:172.21.15.39:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fbb2c037040 con 0x7fbb3807de00 2024-09-12T02:27:12.692 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stderr 2024-09-12T02:27:11.700+0000 7fbb35600640 1 -- 172.21.15.39:0/3338170559 <== mon.0 v2:172.21.15.39:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7fbb2c040070 con 0x7fbb3807de00 2024-09-12T02:27:12.692 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stderr 2024-09-12T02:27:11.700+0000 7fbb3e600640 1 -- 172.21.15.39:0/3338170559 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fbb3819de70 con 0x7fbb3807de00 2024-09-12T02:27:12.692 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stderr 2024-09-12T02:27:11.700+0000 7fbb35600640 1 -- 172.21.15.39:0/3338170559 <== mon.0 v2:172.21.15.39:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fbb2c03a390 con 0x7fbb3807de00 2024-09-12T02:27:12.692 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stderr 2024-09-12T02:27:11.700+0000 7fbb3e600640 1 -- 172.21.15.39:0/3338170559 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fbb381a0b60 con 0x7fbb3807de00 2024-09-12T02:27:12.692 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stderr 2024-09-12T02:27:11.701+0000 7fbb3e600640 1 -- 172.21.15.39:0/3338170559 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fbb3807c2e0 con 0x7fbb3807de00 2024-09-12T02:27:12.692 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stderr 2024-09-12T02:27:11.702+0000 7fbb35600640 1 -- 172.21.15.39:0/3338170559 <== mon.0 v2:172.21.15.39:3300/0 4 ==== mgrmap(e 5) ==== 46287+0+0 (secure 0 0 0) 0x7fbb2c03b430 con 0x7fbb3807de00 2024-09-12T02:27:12.692 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stderr 2024-09-12T02:27:11.702+0000 7fbb35600640 1 --2- 172.21.15.39:0/3338170559 >> [v2:172.21.15.39:6800/1074685700,v1:172.21.15.39:6801/1074685700] conn(0x7fbb20038fc0 0x7fbb2003b480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:27:12.693 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stderr 2024-09-12T02:27:11.702+0000 7fbb35600640 1 -- 172.21.15.39:0/3338170559 <== mon.0 v2:172.21.15.39:3300/0 5 ==== osd_map(1..1 src has 1..1) ==== 725+0+0 (secure 0 0 0) 0x7fbb2c06c0f0 con 0x7fbb3807de00 2024-09-12T02:27:12.693 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stderr 2024-09-12T02:27:11.702+0000 7fbb37e00640 1 -- 172.21.15.39:0/3338170559 >> [v2:172.21.15.39:6800/1074685700,v1:172.21.15.39:6801/1074685700] conn(0x7fbb20038fc0 msgr2=0x7fbb2003b480 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.39:6800/1074685700 2024-09-12T02:27:12.693 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stderr 2024-09-12T02:27:11.703+0000 7fbb37e00640 1 --2- 172.21.15.39:0/3338170559 >> [v2:172.21.15.39:6800/1074685700,v1:172.21.15.39:6801/1074685700] conn(0x7fbb20038fc0 0x7fbb2003b480 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-09-12T02:27:12.693 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stderr 2024-09-12T02:27:11.708+0000 7fbb35600640 1 -- 172.21.15.39:0/3338170559 <== mon.0 v2:172.21.15.39:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7fbb2c0371e0 con 0x7fbb3807de00 2024-09-12T02:27:12.693 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stderr 2024-09-12T02:27:11.904+0000 7fbb37e00640 1 -- 172.21.15.39:0/3338170559 >> [v2:172.21.15.39:6800/1074685700,v1:172.21.15.39:6801/1074685700] conn(0x7fbb20038fc0 msgr2=0x7fbb2003b480 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.39:6800/1074685700 2024-09-12T02:27:12.693 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stderr 2024-09-12T02:27:11.904+0000 7fbb37e00640 1 --2- 172.21.15.39:0/3338170559 >> [v2:172.21.15.39:6800/1074685700,v1:172.21.15.39:6801/1074685700] conn(0x7fbb20038fc0 0x7fbb2003b480 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2024-09-12T02:27:12.693 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stderr 2024-09-12T02:27:11.943+0000 7fbb3e600640 1 -- 172.21.15.39:0/3338170559 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_command({"prefix": "mgr stat"} v 0) -- 0x7fbb381a0d30 con 0x7fbb3807de00 2024-09-12T02:27:12.693 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stderr 2024-09-12T02:27:11.943+0000 7fbb35600640 1 -- 172.21.15.39:0/3338170559 <== mon.0 v2:172.21.15.39:3300/0 7 ==== mon_command_ack([{"prefix": "mgr stat"}]=0 v5) ==== 56+0+88 (secure 0 0 0) 0x7fbb381a0d30 con 0x7fbb3807de00 2024-09-12T02:27:12.693 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stderr 2024-09-12T02:27:11.946+0000 7fbb3e600640 1 -- 172.21.15.39:0/3338170559 >> [v2:172.21.15.39:6800/1074685700,v1:172.21.15.39:6801/1074685700] conn(0x7fbb20038fc0 msgr2=0x7fbb2003b480 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-09-12T02:27:12.693 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stderr 2024-09-12T02:27:11.946+0000 7fbb3e600640 1 --2- 172.21.15.39:0/3338170559 >> [v2:172.21.15.39:6800/1074685700,v1:172.21.15.39:6801/1074685700] conn(0x7fbb20038fc0 0x7fbb2003b480 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:27:12.693 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stderr 2024-09-12T02:27:11.946+0000 7fbb3e600640 1 -- 172.21.15.39:0/3338170559 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fbb3807de00 msgr2=0x7fbb3819d6a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:27:12.693 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stderr 2024-09-12T02:27:11.946+0000 7fbb3e600640 1 --2- 172.21.15.39:0/3338170559 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fbb3807de00 0x7fbb3819d6a0 secure :-1 s=READY pgs=25 cs=0 l=1 rev1=1 crypto rx=0x7fbb2c0097f0 tx=0x7fbb2c030d80 comp rx=0 tx=0).stop 2024-09-12T02:27:12.693 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stderr 2024-09-12T02:27:11.946+0000 7fbb3e600640 1 -- 172.21.15.39:0/3338170559 shutdown_connections 2024-09-12T02:27:12.693 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stderr 2024-09-12T02:27:11.946+0000 7fbb3e600640 1 --2- 172.21.15.39:0/3338170559 >> [v2:172.21.15.39:6800/1074685700,v1:172.21.15.39:6801/1074685700] conn(0x7fbb20038fc0 0x7fbb2003b480 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:27:12.694 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stderr 2024-09-12T02:27:11.946+0000 7fbb3e600640 1 --2- 172.21.15.39:0/3338170559 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fbb3807de00 0x7fbb3819d6a0 unknown :-1 s=CLOSED pgs=25 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:27:12.694 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stderr 2024-09-12T02:27:11.946+0000 7fbb3e600640 1 -- 172.21.15.39:0/3338170559 >> 172.21.15.39:0/3338170559 conn(0x7fbb38102d10 msgr2=0x7fbb38103890 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:27:12.694 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stderr 2024-09-12T02:27:11.946+0000 7fbb3e600640 1 -- 172.21.15.39:0/3338170559 shutdown_connections 2024-09-12T02:27:12.694 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stderr 2024-09-12T02:27:11.946+0000 7fbb3e600640 1 -- 172.21.15.39:0/3338170559 wait complete. 2024-09-12T02:27:12.694 INFO:teuthology.orchestra.run.smithi039.stdout:Waiting for the mgr to restart... 2024-09-12T02:27:12.694 INFO:teuthology.orchestra.run.smithi039.stdout:Waiting for mgr epoch 5... 2024-09-12T02:27:13.599 INFO:journalctl@ceph.mgr.x.smithi039.stdout:Sep 12 02:27:13 smithi039 ceph-4954ed46-70ae-11ef-bcea-c7b262605968-mgr-x[30736]: 2024-09-12T02:27:13.236+0000 7f007da0b040 -1 mgr[py] Module telemetry has missing NOTIFY_TYPES member 2024-09-12T02:27:13.600 INFO:journalctl@ceph.mgr.x.smithi039.stdout:Sep 12 02:27:13 smithi039 ceph-4954ed46-70ae-11ef-bcea-c7b262605968-mgr-x[30736]: 2024-09-12T02:27:13.320+0000 7f007da0b040 -1 mgr[py] Module balancer has missing NOTIFY_TYPES member 2024-09-12T02:27:14.580 INFO:journalctl@ceph.mgr.x.smithi039.stdout:Sep 12 02:27:14 smithi039 ceph-4954ed46-70ae-11ef-bcea-c7b262605968-mgr-x[30736]: 2024-09-12T02:27:14.270+0000 7f007da0b040 -1 mgr[py] Module rook has missing NOTIFY_TYPES member 2024-09-12T02:27:14.581 INFO:journalctl@ceph.mgr.x.smithi039.stdout:Sep 12 02:27:14 smithi039 ceph-4954ed46-70ae-11ef-bcea-c7b262605968-mgr-x[30736]: 2024-09-12T02:27:14.410+0000 7f007da0b040 -1 mgr[py] Module iostat has missing NOTIFY_TYPES member 2024-09-12T02:27:14.581 INFO:journalctl@ceph.mgr.x.smithi039.stdout:Sep 12 02:27:14 smithi039 ceph-4954ed46-70ae-11ef-bcea-c7b262605968-mgr-x[30736]: 2024-09-12T02:27:14.579+0000 7f007da0b040 -1 mgr[py] Module orchestrator has missing NOTIFY_TYPES member 2024-09-12T02:27:14.834 INFO:journalctl@ceph.mgr.x.smithi039.stdout:Sep 12 02:27:14 smithi039 ceph-4954ed46-70ae-11ef-bcea-c7b262605968-mgr-x[30736]: 2024-09-12T02:27:14.654+0000 7f007da0b040 -1 mgr[py] Module devicehealth has missing NOTIFY_TYPES member 2024-09-12T02:27:14.834 INFO:journalctl@ceph.mgr.x.smithi039.stdout:Sep 12 02:27:14 smithi039 ceph-4954ed46-70ae-11ef-bcea-c7b262605968-mgr-x[30736]: 2024-09-12T02:27:14.833+0000 7f007da0b040 -1 mgr[py] Module rgw has missing NOTIFY_TYPES member 2024-09-12T02:27:15.099 INFO:journalctl@ceph.mgr.x.smithi039.stdout:Sep 12 02:27:14 smithi039 ceph-4954ed46-70ae-11ef-bcea-c7b262605968-mgr-x[30736]: 2024-09-12T02:27:14.917+0000 7f007da0b040 -1 mgr[py] Module alerts has missing NOTIFY_TYPES member 2024-09-12T02:27:15.099 INFO:journalctl@ceph.mgr.x.smithi039.stdout:Sep 12 02:27:14 smithi039 ceph-4954ed46-70ae-11ef-bcea-c7b262605968-mgr-x[30736]: 2024-09-12T02:27:14.990+0000 7f007da0b040 -1 mgr[py] Module progress has missing NOTIFY_TYPES member 2024-09-12T02:27:15.439 INFO:journalctl@ceph.mgr.x.smithi039.stdout:Sep 12 02:27:15 smithi039 ceph-4954ed46-70ae-11ef-bcea-c7b262605968-mgr-x[30736]: 2024-09-12T02:27:15.177+0000 7f007da0b040 -1 mgr[py] Module nfs has missing NOTIFY_TYPES member 2024-09-12T02:27:15.439 INFO:journalctl@ceph.mgr.x.smithi039.stdout:Sep 12 02:27:15 smithi039 ceph-4954ed46-70ae-11ef-bcea-c7b262605968-mgr-x[30736]: 2024-09-12T02:27:15.257+0000 7f007da0b040 -1 mgr[py] Module status has missing NOTIFY_TYPES member 2024-09-12T02:27:15.439 INFO:journalctl@ceph.mgr.x.smithi039.stdout:Sep 12 02:27:15 smithi039 ceph-4954ed46-70ae-11ef-bcea-c7b262605968-mgr-x[30736]: 2024-09-12T02:27:15.338+0000 7f007da0b040 -1 mgr[py] Module pg_autoscaler has missing NOTIFY_TYPES member 2024-09-12T02:27:15.440 INFO:journalctl@ceph.mgr.x.smithi039.stdout:Sep 12 02:27:15 smithi039 ceph-4954ed46-70ae-11ef-bcea-c7b262605968-mgr-x[30736]: 2024-09-12T02:27:15.438+0000 7f007da0b040 -1 mgr[py] Module rbd_support has missing NOTIFY_TYPES member 2024-09-12T02:27:15.849 INFO:journalctl@ceph.mgr.x.smithi039.stdout:Sep 12 02:27:15 smithi039 ceph-4954ed46-70ae-11ef-bcea-c7b262605968-mgr-x[30736]: 2024-09-12T02:27:15.511+0000 7f007da0b040 -1 mgr[py] Module influx has missing NOTIFY_TYPES member 2024-09-12T02:27:15.849 INFO:journalctl@ceph.mgr.x.smithi039.stdout:Sep 12 02:27:15 smithi039 ceph-4954ed46-70ae-11ef-bcea-c7b262605968-mgr-x[30736]: 2024-09-12T02:27:15.583+0000 7f007da0b040 -1 mgr[py] Module zabbix has missing NOTIFY_TYPES member 2024-09-12T02:27:16.849 INFO:journalctl@ceph.mgr.x.smithi039.stdout:Sep 12 02:27:16 smithi039 ceph-4954ed46-70ae-11ef-bcea-c7b262605968-mgr-x[30736]: 2024-09-12T02:27:16.529+0000 7f007da0b040 -1 mgr[py] Module telegraf has missing NOTIFY_TYPES member 2024-09-12T02:27:16.850 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 02:27:16 smithi039 ceph-mon[30515]: Active manager daemon x restarted 2024-09-12T02:27:16.850 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 02:27:16 smithi039 ceph-mon[30515]: Activating manager daemon x 2024-09-12T02:27:16.850 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 02:27:16 smithi039 ceph-mon[30515]: osdmap e2: 0 total, 0 up, 0 in 2024-09-12T02:27:16.850 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 02:27:16 smithi039 ceph-mon[30515]: mgrmap e6: x(active, starting, since 0.00798606s) 2024-09-12T02:27:16.850 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 02:27:16 smithi039 ceph-mon[30515]: from='mgr.14118 172.21.15.39:0/2227794351' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2024-09-12T02:27:16.850 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 02:27:16 smithi039 ceph-mon[30515]: from='mgr.14118 172.21.15.39:0/2227794351' entity='mgr.x' cmd=[{"prefix": "mgr metadata", "who": "x", "id": "x"}]: dispatch 2024-09-12T02:27:16.850 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 02:27:16 smithi039 ceph-mon[30515]: from='mgr.14118 172.21.15.39:0/2227794351' entity='mgr.x' cmd=[{"prefix": "mds metadata"}]: dispatch 2024-09-12T02:27:16.850 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 02:27:16 smithi039 ceph-mon[30515]: from='mgr.14118 172.21.15.39:0/2227794351' entity='mgr.x' cmd=[{"prefix": "osd metadata"}]: dispatch 2024-09-12T02:27:16.850 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 02:27:16 smithi039 ceph-mon[30515]: from='mgr.14118 172.21.15.39:0/2227794351' entity='mgr.x' cmd=[{"prefix": "mon metadata"}]: dispatch 2024-09-12T02:27:16.850 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 02:27:16 smithi039 ceph-mon[30515]: Manager daemon x is now available 2024-09-12T02:27:16.851 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 02:27:16 smithi039 ceph-mon[30515]: Found migration_current of "None". Setting to last migration. 2024-09-12T02:27:16.851 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 02:27:16 smithi039 ceph-mon[30515]: from='mgr.14118 172.21.15.39:0/2227794351' entity='mgr.x' 2024-09-12T02:27:16.851 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 02:27:16 smithi039 ceph-mon[30515]: from='mgr.14118 172.21.15.39:0/2227794351' entity='mgr.x' 2024-09-12T02:27:16.851 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 02:27:16 smithi039 ceph-mon[30515]: from='mgr.14118 172.21.15.39:0/2227794351' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-12T02:27:16.851 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 02:27:16 smithi039 ceph-mon[30515]: from='mgr.14118 172.21.15.39:0/2227794351' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-12T02:27:17.849 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 02:27:17 smithi039 ceph-mon[30515]: from='mgr.14118 172.21.15.39:0/2227794351' entity='mgr.x' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/x/mirror_snapshot_schedule"}]: dispatch 2024-09-12T02:27:17.849 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 02:27:17 smithi039 ceph-mon[30515]: from='mgr.14118 172.21.15.39:0/2227794351' entity='mgr.x' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/x/trash_purge_schedule"}]: dispatch 2024-09-12T02:27:17.850 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 02:27:17 smithi039 ceph-mon[30515]: mgrmap e7: x(active, since 1.00656s) 2024-09-12T02:27:17.850 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 02:27:17 smithi039 ceph-mon[30515]: from='client.14122 -' entity='client.admin' cmd=[{"prefix": "get_command_descriptions"}]: dispatch 2024-09-12T02:27:17.850 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 02:27:17 smithi039 ceph-mon[30515]: from='client.14122 -' entity='client.admin' cmd=[{"prefix": "mgr_status"}]: dispatch 2024-09-12T02:27:18.177 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stdout { 2024-09-12T02:27:18.177 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stdout "mgrmap_epoch": 7, 2024-09-12T02:27:18.177 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stdout "initialized": true 2024-09-12T02:27:18.177 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stdout } 2024-09-12T02:27:18.177 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stderr 2024-09-12T02:27:13.204+0000 7fbe0c400640 1 Processor -- start 2024-09-12T02:27:18.177 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stderr 2024-09-12T02:27:13.204+0000 7fbe0c400640 1 -- start start 2024-09-12T02:27:18.177 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stderr 2024-09-12T02:27:13.205+0000 7fbe0c400640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fbe04108d80 0x7fbe04109180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:27:18.177 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stderr 2024-09-12T02:27:13.205+0000 7fbe0c400640 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 -- 0x7fbe041072c0 con 0x7fbe04108d80 2024-09-12T02:27:18.178 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stderr 2024-09-12T02:27:13.205+0000 7fbe09a00640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fbe04108d80 0x7fbe04109180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:27:18.178 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stderr 2024-09-12T02:27:13.205+0000 7fbe09a00640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fbe04108d80 0x7fbe04109180 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.39:3300/0 says I am v2:172.21.15.39:54464/0 (socket says 172.21.15.39:54464) 2024-09-12T02:27:18.178 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stderr 2024-09-12T02:27:13.205+0000 7fbe09a00640 1 -- 172.21.15.39:0/2061226782 learned_addr learned my addr 172.21.15.39:0/2061226782 (peer_addr_for_me v2:172.21.15.39:0/0) 2024-09-12T02:27:18.178 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stderr 2024-09-12T02:27:13.205+0000 7fbe09a00640 1 -- 172.21.15.39:0/2061226782 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fbe04107440 con 0x7fbe04108d80 2024-09-12T02:27:18.178 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stderr 2024-09-12T02:27:13.206+0000 7fbe09a00640 1 --2- 172.21.15.39:0/2061226782 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fbe04108d80 0x7fbe04109180 secure :-1 s=READY pgs=26 cs=0 l=1 rev1=1 crypto rx=0x7fbdf8009820 tx=0x7fbdf802a270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6193be66cf252976 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:27:18.178 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stderr 2024-09-12T02:27:13.207+0000 7fbe03e00640 1 -- 172.21.15.39:0/2061226782 <== mon.0 v2:172.21.15.39:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fbdf8037070 con 0x7fbe04108d80 2024-09-12T02:27:18.178 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stderr 2024-09-12T02:27:13.207+0000 7fbe03e00640 1 -- 172.21.15.39:0/2061226782 <== mon.0 v2:172.21.15.39:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7fbdf8032900 con 0x7fbe04108d80 2024-09-12T02:27:18.178 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stderr 2024-09-12T02:27:13.207+0000 7fbe03e00640 1 -- 172.21.15.39:0/2061226782 <== mon.0 v2:172.21.15.39:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fbdf8030850 con 0x7fbe04108d80 2024-09-12T02:27:18.178 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stderr 2024-09-12T02:27:13.207+0000 7fbe0c400640 1 -- 172.21.15.39:0/2061226782 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fbe04108d80 msgr2=0x7fbe04109180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:27:18.178 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stderr 2024-09-12T02:27:13.207+0000 7fbe0c400640 1 --2- 172.21.15.39:0/2061226782 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fbe04108d80 0x7fbe04109180 secure :-1 s=READY pgs=26 cs=0 l=1 rev1=1 crypto rx=0x7fbdf8009820 tx=0x7fbdf802a270 comp rx=0 tx=0).stop 2024-09-12T02:27:18.178 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stderr 2024-09-12T02:27:13.208+0000 7fbe0c400640 1 -- 172.21.15.39:0/2061226782 shutdown_connections 2024-09-12T02:27:18.178 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stderr 2024-09-12T02:27:13.208+0000 7fbe0c400640 1 --2- 172.21.15.39:0/2061226782 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fbe04108d80 0x7fbe04109180 unknown :-1 s=CLOSED pgs=26 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:27:18.179 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stderr 2024-09-12T02:27:13.208+0000 7fbe0c400640 1 -- 172.21.15.39:0/2061226782 >> 172.21.15.39:0/2061226782 conn(0x7fbe04102e50 msgr2=0x7fbe04105270 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:27:18.179 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stderr 2024-09-12T02:27:13.208+0000 7fbe0c400640 1 -- 172.21.15.39:0/2061226782 shutdown_connections 2024-09-12T02:27:18.179 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stderr 2024-09-12T02:27:13.208+0000 7fbe0c400640 1 -- 172.21.15.39:0/2061226782 wait complete. 2024-09-12T02:27:18.179 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stderr 2024-09-12T02:27:13.209+0000 7fbe0c400640 1 Processor -- start 2024-09-12T02:27:18.179 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stderr 2024-09-12T02:27:13.209+0000 7fbe0c400640 1 -- start start 2024-09-12T02:27:18.179 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stderr 2024-09-12T02:27:13.210+0000 7fbe0c400640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fbe04108d80 0x7fbe0407e310 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:27:18.179 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stderr 2024-09-12T02:27:13.210+0000 7fbe0c400640 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 -- 0x7fbe0410bc50 con 0x7fbe04108d80 2024-09-12T02:27:18.179 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stderr 2024-09-12T02:27:13.210+0000 7fbe09a00640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fbe04108d80 0x7fbe0407e310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:27:18.179 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stderr 2024-09-12T02:27:13.210+0000 7fbe09a00640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fbe04108d80 0x7fbe0407e310 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.39:3300/0 says I am v2:172.21.15.39:54478/0 (socket says 172.21.15.39:54478) 2024-09-12T02:27:18.180 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stderr 2024-09-12T02:27:13.210+0000 7fbe09a00640 1 -- 172.21.15.39:0/898685347 learned_addr learned my addr 172.21.15.39:0/898685347 (peer_addr_for_me v2:172.21.15.39:0/0) 2024-09-12T02:27:18.180 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stderr 2024-09-12T02:27:13.210+0000 7fbe09a00640 1 -- 172.21.15.39:0/898685347 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fbe0407e850 con 0x7fbe04108d80 2024-09-12T02:27:18.180 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stderr 2024-09-12T02:27:13.211+0000 7fbe09a00640 1 --2- 172.21.15.39:0/898685347 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fbe04108d80 0x7fbe0407e310 secure :-1 s=READY pgs=27 cs=0 l=1 rev1=1 crypto rx=0x7fbdf80097f0 tx=0x7fbdf8030d80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:27:18.180 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stderr 2024-09-12T02:27:13.211+0000 7fbe02000640 1 -- 172.21.15.39:0/898685347 <== mon.0 v2:172.21.15.39:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fbdf8037040 con 0x7fbe04108d80 2024-09-12T02:27:18.180 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stderr 2024-09-12T02:27:13.211+0000 7fbe02000640 1 -- 172.21.15.39:0/898685347 <== mon.0 v2:172.21.15.39:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7fbdf8040070 con 0x7fbe04108d80 2024-09-12T02:27:18.180 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stderr 2024-09-12T02:27:13.211+0000 7fbe0c400640 1 -- 172.21.15.39:0/898685347 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fbe0407ca40 con 0x7fbe04108d80 2024-09-12T02:27:18.180 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stderr 2024-09-12T02:27:13.211+0000 7fbe02000640 1 -- 172.21.15.39:0/898685347 <== mon.0 v2:172.21.15.39:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fbdf803a390 con 0x7fbe04108d80 2024-09-12T02:27:18.180 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stderr 2024-09-12T02:27:13.211+0000 7fbe0c400640 1 -- 172.21.15.39:0/898685347 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fbe0407cf20 con 0x7fbe04108d80 2024-09-12T02:27:18.180 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stderr 2024-09-12T02:27:13.212+0000 7fbe02000640 1 -- 172.21.15.39:0/898685347 <== mon.0 v2:172.21.15.39:3300/0 4 ==== mgrmap(e 5) ==== 46287+0+0 (secure 0 0 0) 0x7fbdf803b430 con 0x7fbe04108d80 2024-09-12T02:27:18.180 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stderr 2024-09-12T02:27:13.213+0000 7fbe02000640 1 --2- 172.21.15.39:0/898685347 >> [v2:172.21.15.39:6800/1074685700,v1:172.21.15.39:6801/1074685700] conn(0x7fbdec038fc0 0x7fbdec03b480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:27:18.180 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stderr 2024-09-12T02:27:13.213+0000 7fbe02000640 1 -- 172.21.15.39:0/898685347 --> [v2:172.21.15.39:6800/1074685700,v1:172.21.15.39:6801/1074685700] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x7fbdec03bb90 con 0x7fbdec038fc0 2024-09-12T02:27:18.180 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stderr 2024-09-12T02:27:13.213+0000 7fbe02000640 1 -- 172.21.15.39:0/898685347 <== mon.0 v2:172.21.15.39:3300/0 5 ==== osd_map(1..1 src has 1..1) ==== 725+0+0 (secure 0 0 0) 0x7fbdf806c0c0 con 0x7fbe04108d80 2024-09-12T02:27:18.181 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stderr 2024-09-12T02:27:13.213+0000 7fbe09000640 1 -- 172.21.15.39:0/898685347 >> [v2:172.21.15.39:6800/1074685700,v1:172.21.15.39:6801/1074685700] conn(0x7fbdec038fc0 msgr2=0x7fbdec03b480 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.39:6800/1074685700 2024-09-12T02:27:18.181 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stderr 2024-09-12T02:27:13.213+0000 7fbe09000640 1 --2- 172.21.15.39:0/898685347 >> [v2:172.21.15.39:6800/1074685700,v1:172.21.15.39:6801/1074685700] conn(0x7fbdec038fc0 0x7fbdec03b480 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-09-12T02:27:18.181 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stderr 2024-09-12T02:27:13.414+0000 7fbe09000640 1 -- 172.21.15.39:0/898685347 >> [v2:172.21.15.39:6800/1074685700,v1:172.21.15.39:6801/1074685700] conn(0x7fbdec038fc0 msgr2=0x7fbdec03b480 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.39:6800/1074685700 2024-09-12T02:27:18.181 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stderr 2024-09-12T02:27:13.414+0000 7fbe09000640 1 --2- 172.21.15.39:0/898685347 >> [v2:172.21.15.39:6800/1074685700,v1:172.21.15.39:6801/1074685700] conn(0x7fbdec038fc0 0x7fbdec03b480 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2024-09-12T02:27:18.181 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stderr 2024-09-12T02:27:13.815+0000 7fbe09000640 1 -- 172.21.15.39:0/898685347 >> [v2:172.21.15.39:6800/1074685700,v1:172.21.15.39:6801/1074685700] conn(0x7fbdec038fc0 msgr2=0x7fbdec03b480 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.39:6800/1074685700 2024-09-12T02:27:18.181 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stderr 2024-09-12T02:27:13.815+0000 7fbe09000640 1 --2- 172.21.15.39:0/898685347 >> [v2:172.21.15.39:6800/1074685700,v1:172.21.15.39:6801/1074685700] conn(0x7fbdec038fc0 0x7fbdec03b480 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2024-09-12T02:27:18.181 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stderr 2024-09-12T02:27:14.616+0000 7fbe09000640 1 -- 172.21.15.39:0/898685347 >> [v2:172.21.15.39:6800/1074685700,v1:172.21.15.39:6801/1074685700] conn(0x7fbdec038fc0 msgr2=0x7fbdec03b480 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.39:6800/1074685700 2024-09-12T02:27:18.181 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stderr 2024-09-12T02:27:14.616+0000 7fbe09000640 1 --2- 172.21.15.39:0/898685347 >> [v2:172.21.15.39:6800/1074685700,v1:172.21.15.39:6801/1074685700] conn(0x7fbdec038fc0 0x7fbdec03b480 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2024-09-12T02:27:18.181 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stderr 2024-09-12T02:27:16.217+0000 7fbe09000640 1 -- 172.21.15.39:0/898685347 >> [v2:172.21.15.39:6800/1074685700,v1:172.21.15.39:6801/1074685700] conn(0x7fbdec038fc0 msgr2=0x7fbdec03b480 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.39:6800/1074685700 2024-09-12T02:27:18.181 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stderr 2024-09-12T02:27:16.217+0000 7fbe09000640 1 --2- 172.21.15.39:0/898685347 >> [v2:172.21.15.39:6800/1074685700,v1:172.21.15.39:6801/1074685700] conn(0x7fbdec038fc0 0x7fbdec03b480 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 3.200000 2024-09-12T02:27:18.181 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stderr 2024-09-12T02:27:16.537+0000 7fbe02000640 1 -- 172.21.15.39:0/898685347 <== mon.0 v2:172.21.15.39:3300/0 6 ==== mgrmap(e 6) ==== 46054+0+0 (secure 0 0 0) 0x7fbdf804acf0 con 0x7fbe04108d80 2024-09-12T02:27:18.181 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stderr 2024-09-12T02:27:16.538+0000 7fbe02000640 1 -- 172.21.15.39:0/898685347 >> [v2:172.21.15.39:6800/1074685700,v1:172.21.15.39:6801/1074685700] conn(0x7fbdec038fc0 msgr2=0x7fbdec03b480 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-09-12T02:27:18.182 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stderr 2024-09-12T02:27:16.538+0000 7fbe02000640 1 --2- 172.21.15.39:0/898685347 >> [v2:172.21.15.39:6800/1074685700,v1:172.21.15.39:6801/1074685700] conn(0x7fbdec038fc0 0x7fbdec03b480 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:27:18.182 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stderr 2024-09-12T02:27:17.535+0000 7fbe02000640 1 -- 172.21.15.39:0/898685347 <== mon.0 v2:172.21.15.39:3300/0 7 ==== mgrmap(e 7) ==== 46181+0+0 (secure 0 0 0) 0x7fbdf806dc60 con 0x7fbe04108d80 2024-09-12T02:27:18.182 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stderr 2024-09-12T02:27:17.535+0000 7fbe02000640 1 --2- 172.21.15.39:0/898685347 >> [v2:172.21.15.39:6800/3152613618,v1:172.21.15.39:6801/3152613618] conn(0x7fbdec03c8f0 0x7fbdec03ece0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:27:18.182 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stderr 2024-09-12T02:27:17.535+0000 7fbe02000640 1 -- 172.21.15.39:0/898685347 --> [v2:172.21.15.39:6800/3152613618,v1:172.21.15.39:6801/3152613618] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x7fbdf8047e70 con 0x7fbdec03c8f0 2024-09-12T02:27:18.182 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stderr 2024-09-12T02:27:17.536+0000 7fbe09000640 1 --2- 172.21.15.39:0/898685347 >> [v2:172.21.15.39:6800/3152613618,v1:172.21.15.39:6801/3152613618] conn(0x7fbdec03c8f0 0x7fbdec03ece0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:27:18.182 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stderr 2024-09-12T02:27:17.538+0000 7fbe09000640 1 --2- 172.21.15.39:0/898685347 >> [v2:172.21.15.39:6800/3152613618,v1:172.21.15.39:6801/3152613618] conn(0x7fbdec03c8f0 0x7fbdec03ece0 secure :-1 s=READY pgs=3 cs=0 l=1 rev1=1 crypto rx=0x7fbdf0003980 tx=0x7fbdf00092b0 comp rx=0 tx=0).ready entity=mgr.14118 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:27:18.182 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stderr 2024-09-12T02:27:17.539+0000 7fbe02000640 1 -- 172.21.15.39:0/898685347 <== mgr.14118 v2:172.21.15.39:6800/3152613618 1 ==== command_reply(tid 0: 0 ) ==== 8+0+9564 (secure 0 0 0) 0x7fbdf8047e70 con 0x7fbdec03c8f0 2024-09-12T02:27:18.182 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stderr 2024-09-12T02:27:17.546+0000 7fbe0c400640 1 -- 172.21.15.39:0/898685347 --> [v2:172.21.15.39:6800/3152613618,v1:172.21.15.39:6801/3152613618] -- command(tid 1: {"prefix": "mgr_status"}) -- 0x7fbe04109200 con 0x7fbdec03c8f0 2024-09-12T02:27:18.182 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stderr 2024-09-12T02:27:17.546+0000 7fbe02000640 1 -- 172.21.15.39:0/898685347 <== mgr.14118 v2:172.21.15.39:6800/3152613618 2 ==== command_reply(tid 1: 0 ) ==== 8+0+51 (secure 0 0 0) 0x7fbe04109200 con 0x7fbdec03c8f0 2024-09-12T02:27:18.182 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stderr 2024-09-12T02:27:17.547+0000 7fbe0c400640 1 -- 172.21.15.39:0/898685347 >> [v2:172.21.15.39:6800/3152613618,v1:172.21.15.39:6801/3152613618] conn(0x7fbdec03c8f0 msgr2=0x7fbdec03ece0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:27:18.182 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stderr 2024-09-12T02:27:17.547+0000 7fbe0c400640 1 --2- 172.21.15.39:0/898685347 >> [v2:172.21.15.39:6800/3152613618,v1:172.21.15.39:6801/3152613618] conn(0x7fbdec03c8f0 0x7fbdec03ece0 secure :-1 s=READY pgs=3 cs=0 l=1 rev1=1 crypto rx=0x7fbdf0003980 tx=0x7fbdf00092b0 comp rx=0 tx=0).stop 2024-09-12T02:27:18.182 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stderr 2024-09-12T02:27:17.547+0000 7fbe0c400640 1 -- 172.21.15.39:0/898685347 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fbe04108d80 msgr2=0x7fbe0407e310 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:27:18.182 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stderr 2024-09-12T02:27:17.547+0000 7fbe0c400640 1 --2- 172.21.15.39:0/898685347 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fbe04108d80 0x7fbe0407e310 secure :-1 s=READY pgs=27 cs=0 l=1 rev1=1 crypto rx=0x7fbdf80097f0 tx=0x7fbdf8030d80 comp rx=0 tx=0).stop 2024-09-12T02:27:18.183 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stderr 2024-09-12T02:27:17.547+0000 7fbe0c400640 1 -- 172.21.15.39:0/898685347 shutdown_connections 2024-09-12T02:27:18.183 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stderr 2024-09-12T02:27:17.547+0000 7fbe0c400640 1 --2- 172.21.15.39:0/898685347 >> [v2:172.21.15.39:6800/1074685700,v1:172.21.15.39:6801/1074685700] conn(0x7fbdec038fc0 0x7fbdec03b480 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:27:18.183 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stderr 2024-09-12T02:27:17.547+0000 7fbe0c400640 1 --2- 172.21.15.39:0/898685347 >> [v2:172.21.15.39:6800/3152613618,v1:172.21.15.39:6801/3152613618] conn(0x7fbdec03c8f0 0x7fbdec03ece0 unknown :-1 s=CLOSED pgs=3 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:27:18.183 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stderr 2024-09-12T02:27:17.547+0000 7fbe0c400640 1 --2- 172.21.15.39:0/898685347 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fbe04108d80 0x7fbe0407e310 unknown :-1 s=CLOSED pgs=27 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:27:18.183 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stderr 2024-09-12T02:27:17.547+0000 7fbe0c400640 1 -- 172.21.15.39:0/898685347 >> 172.21.15.39:0/898685347 conn(0x7fbe04102e50 msgr2=0x7fbe04103960 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:27:18.183 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stderr 2024-09-12T02:27:17.547+0000 7fbe0c400640 1 -- 172.21.15.39:0/898685347 shutdown_connections 2024-09-12T02:27:18.183 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stderr 2024-09-12T02:27:17.547+0000 7fbe0c400640 1 -- 172.21.15.39:0/898685347 wait complete. 2024-09-12T02:27:18.183 INFO:teuthology.orchestra.run.smithi039.stdout:mgr epoch 5 is available 2024-09-12T02:27:18.183 INFO:teuthology.orchestra.run.smithi039.stdout:Setting orchestrator backend to cephadm... 2024-09-12T02:27:18.684 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 02:27:18 smithi039 ceph-mon[30515]: from='mgr.14118 172.21.15.39:0/2227794351' entity='mgr.x' 2024-09-12T02:27:18.684 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 02:27:18 smithi039 ceph-mon[30515]: from='mgr.14118 172.21.15.39:0/2227794351' entity='mgr.x' 2024-09-12T02:27:19.558 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stderr 2024-09-12T02:27:18.669+0000 7f2a41600640 1 Processor -- start 2024-09-12T02:27:19.558 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stderr 2024-09-12T02:27:18.669+0000 7f2a41600640 1 -- start start 2024-09-12T02:27:19.558 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stderr 2024-09-12T02:27:18.669+0000 7f2a41600640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f2a3c109880 0x7f2a3c109c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:27:19.558 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stderr 2024-09-12T02:27:18.669+0000 7f2a41600640 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 -- 0x7f2a3c10a250 con 0x7f2a3c109880 2024-09-12T02:27:19.558 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stderr 2024-09-12T02:27:18.669+0000 7f2a3aa00640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f2a3c109880 0x7f2a3c109c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:27:19.559 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stderr 2024-09-12T02:27:18.669+0000 7f2a3aa00640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f2a3c109880 0x7f2a3c109c80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.39:3300/0 says I am v2:172.21.15.39:40336/0 (socket says 172.21.15.39:40336) 2024-09-12T02:27:19.559 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stderr 2024-09-12T02:27:18.669+0000 7f2a3aa00640 1 -- 172.21.15.39:0/1959634393 learned_addr learned my addr 172.21.15.39:0/1959634393 (peer_addr_for_me v2:172.21.15.39:0/0) 2024-09-12T02:27:19.559 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stderr 2024-09-12T02:27:18.671+0000 7f2a3aa00640 1 -- 172.21.15.39:0/1959634393 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2a3c10aa80 con 0x7f2a3c109880 2024-09-12T02:27:19.559 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stderr 2024-09-12T02:27:18.672+0000 7f2a3aa00640 1 --2- 172.21.15.39:0/1959634393 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f2a3c109880 0x7f2a3c109c80 secure :-1 s=READY pgs=35 cs=0 l=1 rev1=1 crypto rx=0x7f2a2c009820 tx=0x7f2a2c02a270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=23e958bec9ddcab3 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:27:19.559 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stderr 2024-09-12T02:27:18.673+0000 7f2a39600640 1 -- 172.21.15.39:0/1959634393 <== mon.0 v2:172.21.15.39:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f2a2c037070 con 0x7f2a3c109880 2024-09-12T02:27:19.559 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stderr 2024-09-12T02:27:18.673+0000 7f2a39600640 1 -- 172.21.15.39:0/1959634393 <== mon.0 v2:172.21.15.39:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7f2a2c032900 con 0x7f2a3c109880 2024-09-12T02:27:19.559 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stderr 2024-09-12T02:27:18.673+0000 7f2a39600640 1 -- 172.21.15.39:0/1959634393 <== mon.0 v2:172.21.15.39:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f2a2c030850 con 0x7f2a3c109880 2024-09-12T02:27:19.559 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stderr 2024-09-12T02:27:18.673+0000 7f2a41600640 1 -- 172.21.15.39:0/1959634393 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f2a3c109880 msgr2=0x7f2a3c109c80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:27:19.559 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stderr 2024-09-12T02:27:18.673+0000 7f2a41600640 1 --2- 172.21.15.39:0/1959634393 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f2a3c109880 0x7f2a3c109c80 secure :-1 s=READY pgs=35 cs=0 l=1 rev1=1 crypto rx=0x7f2a2c009820 tx=0x7f2a2c02a270 comp rx=0 tx=0).stop 2024-09-12T02:27:19.559 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stderr 2024-09-12T02:27:18.673+0000 7f2a41600640 1 -- 172.21.15.39:0/1959634393 shutdown_connections 2024-09-12T02:27:19.559 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stderr 2024-09-12T02:27:18.673+0000 7f2a41600640 1 --2- 172.21.15.39:0/1959634393 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f2a3c109880 0x7f2a3c109c80 unknown :-1 s=CLOSED pgs=35 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:27:19.559 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stderr 2024-09-12T02:27:18.673+0000 7f2a41600640 1 -- 172.21.15.39:0/1959634393 >> 172.21.15.39:0/1959634393 conn(0x7f2a3c07ce60 msgr2=0x7f2a3c07d270 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:27:19.560 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stderr 2024-09-12T02:27:18.673+0000 7f2a41600640 1 -- 172.21.15.39:0/1959634393 shutdown_connections 2024-09-12T02:27:19.560 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stderr 2024-09-12T02:27:18.674+0000 7f2a41600640 1 -- 172.21.15.39:0/1959634393 wait complete. 2024-09-12T02:27:19.560 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stderr 2024-09-12T02:27:18.674+0000 7f2a41600640 1 Processor -- start 2024-09-12T02:27:19.560 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stderr 2024-09-12T02:27:18.674+0000 7f2a41600640 1 -- start start 2024-09-12T02:27:19.560 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stderr 2024-09-12T02:27:18.674+0000 7f2a41600640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f2a3c109880 0x7f2a3c19d880 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:27:19.560 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stderr 2024-09-12T02:27:18.674+0000 7f2a41600640 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 -- 0x7f2a3c10de30 con 0x7f2a3c109880 2024-09-12T02:27:19.560 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stderr 2024-09-12T02:27:18.674+0000 7f2a3aa00640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f2a3c109880 0x7f2a3c19d880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:27:19.560 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stderr 2024-09-12T02:27:18.674+0000 7f2a3aa00640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f2a3c109880 0x7f2a3c19d880 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.39:3300/0 says I am v2:172.21.15.39:40340/0 (socket says 172.21.15.39:40340) 2024-09-12T02:27:19.560 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stderr 2024-09-12T02:27:18.674+0000 7f2a3aa00640 1 -- 172.21.15.39:0/3522769542 learned_addr learned my addr 172.21.15.39:0/3522769542 (peer_addr_for_me v2:172.21.15.39:0/0) 2024-09-12T02:27:19.560 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stderr 2024-09-12T02:27:18.674+0000 7f2a3aa00640 1 -- 172.21.15.39:0/3522769542 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2a3c19ddc0 con 0x7f2a3c109880 2024-09-12T02:27:19.560 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stderr 2024-09-12T02:27:18.676+0000 7f2a3aa00640 1 --2- 172.21.15.39:0/3522769542 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f2a3c109880 0x7f2a3c19d880 secure :-1 s=READY pgs=36 cs=0 l=1 rev1=1 crypto rx=0x7f2a2c0097f0 tx=0x7f2a2c030d80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:27:19.560 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stderr 2024-09-12T02:27:18.676+0000 7f2a33400640 1 -- 172.21.15.39:0/3522769542 <== mon.0 v2:172.21.15.39:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f2a2c037040 con 0x7f2a3c109880 2024-09-12T02:27:19.560 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stderr 2024-09-12T02:27:18.676+0000 7f2a33400640 1 -- 172.21.15.39:0/3522769542 <== mon.0 v2:172.21.15.39:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7f2a2c040070 con 0x7f2a3c109880 2024-09-12T02:27:19.561 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stderr 2024-09-12T02:27:18.676+0000 7f2a41600640 1 -- 172.21.15.39:0/3522769542 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f2a3c19e050 con 0x7f2a3c109880 2024-09-12T02:27:19.561 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stderr 2024-09-12T02:27:18.676+0000 7f2a33400640 1 -- 172.21.15.39:0/3522769542 <== mon.0 v2:172.21.15.39:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f2a2c03a390 con 0x7f2a3c109880 2024-09-12T02:27:19.561 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stderr 2024-09-12T02:27:18.676+0000 7f2a41600640 1 -- 172.21.15.39:0/3522769542 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f2a3c1a0d40 con 0x7f2a3c109880 2024-09-12T02:27:19.561 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stderr 2024-09-12T02:27:18.677+0000 7f2a41600640 1 -- 172.21.15.39:0/3522769542 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f2a3c109d00 con 0x7f2a3c109880 2024-09-12T02:27:19.561 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stderr 2024-09-12T02:27:18.678+0000 7f2a33400640 1 -- 172.21.15.39:0/3522769542 <== mon.0 v2:172.21.15.39:3300/0 4 ==== mgrmap(e 8) ==== 46287+0+0 (secure 0 0 0) 0x7f2a2c03b430 con 0x7f2a3c109880 2024-09-12T02:27:19.561 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stderr 2024-09-12T02:27:18.678+0000 7f2a33400640 1 --2- 172.21.15.39:0/3522769542 >> [v2:172.21.15.39:6800/3152613618,v1:172.21.15.39:6801/3152613618] conn(0x7f2a20038fc0 0x7f2a2003b480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:27:19.561 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stderr 2024-09-12T02:27:18.678+0000 7f2a33400640 1 -- 172.21.15.39:0/3522769542 <== mon.0 v2:172.21.15.39:3300/0 5 ==== osd_map(2..2 src has 1..2) ==== 940+0+0 (secure 0 0 0) 0x7f2a2c06c4e0 con 0x7f2a3c109880 2024-09-12T02:27:19.561 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stderr 2024-09-12T02:27:18.679+0000 7f2a3a000640 1 --2- 172.21.15.39:0/3522769542 >> [v2:172.21.15.39:6800/3152613618,v1:172.21.15.39:6801/3152613618] conn(0x7f2a20038fc0 0x7f2a2003b480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:27:19.562 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stderr 2024-09-12T02:27:18.679+0000 7f2a3a000640 1 --2- 172.21.15.39:0/3522769542 >> [v2:172.21.15.39:6800/3152613618,v1:172.21.15.39:6801/3152613618] conn(0x7f2a20038fc0 0x7f2a2003b480 secure :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0x7f2a280098c0 tx=0x7f2a28006db0 comp rx=0 tx=0).ready entity=mgr.14118 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:27:19.562 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stderr 2024-09-12T02:27:18.684+0000 7f2a33400640 1 -- 172.21.15.39:0/3522769542 <== mon.0 v2:172.21.15.39:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7f2a2c06be30 con 0x7f2a3c109880 2024-09-12T02:27:19.562 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stderr 2024-09-12T02:27:18.886+0000 7f2a41600640 1 -- 172.21.15.39:0/3522769542 --> [v2:172.21.15.39:6800/3152613618,v1:172.21.15.39:6801/3152613618] -- mgr_command(tid 0: {"prefix": "orch set backend", "module_name": "cephadm", "target": ["mon-mgr", ""]}) -- 0x7f2a3c1073e0 con 0x7f2a20038fc0 2024-09-12T02:27:19.562 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stderr 2024-09-12T02:27:18.894+0000 7f2a33400640 1 -- 172.21.15.39:0/3522769542 <== mgr.14118 v2:172.21.15.39:6800/3152613618 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+0 (secure 0 0 0) 0x7f2a3c1073e0 con 0x7f2a20038fc0 2024-09-12T02:27:19.562 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stderr 2024-09-12T02:27:18.897+0000 7f2a41600640 1 -- 172.21.15.39:0/3522769542 >> [v2:172.21.15.39:6800/3152613618,v1:172.21.15.39:6801/3152613618] conn(0x7f2a20038fc0 msgr2=0x7f2a2003b480 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:27:19.562 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stderr 2024-09-12T02:27:18.897+0000 7f2a41600640 1 --2- 172.21.15.39:0/3522769542 >> [v2:172.21.15.39:6800/3152613618,v1:172.21.15.39:6801/3152613618] conn(0x7f2a20038fc0 0x7f2a2003b480 secure :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0x7f2a280098c0 tx=0x7f2a28006db0 comp rx=0 tx=0).stop 2024-09-12T02:27:19.562 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stderr 2024-09-12T02:27:18.897+0000 7f2a41600640 1 -- 172.21.15.39:0/3522769542 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f2a3c109880 msgr2=0x7f2a3c19d880 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:27:19.562 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stderr 2024-09-12T02:27:18.897+0000 7f2a41600640 1 --2- 172.21.15.39:0/3522769542 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f2a3c109880 0x7f2a3c19d880 secure :-1 s=READY pgs=36 cs=0 l=1 rev1=1 crypto rx=0x7f2a2c0097f0 tx=0x7f2a2c030d80 comp rx=0 tx=0).stop 2024-09-12T02:27:19.562 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stderr 2024-09-12T02:27:18.897+0000 7f2a41600640 1 -- 172.21.15.39:0/3522769542 shutdown_connections 2024-09-12T02:27:19.562 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stderr 2024-09-12T02:27:18.897+0000 7f2a41600640 1 --2- 172.21.15.39:0/3522769542 >> [v2:172.21.15.39:6800/3152613618,v1:172.21.15.39:6801/3152613618] conn(0x7f2a20038fc0 0x7f2a2003b480 unknown :-1 s=CLOSED pgs=7 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:27:19.562 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stderr 2024-09-12T02:27:18.897+0000 7f2a41600640 1 --2- 172.21.15.39:0/3522769542 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f2a3c109880 0x7f2a3c19d880 unknown :-1 s=CLOSED pgs=36 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:27:19.562 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stderr 2024-09-12T02:27:18.897+0000 7f2a41600640 1 -- 172.21.15.39:0/3522769542 >> 172.21.15.39:0/3522769542 conn(0x7f2a3c07ce60 msgr2=0x7f2a3c106cd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:27:19.562 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stderr 2024-09-12T02:27:18.898+0000 7f2a41600640 1 -- 172.21.15.39:0/3522769542 shutdown_connections 2024-09-12T02:27:19.562 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stderr 2024-09-12T02:27:18.898+0000 7f2a41600640 1 -- 172.21.15.39:0/3522769542 wait complete. 2024-09-12T02:27:19.849 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 02:27:19 smithi039 ceph-mon[30515]: mgrmap e8: x(active, since 2s) 2024-09-12T02:27:19.849 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 02:27:19 smithi039 ceph-mon[30515]: from='client.14130 -' entity='client.admin' cmd=[{"prefix": "orch set backend", "module_name": "cephadm", "target": ["mon-mgr", ""]}]: dispatch 2024-09-12T02:27:19.849 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 02:27:19 smithi039 ceph-mon[30515]: from='mgr.14118 172.21.15.39:0/2227794351' entity='mgr.x' 2024-09-12T02:27:19.849 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 02:27:19 smithi039 ceph-mon[30515]: from='mgr.14118 172.21.15.39:0/2227794351' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-12T02:27:19.849 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 02:27:19 smithi039 ceph-mon[30515]: [12/Sep/2024:02:27:19] ENGINE Bus STARTING 2024-09-12T02:27:19.850 INFO:journalctl@ceph.mgr.x.smithi039.stdout:Sep 12 02:27:19 smithi039 ceph-4954ed46-70ae-11ef-bcea-c7b262605968-mgr-x[30736]: 2024-09-12T02:27:19.679+0000 7effdbe00640 -1 log_channel(cephadm) log [ERR] : [12/Sep/2024:02:27:19] ENGINE Error in HTTPServer.serve 2024-09-12T02:27:19.850 INFO:journalctl@ceph.mgr.x.smithi039.stdout:Sep 12 02:27:19 smithi039 ceph-4954ed46-70ae-11ef-bcea-c7b262605968-mgr-x[30736]: Traceback (most recent call last): 2024-09-12T02:27:19.850 INFO:journalctl@ceph.mgr.x.smithi039.stdout:Sep 12 02:27:19 smithi039 ceph-4954ed46-70ae-11ef-bcea-c7b262605968-mgr-x[30736]: File "/lib/python3.9/site-packages/cheroot/server.py", line 1823, in serve 2024-09-12T02:27:19.850 INFO:journalctl@ceph.mgr.x.smithi039.stdout:Sep 12 02:27:19 smithi039 ceph-4954ed46-70ae-11ef-bcea-c7b262605968-mgr-x[30736]: self._connections.run(self.expiration_interval) 2024-09-12T02:27:19.850 INFO:journalctl@ceph.mgr.x.smithi039.stdout:Sep 12 02:27:19 smithi039 ceph-4954ed46-70ae-11ef-bcea-c7b262605968-mgr-x[30736]: File "/lib/python3.9/site-packages/cheroot/connections.py", line 203, in run 2024-09-12T02:27:19.850 INFO:journalctl@ceph.mgr.x.smithi039.stdout:Sep 12 02:27:19 smithi039 ceph-4954ed46-70ae-11ef-bcea-c7b262605968-mgr-x[30736]: self._run(expiration_interval) 2024-09-12T02:27:19.850 INFO:journalctl@ceph.mgr.x.smithi039.stdout:Sep 12 02:27:19 smithi039 ceph-4954ed46-70ae-11ef-bcea-c7b262605968-mgr-x[30736]: File "/lib/python3.9/site-packages/cheroot/connections.py", line 246, in _run 2024-09-12T02:27:19.850 INFO:journalctl@ceph.mgr.x.smithi039.stdout:Sep 12 02:27:19 smithi039 ceph-4954ed46-70ae-11ef-bcea-c7b262605968-mgr-x[30736]: new_conn = self._from_server_socket(self.server.socket) 2024-09-12T02:27:19.850 INFO:journalctl@ceph.mgr.x.smithi039.stdout:Sep 12 02:27:19 smithi039 ceph-4954ed46-70ae-11ef-bcea-c7b262605968-mgr-x[30736]: File "/lib/python3.9/site-packages/cheroot/connections.py", line 300, in _from_server_socket 2024-09-12T02:27:19.850 INFO:journalctl@ceph.mgr.x.smithi039.stdout:Sep 12 02:27:19 smithi039 ceph-4954ed46-70ae-11ef-bcea-c7b262605968-mgr-x[30736]: s, ssl_env = self.server.ssl_adapter.wrap(s) 2024-09-12T02:27:19.850 INFO:journalctl@ceph.mgr.x.smithi039.stdout:Sep 12 02:27:19 smithi039 ceph-4954ed46-70ae-11ef-bcea-c7b262605968-mgr-x[30736]: File "/lib/python3.9/site-packages/cheroot/ssl/builtin.py", line 277, in wrap 2024-09-12T02:27:19.851 INFO:journalctl@ceph.mgr.x.smithi039.stdout:Sep 12 02:27:19 smithi039 ceph-4954ed46-70ae-11ef-bcea-c7b262605968-mgr-x[30736]: s = self.context.wrap_socket( 2024-09-12T02:27:19.851 INFO:journalctl@ceph.mgr.x.smithi039.stdout:Sep 12 02:27:19 smithi039 ceph-4954ed46-70ae-11ef-bcea-c7b262605968-mgr-x[30736]: File "/lib64/python3.9/ssl.py", line 501, in wrap_socket 2024-09-12T02:27:19.851 INFO:journalctl@ceph.mgr.x.smithi039.stdout:Sep 12 02:27:19 smithi039 ceph-4954ed46-70ae-11ef-bcea-c7b262605968-mgr-x[30736]: return self.sslsocket_class._create( 2024-09-12T02:27:19.851 INFO:journalctl@ceph.mgr.x.smithi039.stdout:Sep 12 02:27:19 smithi039 ceph-4954ed46-70ae-11ef-bcea-c7b262605968-mgr-x[30736]: File "/lib64/python3.9/ssl.py", line 1074, in _create 2024-09-12T02:27:19.851 INFO:journalctl@ceph.mgr.x.smithi039.stdout:Sep 12 02:27:19 smithi039 ceph-4954ed46-70ae-11ef-bcea-c7b262605968-mgr-x[30736]: self.do_handshake() 2024-09-12T02:27:19.851 INFO:journalctl@ceph.mgr.x.smithi039.stdout:Sep 12 02:27:19 smithi039 ceph-4954ed46-70ae-11ef-bcea-c7b262605968-mgr-x[30736]: File "/lib64/python3.9/ssl.py", line 1343, in do_handshake 2024-09-12T02:27:19.851 INFO:journalctl@ceph.mgr.x.smithi039.stdout:Sep 12 02:27:19 smithi039 ceph-4954ed46-70ae-11ef-bcea-c7b262605968-mgr-x[30736]: self._sslobj.do_handshake() 2024-09-12T02:27:19.851 INFO:journalctl@ceph.mgr.x.smithi039.stdout:Sep 12 02:27:19 smithi039 ceph-4954ed46-70ae-11ef-bcea-c7b262605968-mgr-x[30736]: ssl.SSLZeroReturnError: TLS/SSL connection has been closed (EOF) (_ssl.c:1133) 2024-09-12T02:27:19.851 INFO:journalctl@ceph.mgr.x.smithi039.stdout:Sep 12 02:27:19 smithi039 ceph-4954ed46-70ae-11ef-bcea-c7b262605968-mgr-x[30736]: 2024-09-12T02:27:21.046 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 02:27:20 smithi039 ceph-mon[30515]: [12/Sep/2024:02:27:19] ENGINE Serving on https://172.21.15.39:7150 2024-09-12T02:27:21.046 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 02:27:20 smithi039 ceph-mon[30515]: [12/Sep/2024:02:27:19] ENGINE Error in HTTPServer.serve 2024-09-12T02:27:21.046 INFO:journalctl@ceph.mon.a.smithi039.stdout: Traceback (most recent call last): 2024-09-12T02:27:21.046 INFO:journalctl@ceph.mon.a.smithi039.stdout: File "/lib/python3.9/site-packages/cheroot/server.py", line 1823, in serve 2024-09-12T02:27:21.046 INFO:journalctl@ceph.mon.a.smithi039.stdout: self._connections.run(self.expiration_interval) 2024-09-12T02:27:21.046 INFO:journalctl@ceph.mon.a.smithi039.stdout: File "/lib/python3.9/site-packages/cheroot/connections.py", line 203, in run 2024-09-12T02:27:21.046 INFO:journalctl@ceph.mon.a.smithi039.stdout: self._run(expiration_interval) 2024-09-12T02:27:21.046 INFO:journalctl@ceph.mon.a.smithi039.stdout: File "/lib/python3.9/site-packages/cheroot/connections.py", line 246, in _run 2024-09-12T02:27:21.046 INFO:journalctl@ceph.mon.a.smithi039.stdout: new_conn = self._from_server_socket(self.server.socket) 2024-09-12T02:27:21.047 INFO:journalctl@ceph.mon.a.smithi039.stdout: File "/lib/python3.9/site-packages/cheroot/connections.py", line 300, in _from_server_socket 2024-09-12T02:27:21.047 INFO:journalctl@ceph.mon.a.smithi039.stdout: s, ssl_env = self.server.ssl_adapter.wrap(s) 2024-09-12T02:27:21.047 INFO:journalctl@ceph.mon.a.smithi039.stdout: File "/lib/python3.9/site-packages/cheroot/ssl/builtin.py", line 277, in wrap 2024-09-12T02:27:21.047 INFO:journalctl@ceph.mon.a.smithi039.stdout: s = self.context.wrap_socket( 2024-09-12T02:27:21.047 INFO:journalctl@ceph.mon.a.smithi039.stdout: File "/lib64/python3.9/ssl.py", line 501, in wrap_socket 2024-09-12T02:27:21.047 INFO:journalctl@ceph.mon.a.smithi039.stdout: return self.sslsocket_class._create( 2024-09-12T02:27:21.047 INFO:journalctl@ceph.mon.a.smithi039.stdout: File "/lib64/python3.9/ssl.py", line 1074, in _create 2024-09-12T02:27:21.047 INFO:journalctl@ceph.mon.a.smithi039.stdout: self.do_handshake() 2024-09-12T02:27:21.047 INFO:journalctl@ceph.mon.a.smithi039.stdout: File "/lib64/python3.9/ssl.py", line 1343, in do_handshake 2024-09-12T02:27:21.047 INFO:journalctl@ceph.mon.a.smithi039.stdout: self._sslobj.do_handshake() 2024-09-12T02:27:21.047 INFO:journalctl@ceph.mon.a.smithi039.stdout: ssl.SSLZeroReturnError: TLS/SSL connection has been closed (EOF) (_ssl.c:1133) 2024-09-12T02:27:21.047 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 02:27:20 smithi039 ceph-mon[30515]: [12/Sep/2024:02:27:19] ENGINE Serving on http://172.21.15.39:8765 2024-09-12T02:27:21.048 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 02:27:20 smithi039 ceph-mon[30515]: [12/Sep/2024:02:27:19] ENGINE Bus STARTED 2024-09-12T02:27:21.048 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 02:27:20 smithi039 ceph-mon[30515]: from='mgr.14118 172.21.15.39:0/2227794351' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-12T02:27:21.048 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 02:27:20 smithi039 ceph-mon[30515]: from='client.14132 -' entity='client.admin' cmd=[{"prefix": "cephadm set-user", "user": "root", "target": ["mon-mgr", ""]}]: dispatch 2024-09-12T02:27:21.060 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stdout value unchanged 2024-09-12T02:27:21.060 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stderr 2024-09-12T02:27:20.084+0000 7fb78f400640 1 Processor -- start 2024-09-12T02:27:21.060 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stderr 2024-09-12T02:27:20.084+0000 7fb78f400640 1 -- start start 2024-09-12T02:27:21.060 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stderr 2024-09-12T02:27:20.084+0000 7fb78f400640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fb788109880 0x7fb788109c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:27:21.060 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stderr 2024-09-12T02:27:20.084+0000 7fb78f400640 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 -- 0x7fb78810a250 con 0x7fb788109880 2024-09-12T02:27:21.060 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stderr 2024-09-12T02:27:20.085+0000 7fb78ca00640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fb788109880 0x7fb788109c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:27:21.060 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stderr 2024-09-12T02:27:20.085+0000 7fb78ca00640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fb788109880 0x7fb788109c80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.39:3300/0 says I am v2:172.21.15.39:40350/0 (socket says 172.21.15.39:40350) 2024-09-12T02:27:21.060 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stderr 2024-09-12T02:27:20.085+0000 7fb78ca00640 1 -- 172.21.15.39:0/2312375380 learned_addr learned my addr 172.21.15.39:0/2312375380 (peer_addr_for_me v2:172.21.15.39:0/0) 2024-09-12T02:27:21.060 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stderr 2024-09-12T02:27:20.085+0000 7fb78ca00640 1 -- 172.21.15.39:0/2312375380 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb78810aa80 con 0x7fb788109880 2024-09-12T02:27:21.060 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stderr 2024-09-12T02:27:20.086+0000 7fb78ca00640 1 --2- 172.21.15.39:0/2312375380 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fb788109880 0x7fb788109c80 secure :-1 s=READY pgs=37 cs=0 l=1 rev1=1 crypto rx=0x7fb77c009820 tx=0x7fb77c02a270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7ce6ca96b4639d03 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:27:21.060 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stderr 2024-09-12T02:27:20.086+0000 7fb787400640 1 -- 172.21.15.39:0/2312375380 <== mon.0 v2:172.21.15.39:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fb77c037070 con 0x7fb788109880 2024-09-12T02:27:21.061 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stderr 2024-09-12T02:27:20.086+0000 7fb787400640 1 -- 172.21.15.39:0/2312375380 <== mon.0 v2:172.21.15.39:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7fb77c032900 con 0x7fb788109880 2024-09-12T02:27:21.061 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stderr 2024-09-12T02:27:20.086+0000 7fb787400640 1 -- 172.21.15.39:0/2312375380 <== mon.0 v2:172.21.15.39:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fb77c030850 con 0x7fb788109880 2024-09-12T02:27:21.061 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stderr 2024-09-12T02:27:20.087+0000 7fb78f400640 1 -- 172.21.15.39:0/2312375380 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fb788109880 msgr2=0x7fb788109c80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:27:21.061 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stderr 2024-09-12T02:27:20.087+0000 7fb78f400640 1 --2- 172.21.15.39:0/2312375380 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fb788109880 0x7fb788109c80 secure :-1 s=READY pgs=37 cs=0 l=1 rev1=1 crypto rx=0x7fb77c009820 tx=0x7fb77c02a270 comp rx=0 tx=0).stop 2024-09-12T02:27:21.061 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stderr 2024-09-12T02:27:20.087+0000 7fb78f400640 1 -- 172.21.15.39:0/2312375380 shutdown_connections 2024-09-12T02:27:21.061 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stderr 2024-09-12T02:27:20.087+0000 7fb78f400640 1 --2- 172.21.15.39:0/2312375380 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fb788109880 0x7fb788109c80 unknown :-1 s=CLOSED pgs=37 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:27:21.061 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stderr 2024-09-12T02:27:20.087+0000 7fb78f400640 1 -- 172.21.15.39:0/2312375380 >> 172.21.15.39:0/2312375380 conn(0x7fb78807ce60 msgr2=0x7fb78807d270 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:27:21.061 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stderr 2024-09-12T02:27:20.087+0000 7fb78f400640 1 -- 172.21.15.39:0/2312375380 shutdown_connections 2024-09-12T02:27:21.061 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stderr 2024-09-12T02:27:20.087+0000 7fb78f400640 1 -- 172.21.15.39:0/2312375380 wait complete. 2024-09-12T02:27:21.061 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stderr 2024-09-12T02:27:20.088+0000 7fb78f400640 1 Processor -- start 2024-09-12T02:27:21.061 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stderr 2024-09-12T02:27:20.088+0000 7fb78f400640 1 -- start start 2024-09-12T02:27:21.062 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stderr 2024-09-12T02:27:20.089+0000 7fb78f400640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fb788109880 0x7fb78819d8a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:27:21.062 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stderr 2024-09-12T02:27:20.089+0000 7fb78f400640 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 -- 0x7fb78810de30 con 0x7fb788109880 2024-09-12T02:27:21.062 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stderr 2024-09-12T02:27:20.089+0000 7fb78ca00640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fb788109880 0x7fb78819d8a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:27:21.062 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stderr 2024-09-12T02:27:20.089+0000 7fb78ca00640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fb788109880 0x7fb78819d8a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.39:3300/0 says I am v2:172.21.15.39:40352/0 (socket says 172.21.15.39:40352) 2024-09-12T02:27:21.062 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stderr 2024-09-12T02:27:20.089+0000 7fb78ca00640 1 -- 172.21.15.39:0/1578062563 learned_addr learned my addr 172.21.15.39:0/1578062563 (peer_addr_for_me v2:172.21.15.39:0/0) 2024-09-12T02:27:21.062 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stderr 2024-09-12T02:27:20.089+0000 7fb78ca00640 1 -- 172.21.15.39:0/1578062563 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb78819dde0 con 0x7fb788109880 2024-09-12T02:27:21.062 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stderr 2024-09-12T02:27:20.089+0000 7fb78ca00640 1 --2- 172.21.15.39:0/1578062563 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fb788109880 0x7fb78819d8a0 secure :-1 s=READY pgs=38 cs=0 l=1 rev1=1 crypto rx=0x7fb77c009940 tx=0x7fb77c032ce0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:27:21.062 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stderr 2024-09-12T02:27:20.090+0000 7fb785600640 1 -- 172.21.15.39:0/1578062563 <== mon.0 v2:172.21.15.39:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fb77c042070 con 0x7fb788109880 2024-09-12T02:27:21.062 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stderr 2024-09-12T02:27:20.090+0000 7fb785600640 1 -- 172.21.15.39:0/1578062563 <== mon.0 v2:172.21.15.39:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7fb77c0308c0 con 0x7fb788109880 2024-09-12T02:27:21.062 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stderr 2024-09-12T02:27:20.090+0000 7fb78f400640 1 -- 172.21.15.39:0/1578062563 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb78819e070 con 0x7fb788109880 2024-09-12T02:27:21.062 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stderr 2024-09-12T02:27:20.090+0000 7fb785600640 1 -- 172.21.15.39:0/1578062563 <== mon.0 v2:172.21.15.39:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fb77c037040 con 0x7fb788109880 2024-09-12T02:27:21.062 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stderr 2024-09-12T02:27:20.090+0000 7fb78f400640 1 -- 172.21.15.39:0/1578062563 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb7881a0d60 con 0x7fb788109880 2024-09-12T02:27:21.062 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stderr 2024-09-12T02:27:20.091+0000 7fb785600640 1 -- 172.21.15.39:0/1578062563 <== mon.0 v2:172.21.15.39:3300/0 4 ==== mgrmap(e 8) ==== 46287+0+0 (secure 0 0 0) 0x7fb77c045070 con 0x7fb788109880 2024-09-12T02:27:21.063 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stderr 2024-09-12T02:27:20.091+0000 7fb78f400640 1 -- 172.21.15.39:0/1578062563 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fb78810dfb0 con 0x7fb788109880 2024-09-12T02:27:21.063 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stderr 2024-09-12T02:27:20.091+0000 7fb785600640 1 --2- 172.21.15.39:0/1578062563 >> [v2:172.21.15.39:6800/3152613618,v1:172.21.15.39:6801/3152613618] conn(0x7fb770038fc0 0x7fb77003b480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:27:21.063 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stderr 2024-09-12T02:27:20.091+0000 7fb785600640 1 -- 172.21.15.39:0/1578062563 <== mon.0 v2:172.21.15.39:3300/0 5 ==== osd_map(2..2 src has 1..2) ==== 940+0+0 (secure 0 0 0) 0x7fb77c06c090 con 0x7fb788109880 2024-09-12T02:27:21.063 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stderr 2024-09-12T02:27:20.092+0000 7fb787e00640 1 --2- 172.21.15.39:0/1578062563 >> [v2:172.21.15.39:6800/3152613618,v1:172.21.15.39:6801/3152613618] conn(0x7fb770038fc0 0x7fb77003b480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:27:21.063 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stderr 2024-09-12T02:27:20.092+0000 7fb787e00640 1 --2- 172.21.15.39:0/1578062563 >> [v2:172.21.15.39:6800/3152613618,v1:172.21.15.39:6801/3152613618] conn(0x7fb770038fc0 0x7fb77003b480 secure :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0x7fb7740098c0 tx=0x7fb774006db0 comp rx=0 tx=0).ready entity=mgr.14118 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:27:21.063 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stderr 2024-09-12T02:27:20.096+0000 7fb785600640 1 -- 172.21.15.39:0/1578062563 <== mon.0 v2:172.21.15.39:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7fb77c04b170 con 0x7fb788109880 2024-09-12T02:27:21.063 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stderr 2024-09-12T02:27:20.285+0000 7fb78f400640 1 -- 172.21.15.39:0/1578062563 --> [v2:172.21.15.39:6800/3152613618,v1:172.21.15.39:6801/3152613618] -- mgr_command(tid 0: {"prefix": "cephadm set-user", "user": "root", "target": ["mon-mgr", ""]}) -- 0x7fb7881073e0 con 0x7fb770038fc0 2024-09-12T02:27:21.063 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stderr 2024-09-12T02:27:20.286+0000 7fb785600640 1 -- 172.21.15.39:0/1578062563 <== mgr.14118 v2:172.21.15.39:6800/3152613618 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+16 (secure 0 0 0) 0x7fb7881073e0 con 0x7fb770038fc0 2024-09-12T02:27:21.063 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stderr 2024-09-12T02:27:20.288+0000 7fb78f400640 1 -- 172.21.15.39:0/1578062563 >> [v2:172.21.15.39:6800/3152613618,v1:172.21.15.39:6801/3152613618] conn(0x7fb770038fc0 msgr2=0x7fb77003b480 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:27:21.063 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stderr 2024-09-12T02:27:20.288+0000 7fb78f400640 1 --2- 172.21.15.39:0/1578062563 >> [v2:172.21.15.39:6800/3152613618,v1:172.21.15.39:6801/3152613618] conn(0x7fb770038fc0 0x7fb77003b480 secure :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0x7fb7740098c0 tx=0x7fb774006db0 comp rx=0 tx=0).stop 2024-09-12T02:27:21.064 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stderr 2024-09-12T02:27:20.288+0000 7fb78f400640 1 -- 172.21.15.39:0/1578062563 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fb788109880 msgr2=0x7fb78819d8a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:27:21.064 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stderr 2024-09-12T02:27:20.288+0000 7fb78f400640 1 --2- 172.21.15.39:0/1578062563 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fb788109880 0x7fb78819d8a0 secure :-1 s=READY pgs=38 cs=0 l=1 rev1=1 crypto rx=0x7fb77c009940 tx=0x7fb77c032ce0 comp rx=0 tx=0).stop 2024-09-12T02:27:21.064 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stderr 2024-09-12T02:27:20.288+0000 7fb78f400640 1 -- 172.21.15.39:0/1578062563 shutdown_connections 2024-09-12T02:27:21.064 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stderr 2024-09-12T02:27:20.288+0000 7fb78f400640 1 --2- 172.21.15.39:0/1578062563 >> [v2:172.21.15.39:6800/3152613618,v1:172.21.15.39:6801/3152613618] conn(0x7fb770038fc0 0x7fb77003b480 unknown :-1 s=CLOSED pgs=8 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:27:21.064 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stderr 2024-09-12T02:27:20.288+0000 7fb78f400640 1 --2- 172.21.15.39:0/1578062563 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fb788109880 0x7fb78819d8a0 unknown :-1 s=CLOSED pgs=38 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:27:21.064 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stderr 2024-09-12T02:27:20.288+0000 7fb78f400640 1 -- 172.21.15.39:0/1578062563 >> 172.21.15.39:0/1578062563 conn(0x7fb78807ce60 msgr2=0x7fb788106cd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:27:21.064 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stderr 2024-09-12T02:27:20.289+0000 7fb78f400640 1 -- 172.21.15.39:0/1578062563 shutdown_connections 2024-09-12T02:27:21.064 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stderr 2024-09-12T02:27:20.289+0000 7fb78f400640 1 -- 172.21.15.39:0/1578062563 wait complete. 2024-09-12T02:27:21.064 INFO:teuthology.orchestra.run.smithi039.stdout:Generating ssh key... 2024-09-12T02:27:22.482 INFO:journalctl@ceph.mgr.x.smithi039.stdout:Sep 12 02:27:22 smithi039 ceph-4954ed46-70ae-11ef-bcea-c7b262605968-mgr-x[30736]: Generating public/private rsa key pair. 2024-09-12T02:27:22.482 INFO:journalctl@ceph.mgr.x.smithi039.stdout:Sep 12 02:27:22 smithi039 ceph-4954ed46-70ae-11ef-bcea-c7b262605968-mgr-x[30736]: Your identification has been saved in /tmp/tmpsiagvain/key 2024-09-12T02:27:22.482 INFO:journalctl@ceph.mgr.x.smithi039.stdout:Sep 12 02:27:22 smithi039 ceph-4954ed46-70ae-11ef-bcea-c7b262605968-mgr-x[30736]: Your public key has been saved in /tmp/tmpsiagvain/key.pub 2024-09-12T02:27:22.482 INFO:journalctl@ceph.mgr.x.smithi039.stdout:Sep 12 02:27:22 smithi039 ceph-4954ed46-70ae-11ef-bcea-c7b262605968-mgr-x[30736]: The key fingerprint is: 2024-09-12T02:27:22.482 INFO:journalctl@ceph.mgr.x.smithi039.stdout:Sep 12 02:27:22 smithi039 ceph-4954ed46-70ae-11ef-bcea-c7b262605968-mgr-x[30736]: SHA256:cMn5ttf1PVK90dwW5+hnuKmYZ5pn2TQsdtLTGRKuUSE ceph-4954ed46-70ae-11ef-bcea-c7b262605968 2024-09-12T02:27:22.482 INFO:journalctl@ceph.mgr.x.smithi039.stdout:Sep 12 02:27:22 smithi039 ceph-4954ed46-70ae-11ef-bcea-c7b262605968-mgr-x[30736]: The key's randomart image is: 2024-09-12T02:27:22.482 INFO:journalctl@ceph.mgr.x.smithi039.stdout:Sep 12 02:27:22 smithi039 ceph-4954ed46-70ae-11ef-bcea-c7b262605968-mgr-x[30736]: +---[RSA 3072]----+ 2024-09-12T02:27:22.482 INFO:journalctl@ceph.mgr.x.smithi039.stdout:Sep 12 02:27:22 smithi039 ceph-4954ed46-70ae-11ef-bcea-c7b262605968-mgr-x[30736]: | E .. | 2024-09-12T02:27:22.482 INFO:journalctl@ceph.mgr.x.smithi039.stdout:Sep 12 02:27:22 smithi039 ceph-4954ed46-70ae-11ef-bcea-c7b262605968-mgr-x[30736]: | . o .o | 2024-09-12T02:27:22.482 INFO:journalctl@ceph.mgr.x.smithi039.stdout:Sep 12 02:27:22 smithi039 ceph-4954ed46-70ae-11ef-bcea-c7b262605968-mgr-x[30736]: | . = o ...| 2024-09-12T02:27:22.483 INFO:journalctl@ceph.mgr.x.smithi039.stdout:Sep 12 02:27:22 smithi039 ceph-4954ed46-70ae-11ef-bcea-c7b262605968-mgr-x[30736]: | o . . o =*| 2024-09-12T02:27:22.483 INFO:journalctl@ceph.mgr.x.smithi039.stdout:Sep 12 02:27:22 smithi039 ceph-4954ed46-70ae-11ef-bcea-c7b262605968-mgr-x[30736]: | S o ooo+@| 2024-09-12T02:27:22.483 INFO:journalctl@ceph.mgr.x.smithi039.stdout:Sep 12 02:27:22 smithi039 ceph-4954ed46-70ae-11ef-bcea-c7b262605968-mgr-x[30736]: | . o+oO=*| 2024-09-12T02:27:22.483 INFO:journalctl@ceph.mgr.x.smithi039.stdout:Sep 12 02:27:22 smithi039 ceph-4954ed46-70ae-11ef-bcea-c7b262605968-mgr-x[30736]: | ...O+==| 2024-09-12T02:27:22.483 INFO:journalctl@ceph.mgr.x.smithi039.stdout:Sep 12 02:27:22 smithi039 ceph-4954ed46-70ae-11ef-bcea-c7b262605968-mgr-x[30736]: | =* o=.| 2024-09-12T02:27:22.483 INFO:journalctl@ceph.mgr.x.smithi039.stdout:Sep 12 02:27:22 smithi039 ceph-4954ed46-70ae-11ef-bcea-c7b262605968-mgr-x[30736]: | =*..o | 2024-09-12T02:27:22.483 INFO:journalctl@ceph.mgr.x.smithi039.stdout:Sep 12 02:27:22 smithi039 ceph-4954ed46-70ae-11ef-bcea-c7b262605968-mgr-x[30736]: +----[SHA256]-----+ 2024-09-12T02:27:22.804 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stderr 2024-09-12T02:27:21.572+0000 7fdd68a00640 1 Processor -- start 2024-09-12T02:27:22.804 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stderr 2024-09-12T02:27:21.572+0000 7fdd68a00640 1 -- start start 2024-09-12T02:27:22.804 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stderr 2024-09-12T02:27:21.572+0000 7fdd68a00640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fdd641096a0 0x7fdd64109aa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:27:22.804 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stderr 2024-09-12T02:27:21.572+0000 7fdd68a00640 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 -- 0x7fdd6410a070 con 0x7fdd641096a0 2024-09-12T02:27:22.804 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stderr 2024-09-12T02:27:21.573+0000 7fdd62800640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fdd641096a0 0x7fdd64109aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:27:22.804 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stderr 2024-09-12T02:27:21.573+0000 7fdd62800640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fdd641096a0 0x7fdd64109aa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.39:3300/0 says I am v2:172.21.15.39:40360/0 (socket says 172.21.15.39:40360) 2024-09-12T02:27:22.804 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stderr 2024-09-12T02:27:21.573+0000 7fdd62800640 1 -- 172.21.15.39:0/3232414471 learned_addr learned my addr 172.21.15.39:0/3232414471 (peer_addr_for_me v2:172.21.15.39:0/0) 2024-09-12T02:27:22.804 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stderr 2024-09-12T02:27:21.573+0000 7fdd62800640 1 -- 172.21.15.39:0/3232414471 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fdd6410a8a0 con 0x7fdd641096a0 2024-09-12T02:27:22.804 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stderr 2024-09-12T02:27:21.574+0000 7fdd62800640 1 --2- 172.21.15.39:0/3232414471 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fdd641096a0 0x7fdd64109aa0 secure :-1 s=READY pgs=39 cs=0 l=1 rev1=1 crypto rx=0x7fdd54009e80 tx=0x7fdd5402a7a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3869fed98c0db489 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:27:22.804 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stderr 2024-09-12T02:27:21.574+0000 7fdd61e00640 1 -- 172.21.15.39:0/3232414471 <== mon.0 v2:172.21.15.39:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fdd54036070 con 0x7fdd641096a0 2024-09-12T02:27:22.804 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stderr 2024-09-12T02:27:21.574+0000 7fdd61e00640 1 -- 172.21.15.39:0/3232414471 <== mon.0 v2:172.21.15.39:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7fdd540318c0 con 0x7fdd641096a0 2024-09-12T02:27:22.805 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stderr 2024-09-12T02:27:21.574+0000 7fdd61e00640 1 -- 172.21.15.39:0/3232414471 <== mon.0 v2:172.21.15.39:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fdd54007ab0 con 0x7fdd641096a0 2024-09-12T02:27:22.805 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stderr 2024-09-12T02:27:21.575+0000 7fdd68a00640 1 -- 172.21.15.39:0/3232414471 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fdd641096a0 msgr2=0x7fdd64109aa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:27:22.805 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stderr 2024-09-12T02:27:21.575+0000 7fdd68a00640 1 --2- 172.21.15.39:0/3232414471 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fdd641096a0 0x7fdd64109aa0 secure :-1 s=READY pgs=39 cs=0 l=1 rev1=1 crypto rx=0x7fdd54009e80 tx=0x7fdd5402a7a0 comp rx=0 tx=0).stop 2024-09-12T02:27:22.805 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stderr 2024-09-12T02:27:21.575+0000 7fdd68a00640 1 -- 172.21.15.39:0/3232414471 shutdown_connections 2024-09-12T02:27:22.805 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stderr 2024-09-12T02:27:21.575+0000 7fdd68a00640 1 --2- 172.21.15.39:0/3232414471 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fdd641096a0 0x7fdd64109aa0 unknown :-1 s=CLOSED pgs=39 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:27:22.805 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stderr 2024-09-12T02:27:21.575+0000 7fdd68a00640 1 -- 172.21.15.39:0/3232414471 >> 172.21.15.39:0/3232414471 conn(0x7fdd6407cd10 msgr2=0x7fdd6407d120 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:27:22.805 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stderr 2024-09-12T02:27:21.575+0000 7fdd68a00640 1 -- 172.21.15.39:0/3232414471 shutdown_connections 2024-09-12T02:27:22.805 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stderr 2024-09-12T02:27:21.575+0000 7fdd68a00640 1 -- 172.21.15.39:0/3232414471 wait complete. 2024-09-12T02:27:22.805 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stderr 2024-09-12T02:27:21.576+0000 7fdd68a00640 1 Processor -- start 2024-09-12T02:27:22.805 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stderr 2024-09-12T02:27:21.576+0000 7fdd68a00640 1 -- start start 2024-09-12T02:27:22.805 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stderr 2024-09-12T02:27:21.576+0000 7fdd68a00640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fdd641096a0 0x7fdd6419d6a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:27:22.805 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stderr 2024-09-12T02:27:21.576+0000 7fdd68a00640 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 -- 0x7fdd6410dc50 con 0x7fdd641096a0 2024-09-12T02:27:22.805 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stderr 2024-09-12T02:27:21.576+0000 7fdd62800640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fdd641096a0 0x7fdd6419d6a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:27:22.805 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stderr 2024-09-12T02:27:21.577+0000 7fdd62800640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fdd641096a0 0x7fdd6419d6a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.39:3300/0 says I am v2:172.21.15.39:40374/0 (socket says 172.21.15.39:40374) 2024-09-12T02:27:22.806 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stderr 2024-09-12T02:27:21.577+0000 7fdd62800640 1 -- 172.21.15.39:0/3304130442 learned_addr learned my addr 172.21.15.39:0/3304130442 (peer_addr_for_me v2:172.21.15.39:0/0) 2024-09-12T02:27:22.806 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stderr 2024-09-12T02:27:21.577+0000 7fdd62800640 1 -- 172.21.15.39:0/3304130442 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fdd6419dbe0 con 0x7fdd641096a0 2024-09-12T02:27:22.806 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stderr 2024-09-12T02:27:21.577+0000 7fdd62800640 1 --2- 172.21.15.39:0/3304130442 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fdd641096a0 0x7fdd6419d6a0 secure :-1 s=READY pgs=40 cs=0 l=1 rev1=1 crypto rx=0x7fdd5402ad90 tx=0x7fdd54031ca0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:27:22.806 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stderr 2024-09-12T02:27:21.577+0000 7fdd5be00640 1 -- 172.21.15.39:0/3304130442 <== mon.0 v2:172.21.15.39:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fdd54036050 con 0x7fdd641096a0 2024-09-12T02:27:22.806 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stderr 2024-09-12T02:27:21.577+0000 7fdd5be00640 1 -- 172.21.15.39:0/3304130442 <== mon.0 v2:172.21.15.39:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7fdd54042070 con 0x7fdd641096a0 2024-09-12T02:27:22.806 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stderr 2024-09-12T02:27:21.577+0000 7fdd68a00640 1 -- 172.21.15.39:0/3304130442 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fdd6419de70 con 0x7fdd641096a0 2024-09-12T02:27:22.806 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stderr 2024-09-12T02:27:21.578+0000 7fdd5be00640 1 -- 172.21.15.39:0/3304130442 <== mon.0 v2:172.21.15.39:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fdd5403d7e0 con 0x7fdd641096a0 2024-09-12T02:27:22.806 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stderr 2024-09-12T02:27:21.578+0000 7fdd68a00640 1 -- 172.21.15.39:0/3304130442 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fdd641a0b60 con 0x7fdd641096a0 2024-09-12T02:27:22.806 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stderr 2024-09-12T02:27:21.579+0000 7fdd5be00640 1 -- 172.21.15.39:0/3304130442 <== mon.0 v2:172.21.15.39:3300/0 4 ==== mgrmap(e 8) ==== 46287+0+0 (secure 0 0 0) 0x7fdd5403b610 con 0x7fdd641096a0 2024-09-12T02:27:22.806 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stderr 2024-09-12T02:27:21.579+0000 7fdd68a00640 1 -- 172.21.15.39:0/3304130442 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fdd6410ddd0 con 0x7fdd641096a0 2024-09-12T02:27:22.806 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stderr 2024-09-12T02:27:21.579+0000 7fdd5be00640 1 --2- 172.21.15.39:0/3304130442 >> [v2:172.21.15.39:6800/3152613618,v1:172.21.15.39:6801/3152613618] conn(0x7fdd48038fc0 0x7fdd4803b480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:27:22.806 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stderr 2024-09-12T02:27:21.579+0000 7fdd5be00640 1 -- 172.21.15.39:0/3304130442 <== mon.0 v2:172.21.15.39:3300/0 5 ==== osd_map(2..2 src has 1..2) ==== 940+0+0 (secure 0 0 0) 0x7fdd54007e00 con 0x7fdd641096a0 2024-09-12T02:27:22.806 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stderr 2024-09-12T02:27:21.579+0000 7fdd59e00640 1 --2- 172.21.15.39:0/3304130442 >> [v2:172.21.15.39:6800/3152613618,v1:172.21.15.39:6801/3152613618] conn(0x7fdd48038fc0 0x7fdd4803b480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:27:22.807 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stderr 2024-09-12T02:27:21.580+0000 7fdd59e00640 1 --2- 172.21.15.39:0/3304130442 >> [v2:172.21.15.39:6800/3152613618,v1:172.21.15.39:6801/3152613618] conn(0x7fdd48038fc0 0x7fdd4803b480 secure :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0x7fdd4c0098c0 tx=0x7fdd4c006db0 comp rx=0 tx=0).ready entity=mgr.14118 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:27:22.807 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stderr 2024-09-12T02:27:21.584+0000 7fdd5be00640 1 -- 172.21.15.39:0/3304130442 <== mon.0 v2:172.21.15.39:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7fdd540073a0 con 0x7fdd641096a0 2024-09-12T02:27:22.807 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stderr 2024-09-12T02:27:21.772+0000 7fdd68a00640 1 -- 172.21.15.39:0/3304130442 --> [v2:172.21.15.39:6800/3152613618,v1:172.21.15.39:6801/3152613618] -- mgr_command(tid 0: {"prefix": "cephadm generate-key", "target": ["mon-mgr", ""]}) -- 0x7fdd6410c1d0 con 0x7fdd48038fc0 2024-09-12T02:27:22.807 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stderr 2024-09-12T02:27:22.122+0000 7fdd5be00640 1 -- 172.21.15.39:0/3304130442 <== mgr.14118 v2:172.21.15.39:6800/3152613618 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+0 (secure 0 0 0) 0x7fdd6410c1d0 con 0x7fdd48038fc0 2024-09-12T02:27:22.807 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stderr 2024-09-12T02:27:22.124+0000 7fdd68a00640 1 -- 172.21.15.39:0/3304130442 >> [v2:172.21.15.39:6800/3152613618,v1:172.21.15.39:6801/3152613618] conn(0x7fdd48038fc0 msgr2=0x7fdd4803b480 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:27:22.807 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stderr 2024-09-12T02:27:22.124+0000 7fdd68a00640 1 --2- 172.21.15.39:0/3304130442 >> [v2:172.21.15.39:6800/3152613618,v1:172.21.15.39:6801/3152613618] conn(0x7fdd48038fc0 0x7fdd4803b480 secure :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0x7fdd4c0098c0 tx=0x7fdd4c006db0 comp rx=0 tx=0).stop 2024-09-12T02:27:22.807 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stderr 2024-09-12T02:27:22.124+0000 7fdd68a00640 1 -- 172.21.15.39:0/3304130442 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fdd641096a0 msgr2=0x7fdd6419d6a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:27:22.807 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stderr 2024-09-12T02:27:22.124+0000 7fdd68a00640 1 --2- 172.21.15.39:0/3304130442 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fdd641096a0 0x7fdd6419d6a0 secure :-1 s=READY pgs=40 cs=0 l=1 rev1=1 crypto rx=0x7fdd5402ad90 tx=0x7fdd54031ca0 comp rx=0 tx=0).stop 2024-09-12T02:27:22.807 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stderr 2024-09-12T02:27:22.124+0000 7fdd68a00640 1 -- 172.21.15.39:0/3304130442 shutdown_connections 2024-09-12T02:27:22.807 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stderr 2024-09-12T02:27:22.124+0000 7fdd68a00640 1 --2- 172.21.15.39:0/3304130442 >> [v2:172.21.15.39:6800/3152613618,v1:172.21.15.39:6801/3152613618] conn(0x7fdd48038fc0 0x7fdd4803b480 unknown :-1 s=CLOSED pgs=9 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:27:22.807 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stderr 2024-09-12T02:27:22.124+0000 7fdd68a00640 1 --2- 172.21.15.39:0/3304130442 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fdd641096a0 0x7fdd6419d6a0 unknown :-1 s=CLOSED pgs=40 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:27:22.807 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stderr 2024-09-12T02:27:22.124+0000 7fdd68a00640 1 -- 172.21.15.39:0/3304130442 >> 172.21.15.39:0/3304130442 conn(0x7fdd6407cd10 msgr2=0x7fdd6410bac0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:27:22.807 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stderr 2024-09-12T02:27:22.125+0000 7fdd68a00640 1 -- 172.21.15.39:0/3304130442 shutdown_connections 2024-09-12T02:27:22.808 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stderr 2024-09-12T02:27:22.125+0000 7fdd68a00640 1 -- 172.21.15.39:0/3304130442 wait complete. 2024-09-12T02:27:23.315 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 02:27:23 smithi039 ceph-mon[30515]: from='client.14134 -' entity='client.admin' cmd=[{"prefix": "cephadm generate-key", "target": ["mon-mgr", ""]}]: dispatch 2024-09-12T02:27:23.315 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 02:27:23 smithi039 ceph-mon[30515]: Generating ssh key... 2024-09-12T02:27:23.315 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 02:27:23 smithi039 ceph-mon[30515]: from='mgr.14118 172.21.15.39:0/2227794351' entity='mgr.x' 2024-09-12T02:27:23.315 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 02:27:23 smithi039 ceph-mon[30515]: from='mgr.14118 172.21.15.39:0/2227794351' entity='mgr.x' 2024-09-12T02:27:24.166 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 02:27:24 smithi039 ceph-mon[30515]: from='client.14136 -' entity='client.admin' cmd=[{"prefix": "cephadm get-pub-key", "target": ["mon-mgr", ""]}]: dispatch 2024-09-12T02:27:24.178 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stdout ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQDdr1KhalnZElck1UERmqBqYHZcvOpK3aiNObsYCwJBrpDUZ/byEd9On0VGA3J/W0FK7/F8HU1Kigumi+98Xjt+vn1IDFrn5OrkGdDt4drROzHQK7bzQfFCoZK1OOxf7IjjSFWmFCUZAZoOKSjMm2jGLw6I56vKPFgsZ1lSt/w8zWGjKsHdSZH3wF773G3V56lPLpvIrWS4X4CP2ZrTDrCek0issZ5OzXNXQIm0HAbxMJsxaTK48/heavAqJlIeU+mlHTyDI6RJi/K1OVjvralmXnN1puaF1uLvZvU4qHE9xX0ON26p7eFJ8bstySaRKA3KIF6eDQgq5iiT7/2vap924jbpeYFMKzTS4NeUICdO1bO24hS/Sd+4V4kRjvAc2tfdQKiGTut+i/xmnn/yAOx5f4ZN06yGyN1MZEHe5v6rYukHaWfE5uEZgdX5d4fxs/x9MhPNlLaEQAMelhBZFRyzlXPysEZpJcd3KPEgbISrLknF9QfbygjrtTH0/faWnHU= ceph-4954ed46-70ae-11ef-bcea-c7b262605968 2024-09-12T02:27:24.178 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stderr 2024-09-12T02:27:23.314+0000 7f9fd5a00640 1 Processor -- start 2024-09-12T02:27:24.178 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stderr 2024-09-12T02:27:23.314+0000 7f9fd5a00640 1 -- start start 2024-09-12T02:27:24.178 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stderr 2024-09-12T02:27:23.314+0000 7f9fd5a00640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f9fd0109840 0x7f9fd0109c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:27:24.178 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stderr 2024-09-12T02:27:23.314+0000 7f9fd5a00640 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 -- 0x7f9fd010a210 con 0x7f9fd0109840 2024-09-12T02:27:24.179 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stderr 2024-09-12T02:27:23.314+0000 7f9fcfe00640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f9fd0109840 0x7f9fd0109c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:27:24.179 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stderr 2024-09-12T02:27:23.314+0000 7f9fcfe00640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f9fd0109840 0x7f9fd0109c40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.39:3300/0 says I am v2:172.21.15.39:40388/0 (socket says 172.21.15.39:40388) 2024-09-12T02:27:24.179 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stderr 2024-09-12T02:27:23.314+0000 7f9fcfe00640 1 -- 172.21.15.39:0/1664011798 learned_addr learned my addr 172.21.15.39:0/1664011798 (peer_addr_for_me v2:172.21.15.39:0/0) 2024-09-12T02:27:24.179 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stderr 2024-09-12T02:27:23.315+0000 7f9fcfe00640 1 -- 172.21.15.39:0/1664011798 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9fd010a890 con 0x7f9fd0109840 2024-09-12T02:27:24.179 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stderr 2024-09-12T02:27:23.316+0000 7f9fcfe00640 1 --2- 172.21.15.39:0/1664011798 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f9fd0109840 0x7f9fd0109c40 secure :-1 s=READY pgs=41 cs=0 l=1 rev1=1 crypto rx=0x7f9fc0009820 tx=0x7f9fc002a270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4c316044ca8a360d server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:27:24.179 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stderr 2024-09-12T02:27:23.317+0000 7f9fcf400640 1 -- 172.21.15.39:0/1664011798 <== mon.0 v2:172.21.15.39:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f9fc0037070 con 0x7f9fd0109840 2024-09-12T02:27:24.179 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stderr 2024-09-12T02:27:23.317+0000 7f9fcf400640 1 -- 172.21.15.39:0/1664011798 <== mon.0 v2:172.21.15.39:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7f9fc0032900 con 0x7f9fd0109840 2024-09-12T02:27:24.179 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stderr 2024-09-12T02:27:23.317+0000 7f9fcf400640 1 -- 172.21.15.39:0/1664011798 <== mon.0 v2:172.21.15.39:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f9fc0030850 con 0x7f9fd0109840 2024-09-12T02:27:24.179 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stderr 2024-09-12T02:27:23.317+0000 7f9fd5a00640 1 -- 172.21.15.39:0/1664011798 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f9fd0109840 msgr2=0x7f9fd0109c40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:27:24.179 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stderr 2024-09-12T02:27:23.317+0000 7f9fd5a00640 1 --2- 172.21.15.39:0/1664011798 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f9fd0109840 0x7f9fd0109c40 secure :-1 s=READY pgs=41 cs=0 l=1 rev1=1 crypto rx=0x7f9fc0009820 tx=0x7f9fc002a270 comp rx=0 tx=0).stop 2024-09-12T02:27:24.179 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stderr 2024-09-12T02:27:23.317+0000 7f9fd5a00640 1 -- 172.21.15.39:0/1664011798 shutdown_connections 2024-09-12T02:27:24.179 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stderr 2024-09-12T02:27:23.317+0000 7f9fd5a00640 1 --2- 172.21.15.39:0/1664011798 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f9fd0109840 0x7f9fd0109c40 unknown :-1 s=CLOSED pgs=41 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:27:24.180 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stderr 2024-09-12T02:27:23.317+0000 7f9fd5a00640 1 -- 172.21.15.39:0/1664011798 >> 172.21.15.39:0/1664011798 conn(0x7f9fd007ccf0 msgr2=0x7f9fd007d100 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:27:24.180 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stderr 2024-09-12T02:27:23.318+0000 7f9fd5a00640 1 -- 172.21.15.39:0/1664011798 shutdown_connections 2024-09-12T02:27:24.180 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stderr 2024-09-12T02:27:23.318+0000 7f9fd5a00640 1 -- 172.21.15.39:0/1664011798 wait complete. 2024-09-12T02:27:24.180 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stderr 2024-09-12T02:27:23.318+0000 7f9fd5a00640 1 Processor -- start 2024-09-12T02:27:24.180 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stderr 2024-09-12T02:27:23.319+0000 7f9fd5a00640 1 -- start start 2024-09-12T02:27:24.180 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stderr 2024-09-12T02:27:23.319+0000 7f9fd5a00640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f9fd0109840 0x7f9fd019d670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:27:24.180 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stderr 2024-09-12T02:27:23.319+0000 7f9fd5a00640 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 -- 0x7f9fd010dc40 con 0x7f9fd0109840 2024-09-12T02:27:24.180 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stderr 2024-09-12T02:27:23.319+0000 7f9fcfe00640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f9fd0109840 0x7f9fd019d670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:27:24.180 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stderr 2024-09-12T02:27:23.319+0000 7f9fcfe00640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f9fd0109840 0x7f9fd019d670 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.39:3300/0 says I am v2:172.21.15.39:40402/0 (socket says 172.21.15.39:40402) 2024-09-12T02:27:24.181 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stderr 2024-09-12T02:27:23.319+0000 7f9fcfe00640 1 -- 172.21.15.39:0/923518288 learned_addr learned my addr 172.21.15.39:0/923518288 (peer_addr_for_me v2:172.21.15.39:0/0) 2024-09-12T02:27:24.181 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stderr 2024-09-12T02:27:23.320+0000 7f9fcfe00640 1 -- 172.21.15.39:0/923518288 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9fd019dbb0 con 0x7f9fd0109840 2024-09-12T02:27:24.181 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stderr 2024-09-12T02:27:23.320+0000 7f9fcfe00640 1 --2- 172.21.15.39:0/923518288 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f9fd0109840 0x7f9fd019d670 secure :-1 s=READY pgs=42 cs=0 l=1 rev1=1 crypto rx=0x7f9fc00097f0 tx=0x7f9fc0030d80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:27:24.181 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stderr 2024-09-12T02:27:23.320+0000 7f9fcd600640 1 -- 172.21.15.39:0/923518288 <== mon.0 v2:172.21.15.39:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f9fc0037040 con 0x7f9fd0109840 2024-09-12T02:27:24.181 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stderr 2024-09-12T02:27:23.320+0000 7f9fcd600640 1 -- 172.21.15.39:0/923518288 <== mon.0 v2:172.21.15.39:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7f9fc0040070 con 0x7f9fd0109840 2024-09-12T02:27:24.181 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stderr 2024-09-12T02:27:23.320+0000 7f9fd5a00640 1 -- 172.21.15.39:0/923518288 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f9fd019de40 con 0x7f9fd0109840 2024-09-12T02:27:24.181 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stderr 2024-09-12T02:27:23.320+0000 7f9fcd600640 1 -- 172.21.15.39:0/923518288 <== mon.0 v2:172.21.15.39:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f9fc003a390 con 0x7f9fd0109840 2024-09-12T02:27:24.181 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stderr 2024-09-12T02:27:23.320+0000 7f9fd5a00640 1 -- 172.21.15.39:0/923518288 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f9fd01a0b30 con 0x7f9fd0109840 2024-09-12T02:27:24.181 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stderr 2024-09-12T02:27:23.321+0000 7f9fcd600640 1 -- 172.21.15.39:0/923518288 <== mon.0 v2:172.21.15.39:3300/0 4 ==== mgrmap(e 8) ==== 46287+0+0 (secure 0 0 0) 0x7f9fc003b430 con 0x7f9fd0109840 2024-09-12T02:27:24.181 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stderr 2024-09-12T02:27:23.321+0000 7f9fd5a00640 1 -- 172.21.15.39:0/923518288 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f9fd0109c40 con 0x7f9fd0109840 2024-09-12T02:27:24.182 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stderr 2024-09-12T02:27:23.322+0000 7f9fcd600640 1 --2- 172.21.15.39:0/923518288 >> [v2:172.21.15.39:6800/3152613618,v1:172.21.15.39:6801/3152613618] conn(0x7f9fb4038fc0 0x7f9fb403b480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:27:24.182 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stderr 2024-09-12T02:27:23.322+0000 7f9fcd600640 1 -- 172.21.15.39:0/923518288 <== mon.0 v2:172.21.15.39:3300/0 5 ==== osd_map(2..2 src has 1..2) ==== 940+0+0 (secure 0 0 0) 0x7f9fc006c4e0 con 0x7f9fd0109840 2024-09-12T02:27:24.182 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stderr 2024-09-12T02:27:23.322+0000 7f9fc7e00640 1 --2- 172.21.15.39:0/923518288 >> [v2:172.21.15.39:6800/3152613618,v1:172.21.15.39:6801/3152613618] conn(0x7f9fb4038fc0 0x7f9fb403b480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:27:24.182 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stderr 2024-09-12T02:27:23.323+0000 7f9fc7e00640 1 --2- 172.21.15.39:0/923518288 >> [v2:172.21.15.39:6800/3152613618,v1:172.21.15.39:6801/3152613618] conn(0x7f9fb4038fc0 0x7f9fb403b480 secure :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0x7f9fb80098c0 tx=0x7f9fb8006db0 comp rx=0 tx=0).ready entity=mgr.14118 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:27:24.182 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stderr 2024-09-12T02:27:23.327+0000 7f9fcd600640 1 -- 172.21.15.39:0/923518288 <== mon.0 v2:172.21.15.39:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7f9fc006be30 con 0x7f9fd0109840 2024-09-12T02:27:24.182 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stderr 2024-09-12T02:27:23.514+0000 7f9fd5a00640 1 -- 172.21.15.39:0/923518288 --> [v2:172.21.15.39:6800/3152613618,v1:172.21.15.39:6801/3152613618] -- mgr_command(tid 0: {"prefix": "cephadm get-pub-key", "target": ["mon-mgr", ""]}) -- 0x7f9fd0107c10 con 0x7f9fb4038fc0 2024-09-12T02:27:24.182 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stderr 2024-09-12T02:27:23.514+0000 7f9fcd600640 1 -- 172.21.15.39:0/923518288 <== mgr.14118 v2:172.21.15.39:6800/3152613618 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+595 (secure 0 0 0) 0x7f9fd0107c10 con 0x7f9fb4038fc0 2024-09-12T02:27:24.182 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stderr 2024-09-12T02:27:23.517+0000 7f9fd5a00640 1 -- 172.21.15.39:0/923518288 >> [v2:172.21.15.39:6800/3152613618,v1:172.21.15.39:6801/3152613618] conn(0x7f9fb4038fc0 msgr2=0x7f9fb403b480 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:27:24.182 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stderr 2024-09-12T02:27:23.517+0000 7f9fd5a00640 1 --2- 172.21.15.39:0/923518288 >> [v2:172.21.15.39:6800/3152613618,v1:172.21.15.39:6801/3152613618] conn(0x7f9fb4038fc0 0x7f9fb403b480 secure :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0x7f9fb80098c0 tx=0x7f9fb8006db0 comp rx=0 tx=0).stop 2024-09-12T02:27:24.182 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stderr 2024-09-12T02:27:23.517+0000 7f9fd5a00640 1 -- 172.21.15.39:0/923518288 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f9fd0109840 msgr2=0x7f9fd019d670 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:27:24.182 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stderr 2024-09-12T02:27:23.517+0000 7f9fd5a00640 1 --2- 172.21.15.39:0/923518288 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f9fd0109840 0x7f9fd019d670 secure :-1 s=READY pgs=42 cs=0 l=1 rev1=1 crypto rx=0x7f9fc00097f0 tx=0x7f9fc0030d80 comp rx=0 tx=0).stop 2024-09-12T02:27:24.182 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stderr 2024-09-12T02:27:23.517+0000 7f9fd5a00640 1 -- 172.21.15.39:0/923518288 shutdown_connections 2024-09-12T02:27:24.183 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stderr 2024-09-12T02:27:23.517+0000 7f9fd5a00640 1 --2- 172.21.15.39:0/923518288 >> [v2:172.21.15.39:6800/3152613618,v1:172.21.15.39:6801/3152613618] conn(0x7f9fb4038fc0 0x7f9fb403b480 unknown :-1 s=CLOSED pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:27:24.183 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stderr 2024-09-12T02:27:23.517+0000 7f9fd5a00640 1 --2- 172.21.15.39:0/923518288 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f9fd0109840 0x7f9fd019d670 unknown :-1 s=CLOSED pgs=42 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:27:24.183 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stderr 2024-09-12T02:27:23.517+0000 7f9fd5a00640 1 -- 172.21.15.39:0/923518288 >> 172.21.15.39:0/923518288 conn(0x7f9fd007ccf0 msgr2=0x7f9fd0107500 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:27:24.183 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stderr 2024-09-12T02:27:23.517+0000 7f9fd5a00640 1 -- 172.21.15.39:0/923518288 shutdown_connections 2024-09-12T02:27:24.183 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stderr 2024-09-12T02:27:23.517+0000 7f9fd5a00640 1 -- 172.21.15.39:0/923518288 wait complete. 2024-09-12T02:27:24.183 INFO:teuthology.orchestra.run.smithi039.stdout:Wrote public SSH key to /home/ubuntu/cephtest/ceph.pub 2024-09-12T02:27:24.183 INFO:teuthology.orchestra.run.smithi039.stdout:Adding key to root@localhost authorized_keys... 2024-09-12T02:27:24.183 INFO:teuthology.orchestra.run.smithi039.stdout:Adding host smithi039... 2024-09-12T02:27:26.047 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 02:27:25 smithi039 ceph-mon[30515]: from='client.14138 -' entity='client.admin' cmd=[{"prefix": "orch host add", "hostname": "smithi039", "addr": "172.21.15.39", "target": ["mon-mgr", ""]}]: dispatch 2024-09-12T02:27:26.770 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 02:27:26 smithi039 ceph-mon[30515]: Deploying cephadm binary to smithi039 2024-09-12T02:27:30.059 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stdout Added host 'smithi039' with addr '172.21.15.39' 2024-09-12T02:27:30.059 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stderr 2024-09-12T02:27:24.671+0000 7f34f9400640 1 Processor -- start 2024-09-12T02:27:30.059 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stderr 2024-09-12T02:27:24.671+0000 7f34f9400640 1 -- start start 2024-09-12T02:27:30.059 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stderr 2024-09-12T02:27:24.672+0000 7f34f9400640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f34f4106560 0x7f34f4106960 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:27:30.059 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stderr 2024-09-12T02:27:24.672+0000 7f34f9400640 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 -- 0x7f34f4106f30 con 0x7f34f4106560 2024-09-12T02:27:30.059 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stderr 2024-09-12T02:27:24.672+0000 7f34f2800640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f34f4106560 0x7f34f4106960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:27:30.059 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stderr 2024-09-12T02:27:24.672+0000 7f34f2800640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f34f4106560 0x7f34f4106960 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.39:3300/0 says I am v2:172.21.15.39:40410/0 (socket says 172.21.15.39:40410) 2024-09-12T02:27:30.059 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stderr 2024-09-12T02:27:24.672+0000 7f34f2800640 1 -- 172.21.15.39:0/3151194297 learned_addr learned my addr 172.21.15.39:0/3151194297 (peer_addr_for_me v2:172.21.15.39:0/0) 2024-09-12T02:27:30.060 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stderr 2024-09-12T02:27:24.673+0000 7f34f2800640 1 -- 172.21.15.39:0/3151194297 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f34f4107760 con 0x7f34f4106560 2024-09-12T02:27:30.060 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stderr 2024-09-12T02:27:24.673+0000 7f34f2800640 1 --2- 172.21.15.39:0/3151194297 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f34f4106560 0x7f34f4106960 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0x7f34e4009820 tx=0x7f34e402a270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6c70d8939773cc9d server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:27:30.060 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stderr 2024-09-12T02:27:24.674+0000 7f34f1e00640 1 -- 172.21.15.39:0/3151194297 <== mon.0 v2:172.21.15.39:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f34e4037070 con 0x7f34f4106560 2024-09-12T02:27:30.060 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stderr 2024-09-12T02:27:24.674+0000 7f34f1e00640 1 -- 172.21.15.39:0/3151194297 <== mon.0 v2:172.21.15.39:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7f34e4032900 con 0x7f34f4106560 2024-09-12T02:27:30.060 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stderr 2024-09-12T02:27:24.674+0000 7f34f1e00640 1 -- 172.21.15.39:0/3151194297 <== mon.0 v2:172.21.15.39:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f34e4030850 con 0x7f34f4106560 2024-09-12T02:27:30.060 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stderr 2024-09-12T02:27:24.674+0000 7f34f9400640 1 -- 172.21.15.39:0/3151194297 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f34f4106560 msgr2=0x7f34f4106960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:27:30.060 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stderr 2024-09-12T02:27:24.674+0000 7f34f9400640 1 --2- 172.21.15.39:0/3151194297 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f34f4106560 0x7f34f4106960 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0x7f34e4009820 tx=0x7f34e402a270 comp rx=0 tx=0).stop 2024-09-12T02:27:30.060 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stderr 2024-09-12T02:27:24.675+0000 7f34f9400640 1 -- 172.21.15.39:0/3151194297 shutdown_connections 2024-09-12T02:27:30.060 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stderr 2024-09-12T02:27:24.675+0000 7f34f9400640 1 --2- 172.21.15.39:0/3151194297 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f34f4106560 0x7f34f4106960 unknown :-1 s=CLOSED pgs=43 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:27:30.060 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stderr 2024-09-12T02:27:24.675+0000 7f34f9400640 1 -- 172.21.15.39:0/3151194297 >> 172.21.15.39:0/3151194297 conn(0x7f34f4101d10 msgr2=0x7f34f4104130 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:27:30.060 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stderr 2024-09-12T02:27:24.675+0000 7f34f9400640 1 -- 172.21.15.39:0/3151194297 shutdown_connections 2024-09-12T02:27:30.060 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stderr 2024-09-12T02:27:24.675+0000 7f34f9400640 1 -- 172.21.15.39:0/3151194297 wait complete. 2024-09-12T02:27:30.061 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stderr 2024-09-12T02:27:24.676+0000 7f34f9400640 1 Processor -- start 2024-09-12T02:27:30.061 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stderr 2024-09-12T02:27:24.676+0000 7f34f9400640 1 -- start start 2024-09-12T02:27:30.061 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stderr 2024-09-12T02:27:24.676+0000 7f34f9400640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f34f4106560 0x7f34f419d920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:27:30.061 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stderr 2024-09-12T02:27:24.676+0000 7f34f9400640 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 -- 0x7f34f410ab10 con 0x7f34f4106560 2024-09-12T02:27:30.061 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stderr 2024-09-12T02:27:24.676+0000 7f34f2800640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f34f4106560 0x7f34f419d920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:27:30.061 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stderr 2024-09-12T02:27:24.676+0000 7f34f2800640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f34f4106560 0x7f34f419d920 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.39:3300/0 says I am v2:172.21.15.39:40426/0 (socket says 172.21.15.39:40426) 2024-09-12T02:27:30.061 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stderr 2024-09-12T02:27:24.676+0000 7f34f2800640 1 -- 172.21.15.39:0/1368799394 learned_addr learned my addr 172.21.15.39:0/1368799394 (peer_addr_for_me v2:172.21.15.39:0/0) 2024-09-12T02:27:30.061 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stderr 2024-09-12T02:27:24.677+0000 7f34f2800640 1 -- 172.21.15.39:0/1368799394 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f34f419de60 con 0x7f34f4106560 2024-09-12T02:27:30.061 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stderr 2024-09-12T02:27:24.677+0000 7f34f2800640 1 --2- 172.21.15.39:0/1368799394 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f34f4106560 0x7f34f419d920 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 crypto rx=0x7f34e40097f0 tx=0x7f34e4032ce0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:27:30.061 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stderr 2024-09-12T02:27:24.677+0000 7f34eb400640 1 -- 172.21.15.39:0/1368799394 <== mon.0 v2:172.21.15.39:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f34e4042070 con 0x7f34f4106560 2024-09-12T02:27:30.061 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stderr 2024-09-12T02:27:24.677+0000 7f34eb400640 1 -- 172.21.15.39:0/1368799394 <== mon.0 v2:172.21.15.39:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7f34e40308e0 con 0x7f34f4106560 2024-09-12T02:27:30.061 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stderr 2024-09-12T02:27:24.677+0000 7f34f9400640 1 -- 172.21.15.39:0/1368799394 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f34f419e0f0 con 0x7f34f4106560 2024-09-12T02:27:30.062 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stderr 2024-09-12T02:27:24.677+0000 7f34eb400640 1 -- 172.21.15.39:0/1368799394 <== mon.0 v2:172.21.15.39:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f34e4037040 con 0x7f34f4106560 2024-09-12T02:27:30.062 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stderr 2024-09-12T02:27:24.677+0000 7f34f9400640 1 -- 172.21.15.39:0/1368799394 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f34f41a0de0 con 0x7f34f4106560 2024-09-12T02:27:30.062 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stderr 2024-09-12T02:27:24.678+0000 7f34eb400640 1 -- 172.21.15.39:0/1368799394 <== mon.0 v2:172.21.15.39:3300/0 4 ==== mgrmap(e 8) ==== 46287+0+0 (secure 0 0 0) 0x7f34e4045070 con 0x7f34f4106560 2024-09-12T02:27:30.062 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stderr 2024-09-12T02:27:24.679+0000 7f34f9400640 1 -- 172.21.15.39:0/1368799394 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f34f41069e0 con 0x7f34f4106560 2024-09-12T02:27:30.062 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stderr 2024-09-12T02:27:24.679+0000 7f34eb400640 1 --2- 172.21.15.39:0/1368799394 >> [v2:172.21.15.39:6800/3152613618,v1:172.21.15.39:6801/3152613618] conn(0x7f34d8038fc0 0x7f34d803b480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:27:30.062 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stderr 2024-09-12T02:27:24.679+0000 7f34eb400640 1 -- 172.21.15.39:0/1368799394 <== mon.0 v2:172.21.15.39:3300/0 5 ==== osd_map(2..2 src has 1..2) ==== 940+0+0 (secure 0 0 0) 0x7f34e406c2a0 con 0x7f34f4106560 2024-09-12T02:27:30.062 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stderr 2024-09-12T02:27:24.679+0000 7f34ebe00640 1 --2- 172.21.15.39:0/1368799394 >> [v2:172.21.15.39:6800/3152613618,v1:172.21.15.39:6801/3152613618] conn(0x7f34d8038fc0 0x7f34d803b480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:27:30.062 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stderr 2024-09-12T02:27:24.680+0000 7f34ebe00640 1 --2- 172.21.15.39:0/1368799394 >> [v2:172.21.15.39:6800/3152613618,v1:172.21.15.39:6801/3152613618] conn(0x7f34d8038fc0 0x7f34d803b480 secure :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0x7f34dc0098c0 tx=0x7f34dc006db0 comp rx=0 tx=0).ready entity=mgr.14118 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:27:30.062 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stderr 2024-09-12T02:27:24.684+0000 7f34eb400640 1 -- 172.21.15.39:0/1368799394 <== mon.0 v2:172.21.15.39:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7f34e40328a0 con 0x7f34f4106560 2024-09-12T02:27:30.062 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stderr 2024-09-12T02:27:24.873+0000 7f34f9400640 1 -- 172.21.15.39:0/1368799394 --> [v2:172.21.15.39:6800/3152613618,v1:172.21.15.39:6801/3152613618] -- mgr_command(tid 0: {"prefix": "orch host add", "hostname": "smithi039", "addr": "172.21.15.39", "target": ["mon-mgr", ""]}) -- 0x7f34f402dab0 con 0x7f34d8038fc0 2024-09-12T02:27:30.062 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stderr 2024-09-12T02:27:29.386+0000 7f34eb400640 1 -- 172.21.15.39:0/1368799394 <== mgr.14118 v2:172.21.15.39:6800/3152613618 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+48 (secure 0 0 0) 0x7f34f402dab0 con 0x7f34d8038fc0 2024-09-12T02:27:30.062 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stderr 2024-09-12T02:27:29.389+0000 7f34f9400640 1 -- 172.21.15.39:0/1368799394 >> [v2:172.21.15.39:6800/3152613618,v1:172.21.15.39:6801/3152613618] conn(0x7f34d8038fc0 msgr2=0x7f34d803b480 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:27:30.063 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stderr 2024-09-12T02:27:29.389+0000 7f34f9400640 1 --2- 172.21.15.39:0/1368799394 >> [v2:172.21.15.39:6800/3152613618,v1:172.21.15.39:6801/3152613618] conn(0x7f34d8038fc0 0x7f34d803b480 secure :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0x7f34dc0098c0 tx=0x7f34dc006db0 comp rx=0 tx=0).stop 2024-09-12T02:27:30.063 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stderr 2024-09-12T02:27:29.389+0000 7f34f9400640 1 -- 172.21.15.39:0/1368799394 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f34f4106560 msgr2=0x7f34f419d920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:27:30.063 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stderr 2024-09-12T02:27:29.389+0000 7f34f9400640 1 --2- 172.21.15.39:0/1368799394 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f34f4106560 0x7f34f419d920 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 crypto rx=0x7f34e40097f0 tx=0x7f34e4032ce0 comp rx=0 tx=0).stop 2024-09-12T02:27:30.063 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stderr 2024-09-12T02:27:29.389+0000 7f34f9400640 1 -- 172.21.15.39:0/1368799394 shutdown_connections 2024-09-12T02:27:30.063 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stderr 2024-09-12T02:27:29.389+0000 7f34f9400640 1 --2- 172.21.15.39:0/1368799394 >> [v2:172.21.15.39:6800/3152613618,v1:172.21.15.39:6801/3152613618] conn(0x7f34d8038fc0 0x7f34d803b480 unknown :-1 s=CLOSED pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:27:30.063 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stderr 2024-09-12T02:27:29.389+0000 7f34f9400640 1 --2- 172.21.15.39:0/1368799394 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f34f4106560 0x7f34f419d920 unknown :-1 s=CLOSED pgs=44 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:27:30.063 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stderr 2024-09-12T02:27:29.389+0000 7f34f9400640 1 -- 172.21.15.39:0/1368799394 >> 172.21.15.39:0/1368799394 conn(0x7f34f4101d10 msgr2=0x7f34f4102c30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:27:30.063 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stderr 2024-09-12T02:27:29.389+0000 7f34f9400640 1 -- 172.21.15.39:0/1368799394 shutdown_connections 2024-09-12T02:27:30.063 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stderr 2024-09-12T02:27:29.389+0000 7f34f9400640 1 -- 172.21.15.39:0/1368799394 wait complete. 2024-09-12T02:27:30.063 INFO:teuthology.orchestra.run.smithi039.stdout:Deploying unmanaged mon service... 2024-09-12T02:27:30.599 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 02:27:30 smithi039 ceph-mon[30515]: from='mgr.14118 172.21.15.39:0/2227794351' entity='mgr.x' 2024-09-12T02:27:30.600 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 02:27:30 smithi039 ceph-mon[30515]: Added host smithi039 2024-09-12T02:27:30.600 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 02:27:30 smithi039 ceph-mon[30515]: from='mgr.14118 172.21.15.39:0/2227794351' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-12T02:27:31.562 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stdout Scheduled mon update... 2024-09-12T02:27:31.562 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stderr 2024-09-12T02:27:30.630+0000 7fbd9de00640 1 Processor -- start 2024-09-12T02:27:31.562 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stderr 2024-09-12T02:27:30.630+0000 7fbd9de00640 1 -- start start 2024-09-12T02:27:31.562 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stderr 2024-09-12T02:27:30.630+0000 7fbd9de00640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fbd98105f20 0x7fbd98106320 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:27:31.562 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stderr 2024-09-12T02:27:30.630+0000 7fbd9de00640 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 -- 0x7fbd9807c660 con 0x7fbd98105f20 2024-09-12T02:27:31.562 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stderr 2024-09-12T02:27:30.631+0000 7fbd96a00640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fbd98105f20 0x7fbd98106320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:27:31.562 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stderr 2024-09-12T02:27:30.631+0000 7fbd96a00640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fbd98105f20 0x7fbd98106320 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.39:3300/0 says I am v2:172.21.15.39:57120/0 (socket says 172.21.15.39:57120) 2024-09-12T02:27:31.562 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stderr 2024-09-12T02:27:30.631+0000 7fbd96a00640 1 -- 172.21.15.39:0/3751110738 learned_addr learned my addr 172.21.15.39:0/3751110738 (peer_addr_for_me v2:172.21.15.39:0/0) 2024-09-12T02:27:31.562 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stderr 2024-09-12T02:27:30.631+0000 7fbd96a00640 1 -- 172.21.15.39:0/3751110738 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fbd98106860 con 0x7fbd98105f20 2024-09-12T02:27:31.562 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stderr 2024-09-12T02:27:30.632+0000 7fbd96a00640 1 --2- 172.21.15.39:0/3751110738 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fbd98105f20 0x7fbd98106320 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0x7fbd88009820 tx=0x7fbd8802a270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c52829548ac4c5c server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:27:31.563 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stderr 2024-09-12T02:27:30.633+0000 7fbd95600640 1 -- 172.21.15.39:0/3751110738 <== mon.0 v2:172.21.15.39:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fbd88037070 con 0x7fbd98105f20 2024-09-12T02:27:31.563 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stderr 2024-09-12T02:27:30.633+0000 7fbd95600640 1 -- 172.21.15.39:0/3751110738 <== mon.0 v2:172.21.15.39:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7fbd88032900 con 0x7fbd98105f20 2024-09-12T02:27:31.563 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stderr 2024-09-12T02:27:30.633+0000 7fbd95600640 1 -- 172.21.15.39:0/3751110738 <== mon.0 v2:172.21.15.39:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fbd88030850 con 0x7fbd98105f20 2024-09-12T02:27:31.563 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stderr 2024-09-12T02:27:30.633+0000 7fbd9de00640 1 -- 172.21.15.39:0/3751110738 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fbd98105f20 msgr2=0x7fbd98106320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:27:31.563 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stderr 2024-09-12T02:27:30.633+0000 7fbd9de00640 1 --2- 172.21.15.39:0/3751110738 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fbd98105f20 0x7fbd98106320 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0x7fbd88009820 tx=0x7fbd8802a270 comp rx=0 tx=0).stop 2024-09-12T02:27:31.563 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stderr 2024-09-12T02:27:30.634+0000 7fbd9de00640 1 -- 172.21.15.39:0/3751110738 shutdown_connections 2024-09-12T02:27:31.563 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stderr 2024-09-12T02:27:30.634+0000 7fbd9de00640 1 --2- 172.21.15.39:0/3751110738 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fbd98105f20 0x7fbd98106320 unknown :-1 s=CLOSED pgs=45 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:27:31.563 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stderr 2024-09-12T02:27:30.634+0000 7fbd9de00640 1 -- 172.21.15.39:0/3751110738 >> 172.21.15.39:0/3751110738 conn(0x7fbd98101d10 msgr2=0x7fbd98104130 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:27:31.563 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stderr 2024-09-12T02:27:30.634+0000 7fbd9de00640 1 -- 172.21.15.39:0/3751110738 shutdown_connections 2024-09-12T02:27:31.563 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stderr 2024-09-12T02:27:30.634+0000 7fbd9de00640 1 -- 172.21.15.39:0/3751110738 wait complete. 2024-09-12T02:27:31.563 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stderr 2024-09-12T02:27:30.635+0000 7fbd9de00640 1 Processor -- start 2024-09-12T02:27:31.563 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stderr 2024-09-12T02:27:30.635+0000 7fbd9de00640 1 -- start start 2024-09-12T02:27:31.563 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stderr 2024-09-12T02:27:30.635+0000 7fbd9de00640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fbd98105f20 0x7fbd9819d830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:27:31.563 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stderr 2024-09-12T02:27:30.635+0000 7fbd9de00640 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 -- 0x7fbd98107960 con 0x7fbd98105f20 2024-09-12T02:27:31.564 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stderr 2024-09-12T02:27:30.635+0000 7fbd96a00640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fbd98105f20 0x7fbd9819d830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:27:31.564 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stderr 2024-09-12T02:27:30.636+0000 7fbd96a00640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fbd98105f20 0x7fbd9819d830 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.39:3300/0 says I am v2:172.21.15.39:57122/0 (socket says 172.21.15.39:57122) 2024-09-12T02:27:31.564 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stderr 2024-09-12T02:27:30.636+0000 7fbd96a00640 1 -- 172.21.15.39:0/996604922 learned_addr learned my addr 172.21.15.39:0/996604922 (peer_addr_for_me v2:172.21.15.39:0/0) 2024-09-12T02:27:31.564 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stderr 2024-09-12T02:27:30.636+0000 7fbd96a00640 1 -- 172.21.15.39:0/996604922 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fbd9819dd70 con 0x7fbd98105f20 2024-09-12T02:27:31.564 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stderr 2024-09-12T02:27:30.636+0000 7fbd96a00640 1 --2- 172.21.15.39:0/996604922 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fbd98105f20 0x7fbd9819d830 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0x7fbd880097f0 tx=0x7fbd88030d80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:27:31.564 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stderr 2024-09-12T02:27:30.636+0000 7fbd9ca00640 1 -- 172.21.15.39:0/996604922 <== mon.0 v2:172.21.15.39:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fbd88037040 con 0x7fbd98105f20 2024-09-12T02:27:31.564 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stderr 2024-09-12T02:27:30.636+0000 7fbd9ca00640 1 -- 172.21.15.39:0/996604922 <== mon.0 v2:172.21.15.39:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7fbd88040070 con 0x7fbd98105f20 2024-09-12T02:27:31.564 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stderr 2024-09-12T02:27:30.636+0000 7fbd9de00640 1 -- 172.21.15.39:0/996604922 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fbd9819e000 con 0x7fbd98105f20 2024-09-12T02:27:31.564 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stderr 2024-09-12T02:27:30.636+0000 7fbd9ca00640 1 -- 172.21.15.39:0/996604922 <== mon.0 v2:172.21.15.39:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fbd8803a390 con 0x7fbd98105f20 2024-09-12T02:27:31.564 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stderr 2024-09-12T02:27:30.637+0000 7fbd9de00640 1 -- 172.21.15.39:0/996604922 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fbd981a0cf0 con 0x7fbd98105f20 2024-09-12T02:27:31.564 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stderr 2024-09-12T02:27:30.638+0000 7fbd9ca00640 1 -- 172.21.15.39:0/996604922 <== mon.0 v2:172.21.15.39:3300/0 4 ==== mgrmap(e 8) ==== 46287+0+0 (secure 0 0 0) 0x7fbd8803b430 con 0x7fbd98105f20 2024-09-12T02:27:31.564 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stderr 2024-09-12T02:27:30.638+0000 7fbd9de00640 1 -- 172.21.15.39:0/996604922 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fbd98106320 con 0x7fbd98105f20 2024-09-12T02:27:31.565 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stderr 2024-09-12T02:27:30.638+0000 7fbd9ca00640 1 --2- 172.21.15.39:0/996604922 >> [v2:172.21.15.39:6800/3152613618,v1:172.21.15.39:6801/3152613618] conn(0x7fbd7c038fc0 0x7fbd7c03b480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:27:31.565 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stderr 2024-09-12T02:27:30.638+0000 7fbd9ca00640 1 -- 172.21.15.39:0/996604922 <== mon.0 v2:172.21.15.39:3300/0 5 ==== osd_map(2..2 src has 1..2) ==== 940+0+0 (secure 0 0 0) 0x7fbd8806c500 con 0x7fbd98105f20 2024-09-12T02:27:31.565 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stderr 2024-09-12T02:27:30.638+0000 7fbd96000640 1 --2- 172.21.15.39:0/996604922 >> [v2:172.21.15.39:6800/3152613618,v1:172.21.15.39:6801/3152613618] conn(0x7fbd7c038fc0 0x7fbd7c03b480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:27:31.565 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stderr 2024-09-12T02:27:30.639+0000 7fbd96000640 1 --2- 172.21.15.39:0/996604922 >> [v2:172.21.15.39:6800/3152613618,v1:172.21.15.39:6801/3152613618] conn(0x7fbd7c038fc0 0x7fbd7c03b480 secure :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0x7fbd840098c0 tx=0x7fbd84006db0 comp rx=0 tx=0).ready entity=mgr.14118 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:27:31.565 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stderr 2024-09-12T02:27:30.643+0000 7fbd9ca00640 1 -- 172.21.15.39:0/996604922 <== mon.0 v2:172.21.15.39:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7fbd880371e0 con 0x7fbd98105f20 2024-09-12T02:27:31.565 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stderr 2024-09-12T02:27:30.840+0000 7fbd9de00640 1 -- 172.21.15.39:0/996604922 --> [v2:172.21.15.39:6800/3152613618,v1:172.21.15.39:6801/3152613618] -- mgr_command(tid 0: {"prefix": "orch apply", "service_type": "mon", "unmanaged": true, "target": ["mon-mgr", ""]}) -- 0x7fbd9802da60 con 0x7fbd7c038fc0 2024-09-12T02:27:31.565 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stderr 2024-09-12T02:27:30.846+0000 7fbd9ca00640 1 -- 172.21.15.39:0/996604922 <== mgr.14118 v2:172.21.15.39:6800/3152613618 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+24 (secure 0 0 0) 0x7fbd9802da60 con 0x7fbd7c038fc0 2024-09-12T02:27:31.565 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stderr 2024-09-12T02:27:30.848+0000 7fbd9de00640 1 -- 172.21.15.39:0/996604922 >> [v2:172.21.15.39:6800/3152613618,v1:172.21.15.39:6801/3152613618] conn(0x7fbd7c038fc0 msgr2=0x7fbd7c03b480 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:27:31.565 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stderr 2024-09-12T02:27:30.848+0000 7fbd9de00640 1 --2- 172.21.15.39:0/996604922 >> [v2:172.21.15.39:6800/3152613618,v1:172.21.15.39:6801/3152613618] conn(0x7fbd7c038fc0 0x7fbd7c03b480 secure :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0x7fbd840098c0 tx=0x7fbd84006db0 comp rx=0 tx=0).stop 2024-09-12T02:27:31.565 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stderr 2024-09-12T02:27:30.848+0000 7fbd9de00640 1 -- 172.21.15.39:0/996604922 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fbd98105f20 msgr2=0x7fbd9819d830 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:27:31.565 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stderr 2024-09-12T02:27:30.848+0000 7fbd9de00640 1 --2- 172.21.15.39:0/996604922 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fbd98105f20 0x7fbd9819d830 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0x7fbd880097f0 tx=0x7fbd88030d80 comp rx=0 tx=0).stop 2024-09-12T02:27:31.565 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stderr 2024-09-12T02:27:30.848+0000 7fbd9de00640 1 -- 172.21.15.39:0/996604922 shutdown_connections 2024-09-12T02:27:31.565 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stderr 2024-09-12T02:27:30.848+0000 7fbd9de00640 1 --2- 172.21.15.39:0/996604922 >> [v2:172.21.15.39:6800/3152613618,v1:172.21.15.39:6801/3152613618] conn(0x7fbd7c038fc0 0x7fbd7c03b480 unknown :-1 s=CLOSED pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:27:31.565 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stderr 2024-09-12T02:27:30.848+0000 7fbd9de00640 1 --2- 172.21.15.39:0/996604922 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fbd98105f20 0x7fbd9819d830 unknown :-1 s=CLOSED pgs=46 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:27:31.566 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stderr 2024-09-12T02:27:30.848+0000 7fbd9de00640 1 -- 172.21.15.39:0/996604922 >> 172.21.15.39:0/996604922 conn(0x7fbd98101d10 msgr2=0x7fbd981944d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:27:31.566 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stderr 2024-09-12T02:27:30.849+0000 7fbd9de00640 1 -- 172.21.15.39:0/996604922 shutdown_connections 2024-09-12T02:27:31.566 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stderr 2024-09-12T02:27:30.849+0000 7fbd9de00640 1 -- 172.21.15.39:0/996604922 wait complete. 2024-09-12T02:27:31.566 INFO:teuthology.orchestra.run.smithi039.stdout:Deploying unmanaged mgr service... 2024-09-12T02:27:32.099 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 02:27:31 smithi039 ceph-mon[30515]: from='client.14140 -' entity='client.admin' cmd=[{"prefix": "orch apply", "service_type": "mon", "unmanaged": true, "target": ["mon-mgr", ""]}]: dispatch 2024-09-12T02:27:32.099 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 02:27:31 smithi039 ceph-mon[30515]: Saving service mon spec with placement count:5 2024-09-12T02:27:32.100 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 02:27:31 smithi039 ceph-mon[30515]: from='mgr.14118 172.21.15.39:0/2227794351' entity='mgr.x' 2024-09-12T02:27:33.865 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stdout Scheduled mgr update... 2024-09-12T02:27:33.866 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stderr 2024-09-12T02:27:32.384+0000 7fda66a00640 1 Processor -- start 2024-09-12T02:27:33.866 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stderr 2024-09-12T02:27:32.384+0000 7fda66a00640 1 -- start start 2024-09-12T02:27:33.866 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stderr 2024-09-12T02:27:32.385+0000 7fda66a00640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fda601076a0 0x7fda60107aa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:27:33.866 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stderr 2024-09-12T02:27:32.385+0000 7fda66a00640 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 -- 0x7fda60108070 con 0x7fda601076a0 2024-09-12T02:27:33.866 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stderr 2024-09-12T02:27:32.385+0000 7fda5fe00640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fda601076a0 0x7fda60107aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:27:33.866 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stderr 2024-09-12T02:27:32.385+0000 7fda5fe00640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fda601076a0 0x7fda60107aa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.39:3300/0 says I am v2:172.21.15.39:57128/0 (socket says 172.21.15.39:57128) 2024-09-12T02:27:33.866 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stderr 2024-09-12T02:27:32.385+0000 7fda5fe00640 1 -- 172.21.15.39:0/2713421915 learned_addr learned my addr 172.21.15.39:0/2713421915 (peer_addr_for_me v2:172.21.15.39:0/0) 2024-09-12T02:27:33.866 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stderr 2024-09-12T02:27:32.386+0000 7fda5fe00640 1 -- 172.21.15.39:0/2713421915 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fda601088a0 con 0x7fda601076a0 2024-09-12T02:27:33.866 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stderr 2024-09-12T02:27:32.387+0000 7fda5fe00640 1 --2- 172.21.15.39:0/2713421915 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fda601076a0 0x7fda60107aa0 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0x7fda50009820 tx=0x7fda5002a270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2c7ebca8b72d7325 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:27:33.866 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stderr 2024-09-12T02:27:32.387+0000 7fda5f400640 1 -- 172.21.15.39:0/2713421915 <== mon.0 v2:172.21.15.39:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fda50037070 con 0x7fda601076a0 2024-09-12T02:27:33.866 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stderr 2024-09-12T02:27:32.387+0000 7fda5f400640 1 -- 172.21.15.39:0/2713421915 <== mon.0 v2:172.21.15.39:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7fda50032900 con 0x7fda601076a0 2024-09-12T02:27:33.867 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stderr 2024-09-12T02:27:32.387+0000 7fda5f400640 1 -- 172.21.15.39:0/2713421915 <== mon.0 v2:172.21.15.39:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fda50030850 con 0x7fda601076a0 2024-09-12T02:27:33.867 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stderr 2024-09-12T02:27:32.388+0000 7fda66a00640 1 -- 172.21.15.39:0/2713421915 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fda601076a0 msgr2=0x7fda60107aa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:27:33.867 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stderr 2024-09-12T02:27:32.388+0000 7fda66a00640 1 --2- 172.21.15.39:0/2713421915 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fda601076a0 0x7fda60107aa0 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0x7fda50009820 tx=0x7fda5002a270 comp rx=0 tx=0).stop 2024-09-12T02:27:33.867 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stderr 2024-09-12T02:27:32.388+0000 7fda66a00640 1 -- 172.21.15.39:0/2713421915 shutdown_connections 2024-09-12T02:27:33.867 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stderr 2024-09-12T02:27:32.388+0000 7fda66a00640 1 --2- 172.21.15.39:0/2713421915 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fda601076a0 0x7fda60107aa0 unknown :-1 s=CLOSED pgs=47 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:27:33.867 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stderr 2024-09-12T02:27:32.388+0000 7fda66a00640 1 -- 172.21.15.39:0/2713421915 >> 172.21.15.39:0/2713421915 conn(0x7fda60102e70 msgr2=0x7fda60105290 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:27:33.867 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stderr 2024-09-12T02:27:32.388+0000 7fda66a00640 1 -- 172.21.15.39:0/2713421915 shutdown_connections 2024-09-12T02:27:33.867 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stderr 2024-09-12T02:27:32.388+0000 7fda66a00640 1 -- 172.21.15.39:0/2713421915 wait complete. 2024-09-12T02:27:33.867 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stderr 2024-09-12T02:27:32.389+0000 7fda66a00640 1 Processor -- start 2024-09-12T02:27:33.867 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stderr 2024-09-12T02:27:32.389+0000 7fda66a00640 1 -- start start 2024-09-12T02:27:33.867 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stderr 2024-09-12T02:27:32.389+0000 7fda66a00640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fda601076a0 0x7fda6019d8c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:27:33.867 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stderr 2024-09-12T02:27:32.389+0000 7fda66a00640 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 -- 0x7fda6010bc50 con 0x7fda601076a0 2024-09-12T02:27:33.867 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stderr 2024-09-12T02:27:32.389+0000 7fda5fe00640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fda601076a0 0x7fda6019d8c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:27:33.868 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stderr 2024-09-12T02:27:32.389+0000 7fda5fe00640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fda601076a0 0x7fda6019d8c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.39:3300/0 says I am v2:172.21.15.39:57140/0 (socket says 172.21.15.39:57140) 2024-09-12T02:27:33.868 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stderr 2024-09-12T02:27:32.389+0000 7fda5fe00640 1 -- 172.21.15.39:0/3403403669 learned_addr learned my addr 172.21.15.39:0/3403403669 (peer_addr_for_me v2:172.21.15.39:0/0) 2024-09-12T02:27:33.868 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stderr 2024-09-12T02:27:32.390+0000 7fda5fe00640 1 -- 172.21.15.39:0/3403403669 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fda6019de00 con 0x7fda601076a0 2024-09-12T02:27:33.868 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stderr 2024-09-12T02:27:32.390+0000 7fda5fe00640 1 --2- 172.21.15.39:0/3403403669 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fda601076a0 0x7fda6019d8c0 secure :-1 s=READY pgs=48 cs=0 l=1 rev1=1 crypto rx=0x7fda50009940 tx=0x7fda50032ce0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:27:33.868 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stderr 2024-09-12T02:27:32.390+0000 7fda5d600640 1 -- 172.21.15.39:0/3403403669 <== mon.0 v2:172.21.15.39:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fda50042070 con 0x7fda601076a0 2024-09-12T02:27:33.868 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stderr 2024-09-12T02:27:32.390+0000 7fda5d600640 1 -- 172.21.15.39:0/3403403669 <== mon.0 v2:172.21.15.39:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7fda500308c0 con 0x7fda601076a0 2024-09-12T02:27:33.868 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stderr 2024-09-12T02:27:32.390+0000 7fda66a00640 1 -- 172.21.15.39:0/3403403669 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fda6019e090 con 0x7fda601076a0 2024-09-12T02:27:33.868 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stderr 2024-09-12T02:27:32.390+0000 7fda5d600640 1 -- 172.21.15.39:0/3403403669 <== mon.0 v2:172.21.15.39:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fda50037040 con 0x7fda601076a0 2024-09-12T02:27:33.868 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stderr 2024-09-12T02:27:32.391+0000 7fda66a00640 1 -- 172.21.15.39:0/3403403669 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fda601a0d80 con 0x7fda601076a0 2024-09-12T02:27:33.868 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stderr 2024-09-12T02:27:32.392+0000 7fda5d600640 1 -- 172.21.15.39:0/3403403669 <== mon.0 v2:172.21.15.39:3300/0 4 ==== mgrmap(e 8) ==== 46287+0+0 (secure 0 0 0) 0x7fda50045070 con 0x7fda601076a0 2024-09-12T02:27:33.868 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stderr 2024-09-12T02:27:32.392+0000 7fda66a00640 1 -- 172.21.15.39:0/3403403669 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fda6010bdd0 con 0x7fda601076a0 2024-09-12T02:27:33.868 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stderr 2024-09-12T02:27:32.392+0000 7fda5d600640 1 --2- 172.21.15.39:0/3403403669 >> [v2:172.21.15.39:6800/3152613618,v1:172.21.15.39:6801/3152613618] conn(0x7fda44038f70 0x7fda4403b430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:27:33.868 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stderr 2024-09-12T02:27:32.392+0000 7fda5d600640 1 -- 172.21.15.39:0/3403403669 <== mon.0 v2:172.21.15.39:3300/0 5 ==== osd_map(2..2 src has 1..2) ==== 940+0+0 (secure 0 0 0) 0x7fda5006c0f0 con 0x7fda601076a0 2024-09-12T02:27:33.869 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stderr 2024-09-12T02:27:32.392+0000 7fda57e00640 1 --2- 172.21.15.39:0/3403403669 >> [v2:172.21.15.39:6800/3152613618,v1:172.21.15.39:6801/3152613618] conn(0x7fda44038f70 0x7fda4403b430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:27:33.869 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stderr 2024-09-12T02:27:32.393+0000 7fda57e00640 1 --2- 172.21.15.39:0/3403403669 >> [v2:172.21.15.39:6800/3152613618,v1:172.21.15.39:6801/3152613618] conn(0x7fda44038f70 0x7fda4403b430 secure :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0x7fda480098c0 tx=0x7fda48006db0 comp rx=0 tx=0).ready entity=mgr.14118 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:27:33.869 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stderr 2024-09-12T02:27:32.402+0000 7fda5d600640 1 -- 172.21.15.39:0/3403403669 <== mon.0 v2:172.21.15.39:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7fda5006ba40 con 0x7fda601076a0 2024-09-12T02:27:33.869 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stderr 2024-09-12T02:27:32.602+0000 7fda66a00640 1 -- 172.21.15.39:0/3403403669 --> [v2:172.21.15.39:6800/3152613618,v1:172.21.15.39:6801/3152613618] -- mgr_command(tid 0: {"prefix": "orch apply", "service_type": "mgr", "unmanaged": true, "target": ["mon-mgr", ""]}) -- 0x7fda60104080 con 0x7fda44038f70 2024-09-12T02:27:33.869 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stderr 2024-09-12T02:27:32.609+0000 7fda5d600640 1 -- 172.21.15.39:0/3403403669 <== mgr.14118 v2:172.21.15.39:6800/3152613618 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+24 (secure 0 0 0) 0x7fda60104080 con 0x7fda44038f70 2024-09-12T02:27:33.869 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stderr 2024-09-12T02:27:32.611+0000 7fda66a00640 1 -- 172.21.15.39:0/3403403669 >> [v2:172.21.15.39:6800/3152613618,v1:172.21.15.39:6801/3152613618] conn(0x7fda44038f70 msgr2=0x7fda4403b430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:27:33.869 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stderr 2024-09-12T02:27:32.611+0000 7fda66a00640 1 --2- 172.21.15.39:0/3403403669 >> [v2:172.21.15.39:6800/3152613618,v1:172.21.15.39:6801/3152613618] conn(0x7fda44038f70 0x7fda4403b430 secure :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0x7fda480098c0 tx=0x7fda48006db0 comp rx=0 tx=0).stop 2024-09-12T02:27:33.869 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stderr 2024-09-12T02:27:32.611+0000 7fda66a00640 1 -- 172.21.15.39:0/3403403669 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fda601076a0 msgr2=0x7fda6019d8c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:27:33.869 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stderr 2024-09-12T02:27:32.611+0000 7fda66a00640 1 --2- 172.21.15.39:0/3403403669 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fda601076a0 0x7fda6019d8c0 secure :-1 s=READY pgs=48 cs=0 l=1 rev1=1 crypto rx=0x7fda50009940 tx=0x7fda50032ce0 comp rx=0 tx=0).stop 2024-09-12T02:27:33.869 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stderr 2024-09-12T02:27:32.611+0000 7fda66a00640 1 -- 172.21.15.39:0/3403403669 shutdown_connections 2024-09-12T02:27:33.869 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stderr 2024-09-12T02:27:32.611+0000 7fda66a00640 1 --2- 172.21.15.39:0/3403403669 >> [v2:172.21.15.39:6800/3152613618,v1:172.21.15.39:6801/3152613618] conn(0x7fda44038f70 0x7fda4403b430 unknown :-1 s=CLOSED pgs=13 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:27:33.869 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stderr 2024-09-12T02:27:32.611+0000 7fda66a00640 1 --2- 172.21.15.39:0/3403403669 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fda601076a0 0x7fda6019d8c0 unknown :-1 s=CLOSED pgs=48 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:27:33.869 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stderr 2024-09-12T02:27:32.611+0000 7fda66a00640 1 -- 172.21.15.39:0/3403403669 >> 172.21.15.39:0/3403403669 conn(0x7fda60102e70 msgr2=0x7fda60103970 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:27:33.869 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stderr 2024-09-12T02:27:32.612+0000 7fda66a00640 1 -- 172.21.15.39:0/3403403669 shutdown_connections 2024-09-12T02:27:33.870 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stderr 2024-09-12T02:27:32.612+0000 7fda66a00640 1 -- 172.21.15.39:0/3403403669 wait complete. 2024-09-12T02:27:34.005 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 02:27:33 smithi039 ceph-mon[30515]: from='client.14142 -' entity='client.admin' cmd=[{"prefix": "orch apply", "service_type": "mgr", "unmanaged": true, "target": ["mon-mgr", ""]}]: dispatch 2024-09-12T02:27:34.005 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 02:27:33 smithi039 ceph-mon[30515]: Saving service mgr spec with placement count:2 2024-09-12T02:27:34.005 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 02:27:33 smithi039 ceph-mon[30515]: from='mgr.14118 172.21.15.39:0/2227794351' entity='mgr.x' 2024-09-12T02:27:34.005 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 02:27:33 smithi039 ceph-mon[30515]: from='mgr.14118 172.21.15.39:0/2227794351' entity='mgr.x' 2024-09-12T02:27:35.031 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 02:27:34 smithi039 ceph-mon[30515]: from='mgr.14118 172.21.15.39:0/2227794351' entity='mgr.x' 2024-09-12T02:27:35.031 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 02:27:34 smithi039 ceph-mon[30515]: from='client.? 172.21.15.39:0/3500520507' entity='client.admin' 2024-09-12T02:27:35.965 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stderr 2024-09-12T02:27:34.404+0000 7f6392a00640 1 Processor -- start 2024-09-12T02:27:35.966 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stderr 2024-09-12T02:27:34.405+0000 7f6392a00640 1 -- start start 2024-09-12T02:27:35.966 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stderr 2024-09-12T02:27:34.405+0000 7f6392a00640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f638c109880 0x7f638c109c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:27:35.966 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stderr 2024-09-12T02:27:34.405+0000 7f6392a00640 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 -- 0x7f638c10a250 con 0x7f638c109880 2024-09-12T02:27:35.966 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stderr 2024-09-12T02:27:34.405+0000 7f638be00640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f638c109880 0x7f638c109c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:27:35.966 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stderr 2024-09-12T02:27:34.405+0000 7f638be00640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f638c109880 0x7f638c109c80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.39:3300/0 says I am v2:172.21.15.39:57156/0 (socket says 172.21.15.39:57156) 2024-09-12T02:27:35.966 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stderr 2024-09-12T02:27:34.405+0000 7f638be00640 1 -- 172.21.15.39:0/1479828612 learned_addr learned my addr 172.21.15.39:0/1479828612 (peer_addr_for_me v2:172.21.15.39:0/0) 2024-09-12T02:27:35.966 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stderr 2024-09-12T02:27:34.406+0000 7f638be00640 1 -- 172.21.15.39:0/1479828612 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f638c10aa80 con 0x7f638c109880 2024-09-12T02:27:35.966 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stderr 2024-09-12T02:27:34.407+0000 7f638be00640 1 --2- 172.21.15.39:0/1479828612 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f638c109880 0x7f638c109c80 secure :-1 s=READY pgs=49 cs=0 l=1 rev1=1 crypto rx=0x7f637c009820 tx=0x7f637c02a270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ab92c18f317add84 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:27:35.966 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stderr 2024-09-12T02:27:34.407+0000 7f638b400640 1 -- 172.21.15.39:0/1479828612 <== mon.0 v2:172.21.15.39:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f637c037070 con 0x7f638c109880 2024-09-12T02:27:35.966 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stderr 2024-09-12T02:27:34.407+0000 7f638b400640 1 -- 172.21.15.39:0/1479828612 <== mon.0 v2:172.21.15.39:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f637c032920 con 0x7f638c109880 2024-09-12T02:27:35.966 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stderr 2024-09-12T02:27:34.407+0000 7f638b400640 1 -- 172.21.15.39:0/1479828612 <== mon.0 v2:172.21.15.39:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f637c030810 con 0x7f638c109880 2024-09-12T02:27:35.967 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stderr 2024-09-12T02:27:34.408+0000 7f6392a00640 1 -- 172.21.15.39:0/1479828612 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f638c109880 msgr2=0x7f638c109c80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:27:35.967 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stderr 2024-09-12T02:27:34.408+0000 7f6392a00640 1 --2- 172.21.15.39:0/1479828612 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f638c109880 0x7f638c109c80 secure :-1 s=READY pgs=49 cs=0 l=1 rev1=1 crypto rx=0x7f637c009820 tx=0x7f637c02a270 comp rx=0 tx=0).stop 2024-09-12T02:27:35.967 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stderr 2024-09-12T02:27:34.408+0000 7f6392a00640 1 -- 172.21.15.39:0/1479828612 shutdown_connections 2024-09-12T02:27:35.967 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stderr 2024-09-12T02:27:34.408+0000 7f6392a00640 1 --2- 172.21.15.39:0/1479828612 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f638c109880 0x7f638c109c80 unknown :-1 s=CLOSED pgs=49 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:27:35.967 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stderr 2024-09-12T02:27:34.408+0000 7f6392a00640 1 -- 172.21.15.39:0/1479828612 >> 172.21.15.39:0/1479828612 conn(0x7f638c07ce60 msgr2=0x7f638c07d270 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:27:35.967 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stderr 2024-09-12T02:27:34.408+0000 7f6392a00640 1 -- 172.21.15.39:0/1479828612 shutdown_connections 2024-09-12T02:27:35.967 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stderr 2024-09-12T02:27:34.408+0000 7f6392a00640 1 -- 172.21.15.39:0/1479828612 wait complete. 2024-09-12T02:27:35.967 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stderr 2024-09-12T02:27:34.409+0000 7f6392a00640 1 Processor -- start 2024-09-12T02:27:35.967 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stderr 2024-09-12T02:27:34.409+0000 7f6392a00640 1 -- start start 2024-09-12T02:27:35.967 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stderr 2024-09-12T02:27:34.409+0000 7f6392a00640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f638c109880 0x7f638c19d8d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:27:35.967 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stderr 2024-09-12T02:27:34.409+0000 7f6392a00640 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 -- 0x7f638c10de30 con 0x7f638c109880 2024-09-12T02:27:35.967 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stderr 2024-09-12T02:27:34.410+0000 7f638be00640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f638c109880 0x7f638c19d8d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:27:35.967 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stderr 2024-09-12T02:27:34.410+0000 7f638be00640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f638c109880 0x7f638c19d8d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.39:3300/0 says I am v2:172.21.15.39:57166/0 (socket says 172.21.15.39:57166) 2024-09-12T02:27:35.968 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stderr 2024-09-12T02:27:34.410+0000 7f638be00640 1 -- 172.21.15.39:0/3500520507 learned_addr learned my addr 172.21.15.39:0/3500520507 (peer_addr_for_me v2:172.21.15.39:0/0) 2024-09-12T02:27:35.968 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stderr 2024-09-12T02:27:34.410+0000 7f638be00640 1 -- 172.21.15.39:0/3500520507 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f638c19de10 con 0x7f638c109880 2024-09-12T02:27:35.968 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stderr 2024-09-12T02:27:34.410+0000 7f638be00640 1 --2- 172.21.15.39:0/3500520507 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f638c109880 0x7f638c19d8d0 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 crypto rx=0x7f637c0097f0 tx=0x7f637c0327b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:27:35.968 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stderr 2024-09-12T02:27:34.411+0000 7f6389600640 1 -- 172.21.15.39:0/3500520507 <== mon.0 v2:172.21.15.39:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f637c037040 con 0x7f638c109880 2024-09-12T02:27:35.968 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stderr 2024-09-12T02:27:34.411+0000 7f6389600640 1 -- 172.21.15.39:0/3500520507 <== mon.0 v2:172.21.15.39:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f637c030cc0 con 0x7f638c109880 2024-09-12T02:27:35.968 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stderr 2024-09-12T02:27:34.411+0000 7f6389600640 1 -- 172.21.15.39:0/3500520507 <== mon.0 v2:172.21.15.39:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f637c03a640 con 0x7f638c109880 2024-09-12T02:27:35.968 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stderr 2024-09-12T02:27:34.411+0000 7f6392a00640 1 -- 172.21.15.39:0/3500520507 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f638c19e0a0 con 0x7f638c109880 2024-09-12T02:27:35.968 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stderr 2024-09-12T02:27:34.411+0000 7f6392a00640 1 -- 172.21.15.39:0/3500520507 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f638c1a0d90 con 0x7f638c109880 2024-09-12T02:27:35.968 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stderr 2024-09-12T02:27:34.412+0000 7f6389600640 1 -- 172.21.15.39:0/3500520507 <== mon.0 v2:172.21.15.39:3300/0 4 ==== mgrmap(e 8) ==== 46287+0+0 (secure 0 0 0) 0x7f637c03b3f0 con 0x7f638c109880 2024-09-12T02:27:35.968 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stderr 2024-09-12T02:27:34.412+0000 7f6392a00640 1 -- 172.21.15.39:0/3500520507 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f638c10dfb0 con 0x7f638c109880 2024-09-12T02:27:35.968 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stderr 2024-09-12T02:27:34.412+0000 7f6389600640 1 --2- 172.21.15.39:0/3500520507 >> [v2:172.21.15.39:6800/3152613618,v1:172.21.15.39:6801/3152613618] conn(0x7f6370038fc0 0x7f637003b480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:27:35.968 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stderr 2024-09-12T02:27:34.412+0000 7f6389600640 1 -- 172.21.15.39:0/3500520507 <== mon.0 v2:172.21.15.39:3300/0 5 ==== osd_map(2..2 src has 1..2) ==== 940+0+0 (secure 0 0 0) 0x7f637c06c570 con 0x7f638c109880 2024-09-12T02:27:35.968 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stderr 2024-09-12T02:27:34.413+0000 7f6383e00640 1 --2- 172.21.15.39:0/3500520507 >> [v2:172.21.15.39:6800/3152613618,v1:172.21.15.39:6801/3152613618] conn(0x7f6370038fc0 0x7f637003b480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:27:35.969 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stderr 2024-09-12T02:27:34.413+0000 7f6383e00640 1 --2- 172.21.15.39:0/3500520507 >> [v2:172.21.15.39:6800/3152613618,v1:172.21.15.39:6801/3152613618] conn(0x7f6370038fc0 0x7f637003b480 secure :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0x7f63740098c0 tx=0x7f6374006db0 comp rx=0 tx=0).ready entity=mgr.14118 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:27:35.969 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stderr 2024-09-12T02:27:34.417+0000 7f6389600640 1 -- 172.21.15.39:0/3500520507 <== mon.0 v2:172.21.15.39:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7f637c042e10 con 0x7f638c109880 2024-09-12T02:27:35.969 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stderr 2024-09-12T02:27:34.622+0000 7f6392a00640 1 -- 172.21.15.39:0/3500520507 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_command([{prefix=config set, name=mgr/cephadm/container_init}] v 0) -- 0x7f638c109d00 con 0x7f638c109880 2024-09-12T02:27:35.969 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stderr 2024-09-12T02:27:34.626+0000 7f6389600640 1 -- 172.21.15.39:0/3500520507 <== mon.0 v2:172.21.15.39:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mgr/cephadm/container_init}]=0 v7)=0 v7) ==== 142+0+0 (secure 0 0 0) 0x7f637c0328c0 con 0x7f638c109880 2024-09-12T02:27:35.969 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stderr 2024-09-12T02:27:34.629+0000 7f6392a00640 1 -- 172.21.15.39:0/3500520507 >> [v2:172.21.15.39:6800/3152613618,v1:172.21.15.39:6801/3152613618] conn(0x7f6370038fc0 msgr2=0x7f637003b480 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:27:35.969 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stderr 2024-09-12T02:27:34.629+0000 7f6392a00640 1 --2- 172.21.15.39:0/3500520507 >> [v2:172.21.15.39:6800/3152613618,v1:172.21.15.39:6801/3152613618] conn(0x7f6370038fc0 0x7f637003b480 secure :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0x7f63740098c0 tx=0x7f6374006db0 comp rx=0 tx=0).stop 2024-09-12T02:27:35.969 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stderr 2024-09-12T02:27:34.629+0000 7f6392a00640 1 -- 172.21.15.39:0/3500520507 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f638c109880 msgr2=0x7f638c19d8d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:27:35.969 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stderr 2024-09-12T02:27:34.629+0000 7f6392a00640 1 --2- 172.21.15.39:0/3500520507 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f638c109880 0x7f638c19d8d0 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 crypto rx=0x7f637c0097f0 tx=0x7f637c0327b0 comp rx=0 tx=0).stop 2024-09-12T02:27:35.969 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stderr 2024-09-12T02:27:34.629+0000 7f6392a00640 1 -- 172.21.15.39:0/3500520507 shutdown_connections 2024-09-12T02:27:35.969 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stderr 2024-09-12T02:27:34.629+0000 7f6392a00640 1 --2- 172.21.15.39:0/3500520507 >> [v2:172.21.15.39:6800/3152613618,v1:172.21.15.39:6801/3152613618] conn(0x7f6370038fc0 0x7f637003b480 unknown :-1 s=CLOSED pgs=14 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:27:35.969 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stderr 2024-09-12T02:27:34.629+0000 7f6392a00640 1 --2- 172.21.15.39:0/3500520507 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f638c109880 0x7f638c19d8d0 unknown :-1 s=CLOSED pgs=50 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:27:35.969 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stderr 2024-09-12T02:27:34.629+0000 7f6392a00640 1 -- 172.21.15.39:0/3500520507 >> 172.21.15.39:0/3500520507 conn(0x7f638c07ce60 msgr2=0x7f638c106d00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:27:35.969 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stderr 2024-09-12T02:27:34.629+0000 7f6392a00640 1 -- 172.21.15.39:0/3500520507 shutdown_connections 2024-09-12T02:27:35.970 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stderr 2024-09-12T02:27:34.629+0000 7f6392a00640 1 -- 172.21.15.39:0/3500520507 wait complete. 2024-09-12T02:27:36.849 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 02:27:36 smithi039 ceph-mon[30515]: from='mgr.14118 172.21.15.39:0/2227794351' entity='mgr.x' 2024-09-12T02:27:37.322 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stderr 2024-09-12T02:27:36.464+0000 7fa74c600640 1 Processor -- start 2024-09-12T02:27:37.322 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stderr 2024-09-12T02:27:36.464+0000 7fa74c600640 1 -- start start 2024-09-12T02:27:37.322 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stderr 2024-09-12T02:27:36.465+0000 7fa74c600640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fa744109880 0x7fa744109c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:27:37.322 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stderr 2024-09-12T02:27:36.465+0000 7fa74c600640 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 -- 0x7fa74410a250 con 0x7fa744109880 2024-09-12T02:27:37.322 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stderr 2024-09-12T02:27:36.465+0000 7fa749c00640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fa744109880 0x7fa744109c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:27:37.322 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stderr 2024-09-12T02:27:36.465+0000 7fa749c00640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fa744109880 0x7fa744109c80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.39:3300/0 says I am v2:172.21.15.39:57172/0 (socket says 172.21.15.39:57172) 2024-09-12T02:27:37.322 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stderr 2024-09-12T02:27:36.465+0000 7fa749c00640 1 -- 172.21.15.39:0/1293820883 learned_addr learned my addr 172.21.15.39:0/1293820883 (peer_addr_for_me v2:172.21.15.39:0/0) 2024-09-12T02:27:37.323 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stderr 2024-09-12T02:27:36.466+0000 7fa749c00640 1 -- 172.21.15.39:0/1293820883 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa74410aa80 con 0x7fa744109880 2024-09-12T02:27:37.323 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stderr 2024-09-12T02:27:36.467+0000 7fa749c00640 1 --2- 172.21.15.39:0/1293820883 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fa744109880 0x7fa744109c80 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0x7fa738009820 tx=0x7fa73802a270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b7a86d0ac67eefc2 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:27:37.323 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stderr 2024-09-12T02:27:36.467+0000 7fa743e00640 1 -- 172.21.15.39:0/1293820883 <== mon.0 v2:172.21.15.39:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fa738037070 con 0x7fa744109880 2024-09-12T02:27:37.323 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stderr 2024-09-12T02:27:36.467+0000 7fa743e00640 1 -- 172.21.15.39:0/1293820883 <== mon.0 v2:172.21.15.39:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fa738032920 con 0x7fa744109880 2024-09-12T02:27:37.323 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stderr 2024-09-12T02:27:36.467+0000 7fa743e00640 1 -- 172.21.15.39:0/1293820883 <== mon.0 v2:172.21.15.39:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fa738030810 con 0x7fa744109880 2024-09-12T02:27:37.323 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stderr 2024-09-12T02:27:36.468+0000 7fa74c600640 1 -- 172.21.15.39:0/1293820883 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fa744109880 msgr2=0x7fa744109c80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:27:37.323 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stderr 2024-09-12T02:27:36.468+0000 7fa74c600640 1 --2- 172.21.15.39:0/1293820883 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fa744109880 0x7fa744109c80 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0x7fa738009820 tx=0x7fa73802a270 comp rx=0 tx=0).stop 2024-09-12T02:27:37.323 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stderr 2024-09-12T02:27:36.468+0000 7fa74c600640 1 -- 172.21.15.39:0/1293820883 shutdown_connections 2024-09-12T02:27:37.323 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stderr 2024-09-12T02:27:36.468+0000 7fa74c600640 1 --2- 172.21.15.39:0/1293820883 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fa744109880 0x7fa744109c80 unknown :-1 s=CLOSED pgs=51 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:27:37.323 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stderr 2024-09-12T02:27:36.468+0000 7fa74c600640 1 -- 172.21.15.39:0/1293820883 >> 172.21.15.39:0/1293820883 conn(0x7fa74407ce60 msgr2=0x7fa74407d270 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:27:37.323 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stderr 2024-09-12T02:27:36.468+0000 7fa74c600640 1 -- 172.21.15.39:0/1293820883 shutdown_connections 2024-09-12T02:27:37.323 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stderr 2024-09-12T02:27:36.468+0000 7fa74c600640 1 -- 172.21.15.39:0/1293820883 wait complete. 2024-09-12T02:27:37.323 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stderr 2024-09-12T02:27:36.469+0000 7fa74c600640 1 Processor -- start 2024-09-12T02:27:37.323 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stderr 2024-09-12T02:27:36.469+0000 7fa74c600640 1 -- start start 2024-09-12T02:27:37.324 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stderr 2024-09-12T02:27:36.469+0000 7fa74c600640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fa744109880 0x7fa74419d8d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:27:37.324 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stderr 2024-09-12T02:27:36.469+0000 7fa74c600640 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 -- 0x7fa74410de30 con 0x7fa744109880 2024-09-12T02:27:37.324 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stderr 2024-09-12T02:27:36.470+0000 7fa749c00640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fa744109880 0x7fa74419d8d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:27:37.324 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stderr 2024-09-12T02:27:36.470+0000 7fa749c00640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fa744109880 0x7fa74419d8d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.39:3300/0 says I am v2:172.21.15.39:57174/0 (socket says 172.21.15.39:57174) 2024-09-12T02:27:37.324 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stderr 2024-09-12T02:27:36.470+0000 7fa749c00640 1 -- 172.21.15.39:0/1300997504 learned_addr learned my addr 172.21.15.39:0/1300997504 (peer_addr_for_me v2:172.21.15.39:0/0) 2024-09-12T02:27:37.324 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stderr 2024-09-12T02:27:36.470+0000 7fa749c00640 1 -- 172.21.15.39:0/1300997504 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa74419de10 con 0x7fa744109880 2024-09-12T02:27:37.324 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stderr 2024-09-12T02:27:36.470+0000 7fa749c00640 1 --2- 172.21.15.39:0/1300997504 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fa744109880 0x7fa74419d8d0 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7fa738030560 tx=0x7fa738032670 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:27:37.324 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stderr 2024-09-12T02:27:36.471+0000 7fa742000640 1 -- 172.21.15.39:0/1300997504 <== mon.0 v2:172.21.15.39:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fa738037040 con 0x7fa744109880 2024-09-12T02:27:37.324 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stderr 2024-09-12T02:27:36.471+0000 7fa742000640 1 -- 172.21.15.39:0/1300997504 <== mon.0 v2:172.21.15.39:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fa738040070 con 0x7fa744109880 2024-09-12T02:27:37.324 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stderr 2024-09-12T02:27:36.471+0000 7fa74c600640 1 -- 172.21.15.39:0/1300997504 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa74419e0a0 con 0x7fa744109880 2024-09-12T02:27:37.324 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stderr 2024-09-12T02:27:36.471+0000 7fa742000640 1 -- 172.21.15.39:0/1300997504 <== mon.0 v2:172.21.15.39:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fa73803a740 con 0x7fa744109880 2024-09-12T02:27:37.324 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stderr 2024-09-12T02:27:36.471+0000 7fa74c600640 1 -- 172.21.15.39:0/1300997504 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa7441a0d90 con 0x7fa744109880 2024-09-12T02:27:37.324 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stderr 2024-09-12T02:27:36.472+0000 7fa742000640 1 -- 172.21.15.39:0/1300997504 <== mon.0 v2:172.21.15.39:3300/0 4 ==== mgrmap(e 8) ==== 46287+0+0 (secure 0 0 0) 0x7fa73803a9b0 con 0x7fa744109880 2024-09-12T02:27:37.325 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stderr 2024-09-12T02:27:36.472+0000 7fa74c600640 1 -- 172.21.15.39:0/1300997504 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fa74410dfb0 con 0x7fa744109880 2024-09-12T02:27:37.325 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stderr 2024-09-12T02:27:36.472+0000 7fa742000640 1 --2- 172.21.15.39:0/1300997504 >> [v2:172.21.15.39:6800/3152613618,v1:172.21.15.39:6801/3152613618] conn(0x7fa72c038f70 0x7fa72c03b430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:27:37.325 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stderr 2024-09-12T02:27:36.473+0000 7fa742000640 1 -- 172.21.15.39:0/1300997504 <== mon.0 v2:172.21.15.39:3300/0 5 ==== osd_map(2..2 src has 1..2) ==== 940+0+0 (secure 0 0 0) 0x7fa73806c7e0 con 0x7fa744109880 2024-09-12T02:27:37.325 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stderr 2024-09-12T02:27:36.473+0000 7fa749200640 1 --2- 172.21.15.39:0/1300997504 >> [v2:172.21.15.39:6800/3152613618,v1:172.21.15.39:6801/3152613618] conn(0x7fa72c038f70 0x7fa72c03b430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:27:37.325 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stderr 2024-09-12T02:27:36.473+0000 7fa749200640 1 --2- 172.21.15.39:0/1300997504 >> [v2:172.21.15.39:6800/3152613618,v1:172.21.15.39:6801/3152613618] conn(0x7fa72c038f70 0x7fa72c03b430 secure :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0x7fa7300098c0 tx=0x7fa730006db0 comp rx=0 tx=0).ready entity=mgr.14118 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:27:37.325 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stderr 2024-09-12T02:27:36.478+0000 7fa742000640 1 -- 172.21.15.39:0/1300997504 <== mon.0 v2:172.21.15.39:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7fa738032920 con 0x7fa744109880 2024-09-12T02:27:37.325 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stderr 2024-09-12T02:27:36.671+0000 7fa74c600640 1 -- 172.21.15.39:0/1300997504 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_command([{prefix=config set, name=mgr/dashboard/ssl_server_port}] v 0) -- 0x7fa744109d00 con 0x7fa744109880 2024-09-12T02:27:37.325 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stderr 2024-09-12T02:27:36.676+0000 7fa742000640 1 -- 172.21.15.39:0/1300997504 <== mon.0 v2:172.21.15.39:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mgr/dashboard/ssl_server_port}]=0 v8)=0 v8) ==== 130+0+0 (secure 0 0 0) 0x7fa73806c130 con 0x7fa744109880 2024-09-12T02:27:37.325 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stderr 2024-09-12T02:27:36.678+0000 7fa74c600640 1 -- 172.21.15.39:0/1300997504 >> [v2:172.21.15.39:6800/3152613618,v1:172.21.15.39:6801/3152613618] conn(0x7fa72c038f70 msgr2=0x7fa72c03b430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:27:37.325 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stderr 2024-09-12T02:27:36.678+0000 7fa74c600640 1 --2- 172.21.15.39:0/1300997504 >> [v2:172.21.15.39:6800/3152613618,v1:172.21.15.39:6801/3152613618] conn(0x7fa72c038f70 0x7fa72c03b430 secure :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0x7fa7300098c0 tx=0x7fa730006db0 comp rx=0 tx=0).stop 2024-09-12T02:27:37.325 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stderr 2024-09-12T02:27:36.679+0000 7fa74c600640 1 -- 172.21.15.39:0/1300997504 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fa744109880 msgr2=0x7fa74419d8d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:27:37.325 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stderr 2024-09-12T02:27:36.679+0000 7fa74c600640 1 --2- 172.21.15.39:0/1300997504 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fa744109880 0x7fa74419d8d0 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7fa738030560 tx=0x7fa738032670 comp rx=0 tx=0).stop 2024-09-12T02:27:37.325 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stderr 2024-09-12T02:27:36.679+0000 7fa74c600640 1 -- 172.21.15.39:0/1300997504 shutdown_connections 2024-09-12T02:27:37.325 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stderr 2024-09-12T02:27:36.679+0000 7fa74c600640 1 --2- 172.21.15.39:0/1300997504 >> [v2:172.21.15.39:6800/3152613618,v1:172.21.15.39:6801/3152613618] conn(0x7fa72c038f70 0x7fa72c03b430 unknown :-1 s=CLOSED pgs=15 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:27:37.326 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stderr 2024-09-12T02:27:36.679+0000 7fa74c600640 1 --2- 172.21.15.39:0/1300997504 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fa744109880 0x7fa74419d8d0 unknown :-1 s=CLOSED pgs=52 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:27:37.326 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stderr 2024-09-12T02:27:36.679+0000 7fa74c600640 1 -- 172.21.15.39:0/1300997504 >> 172.21.15.39:0/1300997504 conn(0x7fa74407ce60 msgr2=0x7fa744106d00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:27:37.326 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stderr 2024-09-12T02:27:36.679+0000 7fa74c600640 1 -- 172.21.15.39:0/1300997504 shutdown_connections 2024-09-12T02:27:37.326 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stderr 2024-09-12T02:27:36.679+0000 7fa74c600640 1 -- 172.21.15.39:0/1300997504 wait complete. 2024-09-12T02:27:37.326 INFO:teuthology.orchestra.run.smithi039.stdout:Enabling the dashboard module... 2024-09-12T02:27:37.595 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 02:27:37 smithi039 ceph-mon[30515]: pgmap v3: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-12T02:27:37.595 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 02:27:37 smithi039 ceph-mon[30515]: from='client.? 172.21.15.39:0/1300997504' entity='client.admin' 2024-09-12T02:27:37.595 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 02:27:37 smithi039 ceph-mon[30515]: from='mgr.14118 172.21.15.39:0/2227794351' entity='mgr.x' 2024-09-12T02:27:38.807 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 02:27:38 smithi039 ceph-mon[30515]: from='client.? 172.21.15.39:0/2046471114' entity='client.admin' cmd=[{"prefix": "mgr module enable", "module": "dashboard"}]: dispatch 2024-09-12T02:27:38.807 INFO:journalctl@ceph.mgr.x.smithi039.stdout:Sep 12 02:27:38 smithi039 ceph-4954ed46-70ae-11ef-bcea-c7b262605968-mgr-x[30736]: ignoring --setuser ceph since I am not root 2024-09-12T02:27:38.807 INFO:journalctl@ceph.mgr.x.smithi039.stdout:Sep 12 02:27:38 smithi039 ceph-4954ed46-70ae-11ef-bcea-c7b262605968-mgr-x[30736]: ignoring --setgroup ceph since I am not root 2024-09-12T02:27:38.807 INFO:journalctl@ceph.mgr.x.smithi039.stdout:Sep 12 02:27:38 smithi039 ceph-4954ed46-70ae-11ef-bcea-c7b262605968-mgr-x[30736]: 2024-09-12T02:27:38.806+0000 7f3202e36040 -1 mgr[py] Module osd_perf_query has missing NOTIFY_TYPES member 2024-09-12T02:27:39.072 INFO:journalctl@ceph.mgr.x.smithi039.stdout:Sep 12 02:27:38 smithi039 ceph-4954ed46-70ae-11ef-bcea-c7b262605968-mgr-x[30736]: 2024-09-12T02:27:38.881+0000 7f3202e36040 -1 mgr[py] Module osd_support has missing NOTIFY_TYPES member 2024-09-12T02:27:39.072 INFO:journalctl@ceph.mgr.x.smithi039.stdout:Sep 12 02:27:39 smithi039 ceph-4954ed46-70ae-11ef-bcea-c7b262605968-mgr-x[30736]: 2024-09-12T02:27:39.071+0000 7f3202e36040 -1 mgr[py] Module diskprediction_local has missing NOTIFY_TYPES member 2024-09-12T02:27:39.337 INFO:journalctl@ceph.mgr.x.smithi039.stdout:Sep 12 02:27:39 smithi039 ceph-4954ed46-70ae-11ef-bcea-c7b262605968-mgr-x[30736]: 2024-09-12T02:27:39.155+0000 7f3202e36040 -1 mgr[py] Module crash has missing NOTIFY_TYPES member 2024-09-12T02:27:39.337 INFO:journalctl@ceph.mgr.x.smithi039.stdout:Sep 12 02:27:39 smithi039 ceph-4954ed46-70ae-11ef-bcea-c7b262605968-mgr-x[30736]: 2024-09-12T02:27:39.335+0000 7f3202e36040 -1 mgr[py] Module test_orchestrator has missing NOTIFY_TYPES member 2024-09-12T02:27:39.599 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 02:27:39 smithi039 ceph-mon[30515]: from='client.? 172.21.15.39:0/2046471114' entity='client.admin' cmd='[{"prefix": "mgr module enable", "module": "dashboard"}]': finished 2024-09-12T02:27:39.600 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 02:27:39 smithi039 ceph-mon[30515]: mgrmap e9: x(active, since 22s) 2024-09-12T02:27:39.600 INFO:journalctl@ceph.mgr.x.smithi039.stdout:Sep 12 02:27:39 smithi039 ceph-4954ed46-70ae-11ef-bcea-c7b262605968-mgr-x[30736]: 2024-09-12T02:27:39.507+0000 7f3202e36040 -1 mgr[py] Module snap_schedule has missing NOTIFY_TYPES member 2024-09-12T02:27:39.627 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stderr 2024-09-12T02:27:37.853+0000 7f6327e00640 1 Processor -- start 2024-09-12T02:27:39.627 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stderr 2024-09-12T02:27:37.853+0000 7f6327e00640 1 -- start start 2024-09-12T02:27:39.627 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stderr 2024-09-12T02:27:37.853+0000 7f6327e00640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f632807dde0 0x7f632807c240 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:27:39.627 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stderr 2024-09-12T02:27:37.853+0000 7f6327e00640 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 -- 0x7f632807c780 con 0x7f632807dde0 2024-09-12T02:27:39.628 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stderr 2024-09-12T02:27:37.854+0000 7f6326a00640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f632807dde0 0x7f632807c240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:27:39.628 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stderr 2024-09-12T02:27:37.854+0000 7f6326a00640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f632807dde0 0x7f632807c240 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.39:3300/0 says I am v2:172.21.15.39:57178/0 (socket says 172.21.15.39:57178) 2024-09-12T02:27:39.628 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stderr 2024-09-12T02:27:37.854+0000 7f6326a00640 1 -- 172.21.15.39:0/606439665 learned_addr learned my addr 172.21.15.39:0/606439665 (peer_addr_for_me v2:172.21.15.39:0/0) 2024-09-12T02:27:39.628 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stderr 2024-09-12T02:27:37.854+0000 7f6326a00640 1 -- 172.21.15.39:0/606439665 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f632807c900 con 0x7f632807dde0 2024-09-12T02:27:39.628 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stderr 2024-09-12T02:27:37.855+0000 7f6326a00640 1 --2- 172.21.15.39:0/606439665 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f632807dde0 0x7f632807c240 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7f6318009820 tx=0x7f631802a270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d4c6f8add2c8570b server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:27:39.628 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stderr 2024-09-12T02:27:37.856+0000 7f6326000640 1 -- 172.21.15.39:0/606439665 <== mon.0 v2:172.21.15.39:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f6318037070 con 0x7f632807dde0 2024-09-12T02:27:39.628 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stderr 2024-09-12T02:27:37.856+0000 7f6326000640 1 -- 172.21.15.39:0/606439665 <== mon.0 v2:172.21.15.39:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f6318032920 con 0x7f632807dde0 2024-09-12T02:27:39.628 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stderr 2024-09-12T02:27:37.856+0000 7f6326000640 1 -- 172.21.15.39:0/606439665 <== mon.0 v2:172.21.15.39:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f6318030810 con 0x7f632807dde0 2024-09-12T02:27:39.628 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stderr 2024-09-12T02:27:37.856+0000 7f6327e00640 1 -- 172.21.15.39:0/606439665 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f632807dde0 msgr2=0x7f632807c240 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:27:39.628 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stderr 2024-09-12T02:27:37.856+0000 7f6327e00640 1 --2- 172.21.15.39:0/606439665 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f632807dde0 0x7f632807c240 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7f6318009820 tx=0x7f631802a270 comp rx=0 tx=0).stop 2024-09-12T02:27:39.628 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stderr 2024-09-12T02:27:37.857+0000 7f6327e00640 1 -- 172.21.15.39:0/606439665 shutdown_connections 2024-09-12T02:27:39.629 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stderr 2024-09-12T02:27:37.857+0000 7f6327e00640 1 --2- 172.21.15.39:0/606439665 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f632807dde0 0x7f632807c240 unknown :-1 s=CLOSED pgs=53 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:27:39.629 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stderr 2024-09-12T02:27:37.857+0000 7f6327e00640 1 -- 172.21.15.39:0/606439665 >> 172.21.15.39:0/606439665 conn(0x7f6328102d10 msgr2=0x7f6328105130 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:27:39.629 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stderr 2024-09-12T02:27:37.857+0000 7f6327e00640 1 -- 172.21.15.39:0/606439665 shutdown_connections 2024-09-12T02:27:39.629 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stderr 2024-09-12T02:27:37.857+0000 7f6327e00640 1 -- 172.21.15.39:0/606439665 wait complete. 2024-09-12T02:27:39.629 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stderr 2024-09-12T02:27:37.858+0000 7f6327e00640 1 Processor -- start 2024-09-12T02:27:39.629 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stderr 2024-09-12T02:27:37.858+0000 7f6327e00640 1 -- start start 2024-09-12T02:27:39.629 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stderr 2024-09-12T02:27:37.858+0000 7f6327e00640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f632807dde0 0x7f632819d6c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:27:39.629 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stderr 2024-09-12T02:27:37.858+0000 7f6327e00640 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 -- 0x7f632810db30 con 0x7f632807dde0 2024-09-12T02:27:39.629 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stderr 2024-09-12T02:27:37.858+0000 7f6326a00640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f632807dde0 0x7f632819d6c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:27:39.629 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stderr 2024-09-12T02:27:37.858+0000 7f6326a00640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f632807dde0 0x7f632819d6c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.39:3300/0 says I am v2:172.21.15.39:57188/0 (socket says 172.21.15.39:57188) 2024-09-12T02:27:39.629 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stderr 2024-09-12T02:27:37.858+0000 7f6326a00640 1 -- 172.21.15.39:0/2046471114 learned_addr learned my addr 172.21.15.39:0/2046471114 (peer_addr_for_me v2:172.21.15.39:0/0) 2024-09-12T02:27:39.629 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stderr 2024-09-12T02:27:37.859+0000 7f6326a00640 1 -- 172.21.15.39:0/2046471114 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f632819dc00 con 0x7f632807dde0 2024-09-12T02:27:39.629 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stderr 2024-09-12T02:27:37.859+0000 7f6326a00640 1 --2- 172.21.15.39:0/2046471114 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f632807dde0 0x7f632819d6c0 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7f63180097f0 tx=0x7f63180327b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:27:39.630 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stderr 2024-09-12T02:27:37.859+0000 7f631f400640 1 -- 172.21.15.39:0/2046471114 <== mon.0 v2:172.21.15.39:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f6318037040 con 0x7f632807dde0 2024-09-12T02:27:39.630 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stderr 2024-09-12T02:27:37.859+0000 7f631f400640 1 -- 172.21.15.39:0/2046471114 <== mon.0 v2:172.21.15.39:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f6318030cc0 con 0x7f632807dde0 2024-09-12T02:27:39.630 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stderr 2024-09-12T02:27:37.860+0000 7f6327e00640 1 -- 172.21.15.39:0/2046471114 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f632819de90 con 0x7f632807dde0 2024-09-12T02:27:39.630 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stderr 2024-09-12T02:27:37.860+0000 7f631f400640 1 -- 172.21.15.39:0/2046471114 <== mon.0 v2:172.21.15.39:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f631803a6b0 con 0x7f632807dde0 2024-09-12T02:27:39.630 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stderr 2024-09-12T02:27:37.860+0000 7f6327e00640 1 -- 172.21.15.39:0/2046471114 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f63281a0b80 con 0x7f632807dde0 2024-09-12T02:27:39.630 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stderr 2024-09-12T02:27:37.861+0000 7f631f400640 1 -- 172.21.15.39:0/2046471114 <== mon.0 v2:172.21.15.39:3300/0 4 ==== mgrmap(e 8) ==== 46287+0+0 (secure 0 0 0) 0x7f631803a850 con 0x7f632807dde0 2024-09-12T02:27:39.630 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stderr 2024-09-12T02:27:37.861+0000 7f6327e00640 1 -- 172.21.15.39:0/2046471114 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f632807c2c0 con 0x7f632807dde0 2024-09-12T02:27:39.630 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stderr 2024-09-12T02:27:37.861+0000 7f631f400640 1 --2- 172.21.15.39:0/2046471114 >> [v2:172.21.15.39:6800/3152613618,v1:172.21.15.39:6801/3152613618] conn(0x7f630c038fc0 0x7f630c03b480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:27:39.630 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stderr 2024-09-12T02:27:37.861+0000 7f631f400640 1 -- 172.21.15.39:0/2046471114 <== mon.0 v2:172.21.15.39:3300/0 5 ==== osd_map(2..2 src has 1..2) ==== 940+0+0 (secure 0 0 0) 0x7f631806c730 con 0x7f632807dde0 2024-09-12T02:27:39.630 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stderr 2024-09-12T02:27:37.862+0000 7f631fe00640 1 --2- 172.21.15.39:0/2046471114 >> [v2:172.21.15.39:6800/3152613618,v1:172.21.15.39:6801/3152613618] conn(0x7f630c038fc0 0x7f630c03b480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:27:39.630 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stderr 2024-09-12T02:27:37.862+0000 7f631fe00640 1 --2- 172.21.15.39:0/2046471114 >> [v2:172.21.15.39:6800/3152613618,v1:172.21.15.39:6801/3152613618] conn(0x7f630c038fc0 0x7f630c03b480 secure :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0x7f63100098c0 tx=0x7f6310006db0 comp rx=0 tx=0).ready entity=mgr.14118 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:27:39.630 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stderr 2024-09-12T02:27:37.867+0000 7f631f400640 1 -- 172.21.15.39:0/2046471114 <== mon.0 v2:172.21.15.39:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7f631806c080 con 0x7f632807dde0 2024-09-12T02:27:39.631 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stderr 2024-09-12T02:27:38.118+0000 7f6327e00640 1 -- 172.21.15.39:0/2046471114 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_command({"prefix": "mgr module enable", "module": "dashboard"} v 0) -- 0x7f63281a1170 con 0x7f632807dde0 2024-09-12T02:27:39.631 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stderr 2024-09-12T02:27:38.555+0000 7f631f400640 1 -- 172.21.15.39:0/2046471114 <== mon.0 v2:172.21.15.39:3300/0 7 ==== mon_command_ack([{"prefix": "mgr module enable", "module": "dashboard"}]=0 v9) ==== 88+0+0 (secure 0 0 0) 0x7f631802fd60 con 0x7f632807dde0 2024-09-12T02:27:39.631 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stderr 2024-09-12T02:27:38.557+0000 7f631f400640 1 -- 172.21.15.39:0/2046471114 <== mon.0 v2:172.21.15.39:3300/0 8 ==== mgrmap(e 9) ==== 46300+0+0 (secure 0 0 0) 0x7f6318044920 con 0x7f632807dde0 2024-09-12T02:27:39.631 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stderr 2024-09-12T02:27:38.558+0000 7f6327e00640 1 -- 172.21.15.39:0/2046471114 >> [v2:172.21.15.39:6800/3152613618,v1:172.21.15.39:6801/3152613618] conn(0x7f630c038fc0 msgr2=0x7f630c03b480 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:27:39.631 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stderr 2024-09-12T02:27:38.558+0000 7f6327e00640 1 --2- 172.21.15.39:0/2046471114 >> [v2:172.21.15.39:6800/3152613618,v1:172.21.15.39:6801/3152613618] conn(0x7f630c038fc0 0x7f630c03b480 secure :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0x7f63100098c0 tx=0x7f6310006db0 comp rx=0 tx=0).stop 2024-09-12T02:27:39.631 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stderr 2024-09-12T02:27:38.558+0000 7f6327e00640 1 -- 172.21.15.39:0/2046471114 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f632807dde0 msgr2=0x7f632819d6c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:27:39.631 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stderr 2024-09-12T02:27:38.558+0000 7f6327e00640 1 --2- 172.21.15.39:0/2046471114 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f632807dde0 0x7f632819d6c0 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7f63180097f0 tx=0x7f63180327b0 comp rx=0 tx=0).stop 2024-09-12T02:27:39.631 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stderr 2024-09-12T02:27:38.558+0000 7f6327e00640 1 -- 172.21.15.39:0/2046471114 shutdown_connections 2024-09-12T02:27:39.631 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stderr 2024-09-12T02:27:38.558+0000 7f6327e00640 1 --2- 172.21.15.39:0/2046471114 >> [v2:172.21.15.39:6800/3152613618,v1:172.21.15.39:6801/3152613618] conn(0x7f630c038fc0 0x7f630c03b480 unknown :-1 s=CLOSED pgs=16 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:27:39.631 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stderr 2024-09-12T02:27:38.558+0000 7f6327e00640 1 --2- 172.21.15.39:0/2046471114 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f632807dde0 0x7f632819d6c0 unknown :-1 s=CLOSED pgs=54 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:27:39.631 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stderr 2024-09-12T02:27:38.558+0000 7f6327e00640 1 -- 172.21.15.39:0/2046471114 >> 172.21.15.39:0/2046471114 conn(0x7f6328102d10 msgr2=0x7f6328103830 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:27:39.631 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stderr 2024-09-12T02:27:38.558+0000 7f6327e00640 1 -- 172.21.15.39:0/2046471114 shutdown_connections 2024-09-12T02:27:39.631 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stderr 2024-09-12T02:27:38.558+0000 7f6327e00640 1 -- 172.21.15.39:0/2046471114 wait complete. 2024-09-12T02:27:40.131 INFO:journalctl@ceph.mgr.x.smithi039.stdout:Sep 12 02:27:39 smithi039 ceph-4954ed46-70ae-11ef-bcea-c7b262605968-mgr-x[30736]: 2024-09-12T02:27:39.903+0000 7f3202e36040 -1 mgr[py] Module prometheus has missing NOTIFY_TYPES member 2024-09-12T02:27:40.131 INFO:journalctl@ceph.mgr.x.smithi039.stdout:Sep 12 02:27:39 smithi039 ceph-4954ed46-70ae-11ef-bcea-c7b262605968-mgr-x[30736]: 2024-09-12T02:27:39.978+0000 7f3202e36040 -1 mgr[py] Module selftest has missing NOTIFY_TYPES member 2024-09-12T02:27:40.391 INFO:journalctl@ceph.mgr.x.smithi039.stdout:Sep 12 02:27:40 smithi039 ceph-4954ed46-70ae-11ef-bcea-c7b262605968-mgr-x[30736]: 2024-09-12T02:27:40.203+0000 7f3202e36040 -1 mgr[py] Module volumes has missing NOTIFY_TYPES member 2024-09-12T02:27:40.791 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 02:27:40 smithi039 ceph-mon[30515]: from='client.? 172.21.15.39:0/154982435' entity='client.admin' cmd=[{"prefix": "mgr stat"}]: dispatch 2024-09-12T02:27:41.102 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stdout { 2024-09-12T02:27:41.102 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stdout "epoch": 9, 2024-09-12T02:27:41.102 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stdout "available": true, 2024-09-12T02:27:41.102 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stdout "active_name": "x", 2024-09-12T02:27:41.102 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stdout "num_standby": 0 2024-09-12T02:27:41.102 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stdout } 2024-09-12T02:27:41.102 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stderr 2024-09-12T02:27:40.130+0000 7fe552200640 1 Processor -- start 2024-09-12T02:27:41.102 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stderr 2024-09-12T02:27:40.130+0000 7fe552200640 1 -- start start 2024-09-12T02:27:41.102 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stderr 2024-09-12T02:27:40.130+0000 7fe552200640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fe54c07de20 0x7fe54c07c280 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:27:41.102 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stderr 2024-09-12T02:27:40.130+0000 7fe552200640 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 -- 0x7fe54c07c850 con 0x7fe54c07de20 2024-09-12T02:27:41.103 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stderr 2024-09-12T02:27:40.131+0000 7fe550e00640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fe54c07de20 0x7fe54c07c280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:27:41.103 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stderr 2024-09-12T02:27:40.131+0000 7fe550e00640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fe54c07de20 0x7fe54c07c280 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.39:3300/0 says I am v2:172.21.15.39:41714/0 (socket says 172.21.15.39:41714) 2024-09-12T02:27:41.103 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stderr 2024-09-12T02:27:40.131+0000 7fe550e00640 1 -- 172.21.15.39:0/144968273 learned_addr learned my addr 172.21.15.39:0/144968273 (peer_addr_for_me v2:172.21.15.39:0/0) 2024-09-12T02:27:41.103 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stderr 2024-09-12T02:27:40.131+0000 7fe550e00640 1 -- 172.21.15.39:0/144968273 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe54c07c9d0 con 0x7fe54c07de20 2024-09-12T02:27:41.103 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stderr 2024-09-12T02:27:40.132+0000 7fe550e00640 1 --2- 172.21.15.39:0/144968273 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fe54c07de20 0x7fe54c07c280 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7fe540009820 tx=0x7fe54002a270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=381e310c2bd44ffa server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:27:41.103 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stderr 2024-09-12T02:27:40.132+0000 7fe54b400640 1 -- 172.21.15.39:0/144968273 <== mon.0 v2:172.21.15.39:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fe540037070 con 0x7fe54c07de20 2024-09-12T02:27:41.103 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stderr 2024-09-12T02:27:40.132+0000 7fe54b400640 1 -- 172.21.15.39:0/144968273 <== mon.0 v2:172.21.15.39:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fe540032920 con 0x7fe54c07de20 2024-09-12T02:27:41.103 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stderr 2024-09-12T02:27:40.132+0000 7fe54b400640 1 -- 172.21.15.39:0/144968273 <== mon.0 v2:172.21.15.39:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fe540030810 con 0x7fe54c07de20 2024-09-12T02:27:41.103 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stderr 2024-09-12T02:27:40.133+0000 7fe552200640 1 -- 172.21.15.39:0/144968273 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fe54c07de20 msgr2=0x7fe54c07c280 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:27:41.103 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stderr 2024-09-12T02:27:40.133+0000 7fe552200640 1 --2- 172.21.15.39:0/144968273 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fe54c07de20 0x7fe54c07c280 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7fe540009820 tx=0x7fe54002a270 comp rx=0 tx=0).stop 2024-09-12T02:27:41.103 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stderr 2024-09-12T02:27:40.133+0000 7fe552200640 1 -- 172.21.15.39:0/144968273 shutdown_connections 2024-09-12T02:27:41.103 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stderr 2024-09-12T02:27:40.133+0000 7fe552200640 1 --2- 172.21.15.39:0/144968273 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fe54c07de20 0x7fe54c07c280 unknown :-1 s=CLOSED pgs=57 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:27:41.104 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stderr 2024-09-12T02:27:40.133+0000 7fe552200640 1 -- 172.21.15.39:0/144968273 >> 172.21.15.39:0/144968273 conn(0x7fe54c102d10 msgr2=0x7fe54c105130 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:27:41.104 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stderr 2024-09-12T02:27:40.133+0000 7fe552200640 1 -- 172.21.15.39:0/144968273 shutdown_connections 2024-09-12T02:27:41.104 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stderr 2024-09-12T02:27:40.133+0000 7fe552200640 1 -- 172.21.15.39:0/144968273 wait complete. 2024-09-12T02:27:41.104 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stderr 2024-09-12T02:27:40.135+0000 7fe552200640 1 Processor -- start 2024-09-12T02:27:41.104 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stderr 2024-09-12T02:27:40.135+0000 7fe552200640 1 -- start start 2024-09-12T02:27:41.104 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stderr 2024-09-12T02:27:40.135+0000 7fe552200640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fe54c07de20 0x7fe54c19d6c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:27:41.104 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stderr 2024-09-12T02:27:40.135+0000 7fe552200640 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 -- 0x7fe54c10dbb0 con 0x7fe54c07de20 2024-09-12T02:27:41.104 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stderr 2024-09-12T02:27:40.136+0000 7fe550e00640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fe54c07de20 0x7fe54c19d6c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:27:41.104 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stderr 2024-09-12T02:27:40.136+0000 7fe550e00640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fe54c07de20 0x7fe54c19d6c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.39:3300/0 says I am v2:172.21.15.39:41722/0 (socket says 172.21.15.39:41722) 2024-09-12T02:27:41.104 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stderr 2024-09-12T02:27:40.136+0000 7fe550e00640 1 -- 172.21.15.39:0/154982435 learned_addr learned my addr 172.21.15.39:0/154982435 (peer_addr_for_me v2:172.21.15.39:0/0) 2024-09-12T02:27:41.104 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stderr 2024-09-12T02:27:40.136+0000 7fe550e00640 1 -- 172.21.15.39:0/154982435 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe54c19dc00 con 0x7fe54c07de20 2024-09-12T02:27:41.104 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stderr 2024-09-12T02:27:40.136+0000 7fe550e00640 1 --2- 172.21.15.39:0/154982435 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fe54c07de20 0x7fe54c19d6c0 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7fe5400097f0 tx=0x7fe5400327b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:27:41.104 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stderr 2024-09-12T02:27:40.136+0000 7fe549600640 1 -- 172.21.15.39:0/154982435 <== mon.0 v2:172.21.15.39:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fe540037040 con 0x7fe54c07de20 2024-09-12T02:27:41.104 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stderr 2024-09-12T02:27:40.136+0000 7fe549600640 1 -- 172.21.15.39:0/154982435 <== mon.0 v2:172.21.15.39:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fe540030cc0 con 0x7fe54c07de20 2024-09-12T02:27:41.105 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stderr 2024-09-12T02:27:40.136+0000 7fe552200640 1 -- 172.21.15.39:0/154982435 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe54c19de90 con 0x7fe54c07de20 2024-09-12T02:27:41.105 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stderr 2024-09-12T02:27:40.137+0000 7fe549600640 1 -- 172.21.15.39:0/154982435 <== mon.0 v2:172.21.15.39:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fe54003a6b0 con 0x7fe54c07de20 2024-09-12T02:27:41.105 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stderr 2024-09-12T02:27:40.137+0000 7fe552200640 1 -- 172.21.15.39:0/154982435 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe54c1a0b80 con 0x7fe54c07de20 2024-09-12T02:27:41.105 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stderr 2024-09-12T02:27:40.138+0000 7fe549600640 1 -- 172.21.15.39:0/154982435 <== mon.0 v2:172.21.15.39:3300/0 4 ==== mgrmap(e 9) ==== 46300+0+0 (secure 0 0 0) 0x7fe54003a8a0 con 0x7fe54c07de20 2024-09-12T02:27:41.105 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stderr 2024-09-12T02:27:40.138+0000 7fe552200640 1 -- 172.21.15.39:0/154982435 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fe54c07c300 con 0x7fe54c07de20 2024-09-12T02:27:41.105 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stderr 2024-09-12T02:27:40.138+0000 7fe549600640 1 --2- 172.21.15.39:0/154982435 >> [v2:172.21.15.39:6800/3152613618,v1:172.21.15.39:6801/3152613618] conn(0x7fe534038fc0 0x7fe53403b480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:27:41.105 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stderr 2024-09-12T02:27:40.138+0000 7fe549600640 1 -- 172.21.15.39:0/154982435 <== mon.0 v2:172.21.15.39:3300/0 5 ==== osd_map(2..2 src has 1..2) ==== 940+0+0 (secure 0 0 0) 0x7fe54006c600 con 0x7fe54c07de20 2024-09-12T02:27:41.105 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stderr 2024-09-12T02:27:40.139+0000 7fe54be00640 1 -- 172.21.15.39:0/154982435 >> [v2:172.21.15.39:6800/3152613618,v1:172.21.15.39:6801/3152613618] conn(0x7fe534038fc0 msgr2=0x7fe53403b480 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.39:6800/3152613618 2024-09-12T02:27:41.105 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stderr 2024-09-12T02:27:40.139+0000 7fe54be00640 1 --2- 172.21.15.39:0/154982435 >> [v2:172.21.15.39:6800/3152613618,v1:172.21.15.39:6801/3152613618] conn(0x7fe534038fc0 0x7fe53403b480 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-09-12T02:27:41.105 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stderr 2024-09-12T02:27:40.143+0000 7fe549600640 1 -- 172.21.15.39:0/154982435 <== mon.0 v2:172.21.15.39:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7fe54006bf50 con 0x7fe54c07de20 2024-09-12T02:27:41.105 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stderr 2024-09-12T02:27:40.340+0000 7fe54be00640 1 -- 172.21.15.39:0/154982435 >> [v2:172.21.15.39:6800/3152613618,v1:172.21.15.39:6801/3152613618] conn(0x7fe534038fc0 msgr2=0x7fe53403b480 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.39:6800/3152613618 2024-09-12T02:27:41.105 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stderr 2024-09-12T02:27:40.340+0000 7fe54be00640 1 --2- 172.21.15.39:0/154982435 >> [v2:172.21.15.39:6800/3152613618,v1:172.21.15.39:6801/3152613618] conn(0x7fe534038fc0 0x7fe53403b480 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2024-09-12T02:27:41.106 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stderr 2024-09-12T02:27:40.374+0000 7fe552200640 1 -- 172.21.15.39:0/154982435 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_command({"prefix": "mgr stat"} v 0) -- 0x7fe54c1a1170 con 0x7fe54c07de20 2024-09-12T02:27:41.106 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stderr 2024-09-12T02:27:40.375+0000 7fe549600640 1 -- 172.21.15.39:0/154982435 <== mon.0 v2:172.21.15.39:3300/0 7 ==== mon_command_ack([{"prefix": "mgr stat"}]=0 v9) ==== 56+0+88 (secure 0 0 0) 0x7fe54003ace0 con 0x7fe54c07de20 2024-09-12T02:27:41.106 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stderr 2024-09-12T02:27:40.377+0000 7fe552200640 1 -- 172.21.15.39:0/154982435 >> [v2:172.21.15.39:6800/3152613618,v1:172.21.15.39:6801/3152613618] conn(0x7fe534038fc0 msgr2=0x7fe53403b480 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-09-12T02:27:41.106 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stderr 2024-09-12T02:27:40.377+0000 7fe552200640 1 --2- 172.21.15.39:0/154982435 >> [v2:172.21.15.39:6800/3152613618,v1:172.21.15.39:6801/3152613618] conn(0x7fe534038fc0 0x7fe53403b480 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:27:41.106 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stderr 2024-09-12T02:27:40.377+0000 7fe552200640 1 -- 172.21.15.39:0/154982435 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fe54c07de20 msgr2=0x7fe54c19d6c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:27:41.106 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stderr 2024-09-12T02:27:40.377+0000 7fe552200640 1 --2- 172.21.15.39:0/154982435 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fe54c07de20 0x7fe54c19d6c0 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7fe5400097f0 tx=0x7fe5400327b0 comp rx=0 tx=0).stop 2024-09-12T02:27:41.106 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stderr 2024-09-12T02:27:40.377+0000 7fe552200640 1 -- 172.21.15.39:0/154982435 shutdown_connections 2024-09-12T02:27:41.106 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stderr 2024-09-12T02:27:40.377+0000 7fe552200640 1 --2- 172.21.15.39:0/154982435 >> [v2:172.21.15.39:6800/3152613618,v1:172.21.15.39:6801/3152613618] conn(0x7fe534038fc0 0x7fe53403b480 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:27:41.106 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stderr 2024-09-12T02:27:40.377+0000 7fe552200640 1 --2- 172.21.15.39:0/154982435 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fe54c07de20 0x7fe54c19d6c0 unknown :-1 s=CLOSED pgs=58 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:27:41.106 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stderr 2024-09-12T02:27:40.377+0000 7fe552200640 1 -- 172.21.15.39:0/154982435 >> 172.21.15.39:0/154982435 conn(0x7fe54c102d10 msgr2=0x7fe54c103850 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:27:41.106 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stderr 2024-09-12T02:27:40.377+0000 7fe552200640 1 -- 172.21.15.39:0/154982435 shutdown_connections 2024-09-12T02:27:41.106 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stderr 2024-09-12T02:27:40.377+0000 7fe552200640 1 -- 172.21.15.39:0/154982435 wait complete. 2024-09-12T02:27:41.106 INFO:teuthology.orchestra.run.smithi039.stdout:Waiting for the mgr to restart... 2024-09-12T02:27:41.106 INFO:teuthology.orchestra.run.smithi039.stdout:Waiting for mgr epoch 9... 2024-09-12T02:27:41.651 INFO:journalctl@ceph.mgr.x.smithi039.stdout:Sep 12 02:27:41 smithi039 ceph-4954ed46-70ae-11ef-bcea-c7b262605968-mgr-x[30736]: 2024-09-12T02:27:41.380+0000 7f3202e36040 -1 mgr[py] Module telemetry has missing NOTIFY_TYPES member 2024-09-12T02:27:41.651 INFO:journalctl@ceph.mgr.x.smithi039.stdout:Sep 12 02:27:41 smithi039 ceph-4954ed46-70ae-11ef-bcea-c7b262605968-mgr-x[30736]: 2024-09-12T02:27:41.466+0000 7f3202e36040 -1 mgr[py] Module balancer has missing NOTIFY_TYPES member 2024-09-12T02:27:42.569 INFO:journalctl@ceph.mgr.x.smithi039.stdout:Sep 12 02:27:42 smithi039 ceph-4954ed46-70ae-11ef-bcea-c7b262605968-mgr-x[30736]: 2024-09-12T02:27:42.426+0000 7f3202e36040 -1 mgr[py] Module rook has missing NOTIFY_TYPES member 2024-09-12T02:27:42.849 INFO:journalctl@ceph.mgr.x.smithi039.stdout:Sep 12 02:27:42 smithi039 ceph-4954ed46-70ae-11ef-bcea-c7b262605968-mgr-x[30736]: 2024-09-12T02:27:42.568+0000 7f3202e36040 -1 mgr[py] Module iostat has missing NOTIFY_TYPES member 2024-09-12T02:27:42.849 INFO:journalctl@ceph.mgr.x.smithi039.stdout:Sep 12 02:27:42 smithi039 ceph-4954ed46-70ae-11ef-bcea-c7b262605968-mgr-x[30736]: 2024-09-12T02:27:42.738+0000 7f3202e36040 -1 mgr[py] Module orchestrator has missing NOTIFY_TYPES member 2024-09-12T02:27:42.850 INFO:journalctl@ceph.mgr.x.smithi039.stdout:Sep 12 02:27:42 smithi039 ceph-4954ed46-70ae-11ef-bcea-c7b262605968-mgr-x[30736]: 2024-09-12T02:27:42.814+0000 7f3202e36040 -1 mgr[py] Module devicehealth has missing NOTIFY_TYPES member 2024-09-12T02:27:43.346 INFO:journalctl@ceph.mgr.x.smithi039.stdout:Sep 12 02:27:42 smithi039 ceph-4954ed46-70ae-11ef-bcea-c7b262605968-mgr-x[30736]: 2024-09-12T02:27:42.993+0000 7f3202e36040 -1 mgr[py] Module rgw has missing NOTIFY_TYPES member 2024-09-12T02:27:43.346 INFO:journalctl@ceph.mgr.x.smithi039.stdout:Sep 12 02:27:43 smithi039 ceph-4954ed46-70ae-11ef-bcea-c7b262605968-mgr-x[30736]: 2024-09-12T02:27:43.081+0000 7f3202e36040 -1 mgr[py] Module alerts has missing NOTIFY_TYPES member 2024-09-12T02:27:43.346 INFO:journalctl@ceph.mgr.x.smithi039.stdout:Sep 12 02:27:43 smithi039 ceph-4954ed46-70ae-11ef-bcea-c7b262605968-mgr-x[30736]: 2024-09-12T02:27:43.156+0000 7f3202e36040 -1 mgr[py] Module progress has missing NOTIFY_TYPES member 2024-09-12T02:27:43.346 INFO:journalctl@ceph.mgr.x.smithi039.stdout:Sep 12 02:27:43 smithi039 ceph-4954ed46-70ae-11ef-bcea-c7b262605968-mgr-x[30736]: 2024-09-12T02:27:43.344+0000 7f3202e36040 -1 mgr[py] Module nfs has missing NOTIFY_TYPES member 2024-09-12T02:27:43.599 INFO:journalctl@ceph.mgr.x.smithi039.stdout:Sep 12 02:27:43 smithi039 ceph-4954ed46-70ae-11ef-bcea-c7b262605968-mgr-x[30736]: 2024-09-12T02:27:43.425+0000 7f3202e36040 -1 mgr[py] Module status has missing NOTIFY_TYPES member 2024-09-12T02:27:43.599 INFO:journalctl@ceph.mgr.x.smithi039.stdout:Sep 12 02:27:43 smithi039 ceph-4954ed46-70ae-11ef-bcea-c7b262605968-mgr-x[30736]: 2024-09-12T02:27:43.507+0000 7f3202e36040 -1 mgr[py] Module pg_autoscaler has missing NOTIFY_TYPES member 2024-09-12T02:27:44.099 INFO:journalctl@ceph.mgr.x.smithi039.stdout:Sep 12 02:27:43 smithi039 ceph-4954ed46-70ae-11ef-bcea-c7b262605968-mgr-x[30736]: 2024-09-12T02:27:43.608+0000 7f3202e36040 -1 mgr[py] Module rbd_support has missing NOTIFY_TYPES member 2024-09-12T02:27:44.099 INFO:journalctl@ceph.mgr.x.smithi039.stdout:Sep 12 02:27:43 smithi039 ceph-4954ed46-70ae-11ef-bcea-c7b262605968-mgr-x[30736]: 2024-09-12T02:27:43.684+0000 7f3202e36040 -1 mgr[py] Module influx has missing NOTIFY_TYPES member 2024-09-12T02:27:44.100 INFO:journalctl@ceph.mgr.x.smithi039.stdout:Sep 12 02:27:43 smithi039 ceph-4954ed46-70ae-11ef-bcea-c7b262605968-mgr-x[30736]: 2024-09-12T02:27:43.760+0000 7f3202e36040 -1 mgr[py] Module zabbix has missing NOTIFY_TYPES member 2024-09-12T02:27:44.952 INFO:journalctl@ceph.mgr.x.smithi039.stdout:Sep 12 02:27:44 smithi039 ceph-4954ed46-70ae-11ef-bcea-c7b262605968-mgr-x[30736]: 2024-09-12T02:27:44.714+0000 7f3202e36040 -1 mgr[py] Module telegraf has missing NOTIFY_TYPES member 2024-09-12T02:27:44.952 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 02:27:44 smithi039 ceph-mon[30515]: Active manager daemon x restarted 2024-09-12T02:27:44.952 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 02:27:44 smithi039 ceph-mon[30515]: Activating manager daemon x 2024-09-12T02:27:44.952 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 02:27:44 smithi039 ceph-mon[30515]: osdmap e3: 0 total, 0 up, 0 in 2024-09-12T02:27:44.953 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 02:27:44 smithi039 ceph-mon[30515]: mgrmap e10: x(active, starting, since 0.00701268s) 2024-09-12T02:27:44.953 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 02:27:44 smithi039 ceph-mon[30515]: from='mgr.14150 172.21.15.39:0/408627207' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2024-09-12T02:27:44.953 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 02:27:44 smithi039 ceph-mon[30515]: from='mgr.14150 172.21.15.39:0/408627207' entity='mgr.x' cmd=[{"prefix": "mgr metadata", "who": "x", "id": "x"}]: dispatch 2024-09-12T02:27:44.953 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 02:27:44 smithi039 ceph-mon[30515]: from='mgr.14150 172.21.15.39:0/408627207' entity='mgr.x' cmd=[{"prefix": "mds metadata"}]: dispatch 2024-09-12T02:27:44.953 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 02:27:44 smithi039 ceph-mon[30515]: from='mgr.14150 172.21.15.39:0/408627207' entity='mgr.x' cmd=[{"prefix": "osd metadata"}]: dispatch 2024-09-12T02:27:44.953 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 02:27:44 smithi039 ceph-mon[30515]: from='mgr.14150 172.21.15.39:0/408627207' entity='mgr.x' cmd=[{"prefix": "mon metadata"}]: dispatch 2024-09-12T02:27:44.953 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 02:27:44 smithi039 ceph-mon[30515]: Manager daemon x is now available 2024-09-12T02:27:44.953 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 02:27:44 smithi039 ceph-mon[30515]: from='mgr.14150 172.21.15.39:0/408627207' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-12T02:27:46.099 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 02:27:45 smithi039 ceph-mon[30515]: from='mgr.14150 172.21.15.39:0/408627207' entity='mgr.x' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/x/mirror_snapshot_schedule"}]: dispatch 2024-09-12T02:27:46.100 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 02:27:45 smithi039 ceph-mon[30515]: from='mgr.14150 172.21.15.39:0/408627207' entity='mgr.x' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/x/trash_purge_schedule"}]: dispatch 2024-09-12T02:27:46.100 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 02:27:45 smithi039 ceph-mon[30515]: mgrmap e11: x(active, since 1.00902s) 2024-09-12T02:27:46.494 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stdout { 2024-09-12T02:27:46.500 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stdout "mgrmap_epoch": 11, 2024-09-12T02:27:46.501 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stdout "initialized": true 2024-09-12T02:27:46.501 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stdout } 2024-09-12T02:27:46.501 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stderr 2024-09-12T02:27:41.661+0000 7f9affa00640 1 Processor -- start 2024-09-12T02:27:46.501 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stderr 2024-09-12T02:27:41.661+0000 7f9affa00640 1 -- start start 2024-09-12T02:27:46.501 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stderr 2024-09-12T02:27:41.662+0000 7f9affa00640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f9af81098e0 0x7f9af8109ce0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:27:46.501 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stderr 2024-09-12T02:27:41.662+0000 7f9affa00640 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 -- 0x7f9af810a2b0 con 0x7f9af81098e0 2024-09-12T02:27:46.501 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stderr 2024-09-12T02:27:41.662+0000 7f9afd000640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f9af81098e0 0x7f9af8109ce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:27:46.501 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stderr 2024-09-12T02:27:41.662+0000 7f9afd000640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f9af81098e0 0x7f9af8109ce0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.39:3300/0 says I am v2:172.21.15.39:41738/0 (socket says 172.21.15.39:41738) 2024-09-12T02:27:46.501 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stderr 2024-09-12T02:27:41.662+0000 7f9afd000640 1 -- 172.21.15.39:0/2162704979 learned_addr learned my addr 172.21.15.39:0/2162704979 (peer_addr_for_me v2:172.21.15.39:0/0) 2024-09-12T02:27:46.501 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stderr 2024-09-12T02:27:41.662+0000 7f9afd000640 1 -- 172.21.15.39:0/2162704979 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9af810aa90 con 0x7f9af81098e0 2024-09-12T02:27:46.501 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stderr 2024-09-12T02:27:41.663+0000 7f9afd000640 1 --2- 172.21.15.39:0/2162704979 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f9af81098e0 0x7f9af8109ce0 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7f9aec009820 tx=0x7f9aec02a270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9dee394e8e326b61 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:27:46.501 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stderr 2024-09-12T02:27:41.664+0000 7f9af7400640 1 -- 172.21.15.39:0/2162704979 <== mon.0 v2:172.21.15.39:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f9aec037070 con 0x7f9af81098e0 2024-09-12T02:27:46.501 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stderr 2024-09-12T02:27:41.664+0000 7f9af7400640 1 -- 172.21.15.39:0/2162704979 <== mon.0 v2:172.21.15.39:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f9aec032920 con 0x7f9af81098e0 2024-09-12T02:27:46.502 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stderr 2024-09-12T02:27:41.664+0000 7f9af7400640 1 -- 172.21.15.39:0/2162704979 <== mon.0 v2:172.21.15.39:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f9aec030810 con 0x7f9af81098e0 2024-09-12T02:27:46.502 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stderr 2024-09-12T02:27:41.664+0000 7f9affa00640 1 -- 172.21.15.39:0/2162704979 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f9af81098e0 msgr2=0x7f9af8109ce0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:27:46.502 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stderr 2024-09-12T02:27:41.664+0000 7f9affa00640 1 --2- 172.21.15.39:0/2162704979 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f9af81098e0 0x7f9af8109ce0 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7f9aec009820 tx=0x7f9aec02a270 comp rx=0 tx=0).stop 2024-09-12T02:27:46.502 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stderr 2024-09-12T02:27:41.664+0000 7f9affa00640 1 -- 172.21.15.39:0/2162704979 shutdown_connections 2024-09-12T02:27:46.502 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stderr 2024-09-12T02:27:41.664+0000 7f9affa00640 1 --2- 172.21.15.39:0/2162704979 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f9af81098e0 0x7f9af8109ce0 unknown :-1 s=CLOSED pgs=59 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:27:46.502 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stderr 2024-09-12T02:27:41.664+0000 7f9affa00640 1 -- 172.21.15.39:0/2162704979 >> 172.21.15.39:0/2162704979 conn(0x7f9af807cec0 msgr2=0x7f9af807d2d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:27:46.502 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stderr 2024-09-12T02:27:41.665+0000 7f9affa00640 1 -- 172.21.15.39:0/2162704979 shutdown_connections 2024-09-12T02:27:46.502 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stderr 2024-09-12T02:27:41.665+0000 7f9affa00640 1 -- 172.21.15.39:0/2162704979 wait complete. 2024-09-12T02:27:46.502 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stderr 2024-09-12T02:27:41.665+0000 7f9affa00640 1 Processor -- start 2024-09-12T02:27:46.502 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stderr 2024-09-12T02:27:41.666+0000 7f9affa00640 1 -- start start 2024-09-12T02:27:46.502 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stderr 2024-09-12T02:27:41.666+0000 7f9affa00640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f9af81098e0 0x7f9af819d8b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:27:46.502 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stderr 2024-09-12T02:27:41.666+0000 7f9affa00640 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 -- 0x7f9af810de40 con 0x7f9af81098e0 2024-09-12T02:27:46.502 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stderr 2024-09-12T02:27:41.666+0000 7f9afd000640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f9af81098e0 0x7f9af819d8b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:27:46.503 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stderr 2024-09-12T02:27:41.666+0000 7f9afd000640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f9af81098e0 0x7f9af819d8b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.39:3300/0 says I am v2:172.21.15.39:41748/0 (socket says 172.21.15.39:41748) 2024-09-12T02:27:46.503 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stderr 2024-09-12T02:27:41.666+0000 7f9afd000640 1 -- 172.21.15.39:0/2584027576 learned_addr learned my addr 172.21.15.39:0/2584027576 (peer_addr_for_me v2:172.21.15.39:0/0) 2024-09-12T02:27:46.503 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stderr 2024-09-12T02:27:41.667+0000 7f9afd000640 1 -- 172.21.15.39:0/2584027576 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9af819ddf0 con 0x7f9af81098e0 2024-09-12T02:27:46.503 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stderr 2024-09-12T02:27:41.667+0000 7f9afd000640 1 --2- 172.21.15.39:0/2584027576 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f9af81098e0 0x7f9af819d8b0 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7f9aec0097f0 tx=0x7f9aec0327b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:27:46.503 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stderr 2024-09-12T02:27:41.667+0000 7f9af5600640 1 -- 172.21.15.39:0/2584027576 <== mon.0 v2:172.21.15.39:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f9aec037040 con 0x7f9af81098e0 2024-09-12T02:27:46.503 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stderr 2024-09-12T02:27:41.667+0000 7f9af5600640 1 -- 172.21.15.39:0/2584027576 <== mon.0 v2:172.21.15.39:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f9aec030cc0 con 0x7f9af81098e0 2024-09-12T02:27:46.503 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stderr 2024-09-12T02:27:41.667+0000 7f9af5600640 1 -- 172.21.15.39:0/2584027576 <== mon.0 v2:172.21.15.39:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f9aec03a640 con 0x7f9af81098e0 2024-09-12T02:27:46.503 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stderr 2024-09-12T02:27:41.667+0000 7f9affa00640 1 -- 172.21.15.39:0/2584027576 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f9af819e080 con 0x7f9af81098e0 2024-09-12T02:27:46.503 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stderr 2024-09-12T02:27:41.667+0000 7f9affa00640 1 -- 172.21.15.39:0/2584027576 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f9af81a0d70 con 0x7f9af81098e0 2024-09-12T02:27:46.503 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stderr 2024-09-12T02:27:41.668+0000 7f9af5600640 1 -- 172.21.15.39:0/2584027576 <== mon.0 v2:172.21.15.39:3300/0 4 ==== mgrmap(e 9) ==== 46300+0+0 (secure 0 0 0) 0x7f9aec03b3f0 con 0x7f9af81098e0 2024-09-12T02:27:46.503 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stderr 2024-09-12T02:27:41.669+0000 7f9af5600640 1 --2- 172.21.15.39:0/2584027576 >> [v2:172.21.15.39:6800/3152613618,v1:172.21.15.39:6801/3152613618] conn(0x7f9ae0038fc0 0x7f9ae003b480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:27:46.503 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stderr 2024-09-12T02:27:41.669+0000 7f9af5600640 1 -- 172.21.15.39:0/2584027576 --> [v2:172.21.15.39:6800/3152613618,v1:172.21.15.39:6801/3152613618] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x7f9ae003bb90 con 0x7f9ae0038fc0 2024-09-12T02:27:46.503 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stderr 2024-09-12T02:27:41.669+0000 7f9af5600640 1 -- 172.21.15.39:0/2584027576 <== mon.0 v2:172.21.15.39:3300/0 5 ==== osd_map(2..2 src has 1..2) ==== 940+0+0 (secure 0 0 0) 0x7f9aec06c610 con 0x7f9af81098e0 2024-09-12T02:27:46.504 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stderr 2024-09-12T02:27:41.669+0000 7f9af7e00640 1 -- 172.21.15.39:0/2584027576 >> [v2:172.21.15.39:6800/3152613618,v1:172.21.15.39:6801/3152613618] conn(0x7f9ae0038fc0 msgr2=0x7f9ae003b480 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.39:6800/3152613618 2024-09-12T02:27:46.504 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stderr 2024-09-12T02:27:41.669+0000 7f9af7e00640 1 --2- 172.21.15.39:0/2584027576 >> [v2:172.21.15.39:6800/3152613618,v1:172.21.15.39:6801/3152613618] conn(0x7f9ae0038fc0 0x7f9ae003b480 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-09-12T02:27:46.504 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stderr 2024-09-12T02:27:41.870+0000 7f9af7e00640 1 -- 172.21.15.39:0/2584027576 >> [v2:172.21.15.39:6800/3152613618,v1:172.21.15.39:6801/3152613618] conn(0x7f9ae0038fc0 msgr2=0x7f9ae003b480 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.39:6800/3152613618 2024-09-12T02:27:46.504 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stderr 2024-09-12T02:27:41.870+0000 7f9af7e00640 1 --2- 172.21.15.39:0/2584027576 >> [v2:172.21.15.39:6800/3152613618,v1:172.21.15.39:6801/3152613618] conn(0x7f9ae0038fc0 0x7f9ae003b480 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2024-09-12T02:27:46.504 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stderr 2024-09-12T02:27:42.271+0000 7f9af7e00640 1 -- 172.21.15.39:0/2584027576 >> [v2:172.21.15.39:6800/3152613618,v1:172.21.15.39:6801/3152613618] conn(0x7f9ae0038fc0 msgr2=0x7f9ae003b480 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.39:6800/3152613618 2024-09-12T02:27:46.504 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stderr 2024-09-12T02:27:42.271+0000 7f9af7e00640 1 --2- 172.21.15.39:0/2584027576 >> [v2:172.21.15.39:6800/3152613618,v1:172.21.15.39:6801/3152613618] conn(0x7f9ae0038fc0 0x7f9ae003b480 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2024-09-12T02:27:46.504 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stderr 2024-09-12T02:27:43.072+0000 7f9af7e00640 1 -- 172.21.15.39:0/2584027576 >> [v2:172.21.15.39:6800/3152613618,v1:172.21.15.39:6801/3152613618] conn(0x7f9ae0038fc0 msgr2=0x7f9ae003b480 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.39:6800/3152613618 2024-09-12T02:27:46.504 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stderr 2024-09-12T02:27:43.072+0000 7f9af7e00640 1 --2- 172.21.15.39:0/2584027576 >> [v2:172.21.15.39:6800/3152613618,v1:172.21.15.39:6801/3152613618] conn(0x7f9ae0038fc0 0x7f9ae003b480 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2024-09-12T02:27:46.504 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stderr 2024-09-12T02:27:44.673+0000 7f9af7e00640 1 -- 172.21.15.39:0/2584027576 >> [v2:172.21.15.39:6800/3152613618,v1:172.21.15.39:6801/3152613618] conn(0x7f9ae0038fc0 msgr2=0x7f9ae003b480 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.39:6800/3152613618 2024-09-12T02:27:46.504 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stderr 2024-09-12T02:27:44.674+0000 7f9af7e00640 1 --2- 172.21.15.39:0/2584027576 >> [v2:172.21.15.39:6800/3152613618,v1:172.21.15.39:6801/3152613618] conn(0x7f9ae0038fc0 0x7f9ae003b480 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 3.200000 2024-09-12T02:27:46.504 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stderr 2024-09-12T02:27:44.722+0000 7f9af5600640 1 -- 172.21.15.39:0/2584027576 <== mon.0 v2:172.21.15.39:3300/0 6 ==== mgrmap(e 10) ==== 46067+0+0 (secure 0 0 0) 0x7f9aec03a940 con 0x7f9af81098e0 2024-09-12T02:27:46.504 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stderr 2024-09-12T02:27:44.722+0000 7f9af5600640 1 -- 172.21.15.39:0/2584027576 >> [v2:172.21.15.39:6800/3152613618,v1:172.21.15.39:6801/3152613618] conn(0x7f9ae0038fc0 msgr2=0x7f9ae003b480 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-09-12T02:27:46.504 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stderr 2024-09-12T02:27:44.722+0000 7f9af5600640 1 --2- 172.21.15.39:0/2584027576 >> [v2:172.21.15.39:6800/3152613618,v1:172.21.15.39:6801/3152613618] conn(0x7f9ae0038fc0 0x7f9ae003b480 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:27:46.505 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stderr 2024-09-12T02:27:45.722+0000 7f9af5600640 1 -- 172.21.15.39:0/2584027576 <== mon.0 v2:172.21.15.39:3300/0 7 ==== mgrmap(e 11) ==== 46194+0+0 (secure 0 0 0) 0x7f9aec06e5c0 con 0x7f9af81098e0 2024-09-12T02:27:46.505 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stderr 2024-09-12T02:27:45.723+0000 7f9af5600640 1 --2- 172.21.15.39:0/2584027576 >> [v2:172.21.15.39:6800/1725006999,v1:172.21.15.39:6801/1725006999] conn(0x7f9ae003ca80 0x7f9ae003ee70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:27:46.505 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stderr 2024-09-12T02:27:45.723+0000 7f9af5600640 1 -- 172.21.15.39:0/2584027576 --> [v2:172.21.15.39:6800/1725006999,v1:172.21.15.39:6801/1725006999] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x7f9aec065670 con 0x7f9ae003ca80 2024-09-12T02:27:46.505 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stderr 2024-09-12T02:27:45.724+0000 7f9af7e00640 1 --2- 172.21.15.39:0/2584027576 >> [v2:172.21.15.39:6800/1725006999,v1:172.21.15.39:6801/1725006999] conn(0x7f9ae003ca80 0x7f9ae003ee70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:27:46.505 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stderr 2024-09-12T02:27:45.725+0000 7f9af7e00640 1 --2- 172.21.15.39:0/2584027576 >> [v2:172.21.15.39:6800/1725006999,v1:172.21.15.39:6801/1725006999] conn(0x7f9ae003ca80 0x7f9ae003ee70 secure :-1 s=READY pgs=4 cs=0 l=1 rev1=1 crypto rx=0x7f9ae4003980 tx=0x7f9ae4009290 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:27:46.505 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stderr 2024-09-12T02:27:45.726+0000 7f9af5600640 1 -- 172.21.15.39:0/2584027576 <== mgr.14150 v2:172.21.15.39:6800/1725006999 1 ==== command_reply(tid 0: 0 ) ==== 8+0+9564 (secure 0 0 0) 0x7f9aec065670 con 0x7f9ae003ca80 2024-09-12T02:27:46.505 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stderr 2024-09-12T02:27:45.734+0000 7f9affa00640 1 -- 172.21.15.39:0/2584027576 --> [v2:172.21.15.39:6800/1725006999,v1:172.21.15.39:6801/1725006999] -- command(tid 1: {"prefix": "mgr_status"}) -- 0x7f9af810dfc0 con 0x7f9ae003ca80 2024-09-12T02:27:46.505 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stderr 2024-09-12T02:27:45.734+0000 7f9af5600640 1 -- 172.21.15.39:0/2584027576 <== mgr.14150 v2:172.21.15.39:6800/1725006999 2 ==== command_reply(tid 1: 0 ) ==== 8+0+52 (secure 0 0 0) 0x7f9af810dfc0 con 0x7f9ae003ca80 2024-09-12T02:27:46.505 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stderr 2024-09-12T02:27:45.734+0000 7f9affa00640 1 -- 172.21.15.39:0/2584027576 >> [v2:172.21.15.39:6800/1725006999,v1:172.21.15.39:6801/1725006999] conn(0x7f9ae003ca80 msgr2=0x7f9ae003ee70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:27:46.505 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stderr 2024-09-12T02:27:45.734+0000 7f9affa00640 1 --2- 172.21.15.39:0/2584027576 >> [v2:172.21.15.39:6800/1725006999,v1:172.21.15.39:6801/1725006999] conn(0x7f9ae003ca80 0x7f9ae003ee70 secure :-1 s=READY pgs=4 cs=0 l=1 rev1=1 crypto rx=0x7f9ae4003980 tx=0x7f9ae4009290 comp rx=0 tx=0).stop 2024-09-12T02:27:46.505 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stderr 2024-09-12T02:27:45.734+0000 7f9affa00640 1 -- 172.21.15.39:0/2584027576 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f9af81098e0 msgr2=0x7f9af819d8b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:27:46.505 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stderr 2024-09-12T02:27:45.734+0000 7f9affa00640 1 --2- 172.21.15.39:0/2584027576 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f9af81098e0 0x7f9af819d8b0 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7f9aec0097f0 tx=0x7f9aec0327b0 comp rx=0 tx=0).stop 2024-09-12T02:27:46.505 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stderr 2024-09-12T02:27:45.735+0000 7f9affa00640 1 -- 172.21.15.39:0/2584027576 shutdown_connections 2024-09-12T02:27:46.505 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stderr 2024-09-12T02:27:45.735+0000 7f9affa00640 1 --2- 172.21.15.39:0/2584027576 >> [v2:172.21.15.39:6800/1725006999,v1:172.21.15.39:6801/1725006999] conn(0x7f9ae003ca80 0x7f9ae003ee70 unknown :-1 s=CLOSED pgs=4 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:27:46.506 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stderr 2024-09-12T02:27:45.735+0000 7f9affa00640 1 --2- 172.21.15.39:0/2584027576 >> [v2:172.21.15.39:6800/3152613618,v1:172.21.15.39:6801/3152613618] conn(0x7f9ae0038fc0 0x7f9ae003b480 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:27:46.506 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stderr 2024-09-12T02:27:45.735+0000 7f9affa00640 1 --2- 172.21.15.39:0/2584027576 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f9af81098e0 0x7f9af819d8b0 unknown :-1 s=CLOSED pgs=60 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:27:46.506 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stderr 2024-09-12T02:27:45.735+0000 7f9affa00640 1 -- 172.21.15.39:0/2584027576 >> 172.21.15.39:0/2584027576 conn(0x7f9af807cec0 msgr2=0x7f9af8106d00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:27:46.506 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stderr 2024-09-12T02:27:45.735+0000 7f9affa00640 1 -- 172.21.15.39:0/2584027576 shutdown_connections 2024-09-12T02:27:46.506 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stderr 2024-09-12T02:27:45.735+0000 7f9affa00640 1 -- 172.21.15.39:0/2584027576 wait complete. 2024-09-12T02:27:46.506 INFO:teuthology.orchestra.run.smithi039.stdout:mgr epoch 9 is available 2024-09-12T02:27:46.506 INFO:teuthology.orchestra.run.smithi039.stdout:Generating a dashboard self-signed certificate... 2024-09-12T02:27:47.100 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 02:27:46 smithi039 ceph-mon[30515]: from='client.14154 -' entity='client.admin' cmd=[{"prefix": "get_command_descriptions"}]: dispatch 2024-09-12T02:27:47.100 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 02:27:46 smithi039 ceph-mon[30515]: from='client.14154 -' entity='client.admin' cmd=[{"prefix": "mgr_status"}]: dispatch 2024-09-12T02:27:47.100 INFO:journalctl@ceph.mgr.x.smithi039.stdout:Sep 12 02:27:46 smithi039 ceph-4954ed46-70ae-11ef-bcea-c7b262605968-mgr-x[30736]: 2024-09-12T02:27:46.932+0000 7f3160200640 -1 log_channel(cephadm) log [ERR] : [12/Sep/2024:02:27:46] ENGINE Error in HTTPServer.serve 2024-09-12T02:27:47.100 INFO:journalctl@ceph.mgr.x.smithi039.stdout:Sep 12 02:27:46 smithi039 ceph-4954ed46-70ae-11ef-bcea-c7b262605968-mgr-x[30736]: Traceback (most recent call last): 2024-09-12T02:27:47.100 INFO:journalctl@ceph.mgr.x.smithi039.stdout:Sep 12 02:27:46 smithi039 ceph-4954ed46-70ae-11ef-bcea-c7b262605968-mgr-x[30736]: File "/lib/python3.9/site-packages/cheroot/server.py", line 1823, in serve 2024-09-12T02:27:47.100 INFO:journalctl@ceph.mgr.x.smithi039.stdout:Sep 12 02:27:46 smithi039 ceph-4954ed46-70ae-11ef-bcea-c7b262605968-mgr-x[30736]: self._connections.run(self.expiration_interval) 2024-09-12T02:27:47.100 INFO:journalctl@ceph.mgr.x.smithi039.stdout:Sep 12 02:27:46 smithi039 ceph-4954ed46-70ae-11ef-bcea-c7b262605968-mgr-x[30736]: File "/lib/python3.9/site-packages/cheroot/connections.py", line 203, in run 2024-09-12T02:27:47.101 INFO:journalctl@ceph.mgr.x.smithi039.stdout:Sep 12 02:27:46 smithi039 ceph-4954ed46-70ae-11ef-bcea-c7b262605968-mgr-x[30736]: self._run(expiration_interval) 2024-09-12T02:27:47.101 INFO:journalctl@ceph.mgr.x.smithi039.stdout:Sep 12 02:27:46 smithi039 ceph-4954ed46-70ae-11ef-bcea-c7b262605968-mgr-x[30736]: File "/lib/python3.9/site-packages/cheroot/connections.py", line 246, in _run 2024-09-12T02:27:47.101 INFO:journalctl@ceph.mgr.x.smithi039.stdout:Sep 12 02:27:46 smithi039 ceph-4954ed46-70ae-11ef-bcea-c7b262605968-mgr-x[30736]: new_conn = self._from_server_socket(self.server.socket) 2024-09-12T02:27:47.101 INFO:journalctl@ceph.mgr.x.smithi039.stdout:Sep 12 02:27:46 smithi039 ceph-4954ed46-70ae-11ef-bcea-c7b262605968-mgr-x[30736]: File "/lib/python3.9/site-packages/cheroot/connections.py", line 300, in _from_server_socket 2024-09-12T02:27:47.101 INFO:journalctl@ceph.mgr.x.smithi039.stdout:Sep 12 02:27:46 smithi039 ceph-4954ed46-70ae-11ef-bcea-c7b262605968-mgr-x[30736]: s, ssl_env = self.server.ssl_adapter.wrap(s) 2024-09-12T02:27:47.101 INFO:journalctl@ceph.mgr.x.smithi039.stdout:Sep 12 02:27:46 smithi039 ceph-4954ed46-70ae-11ef-bcea-c7b262605968-mgr-x[30736]: File "/lib/python3.9/site-packages/cheroot/ssl/builtin.py", line 277, in wrap 2024-09-12T02:27:47.101 INFO:journalctl@ceph.mgr.x.smithi039.stdout:Sep 12 02:27:46 smithi039 ceph-4954ed46-70ae-11ef-bcea-c7b262605968-mgr-x[30736]: s = self.context.wrap_socket( 2024-09-12T02:27:47.101 INFO:journalctl@ceph.mgr.x.smithi039.stdout:Sep 12 02:27:46 smithi039 ceph-4954ed46-70ae-11ef-bcea-c7b262605968-mgr-x[30736]: File "/lib64/python3.9/ssl.py", line 501, in wrap_socket 2024-09-12T02:27:47.101 INFO:journalctl@ceph.mgr.x.smithi039.stdout:Sep 12 02:27:46 smithi039 ceph-4954ed46-70ae-11ef-bcea-c7b262605968-mgr-x[30736]: return self.sslsocket_class._create( 2024-09-12T02:27:47.101 INFO:journalctl@ceph.mgr.x.smithi039.stdout:Sep 12 02:27:46 smithi039 ceph-4954ed46-70ae-11ef-bcea-c7b262605968-mgr-x[30736]: File "/lib64/python3.9/ssl.py", line 1074, in _create 2024-09-12T02:27:47.101 INFO:journalctl@ceph.mgr.x.smithi039.stdout:Sep 12 02:27:46 smithi039 ceph-4954ed46-70ae-11ef-bcea-c7b262605968-mgr-x[30736]: self.do_handshake() 2024-09-12T02:27:47.101 INFO:journalctl@ceph.mgr.x.smithi039.stdout:Sep 12 02:27:46 smithi039 ceph-4954ed46-70ae-11ef-bcea-c7b262605968-mgr-x[30736]: File "/lib64/python3.9/ssl.py", line 1343, in do_handshake 2024-09-12T02:27:47.101 INFO:journalctl@ceph.mgr.x.smithi039.stdout:Sep 12 02:27:46 smithi039 ceph-4954ed46-70ae-11ef-bcea-c7b262605968-mgr-x[30736]: self._sslobj.do_handshake() 2024-09-12T02:27:47.102 INFO:journalctl@ceph.mgr.x.smithi039.stdout:Sep 12 02:27:46 smithi039 ceph-4954ed46-70ae-11ef-bcea-c7b262605968-mgr-x[30736]: ssl.SSLZeroReturnError: TLS/SSL connection has been closed (EOF) (_ssl.c:1133) 2024-09-12T02:27:47.102 INFO:journalctl@ceph.mgr.x.smithi039.stdout:Sep 12 02:27:46 smithi039 ceph-4954ed46-70ae-11ef-bcea-c7b262605968-mgr-x[30736]: 2024-09-12T02:27:48.099 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 02:27:47 smithi039 ceph-mon[30515]: mgrmap e12: x(active, since 2s) 2024-09-12T02:27:48.100 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 02:27:47 smithi039 ceph-mon[30515]: [12/Sep/2024:02:27:46] ENGINE Bus STARTING 2024-09-12T02:27:48.100 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 02:27:47 smithi039 ceph-mon[30515]: [12/Sep/2024:02:27:46] ENGINE Serving on https://172.21.15.39:7150 2024-09-12T02:27:48.100 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 02:27:47 smithi039 ceph-mon[30515]: [12/Sep/2024:02:27:46] ENGINE Error in HTTPServer.serve 2024-09-12T02:27:48.100 INFO:journalctl@ceph.mon.a.smithi039.stdout: Traceback (most recent call last): 2024-09-12T02:27:48.100 INFO:journalctl@ceph.mon.a.smithi039.stdout: File "/lib/python3.9/site-packages/cheroot/server.py", line 1823, in serve 2024-09-12T02:27:48.100 INFO:journalctl@ceph.mon.a.smithi039.stdout: self._connections.run(self.expiration_interval) 2024-09-12T02:27:48.100 INFO:journalctl@ceph.mon.a.smithi039.stdout: File "/lib/python3.9/site-packages/cheroot/connections.py", line 203, in run 2024-09-12T02:27:48.100 INFO:journalctl@ceph.mon.a.smithi039.stdout: self._run(expiration_interval) 2024-09-12T02:27:48.100 INFO:journalctl@ceph.mon.a.smithi039.stdout: File "/lib/python3.9/site-packages/cheroot/connections.py", line 246, in _run 2024-09-12T02:27:48.100 INFO:journalctl@ceph.mon.a.smithi039.stdout: new_conn = self._from_server_socket(self.server.socket) 2024-09-12T02:27:48.100 INFO:journalctl@ceph.mon.a.smithi039.stdout: File "/lib/python3.9/site-packages/cheroot/connections.py", line 300, in _from_server_socket 2024-09-12T02:27:48.100 INFO:journalctl@ceph.mon.a.smithi039.stdout: s, ssl_env = self.server.ssl_adapter.wrap(s) 2024-09-12T02:27:48.101 INFO:journalctl@ceph.mon.a.smithi039.stdout: File "/lib/python3.9/site-packages/cheroot/ssl/builtin.py", line 277, in wrap 2024-09-12T02:27:48.101 INFO:journalctl@ceph.mon.a.smithi039.stdout: s = self.context.wrap_socket( 2024-09-12T02:27:48.101 INFO:journalctl@ceph.mon.a.smithi039.stdout: File "/lib64/python3.9/ssl.py", line 501, in wrap_socket 2024-09-12T02:27:48.101 INFO:journalctl@ceph.mon.a.smithi039.stdout: return self.sslsocket_class._create( 2024-09-12T02:27:48.101 INFO:journalctl@ceph.mon.a.smithi039.stdout: File "/lib64/python3.9/ssl.py", line 1074, in _create 2024-09-12T02:27:48.101 INFO:journalctl@ceph.mon.a.smithi039.stdout: self.do_handshake() 2024-09-12T02:27:48.101 INFO:journalctl@ceph.mon.a.smithi039.stdout: File "/lib64/python3.9/ssl.py", line 1343, in do_handshake 2024-09-12T02:27:48.101 INFO:journalctl@ceph.mon.a.smithi039.stdout: self._sslobj.do_handshake() 2024-09-12T02:27:48.101 INFO:journalctl@ceph.mon.a.smithi039.stdout: ssl.SSLZeroReturnError: TLS/SSL connection has been closed (EOF) (_ssl.c:1133) 2024-09-12T02:27:48.101 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 02:27:47 smithi039 ceph-mon[30515]: [12/Sep/2024:02:27:47] ENGINE Serving on http://172.21.15.39:8765 2024-09-12T02:27:48.101 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 02:27:47 smithi039 ceph-mon[30515]: [12/Sep/2024:02:27:47] ENGINE Bus STARTED 2024-09-12T02:27:48.101 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 02:27:47 smithi039 ceph-mon[30515]: from='mgr.14150 172.21.15.39:0/408627207' entity='mgr.x' 2024-09-12T02:27:48.102 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 02:27:47 smithi039 ceph-mon[30515]: from='client.14162 -' entity='client.admin' cmd=[{"prefix": "dashboard create-self-signed-cert", "target": ["mon-mgr", ""]}]: dispatch 2024-09-12T02:27:48.534 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stdout Self-signed certificate created 2024-09-12T02:27:48.534 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stderr 2024-09-12T02:27:47.463+0000 7f05a8000640 1 Processor -- start 2024-09-12T02:27:48.534 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stderr 2024-09-12T02:27:47.464+0000 7f05a8000640 1 -- start start 2024-09-12T02:27:48.535 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stderr 2024-09-12T02:27:47.464+0000 7f05a8000640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f05a01076b0 0x7f05a0107ab0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:27:48.535 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stderr 2024-09-12T02:27:47.464+0000 7f05a8000640 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 -- 0x7f05a0108080 con 0x7f05a01076b0 2024-09-12T02:27:48.535 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stderr 2024-09-12T02:27:47.464+0000 7f05a5600640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f05a01076b0 0x7f05a0107ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:27:48.535 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stderr 2024-09-12T02:27:47.464+0000 7f05a5600640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f05a01076b0 0x7f05a0107ab0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.39:3300/0 says I am v2:172.21.15.39:41828/0 (socket says 172.21.15.39:41828) 2024-09-12T02:27:48.535 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stderr 2024-09-12T02:27:47.464+0000 7f05a5600640 1 -- 172.21.15.39:0/3965702630 learned_addr learned my addr 172.21.15.39:0/3965702630 (peer_addr_for_me v2:172.21.15.39:0/0) 2024-09-12T02:27:48.535 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stderr 2024-09-12T02:27:47.465+0000 7f05a5600640 1 -- 172.21.15.39:0/3965702630 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f05a01088b0 con 0x7f05a01076b0 2024-09-12T02:27:48.535 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stderr 2024-09-12T02:27:47.466+0000 7f05a5600640 1 --2- 172.21.15.39:0/3965702630 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f05a01076b0 0x7f05a0107ab0 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7f0594009820 tx=0x7f059402a270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7dd61c00703a22f7 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:27:48.535 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stderr 2024-09-12T02:27:47.466+0000 7f059fe00640 1 -- 172.21.15.39:0/3965702630 <== mon.0 v2:172.21.15.39:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f0594037070 con 0x7f05a01076b0 2024-09-12T02:27:48.535 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stderr 2024-09-12T02:27:47.466+0000 7f059fe00640 1 -- 172.21.15.39:0/3965702630 <== mon.0 v2:172.21.15.39:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f0594032920 con 0x7f05a01076b0 2024-09-12T02:27:48.535 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stderr 2024-09-12T02:27:47.466+0000 7f059fe00640 1 -- 172.21.15.39:0/3965702630 <== mon.0 v2:172.21.15.39:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f0594030810 con 0x7f05a01076b0 2024-09-12T02:27:48.535 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stderr 2024-09-12T02:27:47.467+0000 7f05a8000640 1 -- 172.21.15.39:0/3965702630 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f05a01076b0 msgr2=0x7f05a0107ab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:27:48.536 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stderr 2024-09-12T02:27:47.467+0000 7f05a8000640 1 --2- 172.21.15.39:0/3965702630 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f05a01076b0 0x7f05a0107ab0 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7f0594009820 tx=0x7f059402a270 comp rx=0 tx=0).stop 2024-09-12T02:27:48.536 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stderr 2024-09-12T02:27:47.467+0000 7f05a8000640 1 -- 172.21.15.39:0/3965702630 shutdown_connections 2024-09-12T02:27:48.536 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stderr 2024-09-12T02:27:47.467+0000 7f05a8000640 1 --2- 172.21.15.39:0/3965702630 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f05a01076b0 0x7f05a0107ab0 unknown :-1 s=CLOSED pgs=68 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:27:48.536 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stderr 2024-09-12T02:27:47.467+0000 7f05a8000640 1 -- 172.21.15.39:0/3965702630 >> 172.21.15.39:0/3965702630 conn(0x7f05a0102e20 msgr2=0x7f05a0105280 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:27:48.536 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stderr 2024-09-12T02:27:47.467+0000 7f05a8000640 1 -- 172.21.15.39:0/3965702630 shutdown_connections 2024-09-12T02:27:48.536 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stderr 2024-09-12T02:27:47.467+0000 7f05a8000640 1 -- 172.21.15.39:0/3965702630 wait complete. 2024-09-12T02:27:48.536 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stderr 2024-09-12T02:27:47.468+0000 7f05a8000640 1 Processor -- start 2024-09-12T02:27:48.536 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stderr 2024-09-12T02:27:47.468+0000 7f05a8000640 1 -- start start 2024-09-12T02:27:48.536 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stderr 2024-09-12T02:27:47.469+0000 7f05a8000640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f05a01076b0 0x7f05a019b6a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:27:48.536 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stderr 2024-09-12T02:27:47.469+0000 7f05a8000640 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 -- 0x7f05a010bc60 con 0x7f05a01076b0 2024-09-12T02:27:48.536 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stderr 2024-09-12T02:27:47.469+0000 7f05a5600640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f05a01076b0 0x7f05a019b6a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:27:48.536 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stderr 2024-09-12T02:27:47.469+0000 7f05a5600640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f05a01076b0 0x7f05a019b6a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.39:3300/0 says I am v2:172.21.15.39:41832/0 (socket says 172.21.15.39:41832) 2024-09-12T02:27:48.536 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stderr 2024-09-12T02:27:47.469+0000 7f05a5600640 1 -- 172.21.15.39:0/3062307534 learned_addr learned my addr 172.21.15.39:0/3062307534 (peer_addr_for_me v2:172.21.15.39:0/0) 2024-09-12T02:27:48.537 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stderr 2024-09-12T02:27:47.469+0000 7f05a5600640 1 -- 172.21.15.39:0/3062307534 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f05a019bbe0 con 0x7f05a01076b0 2024-09-12T02:27:48.537 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stderr 2024-09-12T02:27:47.470+0000 7f05a5600640 1 --2- 172.21.15.39:0/3062307534 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f05a01076b0 0x7f05a019b6a0 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7f05940097f0 tx=0x7f05940327b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:27:48.537 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stderr 2024-09-12T02:27:47.470+0000 7f059e000640 1 -- 172.21.15.39:0/3062307534 <== mon.0 v2:172.21.15.39:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f0594037040 con 0x7f05a01076b0 2024-09-12T02:27:48.537 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stderr 2024-09-12T02:27:47.470+0000 7f059e000640 1 -- 172.21.15.39:0/3062307534 <== mon.0 v2:172.21.15.39:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f0594030cc0 con 0x7f05a01076b0 2024-09-12T02:27:48.537 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stderr 2024-09-12T02:27:47.470+0000 7f059e000640 1 -- 172.21.15.39:0/3062307534 <== mon.0 v2:172.21.15.39:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f059403a640 con 0x7f05a01076b0 2024-09-12T02:27:48.537 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stderr 2024-09-12T02:27:47.470+0000 7f05a8000640 1 -- 172.21.15.39:0/3062307534 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f05a019be70 con 0x7f05a01076b0 2024-09-12T02:27:48.537 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stderr 2024-09-12T02:27:47.470+0000 7f05a8000640 1 -- 172.21.15.39:0/3062307534 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f05a019eb60 con 0x7f05a01076b0 2024-09-12T02:27:48.537 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stderr 2024-09-12T02:27:47.471+0000 7f059e000640 1 -- 172.21.15.39:0/3062307534 <== mon.0 v2:172.21.15.39:3300/0 4 ==== mgrmap(e 12) ==== 46300+0+0 (secure 0 0 0) 0x7f059403a8f0 con 0x7f05a01076b0 2024-09-12T02:27:48.537 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stderr 2024-09-12T02:27:47.472+0000 7f05a8000640 1 -- 172.21.15.39:0/3062307534 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f05a010bde0 con 0x7f05a01076b0 2024-09-12T02:27:48.537 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stderr 2024-09-12T02:27:47.472+0000 7f059e000640 1 --2- 172.21.15.39:0/3062307534 >> [v2:172.21.15.39:6800/1725006999,v1:172.21.15.39:6801/1725006999] conn(0x7f0588039020 0x7f058803b4e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:27:48.537 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stderr 2024-09-12T02:27:47.472+0000 7f059e000640 1 -- 172.21.15.39:0/3062307534 <== mon.0 v2:172.21.15.39:3300/0 5 ==== osd_map(3..3 src has 1..3) ==== 1155+0+0 (secure 0 0 0) 0x7f059406c6c0 con 0x7f05a01076b0 2024-09-12T02:27:48.537 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stderr 2024-09-12T02:27:47.472+0000 7f05a4c00640 1 --2- 172.21.15.39:0/3062307534 >> [v2:172.21.15.39:6800/1725006999,v1:172.21.15.39:6801/1725006999] conn(0x7f0588039020 0x7f058803b4e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:27:48.537 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stderr 2024-09-12T02:27:47.473+0000 7f05a4c00640 1 --2- 172.21.15.39:0/3062307534 >> [v2:172.21.15.39:6800/1725006999,v1:172.21.15.39:6801/1725006999] conn(0x7f0588039020 0x7f058803b4e0 secure :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0x7f058c0098c0 tx=0x7f058c006db0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:27:48.538 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stderr 2024-09-12T02:27:47.477+0000 7f059e000640 1 -- 172.21.15.39:0/3062307534 <== mon.0 v2:172.21.15.39:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7f05940328c0 con 0x7f05a01076b0 2024-09-12T02:27:48.538 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stderr 2024-09-12T02:27:47.671+0000 7f05a8000640 1 -- 172.21.15.39:0/3062307534 --> [v2:172.21.15.39:6800/1725006999,v1:172.21.15.39:6801/1725006999] -- mgr_command(tid 0: {"prefix": "dashboard create-self-signed-cert", "target": ["mon-mgr", ""]}) -- 0x7f05a01040f0 con 0x7f0588039020 2024-09-12T02:27:48.538 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stderr 2024-09-12T02:27:47.794+0000 7f059e000640 1 -- 172.21.15.39:0/3062307534 <== mgr.14150 v2:172.21.15.39:6800/1725006999 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+32 (secure 0 0 0) 0x7f05a01040f0 con 0x7f0588039020 2024-09-12T02:27:48.538 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stderr 2024-09-12T02:27:47.797+0000 7f05a8000640 1 -- 172.21.15.39:0/3062307534 >> [v2:172.21.15.39:6800/1725006999,v1:172.21.15.39:6801/1725006999] conn(0x7f0588039020 msgr2=0x7f058803b4e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:27:48.538 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stderr 2024-09-12T02:27:47.797+0000 7f05a8000640 1 --2- 172.21.15.39:0/3062307534 >> [v2:172.21.15.39:6800/1725006999,v1:172.21.15.39:6801/1725006999] conn(0x7f0588039020 0x7f058803b4e0 secure :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0x7f058c0098c0 tx=0x7f058c006db0 comp rx=0 tx=0).stop 2024-09-12T02:27:48.538 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stderr 2024-09-12T02:27:47.797+0000 7f05a8000640 1 -- 172.21.15.39:0/3062307534 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f05a01076b0 msgr2=0x7f05a019b6a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:27:48.538 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stderr 2024-09-12T02:27:47.797+0000 7f05a8000640 1 --2- 172.21.15.39:0/3062307534 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f05a01076b0 0x7f05a019b6a0 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7f05940097f0 tx=0x7f05940327b0 comp rx=0 tx=0).stop 2024-09-12T02:27:48.538 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stderr 2024-09-12T02:27:47.797+0000 7f05a8000640 1 -- 172.21.15.39:0/3062307534 shutdown_connections 2024-09-12T02:27:48.538 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stderr 2024-09-12T02:27:47.797+0000 7f05a8000640 1 --2- 172.21.15.39:0/3062307534 >> [v2:172.21.15.39:6800/1725006999,v1:172.21.15.39:6801/1725006999] conn(0x7f0588039020 0x7f058803b4e0 unknown :-1 s=CLOSED pgs=7 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:27:48.538 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stderr 2024-09-12T02:27:47.797+0000 7f05a8000640 1 --2- 172.21.15.39:0/3062307534 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f05a01076b0 0x7f05a019b6a0 unknown :-1 s=CLOSED pgs=69 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:27:48.538 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stderr 2024-09-12T02:27:47.797+0000 7f05a8000640 1 -- 172.21.15.39:0/3062307534 >> 172.21.15.39:0/3062307534 conn(0x7f05a0102e20 msgr2=0x7f05a01039e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:27:48.538 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stderr 2024-09-12T02:27:47.797+0000 7f05a8000640 1 -- 172.21.15.39:0/3062307534 shutdown_connections 2024-09-12T02:27:48.538 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stderr 2024-09-12T02:27:47.797+0000 7f05a8000640 1 -- 172.21.15.39:0/3062307534 wait complete. 2024-09-12T02:27:48.539 INFO:teuthology.orchestra.run.smithi039.stdout:Creating initial admin user... 2024-09-12T02:27:49.051 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 02:27:48 smithi039 ceph-mon[30515]: from='mgr.14150 172.21.15.39:0/408627207' entity='mgr.x' 2024-09-12T02:27:49.051 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 02:27:48 smithi039 ceph-mon[30515]: from='mgr.14150 172.21.15.39:0/408627207' entity='mgr.x' 2024-09-12T02:27:50.099 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 02:27:49 smithi039 ceph-mon[30515]: from='mgr.14150 172.21.15.39:0/408627207' entity='mgr.x' 2024-09-12T02:27:50.099 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 02:27:49 smithi039 ceph-mon[30515]: from='client.14164 -' entity='client.admin' cmd=[{"prefix": "dashboard ac-user-create", "username": "admin", "rolename": "administrator", "force_password": true, "pwd_update_required": true, "target": ["mon-mgr", ""]}]: dispatch 2024-09-12T02:27:50.100 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 02:27:49 smithi039 ceph-mon[30515]: from='mgr.14150 172.21.15.39:0/408627207' entity='mgr.x' 2024-09-12T02:27:50.585 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stdout {"username": "admin", "password": "$2b$12$7J4x5vAsXamVVbQUXVPsjuwcTIKluHPYngb22m7pR.DB5gFKFgSuS", "roles": ["administrator"], "name": null, "email": null, "lastUpdate": 1726108069, "enabled": true, "pwdExpirationDate": null, "pwdUpdateRequired": true} 2024-09-12T02:27:50.585 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stderr 2024-09-12T02:27:49.074+0000 7f087a200640 1 Processor -- start 2024-09-12T02:27:50.586 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stderr 2024-09-12T02:27:49.074+0000 7f087a200640 1 -- start start 2024-09-12T02:27:50.586 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stderr 2024-09-12T02:27:49.074+0000 7f087a200640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f087407de40 0x7f087407c2a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:27:50.586 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stderr 2024-09-12T02:27:49.074+0000 7f087a200640 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 -- 0x7f087407c870 con 0x7f087407de40 2024-09-12T02:27:50.586 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stderr 2024-09-12T02:27:49.075+0000 7f0878e00640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f087407de40 0x7f087407c2a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:27:50.586 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stderr 2024-09-12T02:27:49.075+0000 7f0878e00640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f087407de40 0x7f087407c2a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.39:3300/0 says I am v2:172.21.15.39:45356/0 (socket says 172.21.15.39:45356) 2024-09-12T02:27:50.586 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stderr 2024-09-12T02:27:49.075+0000 7f0878e00640 1 -- 172.21.15.39:0/541725909 learned_addr learned my addr 172.21.15.39:0/541725909 (peer_addr_for_me v2:172.21.15.39:0/0) 2024-09-12T02:27:50.586 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stderr 2024-09-12T02:27:49.075+0000 7f0878e00640 1 -- 172.21.15.39:0/541725909 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f087407c9f0 con 0x7f087407de40 2024-09-12T02:27:50.586 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stderr 2024-09-12T02:27:49.076+0000 7f0878e00640 1 --2- 172.21.15.39:0/541725909 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f087407de40 0x7f087407c2a0 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7f0868009820 tx=0x7f086802a270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=48f6f3e27630b86a server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:27:50.586 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stderr 2024-09-12T02:27:49.076+0000 7f0873400640 1 -- 172.21.15.39:0/541725909 <== mon.0 v2:172.21.15.39:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f0868037070 con 0x7f087407de40 2024-09-12T02:27:50.586 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stderr 2024-09-12T02:27:49.077+0000 7f0873400640 1 -- 172.21.15.39:0/541725909 <== mon.0 v2:172.21.15.39:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f0868032920 con 0x7f087407de40 2024-09-12T02:27:50.586 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stderr 2024-09-12T02:27:49.077+0000 7f0873400640 1 -- 172.21.15.39:0/541725909 <== mon.0 v2:172.21.15.39:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f0868030810 con 0x7f087407de40 2024-09-12T02:27:50.586 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stderr 2024-09-12T02:27:49.077+0000 7f087a200640 1 -- 172.21.15.39:0/541725909 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f087407de40 msgr2=0x7f087407c2a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:27:50.586 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stderr 2024-09-12T02:27:49.077+0000 7f087a200640 1 --2- 172.21.15.39:0/541725909 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f087407de40 0x7f087407c2a0 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7f0868009820 tx=0x7f086802a270 comp rx=0 tx=0).stop 2024-09-12T02:27:50.586 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stderr 2024-09-12T02:27:49.077+0000 7f087a200640 1 -- 172.21.15.39:0/541725909 shutdown_connections 2024-09-12T02:27:50.587 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stderr 2024-09-12T02:27:49.077+0000 7f087a200640 1 --2- 172.21.15.39:0/541725909 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f087407de40 0x7f087407c2a0 unknown :-1 s=CLOSED pgs=70 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:27:50.587 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stderr 2024-09-12T02:27:49.077+0000 7f087a200640 1 -- 172.21.15.39:0/541725909 >> 172.21.15.39:0/541725909 conn(0x7f0874102d10 msgr2=0x7f0874105130 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:27:50.587 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stderr 2024-09-12T02:27:49.077+0000 7f087a200640 1 -- 172.21.15.39:0/541725909 shutdown_connections 2024-09-12T02:27:50.587 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stderr 2024-09-12T02:27:49.077+0000 7f087a200640 1 -- 172.21.15.39:0/541725909 wait complete. 2024-09-12T02:27:50.587 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stderr 2024-09-12T02:27:49.078+0000 7f087a200640 1 Processor -- start 2024-09-12T02:27:50.587 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stderr 2024-09-12T02:27:49.078+0000 7f087a200640 1 -- start start 2024-09-12T02:27:50.587 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stderr 2024-09-12T02:27:49.079+0000 7f087a200640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f087407de40 0x7f087419d700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:27:50.587 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stderr 2024-09-12T02:27:49.079+0000 7f087a200640 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 -- 0x7f087410db90 con 0x7f087407de40 2024-09-12T02:27:50.587 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stderr 2024-09-12T02:27:49.079+0000 7f0878e00640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f087407de40 0x7f087419d700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:27:50.587 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stderr 2024-09-12T02:27:49.079+0000 7f0878e00640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f087407de40 0x7f087419d700 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.39:3300/0 says I am v2:172.21.15.39:45364/0 (socket says 172.21.15.39:45364) 2024-09-12T02:27:50.587 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stderr 2024-09-12T02:27:49.079+0000 7f0878e00640 1 -- 172.21.15.39:0/1025875103 learned_addr learned my addr 172.21.15.39:0/1025875103 (peer_addr_for_me v2:172.21.15.39:0/0) 2024-09-12T02:27:50.587 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stderr 2024-09-12T02:27:49.079+0000 7f0878e00640 1 -- 172.21.15.39:0/1025875103 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f087419dc40 con 0x7f087407de40 2024-09-12T02:27:50.587 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stderr 2024-09-12T02:27:49.080+0000 7f0878e00640 1 --2- 172.21.15.39:0/1025875103 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f087407de40 0x7f087419d700 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7f0868030560 tx=0x7f0868032670 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:27:50.587 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stderr 2024-09-12T02:27:49.080+0000 7f0871600640 1 -- 172.21.15.39:0/1025875103 <== mon.0 v2:172.21.15.39:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f0868037040 con 0x7f087407de40 2024-09-12T02:27:50.588 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stderr 2024-09-12T02:27:49.080+0000 7f087a200640 1 -- 172.21.15.39:0/1025875103 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f087419ded0 con 0x7f087407de40 2024-09-12T02:27:50.588 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stderr 2024-09-12T02:27:49.080+0000 7f0871600640 1 -- 172.21.15.39:0/1025875103 <== mon.0 v2:172.21.15.39:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f0868040070 con 0x7f087407de40 2024-09-12T02:27:50.588 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stderr 2024-09-12T02:27:49.080+0000 7f0871600640 1 -- 172.21.15.39:0/1025875103 <== mon.0 v2:172.21.15.39:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f086803a740 con 0x7f087407de40 2024-09-12T02:27:50.588 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stderr 2024-09-12T02:27:49.080+0000 7f087a200640 1 -- 172.21.15.39:0/1025875103 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f08741a0bc0 con 0x7f087407de40 2024-09-12T02:27:50.588 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stderr 2024-09-12T02:27:49.081+0000 7f0871600640 1 -- 172.21.15.39:0/1025875103 <== mon.0 v2:172.21.15.39:3300/0 4 ==== mgrmap(e 12) ==== 46300+0+0 (secure 0 0 0) 0x7f086803a8e0 con 0x7f087407de40 2024-09-12T02:27:50.588 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stderr 2024-09-12T02:27:49.081+0000 7f087a200640 1 -- 172.21.15.39:0/1025875103 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f087407c320 con 0x7f087407de40 2024-09-12T02:27:50.588 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stderr 2024-09-12T02:27:49.082+0000 7f0871600640 1 --2- 172.21.15.39:0/1025875103 >> [v2:172.21.15.39:6800/1725006999,v1:172.21.15.39:6801/1725006999] conn(0x7f085c039020 0x7f085c03b4e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:27:50.588 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stderr 2024-09-12T02:27:49.082+0000 7f0871600640 1 -- 172.21.15.39:0/1025875103 <== mon.0 v2:172.21.15.39:3300/0 5 ==== osd_map(3..3 src has 1..3) ==== 1155+0+0 (secure 0 0 0) 0x7f086806c9d0 con 0x7f087407de40 2024-09-12T02:27:50.588 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stderr 2024-09-12T02:27:49.082+0000 7f0873e00640 1 --2- 172.21.15.39:0/1025875103 >> [v2:172.21.15.39:6800/1725006999,v1:172.21.15.39:6801/1725006999] conn(0x7f085c039020 0x7f085c03b4e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:27:50.588 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stderr 2024-09-12T02:27:49.083+0000 7f0873e00640 1 --2- 172.21.15.39:0/1025875103 >> [v2:172.21.15.39:6800/1725006999,v1:172.21.15.39:6801/1725006999] conn(0x7f085c039020 0x7f085c03b4e0 secure :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0x7f08600098c0 tx=0x7f0860006db0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:27:50.588 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stderr 2024-09-12T02:27:49.087+0000 7f0871600640 1 -- 172.21.15.39:0/1025875103 <== mon.0 v2:172.21.15.39:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7f0868044c70 con 0x7f087407de40 2024-09-12T02:27:50.588 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stderr 2024-09-12T02:27:49.292+0000 7f087a200640 1 -- 172.21.15.39:0/1025875103 --> [v2:172.21.15.39:6800/1725006999,v1:172.21.15.39:6801/1725006999] -- mgr_command(tid 0: {"prefix": "dashboard ac-user-create", "username": "admin", "rolename": "administrator", "force_password": true, "pwd_update_required": true, "target": ["mon-mgr", ""]}) -- 0x7f087419e3b0 con 0x7f085c039020 2024-09-12T02:27:50.588 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stderr 2024-09-12T02:27:49.542+0000 7f0871600640 1 -- 172.21.15.39:0/1025875103 <== mgr.14150 v2:172.21.15.39:6800/1725006999 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+252 (secure 0 0 0) 0x7f087419e3b0 con 0x7f085c039020 2024-09-12T02:27:50.589 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stderr 2024-09-12T02:27:49.544+0000 7f087a200640 1 -- 172.21.15.39:0/1025875103 >> [v2:172.21.15.39:6800/1725006999,v1:172.21.15.39:6801/1725006999] conn(0x7f085c039020 msgr2=0x7f085c03b4e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:27:50.589 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stderr 2024-09-12T02:27:49.544+0000 7f087a200640 1 --2- 172.21.15.39:0/1025875103 >> [v2:172.21.15.39:6800/1725006999,v1:172.21.15.39:6801/1725006999] conn(0x7f085c039020 0x7f085c03b4e0 secure :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0x7f08600098c0 tx=0x7f0860006db0 comp rx=0 tx=0).stop 2024-09-12T02:27:50.589 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stderr 2024-09-12T02:27:49.544+0000 7f087a200640 1 -- 172.21.15.39:0/1025875103 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f087407de40 msgr2=0x7f087419d700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:27:50.589 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stderr 2024-09-12T02:27:49.544+0000 7f087a200640 1 --2- 172.21.15.39:0/1025875103 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f087407de40 0x7f087419d700 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7f0868030560 tx=0x7f0868032670 comp rx=0 tx=0).stop 2024-09-12T02:27:50.589 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stderr 2024-09-12T02:27:49.544+0000 7f087a200640 1 -- 172.21.15.39:0/1025875103 shutdown_connections 2024-09-12T02:27:50.589 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stderr 2024-09-12T02:27:49.544+0000 7f087a200640 1 --2- 172.21.15.39:0/1025875103 >> [v2:172.21.15.39:6800/1725006999,v1:172.21.15.39:6801/1725006999] conn(0x7f085c039020 0x7f085c03b4e0 unknown :-1 s=CLOSED pgs=8 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:27:50.589 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stderr 2024-09-12T02:27:49.544+0000 7f087a200640 1 --2- 172.21.15.39:0/1025875103 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f087407de40 0x7f087419d700 unknown :-1 s=CLOSED pgs=71 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:27:50.589 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stderr 2024-09-12T02:27:49.545+0000 7f087a200640 1 -- 172.21.15.39:0/1025875103 >> 172.21.15.39:0/1025875103 conn(0x7f0874102d10 msgr2=0x7f08741038b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:27:50.590 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stderr 2024-09-12T02:27:49.545+0000 7f087a200640 1 -- 172.21.15.39:0/1025875103 shutdown_connections 2024-09-12T02:27:50.590 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stderr 2024-09-12T02:27:49.545+0000 7f087a200640 1 -- 172.21.15.39:0/1025875103 wait complete. 2024-09-12T02:27:50.590 INFO:teuthology.orchestra.run.smithi039.stdout:Fetching dashboard port number... 2024-09-12T02:27:52.100 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 02:27:51 smithi039 ceph-mon[30515]: mgrmap e13: x(active, since 6s) 2024-09-12T02:27:52.573 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stdout 8443 2024-09-12T02:27:52.573 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stderr 2024-09-12T02:27:51.709+0000 7f782e400640 1 Processor -- start 2024-09-12T02:27:52.573 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stderr 2024-09-12T02:27:51.709+0000 7f782e400640 1 -- start start 2024-09-12T02:27:52.573 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stderr 2024-09-12T02:27:51.709+0000 7f782e400640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f78281076a0 0x7f7828107aa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:27:52.573 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stderr 2024-09-12T02:27:51.709+0000 7f782e400640 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 -- 0x7f7828108070 con 0x7f78281076a0 2024-09-12T02:27:52.573 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stderr 2024-09-12T02:27:51.710+0000 7f7827400640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f78281076a0 0x7f7828107aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:27:52.573 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stderr 2024-09-12T02:27:51.710+0000 7f7827400640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f78281076a0 0x7f7828107aa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.39:3300/0 says I am v2:172.21.15.39:45376/0 (socket says 172.21.15.39:45376) 2024-09-12T02:27:52.573 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stderr 2024-09-12T02:27:51.710+0000 7f7827400640 1 -- 172.21.15.39:0/2638949874 learned_addr learned my addr 172.21.15.39:0/2638949874 (peer_addr_for_me v2:172.21.15.39:0/0) 2024-09-12T02:27:52.573 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stderr 2024-09-12T02:27:51.710+0000 7f7827400640 1 -- 172.21.15.39:0/2638949874 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7828108850 con 0x7f78281076a0 2024-09-12T02:27:52.573 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stderr 2024-09-12T02:27:51.711+0000 7f7827400640 1 --2- 172.21.15.39:0/2638949874 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f78281076a0 0x7f7828107aa0 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7f7818009820 tx=0x7f781802a270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1a2b2a94a744ea91 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:27:52.573 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stderr 2024-09-12T02:27:51.712+0000 7f7826000640 1 -- 172.21.15.39:0/2638949874 <== mon.0 v2:172.21.15.39:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f7818037070 con 0x7f78281076a0 2024-09-12T02:27:52.573 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stderr 2024-09-12T02:27:51.712+0000 7f7826000640 1 -- 172.21.15.39:0/2638949874 <== mon.0 v2:172.21.15.39:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f7818032920 con 0x7f78281076a0 2024-09-12T02:27:52.574 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stderr 2024-09-12T02:27:51.712+0000 7f7826000640 1 -- 172.21.15.39:0/2638949874 <== mon.0 v2:172.21.15.39:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f7818030810 con 0x7f78281076a0 2024-09-12T02:27:52.574 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stderr 2024-09-12T02:27:51.712+0000 7f782e400640 1 -- 172.21.15.39:0/2638949874 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f78281076a0 msgr2=0x7f7828107aa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:27:52.574 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stderr 2024-09-12T02:27:51.712+0000 7f782e400640 1 --2- 172.21.15.39:0/2638949874 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f78281076a0 0x7f7828107aa0 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7f7818009820 tx=0x7f781802a270 comp rx=0 tx=0).stop 2024-09-12T02:27:52.574 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stderr 2024-09-12T02:27:51.712+0000 7f782e400640 1 -- 172.21.15.39:0/2638949874 shutdown_connections 2024-09-12T02:27:52.574 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stderr 2024-09-12T02:27:51.712+0000 7f782e400640 1 --2- 172.21.15.39:0/2638949874 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f78281076a0 0x7f7828107aa0 unknown :-1 s=CLOSED pgs=72 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:27:52.574 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stderr 2024-09-12T02:27:51.712+0000 7f782e400640 1 -- 172.21.15.39:0/2638949874 >> 172.21.15.39:0/2638949874 conn(0x7f7828102e30 msgr2=0x7f7828105270 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:27:52.574 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stderr 2024-09-12T02:27:51.713+0000 7f782e400640 1 -- 172.21.15.39:0/2638949874 shutdown_connections 2024-09-12T02:27:52.574 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stderr 2024-09-12T02:27:51.713+0000 7f782e400640 1 -- 172.21.15.39:0/2638949874 wait complete. 2024-09-12T02:27:52.574 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stderr 2024-09-12T02:27:51.713+0000 7f782e400640 1 Processor -- start 2024-09-12T02:27:52.574 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stderr 2024-09-12T02:27:51.714+0000 7f782e400640 1 -- start start 2024-09-12T02:27:52.574 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stderr 2024-09-12T02:27:51.714+0000 7f782e400640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f78281076a0 0x7f782819b6a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:27:52.574 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stderr 2024-09-12T02:27:51.714+0000 7f782e400640 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 -- 0x7f782810bc00 con 0x7f78281076a0 2024-09-12T02:27:52.574 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stderr 2024-09-12T02:27:51.714+0000 7f7827400640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f78281076a0 0x7f782819b6a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:27:52.574 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stderr 2024-09-12T02:27:51.714+0000 7f7827400640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f78281076a0 0x7f782819b6a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.39:3300/0 says I am v2:172.21.15.39:45378/0 (socket says 172.21.15.39:45378) 2024-09-12T02:27:52.575 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stderr 2024-09-12T02:27:51.714+0000 7f7827400640 1 -- 172.21.15.39:0/1001226683 learned_addr learned my addr 172.21.15.39:0/1001226683 (peer_addr_for_me v2:172.21.15.39:0/0) 2024-09-12T02:27:52.575 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stderr 2024-09-12T02:27:51.714+0000 7f7827400640 1 -- 172.21.15.39:0/1001226683 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f782819bbe0 con 0x7f78281076a0 2024-09-12T02:27:52.575 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stderr 2024-09-12T02:27:51.715+0000 7f7827400640 1 --2- 172.21.15.39:0/1001226683 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f78281076a0 0x7f782819b6a0 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7f78180097f0 tx=0x7f78180327b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:27:52.575 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stderr 2024-09-12T02:27:51.715+0000 7f781fe00640 1 -- 172.21.15.39:0/1001226683 <== mon.0 v2:172.21.15.39:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f7818037040 con 0x7f78281076a0 2024-09-12T02:27:52.575 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stderr 2024-09-12T02:27:51.715+0000 7f781fe00640 1 -- 172.21.15.39:0/1001226683 <== mon.0 v2:172.21.15.39:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f7818030cc0 con 0x7f78281076a0 2024-09-12T02:27:52.575 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stderr 2024-09-12T02:27:51.715+0000 7f781fe00640 1 -- 172.21.15.39:0/1001226683 <== mon.0 v2:172.21.15.39:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f781803a640 con 0x7f78281076a0 2024-09-12T02:27:52.575 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stderr 2024-09-12T02:27:51.715+0000 7f782e400640 1 -- 172.21.15.39:0/1001226683 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f782819be70 con 0x7f78281076a0 2024-09-12T02:27:52.575 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stderr 2024-09-12T02:27:51.715+0000 7f782e400640 1 -- 172.21.15.39:0/1001226683 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f782819eb60 con 0x7f78281076a0 2024-09-12T02:27:52.575 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stderr 2024-09-12T02:27:51.716+0000 7f782e400640 1 -- 172.21.15.39:0/1001226683 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f782810bd80 con 0x7f78281076a0 2024-09-12T02:27:52.575 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stderr 2024-09-12T02:27:51.716+0000 7f781fe00640 1 -- 172.21.15.39:0/1001226683 <== mon.0 v2:172.21.15.39:3300/0 4 ==== mgrmap(e 13) ==== 46343+0+0 (secure 0 0 0) 0x7f781803b3f0 con 0x7f78281076a0 2024-09-12T02:27:52.575 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stderr 2024-09-12T02:27:51.717+0000 7f781fe00640 1 --2- 172.21.15.39:0/1001226683 >> [v2:172.21.15.39:6800/1725006999,v1:172.21.15.39:6801/1725006999] conn(0x7f780c0390c0 0x7f780c03b580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:27:52.575 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stderr 2024-09-12T02:27:51.717+0000 7f781fe00640 1 -- 172.21.15.39:0/1001226683 <== mon.0 v2:172.21.15.39:3300/0 5 ==== osd_map(3..3 src has 1..3) ==== 1155+0+0 (secure 0 0 0) 0x7f781806c790 con 0x7f78281076a0 2024-09-12T02:27:52.576 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stderr 2024-09-12T02:27:51.717+0000 7f7826a00640 1 --2- 172.21.15.39:0/1001226683 >> [v2:172.21.15.39:6800/1725006999,v1:172.21.15.39:6801/1725006999] conn(0x7f780c0390c0 0x7f780c03b580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:27:52.576 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stderr 2024-09-12T02:27:51.718+0000 7f7826a00640 1 --2- 172.21.15.39:0/1001226683 >> [v2:172.21.15.39:6800/1725006999,v1:172.21.15.39:6801/1725006999] conn(0x7f780c0390c0 0x7f780c03b580 secure :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0x7f78140098c0 tx=0x7f7814006db0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:27:52.576 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stderr 2024-09-12T02:27:51.722+0000 7f781fe00640 1 -- 172.21.15.39:0/1001226683 <== mon.0 v2:172.21.15.39:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7f78180313a0 con 0x7f78281076a0 2024-09-12T02:27:52.576 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stderr 2024-09-12T02:27:51.908+0000 7f782e400640 1 -- 172.21.15.39:0/1001226683 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_command({"prefix": "config get", "who": "mgr", "key": "mgr/dashboard/ssl_server_port"} v 0) -- 0x7f782819ed30 con 0x7f78281076a0 2024-09-12T02:27:52.576 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stderr 2024-09-12T02:27:51.908+0000 7f781fe00640 1 -- 172.21.15.39:0/1001226683 <== mon.0 v2:172.21.15.39:3300/0 7 ==== mon_command_ack([{"prefix": "config get", "who": "mgr", "key": "mgr/dashboard/ssl_server_port"}]=0 v8) ==== 112+0+5 (secure 0 0 0) 0x7f7818038250 con 0x7f78281076a0 2024-09-12T02:27:52.576 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stderr 2024-09-12T02:27:51.910+0000 7f782e400640 1 -- 172.21.15.39:0/1001226683 >> [v2:172.21.15.39:6800/1725006999,v1:172.21.15.39:6801/1725006999] conn(0x7f780c0390c0 msgr2=0x7f780c03b580 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:27:52.576 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stderr 2024-09-12T02:27:51.910+0000 7f782e400640 1 --2- 172.21.15.39:0/1001226683 >> [v2:172.21.15.39:6800/1725006999,v1:172.21.15.39:6801/1725006999] conn(0x7f780c0390c0 0x7f780c03b580 secure :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0x7f78140098c0 tx=0x7f7814006db0 comp rx=0 tx=0).stop 2024-09-12T02:27:52.576 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stderr 2024-09-12T02:27:51.910+0000 7f782e400640 1 -- 172.21.15.39:0/1001226683 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f78281076a0 msgr2=0x7f782819b6a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:27:52.576 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stderr 2024-09-12T02:27:51.910+0000 7f782e400640 1 --2- 172.21.15.39:0/1001226683 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f78281076a0 0x7f782819b6a0 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7f78180097f0 tx=0x7f78180327b0 comp rx=0 tx=0).stop 2024-09-12T02:27:52.576 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stderr 2024-09-12T02:27:51.910+0000 7f782e400640 1 -- 172.21.15.39:0/1001226683 shutdown_connections 2024-09-12T02:27:52.576 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stderr 2024-09-12T02:27:51.910+0000 7f782e400640 1 --2- 172.21.15.39:0/1001226683 >> [v2:172.21.15.39:6800/1725006999,v1:172.21.15.39:6801/1725006999] conn(0x7f780c0390c0 0x7f780c03b580 unknown :-1 s=CLOSED pgs=9 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:27:52.576 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stderr 2024-09-12T02:27:51.910+0000 7f782e400640 1 --2- 172.21.15.39:0/1001226683 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f78281076a0 0x7f782819b6a0 unknown :-1 s=CLOSED pgs=73 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:27:52.576 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stderr 2024-09-12T02:27:51.911+0000 7f782e400640 1 -- 172.21.15.39:0/1001226683 >> 172.21.15.39:0/1001226683 conn(0x7f7828102e30 msgr2=0x7f7828103a20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:27:52.576 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stderr 2024-09-12T02:27:51.911+0000 7f782e400640 1 -- 172.21.15.39:0/1001226683 shutdown_connections 2024-09-12T02:27:52.577 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stderr 2024-09-12T02:27:51.911+0000 7f782e400640 1 -- 172.21.15.39:0/1001226683 wait complete. 2024-09-12T02:27:52.588 INFO:teuthology.orchestra.run.smithi039.stdout:Non-zero exit code 1 from systemctl is-enabled firewalld.service 2024-09-12T02:27:52.588 INFO:teuthology.orchestra.run.smithi039.stdout:systemctl: stdout disabled 2024-09-12T02:27:52.602 INFO:teuthology.orchestra.run.smithi039.stdout:Non-zero exit code 3 from systemctl is-active firewalld.service 2024-09-12T02:27:52.602 INFO:teuthology.orchestra.run.smithi039.stdout:systemctl: stdout inactive 2024-09-12T02:27:52.602 INFO:teuthology.orchestra.run.smithi039.stdout:firewalld.service is not enabled 2024-09-12T02:27:52.602 INFO:teuthology.orchestra.run.smithi039.stdout:Not possible to open ports <[8443]>. firewalld.service is not available 2024-09-12T02:27:52.605 INFO:teuthology.orchestra.run.smithi039.stdout:Ceph Dashboard is now available at: 2024-09-12T02:27:52.605 INFO:teuthology.orchestra.run.smithi039.stdout: 2024-09-12T02:27:52.605 INFO:teuthology.orchestra.run.smithi039.stdout: URL: https://smithi039.front.sepia.ceph.com:8443/ 2024-09-12T02:27:52.605 INFO:teuthology.orchestra.run.smithi039.stdout: User: admin 2024-09-12T02:27:52.605 INFO:teuthology.orchestra.run.smithi039.stdout: Password: 1bnfz6h221 2024-09-12T02:27:52.605 INFO:teuthology.orchestra.run.smithi039.stdout: 2024-09-12T02:27:52.605 INFO:teuthology.orchestra.run.smithi039.stdout:Saving cluster configuration to /var/lib/ceph/4954ed46-70ae-11ef-bcea-c7b262605968/config directory 2024-09-12T02:27:53.099 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 02:27:52 smithi039 ceph-mon[30515]: from='client.? 172.21.15.39:0/1001226683' entity='client.admin' cmd=[{"prefix": "config get", "who": "mgr", "key": "mgr/dashboard/ssl_server_port"}]: dispatch 2024-09-12T02:27:54.067 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stderr 2024-09-12T02:27:53.155+0000 7f6cb3000640 1 Processor -- start 2024-09-12T02:27:54.067 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stderr 2024-09-12T02:27:53.156+0000 7f6cb3000640 1 -- start start 2024-09-12T02:27:54.068 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stderr 2024-09-12T02:27:53.156+0000 7f6cb3000640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f6cac109880 0x7f6cac109c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:27:54.068 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stderr 2024-09-12T02:27:53.156+0000 7f6cb3000640 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 -- 0x7f6cac10a250 con 0x7f6cac109880 2024-09-12T02:27:54.068 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stderr 2024-09-12T02:27:53.157+0000 7f6cabe00640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f6cac109880 0x7f6cac109c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:27:54.068 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stderr 2024-09-12T02:27:53.157+0000 7f6cabe00640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f6cac109880 0x7f6cac109c80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.39:3300/0 says I am v2:172.21.15.39:45380/0 (socket says 172.21.15.39:45380) 2024-09-12T02:27:54.068 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stderr 2024-09-12T02:27:53.157+0000 7f6cabe00640 1 -- 172.21.15.39:0/1551570350 learned_addr learned my addr 172.21.15.39:0/1551570350 (peer_addr_for_me v2:172.21.15.39:0/0) 2024-09-12T02:27:54.068 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stderr 2024-09-12T02:27:53.157+0000 7f6cabe00640 1 -- 172.21.15.39:0/1551570350 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6cac10aa80 con 0x7f6cac109880 2024-09-12T02:27:54.068 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stderr 2024-09-12T02:27:53.158+0000 7f6cabe00640 1 --2- 172.21.15.39:0/1551570350 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f6cac109880 0x7f6cac109c80 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7f6c9c009820 tx=0x7f6c9c02a270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=aff6e47634492dcb server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:27:54.068 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stderr 2024-09-12T02:27:53.158+0000 7f6cab400640 1 -- 172.21.15.39:0/1551570350 <== mon.0 v2:172.21.15.39:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f6c9c037070 con 0x7f6cac109880 2024-09-12T02:27:54.068 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stderr 2024-09-12T02:27:53.158+0000 7f6cab400640 1 -- 172.21.15.39:0/1551570350 <== mon.0 v2:172.21.15.39:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f6c9c032920 con 0x7f6cac109880 2024-09-12T02:27:54.068 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stderr 2024-09-12T02:27:53.158+0000 7f6cab400640 1 -- 172.21.15.39:0/1551570350 <== mon.0 v2:172.21.15.39:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f6c9c030810 con 0x7f6cac109880 2024-09-12T02:27:54.068 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stderr 2024-09-12T02:27:53.159+0000 7f6cb3000640 1 -- 172.21.15.39:0/1551570350 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f6cac109880 msgr2=0x7f6cac109c80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:27:54.069 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stderr 2024-09-12T02:27:53.159+0000 7f6cb3000640 1 --2- 172.21.15.39:0/1551570350 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f6cac109880 0x7f6cac109c80 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7f6c9c009820 tx=0x7f6c9c02a270 comp rx=0 tx=0).stop 2024-09-12T02:27:54.069 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stderr 2024-09-12T02:27:53.159+0000 7f6cb3000640 1 -- 172.21.15.39:0/1551570350 shutdown_connections 2024-09-12T02:27:54.069 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stderr 2024-09-12T02:27:53.159+0000 7f6cb3000640 1 --2- 172.21.15.39:0/1551570350 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f6cac109880 0x7f6cac109c80 unknown :-1 s=CLOSED pgs=74 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:27:54.069 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stderr 2024-09-12T02:27:53.159+0000 7f6cb3000640 1 -- 172.21.15.39:0/1551570350 >> 172.21.15.39:0/1551570350 conn(0x7f6cac07ce60 msgr2=0x7f6cac07d270 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:27:54.069 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stderr 2024-09-12T02:27:53.159+0000 7f6cb3000640 1 -- 172.21.15.39:0/1551570350 shutdown_connections 2024-09-12T02:27:54.069 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stderr 2024-09-12T02:27:53.159+0000 7f6cb3000640 1 -- 172.21.15.39:0/1551570350 wait complete. 2024-09-12T02:27:54.069 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stderr 2024-09-12T02:27:53.160+0000 7f6cb3000640 1 Processor -- start 2024-09-12T02:27:54.069 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stderr 2024-09-12T02:27:53.160+0000 7f6cb3000640 1 -- start start 2024-09-12T02:27:54.069 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stderr 2024-09-12T02:27:53.160+0000 7f6cb3000640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f6cac109880 0x7f6cac19d8d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:27:54.069 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stderr 2024-09-12T02:27:53.160+0000 7f6cb3000640 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 -- 0x7f6cac10de30 con 0x7f6cac109880 2024-09-12T02:27:54.069 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stderr 2024-09-12T02:27:53.161+0000 7f6cabe00640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f6cac109880 0x7f6cac19d8d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:27:54.069 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stderr 2024-09-12T02:27:53.161+0000 7f6cabe00640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f6cac109880 0x7f6cac19d8d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.39:3300/0 says I am v2:172.21.15.39:45396/0 (socket says 172.21.15.39:45396) 2024-09-12T02:27:54.069 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stderr 2024-09-12T02:27:53.161+0000 7f6cabe00640 1 -- 172.21.15.39:0/342937854 learned_addr learned my addr 172.21.15.39:0/342937854 (peer_addr_for_me v2:172.21.15.39:0/0) 2024-09-12T02:27:54.070 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stderr 2024-09-12T02:27:53.161+0000 7f6cabe00640 1 -- 172.21.15.39:0/342937854 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6cac19de10 con 0x7f6cac109880 2024-09-12T02:27:54.070 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stderr 2024-09-12T02:27:53.161+0000 7f6cabe00640 1 --2- 172.21.15.39:0/342937854 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f6cac109880 0x7f6cac19d8d0 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7f6c9c030560 tx=0x7f6c9c032670 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:27:54.070 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stderr 2024-09-12T02:27:53.162+0000 7f6ca9600640 1 -- 172.21.15.39:0/342937854 <== mon.0 v2:172.21.15.39:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f6c9c037040 con 0x7f6cac109880 2024-09-12T02:27:54.070 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stderr 2024-09-12T02:27:53.162+0000 7f6ca9600640 1 -- 172.21.15.39:0/342937854 <== mon.0 v2:172.21.15.39:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f6c9c040070 con 0x7f6cac109880 2024-09-12T02:27:54.070 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stderr 2024-09-12T02:27:53.162+0000 7f6cb3000640 1 -- 172.21.15.39:0/342937854 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f6cac19e0a0 con 0x7f6cac109880 2024-09-12T02:27:54.070 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stderr 2024-09-12T02:27:53.162+0000 7f6ca9600640 1 -- 172.21.15.39:0/342937854 <== mon.0 v2:172.21.15.39:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f6c9c03a740 con 0x7f6cac109880 2024-09-12T02:27:54.070 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stderr 2024-09-12T02:27:53.162+0000 7f6cb3000640 1 -- 172.21.15.39:0/342937854 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f6cac1a0d90 con 0x7f6cac109880 2024-09-12T02:27:54.070 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stderr 2024-09-12T02:27:53.163+0000 7f6cb3000640 1 -- 172.21.15.39:0/342937854 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f6cac10dfb0 con 0x7f6cac109880 2024-09-12T02:27:54.070 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stderr 2024-09-12T02:27:53.163+0000 7f6ca9600640 1 -- 172.21.15.39:0/342937854 <== mon.0 v2:172.21.15.39:3300/0 4 ==== mgrmap(e 13) ==== 46343+0+0 (secure 0 0 0) 0x7f6c9c03b420 con 0x7f6cac109880 2024-09-12T02:27:54.070 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stderr 2024-09-12T02:27:53.163+0000 7f6ca9600640 1 --2- 172.21.15.39:0/342937854 >> [v2:172.21.15.39:6800/1725006999,v1:172.21.15.39:6801/1725006999] conn(0x7f6c900390c0 0x7f6c9003b580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:27:54.070 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stderr 2024-09-12T02:27:53.164+0000 7f6ca9600640 1 -- 172.21.15.39:0/342937854 <== mon.0 v2:172.21.15.39:3300/0 5 ==== osd_map(3..3 src has 1..3) ==== 1155+0+0 (secure 0 0 0) 0x7f6c9c06c7d0 con 0x7f6cac109880 2024-09-12T02:27:54.071 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stderr 2024-09-12T02:27:53.164+0000 7f6ca3e00640 1 --2- 172.21.15.39:0/342937854 >> [v2:172.21.15.39:6800/1725006999,v1:172.21.15.39:6801/1725006999] conn(0x7f6c900390c0 0x7f6c9003b580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:27:54.071 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stderr 2024-09-12T02:27:53.165+0000 7f6ca3e00640 1 --2- 172.21.15.39:0/342937854 >> [v2:172.21.15.39:6800/1725006999,v1:172.21.15.39:6801/1725006999] conn(0x7f6c900390c0 0x7f6c9003b580 secure :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0x7f6c940098c0 tx=0x7f6c94006db0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:27:54.071 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stderr 2024-09-12T02:27:53.169+0000 7f6ca9600640 1 -- 172.21.15.39:0/342937854 <== mon.0 v2:172.21.15.39:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7f6c9c042b50 con 0x7f6cac109880 2024-09-12T02:27:54.071 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stderr 2024-09-12T02:27:53.444+0000 7f6cb3000640 1 -- 172.21.15.39:0/342937854 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_command([{prefix=config-key set, key=mgr/dashboard/cluster/status}] v 0) -- 0x7f6cac1a0f60 con 0x7f6cac109880 2024-09-12T02:27:54.071 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stderr 2024-09-12T02:27:53.451+0000 7f6ca9600640 1 -- 172.21.15.39:0/342937854 <== mon.0 v2:172.21.15.39:3300/0 7 ==== mon_command_ack([{prefix=config-key set, key=mgr/dashboard/cluster/status}]=0 set mgr/dashboard/cluster/status v28)=0 set mgr/dashboard/cluster/status v28) ==== 153+0+0 (secure 0 0 0) 0x7f6c9c043360 con 0x7f6cac109880 2024-09-12T02:27:54.071 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stderr set mgr/dashboard/cluster/status 2024-09-12T02:27:54.071 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stderr 2024-09-12T02:27:53.453+0000 7f6cb3000640 1 -- 172.21.15.39:0/342937854 >> [v2:172.21.15.39:6800/1725006999,v1:172.21.15.39:6801/1725006999] conn(0x7f6c900390c0 msgr2=0x7f6c9003b580 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:27:54.071 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stderr 2024-09-12T02:27:53.453+0000 7f6cb3000640 1 --2- 172.21.15.39:0/342937854 >> [v2:172.21.15.39:6800/1725006999,v1:172.21.15.39:6801/1725006999] conn(0x7f6c900390c0 0x7f6c9003b580 secure :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0x7f6c940098c0 tx=0x7f6c94006db0 comp rx=0 tx=0).stop 2024-09-12T02:27:54.071 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stderr 2024-09-12T02:27:53.453+0000 7f6cb3000640 1 -- 172.21.15.39:0/342937854 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f6cac109880 msgr2=0x7f6cac19d8d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:27:54.071 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stderr 2024-09-12T02:27:53.453+0000 7f6cb3000640 1 --2- 172.21.15.39:0/342937854 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f6cac109880 0x7f6cac19d8d0 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7f6c9c030560 tx=0x7f6c9c032670 comp rx=0 tx=0).stop 2024-09-12T02:27:54.071 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stderr 2024-09-12T02:27:53.453+0000 7f6cb3000640 1 -- 172.21.15.39:0/342937854 shutdown_connections 2024-09-12T02:27:54.071 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stderr 2024-09-12T02:27:53.453+0000 7f6cb3000640 1 --2- 172.21.15.39:0/342937854 >> [v2:172.21.15.39:6800/1725006999,v1:172.21.15.39:6801/1725006999] conn(0x7f6c900390c0 0x7f6c9003b580 unknown :-1 s=CLOSED pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:27:54.071 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stderr 2024-09-12T02:27:53.453+0000 7f6cb3000640 1 --2- 172.21.15.39:0/342937854 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f6cac109880 0x7f6cac19d8d0 unknown :-1 s=CLOSED pgs=75 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:27:54.072 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stderr 2024-09-12T02:27:53.453+0000 7f6cb3000640 1 -- 172.21.15.39:0/342937854 >> 172.21.15.39:0/342937854 conn(0x7f6cac07ce60 msgr2=0x7f6cac106d00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:27:54.072 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stderr 2024-09-12T02:27:53.453+0000 7f6cb3000640 1 -- 172.21.15.39:0/342937854 shutdown_connections 2024-09-12T02:27:54.072 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stderr 2024-09-12T02:27:53.453+0000 7f6cb3000640 1 -- 172.21.15.39:0/342937854 wait complete. 2024-09-12T02:27:54.072 INFO:teuthology.orchestra.run.smithi039.stdout:You can access the Ceph CLI as following in case of multi-cluster or non-default config: 2024-09-12T02:27:54.072 INFO:teuthology.orchestra.run.smithi039.stdout: 2024-09-12T02:27:54.072 INFO:teuthology.orchestra.run.smithi039.stdout: sudo /home/ubuntu/cephtest/cephadm shell --fsid 4954ed46-70ae-11ef-bcea-c7b262605968 -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring 2024-09-12T02:27:54.072 INFO:teuthology.orchestra.run.smithi039.stdout: 2024-09-12T02:27:54.072 INFO:teuthology.orchestra.run.smithi039.stdout:Or, if you are only running a single cluster on this host: 2024-09-12T02:27:54.072 INFO:teuthology.orchestra.run.smithi039.stdout: 2024-09-12T02:27:54.072 INFO:teuthology.orchestra.run.smithi039.stdout: sudo /home/ubuntu/cephtest/cephadm shell 2024-09-12T02:27:54.072 INFO:teuthology.orchestra.run.smithi039.stdout: 2024-09-12T02:27:54.072 INFO:teuthology.orchestra.run.smithi039.stdout:Please consider enabling telemetry to help improve Ceph: 2024-09-12T02:27:54.072 INFO:teuthology.orchestra.run.smithi039.stdout: 2024-09-12T02:27:54.072 INFO:teuthology.orchestra.run.smithi039.stdout: ceph telemetry on 2024-09-12T02:27:54.073 INFO:teuthology.orchestra.run.smithi039.stdout: 2024-09-12T02:27:54.073 INFO:teuthology.orchestra.run.smithi039.stdout:For more information see: 2024-09-12T02:27:54.073 INFO:teuthology.orchestra.run.smithi039.stdout: 2024-09-12T02:27:54.073 INFO:teuthology.orchestra.run.smithi039.stdout: https://docs.ceph.com/en/latest/mgr/telemetry/ 2024-09-12T02:27:54.073 INFO:teuthology.orchestra.run.smithi039.stdout: 2024-09-12T02:27:54.073 INFO:teuthology.orchestra.run.smithi039.stdout:Bootstrap complete. 2024-09-12T02:27:54.125 INFO:tasks.cephadm:Fetching config... 2024-09-12T02:27:54.126 DEBUG:teuthology.orchestra.run.smithi039:> set -ex 2024-09-12T02:27:54.126 DEBUG:teuthology.orchestra.run.smithi039:> dd if=/etc/ceph/ceph.conf of=/dev/stdout 2024-09-12T02:27:54.161 INFO:tasks.cephadm:Fetching client.admin keyring... 2024-09-12T02:27:54.161 DEBUG:teuthology.orchestra.run.smithi039:> set -ex 2024-09-12T02:27:54.161 DEBUG:teuthology.orchestra.run.smithi039:> dd if=/etc/ceph/ceph.client.admin.keyring of=/dev/stdout 2024-09-12T02:27:54.237 INFO:tasks.cephadm:Fetching mon keyring... 2024-09-12T02:27:54.237 DEBUG:teuthology.orchestra.run.smithi039:> set -ex 2024-09-12T02:27:54.237 DEBUG:teuthology.orchestra.run.smithi039:> sudo dd if=/var/lib/ceph/4954ed46-70ae-11ef-bcea-c7b262605968/mon.a/keyring of=/dev/stdout 2024-09-12T02:27:54.334 INFO:tasks.cephadm:Fetching pub ssh key... 2024-09-12T02:27:54.334 DEBUG:teuthology.orchestra.run.smithi039:> set -ex 2024-09-12T02:27:54.334 DEBUG:teuthology.orchestra.run.smithi039:> dd if=/home/ubuntu/cephtest/ceph.pub of=/dev/stdout 2024-09-12T02:27:54.409 INFO:tasks.cephadm:Installing pub ssh key for root users... 2024-09-12T02:27:54.410 DEBUG:teuthology.orchestra.run.smithi039:> sudo install -d -m 0700 /root/.ssh && echo 'ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQDdr1KhalnZElck1UERmqBqYHZcvOpK3aiNObsYCwJBrpDUZ/byEd9On0VGA3J/W0FK7/F8HU1Kigumi+98Xjt+vn1IDFrn5OrkGdDt4drROzHQK7bzQfFCoZK1OOxf7IjjSFWmFCUZAZoOKSjMm2jGLw6I56vKPFgsZ1lSt/w8zWGjKsHdSZH3wF773G3V56lPLpvIrWS4X4CP2ZrTDrCek0issZ5OzXNXQIm0HAbxMJsxaTK48/heavAqJlIeU+mlHTyDI6RJi/K1OVjvralmXnN1puaF1uLvZvU4qHE9xX0ON26p7eFJ8bstySaRKA3KIF6eDQgq5iiT7/2vap924jbpeYFMKzTS4NeUICdO1bO24hS/Sd+4V4kRjvAc2tfdQKiGTut+i/xmnn/yAOx5f4ZN06yGyN1MZEHe5v6rYukHaWfE5uEZgdX5d4fxs/x9MhPNlLaEQAMelhBZFRyzlXPysEZpJcd3KPEgbISrLknF9QfbygjrtTH0/faWnHU= ceph-4954ed46-70ae-11ef-bcea-c7b262605968' | sudo tee -a /root/.ssh/authorized_keys && sudo chmod 0600 /root/.ssh/authorized_keys 2024-09-12T02:27:54.533 INFO:teuthology.orchestra.run.smithi039.stdout:ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQDdr1KhalnZElck1UERmqBqYHZcvOpK3aiNObsYCwJBrpDUZ/byEd9On0VGA3J/W0FK7/F8HU1Kigumi+98Xjt+vn1IDFrn5OrkGdDt4drROzHQK7bzQfFCoZK1OOxf7IjjSFWmFCUZAZoOKSjMm2jGLw6I56vKPFgsZ1lSt/w8zWGjKsHdSZH3wF773G3V56lPLpvIrWS4X4CP2ZrTDrCek0issZ5OzXNXQIm0HAbxMJsxaTK48/heavAqJlIeU+mlHTyDI6RJi/K1OVjvralmXnN1puaF1uLvZvU4qHE9xX0ON26p7eFJ8bstySaRKA3KIF6eDQgq5iiT7/2vap924jbpeYFMKzTS4NeUICdO1bO24hS/Sd+4V4kRjvAc2tfdQKiGTut+i/xmnn/yAOx5f4ZN06yGyN1MZEHe5v6rYukHaWfE5uEZgdX5d4fxs/x9MhPNlLaEQAMelhBZFRyzlXPysEZpJcd3KPEgbISrLknF9QfbygjrtTH0/faWnHU= ceph-4954ed46-70ae-11ef-bcea-c7b262605968 2024-09-12T02:27:54.558 DEBUG:teuthology.orchestra.run.smithi044:> sudo install -d -m 0700 /root/.ssh && echo 'ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQDdr1KhalnZElck1UERmqBqYHZcvOpK3aiNObsYCwJBrpDUZ/byEd9On0VGA3J/W0FK7/F8HU1Kigumi+98Xjt+vn1IDFrn5OrkGdDt4drROzHQK7bzQfFCoZK1OOxf7IjjSFWmFCUZAZoOKSjMm2jGLw6I56vKPFgsZ1lSt/w8zWGjKsHdSZH3wF773G3V56lPLpvIrWS4X4CP2ZrTDrCek0issZ5OzXNXQIm0HAbxMJsxaTK48/heavAqJlIeU+mlHTyDI6RJi/K1OVjvralmXnN1puaF1uLvZvU4qHE9xX0ON26p7eFJ8bstySaRKA3KIF6eDQgq5iiT7/2vap924jbpeYFMKzTS4NeUICdO1bO24hS/Sd+4V4kRjvAc2tfdQKiGTut+i/xmnn/yAOx5f4ZN06yGyN1MZEHe5v6rYukHaWfE5uEZgdX5d4fxs/x9MhPNlLaEQAMelhBZFRyzlXPysEZpJcd3KPEgbISrLknF9QfbygjrtTH0/faWnHU= ceph-4954ed46-70ae-11ef-bcea-c7b262605968' | sudo tee -a /root/.ssh/authorized_keys && sudo chmod 0600 /root/.ssh/authorized_keys 2024-09-12T02:27:54.599 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 02:27:54 smithi039 ceph-mon[30515]: from='client.? 172.21.15.39:0/342937854' entity='client.admin' 2024-09-12T02:27:54.616 INFO:teuthology.orchestra.run.smithi044.stdout:ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQDdr1KhalnZElck1UERmqBqYHZcvOpK3aiNObsYCwJBrpDUZ/byEd9On0VGA3J/W0FK7/F8HU1Kigumi+98Xjt+vn1IDFrn5OrkGdDt4drROzHQK7bzQfFCoZK1OOxf7IjjSFWmFCUZAZoOKSjMm2jGLw6I56vKPFgsZ1lSt/w8zWGjKsHdSZH3wF773G3V56lPLpvIrWS4X4CP2ZrTDrCek0issZ5OzXNXQIm0HAbxMJsxaTK48/heavAqJlIeU+mlHTyDI6RJi/K1OVjvralmXnN1puaF1uLvZvU4qHE9xX0ON26p7eFJ8bstySaRKA3KIF6eDQgq5iiT7/2vap924jbpeYFMKzTS4NeUICdO1bO24hS/Sd+4V4kRjvAc2tfdQKiGTut+i/xmnn/yAOx5f4ZN06yGyN1MZEHe5v6rYukHaWfE5uEZgdX5d4fxs/x9MhPNlLaEQAMelhBZFRyzlXPysEZpJcd3KPEgbISrLknF9QfbygjrtTH0/faWnHU= ceph-4954ed46-70ae-11ef-bcea-c7b262605968 2024-09-12T02:27:54.630 DEBUG:teuthology.orchestra.run.smithi172:> sudo install -d -m 0700 /root/.ssh && echo 'ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQDdr1KhalnZElck1UERmqBqYHZcvOpK3aiNObsYCwJBrpDUZ/byEd9On0VGA3J/W0FK7/F8HU1Kigumi+98Xjt+vn1IDFrn5OrkGdDt4drROzHQK7bzQfFCoZK1OOxf7IjjSFWmFCUZAZoOKSjMm2jGLw6I56vKPFgsZ1lSt/w8zWGjKsHdSZH3wF773G3V56lPLpvIrWS4X4CP2ZrTDrCek0issZ5OzXNXQIm0HAbxMJsxaTK48/heavAqJlIeU+mlHTyDI6RJi/K1OVjvralmXnN1puaF1uLvZvU4qHE9xX0ON26p7eFJ8bstySaRKA3KIF6eDQgq5iiT7/2vap924jbpeYFMKzTS4NeUICdO1bO24hS/Sd+4V4kRjvAc2tfdQKiGTut+i/xmnn/yAOx5f4ZN06yGyN1MZEHe5v6rYukHaWfE5uEZgdX5d4fxs/x9MhPNlLaEQAMelhBZFRyzlXPysEZpJcd3KPEgbISrLknF9QfbygjrtTH0/faWnHU= ceph-4954ed46-70ae-11ef-bcea-c7b262605968' | sudo tee -a /root/.ssh/authorized_keys && sudo chmod 0600 /root/.ssh/authorized_keys 2024-09-12T02:27:54.673 INFO:teuthology.orchestra.run.smithi172.stdout:ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQDdr1KhalnZElck1UERmqBqYHZcvOpK3aiNObsYCwJBrpDUZ/byEd9On0VGA3J/W0FK7/F8HU1Kigumi+98Xjt+vn1IDFrn5OrkGdDt4drROzHQK7bzQfFCoZK1OOxf7IjjSFWmFCUZAZoOKSjMm2jGLw6I56vKPFgsZ1lSt/w8zWGjKsHdSZH3wF773G3V56lPLpvIrWS4X4CP2ZrTDrCek0issZ5OzXNXQIm0HAbxMJsxaTK48/heavAqJlIeU+mlHTyDI6RJi/K1OVjvralmXnN1puaF1uLvZvU4qHE9xX0ON26p7eFJ8bstySaRKA3KIF6eDQgq5iiT7/2vap924jbpeYFMKzTS4NeUICdO1bO24hS/Sd+4V4kRjvAc2tfdQKiGTut+i/xmnn/yAOx5f4ZN06yGyN1MZEHe5v6rYukHaWfE5uEZgdX5d4fxs/x9MhPNlLaEQAMelhBZFRyzlXPysEZpJcd3KPEgbISrLknF9QfbygjrtTH0/faWnHU= ceph-4954ed46-70ae-11ef-bcea-c7b262605968 2024-09-12T02:27:54.687 DEBUG:teuthology.orchestra.run.smithi039:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 4954ed46-70ae-11ef-bcea-c7b262605968 -- ceph config set mgr mgr/cephadm/allow_ptrace true 2024-09-12T02:27:55.057 INFO:teuthology.orchestra.run.smithi039.stderr:Inferring config /var/lib/ceph/4954ed46-70ae-11ef-bcea-c7b262605968/mon.a/config 2024-09-12T02:27:55.622 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:27:55.621+0000 7fbcb7200640 1 -- 172.21.15.39:0/2783189011 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fbcb8101420 msgr2=0x7fbcb8101820 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:27:55.622 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:27:55.621+0000 7fbcb7200640 1 --2- 172.21.15.39:0/2783189011 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fbcb8101420 0x7fbcb8101820 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7fbcb0009c20 tx=0x7fbcb002aa90 comp rx=0 tx=0).stop 2024-09-12T02:27:55.622 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:27:55.621+0000 7fbcb7200640 1 -- 172.21.15.39:0/2783189011 shutdown_connections 2024-09-12T02:27:55.622 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:27:55.621+0000 7fbcb7200640 1 --2- 172.21.15.39:0/2783189011 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fbcb8101420 0x7fbcb8101820 unknown :-1 s=CLOSED pgs=76 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:27:55.623 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:27:55.621+0000 7fbcb7200640 1 -- 172.21.15.39:0/2783189011 >> 172.21.15.39:0/2783189011 conn(0x7fbcb80fcbd0 msgr2=0x7fbcb80feff0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:27:55.623 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:27:55.621+0000 7fbcb7200640 1 -- 172.21.15.39:0/2783189011 shutdown_connections 2024-09-12T02:27:55.623 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:27:55.621+0000 7fbcb7200640 1 -- 172.21.15.39:0/2783189011 wait complete. 2024-09-12T02:27:55.624 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:27:55.622+0000 7fbcb7200640 1 Processor -- start 2024-09-12T02:27:55.624 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:27:55.622+0000 7fbcb7200640 1 -- start start 2024-09-12T02:27:55.624 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:27:55.623+0000 7fbcb7200640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fbcb8101420 0x7fbcb8198da0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:27:55.624 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:27:55.623+0000 7fbcb7200640 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 -- 0x7fbcb8107530 con 0x7fbcb8101420 2024-09-12T02:27:55.624 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:27:55.623+0000 7fbcb5e00640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fbcb8101420 0x7fbcb8198da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:27:55.624 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:27:55.623+0000 7fbcb5e00640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fbcb8101420 0x7fbcb8198da0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.39:3300/0 says I am v2:172.21.15.39:45416/0 (socket says 172.21.15.39:45416) 2024-09-12T02:27:55.624 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:27:55.623+0000 7fbcb5e00640 1 -- 172.21.15.39:0/256656321 learned_addr learned my addr 172.21.15.39:0/256656321 (peer_addr_for_me v2:172.21.15.39:0/0) 2024-09-12T02:27:55.624 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:27:55.623+0000 7fbcb5e00640 1 -- 172.21.15.39:0/256656321 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fbcb81992e0 con 0x7fbcb8101420 2024-09-12T02:27:55.625 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:27:55.624+0000 7fbcb5e00640 1 --2- 172.21.15.39:0/256656321 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fbcb8101420 0x7fbcb8198da0 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7fbcb002f040 tx=0x7fbcb002e3c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:27:55.625 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:27:55.624+0000 7fbcaea00640 1 -- 172.21.15.39:0/256656321 <== mon.0 v2:172.21.15.39:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fbcb0047070 con 0x7fbcb8101420 2024-09-12T02:27:55.625 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:27:55.624+0000 7fbcaea00640 1 -- 172.21.15.39:0/256656321 <== mon.0 v2:172.21.15.39:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fbcb0003e50 con 0x7fbcb8101420 2024-09-12T02:27:55.625 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:27:55.624+0000 7fbcaea00640 1 -- 172.21.15.39:0/256656321 <== mon.0 v2:172.21.15.39:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fbcb0033050 con 0x7fbcb8101420 2024-09-12T02:27:55.625 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:27:55.624+0000 7fbcb7200640 1 -- 172.21.15.39:0/256656321 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fbcb8199570 con 0x7fbcb8101420 2024-09-12T02:27:55.625 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:27:55.624+0000 7fbcb7200640 1 -- 172.21.15.39:0/256656321 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fbcb819c260 con 0x7fbcb8101420 2024-09-12T02:27:55.626 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:27:55.625+0000 7fbcb7200640 1 -- 172.21.15.39:0/256656321 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fbcb8107cb0 con 0x7fbcb8101420 2024-09-12T02:27:55.626 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:27:55.625+0000 7fbcaea00640 1 -- 172.21.15.39:0/256656321 <== mon.0 v2:172.21.15.39:3300/0 4 ==== mgrmap(e 13) ==== 46343+0+0 (secure 0 0 0) 0x7fbcb004a070 con 0x7fbcb8101420 2024-09-12T02:27:55.627 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:27:55.626+0000 7fbcaea00640 1 --2- 172.21.15.39:0/256656321 >> [v2:172.21.15.39:6800/1725006999,v1:172.21.15.39:6801/1725006999] conn(0x7fbc9c0390c0 0x7fbc9c03b580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:27:55.627 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:27:55.626+0000 7fbcaea00640 1 -- 172.21.15.39:0/256656321 <== mon.0 v2:172.21.15.39:3300/0 5 ==== osd_map(3..3 src has 1..3) ==== 1155+0+0 (secure 0 0 0) 0x7fbcb003e030 con 0x7fbcb8101420 2024-09-12T02:27:55.627 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:27:55.626+0000 7fbcb5400640 1 --2- 172.21.15.39:0/256656321 >> [v2:172.21.15.39:6800/1725006999,v1:172.21.15.39:6801/1725006999] conn(0x7fbc9c0390c0 0x7fbc9c03b580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:27:55.627 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:27:55.627+0000 7fbcb5400640 1 --2- 172.21.15.39:0/256656321 >> [v2:172.21.15.39:6800/1725006999,v1:172.21.15.39:6801/1725006999] conn(0x7fbc9c0390c0 0x7fbc9c03b580 secure :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0x7fbca80098c0 tx=0x7fbca8006db0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:27:55.632 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:27:55.631+0000 7fbcaea00640 1 -- 172.21.15.39:0/256656321 <== mon.0 v2:172.21.15.39:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7fbcb0048260 con 0x7fbcb8101420 2024-09-12T02:27:55.824 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:27:55.823+0000 7fbcb7200640 1 -- 172.21.15.39:0/256656321 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_command([{prefix=config set, name=mgr/cephadm/allow_ptrace}] v 0) -- 0x7fbcb802d830 con 0x7fbcb8101420 2024-09-12T02:27:55.831 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:27:55.830+0000 7fbcaea00640 1 -- 172.21.15.39:0/256656321 <== mon.0 v2:172.21.15.39:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mgr/cephadm/allow_ptrace}]=0 v9)=0 v9) ==== 125+0+0 (secure 0 0 0) 0x7fbcb004ac60 con 0x7fbcb8101420 2024-09-12T02:27:55.834 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:27:55.833+0000 7fbcb7200640 1 -- 172.21.15.39:0/256656321 >> [v2:172.21.15.39:6800/1725006999,v1:172.21.15.39:6801/1725006999] conn(0x7fbc9c0390c0 msgr2=0x7fbc9c03b580 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:27:55.834 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:27:55.833+0000 7fbcb7200640 1 --2- 172.21.15.39:0/256656321 >> [v2:172.21.15.39:6800/1725006999,v1:172.21.15.39:6801/1725006999] conn(0x7fbc9c0390c0 0x7fbc9c03b580 secure :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0x7fbca80098c0 tx=0x7fbca8006db0 comp rx=0 tx=0).stop 2024-09-12T02:27:55.834 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:27:55.833+0000 7fbcb7200640 1 -- 172.21.15.39:0/256656321 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fbcb8101420 msgr2=0x7fbcb8198da0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:27:55.834 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:27:55.833+0000 7fbcb7200640 1 --2- 172.21.15.39:0/256656321 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fbcb8101420 0x7fbcb8198da0 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7fbcb002f040 tx=0x7fbcb002e3c0 comp rx=0 tx=0).stop 2024-09-12T02:27:55.834 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:27:55.833+0000 7fbcb7200640 1 -- 172.21.15.39:0/256656321 shutdown_connections 2024-09-12T02:27:55.834 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:27:55.833+0000 7fbcb7200640 1 --2- 172.21.15.39:0/256656321 >> [v2:172.21.15.39:6800/1725006999,v1:172.21.15.39:6801/1725006999] conn(0x7fbc9c0390c0 0x7fbc9c03b580 unknown :-1 s=CLOSED pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:27:55.834 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:27:55.833+0000 7fbcb7200640 1 --2- 172.21.15.39:0/256656321 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fbcb8101420 0x7fbcb8198da0 unknown :-1 s=CLOSED pgs=77 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:27:55.835 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:27:55.833+0000 7fbcb7200640 1 -- 172.21.15.39:0/256656321 >> 172.21.15.39:0/256656321 conn(0x7fbcb80fcbd0 msgr2=0x7fbcb80fd610 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:27:55.835 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:27:55.833+0000 7fbcb7200640 1 -- 172.21.15.39:0/256656321 shutdown_connections 2024-09-12T02:27:55.835 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:27:55.833+0000 7fbcb7200640 1 -- 172.21.15.39:0/256656321 wait complete. 2024-09-12T02:27:56.980 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 02:27:56 smithi039 ceph-mon[30515]: from='client.? 172.21.15.39:0/256656321' entity='client.admin' 2024-09-12T02:27:56.981 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 02:27:56 smithi039 ceph-mon[30515]: from='mgr.14150 172.21.15.39:0/408627207' entity='mgr.x' 2024-09-12T02:27:56.981 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 02:27:56 smithi039 ceph-mon[30515]: from='mgr.14150 172.21.15.39:0/408627207' entity='mgr.x' 2024-09-12T02:27:56.981 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 02:27:56 smithi039 ceph-mon[30515]: from='mgr.14150 172.21.15.39:0/408627207' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd/host:smithi039", "name": "osd_memory_target"}]: dispatch 2024-09-12T02:27:56.981 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 02:27:56 smithi039 ceph-mon[30515]: from='mgr.14150 172.21.15.39:0/408627207' entity='mgr.x' 2024-09-12T02:27:56.981 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 02:27:56 smithi039 ceph-mon[30515]: from='mgr.14150 172.21.15.39:0/408627207' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-12T02:27:56.981 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 02:27:56 smithi039 ceph-mon[30515]: from='mgr.14150 172.21.15.39:0/408627207' entity='mgr.x' 2024-09-12T02:27:57.017 INFO:tasks.cephadm:Distributing conf and client.admin keyring to all hosts + 0755 2024-09-12T02:27:57.018 DEBUG:teuthology.orchestra.run.smithi039:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 4954ed46-70ae-11ef-bcea-c7b262605968 -- ceph orch client-keyring set client.admin '*' --mode 0755 2024-09-12T02:27:57.562 INFO:teuthology.orchestra.run.smithi039.stderr:Inferring config /var/lib/ceph/4954ed46-70ae-11ef-bcea-c7b262605968/mon.a/config 2024-09-12T02:27:58.170 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:27:58.137+0000 7f7d73e00640 1 -- 172.21.15.39:0/1007112969 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f7d74101420 msgr2=0x7f7d74101820 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:27:58.170 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:27:58.137+0000 7f7d73e00640 1 --2- 172.21.15.39:0/1007112969 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f7d74101420 0x7f7d74101820 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7f7d64009880 tx=0x7f7d6402a5d0 comp rx=0 tx=0).stop 2024-09-12T02:27:58.170 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:27:58.137+0000 7f7d73e00640 1 -- 172.21.15.39:0/1007112969 shutdown_connections 2024-09-12T02:27:58.170 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:27:58.137+0000 7f7d73e00640 1 --2- 172.21.15.39:0/1007112969 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f7d74101420 0x7f7d74101820 unknown :-1 s=CLOSED pgs=78 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:27:58.171 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:27:58.137+0000 7f7d73e00640 1 -- 172.21.15.39:0/1007112969 >> 172.21.15.39:0/1007112969 conn(0x7f7d740fcbd0 msgr2=0x7f7d740feff0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:27:58.171 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:27:58.137+0000 7f7d73e00640 1 -- 172.21.15.39:0/1007112969 shutdown_connections 2024-09-12T02:27:58.171 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:27:58.137+0000 7f7d73e00640 1 -- 172.21.15.39:0/1007112969 wait complete. 2024-09-12T02:27:58.171 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:27:58.138+0000 7f7d73e00640 1 Processor -- start 2024-09-12T02:27:58.171 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:27:58.138+0000 7f7d73e00640 1 -- start start 2024-09-12T02:27:58.171 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:27:58.139+0000 7f7d73e00640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f7d74101420 0x7f7d74075eb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:27:58.171 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:27:58.139+0000 7f7d73e00640 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 -- 0x7f7d74107530 con 0x7f7d74101420 2024-09-12T02:27:58.171 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:27:58.139+0000 7f7d72a00640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f7d74101420 0x7f7d74075eb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:27:58.171 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:27:58.139+0000 7f7d72a00640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f7d74101420 0x7f7d74075eb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.39:3300/0 says I am v2:172.21.15.39:53606/0 (socket says 172.21.15.39:53606) 2024-09-12T02:27:58.171 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:27:58.139+0000 7f7d72a00640 1 -- 172.21.15.39:0/3859793271 learned_addr learned my addr 172.21.15.39:0/3859793271 (peer_addr_for_me v2:172.21.15.39:0/0) 2024-09-12T02:27:58.171 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:27:58.139+0000 7f7d72a00640 1 -- 172.21.15.39:0/3859793271 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7d740763f0 con 0x7f7d74101420 2024-09-12T02:27:58.172 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:27:58.140+0000 7f7d72a00640 1 --2- 172.21.15.39:0/3859793271 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f7d74101420 0x7f7d74075eb0 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7f7d64004f60 tx=0x7f7d640048f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:27:58.172 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:27:58.140+0000 7f7d78a00640 1 -- 172.21.15.39:0/3859793271 <== mon.0 v2:172.21.15.39:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f7d6403f070 con 0x7f7d74101420 2024-09-12T02:27:58.172 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:27:58.140+0000 7f7d78a00640 1 -- 172.21.15.39:0/3859793271 <== mon.0 v2:172.21.15.39:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f7d64004cc0 con 0x7f7d74101420 2024-09-12T02:27:58.172 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:27:58.140+0000 7f7d73e00640 1 -- 172.21.15.39:0/3859793271 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f7d740745e0 con 0x7f7d74101420 2024-09-12T02:27:58.172 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:27:58.140+0000 7f7d78a00640 1 -- 172.21.15.39:0/3859793271 <== mon.0 v2:172.21.15.39:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f7d64035030 con 0x7f7d74101420 2024-09-12T02:27:58.172 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:27:58.140+0000 7f7d73e00640 1 -- 172.21.15.39:0/3859793271 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f7d74074b20 con 0x7f7d74101420 2024-09-12T02:27:58.172 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:27:58.141+0000 7f7d73e00640 1 -- 172.21.15.39:0/3859793271 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f7d74107cb0 con 0x7f7d74101420 2024-09-12T02:27:58.172 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:27:58.141+0000 7f7d78a00640 1 -- 172.21.15.39:0/3859793271 <== mon.0 v2:172.21.15.39:3300/0 4 ==== mgrmap(e 13) ==== 46343+0+0 (secure 0 0 0) 0x7f7d64042070 con 0x7f7d74101420 2024-09-12T02:27:58.172 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:27:58.142+0000 7f7d78a00640 1 --2- 172.21.15.39:0/3859793271 >> [v2:172.21.15.39:6800/1725006999,v1:172.21.15.39:6801/1725006999] conn(0x7f7d580390c0 0x7f7d5803b580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:27:58.172 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:27:58.142+0000 7f7d78a00640 1 -- 172.21.15.39:0/3859793271 <== mon.0 v2:172.21.15.39:3300/0 5 ==== osd_map(3..3 src has 1..3) ==== 1155+0+0 (secure 0 0 0) 0x7f7d6406cd50 con 0x7f7d74101420 2024-09-12T02:27:58.172 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:27:58.142+0000 7f7d72000640 1 --2- 172.21.15.39:0/3859793271 >> [v2:172.21.15.39:6800/1725006999,v1:172.21.15.39:6801/1725006999] conn(0x7f7d580390c0 0x7f7d5803b580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:27:58.172 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:27:58.143+0000 7f7d72000640 1 --2- 172.21.15.39:0/3859793271 >> [v2:172.21.15.39:6800/1725006999,v1:172.21.15.39:6801/1725006999] conn(0x7f7d580390c0 0x7f7d5803b580 secure :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0x7f7d600098c0 tx=0x7f7d60006db0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:27:58.172 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:27:58.150+0000 7f7d78a00640 1 -- 172.21.15.39:0/3859793271 <== mon.0 v2:172.21.15.39:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7f7d64040260 con 0x7f7d74101420 2024-09-12T02:27:58.343 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:27:58.342+0000 7f7d73e00640 1 -- 172.21.15.39:0/3859793271 --> [v2:172.21.15.39:6800/1725006999,v1:172.21.15.39:6801/1725006999] -- mgr_command(tid 0: {"prefix": "orch client-keyring set", "entity": "client.admin", "placement": "*", "mode": "0755", "target": ["mon-mgr", ""]}) -- 0x7f7d7418fff0 con 0x7f7d580390c0 2024-09-12T02:27:58.346 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:27:58.346+0000 7f7d78a00640 1 -- 172.21.15.39:0/3859793271 <== mgr.14150 v2:172.21.15.39:6800/1725006999 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+0 (secure 0 0 0) 0x7f7d7418fff0 con 0x7f7d580390c0 2024-09-12T02:27:58.350 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:27:58.349+0000 7f7d73e00640 1 -- 172.21.15.39:0/3859793271 >> [v2:172.21.15.39:6800/1725006999,v1:172.21.15.39:6801/1725006999] conn(0x7f7d580390c0 msgr2=0x7f7d5803b580 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:27:58.350 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:27:58.349+0000 7f7d73e00640 1 --2- 172.21.15.39:0/3859793271 >> [v2:172.21.15.39:6800/1725006999,v1:172.21.15.39:6801/1725006999] conn(0x7f7d580390c0 0x7f7d5803b580 secure :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0x7f7d600098c0 tx=0x7f7d60006db0 comp rx=0 tx=0).stop 2024-09-12T02:27:58.350 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:27:58.349+0000 7f7d73e00640 1 -- 172.21.15.39:0/3859793271 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f7d74101420 msgr2=0x7f7d74075eb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:27:58.350 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:27:58.349+0000 7f7d73e00640 1 --2- 172.21.15.39:0/3859793271 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f7d74101420 0x7f7d74075eb0 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7f7d64004f60 tx=0x7f7d640048f0 comp rx=0 tx=0).stop 2024-09-12T02:27:58.350 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:27:58.349+0000 7f7d73e00640 1 -- 172.21.15.39:0/3859793271 shutdown_connections 2024-09-12T02:27:58.350 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:27:58.349+0000 7f7d73e00640 1 --2- 172.21.15.39:0/3859793271 >> [v2:172.21.15.39:6800/1725006999,v1:172.21.15.39:6801/1725006999] conn(0x7f7d580390c0 0x7f7d5803b580 unknown :-1 s=CLOSED pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:27:58.351 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:27:58.349+0000 7f7d73e00640 1 --2- 172.21.15.39:0/3859793271 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f7d74101420 0x7f7d74075eb0 unknown :-1 s=CLOSED pgs=79 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:27:58.351 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:27:58.349+0000 7f7d73e00640 1 -- 172.21.15.39:0/3859793271 >> 172.21.15.39:0/3859793271 conn(0x7f7d740fcbd0 msgr2=0x7f7d740fd570 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:27:58.351 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:27:58.349+0000 7f7d73e00640 1 -- 172.21.15.39:0/3859793271 shutdown_connections 2024-09-12T02:27:58.351 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:27:58.349+0000 7f7d73e00640 1 -- 172.21.15.39:0/3859793271 wait complete. 2024-09-12T02:27:59.160 INFO:tasks.cephadm:Writing (initial) conf and keyring to smithi044 2024-09-12T02:27:59.160 DEBUG:teuthology.orchestra.run.smithi044:> set -ex 2024-09-12T02:27:59.160 DEBUG:teuthology.orchestra.run.smithi044:> dd of=/etc/ceph/ceph.conf 2024-09-12T02:27:59.180 DEBUG:teuthology.orchestra.run.smithi044:> set -ex 2024-09-12T02:27:59.180 DEBUG:teuthology.orchestra.run.smithi044:> dd of=/etc/ceph/ceph.client.admin.keyring 2024-09-12T02:27:59.238 INFO:tasks.cephadm:Adding host smithi044 to orchestrator... 2024-09-12T02:27:59.238 DEBUG:teuthology.orchestra.run.smithi039:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 4954ed46-70ae-11ef-bcea-c7b262605968 -- ceph orch host add smithi044 2024-09-12T02:27:59.471 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 02:27:59 smithi039 ceph-mon[30515]: from='client.14172 -' entity='client.admin' cmd=[{"prefix": "orch client-keyring set", "entity": "client.admin", "placement": "*", "mode": "0755", "target": ["mon-mgr", ""]}]: dispatch 2024-09-12T02:27:59.471 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 02:27:59 smithi039 ceph-mon[30515]: from='mgr.14150 172.21.15.39:0/408627207' entity='mgr.x' 2024-09-12T02:27:59.471 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 02:27:59 smithi039 ceph-mon[30515]: from='mgr.14150 172.21.15.39:0/408627207' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-12T02:27:59.471 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 02:27:59 smithi039 ceph-mon[30515]: from='mgr.14150 172.21.15.39:0/408627207' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-12T02:27:59.471 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 02:27:59 smithi039 ceph-mon[30515]: from='mgr.14150 172.21.15.39:0/408627207' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-12T02:27:59.471 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 02:27:59 smithi039 ceph-mon[30515]: Updating smithi039:/etc/ceph/ceph.conf 2024-09-12T02:27:59.910 INFO:teuthology.orchestra.run.smithi039.stderr:Inferring config /var/lib/ceph/4954ed46-70ae-11ef-bcea-c7b262605968/mon.a/config 2024-09-12T02:28:00.408 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 02:28:00 smithi039 ceph-mon[30515]: Updating smithi039:/var/lib/ceph/4954ed46-70ae-11ef-bcea-c7b262605968/config/ceph.conf 2024-09-12T02:28:00.409 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 02:28:00 smithi039 ceph-mon[30515]: Updating smithi039:/etc/ceph/ceph.client.admin.keyring 2024-09-12T02:28:00.409 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 02:28:00 smithi039 ceph-mon[30515]: from='mgr.14150 172.21.15.39:0/408627207' entity='mgr.x' 2024-09-12T02:28:00.409 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 02:28:00 smithi039 ceph-mon[30515]: from='mgr.14150 172.21.15.39:0/408627207' entity='mgr.x' 2024-09-12T02:28:00.409 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 02:28:00 smithi039 ceph-mon[30515]: from='mgr.14150 172.21.15.39:0/408627207' entity='mgr.x' 2024-09-12T02:28:00.523 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:28:00.522+0000 7fa251400640 1 -- 172.21.15.39:0/1105092500 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fa24c107660 msgr2=0x7fa24c107a40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:28:00.523 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:28:00.522+0000 7fa251400640 1 --2- 172.21.15.39:0/1105092500 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fa24c107660 0x7fa24c107a40 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7fa23c009880 tx=0x7fa23c02a5d0 comp rx=0 tx=0).stop 2024-09-12T02:28:00.523 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:28:00.522+0000 7fa251400640 1 -- 172.21.15.39:0/1105092500 shutdown_connections 2024-09-12T02:28:00.523 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:28:00.522+0000 7fa251400640 1 --2- 172.21.15.39:0/1105092500 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fa24c107660 0x7fa24c107a40 unknown :-1 s=CLOSED pgs=80 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:28:00.523 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:28:00.522+0000 7fa251400640 1 -- 172.21.15.39:0/1105092500 >> 172.21.15.39:0/1105092500 conn(0x7fa24c0fd290 msgr2=0x7fa24c0ff6b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:28:00.523 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:28:00.522+0000 7fa251400640 1 -- 172.21.15.39:0/1105092500 shutdown_connections 2024-09-12T02:28:00.523 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:28:00.522+0000 7fa251400640 1 -- 172.21.15.39:0/1105092500 wait complete. 2024-09-12T02:28:00.524 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:28:00.523+0000 7fa251400640 1 Processor -- start 2024-09-12T02:28:00.524 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:28:00.524+0000 7fa251400640 1 -- start start 2024-09-12T02:28:00.525 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:28:00.524+0000 7fa251400640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fa24c107660 0x7fa24c0744f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:28:00.525 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:28:00.524+0000 7fa251400640 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 -- 0x7fa24c10bc90 con 0x7fa24c107660 2024-09-12T02:28:00.525 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:28:00.524+0000 7fa24a800640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fa24c107660 0x7fa24c0744f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:28:00.525 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:28:00.524+0000 7fa24a800640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fa24c107660 0x7fa24c0744f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.39:3300/0 says I am v2:172.21.15.39:53620/0 (socket says 172.21.15.39:53620) 2024-09-12T02:28:00.525 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:28:00.524+0000 7fa24a800640 1 -- 172.21.15.39:0/2390802544 learned_addr learned my addr 172.21.15.39:0/2390802544 (peer_addr_for_me v2:172.21.15.39:0/0) 2024-09-12T02:28:00.526 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:28:00.525+0000 7fa24a800640 1 -- 172.21.15.39:0/2390802544 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa24c0763e0 con 0x7fa24c107660 2024-09-12T02:28:00.526 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:28:00.525+0000 7fa24a800640 1 --2- 172.21.15.39:0/2390802544 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fa24c107660 0x7fa24c0744f0 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7fa23c009230 tx=0x7fa23c003d40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:28:00.526 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:28:00.525+0000 7fa243400640 1 -- 172.21.15.39:0/2390802544 <== mon.0 v2:172.21.15.39:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fa23c03f070 con 0x7fa24c107660 2024-09-12T02:28:00.526 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:28:00.525+0000 7fa243400640 1 -- 172.21.15.39:0/2390802544 <== mon.0 v2:172.21.15.39:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fa23c03bc80 con 0x7fa24c107660 2024-09-12T02:28:00.526 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:28:00.525+0000 7fa251400640 1 -- 172.21.15.39:0/2390802544 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa24c074a30 con 0x7fa24c107660 2024-09-12T02:28:00.527 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:28:00.525+0000 7fa243400640 1 -- 172.21.15.39:0/2390802544 <== mon.0 v2:172.21.15.39:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fa23c035030 con 0x7fa24c107660 2024-09-12T02:28:00.527 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:28:00.525+0000 7fa251400640 1 -- 172.21.15.39:0/2390802544 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa24c074ef0 con 0x7fa24c107660 2024-09-12T02:28:00.527 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:28:00.526+0000 7fa243400640 1 -- 172.21.15.39:0/2390802544 <== mon.0 v2:172.21.15.39:3300/0 4 ==== mgrmap(e 13) ==== 46343+0+0 (secure 0 0 0) 0x7fa23c042070 con 0x7fa24c107660 2024-09-12T02:28:00.527 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:28:00.526+0000 7fa251400640 1 -- 172.21.15.39:0/2390802544 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fa24c102cd0 con 0x7fa24c107660 2024-09-12T02:28:00.527 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:28:00.527+0000 7fa243400640 1 --2- 172.21.15.39:0/2390802544 >> [v2:172.21.15.39:6800/1725006999,v1:172.21.15.39:6801/1725006999] conn(0x7fa2300390c0 0x7fa23003b580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:28:00.527 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:28:00.527+0000 7fa243400640 1 -- 172.21.15.39:0/2390802544 <== mon.0 v2:172.21.15.39:3300/0 5 ==== osd_map(3..3 src has 1..3) ==== 1155+0+0 (secure 0 0 0) 0x7fa23c06cd80 con 0x7fa24c107660 2024-09-12T02:28:00.528 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:28:00.527+0000 7fa243e00640 1 --2- 172.21.15.39:0/2390802544 >> [v2:172.21.15.39:6800/1725006999,v1:172.21.15.39:6801/1725006999] conn(0x7fa2300390c0 0x7fa23003b580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:28:00.528 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:28:00.528+0000 7fa243e00640 1 --2- 172.21.15.39:0/2390802544 >> [v2:172.21.15.39:6800/1725006999,v1:172.21.15.39:6801/1725006999] conn(0x7fa2300390c0 0x7fa23003b580 secure :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0x7fa2340098c0 tx=0x7fa234006db0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:28:00.533 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:28:00.532+0000 7fa243400640 1 -- 172.21.15.39:0/2390802544 <== mon.0 v2:172.21.15.39:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7fa23c0372d0 con 0x7fa24c107660 2024-09-12T02:28:00.720 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:28:00.719+0000 7fa251400640 1 -- 172.21.15.39:0/2390802544 --> [v2:172.21.15.39:6800/1725006999,v1:172.21.15.39:6801/1725006999] -- mgr_command(tid 0: {"prefix": "orch host add", "hostname": "smithi044", "target": ["mon-mgr", ""]}) -- 0x7fa24c075a90 con 0x7fa2300390c0 2024-09-12T02:28:01.849 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 02:28:01 smithi039 ceph-mon[30515]: Updating smithi039:/var/lib/ceph/4954ed46-70ae-11ef-bcea-c7b262605968/config/ceph.client.admin.keyring 2024-09-12T02:28:02.849 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 02:28:02 smithi039 ceph-mon[30515]: from='client.14174 -' entity='client.admin' cmd=[{"prefix": "orch host add", "hostname": "smithi044", "target": ["mon-mgr", ""]}]: dispatch 2024-09-12T02:28:03.495 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 02:28:03 smithi039 ceph-mon[30515]: Deploying cephadm binary to smithi044 2024-09-12T02:28:04.640 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:28:04.638+0000 7fa243400640 1 -- 172.21.15.39:0/2390802544 <== mgr.14150 v2:172.21.15.39:6800/1725006999 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+48 (secure 0 0 0) 0x7fa24c075a90 con 0x7fa2300390c0 2024-09-12T02:28:04.640 INFO:teuthology.orchestra.run.smithi039.stdout:Added host 'smithi044' with addr '172.21.15.44' 2024-09-12T02:28:04.641 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:28:04.640+0000 7fa251400640 1 -- 172.21.15.39:0/2390802544 >> [v2:172.21.15.39:6800/1725006999,v1:172.21.15.39:6801/1725006999] conn(0x7fa2300390c0 msgr2=0x7fa23003b580 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:28:04.641 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:28:04.640+0000 7fa251400640 1 --2- 172.21.15.39:0/2390802544 >> [v2:172.21.15.39:6800/1725006999,v1:172.21.15.39:6801/1725006999] conn(0x7fa2300390c0 0x7fa23003b580 secure :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0x7fa2340098c0 tx=0x7fa234006db0 comp rx=0 tx=0).stop 2024-09-12T02:28:04.642 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:28:04.640+0000 7fa251400640 1 -- 172.21.15.39:0/2390802544 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fa24c107660 msgr2=0x7fa24c0744f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:28:04.642 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:28:04.640+0000 7fa251400640 1 --2- 172.21.15.39:0/2390802544 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fa24c107660 0x7fa24c0744f0 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7fa23c009230 tx=0x7fa23c003d40 comp rx=0 tx=0).stop 2024-09-12T02:28:04.642 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:28:04.641+0000 7fa251400640 1 -- 172.21.15.39:0/2390802544 shutdown_connections 2024-09-12T02:28:04.642 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:28:04.641+0000 7fa251400640 1 --2- 172.21.15.39:0/2390802544 >> [v2:172.21.15.39:6800/1725006999,v1:172.21.15.39:6801/1725006999] conn(0x7fa2300390c0 0x7fa23003b580 unknown :-1 s=CLOSED pgs=13 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:28:04.642 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:28:04.641+0000 7fa251400640 1 --2- 172.21.15.39:0/2390802544 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fa24c107660 0x7fa24c0744f0 unknown :-1 s=CLOSED pgs=81 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:28:04.642 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:28:04.641+0000 7fa251400640 1 -- 172.21.15.39:0/2390802544 >> 172.21.15.39:0/2390802544 conn(0x7fa24c0fd290 msgr2=0x7fa24c0fd670 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:28:04.642 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:28:04.641+0000 7fa251400640 1 -- 172.21.15.39:0/2390802544 shutdown_connections 2024-09-12T02:28:04.642 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:28:04.641+0000 7fa251400640 1 -- 172.21.15.39:0/2390802544 wait complete. 2024-09-12T02:28:05.276 DEBUG:teuthology.orchestra.run.smithi039:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 4954ed46-70ae-11ef-bcea-c7b262605968 -- ceph orch host ls --format=json 2024-09-12T02:28:05.646 INFO:teuthology.orchestra.run.smithi039.stderr:Inferring config /var/lib/ceph/4954ed46-70ae-11ef-bcea-c7b262605968/mon.a/config 2024-09-12T02:28:05.954 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 02:28:05 smithi039 ceph-mon[30515]: from='mgr.14150 172.21.15.39:0/408627207' entity='mgr.x' 2024-09-12T02:28:05.955 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 02:28:05 smithi039 ceph-mon[30515]: Added host smithi044 2024-09-12T02:28:05.955 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 02:28:05 smithi039 ceph-mon[30515]: from='mgr.14150 172.21.15.39:0/408627207' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-12T02:28:05.955 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 02:28:05 smithi039 ceph-mon[30515]: from='mgr.14150 172.21.15.39:0/408627207' entity='mgr.x' 2024-09-12T02:28:05.955 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 02:28:05 smithi039 ceph-mon[30515]: from='mgr.14150 172.21.15.39:0/408627207' entity='mgr.x' 2024-09-12T02:28:06.320 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:28:06.319+0000 7fbd8e800640 1 -- 172.21.15.39:0/2630489495 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fbd88109770 msgr2=0x7fbd88109b50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:28:06.320 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:28:06.319+0000 7fbd8e800640 1 --2- 172.21.15.39:0/2630489495 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fbd88109770 0x7fbd88109b50 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7fbd78009880 tx=0x7fbd7802a5d0 comp rx=0 tx=0).stop 2024-09-12T02:28:06.320 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:28:06.319+0000 7fbd8e800640 1 -- 172.21.15.39:0/2630489495 shutdown_connections 2024-09-12T02:28:06.320 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:28:06.319+0000 7fbd8e800640 1 --2- 172.21.15.39:0/2630489495 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fbd88109770 0x7fbd88109b50 unknown :-1 s=CLOSED pgs=82 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:28:06.320 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:28:06.319+0000 7fbd8e800640 1 -- 172.21.15.39:0/2630489495 >> 172.21.15.39:0/2630489495 conn(0x7fbd880ff450 msgr2=0x7fbd88101870 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:28:06.321 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:28:06.319+0000 7fbd8e800640 1 -- 172.21.15.39:0/2630489495 shutdown_connections 2024-09-12T02:28:06.321 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:28:06.319+0000 7fbd8e800640 1 -- 172.21.15.39:0/2630489495 wait complete. 2024-09-12T02:28:06.321 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:28:06.320+0000 7fbd8e800640 1 Processor -- start 2024-09-12T02:28:06.321 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:28:06.320+0000 7fbd8e800640 1 -- start start 2024-09-12T02:28:06.321 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:28:06.321+0000 7fbd8e800640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fbd88109770 0x7fbd88199340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:28:06.322 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:28:06.321+0000 7fbd8e800640 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 -- 0x7fbd8810de30 con 0x7fbd88109770 2024-09-12T02:28:06.322 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:28:06.321+0000 7fbd87400640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fbd88109770 0x7fbd88199340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:28:06.322 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:28:06.321+0000 7fbd87400640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fbd88109770 0x7fbd88199340 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.39:3300/0 says I am v2:172.21.15.39:53646/0 (socket says 172.21.15.39:53646) 2024-09-12T02:28:06.322 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:28:06.321+0000 7fbd87400640 1 -- 172.21.15.39:0/2744626394 learned_addr learned my addr 172.21.15.39:0/2744626394 (peer_addr_for_me v2:172.21.15.39:0/0) 2024-09-12T02:28:06.323 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:28:06.321+0000 7fbd87400640 1 -- 172.21.15.39:0/2744626394 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fbd88199880 con 0x7fbd88109770 2024-09-12T02:28:06.323 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:28:06.322+0000 7fbd87400640 1 --2- 172.21.15.39:0/2744626394 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fbd88109770 0x7fbd88199340 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7fbd78009230 tx=0x7fbd78003d40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:28:06.323 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:28:06.322+0000 7fbd84c00640 1 -- 172.21.15.39:0/2744626394 <== mon.0 v2:172.21.15.39:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fbd7803f070 con 0x7fbd88109770 2024-09-12T02:28:06.323 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:28:06.322+0000 7fbd84c00640 1 -- 172.21.15.39:0/2744626394 <== mon.0 v2:172.21.15.39:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fbd7803bc80 con 0x7fbd88109770 2024-09-12T02:28:06.323 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:28:06.322+0000 7fbd84c00640 1 -- 172.21.15.39:0/2744626394 <== mon.0 v2:172.21.15.39:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fbd78035030 con 0x7fbd88109770 2024-09-12T02:28:06.323 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:28:06.322+0000 7fbd8e800640 1 -- 172.21.15.39:0/2744626394 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fbd88199b70 con 0x7fbd88109770 2024-09-12T02:28:06.323 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:28:06.322+0000 7fbd8e800640 1 -- 172.21.15.39:0/2744626394 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fbd8819dc10 con 0x7fbd88109770 2024-09-12T02:28:06.324 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:28:06.323+0000 7fbd84c00640 1 -- 172.21.15.39:0/2744626394 <== mon.0 v2:172.21.15.39:3300/0 4 ==== mgrmap(e 13) ==== 46343+0+0 (secure 0 0 0) 0x7fbd78042070 con 0x7fbd88109770 2024-09-12T02:28:06.324 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:28:06.323+0000 7fbd8e800640 1 -- 172.21.15.39:0/2744626394 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fbd88104eb0 con 0x7fbd88109770 2024-09-12T02:28:06.324 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:28:06.324+0000 7fbd84c00640 1 --2- 172.21.15.39:0/2744626394 >> [v2:172.21.15.39:6800/1725006999,v1:172.21.15.39:6801/1725006999] conn(0x7fbd6c039060 0x7fbd6c03b520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:28:06.324 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:28:06.324+0000 7fbd84c00640 1 -- 172.21.15.39:0/2744626394 <== mon.0 v2:172.21.15.39:3300/0 5 ==== osd_map(3..3 src has 1..3) ==== 1155+0+0 (secure 0 0 0) 0x7fbd7806ca20 con 0x7fbd88109770 2024-09-12T02:28:06.324 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:28:06.324+0000 7fbd7ea00640 1 --2- 172.21.15.39:0/2744626394 >> [v2:172.21.15.39:6800/1725006999,v1:172.21.15.39:6801/1725006999] conn(0x7fbd6c039060 0x7fbd6c03b520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:28:06.325 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:28:06.324+0000 7fbd7ea00640 1 --2- 172.21.15.39:0/2744626394 >> [v2:172.21.15.39:6800/1725006999,v1:172.21.15.39:6801/1725006999] conn(0x7fbd6c039060 0x7fbd6c03b520 secure :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0x7fbd700098c0 tx=0x7fbd70006db0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:28:06.329 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:28:06.329+0000 7fbd84c00640 1 -- 172.21.15.39:0/2744626394 <== mon.0 v2:172.21.15.39:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7fbd78031570 con 0x7fbd88109770 2024-09-12T02:28:06.517 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:28:06.516+0000 7fbd8e800640 1 -- 172.21.15.39:0/2744626394 --> [v2:172.21.15.39:6800/1725006999,v1:172.21.15.39:6801/1725006999] -- mgr_command(tid 0: {"prefix": "orch host ls", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7fbd88109bd0 con 0x7fbd6c039060 2024-09-12T02:28:06.518 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:28:06.518+0000 7fbd84c00640 1 -- 172.21.15.39:0/2744626394 <== mgr.14150 v2:172.21.15.39:6800/1725006999 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+159 (secure 0 0 0) 0x7fbd88109bd0 con 0x7fbd6c039060 2024-09-12T02:28:06.518 INFO:teuthology.orchestra.run.smithi039.stdout: 2024-09-12T02:28:06.518 INFO:teuthology.orchestra.run.smithi039.stdout:[{"addr": "172.21.15.39", "hostname": "smithi039", "labels": [], "status": ""}, {"addr": "172.21.15.44", "hostname": "smithi044", "labels": [], "status": ""}] 2024-09-12T02:28:06.521 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:28:06.520+0000 7fbd8e800640 1 -- 172.21.15.39:0/2744626394 >> [v2:172.21.15.39:6800/1725006999,v1:172.21.15.39:6801/1725006999] conn(0x7fbd6c039060 msgr2=0x7fbd6c03b520 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:28:06.521 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:28:06.520+0000 7fbd8e800640 1 --2- 172.21.15.39:0/2744626394 >> [v2:172.21.15.39:6800/1725006999,v1:172.21.15.39:6801/1725006999] conn(0x7fbd6c039060 0x7fbd6c03b520 secure :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0x7fbd700098c0 tx=0x7fbd70006db0 comp rx=0 tx=0).stop 2024-09-12T02:28:06.522 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:28:06.520+0000 7fbd8e800640 1 -- 172.21.15.39:0/2744626394 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fbd88109770 msgr2=0x7fbd88199340 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:28:06.522 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:28:06.520+0000 7fbd8e800640 1 --2- 172.21.15.39:0/2744626394 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fbd88109770 0x7fbd88199340 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7fbd78009230 tx=0x7fbd78003d40 comp rx=0 tx=0).stop 2024-09-12T02:28:06.522 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:28:06.520+0000 7fbd8e800640 1 -- 172.21.15.39:0/2744626394 shutdown_connections 2024-09-12T02:28:06.522 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:28:06.520+0000 7fbd8e800640 1 --2- 172.21.15.39:0/2744626394 >> [v2:172.21.15.39:6800/1725006999,v1:172.21.15.39:6801/1725006999] conn(0x7fbd6c039060 0x7fbd6c03b520 unknown :-1 s=CLOSED pgs=14 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:28:06.522 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:28:06.520+0000 7fbd8e800640 1 --2- 172.21.15.39:0/2744626394 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fbd88109770 0x7fbd88199340 unknown :-1 s=CLOSED pgs=83 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:28:06.522 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:28:06.520+0000 7fbd8e800640 1 -- 172.21.15.39:0/2744626394 >> 172.21.15.39:0/2744626394 conn(0x7fbd880ff450 msgr2=0x7fbd880ff830 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:28:06.522 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:28:06.521+0000 7fbd8e800640 1 -- 172.21.15.39:0/2744626394 shutdown_connections 2024-09-12T02:28:06.522 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:28:06.521+0000 7fbd8e800640 1 -- 172.21.15.39:0/2744626394 wait complete. 2024-09-12T02:28:06.849 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 02:28:06 smithi039 ceph-mon[30515]: pgmap v3: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-12T02:28:06.849 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 02:28:06 smithi039 ceph-mon[30515]: from='mgr.14150 172.21.15.39:0/408627207' entity='mgr.x' 2024-09-12T02:28:07.171 INFO:tasks.cephadm:Writing (initial) conf and keyring to smithi172 2024-09-12T02:28:07.171 DEBUG:teuthology.orchestra.run.smithi172:> set -ex 2024-09-12T02:28:07.171 DEBUG:teuthology.orchestra.run.smithi172:> dd of=/etc/ceph/ceph.conf 2024-09-12T02:28:07.191 DEBUG:teuthology.orchestra.run.smithi172:> set -ex 2024-09-12T02:28:07.191 DEBUG:teuthology.orchestra.run.smithi172:> dd of=/etc/ceph/ceph.client.admin.keyring 2024-09-12T02:28:07.249 INFO:tasks.cephadm:Adding host smithi172 to orchestrator... 2024-09-12T02:28:07.249 DEBUG:teuthology.orchestra.run.smithi039:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 4954ed46-70ae-11ef-bcea-c7b262605968 -- ceph orch host add smithi172 2024-09-12T02:28:07.614 INFO:teuthology.orchestra.run.smithi039.stderr:Inferring config /var/lib/ceph/4954ed46-70ae-11ef-bcea-c7b262605968/mon.a/config 2024-09-12T02:28:07.914 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 02:28:07 smithi039 ceph-mon[30515]: from='client.14176 -' entity='client.admin' cmd=[{"prefix": "orch host ls", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-09-12T02:28:08.120 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:28:08.118+0000 7fb22b400640 1 -- 172.21.15.39:0/2753372774 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fb2241097c0 msgr2=0x7fb224109ba0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:28:08.120 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:28:08.118+0000 7fb22b400640 1 --2- 172.21.15.39:0/2753372774 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fb2241097c0 0x7fb224109ba0 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7fb214009880 tx=0x7fb21402a5d0 comp rx=0 tx=0).stop 2024-09-12T02:28:08.120 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:28:08.118+0000 7fb22b400640 1 -- 172.21.15.39:0/2753372774 shutdown_connections 2024-09-12T02:28:08.120 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:28:08.118+0000 7fb22b400640 1 --2- 172.21.15.39:0/2753372774 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fb2241097c0 0x7fb224109ba0 unknown :-1 s=CLOSED pgs=84 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:28:08.120 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:28:08.118+0000 7fb22b400640 1 -- 172.21.15.39:0/2753372774 >> 172.21.15.39:0/2753372774 conn(0x7fb2240ff480 msgr2=0x7fb2241018a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:28:08.120 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:28:08.119+0000 7fb22b400640 1 -- 172.21.15.39:0/2753372774 shutdown_connections 2024-09-12T02:28:08.120 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:28:08.119+0000 7fb22b400640 1 -- 172.21.15.39:0/2753372774 wait complete. 2024-09-12T02:28:08.121 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:28:08.119+0000 7fb22b400640 1 Processor -- start 2024-09-12T02:28:08.121 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:28:08.120+0000 7fb22b400640 1 -- start start 2024-09-12T02:28:08.121 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:28:08.120+0000 7fb22b400640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fb2241097c0 0x7fb224199320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:28:08.121 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:28:08.120+0000 7fb22b400640 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 -- 0x7fb22410de80 con 0x7fb2241097c0 2024-09-12T02:28:08.121 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:28:08.120+0000 7fb228a00640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fb2241097c0 0x7fb224199320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:28:08.121 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:28:08.120+0000 7fb228a00640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fb2241097c0 0x7fb224199320 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.39:3300/0 says I am v2:172.21.15.39:40392/0 (socket says 172.21.15.39:40392) 2024-09-12T02:28:08.121 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:28:08.120+0000 7fb228a00640 1 -- 172.21.15.39:0/3194748014 learned_addr learned my addr 172.21.15.39:0/3194748014 (peer_addr_for_me v2:172.21.15.39:0/0) 2024-09-12T02:28:08.121 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:28:08.121+0000 7fb228a00640 1 -- 172.21.15.39:0/3194748014 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb224199860 con 0x7fb2241097c0 2024-09-12T02:28:08.122 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:28:08.121+0000 7fb228a00640 1 --2- 172.21.15.39:0/3194748014 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fb2241097c0 0x7fb224199320 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7fb214009230 tx=0x7fb214003d80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:28:08.122 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:28:08.121+0000 7fb222000640 1 -- 172.21.15.39:0/3194748014 <== mon.0 v2:172.21.15.39:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fb21403f070 con 0x7fb2241097c0 2024-09-12T02:28:08.122 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:28:08.121+0000 7fb222000640 1 -- 172.21.15.39:0/3194748014 <== mon.0 v2:172.21.15.39:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fb21403bd40 con 0x7fb2241097c0 2024-09-12T02:28:08.122 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:28:08.121+0000 7fb222000640 1 -- 172.21.15.39:0/3194748014 <== mon.0 v2:172.21.15.39:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fb214035030 con 0x7fb2241097c0 2024-09-12T02:28:08.122 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:28:08.121+0000 7fb22b400640 1 -- 172.21.15.39:0/3194748014 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb224199b50 con 0x7fb2241097c0 2024-09-12T02:28:08.122 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:28:08.121+0000 7fb22b400640 1 -- 172.21.15.39:0/3194748014 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb22419dbf0 con 0x7fb2241097c0 2024-09-12T02:28:08.123 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:28:08.122+0000 7fb22b400640 1 -- 172.21.15.39:0/3194748014 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fb224104f00 con 0x7fb2241097c0 2024-09-12T02:28:08.123 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:28:08.122+0000 7fb222000640 1 -- 172.21.15.39:0/3194748014 <== mon.0 v2:172.21.15.39:3300/0 4 ==== mgrmap(e 13) ==== 46343+0+0 (secure 0 0 0) 0x7fb214042070 con 0x7fb2241097c0 2024-09-12T02:28:08.124 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:28:08.123+0000 7fb222000640 1 --2- 172.21.15.39:0/3194748014 >> [v2:172.21.15.39:6800/1725006999,v1:172.21.15.39:6801/1725006999] conn(0x7fb2080390c0 0x7fb20803b580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:28:08.124 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:28:08.123+0000 7fb222000640 1 -- 172.21.15.39:0/3194748014 <== mon.0 v2:172.21.15.39:3300/0 5 ==== osd_map(3..3 src has 1..3) ==== 1155+0+0 (secure 0 0 0) 0x7fb21406c8c0 con 0x7fb2241097c0 2024-09-12T02:28:08.124 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:28:08.123+0000 7fb21be00640 1 --2- 172.21.15.39:0/3194748014 >> [v2:172.21.15.39:6800/1725006999,v1:172.21.15.39:6801/1725006999] conn(0x7fb2080390c0 0x7fb20803b580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:28:08.124 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:28:08.124+0000 7fb21be00640 1 --2- 172.21.15.39:0/3194748014 >> [v2:172.21.15.39:6800/1725006999,v1:172.21.15.39:6801/1725006999] conn(0x7fb2080390c0 0x7fb20803b580 secure :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0x7fb20c0098c0 tx=0x7fb20c006db0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:28:08.129 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:28:08.128+0000 7fb222000640 1 -- 172.21.15.39:0/3194748014 <== mon.0 v2:172.21.15.39:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7fb214044e10 con 0x7fb2241097c0 2024-09-12T02:28:08.318 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:28:08.317+0000 7fb22b400640 1 -- 172.21.15.39:0/3194748014 --> [v2:172.21.15.39:6800/1725006999,v1:172.21.15.39:6801/1725006999] -- mgr_command(tid 0: {"prefix": "orch host add", "hostname": "smithi172", "target": ["mon-mgr", ""]}) -- 0x7fb22419a680 con 0x7fb2080390c0 2024-09-12T02:28:09.099 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 02:28:08 smithi039 ceph-mon[30515]: pgmap v4: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-12T02:28:10.099 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 02:28:09 smithi039 ceph-mon[30515]: from='client.14178 -' entity='client.admin' cmd=[{"prefix": "orch host add", "hostname": "smithi172", "target": ["mon-mgr", ""]}]: dispatch 2024-09-12T02:28:10.100 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 02:28:09 smithi039 ceph-mon[30515]: from='mgr.14150 172.21.15.39:0/408627207' entity='mgr.x' 2024-09-12T02:28:10.100 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 02:28:09 smithi039 ceph-mon[30515]: from='mgr.14150 172.21.15.39:0/408627207' entity='mgr.x' 2024-09-12T02:28:10.100 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 02:28:09 smithi039 ceph-mon[30515]: from='mgr.14150 172.21.15.39:0/408627207' entity='mgr.x' 2024-09-12T02:28:10.100 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 02:28:09 smithi039 ceph-mon[30515]: from='mgr.14150 172.21.15.39:0/408627207' entity='mgr.x' 2024-09-12T02:28:10.100 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 02:28:09 smithi039 ceph-mon[30515]: from='mgr.14150 172.21.15.39:0/408627207' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd/host:smithi044", "name": "osd_memory_target"}]: dispatch 2024-09-12T02:28:10.100 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 02:28:09 smithi039 ceph-mon[30515]: from='mgr.14150 172.21.15.39:0/408627207' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-12T02:28:10.100 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 02:28:09 smithi039 ceph-mon[30515]: from='mgr.14150 172.21.15.39:0/408627207' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-12T02:28:11.099 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 02:28:10 smithi039 ceph-mon[30515]: pgmap v5: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-12T02:28:11.099 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 02:28:10 smithi039 ceph-mon[30515]: Updating smithi044:/etc/ceph/ceph.conf 2024-09-12T02:28:11.099 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 02:28:10 smithi039 ceph-mon[30515]: Updating smithi044:/var/lib/ceph/4954ed46-70ae-11ef-bcea-c7b262605968/config/ceph.conf 2024-09-12T02:28:11.100 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 02:28:10 smithi039 ceph-mon[30515]: Updating smithi044:/etc/ceph/ceph.client.admin.keyring 2024-09-12T02:28:11.100 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 02:28:10 smithi039 ceph-mon[30515]: Updating smithi044:/var/lib/ceph/4954ed46-70ae-11ef-bcea-c7b262605968/config/ceph.client.admin.keyring 2024-09-12T02:28:11.100 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 02:28:10 smithi039 ceph-mon[30515]: Deploying cephadm binary to smithi172 2024-09-12T02:28:11.100 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 02:28:10 smithi039 ceph-mon[30515]: from='mgr.14150 172.21.15.39:0/408627207' entity='mgr.x' 2024-09-12T02:28:11.100 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 02:28:10 smithi039 ceph-mon[30515]: from='mgr.14150 172.21.15.39:0/408627207' entity='mgr.x' 2024-09-12T02:28:11.100 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 02:28:10 smithi039 ceph-mon[30515]: from='mgr.14150 172.21.15.39:0/408627207' entity='mgr.x' 2024-09-12T02:28:12.293 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:28:12.292+0000 7fb222000640 1 -- 172.21.15.39:0/3194748014 <== mgr.14150 v2:172.21.15.39:6800/1725006999 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+49 (secure 0 0 0) 0x7fb22419a680 con 0x7fb2080390c0 2024-09-12T02:28:12.293 INFO:teuthology.orchestra.run.smithi039.stdout:Added host 'smithi172' with addr '172.21.15.172' 2024-09-12T02:28:12.295 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:28:12.294+0000 7fb22b400640 1 -- 172.21.15.39:0/3194748014 >> [v2:172.21.15.39:6800/1725006999,v1:172.21.15.39:6801/1725006999] conn(0x7fb2080390c0 msgr2=0x7fb20803b580 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:28:12.295 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:28:12.294+0000 7fb22b400640 1 --2- 172.21.15.39:0/3194748014 >> [v2:172.21.15.39:6800/1725006999,v1:172.21.15.39:6801/1725006999] conn(0x7fb2080390c0 0x7fb20803b580 secure :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0x7fb20c0098c0 tx=0x7fb20c006db0 comp rx=0 tx=0).stop 2024-09-12T02:28:12.295 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:28:12.294+0000 7fb22b400640 1 -- 172.21.15.39:0/3194748014 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fb2241097c0 msgr2=0x7fb224199320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:28:12.296 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:28:12.294+0000 7fb22b400640 1 --2- 172.21.15.39:0/3194748014 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fb2241097c0 0x7fb224199320 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7fb214009230 tx=0x7fb214003d80 comp rx=0 tx=0).stop 2024-09-12T02:28:12.296 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:28:12.294+0000 7fb22b400640 1 -- 172.21.15.39:0/3194748014 shutdown_connections 2024-09-12T02:28:12.296 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:28:12.294+0000 7fb22b400640 1 --2- 172.21.15.39:0/3194748014 >> [v2:172.21.15.39:6800/1725006999,v1:172.21.15.39:6801/1725006999] conn(0x7fb2080390c0 0x7fb20803b580 unknown :-1 s=CLOSED pgs=15 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:28:12.296 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:28:12.294+0000 7fb22b400640 1 --2- 172.21.15.39:0/3194748014 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fb2241097c0 0x7fb224199320 unknown :-1 s=CLOSED pgs=85 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:28:12.296 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:28:12.294+0000 7fb22b400640 1 -- 172.21.15.39:0/3194748014 >> 172.21.15.39:0/3194748014 conn(0x7fb2240ff480 msgr2=0x7fb224100e80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:28:12.296 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:28:12.295+0000 7fb22b400640 1 -- 172.21.15.39:0/3194748014 shutdown_connections 2024-09-12T02:28:12.296 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:28:12.295+0000 7fb22b400640 1 -- 172.21.15.39:0/3194748014 wait complete. 2024-09-12T02:28:12.958 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 02:28:12 smithi039 ceph-mon[30515]: pgmap v6: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-12T02:28:12.958 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 02:28:12 smithi039 ceph-mon[30515]: from='mgr.14150 172.21.15.39:0/408627207' entity='mgr.x' 2024-09-12T02:28:12.958 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 02:28:12 smithi039 ceph-mon[30515]: from='mgr.14150 172.21.15.39:0/408627207' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-12T02:28:12.958 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 02:28:12 smithi039 ceph-mon[30515]: from='mgr.14150 172.21.15.39:0/408627207' entity='mgr.x' 2024-09-12T02:28:12.996 DEBUG:teuthology.orchestra.run.smithi039:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 4954ed46-70ae-11ef-bcea-c7b262605968 -- ceph orch host ls --format=json 2024-09-12T02:28:13.361 INFO:teuthology.orchestra.run.smithi039.stderr:Inferring config /var/lib/ceph/4954ed46-70ae-11ef-bcea-c7b262605968/mon.a/config 2024-09-12T02:28:13.794 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 02:28:13 smithi039 ceph-mon[30515]: Added host smithi172 2024-09-12T02:28:13.794 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 02:28:13 smithi039 ceph-mon[30515]: from='mgr.14150 172.21.15.39:0/408627207' entity='mgr.x' 2024-09-12T02:28:13.794 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 02:28:13 smithi039 ceph-mon[30515]: from='mgr.14150 172.21.15.39:0/408627207' entity='mgr.x' 2024-09-12T02:28:13.908 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:28:13.907+0000 7f8a3a200640 1 -- 172.21.15.39:0/2735472867 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f8a34107580 msgr2=0x7f8a34107960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:28:13.908 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:28:13.907+0000 7f8a3a200640 1 --2- 172.21.15.39:0/2735472867 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f8a34107580 0x7f8a34107960 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7f8a28009880 tx=0x7f8a2802a5d0 comp rx=0 tx=0).stop 2024-09-12T02:28:13.908 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:28:13.907+0000 7f8a3a200640 1 -- 172.21.15.39:0/2735472867 shutdown_connections 2024-09-12T02:28:13.908 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:28:13.907+0000 7f8a3a200640 1 --2- 172.21.15.39:0/2735472867 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f8a34107580 0x7f8a34107960 unknown :-1 s=CLOSED pgs=86 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:28:13.908 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:28:13.907+0000 7f8a3a200640 1 -- 172.21.15.39:0/2735472867 >> 172.21.15.39:0/2735472867 conn(0x7f8a34078260 msgr2=0x7f8a340ff510 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:28:13.908 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:28:13.907+0000 7f8a3a200640 1 -- 172.21.15.39:0/2735472867 shutdown_connections 2024-09-12T02:28:13.908 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:28:13.907+0000 7f8a3a200640 1 -- 172.21.15.39:0/2735472867 wait complete. 2024-09-12T02:28:13.909 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:28:13.908+0000 7f8a3a200640 1 Processor -- start 2024-09-12T02:28:13.909 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:28:13.908+0000 7f8a3a200640 1 -- start start 2024-09-12T02:28:13.909 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:28:13.909+0000 7f8a3a200640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f8a34107580 0x7f8a340744f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:28:13.910 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:28:13.909+0000 7f8a3a200640 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 -- 0x7f8a3410bbb0 con 0x7f8a34107580 2024-09-12T02:28:13.910 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:28:13.909+0000 7f8a38e00640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f8a34107580 0x7f8a340744f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:28:13.910 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:28:13.909+0000 7f8a38e00640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f8a34107580 0x7f8a340744f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.39:3300/0 says I am v2:172.21.15.39:40408/0 (socket says 172.21.15.39:40408) 2024-09-12T02:28:13.910 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:28:13.909+0000 7f8a38e00640 1 -- 172.21.15.39:0/959563913 learned_addr learned my addr 172.21.15.39:0/959563913 (peer_addr_for_me v2:172.21.15.39:0/0) 2024-09-12T02:28:13.910 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:28:13.909+0000 7f8a38e00640 1 -- 172.21.15.39:0/959563913 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8a340763e0 con 0x7f8a34107580 2024-09-12T02:28:13.910 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:28:13.910+0000 7f8a38e00640 1 --2- 172.21.15.39:0/959563913 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f8a34107580 0x7f8a340744f0 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7f8a28009230 tx=0x7f8a28003d80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:28:13.911 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:28:13.910+0000 7f8a31600640 1 -- 172.21.15.39:0/959563913 <== mon.0 v2:172.21.15.39:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f8a2803f070 con 0x7f8a34107580 2024-09-12T02:28:13.911 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:28:13.910+0000 7f8a31600640 1 -- 172.21.15.39:0/959563913 <== mon.0 v2:172.21.15.39:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f8a2803bd40 con 0x7f8a34107580 2024-09-12T02:28:13.911 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:28:13.910+0000 7f8a3a200640 1 -- 172.21.15.39:0/959563913 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f8a34074a30 con 0x7f8a34107580 2024-09-12T02:28:13.911 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:28:13.910+0000 7f8a31600640 1 -- 172.21.15.39:0/959563913 <== mon.0 v2:172.21.15.39:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f8a28035030 con 0x7f8a34107580 2024-09-12T02:28:13.911 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:28:13.910+0000 7f8a3a200640 1 -- 172.21.15.39:0/959563913 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f8a34074ef0 con 0x7f8a34107580 2024-09-12T02:28:13.912 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:28:13.911+0000 7f8a3a200640 1 -- 172.21.15.39:0/959563913 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f8a34102ae0 con 0x7f8a34107580 2024-09-12T02:28:13.912 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:28:13.912+0000 7f8a31600640 1 -- 172.21.15.39:0/959563913 <== mon.0 v2:172.21.15.39:3300/0 4 ==== mgrmap(e 13) ==== 46343+0+0 (secure 0 0 0) 0x7f8a28042070 con 0x7f8a34107580 2024-09-12T02:28:13.912 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:28:13.912+0000 7f8a31600640 1 --2- 172.21.15.39:0/959563913 >> [v2:172.21.15.39:6800/1725006999,v1:172.21.15.39:6801/1725006999] conn(0x7f8a1c0390c0 0x7f8a1c03b580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:28:13.913 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:28:13.912+0000 7f8a31600640 1 -- 172.21.15.39:0/959563913 <== mon.0 v2:172.21.15.39:3300/0 5 ==== osd_map(3..3 src has 1..3) ==== 1155+0+0 (secure 0 0 0) 0x7f8a2806ccd0 con 0x7f8a34107580 2024-09-12T02:28:13.913 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:28:13.912+0000 7f8a33e00640 1 --2- 172.21.15.39:0/959563913 >> [v2:172.21.15.39:6800/1725006999,v1:172.21.15.39:6801/1725006999] conn(0x7f8a1c0390c0 0x7f8a1c03b580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:28:13.913 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:28:13.913+0000 7f8a33e00640 1 --2- 172.21.15.39:0/959563913 >> [v2:172.21.15.39:6800/1725006999,v1:172.21.15.39:6801/1725006999] conn(0x7f8a1c0390c0 0x7f8a1c03b580 secure :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0x7f8a200098c0 tx=0x7f8a20006db0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:28:13.918 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:28:13.917+0000 7f8a31600640 1 -- 172.21.15.39:0/959563913 <== mon.0 v2:172.21.15.39:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7f8a280412c0 con 0x7f8a34107580 2024-09-12T02:28:14.110 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:28:14.109+0000 7f8a3a200640 1 -- 172.21.15.39:0/959563913 --> [v2:172.21.15.39:6800/1725006999,v1:172.21.15.39:6801/1725006999] -- mgr_command(tid 0: {"prefix": "orch host ls", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7f8a34075a20 con 0x7f8a1c0390c0 2024-09-12T02:28:14.111 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:28:14.111+0000 7f8a31600640 1 -- 172.21.15.39:0/959563913 <== mgr.14150 v2:172.21.15.39:6800/1725006999 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+239 (secure 0 0 0) 0x7f8a34075a20 con 0x7f8a1c0390c0 2024-09-12T02:28:14.111 INFO:teuthology.orchestra.run.smithi039.stdout: 2024-09-12T02:28:14.112 INFO:teuthology.orchestra.run.smithi039.stdout:[{"addr": "172.21.15.39", "hostname": "smithi039", "labels": [], "status": ""}, {"addr": "172.21.15.44", "hostname": "smithi044", "labels": [], "status": ""}, {"addr": "172.21.15.172", "hostname": "smithi172", "labels": [], "status": ""}] 2024-09-12T02:28:14.114 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:28:14.113+0000 7f8a3a200640 1 -- 172.21.15.39:0/959563913 >> [v2:172.21.15.39:6800/1725006999,v1:172.21.15.39:6801/1725006999] conn(0x7f8a1c0390c0 msgr2=0x7f8a1c03b580 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:28:14.114 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:28:14.113+0000 7f8a3a200640 1 --2- 172.21.15.39:0/959563913 >> [v2:172.21.15.39:6800/1725006999,v1:172.21.15.39:6801/1725006999] conn(0x7f8a1c0390c0 0x7f8a1c03b580 secure :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0x7f8a200098c0 tx=0x7f8a20006db0 comp rx=0 tx=0).stop 2024-09-12T02:28:14.114 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:28:14.113+0000 7f8a3a200640 1 -- 172.21.15.39:0/959563913 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f8a34107580 msgr2=0x7f8a340744f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:28:14.114 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:28:14.113+0000 7f8a3a200640 1 --2- 172.21.15.39:0/959563913 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f8a34107580 0x7f8a340744f0 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7f8a28009230 tx=0x7f8a28003d80 comp rx=0 tx=0).stop 2024-09-12T02:28:14.114 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:28:14.113+0000 7f8a3a200640 1 -- 172.21.15.39:0/959563913 shutdown_connections 2024-09-12T02:28:14.114 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:28:14.113+0000 7f8a3a200640 1 --2- 172.21.15.39:0/959563913 >> [v2:172.21.15.39:6800/1725006999,v1:172.21.15.39:6801/1725006999] conn(0x7f8a1c0390c0 0x7f8a1c03b580 unknown :-1 s=CLOSED pgs=16 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:28:14.114 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:28:14.113+0000 7f8a3a200640 1 --2- 172.21.15.39:0/959563913 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f8a34107580 0x7f8a340744f0 unknown :-1 s=CLOSED pgs=87 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:28:14.114 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:28:14.113+0000 7f8a3a200640 1 -- 172.21.15.39:0/959563913 >> 172.21.15.39:0/959563913 conn(0x7f8a34078260 msgr2=0x7f8a340fd500 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:28:14.114 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:28:14.113+0000 7f8a3a200640 1 -- 172.21.15.39:0/959563913 shutdown_connections 2024-09-12T02:28:14.114 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:28:14.113+0000 7f8a3a200640 1 -- 172.21.15.39:0/959563913 wait complete. 2024-09-12T02:28:14.822 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 02:28:14 smithi039 ceph-mon[30515]: pgmap v7: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-12T02:28:14.859 INFO:tasks.cephadm:Setting crush tunables to default 2024-09-12T02:28:14.859 DEBUG:teuthology.orchestra.run.smithi039:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 4954ed46-70ae-11ef-bcea-c7b262605968 -- ceph osd crush tunables default 2024-09-12T02:28:15.223 INFO:teuthology.orchestra.run.smithi039.stderr:Inferring config /var/lib/ceph/4954ed46-70ae-11ef-bcea-c7b262605968/mon.a/config 2024-09-12T02:28:15.783 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:28:15.763+0000 7f33f5400640 1 -- 172.21.15.39:0/2078050496 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f33f0107660 msgr2=0x7f33f0107a40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:28:15.784 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:28:15.763+0000 7f33f5400640 1 --2- 172.21.15.39:0/2078050496 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f33f0107660 0x7f33f0107a40 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7f33e0009880 tx=0x7f33e002a5d0 comp rx=0 tx=0).stop 2024-09-12T02:28:15.784 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:28:15.764+0000 7f33f5400640 1 -- 172.21.15.39:0/2078050496 shutdown_connections 2024-09-12T02:28:15.784 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:28:15.764+0000 7f33f5400640 1 --2- 172.21.15.39:0/2078050496 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f33f0107660 0x7f33f0107a40 unknown :-1 s=CLOSED pgs=88 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:28:15.784 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:28:15.764+0000 7f33f5400640 1 -- 172.21.15.39:0/2078050496 >> 172.21.15.39:0/2078050496 conn(0x7f33f00fd290 msgr2=0x7f33f00ff6b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:28:15.784 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:28:15.764+0000 7f33f5400640 1 -- 172.21.15.39:0/2078050496 shutdown_connections 2024-09-12T02:28:15.784 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:28:15.764+0000 7f33f5400640 1 -- 172.21.15.39:0/2078050496 wait complete. 2024-09-12T02:28:15.784 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:28:15.765+0000 7f33f5400640 1 Processor -- start 2024-09-12T02:28:15.784 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:28:15.765+0000 7f33f5400640 1 -- start start 2024-09-12T02:28:15.784 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:28:15.765+0000 7f33f5400640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f33f0107660 0x7f33f0197130 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:28:15.784 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:28:15.765+0000 7f33f5400640 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 -- 0x7f33f010bc90 con 0x7f33f0107660 2024-09-12T02:28:15.784 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:28:15.765+0000 7f33ee800640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f33f0107660 0x7f33f0197130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:28:15.784 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:28:15.765+0000 7f33ee800640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f33f0107660 0x7f33f0197130 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.39:3300/0 says I am v2:172.21.15.39:40436/0 (socket says 172.21.15.39:40436) 2024-09-12T02:28:15.784 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:28:15.765+0000 7f33ee800640 1 -- 172.21.15.39:0/549691537 learned_addr learned my addr 172.21.15.39:0/549691537 (peer_addr_for_me v2:172.21.15.39:0/0) 2024-09-12T02:28:15.785 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:28:15.766+0000 7f33ee800640 1 -- 172.21.15.39:0/549691537 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f33f0197670 con 0x7f33f0107660 2024-09-12T02:28:15.785 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:28:15.766+0000 7f33ee800640 1 --2- 172.21.15.39:0/549691537 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f33f0107660 0x7f33f0197130 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7f33e0009230 tx=0x7f33e0003d40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:28:15.785 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:28:15.766+0000 7f33e7400640 1 -- 172.21.15.39:0/549691537 <== mon.0 v2:172.21.15.39:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f33e003f070 con 0x7f33f0107660 2024-09-12T02:28:15.785 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:28:15.766+0000 7f33f5400640 1 -- 172.21.15.39:0/549691537 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f33f0197900 con 0x7f33f0107660 2024-09-12T02:28:15.785 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:28:15.766+0000 7f33e7400640 1 -- 172.21.15.39:0/549691537 <== mon.0 v2:172.21.15.39:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f33e003bc80 con 0x7f33f0107660 2024-09-12T02:28:15.785 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:28:15.766+0000 7f33e7400640 1 -- 172.21.15.39:0/549691537 <== mon.0 v2:172.21.15.39:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f33e0035030 con 0x7f33f0107660 2024-09-12T02:28:15.785 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:28:15.766+0000 7f33f5400640 1 -- 172.21.15.39:0/549691537 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f33f019ba00 con 0x7f33f0107660 2024-09-12T02:28:15.785 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:28:15.767+0000 7f33e7400640 1 -- 172.21.15.39:0/549691537 <== mon.0 v2:172.21.15.39:3300/0 4 ==== mgrmap(e 13) ==== 46343+0+0 (secure 0 0 0) 0x7f33e0042070 con 0x7f33f0107660 2024-09-12T02:28:15.785 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:28:15.767+0000 7f33f5400640 1 -- 172.21.15.39:0/549691537 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f33f0102cd0 con 0x7f33f0107660 2024-09-12T02:28:15.785 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:28:15.768+0000 7f33e7400640 1 --2- 172.21.15.39:0/549691537 >> [v2:172.21.15.39:6800/1725006999,v1:172.21.15.39:6801/1725006999] conn(0x7f33d40390c0 0x7f33d403b580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:28:15.785 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:28:15.768+0000 7f33e7400640 1 -- 172.21.15.39:0/549691537 <== mon.0 v2:172.21.15.39:3300/0 5 ==== osd_map(3..3 src has 1..3) ==== 1155+0+0 (secure 0 0 0) 0x7f33e006cd80 con 0x7f33f0107660 2024-09-12T02:28:15.785 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:28:15.768+0000 7f33ede00640 1 --2- 172.21.15.39:0/549691537 >> [v2:172.21.15.39:6800/1725006999,v1:172.21.15.39:6801/1725006999] conn(0x7f33d40390c0 0x7f33d403b580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:28:15.786 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:28:15.769+0000 7f33ede00640 1 --2- 172.21.15.39:0/549691537 >> [v2:172.21.15.39:6800/1725006999,v1:172.21.15.39:6801/1725006999] conn(0x7f33d40390c0 0x7f33d403b580 secure :-1 s=READY pgs=17 cs=0 l=1 rev1=1 crypto rx=0x7f33dc0098c0 tx=0x7f33dc006db0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:28:15.786 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:28:15.773+0000 7f33e7400640 1 -- 172.21.15.39:0/549691537 <== mon.0 v2:172.21.15.39:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7f33e00372d0 con 0x7f33f0107660 2024-09-12T02:28:15.964 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:28:15.963+0000 7f33f5400640 1 -- 172.21.15.39:0/549691537 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_command({"prefix": "osd crush tunables", "profile": "default"} v 0) -- 0x7f33f0198490 con 0x7f33f0107660 2024-09-12T02:28:15.964 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 02:28:15 smithi039 ceph-mon[30515]: from='client.14180 -' entity='client.admin' cmd=[{"prefix": "orch host ls", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-09-12T02:28:16.688 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:28:16.687+0000 7f33e7400640 1 -- 172.21.15.39:0/549691537 <== mon.0 v2:172.21.15.39:3300/0 7 ==== mon_command_ack([{"prefix": "osd crush tunables", "profile": "default"}]=0 adjusted tunables profile to default v4) ==== 124+0+0 (secure 0 0 0) 0x7f33e0031dd0 con 0x7f33f0107660 2024-09-12T02:28:16.688 INFO:teuthology.orchestra.run.smithi039.stderr:adjusted tunables profile to default 2024-09-12T02:28:16.690 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:28:16.689+0000 7f33f5400640 1 -- 172.21.15.39:0/549691537 >> [v2:172.21.15.39:6800/1725006999,v1:172.21.15.39:6801/1725006999] conn(0x7f33d40390c0 msgr2=0x7f33d403b580 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:28:16.690 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:28:16.689+0000 7f33f5400640 1 --2- 172.21.15.39:0/549691537 >> [v2:172.21.15.39:6800/1725006999,v1:172.21.15.39:6801/1725006999] conn(0x7f33d40390c0 0x7f33d403b580 secure :-1 s=READY pgs=17 cs=0 l=1 rev1=1 crypto rx=0x7f33dc0098c0 tx=0x7f33dc006db0 comp rx=0 tx=0).stop 2024-09-12T02:28:16.690 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:28:16.689+0000 7f33f5400640 1 -- 172.21.15.39:0/549691537 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f33f0107660 msgr2=0x7f33f0197130 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:28:16.690 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:28:16.689+0000 7f33f5400640 1 --2- 172.21.15.39:0/549691537 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f33f0107660 0x7f33f0197130 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7f33e0009230 tx=0x7f33e0003d40 comp rx=0 tx=0).stop 2024-09-12T02:28:16.690 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:28:16.689+0000 7f33f5400640 1 -- 172.21.15.39:0/549691537 shutdown_connections 2024-09-12T02:28:16.690 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:28:16.689+0000 7f33f5400640 1 --2- 172.21.15.39:0/549691537 >> [v2:172.21.15.39:6800/1725006999,v1:172.21.15.39:6801/1725006999] conn(0x7f33d40390c0 0x7f33d403b580 unknown :-1 s=CLOSED pgs=17 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:28:16.691 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:28:16.689+0000 7f33f5400640 1 --2- 172.21.15.39:0/549691537 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f33f0107660 0x7f33f0197130 unknown :-1 s=CLOSED pgs=89 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:28:16.691 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:28:16.689+0000 7f33f5400640 1 -- 172.21.15.39:0/549691537 >> 172.21.15.39:0/549691537 conn(0x7f33f00fd290 msgr2=0x7f33f00feb50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:28:16.691 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:28:16.690+0000 7f33f5400640 1 -- 172.21.15.39:0/549691537 shutdown_connections 2024-09-12T02:28:16.691 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:28:16.690+0000 7f33f5400640 1 -- 172.21.15.39:0/549691537 wait complete. 2024-09-12T02:28:17.029 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 02:28:16 smithi039 ceph-mon[30515]: pgmap v8: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-12T02:28:17.029 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 02:28:16 smithi039 ceph-mon[30515]: from='client.? 172.21.15.39:0/549691537' entity='client.admin' cmd=[{"prefix": "osd crush tunables", "profile": "default"}]: dispatch 2024-09-12T02:28:17.029 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 02:28:16 smithi039 ceph-mon[30515]: from='mgr.14150 172.21.15.39:0/408627207' entity='mgr.x' 2024-09-12T02:28:17.029 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 02:28:16 smithi039 ceph-mon[30515]: from='mgr.14150 172.21.15.39:0/408627207' entity='mgr.x' 2024-09-12T02:28:17.029 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 02:28:16 smithi039 ceph-mon[30515]: from='mgr.14150 172.21.15.39:0/408627207' entity='mgr.x' 2024-09-12T02:28:17.029 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 02:28:16 smithi039 ceph-mon[30515]: from='mgr.14150 172.21.15.39:0/408627207' entity='mgr.x' 2024-09-12T02:28:17.029 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 02:28:16 smithi039 ceph-mon[30515]: from='mgr.14150 172.21.15.39:0/408627207' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd/host:smithi172", "name": "osd_memory_target"}]: dispatch 2024-09-12T02:28:17.029 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 02:28:16 smithi039 ceph-mon[30515]: from='mgr.14150 172.21.15.39:0/408627207' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-12T02:28:17.029 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 02:28:16 smithi039 ceph-mon[30515]: from='mgr.14150 172.21.15.39:0/408627207' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-12T02:28:17.391 INFO:tasks.cephadm:Adding mon.a on smithi039 2024-09-12T02:28:17.391 INFO:tasks.cephadm:Adding mon.b on smithi044 2024-09-12T02:28:17.391 INFO:tasks.cephadm:Adding mon.c on smithi172 2024-09-12T02:28:17.391 DEBUG:teuthology.orchestra.run.smithi172:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 4954ed46-70ae-11ef-bcea-c7b262605968 -- ceph orch apply mon '3;smithi039:172.21.15.39=a;smithi044:172.21.15.44=b;smithi172:172.21.15.172=c' 2024-09-12T02:28:17.664 INFO:teuthology.orchestra.run.smithi172.stderr:Inferring config /var/lib/ceph/4954ed46-70ae-11ef-bcea-c7b262605968/config/ceph.conf 2024-09-12T02:28:18.084 INFO:teuthology.orchestra.run.smithi172.stderr:2024-09-12T02:28:18.082+0000 7fb4e9c34640 1 -- 172.21.15.172:0/1761853691 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fb4e41027f0 msgr2=0x7fb4e4102bd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:28:18.085 INFO:teuthology.orchestra.run.smithi172.stderr:2024-09-12T02:28:18.082+0000 7fb4e9c34640 1 --2- 172.21.15.172:0/1761853691 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fb4e41027f0 0x7fb4e4102bd0 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0x7fb4d4009880 tx=0x7fb4d402a670 comp rx=0 tx=0).stop 2024-09-12T02:28:18.085 INFO:teuthology.orchestra.run.smithi172.stderr:2024-09-12T02:28:18.082+0000 7fb4e9c34640 1 -- 172.21.15.172:0/1761853691 shutdown_connections 2024-09-12T02:28:18.085 INFO:teuthology.orchestra.run.smithi172.stderr:2024-09-12T02:28:18.082+0000 7fb4e9c34640 1 --2- 172.21.15.172:0/1761853691 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fb4e41027f0 0x7fb4e4102bd0 unknown :-1 s=CLOSED pgs=90 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:28:18.085 INFO:teuthology.orchestra.run.smithi172.stderr:2024-09-12T02:28:18.082+0000 7fb4e9c34640 1 -- 172.21.15.172:0/1761853691 >> 172.21.15.172:0/1761853691 conn(0x7fb4e40fc1b0 msgr2=0x7fb4e40fe5d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:28:18.085 INFO:teuthology.orchestra.run.smithi172.stderr:2024-09-12T02:28:18.082+0000 7fb4e9c34640 1 -- 172.21.15.172:0/1761853691 shutdown_connections 2024-09-12T02:28:18.085 INFO:teuthology.orchestra.run.smithi172.stderr:2024-09-12T02:28:18.082+0000 7fb4e9c34640 1 -- 172.21.15.172:0/1761853691 wait complete. 2024-09-12T02:28:18.085 INFO:teuthology.orchestra.run.smithi172.stderr:2024-09-12T02:28:18.083+0000 7fb4e9c34640 1 Processor -- start 2024-09-12T02:28:18.085 INFO:teuthology.orchestra.run.smithi172.stderr:2024-09-12T02:28:18.083+0000 7fb4e9c34640 1 -- start start 2024-09-12T02:28:18.085 INFO:teuthology.orchestra.run.smithi172.stderr:2024-09-12T02:28:18.083+0000 7fb4e9c34640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fb4e41027f0 0x7fb4e41993c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:28:18.085 INFO:teuthology.orchestra.run.smithi172.stderr:2024-09-12T02:28:18.083+0000 7fb4e9c34640 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 -- 0x7fb4e410bcc0 con 0x7fb4e41027f0 2024-09-12T02:28:18.086 INFO:teuthology.orchestra.run.smithi172.stderr:2024-09-12T02:28:18.084+0000 7fb4e37fe640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fb4e41027f0 0x7fb4e41993c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:28:18.086 INFO:teuthology.orchestra.run.smithi172.stderr:2024-09-12T02:28:18.084+0000 7fb4e37fe640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fb4e41027f0 0x7fb4e41993c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.39:3300/0 says I am v2:172.21.15.172:57386/0 (socket says 172.21.15.172:57386) 2024-09-12T02:28:18.086 INFO:teuthology.orchestra.run.smithi172.stderr:2024-09-12T02:28:18.084+0000 7fb4e37fe640 1 -- 172.21.15.172:0/676310424 learned_addr learned my addr 172.21.15.172:0/676310424 (peer_addr_for_me v2:172.21.15.172:0/0) 2024-09-12T02:28:18.086 INFO:teuthology.orchestra.run.smithi172.stderr:2024-09-12T02:28:18.084+0000 7fb4e37fe640 1 -- 172.21.15.172:0/676310424 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb4e4199900 con 0x7fb4e41027f0 2024-09-12T02:28:18.087 INFO:teuthology.orchestra.run.smithi172.stderr:2024-09-12T02:28:18.085+0000 7fb4e37fe640 1 --2- 172.21.15.172:0/676310424 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fb4e41027f0 0x7fb4e41993c0 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7fb4d4009230 tx=0x7fb4d4003d80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:28:18.087 INFO:teuthology.orchestra.run.smithi172.stderr:2024-09-12T02:28:18.085+0000 7fb4e0ff9640 1 -- 172.21.15.172:0/676310424 <== mon.0 v2:172.21.15.39:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fb4d403f070 con 0x7fb4e41027f0 2024-09-12T02:28:18.087 INFO:teuthology.orchestra.run.smithi172.stderr:2024-09-12T02:28:18.085+0000 7fb4e9c34640 1 -- 172.21.15.172:0/676310424 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb4e4199b90 con 0x7fb4e41027f0 2024-09-12T02:28:18.087 INFO:teuthology.orchestra.run.smithi172.stderr:2024-09-12T02:28:18.085+0000 7fb4e0ff9640 1 -- 172.21.15.172:0/676310424 <== mon.0 v2:172.21.15.39:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fb4d403bd40 con 0x7fb4e41027f0 2024-09-12T02:28:18.087 INFO:teuthology.orchestra.run.smithi172.stderr:2024-09-12T02:28:18.085+0000 7fb4e0ff9640 1 -- 172.21.15.172:0/676310424 <== mon.0 v2:172.21.15.39:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fb4d4035030 con 0x7fb4e41027f0 2024-09-12T02:28:18.087 INFO:teuthology.orchestra.run.smithi172.stderr:2024-09-12T02:28:18.085+0000 7fb4e9c34640 1 -- 172.21.15.172:0/676310424 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb4e4199ff0 con 0x7fb4e41027f0 2024-09-12T02:28:18.087 INFO:teuthology.orchestra.run.smithi172.stderr:2024-09-12T02:28:18.086+0000 7fb4e9c34640 1 -- 172.21.15.172:0/676310424 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fb4e406a710 con 0x7fb4e41027f0 2024-09-12T02:28:18.087 INFO:teuthology.orchestra.run.smithi172.stderr:2024-09-12T02:28:18.086+0000 7fb4e0ff9640 1 -- 172.21.15.172:0/676310424 <== mon.0 v2:172.21.15.39:3300/0 4 ==== mgrmap(e 13) ==== 46343+0+0 (secure 0 0 0) 0x7fb4d4042070 con 0x7fb4e41027f0 2024-09-12T02:28:18.088 INFO:teuthology.orchestra.run.smithi172.stderr:2024-09-12T02:28:18.086+0000 7fb4e0ff9640 1 --2- 172.21.15.172:0/676310424 >> [v2:172.21.15.39:6800/1725006999,v1:172.21.15.39:6801/1725006999] conn(0x7fb4cc0390c0 0x7fb4cc03b580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:28:18.088 INFO:teuthology.orchestra.run.smithi172.stderr:2024-09-12T02:28:18.086+0000 7fb4e0ff9640 1 -- 172.21.15.172:0/676310424 <== mon.0 v2:172.21.15.39:3300/0 5 ==== osd_map(4..4 src has 1..4) ==== 1155+0+0 (secure 0 0 0) 0x7fb4d406ed10 con 0x7fb4e41027f0 2024-09-12T02:28:18.088 INFO:teuthology.orchestra.run.smithi172.stderr:2024-09-12T02:28:18.087+0000 7fb4e2ffd640 1 --2- 172.21.15.172:0/676310424 >> [v2:172.21.15.39:6800/1725006999,v1:172.21.15.39:6801/1725006999] conn(0x7fb4cc0390c0 0x7fb4cc03b580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:28:18.088 INFO:teuthology.orchestra.run.smithi172.stderr:2024-09-12T02:28:18.087+0000 7fb4e2ffd640 1 --2- 172.21.15.172:0/676310424 >> [v2:172.21.15.39:6800/1725006999,v1:172.21.15.39:6801/1725006999] conn(0x7fb4cc0390c0 0x7fb4cc03b580 secure :-1 s=READY pgs=18 cs=0 l=1 rev1=1 crypto rx=0x7fb4d80098c0 tx=0x7fb4d8006db0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:28:18.093 INFO:teuthology.orchestra.run.smithi172.stderr:2024-09-12T02:28:18.093+0000 7fb4e0ff9640 1 -- 172.21.15.172:0/676310424 <== mon.0 v2:172.21.15.39:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7fb4d4036df0 con 0x7fb4e41027f0 2024-09-12T02:28:18.099 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 02:28:17 smithi039 ceph-mon[30515]: Updating smithi172:/etc/ceph/ceph.conf 2024-09-12T02:28:18.099 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 02:28:17 smithi039 ceph-mon[30515]: Updating smithi172:/var/lib/ceph/4954ed46-70ae-11ef-bcea-c7b262605968/config/ceph.conf 2024-09-12T02:28:18.099 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 02:28:17 smithi039 ceph-mon[30515]: from='client.? 172.21.15.39:0/549691537' entity='client.admin' cmd='[{"prefix": "osd crush tunables", "profile": "default"}]': finished 2024-09-12T02:28:18.100 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 02:28:17 smithi039 ceph-mon[30515]: osdmap e4: 0 total, 0 up, 0 in 2024-09-12T02:28:18.100 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 02:28:17 smithi039 ceph-mon[30515]: from='mgr.14150 172.21.15.39:0/408627207' entity='mgr.x' 2024-09-12T02:28:18.100 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 02:28:17 smithi039 ceph-mon[30515]: from='mgr.14150 172.21.15.39:0/408627207' entity='mgr.x' 2024-09-12T02:28:18.100 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 02:28:17 smithi039 ceph-mon[30515]: from='mgr.14150 172.21.15.39:0/408627207' entity='mgr.x' 2024-09-12T02:28:18.269 INFO:teuthology.orchestra.run.smithi172.stderr:2024-09-12T02:28:18.268+0000 7fb4e9c34640 1 -- 172.21.15.172:0/676310424 --> [v2:172.21.15.39:6800/1725006999,v1:172.21.15.39:6801/1725006999] -- mgr_command(tid 0: {"prefix": "orch apply", "service_type": "mon", "placement": "3;smithi039:172.21.15.39=a;smithi044:172.21.15.44=b;smithi172:172.21.15.172=c", "target": ["mon-mgr", ""]}) -- 0x7fb4e41080c0 con 0x7fb4cc0390c0 2024-09-12T02:28:18.276 INFO:teuthology.orchestra.run.smithi172.stderr:2024-09-12T02:28:18.275+0000 7fb4e0ff9640 1 -- 172.21.15.172:0/676310424 <== mgr.14150 v2:172.21.15.39:6800/1725006999 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+24 (secure 0 0 0) 0x7fb4e41080c0 con 0x7fb4cc0390c0 2024-09-12T02:28:18.276 INFO:teuthology.orchestra.run.smithi172.stdout:Scheduled mon update... 2024-09-12T02:28:18.278 INFO:teuthology.orchestra.run.smithi172.stderr:2024-09-12T02:28:18.277+0000 7fb4e9c34640 1 -- 172.21.15.172:0/676310424 >> [v2:172.21.15.39:6800/1725006999,v1:172.21.15.39:6801/1725006999] conn(0x7fb4cc0390c0 msgr2=0x7fb4cc03b580 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:28:18.278 INFO:teuthology.orchestra.run.smithi172.stderr:2024-09-12T02:28:18.277+0000 7fb4e9c34640 1 --2- 172.21.15.172:0/676310424 >> [v2:172.21.15.39:6800/1725006999,v1:172.21.15.39:6801/1725006999] conn(0x7fb4cc0390c0 0x7fb4cc03b580 secure :-1 s=READY pgs=18 cs=0 l=1 rev1=1 crypto rx=0x7fb4d80098c0 tx=0x7fb4d8006db0 comp rx=0 tx=0).stop 2024-09-12T02:28:18.278 INFO:teuthology.orchestra.run.smithi172.stderr:2024-09-12T02:28:18.277+0000 7fb4e9c34640 1 -- 172.21.15.172:0/676310424 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fb4e41027f0 msgr2=0x7fb4e41993c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:28:18.278 INFO:teuthology.orchestra.run.smithi172.stderr:2024-09-12T02:28:18.277+0000 7fb4e9c34640 1 --2- 172.21.15.172:0/676310424 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fb4e41027f0 0x7fb4e41993c0 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7fb4d4009230 tx=0x7fb4d4003d80 comp rx=0 tx=0).stop 2024-09-12T02:28:18.278 INFO:teuthology.orchestra.run.smithi172.stderr:2024-09-12T02:28:18.277+0000 7fb4e9c34640 1 -- 172.21.15.172:0/676310424 shutdown_connections 2024-09-12T02:28:18.278 INFO:teuthology.orchestra.run.smithi172.stderr:2024-09-12T02:28:18.277+0000 7fb4e9c34640 1 --2- 172.21.15.172:0/676310424 >> [v2:172.21.15.39:6800/1725006999,v1:172.21.15.39:6801/1725006999] conn(0x7fb4cc0390c0 0x7fb4cc03b580 unknown :-1 s=CLOSED pgs=18 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:28:18.278 INFO:teuthology.orchestra.run.smithi172.stderr:2024-09-12T02:28:18.277+0000 7fb4e9c34640 1 --2- 172.21.15.172:0/676310424 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fb4e41027f0 0x7fb4e41993c0 unknown :-1 s=CLOSED pgs=91 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:28:18.279 INFO:teuthology.orchestra.run.smithi172.stderr:2024-09-12T02:28:18.277+0000 7fb4e9c34640 1 -- 172.21.15.172:0/676310424 >> 172.21.15.172:0/676310424 conn(0x7fb4e40fc1b0 msgr2=0x7fb4e41079b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:28:18.279 INFO:teuthology.orchestra.run.smithi172.stderr:2024-09-12T02:28:18.278+0000 7fb4e9c34640 1 -- 172.21.15.172:0/676310424 shutdown_connections 2024-09-12T02:28:18.279 INFO:teuthology.orchestra.run.smithi172.stderr:2024-09-12T02:28:18.278+0000 7fb4e9c34640 1 -- 172.21.15.172:0/676310424 wait complete. 2024-09-12T02:28:18.892 DEBUG:teuthology.orchestra.run.smithi044:mon.b> sudo journalctl -f -n 0 -u ceph-4954ed46-70ae-11ef-bcea-c7b262605968@mon.b.service 2024-09-12T02:28:18.895 DEBUG:teuthology.orchestra.run.smithi172:mon.c> sudo journalctl -f -n 0 -u ceph-4954ed46-70ae-11ef-bcea-c7b262605968@mon.c.service 2024-09-12T02:28:18.898 INFO:tasks.cephadm:Waiting for 3 mons in monmap... 2024-09-12T02:28:18.898 DEBUG:teuthology.orchestra.run.smithi172:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 4954ed46-70ae-11ef-bcea-c7b262605968 -- ceph mon dump -f json 2024-09-12T02:28:19.100 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 02:28:18 smithi039 ceph-mon[30515]: pgmap v10: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-12T02:28:19.100 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 02:28:18 smithi039 ceph-mon[30515]: Updating smithi172:/etc/ceph/ceph.client.admin.keyring 2024-09-12T02:28:19.100 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 02:28:18 smithi039 ceph-mon[30515]: Updating smithi172:/var/lib/ceph/4954ed46-70ae-11ef-bcea-c7b262605968/config/ceph.client.admin.keyring 2024-09-12T02:28:19.100 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 02:28:18 smithi039 ceph-mon[30515]: from='client.14184 -' entity='client.admin' cmd=[{"prefix": "orch apply", "service_type": "mon", "placement": "3;smithi039:172.21.15.39=a;smithi044:172.21.15.44=b;smithi172:172.21.15.172=c", "target": ["mon-mgr", ""]}]: dispatch 2024-09-12T02:28:19.100 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 02:28:18 smithi039 ceph-mon[30515]: Saving service mon spec with placement smithi039:172.21.15.39=a;smithi044:172.21.15.44=b;smithi172:172.21.15.172=c;count:3 2024-09-12T02:28:19.100 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 02:28:18 smithi039 ceph-mon[30515]: from='mgr.14150 172.21.15.39:0/408627207' entity='mgr.x' 2024-09-12T02:28:19.100 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 02:28:18 smithi039 ceph-mon[30515]: from='mgr.14150 172.21.15.39:0/408627207' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-12T02:28:19.100 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 02:28:18 smithi039 ceph-mon[30515]: from='mgr.14150 172.21.15.39:0/408627207' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-12T02:28:19.100 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 02:28:18 smithi039 ceph-mon[30515]: from='mgr.14150 172.21.15.39:0/408627207' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-12T02:28:19.100 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 02:28:18 smithi039 ceph-mon[30515]: from='mgr.14150 172.21.15.39:0/408627207' entity='mgr.x' 2024-09-12T02:28:19.100 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 02:28:18 smithi039 ceph-mon[30515]: from='mgr.14150 172.21.15.39:0/408627207' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2024-09-12T02:28:19.101 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 02:28:18 smithi039 ceph-mon[30515]: from='mgr.14150 172.21.15.39:0/408627207' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-12T02:28:19.101 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 02:28:18 smithi039 ceph-mon[30515]: Deploying daemon mon.c on smithi172 2024-09-12T02:28:19.661 INFO:teuthology.orchestra.run.smithi172.stderr:Inferring config /var/lib/ceph/4954ed46-70ae-11ef-bcea-c7b262605968/config/ceph.conf 2024-09-12T02:28:20.044 INFO:teuthology.orchestra.run.smithi172.stderr:2024-09-12T02:28:20.032+0000 7fba33785640 1 -- 172.21.15.172:0/2159596637 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fba2c106540 msgr2=0x7fba2c106920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:28:20.044 INFO:teuthology.orchestra.run.smithi172.stderr:2024-09-12T02:28:20.032+0000 7fba33785640 1 --2- 172.21.15.172:0/2159596637 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fba2c106540 0x7fba2c106920 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0x7fba1c009810 tx=0x7fba1c02a540 comp rx=0 tx=0).stop 2024-09-12T02:28:20.044 INFO:teuthology.orchestra.run.smithi172.stderr:2024-09-12T02:28:20.032+0000 7fba33785640 1 -- 172.21.15.172:0/2159596637 shutdown_connections 2024-09-12T02:28:20.044 INFO:teuthology.orchestra.run.smithi172.stderr:2024-09-12T02:28:20.032+0000 7fba33785640 1 --2- 172.21.15.172:0/2159596637 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fba2c106540 0x7fba2c106920 unknown :-1 s=CLOSED pgs=92 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:28:20.044 INFO:teuthology.orchestra.run.smithi172.stderr:2024-09-12T02:28:20.032+0000 7fba33785640 1 -- 172.21.15.172:0/2159596637 >> 172.21.15.172:0/2159596637 conn(0x7fba2c077310 msgr2=0x7fba2c0fe640 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:28:20.044 INFO:teuthology.orchestra.run.smithi172.stderr:2024-09-12T02:28:20.033+0000 7fba33785640 1 -- 172.21.15.172:0/2159596637 shutdown_connections 2024-09-12T02:28:20.044 INFO:teuthology.orchestra.run.smithi172.stderr:2024-09-12T02:28:20.033+0000 7fba33785640 1 -- 172.21.15.172:0/2159596637 wait complete. 2024-09-12T02:28:20.044 INFO:teuthology.orchestra.run.smithi172.stderr:2024-09-12T02:28:20.033+0000 7fba33785640 1 Processor -- start 2024-09-12T02:28:20.044 INFO:teuthology.orchestra.run.smithi172.stderr:2024-09-12T02:28:20.033+0000 7fba33785640 1 -- start start 2024-09-12T02:28:20.044 INFO:teuthology.orchestra.run.smithi172.stderr:2024-09-12T02:28:20.033+0000 7fba33785640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fba2c106540 0x7fba2c197110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:28:20.045 INFO:teuthology.orchestra.run.smithi172.stderr:2024-09-12T02:28:20.033+0000 7fba33785640 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 -- 0x7fba2c10ab70 con 0x7fba2c106540 2024-09-12T02:28:20.045 INFO:teuthology.orchestra.run.smithi172.stderr:2024-09-12T02:28:20.034+0000 7fba31521640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fba2c106540 0x7fba2c197110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:28:20.045 INFO:teuthology.orchestra.run.smithi172.stderr:2024-09-12T02:28:20.034+0000 7fba31521640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fba2c106540 0x7fba2c197110 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.39:3300/0 says I am v2:172.21.15.172:57396/0 (socket says 172.21.15.172:57396) 2024-09-12T02:28:20.045 INFO:teuthology.orchestra.run.smithi172.stderr:2024-09-12T02:28:20.034+0000 7fba31521640 1 -- 172.21.15.172:0/955370917 learned_addr learned my addr 172.21.15.172:0/955370917 (peer_addr_for_me v2:172.21.15.172:0/0) 2024-09-12T02:28:20.045 INFO:teuthology.orchestra.run.smithi172.stderr:2024-09-12T02:28:20.034+0000 7fba31521640 1 -- 172.21.15.172:0/955370917 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fba2c197650 con 0x7fba2c106540 2024-09-12T02:28:20.045 INFO:teuthology.orchestra.run.smithi172.stderr:2024-09-12T02:28:20.035+0000 7fba31521640 1 --2- 172.21.15.172:0/955370917 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fba2c106540 0x7fba2c197110 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7fba1c0045e0 tx=0x7fba1c004610 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:28:20.045 INFO:teuthology.orchestra.run.smithi172.stderr:2024-09-12T02:28:20.035+0000 7fba227fc640 1 -- 172.21.15.172:0/955370917 <== mon.0 v2:172.21.15.39:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fba1c030e70 con 0x7fba2c106540 2024-09-12T02:28:20.045 INFO:teuthology.orchestra.run.smithi172.stderr:2024-09-12T02:28:20.035+0000 7fba33785640 1 -- 172.21.15.172:0/955370917 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fba2c1978e0 con 0x7fba2c106540 2024-09-12T02:28:20.045 INFO:teuthology.orchestra.run.smithi172.stderr:2024-09-12T02:28:20.035+0000 7fba227fc640 1 -- 172.21.15.172:0/955370917 <== mon.0 v2:172.21.15.39:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fba1c0318e0 con 0x7fba2c106540 2024-09-12T02:28:20.045 INFO:teuthology.orchestra.run.smithi172.stderr:2024-09-12T02:28:20.035+0000 7fba227fc640 1 -- 172.21.15.172:0/955370917 <== mon.0 v2:172.21.15.39:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fba1c0049c0 con 0x7fba2c106540 2024-09-12T02:28:20.045 INFO:teuthology.orchestra.run.smithi172.stderr:2024-09-12T02:28:20.035+0000 7fba33785640 1 -- 172.21.15.172:0/955370917 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fba2c19b9e0 con 0x7fba2c106540 2024-09-12T02:28:20.045 INFO:teuthology.orchestra.run.smithi172.stderr:2024-09-12T02:28:20.036+0000 7fba33785640 1 -- 172.21.15.172:0/955370917 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fba2c101bb0 con 0x7fba2c106540 2024-09-12T02:28:20.045 INFO:teuthology.orchestra.run.smithi172.stderr:2024-09-12T02:28:20.036+0000 7fba227fc640 1 -- 172.21.15.172:0/955370917 <== mon.0 v2:172.21.15.39:3300/0 4 ==== mgrmap(e 13) ==== 46343+0+0 (secure 0 0 0) 0x7fba1c039040 con 0x7fba2c106540 2024-09-12T02:28:20.045 INFO:teuthology.orchestra.run.smithi172.stderr:2024-09-12T02:28:20.036+0000 7fba227fc640 1 --2- 172.21.15.172:0/955370917 >> [v2:172.21.15.39:6800/1725006999,v1:172.21.15.39:6801/1725006999] conn(0x7fba18039060 0x7fba1803b520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:28:20.046 INFO:teuthology.orchestra.run.smithi172.stderr:2024-09-12T02:28:20.036+0000 7fba227fc640 1 -- 172.21.15.172:0/955370917 <== mon.0 v2:172.21.15.39:3300/0 5 ==== osd_map(4..4 src has 1..4) ==== 1155+0+0 (secure 0 0 0) 0x7fba1c06d2a0 con 0x7fba2c106540 2024-09-12T02:28:20.046 INFO:teuthology.orchestra.run.smithi172.stderr:2024-09-12T02:28:20.036+0000 7fba30d20640 1 --2- 172.21.15.172:0/955370917 >> [v2:172.21.15.39:6800/1725006999,v1:172.21.15.39:6801/1725006999] conn(0x7fba18039060 0x7fba1803b520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:28:20.046 INFO:teuthology.orchestra.run.smithi172.stderr:2024-09-12T02:28:20.037+0000 7fba30d20640 1 --2- 172.21.15.172:0/955370917 >> [v2:172.21.15.39:6800/1725006999,v1:172.21.15.39:6801/1725006999] conn(0x7fba18039060 0x7fba1803b520 secure :-1 s=READY pgs=19 cs=0 l=1 rev1=1 crypto rx=0x7fba280098c0 tx=0x7fba28006db0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:28:20.046 INFO:teuthology.orchestra.run.smithi172.stderr:2024-09-12T02:28:20.042+0000 7fba227fc640 1 -- 172.21.15.172:0/955370917 <== mon.0 v2:172.21.15.39:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7fba1c040030 con 0x7fba2c106540 2024-09-12T02:28:20.099 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 02:28:19 smithi039 ceph-mon[30515]: pgmap v11: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-12T02:28:20.279 INFO:teuthology.orchestra.run.smithi172.stderr:2024-09-12T02:28:20.278+0000 7fba33785640 1 -- 172.21.15.172:0/955370917 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_command({"prefix": "mon dump", "format": "json"} v 0) -- 0x7fba2c198470 con 0x7fba2c106540 2024-09-12T02:28:20.280 INFO:teuthology.orchestra.run.smithi172.stderr:2024-09-12T02:28:20.279+0000 7fba227fc640 1 -- 172.21.15.172:0/955370917 <== mon.0 v2:172.21.15.39:3300/0 7 ==== mon_command_ack([{"prefix": "mon dump", "format": "json"}]=0 dumped monmap epoch 1 v1) ==== 95+0+745 (secure 0 0 0) 0x7fba1c037d70 con 0x7fba2c106540 2024-09-12T02:28:20.280 INFO:teuthology.orchestra.run.smithi172.stdout: 2024-09-12T02:28:20.280 INFO:teuthology.orchestra.run.smithi172.stdout:{"epoch":1,"fsid":"4954ed46-70ae-11ef-bcea-c7b262605968","modified":"2024-09-12T02:26:39.333323Z","created":"2024-09-12T02:26:39.333323Z","min_mon_release":19,"min_mon_release_name":"squid","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks: ":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"],"optional":[]},"mons":[{"rank":0,"name":"a","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:3300","nonce":0},{"type":"v1","addr":"172.21.15.39:6789","nonce":0}]},"addr":"172.21.15.39:6789/0","public_addr":"172.21.15.39:6789/0","priority":0,"weight":0,"crush_location":"{}"}],"quorum":[0]} 2024-09-12T02:28:20.280 INFO:teuthology.orchestra.run.smithi172.stderr:dumped monmap epoch 1 2024-09-12T02:28:20.282 INFO:teuthology.orchestra.run.smithi172.stderr:2024-09-12T02:28:20.281+0000 7fba33785640 1 -- 172.21.15.172:0/955370917 >> [v2:172.21.15.39:6800/1725006999,v1:172.21.15.39:6801/1725006999] conn(0x7fba18039060 msgr2=0x7fba1803b520 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:28:20.282 INFO:teuthology.orchestra.run.smithi172.stderr:2024-09-12T02:28:20.281+0000 7fba33785640 1 --2- 172.21.15.172:0/955370917 >> [v2:172.21.15.39:6800/1725006999,v1:172.21.15.39:6801/1725006999] conn(0x7fba18039060 0x7fba1803b520 secure :-1 s=READY pgs=19 cs=0 l=1 rev1=1 crypto rx=0x7fba280098c0 tx=0x7fba28006db0 comp rx=0 tx=0).stop 2024-09-12T02:28:20.282 INFO:teuthology.orchestra.run.smithi172.stderr:2024-09-12T02:28:20.281+0000 7fba33785640 1 -- 172.21.15.172:0/955370917 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fba2c106540 msgr2=0x7fba2c197110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:28:20.282 INFO:teuthology.orchestra.run.smithi172.stderr:2024-09-12T02:28:20.281+0000 7fba33785640 1 --2- 172.21.15.172:0/955370917 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fba2c106540 0x7fba2c197110 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7fba1c0045e0 tx=0x7fba1c004610 comp rx=0 tx=0).stop 2024-09-12T02:28:20.282 INFO:teuthology.orchestra.run.smithi172.stderr:2024-09-12T02:28:20.281+0000 7fba33785640 1 -- 172.21.15.172:0/955370917 shutdown_connections 2024-09-12T02:28:20.282 INFO:teuthology.orchestra.run.smithi172.stderr:2024-09-12T02:28:20.281+0000 7fba33785640 1 --2- 172.21.15.172:0/955370917 >> [v2:172.21.15.39:6800/1725006999,v1:172.21.15.39:6801/1725006999] conn(0x7fba18039060 0x7fba1803b520 unknown :-1 s=CLOSED pgs=19 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:28:20.282 INFO:teuthology.orchestra.run.smithi172.stderr:2024-09-12T02:28:20.281+0000 7fba33785640 1 --2- 172.21.15.172:0/955370917 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fba2c106540 0x7fba2c197110 unknown :-1 s=CLOSED pgs=93 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:28:20.282 INFO:teuthology.orchestra.run.smithi172.stderr:2024-09-12T02:28:20.281+0000 7fba33785640 1 -- 172.21.15.172:0/955370917 >> 172.21.15.172:0/955370917 conn(0x7fba2c077310 msgr2=0x7fba2c0696b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:28:20.283 INFO:teuthology.orchestra.run.smithi172.stderr:2024-09-12T02:28:20.281+0000 7fba33785640 1 -- 172.21.15.172:0/955370917 shutdown_connections 2024-09-12T02:28:20.283 INFO:teuthology.orchestra.run.smithi172.stderr:2024-09-12T02:28:20.281+0000 7fba33785640 1 -- 172.21.15.172:0/955370917 wait complete. 2024-09-12T02:28:21.099 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 02:28:20 smithi039 ceph-mon[30515]: from='client.? 172.21.15.172:0/955370917' entity='client.admin' cmd=[{"prefix": "mon dump", "format": "json"}]: dispatch 2024-09-12T02:28:22.003 INFO:tasks.cephadm:Waiting for 3 mons in monmap... 2024-09-12T02:28:22.003 DEBUG:teuthology.orchestra.run.smithi172:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 4954ed46-70ae-11ef-bcea-c7b262605968 -- ceph mon dump -f json 2024-09-12T02:28:22.099 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 02:28:21 smithi039 ceph-mon[30515]: pgmap v12: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-12T02:28:22.389 INFO:teuthology.orchestra.run.smithi172.stderr:Inferring config /var/lib/ceph/4954ed46-70ae-11ef-bcea-c7b262605968/mon.c/config 2024-09-12T02:28:23.069 INFO:teuthology.orchestra.run.smithi172.stderr:2024-09-12T02:28:23.067+0000 7fcd372d4640 1 -- 172.21.15.172:0/3139592261 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fcd30102840 msgr2=0x7fcd30102c20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:28:23.070 INFO:teuthology.orchestra.run.smithi172.stderr:2024-09-12T02:28:23.067+0000 7fcd372d4640 1 --2- 172.21.15.172:0/3139592261 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fcd30102840 0x7fcd30102c20 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0x7fcd20009880 tx=0x7fcd2002a670 comp rx=0 tx=0).stop 2024-09-12T02:28:23.070 INFO:teuthology.orchestra.run.smithi172.stderr:2024-09-12T02:28:23.067+0000 7fcd372d4640 1 -- 172.21.15.172:0/3139592261 shutdown_connections 2024-09-12T02:28:23.070 INFO:teuthology.orchestra.run.smithi172.stderr:2024-09-12T02:28:23.067+0000 7fcd372d4640 1 --2- 172.21.15.172:0/3139592261 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fcd30102840 0x7fcd30102c20 unknown :-1 s=CLOSED pgs=94 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:28:23.070 INFO:teuthology.orchestra.run.smithi172.stderr:2024-09-12T02:28:23.067+0000 7fcd372d4640 1 -- 172.21.15.172:0/3139592261 >> 172.21.15.172:0/3139592261 conn(0x7fcd300fc280 msgr2=0x7fcd300fe6a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:28:23.070 INFO:teuthology.orchestra.run.smithi172.stderr:2024-09-12T02:28:23.067+0000 7fcd372d4640 1 -- 172.21.15.172:0/3139592261 shutdown_connections 2024-09-12T02:28:23.070 INFO:teuthology.orchestra.run.smithi172.stderr:2024-09-12T02:28:23.067+0000 7fcd372d4640 1 -- 172.21.15.172:0/3139592261 wait complete. 2024-09-12T02:28:23.070 INFO:teuthology.orchestra.run.smithi172.stderr:2024-09-12T02:28:23.068+0000 7fcd372d4640 1 Processor -- start 2024-09-12T02:28:23.070 INFO:teuthology.orchestra.run.smithi172.stderr:2024-09-12T02:28:23.068+0000 7fcd372d4640 1 -- start start 2024-09-12T02:28:23.070 INFO:teuthology.orchestra.run.smithi172.stderr:2024-09-12T02:28:23.068+0000 7fcd372d4640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fcd30102840 0x7fcd301972a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:28:23.070 INFO:teuthology.orchestra.run.smithi172.stderr:2024-09-12T02:28:23.068+0000 7fcd372d4640 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 -- 0x7fcd3010bdb0 con 0x7fcd30102840 2024-09-12T02:28:23.070 INFO:teuthology.orchestra.run.smithi172.stderr:2024-09-12T02:28:23.069+0000 7fcd35070640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fcd30102840 0x7fcd301972a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:28:23.070 INFO:teuthology.orchestra.run.smithi172.stderr:2024-09-12T02:28:23.069+0000 7fcd35070640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fcd30102840 0x7fcd301972a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.39:3300/0 says I am v2:172.21.15.172:57416/0 (socket says 172.21.15.172:57416) 2024-09-12T02:28:23.070 INFO:teuthology.orchestra.run.smithi172.stderr:2024-09-12T02:28:23.069+0000 7fcd35070640 1 -- 172.21.15.172:0/3055283425 learned_addr learned my addr 172.21.15.172:0/3055283425 (peer_addr_for_me v2:172.21.15.172:0/0) 2024-09-12T02:28:23.070 INFO:teuthology.orchestra.run.smithi172.stderr:2024-09-12T02:28:23.069+0000 7fcd35070640 1 -- 172.21.15.172:0/3055283425 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fcd301977e0 con 0x7fcd30102840 2024-09-12T02:28:23.071 INFO:teuthology.orchestra.run.smithi172.stderr:2024-09-12T02:28:23.069+0000 7fcd35070640 1 --2- 172.21.15.172:0/3055283425 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fcd30102840 0x7fcd301972a0 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0x7fcd20009230 tx=0x7fcd20003d40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:28:23.071 INFO:teuthology.orchestra.run.smithi172.stderr:2024-09-12T02:28:23.070+0000 7fcd267fc640 1 -- 172.21.15.172:0/3055283425 <== mon.0 v2:172.21.15.39:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fcd2003f070 con 0x7fcd30102840 2024-09-12T02:28:23.072 INFO:teuthology.orchestra.run.smithi172.stderr:2024-09-12T02:28:23.070+0000 7fcd372d4640 1 -- 172.21.15.172:0/3055283425 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fcd30197a70 con 0x7fcd30102840 2024-09-12T02:28:23.072 INFO:teuthology.orchestra.run.smithi172.stderr:2024-09-12T02:28:23.070+0000 7fcd267fc640 1 -- 172.21.15.172:0/3055283425 <== mon.0 v2:172.21.15.39:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fcd2003bc80 con 0x7fcd30102840 2024-09-12T02:28:23.072 INFO:teuthology.orchestra.run.smithi172.stderr:2024-09-12T02:28:23.070+0000 7fcd267fc640 1 -- 172.21.15.172:0/3055283425 <== mon.0 v2:172.21.15.39:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fcd20035030 con 0x7fcd30102840 2024-09-12T02:28:23.072 INFO:teuthology.orchestra.run.smithi172.stderr:2024-09-12T02:28:23.070+0000 7fcd372d4640 1 -- 172.21.15.172:0/3055283425 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fcd30197ed0 con 0x7fcd30102840 2024-09-12T02:28:23.072 INFO:teuthology.orchestra.run.smithi172.stderr:2024-09-12T02:28:23.071+0000 7fcd267fc640 1 -- 172.21.15.172:0/3055283425 <== mon.0 v2:172.21.15.39:3300/0 4 ==== mgrmap(e 13) ==== 46343+0+0 (secure 0 0 0) 0x7fcd20042070 con 0x7fcd30102840 2024-09-12T02:28:23.072 INFO:teuthology.orchestra.run.smithi172.stderr:2024-09-12T02:28:23.071+0000 7fcd267fc640 1 --2- 172.21.15.172:0/3055283425 >> [v2:172.21.15.39:6800/1725006999,v1:172.21.15.39:6801/1725006999] conn(0x7fcd1c039060 0x7fcd1c03b520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:28:23.072 INFO:teuthology.orchestra.run.smithi172.stderr:2024-09-12T02:28:23.071+0000 7fcd267fc640 1 -- 172.21.15.172:0/3055283425 <== mon.0 v2:172.21.15.39:3300/0 5 ==== osd_map(4..4 src has 1..4) ==== 1155+0+0 (secure 0 0 0) 0x7fcd2006cce0 con 0x7fcd30102840 2024-09-12T02:28:23.072 INFO:teuthology.orchestra.run.smithi172.stderr:2024-09-12T02:28:23.071+0000 7fcd372d4640 1 -- 172.21.15.172:0/3055283425 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fcd3006a4f0 con 0x7fcd30102840 2024-09-12T02:28:23.073 INFO:teuthology.orchestra.run.smithi172.stderr:2024-09-12T02:28:23.072+0000 7fcd3486f640 1 --2- 172.21.15.172:0/3055283425 >> [v2:172.21.15.39:6800/1725006999,v1:172.21.15.39:6801/1725006999] conn(0x7fcd1c039060 0x7fcd1c03b520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:28:23.073 INFO:teuthology.orchestra.run.smithi172.stderr:2024-09-12T02:28:23.072+0000 7fcd3486f640 1 --2- 172.21.15.172:0/3055283425 >> [v2:172.21.15.39:6800/1725006999,v1:172.21.15.39:6801/1725006999] conn(0x7fcd1c039060 0x7fcd1c03b520 secure :-1 s=READY pgs=20 cs=0 l=1 rev1=1 crypto rx=0x7fcd2c0098c0 tx=0x7fcd2c006db0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:28:23.077 INFO:teuthology.orchestra.run.smithi172.stderr:2024-09-12T02:28:23.077+0000 7fcd267fc640 1 -- 172.21.15.172:0/3055283425 <== mon.0 v2:172.21.15.39:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7fcd200372d0 con 0x7fcd30102840 2024-09-12T02:28:23.263 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 12 02:28:23 smithi172 systemd[1]: Starting Ceph mon.c for 4954ed46-70ae-11ef-bcea-c7b262605968... 2024-09-12T02:28:23.325 INFO:teuthology.orchestra.run.smithi172.stderr:2024-09-12T02:28:23.324+0000 7fcd372d4640 1 -- 172.21.15.172:0/3055283425 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_command({"prefix": "mon dump", "format": "json"} v 0) -- 0x7fcd30198600 con 0x7fcd30102840 2024-09-12T02:28:23.325 INFO:teuthology.orchestra.run.smithi172.stderr:2024-09-12T02:28:23.325+0000 7fcd267fc640 1 -- 172.21.15.172:0/3055283425 <== mon.0 v2:172.21.15.39:3300/0 7 ==== mon_command_ack([{"prefix": "mon dump", "format": "json"}]=0 dumped monmap epoch 1 v1) ==== 95+0+745 (secure 0 0 0) 0x7fcd200314c0 con 0x7fcd30102840 2024-09-12T02:28:23.326 INFO:teuthology.orchestra.run.smithi172.stdout: 2024-09-12T02:28:23.326 INFO:teuthology.orchestra.run.smithi172.stdout:{"epoch":1,"fsid":"4954ed46-70ae-11ef-bcea-c7b262605968","modified":"2024-09-12T02:26:39.333323Z","created":"2024-09-12T02:26:39.333323Z","min_mon_release":19,"min_mon_release_name":"squid","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks: ":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"],"optional":[]},"mons":[{"rank":0,"name":"a","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:3300","nonce":0},{"type":"v1","addr":"172.21.15.39:6789","nonce":0}]},"addr":"172.21.15.39:6789/0","public_addr":"172.21.15.39:6789/0","priority":0,"weight":0,"crush_location":"{}"}],"quorum":[0]} 2024-09-12T02:28:23.326 INFO:teuthology.orchestra.run.smithi172.stderr:dumped monmap epoch 1 2024-09-12T02:28:23.328 INFO:teuthology.orchestra.run.smithi172.stderr:2024-09-12T02:28:23.327+0000 7fcd372d4640 1 -- 172.21.15.172:0/3055283425 >> [v2:172.21.15.39:6800/1725006999,v1:172.21.15.39:6801/1725006999] conn(0x7fcd1c039060 msgr2=0x7fcd1c03b520 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:28:23.328 INFO:teuthology.orchestra.run.smithi172.stderr:2024-09-12T02:28:23.327+0000 7fcd372d4640 1 --2- 172.21.15.172:0/3055283425 >> [v2:172.21.15.39:6800/1725006999,v1:172.21.15.39:6801/1725006999] conn(0x7fcd1c039060 0x7fcd1c03b520 secure :-1 s=READY pgs=20 cs=0 l=1 rev1=1 crypto rx=0x7fcd2c0098c0 tx=0x7fcd2c006db0 comp rx=0 tx=0).stop 2024-09-12T02:28:23.328 INFO:teuthology.orchestra.run.smithi172.stderr:2024-09-12T02:28:23.327+0000 7fcd372d4640 1 -- 172.21.15.172:0/3055283425 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fcd30102840 msgr2=0x7fcd301972a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:28:23.328 INFO:teuthology.orchestra.run.smithi172.stderr:2024-09-12T02:28:23.327+0000 7fcd372d4640 1 --2- 172.21.15.172:0/3055283425 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fcd30102840 0x7fcd301972a0 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0x7fcd20009230 tx=0x7fcd20003d40 comp rx=0 tx=0).stop 2024-09-12T02:28:23.328 INFO:teuthology.orchestra.run.smithi172.stderr:2024-09-12T02:28:23.327+0000 7fcd372d4640 1 -- 172.21.15.172:0/3055283425 shutdown_connections 2024-09-12T02:28:23.328 INFO:teuthology.orchestra.run.smithi172.stderr:2024-09-12T02:28:23.327+0000 7fcd372d4640 1 --2- 172.21.15.172:0/3055283425 >> [v2:172.21.15.39:6800/1725006999,v1:172.21.15.39:6801/1725006999] conn(0x7fcd1c039060 0x7fcd1c03b520 unknown :-1 s=CLOSED pgs=20 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:28:23.328 INFO:teuthology.orchestra.run.smithi172.stderr:2024-09-12T02:28:23.327+0000 7fcd372d4640 1 --2- 172.21.15.172:0/3055283425 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fcd30102840 0x7fcd301972a0 unknown :-1 s=CLOSED pgs=95 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:28:23.328 INFO:teuthology.orchestra.run.smithi172.stderr:2024-09-12T02:28:23.327+0000 7fcd372d4640 1 -- 172.21.15.172:0/3055283425 >> 172.21.15.172:0/3055283425 conn(0x7fcd300fc280 msgr2=0x7fcd30105600 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:28:23.328 INFO:teuthology.orchestra.run.smithi172.stderr:2024-09-12T02:28:23.327+0000 7fcd372d4640 1 -- 172.21.15.172:0/3055283425 shutdown_connections 2024-09-12T02:28:23.328 INFO:teuthology.orchestra.run.smithi172.stderr:2024-09-12T02:28:23.327+0000 7fcd372d4640 1 -- 172.21.15.172:0/3055283425 wait complete. 2024-09-12T02:28:23.681 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 12 02:28:23 smithi172 podman[35578]: 2024-09-12 02:28:23.319671011 +0000 UTC m=+0.113321905 container create d652d920a68131c82cc8981f2e3c21867791ae6f87554cb9b7e48df69d048395 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:3be30d720e37ec4df7f667e60f22b4d221c4ce7b408e68b90f9ac10220535e66, name=ceph-4954ed46-70ae-11ef-bcea-c7b262605968-mon-c, org.label-schema.schema-version=1.0, org.label-schema.build-date=20240731, GIT_BRANCH=HEAD, ceph=True, org.label-schema.vendor=CentOS, io.buildah.version=1.37.2, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.license=GPLv2, org.label-schema.name=CentOS Stream 9 Base Image, CEPH_POINT_RELEASE=, RELEASE=squid-b53b6d3, GIT_REPO=git@github.com:ceph/ceph-container.git, maintainer=Guillaume Abrioux , GIT_CLEAN=True) 2024-09-12T02:28:23.681 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 12 02:28:23 smithi172 podman[35578]: 2024-09-12 02:28:23.22242229 +0000 UTC m=+0.016073195 image pull 54467abc55f864c4f73dfaf9c6ac3bb3e87b773123d5badaf790bee57321d594 quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:3be30d720e37ec4df7f667e60f22b4d221c4ce7b408e68b90f9ac10220535e66 2024-09-12T02:28:23.682 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 12 02:28:23 smithi172 podman[35578]: 2024-09-12 02:28:23.68139518 +0000 UTC m=+0.475046080 container init d652d920a68131c82cc8981f2e3c21867791ae6f87554cb9b7e48df69d048395 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:3be30d720e37ec4df7f667e60f22b4d221c4ce7b408e68b90f9ac10220535e66, name=ceph-4954ed46-70ae-11ef-bcea-c7b262605968-mon-c, ceph=True, CEPH_POINT_RELEASE=, org.label-schema.vendor=CentOS, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.schema-version=1.0, GIT_CLEAN=True, org.label-schema.name=CentOS Stream 9 Base Image, GIT_REPO=git@github.com:ceph/ceph-container.git, io.buildah.version=1.37.2, org.label-schema.license=GPLv2, RELEASE=squid-b53b6d3, maintainer=Guillaume Abrioux , org.label-schema.build-date=20240731, GIT_BRANCH=HEAD) 2024-09-12T02:28:24.013 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 12 02:28:23 smithi172 podman[35578]: 2024-09-12 02:28:23.685831121 +0000 UTC m=+0.479482016 container start d652d920a68131c82cc8981f2e3c21867791ae6f87554cb9b7e48df69d048395 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:3be30d720e37ec4df7f667e60f22b4d221c4ce7b408e68b90f9ac10220535e66, name=ceph-4954ed46-70ae-11ef-bcea-c7b262605968-mon-c, ceph=True, CEPH_POINT_RELEASE=, GIT_CLEAN=True, org.label-schema.vendor=CentOS, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.license=GPLv2, org.label-schema.name=CentOS Stream 9 Base Image, io.buildah.version=1.37.2, org.label-schema.build-date=20240731, GIT_BRANCH=HEAD, RELEASE=squid-b53b6d3, maintainer=Guillaume Abrioux , org.label-schema.schema-version=1.0) 2024-09-12T02:28:24.014 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 12 02:28:23 smithi172 ceph-mon[35609]: set uid:gid to 167:167 (ceph:ceph) 2024-09-12T02:28:24.014 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 12 02:28:23 smithi172 ceph-mon[35609]: ceph version 19.1.1-298-gb53b6d3e (b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc) squid (stable), process ceph-mon, pid 2 2024-09-12T02:28:24.014 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 12 02:28:23 smithi172 ceph-mon[35609]: pidfile_write: ignore empty --pid-file 2024-09-12T02:28:24.014 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 12 02:28:23 smithi172 ceph-mon[35609]: load: jerasure load: lrc 2024-09-12T02:28:24.014 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 12 02:28:23 smithi172 ceph-mon[35609]: rocksdb: RocksDB version: 7.9.2 2024-09-12T02:28:24.014 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 12 02:28:23 smithi172 ceph-mon[35609]: rocksdb: Git sha 0 2024-09-12T02:28:24.014 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 12 02:28:23 smithi172 ceph-mon[35609]: rocksdb: Compile date 2024-09-09 16:23:28 2024-09-12T02:28:24.014 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 12 02:28:23 smithi172 ceph-mon[35609]: rocksdb: DB SUMMARY 2024-09-12T02:28:24.014 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 12 02:28:23 smithi172 ceph-mon[35609]: rocksdb: DB Session ID: SB6H2QCSPF4PX71FMVAE 2024-09-12T02:28:24.014 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 12 02:28:23 smithi172 ceph-mon[35609]: rocksdb: CURRENT file: CURRENT 2024-09-12T02:28:24.014 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 12 02:28:23 smithi172 ceph-mon[35609]: rocksdb: IDENTITY file: IDENTITY 2024-09-12T02:28:24.014 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 12 02:28:23 smithi172 ceph-mon[35609]: rocksdb: MANIFEST file: MANIFEST-000005 size: 59 Bytes 2024-09-12T02:28:24.014 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 12 02:28:23 smithi172 ceph-mon[35609]: rocksdb: SST files in /var/lib/ceph/mon/ceph-c/store.db dir, Total Num: 0, files: 2024-09-12T02:28:24.015 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 12 02:28:23 smithi172 ceph-mon[35609]: rocksdb: Write Ahead Log file in /var/lib/ceph/mon/ceph-c/store.db: 000004.log size: 511 ; 2024-09-12T02:28:24.015 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 12 02:28:23 smithi172 ceph-mon[35609]: rocksdb: Options.error_if_exists: 0 2024-09-12T02:28:24.015 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 12 02:28:23 smithi172 ceph-mon[35609]: rocksdb: Options.create_if_missing: 0 2024-09-12T02:28:24.015 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 12 02:28:23 smithi172 ceph-mon[35609]: rocksdb: Options.paranoid_checks: 1 2024-09-12T02:28:24.015 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 12 02:28:23 smithi172 ceph-mon[35609]: rocksdb: Options.flush_verify_memtable_count: 1 2024-09-12T02:28:24.015 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 12 02:28:23 smithi172 ceph-mon[35609]: rocksdb: Options.track_and_verify_wals_in_manifest: 0 2024-09-12T02:28:24.015 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 12 02:28:23 smithi172 ceph-mon[35609]: rocksdb: Options.verify_sst_unique_id_in_manifest: 1 2024-09-12T02:28:24.015 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 12 02:28:23 smithi172 ceph-mon[35609]: rocksdb: Options.env: 0x55cf342fe940 2024-09-12T02:28:24.015 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 12 02:28:23 smithi172 ceph-mon[35609]: rocksdb: Options.fs: PosixFileSystem 2024-09-12T02:28:24.015 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 12 02:28:23 smithi172 ceph-mon[35609]: rocksdb: Options.info_log: 0x55cf354256e0 2024-09-12T02:28:24.015 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 12 02:28:23 smithi172 ceph-mon[35609]: rocksdb: Options.max_file_opening_threads: 16 2024-09-12T02:28:24.015 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 12 02:28:23 smithi172 ceph-mon[35609]: rocksdb: Options.statistics: (nil) 2024-09-12T02:28:24.015 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 12 02:28:23 smithi172 ceph-mon[35609]: rocksdb: Options.use_fsync: 0 2024-09-12T02:28:24.015 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 12 02:28:23 smithi172 ceph-mon[35609]: rocksdb: Options.max_log_file_size: 0 2024-09-12T02:28:24.015 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 12 02:28:23 smithi172 ceph-mon[35609]: rocksdb: Options.max_manifest_file_size: 1073741824 2024-09-12T02:28:24.015 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 12 02:28:23 smithi172 ceph-mon[35609]: rocksdb: Options.log_file_time_to_roll: 0 2024-09-12T02:28:24.016 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 12 02:28:23 smithi172 ceph-mon[35609]: rocksdb: Options.keep_log_file_num: 1000 2024-09-12T02:28:24.016 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 12 02:28:23 smithi172 ceph-mon[35609]: rocksdb: Options.recycle_log_file_num: 0 2024-09-12T02:28:24.016 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 12 02:28:23 smithi172 ceph-mon[35609]: rocksdb: Options.allow_fallocate: 1 2024-09-12T02:28:24.017 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 12 02:28:23 smithi172 ceph-mon[35609]: rocksdb: Options.allow_mmap_reads: 0 2024-09-12T02:28:24.017 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 12 02:28:23 smithi172 ceph-mon[35609]: rocksdb: Options.allow_mmap_writes: 0 2024-09-12T02:28:24.018 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 12 02:28:23 smithi172 ceph-mon[35609]: rocksdb: Options.use_direct_reads: 0 2024-09-12T02:28:24.018 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 12 02:28:23 smithi172 ceph-mon[35609]: rocksdb: Options.use_direct_io_for_flush_and_compaction: 0 2024-09-12T02:28:24.018 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 12 02:28:23 smithi172 ceph-mon[35609]: rocksdb: Options.create_missing_column_families: 0 2024-09-12T02:28:24.018 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 12 02:28:23 smithi172 ceph-mon[35609]: rocksdb: Options.db_log_dir: 2024-09-12T02:28:24.018 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 12 02:28:23 smithi172 ceph-mon[35609]: rocksdb: Options.wal_dir: 2024-09-12T02:28:24.018 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 12 02:28:23 smithi172 ceph-mon[35609]: rocksdb: Options.table_cache_numshardbits: 6 2024-09-12T02:28:24.018 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 12 02:28:23 smithi172 ceph-mon[35609]: rocksdb: Options.WAL_ttl_seconds: 0 2024-09-12T02:28:24.018 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 12 02:28:23 smithi172 ceph-mon[35609]: rocksdb: Options.WAL_size_limit_MB: 0 2024-09-12T02:28:24.018 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 12 02:28:23 smithi172 ceph-mon[35609]: rocksdb: Options.max_write_batch_group_size_bytes: 1048576 2024-09-12T02:28:24.018 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 12 02:28:23 smithi172 ceph-mon[35609]: rocksdb: Options.manifest_preallocation_size: 4194304 2024-09-12T02:28:24.018 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 12 02:28:23 smithi172 ceph-mon[35609]: rocksdb: Options.is_fd_close_on_exec: 1 2024-09-12T02:28:24.018 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 12 02:28:23 smithi172 ceph-mon[35609]: rocksdb: Options.advise_random_on_open: 1 2024-09-12T02:28:24.018 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 12 02:28:23 smithi172 ceph-mon[35609]: rocksdb: Options.db_write_buffer_size: 0 2024-09-12T02:28:24.019 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 12 02:28:23 smithi172 ceph-mon[35609]: rocksdb: Options.write_buffer_manager: 0x55cf35434dc0 2024-09-12T02:28:24.019 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 12 02:28:23 smithi172 ceph-mon[35609]: rocksdb: Options.access_hint_on_compaction_start: 1 2024-09-12T02:28:24.019 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 12 02:28:23 smithi172 ceph-mon[35609]: rocksdb: Options.random_access_max_buffer_size: 1048576 2024-09-12T02:28:24.019 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 12 02:28:23 smithi172 ceph-mon[35609]: rocksdb: Options.use_adaptive_mutex: 0 2024-09-12T02:28:24.019 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 12 02:28:23 smithi172 ceph-mon[35609]: rocksdb: Options.rate_limiter: (nil) 2024-09-12T02:28:24.019 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 12 02:28:23 smithi172 ceph-mon[35609]: rocksdb: Options.sst_file_manager.rate_bytes_per_sec: 0 2024-09-12T02:28:24.019 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 12 02:28:23 smithi172 ceph-mon[35609]: rocksdb: Options.wal_recovery_mode: 2 2024-09-12T02:28:24.019 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 12 02:28:23 smithi172 ceph-mon[35609]: rocksdb: Options.enable_thread_tracking: 0 2024-09-12T02:28:24.019 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 12 02:28:23 smithi172 ceph-mon[35609]: rocksdb: Options.enable_pipelined_write: 0 2024-09-12T02:28:24.019 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 12 02:28:23 smithi172 ceph-mon[35609]: rocksdb: Options.unordered_write: 0 2024-09-12T02:28:24.019 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 12 02:28:23 smithi172 ceph-mon[35609]: rocksdb: Options.allow_concurrent_memtable_write: 1 2024-09-12T02:28:24.019 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 12 02:28:23 smithi172 ceph-mon[35609]: rocksdb: Options.enable_write_thread_adaptive_yield: 1 2024-09-12T02:28:24.019 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 12 02:28:23 smithi172 ceph-mon[35609]: rocksdb: Options.write_thread_max_yield_usec: 100 2024-09-12T02:28:24.019 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 12 02:28:23 smithi172 ceph-mon[35609]: rocksdb: Options.write_thread_slow_yield_usec: 3 2024-09-12T02:28:24.020 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 12 02:28:23 smithi172 ceph-mon[35609]: rocksdb: Options.row_cache: None 2024-09-12T02:28:24.020 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 12 02:28:23 smithi172 ceph-mon[35609]: rocksdb: Options.wal_filter: None 2024-09-12T02:28:24.020 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 12 02:28:23 smithi172 ceph-mon[35609]: rocksdb: Options.avoid_flush_during_recovery: 0 2024-09-12T02:28:24.020 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 12 02:28:23 smithi172 ceph-mon[35609]: rocksdb: Options.allow_ingest_behind: 0 2024-09-12T02:28:24.020 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 12 02:28:23 smithi172 ceph-mon[35609]: rocksdb: Options.two_write_queues: 0 2024-09-12T02:28:24.020 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 12 02:28:23 smithi172 ceph-mon[35609]: rocksdb: Options.manual_wal_flush: 0 2024-09-12T02:28:24.020 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 12 02:28:23 smithi172 ceph-mon[35609]: rocksdb: Options.wal_compression: 0 2024-09-12T02:28:24.021 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 12 02:28:23 smithi172 ceph-mon[35609]: rocksdb: Options.atomic_flush: 0 2024-09-12T02:28:24.021 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 12 02:28:23 smithi172 ceph-mon[35609]: rocksdb: Options.avoid_unnecessary_blocking_io: 0 2024-09-12T02:28:24.021 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 12 02:28:23 smithi172 ceph-mon[35609]: rocksdb: Options.persist_stats_to_disk: 0 2024-09-12T02:28:24.021 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 12 02:28:23 smithi172 ceph-mon[35609]: rocksdb: Options.write_dbid_to_manifest: 0 2024-09-12T02:28:24.021 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 12 02:28:23 smithi172 ceph-mon[35609]: rocksdb: Options.log_readahead_size: 0 2024-09-12T02:28:24.021 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 12 02:28:23 smithi172 ceph-mon[35609]: rocksdb: Options.file_checksum_gen_factory: Unknown 2024-09-12T02:28:24.021 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 12 02:28:23 smithi172 ceph-mon[35609]: rocksdb: Options.best_efforts_recovery: 0 2024-09-12T02:28:24.021 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 12 02:28:23 smithi172 ceph-mon[35609]: rocksdb: Options.max_bgerror_resume_count: 2147483647 2024-09-12T02:28:24.021 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 12 02:28:23 smithi172 ceph-mon[35609]: rocksdb: Options.bgerror_resume_retry_interval: 1000000 2024-09-12T02:28:24.021 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 12 02:28:23 smithi172 ceph-mon[35609]: rocksdb: Options.allow_data_in_errors: 0 2024-09-12T02:28:24.021 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 12 02:28:23 smithi172 ceph-mon[35609]: rocksdb: Options.db_host_id: __hostname__ 2024-09-12T02:28:24.021 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 12 02:28:23 smithi172 ceph-mon[35609]: rocksdb: Options.enforce_single_del_contracts: true 2024-09-12T02:28:24.021 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 12 02:28:23 smithi172 ceph-mon[35609]: rocksdb: Options.max_background_jobs: 2 2024-09-12T02:28:24.022 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 12 02:28:23 smithi172 ceph-mon[35609]: rocksdb: Options.max_background_compactions: -1 2024-09-12T02:28:24.022 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 12 02:28:23 smithi172 ceph-mon[35609]: rocksdb: Options.max_subcompactions: 1 2024-09-12T02:28:24.022 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 12 02:28:23 smithi172 ceph-mon[35609]: rocksdb: Options.avoid_flush_during_shutdown: 0 2024-09-12T02:28:24.022 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 12 02:28:23 smithi172 ceph-mon[35609]: rocksdb: Options.writable_file_max_buffer_size: 1048576 2024-09-12T02:28:24.022 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 12 02:28:23 smithi172 ceph-mon[35609]: rocksdb: Options.delayed_write_rate : 16777216 2024-09-12T02:28:24.022 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 12 02:28:23 smithi172 ceph-mon[35609]: rocksdb: Options.max_total_wal_size: 0 2024-09-12T02:28:24.022 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 12 02:28:23 smithi172 ceph-mon[35609]: rocksdb: Options.delete_obsolete_files_period_micros: 21600000000 2024-09-12T02:28:24.022 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 12 02:28:23 smithi172 ceph-mon[35609]: rocksdb: Options.stats_dump_period_sec: 600 2024-09-12T02:28:24.022 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 12 02:28:23 smithi172 ceph-mon[35609]: rocksdb: Options.stats_persist_period_sec: 600 2024-09-12T02:28:24.022 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 12 02:28:23 smithi172 ceph-mon[35609]: rocksdb: Options.stats_history_buffer_size: 1048576 2024-09-12T02:28:24.022 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 12 02:28:23 smithi172 ceph-mon[35609]: rocksdb: Options.max_open_files: -1 2024-09-12T02:28:24.023 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 12 02:28:23 smithi172 ceph-mon[35609]: rocksdb: Options.bytes_per_sync: 0 2024-09-12T02:28:24.023 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 12 02:28:23 smithi172 ceph-mon[35609]: rocksdb: Options.wal_bytes_per_sync: 0 2024-09-12T02:28:24.023 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 12 02:28:23 smithi172 ceph-mon[35609]: rocksdb: Options.strict_bytes_per_sync: 0 2024-09-12T02:28:24.023 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 12 02:28:23 smithi172 ceph-mon[35609]: rocksdb: Options.compaction_readahead_size: 0 2024-09-12T02:28:24.023 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 12 02:28:23 smithi172 ceph-mon[35609]: rocksdb: Options.max_background_flushes: -1 2024-09-12T02:28:24.023 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 12 02:28:23 smithi172 ceph-mon[35609]: rocksdb: Compression algorithms supported: 2024-09-12T02:28:24.023 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 12 02:28:23 smithi172 ceph-mon[35609]: rocksdb: kZSTD supported: 0 2024-09-12T02:28:24.023 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 12 02:28:23 smithi172 ceph-mon[35609]: rocksdb: kXpressCompression supported: 0 2024-09-12T02:28:24.023 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 12 02:28:23 smithi172 ceph-mon[35609]: rocksdb: kBZip2Compression supported: 0 2024-09-12T02:28:24.023 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 12 02:28:23 smithi172 ceph-mon[35609]: rocksdb: kZSTDNotFinalCompression supported: 0 2024-09-12T02:28:24.023 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 12 02:28:23 smithi172 ceph-mon[35609]: rocksdb: kLZ4Compression supported: 1 2024-09-12T02:28:24.023 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 12 02:28:23 smithi172 ceph-mon[35609]: rocksdb: kZlibCompression supported: 1 2024-09-12T02:28:24.023 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 12 02:28:23 smithi172 ceph-mon[35609]: rocksdb: kLZ4HCCompression supported: 1 2024-09-12T02:28:24.024 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 12 02:28:23 smithi172 ceph-mon[35609]: rocksdb: kSnappyCompression supported: 1 2024-09-12T02:28:24.024 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 12 02:28:23 smithi172 ceph-mon[35609]: rocksdb: Fast CRC32 supported: Supported on x86 2024-09-12T02:28:24.024 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 12 02:28:23 smithi172 ceph-mon[35609]: rocksdb: DMutex implementation: pthread_mutex_t 2024-09-12T02:28:24.024 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 12 02:28:23 smithi172 ceph-mon[35609]: rocksdb: [db/version_set.cc:5527] Recovering from manifest file: /var/lib/ceph/mon/ceph-c/store.db/MANIFEST-000005 2024-09-12T02:28:24.024 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 12 02:28:23 smithi172 ceph-mon[35609]: rocksdb: [db/column_family.cc:630] --------------- Options for column family [default]: 2024-09-12T02:28:24.024 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 12 02:28:23 smithi172 ceph-mon[35609]: rocksdb: Options.comparator: leveldb.BytewiseComparator 2024-09-12T02:28:24.024 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 12 02:28:23 smithi172 ceph-mon[35609]: rocksdb: Options.merge_operator: 2024-09-12T02:28:24.024 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 12 02:28:23 smithi172 ceph-mon[35609]: rocksdb: Options.compaction_filter: None 2024-09-12T02:28:24.024 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 12 02:28:23 smithi172 ceph-mon[35609]: rocksdb: Options.compaction_filter_factory: None 2024-09-12T02:28:24.024 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 12 02:28:23 smithi172 ceph-mon[35609]: rocksdb: Options.sst_partitioner_factory: None 2024-09-12T02:28:24.024 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 12 02:28:23 smithi172 ceph-mon[35609]: rocksdb: Options.memtable_factory: SkipListFactory 2024-09-12T02:28:24.024 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 12 02:28:23 smithi172 ceph-mon[35609]: rocksdb: Options.table_factory: BlockBasedTable 2024-09-12T02:28:24.024 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 12 02:28:23 smithi172 ceph-mon[35609]: rocksdb: table_factory options: flush_block_policy_factory: FlushBlockBySizePolicyFactory (0x55cf35425320) 2024-09-12T02:28:24.024 INFO:journalctl@ceph.mon.c.smithi172.stdout: cache_index_and_filter_blocks: 1 2024-09-12T02:28:24.025 INFO:journalctl@ceph.mon.c.smithi172.stdout: cache_index_and_filter_blocks_with_high_priority: 0 2024-09-12T02:28:24.025 INFO:journalctl@ceph.mon.c.smithi172.stdout: pin_l0_filter_and_index_blocks_in_cache: 0 2024-09-12T02:28:24.025 INFO:journalctl@ceph.mon.c.smithi172.stdout: pin_top_level_index_and_filter: 1 2024-09-12T02:28:24.025 INFO:journalctl@ceph.mon.c.smithi172.stdout: index_type: 0 2024-09-12T02:28:24.025 INFO:journalctl@ceph.mon.c.smithi172.stdout: data_block_index_type: 0 2024-09-12T02:28:24.025 INFO:journalctl@ceph.mon.c.smithi172.stdout: index_shortening: 1 2024-09-12T02:28:24.025 INFO:journalctl@ceph.mon.c.smithi172.stdout: data_block_hash_table_util_ratio: 0.750000 2024-09-12T02:28:24.025 INFO:journalctl@ceph.mon.c.smithi172.stdout: checksum: 4 2024-09-12T02:28:24.025 INFO:journalctl@ceph.mon.c.smithi172.stdout: no_block_cache: 0 2024-09-12T02:28:24.025 INFO:journalctl@ceph.mon.c.smithi172.stdout: block_cache: 0x55cf354191f0 2024-09-12T02:28:24.025 INFO:journalctl@ceph.mon.c.smithi172.stdout: block_cache_name: BinnedLRUCache 2024-09-12T02:28:24.025 INFO:journalctl@ceph.mon.c.smithi172.stdout: block_cache_options: 2024-09-12T02:28:24.025 INFO:journalctl@ceph.mon.c.smithi172.stdout: capacity : 536870912 2024-09-12T02:28:24.025 INFO:journalctl@ceph.mon.c.smithi172.stdout: num_shard_bits : 4 2024-09-12T02:28:24.026 INFO:journalctl@ceph.mon.c.smithi172.stdout: strict_capacity_limit : 0 2024-09-12T02:28:24.026 INFO:journalctl@ceph.mon.c.smithi172.stdout: high_pri_pool_ratio: 0.000 2024-09-12T02:28:24.026 INFO:journalctl@ceph.mon.c.smithi172.stdout: block_cache_compressed: (nil) 2024-09-12T02:28:24.026 INFO:journalctl@ceph.mon.c.smithi172.stdout: persistent_cache: (nil) 2024-09-12T02:28:24.026 INFO:journalctl@ceph.mon.c.smithi172.stdout: block_size: 4096 2024-09-12T02:28:24.026 INFO:journalctl@ceph.mon.c.smithi172.stdout: block_size_deviation: 10 2024-09-12T02:28:24.026 INFO:journalctl@ceph.mon.c.smithi172.stdout: block_restart_interval: 16 2024-09-12T02:28:24.026 INFO:journalctl@ceph.mon.c.smithi172.stdout: index_block_restart_interval: 1 2024-09-12T02:28:24.026 INFO:journalctl@ceph.mon.c.smithi172.stdout: metadata_block_size: 4096 2024-09-12T02:28:24.026 INFO:journalctl@ceph.mon.c.smithi172.stdout: partition_filters: 0 2024-09-12T02:28:24.026 INFO:journalctl@ceph.mon.c.smithi172.stdout: use_delta_encoding: 1 2024-09-12T02:28:24.026 INFO:journalctl@ceph.mon.c.smithi172.stdout: filter_policy: bloomfilter 2024-09-12T02:28:24.026 INFO:journalctl@ceph.mon.c.smithi172.stdout: whole_key_filtering: 1 2024-09-12T02:28:24.027 INFO:journalctl@ceph.mon.c.smithi172.stdout: verify_compression: 0 2024-09-12T02:28:24.027 INFO:journalctl@ceph.mon.c.smithi172.stdout: read_amp_bytes_per_bit: 0 2024-09-12T02:28:24.027 INFO:journalctl@ceph.mon.c.smithi172.stdout: format_version: 5 2024-09-12T02:28:24.027 INFO:journalctl@ceph.mon.c.smithi172.stdout: enable_index_compression: 1 2024-09-12T02:28:24.027 INFO:journalctl@ceph.mon.c.smithi172.stdout: block_align: 0 2024-09-12T02:28:24.027 INFO:journalctl@ceph.mon.c.smithi172.stdout: max_auto_readahead_size: 262144 2024-09-12T02:28:24.027 INFO:journalctl@ceph.mon.c.smithi172.stdout: prepopulate_block_cache: 0 2024-09-12T02:28:24.027 INFO:journalctl@ceph.mon.c.smithi172.stdout: initial_auto_readahead_size: 8192 2024-09-12T02:28:24.027 INFO:journalctl@ceph.mon.c.smithi172.stdout: num_file_reads_for_auto_readahead: 2 2024-09-12T02:28:24.027 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 12 02:28:23 smithi172 ceph-mon[35609]: rocksdb: Options.write_buffer_size: 33554432 2024-09-12T02:28:24.027 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 12 02:28:23 smithi172 ceph-mon[35609]: rocksdb: Options.max_write_buffer_number: 2 2024-09-12T02:28:24.027 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 12 02:28:23 smithi172 ceph-mon[35609]: rocksdb: Options.compression: NoCompression 2024-09-12T02:28:24.027 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 12 02:28:23 smithi172 ceph-mon[35609]: rocksdb: Options.bottommost_compression: Disabled 2024-09-12T02:28:24.027 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 12 02:28:23 smithi172 ceph-mon[35609]: rocksdb: Options.prefix_extractor: nullptr 2024-09-12T02:28:24.028 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 12 02:28:23 smithi172 ceph-mon[35609]: rocksdb: Options.memtable_insert_with_hint_prefix_extractor: nullptr 2024-09-12T02:28:24.028 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 12 02:28:23 smithi172 ceph-mon[35609]: rocksdb: Options.num_levels: 7 2024-09-12T02:28:24.028 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 12 02:28:23 smithi172 ceph-mon[35609]: rocksdb: Options.min_write_buffer_number_to_merge: 1 2024-09-12T02:28:24.028 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 12 02:28:23 smithi172 ceph-mon[35609]: rocksdb: Options.max_write_buffer_number_to_maintain: 0 2024-09-12T02:28:24.028 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 12 02:28:23 smithi172 ceph-mon[35609]: rocksdb: Options.max_write_buffer_size_to_maintain: 0 2024-09-12T02:28:24.028 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 12 02:28:23 smithi172 ceph-mon[35609]: rocksdb: Options.bottommost_compression_opts.window_bits: -14 2024-09-12T02:28:24.028 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 12 02:28:23 smithi172 ceph-mon[35609]: rocksdb: Options.bottommost_compression_opts.level: 32767 2024-09-12T02:28:24.028 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 12 02:28:23 smithi172 ceph-mon[35609]: rocksdb: Options.bottommost_compression_opts.strategy: 0 2024-09-12T02:28:24.028 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 12 02:28:23 smithi172 ceph-mon[35609]: rocksdb: Options.bottommost_compression_opts.max_dict_bytes: 0 2024-09-12T02:28:24.028 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 12 02:28:23 smithi172 ceph-mon[35609]: rocksdb: Options.bottommost_compression_opts.zstd_max_train_bytes: 0 2024-09-12T02:28:24.028 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 12 02:28:23 smithi172 ceph-mon[35609]: rocksdb: Options.bottommost_compression_opts.parallel_threads: 1 2024-09-12T02:28:24.028 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 12 02:28:23 smithi172 ceph-mon[35609]: rocksdb: Options.bottommost_compression_opts.enabled: false 2024-09-12T02:28:24.028 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 12 02:28:23 smithi172 ceph-mon[35609]: rocksdb: Options.bottommost_compression_opts.max_dict_buffer_bytes: 0 2024-09-12T02:28:24.028 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 12 02:28:23 smithi172 ceph-mon[35609]: rocksdb: Options.bottommost_compression_opts.use_zstd_dict_trainer: true 2024-09-12T02:28:24.029 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 12 02:28:23 smithi172 ceph-mon[35609]: rocksdb: Options.compression_opts.window_bits: -14 2024-09-12T02:28:24.029 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 12 02:28:23 smithi172 ceph-mon[35609]: rocksdb: Options.compression_opts.level: 32767 2024-09-12T02:28:24.029 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 12 02:28:23 smithi172 ceph-mon[35609]: rocksdb: Options.compression_opts.strategy: 0 2024-09-12T02:28:24.029 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 12 02:28:23 smithi172 ceph-mon[35609]: rocksdb: Options.compression_opts.max_dict_bytes: 0 2024-09-12T02:28:24.029 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 12 02:28:23 smithi172 ceph-mon[35609]: rocksdb: Options.compression_opts.zstd_max_train_bytes: 0 2024-09-12T02:28:24.029 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 12 02:28:23 smithi172 ceph-mon[35609]: rocksdb: Options.compression_opts.use_zstd_dict_trainer: true 2024-09-12T02:28:24.029 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 12 02:28:23 smithi172 ceph-mon[35609]: rocksdb: Options.compression_opts.parallel_threads: 1 2024-09-12T02:28:24.029 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 12 02:28:23 smithi172 ceph-mon[35609]: rocksdb: Options.compression_opts.enabled: false 2024-09-12T02:28:24.029 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 12 02:28:23 smithi172 ceph-mon[35609]: rocksdb: Options.compression_opts.max_dict_buffer_bytes: 0 2024-09-12T02:28:24.029 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 12 02:28:23 smithi172 ceph-mon[35609]: rocksdb: Options.level0_file_num_compaction_trigger: 4 2024-09-12T02:28:24.029 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 12 02:28:23 smithi172 ceph-mon[35609]: rocksdb: Options.level0_slowdown_writes_trigger: 20 2024-09-12T02:28:24.029 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 12 02:28:23 smithi172 ceph-mon[35609]: rocksdb: Options.level0_stop_writes_trigger: 36 2024-09-12T02:28:24.029 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 12 02:28:23 smithi172 ceph-mon[35609]: rocksdb: Options.target_file_size_base: 67108864 2024-09-12T02:28:24.029 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 12 02:28:23 smithi172 ceph-mon[35609]: rocksdb: Options.target_file_size_multiplier: 1 2024-09-12T02:28:24.030 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 12 02:28:23 smithi172 ceph-mon[35609]: rocksdb: Options.max_bytes_for_level_base: 268435456 2024-09-12T02:28:24.030 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 12 02:28:23 smithi172 ceph-mon[35609]: rocksdb: Options.level_compaction_dynamic_level_bytes: 1 2024-09-12T02:28:24.030 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 12 02:28:23 smithi172 ceph-mon[35609]: rocksdb: Options.max_bytes_for_level_multiplier: 10.000000 2024-09-12T02:28:24.030 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 12 02:28:23 smithi172 ceph-mon[35609]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[0]: 1 2024-09-12T02:28:24.030 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 12 02:28:23 smithi172 ceph-mon[35609]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[1]: 1 2024-09-12T02:28:24.030 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 12 02:28:23 smithi172 ceph-mon[35609]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[2]: 1 2024-09-12T02:28:24.030 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 12 02:28:23 smithi172 ceph-mon[35609]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[3]: 1 2024-09-12T02:28:24.030 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 12 02:28:23 smithi172 ceph-mon[35609]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[4]: 1 2024-09-12T02:28:24.030 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 12 02:28:23 smithi172 ceph-mon[35609]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[5]: 1 2024-09-12T02:28:24.030 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 12 02:28:23 smithi172 ceph-mon[35609]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[6]: 1 2024-09-12T02:28:24.030 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 12 02:28:23 smithi172 ceph-mon[35609]: rocksdb: Options.max_sequential_skip_in_iterations: 8 2024-09-12T02:28:24.030 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 12 02:28:23 smithi172 ceph-mon[35609]: rocksdb: Options.max_compaction_bytes: 1677721600 2024-09-12T02:28:24.030 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 12 02:28:23 smithi172 ceph-mon[35609]: rocksdb: Options.ignore_max_compaction_bytes_for_input: true 2024-09-12T02:28:24.030 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 12 02:28:23 smithi172 ceph-mon[35609]: rocksdb: Options.arena_block_size: 1048576 2024-09-12T02:28:24.031 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 12 02:28:23 smithi172 ceph-mon[35609]: rocksdb: Options.soft_pending_compaction_bytes_limit: 68719476736 2024-09-12T02:28:24.031 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 12 02:28:23 smithi172 ceph-mon[35609]: rocksdb: Options.hard_pending_compaction_bytes_limit: 274877906944 2024-09-12T02:28:24.031 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 12 02:28:23 smithi172 ceph-mon[35609]: rocksdb: Options.disable_auto_compactions: 0 2024-09-12T02:28:24.031 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 12 02:28:23 smithi172 ceph-mon[35609]: rocksdb: Options.compaction_style: kCompactionStyleLevel 2024-09-12T02:28:24.031 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 12 02:28:23 smithi172 ceph-mon[35609]: rocksdb: Options.compaction_pri: kMinOverlappingRatio 2024-09-12T02:28:24.031 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 12 02:28:23 smithi172 ceph-mon[35609]: rocksdb: Options.compaction_options_universal.size_ratio: 1 2024-09-12T02:28:24.031 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 12 02:28:23 smithi172 ceph-mon[35609]: rocksdb: Options.compaction_options_universal.min_merge_width: 2 2024-09-12T02:28:24.031 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 12 02:28:23 smithi172 ceph-mon[35609]: rocksdb: Options.compaction_options_universal.max_merge_width: 4294967295 2024-09-12T02:28:24.031 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 12 02:28:23 smithi172 ceph-mon[35609]: rocksdb: Options.compaction_options_universal.max_size_amplification_percent: 200 2024-09-12T02:28:24.031 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 12 02:28:23 smithi172 ceph-mon[35609]: rocksdb: Options.compaction_options_universal.compression_size_percent: -1 2024-09-12T02:28:24.031 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 12 02:28:23 smithi172 ceph-mon[35609]: rocksdb: Options.compaction_options_universal.stop_style: kCompactionStopStyleTotalSize 2024-09-12T02:28:24.031 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 12 02:28:23 smithi172 ceph-mon[35609]: rocksdb: Options.compaction_options_fifo.max_table_files_size: 1073741824 2024-09-12T02:28:24.031 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 12 02:28:23 smithi172 ceph-mon[35609]: rocksdb: Options.compaction_options_fifo.allow_compaction: 0 2024-09-12T02:28:24.031 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 12 02:28:23 smithi172 ceph-mon[35609]: rocksdb: Options.table_properties_collectors: CompactOnDeletionCollector (Sliding window size = 32768 Deletion trigger = 16384 Deletion ratio = 0); 2024-09-12T02:28:24.031 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 12 02:28:23 smithi172 ceph-mon[35609]: rocksdb: Options.inplace_update_support: 0 2024-09-12T02:28:24.031 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 12 02:28:23 smithi172 ceph-mon[35609]: rocksdb: Options.inplace_update_num_locks: 10000 2024-09-12T02:28:24.032 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 12 02:28:23 smithi172 ceph-mon[35609]: rocksdb: Options.memtable_prefix_bloom_size_ratio: 0.000000 2024-09-12T02:28:24.032 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 12 02:28:23 smithi172 ceph-mon[35609]: rocksdb: Options.memtable_whole_key_filtering: 0 2024-09-12T02:28:24.032 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 12 02:28:23 smithi172 ceph-mon[35609]: rocksdb: Options.memtable_huge_page_size: 0 2024-09-12T02:28:24.032 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 12 02:28:23 smithi172 ceph-mon[35609]: rocksdb: Options.bloom_locality: 0 2024-09-12T02:28:24.032 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 12 02:28:23 smithi172 ceph-mon[35609]: rocksdb: Options.max_successive_merges: 0 2024-09-12T02:28:24.032 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 12 02:28:23 smithi172 ceph-mon[35609]: rocksdb: Options.optimize_filters_for_hits: 0 2024-09-12T02:28:24.032 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 12 02:28:23 smithi172 ceph-mon[35609]: rocksdb: Options.paranoid_file_checks: 0 2024-09-12T02:28:24.032 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 12 02:28:23 smithi172 ceph-mon[35609]: rocksdb: Options.force_consistency_checks: 1 2024-09-12T02:28:24.032 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 12 02:28:23 smithi172 ceph-mon[35609]: rocksdb: Options.report_bg_io_stats: 0 2024-09-12T02:28:24.032 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 12 02:28:23 smithi172 ceph-mon[35609]: rocksdb: Options.ttl: 2592000 2024-09-12T02:28:24.032 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 12 02:28:23 smithi172 ceph-mon[35609]: rocksdb: Options.periodic_compaction_seconds: 0 2024-09-12T02:28:24.032 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 12 02:28:23 smithi172 ceph-mon[35609]: rocksdb: Options.preclude_last_level_data_seconds: 0 2024-09-12T02:28:24.032 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 12 02:28:23 smithi172 ceph-mon[35609]: rocksdb: Options.preserve_internal_time_seconds: 0 2024-09-12T02:28:24.032 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 12 02:28:23 smithi172 ceph-mon[35609]: rocksdb: Options.enable_blob_files: false 2024-09-12T02:28:24.033 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 12 02:28:23 smithi172 ceph-mon[35609]: rocksdb: Options.min_blob_size: 0 2024-09-12T02:28:24.033 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 12 02:28:23 smithi172 ceph-mon[35609]: rocksdb: Options.blob_file_size: 268435456 2024-09-12T02:28:24.033 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 12 02:28:23 smithi172 ceph-mon[35609]: rocksdb: Options.blob_compression_type: NoCompression 2024-09-12T02:28:24.033 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 12 02:28:23 smithi172 ceph-mon[35609]: rocksdb: Options.enable_blob_garbage_collection: false 2024-09-12T02:28:24.033 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 12 02:28:23 smithi172 ceph-mon[35609]: rocksdb: Options.blob_garbage_collection_age_cutoff: 0.250000 2024-09-12T02:28:24.033 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 12 02:28:23 smithi172 ceph-mon[35609]: rocksdb: Options.blob_garbage_collection_force_threshold: 1.000000 2024-09-12T02:28:24.033 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 12 02:28:23 smithi172 ceph-mon[35609]: rocksdb: Options.blob_compaction_readahead_size: 0 2024-09-12T02:28:24.033 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 12 02:28:23 smithi172 ceph-mon[35609]: rocksdb: Options.blob_file_starting_level: 0 2024-09-12T02:28:24.033 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 12 02:28:23 smithi172 ceph-mon[35609]: rocksdb: Options.experimental_mempurge_threshold: 0.000000 2024-09-12T02:28:24.033 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 12 02:28:23 smithi172 ceph-mon[35609]: rocksdb: [db/version_set.cc:5566] Recovered from manifest file:/var/lib/ceph/mon/ceph-c/store.db/MANIFEST-000005 succeeded,manifest_file_number is 5, next_file_number is 7, last_sequence is 0, log_number is 0,prev_log_number is 0,max_column_family is 0,min_log_number_to_keep is 0 2024-09-12T02:28:24.033 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 12 02:28:23 smithi172 ceph-mon[35609]: rocksdb: [db/version_set.cc:5581] Column family [default] (ID 0), log number is 0 2024-09-12T02:28:24.033 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 12 02:28:23 smithi172 ceph-mon[35609]: rocksdb: [db/db_impl/db_impl_open.cc:539] DB ID: 46b5ecad-ffff-45e3-8137-d56777320be2 2024-09-12T02:28:24.033 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 12 02:28:23 smithi172 ceph-mon[35609]: rocksdb: EVENT_LOG_v1 {"time_micros": 1726108103712697, "job": 1, "event": "recovery_started", "wal_files": [4]} 2024-09-12T02:28:24.033 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 12 02:28:23 smithi172 ceph-mon[35609]: rocksdb: [db/db_impl/db_impl_open.cc:1043] Recovering log #4 mode 2 2024-09-12T02:28:24.034 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 12 02:28:23 smithi172 ceph-mon[35609]: rocksdb: EVENT_LOG_v1 {"time_micros": 1726108103713118, "cf_name": "default", "job": 1, "event": "table_file_creation", "file_number": 8, "file_size": 1648, "file_checksum": "", "file_checksum_func_name": "Unknown", "smallest_seqno": 1, "largest_seqno": 5, "table_properties": {"data_size": 523, "index_size": 31, "index_partitions": 0, "top_level_index_size": 0, "index_key_is_user_key": 1, "index_value_is_delta_encoded": 1, "filter_size": 69, "raw_key_size": 115, "raw_average_key_size": 23, "raw_value_size": 401, "raw_average_value_size": 80, "num_data_blocks": 1, "num_entries": 5, "num_filter_entries": 5, "num_deletions": 0, "num_merge_operands": 0, "num_range_deletions": 0, "format_version": 0, "fixed_key_len": 0, "filter_policy": "bloomfilter", "column_family_name": "default", "column_family_id": 0, "comparator": "leveldb.BytewiseComparator", "merge_operator": "", "prefix_extractor_name": "nullptr", "property_collectors": "[CompactOnDeletionCollector]", "compression": "NoCompression", "compression_options": "window_bits=-14; level=32767; strategy=0; max_dict_bytes=0; zstd_max_train_bytes=0; enabled=0; max_dict_buffer_bytes=0; use_zstd_dict_trainer=1; ", "creation_time": 1726108103, "oldest_key_time": 0, "file_creation_time": 0, "slow_compression_estimated_data_size": 0, "fast_compression_estimated_data_size": 0, "db_id": "46b5ecad-ffff-45e3-8137-d56777320be2", "db_session_id": "SB6H2QCSPF4PX71FMVAE", "orig_file_number": 8, "seqno_to_time_mapping": "N/A"}} 2024-09-12T02:28:24.034 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 12 02:28:23 smithi172 ceph-mon[35609]: rocksdb: EVENT_LOG_v1 {"time_micros": 1726108103713211, "job": 1, "event": "recovery_finished"} 2024-09-12T02:28:24.034 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 12 02:28:23 smithi172 ceph-mon[35609]: rocksdb: [db/version_set.cc:5047] Creating manifest 10 2024-09-12T02:28:24.034 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 12 02:28:23 smithi172 ceph-mon[35609]: rocksdb: [file/delete_scheduler.cc:74] Deleted file /var/lib/ceph/mon/ceph-c/store.db/000004.log immediately, rate_bytes_per_sec 0, total_trash_size 0 max_trash_db_ratio 0.250000 2024-09-12T02:28:24.034 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 12 02:28:23 smithi172 ceph-mon[35609]: rocksdb: [db/db_impl/db_impl_open.cc:1987] SstFileManager instance 0x55cf35446e00 2024-09-12T02:28:24.034 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 12 02:28:23 smithi172 ceph-mon[35609]: rocksdb: DB pointer 0x55cf35542000 2024-09-12T02:28:24.034 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 12 02:28:23 smithi172 ceph-mon[35609]: rocksdb: [db/db_impl/db_impl.cc:1109] ------- DUMPING STATS ------- 2024-09-12T02:28:24.034 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 12 02:28:23 smithi172 ceph-mon[35609]: rocksdb: [db/db_impl/db_impl.cc:1111] 2024-09-12T02:28:24.034 INFO:journalctl@ceph.mon.c.smithi172.stdout: ** DB Stats ** 2024-09-12T02:28:24.034 INFO:journalctl@ceph.mon.c.smithi172.stdout: Uptime(secs): 0.0 total, 0.0 interval 2024-09-12T02:28:24.034 INFO:journalctl@ceph.mon.c.smithi172.stdout: Cumulative writes: 0 writes, 0 keys, 0 commit groups, 0.0 writes per commit group, ingest: 0.00 GB, 0.00 MB/s 2024-09-12T02:28:24.034 INFO:journalctl@ceph.mon.c.smithi172.stdout: Cumulative WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s 2024-09-12T02:28:24.034 INFO:journalctl@ceph.mon.c.smithi172.stdout: Cumulative stall: 00:00:0.000 H:M:S, 0.0 percent 2024-09-12T02:28:24.034 INFO:journalctl@ceph.mon.c.smithi172.stdout: Interval writes: 0 writes, 0 keys, 0 commit groups, 0.0 writes per commit group, ingest: 0.00 MB, 0.00 MB/s 2024-09-12T02:28:24.034 INFO:journalctl@ceph.mon.c.smithi172.stdout: Interval WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s 2024-09-12T02:28:24.035 INFO:journalctl@ceph.mon.c.smithi172.stdout: Interval stall: 00:00:0.000 H:M:S, 0.0 percent 2024-09-12T02:28:24.035 INFO:journalctl@ceph.mon.c.smithi172.stdout: 2024-09-12T02:28:24.035 INFO:journalctl@ceph.mon.c.smithi172.stdout: ** Compaction Stats [default] ** 2024-09-12T02:28:24.035 INFO:journalctl@ceph.mon.c.smithi172.stdout: Level Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) 2024-09-12T02:28:24.035 INFO:journalctl@ceph.mon.c.smithi172.stdout: ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------ 2024-09-12T02:28:24.035 INFO:journalctl@ceph.mon.c.smithi172.stdout: L0 1/0 1.61 KB 0.2 0.0 0.0 0.0 0.0 0.0 0.0 1.0 0.0 3.9 0.00 0.00 1 0.000 0 0 0.0 0.0 2024-09-12T02:28:24.035 INFO:journalctl@ceph.mon.c.smithi172.stdout: Sum 1/0 1.61 KB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 1.0 0.0 3.9 0.00 0.00 1 0.000 0 0 0.0 0.0 2024-09-12T02:28:24.035 INFO:journalctl@ceph.mon.c.smithi172.stdout: Int 0/0 0.00 KB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 1.0 0.0 3.9 0.00 0.00 1 0.000 0 0 0.0 0.0 2024-09-12T02:28:24.035 INFO:journalctl@ceph.mon.c.smithi172.stdout: 2024-09-12T02:28:24.035 INFO:journalctl@ceph.mon.c.smithi172.stdout: ** Compaction Stats [default] ** 2024-09-12T02:28:24.035 INFO:journalctl@ceph.mon.c.smithi172.stdout: Priority Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) 2024-09-12T02:28:24.035 INFO:journalctl@ceph.mon.c.smithi172.stdout: --------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- 2024-09-12T02:28:24.035 INFO:journalctl@ceph.mon.c.smithi172.stdout: User 0/0 0.00 KB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 3.9 0.00 0.00 1 0.000 0 0 0.0 0.0 2024-09-12T02:28:24.035 INFO:journalctl@ceph.mon.c.smithi172.stdout: 2024-09-12T02:28:24.036 INFO:journalctl@ceph.mon.c.smithi172.stdout: Blob file count: 0, total size: 0.0 GB, garbage size: 0.0 GB, space amp: 0.0 2024-09-12T02:28:24.036 INFO:journalctl@ceph.mon.c.smithi172.stdout: 2024-09-12T02:28:24.036 INFO:journalctl@ceph.mon.c.smithi172.stdout: Uptime(secs): 0.0 total, 0.0 interval 2024-09-12T02:28:24.036 INFO:journalctl@ceph.mon.c.smithi172.stdout: Flush(GB): cumulative 0.000, interval 0.000 2024-09-12T02:28:24.036 INFO:journalctl@ceph.mon.c.smithi172.stdout: AddFile(GB): cumulative 0.000, interval 0.000 2024-09-12T02:28:24.036 INFO:journalctl@ceph.mon.c.smithi172.stdout: AddFile(Total Files): cumulative 0, interval 0 2024-09-12T02:28:24.036 INFO:journalctl@ceph.mon.c.smithi172.stdout: AddFile(L0 Files): cumulative 0, interval 0 2024-09-12T02:28:24.036 INFO:journalctl@ceph.mon.c.smithi172.stdout: AddFile(Keys): cumulative 0, interval 0 2024-09-12T02:28:24.036 INFO:journalctl@ceph.mon.c.smithi172.stdout: Cumulative compaction: 0.00 GB write, 0.61 MB/s write, 0.00 GB read, 0.00 MB/s read, 0.0 seconds 2024-09-12T02:28:24.036 INFO:journalctl@ceph.mon.c.smithi172.stdout: Interval compaction: 0.00 GB write, 0.61 MB/s write, 0.00 GB read, 0.00 MB/s read, 0.0 seconds 2024-09-12T02:28:24.036 INFO:journalctl@ceph.mon.c.smithi172.stdout: Stalls(count): 0 level0_slowdown, 0 level0_slowdown_with_compaction, 0 level0_numfiles, 0 level0_numfiles_with_compaction, 0 stop for pending_compaction_bytes, 0 slowdown for pending_compaction_bytes, 0 memtable_compaction, 0 memtable_slowdown, interval 0 total count 2024-09-12T02:28:24.036 INFO:journalctl@ceph.mon.c.smithi172.stdout: Block cache BinnedLRUCache@0x55cf354191f0#2 capacity: 512.00 MB usage: 0.22 KB table_size: 0 occupancy: 18446744073709551615 collections: 1 last_copies: 0 last_secs: 9e-06 secs_since: 0 2024-09-12T02:28:24.036 INFO:journalctl@ceph.mon.c.smithi172.stdout: Block cache entry stats(count,size,portion): FilterBlock(1,0.11 KB,2.08616e-05%) IndexBlock(1,0.11 KB,2.08616e-05%) Misc(1,0.00 KB,0%) 2024-09-12T02:28:24.036 INFO:journalctl@ceph.mon.c.smithi172.stdout: 2024-09-12T02:28:24.037 INFO:journalctl@ceph.mon.c.smithi172.stdout: ** File Read Latency Histogram By Level [default] ** 2024-09-12T02:28:24.037 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 12 02:28:23 smithi172 ceph-mon[35609]: mon.c does not exist in monmap, will attempt to join an existing cluster 2024-09-12T02:28:24.037 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 12 02:28:23 smithi172 ceph-mon[35609]: using public_addr v2:172.21.15.172:0/0 -> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] 2024-09-12T02:28:24.037 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 12 02:28:23 smithi172 ceph-mon[35609]: starting mon.c rank -1 at public addrs [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] at bind addrs [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] mon_data /var/lib/ceph/mon/ceph-c fsid 4954ed46-70ae-11ef-bcea-c7b262605968 2024-09-12T02:28:24.037 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 12 02:28:23 smithi172 ceph-mon[35609]: mon.c@-1(???) e0 preinit fsid 4954ed46-70ae-11ef-bcea-c7b262605968 2024-09-12T02:28:24.037 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 12 02:28:23 smithi172 ceph-mon[35609]: mon.c@-1(synchronizing).mds e1 new map 2024-09-12T02:28:24.037 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 12 02:28:23 smithi172 ceph-mon[35609]: mon.c@-1(synchronizing).mds e1 print_map 2024-09-12T02:28:24.037 INFO:journalctl@ceph.mon.c.smithi172.stdout: e1 2024-09-12T02:28:24.037 INFO:journalctl@ceph.mon.c.smithi172.stdout: btime 2024-09-12T02:26:43:086025+0000 2024-09-12T02:28:24.037 INFO:journalctl@ceph.mon.c.smithi172.stdout: enable_multiple, ever_enabled_multiple: 1,1 2024-09-12T02:28:24.037 INFO:journalctl@ceph.mon.c.smithi172.stdout: default compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2,11=minor log segments,12=quiesce subvolumes} 2024-09-12T02:28:24.037 INFO:journalctl@ceph.mon.c.smithi172.stdout: legacy client fscid: -1 2024-09-12T02:28:24.037 INFO:journalctl@ceph.mon.c.smithi172.stdout: 2024-09-12T02:28:24.038 INFO:journalctl@ceph.mon.c.smithi172.stdout: No filesystems configured 2024-09-12T02:28:24.038 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 12 02:28:23 smithi172 ceph-mon[35609]: mon.c@-1(synchronizing).osd e0 _set_cache_ratios kv ratio 0.25 inc ratio 0.375 full ratio 0.375 2024-09-12T02:28:24.038 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 12 02:28:23 smithi172 ceph-mon[35609]: mon.c@-1(synchronizing).osd e0 register_cache_with_pcm pcm target: 2147483648 pcm max: 1020054732 pcm min: 134217728 inc_osd_cache size: 1 2024-09-12T02:28:24.038 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 12 02:28:23 smithi172 ceph-mon[35609]: mon.c@-1(synchronizing).osd e1 e1: 0 total, 0 up, 0 in 2024-09-12T02:28:24.038 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 12 02:28:23 smithi172 ceph-mon[35609]: mon.c@-1(synchronizing).osd e2 e2: 0 total, 0 up, 0 in 2024-09-12T02:28:24.038 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 12 02:28:23 smithi172 ceph-mon[35609]: mon.c@-1(synchronizing).osd e3 e3: 0 total, 0 up, 0 in 2024-09-12T02:28:24.038 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 12 02:28:23 smithi172 ceph-mon[35609]: mon.c@-1(synchronizing).osd e4 e4: 0 total, 0 up, 0 in 2024-09-12T02:28:24.038 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 12 02:28:23 smithi172 ceph-mon[35609]: mon.c@-1(synchronizing).osd e4 crush map has features 3314932999778484224, adjusting msgr requires 2024-09-12T02:28:24.038 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 12 02:28:23 smithi172 ceph-mon[35609]: mon.c@-1(synchronizing).osd e4 crush map has features 288514050185494528, adjusting msgr requires 2024-09-12T02:28:24.038 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 12 02:28:23 smithi172 ceph-mon[35609]: mon.c@-1(synchronizing).osd e4 crush map has features 288514050185494528, adjusting msgr requires 2024-09-12T02:28:24.038 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 12 02:28:23 smithi172 ceph-mon[35609]: mon.c@-1(synchronizing).osd e4 crush map has features 288514050185494528, adjusting msgr requires 2024-09-12T02:28:24.038 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 12 02:28:23 smithi172 ceph-mon[35609]: from='client.14176 -' entity='client.admin' cmd=[{"prefix": "orch host ls", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-09-12T02:28:24.038 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 12 02:28:23 smithi172 ceph-mon[35609]: pgmap v4: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-12T02:28:24.038 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 12 02:28:23 smithi172 ceph-mon[35609]: from='client.14178 -' entity='client.admin' cmd=[{"prefix": "orch host add", "hostname": "smithi172", "target": ["mon-mgr", ""]}]: dispatch 2024-09-12T02:28:24.039 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 12 02:28:23 smithi172 ceph-mon[35609]: from='mgr.14150 172.21.15.39:0/408627207' entity='mgr.x' 2024-09-12T02:28:24.039 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 12 02:28:23 smithi172 ceph-mon[35609]: from='mgr.14150 172.21.15.39:0/408627207' entity='mgr.x' 2024-09-12T02:28:24.039 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 12 02:28:23 smithi172 ceph-mon[35609]: from='mgr.14150 172.21.15.39:0/408627207' entity='mgr.x' 2024-09-12T02:28:24.039 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 12 02:28:23 smithi172 ceph-mon[35609]: from='mgr.14150 172.21.15.39:0/408627207' entity='mgr.x' 2024-09-12T02:28:24.039 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 12 02:28:23 smithi172 ceph-mon[35609]: from='mgr.14150 172.21.15.39:0/408627207' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd/host:smithi044", "name": "osd_memory_target"}]: dispatch 2024-09-12T02:28:24.039 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 12 02:28:23 smithi172 ceph-mon[35609]: from='mgr.14150 172.21.15.39:0/408627207' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-12T02:28:24.039 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 12 02:28:23 smithi172 ceph-mon[35609]: from='mgr.14150 172.21.15.39:0/408627207' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-12T02:28:24.039 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 12 02:28:23 smithi172 ceph-mon[35609]: pgmap v5: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-12T02:28:24.039 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 12 02:28:23 smithi172 ceph-mon[35609]: Updating smithi044:/etc/ceph/ceph.conf 2024-09-12T02:28:24.039 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 12 02:28:23 smithi172 ceph-mon[35609]: Updating smithi044:/var/lib/ceph/4954ed46-70ae-11ef-bcea-c7b262605968/config/ceph.conf 2024-09-12T02:28:24.039 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 12 02:28:23 smithi172 ceph-mon[35609]: Updating smithi044:/etc/ceph/ceph.client.admin.keyring 2024-09-12T02:28:24.039 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 12 02:28:23 smithi172 ceph-mon[35609]: Updating smithi044:/var/lib/ceph/4954ed46-70ae-11ef-bcea-c7b262605968/config/ceph.client.admin.keyring 2024-09-12T02:28:24.039 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 12 02:28:23 smithi172 ceph-mon[35609]: Deploying cephadm binary to smithi172 2024-09-12T02:28:24.039 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 12 02:28:23 smithi172 ceph-mon[35609]: from='mgr.14150 172.21.15.39:0/408627207' entity='mgr.x' 2024-09-12T02:28:24.040 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 12 02:28:23 smithi172 ceph-mon[35609]: from='mgr.14150 172.21.15.39:0/408627207' entity='mgr.x' 2024-09-12T02:28:24.040 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 12 02:28:23 smithi172 ceph-mon[35609]: from='mgr.14150 172.21.15.39:0/408627207' entity='mgr.x' 2024-09-12T02:28:24.040 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 12 02:28:23 smithi172 ceph-mon[35609]: pgmap v6: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-12T02:28:24.040 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 12 02:28:23 smithi172 ceph-mon[35609]: from='mgr.14150 172.21.15.39:0/408627207' entity='mgr.x' 2024-09-12T02:28:24.040 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 12 02:28:23 smithi172 ceph-mon[35609]: from='mgr.14150 172.21.15.39:0/408627207' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-12T02:28:24.040 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 12 02:28:23 smithi172 ceph-mon[35609]: from='mgr.14150 172.21.15.39:0/408627207' entity='mgr.x' 2024-09-12T02:28:24.040 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 12 02:28:23 smithi172 ceph-mon[35609]: Added host smithi172 2024-09-12T02:28:24.040 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 12 02:28:23 smithi172 ceph-mon[35609]: from='mgr.14150 172.21.15.39:0/408627207' entity='mgr.x' 2024-09-12T02:28:24.040 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 12 02:28:23 smithi172 ceph-mon[35609]: from='mgr.14150 172.21.15.39:0/408627207' entity='mgr.x' 2024-09-12T02:28:24.040 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 12 02:28:23 smithi172 ceph-mon[35609]: pgmap v7: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-12T02:28:24.040 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 12 02:28:23 smithi172 ceph-mon[35609]: from='client.14180 -' entity='client.admin' cmd=[{"prefix": "orch host ls", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-09-12T02:28:24.040 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 12 02:28:23 smithi172 ceph-mon[35609]: pgmap v8: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-12T02:28:24.040 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 12 02:28:23 smithi172 ceph-mon[35609]: from='client.? 172.21.15.39:0/549691537' entity='client.admin' cmd=[{"prefix": "osd crush tunables", "profile": "default"}]: dispatch 2024-09-12T02:28:24.040 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 12 02:28:23 smithi172 ceph-mon[35609]: from='mgr.14150 172.21.15.39:0/408627207' entity='mgr.x' 2024-09-12T02:28:24.041 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 12 02:28:23 smithi172 ceph-mon[35609]: from='mgr.14150 172.21.15.39:0/408627207' entity='mgr.x' 2024-09-12T02:28:24.041 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 12 02:28:23 smithi172 ceph-mon[35609]: from='mgr.14150 172.21.15.39:0/408627207' entity='mgr.x' 2024-09-12T02:28:24.041 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 12 02:28:23 smithi172 ceph-mon[35609]: from='mgr.14150 172.21.15.39:0/408627207' entity='mgr.x' 2024-09-12T02:28:24.041 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 12 02:28:23 smithi172 ceph-mon[35609]: from='mgr.14150 172.21.15.39:0/408627207' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd/host:smithi172", "name": "osd_memory_target"}]: dispatch 2024-09-12T02:28:24.041 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 12 02:28:23 smithi172 ceph-mon[35609]: from='mgr.14150 172.21.15.39:0/408627207' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-12T02:28:24.041 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 12 02:28:23 smithi172 ceph-mon[35609]: from='mgr.14150 172.21.15.39:0/408627207' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-12T02:28:24.041 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 12 02:28:23 smithi172 ceph-mon[35609]: Updating smithi172:/etc/ceph/ceph.conf 2024-09-12T02:28:24.041 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 12 02:28:23 smithi172 ceph-mon[35609]: Updating smithi172:/var/lib/ceph/4954ed46-70ae-11ef-bcea-c7b262605968/config/ceph.conf 2024-09-12T02:28:24.041 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 12 02:28:23 smithi172 ceph-mon[35609]: from='client.? 172.21.15.39:0/549691537' entity='client.admin' cmd='[{"prefix": "osd crush tunables", "profile": "default"}]': finished 2024-09-12T02:28:24.041 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 12 02:28:23 smithi172 ceph-mon[35609]: osdmap e4: 0 total, 0 up, 0 in 2024-09-12T02:28:24.041 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 12 02:28:23 smithi172 ceph-mon[35609]: from='mgr.14150 172.21.15.39:0/408627207' entity='mgr.x' 2024-09-12T02:28:24.041 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 12 02:28:23 smithi172 ceph-mon[35609]: from='mgr.14150 172.21.15.39:0/408627207' entity='mgr.x' 2024-09-12T02:28:24.041 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 12 02:28:23 smithi172 ceph-mon[35609]: from='mgr.14150 172.21.15.39:0/408627207' entity='mgr.x' 2024-09-12T02:28:24.041 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 12 02:28:23 smithi172 ceph-mon[35609]: pgmap v10: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-12T02:28:24.042 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 12 02:28:23 smithi172 ceph-mon[35609]: Updating smithi172:/etc/ceph/ceph.client.admin.keyring 2024-09-12T02:28:24.042 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 12 02:28:23 smithi172 ceph-mon[35609]: Updating smithi172:/var/lib/ceph/4954ed46-70ae-11ef-bcea-c7b262605968/config/ceph.client.admin.keyring 2024-09-12T02:28:24.042 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 12 02:28:23 smithi172 ceph-mon[35609]: from='client.14184 -' entity='client.admin' cmd=[{"prefix": "orch apply", "service_type": "mon", "placement": "3;smithi039:172.21.15.39=a;smithi044:172.21.15.44=b;smithi172:172.21.15.172=c", "target": ["mon-mgr", ""]}]: dispatch 2024-09-12T02:28:24.042 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 12 02:28:23 smithi172 ceph-mon[35609]: Saving service mon spec with placement smithi039:172.21.15.39=a;smithi044:172.21.15.44=b;smithi172:172.21.15.172=c;count:3 2024-09-12T02:28:24.042 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 12 02:28:23 smithi172 ceph-mon[35609]: from='mgr.14150 172.21.15.39:0/408627207' entity='mgr.x' 2024-09-12T02:28:24.042 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 12 02:28:23 smithi172 ceph-mon[35609]: from='mgr.14150 172.21.15.39:0/408627207' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-12T02:28:24.042 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 12 02:28:23 smithi172 ceph-mon[35609]: from='mgr.14150 172.21.15.39:0/408627207' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-12T02:28:24.042 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 12 02:28:23 smithi172 ceph-mon[35609]: from='mgr.14150 172.21.15.39:0/408627207' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-12T02:28:24.042 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 12 02:28:23 smithi172 ceph-mon[35609]: from='mgr.14150 172.21.15.39:0/408627207' entity='mgr.x' 2024-09-12T02:28:24.042 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 12 02:28:23 smithi172 ceph-mon[35609]: from='mgr.14150 172.21.15.39:0/408627207' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2024-09-12T02:28:24.042 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 12 02:28:23 smithi172 ceph-mon[35609]: from='mgr.14150 172.21.15.39:0/408627207' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-12T02:28:24.042 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 12 02:28:23 smithi172 ceph-mon[35609]: Deploying daemon mon.c on smithi172 2024-09-12T02:28:24.042 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 12 02:28:23 smithi172 ceph-mon[35609]: pgmap v11: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-12T02:28:24.042 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 12 02:28:23 smithi172 ceph-mon[35609]: from='client.? 172.21.15.172:0/955370917' entity='client.admin' cmd=[{"prefix": "mon dump", "format": "json"}]: dispatch 2024-09-12T02:28:24.043 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 12 02:28:23 smithi172 ceph-mon[35609]: pgmap v12: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-12T02:28:24.043 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 12 02:28:23 smithi172 ceph-mon[35609]: mon.c@-1(synchronizing).paxosservice(auth 1..3) refresh upgraded, format 0 -> 3 2024-09-12T02:28:24.043 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 12 02:28:23 smithi172 bash[35578]: d652d920a68131c82cc8981f2e3c21867791ae6f87554cb9b7e48df69d048395 2024-09-12T02:28:24.043 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 12 02:28:23 smithi172 systemd[1]: Started Ceph mon.c for 4954ed46-70ae-11ef-bcea-c7b262605968. 2024-09-12T02:28:25.231 INFO:tasks.cephadm:Waiting for 3 mons in monmap... 2024-09-12T02:28:25.232 DEBUG:teuthology.orchestra.run.smithi172:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 4954ed46-70ae-11ef-bcea-c7b262605968 -- ceph mon dump -f json 2024-09-12T02:28:25.497 INFO:teuthology.orchestra.run.smithi172.stderr:Inferring config /var/lib/ceph/4954ed46-70ae-11ef-bcea-c7b262605968/mon.c/config 2024-09-12T02:28:28.937 INFO:teuthology.orchestra.run.smithi172.stderr:2024-09-12T02:28:28.936+0000 7fcea2edb640 1 -- 172.21.15.172:0/96271408 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fce8c003530 msgr2=0x7fce8c0059c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:28:28.938 INFO:teuthology.orchestra.run.smithi172.stderr:2024-09-12T02:28:28.936+0000 7fcea2edb640 1 --2- 172.21.15.172:0/96271408 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fce8c003530 0x7fce8c0059c0 secure :-1 s=READY pgs=98 cs=0 l=1 rev1=1 crypto rx=0x7fce9c1016a0 tx=0x7fce9002bce0 comp rx=0 tx=0).stop 2024-09-12T02:28:28.938 INFO:teuthology.orchestra.run.smithi172.stderr:2024-09-12T02:28:28.936+0000 7fcea2edb640 1 -- 172.21.15.172:0/96271408 shutdown_connections 2024-09-12T02:28:28.938 INFO:teuthology.orchestra.run.smithi172.stderr:2024-09-12T02:28:28.936+0000 7fcea2edb640 1 --2- 172.21.15.172:0/96271408 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fce8c003530 0x7fce8c0059c0 unknown :-1 s=CLOSED pgs=98 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:28:28.938 INFO:teuthology.orchestra.run.smithi172.stderr:2024-09-12T02:28:28.936+0000 7fcea2edb640 1 -- 172.21.15.172:0/96271408 >> 172.21.15.172:0/96271408 conn(0x7fce9c0fc220 msgr2=0x7fce9c0fe640 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:28:28.938 INFO:teuthology.orchestra.run.smithi172.stderr:2024-09-12T02:28:28.936+0000 7fcea2edb640 1 -- 172.21.15.172:0/96271408 shutdown_connections 2024-09-12T02:28:28.938 INFO:teuthology.orchestra.run.smithi172.stderr:2024-09-12T02:28:28.936+0000 7fcea2edb640 1 -- 172.21.15.172:0/96271408 wait complete. 2024-09-12T02:28:28.938 INFO:teuthology.orchestra.run.smithi172.stderr:2024-09-12T02:28:28.937+0000 7fcea2edb640 1 Processor -- start 2024-09-12T02:28:28.938 INFO:teuthology.orchestra.run.smithi172.stderr:2024-09-12T02:28:28.937+0000 7fcea2edb640 1 -- start start 2024-09-12T02:28:28.940 INFO:teuthology.orchestra.run.smithi172.stderr:2024-09-12T02:28:28.937+0000 7fcea2edb640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fce8c003530 0x7fce9c198100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:28:28.940 INFO:teuthology.orchestra.run.smithi172.stderr:2024-09-12T02:28:28.937+0000 7fcea2edb640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fce9c198640 0x7fce9c198aa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:28:28.940 INFO:teuthology.orchestra.run.smithi172.stderr:2024-09-12T02:28:28.937+0000 7fcea2edb640 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 -- 0x7fce9c108670 con 0x7fce9c198640 2024-09-12T02:28:28.940 INFO:teuthology.orchestra.run.smithi172.stderr:2024-09-12T02:28:28.937+0000 7fcea2edb640 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7fce9c1084f0 con 0x7fce8c003530 2024-09-12T02:28:28.940 INFO:teuthology.orchestra.run.smithi172.stderr:2024-09-12T02:28:28.937+0000 7fcea0c77640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fce8c003530 0x7fce9c198100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:28:28.940 INFO:teuthology.orchestra.run.smithi172.stderr:2024-09-12T02:28:28.937+0000 7fcea0c77640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fce8c003530 0x7fce9c198100 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.172:3300/0 says I am v2:172.21.15.172:60724/0 (socket says 172.21.15.172:60724) 2024-09-12T02:28:28.940 INFO:teuthology.orchestra.run.smithi172.stderr:2024-09-12T02:28:28.937+0000 7fcea0c77640 1 -- 172.21.15.172:0/3707367595 learned_addr learned my addr 172.21.15.172:0/3707367595 (peer_addr_for_me v2:172.21.15.172:0/0) 2024-09-12T02:28:28.940 INFO:teuthology.orchestra.run.smithi172.stderr:2024-09-12T02:28:28.938+0000 7fcea0c77640 1 -- 172.21.15.172:0/3707367595 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fce8c003530 msgr2=0x7fce9c198100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_bulk peer close file descriptor 12 2024-09-12T02:28:28.940 INFO:teuthology.orchestra.run.smithi172.stderr:2024-09-12T02:28:28.938+0000 7fcea0c77640 1 -- 172.21.15.172:0/3707367595 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fce8c003530 msgr2=0x7fce9c198100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until read failed 2024-09-12T02:28:28.940 INFO:teuthology.orchestra.run.smithi172.stderr:2024-09-12T02:28:28.938+0000 7fcea0c77640 1 --2- 172.21.15.172:0/3707367595 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fce8c003530 0x7fce9c198100 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-09-12T02:28:28.940 INFO:teuthology.orchestra.run.smithi172.stderr:2024-09-12T02:28:28.938+0000 7fcea0c77640 1 --2- 172.21.15.172:0/3707367595 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fce8c003530 0x7fce9c198100 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-09-12T02:28:28.940 INFO:teuthology.orchestra.run.smithi172.stderr:2024-09-12T02:28:28.938+0000 7fce9bfff640 1 --2- 172.21.15.172:0/3707367595 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fce9c198640 0x7fce9c198aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:28:28.941 INFO:teuthology.orchestra.run.smithi172.stderr:2024-09-12T02:28:28.938+0000 7fce9bfff640 1 -- 172.21.15.172:0/3707367595 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fce8c003530 msgr2=0x7fce9c198100 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-09-12T02:28:28.941 INFO:teuthology.orchestra.run.smithi172.stderr:2024-09-12T02:28:28.938+0000 7fce9bfff640 1 --2- 172.21.15.172:0/3707367595 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fce8c003530 0x7fce9c198100 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:28:28.941 INFO:teuthology.orchestra.run.smithi172.stderr:2024-09-12T02:28:28.938+0000 7fce9bfff640 1 -- 172.21.15.172:0/3707367595 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fce9c1a1170 con 0x7fce9c198640 2024-09-12T02:28:28.941 INFO:teuthology.orchestra.run.smithi172.stderr:2024-09-12T02:28:28.938+0000 7fce9bfff640 1 --2- 172.21.15.172:0/3707367595 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fce9c198640 0x7fce9c198aa0 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0x7fce8800b400 tx=0x7fce8800b8c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:28:28.941 INFO:teuthology.orchestra.run.smithi172.stderr:2024-09-12T02:28:28.939+0000 7fce99ffb640 1 -- 172.21.15.172:0/3707367595 <== mon.0 v2:172.21.15.39:3300/0 1 ==== mon_map magic: 0 ==== 309+0+0 (secure 0 0 0) 0x7fce88011630 con 0x7fce9c198640 2024-09-12T02:28:28.941 INFO:teuthology.orchestra.run.smithi172.stderr:2024-09-12T02:28:28.939+0000 7fce99ffb640 1 -- 172.21.15.172:0/3707367595 <== mon.0 v2:172.21.15.39:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fce88011cb0 con 0x7fce9c198640 2024-09-12T02:28:28.941 INFO:teuthology.orchestra.run.smithi172.stderr:2024-09-12T02:28:28.939+0000 7fcea2edb640 1 -- 172.21.15.172:0/3707367595 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fce9c1a1340 con 0x7fce9c198640 2024-09-12T02:28:28.941 INFO:teuthology.orchestra.run.smithi172.stderr:2024-09-12T02:28:28.939+0000 7fce99ffb640 1 -- 172.21.15.172:0/3707367595 <== mon.0 v2:172.21.15.39:3300/0 3 ==== mon_map magic: 0 ==== 309+0+0 (secure 0 0 0) 0x7fce88010d80 con 0x7fce9c198640 2024-09-12T02:28:28.941 INFO:teuthology.orchestra.run.smithi172.stderr:2024-09-12T02:28:28.939+0000 7fcea2edb640 1 -- 172.21.15.172:0/3707367595 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fce9c1a18a0 con 0x7fce9c198640 2024-09-12T02:28:28.942 INFO:teuthology.orchestra.run.smithi172.stderr:2024-09-12T02:28:28.940+0000 7fce99ffb640 1 -- 172.21.15.172:0/3707367595 <== mon.0 v2:172.21.15.39:3300/0 4 ==== mgrmap(e 13) ==== 46343+0+0 (secure 0 0 0) 0x7fce88018020 con 0x7fce9c198640 2024-09-12T02:28:28.942 INFO:teuthology.orchestra.run.smithi172.stderr:2024-09-12T02:28:28.940+0000 7fce99ffb640 1 --2- 172.21.15.172:0/3707367595 >> [v2:172.21.15.39:6800/1725006999,v1:172.21.15.39:6801/1725006999] conn(0x7fce80038e00 0x7fce8003b2c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:28:28.942 INFO:teuthology.orchestra.run.smithi172.stderr:2024-09-12T02:28:28.940+0000 7fce99ffb640 1 -- 172.21.15.172:0/3707367595 <== mon.0 v2:172.21.15.39:3300/0 5 ==== osd_map(4..4 src has 1..4) ==== 1155+0+0 (secure 0 0 0) 0x7fce8804bbe0 con 0x7fce9c198640 2024-09-12T02:28:28.942 INFO:teuthology.orchestra.run.smithi172.stderr:2024-09-12T02:28:28.940+0000 7fcea2edb640 1 -- 172.21.15.172:0/3707367595 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fce9c101ca0 con 0x7fce9c198640 2024-09-12T02:28:28.942 INFO:teuthology.orchestra.run.smithi172.stderr:2024-09-12T02:28:28.941+0000 7fcea0c77640 1 --2- 172.21.15.172:0/3707367595 >> [v2:172.21.15.39:6800/1725006999,v1:172.21.15.39:6801/1725006999] conn(0x7fce80038e00 0x7fce8003b2c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:28:28.942 INFO:teuthology.orchestra.run.smithi172.stderr:2024-09-12T02:28:28.941+0000 7fcea0c77640 1 --2- 172.21.15.172:0/3707367595 >> [v2:172.21.15.39:6800/1725006999,v1:172.21.15.39:6801/1725006999] conn(0x7fce80038e00 0x7fce8003b2c0 secure :-1 s=READY pgs=27 cs=0 l=1 rev1=1 crypto rx=0x7fce90005940 tx=0x7fce900058b0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:28:28.946 INFO:teuthology.orchestra.run.smithi172.stderr:2024-09-12T02:28:28.946+0000 7fce99ffb640 1 -- 172.21.15.172:0/3707367595 <== mon.0 v2:172.21.15.39:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7fce8801f020 con 0x7fce9c198640 2024-09-12T02:28:29.100 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 02:28:28 smithi039 ceph-mon[30515]: from='mgr.14150 172.21.15.39:0/408627207' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2024-09-12T02:28:29.100 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 02:28:28 smithi039 ceph-mon[30515]: from='mgr.14150 172.21.15.39:0/408627207' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-09-12T02:28:29.100 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 02:28:28 smithi039 ceph-mon[30515]: mon.a calling monitor election 2024-09-12T02:28:29.100 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 02:28:28 smithi039 ceph-mon[30515]: pgmap v14: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-12T02:28:29.100 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 02:28:28 smithi039 ceph-mon[30515]: from='mgr.14150 172.21.15.39:0/408627207' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-09-12T02:28:29.100 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 02:28:28 smithi039 ceph-mon[30515]: mon.c calling monitor election 2024-09-12T02:28:29.101 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 02:28:28 smithi039 ceph-mon[30515]: from='mgr.14150 172.21.15.39:0/408627207' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-09-12T02:28:29.101 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 02:28:28 smithi039 ceph-mon[30515]: pgmap v15: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-12T02:28:29.101 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 02:28:28 smithi039 ceph-mon[30515]: from='mgr.14150 172.21.15.39:0/408627207' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-09-12T02:28:29.101 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 02:28:28 smithi039 ceph-mon[30515]: from='mgr.14150 172.21.15.39:0/408627207' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-09-12T02:28:29.101 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 02:28:28 smithi039 ceph-mon[30515]: from='mgr.14150 172.21.15.39:0/408627207' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-09-12T02:28:29.101 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 02:28:28 smithi039 ceph-mon[30515]: mon.a is new leader, mons a,c in quorum (ranks 0,1) 2024-09-12T02:28:29.101 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 02:28:28 smithi039 ceph-mon[30515]: monmap epoch 2 2024-09-12T02:28:29.101 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 02:28:28 smithi039 ceph-mon[30515]: fsid 4954ed46-70ae-11ef-bcea-c7b262605968 2024-09-12T02:28:29.101 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 02:28:28 smithi039 ceph-mon[30515]: last_changed 2024-09-12T02:28:23.741500+0000 2024-09-12T02:28:29.101 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 02:28:28 smithi039 ceph-mon[30515]: created 2024-09-12T02:26:39.333323+0000 2024-09-12T02:28:29.101 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 02:28:28 smithi039 ceph-mon[30515]: min_mon_release 19 (squid) 2024-09-12T02:28:29.101 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 02:28:28 smithi039 ceph-mon[30515]: election_strategy: 1 2024-09-12T02:28:29.101 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 02:28:28 smithi039 ceph-mon[30515]: 0: [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] mon.a 2024-09-12T02:28:29.101 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 02:28:28 smithi039 ceph-mon[30515]: 1: [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] mon.c 2024-09-12T02:28:29.102 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 02:28:28 smithi039 ceph-mon[30515]: fsmap 2024-09-12T02:28:29.102 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 02:28:28 smithi039 ceph-mon[30515]: osdmap e4: 0 total, 0 up, 0 in 2024-09-12T02:28:29.102 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 02:28:28 smithi039 ceph-mon[30515]: mgrmap e13: x(active, since 44s) 2024-09-12T02:28:29.102 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 02:28:28 smithi039 ceph-mon[30515]: overall HEALTH_OK 2024-09-12T02:28:29.102 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 02:28:28 smithi039 ceph-mon[30515]: from='mgr.14150 172.21.15.39:0/408627207' entity='mgr.x' 2024-09-12T02:28:29.102 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 02:28:28 smithi039 ceph-mon[30515]: from='mgr.14150 172.21.15.39:0/408627207' entity='mgr.x' 2024-09-12T02:28:29.102 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 02:28:28 smithi039 ceph-mon[30515]: from='mgr.14150 172.21.15.39:0/408627207' entity='mgr.x' 2024-09-12T02:28:29.102 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 02:28:28 smithi039 ceph-mon[30515]: from='mgr.14150 172.21.15.39:0/408627207' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2024-09-12T02:28:29.102 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 02:28:28 smithi039 ceph-mon[30515]: from='mgr.14150 172.21.15.39:0/408627207' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-12T02:28:29.181 INFO:teuthology.orchestra.run.smithi172.stderr:2024-09-12T02:28:29.180+0000 7fcea2edb640 1 -- 172.21.15.172:0/3707367595 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_command({"prefix": "mon dump", "format": "json"} v 0) -- 0x7fce9c06aaf0 con 0x7fce9c198640 2024-09-12T02:28:29.181 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 12 02:28:28 smithi172 ceph-mon[35609]: from='mgr.14150 172.21.15.39:0/408627207' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2024-09-12T02:28:29.181 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 12 02:28:28 smithi172 ceph-mon[35609]: from='mgr.14150 172.21.15.39:0/408627207' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-09-12T02:28:29.181 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 12 02:28:28 smithi172 ceph-mon[35609]: mon.a calling monitor election 2024-09-12T02:28:29.181 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 12 02:28:28 smithi172 ceph-mon[35609]: pgmap v14: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-12T02:28:29.182 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 12 02:28:28 smithi172 ceph-mon[35609]: from='mgr.14150 172.21.15.39:0/408627207' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-09-12T02:28:29.182 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 12 02:28:28 smithi172 ceph-mon[35609]: mon.c calling monitor election 2024-09-12T02:28:29.182 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 12 02:28:28 smithi172 ceph-mon[35609]: from='mgr.14150 172.21.15.39:0/408627207' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-09-12T02:28:29.182 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 12 02:28:28 smithi172 ceph-mon[35609]: pgmap v15: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-12T02:28:29.182 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 12 02:28:28 smithi172 ceph-mon[35609]: from='mgr.14150 172.21.15.39:0/408627207' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-09-12T02:28:29.182 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 12 02:28:28 smithi172 ceph-mon[35609]: from='mgr.14150 172.21.15.39:0/408627207' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-09-12T02:28:29.182 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 12 02:28:28 smithi172 ceph-mon[35609]: from='mgr.14150 172.21.15.39:0/408627207' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-09-12T02:28:29.182 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 12 02:28:28 smithi172 ceph-mon[35609]: mon.a is new leader, mons a,c in quorum (ranks 0,1) 2024-09-12T02:28:29.182 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 12 02:28:28 smithi172 ceph-mon[35609]: monmap epoch 2 2024-09-12T02:28:29.182 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 12 02:28:28 smithi172 ceph-mon[35609]: fsid 4954ed46-70ae-11ef-bcea-c7b262605968 2024-09-12T02:28:29.182 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 12 02:28:28 smithi172 ceph-mon[35609]: last_changed 2024-09-12T02:28:23.741500+0000 2024-09-12T02:28:29.182 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 12 02:28:28 smithi172 ceph-mon[35609]: created 2024-09-12T02:26:39.333323+0000 2024-09-12T02:28:29.182 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 12 02:28:28 smithi172 ceph-mon[35609]: min_mon_release 19 (squid) 2024-09-12T02:28:29.183 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 12 02:28:28 smithi172 ceph-mon[35609]: election_strategy: 1 2024-09-12T02:28:29.183 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 12 02:28:28 smithi172 ceph-mon[35609]: 0: [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] mon.a 2024-09-12T02:28:29.183 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 12 02:28:28 smithi172 ceph-mon[35609]: 1: [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] mon.c 2024-09-12T02:28:29.183 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 12 02:28:28 smithi172 ceph-mon[35609]: fsmap 2024-09-12T02:28:29.183 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 12 02:28:28 smithi172 ceph-mon[35609]: osdmap e4: 0 total, 0 up, 0 in 2024-09-12T02:28:29.183 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 12 02:28:28 smithi172 ceph-mon[35609]: mgrmap e13: x(active, since 44s) 2024-09-12T02:28:29.183 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 12 02:28:28 smithi172 ceph-mon[35609]: overall HEALTH_OK 2024-09-12T02:28:29.183 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 12 02:28:28 smithi172 ceph-mon[35609]: from='mgr.14150 172.21.15.39:0/408627207' entity='mgr.x' 2024-09-12T02:28:29.183 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 12 02:28:28 smithi172 ceph-mon[35609]: from='mgr.14150 172.21.15.39:0/408627207' entity='mgr.x' 2024-09-12T02:28:29.183 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 12 02:28:28 smithi172 ceph-mon[35609]: from='mgr.14150 172.21.15.39:0/408627207' entity='mgr.x' 2024-09-12T02:28:29.183 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 12 02:28:28 smithi172 ceph-mon[35609]: from='mgr.14150 172.21.15.39:0/408627207' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2024-09-12T02:28:29.183 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 12 02:28:28 smithi172 ceph-mon[35609]: from='mgr.14150 172.21.15.39:0/408627207' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-12T02:28:29.184 INFO:teuthology.orchestra.run.smithi172.stderr:2024-09-12T02:28:29.181+0000 7fce99ffb640 1 -- 172.21.15.172:0/3707367595 <== mon.0 v2:172.21.15.39:3300/0 7 ==== mon_command_ack([{"prefix": "mon dump", "format": "json"}]=0 dumped monmap epoch 2 v2) ==== 95+0+1015 (secure 0 0 0) 0x7fce88018310 con 0x7fce9c198640 2024-09-12T02:28:29.184 INFO:teuthology.orchestra.run.smithi172.stdout: 2024-09-12T02:28:29.184 INFO:teuthology.orchestra.run.smithi172.stdout:{"epoch":2,"fsid":"4954ed46-70ae-11ef-bcea-c7b262605968","modified":"2024-09-12T02:28:23.741500Z","created":"2024-09-12T02:26:39.333323Z","min_mon_release":19,"min_mon_release_name":"squid","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks: ":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"],"optional":[]},"mons":[{"rank":0,"name":"a","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:3300","nonce":0},{"type":"v1","addr":"172.21.15.39:6789","nonce":0}]},"addr":"172.21.15.39:6789/0","public_addr":"172.21.15.39:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":1,"name":"c","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:3300","nonce":0},{"type":"v1","addr":"172.21.15.172:6789","nonce":0}]},"addr":"172.21.15.172:6789/0","public_addr":"172.21.15.172:6789/0","priority":0,"weight":0,"crush_location":"{}"}],"quorum":[0,1]} 2024-09-12T02:28:29.185 INFO:teuthology.orchestra.run.smithi172.stderr:dumped monmap epoch 2 2024-09-12T02:28:29.185 INFO:teuthology.orchestra.run.smithi172.stderr:2024-09-12T02:28:29.183+0000 7fcea2edb640 1 -- 172.21.15.172:0/3707367595 >> [v2:172.21.15.39:6800/1725006999,v1:172.21.15.39:6801/1725006999] conn(0x7fce80038e00 msgr2=0x7fce8003b2c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:28:29.185 INFO:teuthology.orchestra.run.smithi172.stderr:2024-09-12T02:28:29.183+0000 7fcea2edb640 1 --2- 172.21.15.172:0/3707367595 >> [v2:172.21.15.39:6800/1725006999,v1:172.21.15.39:6801/1725006999] conn(0x7fce80038e00 0x7fce8003b2c0 secure :-1 s=READY pgs=27 cs=0 l=1 rev1=1 crypto rx=0x7fce90005940 tx=0x7fce900058b0 comp rx=0 tx=0).stop 2024-09-12T02:28:29.185 INFO:teuthology.orchestra.run.smithi172.stderr:2024-09-12T02:28:29.183+0000 7fcea2edb640 1 -- 172.21.15.172:0/3707367595 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fce9c198640 msgr2=0x7fce9c198aa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:28:29.185 INFO:teuthology.orchestra.run.smithi172.stderr:2024-09-12T02:28:29.183+0000 7fcea2edb640 1 --2- 172.21.15.172:0/3707367595 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fce9c198640 0x7fce9c198aa0 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0x7fce8800b400 tx=0x7fce8800b8c0 comp rx=0 tx=0).stop 2024-09-12T02:28:29.185 INFO:teuthology.orchestra.run.smithi172.stderr:2024-09-12T02:28:29.183+0000 7fcea2edb640 1 -- 172.21.15.172:0/3707367595 shutdown_connections 2024-09-12T02:28:29.185 INFO:teuthology.orchestra.run.smithi172.stderr:2024-09-12T02:28:29.183+0000 7fcea2edb640 1 --2- 172.21.15.172:0/3707367595 >> [v2:172.21.15.39:6800/1725006999,v1:172.21.15.39:6801/1725006999] conn(0x7fce80038e00 0x7fce8003b2c0 unknown :-1 s=CLOSED pgs=27 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:28:29.185 INFO:teuthology.orchestra.run.smithi172.stderr:2024-09-12T02:28:29.183+0000 7fcea2edb640 1 --2- 172.21.15.172:0/3707367595 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fce9c198640 0x7fce9c198aa0 unknown :-1 s=CLOSED pgs=99 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:28:29.185 INFO:teuthology.orchestra.run.smithi172.stderr:2024-09-12T02:28:29.183+0000 7fcea2edb640 1 --2- 172.21.15.172:0/3707367595 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fce8c003530 0x7fce9c198100 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:28:29.185 INFO:teuthology.orchestra.run.smithi172.stderr:2024-09-12T02:28:29.183+0000 7fcea2edb640 1 -- 172.21.15.172:0/3707367595 >> 172.21.15.172:0/3707367595 conn(0x7fce9c0fc220 msgr2=0x7fce9c0fe020 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:28:29.186 INFO:teuthology.orchestra.run.smithi172.stderr:2024-09-12T02:28:29.183+0000 7fcea2edb640 1 -- 172.21.15.172:0/3707367595 shutdown_connections 2024-09-12T02:28:29.186 INFO:teuthology.orchestra.run.smithi172.stderr:2024-09-12T02:28:29.183+0000 7fcea2edb640 1 -- 172.21.15.172:0/3707367595 wait complete. 2024-09-12T02:28:30.013 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 12 02:28:29 smithi172 ceph-mon[35609]: pgmap v16: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-12T02:28:30.013 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 12 02:28:29 smithi172 ceph-mon[35609]: Deploying daemon mon.b on smithi044 2024-09-12T02:28:30.013 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 12 02:28:29 smithi172 ceph-mon[35609]: from='client.? 172.21.15.172:0/3707367595' entity='client.admin' cmd=[{"prefix": "mon dump", "format": "json"}]: dispatch 2024-09-12T02:28:30.013 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 12 02:28:29 smithi172 ceph-mon[35609]: from='mgr.14150 172.21.15.39:0/408627207' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-09-12T02:28:30.099 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 02:28:29 smithi039 ceph-mon[30515]: pgmap v16: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-12T02:28:30.100 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 02:28:29 smithi039 ceph-mon[30515]: Deploying daemon mon.b on smithi044 2024-09-12T02:28:30.100 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 02:28:29 smithi039 ceph-mon[30515]: from='client.? 172.21.15.172:0/3707367595' entity='client.admin' cmd=[{"prefix": "mon dump", "format": "json"}]: dispatch 2024-09-12T02:28:30.100 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 02:28:29 smithi039 ceph-mon[30515]: from='mgr.14150 172.21.15.39:0/408627207' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-09-12T02:28:30.769 INFO:tasks.cephadm:Waiting for 3 mons in monmap... 2024-09-12T02:28:30.770 DEBUG:teuthology.orchestra.run.smithi172:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 4954ed46-70ae-11ef-bcea-c7b262605968 -- ceph mon dump -f json 2024-09-12T02:28:31.019 INFO:teuthology.orchestra.run.smithi172.stderr:Inferring config /var/lib/ceph/4954ed46-70ae-11ef-bcea-c7b262605968/mon.c/config 2024-09-12T02:28:31.460 INFO:teuthology.orchestra.run.smithi172.stderr:2024-09-12T02:28:31.457+0000 7f6d06e57640 1 -- 172.21.15.172:0/3388963836 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f6d00107670 msgr2=0x7f6d00107a50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:28:31.460 INFO:teuthology.orchestra.run.smithi172.stderr:2024-09-12T02:28:31.457+0000 7f6d06e57640 1 --2- 172.21.15.172:0/3388963836 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f6d00107670 0x7f6d00107a50 secure :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0x7f6cf0009880 tx=0x7f6cf002a5d0 comp rx=0 tx=0).stop 2024-09-12T02:28:31.460 INFO:teuthology.orchestra.run.smithi172.stderr:2024-09-12T02:28:31.457+0000 7f6d06e57640 1 -- 172.21.15.172:0/3388963836 shutdown_connections 2024-09-12T02:28:31.460 INFO:teuthology.orchestra.run.smithi172.stderr:2024-09-12T02:28:31.457+0000 7f6d06e57640 1 --2- 172.21.15.172:0/3388963836 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f6d00107670 0x7f6d00107a50 unknown :-1 s=CLOSED pgs=100 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:28:31.460 INFO:teuthology.orchestra.run.smithi172.stderr:2024-09-12T02:28:31.457+0000 7f6d06e57640 1 -- 172.21.15.172:0/3388963836 >> 172.21.15.172:0/3388963836 conn(0x7f6d000fd350 msgr2=0x7f6d000ff770 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:28:31.460 INFO:teuthology.orchestra.run.smithi172.stderr:2024-09-12T02:28:31.457+0000 7f6d06e57640 1 -- 172.21.15.172:0/3388963836 shutdown_connections 2024-09-12T02:28:31.460 INFO:teuthology.orchestra.run.smithi172.stderr:2024-09-12T02:28:31.457+0000 7f6d06e57640 1 -- 172.21.15.172:0/3388963836 wait complete. 2024-09-12T02:28:31.460 INFO:teuthology.orchestra.run.smithi172.stderr:2024-09-12T02:28:31.457+0000 7f6d06e57640 1 Processor -- start 2024-09-12T02:28:31.461 INFO:teuthology.orchestra.run.smithi172.stderr:2024-09-12T02:28:31.457+0000 7f6d06e57640 1 -- start start 2024-09-12T02:28:31.461 INFO:teuthology.orchestra.run.smithi172.stderr:2024-09-12T02:28:31.457+0000 7f6d06e57640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f6d00107670 0x7f6d00197420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:28:31.461 INFO:teuthology.orchestra.run.smithi172.stderr:2024-09-12T02:28:31.457+0000 7f6d06e57640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f6d00197960 0x7f6d0019bca0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:28:31.461 INFO:teuthology.orchestra.run.smithi172.stderr:2024-09-12T02:28:31.457+0000 7f6d06e57640 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 -- 0x7f6d0010bd30 con 0x7f6d00107670 2024-09-12T02:28:31.461 INFO:teuthology.orchestra.run.smithi172.stderr:2024-09-12T02:28:31.457+0000 7f6d06e57640 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7f6d0010bbb0 con 0x7f6d00197960 2024-09-12T02:28:31.461 INFO:teuthology.orchestra.run.smithi172.stderr:2024-09-12T02:28:31.458+0000 7f6cfffff640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f6d00197960 0x7f6d0019bca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:28:31.461 INFO:teuthology.orchestra.run.smithi172.stderr:2024-09-12T02:28:31.458+0000 7f6cfffff640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f6d00197960 0x7f6d0019bca0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.172:3300/0 says I am v2:172.21.15.172:60736/0 (socket says 172.21.15.172:60736) 2024-09-12T02:28:31.461 INFO:teuthology.orchestra.run.smithi172.stderr:2024-09-12T02:28:31.458+0000 7f6cfffff640 1 -- 172.21.15.172:0/4120717245 learned_addr learned my addr 172.21.15.172:0/4120717245 (peer_addr_for_me v2:172.21.15.172:0/0) 2024-09-12T02:28:31.461 INFO:teuthology.orchestra.run.smithi172.stderr:2024-09-12T02:28:31.458+0000 7f6cfffff640 1 -- 172.21.15.172:0/4120717245 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f6d00197960 msgr2=0x7f6d0019bca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_bulk peer close file descriptor 13 2024-09-12T02:28:31.461 INFO:teuthology.orchestra.run.smithi172.stderr:2024-09-12T02:28:31.458+0000 7f6cfffff640 1 -- 172.21.15.172:0/4120717245 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f6d00197960 msgr2=0x7f6d0019bca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until read failed 2024-09-12T02:28:31.461 INFO:teuthology.orchestra.run.smithi172.stderr:2024-09-12T02:28:31.458+0000 7f6cfffff640 1 --2- 172.21.15.172:0/4120717245 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f6d00197960 0x7f6d0019bca0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-09-12T02:28:31.461 INFO:teuthology.orchestra.run.smithi172.stderr:2024-09-12T02:28:31.458+0000 7f6cfffff640 1 --2- 172.21.15.172:0/4120717245 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f6d00197960 0x7f6d0019bca0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-09-12T02:28:31.461 INFO:teuthology.orchestra.run.smithi172.stderr:2024-09-12T02:28:31.458+0000 7f6d04bf3640 1 --2- 172.21.15.172:0/4120717245 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f6d00107670 0x7f6d00197420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:28:31.462 INFO:teuthology.orchestra.run.smithi172.stderr:2024-09-12T02:28:31.458+0000 7f6d04bf3640 1 -- 172.21.15.172:0/4120717245 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f6d00197960 msgr2=0x7f6d0019bca0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-09-12T02:28:31.462 INFO:teuthology.orchestra.run.smithi172.stderr:2024-09-12T02:28:31.458+0000 7f6d04bf3640 1 --2- 172.21.15.172:0/4120717245 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f6d00197960 0x7f6d0019bca0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:28:31.462 INFO:teuthology.orchestra.run.smithi172.stderr:2024-09-12T02:28:31.458+0000 7f6d04bf3640 1 -- 172.21.15.172:0/4120717245 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6d00197f80 con 0x7f6d00107670 2024-09-12T02:28:31.462 INFO:teuthology.orchestra.run.smithi172.stderr:2024-09-12T02:28:31.459+0000 7f6d04bf3640 1 --2- 172.21.15.172:0/4120717245 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f6d00107670 0x7f6d00197420 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0x7f6cf0005ab0 tx=0x7f6cf0032c50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:28:31.462 INFO:teuthology.orchestra.run.smithi172.stderr:2024-09-12T02:28:31.459+0000 7f6cfdffb640 1 -- 172.21.15.172:0/4120717245 <== mon.0 v2:172.21.15.39:3300/0 1 ==== mon_map magic: 0 ==== 309+0+0 (secure 0 0 0) 0x7f6cf0035070 con 0x7f6d00107670 2024-09-12T02:28:31.462 INFO:teuthology.orchestra.run.smithi172.stderr:2024-09-12T02:28:31.459+0000 7f6cfdffb640 1 -- 172.21.15.172:0/4120717245 <== mon.0 v2:172.21.15.39:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f6cf0032e40 con 0x7f6d00107670 2024-09-12T02:28:31.462 INFO:teuthology.orchestra.run.smithi172.stderr:2024-09-12T02:28:31.459+0000 7f6cfdffb640 1 -- 172.21.15.172:0/4120717245 <== mon.0 v2:172.21.15.39:3300/0 3 ==== mon_map magic: 0 ==== 309+0+0 (secure 0 0 0) 0x7f6cf003bc10 con 0x7f6d00107670 2024-09-12T02:28:31.462 INFO:teuthology.orchestra.run.smithi172.stderr:2024-09-12T02:28:31.459+0000 7f6d06e57640 1 -- 172.21.15.172:0/4120717245 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f6d0019c1e0 con 0x7f6d00107670 2024-09-12T02:28:31.462 INFO:teuthology.orchestra.run.smithi172.stderr:2024-09-12T02:28:31.459+0000 7f6d06e57640 1 -- 172.21.15.172:0/4120717245 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f6d0019c720 con 0x7f6d00107670 2024-09-12T02:28:31.463 INFO:teuthology.orchestra.run.smithi172.stderr:2024-09-12T02:28:31.460+0000 7f6d06e57640 1 -- 172.21.15.172:0/4120717245 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f6d00102db0 con 0x7f6d00107670 2024-09-12T02:28:31.463 INFO:teuthology.orchestra.run.smithi172.stderr:2024-09-12T02:28:31.460+0000 7f6cfdffb640 1 -- 172.21.15.172:0/4120717245 <== mon.0 v2:172.21.15.39:3300/0 4 ==== mgrmap(e 13) ==== 46343+0+0 (secure 0 0 0) 0x7f6cf0042030 con 0x7f6d00107670 2024-09-12T02:28:31.463 INFO:teuthology.orchestra.run.smithi172.stderr:2024-09-12T02:28:31.461+0000 7f6cfdffb640 1 --2- 172.21.15.172:0/4120717245 >> [v2:172.21.15.39:6800/1725006999,v1:172.21.15.39:6801/1725006999] conn(0x7f6ce0038e00 0x7f6ce003b2c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:28:31.463 INFO:teuthology.orchestra.run.smithi172.stderr:2024-09-12T02:28:31.461+0000 7f6cfdffb640 1 -- 172.21.15.172:0/4120717245 <== mon.0 v2:172.21.15.39:3300/0 5 ==== osd_map(4..4 src has 1..4) ==== 1155+0+0 (secure 0 0 0) 0x7f6cf0040070 con 0x7f6d00107670 2024-09-12T02:28:31.463 INFO:teuthology.orchestra.run.smithi172.stderr:2024-09-12T02:28:31.461+0000 7f6cfffff640 1 --2- 172.21.15.172:0/4120717245 >> [v2:172.21.15.39:6800/1725006999,v1:172.21.15.39:6801/1725006999] conn(0x7f6ce0038e00 0x7f6ce003b2c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:28:31.464 INFO:teuthology.orchestra.run.smithi172.stderr:2024-09-12T02:28:31.461+0000 7f6cfffff640 1 --2- 172.21.15.172:0/4120717245 >> [v2:172.21.15.39:6800/1725006999,v1:172.21.15.39:6801/1725006999] conn(0x7f6ce0038e00 0x7f6ce003b2c0 secure :-1 s=READY pgs=30 cs=0 l=1 rev1=1 crypto rx=0x7f6ce8009100 tx=0x7f6ce8008040 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:28:31.466 INFO:teuthology.orchestra.run.smithi172.stderr:2024-09-12T02:28:31.466+0000 7f6cfdffb640 1 -- 172.21.15.172:0/4120717245 <== mon.0 v2:172.21.15.39:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7f6cf0004e20 con 0x7f6d00107670 2024-09-12T02:28:31.695 INFO:teuthology.orchestra.run.smithi172.stderr:2024-09-12T02:28:31.694+0000 7f6d06e57640 1 -- 172.21.15.172:0/4120717245 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_command({"prefix": "mon dump", "format": "json"} v 0) -- 0x7f6d0019ca00 con 0x7f6d00107670 2024-09-12T02:28:31.696 INFO:teuthology.orchestra.run.smithi172.stderr:2024-09-12T02:28:31.695+0000 7f6cfdffb640 1 -- 172.21.15.172:0/4120717245 <== mon.0 v2:172.21.15.39:3300/0 7 ==== mon_command_ack([{"prefix": "mon dump", "format": "json"}]=0 dumped monmap epoch 2 v2) ==== 95+0+1015 (secure 0 0 0) 0x7f6cf00303a0 con 0x7f6d00107670 2024-09-12T02:28:31.696 INFO:teuthology.orchestra.run.smithi172.stdout: 2024-09-12T02:28:31.696 INFO:teuthology.orchestra.run.smithi172.stdout:{"epoch":2,"fsid":"4954ed46-70ae-11ef-bcea-c7b262605968","modified":"2024-09-12T02:28:23.741500Z","created":"2024-09-12T02:26:39.333323Z","min_mon_release":19,"min_mon_release_name":"squid","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks: ":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"],"optional":[]},"mons":[{"rank":0,"name":"a","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:3300","nonce":0},{"type":"v1","addr":"172.21.15.39:6789","nonce":0}]},"addr":"172.21.15.39:6789/0","public_addr":"172.21.15.39:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":1,"name":"c","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:3300","nonce":0},{"type":"v1","addr":"172.21.15.172:6789","nonce":0}]},"addr":"172.21.15.172:6789/0","public_addr":"172.21.15.172:6789/0","priority":0,"weight":0,"crush_location":"{}"}],"quorum":[0,1]} 2024-09-12T02:28:31.697 INFO:teuthology.orchestra.run.smithi172.stderr:dumped monmap epoch 2 2024-09-12T02:28:31.698 INFO:teuthology.orchestra.run.smithi172.stderr:2024-09-12T02:28:31.698+0000 7f6d06e57640 1 -- 172.21.15.172:0/4120717245 >> [v2:172.21.15.39:6800/1725006999,v1:172.21.15.39:6801/1725006999] conn(0x7f6ce0038e00 msgr2=0x7f6ce003b2c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:28:31.698 INFO:teuthology.orchestra.run.smithi172.stderr:2024-09-12T02:28:31.698+0000 7f6d06e57640 1 --2- 172.21.15.172:0/4120717245 >> [v2:172.21.15.39:6800/1725006999,v1:172.21.15.39:6801/1725006999] conn(0x7f6ce0038e00 0x7f6ce003b2c0 secure :-1 s=READY pgs=30 cs=0 l=1 rev1=1 crypto rx=0x7f6ce8009100 tx=0x7f6ce8008040 comp rx=0 tx=0).stop 2024-09-12T02:28:31.698 INFO:teuthology.orchestra.run.smithi172.stderr:2024-09-12T02:28:31.698+0000 7f6d06e57640 1 -- 172.21.15.172:0/4120717245 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f6d00107670 msgr2=0x7f6d00197420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:28:31.698 INFO:teuthology.orchestra.run.smithi172.stderr:2024-09-12T02:28:31.698+0000 7f6d06e57640 1 --2- 172.21.15.172:0/4120717245 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f6d00107670 0x7f6d00197420 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0x7f6cf0005ab0 tx=0x7f6cf0032c50 comp rx=0 tx=0).stop 2024-09-12T02:28:31.699 INFO:teuthology.orchestra.run.smithi172.stderr:2024-09-12T02:28:31.698+0000 7f6d06e57640 1 -- 172.21.15.172:0/4120717245 shutdown_connections 2024-09-12T02:28:31.699 INFO:teuthology.orchestra.run.smithi172.stderr:2024-09-12T02:28:31.698+0000 7f6d06e57640 1 --2- 172.21.15.172:0/4120717245 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f6d00197960 0x7f6d0019bca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:28:31.699 INFO:teuthology.orchestra.run.smithi172.stderr:2024-09-12T02:28:31.698+0000 7f6d06e57640 1 --2- 172.21.15.172:0/4120717245 >> [v2:172.21.15.39:6800/1725006999,v1:172.21.15.39:6801/1725006999] conn(0x7f6ce0038e00 0x7f6ce003b2c0 unknown :-1 s=CLOSED pgs=30 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:28:31.699 INFO:teuthology.orchestra.run.smithi172.stderr:2024-09-12T02:28:31.698+0000 7f6d06e57640 1 --2- 172.21.15.172:0/4120717245 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f6d00107670 0x7f6d00197420 unknown :-1 s=CLOSED pgs=101 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:28:31.699 INFO:teuthology.orchestra.run.smithi172.stderr:2024-09-12T02:28:31.698+0000 7f6d06e57640 1 -- 172.21.15.172:0/4120717245 >> 172.21.15.172:0/4120717245 conn(0x7f6d000fd350 msgr2=0x7f6d000fd730 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:28:31.699 INFO:teuthology.orchestra.run.smithi172.stderr:2024-09-12T02:28:31.698+0000 7f6d06e57640 1 -- 172.21.15.172:0/4120717245 shutdown_connections 2024-09-12T02:28:31.699 INFO:teuthology.orchestra.run.smithi172.stderr:2024-09-12T02:28:31.698+0000 7f6d06e57640 1 -- 172.21.15.172:0/4120717245 wait complete. 2024-09-12T02:28:32.013 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 12 02:28:31 smithi172 ceph-mon[35609]: pgmap v17: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-12T02:28:32.013 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 12 02:28:31 smithi172 ceph-mon[35609]: from='client.? 172.21.15.172:0/4120717245' entity='client.admin' cmd=[{"prefix": "mon dump", "format": "json"}]: dispatch 2024-09-12T02:28:32.099 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 02:28:31 smithi039 ceph-mon[30515]: pgmap v17: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-12T02:28:32.100 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 02:28:31 smithi039 ceph-mon[30515]: from='client.? 172.21.15.172:0/4120717245' entity='client.admin' cmd=[{"prefix": "mon dump", "format": "json"}]: dispatch 2024-09-12T02:28:32.449 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 12 02:28:32 smithi044 podman[35392]: 2024-09-12 02:28:32.294701173 +0000 UTC m=+0.016088832 image pull 54467abc55f864c4f73dfaf9c6ac3bb3e87b773123d5badaf790bee57321d594 quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:3be30d720e37ec4df7f667e60f22b4d221c4ce7b408e68b90f9ac10220535e66 2024-09-12T02:28:32.949 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 12 02:28:32 smithi044 podman[35392]: 2024-09-12 02:28:32.612992049 +0000 UTC m=+0.334379707 container init 41838f02b634abb688a9fb1f3a8a15bb75d3f2d8da7c345ab802229c9adb2389 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:3be30d720e37ec4df7f667e60f22b4d221c4ce7b408e68b90f9ac10220535e66, name=ceph-4954ed46-70ae-11ef-bcea-c7b262605968-mon-b, org.label-schema.license=GPLv2, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.schema-version=1.0, org.label-schema.vendor=CentOS, CEPH_POINT_RELEASE=, ceph=True, GIT_BRANCH=HEAD, org.label-schema.name=CentOS Stream 9 Base Image, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.build-date=20240731, maintainer=Guillaume Abrioux , RELEASE=squid-b53b6d3, io.buildah.version=1.37.2, GIT_CLEAN=True) 2024-09-12T02:28:32.949 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 12 02:28:32 smithi044 podman[35392]: 2024-09-12 02:28:32.616098122 +0000 UTC m=+0.337492189 container start 41838f02b634abb688a9fb1f3a8a15bb75d3f2d8da7c345ab802229c9adb2389 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:3be30d720e37ec4df7f667e60f22b4d221c4ce7b408e68b90f9ac10220535e66, name=ceph-4954ed46-70ae-11ef-bcea-c7b262605968-mon-b, io.buildah.version=1.37.2, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, GIT_CLEAN=True, ceph=True, maintainer=Guillaume Abrioux , CEPH_POINT_RELEASE=, org.label-schema.vendor=CentOS, GIT_BRANCH=HEAD, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.schema-version=1.0, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.license=GPLv2, org.label-schema.build-date=20240731, RELEASE=squid-b53b6d3) 2024-09-12T02:28:32.949 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 12 02:28:32 smithi044 ceph-mon[35411]: set uid:gid to 167:167 (ceph:ceph) 2024-09-12T02:28:32.949 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 12 02:28:32 smithi044 ceph-mon[35411]: ceph version 19.1.1-298-gb53b6d3e (b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc) squid (stable), process ceph-mon, pid 2 2024-09-12T02:28:32.949 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 12 02:28:32 smithi044 ceph-mon[35411]: pidfile_write: ignore empty --pid-file 2024-09-12T02:28:32.949 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 12 02:28:32 smithi044 ceph-mon[35411]: load: jerasure load: lrc 2024-09-12T02:28:32.949 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 12 02:28:32 smithi044 ceph-mon[35411]: rocksdb: RocksDB version: 7.9.2 2024-09-12T02:28:32.950 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 12 02:28:32 smithi044 ceph-mon[35411]: rocksdb: Git sha 0 2024-09-12T02:28:32.950 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 12 02:28:32 smithi044 ceph-mon[35411]: rocksdb: Compile date 2024-09-09 16:23:28 2024-09-12T02:28:32.950 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 12 02:28:32 smithi044 ceph-mon[35411]: rocksdb: DB SUMMARY 2024-09-12T02:28:32.950 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 12 02:28:32 smithi044 ceph-mon[35411]: rocksdb: DB Session ID: 2W04NM0YORI8W0V2DIXE 2024-09-12T02:28:32.950 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 12 02:28:32 smithi044 ceph-mon[35411]: rocksdb: CURRENT file: CURRENT 2024-09-12T02:28:32.950 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 12 02:28:32 smithi044 ceph-mon[35411]: rocksdb: IDENTITY file: IDENTITY 2024-09-12T02:28:32.950 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 12 02:28:32 smithi044 ceph-mon[35411]: rocksdb: MANIFEST file: MANIFEST-000005 size: 59 Bytes 2024-09-12T02:28:32.950 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 12 02:28:32 smithi044 ceph-mon[35411]: rocksdb: SST files in /var/lib/ceph/mon/ceph-b/store.db dir, Total Num: 0, files: 2024-09-12T02:28:32.950 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 12 02:28:32 smithi044 ceph-mon[35411]: rocksdb: Write Ahead Log file in /var/lib/ceph/mon/ceph-b/store.db: 000004.log size: 636 ; 2024-09-12T02:28:32.950 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 12 02:28:32 smithi044 ceph-mon[35411]: rocksdb: Options.error_if_exists: 0 2024-09-12T02:28:32.950 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 12 02:28:32 smithi044 ceph-mon[35411]: rocksdb: Options.create_if_missing: 0 2024-09-12T02:28:32.951 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 12 02:28:32 smithi044 ceph-mon[35411]: rocksdb: Options.paranoid_checks: 1 2024-09-12T02:28:32.951 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 12 02:28:32 smithi044 ceph-mon[35411]: rocksdb: Options.flush_verify_memtable_count: 1 2024-09-12T02:28:32.951 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 12 02:28:32 smithi044 ceph-mon[35411]: rocksdb: Options.track_and_verify_wals_in_manifest: 0 2024-09-12T02:28:32.951 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 12 02:28:32 smithi044 ceph-mon[35411]: rocksdb: Options.verify_sst_unique_id_in_manifest: 1 2024-09-12T02:28:32.951 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 12 02:28:32 smithi044 ceph-mon[35411]: rocksdb: Options.env: 0x55e0aa860940 2024-09-12T02:28:32.951 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 12 02:28:32 smithi044 ceph-mon[35411]: rocksdb: Options.fs: PosixFileSystem 2024-09-12T02:28:32.951 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 12 02:28:32 smithi044 ceph-mon[35411]: rocksdb: Options.info_log: 0x55e0acd136e0 2024-09-12T02:28:32.951 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 12 02:28:32 smithi044 ceph-mon[35411]: rocksdb: Options.max_file_opening_threads: 16 2024-09-12T02:28:32.951 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 12 02:28:32 smithi044 ceph-mon[35411]: rocksdb: Options.statistics: (nil) 2024-09-12T02:28:32.951 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 12 02:28:32 smithi044 ceph-mon[35411]: rocksdb: Options.use_fsync: 0 2024-09-12T02:28:32.951 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 12 02:28:32 smithi044 ceph-mon[35411]: rocksdb: Options.max_log_file_size: 0 2024-09-12T02:28:32.951 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 12 02:28:32 smithi044 ceph-mon[35411]: rocksdb: Options.max_manifest_file_size: 1073741824 2024-09-12T02:28:32.951 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 12 02:28:32 smithi044 ceph-mon[35411]: rocksdb: Options.log_file_time_to_roll: 0 2024-09-12T02:28:32.952 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 12 02:28:32 smithi044 ceph-mon[35411]: rocksdb: Options.keep_log_file_num: 1000 2024-09-12T02:28:32.952 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 12 02:28:32 smithi044 ceph-mon[35411]: rocksdb: Options.recycle_log_file_num: 0 2024-09-12T02:28:32.952 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 12 02:28:32 smithi044 ceph-mon[35411]: rocksdb: Options.allow_fallocate: 1 2024-09-12T02:28:32.952 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 12 02:28:32 smithi044 ceph-mon[35411]: rocksdb: Options.allow_mmap_reads: 0 2024-09-12T02:28:32.952 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 12 02:28:32 smithi044 ceph-mon[35411]: rocksdb: Options.allow_mmap_writes: 0 2024-09-12T02:28:32.952 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 12 02:28:32 smithi044 ceph-mon[35411]: rocksdb: Options.use_direct_reads: 0 2024-09-12T02:28:32.952 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 12 02:28:32 smithi044 ceph-mon[35411]: rocksdb: Options.use_direct_io_for_flush_and_compaction: 0 2024-09-12T02:28:32.952 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 12 02:28:32 smithi044 ceph-mon[35411]: rocksdb: Options.create_missing_column_families: 0 2024-09-12T02:28:32.952 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 12 02:28:32 smithi044 ceph-mon[35411]: rocksdb: Options.db_log_dir: 2024-09-12T02:28:32.952 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 12 02:28:32 smithi044 ceph-mon[35411]: rocksdb: Options.wal_dir: 2024-09-12T02:28:32.952 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 12 02:28:32 smithi044 ceph-mon[35411]: rocksdb: Options.table_cache_numshardbits: 6 2024-09-12T02:28:32.952 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 12 02:28:32 smithi044 ceph-mon[35411]: rocksdb: Options.WAL_ttl_seconds: 0 2024-09-12T02:28:32.952 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 12 02:28:32 smithi044 ceph-mon[35411]: rocksdb: Options.WAL_size_limit_MB: 0 2024-09-12T02:28:32.953 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 12 02:28:32 smithi044 ceph-mon[35411]: rocksdb: Options.max_write_batch_group_size_bytes: 1048576 2024-09-12T02:28:32.953 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 12 02:28:32 smithi044 ceph-mon[35411]: rocksdb: Options.manifest_preallocation_size: 4194304 2024-09-12T02:28:32.953 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 12 02:28:32 smithi044 ceph-mon[35411]: rocksdb: Options.is_fd_close_on_exec: 1 2024-09-12T02:28:32.953 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 12 02:28:32 smithi044 ceph-mon[35411]: rocksdb: Options.advise_random_on_open: 1 2024-09-12T02:28:32.953 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 12 02:28:32 smithi044 ceph-mon[35411]: rocksdb: Options.db_write_buffer_size: 0 2024-09-12T02:28:32.953 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 12 02:28:32 smithi044 ceph-mon[35411]: rocksdb: Options.write_buffer_manager: 0x55e0acd22dc0 2024-09-12T02:28:32.953 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 12 02:28:32 smithi044 ceph-mon[35411]: rocksdb: Options.access_hint_on_compaction_start: 1 2024-09-12T02:28:32.953 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 12 02:28:32 smithi044 ceph-mon[35411]: rocksdb: Options.random_access_max_buffer_size: 1048576 2024-09-12T02:28:32.953 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 12 02:28:32 smithi044 ceph-mon[35411]: rocksdb: Options.use_adaptive_mutex: 0 2024-09-12T02:28:32.953 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 12 02:28:32 smithi044 ceph-mon[35411]: rocksdb: Options.rate_limiter: (nil) 2024-09-12T02:28:32.953 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 12 02:28:32 smithi044 ceph-mon[35411]: rocksdb: Options.sst_file_manager.rate_bytes_per_sec: 0 2024-09-12T02:28:32.953 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 12 02:28:32 smithi044 ceph-mon[35411]: rocksdb: Options.wal_recovery_mode: 2 2024-09-12T02:28:32.953 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 12 02:28:32 smithi044 ceph-mon[35411]: rocksdb: Options.enable_thread_tracking: 0 2024-09-12T02:28:32.954 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 12 02:28:32 smithi044 ceph-mon[35411]: rocksdb: Options.enable_pipelined_write: 0 2024-09-12T02:28:32.954 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 12 02:28:32 smithi044 ceph-mon[35411]: rocksdb: Options.unordered_write: 0 2024-09-12T02:28:32.954 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 12 02:28:32 smithi044 ceph-mon[35411]: rocksdb: Options.allow_concurrent_memtable_write: 1 2024-09-12T02:28:32.954 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 12 02:28:32 smithi044 ceph-mon[35411]: rocksdb: Options.enable_write_thread_adaptive_yield: 1 2024-09-12T02:28:32.954 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 12 02:28:32 smithi044 ceph-mon[35411]: rocksdb: Options.write_thread_max_yield_usec: 100 2024-09-12T02:28:32.954 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 12 02:28:32 smithi044 ceph-mon[35411]: rocksdb: Options.write_thread_slow_yield_usec: 3 2024-09-12T02:28:32.954 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 12 02:28:32 smithi044 ceph-mon[35411]: rocksdb: Options.row_cache: None 2024-09-12T02:28:32.954 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 12 02:28:32 smithi044 ceph-mon[35411]: rocksdb: Options.wal_filter: None 2024-09-12T02:28:32.955 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 12 02:28:32 smithi044 ceph-mon[35411]: rocksdb: Options.avoid_flush_during_recovery: 0 2024-09-12T02:28:32.955 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 12 02:28:32 smithi044 ceph-mon[35411]: rocksdb: Options.allow_ingest_behind: 0 2024-09-12T02:28:32.955 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 12 02:28:32 smithi044 ceph-mon[35411]: rocksdb: Options.two_write_queues: 0 2024-09-12T02:28:32.956 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 12 02:28:32 smithi044 ceph-mon[35411]: rocksdb: Options.manual_wal_flush: 0 2024-09-12T02:28:32.956 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 12 02:28:32 smithi044 ceph-mon[35411]: rocksdb: Options.wal_compression: 0 2024-09-12T02:28:32.956 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 12 02:28:32 smithi044 ceph-mon[35411]: rocksdb: Options.atomic_flush: 0 2024-09-12T02:28:32.956 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 12 02:28:32 smithi044 ceph-mon[35411]: rocksdb: Options.avoid_unnecessary_blocking_io: 0 2024-09-12T02:28:32.956 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 12 02:28:32 smithi044 ceph-mon[35411]: rocksdb: Options.persist_stats_to_disk: 0 2024-09-12T02:28:32.956 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 12 02:28:32 smithi044 ceph-mon[35411]: rocksdb: Options.write_dbid_to_manifest: 0 2024-09-12T02:28:32.956 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 12 02:28:32 smithi044 ceph-mon[35411]: rocksdb: Options.log_readahead_size: 0 2024-09-12T02:28:32.956 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 12 02:28:32 smithi044 ceph-mon[35411]: rocksdb: Options.file_checksum_gen_factory: Unknown 2024-09-12T02:28:32.956 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 12 02:28:32 smithi044 ceph-mon[35411]: rocksdb: Options.best_efforts_recovery: 0 2024-09-12T02:28:32.956 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 12 02:28:32 smithi044 ceph-mon[35411]: rocksdb: Options.max_bgerror_resume_count: 2147483647 2024-09-12T02:28:32.956 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 12 02:28:32 smithi044 ceph-mon[35411]: rocksdb: Options.bgerror_resume_retry_interval: 1000000 2024-09-12T02:28:32.956 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 12 02:28:32 smithi044 ceph-mon[35411]: rocksdb: Options.allow_data_in_errors: 0 2024-09-12T02:28:32.956 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 12 02:28:32 smithi044 ceph-mon[35411]: rocksdb: Options.db_host_id: __hostname__ 2024-09-12T02:28:32.956 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 12 02:28:32 smithi044 ceph-mon[35411]: rocksdb: Options.enforce_single_del_contracts: true 2024-09-12T02:28:32.957 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 12 02:28:32 smithi044 ceph-mon[35411]: rocksdb: Options.max_background_jobs: 2 2024-09-12T02:28:32.957 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 12 02:28:32 smithi044 ceph-mon[35411]: rocksdb: Options.max_background_compactions: -1 2024-09-12T02:28:32.957 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 12 02:28:32 smithi044 ceph-mon[35411]: rocksdb: Options.max_subcompactions: 1 2024-09-12T02:28:32.957 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 12 02:28:32 smithi044 ceph-mon[35411]: rocksdb: Options.avoid_flush_during_shutdown: 0 2024-09-12T02:28:32.957 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 12 02:28:32 smithi044 ceph-mon[35411]: rocksdb: Options.writable_file_max_buffer_size: 1048576 2024-09-12T02:28:32.957 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 12 02:28:32 smithi044 ceph-mon[35411]: rocksdb: Options.delayed_write_rate : 16777216 2024-09-12T02:28:32.957 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 12 02:28:32 smithi044 ceph-mon[35411]: rocksdb: Options.max_total_wal_size: 0 2024-09-12T02:28:32.957 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 12 02:28:32 smithi044 ceph-mon[35411]: rocksdb: Options.delete_obsolete_files_period_micros: 21600000000 2024-09-12T02:28:32.957 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 12 02:28:32 smithi044 ceph-mon[35411]: rocksdb: Options.stats_dump_period_sec: 600 2024-09-12T02:28:32.957 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 12 02:28:32 smithi044 ceph-mon[35411]: rocksdb: Options.stats_persist_period_sec: 600 2024-09-12T02:28:32.957 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 12 02:28:32 smithi044 ceph-mon[35411]: rocksdb: Options.stats_history_buffer_size: 1048576 2024-09-12T02:28:32.957 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 12 02:28:32 smithi044 ceph-mon[35411]: rocksdb: Options.max_open_files: -1 2024-09-12T02:28:32.957 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 12 02:28:32 smithi044 ceph-mon[35411]: rocksdb: Options.bytes_per_sync: 0 2024-09-12T02:28:32.957 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 12 02:28:32 smithi044 ceph-mon[35411]: rocksdb: Options.wal_bytes_per_sync: 0 2024-09-12T02:28:32.958 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 12 02:28:32 smithi044 ceph-mon[35411]: rocksdb: Options.strict_bytes_per_sync: 0 2024-09-12T02:28:32.958 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 12 02:28:32 smithi044 ceph-mon[35411]: rocksdb: Options.compaction_readahead_size: 0 2024-09-12T02:28:32.958 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 12 02:28:32 smithi044 ceph-mon[35411]: rocksdb: Options.max_background_flushes: -1 2024-09-12T02:28:32.958 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 12 02:28:32 smithi044 ceph-mon[35411]: rocksdb: Compression algorithms supported: 2024-09-12T02:28:32.958 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 12 02:28:32 smithi044 ceph-mon[35411]: rocksdb: kZSTD supported: 0 2024-09-12T02:28:32.958 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 12 02:28:32 smithi044 ceph-mon[35411]: rocksdb: kXpressCompression supported: 0 2024-09-12T02:28:32.958 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 12 02:28:32 smithi044 ceph-mon[35411]: rocksdb: kBZip2Compression supported: 0 2024-09-12T02:28:32.958 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 12 02:28:32 smithi044 ceph-mon[35411]: rocksdb: kZSTDNotFinalCompression supported: 0 2024-09-12T02:28:32.958 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 12 02:28:32 smithi044 ceph-mon[35411]: rocksdb: kLZ4Compression supported: 1 2024-09-12T02:28:32.958 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 12 02:28:32 smithi044 ceph-mon[35411]: rocksdb: kZlibCompression supported: 1 2024-09-12T02:28:32.958 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 12 02:28:32 smithi044 ceph-mon[35411]: rocksdb: kLZ4HCCompression supported: 1 2024-09-12T02:28:32.958 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 12 02:28:32 smithi044 ceph-mon[35411]: rocksdb: kSnappyCompression supported: 1 2024-09-12T02:28:32.958 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 12 02:28:32 smithi044 ceph-mon[35411]: rocksdb: Fast CRC32 supported: Supported on x86 2024-09-12T02:28:32.958 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 12 02:28:32 smithi044 ceph-mon[35411]: rocksdb: DMutex implementation: pthread_mutex_t 2024-09-12T02:28:32.958 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 12 02:28:32 smithi044 ceph-mon[35411]: rocksdb: [db/version_set.cc:5527] Recovering from manifest file: /var/lib/ceph/mon/ceph-b/store.db/MANIFEST-000005 2024-09-12T02:28:32.959 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 12 02:28:32 smithi044 ceph-mon[35411]: rocksdb: [db/column_family.cc:630] --------------- Options for column family [default]: 2024-09-12T02:28:32.959 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 12 02:28:32 smithi044 ceph-mon[35411]: rocksdb: Options.comparator: leveldb.BytewiseComparator 2024-09-12T02:28:32.959 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 12 02:28:32 smithi044 ceph-mon[35411]: rocksdb: Options.merge_operator: 2024-09-12T02:28:32.959 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 12 02:28:32 smithi044 ceph-mon[35411]: rocksdb: Options.compaction_filter: None 2024-09-12T02:28:32.959 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 12 02:28:32 smithi044 ceph-mon[35411]: rocksdb: Options.compaction_filter_factory: None 2024-09-12T02:28:32.959 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 12 02:28:32 smithi044 ceph-mon[35411]: rocksdb: Options.sst_partitioner_factory: None 2024-09-12T02:28:32.959 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 12 02:28:32 smithi044 ceph-mon[35411]: rocksdb: Options.memtable_factory: SkipListFactory 2024-09-12T02:28:32.959 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 12 02:28:32 smithi044 ceph-mon[35411]: rocksdb: Options.table_factory: BlockBasedTable 2024-09-12T02:28:32.959 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 12 02:28:32 smithi044 ceph-mon[35411]: rocksdb: table_factory options: flush_block_policy_factory: FlushBlockBySizePolicyFactory (0x55e0acd13320) 2024-09-12T02:28:32.959 INFO:journalctl@ceph.mon.b.smithi044.stdout: cache_index_and_filter_blocks: 1 2024-09-12T02:28:32.959 INFO:journalctl@ceph.mon.b.smithi044.stdout: cache_index_and_filter_blocks_with_high_priority: 0 2024-09-12T02:28:32.959 INFO:journalctl@ceph.mon.b.smithi044.stdout: pin_l0_filter_and_index_blocks_in_cache: 0 2024-09-12T02:28:32.959 INFO:journalctl@ceph.mon.b.smithi044.stdout: pin_top_level_index_and_filter: 1 2024-09-12T02:28:32.960 INFO:journalctl@ceph.mon.b.smithi044.stdout: index_type: 0 2024-09-12T02:28:32.960 INFO:journalctl@ceph.mon.b.smithi044.stdout: data_block_index_type: 0 2024-09-12T02:28:32.960 INFO:journalctl@ceph.mon.b.smithi044.stdout: index_shortening: 1 2024-09-12T02:28:32.960 INFO:journalctl@ceph.mon.b.smithi044.stdout: data_block_hash_table_util_ratio: 0.750000 2024-09-12T02:28:32.960 INFO:journalctl@ceph.mon.b.smithi044.stdout: checksum: 4 2024-09-12T02:28:32.960 INFO:journalctl@ceph.mon.b.smithi044.stdout: no_block_cache: 0 2024-09-12T02:28:32.960 INFO:journalctl@ceph.mon.b.smithi044.stdout: block_cache: 0x55e0acd071f0 2024-09-12T02:28:32.960 INFO:journalctl@ceph.mon.b.smithi044.stdout: block_cache_name: BinnedLRUCache 2024-09-12T02:28:32.960 INFO:journalctl@ceph.mon.b.smithi044.stdout: block_cache_options: 2024-09-12T02:28:32.960 INFO:journalctl@ceph.mon.b.smithi044.stdout: capacity : 536870912 2024-09-12T02:28:32.960 INFO:journalctl@ceph.mon.b.smithi044.stdout: num_shard_bits : 4 2024-09-12T02:28:32.960 INFO:journalctl@ceph.mon.b.smithi044.stdout: strict_capacity_limit : 0 2024-09-12T02:28:32.960 INFO:journalctl@ceph.mon.b.smithi044.stdout: high_pri_pool_ratio: 0.000 2024-09-12T02:28:32.960 INFO:journalctl@ceph.mon.b.smithi044.stdout: block_cache_compressed: (nil) 2024-09-12T02:28:32.961 INFO:journalctl@ceph.mon.b.smithi044.stdout: persistent_cache: (nil) 2024-09-12T02:28:32.961 INFO:journalctl@ceph.mon.b.smithi044.stdout: block_size: 4096 2024-09-12T02:28:32.961 INFO:journalctl@ceph.mon.b.smithi044.stdout: block_size_deviation: 10 2024-09-12T02:28:32.961 INFO:journalctl@ceph.mon.b.smithi044.stdout: block_restart_interval: 16 2024-09-12T02:28:32.961 INFO:journalctl@ceph.mon.b.smithi044.stdout: index_block_restart_interval: 1 2024-09-12T02:28:32.961 INFO:journalctl@ceph.mon.b.smithi044.stdout: metadata_block_size: 4096 2024-09-12T02:28:32.961 INFO:journalctl@ceph.mon.b.smithi044.stdout: partition_filters: 0 2024-09-12T02:28:32.961 INFO:journalctl@ceph.mon.b.smithi044.stdout: use_delta_encoding: 1 2024-09-12T02:28:32.961 INFO:journalctl@ceph.mon.b.smithi044.stdout: filter_policy: bloomfilter 2024-09-12T02:28:32.961 INFO:journalctl@ceph.mon.b.smithi044.stdout: whole_key_filtering: 1 2024-09-12T02:28:32.961 INFO:journalctl@ceph.mon.b.smithi044.stdout: verify_compression: 0 2024-09-12T02:28:32.961 INFO:journalctl@ceph.mon.b.smithi044.stdout: read_amp_bytes_per_bit: 0 2024-09-12T02:28:32.961 INFO:journalctl@ceph.mon.b.smithi044.stdout: format_version: 5 2024-09-12T02:28:32.961 INFO:journalctl@ceph.mon.b.smithi044.stdout: enable_index_compression: 1 2024-09-12T02:28:32.962 INFO:journalctl@ceph.mon.b.smithi044.stdout: block_align: 0 2024-09-12T02:28:32.962 INFO:journalctl@ceph.mon.b.smithi044.stdout: max_auto_readahead_size: 262144 2024-09-12T02:28:32.962 INFO:journalctl@ceph.mon.b.smithi044.stdout: prepopulate_block_cache: 0 2024-09-12T02:28:32.962 INFO:journalctl@ceph.mon.b.smithi044.stdout: initial_auto_readahead_size: 8192 2024-09-12T02:28:32.962 INFO:journalctl@ceph.mon.b.smithi044.stdout: num_file_reads_for_auto_readahead: 2 2024-09-12T02:28:32.962 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 12 02:28:32 smithi044 ceph-mon[35411]: rocksdb: Options.write_buffer_size: 33554432 2024-09-12T02:28:32.962 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 12 02:28:32 smithi044 ceph-mon[35411]: rocksdb: Options.max_write_buffer_number: 2 2024-09-12T02:28:32.962 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 12 02:28:32 smithi044 ceph-mon[35411]: rocksdb: Options.compression: NoCompression 2024-09-12T02:28:32.962 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 12 02:28:32 smithi044 ceph-mon[35411]: rocksdb: Options.bottommost_compression: Disabled 2024-09-12T02:28:32.962 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 12 02:28:32 smithi044 ceph-mon[35411]: rocksdb: Options.prefix_extractor: nullptr 2024-09-12T02:28:32.962 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 12 02:28:32 smithi044 ceph-mon[35411]: rocksdb: Options.memtable_insert_with_hint_prefix_extractor: nullptr 2024-09-12T02:28:32.962 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 12 02:28:32 smithi044 ceph-mon[35411]: rocksdb: Options.num_levels: 7 2024-09-12T02:28:32.962 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 12 02:28:32 smithi044 ceph-mon[35411]: rocksdb: Options.min_write_buffer_number_to_merge: 1 2024-09-12T02:28:32.962 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 12 02:28:32 smithi044 ceph-mon[35411]: rocksdb: Options.max_write_buffer_number_to_maintain: 0 2024-09-12T02:28:32.962 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 12 02:28:32 smithi044 ceph-mon[35411]: rocksdb: Options.max_write_buffer_size_to_maintain: 0 2024-09-12T02:28:32.963 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 12 02:28:32 smithi044 ceph-mon[35411]: rocksdb: Options.bottommost_compression_opts.window_bits: -14 2024-09-12T02:28:32.963 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 12 02:28:32 smithi044 ceph-mon[35411]: rocksdb: Options.bottommost_compression_opts.level: 32767 2024-09-12T02:28:32.963 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 12 02:28:32 smithi044 ceph-mon[35411]: rocksdb: Options.bottommost_compression_opts.strategy: 0 2024-09-12T02:28:32.963 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 12 02:28:32 smithi044 ceph-mon[35411]: rocksdb: Options.bottommost_compression_opts.max_dict_bytes: 0 2024-09-12T02:28:32.963 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 12 02:28:32 smithi044 ceph-mon[35411]: rocksdb: Options.bottommost_compression_opts.zstd_max_train_bytes: 0 2024-09-12T02:28:32.963 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 12 02:28:32 smithi044 ceph-mon[35411]: rocksdb: Options.bottommost_compression_opts.parallel_threads: 1 2024-09-12T02:28:32.963 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 12 02:28:32 smithi044 ceph-mon[35411]: rocksdb: Options.bottommost_compression_opts.enabled: false 2024-09-12T02:28:32.963 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 12 02:28:32 smithi044 ceph-mon[35411]: rocksdb: Options.bottommost_compression_opts.max_dict_buffer_bytes: 0 2024-09-12T02:28:32.963 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 12 02:28:32 smithi044 ceph-mon[35411]: rocksdb: Options.bottommost_compression_opts.use_zstd_dict_trainer: true 2024-09-12T02:28:32.963 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 12 02:28:32 smithi044 ceph-mon[35411]: rocksdb: Options.compression_opts.window_bits: -14 2024-09-12T02:28:32.963 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 12 02:28:32 smithi044 ceph-mon[35411]: rocksdb: Options.compression_opts.level: 32767 2024-09-12T02:28:32.963 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 12 02:28:32 smithi044 ceph-mon[35411]: rocksdb: Options.compression_opts.strategy: 0 2024-09-12T02:28:32.963 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 12 02:28:32 smithi044 ceph-mon[35411]: rocksdb: Options.compression_opts.max_dict_bytes: 0 2024-09-12T02:28:32.963 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 12 02:28:32 smithi044 ceph-mon[35411]: rocksdb: Options.compression_opts.zstd_max_train_bytes: 0 2024-09-12T02:28:32.963 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 12 02:28:32 smithi044 ceph-mon[35411]: rocksdb: Options.compression_opts.use_zstd_dict_trainer: true 2024-09-12T02:28:32.964 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 12 02:28:32 smithi044 ceph-mon[35411]: rocksdb: Options.compression_opts.parallel_threads: 1 2024-09-12T02:28:32.964 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 12 02:28:32 smithi044 ceph-mon[35411]: rocksdb: Options.compression_opts.enabled: false 2024-09-12T02:28:32.964 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 12 02:28:32 smithi044 ceph-mon[35411]: rocksdb: Options.compression_opts.max_dict_buffer_bytes: 0 2024-09-12T02:28:32.964 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 12 02:28:32 smithi044 ceph-mon[35411]: rocksdb: Options.level0_file_num_compaction_trigger: 4 2024-09-12T02:28:32.964 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 12 02:28:32 smithi044 ceph-mon[35411]: rocksdb: Options.level0_slowdown_writes_trigger: 20 2024-09-12T02:28:32.964 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 12 02:28:32 smithi044 ceph-mon[35411]: rocksdb: Options.level0_stop_writes_trigger: 36 2024-09-12T02:28:32.964 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 12 02:28:32 smithi044 ceph-mon[35411]: rocksdb: Options.target_file_size_base: 67108864 2024-09-12T02:28:32.964 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 12 02:28:32 smithi044 ceph-mon[35411]: rocksdb: Options.target_file_size_multiplier: 1 2024-09-12T02:28:32.964 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 12 02:28:32 smithi044 ceph-mon[35411]: rocksdb: Options.max_bytes_for_level_base: 268435456 2024-09-12T02:28:32.964 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 12 02:28:32 smithi044 ceph-mon[35411]: rocksdb: Options.level_compaction_dynamic_level_bytes: 1 2024-09-12T02:28:32.964 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 12 02:28:32 smithi044 ceph-mon[35411]: rocksdb: Options.max_bytes_for_level_multiplier: 10.000000 2024-09-12T02:28:32.964 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 12 02:28:32 smithi044 ceph-mon[35411]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[0]: 1 2024-09-12T02:28:32.964 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 12 02:28:32 smithi044 ceph-mon[35411]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[1]: 1 2024-09-12T02:28:32.964 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 12 02:28:32 smithi044 ceph-mon[35411]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[2]: 1 2024-09-12T02:28:32.964 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 12 02:28:32 smithi044 ceph-mon[35411]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[3]: 1 2024-09-12T02:28:32.964 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 12 02:28:32 smithi044 ceph-mon[35411]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[4]: 1 2024-09-12T02:28:32.965 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 12 02:28:32 smithi044 ceph-mon[35411]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[5]: 1 2024-09-12T02:28:32.965 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 12 02:28:32 smithi044 ceph-mon[35411]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[6]: 1 2024-09-12T02:28:32.965 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 12 02:28:32 smithi044 ceph-mon[35411]: rocksdb: Options.max_sequential_skip_in_iterations: 8 2024-09-12T02:28:32.965 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 12 02:28:32 smithi044 ceph-mon[35411]: rocksdb: Options.max_compaction_bytes: 1677721600 2024-09-12T02:28:32.965 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 12 02:28:32 smithi044 ceph-mon[35411]: rocksdb: Options.ignore_max_compaction_bytes_for_input: true 2024-09-12T02:28:32.965 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 12 02:28:32 smithi044 ceph-mon[35411]: rocksdb: Options.arena_block_size: 1048576 2024-09-12T02:28:32.965 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 12 02:28:32 smithi044 ceph-mon[35411]: rocksdb: Options.soft_pending_compaction_bytes_limit: 68719476736 2024-09-12T02:28:32.965 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 12 02:28:32 smithi044 ceph-mon[35411]: rocksdb: Options.hard_pending_compaction_bytes_limit: 274877906944 2024-09-12T02:28:32.965 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 12 02:28:32 smithi044 ceph-mon[35411]: rocksdb: Options.disable_auto_compactions: 0 2024-09-12T02:28:32.965 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 12 02:28:32 smithi044 ceph-mon[35411]: rocksdb: Options.compaction_style: kCompactionStyleLevel 2024-09-12T02:28:32.965 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 12 02:28:32 smithi044 ceph-mon[35411]: rocksdb: Options.compaction_pri: kMinOverlappingRatio 2024-09-12T02:28:32.965 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 12 02:28:32 smithi044 ceph-mon[35411]: rocksdb: Options.compaction_options_universal.size_ratio: 1 2024-09-12T02:28:32.965 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 12 02:28:32 smithi044 ceph-mon[35411]: rocksdb: Options.compaction_options_universal.min_merge_width: 2 2024-09-12T02:28:32.965 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 12 02:28:32 smithi044 ceph-mon[35411]: rocksdb: Options.compaction_options_universal.max_merge_width: 4294967295 2024-09-12T02:28:32.966 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 12 02:28:32 smithi044 ceph-mon[35411]: rocksdb: Options.compaction_options_universal.max_size_amplification_percent: 200 2024-09-12T02:28:32.966 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 12 02:28:32 smithi044 ceph-mon[35411]: rocksdb: Options.compaction_options_universal.compression_size_percent: -1 2024-09-12T02:28:32.966 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 12 02:28:32 smithi044 ceph-mon[35411]: rocksdb: Options.compaction_options_universal.stop_style: kCompactionStopStyleTotalSize 2024-09-12T02:28:32.966 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 12 02:28:32 smithi044 ceph-mon[35411]: rocksdb: Options.compaction_options_fifo.max_table_files_size: 1073741824 2024-09-12T02:28:32.966 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 12 02:28:32 smithi044 ceph-mon[35411]: rocksdb: Options.compaction_options_fifo.allow_compaction: 0 2024-09-12T02:28:32.966 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 12 02:28:32 smithi044 ceph-mon[35411]: rocksdb: Options.table_properties_collectors: CompactOnDeletionCollector (Sliding window size = 32768 Deletion trigger = 16384 Deletion ratio = 0); 2024-09-12T02:28:32.966 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 12 02:28:32 smithi044 ceph-mon[35411]: rocksdb: Options.inplace_update_support: 0 2024-09-12T02:28:32.966 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 12 02:28:32 smithi044 ceph-mon[35411]: rocksdb: Options.inplace_update_num_locks: 10000 2024-09-12T02:28:32.966 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 12 02:28:32 smithi044 ceph-mon[35411]: rocksdb: Options.memtable_prefix_bloom_size_ratio: 0.000000 2024-09-12T02:28:32.966 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 12 02:28:32 smithi044 ceph-mon[35411]: rocksdb: Options.memtable_whole_key_filtering: 0 2024-09-12T02:28:32.966 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 12 02:28:32 smithi044 ceph-mon[35411]: rocksdb: Options.memtable_huge_page_size: 0 2024-09-12T02:28:32.966 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 12 02:28:32 smithi044 ceph-mon[35411]: rocksdb: Options.bloom_locality: 0 2024-09-12T02:28:32.966 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 12 02:28:32 smithi044 ceph-mon[35411]: rocksdb: Options.max_successive_merges: 0 2024-09-12T02:28:32.966 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 12 02:28:32 smithi044 ceph-mon[35411]: rocksdb: Options.optimize_filters_for_hits: 0 2024-09-12T02:28:32.967 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 12 02:28:32 smithi044 ceph-mon[35411]: rocksdb: Options.paranoid_file_checks: 0 2024-09-12T02:28:32.967 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 12 02:28:32 smithi044 ceph-mon[35411]: rocksdb: Options.force_consistency_checks: 1 2024-09-12T02:28:32.967 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 12 02:28:32 smithi044 ceph-mon[35411]: rocksdb: Options.report_bg_io_stats: 0 2024-09-12T02:28:32.967 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 12 02:28:32 smithi044 ceph-mon[35411]: rocksdb: Options.ttl: 2592000 2024-09-12T02:28:32.967 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 12 02:28:32 smithi044 ceph-mon[35411]: rocksdb: Options.periodic_compaction_seconds: 0 2024-09-12T02:28:32.967 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 12 02:28:32 smithi044 ceph-mon[35411]: rocksdb: Options.preclude_last_level_data_seconds: 0 2024-09-12T02:28:32.967 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 12 02:28:32 smithi044 ceph-mon[35411]: rocksdb: Options.preserve_internal_time_seconds: 0 2024-09-12T02:28:32.967 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 12 02:28:32 smithi044 ceph-mon[35411]: rocksdb: Options.enable_blob_files: false 2024-09-12T02:28:32.967 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 12 02:28:32 smithi044 ceph-mon[35411]: rocksdb: Options.min_blob_size: 0 2024-09-12T02:28:32.967 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 12 02:28:32 smithi044 ceph-mon[35411]: rocksdb: Options.blob_file_size: 268435456 2024-09-12T02:28:32.967 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 12 02:28:32 smithi044 ceph-mon[35411]: rocksdb: Options.blob_compression_type: NoCompression 2024-09-12T02:28:32.967 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 12 02:28:32 smithi044 ceph-mon[35411]: rocksdb: Options.enable_blob_garbage_collection: false 2024-09-12T02:28:32.967 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 12 02:28:32 smithi044 ceph-mon[35411]: rocksdb: Options.blob_garbage_collection_age_cutoff: 0.250000 2024-09-12T02:28:32.967 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 12 02:28:32 smithi044 ceph-mon[35411]: rocksdb: Options.blob_garbage_collection_force_threshold: 1.000000 2024-09-12T02:28:32.968 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 12 02:28:32 smithi044 ceph-mon[35411]: rocksdb: Options.blob_compaction_readahead_size: 0 2024-09-12T02:28:32.968 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 12 02:28:32 smithi044 ceph-mon[35411]: rocksdb: Options.blob_file_starting_level: 0 2024-09-12T02:28:32.968 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 12 02:28:32 smithi044 ceph-mon[35411]: rocksdb: Options.experimental_mempurge_threshold: 0.000000 2024-09-12T02:28:32.968 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 12 02:28:32 smithi044 ceph-mon[35411]: rocksdb: [db/version_set.cc:5566] Recovered from manifest file:/var/lib/ceph/mon/ceph-b/store.db/MANIFEST-000005 succeeded,manifest_file_number is 5, next_file_number is 7, last_sequence is 0, log_number is 0,prev_log_number is 0,max_column_family is 0,min_log_number_to_keep is 0 2024-09-12T02:28:32.968 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 12 02:28:32 smithi044 ceph-mon[35411]: rocksdb: [db/version_set.cc:5581] Column family [default] (ID 0), log number is 0 2024-09-12T02:28:32.968 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 12 02:28:32 smithi044 ceph-mon[35411]: rocksdb: [db/db_impl/db_impl_open.cc:539] DB ID: db09ca3b-f3a2-48a4-9b7f-cd2dc9bf1c81 2024-09-12T02:28:32.968 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 12 02:28:32 smithi044 ceph-mon[35411]: rocksdb: EVENT_LOG_v1 {"time_micros": 1726108112642807, "job": 1, "event": "recovery_started", "wal_files": [4]} 2024-09-12T02:28:32.968 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 12 02:28:32 smithi044 ceph-mon[35411]: rocksdb: [db/db_impl/db_impl_open.cc:1043] Recovering log #4 mode 2 2024-09-12T02:28:32.968 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 12 02:28:32 smithi044 ceph-mon[35411]: rocksdb: EVENT_LOG_v1 {"time_micros": 1726108112643205, "cf_name": "default", "job": 1, "event": "table_file_creation", "file_number": 8, "file_size": 1773, "file_checksum": "", "file_checksum_func_name": "Unknown", "smallest_seqno": 1, "largest_seqno": 5, "table_properties": {"data_size": 648, "index_size": 31, "index_partitions": 0, "top_level_index_size": 0, "index_key_is_user_key": 1, "index_value_is_delta_encoded": 1, "filter_size": 69, "raw_key_size": 115, "raw_average_key_size": 23, "raw_value_size": 526, "raw_average_value_size": 105, "num_data_blocks": 1, "num_entries": 5, "num_filter_entries": 5, "num_deletions": 0, "num_merge_operands": 0, "num_range_deletions": 0, "format_version": 0, "fixed_key_len": 0, "filter_policy": "bloomfilter", "column_family_name": "default", "column_family_id": 0, "comparator": "leveldb.BytewiseComparator", "merge_operator": "", "prefix_extractor_name": "nullptr", "property_collectors": "[CompactOnDeletionCollector]", "compression": "NoCompression", "compression_options": "window_bits=-14; level=32767; strategy=0; max_dict_bytes=0; zstd_max_train_bytes=0; enabled=0; max_dict_buffer_bytes=0; use_zstd_dict_trainer=1; ", "creation_time": 1726108112, "oldest_key_time": 0, "file_creation_time": 0, "slow_compression_estimated_data_size": 0, "fast_compression_estimated_data_size": 0, "db_id": "db09ca3b-f3a2-48a4-9b7f-cd2dc9bf1c81", "db_session_id": "2W04NM0YORI8W0V2DIXE", "orig_file_number": 8, "seqno_to_time_mapping": "N/A"}} 2024-09-12T02:28:32.968 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 12 02:28:32 smithi044 ceph-mon[35411]: rocksdb: EVENT_LOG_v1 {"time_micros": 1726108112643296, "job": 1, "event": "recovery_finished"} 2024-09-12T02:28:32.968 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 12 02:28:32 smithi044 ceph-mon[35411]: rocksdb: [db/version_set.cc:5047] Creating manifest 10 2024-09-12T02:28:32.968 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 12 02:28:32 smithi044 ceph-mon[35411]: rocksdb: [file/delete_scheduler.cc:74] Deleted file /var/lib/ceph/mon/ceph-b/store.db/000004.log immediately, rate_bytes_per_sec 0, total_trash_size 0 max_trash_db_ratio 0.250000 2024-09-12T02:28:32.968 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 12 02:28:32 smithi044 ceph-mon[35411]: rocksdb: [db/db_impl/db_impl_open.cc:1987] SstFileManager instance 0x55e0acd34e00 2024-09-12T02:28:32.968 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 12 02:28:32 smithi044 ceph-mon[35411]: rocksdb: DB pointer 0x55e0ace30000 2024-09-12T02:28:32.969 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 12 02:28:32 smithi044 ceph-mon[35411]: rocksdb: [db/db_impl/db_impl.cc:1109] ------- DUMPING STATS ------- 2024-09-12T02:28:32.969 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 12 02:28:32 smithi044 ceph-mon[35411]: rocksdb: [db/db_impl/db_impl.cc:1111] 2024-09-12T02:28:32.969 INFO:journalctl@ceph.mon.b.smithi044.stdout: ** DB Stats ** 2024-09-12T02:28:32.969 INFO:journalctl@ceph.mon.b.smithi044.stdout: Uptime(secs): 0.0 total, 0.0 interval 2024-09-12T02:28:32.969 INFO:journalctl@ceph.mon.b.smithi044.stdout: Cumulative writes: 0 writes, 0 keys, 0 commit groups, 0.0 writes per commit group, ingest: 0.00 GB, 0.00 MB/s 2024-09-12T02:28:32.969 INFO:journalctl@ceph.mon.b.smithi044.stdout: Cumulative WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s 2024-09-12T02:28:32.969 INFO:journalctl@ceph.mon.b.smithi044.stdout: Cumulative stall: 00:00:0.000 H:M:S, 0.0 percent 2024-09-12T02:28:32.969 INFO:journalctl@ceph.mon.b.smithi044.stdout: Interval writes: 0 writes, 0 keys, 0 commit groups, 0.0 writes per commit group, ingest: 0.00 MB, 0.00 MB/s 2024-09-12T02:28:32.969 INFO:journalctl@ceph.mon.b.smithi044.stdout: Interval WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s 2024-09-12T02:28:32.969 INFO:journalctl@ceph.mon.b.smithi044.stdout: Interval stall: 00:00:0.000 H:M:S, 0.0 percent 2024-09-12T02:28:32.969 INFO:journalctl@ceph.mon.b.smithi044.stdout: 2024-09-12T02:28:32.969 INFO:journalctl@ceph.mon.b.smithi044.stdout: ** Compaction Stats [default] ** 2024-09-12T02:28:32.969 INFO:journalctl@ceph.mon.b.smithi044.stdout: Level Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) 2024-09-12T02:28:32.969 INFO:journalctl@ceph.mon.b.smithi044.stdout: ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------ 2024-09-12T02:28:32.969 INFO:journalctl@ceph.mon.b.smithi044.stdout: L0 1/0 1.73 KB 0.2 0.0 0.0 0.0 0.0 0.0 0.0 1.0 0.0 4.4 0.00 0.00 1 0.000 0 0 0.0 0.0 2024-09-12T02:28:32.970 INFO:journalctl@ceph.mon.b.smithi044.stdout: Sum 1/0 1.73 KB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 1.0 0.0 4.4 0.00 0.00 1 0.000 0 0 0.0 0.0 2024-09-12T02:28:32.970 INFO:journalctl@ceph.mon.b.smithi044.stdout: Int 0/0 0.00 KB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 1.0 0.0 4.4 0.00 0.00 1 0.000 0 0 0.0 0.0 2024-09-12T02:28:32.970 INFO:journalctl@ceph.mon.b.smithi044.stdout: 2024-09-12T02:28:32.970 INFO:journalctl@ceph.mon.b.smithi044.stdout: ** Compaction Stats [default] ** 2024-09-12T02:28:32.970 INFO:journalctl@ceph.mon.b.smithi044.stdout: Priority Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) 2024-09-12T02:28:32.970 INFO:journalctl@ceph.mon.b.smithi044.stdout: --------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- 2024-09-12T02:28:32.970 INFO:journalctl@ceph.mon.b.smithi044.stdout: User 0/0 0.00 KB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 4.4 0.00 0.00 1 0.000 0 0 0.0 0.0 2024-09-12T02:28:32.970 INFO:journalctl@ceph.mon.b.smithi044.stdout: 2024-09-12T02:28:32.970 INFO:journalctl@ceph.mon.b.smithi044.stdout: Blob file count: 0, total size: 0.0 GB, garbage size: 0.0 GB, space amp: 0.0 2024-09-12T02:28:32.970 INFO:journalctl@ceph.mon.b.smithi044.stdout: 2024-09-12T02:28:32.970 INFO:journalctl@ceph.mon.b.smithi044.stdout: Uptime(secs): 0.0 total, 0.0 interval 2024-09-12T02:28:32.970 INFO:journalctl@ceph.mon.b.smithi044.stdout: Flush(GB): cumulative 0.000, interval 0.000 2024-09-12T02:28:32.970 INFO:journalctl@ceph.mon.b.smithi044.stdout: AddFile(GB): cumulative 0.000, interval 0.000 2024-09-12T02:28:32.970 INFO:journalctl@ceph.mon.b.smithi044.stdout: AddFile(Total Files): cumulative 0, interval 0 2024-09-12T02:28:32.971 INFO:journalctl@ceph.mon.b.smithi044.stdout: AddFile(L0 Files): cumulative 0, interval 0 2024-09-12T02:28:32.971 INFO:journalctl@ceph.mon.b.smithi044.stdout: AddFile(Keys): cumulative 0, interval 0 2024-09-12T02:28:32.971 INFO:journalctl@ceph.mon.b.smithi044.stdout: Cumulative compaction: 0.00 GB write, 0.67 MB/s write, 0.00 GB read, 0.00 MB/s read, 0.0 seconds 2024-09-12T02:28:32.971 INFO:journalctl@ceph.mon.b.smithi044.stdout: Interval compaction: 0.00 GB write, 0.67 MB/s write, 0.00 GB read, 0.00 MB/s read, 0.0 seconds 2024-09-12T02:28:32.971 INFO:journalctl@ceph.mon.b.smithi044.stdout: Stalls(count): 0 level0_slowdown, 0 level0_slowdown_with_compaction, 0 level0_numfiles, 0 level0_numfiles_with_compaction, 0 stop for pending_compaction_bytes, 0 slowdown for pending_compaction_bytes, 0 memtable_compaction, 0 memtable_slowdown, interval 0 total count 2024-09-12T02:28:32.971 INFO:journalctl@ceph.mon.b.smithi044.stdout: Block cache BinnedLRUCache@0x55e0acd071f0#2 capacity: 512.00 MB usage: 0.22 KB table_size: 0 occupancy: 18446744073709551615 collections: 1 last_copies: 0 last_secs: 1e-05 secs_since: 0 2024-09-12T02:28:32.971 INFO:journalctl@ceph.mon.b.smithi044.stdout: Block cache entry stats(count,size,portion): FilterBlock(1,0.11 KB,2.08616e-05%) IndexBlock(1,0.11 KB,2.08616e-05%) Misc(1,0.00 KB,0%) 2024-09-12T02:28:32.971 INFO:journalctl@ceph.mon.b.smithi044.stdout: 2024-09-12T02:28:32.971 INFO:journalctl@ceph.mon.b.smithi044.stdout: ** File Read Latency Histogram By Level [default] ** 2024-09-12T02:28:32.971 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 12 02:28:32 smithi044 ceph-mon[35411]: mon.b does not exist in monmap, will attempt to join an existing cluster 2024-09-12T02:28:32.971 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 12 02:28:32 smithi044 ceph-mon[35411]: using public_addr v2:172.21.15.44:0/0 -> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] 2024-09-12T02:28:32.971 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 12 02:28:32 smithi044 ceph-mon[35411]: starting mon.b rank -1 at public addrs [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] at bind addrs [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] mon_data /var/lib/ceph/mon/ceph-b fsid 4954ed46-70ae-11ef-bcea-c7b262605968 2024-09-12T02:28:32.971 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 12 02:28:32 smithi044 ceph-mon[35411]: mon.b@-1(???) e0 preinit fsid 4954ed46-70ae-11ef-bcea-c7b262605968 2024-09-12T02:28:32.972 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 12 02:28:32 smithi044 ceph-mon[35411]: mon.b@-1(synchronizing).mds e1 new map 2024-09-12T02:28:32.972 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 12 02:28:32 smithi044 ceph-mon[35411]: mon.b@-1(synchronizing).mds e1 print_map 2024-09-12T02:28:32.972 INFO:journalctl@ceph.mon.b.smithi044.stdout: e1 2024-09-12T02:28:32.972 INFO:journalctl@ceph.mon.b.smithi044.stdout: btime 2024-09-12T02:26:43:086025+0000 2024-09-12T02:28:32.972 INFO:journalctl@ceph.mon.b.smithi044.stdout: enable_multiple, ever_enabled_multiple: 1,1 2024-09-12T02:28:32.972 INFO:journalctl@ceph.mon.b.smithi044.stdout: default compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2,11=minor log segments,12=quiesce subvolumes} 2024-09-12T02:28:32.972 INFO:journalctl@ceph.mon.b.smithi044.stdout: legacy client fscid: -1 2024-09-12T02:28:32.972 INFO:journalctl@ceph.mon.b.smithi044.stdout: 2024-09-12T02:28:32.972 INFO:journalctl@ceph.mon.b.smithi044.stdout: No filesystems configured 2024-09-12T02:28:32.972 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 12 02:28:32 smithi044 ceph-mon[35411]: mon.b@-1(synchronizing).osd e0 _set_cache_ratios kv ratio 0.25 inc ratio 0.375 full ratio 0.375 2024-09-12T02:28:32.972 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 12 02:28:32 smithi044 ceph-mon[35411]: mon.b@-1(synchronizing).osd e0 register_cache_with_pcm pcm target: 2147483648 pcm max: 1020054732 pcm min: 134217728 inc_osd_cache size: 1 2024-09-12T02:28:32.972 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 12 02:28:32 smithi044 ceph-mon[35411]: mon.b@-1(synchronizing).osd e1 e1: 0 total, 0 up, 0 in 2024-09-12T02:28:32.972 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 12 02:28:32 smithi044 ceph-mon[35411]: mon.b@-1(synchronizing).osd e2 e2: 0 total, 0 up, 0 in 2024-09-12T02:28:32.973 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 12 02:28:32 smithi044 ceph-mon[35411]: mon.b@-1(synchronizing).osd e3 e3: 0 total, 0 up, 0 in 2024-09-12T02:28:32.973 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 12 02:28:32 smithi044 ceph-mon[35411]: mon.b@-1(synchronizing).osd e4 e4: 0 total, 0 up, 0 in 2024-09-12T02:28:32.973 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 12 02:28:32 smithi044 ceph-mon[35411]: mon.b@-1(synchronizing).osd e4 crush map has features 3314932999778484224, adjusting msgr requires 2024-09-12T02:28:32.973 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 12 02:28:32 smithi044 ceph-mon[35411]: mon.b@-1(synchronizing).osd e4 crush map has features 288514050185494528, adjusting msgr requires 2024-09-12T02:28:32.973 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 12 02:28:32 smithi044 ceph-mon[35411]: mon.b@-1(synchronizing).osd e4 crush map has features 288514050185494528, adjusting msgr requires 2024-09-12T02:28:32.973 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 12 02:28:32 smithi044 ceph-mon[35411]: mon.b@-1(synchronizing).osd e4 crush map has features 288514050185494528, adjusting msgr requires 2024-09-12T02:28:32.973 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 12 02:28:32 smithi044 ceph-mon[35411]: from='client.14176 -' entity='client.admin' cmd=[{"prefix": "orch host ls", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-09-12T02:28:32.973 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 12 02:28:32 smithi044 ceph-mon[35411]: pgmap v4: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-12T02:28:32.973 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 12 02:28:32 smithi044 ceph-mon[35411]: from='client.14178 -' entity='client.admin' cmd=[{"prefix": "orch host add", "hostname": "smithi172", "target": ["mon-mgr", ""]}]: dispatch 2024-09-12T02:28:32.973 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 12 02:28:32 smithi044 ceph-mon[35411]: from='mgr.14150 172.21.15.39:0/408627207' entity='mgr.x' 2024-09-12T02:28:32.973 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 12 02:28:32 smithi044 ceph-mon[35411]: from='mgr.14150 172.21.15.39:0/408627207' entity='mgr.x' 2024-09-12T02:28:32.973 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 12 02:28:32 smithi044 ceph-mon[35411]: from='mgr.14150 172.21.15.39:0/408627207' entity='mgr.x' 2024-09-12T02:28:32.973 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 12 02:28:32 smithi044 ceph-mon[35411]: from='mgr.14150 172.21.15.39:0/408627207' entity='mgr.x' 2024-09-12T02:28:32.974 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 12 02:28:32 smithi044 ceph-mon[35411]: from='mgr.14150 172.21.15.39:0/408627207' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd/host:smithi044", "name": "osd_memory_target"}]: dispatch 2024-09-12T02:28:32.974 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 12 02:28:32 smithi044 ceph-mon[35411]: from='mgr.14150 172.21.15.39:0/408627207' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-12T02:28:32.974 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 12 02:28:32 smithi044 ceph-mon[35411]: from='mgr.14150 172.21.15.39:0/408627207' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-12T02:28:32.974 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 12 02:28:32 smithi044 ceph-mon[35411]: pgmap v5: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-12T02:28:32.974 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 12 02:28:32 smithi044 ceph-mon[35411]: Updating smithi044:/etc/ceph/ceph.conf 2024-09-12T02:28:32.974 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 12 02:28:32 smithi044 ceph-mon[35411]: Updating smithi044:/var/lib/ceph/4954ed46-70ae-11ef-bcea-c7b262605968/config/ceph.conf 2024-09-12T02:28:32.974 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 12 02:28:32 smithi044 ceph-mon[35411]: Updating smithi044:/etc/ceph/ceph.client.admin.keyring 2024-09-12T02:28:32.974 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 12 02:28:32 smithi044 ceph-mon[35411]: Updating smithi044:/var/lib/ceph/4954ed46-70ae-11ef-bcea-c7b262605968/config/ceph.client.admin.keyring 2024-09-12T02:28:32.974 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 12 02:28:32 smithi044 ceph-mon[35411]: Deploying cephadm binary to smithi172 2024-09-12T02:28:32.974 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 12 02:28:32 smithi044 ceph-mon[35411]: from='mgr.14150 172.21.15.39:0/408627207' entity='mgr.x' 2024-09-12T02:28:32.974 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 12 02:28:32 smithi044 ceph-mon[35411]: from='mgr.14150 172.21.15.39:0/408627207' entity='mgr.x' 2024-09-12T02:28:32.974 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 12 02:28:32 smithi044 ceph-mon[35411]: from='mgr.14150 172.21.15.39:0/408627207' entity='mgr.x' 2024-09-12T02:28:32.974 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 12 02:28:32 smithi044 ceph-mon[35411]: pgmap v6: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-12T02:28:32.975 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 12 02:28:32 smithi044 ceph-mon[35411]: from='mgr.14150 172.21.15.39:0/408627207' entity='mgr.x' 2024-09-12T02:28:32.975 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 12 02:28:32 smithi044 ceph-mon[35411]: from='mgr.14150 172.21.15.39:0/408627207' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-12T02:28:32.975 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 12 02:28:32 smithi044 ceph-mon[35411]: from='mgr.14150 172.21.15.39:0/408627207' entity='mgr.x' 2024-09-12T02:28:32.975 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 12 02:28:32 smithi044 ceph-mon[35411]: Added host smithi172 2024-09-12T02:28:32.975 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 12 02:28:32 smithi044 ceph-mon[35411]: from='mgr.14150 172.21.15.39:0/408627207' entity='mgr.x' 2024-09-12T02:28:32.975 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 12 02:28:32 smithi044 ceph-mon[35411]: from='mgr.14150 172.21.15.39:0/408627207' entity='mgr.x' 2024-09-12T02:28:32.975 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 12 02:28:32 smithi044 ceph-mon[35411]: pgmap v7: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-12T02:28:32.975 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 12 02:28:32 smithi044 ceph-mon[35411]: from='client.14180 -' entity='client.admin' cmd=[{"prefix": "orch host ls", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-09-12T02:28:32.975 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 12 02:28:32 smithi044 ceph-mon[35411]: pgmap v8: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-12T02:28:32.975 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 12 02:28:32 smithi044 ceph-mon[35411]: from='client.? 172.21.15.39:0/549691537' entity='client.admin' cmd=[{"prefix": "osd crush tunables", "profile": "default"}]: dispatch 2024-09-12T02:28:32.975 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 12 02:28:32 smithi044 ceph-mon[35411]: from='mgr.14150 172.21.15.39:0/408627207' entity='mgr.x' 2024-09-12T02:28:32.975 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 12 02:28:32 smithi044 ceph-mon[35411]: from='mgr.14150 172.21.15.39:0/408627207' entity='mgr.x' 2024-09-12T02:28:32.975 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 12 02:28:32 smithi044 ceph-mon[35411]: from='mgr.14150 172.21.15.39:0/408627207' entity='mgr.x' 2024-09-12T02:28:32.976 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 12 02:28:32 smithi044 ceph-mon[35411]: from='mgr.14150 172.21.15.39:0/408627207' entity='mgr.x' 2024-09-12T02:28:32.976 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 12 02:28:32 smithi044 ceph-mon[35411]: from='mgr.14150 172.21.15.39:0/408627207' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd/host:smithi172", "name": "osd_memory_target"}]: dispatch 2024-09-12T02:28:32.976 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 12 02:28:32 smithi044 ceph-mon[35411]: from='mgr.14150 172.21.15.39:0/408627207' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-12T02:28:32.976 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 12 02:28:32 smithi044 ceph-mon[35411]: from='mgr.14150 172.21.15.39:0/408627207' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-12T02:28:32.976 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 12 02:28:32 smithi044 ceph-mon[35411]: Updating smithi172:/etc/ceph/ceph.conf 2024-09-12T02:28:32.976 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 12 02:28:32 smithi044 ceph-mon[35411]: Updating smithi172:/var/lib/ceph/4954ed46-70ae-11ef-bcea-c7b262605968/config/ceph.conf 2024-09-12T02:28:32.976 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 12 02:28:32 smithi044 ceph-mon[35411]: from='client.? 172.21.15.39:0/549691537' entity='client.admin' cmd='[{"prefix": "osd crush tunables", "profile": "default"}]': finished 2024-09-12T02:28:32.976 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 12 02:28:32 smithi044 ceph-mon[35411]: osdmap e4: 0 total, 0 up, 0 in 2024-09-12T02:28:32.976 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 12 02:28:32 smithi044 ceph-mon[35411]: from='mgr.14150 172.21.15.39:0/408627207' entity='mgr.x' 2024-09-12T02:28:32.976 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 12 02:28:32 smithi044 ceph-mon[35411]: from='mgr.14150 172.21.15.39:0/408627207' entity='mgr.x' 2024-09-12T02:28:32.976 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 12 02:28:32 smithi044 ceph-mon[35411]: from='mgr.14150 172.21.15.39:0/408627207' entity='mgr.x' 2024-09-12T02:28:32.977 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 12 02:28:32 smithi044 ceph-mon[35411]: pgmap v10: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-12T02:28:32.977 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 12 02:28:32 smithi044 ceph-mon[35411]: Updating smithi172:/etc/ceph/ceph.client.admin.keyring 2024-09-12T02:28:32.977 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 12 02:28:32 smithi044 ceph-mon[35411]: Updating smithi172:/var/lib/ceph/4954ed46-70ae-11ef-bcea-c7b262605968/config/ceph.client.admin.keyring 2024-09-12T02:28:32.977 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 12 02:28:32 smithi044 ceph-mon[35411]: from='client.14184 -' entity='client.admin' cmd=[{"prefix": "orch apply", "service_type": "mon", "placement": "3;smithi039:172.21.15.39=a;smithi044:172.21.15.44=b;smithi172:172.21.15.172=c", "target": ["mon-mgr", ""]}]: dispatch 2024-09-12T02:28:32.977 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 12 02:28:32 smithi044 ceph-mon[35411]: Saving service mon spec with placement smithi039:172.21.15.39=a;smithi044:172.21.15.44=b;smithi172:172.21.15.172=c;count:3 2024-09-12T02:28:32.977 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 12 02:28:32 smithi044 ceph-mon[35411]: from='mgr.14150 172.21.15.39:0/408627207' entity='mgr.x' 2024-09-12T02:28:32.977 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 12 02:28:32 smithi044 ceph-mon[35411]: from='mgr.14150 172.21.15.39:0/408627207' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-12T02:28:32.977 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 12 02:28:32 smithi044 ceph-mon[35411]: from='mgr.14150 172.21.15.39:0/408627207' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-12T02:28:32.977 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 12 02:28:32 smithi044 ceph-mon[35411]: from='mgr.14150 172.21.15.39:0/408627207' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-12T02:28:32.977 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 12 02:28:32 smithi044 ceph-mon[35411]: from='mgr.14150 172.21.15.39:0/408627207' entity='mgr.x' 2024-09-12T02:28:32.977 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 12 02:28:32 smithi044 ceph-mon[35411]: from='mgr.14150 172.21.15.39:0/408627207' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2024-09-12T02:28:32.977 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 12 02:28:32 smithi044 ceph-mon[35411]: from='mgr.14150 172.21.15.39:0/408627207' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-12T02:28:32.977 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 12 02:28:32 smithi044 ceph-mon[35411]: Deploying daemon mon.c on smithi172 2024-09-12T02:28:32.978 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 12 02:28:32 smithi044 ceph-mon[35411]: pgmap v11: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-12T02:28:32.978 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 12 02:28:32 smithi044 ceph-mon[35411]: from='client.? 172.21.15.172:0/955370917' entity='client.admin' cmd=[{"prefix": "mon dump", "format": "json"}]: dispatch 2024-09-12T02:28:32.978 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 12 02:28:32 smithi044 ceph-mon[35411]: pgmap v12: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-12T02:28:32.978 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 12 02:28:32 smithi044 ceph-mon[35411]: from='mgr.14150 172.21.15.39:0/408627207' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2024-09-12T02:28:32.978 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 12 02:28:32 smithi044 ceph-mon[35411]: from='mgr.14150 172.21.15.39:0/408627207' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-09-12T02:28:32.978 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 12 02:28:32 smithi044 ceph-mon[35411]: mon.a calling monitor election 2024-09-12T02:28:32.978 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 12 02:28:32 smithi044 ceph-mon[35411]: pgmap v14: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-12T02:28:32.978 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 12 02:28:32 smithi044 ceph-mon[35411]: from='mgr.14150 172.21.15.39:0/408627207' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-09-12T02:28:32.978 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 12 02:28:32 smithi044 ceph-mon[35411]: mon.c calling monitor election 2024-09-12T02:28:32.978 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 12 02:28:32 smithi044 ceph-mon[35411]: from='mgr.14150 172.21.15.39:0/408627207' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-09-12T02:28:32.978 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 12 02:28:32 smithi044 ceph-mon[35411]: pgmap v15: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-12T02:28:32.978 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 12 02:28:32 smithi044 ceph-mon[35411]: from='mgr.14150 172.21.15.39:0/408627207' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-09-12T02:28:32.978 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 12 02:28:32 smithi044 ceph-mon[35411]: from='mgr.14150 172.21.15.39:0/408627207' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-09-12T02:28:32.978 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 12 02:28:32 smithi044 ceph-mon[35411]: from='mgr.14150 172.21.15.39:0/408627207' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-09-12T02:28:32.978 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 12 02:28:32 smithi044 ceph-mon[35411]: mon.a is new leader, mons a,c in quorum (ranks 0,1) 2024-09-12T02:28:32.979 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 12 02:28:32 smithi044 ceph-mon[35411]: monmap epoch 2 2024-09-12T02:28:32.979 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 12 02:28:32 smithi044 ceph-mon[35411]: fsid 4954ed46-70ae-11ef-bcea-c7b262605968 2024-09-12T02:28:32.979 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 12 02:28:32 smithi044 ceph-mon[35411]: last_changed 2024-09-12T02:28:23.741500+0000 2024-09-12T02:28:32.979 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 12 02:28:32 smithi044 ceph-mon[35411]: created 2024-09-12T02:26:39.333323+0000 2024-09-12T02:28:32.979 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 12 02:28:32 smithi044 ceph-mon[35411]: min_mon_release 19 (squid) 2024-09-12T02:28:32.979 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 12 02:28:32 smithi044 ceph-mon[35411]: election_strategy: 1 2024-09-12T02:28:32.979 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 12 02:28:32 smithi044 ceph-mon[35411]: 0: [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] mon.a 2024-09-12T02:28:32.979 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 12 02:28:32 smithi044 ceph-mon[35411]: 1: [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] mon.c 2024-09-12T02:28:32.979 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 12 02:28:32 smithi044 ceph-mon[35411]: fsmap 2024-09-12T02:28:32.979 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 12 02:28:32 smithi044 ceph-mon[35411]: osdmap e4: 0 total, 0 up, 0 in 2024-09-12T02:28:32.979 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 12 02:28:32 smithi044 ceph-mon[35411]: mgrmap e13: x(active, since 44s) 2024-09-12T02:28:32.979 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 12 02:28:32 smithi044 ceph-mon[35411]: overall HEALTH_OK 2024-09-12T02:28:32.979 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 12 02:28:32 smithi044 ceph-mon[35411]: from='mgr.14150 172.21.15.39:0/408627207' entity='mgr.x' 2024-09-12T02:28:32.979 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 12 02:28:32 smithi044 ceph-mon[35411]: from='mgr.14150 172.21.15.39:0/408627207' entity='mgr.x' 2024-09-12T02:28:32.979 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 12 02:28:32 smithi044 ceph-mon[35411]: from='mgr.14150 172.21.15.39:0/408627207' entity='mgr.x' 2024-09-12T02:28:32.980 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 12 02:28:32 smithi044 ceph-mon[35411]: from='mgr.14150 172.21.15.39:0/408627207' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2024-09-12T02:28:32.980 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 12 02:28:32 smithi044 ceph-mon[35411]: from='mgr.14150 172.21.15.39:0/408627207' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-12T02:28:32.980 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 12 02:28:32 smithi044 ceph-mon[35411]: pgmap v16: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-12T02:28:32.980 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 12 02:28:32 smithi044 ceph-mon[35411]: Deploying daemon mon.b on smithi044 2024-09-12T02:28:32.980 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 12 02:28:32 smithi044 ceph-mon[35411]: from='client.? 172.21.15.172:0/3707367595' entity='client.admin' cmd=[{"prefix": "mon dump", "format": "json"}]: dispatch 2024-09-12T02:28:32.980 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 12 02:28:32 smithi044 ceph-mon[35411]: from='mgr.14150 172.21.15.39:0/408627207' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-09-12T02:28:32.980 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 12 02:28:32 smithi044 ceph-mon[35411]: pgmap v17: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-12T02:28:32.980 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 12 02:28:32 smithi044 ceph-mon[35411]: from='client.? 172.21.15.172:0/4120717245' entity='client.admin' cmd=[{"prefix": "mon dump", "format": "json"}]: dispatch 2024-09-12T02:28:32.980 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 12 02:28:32 smithi044 ceph-mon[35411]: mon.b@-1(synchronizing).paxosservice(auth 1..3) refresh upgraded, format 0 -> 3 2024-09-12T02:28:32.980 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 12 02:28:32 smithi044 bash[35392]: 41838f02b634abb688a9fb1f3a8a15bb75d3f2d8da7c345ab802229c9adb2389 2024-09-12T02:28:32.980 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 12 02:28:32 smithi044 systemd[1]: Started Ceph mon.b for 4954ed46-70ae-11ef-bcea-c7b262605968. 2024-09-12T02:28:33.341 INFO:tasks.cephadm:Waiting for 3 mons in monmap... 2024-09-12T02:28:33.341 DEBUG:teuthology.orchestra.run.smithi172:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 4954ed46-70ae-11ef-bcea-c7b262605968 -- ceph mon dump -f json 2024-09-12T02:28:33.605 INFO:teuthology.orchestra.run.smithi172.stderr:Inferring config /var/lib/ceph/4954ed46-70ae-11ef-bcea-c7b262605968/mon.c/config 2024-09-12T02:28:37.691 INFO:teuthology.orchestra.run.smithi172.stderr:2024-09-12T02:28:37.690+0000 7fa4879f4640 1 -- 172.21.15.172:0/3076257210 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fa46c003530 msgr2=0x7fa46c0059c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:28:37.691 INFO:teuthology.orchestra.run.smithi172.stderr:2024-09-12T02:28:37.690+0000 7fa4879f4640 1 --2- 172.21.15.172:0/3076257210 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fa46c003530 0x7fa46c0059c0 secure :-1 s=READY pgs=104 cs=0 l=1 rev1=1 crypto rx=0x7fa4801016a0 tx=0x7fa47c02c3f0 comp rx=0 tx=0).stop 2024-09-12T02:28:37.691 INFO:teuthology.orchestra.run.smithi172.stderr:2024-09-12T02:28:37.690+0000 7fa4879f4640 1 -- 172.21.15.172:0/3076257210 shutdown_connections 2024-09-12T02:28:37.691 INFO:teuthology.orchestra.run.smithi172.stderr:2024-09-12T02:28:37.690+0000 7fa4879f4640 1 --2- 172.21.15.172:0/3076257210 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fa46c003530 0x7fa46c0059c0 unknown :-1 s=CLOSED pgs=104 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:28:37.691 INFO:teuthology.orchestra.run.smithi172.stderr:2024-09-12T02:28:37.690+0000 7fa4879f4640 1 -- 172.21.15.172:0/3076257210 >> 172.21.15.172:0/3076257210 conn(0x7fa4800fc220 msgr2=0x7fa4800fe640 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:28:37.691 INFO:teuthology.orchestra.run.smithi172.stderr:2024-09-12T02:28:37.690+0000 7fa4879f4640 1 -- 172.21.15.172:0/3076257210 shutdown_connections 2024-09-12T02:28:37.691 INFO:teuthology.orchestra.run.smithi172.stderr:2024-09-12T02:28:37.690+0000 7fa4879f4640 1 -- 172.21.15.172:0/3076257210 wait complete. 2024-09-12T02:28:37.693 INFO:teuthology.orchestra.run.smithi172.stderr:2024-09-12T02:28:37.691+0000 7fa4879f4640 1 Processor -- start 2024-09-12T02:28:37.694 INFO:teuthology.orchestra.run.smithi172.stderr:2024-09-12T02:28:37.691+0000 7fa4879f4640 1 -- start start 2024-09-12T02:28:37.694 INFO:teuthology.orchestra.run.smithi172.stderr:2024-09-12T02:28:37.691+0000 7fa4879f4640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fa46c003530 0x7fa480198160 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:28:37.694 INFO:teuthology.orchestra.run.smithi172.stderr:2024-09-12T02:28:37.691+0000 7fa4879f4640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fa4801986a0 0x7fa480198b00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:28:37.694 INFO:teuthology.orchestra.run.smithi172.stderr:2024-09-12T02:28:37.691+0000 7fa4879f4640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fa4801a11d0 0x7fa4801a35c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:28:37.694 INFO:teuthology.orchestra.run.smithi172.stderr:2024-09-12T02:28:37.691+0000 7fa4879f4640 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 -- 0x7fa480108670 con 0x7fa4801986a0 2024-09-12T02:28:37.694 INFO:teuthology.orchestra.run.smithi172.stderr:2024-09-12T02:28:37.691+0000 7fa4879f4640 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x7fa4801084f0 con 0x7fa4801a11d0 2024-09-12T02:28:37.694 INFO:teuthology.orchestra.run.smithi172.stderr:2024-09-12T02:28:37.691+0000 7fa4879f4640 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7fa4801087f0 con 0x7fa46c003530 2024-09-12T02:28:37.694 INFO:teuthology.orchestra.run.smithi172.stderr:2024-09-12T02:28:37.692+0000 7fa485790640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fa46c003530 0x7fa480198160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:28:37.694 INFO:teuthology.orchestra.run.smithi172.stderr:2024-09-12T02:28:37.692+0000 7fa485790640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fa46c003530 0x7fa480198160 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.172:3300/0 says I am v2:172.21.15.172:55954/0 (socket says 172.21.15.172:55954) 2024-09-12T02:28:37.694 INFO:teuthology.orchestra.run.smithi172.stderr:2024-09-12T02:28:37.692+0000 7fa485790640 1 -- 172.21.15.172:0/2110469974 learned_addr learned my addr 172.21.15.172:0/2110469974 (peer_addr_for_me v2:172.21.15.172:0/0) 2024-09-12T02:28:37.694 INFO:teuthology.orchestra.run.smithi172.stderr:2024-09-12T02:28:37.692+0000 7fa484f8f640 1 --2- 172.21.15.172:0/2110469974 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fa4801986a0 0x7fa480198b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:28:37.694 INFO:teuthology.orchestra.run.smithi172.stderr:2024-09-12T02:28:37.692+0000 7fa485f91640 1 --2- 172.21.15.172:0/2110469974 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fa4801a11d0 0x7fa4801a35c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:28:37.694 INFO:teuthology.orchestra.run.smithi172.stderr:2024-09-12T02:28:37.692+0000 7fa485790640 1 -- 172.21.15.172:0/2110469974 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fa46c003530 msgr2=0x7fa480198160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_bulk peer close file descriptor 12 2024-09-12T02:28:37.694 INFO:teuthology.orchestra.run.smithi172.stderr:2024-09-12T02:28:37.692+0000 7fa485790640 1 -- 172.21.15.172:0/2110469974 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fa46c003530 msgr2=0x7fa480198160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until read failed 2024-09-12T02:28:37.695 INFO:teuthology.orchestra.run.smithi172.stderr:2024-09-12T02:28:37.692+0000 7fa485790640 1 --2- 172.21.15.172:0/2110469974 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fa46c003530 0x7fa480198160 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-09-12T02:28:37.695 INFO:teuthology.orchestra.run.smithi172.stderr:2024-09-12T02:28:37.692+0000 7fa485790640 1 --2- 172.21.15.172:0/2110469974 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fa46c003530 0x7fa480198160 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-09-12T02:28:37.695 INFO:teuthology.orchestra.run.smithi172.stderr:2024-09-12T02:28:37.692+0000 7fa485f91640 1 -- 172.21.15.172:0/2110469974 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fa4801a11d0 msgr2=0x7fa4801a35c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_bulk peer close file descriptor 14 2024-09-12T02:28:37.695 INFO:teuthology.orchestra.run.smithi172.stderr:2024-09-12T02:28:37.692+0000 7fa485f91640 1 -- 172.21.15.172:0/2110469974 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fa4801a11d0 msgr2=0x7fa4801a35c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until read failed 2024-09-12T02:28:37.695 INFO:teuthology.orchestra.run.smithi172.stderr:2024-09-12T02:28:37.692+0000 7fa485f91640 1 --2- 172.21.15.172:0/2110469974 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fa4801a11d0 0x7fa4801a35c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-09-12T02:28:37.695 INFO:teuthology.orchestra.run.smithi172.stderr:2024-09-12T02:28:37.692+0000 7fa485f91640 1 --2- 172.21.15.172:0/2110469974 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fa4801a11d0 0x7fa4801a35c0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-09-12T02:28:37.695 INFO:teuthology.orchestra.run.smithi172.stderr:2024-09-12T02:28:37.692+0000 7fa484f8f640 1 -- 172.21.15.172:0/2110469974 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fa46c003530 msgr2=0x7fa480198160 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-09-12T02:28:37.695 INFO:teuthology.orchestra.run.smithi172.stderr:2024-09-12T02:28:37.692+0000 7fa484f8f640 1 --2- 172.21.15.172:0/2110469974 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fa46c003530 0x7fa480198160 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:28:37.695 INFO:teuthology.orchestra.run.smithi172.stderr:2024-09-12T02:28:37.692+0000 7fa484f8f640 1 -- 172.21.15.172:0/2110469974 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fa4801a11d0 msgr2=0x7fa4801a35c0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-09-12T02:28:37.695 INFO:teuthology.orchestra.run.smithi172.stderr:2024-09-12T02:28:37.692+0000 7fa484f8f640 1 --2- 172.21.15.172:0/2110469974 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fa4801a11d0 0x7fa4801a35c0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:28:37.695 INFO:teuthology.orchestra.run.smithi172.stderr:2024-09-12T02:28:37.692+0000 7fa484f8f640 1 -- 172.21.15.172:0/2110469974 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa4801a3d60 con 0x7fa4801986a0 2024-09-12T02:28:37.695 INFO:teuthology.orchestra.run.smithi172.stderr:2024-09-12T02:28:37.693+0000 7fa484f8f640 1 --2- 172.21.15.172:0/2110469974 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fa4801986a0 0x7fa480198b00 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0x7fa47000b450 tx=0x7fa47000b910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:28:37.695 INFO:teuthology.orchestra.run.smithi172.stderr:2024-09-12T02:28:37.693+0000 7fa4767fc640 1 -- 172.21.15.172:0/2110469974 <== mon.0 v2:172.21.15.39:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa470004230 con 0x7fa4801986a0 2024-09-12T02:28:37.695 INFO:teuthology.orchestra.run.smithi172.stderr:2024-09-12T02:28:37.693+0000 7fa4767fc640 1 -- 172.21.15.172:0/2110469974 <== mon.0 v2:172.21.15.39:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fa4700043d0 con 0x7fa4801986a0 2024-09-12T02:28:37.696 INFO:teuthology.orchestra.run.smithi172.stderr:2024-09-12T02:28:37.693+0000 7fa4767fc640 1 -- 172.21.15.172:0/2110469974 <== mon.0 v2:172.21.15.39:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa470003cb0 con 0x7fa4801986a0 2024-09-12T02:28:37.696 INFO:teuthology.orchestra.run.smithi172.stderr:2024-09-12T02:28:37.693+0000 7fa4879f4640 1 -- 172.21.15.172:0/2110469974 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa4801a4050 con 0x7fa4801986a0 2024-09-12T02:28:37.696 INFO:teuthology.orchestra.run.smithi172.stderr:2024-09-12T02:28:37.693+0000 7fa4879f4640 1 -- 172.21.15.172:0/2110469974 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa4801a45b0 con 0x7fa4801986a0 2024-09-12T02:28:37.696 INFO:teuthology.orchestra.run.smithi172.stderr:2024-09-12T02:28:37.694+0000 7fa4767fc640 1 -- 172.21.15.172:0/2110469974 <== mon.0 v2:172.21.15.39:3300/0 4 ==== mgrmap(e 13) ==== 46343+0+0 (secure 0 0 0) 0x7fa47000f050 con 0x7fa4801986a0 2024-09-12T02:28:37.697 INFO:teuthology.orchestra.run.smithi172.stderr:2024-09-12T02:28:37.694+0000 7fa4879f4640 1 -- 172.21.15.172:0/2110469974 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fa4801097a0 con 0x7fa4801986a0 2024-09-12T02:28:37.697 INFO:teuthology.orchestra.run.smithi172.stderr:2024-09-12T02:28:37.694+0000 7fa4767fc640 1 --2- 172.21.15.172:0/2110469974 >> [v2:172.21.15.39:6800/1725006999,v1:172.21.15.39:6801/1725006999] conn(0x7fa4640394f0 0x7fa46403b9b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:28:37.697 INFO:teuthology.orchestra.run.smithi172.stderr:2024-09-12T02:28:37.695+0000 7fa4767fc640 1 -- 172.21.15.172:0/2110469974 <== mon.0 v2:172.21.15.39:3300/0 5 ==== osd_map(4..4 src has 1..4) ==== 1155+0+0 (secure 0 0 0) 0x7fa47004bdf0 con 0x7fa4801986a0 2024-09-12T02:28:37.697 INFO:teuthology.orchestra.run.smithi172.stderr:2024-09-12T02:28:37.695+0000 7fa485790640 1 --2- 172.21.15.172:0/2110469974 >> [v2:172.21.15.39:6800/1725006999,v1:172.21.15.39:6801/1725006999] conn(0x7fa4640394f0 0x7fa46403b9b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:28:37.697 INFO:teuthology.orchestra.run.smithi172.stderr:2024-09-12T02:28:37.696+0000 7fa485790640 1 --2- 172.21.15.172:0/2110469974 >> [v2:172.21.15.39:6800/1725006999,v1:172.21.15.39:6801/1725006999] conn(0x7fa4640394f0 0x7fa46403b9b0 secure :-1 s=READY pgs=37 cs=0 l=1 rev1=1 crypto rx=0x7fa47c005fd0 tx=0x7fa47c005f60 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:28:37.700 INFO:teuthology.orchestra.run.smithi172.stderr:2024-09-12T02:28:37.700+0000 7fa4767fc640 1 -- 172.21.15.172:0/2110469974 <== mon.0 v2:172.21.15.39:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7fa47000d040 con 0x7fa4801986a0 2024-09-12T02:28:37.941 INFO:teuthology.orchestra.run.smithi172.stderr:2024-09-12T02:28:37.941+0000 7fa4879f4640 1 -- 172.21.15.172:0/2110469974 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_command({"prefix": "mon dump", "format": "json"} v 0) -- 0x7fa48002d7c0 con 0x7fa4801986a0 2024-09-12T02:28:37.942 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 12 02:28:37 smithi172 ceph-mon[35609]: from='mgr.14150 172.21.15.39:0/408627207' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2024-09-12T02:28:37.942 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 12 02:28:37 smithi172 ceph-mon[35609]: mon.a calling monitor election 2024-09-12T02:28:37.942 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 12 02:28:37 smithi172 ceph-mon[35609]: mon.c calling monitor election 2024-09-12T02:28:37.942 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 12 02:28:37 smithi172 ceph-mon[35609]: from='mgr.14150 172.21.15.39:0/408627207' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-09-12T02:28:37.942 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 12 02:28:37 smithi172 ceph-mon[35609]: from='mgr.14150 172.21.15.39:0/408627207' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-09-12T02:28:37.942 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 12 02:28:37 smithi172 ceph-mon[35609]: pgmap v18: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-12T02:28:37.942 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 12 02:28:37 smithi172 ceph-mon[35609]: from='mgr.14150 172.21.15.39:0/408627207' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-09-12T02:28:37.942 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 12 02:28:37 smithi172 ceph-mon[35609]: from='mgr.14150 172.21.15.39:0/408627207' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-09-12T02:28:37.942 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 12 02:28:37 smithi172 ceph-mon[35609]: pgmap v19: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-12T02:28:37.943 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 12 02:28:37 smithi172 ceph-mon[35609]: from='mgr.14150 172.21.15.39:0/408627207' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-09-12T02:28:37.943 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 12 02:28:37 smithi172 ceph-mon[35609]: from='mgr.14150 172.21.15.39:0/408627207' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-09-12T02:28:37.943 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 12 02:28:37 smithi172 ceph-mon[35609]: pgmap v20: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-12T02:28:37.943 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 12 02:28:37 smithi172 ceph-mon[35609]: from='mgr.14150 172.21.15.39:0/408627207' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-09-12T02:28:37.943 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 12 02:28:37 smithi172 ceph-mon[35609]: mon.a is new leader, mons a,c in quorum (ranks 0,1) 2024-09-12T02:28:37.943 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 12 02:28:37 smithi172 ceph-mon[35609]: monmap epoch 3 2024-09-12T02:28:37.943 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 12 02:28:37 smithi172 ceph-mon[35609]: fsid 4954ed46-70ae-11ef-bcea-c7b262605968 2024-09-12T02:28:37.943 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 12 02:28:37 smithi172 ceph-mon[35609]: last_changed 2024-09-12T02:28:32.669501+0000 2024-09-12T02:28:37.943 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 12 02:28:37 smithi172 ceph-mon[35609]: created 2024-09-12T02:26:39.333323+0000 2024-09-12T02:28:37.943 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 12 02:28:37 smithi172 ceph-mon[35609]: min_mon_release 19 (squid) 2024-09-12T02:28:37.943 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 12 02:28:37 smithi172 ceph-mon[35609]: election_strategy: 1 2024-09-12T02:28:37.943 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 12 02:28:37 smithi172 ceph-mon[35609]: 0: [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] mon.a 2024-09-12T02:28:37.943 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 12 02:28:37 smithi172 ceph-mon[35609]: 1: [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] mon.c 2024-09-12T02:28:37.944 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 12 02:28:37 smithi172 ceph-mon[35609]: 2: [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] mon.b 2024-09-12T02:28:37.944 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 12 02:28:37 smithi172 ceph-mon[35609]: fsmap 2024-09-12T02:28:37.944 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 12 02:28:37 smithi172 ceph-mon[35609]: osdmap e4: 0 total, 0 up, 0 in 2024-09-12T02:28:37.944 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 12 02:28:37 smithi172 ceph-mon[35609]: mgrmap e13: x(active, since 52s) 2024-09-12T02:28:37.944 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 12 02:28:37 smithi172 ceph-mon[35609]: overall HEALTH_OK 2024-09-12T02:28:37.944 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 12 02:28:37 smithi172 ceph-mon[35609]: from='mgr.14150 172.21.15.39:0/408627207' entity='mgr.x' 2024-09-12T02:28:37.944 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 12 02:28:37 smithi172 ceph-mon[35609]: from='mgr.14150 172.21.15.39:0/408627207' entity='mgr.x' 2024-09-12T02:28:37.944 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 12 02:28:37 smithi172 ceph-mon[35609]: from='mgr.14150 172.21.15.39:0/408627207' entity='mgr.x' 2024-09-12T02:28:37.944 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 12 02:28:37 smithi172 ceph-mon[35609]: from='mgr.14150 172.21.15.39:0/408627207' entity='mgr.x' 2024-09-12T02:28:37.944 INFO:teuthology.orchestra.run.smithi172.stderr:2024-09-12T02:28:37.941+0000 7fa4767fc640 1 -- 172.21.15.172:0/2110469974 <== mon.0 v2:172.21.15.39:3300/0 7 ==== mon_command_ack([{"prefix": "mon dump", "format": "json"}]=0 dumped monmap epoch 3 v3) ==== 95+0+1279 (secure 0 0 0) 0x7fa470011db0 con 0x7fa4801986a0 2024-09-12T02:28:37.945 INFO:teuthology.orchestra.run.smithi172.stdout: 2024-09-12T02:28:37.945 INFO:teuthology.orchestra.run.smithi172.stdout:{"epoch":3,"fsid":"4954ed46-70ae-11ef-bcea-c7b262605968","modified":"2024-09-12T02:28:32.669501Z","created":"2024-09-12T02:26:39.333323Z","min_mon_release":19,"min_mon_release_name":"squid","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks: ":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"],"optional":[]},"mons":[{"rank":0,"name":"a","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:3300","nonce":0},{"type":"v1","addr":"172.21.15.39:6789","nonce":0}]},"addr":"172.21.15.39:6789/0","public_addr":"172.21.15.39:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":1,"name":"c","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:3300","nonce":0},{"type":"v1","addr":"172.21.15.172:6789","nonce":0}]},"addr":"172.21.15.172:6789/0","public_addr":"172.21.15.172:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":2,"name":"b","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:3300","nonce":0},{"type":"v1","addr":"172.21.15.44:6789","nonce":0}]},"addr":"172.21.15.44:6789/0","public_addr":"172.21.15.44:6789/0","priority":0,"weight":0,"crush_location":"{}"}],"quorum":[0,1]} 2024-09-12T02:28:37.945 INFO:teuthology.orchestra.run.smithi172.stderr:dumped monmap epoch 3 2024-09-12T02:28:37.945 INFO:teuthology.orchestra.run.smithi172.stderr:2024-09-12T02:28:37.943+0000 7fa4879f4640 1 -- 172.21.15.172:0/2110469974 >> [v2:172.21.15.39:6800/1725006999,v1:172.21.15.39:6801/1725006999] conn(0x7fa4640394f0 msgr2=0x7fa46403b9b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:28:37.946 INFO:teuthology.orchestra.run.smithi172.stderr:2024-09-12T02:28:37.943+0000 7fa4879f4640 1 --2- 172.21.15.172:0/2110469974 >> [v2:172.21.15.39:6800/1725006999,v1:172.21.15.39:6801/1725006999] conn(0x7fa4640394f0 0x7fa46403b9b0 secure :-1 s=READY pgs=37 cs=0 l=1 rev1=1 crypto rx=0x7fa47c005fd0 tx=0x7fa47c005f60 comp rx=0 tx=0).stop 2024-09-12T02:28:37.946 INFO:teuthology.orchestra.run.smithi172.stderr:2024-09-12T02:28:37.943+0000 7fa4879f4640 1 -- 172.21.15.172:0/2110469974 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fa4801986a0 msgr2=0x7fa480198b00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:28:37.946 INFO:teuthology.orchestra.run.smithi172.stderr:2024-09-12T02:28:37.943+0000 7fa4879f4640 1 --2- 172.21.15.172:0/2110469974 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fa4801986a0 0x7fa480198b00 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0x7fa47000b450 tx=0x7fa47000b910 comp rx=0 tx=0).stop 2024-09-12T02:28:37.946 INFO:teuthology.orchestra.run.smithi172.stderr:2024-09-12T02:28:37.943+0000 7fa4879f4640 1 -- 172.21.15.172:0/2110469974 shutdown_connections 2024-09-12T02:28:37.946 INFO:teuthology.orchestra.run.smithi172.stderr:2024-09-12T02:28:37.943+0000 7fa4879f4640 1 --2- 172.21.15.172:0/2110469974 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fa4801a11d0 0x7fa4801a35c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:28:37.946 INFO:teuthology.orchestra.run.smithi172.stderr:2024-09-12T02:28:37.943+0000 7fa4879f4640 1 --2- 172.21.15.172:0/2110469974 >> [v2:172.21.15.39:6800/1725006999,v1:172.21.15.39:6801/1725006999] conn(0x7fa4640394f0 0x7fa46403b9b0 unknown :-1 s=CLOSED pgs=37 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:28:37.946 INFO:teuthology.orchestra.run.smithi172.stderr:2024-09-12T02:28:37.943+0000 7fa4879f4640 1 --2- 172.21.15.172:0/2110469974 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fa4801986a0 0x7fa480198b00 unknown :-1 s=CLOSED pgs=105 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:28:37.946 INFO:teuthology.orchestra.run.smithi172.stderr:2024-09-12T02:28:37.943+0000 7fa4879f4640 1 --2- 172.21.15.172:0/2110469974 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fa46c003530 0x7fa480198160 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:28:37.946 INFO:teuthology.orchestra.run.smithi172.stderr:2024-09-12T02:28:37.943+0000 7fa4879f4640 1 -- 172.21.15.172:0/2110469974 >> 172.21.15.172:0/2110469974 conn(0x7fa4800fc220 msgr2=0x7fa4800fe080 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:28:37.946 INFO:teuthology.orchestra.run.smithi172.stderr:2024-09-12T02:28:37.943+0000 7fa4879f4640 1 -- 172.21.15.172:0/2110469974 shutdown_connections 2024-09-12T02:28:37.946 INFO:teuthology.orchestra.run.smithi172.stderr:2024-09-12T02:28:37.943+0000 7fa4879f4640 1 -- 172.21.15.172:0/2110469974 wait complete. 2024-09-12T02:28:38.100 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 02:28:37 smithi039 ceph-mon[30515]: from='mgr.14150 172.21.15.39:0/408627207' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2024-09-12T02:28:38.100 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 02:28:37 smithi039 ceph-mon[30515]: mon.a calling monitor election 2024-09-12T02:28:38.100 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 02:28:37 smithi039 ceph-mon[30515]: mon.c calling monitor election 2024-09-12T02:28:38.100 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 02:28:37 smithi039 ceph-mon[30515]: from='mgr.14150 172.21.15.39:0/408627207' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-09-12T02:28:38.100 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 02:28:37 smithi039 ceph-mon[30515]: from='mgr.14150 172.21.15.39:0/408627207' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-09-12T02:28:38.100 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 02:28:37 smithi039 ceph-mon[30515]: pgmap v18: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-12T02:28:38.100 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 02:28:37 smithi039 ceph-mon[30515]: from='mgr.14150 172.21.15.39:0/408627207' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-09-12T02:28:38.101 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 02:28:37 smithi039 ceph-mon[30515]: from='mgr.14150 172.21.15.39:0/408627207' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-09-12T02:28:38.101 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 02:28:37 smithi039 ceph-mon[30515]: pgmap v19: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-12T02:28:38.101 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 02:28:37 smithi039 ceph-mon[30515]: from='mgr.14150 172.21.15.39:0/408627207' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-09-12T02:28:38.101 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 02:28:37 smithi039 ceph-mon[30515]: from='mgr.14150 172.21.15.39:0/408627207' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-09-12T02:28:38.101 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 02:28:37 smithi039 ceph-mon[30515]: pgmap v20: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-12T02:28:38.101 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 02:28:37 smithi039 ceph-mon[30515]: from='mgr.14150 172.21.15.39:0/408627207' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-09-12T02:28:38.101 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 02:28:37 smithi039 ceph-mon[30515]: mon.a is new leader, mons a,c in quorum (ranks 0,1) 2024-09-12T02:28:38.101 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 02:28:37 smithi039 ceph-mon[30515]: monmap epoch 3 2024-09-12T02:28:38.101 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 02:28:37 smithi039 ceph-mon[30515]: fsid 4954ed46-70ae-11ef-bcea-c7b262605968 2024-09-12T02:28:38.101 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 02:28:37 smithi039 ceph-mon[30515]: last_changed 2024-09-12T02:28:32.669501+0000 2024-09-12T02:28:38.101 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 02:28:37 smithi039 ceph-mon[30515]: created 2024-09-12T02:26:39.333323+0000 2024-09-12T02:28:38.101 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 02:28:37 smithi039 ceph-mon[30515]: min_mon_release 19 (squid) 2024-09-12T02:28:38.102 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 02:28:37 smithi039 ceph-mon[30515]: election_strategy: 1 2024-09-12T02:28:38.102 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 02:28:37 smithi039 ceph-mon[30515]: 0: [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] mon.a 2024-09-12T02:28:38.102 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 02:28:37 smithi039 ceph-mon[30515]: 1: [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] mon.c 2024-09-12T02:28:38.102 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 02:28:37 smithi039 ceph-mon[30515]: 2: [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] mon.b 2024-09-12T02:28:38.102 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 02:28:37 smithi039 ceph-mon[30515]: fsmap 2024-09-12T02:28:38.102 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 02:28:37 smithi039 ceph-mon[30515]: osdmap e4: 0 total, 0 up, 0 in 2024-09-12T02:28:38.102 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 02:28:37 smithi039 ceph-mon[30515]: mgrmap e13: x(active, since 52s) 2024-09-12T02:28:38.102 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 02:28:37 smithi039 ceph-mon[30515]: overall HEALTH_OK 2024-09-12T02:28:38.102 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 02:28:37 smithi039 ceph-mon[30515]: from='mgr.14150 172.21.15.39:0/408627207' entity='mgr.x' 2024-09-12T02:28:38.102 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 02:28:37 smithi039 ceph-mon[30515]: from='mgr.14150 172.21.15.39:0/408627207' entity='mgr.x' 2024-09-12T02:28:38.102 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 02:28:37 smithi039 ceph-mon[30515]: from='mgr.14150 172.21.15.39:0/408627207' entity='mgr.x' 2024-09-12T02:28:38.102 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 02:28:37 smithi039 ceph-mon[30515]: from='mgr.14150 172.21.15.39:0/408627207' entity='mgr.x' 2024-09-12T02:28:38.555 INFO:tasks.cephadm:Generating final ceph.conf file... 2024-09-12T02:28:38.556 DEBUG:teuthology.orchestra.run.smithi039:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 4954ed46-70ae-11ef-bcea-c7b262605968 -- ceph config generate-minimal-conf 2024-09-12T02:28:38.847 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 12 02:28:38 smithi172 ceph-mon[35609]: from='mgr.14150 172.21.15.39:0/408627207' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-12T02:28:38.847 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 12 02:28:38 smithi172 ceph-mon[35609]: from='client.? 172.21.15.172:0/2110469974' entity='client.admin' cmd=[{"prefix": "mon dump", "format": "json"}]: dispatch 2024-09-12T02:28:38.847 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 12 02:28:38 smithi172 ceph-mon[35609]: from='mgr.14150 172.21.15.39:0/408627207' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-09-12T02:28:38.937 INFO:teuthology.orchestra.run.smithi039.stderr:Inferring config /var/lib/ceph/4954ed46-70ae-11ef-bcea-c7b262605968/mon.a/config 2024-09-12T02:28:39.076 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 02:28:38 smithi039 ceph-mon[30515]: from='mgr.14150 172.21.15.39:0/408627207' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-12T02:28:39.076 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 02:28:38 smithi039 ceph-mon[30515]: from='client.? 172.21.15.172:0/2110469974' entity='client.admin' cmd=[{"prefix": "mon dump", "format": "json"}]: dispatch 2024-09-12T02:28:39.076 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 02:28:38 smithi039 ceph-mon[30515]: from='mgr.14150 172.21.15.39:0/408627207' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-09-12T02:28:39.500 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:28:39.498+0000 7f9c3e400640 1 -- 172.21.15.39:0/1878297224 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f9c38102560 msgr2=0x7f9c38102940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:28:39.500 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:28:39.498+0000 7f9c3e400640 1 --2- 172.21.15.39:0/1878297224 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f9c38102560 0x7f9c38102940 secure :-1 s=READY pgs=106 cs=0 l=1 rev1=1 crypto rx=0x7f9c2c009880 tx=0x7f9c2c02a670 comp rx=0 tx=0).stop 2024-09-12T02:28:39.500 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:28:39.498+0000 7f9c3e400640 1 -- 172.21.15.39:0/1878297224 shutdown_connections 2024-09-12T02:28:39.500 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:28:39.498+0000 7f9c3e400640 1 --2- 172.21.15.39:0/1878297224 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f9c38102560 0x7f9c38102940 unknown :-1 s=CLOSED pgs=106 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:28:39.500 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:28:39.498+0000 7f9c3e400640 1 -- 172.21.15.39:0/1878297224 >> 172.21.15.39:0/1878297224 conn(0x7f9c38077170 msgr2=0x7f9c380fe480 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:28:39.500 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:28:39.498+0000 7f9c3e400640 1 -- 172.21.15.39:0/1878297224 shutdown_connections 2024-09-12T02:28:39.501 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:28:39.498+0000 7f9c3e400640 1 -- 172.21.15.39:0/1878297224 wait complete. 2024-09-12T02:28:39.501 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:28:39.499+0000 7f9c3e400640 1 Processor -- start 2024-09-12T02:28:39.501 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:28:39.499+0000 7f9c3e400640 1 -- start start 2024-09-12T02:28:39.502 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:28:39.500+0000 7f9c3e400640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f9c38102560 0x7f9c381994a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:28:39.503 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:28:39.500+0000 7f9c3e400640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f9c381999e0 0x7f9c3819dd70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:28:39.503 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:28:39.500+0000 7f9c3e400640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f9c3819e2b0 0x7f9c3819e760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:28:39.503 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:28:39.500+0000 7f9c3e400640 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 -- 0x7f9c3810bad0 con 0x7f9c381999e0 2024-09-12T02:28:39.503 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:28:39.500+0000 7f9c3e400640 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x7f9c3810b950 con 0x7f9c3819e2b0 2024-09-12T02:28:39.503 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:28:39.500+0000 7f9c3e400640 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7f9c3810bc50 con 0x7f9c38102560 2024-09-12T02:28:39.503 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:28:39.500+0000 7f9c37e00640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f9c381999e0 0x7f9c3819dd70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:28:39.503 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:28:39.500+0000 7f9c3da00640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f9c3819e2b0 0x7f9c3819e760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:28:39.503 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:28:39.500+0000 7f9c3d000640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f9c38102560 0x7f9c381994a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:28:39.503 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:28:39.500+0000 7f9c3d000640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f9c38102560 0x7f9c381994a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.172:3300/0 says I am v2:172.21.15.39:57998/0 (socket says 172.21.15.39:57998) 2024-09-12T02:28:39.503 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:28:39.500+0000 7f9c3d000640 1 -- 172.21.15.39:0/1256115946 learned_addr learned my addr 172.21.15.39:0/1256115946 (peer_addr_for_me v2:172.21.15.39:0/0) 2024-09-12T02:28:39.503 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:28:39.501+0000 7f9c3da00640 1 -- 172.21.15.39:0/1256115946 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f9c3819e2b0 msgr2=0x7f9c3819e760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_bulk peer close file descriptor 14 2024-09-12T02:28:39.503 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:28:39.501+0000 7f9c3da00640 1 -- 172.21.15.39:0/1256115946 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f9c3819e2b0 msgr2=0x7f9c3819e760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until read failed 2024-09-12T02:28:39.504 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:28:39.501+0000 7f9c3da00640 1 --2- 172.21.15.39:0/1256115946 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f9c3819e2b0 0x7f9c3819e760 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-09-12T02:28:39.504 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:28:39.501+0000 7f9c3da00640 1 --2- 172.21.15.39:0/1256115946 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f9c3819e2b0 0x7f9c3819e760 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-09-12T02:28:39.504 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:28:39.501+0000 7f9c3d000640 1 -- 172.21.15.39:0/1256115946 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f9c3819e2b0 msgr2=0x7f9c3819e760 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-09-12T02:28:39.504 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:28:39.501+0000 7f9c3d000640 1 --2- 172.21.15.39:0/1256115946 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f9c3819e2b0 0x7f9c3819e760 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:28:39.504 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:28:39.501+0000 7f9c3d000640 1 -- 172.21.15.39:0/1256115946 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f9c381999e0 msgr2=0x7f9c3819dd70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:28:39.504 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:28:39.501+0000 7f9c3d000640 1 --2- 172.21.15.39:0/1256115946 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f9c381999e0 0x7f9c3819dd70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:28:39.504 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:28:39.501+0000 7f9c3d000640 1 -- 172.21.15.39:0/1256115946 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9c381a6020 con 0x7f9c38102560 2024-09-12T02:28:39.504 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:28:39.501+0000 7f9c37e00640 1 --2- 172.21.15.39:0/1256115946 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f9c381999e0 0x7f9c3819dd70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-12T02:28:39.504 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:28:39.501+0000 7f9c3d000640 1 --2- 172.21.15.39:0/1256115946 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f9c38102560 0x7f9c381994a0 secure :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0x7f9c2c006010 tx=0x7f9c2c003c00 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:28:39.504 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:28:39.502+0000 7f9c35600640 1 -- 172.21.15.39:0/1256115946 <== mon.1 v2:172.21.15.172:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9c2c03f070 con 0x7f9c38102560 2024-09-12T02:28:39.504 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:28:39.502+0000 7f9c35600640 1 -- 172.21.15.39:0/1256115946 <== mon.1 v2:172.21.15.172:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f9c2c03b460 con 0x7f9c38102560 2024-09-12T02:28:39.504 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:28:39.502+0000 7f9c3e400640 1 -- 172.21.15.39:0/1256115946 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f9c381a61f0 con 0x7f9c38102560 2024-09-12T02:28:39.504 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:28:39.502+0000 7f9c35600640 1 -- 172.21.15.39:0/1256115946 <== mon.1 v2:172.21.15.172:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9c2c035030 con 0x7f9c38102560 2024-09-12T02:28:39.505 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:28:39.502+0000 7f9c3e400640 1 -- 172.21.15.39:0/1256115946 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f9c381a66f0 con 0x7f9c38102560 2024-09-12T02:28:39.505 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:28:39.503+0000 7f9c3e400640 1 -- 172.21.15.39:0/1256115946 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f9c381029c0 con 0x7f9c38102560 2024-09-12T02:28:39.506 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:28:39.503+0000 7f9c35600640 1 -- 172.21.15.39:0/1256115946 <== mon.1 v2:172.21.15.172:3300/0 4 ==== mgrmap(e 13) ==== 46343+0+0 (secure 0 0 0) 0x7f9c2c042070 con 0x7f9c38102560 2024-09-12T02:28:39.506 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:28:39.503+0000 7f9c35600640 1 --2- 172.21.15.39:0/1256115946 >> [v2:172.21.15.39:6800/1725006999,v1:172.21.15.39:6801/1725006999] conn(0x7f9c200394f0 0x7f9c2003b9b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:28:39.506 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:28:39.504+0000 7f9c35600640 1 -- 172.21.15.39:0/1256115946 <== mon.1 v2:172.21.15.172:3300/0 5 ==== osd_map(4..4 src has 1..4) ==== 1155+0+0 (secure 0 0 0) 0x7f9c2c06c9c0 con 0x7f9c38102560 2024-09-12T02:28:39.506 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:28:39.504+0000 7f9c37e00640 1 --2- 172.21.15.39:0/1256115946 >> [v2:172.21.15.39:6800/1725006999,v1:172.21.15.39:6801/1725006999] conn(0x7f9c200394f0 0x7f9c2003b9b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:28:39.506 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:28:39.505+0000 7f9c37e00640 1 --2- 172.21.15.39:0/1256115946 >> [v2:172.21.15.39:6800/1725006999,v1:172.21.15.39:6801/1725006999] conn(0x7f9c200394f0 0x7f9c2003b9b0 secure :-1 s=READY pgs=39 cs=0 l=1 rev1=1 crypto rx=0x7f9c24009e20 tx=0x7f9c24009190 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:28:39.509 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:28:39.509+0000 7f9c35600640 1 -- 172.21.15.39:0/1256115946 <== mon.1 v2:172.21.15.172:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7f9c2c042c60 con 0x7f9c38102560 2024-09-12T02:28:39.704 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:28:39.703+0000 7f9c3e400640 1 -- 172.21.15.39:0/1256115946 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_command({"prefix": "config generate-minimal-conf"} v 0) -- 0x7f9c381930f0 con 0x7f9c38102560 2024-09-12T02:28:39.705 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:28:39.704+0000 7f9c35600640 1 -- 172.21.15.39:0/1256115946 <== mon.1 v2:172.21.15.172:3300/0 7 ==== mon_command_ack([{"prefix": "config generate-minimal-conf"}]=0 v9) ==== 76+0+273 (secure 0 0 0) 0x7f9c2c03b9a0 con 0x7f9c38102560 2024-09-12T02:28:39.705 INFO:teuthology.orchestra.run.smithi039.stdout:# minimal ceph.conf for 4954ed46-70ae-11ef-bcea-c7b262605968 2024-09-12T02:28:39.705 INFO:teuthology.orchestra.run.smithi039.stdout:[global] 2024-09-12T02:28:39.705 INFO:teuthology.orchestra.run.smithi039.stdout: fsid = 4954ed46-70ae-11ef-bcea-c7b262605968 2024-09-12T02:28:39.705 INFO:teuthology.orchestra.run.smithi039.stdout: mon_host = [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] 2024-09-12T02:28:39.707 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:28:39.706+0000 7f9c3e400640 1 -- 172.21.15.39:0/1256115946 >> [v2:172.21.15.39:6800/1725006999,v1:172.21.15.39:6801/1725006999] conn(0x7f9c200394f0 msgr2=0x7f9c2003b9b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:28:39.708 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:28:39.706+0000 7f9c3e400640 1 --2- 172.21.15.39:0/1256115946 >> [v2:172.21.15.39:6800/1725006999,v1:172.21.15.39:6801/1725006999] conn(0x7f9c200394f0 0x7f9c2003b9b0 secure :-1 s=READY pgs=39 cs=0 l=1 rev1=1 crypto rx=0x7f9c24009e20 tx=0x7f9c24009190 comp rx=0 tx=0).stop 2024-09-12T02:28:39.708 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:28:39.706+0000 7f9c3e400640 1 -- 172.21.15.39:0/1256115946 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f9c38102560 msgr2=0x7f9c381994a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:28:39.708 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:28:39.706+0000 7f9c3e400640 1 --2- 172.21.15.39:0/1256115946 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f9c38102560 0x7f9c381994a0 secure :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0x7f9c2c006010 tx=0x7f9c2c003c00 comp rx=0 tx=0).stop 2024-09-12T02:28:39.708 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:28:39.706+0000 7f9c3e400640 1 -- 172.21.15.39:0/1256115946 shutdown_connections 2024-09-12T02:28:39.708 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:28:39.706+0000 7f9c3e400640 1 --2- 172.21.15.39:0/1256115946 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f9c3819e2b0 0x7f9c3819e760 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:28:39.708 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:28:39.706+0000 7f9c3e400640 1 --2- 172.21.15.39:0/1256115946 >> [v2:172.21.15.39:6800/1725006999,v1:172.21.15.39:6801/1725006999] conn(0x7f9c200394f0 0x7f9c2003b9b0 unknown :-1 s=CLOSED pgs=39 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:28:39.708 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:28:39.706+0000 7f9c3e400640 1 --2- 172.21.15.39:0/1256115946 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f9c381999e0 0x7f9c3819dd70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:28:39.708 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:28:39.706+0000 7f9c3e400640 1 --2- 172.21.15.39:0/1256115946 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f9c38102560 0x7f9c381994a0 unknown :-1 s=CLOSED pgs=7 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:28:39.708 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:28:39.706+0000 7f9c3e400640 1 -- 172.21.15.39:0/1256115946 >> 172.21.15.39:0/1256115946 conn(0x7f9c38077170 msgr2=0x7f9c381085e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:28:39.708 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:28:39.707+0000 7f9c3e400640 1 -- 172.21.15.39:0/1256115946 shutdown_connections 2024-09-12T02:28:39.708 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:28:39.707+0000 7f9c3e400640 1 -- 172.21.15.39:0/1256115946 wait complete. 2024-09-12T02:28:39.949 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 12 02:28:39 smithi044 ceph-mon[35411]: from='mgr.14150 172.21.15.39:0/408627207' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2024-09-12T02:28:39.949 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 12 02:28:39 smithi044 ceph-mon[35411]: mon.a calling monitor election 2024-09-12T02:28:39.949 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 12 02:28:39 smithi044 ceph-mon[35411]: mon.c calling monitor election 2024-09-12T02:28:39.949 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 12 02:28:39 smithi044 ceph-mon[35411]: from='mgr.14150 172.21.15.39:0/408627207' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-09-12T02:28:39.949 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 12 02:28:39 smithi044 ceph-mon[35411]: from='mgr.14150 172.21.15.39:0/408627207' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-09-12T02:28:39.949 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 12 02:28:39 smithi044 ceph-mon[35411]: pgmap v18: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-12T02:28:39.949 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 12 02:28:39 smithi044 ceph-mon[35411]: from='mgr.14150 172.21.15.39:0/408627207' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-09-12T02:28:39.949 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 12 02:28:39 smithi044 ceph-mon[35411]: from='mgr.14150 172.21.15.39:0/408627207' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-09-12T02:28:39.950 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 12 02:28:39 smithi044 ceph-mon[35411]: pgmap v19: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-12T02:28:39.950 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 12 02:28:39 smithi044 ceph-mon[35411]: from='mgr.14150 172.21.15.39:0/408627207' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-09-12T02:28:39.950 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 12 02:28:39 smithi044 ceph-mon[35411]: from='mgr.14150 172.21.15.39:0/408627207' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-09-12T02:28:39.950 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 12 02:28:39 smithi044 ceph-mon[35411]: pgmap v20: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-12T02:28:39.950 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 12 02:28:39 smithi044 ceph-mon[35411]: from='mgr.14150 172.21.15.39:0/408627207' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-09-12T02:28:39.950 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 12 02:28:39 smithi044 ceph-mon[35411]: mon.a is new leader, mons a,c in quorum (ranks 0,1) 2024-09-12T02:28:39.950 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 12 02:28:39 smithi044 ceph-mon[35411]: monmap epoch 3 2024-09-12T02:28:39.950 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 12 02:28:39 smithi044 ceph-mon[35411]: fsid 4954ed46-70ae-11ef-bcea-c7b262605968 2024-09-12T02:28:39.950 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 12 02:28:39 smithi044 ceph-mon[35411]: last_changed 2024-09-12T02:28:32.669501+0000 2024-09-12T02:28:39.950 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 12 02:28:39 smithi044 ceph-mon[35411]: created 2024-09-12T02:26:39.333323+0000 2024-09-12T02:28:39.950 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 12 02:28:39 smithi044 ceph-mon[35411]: min_mon_release 19 (squid) 2024-09-12T02:28:39.950 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 12 02:28:39 smithi044 ceph-mon[35411]: election_strategy: 1 2024-09-12T02:28:39.950 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 12 02:28:39 smithi044 ceph-mon[35411]: 0: [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] mon.a 2024-09-12T02:28:39.950 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 12 02:28:39 smithi044 ceph-mon[35411]: 1: [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] mon.c 2024-09-12T02:28:39.950 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 12 02:28:39 smithi044 ceph-mon[35411]: 2: [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] mon.b 2024-09-12T02:28:39.951 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 12 02:28:39 smithi044 ceph-mon[35411]: fsmap 2024-09-12T02:28:39.951 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 12 02:28:39 smithi044 ceph-mon[35411]: osdmap e4: 0 total, 0 up, 0 in 2024-09-12T02:28:39.951 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 12 02:28:39 smithi044 ceph-mon[35411]: mgrmap e13: x(active, since 52s) 2024-09-12T02:28:39.951 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 12 02:28:39 smithi044 ceph-mon[35411]: overall HEALTH_OK 2024-09-12T02:28:39.951 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 12 02:28:39 smithi044 ceph-mon[35411]: from='mgr.14150 172.21.15.39:0/408627207' entity='mgr.x' 2024-09-12T02:28:39.951 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 12 02:28:39 smithi044 ceph-mon[35411]: from='mgr.14150 172.21.15.39:0/408627207' entity='mgr.x' 2024-09-12T02:28:39.951 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 12 02:28:39 smithi044 ceph-mon[35411]: from='mgr.14150 172.21.15.39:0/408627207' entity='mgr.x' 2024-09-12T02:28:39.951 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 12 02:28:39 smithi044 ceph-mon[35411]: from='mgr.14150 172.21.15.39:0/408627207' entity='mgr.x' 2024-09-12T02:28:39.951 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 12 02:28:39 smithi044 ceph-mon[35411]: from='mgr.14150 172.21.15.39:0/408627207' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-12T02:28:39.951 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 12 02:28:39 smithi044 ceph-mon[35411]: from='client.? 172.21.15.172:0/2110469974' entity='client.admin' cmd=[{"prefix": "mon dump", "format": "json"}]: dispatch 2024-09-12T02:28:39.951 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 12 02:28:39 smithi044 ceph-mon[35411]: from='mgr.14150 172.21.15.39:0/408627207' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-09-12T02:28:40.350 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 02:28:40 smithi039 ceph-mon[30515]: mon.b calling monitor election 2024-09-12T02:28:40.350 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 02:28:40 smithi039 ceph-mon[30515]: pgmap v21: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-12T02:28:40.350 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 02:28:40 smithi039 ceph-mon[30515]: Updating smithi039:/etc/ceph/ceph.conf 2024-09-12T02:28:40.350 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 02:28:40 smithi039 ceph-mon[30515]: Updating smithi044:/etc/ceph/ceph.conf 2024-09-12T02:28:40.350 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 02:28:40 smithi039 ceph-mon[30515]: Updating smithi172:/etc/ceph/ceph.conf 2024-09-12T02:28:40.350 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 02:28:40 smithi039 ceph-mon[30515]: Updating smithi172:/var/lib/ceph/4954ed46-70ae-11ef-bcea-c7b262605968/config/ceph.conf 2024-09-12T02:28:40.350 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 02:28:40 smithi039 ceph-mon[30515]: Updating smithi044:/var/lib/ceph/4954ed46-70ae-11ef-bcea-c7b262605968/config/ceph.conf 2024-09-12T02:28:40.350 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 02:28:40 smithi039 ceph-mon[30515]: mon.b calling monitor election 2024-09-12T02:28:40.350 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 02:28:40 smithi039 ceph-mon[30515]: mon.c calling monitor election 2024-09-12T02:28:40.350 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 02:28:40 smithi039 ceph-mon[30515]: mon.a calling monitor election 2024-09-12T02:28:40.351 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 02:28:40 smithi039 ceph-mon[30515]: mon.a is new leader, mons a,c,b in quorum (ranks 0,1,2) 2024-09-12T02:28:40.351 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 02:28:40 smithi039 ceph-mon[30515]: monmap epoch 3 2024-09-12T02:28:40.351 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 02:28:40 smithi039 ceph-mon[30515]: fsid 4954ed46-70ae-11ef-bcea-c7b262605968 2024-09-12T02:28:40.351 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 02:28:40 smithi039 ceph-mon[30515]: last_changed 2024-09-12T02:28:32.669501+0000 2024-09-12T02:28:40.351 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 02:28:40 smithi039 ceph-mon[30515]: created 2024-09-12T02:26:39.333323+0000 2024-09-12T02:28:40.351 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 02:28:40 smithi039 ceph-mon[30515]: min_mon_release 19 (squid) 2024-09-12T02:28:40.351 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 02:28:40 smithi039 ceph-mon[30515]: election_strategy: 1 2024-09-12T02:28:40.351 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 02:28:40 smithi039 ceph-mon[30515]: 0: [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] mon.a 2024-09-12T02:28:40.351 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 02:28:40 smithi039 ceph-mon[30515]: 1: [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] mon.c 2024-09-12T02:28:40.351 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 02:28:40 smithi039 ceph-mon[30515]: 2: [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] mon.b 2024-09-12T02:28:40.351 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 02:28:40 smithi039 ceph-mon[30515]: fsmap 2024-09-12T02:28:40.351 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 02:28:40 smithi039 ceph-mon[30515]: osdmap e4: 0 total, 0 up, 0 in 2024-09-12T02:28:40.352 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 02:28:40 smithi039 ceph-mon[30515]: mgrmap e13: x(active, since 54s) 2024-09-12T02:28:40.352 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 02:28:40 smithi039 ceph-mon[30515]: overall HEALTH_OK 2024-09-12T02:28:40.352 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 02:28:40 smithi039 ceph-mon[30515]: from='client.? 172.21.15.39:0/1256115946' entity='client.admin' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-12T02:28:40.352 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 02:28:40 smithi039 ceph-mon[30515]: from='mgr.14150 172.21.15.39:0/408627207' entity='mgr.x' 2024-09-12T02:28:40.352 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 02:28:40 smithi039 ceph-mon[30515]: from='mgr.14150 172.21.15.39:0/408627207' entity='mgr.x' 2024-09-12T02:28:40.352 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 02:28:40 smithi039 ceph-mon[30515]: from='mgr.14150 172.21.15.39:0/408627207' entity='mgr.x' 2024-09-12T02:28:40.352 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 02:28:40 smithi039 ceph-mon[30515]: from='mgr.14150 172.21.15.39:0/408627207' entity='mgr.x' 2024-09-12T02:28:40.352 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 02:28:40 smithi039 ceph-mon[30515]: from='mgr.14150 172.21.15.39:0/408627207' entity='mgr.x' 2024-09-12T02:28:40.483 INFO:tasks.cephadm:Distributing (final) config and client.admin keyring... 2024-09-12T02:28:40.483 DEBUG:teuthology.orchestra.run.smithi039:> set -ex 2024-09-12T02:28:40.483 DEBUG:teuthology.orchestra.run.smithi039:> sudo dd of=/etc/ceph/ceph.conf 2024-09-12T02:28:40.544 DEBUG:teuthology.orchestra.run.smithi039:> set -ex 2024-09-12T02:28:40.544 DEBUG:teuthology.orchestra.run.smithi039:> sudo dd of=/etc/ceph/ceph.client.admin.keyring 2024-09-12T02:28:40.640 DEBUG:teuthology.orchestra.run.smithi044:> set -ex 2024-09-12T02:28:40.640 DEBUG:teuthology.orchestra.run.smithi044:> sudo dd of=/etc/ceph/ceph.conf 2024-09-12T02:28:40.665 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 12 02:28:40 smithi044 ceph-mon[35411]: mon.b calling monitor election 2024-09-12T02:28:40.665 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 12 02:28:40 smithi044 ceph-mon[35411]: pgmap v21: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-12T02:28:40.665 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 12 02:28:40 smithi044 ceph-mon[35411]: Updating smithi039:/etc/ceph/ceph.conf 2024-09-12T02:28:40.665 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 12 02:28:40 smithi044 ceph-mon[35411]: Updating smithi044:/etc/ceph/ceph.conf 2024-09-12T02:28:40.666 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 12 02:28:40 smithi044 ceph-mon[35411]: Updating smithi172:/etc/ceph/ceph.conf 2024-09-12T02:28:40.666 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 12 02:28:40 smithi044 ceph-mon[35411]: Updating smithi172:/var/lib/ceph/4954ed46-70ae-11ef-bcea-c7b262605968/config/ceph.conf 2024-09-12T02:28:40.666 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 12 02:28:40 smithi044 ceph-mon[35411]: Updating smithi044:/var/lib/ceph/4954ed46-70ae-11ef-bcea-c7b262605968/config/ceph.conf 2024-09-12T02:28:40.666 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 12 02:28:40 smithi044 ceph-mon[35411]: mon.b calling monitor election 2024-09-12T02:28:40.666 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 12 02:28:40 smithi044 ceph-mon[35411]: mon.c calling monitor election 2024-09-12T02:28:40.666 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 12 02:28:40 smithi044 ceph-mon[35411]: mon.a calling monitor election 2024-09-12T02:28:40.666 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 12 02:28:40 smithi044 ceph-mon[35411]: mon.a is new leader, mons a,c,b in quorum (ranks 0,1,2) 2024-09-12T02:28:40.666 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 12 02:28:40 smithi044 ceph-mon[35411]: monmap epoch 3 2024-09-12T02:28:40.666 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 12 02:28:40 smithi044 ceph-mon[35411]: fsid 4954ed46-70ae-11ef-bcea-c7b262605968 2024-09-12T02:28:40.666 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 12 02:28:40 smithi044 ceph-mon[35411]: last_changed 2024-09-12T02:28:32.669501+0000 2024-09-12T02:28:40.666 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 12 02:28:40 smithi044 ceph-mon[35411]: created 2024-09-12T02:26:39.333323+0000 2024-09-12T02:28:40.666 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 12 02:28:40 smithi044 ceph-mon[35411]: min_mon_release 19 (squid) 2024-09-12T02:28:40.666 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 12 02:28:40 smithi044 ceph-mon[35411]: election_strategy: 1 2024-09-12T02:28:40.666 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 12 02:28:40 smithi044 ceph-mon[35411]: 0: [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] mon.a 2024-09-12T02:28:40.667 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 12 02:28:40 smithi044 ceph-mon[35411]: 1: [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] mon.c 2024-09-12T02:28:40.667 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 12 02:28:40 smithi044 ceph-mon[35411]: 2: [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] mon.b 2024-09-12T02:28:40.667 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 12 02:28:40 smithi044 ceph-mon[35411]: fsmap 2024-09-12T02:28:40.667 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 12 02:28:40 smithi044 ceph-mon[35411]: osdmap e4: 0 total, 0 up, 0 in 2024-09-12T02:28:40.667 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 12 02:28:40 smithi044 ceph-mon[35411]: mgrmap e13: x(active, since 54s) 2024-09-12T02:28:40.667 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 12 02:28:40 smithi044 ceph-mon[35411]: overall HEALTH_OK 2024-09-12T02:28:40.667 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 12 02:28:40 smithi044 ceph-mon[35411]: from='client.? 172.21.15.39:0/1256115946' entity='client.admin' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-12T02:28:40.667 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 12 02:28:40 smithi044 ceph-mon[35411]: from='mgr.14150 172.21.15.39:0/408627207' entity='mgr.x' 2024-09-12T02:28:40.667 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 12 02:28:40 smithi044 ceph-mon[35411]: from='mgr.14150 172.21.15.39:0/408627207' entity='mgr.x' 2024-09-12T02:28:40.667 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 12 02:28:40 smithi044 ceph-mon[35411]: from='mgr.14150 172.21.15.39:0/408627207' entity='mgr.x' 2024-09-12T02:28:40.667 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 12 02:28:40 smithi044 ceph-mon[35411]: from='mgr.14150 172.21.15.39:0/408627207' entity='mgr.x' 2024-09-12T02:28:40.667 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 12 02:28:40 smithi044 ceph-mon[35411]: from='mgr.14150 172.21.15.39:0/408627207' entity='mgr.x' 2024-09-12T02:28:40.671 DEBUG:teuthology.orchestra.run.smithi044:> set -ex 2024-09-12T02:28:40.671 DEBUG:teuthology.orchestra.run.smithi044:> sudo dd of=/etc/ceph/ceph.client.admin.keyring 2024-09-12T02:28:40.737 DEBUG:teuthology.orchestra.run.smithi172:> set -ex 2024-09-12T02:28:40.737 DEBUG:teuthology.orchestra.run.smithi172:> sudo dd of=/etc/ceph/ceph.conf 2024-09-12T02:28:40.762 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 12 02:28:40 smithi172 ceph-mon[35609]: mon.b calling monitor election 2024-09-12T02:28:40.762 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 12 02:28:40 smithi172 ceph-mon[35609]: pgmap v21: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-12T02:28:40.762 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 12 02:28:40 smithi172 ceph-mon[35609]: Updating smithi039:/etc/ceph/ceph.conf 2024-09-12T02:28:40.762 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 12 02:28:40 smithi172 ceph-mon[35609]: Updating smithi044:/etc/ceph/ceph.conf 2024-09-12T02:28:40.763 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 12 02:28:40 smithi172 ceph-mon[35609]: Updating smithi172:/etc/ceph/ceph.conf 2024-09-12T02:28:40.763 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 12 02:28:40 smithi172 ceph-mon[35609]: Updating smithi172:/var/lib/ceph/4954ed46-70ae-11ef-bcea-c7b262605968/config/ceph.conf 2024-09-12T02:28:40.763 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 12 02:28:40 smithi172 ceph-mon[35609]: Updating smithi044:/var/lib/ceph/4954ed46-70ae-11ef-bcea-c7b262605968/config/ceph.conf 2024-09-12T02:28:40.763 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 12 02:28:40 smithi172 ceph-mon[35609]: mon.b calling monitor election 2024-09-12T02:28:40.763 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 12 02:28:40 smithi172 ceph-mon[35609]: mon.c calling monitor election 2024-09-12T02:28:40.763 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 12 02:28:40 smithi172 ceph-mon[35609]: mon.a calling monitor election 2024-09-12T02:28:40.763 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 12 02:28:40 smithi172 ceph-mon[35609]: mon.a is new leader, mons a,c,b in quorum (ranks 0,1,2) 2024-09-12T02:28:40.763 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 12 02:28:40 smithi172 ceph-mon[35609]: monmap epoch 3 2024-09-12T02:28:40.763 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 12 02:28:40 smithi172 ceph-mon[35609]: fsid 4954ed46-70ae-11ef-bcea-c7b262605968 2024-09-12T02:28:40.763 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 12 02:28:40 smithi172 ceph-mon[35609]: last_changed 2024-09-12T02:28:32.669501+0000 2024-09-12T02:28:40.763 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 12 02:28:40 smithi172 ceph-mon[35609]: created 2024-09-12T02:26:39.333323+0000 2024-09-12T02:28:40.763 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 12 02:28:40 smithi172 ceph-mon[35609]: min_mon_release 19 (squid) 2024-09-12T02:28:40.763 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 12 02:28:40 smithi172 ceph-mon[35609]: election_strategy: 1 2024-09-12T02:28:40.763 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 12 02:28:40 smithi172 ceph-mon[35609]: 0: [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] mon.a 2024-09-12T02:28:40.764 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 12 02:28:40 smithi172 ceph-mon[35609]: 1: [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] mon.c 2024-09-12T02:28:40.764 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 12 02:28:40 smithi172 ceph-mon[35609]: 2: [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] mon.b 2024-09-12T02:28:40.764 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 12 02:28:40 smithi172 ceph-mon[35609]: fsmap 2024-09-12T02:28:40.764 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 12 02:28:40 smithi172 ceph-mon[35609]: osdmap e4: 0 total, 0 up, 0 in 2024-09-12T02:28:40.764 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 12 02:28:40 smithi172 ceph-mon[35609]: mgrmap e13: x(active, since 54s) 2024-09-12T02:28:40.764 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 12 02:28:40 smithi172 ceph-mon[35609]: overall HEALTH_OK 2024-09-12T02:28:40.764 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 12 02:28:40 smithi172 ceph-mon[35609]: from='client.? 172.21.15.39:0/1256115946' entity='client.admin' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-12T02:28:40.764 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 12 02:28:40 smithi172 ceph-mon[35609]: from='mgr.14150 172.21.15.39:0/408627207' entity='mgr.x' 2024-09-12T02:28:40.764 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 12 02:28:40 smithi172 ceph-mon[35609]: from='mgr.14150 172.21.15.39:0/408627207' entity='mgr.x' 2024-09-12T02:28:40.764 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 12 02:28:40 smithi172 ceph-mon[35609]: from='mgr.14150 172.21.15.39:0/408627207' entity='mgr.x' 2024-09-12T02:28:40.764 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 12 02:28:40 smithi172 ceph-mon[35609]: from='mgr.14150 172.21.15.39:0/408627207' entity='mgr.x' 2024-09-12T02:28:40.764 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 12 02:28:40 smithi172 ceph-mon[35609]: from='mgr.14150 172.21.15.39:0/408627207' entity='mgr.x' 2024-09-12T02:28:40.767 DEBUG:teuthology.orchestra.run.smithi172:> set -ex 2024-09-12T02:28:40.767 DEBUG:teuthology.orchestra.run.smithi172:> sudo dd of=/etc/ceph/ceph.client.admin.keyring 2024-09-12T02:28:40.834 INFO:tasks.cephadm:Adding mgr.x on smithi039 2024-09-12T02:28:40.834 INFO:tasks.cephadm:Adding mgr.y on smithi044 2024-09-12T02:28:40.834 INFO:tasks.cephadm:Adding mgr.z on smithi172 2024-09-12T02:28:40.834 DEBUG:teuthology.orchestra.run.smithi172:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 4954ed46-70ae-11ef-bcea-c7b262605968 -- ceph orch apply mgr '3;smithi039=x;smithi044=y;smithi172=z' 2024-09-12T02:28:41.115 INFO:teuthology.orchestra.run.smithi172.stderr:Inferring config /var/lib/ceph/4954ed46-70ae-11ef-bcea-c7b262605968/mon.c/config 2024-09-12T02:28:41.508 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 12 02:28:41 smithi172 ceph-mon[35609]: Updating smithi039:/var/lib/ceph/4954ed46-70ae-11ef-bcea-c7b262605968/config/ceph.conf 2024-09-12T02:28:41.508 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 12 02:28:41 smithi172 ceph-mon[35609]: from='mgr.14150 172.21.15.39:0/408627207' entity='mgr.x' 2024-09-12T02:28:41.508 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 12 02:28:41 smithi172 ceph-mon[35609]: from='mgr.14150 172.21.15.39:0/408627207' entity='mgr.x' 2024-09-12T02:28:41.508 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 12 02:28:41 smithi172 ceph-mon[35609]: from='mgr.14150 172.21.15.39:0/408627207' entity='mgr.x' 2024-09-12T02:28:41.508 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 12 02:28:41 smithi172 ceph-mon[35609]: from='mgr.14150 172.21.15.39:0/408627207' entity='mgr.x' 2024-09-12T02:28:41.508 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 12 02:28:41 smithi172 ceph-mon[35609]: from='mgr.14150 172.21.15.39:0/408627207' entity='mgr.x' 2024-09-12T02:28:41.509 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 12 02:28:41 smithi172 ceph-mon[35609]: from='mgr.14150 172.21.15.39:0/408627207' entity='mgr.x' 2024-09-12T02:28:41.509 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 12 02:28:41 smithi172 ceph-mon[35609]: from='mgr.14150 172.21.15.39:0/408627207' entity='mgr.x' 2024-09-12T02:28:41.509 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 12 02:28:41 smithi172 ceph-mon[35609]: Reconfiguring mon.a (unknown last config time)... 2024-09-12T02:28:41.509 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 12 02:28:41 smithi172 ceph-mon[35609]: from='mgr.14150 172.21.15.39:0/408627207' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2024-09-12T02:28:41.509 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 12 02:28:41 smithi172 ceph-mon[35609]: from='mgr.14150 172.21.15.39:0/408627207' entity='mgr.x' cmd=[{"prefix": "config get", "who": "mon", "key": "public_network"}]: dispatch 2024-09-12T02:28:41.509 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 12 02:28:41 smithi172 ceph-mon[35609]: from='mgr.14150 172.21.15.39:0/408627207' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-12T02:28:41.509 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 12 02:28:41 smithi172 ceph-mon[35609]: Reconfiguring daemon mon.a on smithi039 2024-09-12T02:28:41.509 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 12 02:28:41 smithi172 ceph-mon[35609]: from='mgr.14150 172.21.15.39:0/408627207' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-09-12T02:28:41.516 INFO:teuthology.orchestra.run.smithi172.stderr:2024-09-12T02:28:41.515+0000 7ff790ec8640 1 -- 172.21.15.172:0/1194459646 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7ff78c1016e0 msgr2=0x7ff78c101ae0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:28:41.516 INFO:teuthology.orchestra.run.smithi172.stderr:2024-09-12T02:28:41.515+0000 7ff790ec8640 1 --2- 172.21.15.172:0/1194459646 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7ff78c1016e0 0x7ff78c101ae0 secure :-1 s=READY pgs=107 cs=0 l=1 rev1=1 crypto rx=0x7ff77c009880 tx=0x7ff77c02a5d0 comp rx=0 tx=0).stop 2024-09-12T02:28:41.516 INFO:teuthology.orchestra.run.smithi172.stderr:2024-09-12T02:28:41.515+0000 7ff790ec8640 1 -- 172.21.15.172:0/1194459646 shutdown_connections 2024-09-12T02:28:41.516 INFO:teuthology.orchestra.run.smithi172.stderr:2024-09-12T02:28:41.515+0000 7ff790ec8640 1 --2- 172.21.15.172:0/1194459646 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7ff78c1016e0 0x7ff78c101ae0 unknown :-1 s=CLOSED pgs=107 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:28:41.516 INFO:teuthology.orchestra.run.smithi172.stderr:2024-09-12T02:28:41.515+0000 7ff790ec8640 1 -- 172.21.15.172:0/1194459646 >> 172.21.15.172:0/1194459646 conn(0x7ff78c0fce90 msgr2=0x7ff78c0ff2b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:28:41.517 INFO:teuthology.orchestra.run.smithi172.stderr:2024-09-12T02:28:41.515+0000 7ff790ec8640 1 -- 172.21.15.172:0/1194459646 shutdown_connections 2024-09-12T02:28:41.517 INFO:teuthology.orchestra.run.smithi172.stderr:2024-09-12T02:28:41.515+0000 7ff790ec8640 1 -- 172.21.15.172:0/1194459646 wait complete. 2024-09-12T02:28:41.517 INFO:teuthology.orchestra.run.smithi172.stderr:2024-09-12T02:28:41.516+0000 7ff790ec8640 1 Processor -- start 2024-09-12T02:28:41.517 INFO:teuthology.orchestra.run.smithi172.stderr:2024-09-12T02:28:41.516+0000 7ff790ec8640 1 -- start start 2024-09-12T02:28:41.518 INFO:teuthology.orchestra.run.smithi172.stderr:2024-09-12T02:28:41.516+0000 7ff790ec8640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7ff78c1016e0 0x7ff78c196fd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:28:41.518 INFO:teuthology.orchestra.run.smithi172.stderr:2024-09-12T02:28:41.516+0000 7ff790ec8640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7ff78c197510 0x7ff78c19c580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:28:41.518 INFO:teuthology.orchestra.run.smithi172.stderr:2024-09-12T02:28:41.516+0000 7ff790ec8640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7ff78c197990 0x7ff78c19eb10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:28:41.518 INFO:teuthology.orchestra.run.smithi172.stderr:2024-09-12T02:28:41.516+0000 7ff790ec8640 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 -- 0x7ff78c1077d0 con 0x7ff78c197990 2024-09-12T02:28:41.518 INFO:teuthology.orchestra.run.smithi172.stderr:2024-09-12T02:28:41.516+0000 7ff790ec8640 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x7ff78c107650 con 0x7ff78c197510 2024-09-12T02:28:41.519 INFO:teuthology.orchestra.run.smithi172.stderr:2024-09-12T02:28:41.516+0000 7ff790ec8640 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7ff78c107950 con 0x7ff78c1016e0 2024-09-12T02:28:41.519 INFO:teuthology.orchestra.run.smithi172.stderr:2024-09-12T02:28:41.516+0000 7ff78ad9d640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7ff78c197990 0x7ff78c19eb10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:28:41.519 INFO:teuthology.orchestra.run.smithi172.stderr:2024-09-12T02:28:41.516+0000 7ff78a59c640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7ff78c1016e0 0x7ff78c196fd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:28:41.519 INFO:teuthology.orchestra.run.smithi172.stderr:2024-09-12T02:28:41.516+0000 7ff78ad9d640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7ff78c197990 0x7ff78c19eb10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.39:3300/0 says I am v2:172.21.15.172:56958/0 (socket says 172.21.15.172:56958) 2024-09-12T02:28:41.519 INFO:teuthology.orchestra.run.smithi172.stderr:2024-09-12T02:28:41.516+0000 7ff78ad9d640 1 -- 172.21.15.172:0/329820618 learned_addr learned my addr 172.21.15.172:0/329820618 (peer_addr_for_me v2:172.21.15.172:0/0) 2024-09-12T02:28:41.519 INFO:teuthology.orchestra.run.smithi172.stderr:2024-09-12T02:28:41.516+0000 7ff789d9b640 1 --2- 172.21.15.172:0/329820618 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7ff78c197510 0x7ff78c19c580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:28:41.519 INFO:teuthology.orchestra.run.smithi172.stderr:2024-09-12T02:28:41.517+0000 7ff78ad9d640 1 -- 172.21.15.172:0/329820618 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7ff78c1016e0 msgr2=0x7ff78c196fd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:28:41.519 INFO:teuthology.orchestra.run.smithi172.stderr:2024-09-12T02:28:41.517+0000 7ff78ad9d640 1 --2- 172.21.15.172:0/329820618 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7ff78c1016e0 0x7ff78c196fd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:28:41.519 INFO:teuthology.orchestra.run.smithi172.stderr:2024-09-12T02:28:41.517+0000 7ff78ad9d640 1 -- 172.21.15.172:0/329820618 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7ff78c197510 msgr2=0x7ff78c19c580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:28:41.519 INFO:teuthology.orchestra.run.smithi172.stderr:2024-09-12T02:28:41.517+0000 7ff78ad9d640 1 --2- 172.21.15.172:0/329820618 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7ff78c197510 0x7ff78c19c580 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:28:41.519 INFO:teuthology.orchestra.run.smithi172.stderr:2024-09-12T02:28:41.517+0000 7ff78ad9d640 1 -- 172.21.15.172:0/329820618 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff78c19f3d0 con 0x7ff78c197990 2024-09-12T02:28:41.519 INFO:teuthology.orchestra.run.smithi172.stderr:2024-09-12T02:28:41.517+0000 7ff78a59c640 1 --2- 172.21.15.172:0/329820618 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7ff78c1016e0 0x7ff78c196fd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-12T02:28:41.519 INFO:teuthology.orchestra.run.smithi172.stderr:2024-09-12T02:28:41.517+0000 7ff78ad9d640 1 --2- 172.21.15.172:0/329820618 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7ff78c197990 0x7ff78c19eb10 secure :-1 s=READY pgs=108 cs=0 l=1 rev1=1 crypto rx=0x7ff78400ba50 tx=0x7ff78400bf10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:28:41.520 INFO:teuthology.orchestra.run.smithi172.stderr:2024-09-12T02:28:41.517+0000 7ff77b7fe640 1 -- 172.21.15.172:0/329820618 <== mon.0 v2:172.21.15.39:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff784019070 con 0x7ff78c197990 2024-09-12T02:28:41.520 INFO:teuthology.orchestra.run.smithi172.stderr:2024-09-12T02:28:41.517+0000 7ff77b7fe640 1 -- 172.21.15.172:0/329820618 <== mon.0 v2:172.21.15.39:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7ff78400cbe0 con 0x7ff78c197990 2024-09-12T02:28:41.520 INFO:teuthology.orchestra.run.smithi172.stderr:2024-09-12T02:28:41.517+0000 7ff790ec8640 1 -- 172.21.15.172:0/329820618 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff78c19f6c0 con 0x7ff78c197990 2024-09-12T02:28:41.520 INFO:teuthology.orchestra.run.smithi172.stderr:2024-09-12T02:28:41.517+0000 7ff77b7fe640 1 -- 172.21.15.172:0/329820618 <== mon.0 v2:172.21.15.39:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff7840076a0 con 0x7ff78c197990 2024-09-12T02:28:41.520 INFO:teuthology.orchestra.run.smithi172.stderr:2024-09-12T02:28:41.517+0000 7ff790ec8640 1 -- 172.21.15.172:0/329820618 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff78c19fc80 con 0x7ff78c197990 2024-09-12T02:28:41.521 INFO:teuthology.orchestra.run.smithi172.stderr:2024-09-12T02:28:41.518+0000 7ff77b7fe640 1 -- 172.21.15.172:0/329820618 <== mon.0 v2:172.21.15.39:3300/0 4 ==== mgrmap(e 13) ==== 46343+0+0 (secure 0 0 0) 0x7ff78401c070 con 0x7ff78c197990 2024-09-12T02:28:41.521 INFO:teuthology.orchestra.run.smithi172.stderr:2024-09-12T02:28:41.518+0000 7ff790ec8640 1 -- 172.21.15.172:0/329820618 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ff78c190590 con 0x7ff78c197990 2024-09-12T02:28:41.521 INFO:teuthology.orchestra.run.smithi172.stderr:2024-09-12T02:28:41.518+0000 7ff77b7fe640 1 --2- 172.21.15.172:0/329820618 >> [v2:172.21.15.39:6800/1725006999,v1:172.21.15.39:6801/1725006999] conn(0x7ff7740394f0 0x7ff77403b9b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:28:41.521 INFO:teuthology.orchestra.run.smithi172.stderr:2024-09-12T02:28:41.518+0000 7ff77b7fe640 1 -- 172.21.15.172:0/329820618 <== mon.0 v2:172.21.15.39:3300/0 5 ==== osd_map(4..4 src has 1..4) ==== 1155+0+0 (secure 0 0 0) 0x7ff78404bc10 con 0x7ff78c197990 2024-09-12T02:28:41.521 INFO:teuthology.orchestra.run.smithi172.stderr:2024-09-12T02:28:41.519+0000 7ff78a59c640 1 --2- 172.21.15.172:0/329820618 >> [v2:172.21.15.39:6800/1725006999,v1:172.21.15.39:6801/1725006999] conn(0x7ff7740394f0 0x7ff77403b9b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:28:41.521 INFO:teuthology.orchestra.run.smithi172.stderr:2024-09-12T02:28:41.519+0000 7ff78a59c640 1 --2- 172.21.15.172:0/329820618 >> [v2:172.21.15.39:6800/1725006999,v1:172.21.15.39:6801/1725006999] conn(0x7ff7740394f0 0x7ff77403b9b0 secure :-1 s=READY pgs=42 cs=0 l=1 rev1=1 crypto rx=0x7ff77c009230 tx=0x7ff77c0315d0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:28:41.524 INFO:teuthology.orchestra.run.smithi172.stderr:2024-09-12T02:28:41.523+0000 7ff77b7fe640 1 -- 172.21.15.172:0/329820618 <== mon.0 v2:172.21.15.39:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7ff78400ce00 con 0x7ff78c197990 2024-09-12T02:28:41.600 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 02:28:41 smithi039 ceph-mon[30515]: Updating smithi039:/var/lib/ceph/4954ed46-70ae-11ef-bcea-c7b262605968/config/ceph.conf 2024-09-12T02:28:41.600 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 02:28:41 smithi039 ceph-mon[30515]: from='mgr.14150 172.21.15.39:0/408627207' entity='mgr.x' 2024-09-12T02:28:41.600 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 02:28:41 smithi039 ceph-mon[30515]: from='mgr.14150 172.21.15.39:0/408627207' entity='mgr.x' 2024-09-12T02:28:41.600 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 02:28:41 smithi039 ceph-mon[30515]: from='mgr.14150 172.21.15.39:0/408627207' entity='mgr.x' 2024-09-12T02:28:41.600 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 02:28:41 smithi039 ceph-mon[30515]: from='mgr.14150 172.21.15.39:0/408627207' entity='mgr.x' 2024-09-12T02:28:41.600 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 02:28:41 smithi039 ceph-mon[30515]: from='mgr.14150 172.21.15.39:0/408627207' entity='mgr.x' 2024-09-12T02:28:41.600 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 02:28:41 smithi039 ceph-mon[30515]: from='mgr.14150 172.21.15.39:0/408627207' entity='mgr.x' 2024-09-12T02:28:41.600 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 02:28:41 smithi039 ceph-mon[30515]: from='mgr.14150 172.21.15.39:0/408627207' entity='mgr.x' 2024-09-12T02:28:41.600 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 02:28:41 smithi039 ceph-mon[30515]: Reconfiguring mon.a (unknown last config time)... 2024-09-12T02:28:41.600 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 02:28:41 smithi039 ceph-mon[30515]: from='mgr.14150 172.21.15.39:0/408627207' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2024-09-12T02:28:41.600 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 02:28:41 smithi039 ceph-mon[30515]: from='mgr.14150 172.21.15.39:0/408627207' entity='mgr.x' cmd=[{"prefix": "config get", "who": "mon", "key": "public_network"}]: dispatch 2024-09-12T02:28:41.601 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 02:28:41 smithi039 ceph-mon[30515]: from='mgr.14150 172.21.15.39:0/408627207' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-12T02:28:41.601 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 02:28:41 smithi039 ceph-mon[30515]: Reconfiguring daemon mon.a on smithi039 2024-09-12T02:28:41.601 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 02:28:41 smithi039 ceph-mon[30515]: from='mgr.14150 172.21.15.39:0/408627207' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-09-12T02:28:41.699 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 12 02:28:41 smithi044 ceph-mon[35411]: Updating smithi039:/var/lib/ceph/4954ed46-70ae-11ef-bcea-c7b262605968/config/ceph.conf 2024-09-12T02:28:41.839 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 12 02:28:41 smithi044 ceph-mon[35411]: from='mgr.14150 172.21.15.39:0/408627207' entity='mgr.x' 2024-09-12T02:28:41.839 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 12 02:28:41 smithi044 ceph-mon[35411]: from='mgr.14150 172.21.15.39:0/408627207' entity='mgr.x' 2024-09-12T02:28:41.839 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 12 02:28:41 smithi044 ceph-mon[35411]: from='mgr.14150 172.21.15.39:0/408627207' entity='mgr.x' 2024-09-12T02:28:41.839 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 12 02:28:41 smithi044 ceph-mon[35411]: from='mgr.14150 172.21.15.39:0/408627207' entity='mgr.x' 2024-09-12T02:28:41.839 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 12 02:28:41 smithi044 ceph-mon[35411]: from='mgr.14150 172.21.15.39:0/408627207' entity='mgr.x' 2024-09-12T02:28:41.839 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 12 02:28:41 smithi044 ceph-mon[35411]: from='mgr.14150 172.21.15.39:0/408627207' entity='mgr.x' 2024-09-12T02:28:41.839 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 12 02:28:41 smithi044 ceph-mon[35411]: from='mgr.14150 172.21.15.39:0/408627207' entity='mgr.x' 2024-09-12T02:28:41.839 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 12 02:28:41 smithi044 ceph-mon[35411]: Reconfiguring mon.a (unknown last config time)... 2024-09-12T02:28:41.839 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 12 02:28:41 smithi044 ceph-mon[35411]: from='mgr.14150 172.21.15.39:0/408627207' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2024-09-12T02:28:41.839 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 12 02:28:41 smithi044 ceph-mon[35411]: from='mgr.14150 172.21.15.39:0/408627207' entity='mgr.x' cmd=[{"prefix": "config get", "who": "mon", "key": "public_network"}]: dispatch 2024-09-12T02:28:41.839 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 12 02:28:41 smithi044 ceph-mon[35411]: from='mgr.14150 172.21.15.39:0/408627207' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-12T02:28:41.840 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 12 02:28:41 smithi044 ceph-mon[35411]: Reconfiguring daemon mon.a on smithi039 2024-09-12T02:28:41.840 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 12 02:28:41 smithi044 ceph-mon[35411]: from='mgr.14150 172.21.15.39:0/408627207' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-09-12T02:28:41.840 INFO:teuthology.orchestra.run.smithi172.stderr:2024-09-12T02:28:41.702+0000 7ff790ec8640 1 -- 172.21.15.172:0/329820618 --> [v2:172.21.15.39:6800/1725006999,v1:172.21.15.39:6801/1725006999] -- mgr_command(tid 0: {"prefix": "orch apply", "service_type": "mgr", "placement": "3;smithi039=x;smithi044=y;smithi172=z", "target": ["mon-mgr", ""]}) -- 0x7ff78c0626c0 con 0x7ff7740394f0 2024-09-12T02:28:41.841 INFO:teuthology.orchestra.run.smithi172.stderr:2024-09-12T02:28:41.709+0000 7ff77b7fe640 1 -- 172.21.15.172:0/329820618 <== mgr.14150 v2:172.21.15.39:6800/1725006999 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+24 (secure 0 0 0) 0x7ff78c0626c0 con 0x7ff7740394f0 2024-09-12T02:28:41.841 INFO:teuthology.orchestra.run.smithi172.stdout:Scheduled mgr update... 2024-09-12T02:28:41.841 INFO:teuthology.orchestra.run.smithi172.stderr:2024-09-12T02:28:41.711+0000 7ff790ec8640 1 -- 172.21.15.172:0/329820618 >> [v2:172.21.15.39:6800/1725006999,v1:172.21.15.39:6801/1725006999] conn(0x7ff7740394f0 msgr2=0x7ff77403b9b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:28:41.841 INFO:teuthology.orchestra.run.smithi172.stderr:2024-09-12T02:28:41.711+0000 7ff790ec8640 1 --2- 172.21.15.172:0/329820618 >> [v2:172.21.15.39:6800/1725006999,v1:172.21.15.39:6801/1725006999] conn(0x7ff7740394f0 0x7ff77403b9b0 secure :-1 s=READY pgs=42 cs=0 l=1 rev1=1 crypto rx=0x7ff77c009230 tx=0x7ff77c0315d0 comp rx=0 tx=0).stop 2024-09-12T02:28:41.842 INFO:teuthology.orchestra.run.smithi172.stderr:2024-09-12T02:28:41.711+0000 7ff790ec8640 1 -- 172.21.15.172:0/329820618 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7ff78c197990 msgr2=0x7ff78c19eb10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:28:41.842 INFO:teuthology.orchestra.run.smithi172.stderr:2024-09-12T02:28:41.711+0000 7ff790ec8640 1 --2- 172.21.15.172:0/329820618 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7ff78c197990 0x7ff78c19eb10 secure :-1 s=READY pgs=108 cs=0 l=1 rev1=1 crypto rx=0x7ff78400ba50 tx=0x7ff78400bf10 comp rx=0 tx=0).stop 2024-09-12T02:28:41.842 INFO:teuthology.orchestra.run.smithi172.stderr:2024-09-12T02:28:41.711+0000 7ff790ec8640 1 -- 172.21.15.172:0/329820618 shutdown_connections 2024-09-12T02:28:41.842 INFO:teuthology.orchestra.run.smithi172.stderr:2024-09-12T02:28:41.711+0000 7ff790ec8640 1 --2- 172.21.15.172:0/329820618 >> [v2:172.21.15.39:6800/1725006999,v1:172.21.15.39:6801/1725006999] conn(0x7ff7740394f0 0x7ff77403b9b0 unknown :-1 s=CLOSED pgs=42 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:28:41.842 INFO:teuthology.orchestra.run.smithi172.stderr:2024-09-12T02:28:41.711+0000 7ff790ec8640 1 --2- 172.21.15.172:0/329820618 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7ff78c197990 0x7ff78c19eb10 unknown :-1 s=CLOSED pgs=108 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:28:41.842 INFO:teuthology.orchestra.run.smithi172.stderr:2024-09-12T02:28:41.711+0000 7ff790ec8640 1 --2- 172.21.15.172:0/329820618 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7ff78c197510 0x7ff78c19c580 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:28:41.842 INFO:teuthology.orchestra.run.smithi172.stderr:2024-09-12T02:28:41.711+0000 7ff790ec8640 1 --2- 172.21.15.172:0/329820618 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7ff78c1016e0 0x7ff78c196fd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:28:41.842 INFO:teuthology.orchestra.run.smithi172.stderr:2024-09-12T02:28:41.711+0000 7ff790ec8640 1 -- 172.21.15.172:0/329820618 >> 172.21.15.172:0/329820618 conn(0x7ff78c0fce90 msgr2=0x7ff78c0fd9c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:28:41.842 INFO:teuthology.orchestra.run.smithi172.stderr:2024-09-12T02:28:41.711+0000 7ff790ec8640 1 -- 172.21.15.172:0/329820618 shutdown_connections 2024-09-12T02:28:41.842 INFO:teuthology.orchestra.run.smithi172.stderr:2024-09-12T02:28:41.711+0000 7ff790ec8640 1 -- 172.21.15.172:0/329820618 wait complete. 2024-09-12T02:28:42.275 DEBUG:teuthology.orchestra.run.smithi044:mgr.y> sudo journalctl -f -n 0 -u ceph-4954ed46-70ae-11ef-bcea-c7b262605968@mgr.y.service 2024-09-12T02:28:42.277 DEBUG:teuthology.orchestra.run.smithi172:mgr.z> sudo journalctl -f -n 0 -u ceph-4954ed46-70ae-11ef-bcea-c7b262605968@mgr.z.service 2024-09-12T02:28:42.279 INFO:tasks.cephadm:Deploying OSDs... 2024-09-12T02:28:42.280 DEBUG:teuthology.orchestra.run.smithi039:> set -ex 2024-09-12T02:28:42.280 DEBUG:teuthology.orchestra.run.smithi039:> dd if=/scratch_devs of=/dev/stdout 2024-09-12T02:28:42.315 DEBUG:teuthology.misc:devs=['/dev/vg_nvme/lv_1', '/dev/vg_nvme/lv_2', '/dev/vg_nvme/lv_3', '/dev/vg_nvme/lv_4'] 2024-09-12T02:28:42.315 DEBUG:teuthology.orchestra.run.smithi039:> stat /dev/vg_nvme/lv_1 2024-09-12T02:28:42.391 INFO:teuthology.orchestra.run.smithi039.stdout: File: /dev/vg_nvme/lv_1 -> ../dm-0 2024-09-12T02:28:42.391 INFO:teuthology.orchestra.run.smithi039.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-09-12T02:28:42.391 INFO:teuthology.orchestra.run.smithi039.stdout:Device: 6h/6d Inode: 632 Links: 1 2024-09-12T02:28:42.391 INFO:teuthology.orchestra.run.smithi039.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-09-12T02:28:42.391 INFO:teuthology.orchestra.run.smithi039.stdout:Context: system_u:object_r:device_t:s0 2024-09-12T02:28:42.391 INFO:teuthology.orchestra.run.smithi039.stdout:Access: 2024-09-12 02:27:58.076248368 +0000 2024-09-12T02:28:42.391 INFO:teuthology.orchestra.run.smithi039.stdout:Modify: 2024-09-12 02:23:11.150890729 +0000 2024-09-12T02:28:42.391 INFO:teuthology.orchestra.run.smithi039.stdout:Change: 2024-09-12 02:23:11.150890729 +0000 2024-09-12T02:28:42.392 INFO:teuthology.orchestra.run.smithi039.stdout: Birth: 2024-09-12 02:23:11.150890729 +0000 2024-09-12T02:28:42.392 DEBUG:teuthology.orchestra.run.smithi039:> sudo dd if=/dev/vg_nvme/lv_1 of=/dev/null count=1 2024-09-12T02:28:42.487 INFO:teuthology.orchestra.run.smithi039.stderr:1+0 records in 2024-09-12T02:28:42.487 INFO:teuthology.orchestra.run.smithi039.stderr:1+0 records out 2024-09-12T02:28:42.488 INFO:teuthology.orchestra.run.smithi039.stderr:512 bytes copied, 0.000420927 s, 1.2 MB/s 2024-09-12T02:28:42.490 DEBUG:teuthology.orchestra.run.smithi039:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_1 2024-09-12T02:28:42.529 DEBUG:teuthology.orchestra.run.smithi039:> stat /dev/vg_nvme/lv_2 2024-09-12T02:28:42.605 INFO:teuthology.orchestra.run.smithi039.stdout: File: /dev/vg_nvme/lv_2 -> ../dm-1 2024-09-12T02:28:42.605 INFO:teuthology.orchestra.run.smithi039.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-09-12T02:28:42.605 INFO:teuthology.orchestra.run.smithi039.stdout:Device: 6h/6d Inode: 653 Links: 1 2024-09-12T02:28:42.605 INFO:teuthology.orchestra.run.smithi039.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-09-12T02:28:42.605 INFO:teuthology.orchestra.run.smithi039.stdout:Context: system_u:object_r:device_t:s0 2024-09-12T02:28:42.605 INFO:teuthology.orchestra.run.smithi039.stdout:Access: 2024-09-12 02:27:58.116247587 +0000 2024-09-12T02:28:42.605 INFO:teuthology.orchestra.run.smithi039.stdout:Modify: 2024-09-12 02:23:11.595881945 +0000 2024-09-12T02:28:42.605 INFO:teuthology.orchestra.run.smithi039.stdout:Change: 2024-09-12 02:23:11.595881945 +0000 2024-09-12T02:28:42.606 INFO:teuthology.orchestra.run.smithi039.stdout: Birth: 2024-09-12 02:23:11.595881945 +0000 2024-09-12T02:28:42.606 DEBUG:teuthology.orchestra.run.smithi039:> sudo dd if=/dev/vg_nvme/lv_2 of=/dev/null count=1 2024-09-12T02:28:42.700 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 12 02:28:42 smithi044 ceph-mon[35411]: pgmap v22: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-12T02:28:42.700 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 12 02:28:42 smithi044 ceph-mon[35411]: from='mgr.14150 172.21.15.39:0/408627207' entity='mgr.x' 2024-09-12T02:28:42.700 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 12 02:28:42 smithi044 ceph-mon[35411]: from='mgr.14150 172.21.15.39:0/408627207' entity='mgr.x' 2024-09-12T02:28:42.701 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 12 02:28:42 smithi044 ceph-mon[35411]: from='mgr.14150 172.21.15.39:0/408627207' entity='mgr.x' 2024-09-12T02:28:42.701 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 12 02:28:42 smithi044 ceph-mon[35411]: from='mgr.14150 172.21.15.39:0/408627207' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mgr.x", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]: dispatch 2024-09-12T02:28:42.701 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 12 02:28:42 smithi044 ceph-mon[35411]: from='mgr.14150 172.21.15.39:0/408627207' entity='mgr.x' cmd=[{"prefix": "mgr services"}]: dispatch 2024-09-12T02:28:42.701 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 12 02:28:42 smithi044 ceph-mon[35411]: from='mgr.14150 172.21.15.39:0/408627207' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-12T02:28:42.701 INFO:teuthology.orchestra.run.smithi039.stderr:1+0 records in 2024-09-12T02:28:42.701 INFO:teuthology.orchestra.run.smithi039.stderr:1+0 records out 2024-09-12T02:28:42.701 INFO:teuthology.orchestra.run.smithi039.stderr:512 bytes copied, 0.000371461 s, 1.4 MB/s 2024-09-12T02:28:42.704 DEBUG:teuthology.orchestra.run.smithi039:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_2 2024-09-12T02:28:42.744 DEBUG:teuthology.orchestra.run.smithi039:> stat /dev/vg_nvme/lv_3 2024-09-12T02:28:42.756 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 02:28:42 smithi039 ceph-mon[30515]: pgmap v22: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-12T02:28:42.756 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 02:28:42 smithi039 ceph-mon[30515]: from='mgr.14150 172.21.15.39:0/408627207' entity='mgr.x' 2024-09-12T02:28:42.756 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 02:28:42 smithi039 ceph-mon[30515]: from='mgr.14150 172.21.15.39:0/408627207' entity='mgr.x' 2024-09-12T02:28:42.756 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 02:28:42 smithi039 ceph-mon[30515]: from='mgr.14150 172.21.15.39:0/408627207' entity='mgr.x' 2024-09-12T02:28:42.756 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 02:28:42 smithi039 ceph-mon[30515]: from='mgr.14150 172.21.15.39:0/408627207' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mgr.x", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]: dispatch 2024-09-12T02:28:42.756 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 02:28:42 smithi039 ceph-mon[30515]: from='mgr.14150 172.21.15.39:0/408627207' entity='mgr.x' cmd=[{"prefix": "mgr services"}]: dispatch 2024-09-12T02:28:42.756 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 02:28:42 smithi039 ceph-mon[30515]: from='mgr.14150 172.21.15.39:0/408627207' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-12T02:28:42.763 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 12 02:28:42 smithi172 ceph-mon[35609]: pgmap v22: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-12T02:28:42.763 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 12 02:28:42 smithi172 ceph-mon[35609]: from='mgr.14150 172.21.15.39:0/408627207' entity='mgr.x' 2024-09-12T02:28:42.763 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 12 02:28:42 smithi172 ceph-mon[35609]: from='mgr.14150 172.21.15.39:0/408627207' entity='mgr.x' 2024-09-12T02:28:42.763 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 12 02:28:42 smithi172 ceph-mon[35609]: from='mgr.14150 172.21.15.39:0/408627207' entity='mgr.x' 2024-09-12T02:28:42.764 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 12 02:28:42 smithi172 ceph-mon[35609]: from='mgr.14150 172.21.15.39:0/408627207' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mgr.x", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]: dispatch 2024-09-12T02:28:42.764 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 12 02:28:42 smithi172 ceph-mon[35609]: from='mgr.14150 172.21.15.39:0/408627207' entity='mgr.x' cmd=[{"prefix": "mgr services"}]: dispatch 2024-09-12T02:28:42.764 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 12 02:28:42 smithi172 ceph-mon[35609]: from='mgr.14150 172.21.15.39:0/408627207' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-12T02:28:42.791 INFO:teuthology.orchestra.run.smithi039.stdout: File: /dev/vg_nvme/lv_3 -> ../dm-2 2024-09-12T02:28:42.791 INFO:teuthology.orchestra.run.smithi039.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-09-12T02:28:42.791 INFO:teuthology.orchestra.run.smithi039.stdout:Device: 6h/6d Inode: 670 Links: 1 2024-09-12T02:28:42.791 INFO:teuthology.orchestra.run.smithi039.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-09-12T02:28:42.791 INFO:teuthology.orchestra.run.smithi039.stdout:Context: system_u:object_r:device_t:s0 2024-09-12T02:28:42.791 INFO:teuthology.orchestra.run.smithi039.stdout:Access: 2024-09-12 02:27:58.160246728 +0000 2024-09-12T02:28:42.791 INFO:teuthology.orchestra.run.smithi039.stdout:Modify: 2024-09-12 02:23:12.079872392 +0000 2024-09-12T02:28:42.791 INFO:teuthology.orchestra.run.smithi039.stdout:Change: 2024-09-12 02:23:12.079872392 +0000 2024-09-12T02:28:42.791 INFO:teuthology.orchestra.run.smithi039.stdout: Birth: 2024-09-12 02:23:12.079872392 +0000 2024-09-12T02:28:42.792 DEBUG:teuthology.orchestra.run.smithi039:> sudo dd if=/dev/vg_nvme/lv_3 of=/dev/null count=1 2024-09-12T02:28:42.887 INFO:teuthology.orchestra.run.smithi039.stderr:1+0 records in 2024-09-12T02:28:42.887 INFO:teuthology.orchestra.run.smithi039.stderr:1+0 records out 2024-09-12T02:28:42.887 INFO:teuthology.orchestra.run.smithi039.stderr:512 bytes copied, 0.000532993 s, 961 kB/s 2024-09-12T02:28:42.890 DEBUG:teuthology.orchestra.run.smithi039:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_3 2024-09-12T02:28:42.928 DEBUG:teuthology.orchestra.run.smithi039:> stat /dev/vg_nvme/lv_4 2024-09-12T02:28:43.004 INFO:teuthology.orchestra.run.smithi039.stdout: File: /dev/vg_nvme/lv_4 -> ../dm-3 2024-09-12T02:28:43.004 INFO:teuthology.orchestra.run.smithi039.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-09-12T02:28:43.004 INFO:teuthology.orchestra.run.smithi039.stdout:Device: 6h/6d Inode: 691 Links: 1 2024-09-12T02:28:43.004 INFO:teuthology.orchestra.run.smithi039.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-09-12T02:28:43.004 INFO:teuthology.orchestra.run.smithi039.stdout:Context: system_u:object_r:device_t:s0 2024-09-12T02:28:43.005 INFO:teuthology.orchestra.run.smithi039.stdout:Access: 2024-09-12 02:27:58.200245948 +0000 2024-09-12T02:28:43.005 INFO:teuthology.orchestra.run.smithi039.stdout:Modify: 2024-09-12 02:23:12.555862996 +0000 2024-09-12T02:28:43.005 INFO:teuthology.orchestra.run.smithi039.stdout:Change: 2024-09-12 02:23:12.555862996 +0000 2024-09-12T02:28:43.005 INFO:teuthology.orchestra.run.smithi039.stdout: Birth: 2024-09-12 02:23:12.555862996 +0000 2024-09-12T02:28:43.005 DEBUG:teuthology.orchestra.run.smithi039:> sudo dd if=/dev/vg_nvme/lv_4 of=/dev/null count=1 2024-09-12T02:28:43.098 INFO:teuthology.orchestra.run.smithi039.stderr:1+0 records in 2024-09-12T02:28:43.098 INFO:teuthology.orchestra.run.smithi039.stderr:1+0 records out 2024-09-12T02:28:43.098 INFO:teuthology.orchestra.run.smithi039.stderr:512 bytes copied, 0.000350511 s, 1.5 MB/s 2024-09-12T02:28:43.100 DEBUG:teuthology.orchestra.run.smithi039:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_4 2024-09-12T02:28:43.137 DEBUG:teuthology.orchestra.run.smithi044:> set -ex 2024-09-12T02:28:43.138 DEBUG:teuthology.orchestra.run.smithi044:> dd if=/scratch_devs of=/dev/stdout 2024-09-12T02:28:43.157 DEBUG:teuthology.misc:devs=['/dev/vg_nvme/lv_1', '/dev/vg_nvme/lv_2', '/dev/vg_nvme/lv_3', '/dev/vg_nvme/lv_4'] 2024-09-12T02:28:43.157 DEBUG:teuthology.orchestra.run.smithi044:> stat /dev/vg_nvme/lv_1 2024-09-12T02:28:43.216 INFO:teuthology.orchestra.run.smithi044.stdout: File: /dev/vg_nvme/lv_1 -> ../dm-0 2024-09-12T02:28:43.216 INFO:teuthology.orchestra.run.smithi044.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-09-12T02:28:43.216 INFO:teuthology.orchestra.run.smithi044.stdout:Device: 5h/5d Inode: 666 Links: 1 2024-09-12T02:28:43.216 INFO:teuthology.orchestra.run.smithi044.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-09-12T02:28:43.216 INFO:teuthology.orchestra.run.smithi044.stdout:Context: system_u:object_r:device_t:s0 2024-09-12T02:28:43.216 INFO:teuthology.orchestra.run.smithi044.stdout:Access: 2024-09-12 02:28:32.101567654 +0000 2024-09-12T02:28:43.216 INFO:teuthology.orchestra.run.smithi044.stdout:Modify: 2024-09-12 02:22:34.665812768 +0000 2024-09-12T02:28:43.216 INFO:teuthology.orchestra.run.smithi044.stdout:Change: 2024-09-12 02:22:34.665812768 +0000 2024-09-12T02:28:43.217 INFO:teuthology.orchestra.run.smithi044.stdout: Birth: 2024-09-12 02:22:34.665812768 +0000 2024-09-12T02:28:43.217 DEBUG:teuthology.orchestra.run.smithi044:> sudo dd if=/dev/vg_nvme/lv_1 of=/dev/null count=1 2024-09-12T02:28:43.283 INFO:teuthology.orchestra.run.smithi044.stderr:1+0 records in 2024-09-12T02:28:43.284 INFO:teuthology.orchestra.run.smithi044.stderr:1+0 records out 2024-09-12T02:28:43.284 INFO:teuthology.orchestra.run.smithi044.stderr:512 bytes copied, 0.000206024 s, 2.5 MB/s 2024-09-12T02:28:43.285 DEBUG:teuthology.orchestra.run.smithi044:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_1 2024-09-12T02:28:43.344 DEBUG:teuthology.orchestra.run.smithi044:> stat /dev/vg_nvme/lv_2 2024-09-12T02:28:43.401 INFO:teuthology.orchestra.run.smithi044.stdout: File: /dev/vg_nvme/lv_2 -> ../dm-1 2024-09-12T02:28:43.401 INFO:teuthology.orchestra.run.smithi044.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-09-12T02:28:43.402 INFO:teuthology.orchestra.run.smithi044.stdout:Device: 5h/5d Inode: 684 Links: 1 2024-09-12T02:28:43.402 INFO:teuthology.orchestra.run.smithi044.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-09-12T02:28:43.402 INFO:teuthology.orchestra.run.smithi044.stdout:Context: system_u:object_r:device_t:s0 2024-09-12T02:28:43.402 INFO:teuthology.orchestra.run.smithi044.stdout:Access: 2024-09-12 02:28:32.102567638 +0000 2024-09-12T02:28:43.402 INFO:teuthology.orchestra.run.smithi044.stdout:Modify: 2024-09-12 02:22:35.000807427 +0000 2024-09-12T02:28:43.402 INFO:teuthology.orchestra.run.smithi044.stdout:Change: 2024-09-12 02:22:35.000807427 +0000 2024-09-12T02:28:43.402 INFO:teuthology.orchestra.run.smithi044.stdout: Birth: 2024-09-12 02:22:35.000807427 +0000 2024-09-12T02:28:43.402 DEBUG:teuthology.orchestra.run.smithi044:> sudo dd if=/dev/vg_nvme/lv_2 of=/dev/null count=1 2024-09-12T02:28:43.467 INFO:teuthology.orchestra.run.smithi044.stderr:1+0 records in 2024-09-12T02:28:43.467 INFO:teuthology.orchestra.run.smithi044.stderr:1+0 records out 2024-09-12T02:28:43.467 INFO:teuthology.orchestra.run.smithi044.stderr:512 bytes copied, 0.000200749 s, 2.6 MB/s 2024-09-12T02:28:43.468 DEBUG:teuthology.orchestra.run.smithi044:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_2 2024-09-12T02:28:43.525 DEBUG:teuthology.orchestra.run.smithi044:> stat /dev/vg_nvme/lv_3 2024-09-12T02:28:43.581 INFO:teuthology.orchestra.run.smithi044.stdout: File: /dev/vg_nvme/lv_3 -> ../dm-2 2024-09-12T02:28:43.581 INFO:teuthology.orchestra.run.smithi044.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-09-12T02:28:43.581 INFO:teuthology.orchestra.run.smithi044.stdout:Device: 5h/5d Inode: 703 Links: 1 2024-09-12T02:28:43.581 INFO:teuthology.orchestra.run.smithi044.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-09-12T02:28:43.582 INFO:teuthology.orchestra.run.smithi044.stdout:Context: system_u:object_r:device_t:s0 2024-09-12T02:28:43.582 INFO:teuthology.orchestra.run.smithi044.stdout:Access: 2024-09-12 02:28:32.102567638 +0000 2024-09-12T02:28:43.582 INFO:teuthology.orchestra.run.smithi044.stdout:Modify: 2024-09-12 02:22:35.350801882 +0000 2024-09-12T02:28:43.582 INFO:teuthology.orchestra.run.smithi044.stdout:Change: 2024-09-12 02:22:35.350801882 +0000 2024-09-12T02:28:43.582 INFO:teuthology.orchestra.run.smithi044.stdout: Birth: 2024-09-12 02:22:35.350801882 +0000 2024-09-12T02:28:43.582 DEBUG:teuthology.orchestra.run.smithi044:> sudo dd if=/dev/vg_nvme/lv_3 of=/dev/null count=1 2024-09-12T02:28:43.644 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 12 02:28:43 smithi044 ceph-mon[35411]: from='client.14214 -' entity='client.admin' cmd=[{"prefix": "orch apply", "service_type": "mgr", "placement": "3;smithi039=x;smithi044=y;smithi172=z", "target": ["mon-mgr", ""]}]: dispatch 2024-09-12T02:28:43.644 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 12 02:28:43 smithi044 ceph-mon[35411]: Saving service mgr spec with placement smithi039=x;smithi044=y;smithi172=z;count:3 2024-09-12T02:28:43.644 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 12 02:28:43 smithi044 ceph-mon[35411]: Reconfiguring mgr.x (unknown last config time)... 2024-09-12T02:28:43.645 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 12 02:28:43 smithi044 ceph-mon[35411]: Reconfiguring daemon mgr.x on smithi039 2024-09-12T02:28:43.646 INFO:teuthology.orchestra.run.smithi044.stderr:1+0 records in 2024-09-12T02:28:43.647 INFO:teuthology.orchestra.run.smithi044.stderr:1+0 records out 2024-09-12T02:28:43.647 INFO:teuthology.orchestra.run.smithi044.stderr:512 bytes copied, 0.000223495 s, 2.3 MB/s 2024-09-12T02:28:43.648 DEBUG:teuthology.orchestra.run.smithi044:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_3 2024-09-12T02:28:43.704 DEBUG:teuthology.orchestra.run.smithi044:> stat /dev/vg_nvme/lv_4 2024-09-12T02:28:43.759 INFO:teuthology.orchestra.run.smithi044.stdout: File: /dev/vg_nvme/lv_4 -> ../dm-3 2024-09-12T02:28:43.760 INFO:teuthology.orchestra.run.smithi044.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-09-12T02:28:43.760 INFO:teuthology.orchestra.run.smithi044.stdout:Device: 5h/5d Inode: 723 Links: 1 2024-09-12T02:28:43.760 INFO:teuthology.orchestra.run.smithi044.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-09-12T02:28:43.760 INFO:teuthology.orchestra.run.smithi044.stdout:Context: system_u:object_r:device_t:s0 2024-09-12T02:28:43.760 INFO:teuthology.orchestra.run.smithi044.stdout:Access: 2024-09-12 02:28:32.103567623 +0000 2024-09-12T02:28:43.760 INFO:teuthology.orchestra.run.smithi044.stdout:Modify: 2024-09-12 02:22:35.690796511 +0000 2024-09-12T02:28:43.760 INFO:teuthology.orchestra.run.smithi044.stdout:Change: 2024-09-12 02:22:35.690796511 +0000 2024-09-12T02:28:43.760 INFO:teuthology.orchestra.run.smithi044.stdout: Birth: 2024-09-12 02:22:35.690796511 +0000 2024-09-12T02:28:43.760 DEBUG:teuthology.orchestra.run.smithi044:> sudo dd if=/dev/vg_nvme/lv_4 of=/dev/null count=1 2024-09-12T02:28:43.763 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 12 02:28:43 smithi172 ceph-mon[35609]: from='client.14214 -' entity='client.admin' cmd=[{"prefix": "orch apply", "service_type": "mgr", "placement": "3;smithi039=x;smithi044=y;smithi172=z", "target": ["mon-mgr", ""]}]: dispatch 2024-09-12T02:28:43.763 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 12 02:28:43 smithi172 ceph-mon[35609]: Saving service mgr spec with placement smithi039=x;smithi044=y;smithi172=z;count:3 2024-09-12T02:28:43.764 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 12 02:28:43 smithi172 ceph-mon[35609]: Reconfiguring mgr.x (unknown last config time)... 2024-09-12T02:28:43.764 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 12 02:28:43 smithi172 ceph-mon[35609]: Reconfiguring daemon mgr.x on smithi039 2024-09-12T02:28:43.823 INFO:teuthology.orchestra.run.smithi044.stderr:1+0 records in 2024-09-12T02:28:43.823 INFO:teuthology.orchestra.run.smithi044.stderr:1+0 records out 2024-09-12T02:28:43.823 INFO:teuthology.orchestra.run.smithi044.stderr:512 bytes copied, 0.000206113 s, 2.5 MB/s 2024-09-12T02:28:43.824 DEBUG:teuthology.orchestra.run.smithi044:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_4 2024-09-12T02:28:43.849 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 02:28:43 smithi039 ceph-mon[30515]: from='client.14214 -' entity='client.admin' cmd=[{"prefix": "orch apply", "service_type": "mgr", "placement": "3;smithi039=x;smithi044=y;smithi172=z", "target": ["mon-mgr", ""]}]: dispatch 2024-09-12T02:28:43.849 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 02:28:43 smithi039 ceph-mon[30515]: Saving service mgr spec with placement smithi039=x;smithi044=y;smithi172=z;count:3 2024-09-12T02:28:43.849 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 02:28:43 smithi039 ceph-mon[30515]: Reconfiguring mgr.x (unknown last config time)... 2024-09-12T02:28:43.850 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 02:28:43 smithi039 ceph-mon[30515]: Reconfiguring daemon mgr.x on smithi039 2024-09-12T02:28:43.881 DEBUG:teuthology.orchestra.run.smithi172:> set -ex 2024-09-12T02:28:43.881 DEBUG:teuthology.orchestra.run.smithi172:> dd if=/scratch_devs of=/dev/stdout 2024-09-12T02:28:43.901 DEBUG:teuthology.misc:devs=['/dev/vg_nvme/lv_1', '/dev/vg_nvme/lv_2', '/dev/vg_nvme/lv_3', '/dev/vg_nvme/lv_4'] 2024-09-12T02:28:43.901 DEBUG:teuthology.orchestra.run.smithi172:> stat /dev/vg_nvme/lv_1 2024-09-12T02:28:43.960 INFO:teuthology.orchestra.run.smithi172.stdout: File: /dev/vg_nvme/lv_1 -> ../dm-0 2024-09-12T02:28:43.960 INFO:teuthology.orchestra.run.smithi172.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-09-12T02:28:43.961 INFO:teuthology.orchestra.run.smithi172.stdout:Device: 5h/5d Inode: 666 Links: 1 2024-09-12T02:28:43.961 INFO:teuthology.orchestra.run.smithi172.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-09-12T02:28:43.961 INFO:teuthology.orchestra.run.smithi172.stdout:Context: system_u:object_r:device_t:s0 2024-09-12T02:28:43.961 INFO:teuthology.orchestra.run.smithi172.stdout:Access: 2024-09-12 02:28:23.014575583 +0000 2024-09-12T02:28:43.961 INFO:teuthology.orchestra.run.smithi172.stdout:Modify: 2024-09-12 02:22:32.591417700 +0000 2024-09-12T02:28:43.961 INFO:teuthology.orchestra.run.smithi172.stdout:Change: 2024-09-12 02:22:32.591417700 +0000 2024-09-12T02:28:43.961 INFO:teuthology.orchestra.run.smithi172.stdout: Birth: 2024-09-12 02:22:32.591417700 +0000 2024-09-12T02:28:43.961 DEBUG:teuthology.orchestra.run.smithi172:> sudo dd if=/dev/vg_nvme/lv_1 of=/dev/null count=1 2024-09-12T02:28:44.029 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-09-12T02:28:44.029 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-09-12T02:28:44.029 INFO:teuthology.orchestra.run.smithi172.stderr:512 bytes copied, 0.000233337 s, 2.2 MB/s 2024-09-12T02:28:44.030 DEBUG:teuthology.orchestra.run.smithi172:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_1 2024-09-12T02:28:44.089 DEBUG:teuthology.orchestra.run.smithi172:> stat /dev/vg_nvme/lv_2 2024-09-12T02:28:44.147 INFO:teuthology.orchestra.run.smithi172.stdout: File: /dev/vg_nvme/lv_2 -> ../dm-1 2024-09-12T02:28:44.147 INFO:teuthology.orchestra.run.smithi172.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-09-12T02:28:44.147 INFO:teuthology.orchestra.run.smithi172.stdout:Device: 5h/5d Inode: 686 Links: 1 2024-09-12T02:28:44.147 INFO:teuthology.orchestra.run.smithi172.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-09-12T02:28:44.147 INFO:teuthology.orchestra.run.smithi172.stdout:Context: system_u:object_r:device_t:s0 2024-09-12T02:28:44.147 INFO:teuthology.orchestra.run.smithi172.stdout:Access: 2024-09-12 02:28:23.015575558 +0000 2024-09-12T02:28:44.147 INFO:teuthology.orchestra.run.smithi172.stdout:Modify: 2024-09-12 02:22:32.924409046 +0000 2024-09-12T02:28:44.147 INFO:teuthology.orchestra.run.smithi172.stdout:Change: 2024-09-12 02:22:32.924409046 +0000 2024-09-12T02:28:44.148 INFO:teuthology.orchestra.run.smithi172.stdout: Birth: 2024-09-12 02:22:32.924409046 +0000 2024-09-12T02:28:44.148 DEBUG:teuthology.orchestra.run.smithi172:> sudo dd if=/dev/vg_nvme/lv_2 of=/dev/null count=1 2024-09-12T02:28:44.215 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-09-12T02:28:44.215 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-09-12T02:28:44.215 INFO:teuthology.orchestra.run.smithi172.stderr:512 bytes copied, 0.000219162 s, 2.3 MB/s 2024-09-12T02:28:44.217 DEBUG:teuthology.orchestra.run.smithi172:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_2 2024-09-12T02:28:44.276 DEBUG:teuthology.orchestra.run.smithi172:> stat /dev/vg_nvme/lv_3 2024-09-12T02:28:44.333 INFO:teuthology.orchestra.run.smithi172.stdout: File: /dev/vg_nvme/lv_3 -> ../dm-2 2024-09-12T02:28:44.333 INFO:teuthology.orchestra.run.smithi172.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-09-12T02:28:44.333 INFO:teuthology.orchestra.run.smithi172.stdout:Device: 5h/5d Inode: 705 Links: 1 2024-09-12T02:28:44.333 INFO:teuthology.orchestra.run.smithi172.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-09-12T02:28:44.334 INFO:teuthology.orchestra.run.smithi172.stdout:Context: system_u:object_r:device_t:s0 2024-09-12T02:28:44.334 INFO:teuthology.orchestra.run.smithi172.stdout:Access: 2024-09-12 02:28:23.015575558 +0000 2024-09-12T02:28:44.334 INFO:teuthology.orchestra.run.smithi172.stdout:Modify: 2024-09-12 02:22:33.260400313 +0000 2024-09-12T02:28:44.334 INFO:teuthology.orchestra.run.smithi172.stdout:Change: 2024-09-12 02:22:33.260400313 +0000 2024-09-12T02:28:44.334 INFO:teuthology.orchestra.run.smithi172.stdout: Birth: 2024-09-12 02:22:33.260400313 +0000 2024-09-12T02:28:44.334 DEBUG:teuthology.orchestra.run.smithi172:> sudo dd if=/dev/vg_nvme/lv_3 of=/dev/null count=1 2024-09-12T02:28:44.399 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-09-12T02:28:44.399 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-09-12T02:28:44.399 INFO:teuthology.orchestra.run.smithi172.stderr:512 bytes copied, 0.000308511 s, 1.7 MB/s 2024-09-12T02:28:44.400 DEBUG:teuthology.orchestra.run.smithi172:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_3 2024-09-12T02:28:44.457 DEBUG:teuthology.orchestra.run.smithi172:> stat /dev/vg_nvme/lv_4 2024-09-12T02:28:44.513 INFO:teuthology.orchestra.run.smithi172.stdout: File: /dev/vg_nvme/lv_4 -> ../dm-3 2024-09-12T02:28:44.513 INFO:teuthology.orchestra.run.smithi172.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-09-12T02:28:44.514 INFO:teuthology.orchestra.run.smithi172.stdout:Device: 5h/5d Inode: 724 Links: 1 2024-09-12T02:28:44.514 INFO:teuthology.orchestra.run.smithi172.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-09-12T02:28:44.514 INFO:teuthology.orchestra.run.smithi172.stdout:Context: system_u:object_r:device_t:s0 2024-09-12T02:28:44.514 INFO:teuthology.orchestra.run.smithi172.stdout:Access: 2024-09-12 02:28:23.016575534 +0000 2024-09-12T02:28:44.514 INFO:teuthology.orchestra.run.smithi172.stdout:Modify: 2024-09-12 02:22:33.594391633 +0000 2024-09-12T02:28:44.514 INFO:teuthology.orchestra.run.smithi172.stdout:Change: 2024-09-12 02:22:33.594391633 +0000 2024-09-12T02:28:44.514 INFO:teuthology.orchestra.run.smithi172.stdout: Birth: 2024-09-12 02:22:33.594391633 +0000 2024-09-12T02:28:44.514 DEBUG:teuthology.orchestra.run.smithi172:> sudo dd if=/dev/vg_nvme/lv_4 of=/dev/null count=1 2024-09-12T02:28:44.577 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-09-12T02:28:44.577 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-09-12T02:28:44.578 INFO:teuthology.orchestra.run.smithi172.stderr:512 bytes copied, 0.000239247 s, 2.1 MB/s 2024-09-12T02:28:44.579 DEBUG:teuthology.orchestra.run.smithi172:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_4 2024-09-12T02:28:44.636 INFO:tasks.cephadm:Deploying osd.0 on smithi039 with /dev/vg_nvme/lv_4... 2024-09-12T02:28:44.636 DEBUG:teuthology.orchestra.run.smithi039:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc ceph-volume -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 4954ed46-70ae-11ef-bcea-c7b262605968 -- lvm zap /dev/vg_nvme/lv_4 2024-09-12T02:28:44.764 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 12 02:28:44 smithi172 ceph-mon[35609]: pgmap v23: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-12T02:28:44.764 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 12 02:28:44 smithi172 ceph-mon[35609]: from='mgr.14150 172.21.15.39:0/408627207' entity='mgr.x' 2024-09-12T02:28:44.764 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 12 02:28:44 smithi172 ceph-mon[35609]: from='mgr.14150 172.21.15.39:0/408627207' entity='mgr.x' 2024-09-12T02:28:44.764 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 12 02:28:44 smithi172 ceph-mon[35609]: Reconfiguring mon.b (monmap changed)... 2024-09-12T02:28:44.764 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 12 02:28:44 smithi172 ceph-mon[35609]: from='mgr.14150 172.21.15.39:0/408627207' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2024-09-12T02:28:44.764 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 12 02:28:44 smithi172 ceph-mon[35609]: from='mgr.14150 172.21.15.39:0/408627207' entity='mgr.x' cmd=[{"prefix": "config get", "who": "mon", "key": "public_network"}]: dispatch 2024-09-12T02:28:44.764 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 12 02:28:44 smithi172 ceph-mon[35609]: from='mgr.14150 172.21.15.39:0/408627207' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-12T02:28:44.764 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 12 02:28:44 smithi172 ceph-mon[35609]: Reconfiguring daemon mon.b on smithi044 2024-09-12T02:28:44.858 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 12 02:28:44 smithi044 ceph-mon[35411]: pgmap v23: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-12T02:28:44.858 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 12 02:28:44 smithi044 ceph-mon[35411]: from='mgr.14150 172.21.15.39:0/408627207' entity='mgr.x' 2024-09-12T02:28:44.858 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 12 02:28:44 smithi044 ceph-mon[35411]: from='mgr.14150 172.21.15.39:0/408627207' entity='mgr.x' 2024-09-12T02:28:44.858 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 12 02:28:44 smithi044 ceph-mon[35411]: Reconfiguring mon.b (monmap changed)... 2024-09-12T02:28:44.858 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 12 02:28:44 smithi044 ceph-mon[35411]: from='mgr.14150 172.21.15.39:0/408627207' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2024-09-12T02:28:44.858 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 12 02:28:44 smithi044 ceph-mon[35411]: from='mgr.14150 172.21.15.39:0/408627207' entity='mgr.x' cmd=[{"prefix": "config get", "who": "mon", "key": "public_network"}]: dispatch 2024-09-12T02:28:44.858 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 12 02:28:44 smithi044 ceph-mon[35411]: from='mgr.14150 172.21.15.39:0/408627207' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-12T02:28:44.859 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 12 02:28:44 smithi044 ceph-mon[35411]: Reconfiguring daemon mon.b on smithi044 2024-09-12T02:28:45.009 INFO:teuthology.orchestra.run.smithi039.stderr:Inferring config /var/lib/ceph/4954ed46-70ae-11ef-bcea-c7b262605968/mon.a/config 2024-09-12T02:28:45.099 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 02:28:44 smithi039 ceph-mon[30515]: pgmap v23: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-12T02:28:45.100 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 02:28:44 smithi039 ceph-mon[30515]: from='mgr.14150 172.21.15.39:0/408627207' entity='mgr.x' 2024-09-12T02:28:45.100 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 02:28:44 smithi039 ceph-mon[30515]: from='mgr.14150 172.21.15.39:0/408627207' entity='mgr.x' 2024-09-12T02:28:45.100 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 02:28:44 smithi039 ceph-mon[30515]: Reconfiguring mon.b (monmap changed)... 2024-09-12T02:28:45.100 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 02:28:44 smithi039 ceph-mon[30515]: from='mgr.14150 172.21.15.39:0/408627207' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2024-09-12T02:28:45.100 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 02:28:44 smithi039 ceph-mon[30515]: from='mgr.14150 172.21.15.39:0/408627207' entity='mgr.x' cmd=[{"prefix": "config get", "who": "mon", "key": "public_network"}]: dispatch 2024-09-12T02:28:45.100 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 02:28:44 smithi039 ceph-mon[30515]: from='mgr.14150 172.21.15.39:0/408627207' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-12T02:28:45.100 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 02:28:44 smithi039 ceph-mon[30515]: Reconfiguring daemon mon.b on smithi044 2024-09-12T02:28:46.170 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 02:28:45 smithi039 ceph-mon[30515]: pgmap v24: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-12T02:28:46.170 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 02:28:45 smithi039 ceph-mon[30515]: from='mgr.14150 172.21.15.39:0/408627207' entity='mgr.x' 2024-09-12T02:28:46.170 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 02:28:45 smithi039 ceph-mon[30515]: from='mgr.14150 172.21.15.39:0/408627207' entity='mgr.x' 2024-09-12T02:28:46.170 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 02:28:45 smithi039 ceph-mon[30515]: Reconfiguring mon.c (monmap changed)... 2024-09-12T02:28:46.170 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 02:28:45 smithi039 ceph-mon[30515]: from='mgr.14150 172.21.15.39:0/408627207' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2024-09-12T02:28:46.170 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 02:28:45 smithi039 ceph-mon[30515]: from='mgr.14150 172.21.15.39:0/408627207' entity='mgr.x' cmd=[{"prefix": "config get", "who": "mon", "key": "public_network"}]: dispatch 2024-09-12T02:28:46.170 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 02:28:45 smithi039 ceph-mon[30515]: from='mgr.14150 172.21.15.39:0/408627207' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-12T02:28:46.170 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 02:28:45 smithi039 ceph-mon[30515]: Reconfiguring daemon mon.c on smithi172 2024-09-12T02:28:46.198 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 12 02:28:45 smithi044 ceph-mon[35411]: pgmap v24: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-12T02:28:46.198 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 12 02:28:45 smithi044 ceph-mon[35411]: from='mgr.14150 172.21.15.39:0/408627207' entity='mgr.x' 2024-09-12T02:28:46.198 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 12 02:28:45 smithi044 ceph-mon[35411]: from='mgr.14150 172.21.15.39:0/408627207' entity='mgr.x' 2024-09-12T02:28:46.199 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 12 02:28:45 smithi044 ceph-mon[35411]: Reconfiguring mon.c (monmap changed)... 2024-09-12T02:28:46.199 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 12 02:28:45 smithi044 ceph-mon[35411]: from='mgr.14150 172.21.15.39:0/408627207' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2024-09-12T02:28:46.199 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 12 02:28:45 smithi044 ceph-mon[35411]: from='mgr.14150 172.21.15.39:0/408627207' entity='mgr.x' cmd=[{"prefix": "config get", "who": "mon", "key": "public_network"}]: dispatch 2024-09-12T02:28:46.199 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 12 02:28:45 smithi044 ceph-mon[35411]: from='mgr.14150 172.21.15.39:0/408627207' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-12T02:28:46.199 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 12 02:28:45 smithi044 ceph-mon[35411]: Reconfiguring daemon mon.c on smithi172 2024-09-12T02:28:46.263 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 12 02:28:45 smithi172 ceph-mon[35609]: pgmap v24: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-12T02:28:46.263 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 12 02:28:45 smithi172 ceph-mon[35609]: from='mgr.14150 172.21.15.39:0/408627207' entity='mgr.x' 2024-09-12T02:28:46.264 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 12 02:28:45 smithi172 ceph-mon[35609]: from='mgr.14150 172.21.15.39:0/408627207' entity='mgr.x' 2024-09-12T02:28:46.264 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 12 02:28:45 smithi172 ceph-mon[35609]: Reconfiguring mon.c (monmap changed)... 2024-09-12T02:28:46.264 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 12 02:28:45 smithi172 ceph-mon[35609]: from='mgr.14150 172.21.15.39:0/408627207' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2024-09-12T02:28:46.264 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 12 02:28:45 smithi172 ceph-mon[35609]: from='mgr.14150 172.21.15.39:0/408627207' entity='mgr.x' cmd=[{"prefix": "config get", "who": "mon", "key": "public_network"}]: dispatch 2024-09-12T02:28:46.264 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 12 02:28:45 smithi172 ceph-mon[35609]: from='mgr.14150 172.21.15.39:0/408627207' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-12T02:28:46.264 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 12 02:28:45 smithi172 ceph-mon[35609]: Reconfiguring daemon mon.c on smithi172 2024-09-12T02:28:47.350 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 02:28:47 smithi039 ceph-mon[30515]: from='mgr.14150 172.21.15.39:0/408627207' entity='mgr.x' 2024-09-12T02:28:47.350 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 02:28:47 smithi039 ceph-mon[30515]: from='mgr.14150 172.21.15.39:0/408627207' entity='mgr.x' 2024-09-12T02:28:47.350 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 02:28:47 smithi039 ceph-mon[30515]: from='mgr.14150 172.21.15.39:0/408627207' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-12T02:28:47.350 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 02:28:47 smithi039 ceph-mon[30515]: from='mgr.14150 172.21.15.39:0/408627207' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-12T02:28:47.350 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 02:28:47 smithi039 ceph-mon[30515]: from='mgr.14150 172.21.15.39:0/408627207' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-12T02:28:47.350 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 02:28:47 smithi039 ceph-mon[30515]: from='mgr.14150 172.21.15.39:0/408627207' entity='mgr.x' 2024-09-12T02:28:47.351 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 02:28:47 smithi039 ceph-mon[30515]: from='mgr.14150 172.21.15.39:0/408627207' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mgr.z", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]: dispatch 2024-09-12T02:28:47.351 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 02:28:47 smithi039 ceph-mon[30515]: from='mgr.14150 172.21.15.39:0/408627207' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mgr.z", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]': finished 2024-09-12T02:28:47.351 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 02:28:47 smithi039 ceph-mon[30515]: from='mgr.14150 172.21.15.39:0/408627207' entity='mgr.x' cmd=[{"prefix": "mgr services"}]: dispatch 2024-09-12T02:28:47.351 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 02:28:47 smithi039 ceph-mon[30515]: from='mgr.14150 172.21.15.39:0/408627207' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-12T02:28:47.351 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 02:28:47 smithi039 ceph-mon[30515]: Deploying daemon mgr.z on smithi172 2024-09-12T02:28:47.414 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 12 02:28:47 smithi172 ceph-mon[35609]: from='mgr.14150 172.21.15.39:0/408627207' entity='mgr.x' 2024-09-12T02:28:47.414 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 12 02:28:47 smithi172 ceph-mon[35609]: from='mgr.14150 172.21.15.39:0/408627207' entity='mgr.x' 2024-09-12T02:28:47.414 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 12 02:28:47 smithi172 ceph-mon[35609]: from='mgr.14150 172.21.15.39:0/408627207' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-12T02:28:47.414 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 12 02:28:47 smithi172 ceph-mon[35609]: from='mgr.14150 172.21.15.39:0/408627207' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-12T02:28:47.414 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 12 02:28:47 smithi172 ceph-mon[35609]: from='mgr.14150 172.21.15.39:0/408627207' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-12T02:28:47.414 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 12 02:28:47 smithi172 ceph-mon[35609]: from='mgr.14150 172.21.15.39:0/408627207' entity='mgr.x' 2024-09-12T02:28:47.414 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 12 02:28:47 smithi172 ceph-mon[35609]: from='mgr.14150 172.21.15.39:0/408627207' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mgr.z", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]: dispatch 2024-09-12T02:28:47.414 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 12 02:28:47 smithi172 ceph-mon[35609]: from='mgr.14150 172.21.15.39:0/408627207' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mgr.z", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]': finished 2024-09-12T02:28:47.415 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 12 02:28:47 smithi172 ceph-mon[35609]: from='mgr.14150 172.21.15.39:0/408627207' entity='mgr.x' cmd=[{"prefix": "mgr services"}]: dispatch 2024-09-12T02:28:47.415 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 12 02:28:47 smithi172 ceph-mon[35609]: from='mgr.14150 172.21.15.39:0/408627207' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-12T02:28:47.415 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 12 02:28:47 smithi172 ceph-mon[35609]: Deploying daemon mgr.z on smithi172 2024-09-12T02:28:47.449 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 12 02:28:47 smithi044 ceph-mon[35411]: from='mgr.14150 172.21.15.39:0/408627207' entity='mgr.x' 2024-09-12T02:28:47.449 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 12 02:28:47 smithi044 ceph-mon[35411]: from='mgr.14150 172.21.15.39:0/408627207' entity='mgr.x' 2024-09-12T02:28:47.449 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 12 02:28:47 smithi044 ceph-mon[35411]: from='mgr.14150 172.21.15.39:0/408627207' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-12T02:28:47.449 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 12 02:28:47 smithi044 ceph-mon[35411]: from='mgr.14150 172.21.15.39:0/408627207' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-12T02:28:47.449 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 12 02:28:47 smithi044 ceph-mon[35411]: from='mgr.14150 172.21.15.39:0/408627207' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-12T02:28:47.449 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 12 02:28:47 smithi044 ceph-mon[35411]: from='mgr.14150 172.21.15.39:0/408627207' entity='mgr.x' 2024-09-12T02:28:47.449 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 12 02:28:47 smithi044 ceph-mon[35411]: from='mgr.14150 172.21.15.39:0/408627207' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mgr.z", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]: dispatch 2024-09-12T02:28:47.449 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 12 02:28:47 smithi044 ceph-mon[35411]: from='mgr.14150 172.21.15.39:0/408627207' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mgr.z", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]': finished 2024-09-12T02:28:47.449 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 12 02:28:47 smithi044 ceph-mon[35411]: from='mgr.14150 172.21.15.39:0/408627207' entity='mgr.x' cmd=[{"prefix": "mgr services"}]: dispatch 2024-09-12T02:28:47.450 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 12 02:28:47 smithi044 ceph-mon[35411]: from='mgr.14150 172.21.15.39:0/408627207' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-12T02:28:47.450 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 12 02:28:47 smithi044 ceph-mon[35411]: Deploying daemon mgr.z on smithi172 2024-09-12T02:28:47.892 INFO:teuthology.orchestra.run.smithi039.stdout: 2024-09-12T02:28:47.922 DEBUG:teuthology.orchestra.run.smithi039:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 4954ed46-70ae-11ef-bcea-c7b262605968 -- ceph orch daemon add osd smithi039:vg_nvme/lv_4 2024-09-12T02:28:48.291 INFO:teuthology.orchestra.run.smithi039.stderr:Inferring config /var/lib/ceph/4954ed46-70ae-11ef-bcea-c7b262605968/mon.a/config 2024-09-12T02:28:48.357 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 12 02:28:48 smithi172 ceph-mon[35609]: pgmap v25: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-12T02:28:48.357 INFO:journalctl@ceph.mgr.z.smithi172.stdout:Sep 12 02:28:48 smithi172 ceph-mgr[37427]: -- 172.21.15.172:0/2290597298 <== mon.1 v2:172.21.15.172:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 194+0+0 (secure 0 0 0) 0x56276e9450e0 con 0x56276e923400 2024-09-12T02:28:48.431 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 02:28:48 smithi039 ceph-mon[30515]: pgmap v25: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-12T02:28:48.448 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 12 02:28:48 smithi044 ceph-mon[35411]: pgmap v25: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-12T02:28:48.634 INFO:journalctl@ceph.mgr.z.smithi172.stdout:Sep 12 02:28:48 smithi172 ceph-4954ed46-70ae-11ef-bcea-c7b262605968-mgr-z[37423]: 2024-09-12T02:28:48.355+0000 7efd0e543040 -1 mgr[py] Module osd_perf_query has missing NOTIFY_TYPES member 2024-09-12T02:28:48.635 INFO:journalctl@ceph.mgr.z.smithi172.stdout:Sep 12 02:28:48 smithi172 bash[37408]: 650e5692e1e13bc86368c20dc0358c9ba5fec6c78e04c987ed7fc3a6cce4ba75 2024-09-12T02:28:48.635 INFO:journalctl@ceph.mgr.z.smithi172.stdout:Sep 12 02:28:48 smithi172 systemd[1]: Started Ceph mgr.z for 4954ed46-70ae-11ef-bcea-c7b262605968. 2024-09-12T02:28:48.635 INFO:journalctl@ceph.mgr.z.smithi172.stdout:Sep 12 02:28:48 smithi172 ceph-4954ed46-70ae-11ef-bcea-c7b262605968-mgr-z[37423]: 2024-09-12T02:28:48.417+0000 7efd0e543040 -1 mgr[py] Module osd_support has missing NOTIFY_TYPES member 2024-09-12T02:28:48.635 INFO:journalctl@ceph.mgr.z.smithi172.stdout:Sep 12 02:28:48 smithi172 ceph-4954ed46-70ae-11ef-bcea-c7b262605968-mgr-z[37423]: 2024-09-12T02:28:48.567+0000 7efd0e543040 -1 mgr[py] Module diskprediction_local has missing NOTIFY_TYPES member 2024-09-12T02:28:48.635 INFO:journalctl@ceph.mgr.z.smithi172.stdout:Sep 12 02:28:48 smithi172 ceph-4954ed46-70ae-11ef-bcea-c7b262605968-mgr-z[37423]: 2024-09-12T02:28:48.633+0000 7efd0e543040 -1 mgr[py] Module crash has missing NOTIFY_TYPES member 2024-09-12T02:28:48.815 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:28:48.814+0000 7f3f7f200640 1 -- 172.21.15.39:0/3007524992 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f3f80104e50 msgr2=0x7f3f801052d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:28:48.815 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:28:48.814+0000 7f3f7f200640 1 --2- 172.21.15.39:0/3007524992 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f3f80104e50 0x7f3f801052d0 secure :-1 s=READY pgs=109 cs=0 l=1 rev1=1 crypto rx=0x7f3f6c009900 tx=0x7f3f6c02a3f0 comp rx=0 tx=0).stop 2024-09-12T02:28:48.815 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:28:48.814+0000 7f3f7f200640 1 -- 172.21.15.39:0/3007524992 shutdown_connections 2024-09-12T02:28:48.815 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:28:48.814+0000 7f3f7f200640 1 --2- 172.21.15.39:0/3007524992 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f3f80105810 0x7f3f8010c0a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:28:48.816 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:28:48.814+0000 7f3f7f200640 1 --2- 172.21.15.39:0/3007524992 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f3f80104e50 0x7f3f801052d0 unknown :-1 s=CLOSED pgs=109 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:28:48.816 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:28:48.814+0000 7f3f7f200640 1 --2- 172.21.15.39:0/3007524992 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f3f80103c50 0x7f3f80104050 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:28:48.816 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:28:48.814+0000 7f3f7f200640 1 -- 172.21.15.39:0/3007524992 >> 172.21.15.39:0/3007524992 conn(0x7f3f800ff3e0 msgr2=0x7f3f80101820 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:28:48.816 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:28:48.814+0000 7f3f7f200640 1 -- 172.21.15.39:0/3007524992 shutdown_connections 2024-09-12T02:28:48.816 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:28:48.814+0000 7f3f7f200640 1 -- 172.21.15.39:0/3007524992 wait complete. 2024-09-12T02:28:48.817 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:28:48.815+0000 7f3f7f200640 1 Processor -- start 2024-09-12T02:28:48.817 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:28:48.815+0000 7f3f7f200640 1 -- start start 2024-09-12T02:28:48.817 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:28:48.816+0000 7f3f7f200640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f3f80103c50 0x7f3f80199f30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:28:48.817 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:28:48.816+0000 7f3f7f200640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f3f80104e50 0x7f3f8019a470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:28:48.818 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:28:48.816+0000 7f3f7f200640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f3f80105810 0x7f3f801a14f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:28:48.818 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:28:48.816+0000 7f3f7f200640 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 -- 0x7f3f8010f900 con 0x7f3f80103c50 2024-09-12T02:28:48.818 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:28:48.816+0000 7f3f7f200640 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x7f3f8010f780 con 0x7f3f80104e50 2024-09-12T02:28:48.818 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:28:48.816+0000 7f3f7f200640 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7f3f8010fa80 con 0x7f3f80105810 2024-09-12T02:28:48.818 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:28:48.816+0000 7f3f7de00640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f3f80103c50 0x7f3f80199f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:28:48.818 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:28:48.816+0000 7f3f7d400640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f3f80104e50 0x7f3f8019a470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:28:48.818 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:28:48.816+0000 7f3f7d400640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f3f80104e50 0x7f3f8019a470 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.39:39126/0 (socket says 172.21.15.39:39126) 2024-09-12T02:28:48.818 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:28:48.816+0000 7f3f7d400640 1 -- 172.21.15.39:0/2171750691 learned_addr learned my addr 172.21.15.39:0/2171750691 (peer_addr_for_me v2:172.21.15.39:0/0) 2024-09-12T02:28:48.818 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:28:48.816+0000 7f3f7e800640 1 --2- 172.21.15.39:0/2171750691 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f3f80105810 0x7f3f801a14f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:28:48.818 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:28:48.816+0000 7f3f7d400640 1 -- 172.21.15.39:0/2171750691 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f3f80105810 msgr2=0x7f3f801a14f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:28:48.819 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:28:48.816+0000 7f3f7d400640 1 --2- 172.21.15.39:0/2171750691 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f3f80105810 0x7f3f801a14f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:28:48.819 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:28:48.816+0000 7f3f7d400640 1 -- 172.21.15.39:0/2171750691 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f3f80103c50 msgr2=0x7f3f80199f30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:28:48.819 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:28:48.816+0000 7f3f7d400640 1 --2- 172.21.15.39:0/2171750691 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f3f80103c50 0x7f3f80199f30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:28:48.819 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:28:48.816+0000 7f3f7d400640 1 -- 172.21.15.39:0/2171750691 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3f801a1b60 con 0x7f3f80104e50 2024-09-12T02:28:48.821 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:28:48.817+0000 7f3f7d400640 1 --2- 172.21.15.39:0/2171750691 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f3f80104e50 0x7f3f8019a470 secure :-1 s=READY pgs=5 cs=0 l=1 rev1=1 crypto rx=0x7f3f6c031440 tx=0x7f3f6c032e20 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:28:48.821 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:28:48.817+0000 7f3f76a00640 1 -- 172.21.15.39:0/2171750691 <== mon.2 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3f6c03f030 con 0x7f3f80104e50 2024-09-12T02:28:48.821 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:28:48.817+0000 7f3f76a00640 1 -- 172.21.15.39:0/2171750691 <== mon.2 v2:172.21.15.44:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f3f6c003ce0 con 0x7f3f80104e50 2024-09-12T02:28:48.821 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:28:48.817+0000 7f3f7f200640 1 -- 172.21.15.39:0/2171750691 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f3f801a1df0 con 0x7f3f80104e50 2024-09-12T02:28:48.821 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:28:48.817+0000 7f3f76a00640 1 -- 172.21.15.39:0/2171750691 <== mon.2 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3f6c035070 con 0x7f3f80104e50 2024-09-12T02:28:48.821 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:28:48.817+0000 7f3f7f200640 1 -- 172.21.15.39:0/2171750691 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f3f801a2250 con 0x7f3f80104e50 2024-09-12T02:28:48.821 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:28:48.818+0000 7f3f7f200640 1 -- 172.21.15.39:0/2171750691 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f3f8010b050 con 0x7f3f80104e50 2024-09-12T02:28:48.821 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:28:48.818+0000 7f3f76a00640 1 -- 172.21.15.39:0/2171750691 <== mon.2 v2:172.21.15.44:3300/0 4 ==== mgrmap(e 13) ==== 46343+0+0 (secure 0 0 0) 0x7f3f6c042030 con 0x7f3f80104e50 2024-09-12T02:28:48.821 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:28:48.819+0000 7f3f76a00640 1 --2- 172.21.15.39:0/2171750691 >> [v2:172.21.15.39:6800/1725006999,v1:172.21.15.39:6801/1725006999] conn(0x7f3f640392c0 0x7f3f6403b780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:28:48.821 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:28:48.819+0000 7f3f76a00640 1 -- 172.21.15.39:0/2171750691 <== mon.2 v2:172.21.15.44:3300/0 5 ==== osd_map(4..4 src has 1..4) ==== 1155+0+0 (secure 0 0 0) 0x7f3f6c06ca20 con 0x7f3f80104e50 2024-09-12T02:28:48.822 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:28:48.819+0000 7f3f7de00640 1 --2- 172.21.15.39:0/2171750691 >> [v2:172.21.15.39:6800/1725006999,v1:172.21.15.39:6801/1725006999] conn(0x7f3f640392c0 0x7f3f6403b780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:28:48.822 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:28:48.820+0000 7f3f7de00640 1 --2- 172.21.15.39:0/2171750691 >> [v2:172.21.15.39:6800/1725006999,v1:172.21.15.39:6801/1725006999] conn(0x7f3f640392c0 0x7f3f6403b780 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 crypto rx=0x7f3f80104cb0 tx=0x7f3f7000b390 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:28:48.825 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:28:48.824+0000 7f3f76a00640 1 -- 172.21.15.39:0/2171750691 <== mon.2 v2:172.21.15.44:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7f3f6c04c350 con 0x7f3f80104e50 2024-09-12T02:28:48.921 INFO:journalctl@ceph.mgr.z.smithi172.stdout:Sep 12 02:28:48 smithi172 ceph-4954ed46-70ae-11ef-bcea-c7b262605968-mgr-z[37423]: 2024-09-12T02:28:48.780+0000 7efd0e543040 -1 mgr[py] Module test_orchestrator has missing NOTIFY_TYPES member 2024-09-12T02:28:49.017 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:28:49.016+0000 7f3f7f200640 1 -- 172.21.15.39:0/2171750691 --> [v2:172.21.15.39:6800/1725006999,v1:172.21.15.39:6801/1725006999] -- mgr_command(tid 0: {"prefix": "orch daemon add osd", "svc_arg": "smithi039:vg_nvme/lv_4", "target": ["mon-mgr", ""]}) -- 0x7f3f80062630 con 0x7f3f640392c0 2024-09-12T02:28:49.234 INFO:journalctl@ceph.mgr.z.smithi172.stdout:Sep 12 02:28:48 smithi172 ceph-4954ed46-70ae-11ef-bcea-c7b262605968-mgr-z[37423]: 2024-09-12T02:28:48.920+0000 7efd0e543040 -1 mgr[py] Module snap_schedule has missing NOTIFY_TYPES member 2024-09-12T02:28:49.234 INFO:journalctl@ceph.mgr.z.smithi172.stdout:Sep 12 02:28:49 smithi172 ceph-4954ed46-70ae-11ef-bcea-c7b262605968-mgr-z[37423]: 2024-09-12T02:28:49.232+0000 7efd0e543040 -1 mgr[py] Module prometheus has missing NOTIFY_TYPES member 2024-09-12T02:28:49.514 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 12 02:28:49 smithi172 ceph-mon[35609]: from='mgr.14150 172.21.15.39:0/408627207' entity='mgr.x' 2024-09-12T02:28:49.514 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 12 02:28:49 smithi172 ceph-mon[35609]: from='mgr.14150 172.21.15.39:0/408627207' entity='mgr.x' 2024-09-12T02:28:49.514 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 12 02:28:49 smithi172 ceph-mon[35609]: from='mgr.14150 172.21.15.39:0/408627207' entity='mgr.x' 2024-09-12T02:28:49.514 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 12 02:28:49 smithi172 ceph-mon[35609]: from='mgr.14150 172.21.15.39:0/408627207' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mgr.y", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]: dispatch 2024-09-12T02:28:49.514 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 12 02:28:49 smithi172 ceph-mon[35609]: from='mgr.14150 172.21.15.39:0/408627207' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mgr.y", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]': finished 2024-09-12T02:28:49.514 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 12 02:28:49 smithi172 ceph-mon[35609]: from='mgr.14150 172.21.15.39:0/408627207' entity='mgr.x' cmd=[{"prefix": "mgr services"}]: dispatch 2024-09-12T02:28:49.514 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 12 02:28:49 smithi172 ceph-mon[35609]: from='mgr.14150 172.21.15.39:0/408627207' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-12T02:28:49.515 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 12 02:28:49 smithi172 ceph-mon[35609]: Deploying daemon mgr.y on smithi044 2024-09-12T02:28:49.515 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 12 02:28:49 smithi172 ceph-mon[35609]: from='mgr.14150 172.21.15.39:0/408627207' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-09-12T02:28:49.515 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 12 02:28:49 smithi172 ceph-mon[35609]: from='mgr.14150 172.21.15.39:0/408627207' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-09-12T02:28:49.515 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 12 02:28:49 smithi172 ceph-mon[35609]: from='mgr.14150 172.21.15.39:0/408627207' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-12T02:28:49.515 INFO:journalctl@ceph.mgr.z.smithi172.stdout:Sep 12 02:28:49 smithi172 ceph-4954ed46-70ae-11ef-bcea-c7b262605968-mgr-z[37423]: 2024-09-12T02:28:49.292+0000 7efd0e543040 -1 mgr[py] Module selftest has missing NOTIFY_TYPES member 2024-09-12T02:28:49.515 INFO:journalctl@ceph.mgr.z.smithi172.stdout:Sep 12 02:28:49 smithi172 ceph-4954ed46-70ae-11ef-bcea-c7b262605968-mgr-z[37423]: 2024-09-12T02:28:49.476+0000 7efd0e543040 -1 mgr[py] Module volumes has missing NOTIFY_TYPES member 2024-09-12T02:28:49.699 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 12 02:28:49 smithi044 ceph-mon[35411]: from='mgr.14150 172.21.15.39:0/408627207' entity='mgr.x' 2024-09-12T02:28:49.699 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 12 02:28:49 smithi044 ceph-mon[35411]: from='mgr.14150 172.21.15.39:0/408627207' entity='mgr.x' 2024-09-12T02:28:49.699 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 12 02:28:49 smithi044 ceph-mon[35411]: from='mgr.14150 172.21.15.39:0/408627207' entity='mgr.x' 2024-09-12T02:28:49.699 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 12 02:28:49 smithi044 ceph-mon[35411]: from='mgr.14150 172.21.15.39:0/408627207' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mgr.y", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]: dispatch 2024-09-12T02:28:49.699 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 12 02:28:49 smithi044 ceph-mon[35411]: from='mgr.14150 172.21.15.39:0/408627207' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mgr.y", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]': finished 2024-09-12T02:28:49.699 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 12 02:28:49 smithi044 ceph-mon[35411]: from='mgr.14150 172.21.15.39:0/408627207' entity='mgr.x' cmd=[{"prefix": "mgr services"}]: dispatch 2024-09-12T02:28:49.699 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 12 02:28:49 smithi044 ceph-mon[35411]: from='mgr.14150 172.21.15.39:0/408627207' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-12T02:28:49.699 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 12 02:28:49 smithi044 ceph-mon[35411]: Deploying daemon mgr.y on smithi044 2024-09-12T02:28:49.699 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 12 02:28:49 smithi044 ceph-mon[35411]: from='mgr.14150 172.21.15.39:0/408627207' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-09-12T02:28:49.699 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 12 02:28:49 smithi044 ceph-mon[35411]: from='mgr.14150 172.21.15.39:0/408627207' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-09-12T02:28:49.699 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 12 02:28:49 smithi044 ceph-mon[35411]: from='mgr.14150 172.21.15.39:0/408627207' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-12T02:28:49.714 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 02:28:49 smithi039 ceph-mon[30515]: from='mgr.14150 172.21.15.39:0/408627207' entity='mgr.x' 2024-09-12T02:28:49.714 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 02:28:49 smithi039 ceph-mon[30515]: from='mgr.14150 172.21.15.39:0/408627207' entity='mgr.x' 2024-09-12T02:28:49.714 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 02:28:49 smithi039 ceph-mon[30515]: from='mgr.14150 172.21.15.39:0/408627207' entity='mgr.x' 2024-09-12T02:28:49.714 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 02:28:49 smithi039 ceph-mon[30515]: from='mgr.14150 172.21.15.39:0/408627207' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mgr.y", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]: dispatch 2024-09-12T02:28:49.714 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 02:28:49 smithi039 ceph-mon[30515]: from='mgr.14150 172.21.15.39:0/408627207' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mgr.y", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]': finished 2024-09-12T02:28:49.714 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 02:28:49 smithi039 ceph-mon[30515]: from='mgr.14150 172.21.15.39:0/408627207' entity='mgr.x' cmd=[{"prefix": "mgr services"}]: dispatch 2024-09-12T02:28:49.714 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 02:28:49 smithi039 ceph-mon[30515]: from='mgr.14150 172.21.15.39:0/408627207' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-12T02:28:49.714 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 02:28:49 smithi039 ceph-mon[30515]: Deploying daemon mgr.y on smithi044 2024-09-12T02:28:49.715 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 02:28:49 smithi039 ceph-mon[30515]: from='mgr.14150 172.21.15.39:0/408627207' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-09-12T02:28:49.715 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 02:28:49 smithi039 ceph-mon[30515]: from='mgr.14150 172.21.15.39:0/408627207' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-09-12T02:28:49.715 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 02:28:49 smithi039 ceph-mon[30515]: from='mgr.14150 172.21.15.39:0/408627207' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-12T02:28:50.388 INFO:journalctl@ceph.mgr.y.smithi044.stdout:Sep 12 02:28:50 smithi044 systemd[1]: Starting Ceph mgr.y for 4954ed46-70ae-11ef-bcea-c7b262605968... 2024-09-12T02:28:50.676 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 12 02:28:50 smithi044 ceph-mon[35411]: pgmap v26: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-12T02:28:50.676 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 12 02:28:50 smithi044 ceph-mon[35411]: from='client.24110 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi039:vg_nvme/lv_4", "target": ["mon-mgr", ""]}]: dispatch 2024-09-12T02:28:50.676 INFO:journalctl@ceph.mgr.y.smithi044.stdout:Sep 12 02:28:50 smithi044 podman[36762]: 2024-09-12 02:28:50.290607594 +0000 UTC m=+0.015787723 image pull 54467abc55f864c4f73dfaf9c6ac3bb3e87b773123d5badaf790bee57321d594 quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:3be30d720e37ec4df7f667e60f22b4d221c4ce7b408e68b90f9ac10220535e66 2024-09-12T02:28:50.676 INFO:journalctl@ceph.mgr.y.smithi044.stdout:Sep 12 02:28:50 smithi044 podman[36762]: 2024-09-12 02:28:50.397834949 +0000 UTC m=+0.123015114 container create 3fe9c80a9d1e9c5535ef736bb93d8ddc78f3c7f03cca581594b3036d77fac138 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:3be30d720e37ec4df7f667e60f22b4d221c4ce7b408e68b90f9ac10220535e66, name=ceph-4954ed46-70ae-11ef-bcea-c7b262605968-mgr-y, RELEASE=squid-b53b6d3, GIT_REPO=git@github.com:ceph/ceph-container.git, io.buildah.version=1.37.2, ceph=True, CEPH_POINT_RELEASE=, org.label-schema.schema-version=1.0, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.build-date=20240731, org.label-schema.name=CentOS Stream 9 Base Image, GIT_CLEAN=True, org.label-schema.vendor=CentOS, org.label-schema.license=GPLv2, GIT_BRANCH=HEAD, maintainer=Guillaume Abrioux ) 2024-09-12T02:28:50.677 INFO:journalctl@ceph.mgr.y.smithi044.stdout:Sep 12 02:28:50 smithi044 podman[36762]: 2024-09-12 02:28:50.608484061 +0000 UTC m=+0.333664183 container init 3fe9c80a9d1e9c5535ef736bb93d8ddc78f3c7f03cca581594b3036d77fac138 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:3be30d720e37ec4df7f667e60f22b4d221c4ce7b408e68b90f9ac10220535e66, name=ceph-4954ed46-70ae-11ef-bcea-c7b262605968-mgr-y, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, GIT_CLEAN=True, ceph=True, org.label-schema.license=GPLv2, io.buildah.version=1.37.2, org.label-schema.vendor=CentOS, org.label-schema.build-date=20240731, org.label-schema.name=CentOS Stream 9 Base Image, maintainer=Guillaume Abrioux , CEPH_POINT_RELEASE=, GIT_BRANCH=HEAD, RELEASE=squid-b53b6d3, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.schema-version=1.0) 2024-09-12T02:28:50.677 INFO:journalctl@ceph.mgr.y.smithi044.stdout:Sep 12 02:28:50 smithi044 podman[36762]: 2024-09-12 02:28:50.611851634 +0000 UTC m=+0.337031756 container start 3fe9c80a9d1e9c5535ef736bb93d8ddc78f3c7f03cca581594b3036d77fac138 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:3be30d720e37ec4df7f667e60f22b4d221c4ce7b408e68b90f9ac10220535e66, name=ceph-4954ed46-70ae-11ef-bcea-c7b262605968-mgr-y, org.label-schema.vendor=CentOS, org.label-schema.build-date=20240731, RELEASE=squid-b53b6d3, org.label-schema.license=GPLv2, GIT_BRANCH=HEAD, org.label-schema.schema-version=1.0, GIT_REPO=git@github.com:ceph/ceph-container.git, maintainer=Guillaume Abrioux , GIT_CLEAN=True, io.buildah.version=1.37.2, ceph=True, CEPH_POINT_RELEASE=, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.name=CentOS Stream 9 Base Image) 2024-09-12T02:28:50.677 INFO:journalctl@ceph.mgr.y.smithi044.stdout:Sep 12 02:28:50 smithi044 ceph-mgr[36781]: -- 172.21.15.44:0/2018896781 <== mon.2 v2:172.21.15.44:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 194+0+0 (secure 0 0 0) 0x55b7a7bf10e0 con 0x55b7a7bcf000 2024-09-12T02:28:50.677 INFO:journalctl@ceph.mgr.y.smithi044.stdout:Sep 12 02:28:50 smithi044 bash[36762]: 3fe9c80a9d1e9c5535ef736bb93d8ddc78f3c7f03cca581594b3036d77fac138 2024-09-12T02:28:50.680 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 12 02:28:50 smithi172 ceph-mon[35609]: pgmap v26: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-12T02:28:50.681 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 12 02:28:50 smithi172 ceph-mon[35609]: from='client.24110 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi039:vg_nvme/lv_4", "target": ["mon-mgr", ""]}]: dispatch 2024-09-12T02:28:50.681 INFO:journalctl@ceph.mgr.z.smithi172.stdout:Sep 12 02:28:50 smithi172 ceph-4954ed46-70ae-11ef-bcea-c7b262605968-mgr-z[37423]: 2024-09-12T02:28:50.391+0000 7efd0e543040 -1 mgr[py] Module telemetry has missing NOTIFY_TYPES member 2024-09-12T02:28:50.681 INFO:journalctl@ceph.mgr.z.smithi172.stdout:Sep 12 02:28:50 smithi172 ceph-4954ed46-70ae-11ef-bcea-c7b262605968-mgr-z[37423]: 2024-09-12T02:28:50.459+0000 7efd0e543040 -1 mgr[py] Module balancer has missing NOTIFY_TYPES member 2024-09-12T02:28:50.712 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 02:28:50 smithi039 ceph-mon[30515]: pgmap v26: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-12T02:28:50.712 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 02:28:50 smithi039 ceph-mon[30515]: from='client.24110 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi039:vg_nvme/lv_4", "target": ["mon-mgr", ""]}]: dispatch 2024-09-12T02:28:50.948 INFO:journalctl@ceph.mgr.y.smithi044.stdout:Sep 12 02:28:50 smithi044 systemd[1]: Started Ceph mgr.y for 4954ed46-70ae-11ef-bcea-c7b262605968. 2024-09-12T02:28:50.949 INFO:journalctl@ceph.mgr.y.smithi044.stdout:Sep 12 02:28:50 smithi044 ceph-4954ed46-70ae-11ef-bcea-c7b262605968-mgr-y[36777]: 2024-09-12T02:28:50.735+0000 7f767d95a040 -1 mgr[py] Module osd_perf_query has missing NOTIFY_TYPES member 2024-09-12T02:28:50.949 INFO:journalctl@ceph.mgr.y.smithi044.stdout:Sep 12 02:28:50 smithi044 ceph-4954ed46-70ae-11ef-bcea-c7b262605968-mgr-y[36777]: 2024-09-12T02:28:50.794+0000 7f767d95a040 -1 mgr[py] Module osd_support has missing NOTIFY_TYPES member 2024-09-12T02:28:51.347 INFO:journalctl@ceph.mgr.y.smithi044.stdout:Sep 12 02:28:50 smithi044 ceph-4954ed46-70ae-11ef-bcea-c7b262605968-mgr-y[36777]: 2024-09-12T02:28:50.950+0000 7f767d95a040 -1 mgr[py] Module diskprediction_local has missing NOTIFY_TYPES member 2024-09-12T02:28:51.347 INFO:journalctl@ceph.mgr.y.smithi044.stdout:Sep 12 02:28:51 smithi044 ceph-4954ed46-70ae-11ef-bcea-c7b262605968-mgr-y[36777]: 2024-09-12T02:28:51.021+0000 7f767d95a040 -1 mgr[py] Module crash has missing NOTIFY_TYPES member 2024-09-12T02:28:51.347 INFO:journalctl@ceph.mgr.y.smithi044.stdout:Sep 12 02:28:51 smithi044 ceph-4954ed46-70ae-11ef-bcea-c7b262605968-mgr-y[36777]: 2024-09-12T02:28:51.180+0000 7f767d95a040 -1 mgr[py] Module test_orchestrator has missing NOTIFY_TYPES member 2024-09-12T02:28:51.347 INFO:journalctl@ceph.mgr.y.smithi044.stdout:Sep 12 02:28:51 smithi044 ceph-4954ed46-70ae-11ef-bcea-c7b262605968-mgr-y[36777]: 2024-09-12T02:28:51.346+0000 7f767d95a040 -1 mgr[py] Module snap_schedule has missing NOTIFY_TYPES member 2024-09-12T02:28:51.479 INFO:journalctl@ceph.mgr.z.smithi172.stdout:Sep 12 02:28:51 smithi172 ceph-4954ed46-70ae-11ef-bcea-c7b262605968-mgr-z[37423]: 2024-09-12T02:28:51.201+0000 7efd0e543040 -1 mgr[py] Module rook has missing NOTIFY_TYPES member 2024-09-12T02:28:51.479 INFO:journalctl@ceph.mgr.z.smithi172.stdout:Sep 12 02:28:51 smithi172 ceph-4954ed46-70ae-11ef-bcea-c7b262605968-mgr-z[37423]: 2024-09-12T02:28:51.333+0000 7efd0e543040 -1 mgr[py] Module iostat has missing NOTIFY_TYPES member 2024-09-12T02:28:51.479 INFO:journalctl@ceph.mgr.z.smithi172.stdout:Sep 12 02:28:51 smithi172 ceph-4954ed46-70ae-11ef-bcea-c7b262605968-mgr-z[37423]: 2024-09-12T02:28:51.477+0000 7efd0e543040 -1 mgr[py] Module orchestrator has missing NOTIFY_TYPES member 2024-09-12T02:28:51.746 INFO:journalctl@ceph.mgr.z.smithi172.stdout:Sep 12 02:28:51 smithi172 ceph-4954ed46-70ae-11ef-bcea-c7b262605968-mgr-z[37423]: 2024-09-12T02:28:51.540+0000 7efd0e543040 -1 mgr[py] Module devicehealth has missing NOTIFY_TYPES member 2024-09-12T02:28:51.746 INFO:journalctl@ceph.mgr.z.smithi172.stdout:Sep 12 02:28:51 smithi172 ceph-4954ed46-70ae-11ef-bcea-c7b262605968-mgr-z[37423]: 2024-09-12T02:28:51.698+0000 7efd0e543040 -1 mgr[py] Module rgw has missing NOTIFY_TYPES member 2024-09-12T02:28:51.849 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 02:28:51 smithi039 ceph-mon[30515]: pgmap v27: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-12T02:28:51.850 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 02:28:51 smithi039 ceph-mon[30515]: from='mgr.14150 172.21.15.39:0/408627207' entity='mgr.x' 2024-09-12T02:28:51.850 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 02:28:51 smithi039 ceph-mon[30515]: from='mgr.14150 172.21.15.39:0/408627207' entity='mgr.x' 2024-09-12T02:28:51.850 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 02:28:51 smithi039 ceph-mon[30515]: from='mgr.14150 172.21.15.39:0/408627207' entity='mgr.x' 2024-09-12T02:28:51.850 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 02:28:51 smithi039 ceph-mon[30515]: from='mgr.14150 172.21.15.39:0/408627207' entity='mgr.x' 2024-09-12T02:28:51.850 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 02:28:51 smithi039 ceph-mon[30515]: from='mgr.14150 172.21.15.39:0/408627207' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-12T02:28:51.948 INFO:journalctl@ceph.mgr.y.smithi044.stdout:Sep 12 02:28:51 smithi044 ceph-4954ed46-70ae-11ef-bcea-c7b262605968-mgr-y[36777]: 2024-09-12T02:28:51.682+0000 7f767d95a040 -1 mgr[py] Module prometheus has missing NOTIFY_TYPES member 2024-09-12T02:28:51.948 INFO:journalctl@ceph.mgr.y.smithi044.stdout:Sep 12 02:28:51 smithi044 ceph-4954ed46-70ae-11ef-bcea-c7b262605968-mgr-y[36777]: 2024-09-12T02:28:51.746+0000 7f767d95a040 -1 mgr[py] Module selftest has missing NOTIFY_TYPES member 2024-09-12T02:28:51.948 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 12 02:28:51 smithi044 ceph-mon[35411]: pgmap v27: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-12T02:28:51.949 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 12 02:28:51 smithi044 ceph-mon[35411]: from='mgr.14150 172.21.15.39:0/408627207' entity='mgr.x' 2024-09-12T02:28:51.949 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 12 02:28:51 smithi044 ceph-mon[35411]: from='mgr.14150 172.21.15.39:0/408627207' entity='mgr.x' 2024-09-12T02:28:51.949 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 12 02:28:51 smithi044 ceph-mon[35411]: from='mgr.14150 172.21.15.39:0/408627207' entity='mgr.x' 2024-09-12T02:28:51.949 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 12 02:28:51 smithi044 ceph-mon[35411]: from='mgr.14150 172.21.15.39:0/408627207' entity='mgr.x' 2024-09-12T02:28:51.949 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 12 02:28:51 smithi044 ceph-mon[35411]: from='mgr.14150 172.21.15.39:0/408627207' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-12T02:28:51.997 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 12 02:28:51 smithi172 ceph-mon[35609]: pgmap v27: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-12T02:28:51.997 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 12 02:28:51 smithi172 ceph-mon[35609]: from='mgr.14150 172.21.15.39:0/408627207' entity='mgr.x' 2024-09-12T02:28:51.998 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 12 02:28:51 smithi172 ceph-mon[35609]: from='mgr.14150 172.21.15.39:0/408627207' entity='mgr.x' 2024-09-12T02:28:51.998 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 12 02:28:51 smithi172 ceph-mon[35609]: from='mgr.14150 172.21.15.39:0/408627207' entity='mgr.x' 2024-09-12T02:28:51.998 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 12 02:28:51 smithi172 ceph-mon[35609]: from='mgr.14150 172.21.15.39:0/408627207' entity='mgr.x' 2024-09-12T02:28:51.998 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 12 02:28:51 smithi172 ceph-mon[35609]: from='mgr.14150 172.21.15.39:0/408627207' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-12T02:28:51.998 INFO:journalctl@ceph.mgr.z.smithi172.stdout:Sep 12 02:28:51 smithi172 ceph-4954ed46-70ae-11ef-bcea-c7b262605968-mgr-z[37423]: 2024-09-12T02:28:51.769+0000 7efd0e543040 -1 mgr[py] Module alerts has missing NOTIFY_TYPES member 2024-09-12T02:28:51.998 INFO:journalctl@ceph.mgr.z.smithi172.stdout:Sep 12 02:28:51 smithi172 ceph-4954ed46-70ae-11ef-bcea-c7b262605968-mgr-z[37423]: 2024-09-12T02:28:51.830+0000 7efd0e543040 -1 mgr[py] Module progress has missing NOTIFY_TYPES member 2024-09-12T02:28:51.998 INFO:journalctl@ceph.mgr.z.smithi172.stdout:Sep 12 02:28:51 smithi172 ceph-4954ed46-70ae-11ef-bcea-c7b262605968-mgr-z[37423]: 2024-09-12T02:28:51.996+0000 7efd0e543040 -1 mgr[py] Module nfs has missing NOTIFY_TYPES member 2024-09-12T02:28:52.263 INFO:journalctl@ceph.mgr.z.smithi172.stdout:Sep 12 02:28:52 smithi172 ceph-4954ed46-70ae-11ef-bcea-c7b262605968-mgr-z[37423]: 2024-09-12T02:28:52.064+0000 7efd0e543040 -1 mgr[py] Module status has missing NOTIFY_TYPES member 2024-09-12T02:28:52.263 INFO:journalctl@ceph.mgr.z.smithi172.stdout:Sep 12 02:28:52 smithi172 ceph-4954ed46-70ae-11ef-bcea-c7b262605968-mgr-z[37423]: 2024-09-12T02:28:52.129+0000 7efd0e543040 -1 mgr[py] Module pg_autoscaler has missing NOTIFY_TYPES member 2024-09-12T02:28:52.263 INFO:journalctl@ceph.mgr.z.smithi172.stdout:Sep 12 02:28:52 smithi172 ceph-4954ed46-70ae-11ef-bcea-c7b262605968-mgr-z[37423]: 2024-09-12T02:28:52.215+0000 7efd0e543040 -1 mgr[py] Module rbd_support has missing NOTIFY_TYPES member 2024-09-12T02:28:52.448 INFO:journalctl@ceph.mgr.y.smithi044.stdout:Sep 12 02:28:51 smithi044 ceph-4954ed46-70ae-11ef-bcea-c7b262605968-mgr-y[36777]: 2024-09-12T02:28:51.949+0000 7f767d95a040 -1 mgr[py] Module volumes has missing NOTIFY_TYPES member 2024-09-12T02:28:52.763 INFO:journalctl@ceph.mgr.z.smithi172.stdout:Sep 12 02:28:52 smithi172 ceph-4954ed46-70ae-11ef-bcea-c7b262605968-mgr-z[37423]: 2024-09-12T02:28:52.274+0000 7efd0e543040 -1 mgr[py] Module influx has missing NOTIFY_TYPES member 2024-09-12T02:28:52.763 INFO:journalctl@ceph.mgr.z.smithi172.stdout:Sep 12 02:28:52 smithi172 ceph-4954ed46-70ae-11ef-bcea-c7b262605968-mgr-z[37423]: 2024-09-12T02:28:52.335+0000 7efd0e543040 -1 mgr[py] Module zabbix has missing NOTIFY_TYPES member 2024-09-12T02:28:53.099 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 02:28:52 smithi039 ceph-mon[30515]: from='mgr.14150 172.21.15.39:0/408627207' entity='mgr.x' 2024-09-12T02:28:53.100 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 02:28:52 smithi039 ceph-mon[30515]: from='mgr.14150 172.21.15.39:0/408627207' entity='mgr.x' 2024-09-12T02:28:53.100 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 02:28:52 smithi039 ceph-mon[30515]: from='client.? 172.21.15.39:0/3020031947' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "c967b48e-8a39-4797-871b-8b1b83d9472f"}]: dispatch 2024-09-12T02:28:53.100 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 02:28:52 smithi039 ceph-mon[30515]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "c967b48e-8a39-4797-871b-8b1b83d9472f"}]: dispatch 2024-09-12T02:28:53.100 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 02:28:52 smithi039 ceph-mon[30515]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "c967b48e-8a39-4797-871b-8b1b83d9472f"}]': finished 2024-09-12T02:28:53.100 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 02:28:52 smithi039 ceph-mon[30515]: osdmap e5: 1 total, 0 up, 1 in 2024-09-12T02:28:53.100 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 02:28:52 smithi039 ceph-mon[30515]: from='mgr.14150 172.21.15.39:0/408627207' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-09-12T02:28:53.100 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 02:28:52 smithi039 ceph-mon[30515]: from='mgr.14150 172.21.15.39:0/408627207' entity='mgr.x' 2024-09-12T02:28:53.100 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 02:28:52 smithi039 ceph-mon[30515]: from='mgr.14150 172.21.15.39:0/408627207' entity='mgr.x' 2024-09-12T02:28:53.100 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 02:28:52 smithi039 ceph-mon[30515]: from='mgr.14150 172.21.15.39:0/408627207' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-12T02:28:53.100 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 02:28:52 smithi039 ceph-mon[30515]: from='mgr.14150 172.21.15.39:0/408627207' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-12T02:28:53.100 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 02:28:52 smithi039 ceph-mon[30515]: from='mgr.14150 172.21.15.39:0/408627207' entity='mgr.x' 2024-09-12T02:28:53.100 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 02:28:52 smithi039 ceph-mon[30515]: from='mgr.14150 172.21.15.39:0/408627207' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-12T02:28:53.101 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 02:28:52 smithi039 ceph-mon[30515]: from='mgr.14150 172.21.15.39:0/408627207' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-12T02:28:53.101 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 02:28:52 smithi039 ceph-mon[30515]: from='mgr.14150 172.21.15.39:0/408627207' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-12T02:28:53.101 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 02:28:52 smithi039 ceph-mon[30515]: from='mgr.14150 172.21.15.39:0/408627207' entity='mgr.x' 2024-09-12T02:28:53.101 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 02:28:52 smithi039 ceph-mon[30515]: from='client.? 172.21.15.39:0/3605818488' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-09-12T02:28:53.198 INFO:journalctl@ceph.mgr.y.smithi044.stdout:Sep 12 02:28:52 smithi044 ceph-4954ed46-70ae-11ef-bcea-c7b262605968-mgr-y[36777]: 2024-09-12T02:28:52.871+0000 7f767d95a040 -1 mgr[py] Module telemetry has missing NOTIFY_TYPES member 2024-09-12T02:28:53.198 INFO:journalctl@ceph.mgr.y.smithi044.stdout:Sep 12 02:28:52 smithi044 ceph-4954ed46-70ae-11ef-bcea-c7b262605968-mgr-y[36777]: 2024-09-12T02:28:52.941+0000 7f767d95a040 -1 mgr[py] Module balancer has missing NOTIFY_TYPES member 2024-09-12T02:28:53.199 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 12 02:28:52 smithi044 ceph-mon[35411]: from='mgr.14150 172.21.15.39:0/408627207' entity='mgr.x' 2024-09-12T02:28:53.199 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 12 02:28:52 smithi044 ceph-mon[35411]: from='mgr.14150 172.21.15.39:0/408627207' entity='mgr.x' 2024-09-12T02:28:53.199 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 12 02:28:52 smithi044 ceph-mon[35411]: from='client.? 172.21.15.39:0/3020031947' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "c967b48e-8a39-4797-871b-8b1b83d9472f"}]: dispatch 2024-09-12T02:28:53.199 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 12 02:28:52 smithi044 ceph-mon[35411]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "c967b48e-8a39-4797-871b-8b1b83d9472f"}]: dispatch 2024-09-12T02:28:53.199 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 12 02:28:52 smithi044 ceph-mon[35411]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "c967b48e-8a39-4797-871b-8b1b83d9472f"}]': finished 2024-09-12T02:28:53.199 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 12 02:28:52 smithi044 ceph-mon[35411]: osdmap e5: 1 total, 0 up, 1 in 2024-09-12T02:28:53.199 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 12 02:28:52 smithi044 ceph-mon[35411]: from='mgr.14150 172.21.15.39:0/408627207' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-09-12T02:28:53.199 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 12 02:28:52 smithi044 ceph-mon[35411]: from='mgr.14150 172.21.15.39:0/408627207' entity='mgr.x' 2024-09-12T02:28:53.199 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 12 02:28:52 smithi044 ceph-mon[35411]: from='mgr.14150 172.21.15.39:0/408627207' entity='mgr.x' 2024-09-12T02:28:53.199 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 12 02:28:52 smithi044 ceph-mon[35411]: from='mgr.14150 172.21.15.39:0/408627207' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-12T02:28:53.199 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 12 02:28:52 smithi044 ceph-mon[35411]: from='mgr.14150 172.21.15.39:0/408627207' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-12T02:28:53.199 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 12 02:28:52 smithi044 ceph-mon[35411]: from='mgr.14150 172.21.15.39:0/408627207' entity='mgr.x' 2024-09-12T02:28:53.199 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 12 02:28:52 smithi044 ceph-mon[35411]: from='mgr.14150 172.21.15.39:0/408627207' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-12T02:28:53.199 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 12 02:28:52 smithi044 ceph-mon[35411]: from='mgr.14150 172.21.15.39:0/408627207' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-12T02:28:53.200 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 12 02:28:52 smithi044 ceph-mon[35411]: from='mgr.14150 172.21.15.39:0/408627207' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-12T02:28:53.200 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 12 02:28:52 smithi044 ceph-mon[35411]: from='mgr.14150 172.21.15.39:0/408627207' entity='mgr.x' 2024-09-12T02:28:53.200 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 12 02:28:52 smithi044 ceph-mon[35411]: from='client.? 172.21.15.39:0/3605818488' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-09-12T02:28:53.263 INFO:journalctl@ceph.mgr.z.smithi172.stdout:Sep 12 02:28:53 smithi172 ceph-4954ed46-70ae-11ef-bcea-c7b262605968-mgr-z[37423]: 2024-09-12T02:28:53.123+0000 7efd0e543040 -1 mgr[py] Module telegraf has missing NOTIFY_TYPES member 2024-09-12T02:28:53.264 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 12 02:28:52 smithi172 ceph-mon[35609]: from='mgr.14150 172.21.15.39:0/408627207' entity='mgr.x' 2024-09-12T02:28:53.264 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 12 02:28:52 smithi172 ceph-mon[35609]: from='mgr.14150 172.21.15.39:0/408627207' entity='mgr.x' 2024-09-12T02:28:53.264 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 12 02:28:52 smithi172 ceph-mon[35609]: from='client.? 172.21.15.39:0/3020031947' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "c967b48e-8a39-4797-871b-8b1b83d9472f"}]: dispatch 2024-09-12T02:28:53.264 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 12 02:28:52 smithi172 ceph-mon[35609]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "c967b48e-8a39-4797-871b-8b1b83d9472f"}]: dispatch 2024-09-12T02:28:53.264 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 12 02:28:52 smithi172 ceph-mon[35609]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "c967b48e-8a39-4797-871b-8b1b83d9472f"}]': finished 2024-09-12T02:28:53.264 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 12 02:28:52 smithi172 ceph-mon[35609]: osdmap e5: 1 total, 0 up, 1 in 2024-09-12T02:28:53.264 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 12 02:28:52 smithi172 ceph-mon[35609]: from='mgr.14150 172.21.15.39:0/408627207' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-09-12T02:28:53.264 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 12 02:28:52 smithi172 ceph-mon[35609]: from='mgr.14150 172.21.15.39:0/408627207' entity='mgr.x' 2024-09-12T02:28:53.264 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 12 02:28:52 smithi172 ceph-mon[35609]: from='mgr.14150 172.21.15.39:0/408627207' entity='mgr.x' 2024-09-12T02:28:53.264 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 12 02:28:52 smithi172 ceph-mon[35609]: from='mgr.14150 172.21.15.39:0/408627207' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-12T02:28:53.264 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 12 02:28:52 smithi172 ceph-mon[35609]: from='mgr.14150 172.21.15.39:0/408627207' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-12T02:28:53.265 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 12 02:28:52 smithi172 ceph-mon[35609]: from='mgr.14150 172.21.15.39:0/408627207' entity='mgr.x' 2024-09-12T02:28:53.265 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 12 02:28:52 smithi172 ceph-mon[35609]: from='mgr.14150 172.21.15.39:0/408627207' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-12T02:28:53.265 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 12 02:28:52 smithi172 ceph-mon[35609]: from='mgr.14150 172.21.15.39:0/408627207' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-12T02:28:53.265 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 12 02:28:52 smithi172 ceph-mon[35609]: from='mgr.14150 172.21.15.39:0/408627207' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-12T02:28:53.265 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 12 02:28:52 smithi172 ceph-mon[35609]: from='mgr.14150 172.21.15.39:0/408627207' entity='mgr.x' 2024-09-12T02:28:53.265 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 12 02:28:52 smithi172 ceph-mon[35609]: from='client.? 172.21.15.39:0/3605818488' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-09-12T02:28:53.948 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:28:53.947+0000 7f3f76a00640 1 -- 172.21.15.39:0/2171750691 <== mon.2 v2:172.21.15.44:3300/0 7 ==== mgrmap(e 14) ==== 92060+0+0 (secure 0 0 0) 0x7f3f6c003800 con 0x7f3f80104e50 2024-09-12T02:28:53.949 INFO:journalctl@ceph.mgr.y.smithi044.stdout:Sep 12 02:28:53 smithi044 ceph-4954ed46-70ae-11ef-bcea-c7b262605968-mgr-y[36777]: 2024-09-12T02:28:53.689+0000 7f767d95a040 -1 mgr[py] Module rook has missing NOTIFY_TYPES member 2024-09-12T02:28:53.949 INFO:journalctl@ceph.mgr.y.smithi044.stdout:Sep 12 02:28:53 smithi044 ceph-4954ed46-70ae-11ef-bcea-c7b262605968-mgr-y[36777]: 2024-09-12T02:28:53.809+0000 7f767d95a040 -1 mgr[py] Module iostat has missing NOTIFY_TYPES member 2024-09-12T02:28:53.949 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 12 02:28:53 smithi044 ceph-mon[35411]: pgmap v29: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-12T02:28:53.949 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 12 02:28:53 smithi044 ceph-mon[35411]: Standby manager daemon z started 2024-09-12T02:28:53.949 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 12 02:28:53 smithi044 ceph-mon[35411]: from='mgr.? 172.21.15.172:0/2233990107' entity='mgr.z' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/z/crt"}]: dispatch 2024-09-12T02:28:53.949 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 12 02:28:53 smithi044 ceph-mon[35411]: from='mgr.? 172.21.15.172:0/2233990107' entity='mgr.z' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/crt"}]: dispatch 2024-09-12T02:28:53.949 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 12 02:28:53 smithi044 ceph-mon[35411]: from='mgr.? 172.21.15.172:0/2233990107' entity='mgr.z' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/z/key"}]: dispatch 2024-09-12T02:28:53.949 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 12 02:28:53 smithi044 ceph-mon[35411]: from='mgr.? 172.21.15.172:0/2233990107' entity='mgr.z' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/key"}]: dispatch 2024-09-12T02:28:54.249 INFO:journalctl@ceph.mgr.y.smithi044.stdout:Sep 12 02:28:53 smithi044 ceph-4954ed46-70ae-11ef-bcea-c7b262605968-mgr-y[36777]: 2024-09-12T02:28:53.958+0000 7f767d95a040 -1 mgr[py] Module orchestrator has missing NOTIFY_TYPES member 2024-09-12T02:28:54.249 INFO:journalctl@ceph.mgr.y.smithi044.stdout:Sep 12 02:28:54 smithi044 ceph-4954ed46-70ae-11ef-bcea-c7b262605968-mgr-y[36777]: 2024-09-12T02:28:54.022+0000 7f767d95a040 -1 mgr[py] Module devicehealth has missing NOTIFY_TYPES member 2024-09-12T02:28:54.250 INFO:journalctl@ceph.mgr.y.smithi044.stdout:Sep 12 02:28:54 smithi044 ceph-4954ed46-70ae-11ef-bcea-c7b262605968-mgr-y[36777]: 2024-09-12T02:28:54.178+0000 7f767d95a040 -1 mgr[py] Module rgw has missing NOTIFY_TYPES member 2024-09-12T02:28:54.250 INFO:journalctl@ceph.mgr.y.smithi044.stdout:Sep 12 02:28:54 smithi044 ceph-4954ed46-70ae-11ef-bcea-c7b262605968-mgr-y[36777]: 2024-09-12T02:28:54.248+0000 7f767d95a040 -1 mgr[py] Module alerts has missing NOTIFY_TYPES member 2024-09-12T02:28:54.263 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 12 02:28:53 smithi172 ceph-mon[35609]: pgmap v29: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-12T02:28:54.264 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 12 02:28:53 smithi172 ceph-mon[35609]: Standby manager daemon z started 2024-09-12T02:28:54.264 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 12 02:28:53 smithi172 ceph-mon[35609]: from='mgr.? 172.21.15.172:0/2233990107' entity='mgr.z' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/z/crt"}]: dispatch 2024-09-12T02:28:54.264 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 12 02:28:53 smithi172 ceph-mon[35609]: from='mgr.? 172.21.15.172:0/2233990107' entity='mgr.z' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/crt"}]: dispatch 2024-09-12T02:28:54.264 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 12 02:28:53 smithi172 ceph-mon[35609]: from='mgr.? 172.21.15.172:0/2233990107' entity='mgr.z' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/z/key"}]: dispatch 2024-09-12T02:28:54.264 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 12 02:28:53 smithi172 ceph-mon[35609]: from='mgr.? 172.21.15.172:0/2233990107' entity='mgr.z' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/key"}]: dispatch 2024-09-12T02:28:54.350 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 02:28:53 smithi039 ceph-mon[30515]: pgmap v29: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-12T02:28:54.350 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 02:28:53 smithi039 ceph-mon[30515]: Standby manager daemon z started 2024-09-12T02:28:54.350 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 02:28:53 smithi039 ceph-mon[30515]: from='mgr.? 172.21.15.172:0/2233990107' entity='mgr.z' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/z/crt"}]: dispatch 2024-09-12T02:28:54.350 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 02:28:53 smithi039 ceph-mon[30515]: from='mgr.? 172.21.15.172:0/2233990107' entity='mgr.z' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/crt"}]: dispatch 2024-09-12T02:28:54.350 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 02:28:53 smithi039 ceph-mon[30515]: from='mgr.? 172.21.15.172:0/2233990107' entity='mgr.z' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/z/key"}]: dispatch 2024-09-12T02:28:54.350 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 02:28:53 smithi039 ceph-mon[30515]: from='mgr.? 172.21.15.172:0/2233990107' entity='mgr.z' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/key"}]: dispatch 2024-09-12T02:28:54.543 INFO:journalctl@ceph.mgr.y.smithi044.stdout:Sep 12 02:28:54 smithi044 ceph-4954ed46-70ae-11ef-bcea-c7b262605968-mgr-y[36777]: 2024-09-12T02:28:54.310+0000 7f767d95a040 -1 mgr[py] Module progress has missing NOTIFY_TYPES member 2024-09-12T02:28:54.543 INFO:journalctl@ceph.mgr.y.smithi044.stdout:Sep 12 02:28:54 smithi044 ceph-4954ed46-70ae-11ef-bcea-c7b262605968-mgr-y[36777]: 2024-09-12T02:28:54.474+0000 7f767d95a040 -1 mgr[py] Module nfs has missing NOTIFY_TYPES member 2024-09-12T02:28:54.543 INFO:journalctl@ceph.mgr.y.smithi044.stdout:Sep 12 02:28:54 smithi044 ceph-4954ed46-70ae-11ef-bcea-c7b262605968-mgr-y[36777]: 2024-09-12T02:28:54.542+0000 7f767d95a040 -1 mgr[py] Module status has missing NOTIFY_TYPES member 2024-09-12T02:28:54.820 INFO:journalctl@ceph.mgr.y.smithi044.stdout:Sep 12 02:28:54 smithi044 ceph-4954ed46-70ae-11ef-bcea-c7b262605968-mgr-y[36777]: 2024-09-12T02:28:54.611+0000 7f767d95a040 -1 mgr[py] Module pg_autoscaler has missing NOTIFY_TYPES member 2024-09-12T02:28:54.821 INFO:journalctl@ceph.mgr.y.smithi044.stdout:Sep 12 02:28:54 smithi044 ceph-4954ed46-70ae-11ef-bcea-c7b262605968-mgr-y[36777]: 2024-09-12T02:28:54.696+0000 7f767d95a040 -1 mgr[py] Module rbd_support has missing NOTIFY_TYPES member 2024-09-12T02:28:54.821 INFO:journalctl@ceph.mgr.y.smithi044.stdout:Sep 12 02:28:54 smithi044 ceph-4954ed46-70ae-11ef-bcea-c7b262605968-mgr-y[36777]: 2024-09-12T02:28:54.758+0000 7f767d95a040 -1 mgr[py] Module influx has missing NOTIFY_TYPES member 2024-09-12T02:28:54.821 INFO:journalctl@ceph.mgr.y.smithi044.stdout:Sep 12 02:28:54 smithi044 ceph-4954ed46-70ae-11ef-bcea-c7b262605968-mgr-y[36777]: 2024-09-12T02:28:54.819+0000 7f767d95a040 -1 mgr[py] Module zabbix has missing NOTIFY_TYPES member 2024-09-12T02:28:55.198 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 12 02:28:54 smithi044 ceph-mon[35411]: mgrmap e14: x(active, since 69s), standbys: z 2024-09-12T02:28:55.198 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 12 02:28:54 smithi044 ceph-mon[35411]: from='mgr.14150 172.21.15.39:0/408627207' entity='mgr.x' cmd=[{"prefix": "mgr metadata", "who": "z", "id": "z"}]: dispatch 2024-09-12T02:28:55.198 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 12 02:28:54 smithi044 ceph-mon[35411]: from='mgr.14150 172.21.15.39:0/408627207' entity='mgr.x' 2024-09-12T02:28:55.263 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 12 02:28:54 smithi172 ceph-mon[35609]: mgrmap e14: x(active, since 69s), standbys: z 2024-09-12T02:28:55.263 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 12 02:28:54 smithi172 ceph-mon[35609]: from='mgr.14150 172.21.15.39:0/408627207' entity='mgr.x' cmd=[{"prefix": "mgr metadata", "who": "z", "id": "z"}]: dispatch 2024-09-12T02:28:55.263 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 12 02:28:54 smithi172 ceph-mon[35609]: from='mgr.14150 172.21.15.39:0/408627207' entity='mgr.x' 2024-09-12T02:28:55.350 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 02:28:54 smithi039 ceph-mon[30515]: mgrmap e14: x(active, since 69s), standbys: z 2024-09-12T02:28:55.350 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 02:28:54 smithi039 ceph-mon[30515]: from='mgr.14150 172.21.15.39:0/408627207' entity='mgr.x' cmd=[{"prefix": "mgr metadata", "who": "z", "id": "z"}]: dispatch 2024-09-12T02:28:55.350 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 02:28:54 smithi039 ceph-mon[30515]: from='mgr.14150 172.21.15.39:0/408627207' entity='mgr.x' 2024-09-12T02:28:55.948 INFO:journalctl@ceph.mgr.y.smithi044.stdout:Sep 12 02:28:55 smithi044 ceph-4954ed46-70ae-11ef-bcea-c7b262605968-mgr-y[36777]: 2024-09-12T02:28:55.643+0000 7f767d95a040 -1 mgr[py] Module telegraf has missing NOTIFY_TYPES member 2024-09-12T02:28:55.964 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:28:55.963+0000 7f3f76a00640 1 -- 172.21.15.39:0/2171750691 <== mon.2 v2:172.21.15.44:3300/0 8 ==== mgrmap(e 15) ==== 137777+0+0 (secure 0 0 0) 0x7f3f6c03b460 con 0x7f3f80104e50 2024-09-12T02:28:56.263 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 12 02:28:55 smithi172 ceph-mon[35609]: pgmap v30: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-12T02:28:56.264 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 12 02:28:55 smithi172 ceph-mon[35609]: Standby manager daemon y started 2024-09-12T02:28:56.264 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 12 02:28:55 smithi172 ceph-mon[35609]: from='mgr.? 172.21.15.44:0/900234755' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/y/crt"}]: dispatch 2024-09-12T02:28:56.264 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 12 02:28:55 smithi172 ceph-mon[35609]: from='mgr.? 172.21.15.44:0/900234755' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/crt"}]: dispatch 2024-09-12T02:28:56.264 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 12 02:28:55 smithi172 ceph-mon[35609]: from='mgr.? 172.21.15.44:0/900234755' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/y/key"}]: dispatch 2024-09-12T02:28:56.264 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 12 02:28:55 smithi172 ceph-mon[35609]: from='mgr.? 172.21.15.44:0/900234755' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/key"}]: dispatch 2024-09-12T02:28:56.349 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 02:28:55 smithi039 ceph-mon[30515]: pgmap v30: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-12T02:28:56.350 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 02:28:55 smithi039 ceph-mon[30515]: Standby manager daemon y started 2024-09-12T02:28:56.350 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 02:28:55 smithi039 ceph-mon[30515]: from='mgr.? 172.21.15.44:0/900234755' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/y/crt"}]: dispatch 2024-09-12T02:28:56.350 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 02:28:55 smithi039 ceph-mon[30515]: from='mgr.? 172.21.15.44:0/900234755' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/crt"}]: dispatch 2024-09-12T02:28:56.350 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 02:28:55 smithi039 ceph-mon[30515]: from='mgr.? 172.21.15.44:0/900234755' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/y/key"}]: dispatch 2024-09-12T02:28:56.350 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 02:28:55 smithi039 ceph-mon[30515]: from='mgr.? 172.21.15.44:0/900234755' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/key"}]: dispatch 2024-09-12T02:28:56.448 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 12 02:28:55 smithi044 ceph-mon[35411]: pgmap v30: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-12T02:28:56.449 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 12 02:28:55 smithi044 ceph-mon[35411]: Standby manager daemon y started 2024-09-12T02:28:56.449 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 12 02:28:55 smithi044 ceph-mon[35411]: from='mgr.? 172.21.15.44:0/900234755' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/y/crt"}]: dispatch 2024-09-12T02:28:56.449 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 12 02:28:55 smithi044 ceph-mon[35411]: from='mgr.? 172.21.15.44:0/900234755' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/crt"}]: dispatch 2024-09-12T02:28:56.449 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 12 02:28:55 smithi044 ceph-mon[35411]: from='mgr.? 172.21.15.44:0/900234755' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/y/key"}]: dispatch 2024-09-12T02:28:56.449 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 12 02:28:55 smithi044 ceph-mon[35411]: from='mgr.? 172.21.15.44:0/900234755' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/key"}]: dispatch 2024-09-12T02:28:57.087 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 02:28:56 smithi039 ceph-mon[30515]: mgrmap e15: x(active, since 71s), standbys: z, y 2024-09-12T02:28:57.088 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 02:28:56 smithi039 ceph-mon[30515]: from='mgr.14150 172.21.15.39:0/408627207' entity='mgr.x' cmd=[{"prefix": "mgr metadata", "who": "y", "id": "y"}]: dispatch 2024-09-12T02:28:57.263 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 12 02:28:56 smithi172 ceph-mon[35609]: mgrmap e15: x(active, since 71s), standbys: z, y 2024-09-12T02:28:57.263 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 12 02:28:56 smithi172 ceph-mon[35609]: from='mgr.14150 172.21.15.39:0/408627207' entity='mgr.x' cmd=[{"prefix": "mgr metadata", "who": "y", "id": "y"}]: dispatch 2024-09-12T02:28:57.448 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 12 02:28:56 smithi044 ceph-mon[35411]: mgrmap e15: x(active, since 71s), standbys: z, y 2024-09-12T02:28:57.449 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 12 02:28:56 smithi044 ceph-mon[35411]: from='mgr.14150 172.21.15.39:0/408627207' entity='mgr.x' cmd=[{"prefix": "mgr metadata", "who": "y", "id": "y"}]: dispatch 2024-09-12T02:28:58.223 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 02:28:57 smithi039 ceph-mon[30515]: pgmap v31: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-12T02:28:58.263 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 12 02:28:57 smithi172 ceph-mon[35609]: pgmap v31: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-12T02:28:58.448 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 12 02:28:57 smithi044 ceph-mon[35411]: pgmap v31: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-12T02:29:00.251 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 12 02:28:59 smithi044 ceph-mon[35411]: pgmap v32: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-12T02:29:00.263 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 12 02:28:59 smithi172 ceph-mon[35609]: pgmap v32: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-12T02:29:00.349 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 02:28:59 smithi039 ceph-mon[30515]: pgmap v32: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-12T02:29:01.013 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 12 02:29:00 smithi172 ceph-mon[35609]: from='mgr.14150 172.21.15.39:0/408627207' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.0"}]: dispatch 2024-09-12T02:29:01.013 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 12 02:29:00 smithi172 ceph-mon[35609]: from='mgr.14150 172.21.15.39:0/408627207' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-12T02:29:01.099 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 02:29:00 smithi039 ceph-mon[30515]: from='mgr.14150 172.21.15.39:0/408627207' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.0"}]: dispatch 2024-09-12T02:29:01.099 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 02:29:00 smithi039 ceph-mon[30515]: from='mgr.14150 172.21.15.39:0/408627207' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-12T02:29:01.267 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 12 02:29:00 smithi044 ceph-mon[35411]: from='mgr.14150 172.21.15.39:0/408627207' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.0"}]: dispatch 2024-09-12T02:29:01.267 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 12 02:29:00 smithi044 ceph-mon[35411]: from='mgr.14150 172.21.15.39:0/408627207' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-12T02:29:02.263 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 12 02:29:01 smithi172 ceph-mon[35609]: pgmap v33: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-12T02:29:02.263 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 12 02:29:01 smithi172 ceph-mon[35609]: Deploying daemon osd.0 on smithi039 2024-09-12T02:29:02.350 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 02:29:01 smithi039 ceph-mon[30515]: pgmap v33: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-12T02:29:02.350 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 02:29:01 smithi039 ceph-mon[30515]: Deploying daemon osd.0 on smithi039 2024-09-12T02:29:02.448 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 12 02:29:01 smithi044 ceph-mon[35411]: pgmap v33: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-12T02:29:02.448 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 12 02:29:01 smithi044 ceph-mon[35411]: Deploying daemon osd.0 on smithi039 2024-09-12T02:29:04.151 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 02:29:03 smithi039 ceph-mon[30515]: pgmap v34: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-12T02:29:04.263 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 12 02:29:03 smithi172 ceph-mon[35609]: pgmap v34: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-12T02:29:04.448 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 12 02:29:03 smithi044 ceph-mon[35411]: pgmap v34: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-12T02:29:06.263 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 12 02:29:05 smithi172 ceph-mon[35609]: pgmap v35: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-12T02:29:06.350 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 02:29:05 smithi039 ceph-mon[30515]: pgmap v35: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-12T02:29:06.448 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 12 02:29:05 smithi044 ceph-mon[35411]: pgmap v35: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-12T02:29:08.249 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 02:29:07 smithi039 ceph-mon[30515]: pgmap v36: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-12T02:29:08.264 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 12 02:29:07 smithi172 ceph-mon[35609]: pgmap v36: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-12T02:29:08.448 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 12 02:29:07 smithi044 ceph-mon[35411]: pgmap v36: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-12T02:29:09.263 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 12 02:29:08 smithi172 ceph-mon[35609]: from='mgr.14150 172.21.15.39:0/408627207' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-12T02:29:09.264 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 12 02:29:08 smithi172 ceph-mon[35609]: from='mgr.14150 172.21.15.39:0/408627207' entity='mgr.x' 2024-09-12T02:29:09.264 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 12 02:29:08 smithi172 ceph-mon[35609]: from='mgr.14150 172.21.15.39:0/408627207' entity='mgr.x' 2024-09-12T02:29:09.329 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 02:29:08 smithi039 ceph-mon[30515]: from='mgr.14150 172.21.15.39:0/408627207' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-12T02:29:09.329 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 02:29:08 smithi039 ceph-mon[30515]: from='mgr.14150 172.21.15.39:0/408627207' entity='mgr.x' 2024-09-12T02:29:09.329 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 02:29:08 smithi039 ceph-mon[30515]: from='mgr.14150 172.21.15.39:0/408627207' entity='mgr.x' 2024-09-12T02:29:09.448 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 12 02:29:08 smithi044 ceph-mon[35411]: from='mgr.14150 172.21.15.39:0/408627207' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-12T02:29:09.449 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 12 02:29:08 smithi044 ceph-mon[35411]: from='mgr.14150 172.21.15.39:0/408627207' entity='mgr.x' 2024-09-12T02:29:09.449 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 12 02:29:08 smithi044 ceph-mon[35411]: from='mgr.14150 172.21.15.39:0/408627207' entity='mgr.x' 2024-09-12T02:29:10.791 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 02:29:10 smithi039 ceph-mon[30515]: pgmap v37: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-12T02:29:10.948 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 12 02:29:10 smithi044 ceph-mon[35411]: pgmap v37: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-12T02:29:11.013 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 12 02:29:10 smithi172 ceph-mon[35609]: pgmap v37: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-12T02:29:12.448 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 12 02:29:12 smithi044 ceph-mon[35411]: pgmap v38: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-12T02:29:12.564 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 12 02:29:12 smithi044 ceph-mon[35411]: from='mgr.14150 172.21.15.39:0/408627207' entity='mgr.x' 2024-09-12T02:29:12.565 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 12 02:29:12 smithi044 ceph-mon[35411]: from='mgr.14150 172.21.15.39:0/408627207' entity='mgr.x' 2024-09-12T02:29:12.565 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 12 02:29:12 smithi044 ceph-mon[35411]: from='mgr.14150 172.21.15.39:0/408627207' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-12T02:29:12.565 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 12 02:29:12 smithi044 ceph-mon[35411]: from='mgr.14150 172.21.15.39:0/408627207' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-12T02:29:12.565 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 12 02:29:12 smithi044 ceph-mon[35411]: from='mgr.14150 172.21.15.39:0/408627207' entity='mgr.x' 2024-09-12T02:29:12.565 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 12 02:29:12 smithi172 ceph-mon[35609]: pgmap v38: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-12T02:29:12.566 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 12 02:29:12 smithi172 ceph-mon[35609]: from='mgr.14150 172.21.15.39:0/408627207' entity='mgr.x' 2024-09-12T02:29:12.566 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 12 02:29:12 smithi172 ceph-mon[35609]: from='mgr.14150 172.21.15.39:0/408627207' entity='mgr.x' 2024-09-12T02:29:12.566 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 12 02:29:12 smithi172 ceph-mon[35609]: from='mgr.14150 172.21.15.39:0/408627207' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-12T02:29:12.566 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 12 02:29:12 smithi172 ceph-mon[35609]: from='mgr.14150 172.21.15.39:0/408627207' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-12T02:29:12.566 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 12 02:29:12 smithi172 ceph-mon[35609]: from='mgr.14150 172.21.15.39:0/408627207' entity='mgr.x' 2024-09-12T02:29:12.599 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 02:29:12 smithi039 ceph-mon[30515]: pgmap v38: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-12T02:29:12.599 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 02:29:12 smithi039 ceph-mon[30515]: from='mgr.14150 172.21.15.39:0/408627207' entity='mgr.x' 2024-09-12T02:29:12.599 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 02:29:12 smithi039 ceph-mon[30515]: from='mgr.14150 172.21.15.39:0/408627207' entity='mgr.x' 2024-09-12T02:29:12.599 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 02:29:12 smithi039 ceph-mon[30515]: from='mgr.14150 172.21.15.39:0/408627207' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-12T02:29:12.600 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 02:29:12 smithi039 ceph-mon[30515]: from='mgr.14150 172.21.15.39:0/408627207' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-12T02:29:12.600 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 02:29:12 smithi039 ceph-mon[30515]: from='mgr.14150 172.21.15.39:0/408627207' entity='mgr.x' 2024-09-12T02:29:13.552 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:29:13.550+0000 7f3f76a00640 1 -- 172.21.15.39:0/2171750691 <== mgr.14150 v2:172.21.15.39:6800/1725006999 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+37 (secure 0 0 0) 0x7f3f80062630 con 0x7f3f640392c0 2024-09-12T02:29:13.552 INFO:teuthology.orchestra.run.smithi039.stdout:Created osd(s) 0 on host 'smithi039' 2024-09-12T02:29:13.554 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:29:13.554+0000 7f3f7f200640 1 -- 172.21.15.39:0/2171750691 >> [v2:172.21.15.39:6800/1725006999,v1:172.21.15.39:6801/1725006999] conn(0x7f3f640392c0 msgr2=0x7f3f6403b780 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:29:13.554 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:29:13.554+0000 7f3f7f200640 1 --2- 172.21.15.39:0/2171750691 >> [v2:172.21.15.39:6800/1725006999,v1:172.21.15.39:6801/1725006999] conn(0x7f3f640392c0 0x7f3f6403b780 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 crypto rx=0x7f3f80104cb0 tx=0x7f3f7000b390 comp rx=0 tx=0).stop 2024-09-12T02:29:13.554 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:29:13.554+0000 7f3f7f200640 1 -- 172.21.15.39:0/2171750691 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f3f80104e50 msgr2=0x7f3f8019a470 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:29:13.555 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:29:13.554+0000 7f3f7f200640 1 --2- 172.21.15.39:0/2171750691 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f3f80104e50 0x7f3f8019a470 secure :-1 s=READY pgs=5 cs=0 l=1 rev1=1 crypto rx=0x7f3f6c031440 tx=0x7f3f6c032e20 comp rx=0 tx=0).stop 2024-09-12T02:29:13.555 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:29:13.554+0000 7f3f7f200640 1 -- 172.21.15.39:0/2171750691 shutdown_connections 2024-09-12T02:29:13.555 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:29:13.554+0000 7f3f7f200640 1 --2- 172.21.15.39:0/2171750691 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f3f80105810 0x7f3f801a14f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:29:13.555 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:29:13.554+0000 7f3f7f200640 1 --2- 172.21.15.39:0/2171750691 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f3f80104e50 0x7f3f8019a470 unknown :-1 s=CLOSED pgs=5 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:29:13.555 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:29:13.554+0000 7f3f7f200640 1 --2- 172.21.15.39:0/2171750691 >> [v2:172.21.15.39:6800/1725006999,v1:172.21.15.39:6801/1725006999] conn(0x7f3f640392c0 0x7f3f6403b780 unknown :-1 s=CLOSED pgs=44 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:29:13.555 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:29:13.554+0000 7f3f7f200640 1 --2- 172.21.15.39:0/2171750691 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f3f80103c50 0x7f3f80199f30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:29:13.555 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:29:13.554+0000 7f3f7f200640 1 -- 172.21.15.39:0/2171750691 >> 172.21.15.39:0/2171750691 conn(0x7f3f800ff3e0 msgr2=0x7f3f80108220 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:29:13.555 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:29:13.554+0000 7f3f7f200640 1 -- 172.21.15.39:0/2171750691 shutdown_connections 2024-09-12T02:29:13.555 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:29:13.554+0000 7f3f7f200640 1 -- 172.21.15.39:0/2171750691 wait complete. 2024-09-12T02:29:14.317 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 02:29:14 smithi039 ceph-mon[30515]: pgmap v39: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-12T02:29:14.317 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 02:29:14 smithi039 ceph-mon[30515]: from='mgr.14150 172.21.15.39:0/408627207' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-12T02:29:14.317 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 02:29:14 smithi039 ceph-mon[30515]: from='mgr.14150 172.21.15.39:0/408627207' entity='mgr.x' 2024-09-12T02:29:14.318 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 02:29:14 smithi039 ceph-mon[30515]: from='mgr.14150 172.21.15.39:0/408627207' entity='mgr.x' 2024-09-12T02:29:14.359 DEBUG:teuthology.orchestra.run.smithi039:osd.0> sudo journalctl -f -n 0 -u ceph-4954ed46-70ae-11ef-bcea-c7b262605968@osd.0.service 2024-09-12T02:29:14.364 INFO:tasks.cephadm:Deploying osd.1 on smithi044 with /dev/vg_nvme/lv_4... 2024-09-12T02:29:14.364 DEBUG:teuthology.orchestra.run.smithi044:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc ceph-volume -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 4954ed46-70ae-11ef-bcea-c7b262605968 -- lvm zap /dev/vg_nvme/lv_4 2024-09-12T02:29:14.448 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 12 02:29:14 smithi044 ceph-mon[35411]: pgmap v39: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-12T02:29:14.448 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 12 02:29:14 smithi044 ceph-mon[35411]: from='mgr.14150 172.21.15.39:0/408627207' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-12T02:29:14.449 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 12 02:29:14 smithi044 ceph-mon[35411]: from='mgr.14150 172.21.15.39:0/408627207' entity='mgr.x' 2024-09-12T02:29:14.449 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 12 02:29:14 smithi044 ceph-mon[35411]: from='mgr.14150 172.21.15.39:0/408627207' entity='mgr.x' 2024-09-12T02:29:14.513 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 12 02:29:14 smithi172 ceph-mon[35609]: pgmap v39: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-12T02:29:14.513 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 12 02:29:14 smithi172 ceph-mon[35609]: from='mgr.14150 172.21.15.39:0/408627207' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-12T02:29:14.513 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 12 02:29:14 smithi172 ceph-mon[35609]: from='mgr.14150 172.21.15.39:0/408627207' entity='mgr.x' 2024-09-12T02:29:14.514 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 12 02:29:14 smithi172 ceph-mon[35609]: from='mgr.14150 172.21.15.39:0/408627207' entity='mgr.x' 2024-09-12T02:29:14.629 INFO:teuthology.orchestra.run.smithi044.stderr:Inferring config /var/lib/ceph/4954ed46-70ae-11ef-bcea-c7b262605968/mon.b/config 2024-09-12T02:29:15.448 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 12 02:29:15 smithi044 ceph-mon[35411]: from='osd.0 [v2:172.21.15.39:6802/2437586899,v1:172.21.15.39:6803/2437586899]' entity='osd.0' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["0"]}]: dispatch 2024-09-12T02:29:15.513 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 12 02:29:15 smithi172 ceph-mon[35609]: from='osd.0 [v2:172.21.15.39:6802/2437586899,v1:172.21.15.39:6803/2437586899]' entity='osd.0' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["0"]}]: dispatch 2024-09-12T02:29:15.599 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 02:29:15 smithi039 ceph-mon[30515]: from='osd.0 [v2:172.21.15.39:6802/2437586899,v1:172.21.15.39:6803/2437586899]' entity='osd.0' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["0"]}]: dispatch 2024-09-12T02:29:16.379 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 12 02:29:16 smithi044 ceph-mon[35411]: pgmap v40: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-12T02:29:16.380 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 12 02:29:16 smithi044 ceph-mon[35411]: from='osd.0 [v2:172.21.15.39:6802/2437586899,v1:172.21.15.39:6803/2437586899]' entity='osd.0' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["0"]}]': finished 2024-09-12T02:29:16.380 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 12 02:29:16 smithi044 ceph-mon[35411]: osdmap e6: 1 total, 0 up, 1 in 2024-09-12T02:29:16.380 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 12 02:29:16 smithi044 ceph-mon[35411]: from='osd.0 [v2:172.21.15.39:6802/2437586899,v1:172.21.15.39:6803/2437586899]' entity='osd.0' cmd=[{"prefix": "osd crush create-or-move", "id": 0, "weight":0.0873, "args": ["host=smithi039", "root=default"]}]: dispatch 2024-09-12T02:29:16.380 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 12 02:29:16 smithi044 ceph-mon[35411]: from='mgr.14150 172.21.15.39:0/408627207' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-09-12T02:29:16.513 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 12 02:29:16 smithi172 ceph-mon[35609]: pgmap v40: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-12T02:29:16.513 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 12 02:29:16 smithi172 ceph-mon[35609]: from='osd.0 [v2:172.21.15.39:6802/2437586899,v1:172.21.15.39:6803/2437586899]' entity='osd.0' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["0"]}]': finished 2024-09-12T02:29:16.513 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 12 02:29:16 smithi172 ceph-mon[35609]: osdmap e6: 1 total, 0 up, 1 in 2024-09-12T02:29:16.514 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 12 02:29:16 smithi172 ceph-mon[35609]: from='osd.0 [v2:172.21.15.39:6802/2437586899,v1:172.21.15.39:6803/2437586899]' entity='osd.0' cmd=[{"prefix": "osd crush create-or-move", "id": 0, "weight":0.0873, "args": ["host=smithi039", "root=default"]}]: dispatch 2024-09-12T02:29:16.514 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 12 02:29:16 smithi172 ceph-mon[35609]: from='mgr.14150 172.21.15.39:0/408627207' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-09-12T02:29:16.599 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 02:29:16 smithi039 ceph-mon[30515]: pgmap v40: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-12T02:29:16.600 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 02:29:16 smithi039 ceph-mon[30515]: from='osd.0 [v2:172.21.15.39:6802/2437586899,v1:172.21.15.39:6803/2437586899]' entity='osd.0' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["0"]}]': finished 2024-09-12T02:29:16.600 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 02:29:16 smithi039 ceph-mon[30515]: osdmap e6: 1 total, 0 up, 1 in 2024-09-12T02:29:16.600 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 02:29:16 smithi039 ceph-mon[30515]: from='osd.0 [v2:172.21.15.39:6802/2437586899,v1:172.21.15.39:6803/2437586899]' entity='osd.0' cmd=[{"prefix": "osd crush create-or-move", "id": 0, "weight":0.0873, "args": ["host=smithi039", "root=default"]}]: dispatch 2024-09-12T02:29:16.600 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 02:29:16 smithi039 ceph-mon[30515]: from='mgr.14150 172.21.15.39:0/408627207' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-09-12T02:29:17.228 INFO:teuthology.orchestra.run.smithi044.stdout: 2024-09-12T02:29:17.251 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 12 02:29:17 smithi044 ceph-mon[35411]: from='osd.0 [v2:172.21.15.39:6802/2437586899,v1:172.21.15.39:6803/2437586899]' entity='osd.0' cmd='[{"prefix": "osd crush create-or-move", "id": 0, "weight":0.0873, "args": ["host=smithi039", "root=default"]}]': finished 2024-09-12T02:29:17.251 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 12 02:29:17 smithi044 ceph-mon[35411]: osdmap e7: 1 total, 0 up, 1 in 2024-09-12T02:29:17.251 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 12 02:29:17 smithi044 ceph-mon[35411]: from='mgr.14150 172.21.15.39:0/408627207' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-09-12T02:29:17.251 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 12 02:29:17 smithi044 ceph-mon[35411]: from='mgr.14150 172.21.15.39:0/408627207' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-09-12T02:29:17.251 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 12 02:29:17 smithi044 ceph-mon[35411]: from='osd.0 [v2:172.21.15.39:6802/2437586899,v1:172.21.15.39:6803/2437586899]' entity='osd.0' 2024-09-12T02:29:17.253 DEBUG:teuthology.orchestra.run.smithi044:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 4954ed46-70ae-11ef-bcea-c7b262605968 -- ceph orch daemon add osd smithi044:vg_nvme/lv_4 2024-09-12T02:29:17.265 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 02:29:17 smithi039 ceph-mon[30515]: from='osd.0 [v2:172.21.15.39:6802/2437586899,v1:172.21.15.39:6803/2437586899]' entity='osd.0' cmd='[{"prefix": "osd crush create-or-move", "id": 0, "weight":0.0873, "args": ["host=smithi039", "root=default"]}]': finished 2024-09-12T02:29:17.265 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 02:29:17 smithi039 ceph-mon[30515]: osdmap e7: 1 total, 0 up, 1 in 2024-09-12T02:29:17.265 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 02:29:17 smithi039 ceph-mon[30515]: from='mgr.14150 172.21.15.39:0/408627207' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-09-12T02:29:17.265 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 02:29:17 smithi039 ceph-mon[30515]: from='mgr.14150 172.21.15.39:0/408627207' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-09-12T02:29:17.265 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 02:29:17 smithi039 ceph-mon[30515]: from='osd.0 [v2:172.21.15.39:6802/2437586899,v1:172.21.15.39:6803/2437586899]' entity='osd.0' 2024-09-12T02:29:17.266 INFO:journalctl@ceph.osd.0.smithi039.stdout:Sep 12 02:29:16 smithi039 ceph-4954ed46-70ae-11ef-bcea-c7b262605968-osd-0[44095]: 2024-09-12T02:29:16.957+0000 7fac9e600640 -1 osd.0 0 waiting for initial osdmap 2024-09-12T02:29:17.266 INFO:journalctl@ceph.osd.0.smithi039.stdout:Sep 12 02:29:16 smithi039 ceph-4954ed46-70ae-11ef-bcea-c7b262605968-osd-0[44095]: 2024-09-12T02:29:16.981+0000 7fac93c00640 -1 osd.0 7 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-09-12T02:29:17.501 INFO:teuthology.orchestra.run.smithi044.stderr:Inferring config /var/lib/ceph/4954ed46-70ae-11ef-bcea-c7b262605968/mon.b/config 2024-09-12T02:29:17.514 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 12 02:29:17 smithi172 ceph-mon[35609]: from='osd.0 [v2:172.21.15.39:6802/2437586899,v1:172.21.15.39:6803/2437586899]' entity='osd.0' cmd='[{"prefix": "osd crush create-or-move", "id": 0, "weight":0.0873, "args": ["host=smithi039", "root=default"]}]': finished 2024-09-12T02:29:17.514 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 12 02:29:17 smithi172 ceph-mon[35609]: osdmap e7: 1 total, 0 up, 1 in 2024-09-12T02:29:17.514 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 12 02:29:17 smithi172 ceph-mon[35609]: from='mgr.14150 172.21.15.39:0/408627207' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-09-12T02:29:17.514 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 12 02:29:17 smithi172 ceph-mon[35609]: from='mgr.14150 172.21.15.39:0/408627207' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-09-12T02:29:17.514 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 12 02:29:17 smithi172 ceph-mon[35609]: from='osd.0 [v2:172.21.15.39:6802/2437586899,v1:172.21.15.39:6803/2437586899]' entity='osd.0' 2024-09-12T02:29:18.004 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T02:29:17.995+0000 7ff335fbf640 1 -- 172.21.15.44:0/1824789301 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7ff330102f70 msgr2=0x7ff3301033f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:29:18.004 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T02:29:17.995+0000 7ff335fbf640 1 --2- 172.21.15.44:0/1824789301 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7ff330102f70 0x7ff3301033f0 secure :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0x7ff324009930 tx=0x7ff32402a420 comp rx=0 tx=0).stop 2024-09-12T02:29:18.004 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T02:29:17.995+0000 7ff335fbf640 1 -- 172.21.15.44:0/1824789301 shutdown_connections 2024-09-12T02:29:18.004 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T02:29:17.995+0000 7ff335fbf640 1 --2- 172.21.15.44:0/1824789301 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7ff330103930 0x7ff33010a1c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:29:18.004 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T02:29:17.995+0000 7ff335fbf640 1 --2- 172.21.15.44:0/1824789301 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7ff330102f70 0x7ff3301033f0 unknown :-1 s=CLOSED pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:29:18.004 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T02:29:17.995+0000 7ff335fbf640 1 --2- 172.21.15.44:0/1824789301 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7ff3300ffef0 0x7ff3301002f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:29:18.004 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T02:29:17.995+0000 7ff335fbf640 1 -- 172.21.15.44:0/1824789301 >> 172.21.15.44:0/1824789301 conn(0x7ff3300fba40 msgr2=0x7ff3300fde60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:29:18.004 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T02:29:17.995+0000 7ff335fbf640 1 -- 172.21.15.44:0/1824789301 shutdown_connections 2024-09-12T02:29:18.004 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T02:29:17.995+0000 7ff335fbf640 1 -- 172.21.15.44:0/1824789301 wait complete. 2024-09-12T02:29:18.004 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T02:29:17.996+0000 7ff335fbf640 1 Processor -- start 2024-09-12T02:29:18.004 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T02:29:17.996+0000 7ff335fbf640 1 -- start start 2024-09-12T02:29:18.005 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T02:29:17.996+0000 7ff335fbf640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7ff3300ffef0 0x7ff330197f60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:29:18.005 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T02:29:17.996+0000 7ff335fbf640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7ff330102f70 0x7ff3301984a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:29:18.005 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T02:29:17.996+0000 7ff335fbf640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7ff330103930 0x7ff33019f520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:29:18.005 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T02:29:17.996+0000 7ff335fbf640 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 -- 0x7ff33010d8e0 con 0x7ff330103930 2024-09-12T02:29:18.005 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T02:29:17.996+0000 7ff335fbf640 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x7ff33010d760 con 0x7ff3300ffef0 2024-09-12T02:29:18.005 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T02:29:17.996+0000 7ff335fbf640 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7ff33010da60 con 0x7ff330102f70 2024-09-12T02:29:18.005 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T02:29:17.996+0000 7ff32f7fe640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7ff3300ffef0 0x7ff330197f60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:29:18.005 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T02:29:17.996+0000 7ff32f7fe640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7ff3300ffef0 0x7ff330197f60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.44:36204/0 (socket says 172.21.15.44:36204) 2024-09-12T02:29:18.005 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T02:29:17.996+0000 7ff32f7fe640 1 -- 172.21.15.44:0/973537028 learned_addr learned my addr 172.21.15.44:0/973537028 (peer_addr_for_me v2:172.21.15.44:0/0) 2024-09-12T02:29:18.005 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T02:29:17.996+0000 7ff32ffff640 1 --2- 172.21.15.44:0/973537028 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7ff330103930 0x7ff33019f520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:29:18.005 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T02:29:17.996+0000 7ff32effd640 1 --2- 172.21.15.44:0/973537028 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7ff330102f70 0x7ff3301984a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:29:18.006 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T02:29:17.996+0000 7ff32f7fe640 1 -- 172.21.15.44:0/973537028 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7ff330102f70 msgr2=0x7ff3301984a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:29:18.006 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T02:29:17.996+0000 7ff32f7fe640 1 --2- 172.21.15.44:0/973537028 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7ff330102f70 0x7ff3301984a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:29:18.006 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T02:29:17.996+0000 7ff32f7fe640 1 -- 172.21.15.44:0/973537028 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7ff330103930 msgr2=0x7ff33019f520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:29:18.006 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T02:29:17.996+0000 7ff32f7fe640 1 --2- 172.21.15.44:0/973537028 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7ff330103930 0x7ff33019f520 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:29:18.006 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T02:29:17.996+0000 7ff32f7fe640 1 -- 172.21.15.44:0/973537028 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff33019fb90 con 0x7ff3300ffef0 2024-09-12T02:29:18.006 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T02:29:17.996+0000 7ff32effd640 1 --2- 172.21.15.44:0/973537028 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7ff330102f70 0x7ff3301984a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-12T02:29:18.006 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T02:29:17.996+0000 7ff32f7fe640 1 --2- 172.21.15.44:0/973537028 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7ff3300ffef0 0x7ff330197f60 secure :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0x7ff32000c970 tx=0x7ff32000ce30 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:29:18.006 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T02:29:17.997+0000 7ff32cff9640 1 -- 172.21.15.44:0/973537028 <== mon.2 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff320007c10 con 0x7ff3300ffef0 2024-09-12T02:29:18.006 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T02:29:17.997+0000 7ff32cff9640 1 -- 172.21.15.44:0/973537028 <== mon.2 v2:172.21.15.44:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7ff320007db0 con 0x7ff3300ffef0 2024-09-12T02:29:18.006 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T02:29:17.997+0000 7ff335fbf640 1 -- 172.21.15.44:0/973537028 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff33019fe80 con 0x7ff3300ffef0 2024-09-12T02:29:18.006 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T02:29:17.997+0000 7ff32cff9640 1 -- 172.21.15.44:0/973537028 <== mon.2 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff32000f940 con 0x7ff3300ffef0 2024-09-12T02:29:18.006 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T02:29:17.997+0000 7ff335fbf640 1 -- 172.21.15.44:0/973537028 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff3301a02d0 con 0x7ff3300ffef0 2024-09-12T02:29:18.006 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T02:29:17.998+0000 7ff335fbf640 1 -- 172.21.15.44:0/973537028 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ff330109170 con 0x7ff3300ffef0 2024-09-12T02:29:18.006 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T02:29:17.999+0000 7ff32cff9640 1 -- 172.21.15.44:0/973537028 <== mon.2 v2:172.21.15.44:3300/0 4 ==== mgrmap(e 15) ==== 137777+0+0 (secure 0 0 0) 0x7ff32000fae0 con 0x7ff3300ffef0 2024-09-12T02:29:18.007 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T02:29:17.999+0000 7ff32cff9640 1 --2- 172.21.15.44:0/973537028 >> [v2:172.21.15.39:6800/1725006999,v1:172.21.15.39:6801/1725006999] conn(0x7ff3180a2b20 0x7ff3180a4fe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:29:18.007 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T02:29:17.999+0000 7ff32cff9640 1 -- 172.21.15.44:0/973537028 <== mon.2 v2:172.21.15.44:3300/0 5 ==== osd_map(8..8 src has 1..8) ==== 1767+0+0 (secure 0 0 0) 0x7ff3200cd970 con 0x7ff3300ffef0 2024-09-12T02:29:18.007 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T02:29:18.000+0000 7ff32effd640 1 --2- 172.21.15.44:0/973537028 >> [v2:172.21.15.39:6800/1725006999,v1:172.21.15.39:6801/1725006999] conn(0x7ff3180a2b20 0x7ff3180a4fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:29:18.007 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T02:29:18.000+0000 7ff32effd640 1 --2- 172.21.15.44:0/973537028 >> [v2:172.21.15.39:6800/1725006999,v1:172.21.15.39:6801/1725006999] conn(0x7ff3180a2b20 0x7ff3180a4fe0 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7ff3240314e0 tx=0x7ff324000bc0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:29:18.007 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T02:29:18.004+0000 7ff32cff9640 1 -- 172.21.15.44:0/973537028 <== mon.2 v2:172.21.15.44:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7ff32009c3d0 con 0x7ff3300ffef0 2024-09-12T02:29:18.188 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T02:29:18.187+0000 7ff335fbf640 1 -- 172.21.15.44:0/973537028 --> [v2:172.21.15.39:6800/1725006999,v1:172.21.15.39:6801/1725006999] -- mgr_command(tid 0: {"prefix": "orch daemon add osd", "svc_arg": "smithi044:vg_nvme/lv_4", "target": ["mon-mgr", ""]}) -- 0x7ff330062630 con 0x7ff3180a2b20 2024-09-12T02:29:18.350 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 02:29:18 smithi039 ceph-mon[30515]: purged_snaps scrub starts 2024-09-12T02:29:18.350 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 02:29:18 smithi039 ceph-mon[30515]: purged_snaps scrub ok 2024-09-12T02:29:18.350 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 02:29:18 smithi039 ceph-mon[30515]: pgmap v43: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-12T02:29:18.350 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 02:29:18 smithi039 ceph-mon[30515]: from='mgr.14150 172.21.15.39:0/408627207' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-09-12T02:29:18.350 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 02:29:18 smithi039 ceph-mon[30515]: osd.0 [v2:172.21.15.39:6802/2437586899,v1:172.21.15.39:6803/2437586899] boot 2024-09-12T02:29:18.350 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 02:29:18 smithi039 ceph-mon[30515]: osdmap e8: 1 total, 1 up, 1 in 2024-09-12T02:29:18.350 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 02:29:18 smithi039 ceph-mon[30515]: from='mgr.14150 172.21.15.39:0/408627207' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-09-12T02:29:18.350 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 02:29:18 smithi039 ceph-mon[30515]: from='mgr.14150 172.21.15.39:0/408627207' entity='mgr.x' 2024-09-12T02:29:18.350 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 02:29:18 smithi039 ceph-mon[30515]: from='mgr.14150 172.21.15.39:0/408627207' entity='mgr.x' 2024-09-12T02:29:18.350 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 02:29:18 smithi039 ceph-mon[30515]: from='mgr.14150 172.21.15.39:0/408627207' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-09-12T02:29:18.350 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 02:29:18 smithi039 ceph-mon[30515]: from='mgr.14150 172.21.15.39:0/408627207' entity='mgr.x' 2024-09-12T02:29:18.351 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 02:29:18 smithi039 ceph-mon[30515]: from='mgr.14150 172.21.15.39:0/408627207' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-12T02:29:18.351 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 02:29:18 smithi039 ceph-mon[30515]: from='mgr.14150 172.21.15.39:0/408627207' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-12T02:29:18.351 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 02:29:18 smithi039 ceph-mon[30515]: from='mgr.14150 172.21.15.39:0/408627207' entity='mgr.x' 2024-09-12T02:29:18.351 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 02:29:18 smithi039 ceph-mon[30515]: from='mgr.14150 172.21.15.39:0/408627207' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-09-12T02:29:18.351 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 02:29:18 smithi039 ceph-mon[30515]: from='mgr.14150 172.21.15.39:0/408627207' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-09-12T02:29:18.351 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 02:29:18 smithi039 ceph-mon[30515]: from='mgr.14150 172.21.15.39:0/408627207' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-12T02:29:18.448 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 12 02:29:18 smithi044 ceph-mon[35411]: purged_snaps scrub starts 2024-09-12T02:29:18.448 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 12 02:29:18 smithi044 ceph-mon[35411]: purged_snaps scrub ok 2024-09-12T02:29:18.448 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 12 02:29:18 smithi044 ceph-mon[35411]: pgmap v43: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-12T02:29:18.449 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 12 02:29:18 smithi044 ceph-mon[35411]: from='mgr.14150 172.21.15.39:0/408627207' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-09-12T02:29:18.449 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 12 02:29:18 smithi044 ceph-mon[35411]: osd.0 [v2:172.21.15.39:6802/2437586899,v1:172.21.15.39:6803/2437586899] boot 2024-09-12T02:29:18.449 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 12 02:29:18 smithi044 ceph-mon[35411]: osdmap e8: 1 total, 1 up, 1 in 2024-09-12T02:29:18.449 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 12 02:29:18 smithi044 ceph-mon[35411]: from='mgr.14150 172.21.15.39:0/408627207' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-09-12T02:29:18.449 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 12 02:29:18 smithi044 ceph-mon[35411]: from='mgr.14150 172.21.15.39:0/408627207' entity='mgr.x' 2024-09-12T02:29:18.449 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 12 02:29:18 smithi044 ceph-mon[35411]: from='mgr.14150 172.21.15.39:0/408627207' entity='mgr.x' 2024-09-12T02:29:18.449 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 12 02:29:18 smithi044 ceph-mon[35411]: from='mgr.14150 172.21.15.39:0/408627207' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-09-12T02:29:18.449 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 12 02:29:18 smithi044 ceph-mon[35411]: from='mgr.14150 172.21.15.39:0/408627207' entity='mgr.x' 2024-09-12T02:29:18.449 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 12 02:29:18 smithi044 ceph-mon[35411]: from='mgr.14150 172.21.15.39:0/408627207' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-12T02:29:18.449 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 12 02:29:18 smithi044 ceph-mon[35411]: from='mgr.14150 172.21.15.39:0/408627207' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-12T02:29:18.449 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 12 02:29:18 smithi044 ceph-mon[35411]: from='mgr.14150 172.21.15.39:0/408627207' entity='mgr.x' 2024-09-12T02:29:18.449 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 12 02:29:18 smithi044 ceph-mon[35411]: from='mgr.14150 172.21.15.39:0/408627207' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-09-12T02:29:18.449 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 12 02:29:18 smithi044 ceph-mon[35411]: from='mgr.14150 172.21.15.39:0/408627207' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-09-12T02:29:18.449 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 12 02:29:18 smithi044 ceph-mon[35411]: from='mgr.14150 172.21.15.39:0/408627207' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-12T02:29:18.514 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 12 02:29:18 smithi172 ceph-mon[35609]: purged_snaps scrub starts 2024-09-12T02:29:18.514 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 12 02:29:18 smithi172 ceph-mon[35609]: purged_snaps scrub ok 2024-09-12T02:29:18.514 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 12 02:29:18 smithi172 ceph-mon[35609]: pgmap v43: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-12T02:29:18.514 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 12 02:29:18 smithi172 ceph-mon[35609]: from='mgr.14150 172.21.15.39:0/408627207' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-09-12T02:29:18.514 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 12 02:29:18 smithi172 ceph-mon[35609]: osd.0 [v2:172.21.15.39:6802/2437586899,v1:172.21.15.39:6803/2437586899] boot 2024-09-12T02:29:18.514 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 12 02:29:18 smithi172 ceph-mon[35609]: osdmap e8: 1 total, 1 up, 1 in 2024-09-12T02:29:18.514 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 12 02:29:18 smithi172 ceph-mon[35609]: from='mgr.14150 172.21.15.39:0/408627207' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-09-12T02:29:18.514 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 12 02:29:18 smithi172 ceph-mon[35609]: from='mgr.14150 172.21.15.39:0/408627207' entity='mgr.x' 2024-09-12T02:29:18.515 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 12 02:29:18 smithi172 ceph-mon[35609]: from='mgr.14150 172.21.15.39:0/408627207' entity='mgr.x' 2024-09-12T02:29:18.515 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 12 02:29:18 smithi172 ceph-mon[35609]: from='mgr.14150 172.21.15.39:0/408627207' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-09-12T02:29:18.515 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 12 02:29:18 smithi172 ceph-mon[35609]: from='mgr.14150 172.21.15.39:0/408627207' entity='mgr.x' 2024-09-12T02:29:18.515 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 12 02:29:18 smithi172 ceph-mon[35609]: from='mgr.14150 172.21.15.39:0/408627207' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-12T02:29:18.515 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 12 02:29:18 smithi172 ceph-mon[35609]: from='mgr.14150 172.21.15.39:0/408627207' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-12T02:29:18.515 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 12 02:29:18 smithi172 ceph-mon[35609]: from='mgr.14150 172.21.15.39:0/408627207' entity='mgr.x' 2024-09-12T02:29:18.515 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 12 02:29:18 smithi172 ceph-mon[35609]: from='mgr.14150 172.21.15.39:0/408627207' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-09-12T02:29:18.515 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 12 02:29:18 smithi172 ceph-mon[35609]: from='mgr.14150 172.21.15.39:0/408627207' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-09-12T02:29:18.515 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 12 02:29:18 smithi172 ceph-mon[35609]: from='mgr.14150 172.21.15.39:0/408627207' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-12T02:29:19.484 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 12 02:29:19 smithi044 ceph-mon[35411]: Detected new or changed devices on smithi039 2024-09-12T02:29:19.484 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 12 02:29:19 smithi044 ceph-mon[35411]: Adjusting osd_memory_target on smithi039 to 17089M 2024-09-12T02:29:19.484 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 12 02:29:19 smithi044 ceph-mon[35411]: from='client.24143 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi044:vg_nvme/lv_4", "target": ["mon-mgr", ""]}]: dispatch 2024-09-12T02:29:19.513 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 12 02:29:19 smithi172 ceph-mon[35609]: Detected new or changed devices on smithi039 2024-09-12T02:29:19.513 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 12 02:29:19 smithi172 ceph-mon[35609]: Adjusting osd_memory_target on smithi039 to 17089M 2024-09-12T02:29:19.513 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 12 02:29:19 smithi172 ceph-mon[35609]: from='client.24143 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi044:vg_nvme/lv_4", "target": ["mon-mgr", ""]}]: dispatch 2024-09-12T02:29:19.599 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 02:29:19 smithi039 ceph-mon[30515]: Detected new or changed devices on smithi039 2024-09-12T02:29:19.600 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 02:29:19 smithi039 ceph-mon[30515]: Adjusting osd_memory_target on smithi039 to 17089M 2024-09-12T02:29:19.600 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 02:29:19 smithi039 ceph-mon[30515]: from='client.24143 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi044:vg_nvme/lv_4", "target": ["mon-mgr", ""]}]: dispatch 2024-09-12T02:29:20.448 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 12 02:29:20 smithi044 ceph-mon[35411]: pgmap v45: 0 pgs: ; 0 B data, 31 MiB used, 89 GiB / 89 GiB avail 2024-09-12T02:29:20.449 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 12 02:29:20 smithi044 ceph-mon[35411]: osdmap e9: 1 total, 1 up, 1 in 2024-09-12T02:29:20.513 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 12 02:29:20 smithi172 ceph-mon[35609]: pgmap v45: 0 pgs: ; 0 B data, 31 MiB used, 89 GiB / 89 GiB avail 2024-09-12T02:29:20.513 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 12 02:29:20 smithi172 ceph-mon[35609]: osdmap e9: 1 total, 1 up, 1 in 2024-09-12T02:29:20.599 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 02:29:20 smithi039 ceph-mon[30515]: pgmap v45: 0 pgs: ; 0 B data, 31 MiB used, 89 GiB / 89 GiB avail 2024-09-12T02:29:20.599 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 02:29:20 smithi039 ceph-mon[30515]: osdmap e9: 1 total, 1 up, 1 in 2024-09-12T02:29:21.448 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 12 02:29:21 smithi044 ceph-mon[35411]: from='client.? 172.21.15.44:0/693365562' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "30e1e4f4-1d50-4003-8978-cb183dca7fbb"}]: dispatch 2024-09-12T02:29:21.448 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 12 02:29:21 smithi044 ceph-mon[35411]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "30e1e4f4-1d50-4003-8978-cb183dca7fbb"}]: dispatch 2024-09-12T02:29:21.449 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 12 02:29:21 smithi044 ceph-mon[35411]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "30e1e4f4-1d50-4003-8978-cb183dca7fbb"}]': finished 2024-09-12T02:29:21.449 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 12 02:29:21 smithi044 ceph-mon[35411]: osdmap e10: 2 total, 1 up, 2 in 2024-09-12T02:29:21.449 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 12 02:29:21 smithi044 ceph-mon[35411]: from='mgr.14150 172.21.15.39:0/408627207' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-09-12T02:29:21.449 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 12 02:29:21 smithi044 ceph-mon[35411]: from='client.? 172.21.15.44:0/3466316918' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-09-12T02:29:21.513 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 12 02:29:21 smithi172 ceph-mon[35609]: from='client.? 172.21.15.44:0/693365562' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "30e1e4f4-1d50-4003-8978-cb183dca7fbb"}]: dispatch 2024-09-12T02:29:21.513 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 12 02:29:21 smithi172 ceph-mon[35609]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "30e1e4f4-1d50-4003-8978-cb183dca7fbb"}]: dispatch 2024-09-12T02:29:21.513 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 12 02:29:21 smithi172 ceph-mon[35609]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "30e1e4f4-1d50-4003-8978-cb183dca7fbb"}]': finished 2024-09-12T02:29:21.514 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 12 02:29:21 smithi172 ceph-mon[35609]: osdmap e10: 2 total, 1 up, 2 in 2024-09-12T02:29:21.514 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 12 02:29:21 smithi172 ceph-mon[35609]: from='mgr.14150 172.21.15.39:0/408627207' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-09-12T02:29:21.514 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 12 02:29:21 smithi172 ceph-mon[35609]: from='client.? 172.21.15.44:0/3466316918' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-09-12T02:29:21.599 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 02:29:21 smithi039 ceph-mon[30515]: from='client.? 172.21.15.44:0/693365562' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "30e1e4f4-1d50-4003-8978-cb183dca7fbb"}]: dispatch 2024-09-12T02:29:21.600 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 02:29:21 smithi039 ceph-mon[30515]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "30e1e4f4-1d50-4003-8978-cb183dca7fbb"}]: dispatch 2024-09-12T02:29:21.600 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 02:29:21 smithi039 ceph-mon[30515]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "30e1e4f4-1d50-4003-8978-cb183dca7fbb"}]': finished 2024-09-12T02:29:21.600 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 02:29:21 smithi039 ceph-mon[30515]: osdmap e10: 2 total, 1 up, 2 in 2024-09-12T02:29:21.600 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 02:29:21 smithi039 ceph-mon[30515]: from='mgr.14150 172.21.15.39:0/408627207' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-09-12T02:29:21.600 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 02:29:21 smithi039 ceph-mon[30515]: from='client.? 172.21.15.44:0/3466316918' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-09-12T02:29:22.849 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 02:29:22 smithi039 ceph-mon[30515]: pgmap v48: 0 pgs: ; 0 B data, 31 MiB used, 89 GiB / 89 GiB avail 2024-09-12T02:29:22.948 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 12 02:29:22 smithi044 ceph-mon[35411]: pgmap v48: 0 pgs: ; 0 B data, 31 MiB used, 89 GiB / 89 GiB avail 2024-09-12T02:29:23.013 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 12 02:29:22 smithi172 ceph-mon[35609]: pgmap v48: 0 pgs: ; 0 B data, 31 MiB used, 89 GiB / 89 GiB avail 2024-09-12T02:29:24.816 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 12 02:29:24 smithi172 ceph-mon[35609]: pgmap v49: 0 pgs: ; 0 B data, 31 MiB used, 89 GiB / 89 GiB avail 2024-09-12T02:29:24.849 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 02:29:24 smithi039 ceph-mon[30515]: pgmap v49: 0 pgs: ; 0 B data, 31 MiB used, 89 GiB / 89 GiB avail 2024-09-12T02:29:24.948 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 12 02:29:24 smithi044 ceph-mon[35411]: pgmap v49: 0 pgs: ; 0 B data, 31 MiB used, 89 GiB / 89 GiB avail 2024-09-12T02:29:26.850 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 02:29:26 smithi039 ceph-mon[30515]: pgmap v50: 0 pgs: ; 0 B data, 31 MiB used, 89 GiB / 89 GiB avail 2024-09-12T02:29:26.862 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 12 02:29:26 smithi044 ceph-mon[35411]: pgmap v50: 0 pgs: ; 0 B data, 31 MiB used, 89 GiB / 89 GiB avail 2024-09-12T02:29:27.014 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 12 02:29:26 smithi172 ceph-mon[35609]: pgmap v50: 0 pgs: ; 0 B data, 31 MiB used, 89 GiB / 89 GiB avail 2024-09-12T02:29:28.849 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 02:29:28 smithi039 ceph-mon[30515]: pgmap v51: 0 pgs: ; 0 B data, 31 MiB used, 89 GiB / 89 GiB avail 2024-09-12T02:29:28.948 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 12 02:29:28 smithi044 ceph-mon[35411]: pgmap v51: 0 pgs: ; 0 B data, 31 MiB used, 89 GiB / 89 GiB avail 2024-09-12T02:29:29.013 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 12 02:29:28 smithi172 ceph-mon[35609]: pgmap v51: 0 pgs: ; 0 B data, 31 MiB used, 89 GiB / 89 GiB avail 2024-09-12T02:29:29.849 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 02:29:29 smithi039 ceph-mon[30515]: from='mgr.14150 172.21.15.39:0/408627207' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.1"}]: dispatch 2024-09-12T02:29:29.850 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 02:29:29 smithi039 ceph-mon[30515]: from='mgr.14150 172.21.15.39:0/408627207' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-12T02:29:29.948 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 12 02:29:29 smithi044 ceph-mon[35411]: from='mgr.14150 172.21.15.39:0/408627207' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.1"}]: dispatch 2024-09-12T02:29:29.949 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 12 02:29:29 smithi044 ceph-mon[35411]: from='mgr.14150 172.21.15.39:0/408627207' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-12T02:29:30.013 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 12 02:29:29 smithi172 ceph-mon[35609]: from='mgr.14150 172.21.15.39:0/408627207' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.1"}]: dispatch 2024-09-12T02:29:30.014 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 12 02:29:29 smithi172 ceph-mon[35609]: from='mgr.14150 172.21.15.39:0/408627207' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-12T02:29:30.708 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 12 02:29:30 smithi044 ceph-mon[35411]: pgmap v52: 0 pgs: ; 0 B data, 31 MiB used, 89 GiB / 89 GiB avail 2024-09-12T02:29:30.708 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 12 02:29:30 smithi044 ceph-mon[35411]: Deploying daemon osd.1 on smithi044 2024-09-12T02:29:30.850 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 02:29:30 smithi039 ceph-mon[30515]: pgmap v52: 0 pgs: ; 0 B data, 31 MiB used, 89 GiB / 89 GiB avail 2024-09-12T02:29:30.850 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 02:29:30 smithi039 ceph-mon[30515]: Deploying daemon osd.1 on smithi044 2024-09-12T02:29:31.013 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 12 02:29:30 smithi172 ceph-mon[35609]: pgmap v52: 0 pgs: ; 0 B data, 31 MiB used, 89 GiB / 89 GiB avail 2024-09-12T02:29:31.013 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 12 02:29:30 smithi172 ceph-mon[35609]: Deploying daemon osd.1 on smithi044 2024-09-12T02:29:32.836 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 12 02:29:32 smithi044 ceph-mon[35411]: pgmap v53: 0 pgs: ; 0 B data, 31 MiB used, 89 GiB / 89 GiB avail 2024-09-12T02:29:32.849 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 02:29:32 smithi039 ceph-mon[30515]: pgmap v53: 0 pgs: ; 0 B data, 31 MiB used, 89 GiB / 89 GiB avail 2024-09-12T02:29:33.013 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 12 02:29:32 smithi172 ceph-mon[35609]: pgmap v53: 0 pgs: ; 0 B data, 31 MiB used, 89 GiB / 89 GiB avail 2024-09-12T02:29:34.599 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 02:29:34 smithi039 ceph-mon[30515]: pgmap v54: 0 pgs: ; 0 B data, 31 MiB used, 89 GiB / 89 GiB avail 2024-09-12T02:29:34.822 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 12 02:29:34 smithi044 ceph-mon[35411]: pgmap v54: 0 pgs: ; 0 B data, 31 MiB used, 89 GiB / 89 GiB avail 2024-09-12T02:29:35.013 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 12 02:29:34 smithi172 ceph-mon[35609]: pgmap v54: 0 pgs: ; 0 B data, 31 MiB used, 89 GiB / 89 GiB avail 2024-09-12T02:29:35.698 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 12 02:29:35 smithi044 ceph-mon[35411]: from='mgr.14150 172.21.15.39:0/408627207' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-12T02:29:35.699 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 12 02:29:35 smithi044 ceph-mon[35411]: from='mgr.14150 172.21.15.39:0/408627207' entity='mgr.x' 2024-09-12T02:29:35.699 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 12 02:29:35 smithi044 ceph-mon[35411]: from='mgr.14150 172.21.15.39:0/408627207' entity='mgr.x' 2024-09-12T02:29:35.849 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 02:29:35 smithi039 ceph-mon[30515]: from='mgr.14150 172.21.15.39:0/408627207' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-12T02:29:35.849 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 02:29:35 smithi039 ceph-mon[30515]: from='mgr.14150 172.21.15.39:0/408627207' entity='mgr.x' 2024-09-12T02:29:35.850 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 02:29:35 smithi039 ceph-mon[30515]: from='mgr.14150 172.21.15.39:0/408627207' entity='mgr.x' 2024-09-12T02:29:36.013 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 12 02:29:35 smithi172 ceph-mon[35609]: from='mgr.14150 172.21.15.39:0/408627207' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-12T02:29:36.013 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 12 02:29:35 smithi172 ceph-mon[35609]: from='mgr.14150 172.21.15.39:0/408627207' entity='mgr.x' 2024-09-12T02:29:36.013 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 12 02:29:35 smithi172 ceph-mon[35609]: from='mgr.14150 172.21.15.39:0/408627207' entity='mgr.x' 2024-09-12T02:29:36.675 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 12 02:29:36 smithi044 ceph-mon[35411]: pgmap v55: 0 pgs: ; 0 B data, 31 MiB used, 89 GiB / 89 GiB avail 2024-09-12T02:29:36.849 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 02:29:36 smithi039 ceph-mon[30515]: pgmap v55: 0 pgs: ; 0 B data, 31 MiB used, 89 GiB / 89 GiB avail 2024-09-12T02:29:37.013 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 12 02:29:36 smithi172 ceph-mon[35609]: pgmap v55: 0 pgs: ; 0 B data, 31 MiB used, 89 GiB / 89 GiB avail 2024-09-12T02:29:38.642 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 12 02:29:38 smithi044 ceph-mon[35411]: pgmap v56: 0 pgs: ; 0 B data, 31 MiB used, 89 GiB / 89 GiB avail 2024-09-12T02:29:38.642 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 12 02:29:38 smithi044 ceph-mon[35411]: from='mgr.14150 172.21.15.39:0/408627207' entity='mgr.x' 2024-09-12T02:29:38.643 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 12 02:29:38 smithi044 ceph-mon[35411]: from='mgr.14150 172.21.15.39:0/408627207' entity='mgr.x' 2024-09-12T02:29:38.643 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 12 02:29:38 smithi044 ceph-mon[35411]: from='mgr.14150 172.21.15.39:0/408627207' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-12T02:29:38.643 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 12 02:29:38 smithi044 ceph-mon[35411]: from='mgr.14150 172.21.15.39:0/408627207' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-12T02:29:38.643 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 12 02:29:38 smithi044 ceph-mon[35411]: from='mgr.14150 172.21.15.39:0/408627207' entity='mgr.x' 2024-09-12T02:29:38.682 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T02:29:38.682+0000 7ff32cff9640 1 -- 172.21.15.44:0/973537028 <== mgr.14150 v2:172.21.15.39:6800/1725006999 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+37 (secure 0 0 0) 0x7ff330062630 con 0x7ff3180a2b20 2024-09-12T02:29:38.683 INFO:teuthology.orchestra.run.smithi044.stdout:Created osd(s) 1 on host 'smithi044' 2024-09-12T02:29:38.685 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T02:29:38.684+0000 7ff335fbf640 1 -- 172.21.15.44:0/973537028 >> [v2:172.21.15.39:6800/1725006999,v1:172.21.15.39:6801/1725006999] conn(0x7ff3180a2b20 msgr2=0x7ff3180a4fe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:29:38.685 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T02:29:38.684+0000 7ff335fbf640 1 --2- 172.21.15.44:0/973537028 >> [v2:172.21.15.39:6800/1725006999,v1:172.21.15.39:6801/1725006999] conn(0x7ff3180a2b20 0x7ff3180a4fe0 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7ff3240314e0 tx=0x7ff324000bc0 comp rx=0 tx=0).stop 2024-09-12T02:29:38.685 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T02:29:38.684+0000 7ff335fbf640 1 -- 172.21.15.44:0/973537028 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7ff3300ffef0 msgr2=0x7ff330197f60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:29:38.685 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T02:29:38.684+0000 7ff335fbf640 1 --2- 172.21.15.44:0/973537028 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7ff3300ffef0 0x7ff330197f60 secure :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0x7ff32000c970 tx=0x7ff32000ce30 comp rx=0 tx=0).stop 2024-09-12T02:29:38.685 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T02:29:38.684+0000 7ff335fbf640 1 -- 172.21.15.44:0/973537028 shutdown_connections 2024-09-12T02:29:38.685 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T02:29:38.684+0000 7ff335fbf640 1 --2- 172.21.15.44:0/973537028 >> [v2:172.21.15.39:6800/1725006999,v1:172.21.15.39:6801/1725006999] conn(0x7ff3180a2b20 0x7ff3180a4fe0 unknown :-1 s=CLOSED pgs=53 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:29:38.685 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T02:29:38.684+0000 7ff335fbf640 1 --2- 172.21.15.44:0/973537028 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7ff330103930 0x7ff33019f520 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:29:38.685 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T02:29:38.684+0000 7ff335fbf640 1 --2- 172.21.15.44:0/973537028 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7ff330102f70 0x7ff3301984a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:29:38.685 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T02:29:38.684+0000 7ff335fbf640 1 --2- 172.21.15.44:0/973537028 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7ff3300ffef0 0x7ff330197f60 unknown :-1 s=CLOSED pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:29:38.685 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T02:29:38.684+0000 7ff335fbf640 1 -- 172.21.15.44:0/973537028 >> 172.21.15.44:0/973537028 conn(0x7ff3300fba40 msgr2=0x7ff330106340 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:29:38.686 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T02:29:38.684+0000 7ff335fbf640 1 -- 172.21.15.44:0/973537028 shutdown_connections 2024-09-12T02:29:38.686 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T02:29:38.684+0000 7ff335fbf640 1 -- 172.21.15.44:0/973537028 wait complete. 2024-09-12T02:29:38.850 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 02:29:38 smithi039 ceph-mon[30515]: pgmap v56: 0 pgs: ; 0 B data, 31 MiB used, 89 GiB / 89 GiB avail 2024-09-12T02:29:38.850 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 02:29:38 smithi039 ceph-mon[30515]: from='mgr.14150 172.21.15.39:0/408627207' entity='mgr.x' 2024-09-12T02:29:38.850 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 02:29:38 smithi039 ceph-mon[30515]: from='mgr.14150 172.21.15.39:0/408627207' entity='mgr.x' 2024-09-12T02:29:38.850 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 02:29:38 smithi039 ceph-mon[30515]: from='mgr.14150 172.21.15.39:0/408627207' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-12T02:29:38.850 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 02:29:38 smithi039 ceph-mon[30515]: from='mgr.14150 172.21.15.39:0/408627207' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-12T02:29:38.850 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 02:29:38 smithi039 ceph-mon[30515]: from='mgr.14150 172.21.15.39:0/408627207' entity='mgr.x' 2024-09-12T02:29:39.013 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 12 02:29:38 smithi172 ceph-mon[35609]: pgmap v56: 0 pgs: ; 0 B data, 31 MiB used, 89 GiB / 89 GiB avail 2024-09-12T02:29:39.014 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 12 02:29:38 smithi172 ceph-mon[35609]: from='mgr.14150 172.21.15.39:0/408627207' entity='mgr.x' 2024-09-12T02:29:39.014 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 12 02:29:38 smithi172 ceph-mon[35609]: from='mgr.14150 172.21.15.39:0/408627207' entity='mgr.x' 2024-09-12T02:29:39.014 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 12 02:29:38 smithi172 ceph-mon[35609]: from='mgr.14150 172.21.15.39:0/408627207' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-12T02:29:39.014 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 12 02:29:38 smithi172 ceph-mon[35609]: from='mgr.14150 172.21.15.39:0/408627207' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-12T02:29:39.014 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 12 02:29:38 smithi172 ceph-mon[35609]: from='mgr.14150 172.21.15.39:0/408627207' entity='mgr.x' 2024-09-12T02:29:39.239 DEBUG:teuthology.orchestra.run.smithi044:osd.1> sudo journalctl -f -n 0 -u ceph-4954ed46-70ae-11ef-bcea-c7b262605968@osd.1.service 2024-09-12T02:29:39.241 INFO:tasks.cephadm:Deploying osd.2 on smithi172 with /dev/vg_nvme/lv_4... 2024-09-12T02:29:39.242 DEBUG:teuthology.orchestra.run.smithi172:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc ceph-volume -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 4954ed46-70ae-11ef-bcea-c7b262605968 -- lvm zap /dev/vg_nvme/lv_4 2024-09-12T02:29:39.495 INFO:teuthology.orchestra.run.smithi172.stderr:Inferring config /var/lib/ceph/4954ed46-70ae-11ef-bcea-c7b262605968/mon.c/config 2024-09-12T02:29:39.849 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 02:29:39 smithi039 ceph-mon[30515]: from='mgr.14150 172.21.15.39:0/408627207' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-12T02:29:39.849 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 02:29:39 smithi039 ceph-mon[30515]: from='mgr.14150 172.21.15.39:0/408627207' entity='mgr.x' 2024-09-12T02:29:39.850 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 02:29:39 smithi039 ceph-mon[30515]: from='mgr.14150 172.21.15.39:0/408627207' entity='mgr.x' 2024-09-12T02:29:39.915 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 12 02:29:39 smithi172 ceph-mon[35609]: from='mgr.14150 172.21.15.39:0/408627207' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-12T02:29:39.915 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 12 02:29:39 smithi172 ceph-mon[35609]: from='mgr.14150 172.21.15.39:0/408627207' entity='mgr.x' 2024-09-12T02:29:39.915 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 12 02:29:39 smithi172 ceph-mon[35609]: from='mgr.14150 172.21.15.39:0/408627207' entity='mgr.x' 2024-09-12T02:29:39.948 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 12 02:29:39 smithi044 ceph-mon[35411]: from='mgr.14150 172.21.15.39:0/408627207' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-12T02:29:39.948 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 12 02:29:39 smithi044 ceph-mon[35411]: from='mgr.14150 172.21.15.39:0/408627207' entity='mgr.x' 2024-09-12T02:29:39.948 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 12 02:29:39 smithi044 ceph-mon[35411]: from='mgr.14150 172.21.15.39:0/408627207' entity='mgr.x' 2024-09-12T02:29:40.804 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 12 02:29:40 smithi172 ceph-mon[35609]: pgmap v57: 0 pgs: ; 0 B data, 31 MiB used, 89 GiB / 89 GiB avail 2024-09-12T02:29:40.805 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 12 02:29:40 smithi172 ceph-mon[35609]: from='osd.1 [v2:172.21.15.44:6800/2349287000,v1:172.21.15.44:6801/2349287000]' entity='osd.1' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["1"]}]: dispatch 2024-09-12T02:29:40.805 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 12 02:29:40 smithi172 ceph-mon[35609]: from='osd.1 ' entity='osd.1' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["1"]}]: dispatch 2024-09-12T02:29:40.949 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 12 02:29:40 smithi044 ceph-mon[35411]: pgmap v57: 0 pgs: ; 0 B data, 31 MiB used, 89 GiB / 89 GiB avail 2024-09-12T02:29:40.949 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 12 02:29:40 smithi044 ceph-mon[35411]: from='osd.1 [v2:172.21.15.44:6800/2349287000,v1:172.21.15.44:6801/2349287000]' entity='osd.1' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["1"]}]: dispatch 2024-09-12T02:29:40.949 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 12 02:29:40 smithi044 ceph-mon[35411]: from='osd.1 ' entity='osd.1' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["1"]}]: dispatch 2024-09-12T02:29:40.949 INFO:journalctl@ceph.osd.1.smithi044.stdout:Sep 12 02:29:40 smithi044 ceph-4954ed46-70ae-11ef-bcea-c7b262605968-osd-1[39876]: 2024-09-12T02:29:40.564+0000 7f99e7fcd640 -1 osd.1 0 log_to_monitors true 2024-09-12T02:29:41.099 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 02:29:40 smithi039 ceph-mon[30515]: pgmap v57: 0 pgs: ; 0 B data, 31 MiB used, 89 GiB / 89 GiB avail 2024-09-12T02:29:41.100 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 02:29:40 smithi039 ceph-mon[30515]: from='osd.1 [v2:172.21.15.44:6800/2349287000,v1:172.21.15.44:6801/2349287000]' entity='osd.1' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["1"]}]: dispatch 2024-09-12T02:29:41.100 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 02:29:40 smithi039 ceph-mon[30515]: from='osd.1 ' entity='osd.1' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["1"]}]: dispatch 2024-09-12T02:29:41.875 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 12 02:29:41 smithi172 ceph-mon[35609]: from='osd.1 ' entity='osd.1' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["1"]}]': finished 2024-09-12T02:29:41.875 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 12 02:29:41 smithi172 ceph-mon[35609]: from='osd.1 [v2:172.21.15.44:6800/2349287000,v1:172.21.15.44:6801/2349287000]' entity='osd.1' cmd=[{"prefix": "osd crush create-or-move", "id": 1, "weight":0.0873, "args": ["host=smithi044", "root=default"]}]: dispatch 2024-09-12T02:29:41.876 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 12 02:29:41 smithi172 ceph-mon[35609]: osdmap e11: 2 total, 1 up, 2 in 2024-09-12T02:29:41.876 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 12 02:29:41 smithi172 ceph-mon[35609]: from='mgr.14150 172.21.15.39:0/408627207' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-09-12T02:29:41.876 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 12 02:29:41 smithi172 ceph-mon[35609]: from='osd.1 ' entity='osd.1' cmd=[{"prefix": "osd crush create-or-move", "id": 1, "weight":0.0873, "args": ["host=smithi044", "root=default"]}]: dispatch 2024-09-12T02:29:41.878 INFO:teuthology.orchestra.run.smithi172.stdout: 2024-09-12T02:29:41.883 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 12 02:29:41 smithi044 ceph-mon[35411]: from='osd.1 ' entity='osd.1' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["1"]}]': finished 2024-09-12T02:29:41.883 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 12 02:29:41 smithi044 ceph-mon[35411]: from='osd.1 [v2:172.21.15.44:6800/2349287000,v1:172.21.15.44:6801/2349287000]' entity='osd.1' cmd=[{"prefix": "osd crush create-or-move", "id": 1, "weight":0.0873, "args": ["host=smithi044", "root=default"]}]: dispatch 2024-09-12T02:29:41.883 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 12 02:29:41 smithi044 ceph-mon[35411]: osdmap e11: 2 total, 1 up, 2 in 2024-09-12T02:29:41.883 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 12 02:29:41 smithi044 ceph-mon[35411]: from='mgr.14150 172.21.15.39:0/408627207' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-09-12T02:29:41.883 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 12 02:29:41 smithi044 ceph-mon[35411]: from='osd.1 ' entity='osd.1' cmd=[{"prefix": "osd crush create-or-move", "id": 1, "weight":0.0873, "args": ["host=smithi044", "root=default"]}]: dispatch 2024-09-12T02:29:41.883 INFO:journalctl@ceph.osd.1.smithi044.stdout:Sep 12 02:29:41 smithi044 ceph-4954ed46-70ae-11ef-bcea-c7b262605968-osd-1[39876]: 2024-09-12T02:29:41.697+0000 7f99e3f50640 -1 osd.1 0 waiting for initial osdmap 2024-09-12T02:29:41.883 INFO:journalctl@ceph.osd.1.smithi044.stdout:Sep 12 02:29:41 smithi044 ceph-4954ed46-70ae-11ef-bcea-c7b262605968-osd-1[39876]: 2024-09-12T02:29:41.706+0000 7f99dfd78640 -1 osd.1 12 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-09-12T02:29:41.905 DEBUG:teuthology.orchestra.run.smithi172:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 4954ed46-70ae-11ef-bcea-c7b262605968 -- ceph orch daemon add osd smithi172:vg_nvme/lv_4 2024-09-12T02:29:42.099 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 02:29:41 smithi039 ceph-mon[30515]: from='osd.1 ' entity='osd.1' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["1"]}]': finished 2024-09-12T02:29:42.099 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 02:29:41 smithi039 ceph-mon[30515]: from='osd.1 [v2:172.21.15.44:6800/2349287000,v1:172.21.15.44:6801/2349287000]' entity='osd.1' cmd=[{"prefix": "osd crush create-or-move", "id": 1, "weight":0.0873, "args": ["host=smithi044", "root=default"]}]: dispatch 2024-09-12T02:29:42.100 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 02:29:41 smithi039 ceph-mon[30515]: osdmap e11: 2 total, 1 up, 2 in 2024-09-12T02:29:42.100 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 02:29:41 smithi039 ceph-mon[30515]: from='mgr.14150 172.21.15.39:0/408627207' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-09-12T02:29:42.100 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 02:29:41 smithi039 ceph-mon[30515]: from='osd.1 ' entity='osd.1' cmd=[{"prefix": "osd crush create-or-move", "id": 1, "weight":0.0873, "args": ["host=smithi044", "root=default"]}]: dispatch 2024-09-12T02:29:42.159 INFO:teuthology.orchestra.run.smithi172.stderr:Inferring config /var/lib/ceph/4954ed46-70ae-11ef-bcea-c7b262605968/mon.c/config 2024-09-12T02:29:42.599 INFO:teuthology.orchestra.run.smithi172.stderr:2024-09-12T02:29:42.595+0000 7f4ae061a640 1 -- 172.21.15.172:0/1208457027 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f4ad8102e00 msgr2=0x7f4ad8103280 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:29:42.599 INFO:teuthology.orchestra.run.smithi172.stderr:2024-09-12T02:29:42.595+0000 7f4ae061a640 1 --2- 172.21.15.172:0/1208457027 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f4ad8102e00 0x7f4ad8103280 secure :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0x7f4ac8009900 tx=0x7f4ac802a410 comp rx=0 tx=0).stop 2024-09-12T02:29:42.600 INFO:teuthology.orchestra.run.smithi172.stderr:2024-09-12T02:29:42.595+0000 7f4ae061a640 1 -- 172.21.15.172:0/1208457027 shutdown_connections 2024-09-12T02:29:42.600 INFO:teuthology.orchestra.run.smithi172.stderr:2024-09-12T02:29:42.595+0000 7f4ae061a640 1 --2- 172.21.15.172:0/1208457027 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f4ad81037c0 0x7f4ad810a050 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:29:42.600 INFO:teuthology.orchestra.run.smithi172.stderr:2024-09-12T02:29:42.595+0000 7f4ae061a640 1 --2- 172.21.15.172:0/1208457027 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f4ad8102e00 0x7f4ad8103280 unknown :-1 s=CLOSED pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:29:42.600 INFO:teuthology.orchestra.run.smithi172.stderr:2024-09-12T02:29:42.595+0000 7f4ae061a640 1 --2- 172.21.15.172:0/1208457027 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f4ad8101c00 0x7f4ad8102000 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:29:42.600 INFO:teuthology.orchestra.run.smithi172.stderr:2024-09-12T02:29:42.595+0000 7f4ae061a640 1 -- 172.21.15.172:0/1208457027 >> 172.21.15.172:0/1208457027 conn(0x7f4ad80fd390 msgr2=0x7f4ad80ff7d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:29:42.600 INFO:teuthology.orchestra.run.smithi172.stderr:2024-09-12T02:29:42.595+0000 7f4ae061a640 1 -- 172.21.15.172:0/1208457027 shutdown_connections 2024-09-12T02:29:42.600 INFO:teuthology.orchestra.run.smithi172.stderr:2024-09-12T02:29:42.595+0000 7f4ae061a640 1 -- 172.21.15.172:0/1208457027 wait complete. 2024-09-12T02:29:42.600 INFO:teuthology.orchestra.run.smithi172.stderr:2024-09-12T02:29:42.596+0000 7f4ae061a640 1 Processor -- start 2024-09-12T02:29:42.601 INFO:teuthology.orchestra.run.smithi172.stderr:2024-09-12T02:29:42.596+0000 7f4ae061a640 1 -- start start 2024-09-12T02:29:42.601 INFO:teuthology.orchestra.run.smithi172.stderr:2024-09-12T02:29:42.596+0000 7f4ae061a640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f4ad8101c00 0x7f4ad8198090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:29:42.601 INFO:teuthology.orchestra.run.smithi172.stderr:2024-09-12T02:29:42.596+0000 7f4ae061a640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f4ad8102e00 0x7f4ad81985d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:29:42.601 INFO:teuthology.orchestra.run.smithi172.stderr:2024-09-12T02:29:42.596+0000 7f4ae061a640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f4ad81037c0 0x7f4ad819f650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:29:42.601 INFO:teuthology.orchestra.run.smithi172.stderr:2024-09-12T02:29:42.596+0000 7f4ae061a640 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 -- 0x7f4ad810d9d0 con 0x7f4ad81037c0 2024-09-12T02:29:42.601 INFO:teuthology.orchestra.run.smithi172.stderr:2024-09-12T02:29:42.596+0000 7f4ae061a640 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x7f4ad810d850 con 0x7f4ad8102e00 2024-09-12T02:29:42.601 INFO:teuthology.orchestra.run.smithi172.stderr:2024-09-12T02:29:42.596+0000 7f4ade3b6640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f4ad8101c00 0x7f4ad8198090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:29:42.601 INFO:teuthology.orchestra.run.smithi172.stderr:2024-09-12T02:29:42.597+0000 7f4ade3b6640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f4ad8101c00 0x7f4ad8198090 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.172:3300/0 says I am v2:172.21.15.172:55626/0 (socket says 172.21.15.172:55626) 2024-09-12T02:29:42.601 INFO:teuthology.orchestra.run.smithi172.stderr:2024-09-12T02:29:42.597+0000 7f4ae061a640 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7f4ad810db50 con 0x7f4ad8101c00 2024-09-12T02:29:42.601 INFO:teuthology.orchestra.run.smithi172.stderr:2024-09-12T02:29:42.597+0000 7f4ade3b6640 1 -- 172.21.15.172:0/3627387108 learned_addr learned my addr 172.21.15.172:0/3627387108 (peer_addr_for_me v2:172.21.15.172:0/0) 2024-09-12T02:29:42.601 INFO:teuthology.orchestra.run.smithi172.stderr:2024-09-12T02:29:42.597+0000 7f4addbb5640 1 --2- 172.21.15.172:0/3627387108 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f4ad8102e00 0x7f4ad81985d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:29:42.602 INFO:teuthology.orchestra.run.smithi172.stderr:2024-09-12T02:29:42.597+0000 7f4ade3b6640 1 -- 172.21.15.172:0/3627387108 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f4ad8102e00 msgr2=0x7f4ad81985d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:29:42.602 INFO:teuthology.orchestra.run.smithi172.stderr:2024-09-12T02:29:42.597+0000 7f4ade3b6640 1 --2- 172.21.15.172:0/3627387108 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f4ad8102e00 0x7f4ad81985d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:29:42.602 INFO:teuthology.orchestra.run.smithi172.stderr:2024-09-12T02:29:42.597+0000 7f4ade3b6640 1 -- 172.21.15.172:0/3627387108 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f4ad81037c0 msgr2=0x7f4ad819f650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:29:42.602 INFO:teuthology.orchestra.run.smithi172.stderr:2024-09-12T02:29:42.597+0000 7f4adebb7640 1 --2- 172.21.15.172:0/3627387108 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f4ad81037c0 0x7f4ad819f650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:29:42.602 INFO:teuthology.orchestra.run.smithi172.stderr:2024-09-12T02:29:42.597+0000 7f4ade3b6640 1 --2- 172.21.15.172:0/3627387108 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f4ad81037c0 0x7f4ad819f650 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:29:42.602 INFO:teuthology.orchestra.run.smithi172.stderr:2024-09-12T02:29:42.597+0000 7f4ade3b6640 1 -- 172.21.15.172:0/3627387108 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4ad819fcc0 con 0x7f4ad8101c00 2024-09-12T02:29:42.602 INFO:teuthology.orchestra.run.smithi172.stderr:2024-09-12T02:29:42.597+0000 7f4adebb7640 1 --2- 172.21.15.172:0/3627387108 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f4ad81037c0 0x7f4ad819f650 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-12T02:29:42.603 INFO:teuthology.orchestra.run.smithi172.stderr:2024-09-12T02:29:42.597+0000 7f4ade3b6640 1 --2- 172.21.15.172:0/3627387108 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f4ad8101c00 0x7f4ad8198090 secure :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0x7f4ad400b450 tx=0x7f4ad400b910 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:29:42.603 INFO:teuthology.orchestra.run.smithi172.stderr:2024-09-12T02:29:42.597+0000 7f4acf7fe640 1 -- 172.21.15.172:0/3627387108 <== mon.1 v2:172.21.15.172:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4ad4015020 con 0x7f4ad8101c00 2024-09-12T02:29:42.603 INFO:teuthology.orchestra.run.smithi172.stderr:2024-09-12T02:29:42.597+0000 7f4acf7fe640 1 -- 172.21.15.172:0/3627387108 <== mon.1 v2:172.21.15.172:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f4ad4011d70 con 0x7f4ad8101c00 2024-09-12T02:29:42.603 INFO:teuthology.orchestra.run.smithi172.stderr:2024-09-12T02:29:42.597+0000 7f4ae061a640 1 -- 172.21.15.172:0/3627387108 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f4ad819ffb0 con 0x7f4ad8101c00 2024-09-12T02:29:42.603 INFO:teuthology.orchestra.run.smithi172.stderr:2024-09-12T02:29:42.597+0000 7f4acf7fe640 1 -- 172.21.15.172:0/3627387108 <== mon.1 v2:172.21.15.172:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4ad400f340 con 0x7f4ad8101c00 2024-09-12T02:29:42.603 INFO:teuthology.orchestra.run.smithi172.stderr:2024-09-12T02:29:42.597+0000 7f4ae061a640 1 -- 172.21.15.172:0/3627387108 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f4ad81a0480 con 0x7f4ad8101c00 2024-09-12T02:29:42.603 INFO:teuthology.orchestra.run.smithi172.stderr:2024-09-12T02:29:42.598+0000 7f4ae061a640 1 -- 172.21.15.172:0/3627387108 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f4ad81090a0 con 0x7f4ad8101c00 2024-09-12T02:29:42.605 INFO:teuthology.orchestra.run.smithi172.stderr:2024-09-12T02:29:42.599+0000 7f4acf7fe640 1 -- 172.21.15.172:0/3627387108 <== mon.1 v2:172.21.15.172:3300/0 4 ==== mgrmap(e 15) ==== 137777+0+0 (secure 0 0 0) 0x7f4ad4018020 con 0x7f4ad8101c00 2024-09-12T02:29:42.605 INFO:teuthology.orchestra.run.smithi172.stderr:2024-09-12T02:29:42.600+0000 7f4acf7fe640 1 --2- 172.21.15.172:0/3627387108 >> [v2:172.21.15.39:6800/1725006999,v1:172.21.15.39:6801/1725006999] conn(0x7f4ac40a2b20 0x7f4ac40a4fe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:29:42.605 INFO:teuthology.orchestra.run.smithi172.stderr:2024-09-12T02:29:42.600+0000 7f4acf7fe640 1 -- 172.21.15.172:0/3627387108 <== mon.1 v2:172.21.15.172:3300/0 5 ==== osd_map(12..12 src has 1..12) ==== 2029+0+0 (secure 0 0 0) 0x7f4ad40cd170 con 0x7f4ad8101c00 2024-09-12T02:29:42.605 INFO:teuthology.orchestra.run.smithi172.stderr:2024-09-12T02:29:42.600+0000 7f4addbb5640 1 --2- 172.21.15.172:0/3627387108 >> [v2:172.21.15.39:6800/1725006999,v1:172.21.15.39:6801/1725006999] conn(0x7f4ac40a2b20 0x7f4ac40a4fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:29:42.605 INFO:teuthology.orchestra.run.smithi172.stderr:2024-09-12T02:29:42.601+0000 7f4addbb5640 1 --2- 172.21.15.172:0/3627387108 >> [v2:172.21.15.39:6800/1725006999,v1:172.21.15.39:6801/1725006999] conn(0x7f4ac40a2b20 0x7f4ac40a4fe0 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7f4ac8006010 tx=0x7f4ac8031400 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:29:42.605 INFO:teuthology.orchestra.run.smithi172.stderr:2024-09-12T02:29:42.604+0000 7f4acf7fe640 1 -- 172.21.15.172:0/3627387108 <== mon.1 v2:172.21.15.172:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7f4ad401f020 con 0x7f4ad8101c00 2024-09-12T02:29:42.781 INFO:teuthology.orchestra.run.smithi172.stderr:2024-09-12T02:29:42.781+0000 7f4ae061a640 1 -- 172.21.15.172:0/3627387108 --> [v2:172.21.15.39:6800/1725006999,v1:172.21.15.39:6801/1725006999] -- mgr_command(tid 0: {"prefix": "orch daemon add osd", "svc_arg": "smithi172:vg_nvme/lv_4", "target": ["mon-mgr", ""]}) -- 0x7f4ad8062630 con 0x7f4ac40a2b20 2024-09-12T02:29:43.013 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 12 02:29:42 smithi172 ceph-mon[35609]: pgmap v59: 0 pgs: ; 0 B data, 31 MiB used, 89 GiB / 89 GiB avail 2024-09-12T02:29:43.014 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 12 02:29:42 smithi172 ceph-mon[35609]: from='osd.1 ' entity='osd.1' cmd='[{"prefix": "osd crush create-or-move", "id": 1, "weight":0.0873, "args": ["host=smithi044", "root=default"]}]': finished 2024-09-12T02:29:43.014 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 12 02:29:42 smithi172 ceph-mon[35609]: osdmap e12: 2 total, 1 up, 2 in 2024-09-12T02:29:43.014 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 12 02:29:42 smithi172 ceph-mon[35609]: from='mgr.14150 172.21.15.39:0/408627207' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-09-12T02:29:43.014 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 12 02:29:42 smithi172 ceph-mon[35609]: from='mgr.14150 172.21.15.39:0/408627207' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-09-12T02:29:43.014 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 12 02:29:42 smithi172 ceph-mon[35609]: from='mgr.14150 172.21.15.39:0/408627207' entity='mgr.x' 2024-09-12T02:29:43.014 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 12 02:29:42 smithi172 ceph-mon[35609]: from='mgr.14150 172.21.15.39:0/408627207' entity='mgr.x' 2024-09-12T02:29:43.014 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 12 02:29:42 smithi172 ceph-mon[35609]: from='mgr.14150 172.21.15.39:0/408627207' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2024-09-12T02:29:43.014 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 12 02:29:42 smithi172 ceph-mon[35609]: from='mgr.14150 172.21.15.39:0/408627207' entity='mgr.x' 2024-09-12T02:29:43.014 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 12 02:29:42 smithi172 ceph-mon[35609]: from='mgr.14150 172.21.15.39:0/408627207' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-12T02:29:43.014 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 12 02:29:42 smithi172 ceph-mon[35609]: from='mgr.14150 172.21.15.39:0/408627207' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-12T02:29:43.014 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 12 02:29:42 smithi172 ceph-mon[35609]: from='mgr.14150 172.21.15.39:0/408627207' entity='mgr.x' 2024-09-12T02:29:43.100 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 02:29:42 smithi039 ceph-mon[30515]: pgmap v59: 0 pgs: ; 0 B data, 31 MiB used, 89 GiB / 89 GiB avail 2024-09-12T02:29:43.100 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 02:29:42 smithi039 ceph-mon[30515]: from='osd.1 ' entity='osd.1' cmd='[{"prefix": "osd crush create-or-move", "id": 1, "weight":0.0873, "args": ["host=smithi044", "root=default"]}]': finished 2024-09-12T02:29:43.100 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 02:29:42 smithi039 ceph-mon[30515]: osdmap e12: 2 total, 1 up, 2 in 2024-09-12T02:29:43.100 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 02:29:42 smithi039 ceph-mon[30515]: from='mgr.14150 172.21.15.39:0/408627207' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-09-12T02:29:43.100 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 02:29:42 smithi039 ceph-mon[30515]: from='mgr.14150 172.21.15.39:0/408627207' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-09-12T02:29:43.100 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 02:29:42 smithi039 ceph-mon[30515]: from='mgr.14150 172.21.15.39:0/408627207' entity='mgr.x' 2024-09-12T02:29:43.100 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 02:29:42 smithi039 ceph-mon[30515]: from='mgr.14150 172.21.15.39:0/408627207' entity='mgr.x' 2024-09-12T02:29:43.100 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 02:29:42 smithi039 ceph-mon[30515]: from='mgr.14150 172.21.15.39:0/408627207' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2024-09-12T02:29:43.100 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 02:29:42 smithi039 ceph-mon[30515]: from='mgr.14150 172.21.15.39:0/408627207' entity='mgr.x' 2024-09-12T02:29:43.101 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 02:29:42 smithi039 ceph-mon[30515]: from='mgr.14150 172.21.15.39:0/408627207' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-12T02:29:43.101 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 02:29:42 smithi039 ceph-mon[30515]: from='mgr.14150 172.21.15.39:0/408627207' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-12T02:29:43.101 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 02:29:42 smithi039 ceph-mon[30515]: from='mgr.14150 172.21.15.39:0/408627207' entity='mgr.x' 2024-09-12T02:29:43.199 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 12 02:29:42 smithi044 ceph-mon[35411]: pgmap v59: 0 pgs: ; 0 B data, 31 MiB used, 89 GiB / 89 GiB avail 2024-09-12T02:29:43.199 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 12 02:29:42 smithi044 ceph-mon[35411]: from='osd.1 ' entity='osd.1' cmd='[{"prefix": "osd crush create-or-move", "id": 1, "weight":0.0873, "args": ["host=smithi044", "root=default"]}]': finished 2024-09-12T02:29:43.199 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 12 02:29:42 smithi044 ceph-mon[35411]: osdmap e12: 2 total, 1 up, 2 in 2024-09-12T02:29:43.199 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 12 02:29:42 smithi044 ceph-mon[35411]: from='mgr.14150 172.21.15.39:0/408627207' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-09-12T02:29:43.199 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 12 02:29:42 smithi044 ceph-mon[35411]: from='mgr.14150 172.21.15.39:0/408627207' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-09-12T02:29:43.199 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 12 02:29:42 smithi044 ceph-mon[35411]: from='mgr.14150 172.21.15.39:0/408627207' entity='mgr.x' 2024-09-12T02:29:43.199 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 12 02:29:42 smithi044 ceph-mon[35411]: from='mgr.14150 172.21.15.39:0/408627207' entity='mgr.x' 2024-09-12T02:29:43.199 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 12 02:29:42 smithi044 ceph-mon[35411]: from='mgr.14150 172.21.15.39:0/408627207' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2024-09-12T02:29:43.199 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 12 02:29:42 smithi044 ceph-mon[35411]: from='mgr.14150 172.21.15.39:0/408627207' entity='mgr.x' 2024-09-12T02:29:43.199 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 12 02:29:42 smithi044 ceph-mon[35411]: from='mgr.14150 172.21.15.39:0/408627207' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-12T02:29:43.199 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 12 02:29:42 smithi044 ceph-mon[35411]: from='mgr.14150 172.21.15.39:0/408627207' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-12T02:29:43.200 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 12 02:29:42 smithi044 ceph-mon[35411]: from='mgr.14150 172.21.15.39:0/408627207' entity='mgr.x' 2024-09-12T02:29:44.013 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 12 02:29:43 smithi172 ceph-mon[35609]: purged_snaps scrub starts 2024-09-12T02:29:44.014 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 12 02:29:43 smithi172 ceph-mon[35609]: purged_snaps scrub ok 2024-09-12T02:29:44.014 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 12 02:29:43 smithi172 ceph-mon[35609]: Detected new or changed devices on smithi044 2024-09-12T02:29:44.014 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 12 02:29:43 smithi172 ceph-mon[35609]: Adjusting osd_memory_target on smithi044 to 17092M 2024-09-12T02:29:44.014 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 12 02:29:43 smithi172 ceph-mon[35609]: from='mgr.14150 172.21.15.39:0/408627207' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-09-12T02:29:44.014 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 12 02:29:43 smithi172 ceph-mon[35609]: osd.1 [v2:172.21.15.44:6800/2349287000,v1:172.21.15.44:6801/2349287000] boot 2024-09-12T02:29:44.014 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 12 02:29:43 smithi172 ceph-mon[35609]: osdmap e13: 2 total, 2 up, 2 in 2024-09-12T02:29:44.014 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 12 02:29:43 smithi172 ceph-mon[35609]: from='mgr.14150 172.21.15.39:0/408627207' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-09-12T02:29:44.014 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 12 02:29:43 smithi172 ceph-mon[35609]: pgmap v62: 0 pgs: ; 0 B data, 31 MiB used, 89 GiB / 89 GiB avail 2024-09-12T02:29:44.014 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 12 02:29:43 smithi172 ceph-mon[35609]: from='client.24160 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi172:vg_nvme/lv_4", "target": ["mon-mgr", ""]}]: dispatch 2024-09-12T02:29:44.014 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 12 02:29:43 smithi172 ceph-mon[35609]: from='mgr.14150 172.21.15.39:0/408627207' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-09-12T02:29:44.014 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 12 02:29:43 smithi172 ceph-mon[35609]: from='mgr.14150 172.21.15.39:0/408627207' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-09-12T02:29:44.014 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 12 02:29:43 smithi172 ceph-mon[35609]: from='mgr.14150 172.21.15.39:0/408627207' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-12T02:29:44.100 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 02:29:43 smithi039 ceph-mon[30515]: purged_snaps scrub starts 2024-09-12T02:29:44.100 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 02:29:43 smithi039 ceph-mon[30515]: purged_snaps scrub ok 2024-09-12T02:29:44.100 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 02:29:43 smithi039 ceph-mon[30515]: Detected new or changed devices on smithi044 2024-09-12T02:29:44.100 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 02:29:43 smithi039 ceph-mon[30515]: Adjusting osd_memory_target on smithi044 to 17092M 2024-09-12T02:29:44.100 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 02:29:43 smithi039 ceph-mon[30515]: from='mgr.14150 172.21.15.39:0/408627207' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-09-12T02:29:44.100 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 02:29:43 smithi039 ceph-mon[30515]: osd.1 [v2:172.21.15.44:6800/2349287000,v1:172.21.15.44:6801/2349287000] boot 2024-09-12T02:29:44.100 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 02:29:43 smithi039 ceph-mon[30515]: osdmap e13: 2 total, 2 up, 2 in 2024-09-12T02:29:44.101 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 02:29:43 smithi039 ceph-mon[30515]: from='mgr.14150 172.21.15.39:0/408627207' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-09-12T02:29:44.101 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 02:29:43 smithi039 ceph-mon[30515]: pgmap v62: 0 pgs: ; 0 B data, 31 MiB used, 89 GiB / 89 GiB avail 2024-09-12T02:29:44.101 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 02:29:43 smithi039 ceph-mon[30515]: from='client.24160 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi172:vg_nvme/lv_4", "target": ["mon-mgr", ""]}]: dispatch 2024-09-12T02:29:44.101 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 02:29:43 smithi039 ceph-mon[30515]: from='mgr.14150 172.21.15.39:0/408627207' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-09-12T02:29:44.101 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 02:29:43 smithi039 ceph-mon[30515]: from='mgr.14150 172.21.15.39:0/408627207' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-09-12T02:29:44.101 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 02:29:43 smithi039 ceph-mon[30515]: from='mgr.14150 172.21.15.39:0/408627207' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-12T02:29:44.198 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 12 02:29:43 smithi044 ceph-mon[35411]: purged_snaps scrub starts 2024-09-12T02:29:44.199 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 12 02:29:43 smithi044 ceph-mon[35411]: purged_snaps scrub ok 2024-09-12T02:29:44.199 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 12 02:29:43 smithi044 ceph-mon[35411]: Detected new or changed devices on smithi044 2024-09-12T02:29:44.199 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 12 02:29:43 smithi044 ceph-mon[35411]: Adjusting osd_memory_target on smithi044 to 17092M 2024-09-12T02:29:44.199 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 12 02:29:43 smithi044 ceph-mon[35411]: from='mgr.14150 172.21.15.39:0/408627207' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-09-12T02:29:44.199 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 12 02:29:43 smithi044 ceph-mon[35411]: osd.1 [v2:172.21.15.44:6800/2349287000,v1:172.21.15.44:6801/2349287000] boot 2024-09-12T02:29:44.199 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 12 02:29:43 smithi044 ceph-mon[35411]: osdmap e13: 2 total, 2 up, 2 in 2024-09-12T02:29:44.199 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 12 02:29:43 smithi044 ceph-mon[35411]: from='mgr.14150 172.21.15.39:0/408627207' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-09-12T02:29:44.199 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 12 02:29:43 smithi044 ceph-mon[35411]: pgmap v62: 0 pgs: ; 0 B data, 31 MiB used, 89 GiB / 89 GiB avail 2024-09-12T02:29:44.199 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 12 02:29:43 smithi044 ceph-mon[35411]: from='client.24160 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi172:vg_nvme/lv_4", "target": ["mon-mgr", ""]}]: dispatch 2024-09-12T02:29:44.199 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 12 02:29:43 smithi044 ceph-mon[35411]: from='mgr.14150 172.21.15.39:0/408627207' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-09-12T02:29:44.199 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 12 02:29:43 smithi044 ceph-mon[35411]: from='mgr.14150 172.21.15.39:0/408627207' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-09-12T02:29:44.199 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 12 02:29:43 smithi044 ceph-mon[35411]: from='mgr.14150 172.21.15.39:0/408627207' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-12T02:29:45.013 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 12 02:29:44 smithi172 ceph-mon[35609]: osdmap e14: 2 total, 2 up, 2 in 2024-09-12T02:29:45.100 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 02:29:44 smithi039 ceph-mon[30515]: osdmap e14: 2 total, 2 up, 2 in 2024-09-12T02:29:45.198 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 12 02:29:44 smithi044 ceph-mon[35411]: osdmap e14: 2 total, 2 up, 2 in 2024-09-12T02:29:46.013 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 12 02:29:45 smithi172 ceph-mon[35609]: pgmap v64: 0 pgs: ; 0 B data, 57 MiB used, 179 GiB / 179 GiB avail 2024-09-12T02:29:46.013 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 12 02:29:45 smithi172 ceph-mon[35609]: from='client.? 172.21.15.172:0/854615132' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "a758803f-8668-4fc8-9417-b8d080cd9a7c"}]: dispatch 2024-09-12T02:29:46.014 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 12 02:29:45 smithi172 ceph-mon[35609]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "a758803f-8668-4fc8-9417-b8d080cd9a7c"}]: dispatch 2024-09-12T02:29:46.014 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 12 02:29:45 smithi172 ceph-mon[35609]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "a758803f-8668-4fc8-9417-b8d080cd9a7c"}]': finished 2024-09-12T02:29:46.014 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 12 02:29:45 smithi172 ceph-mon[35609]: osdmap e15: 3 total, 2 up, 3 in 2024-09-12T02:29:46.014 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 12 02:29:45 smithi172 ceph-mon[35609]: from='mgr.14150 172.21.15.39:0/408627207' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-09-12T02:29:46.014 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 12 02:29:45 smithi172 ceph-mon[35609]: from='client.? 172.21.15.172:0/1350780403' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-09-12T02:29:46.099 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 02:29:45 smithi039 ceph-mon[30515]: pgmap v64: 0 pgs: ; 0 B data, 57 MiB used, 179 GiB / 179 GiB avail 2024-09-12T02:29:46.100 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 02:29:45 smithi039 ceph-mon[30515]: from='client.? 172.21.15.172:0/854615132' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "a758803f-8668-4fc8-9417-b8d080cd9a7c"}]: dispatch 2024-09-12T02:29:46.100 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 02:29:45 smithi039 ceph-mon[30515]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "a758803f-8668-4fc8-9417-b8d080cd9a7c"}]: dispatch 2024-09-12T02:29:46.100 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 02:29:45 smithi039 ceph-mon[30515]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "a758803f-8668-4fc8-9417-b8d080cd9a7c"}]': finished 2024-09-12T02:29:46.100 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 02:29:45 smithi039 ceph-mon[30515]: osdmap e15: 3 total, 2 up, 3 in 2024-09-12T02:29:46.100 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 02:29:45 smithi039 ceph-mon[30515]: from='mgr.14150 172.21.15.39:0/408627207' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-09-12T02:29:46.100 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 02:29:45 smithi039 ceph-mon[30515]: from='client.? 172.21.15.172:0/1350780403' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-09-12T02:29:46.198 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 12 02:29:45 smithi044 ceph-mon[35411]: pgmap v64: 0 pgs: ; 0 B data, 57 MiB used, 179 GiB / 179 GiB avail 2024-09-12T02:29:46.198 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 12 02:29:45 smithi044 ceph-mon[35411]: from='client.? 172.21.15.172:0/854615132' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "a758803f-8668-4fc8-9417-b8d080cd9a7c"}]: dispatch 2024-09-12T02:29:46.199 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 12 02:29:45 smithi044 ceph-mon[35411]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "a758803f-8668-4fc8-9417-b8d080cd9a7c"}]: dispatch 2024-09-12T02:29:46.199 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 12 02:29:45 smithi044 ceph-mon[35411]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "a758803f-8668-4fc8-9417-b8d080cd9a7c"}]': finished 2024-09-12T02:29:46.199 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 12 02:29:45 smithi044 ceph-mon[35411]: osdmap e15: 3 total, 2 up, 3 in 2024-09-12T02:29:46.199 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 12 02:29:45 smithi044 ceph-mon[35411]: from='mgr.14150 172.21.15.39:0/408627207' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-09-12T02:29:46.199 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 12 02:29:45 smithi044 ceph-mon[35411]: from='client.? 172.21.15.172:0/1350780403' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-09-12T02:29:48.099 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 02:29:47 smithi039 ceph-mon[30515]: pgmap v66: 0 pgs: ; 0 B data, 57 MiB used, 179 GiB / 179 GiB avail 2024-09-12T02:29:48.198 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 12 02:29:47 smithi044 ceph-mon[35411]: pgmap v66: 0 pgs: ; 0 B data, 57 MiB used, 179 GiB / 179 GiB avail 2024-09-12T02:29:48.263 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 12 02:29:47 smithi172 ceph-mon[35609]: pgmap v66: 0 pgs: ; 0 B data, 57 MiB used, 179 GiB / 179 GiB avail 2024-09-12T02:29:50.099 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 02:29:49 smithi039 ceph-mon[30515]: pgmap v67: 0 pgs: ; 0 B data, 57 MiB used, 179 GiB / 179 GiB avail 2024-09-12T02:29:50.108 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 12 02:29:49 smithi172 ceph-mon[35609]: pgmap v67: 0 pgs: ; 0 B data, 57 MiB used, 179 GiB / 179 GiB avail 2024-09-12T02:29:50.198 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 12 02:29:49 smithi044 ceph-mon[35411]: pgmap v67: 0 pgs: ; 0 B data, 57 MiB used, 179 GiB / 179 GiB avail 2024-09-12T02:29:52.099 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 02:29:51 smithi039 ceph-mon[30515]: pgmap v68: 0 pgs: ; 0 B data, 57 MiB used, 179 GiB / 179 GiB avail 2024-09-12T02:29:52.134 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 12 02:29:51 smithi172 ceph-mon[35609]: pgmap v68: 0 pgs: ; 0 B data, 57 MiB used, 179 GiB / 179 GiB avail 2024-09-12T02:29:52.198 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 12 02:29:51 smithi044 ceph-mon[35411]: pgmap v68: 0 pgs: ; 0 B data, 57 MiB used, 179 GiB / 179 GiB avail 2024-09-12T02:29:54.013 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 12 02:29:53 smithi172 ceph-mon[35609]: pgmap v69: 0 pgs: ; 0 B data, 57 MiB used, 179 GiB / 179 GiB avail 2024-09-12T02:29:54.014 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 12 02:29:53 smithi172 ceph-mon[35609]: from='mgr.14150 172.21.15.39:0/408627207' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.2"}]: dispatch 2024-09-12T02:29:54.014 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 12 02:29:53 smithi172 ceph-mon[35609]: from='mgr.14150 172.21.15.39:0/408627207' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-12T02:29:54.014 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 12 02:29:53 smithi172 ceph-mon[35609]: Deploying daemon osd.2 on smithi172 2024-09-12T02:29:54.100 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 02:29:53 smithi039 ceph-mon[30515]: pgmap v69: 0 pgs: ; 0 B data, 57 MiB used, 179 GiB / 179 GiB avail 2024-09-12T02:29:54.143 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 02:29:53 smithi039 ceph-mon[30515]: from='mgr.14150 172.21.15.39:0/408627207' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.2"}]: dispatch 2024-09-12T02:29:54.143 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 02:29:53 smithi039 ceph-mon[30515]: from='mgr.14150 172.21.15.39:0/408627207' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-12T02:29:54.143 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 02:29:53 smithi039 ceph-mon[30515]: Deploying daemon osd.2 on smithi172 2024-09-12T02:29:54.199 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 12 02:29:53 smithi044 ceph-mon[35411]: pgmap v69: 0 pgs: ; 0 B data, 57 MiB used, 179 GiB / 179 GiB avail 2024-09-12T02:29:54.199 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 12 02:29:53 smithi044 ceph-mon[35411]: from='mgr.14150 172.21.15.39:0/408627207' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.2"}]: dispatch 2024-09-12T02:29:54.199 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 12 02:29:53 smithi044 ceph-mon[35411]: from='mgr.14150 172.21.15.39:0/408627207' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-12T02:29:54.199 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 12 02:29:53 smithi044 ceph-mon[35411]: Deploying daemon osd.2 on smithi172 2024-09-12T02:29:55.949 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 12 02:29:55 smithi172 ceph-mon[35609]: pgmap v70: 0 pgs: ; 0 B data, 57 MiB used, 179 GiB / 179 GiB avail 2024-09-12T02:29:56.099 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 02:29:55 smithi039 ceph-mon[30515]: pgmap v70: 0 pgs: ; 0 B data, 57 MiB used, 179 GiB / 179 GiB avail 2024-09-12T02:29:56.198 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 12 02:29:55 smithi044 ceph-mon[35411]: pgmap v70: 0 pgs: ; 0 B data, 57 MiB used, 179 GiB / 179 GiB avail 2024-09-12T02:29:58.014 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 12 02:29:57 smithi172 ceph-mon[35609]: pgmap v71: 0 pgs: ; 0 B data, 57 MiB used, 179 GiB / 179 GiB avail 2024-09-12T02:29:58.100 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 02:29:57 smithi039 ceph-mon[30515]: pgmap v71: 0 pgs: ; 0 B data, 57 MiB used, 179 GiB / 179 GiB avail 2024-09-12T02:29:58.198 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 12 02:29:57 smithi044 ceph-mon[35411]: pgmap v71: 0 pgs: ; 0 B data, 57 MiB used, 179 GiB / 179 GiB avail 2024-09-12T02:29:59.922 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 12 02:29:59 smithi172 ceph-mon[35609]: pgmap v72: 0 pgs: ; 0 B data, 57 MiB used, 179 GiB / 179 GiB avail 2024-09-12T02:29:59.923 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 12 02:29:59 smithi172 ceph-mon[35609]: from='mgr.14150 172.21.15.39:0/408627207' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-12T02:29:59.923 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 12 02:29:59 smithi172 ceph-mon[35609]: from='mgr.14150 172.21.15.39:0/408627207' entity='mgr.x' 2024-09-12T02:29:59.923 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 12 02:29:59 smithi172 ceph-mon[35609]: from='mgr.14150 172.21.15.39:0/408627207' entity='mgr.x' 2024-09-12T02:30:00.099 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 02:29:59 smithi039 ceph-mon[30515]: pgmap v72: 0 pgs: ; 0 B data, 57 MiB used, 179 GiB / 179 GiB avail 2024-09-12T02:30:00.100 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 02:29:59 smithi039 ceph-mon[30515]: from='mgr.14150 172.21.15.39:0/408627207' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-12T02:30:00.100 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 02:29:59 smithi039 ceph-mon[30515]: from='mgr.14150 172.21.15.39:0/408627207' entity='mgr.x' 2024-09-12T02:30:00.100 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 02:29:59 smithi039 ceph-mon[30515]: from='mgr.14150 172.21.15.39:0/408627207' entity='mgr.x' 2024-09-12T02:30:00.199 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 12 02:29:59 smithi044 ceph-mon[35411]: pgmap v72: 0 pgs: ; 0 B data, 57 MiB used, 179 GiB / 179 GiB avail 2024-09-12T02:30:00.199 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 12 02:29:59 smithi044 ceph-mon[35411]: from='mgr.14150 172.21.15.39:0/408627207' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-12T02:30:00.199 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 12 02:29:59 smithi044 ceph-mon[35411]: from='mgr.14150 172.21.15.39:0/408627207' entity='mgr.x' 2024-09-12T02:30:00.199 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 12 02:29:59 smithi044 ceph-mon[35411]: from='mgr.14150 172.21.15.39:0/408627207' entity='mgr.x' 2024-09-12T02:30:01.198 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 12 02:30:00 smithi044 ceph-mon[35411]: overall HEALTH_OK 2024-09-12T02:30:01.263 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 12 02:30:00 smithi172 ceph-mon[35609]: overall HEALTH_OK 2024-09-12T02:30:01.349 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 02:30:00 smithi039 ceph-mon[30515]: overall HEALTH_OK 2024-09-12T02:30:02.600 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 02:30:02 smithi039 ceph-mon[30515]: pgmap v73: 0 pgs: ; 0 B data, 57 MiB used, 179 GiB / 179 GiB avail 2024-09-12T02:30:02.600 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 02:30:02 smithi039 ceph-mon[30515]: from='mgr.14150 172.21.15.39:0/408627207' entity='mgr.x' 2024-09-12T02:30:02.600 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 02:30:02 smithi039 ceph-mon[30515]: from='mgr.14150 172.21.15.39:0/408627207' entity='mgr.x' 2024-09-12T02:30:02.600 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 02:30:02 smithi039 ceph-mon[30515]: from='mgr.14150 172.21.15.39:0/408627207' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-12T02:30:02.600 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 02:30:02 smithi039 ceph-mon[30515]: from='mgr.14150 172.21.15.39:0/408627207' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-12T02:30:02.600 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 02:30:02 smithi039 ceph-mon[30515]: from='mgr.14150 172.21.15.39:0/408627207' entity='mgr.x' 2024-09-12T02:30:02.687 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 12 02:30:02 smithi172 ceph-mon[35609]: pgmap v73: 0 pgs: ; 0 B data, 57 MiB used, 179 GiB / 179 GiB avail 2024-09-12T02:30:02.687 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 12 02:30:02 smithi172 ceph-mon[35609]: from='mgr.14150 172.21.15.39:0/408627207' entity='mgr.x' 2024-09-12T02:30:02.687 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 12 02:30:02 smithi172 ceph-mon[35609]: from='mgr.14150 172.21.15.39:0/408627207' entity='mgr.x' 2024-09-12T02:30:02.688 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 12 02:30:02 smithi172 ceph-mon[35609]: from='mgr.14150 172.21.15.39:0/408627207' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-12T02:30:02.688 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 12 02:30:02 smithi172 ceph-mon[35609]: from='mgr.14150 172.21.15.39:0/408627207' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-12T02:30:02.688 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 12 02:30:02 smithi172 ceph-mon[35609]: from='mgr.14150 172.21.15.39:0/408627207' entity='mgr.x' 2024-09-12T02:30:02.698 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 12 02:30:02 smithi044 ceph-mon[35411]: pgmap v73: 0 pgs: ; 0 B data, 57 MiB used, 179 GiB / 179 GiB avail 2024-09-12T02:30:02.698 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 12 02:30:02 smithi044 ceph-mon[35411]: from='mgr.14150 172.21.15.39:0/408627207' entity='mgr.x' 2024-09-12T02:30:02.699 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 12 02:30:02 smithi044 ceph-mon[35411]: from='mgr.14150 172.21.15.39:0/408627207' entity='mgr.x' 2024-09-12T02:30:02.699 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 12 02:30:02 smithi044 ceph-mon[35411]: from='mgr.14150 172.21.15.39:0/408627207' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-12T02:30:02.699 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 12 02:30:02 smithi044 ceph-mon[35411]: from='mgr.14150 172.21.15.39:0/408627207' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-12T02:30:02.699 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 12 02:30:02 smithi044 ceph-mon[35411]: from='mgr.14150 172.21.15.39:0/408627207' entity='mgr.x' 2024-09-12T02:30:03.311 INFO:teuthology.orchestra.run.smithi172.stderr:2024-09-12T02:30:03.311+0000 7f4acf7fe640 1 -- 172.21.15.172:0/3627387108 <== mgr.14150 v2:172.21.15.39:6800/1725006999 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+37 (secure 0 0 0) 0x7f4ad8062630 con 0x7f4ac40a2b20 2024-09-12T02:30:03.312 INFO:teuthology.orchestra.run.smithi172.stdout:Created osd(s) 2 on host 'smithi172' 2024-09-12T02:30:03.314 INFO:teuthology.orchestra.run.smithi172.stderr:2024-09-12T02:30:03.313+0000 7f4ae061a640 1 -- 172.21.15.172:0/3627387108 >> [v2:172.21.15.39:6800/1725006999,v1:172.21.15.39:6801/1725006999] conn(0x7f4ac40a2b20 msgr2=0x7f4ac40a4fe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:30:03.314 INFO:teuthology.orchestra.run.smithi172.stderr:2024-09-12T02:30:03.313+0000 7f4ae061a640 1 --2- 172.21.15.172:0/3627387108 >> [v2:172.21.15.39:6800/1725006999,v1:172.21.15.39:6801/1725006999] conn(0x7f4ac40a2b20 0x7f4ac40a4fe0 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7f4ac8006010 tx=0x7f4ac8031400 comp rx=0 tx=0).stop 2024-09-12T02:30:03.314 INFO:teuthology.orchestra.run.smithi172.stderr:2024-09-12T02:30:03.313+0000 7f4ae061a640 1 -- 172.21.15.172:0/3627387108 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f4ad8101c00 msgr2=0x7f4ad8198090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:30:03.314 INFO:teuthology.orchestra.run.smithi172.stderr:2024-09-12T02:30:03.313+0000 7f4ae061a640 1 --2- 172.21.15.172:0/3627387108 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f4ad8101c00 0x7f4ad8198090 secure :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0x7f4ad400b450 tx=0x7f4ad400b910 comp rx=0 tx=0).stop 2024-09-12T02:30:03.315 INFO:teuthology.orchestra.run.smithi172.stderr:2024-09-12T02:30:03.313+0000 7f4ae061a640 1 -- 172.21.15.172:0/3627387108 shutdown_connections 2024-09-12T02:30:03.315 INFO:teuthology.orchestra.run.smithi172.stderr:2024-09-12T02:30:03.313+0000 7f4ae061a640 1 --2- 172.21.15.172:0/3627387108 >> [v2:172.21.15.39:6800/1725006999,v1:172.21.15.39:6801/1725006999] conn(0x7f4ac40a2b20 0x7f4ac40a4fe0 unknown :-1 s=CLOSED pgs=58 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:30:03.315 INFO:teuthology.orchestra.run.smithi172.stderr:2024-09-12T02:30:03.313+0000 7f4ae061a640 1 --2- 172.21.15.172:0/3627387108 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f4ad81037c0 0x7f4ad819f650 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:30:03.315 INFO:teuthology.orchestra.run.smithi172.stderr:2024-09-12T02:30:03.313+0000 7f4ae061a640 1 --2- 172.21.15.172:0/3627387108 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f4ad8102e00 0x7f4ad81985d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:30:03.315 INFO:teuthology.orchestra.run.smithi172.stderr:2024-09-12T02:30:03.313+0000 7f4ae061a640 1 --2- 172.21.15.172:0/3627387108 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f4ad8101c00 0x7f4ad8198090 unknown :-1 s=CLOSED pgs=13 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:30:03.315 INFO:teuthology.orchestra.run.smithi172.stderr:2024-09-12T02:30:03.313+0000 7f4ae061a640 1 -- 172.21.15.172:0/3627387108 >> 172.21.15.172:0/3627387108 conn(0x7f4ad80fd390 msgr2=0x7f4ad8106270 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:30:03.315 INFO:teuthology.orchestra.run.smithi172.stderr:2024-09-12T02:30:03.313+0000 7f4ae061a640 1 -- 172.21.15.172:0/3627387108 shutdown_connections 2024-09-12T02:30:03.315 INFO:teuthology.orchestra.run.smithi172.stderr:2024-09-12T02:30:03.314+0000 7f4ae061a640 1 -- 172.21.15.172:0/3627387108 wait complete. 2024-09-12T02:30:03.932 DEBUG:teuthology.orchestra.run.smithi172:osd.2> sudo journalctl -f -n 0 -u ceph-4954ed46-70ae-11ef-bcea-c7b262605968@osd.2.service 2024-09-12T02:30:03.935 INFO:tasks.cephadm:Deploying osd.3 on smithi039 with /dev/vg_nvme/lv_3... 2024-09-12T02:30:03.935 DEBUG:teuthology.orchestra.run.smithi039:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc ceph-volume -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 4954ed46-70ae-11ef-bcea-c7b262605968 -- lvm zap /dev/vg_nvme/lv_3 2024-09-12T02:30:04.315 INFO:teuthology.orchestra.run.smithi039.stderr:Inferring config /var/lib/ceph/4954ed46-70ae-11ef-bcea-c7b262605968/mon.a/config 2024-09-12T02:30:04.599 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 02:30:04 smithi039 ceph-mon[30515]: pgmap v74: 0 pgs: ; 0 B data, 57 MiB used, 179 GiB / 179 GiB avail 2024-09-12T02:30:04.599 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 02:30:04 smithi039 ceph-mon[30515]: from='mgr.14150 172.21.15.39:0/408627207' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-12T02:30:04.600 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 02:30:04 smithi039 ceph-mon[30515]: from='mgr.14150 172.21.15.39:0/408627207' entity='mgr.x' 2024-09-12T02:30:04.600 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 02:30:04 smithi039 ceph-mon[30515]: from='mgr.14150 172.21.15.39:0/408627207' entity='mgr.x' 2024-09-12T02:30:04.698 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 12 02:30:04 smithi044 ceph-mon[35411]: pgmap v74: 0 pgs: ; 0 B data, 57 MiB used, 179 GiB / 179 GiB avail 2024-09-12T02:30:04.698 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 12 02:30:04 smithi044 ceph-mon[35411]: from='mgr.14150 172.21.15.39:0/408627207' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-12T02:30:04.699 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 12 02:30:04 smithi044 ceph-mon[35411]: from='mgr.14150 172.21.15.39:0/408627207' entity='mgr.x' 2024-09-12T02:30:04.699 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 12 02:30:04 smithi044 ceph-mon[35411]: from='mgr.14150 172.21.15.39:0/408627207' entity='mgr.x' 2024-09-12T02:30:04.763 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 12 02:30:04 smithi172 ceph-mon[35609]: pgmap v74: 0 pgs: ; 0 B data, 57 MiB used, 179 GiB / 179 GiB avail 2024-09-12T02:30:04.763 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 12 02:30:04 smithi172 ceph-mon[35609]: from='mgr.14150 172.21.15.39:0/408627207' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-12T02:30:04.763 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 12 02:30:04 smithi172 ceph-mon[35609]: from='mgr.14150 172.21.15.39:0/408627207' entity='mgr.x' 2024-09-12T02:30:04.764 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 12 02:30:04 smithi172 ceph-mon[35609]: from='mgr.14150 172.21.15.39:0/408627207' entity='mgr.x' 2024-09-12T02:30:05.224 INFO:journalctl@ceph.osd.2.smithi172.stdout:Sep 12 02:30:04 smithi172 ceph-4954ed46-70ae-11ef-bcea-c7b262605968-osd-2[40621]: 2024-09-12T02:30:04.969+0000 7f04c3f7e640 -1 osd.2 0 log_to_monitors true 2024-09-12T02:30:05.475 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 02:30:05 smithi039 ceph-mon[30515]: from='osd.2 [v2:172.21.15.172:6800/1176898232,v1:172.21.15.172:6801/1176898232]' entity='osd.2' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["2"]}]: dispatch 2024-09-12T02:30:05.475 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 02:30:05 smithi039 ceph-mon[30515]: from='osd.2 ' entity='osd.2' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["2"]}]: dispatch 2024-09-12T02:30:05.506 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 12 02:30:05 smithi172 ceph-mon[35609]: from='osd.2 [v2:172.21.15.172:6800/1176898232,v1:172.21.15.172:6801/1176898232]' entity='osd.2' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["2"]}]: dispatch 2024-09-12T02:30:05.506 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 12 02:30:05 smithi172 ceph-mon[35609]: from='osd.2 ' entity='osd.2' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["2"]}]: dispatch 2024-09-12T02:30:05.699 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 12 02:30:05 smithi044 ceph-mon[35411]: from='osd.2 [v2:172.21.15.172:6800/1176898232,v1:172.21.15.172:6801/1176898232]' entity='osd.2' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["2"]}]: dispatch 2024-09-12T02:30:05.699 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 12 02:30:05 smithi044 ceph-mon[35411]: from='osd.2 ' entity='osd.2' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["2"]}]: dispatch 2024-09-12T02:30:06.349 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 02:30:06 smithi039 ceph-mon[30515]: pgmap v75: 0 pgs: ; 0 B data, 57 MiB used, 179 GiB / 179 GiB avail 2024-09-12T02:30:06.349 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 02:30:06 smithi039 ceph-mon[30515]: from='osd.2 ' entity='osd.2' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["2"]}]': finished 2024-09-12T02:30:06.350 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 02:30:06 smithi039 ceph-mon[30515]: osdmap e16: 3 total, 2 up, 3 in 2024-09-12T02:30:06.350 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 02:30:06 smithi039 ceph-mon[30515]: from='mgr.14150 172.21.15.39:0/408627207' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-09-12T02:30:06.350 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 02:30:06 smithi039 ceph-mon[30515]: from='osd.2 [v2:172.21.15.172:6800/1176898232,v1:172.21.15.172:6801/1176898232]' entity='osd.2' cmd=[{"prefix": "osd crush create-or-move", "id": 2, "weight":0.0873, "args": ["host=smithi172", "root=default"]}]: dispatch 2024-09-12T02:30:06.350 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 02:30:06 smithi039 ceph-mon[30515]: from='osd.2 ' entity='osd.2' cmd=[{"prefix": "osd crush create-or-move", "id": 2, "weight":0.0873, "args": ["host=smithi172", "root=default"]}]: dispatch 2024-09-12T02:30:06.419 INFO:journalctl@ceph.osd.2.smithi172.stdout:Sep 12 02:30:06 smithi172 ceph-4954ed46-70ae-11ef-bcea-c7b262605968-osd-2[40621]: 2024-09-12T02:30:06.317+0000 7f04bff01640 -1 osd.2 0 waiting for initial osdmap 2024-09-12T02:30:06.419 INFO:journalctl@ceph.osd.2.smithi172.stdout:Sep 12 02:30:06 smithi172 ceph-4954ed46-70ae-11ef-bcea-c7b262605968-osd-2[40621]: 2024-09-12T02:30:06.320+0000 7f04bbd29640 -1 osd.2 17 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-09-12T02:30:06.420 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 12 02:30:06 smithi172 ceph-mon[35609]: pgmap v75: 0 pgs: ; 0 B data, 57 MiB used, 179 GiB / 179 GiB avail 2024-09-12T02:30:06.420 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 12 02:30:06 smithi172 ceph-mon[35609]: from='osd.2 ' entity='osd.2' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["2"]}]': finished 2024-09-12T02:30:06.420 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 12 02:30:06 smithi172 ceph-mon[35609]: osdmap e16: 3 total, 2 up, 3 in 2024-09-12T02:30:06.420 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 12 02:30:06 smithi172 ceph-mon[35609]: from='mgr.14150 172.21.15.39:0/408627207' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-09-12T02:30:06.420 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 12 02:30:06 smithi172 ceph-mon[35609]: from='osd.2 [v2:172.21.15.172:6800/1176898232,v1:172.21.15.172:6801/1176898232]' entity='osd.2' cmd=[{"prefix": "osd crush create-or-move", "id": 2, "weight":0.0873, "args": ["host=smithi172", "root=default"]}]: dispatch 2024-09-12T02:30:06.420 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 12 02:30:06 smithi172 ceph-mon[35609]: from='osd.2 ' entity='osd.2' cmd=[{"prefix": "osd crush create-or-move", "id": 2, "weight":0.0873, "args": ["host=smithi172", "root=default"]}]: dispatch 2024-09-12T02:30:06.698 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 12 02:30:06 smithi044 ceph-mon[35411]: pgmap v75: 0 pgs: ; 0 B data, 57 MiB used, 179 GiB / 179 GiB avail 2024-09-12T02:30:06.698 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 12 02:30:06 smithi044 ceph-mon[35411]: from='osd.2 ' entity='osd.2' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["2"]}]': finished 2024-09-12T02:30:06.698 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 12 02:30:06 smithi044 ceph-mon[35411]: osdmap e16: 3 total, 2 up, 3 in 2024-09-12T02:30:06.699 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 12 02:30:06 smithi044 ceph-mon[35411]: from='mgr.14150 172.21.15.39:0/408627207' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-09-12T02:30:06.699 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 12 02:30:06 smithi044 ceph-mon[35411]: from='osd.2 [v2:172.21.15.172:6800/1176898232,v1:172.21.15.172:6801/1176898232]' entity='osd.2' cmd=[{"prefix": "osd crush create-or-move", "id": 2, "weight":0.0873, "args": ["host=smithi172", "root=default"]}]: dispatch 2024-09-12T02:30:06.699 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 12 02:30:06 smithi044 ceph-mon[35411]: from='osd.2 ' entity='osd.2' cmd=[{"prefix": "osd crush create-or-move", "id": 2, "weight":0.0873, "args": ["host=smithi172", "root=default"]}]: dispatch 2024-09-12T02:30:07.360 INFO:teuthology.orchestra.run.smithi039.stdout: 2024-09-12T02:30:07.391 DEBUG:teuthology.orchestra.run.smithi039:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 4954ed46-70ae-11ef-bcea-c7b262605968 -- ceph orch daemon add osd smithi039:vg_nvme/lv_3 2024-09-12T02:30:07.599 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 02:30:07 smithi039 ceph-mon[30515]: from='osd.2 ' entity='osd.2' cmd='[{"prefix": "osd crush create-or-move", "id": 2, "weight":0.0873, "args": ["host=smithi172", "root=default"]}]': finished 2024-09-12T02:30:07.600 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 02:30:07 smithi039 ceph-mon[30515]: osdmap e17: 3 total, 2 up, 3 in 2024-09-12T02:30:07.600 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 02:30:07 smithi039 ceph-mon[30515]: from='mgr.14150 172.21.15.39:0/408627207' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-09-12T02:30:07.600 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 02:30:07 smithi039 ceph-mon[30515]: from='mgr.14150 172.21.15.39:0/408627207' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-09-12T02:30:07.600 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 02:30:07 smithi039 ceph-mon[30515]: from='mgr.14150 172.21.15.39:0/408627207' entity='mgr.x' 2024-09-12T02:30:07.600 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 02:30:07 smithi039 ceph-mon[30515]: from='mgr.14150 172.21.15.39:0/408627207' entity='mgr.x' 2024-09-12T02:30:07.600 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 02:30:07 smithi039 ceph-mon[30515]: from='mgr.14150 172.21.15.39:0/408627207' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2024-09-12T02:30:07.600 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 02:30:07 smithi039 ceph-mon[30515]: from='mgr.14150 172.21.15.39:0/408627207' entity='mgr.x' 2024-09-12T02:30:07.600 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 02:30:07 smithi039 ceph-mon[30515]: from='mgr.14150 172.21.15.39:0/408627207' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-12T02:30:07.600 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 02:30:07 smithi039 ceph-mon[30515]: from='mgr.14150 172.21.15.39:0/408627207' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-12T02:30:07.600 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 02:30:07 smithi039 ceph-mon[30515]: from='mgr.14150 172.21.15.39:0/408627207' entity='mgr.x' 2024-09-12T02:30:07.600 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 02:30:07 smithi039 ceph-mon[30515]: from='mgr.14150 172.21.15.39:0/408627207' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-09-12T02:30:07.698 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 12 02:30:07 smithi044 ceph-mon[35411]: from='osd.2 ' entity='osd.2' cmd='[{"prefix": "osd crush create-or-move", "id": 2, "weight":0.0873, "args": ["host=smithi172", "root=default"]}]': finished 2024-09-12T02:30:07.698 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 12 02:30:07 smithi044 ceph-mon[35411]: osdmap e17: 3 total, 2 up, 3 in 2024-09-12T02:30:07.699 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 12 02:30:07 smithi044 ceph-mon[35411]: from='mgr.14150 172.21.15.39:0/408627207' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-09-12T02:30:07.699 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 12 02:30:07 smithi044 ceph-mon[35411]: from='mgr.14150 172.21.15.39:0/408627207' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-09-12T02:30:07.699 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 12 02:30:07 smithi044 ceph-mon[35411]: from='mgr.14150 172.21.15.39:0/408627207' entity='mgr.x' 2024-09-12T02:30:07.699 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 12 02:30:07 smithi044 ceph-mon[35411]: from='mgr.14150 172.21.15.39:0/408627207' entity='mgr.x' 2024-09-12T02:30:07.699 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 12 02:30:07 smithi044 ceph-mon[35411]: from='mgr.14150 172.21.15.39:0/408627207' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2024-09-12T02:30:07.699 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 12 02:30:07 smithi044 ceph-mon[35411]: from='mgr.14150 172.21.15.39:0/408627207' entity='mgr.x' 2024-09-12T02:30:07.699 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 12 02:30:07 smithi044 ceph-mon[35411]: from='mgr.14150 172.21.15.39:0/408627207' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-12T02:30:07.699 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 12 02:30:07 smithi044 ceph-mon[35411]: from='mgr.14150 172.21.15.39:0/408627207' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-12T02:30:07.699 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 12 02:30:07 smithi044 ceph-mon[35411]: from='mgr.14150 172.21.15.39:0/408627207' entity='mgr.x' 2024-09-12T02:30:07.699 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 12 02:30:07 smithi044 ceph-mon[35411]: from='mgr.14150 172.21.15.39:0/408627207' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-09-12T02:30:07.757 INFO:teuthology.orchestra.run.smithi039.stderr:Inferring config /var/lib/ceph/4954ed46-70ae-11ef-bcea-c7b262605968/mon.a/config 2024-09-12T02:30:07.763 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 12 02:30:07 smithi172 ceph-mon[35609]: from='osd.2 ' entity='osd.2' cmd='[{"prefix": "osd crush create-or-move", "id": 2, "weight":0.0873, "args": ["host=smithi172", "root=default"]}]': finished 2024-09-12T02:30:07.763 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 12 02:30:07 smithi172 ceph-mon[35609]: osdmap e17: 3 total, 2 up, 3 in 2024-09-12T02:30:07.763 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 12 02:30:07 smithi172 ceph-mon[35609]: from='mgr.14150 172.21.15.39:0/408627207' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-09-12T02:30:07.764 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 12 02:30:07 smithi172 ceph-mon[35609]: from='mgr.14150 172.21.15.39:0/408627207' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-09-12T02:30:07.764 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 12 02:30:07 smithi172 ceph-mon[35609]: from='mgr.14150 172.21.15.39:0/408627207' entity='mgr.x' 2024-09-12T02:30:07.764 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 12 02:30:07 smithi172 ceph-mon[35609]: from='mgr.14150 172.21.15.39:0/408627207' entity='mgr.x' 2024-09-12T02:30:07.764 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 12 02:30:07 smithi172 ceph-mon[35609]: from='mgr.14150 172.21.15.39:0/408627207' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2024-09-12T02:30:07.764 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 12 02:30:07 smithi172 ceph-mon[35609]: from='mgr.14150 172.21.15.39:0/408627207' entity='mgr.x' 2024-09-12T02:30:07.764 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 12 02:30:07 smithi172 ceph-mon[35609]: from='mgr.14150 172.21.15.39:0/408627207' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-12T02:30:07.764 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 12 02:30:07 smithi172 ceph-mon[35609]: from='mgr.14150 172.21.15.39:0/408627207' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-12T02:30:07.764 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 12 02:30:07 smithi172 ceph-mon[35609]: from='mgr.14150 172.21.15.39:0/408627207' entity='mgr.x' 2024-09-12T02:30:07.764 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 12 02:30:07 smithi172 ceph-mon[35609]: from='mgr.14150 172.21.15.39:0/408627207' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-09-12T02:30:08.253 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:30:08.251+0000 7fd4b8a00640 1 -- 172.21.15.39:0/3234687049 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fd4b40761a0 msgr2=0x7fd4b4074600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:30:08.253 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:30:08.251+0000 7fd4b8a00640 1 --2- 172.21.15.39:0/3234687049 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fd4b40761a0 0x7fd4b4074600 secure :-1 s=READY pgs=112 cs=0 l=1 rev1=1 crypto rx=0x7fd4a4009900 tx=0x7fd4a402a410 comp rx=0 tx=0).stop 2024-09-12T02:30:08.254 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:30:08.251+0000 7fd4b8a00640 1 -- 172.21.15.39:0/3234687049 shutdown_connections 2024-09-12T02:30:08.254 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:30:08.251+0000 7fd4b8a00640 1 --2- 172.21.15.39:0/3234687049 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fd4b41098b0 0x7fd4b410bd70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:30:08.254 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:30:08.251+0000 7fd4b8a00640 1 --2- 172.21.15.39:0/3234687049 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fd4b4074b40 0x7fd4b4074fa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:30:08.254 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:30:08.251+0000 7fd4b8a00640 1 --2- 172.21.15.39:0/3234687049 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fd4b40761a0 0x7fd4b4074600 unknown :-1 s=CLOSED pgs=112 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:30:08.254 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:30:08.251+0000 7fd4b8a00640 1 -- 172.21.15.39:0/3234687049 >> 172.21.15.39:0/3234687049 conn(0x7fd4b40fd1f0 msgr2=0x7fd4b40ff610 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:30:08.254 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:30:08.251+0000 7fd4b8a00640 1 -- 172.21.15.39:0/3234687049 shutdown_connections 2024-09-12T02:30:08.254 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:30:08.251+0000 7fd4b8a00640 1 -- 172.21.15.39:0/3234687049 wait complete. 2024-09-12T02:30:08.254 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:30:08.252+0000 7fd4b8a00640 1 Processor -- start 2024-09-12T02:30:08.254 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:30:08.252+0000 7fd4b8a00640 1 -- start start 2024-09-12T02:30:08.254 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:30:08.252+0000 7fd4b8a00640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fd4b4074b40 0x7fd4b4199eb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:30:08.254 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:30:08.252+0000 7fd4b8a00640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fd4b40761a0 0x7fd4b419a3f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:30:08.254 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:30:08.252+0000 7fd4b8a00640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fd4b41098b0 0x7fd4b41a1470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:30:08.255 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:30:08.252+0000 7fd4b8a00640 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 -- 0x7fd4b410f8e0 con 0x7fd4b41098b0 2024-09-12T02:30:08.255 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:30:08.252+0000 7fd4b8a00640 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x7fd4b410f760 con 0x7fd4b40761a0 2024-09-12T02:30:08.255 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:30:08.252+0000 7fd4b8a00640 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7fd4b410fa60 con 0x7fd4b4074b40 2024-09-12T02:30:08.255 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:30:08.253+0000 7fd4b1e00640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fd4b40761a0 0x7fd4b419a3f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:30:08.255 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:30:08.253+0000 7fd4b2800640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fd4b4074b40 0x7fd4b4199eb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:30:08.255 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:30:08.253+0000 7fd4b1e00640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fd4b40761a0 0x7fd4b419a3f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.39:43348/0 (socket says 172.21.15.39:43348) 2024-09-12T02:30:08.255 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:30:08.253+0000 7fd4b1e00640 1 -- 172.21.15.39:0/604026423 learned_addr learned my addr 172.21.15.39:0/604026423 (peer_addr_for_me v2:172.21.15.39:0/0) 2024-09-12T02:30:08.255 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:30:08.253+0000 7fd4b3200640 1 --2- 172.21.15.39:0/604026423 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fd4b41098b0 0x7fd4b41a1470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:30:08.256 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:30:08.253+0000 7fd4b1e00640 1 -- 172.21.15.39:0/604026423 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fd4b4074b40 msgr2=0x7fd4b4199eb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:30:08.256 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:30:08.253+0000 7fd4b1e00640 1 --2- 172.21.15.39:0/604026423 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fd4b4074b40 0x7fd4b4199eb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:30:08.256 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:30:08.253+0000 7fd4b1e00640 1 -- 172.21.15.39:0/604026423 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fd4b41098b0 msgr2=0x7fd4b41a1470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:30:08.256 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:30:08.253+0000 7fd4b1e00640 1 --2- 172.21.15.39:0/604026423 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fd4b41098b0 0x7fd4b41a1470 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:30:08.257 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:30:08.253+0000 7fd4b1e00640 1 -- 172.21.15.39:0/604026423 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd4b41a1ae0 con 0x7fd4b40761a0 2024-09-12T02:30:08.257 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:30:08.253+0000 7fd4b1e00640 1 --2- 172.21.15.39:0/604026423 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fd4b40761a0 0x7fd4b419a3f0 secure :-1 s=READY pgs=20 cs=0 l=1 rev1=1 crypto rx=0x7fd4a000d950 tx=0x7fd4a000de10 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:30:08.257 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:30:08.254+0000 7fd4ab400640 1 -- 172.21.15.39:0/604026423 <== mon.2 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd4a0017030 con 0x7fd4b40761a0 2024-09-12T02:30:08.257 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:30:08.254+0000 7fd4ab400640 1 -- 172.21.15.39:0/604026423 <== mon.2 v2:172.21.15.44:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fd4a0004020 con 0x7fd4b40761a0 2024-09-12T02:30:08.257 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:30:08.254+0000 7fd4ab400640 1 -- 172.21.15.39:0/604026423 <== mon.2 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd4a00047a0 con 0x7fd4b40761a0 2024-09-12T02:30:08.257 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:30:08.254+0000 7fd4b8a00640 1 -- 172.21.15.39:0/604026423 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd4b41a1dd0 con 0x7fd4b40761a0 2024-09-12T02:30:08.257 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:30:08.254+0000 7fd4b8a00640 1 -- 172.21.15.39:0/604026423 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd4b41a2230 con 0x7fd4b40761a0 2024-09-12T02:30:08.257 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:30:08.255+0000 7fd4b8a00640 1 -- 172.21.15.39:0/604026423 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fd4b41086c0 con 0x7fd4b40761a0 2024-09-12T02:30:08.257 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:30:08.257+0000 7fd4ab400640 1 -- 172.21.15.39:0/604026423 <== mon.2 v2:172.21.15.44:3300/0 4 ==== mgrmap(e 15) ==== 137777+0+0 (secure 0 0 0) 0x7fd4a00041d0 con 0x7fd4b40761a0 2024-09-12T02:30:08.259 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:30:08.258+0000 7fd4ab400640 1 --2- 172.21.15.39:0/604026423 >> [v2:172.21.15.39:6800/1725006999,v1:172.21.15.39:6801/1725006999] conn(0x7fd4980a2b20 0x7fd4980a4fe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:30:08.259 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:30:08.258+0000 7fd4ab400640 1 -- 172.21.15.39:0/604026423 <== mon.2 v2:172.21.15.44:3300/0 5 ==== osd_map(18..18 src has 1..18) ==== 2851+0+0 (secure 0 0 0) 0x7fd4a00cd3e0 con 0x7fd4b40761a0 2024-09-12T02:30:08.259 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:30:08.258+0000 7fd4b2800640 1 --2- 172.21.15.39:0/604026423 >> [v2:172.21.15.39:6800/1725006999,v1:172.21.15.39:6801/1725006999] conn(0x7fd4980a2b20 0x7fd4980a4fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:30:08.259 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:30:08.259+0000 7fd4b2800640 1 --2- 172.21.15.39:0/604026423 >> [v2:172.21.15.39:6800/1725006999,v1:172.21.15.39:6801/1725006999] conn(0x7fd4980a2b20 0x7fd4980a4fe0 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7fd4a4031440 tx=0x7fd4a40315b0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:30:08.263 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:30:08.263+0000 7fd4ab400640 1 -- 172.21.15.39:0/604026423 <== mon.2 v2:172.21.15.44:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7fd4a009b8d0 con 0x7fd4b40761a0 2024-09-12T02:30:08.460 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:30:08.459+0000 7fd4b8a00640 1 -- 172.21.15.39:0/604026423 --> [v2:172.21.15.39:6800/1725006999,v1:172.21.15.39:6801/1725006999] -- mgr_command(tid 0: {"prefix": "orch daemon add osd", "svc_arg": "smithi039:vg_nvme/lv_3", "target": ["mon-mgr", ""]}) -- 0x7fd4b4062630 con 0x7fd4980a2b20 2024-09-12T02:30:08.599 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 02:30:08 smithi039 ceph-mon[30515]: purged_snaps scrub starts 2024-09-12T02:30:08.600 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 02:30:08 smithi039 ceph-mon[30515]: purged_snaps scrub ok 2024-09-12T02:30:08.600 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 02:30:08 smithi039 ceph-mon[30515]: pgmap v78: 0 pgs: ; 0 B data, 57 MiB used, 179 GiB / 179 GiB avail 2024-09-12T02:30:08.600 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 02:30:08 smithi039 ceph-mon[30515]: Detected new or changed devices on smithi172 2024-09-12T02:30:08.600 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 02:30:08 smithi039 ceph-mon[30515]: Adjusting osd_memory_target on smithi172 to 17088M 2024-09-12T02:30:08.600 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 02:30:08 smithi039 ceph-mon[30515]: osd.2 [v2:172.21.15.172:6800/1176898232,v1:172.21.15.172:6801/1176898232] boot 2024-09-12T02:30:08.600 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 02:30:08 smithi039 ceph-mon[30515]: osdmap e18: 3 total, 3 up, 3 in 2024-09-12T02:30:08.600 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 02:30:08 smithi039 ceph-mon[30515]: from='mgr.14150 172.21.15.39:0/408627207' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-09-12T02:30:08.698 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 12 02:30:08 smithi044 ceph-mon[35411]: purged_snaps scrub starts 2024-09-12T02:30:08.699 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 12 02:30:08 smithi044 ceph-mon[35411]: purged_snaps scrub ok 2024-09-12T02:30:08.699 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 12 02:30:08 smithi044 ceph-mon[35411]: pgmap v78: 0 pgs: ; 0 B data, 57 MiB used, 179 GiB / 179 GiB avail 2024-09-12T02:30:08.699 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 12 02:30:08 smithi044 ceph-mon[35411]: Detected new or changed devices on smithi172 2024-09-12T02:30:08.699 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 12 02:30:08 smithi044 ceph-mon[35411]: Adjusting osd_memory_target on smithi172 to 17088M 2024-09-12T02:30:08.699 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 12 02:30:08 smithi044 ceph-mon[35411]: osd.2 [v2:172.21.15.172:6800/1176898232,v1:172.21.15.172:6801/1176898232] boot 2024-09-12T02:30:08.699 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 12 02:30:08 smithi044 ceph-mon[35411]: osdmap e18: 3 total, 3 up, 3 in 2024-09-12T02:30:08.699 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 12 02:30:08 smithi044 ceph-mon[35411]: from='mgr.14150 172.21.15.39:0/408627207' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-09-12T02:30:08.765 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 12 02:30:08 smithi172 ceph-mon[35609]: purged_snaps scrub starts 2024-09-12T02:30:08.765 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 12 02:30:08 smithi172 ceph-mon[35609]: purged_snaps scrub ok 2024-09-12T02:30:08.765 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 12 02:30:08 smithi172 ceph-mon[35609]: pgmap v78: 0 pgs: ; 0 B data, 57 MiB used, 179 GiB / 179 GiB avail 2024-09-12T02:30:08.765 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 12 02:30:08 smithi172 ceph-mon[35609]: Detected new or changed devices on smithi172 2024-09-12T02:30:08.765 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 12 02:30:08 smithi172 ceph-mon[35609]: Adjusting osd_memory_target on smithi172 to 17088M 2024-09-12T02:30:08.765 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 12 02:30:08 smithi172 ceph-mon[35609]: osd.2 [v2:172.21.15.172:6800/1176898232,v1:172.21.15.172:6801/1176898232] boot 2024-09-12T02:30:08.766 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 12 02:30:08 smithi172 ceph-mon[35609]: osdmap e18: 3 total, 3 up, 3 in 2024-09-12T02:30:08.766 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 12 02:30:08 smithi172 ceph-mon[35609]: from='mgr.14150 172.21.15.39:0/408627207' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-09-12T02:30:09.599 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 02:30:09 smithi039 ceph-mon[30515]: osdmap e19: 3 total, 3 up, 3 in 2024-09-12T02:30:09.600 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 02:30:09 smithi039 ceph-mon[30515]: from='client.24185 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi039:vg_nvme/lv_3", "target": ["mon-mgr", ""]}]: dispatch 2024-09-12T02:30:09.600 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 02:30:09 smithi039 ceph-mon[30515]: from='mgr.14150 172.21.15.39:0/408627207' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-09-12T02:30:09.600 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 02:30:09 smithi039 ceph-mon[30515]: from='mgr.14150 172.21.15.39:0/408627207' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-09-12T02:30:09.600 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 02:30:09 smithi039 ceph-mon[30515]: from='mgr.14150 172.21.15.39:0/408627207' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-12T02:30:09.698 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 12 02:30:09 smithi044 ceph-mon[35411]: osdmap e19: 3 total, 3 up, 3 in 2024-09-12T02:30:09.699 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 12 02:30:09 smithi044 ceph-mon[35411]: from='client.24185 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi039:vg_nvme/lv_3", "target": ["mon-mgr", ""]}]: dispatch 2024-09-12T02:30:09.699 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 12 02:30:09 smithi044 ceph-mon[35411]: from='mgr.14150 172.21.15.39:0/408627207' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-09-12T02:30:09.699 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 12 02:30:09 smithi044 ceph-mon[35411]: from='mgr.14150 172.21.15.39:0/408627207' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-09-12T02:30:09.699 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 12 02:30:09 smithi044 ceph-mon[35411]: from='mgr.14150 172.21.15.39:0/408627207' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-12T02:30:09.764 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 12 02:30:09 smithi172 ceph-mon[35609]: osdmap e19: 3 total, 3 up, 3 in 2024-09-12T02:30:09.764 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 12 02:30:09 smithi172 ceph-mon[35609]: from='client.24185 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi039:vg_nvme/lv_3", "target": ["mon-mgr", ""]}]: dispatch 2024-09-12T02:30:09.764 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 12 02:30:09 smithi172 ceph-mon[35609]: from='mgr.14150 172.21.15.39:0/408627207' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-09-12T02:30:09.764 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 12 02:30:09 smithi172 ceph-mon[35609]: from='mgr.14150 172.21.15.39:0/408627207' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-09-12T02:30:09.764 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 12 02:30:09 smithi172 ceph-mon[35609]: from='mgr.14150 172.21.15.39:0/408627207' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-12T02:30:10.601 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 02:30:10 smithi039 ceph-mon[30515]: pgmap v81: 0 pgs: ; 0 B data, 84 MiB used, 268 GiB / 268 GiB avail 2024-09-12T02:30:10.601 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 02:30:10 smithi039 ceph-mon[30515]: from='mgr.14150 172.21.15.39:0/408627207' entity='mgr.x' cmd=[{"prefix": "osd pool create", "format": "json", "pool": ".mgr", "pg_num": 1, "pg_num_min": 1, "pg_num_max": 32, "yes_i_really_mean_it": true}]: dispatch 2024-09-12T02:30:10.601 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 02:30:10 smithi039 ceph-mon[30515]: from='mgr.14150 172.21.15.39:0/408627207' entity='mgr.x' cmd='[{"prefix": "osd pool create", "format": "json", "pool": ".mgr", "pg_num": 1, "pg_num_min": 1, "pg_num_max": 32, "yes_i_really_mean_it": true}]': finished 2024-09-12T02:30:10.601 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 02:30:10 smithi039 ceph-mon[30515]: osdmap e20: 3 total, 3 up, 3 in 2024-09-12T02:30:10.601 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 02:30:10 smithi039 ceph-mon[30515]: from='mgr.14150 172.21.15.39:0/408627207' entity='mgr.x' cmd=[{"prefix": "osd pool application enable", "format": "json", "pool": ".mgr", "app": "mgr", "yes_i_really_mean_it": true}]: dispatch 2024-09-12T02:30:10.698 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 12 02:30:10 smithi044 ceph-mon[35411]: pgmap v81: 0 pgs: ; 0 B data, 84 MiB used, 268 GiB / 268 GiB avail 2024-09-12T02:30:10.698 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 12 02:30:10 smithi044 ceph-mon[35411]: from='mgr.14150 172.21.15.39:0/408627207' entity='mgr.x' cmd=[{"prefix": "osd pool create", "format": "json", "pool": ".mgr", "pg_num": 1, "pg_num_min": 1, "pg_num_max": 32, "yes_i_really_mean_it": true}]: dispatch 2024-09-12T02:30:10.698 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 12 02:30:10 smithi044 ceph-mon[35411]: from='mgr.14150 172.21.15.39:0/408627207' entity='mgr.x' cmd='[{"prefix": "osd pool create", "format": "json", "pool": ".mgr", "pg_num": 1, "pg_num_min": 1, "pg_num_max": 32, "yes_i_really_mean_it": true}]': finished 2024-09-12T02:30:10.699 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 12 02:30:10 smithi044 ceph-mon[35411]: osdmap e20: 3 total, 3 up, 3 in 2024-09-12T02:30:10.699 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 12 02:30:10 smithi044 ceph-mon[35411]: from='mgr.14150 172.21.15.39:0/408627207' entity='mgr.x' cmd=[{"prefix": "osd pool application enable", "format": "json", "pool": ".mgr", "app": "mgr", "yes_i_really_mean_it": true}]: dispatch 2024-09-12T02:30:10.763 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 12 02:30:10 smithi172 ceph-mon[35609]: pgmap v81: 0 pgs: ; 0 B data, 84 MiB used, 268 GiB / 268 GiB avail 2024-09-12T02:30:10.763 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 12 02:30:10 smithi172 ceph-mon[35609]: from='mgr.14150 172.21.15.39:0/408627207' entity='mgr.x' cmd=[{"prefix": "osd pool create", "format": "json", "pool": ".mgr", "pg_num": 1, "pg_num_min": 1, "pg_num_max": 32, "yes_i_really_mean_it": true}]: dispatch 2024-09-12T02:30:10.764 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 12 02:30:10 smithi172 ceph-mon[35609]: from='mgr.14150 172.21.15.39:0/408627207' entity='mgr.x' cmd='[{"prefix": "osd pool create", "format": "json", "pool": ".mgr", "pg_num": 1, "pg_num_min": 1, "pg_num_max": 32, "yes_i_really_mean_it": true}]': finished 2024-09-12T02:30:10.764 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 12 02:30:10 smithi172 ceph-mon[35609]: osdmap e20: 3 total, 3 up, 3 in 2024-09-12T02:30:10.764 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 12 02:30:10 smithi172 ceph-mon[35609]: from='mgr.14150 172.21.15.39:0/408627207' entity='mgr.x' cmd=[{"prefix": "osd pool application enable", "format": "json", "pool": ".mgr", "app": "mgr", "yes_i_really_mean_it": true}]: dispatch 2024-09-12T02:30:11.349 INFO:journalctl@ceph.osd.0.smithi039.stdout:Sep 12 02:30:11 smithi039 sudo[48597]: ceph : PWD=/ ; USER=root ; COMMAND=/usr/sbin/smartctl -x --json=o /dev/nvme0n1 2024-09-12T02:30:11.349 INFO:journalctl@ceph.osd.0.smithi039.stdout:Sep 12 02:30:11 smithi039 sudo[48597]: pam_systemd(sudo:session): Failed to connect to system bus: No such file or directory 2024-09-12T02:30:11.350 INFO:journalctl@ceph.osd.0.smithi039.stdout:Sep 12 02:30:11 smithi039 sudo[48597]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=167) 2024-09-12T02:30:11.350 INFO:journalctl@ceph.osd.0.smithi039.stdout:Sep 12 02:30:11 smithi039 sudo[48597]: pam_unix(sudo:session): session closed for user root 2024-09-12T02:30:11.423 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:30:11.422+0000 7fd4ab400640 1 -- 172.21.15.39:0/604026423 <== mon.2 v2:172.21.15.44:3300/0 7 ==== mgrmap(e 16) ==== 137833+0+0 (secure 0 0 0) 0x7fd4a0097840 con 0x7fd4b40761a0 2024-09-12T02:30:11.653 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 02:30:11 smithi039 ceph-mon[30515]: from='mgr.14150 172.21.15.39:0/408627207' entity='mgr.x' cmd='[{"prefix": "osd pool application enable", "format": "json", "pool": ".mgr", "app": "mgr", "yes_i_really_mean_it": true}]': finished 2024-09-12T02:30:11.654 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 02:30:11 smithi039 ceph-mon[30515]: osdmap e21: 3 total, 3 up, 3 in 2024-09-12T02:30:11.654 INFO:journalctl@ceph.osd.0.smithi039.stdout:Sep 12 02:30:11 smithi039 sudo[48631]: ceph : PWD=/ ; USER=root ; COMMAND=/usr/sbin/nvme intel smart-log-add --json /dev/nvme0n1 2024-09-12T02:30:11.698 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 12 02:30:11 smithi044 ceph-mon[35411]: from='mgr.14150 172.21.15.39:0/408627207' entity='mgr.x' cmd='[{"prefix": "osd pool application enable", "format": "json", "pool": ".mgr", "app": "mgr", "yes_i_really_mean_it": true}]': finished 2024-09-12T02:30:11.698 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 12 02:30:11 smithi044 ceph-mon[35411]: osdmap e21: 3 total, 3 up, 3 in 2024-09-12T02:30:11.763 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 12 02:30:11 smithi172 ceph-mon[35609]: from='mgr.14150 172.21.15.39:0/408627207' entity='mgr.x' cmd='[{"prefix": "osd pool application enable", "format": "json", "pool": ".mgr", "app": "mgr", "yes_i_really_mean_it": true}]': finished 2024-09-12T02:30:11.763 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 12 02:30:11 smithi172 ceph-mon[35609]: osdmap e21: 3 total, 3 up, 3 in 2024-09-12T02:30:12.099 INFO:journalctl@ceph.osd.0.smithi039.stdout:Sep 12 02:30:11 smithi039 sudo[48631]: pam_systemd(sudo:session): Failed to connect to system bus: No such file or directory 2024-09-12T02:30:12.100 INFO:journalctl@ceph.osd.0.smithi039.stdout:Sep 12 02:30:11 smithi039 sudo[48631]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=167) 2024-09-12T02:30:12.100 INFO:journalctl@ceph.osd.0.smithi039.stdout:Sep 12 02:30:11 smithi039 sudo[48631]: pam_unix(sudo:session): session closed for user root 2024-09-12T02:30:12.198 INFO:journalctl@ceph.osd.1.smithi044.stdout:Sep 12 02:30:11 smithi044 sudo[43704]: ceph : PWD=/ ; USER=root ; COMMAND=/usr/sbin/smartctl -x --json=o /dev/nvme0n1 2024-09-12T02:30:12.198 INFO:journalctl@ceph.osd.1.smithi044.stdout:Sep 12 02:30:11 smithi044 sudo[43704]: pam_systemd(sudo:session): Failed to connect to system bus: No such file or directory 2024-09-12T02:30:12.199 INFO:journalctl@ceph.osd.1.smithi044.stdout:Sep 12 02:30:11 smithi044 sudo[43704]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=167) 2024-09-12T02:30:12.199 INFO:journalctl@ceph.osd.1.smithi044.stdout:Sep 12 02:30:11 smithi044 sudo[43704]: pam_unix(sudo:session): session closed for user root 2024-09-12T02:30:12.698 INFO:journalctl@ceph.osd.1.smithi044.stdout:Sep 12 02:30:12 smithi044 sudo[43707]: ceph : PWD=/ ; USER=root ; COMMAND=/usr/sbin/nvme intel smart-log-add --json /dev/nvme0n1 2024-09-12T02:30:12.699 INFO:journalctl@ceph.osd.1.smithi044.stdout:Sep 12 02:30:12 smithi044 sudo[43707]: pam_systemd(sudo:session): Failed to connect to system bus: No such file or directory 2024-09-12T02:30:12.699 INFO:journalctl@ceph.osd.1.smithi044.stdout:Sep 12 02:30:12 smithi044 sudo[43707]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=167) 2024-09-12T02:30:12.699 INFO:journalctl@ceph.osd.1.smithi044.stdout:Sep 12 02:30:12 smithi044 sudo[43707]: pam_unix(sudo:session): session closed for user root 2024-09-12T02:30:12.699 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 12 02:30:12 smithi044 ceph-mon[35411]: pgmap v84: 1 pgs: 1 unknown; 0 B data, 84 MiB used, 268 GiB / 268 GiB avail 2024-09-12T02:30:12.699 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 12 02:30:12 smithi044 ceph-mon[35411]: mgrmap e16: x(active, since 2m), standbys: z, y 2024-09-12T02:30:12.699 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 12 02:30:12 smithi044 ceph-mon[35411]: osdmap e22: 3 total, 3 up, 3 in 2024-09-12T02:30:12.699 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 12 02:30:12 smithi044 ceph-mon[35411]: from='client.? 172.21.15.39:0/4088238914' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "8b256567-7efe-429c-bc4c-80e93228f139"}]: dispatch 2024-09-12T02:30:12.699 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 12 02:30:12 smithi044 ceph-mon[35411]: from='client.? 172.21.15.39:0/4088238914' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "8b256567-7efe-429c-bc4c-80e93228f139"}]': finished 2024-09-12T02:30:12.699 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 12 02:30:12 smithi044 ceph-mon[35411]: osdmap e23: 4 total, 3 up, 4 in 2024-09-12T02:30:12.699 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 12 02:30:12 smithi044 ceph-mon[35411]: from='mgr.14150 172.21.15.39:0/408627207' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-09-12T02:30:12.700 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 12 02:30:12 smithi044 ceph-mon[35411]: from='mgr.14150 172.21.15.39:0/408627207' entity='mgr.x' 2024-09-12T02:30:12.700 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 12 02:30:12 smithi044 ceph-mon[35411]: from='client.? 172.21.15.39:0/3337833611' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-09-12T02:30:12.700 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 12 02:30:12 smithi044 ceph-mon[35411]: from='mgr.14150 172.21.15.39:0/408627207' entity='mgr.x' 2024-09-12T02:30:12.746 INFO:journalctl@ceph.osd.2.smithi172.stdout:Sep 12 02:30:12 smithi172 sudo[44375]: ceph : PWD=/ ; USER=root ; COMMAND=/usr/sbin/smartctl -x --json=o /dev/nvme0n1 2024-09-12T02:30:12.746 INFO:journalctl@ceph.osd.2.smithi172.stdout:Sep 12 02:30:12 smithi172 sudo[44375]: pam_systemd(sudo:session): Failed to connect to system bus: No such file or directory 2024-09-12T02:30:12.746 INFO:journalctl@ceph.osd.2.smithi172.stdout:Sep 12 02:30:12 smithi172 sudo[44375]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=167) 2024-09-12T02:30:12.746 INFO:journalctl@ceph.osd.2.smithi172.stdout:Sep 12 02:30:12 smithi172 sudo[44375]: pam_unix(sudo:session): session closed for user root 2024-09-12T02:30:12.746 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 12 02:30:12 smithi172 ceph-mon[35609]: pgmap v84: 1 pgs: 1 unknown; 0 B data, 84 MiB used, 268 GiB / 268 GiB avail 2024-09-12T02:30:12.746 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 12 02:30:12 smithi172 ceph-mon[35609]: mgrmap e16: x(active, since 2m), standbys: z, y 2024-09-12T02:30:12.746 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 12 02:30:12 smithi172 ceph-mon[35609]: osdmap e22: 3 total, 3 up, 3 in 2024-09-12T02:30:12.746 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 12 02:30:12 smithi172 ceph-mon[35609]: from='client.? 172.21.15.39:0/4088238914' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "8b256567-7efe-429c-bc4c-80e93228f139"}]: dispatch 2024-09-12T02:30:12.746 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 12 02:30:12 smithi172 ceph-mon[35609]: from='client.? 172.21.15.39:0/4088238914' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "8b256567-7efe-429c-bc4c-80e93228f139"}]': finished 2024-09-12T02:30:12.747 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 12 02:30:12 smithi172 ceph-mon[35609]: osdmap e23: 4 total, 3 up, 4 in 2024-09-12T02:30:12.747 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 12 02:30:12 smithi172 ceph-mon[35609]: from='mgr.14150 172.21.15.39:0/408627207' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-09-12T02:30:12.747 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 12 02:30:12 smithi172 ceph-mon[35609]: from='mgr.14150 172.21.15.39:0/408627207' entity='mgr.x' 2024-09-12T02:30:12.747 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 12 02:30:12 smithi172 ceph-mon[35609]: from='client.? 172.21.15.39:0/3337833611' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-09-12T02:30:12.747 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 12 02:30:12 smithi172 ceph-mon[35609]: from='mgr.14150 172.21.15.39:0/408627207' entity='mgr.x' 2024-09-12T02:30:12.849 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 02:30:12 smithi039 ceph-mon[30515]: pgmap v84: 1 pgs: 1 unknown; 0 B data, 84 MiB used, 268 GiB / 268 GiB avail 2024-09-12T02:30:12.850 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 02:30:12 smithi039 ceph-mon[30515]: mgrmap e16: x(active, since 2m), standbys: z, y 2024-09-12T02:30:12.850 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 02:30:12 smithi039 ceph-mon[30515]: osdmap e22: 3 total, 3 up, 3 in 2024-09-12T02:30:12.850 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 02:30:12 smithi039 ceph-mon[30515]: from='client.? 172.21.15.39:0/4088238914' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "8b256567-7efe-429c-bc4c-80e93228f139"}]: dispatch 2024-09-12T02:30:12.850 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 02:30:12 smithi039 ceph-mon[30515]: from='client.? 172.21.15.39:0/4088238914' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "8b256567-7efe-429c-bc4c-80e93228f139"}]': finished 2024-09-12T02:30:12.850 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 02:30:12 smithi039 ceph-mon[30515]: osdmap e23: 4 total, 3 up, 4 in 2024-09-12T02:30:12.850 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 02:30:12 smithi039 ceph-mon[30515]: from='mgr.14150 172.21.15.39:0/408627207' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-09-12T02:30:12.850 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 02:30:12 smithi039 ceph-mon[30515]: from='mgr.14150 172.21.15.39:0/408627207' entity='mgr.x' 2024-09-12T02:30:12.850 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 02:30:12 smithi039 ceph-mon[30515]: from='client.? 172.21.15.39:0/3337833611' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-09-12T02:30:12.850 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 02:30:12 smithi039 ceph-mon[30515]: from='mgr.14150 172.21.15.39:0/408627207' entity='mgr.x' 2024-09-12T02:30:13.013 INFO:journalctl@ceph.osd.2.smithi172.stdout:Sep 12 02:30:12 smithi172 sudo[44378]: ceph : PWD=/ ; USER=root ; COMMAND=/usr/sbin/nvme intel smart-log-add --json /dev/nvme0n1 2024-09-12T02:30:13.014 INFO:journalctl@ceph.osd.2.smithi172.stdout:Sep 12 02:30:12 smithi172 sudo[44378]: pam_systemd(sudo:session): Failed to connect to system bus: No such file or directory 2024-09-12T02:30:13.014 INFO:journalctl@ceph.osd.2.smithi172.stdout:Sep 12 02:30:12 smithi172 sudo[44378]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=167) 2024-09-12T02:30:13.014 INFO:journalctl@ceph.osd.2.smithi172.stdout:Sep 12 02:30:12 smithi172 sudo[44378]: pam_unix(sudo:session): session closed for user root 2024-09-12T02:30:13.599 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 02:30:13 smithi039 sudo[48896]: ceph : PWD=/ ; USER=root ; COMMAND=/usr/sbin/smartctl -x --json=o /dev/nvme0n1 2024-09-12T02:30:13.599 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 02:30:13 smithi039 sudo[48896]: pam_systemd(sudo:session): Failed to connect to system bus: No such file or directory 2024-09-12T02:30:13.600 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 02:30:13 smithi039 sudo[48896]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=167) 2024-09-12T02:30:13.600 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 02:30:13 smithi039 sudo[48896]: pam_unix(sudo:session): session closed for user root 2024-09-12T02:30:14.198 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 12 02:30:13 smithi044 ceph-mon[35411]: from='mgr.14150 172.21.15.39:0/408627207' entity='mgr.x' 2024-09-12T02:30:14.199 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 12 02:30:13 smithi044 ceph-mon[35411]: from='admin socket' entity='admin socket' cmd='smart' args=[json]: dispatch 2024-09-12T02:30:14.350 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 02:30:13 smithi039 sudo[49089]: ceph : PWD=/ ; USER=root ; COMMAND=/usr/sbin/nvme intel smart-log-add --json /dev/nvme0n1 2024-09-12T02:30:14.350 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 02:30:13 smithi039 sudo[49089]: pam_systemd(sudo:session): Failed to connect to system bus: No such file or directory 2024-09-12T02:30:14.350 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 02:30:13 smithi039 sudo[49089]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=167) 2024-09-12T02:30:14.350 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 02:30:13 smithi039 sudo[49089]: pam_unix(sudo:session): session closed for user root 2024-09-12T02:30:14.350 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 02:30:13 smithi039 ceph-mon[30515]: from='mgr.14150 172.21.15.39:0/408627207' entity='mgr.x' 2024-09-12T02:30:14.350 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 02:30:13 smithi039 ceph-mon[30515]: from='admin socket' entity='admin socket' cmd='smart' args=[json]: dispatch 2024-09-12T02:30:14.408 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 12 02:30:14 smithi172 sudo[44381]: ceph : PWD=/ ; USER=root ; COMMAND=/usr/sbin/smartctl -x --json=o /dev/nvme0n1 2024-09-12T02:30:14.408 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 12 02:30:14 smithi172 sudo[44381]: pam_systemd(sudo:session): Failed to connect to system bus: No such file or directory 2024-09-12T02:30:14.408 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 12 02:30:14 smithi172 sudo[44381]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=167) 2024-09-12T02:30:14.408 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 12 02:30:14 smithi172 sudo[44381]: pam_unix(sudo:session): session closed for user root 2024-09-12T02:30:14.763 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 12 02:30:14 smithi172 sudo[44384]: ceph : PWD=/ ; USER=root ; COMMAND=/usr/sbin/nvme intel smart-log-add --json /dev/nvme0n1 2024-09-12T02:30:14.763 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 12 02:30:14 smithi172 sudo[44384]: pam_systemd(sudo:session): Failed to connect to system bus: No such file or directory 2024-09-12T02:30:14.764 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 12 02:30:14 smithi172 sudo[44384]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=167) 2024-09-12T02:30:14.764 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 12 02:30:14 smithi172 sudo[44384]: pam_unix(sudo:session): session closed for user root 2024-09-12T02:30:14.764 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 12 02:30:14 smithi172 ceph-mon[35609]: from='mgr.14150 172.21.15.39:0/408627207' entity='mgr.x' 2024-09-12T02:30:14.764 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 12 02:30:14 smithi172 ceph-mon[35609]: from='admin socket' entity='admin socket' cmd='smart' args=[json]: dispatch 2024-09-12T02:30:14.934 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 12 02:30:14 smithi044 sudo[43710]: ceph : PWD=/ ; USER=root ; COMMAND=/usr/sbin/smartctl -x --json=o /dev/nvme0n1 2024-09-12T02:30:14.934 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 12 02:30:14 smithi044 sudo[43710]: pam_systemd(sudo:session): Failed to connect to system bus: No such file or directory 2024-09-12T02:30:14.934 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 12 02:30:14 smithi044 sudo[43710]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=167) 2024-09-12T02:30:14.934 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 12 02:30:14 smithi044 sudo[43710]: pam_unix(sudo:session): session closed for user root 2024-09-12T02:30:15.198 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 12 02:30:14 smithi044 sudo[43713]: ceph : PWD=/ ; USER=root ; COMMAND=/usr/sbin/nvme intel smart-log-add --json /dev/nvme0n1 2024-09-12T02:30:15.199 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 12 02:30:14 smithi044 sudo[43713]: pam_systemd(sudo:session): Failed to connect to system bus: No such file or directory 2024-09-12T02:30:15.199 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 12 02:30:14 smithi044 sudo[43713]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=167) 2024-09-12T02:30:15.199 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 12 02:30:14 smithi044 sudo[43713]: pam_unix(sudo:session): session closed for user root 2024-09-12T02:30:15.199 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 12 02:30:14 smithi044 ceph-mon[35411]: pgmap v87: 1 pgs: 1 unknown; 0 B data, 84 MiB used, 268 GiB / 268 GiB avail 2024-09-12T02:30:15.199 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 12 02:30:14 smithi044 ceph-mon[35411]: from='admin socket' entity='admin socket' cmd=smart args=[json]: finished 2024-09-12T02:30:15.199 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 12 02:30:14 smithi044 ceph-mon[35411]: from='mgr.14150 172.21.15.39:0/408627207' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2024-09-12T02:30:15.199 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 12 02:30:14 smithi044 ceph-mon[35411]: from='mgr.14150 172.21.15.39:0/408627207' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-09-12T02:30:15.199 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 12 02:30:14 smithi044 ceph-mon[35411]: from='mgr.14150 172.21.15.39:0/408627207' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-09-12T02:30:15.199 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 12 02:30:14 smithi044 ceph-mon[35411]: from='admin socket' entity='admin socket' cmd='smart' args=[json]: dispatch 2024-09-12T02:30:15.199 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 12 02:30:14 smithi044 ceph-mon[35411]: from='mgr.14150 172.21.15.39:0/408627207' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2024-09-12T02:30:15.199 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 12 02:30:14 smithi044 ceph-mon[35411]: from='mgr.14150 172.21.15.39:0/408627207' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-09-12T02:30:15.199 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 12 02:30:14 smithi044 ceph-mon[35411]: from='mgr.14150 172.21.15.39:0/408627207' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-09-12T02:30:15.199 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 12 02:30:14 smithi044 ceph-mon[35411]: from='admin socket' entity='admin socket' cmd=smart args=[json]: finished 2024-09-12T02:30:15.200 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 12 02:30:14 smithi044 ceph-mon[35411]: from='mgr.14150 172.21.15.39:0/408627207' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2024-09-12T02:30:15.200 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 12 02:30:14 smithi044 ceph-mon[35411]: from='mgr.14150 172.21.15.39:0/408627207' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-09-12T02:30:15.200 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 12 02:30:14 smithi044 ceph-mon[35411]: from='mgr.14150 172.21.15.39:0/408627207' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-09-12T02:30:15.263 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 12 02:30:14 smithi172 ceph-mon[35609]: pgmap v87: 1 pgs: 1 unknown; 0 B data, 84 MiB used, 268 GiB / 268 GiB avail 2024-09-12T02:30:15.264 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 12 02:30:14 smithi172 ceph-mon[35609]: from='admin socket' entity='admin socket' cmd=smart args=[json]: finished 2024-09-12T02:30:15.264 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 12 02:30:14 smithi172 ceph-mon[35609]: from='mgr.14150 172.21.15.39:0/408627207' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2024-09-12T02:30:15.264 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 12 02:30:14 smithi172 ceph-mon[35609]: from='mgr.14150 172.21.15.39:0/408627207' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-09-12T02:30:15.264 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 12 02:30:14 smithi172 ceph-mon[35609]: from='mgr.14150 172.21.15.39:0/408627207' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-09-12T02:30:15.264 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 12 02:30:14 smithi172 ceph-mon[35609]: from='admin socket' entity='admin socket' cmd='smart' args=[json]: dispatch 2024-09-12T02:30:15.264 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 12 02:30:14 smithi172 ceph-mon[35609]: from='mgr.14150 172.21.15.39:0/408627207' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2024-09-12T02:30:15.264 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 12 02:30:14 smithi172 ceph-mon[35609]: from='mgr.14150 172.21.15.39:0/408627207' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-09-12T02:30:15.264 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 12 02:30:14 smithi172 ceph-mon[35609]: from='mgr.14150 172.21.15.39:0/408627207' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-09-12T02:30:15.264 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 12 02:30:14 smithi172 ceph-mon[35609]: from='admin socket' entity='admin socket' cmd=smart args=[json]: finished 2024-09-12T02:30:15.264 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 12 02:30:14 smithi172 ceph-mon[35609]: from='mgr.14150 172.21.15.39:0/408627207' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2024-09-12T02:30:15.264 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 12 02:30:14 smithi172 ceph-mon[35609]: from='mgr.14150 172.21.15.39:0/408627207' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-09-12T02:30:15.265 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 12 02:30:14 smithi172 ceph-mon[35609]: from='mgr.14150 172.21.15.39:0/408627207' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-09-12T02:30:15.349 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 02:30:14 smithi039 ceph-mon[30515]: pgmap v87: 1 pgs: 1 unknown; 0 B data, 84 MiB used, 268 GiB / 268 GiB avail 2024-09-12T02:30:15.350 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 02:30:14 smithi039 ceph-mon[30515]: from='admin socket' entity='admin socket' cmd=smart args=[json]: finished 2024-09-12T02:30:15.350 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 02:30:14 smithi039 ceph-mon[30515]: from='mgr.14150 172.21.15.39:0/408627207' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2024-09-12T02:30:15.350 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 02:30:14 smithi039 ceph-mon[30515]: from='mgr.14150 172.21.15.39:0/408627207' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-09-12T02:30:15.350 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 02:30:14 smithi039 ceph-mon[30515]: from='mgr.14150 172.21.15.39:0/408627207' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-09-12T02:30:15.350 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 02:30:14 smithi039 ceph-mon[30515]: from='admin socket' entity='admin socket' cmd='smart' args=[json]: dispatch 2024-09-12T02:30:15.350 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 02:30:14 smithi039 ceph-mon[30515]: from='mgr.14150 172.21.15.39:0/408627207' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2024-09-12T02:30:15.350 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 02:30:14 smithi039 ceph-mon[30515]: from='mgr.14150 172.21.15.39:0/408627207' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-09-12T02:30:15.350 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 02:30:14 smithi039 ceph-mon[30515]: from='mgr.14150 172.21.15.39:0/408627207' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-09-12T02:30:15.350 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 02:30:14 smithi039 ceph-mon[30515]: from='admin socket' entity='admin socket' cmd=smart args=[json]: finished 2024-09-12T02:30:15.350 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 02:30:14 smithi039 ceph-mon[30515]: from='mgr.14150 172.21.15.39:0/408627207' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2024-09-12T02:30:15.350 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 02:30:14 smithi039 ceph-mon[30515]: from='mgr.14150 172.21.15.39:0/408627207' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-09-12T02:30:15.350 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 02:30:14 smithi039 ceph-mon[30515]: from='mgr.14150 172.21.15.39:0/408627207' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-09-12T02:30:16.263 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 12 02:30:15 smithi172 ceph-mon[35609]: from='admin socket' entity='admin socket' cmd='smart' args=[json]: dispatch 2024-09-12T02:30:16.263 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 12 02:30:15 smithi172 ceph-mon[35609]: pgmap v88: 1 pgs: 1 active+clean; 577 KiB data, 87 MiB used, 268 GiB / 268 GiB avail 2024-09-12T02:30:16.263 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 12 02:30:15 smithi172 ceph-mon[35609]: from='admin socket' entity='admin socket' cmd=smart args=[json]: finished 2024-09-12T02:30:16.350 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 02:30:15 smithi039 ceph-mon[30515]: from='admin socket' entity='admin socket' cmd='smart' args=[json]: dispatch 2024-09-12T02:30:16.350 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 02:30:15 smithi039 ceph-mon[30515]: pgmap v88: 1 pgs: 1 active+clean; 577 KiB data, 87 MiB used, 268 GiB / 268 GiB avail 2024-09-12T02:30:16.350 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 02:30:15 smithi039 ceph-mon[30515]: from='admin socket' entity='admin socket' cmd=smart args=[json]: finished 2024-09-12T02:30:16.449 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 12 02:30:15 smithi044 ceph-mon[35411]: from='admin socket' entity='admin socket' cmd='smart' args=[json]: dispatch 2024-09-12T02:30:16.449 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 12 02:30:15 smithi044 ceph-mon[35411]: pgmap v88: 1 pgs: 1 active+clean; 577 KiB data, 87 MiB used, 268 GiB / 268 GiB avail 2024-09-12T02:30:16.449 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 12 02:30:15 smithi044 ceph-mon[35411]: from='admin socket' entity='admin socket' cmd=smart args=[json]: finished 2024-09-12T02:30:18.004 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 02:30:17 smithi039 ceph-mon[30515]: pgmap v89: 1 pgs: 1 active+clean; 577 KiB data, 87 MiB used, 268 GiB / 268 GiB avail 2024-09-12T02:30:18.263 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 12 02:30:17 smithi172 ceph-mon[35609]: pgmap v89: 1 pgs: 1 active+clean; 577 KiB data, 87 MiB used, 268 GiB / 268 GiB avail 2024-09-12T02:30:18.448 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 12 02:30:17 smithi044 ceph-mon[35411]: pgmap v89: 1 pgs: 1 active+clean; 577 KiB data, 87 MiB used, 268 GiB / 268 GiB avail 2024-09-12T02:30:20.263 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 12 02:30:19 smithi172 ceph-mon[35609]: pgmap v90: 1 pgs: 1 active+clean; 577 KiB data, 86 MiB used, 268 GiB / 268 GiB avail; 2.5 KiB/s rd, 65 KiB/s wr, 6 op/s 2024-09-12T02:30:20.264 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 02:30:19 smithi039 ceph-mon[30515]: pgmap v90: 1 pgs: 1 active+clean; 577 KiB data, 86 MiB used, 268 GiB / 268 GiB avail; 2.5 KiB/s rd, 65 KiB/s wr, 6 op/s 2024-09-12T02:30:20.448 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 12 02:30:19 smithi044 ceph-mon[35411]: pgmap v90: 1 pgs: 1 active+clean; 577 KiB data, 86 MiB used, 268 GiB / 268 GiB avail; 2.5 KiB/s rd, 65 KiB/s wr, 6 op/s 2024-09-12T02:30:21.210 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 02:30:20 smithi039 ceph-mon[30515]: from='mgr.14150 172.21.15.39:0/408627207' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.3"}]: dispatch 2024-09-12T02:30:21.210 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 02:30:20 smithi039 ceph-mon[30515]: from='mgr.14150 172.21.15.39:0/408627207' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-12T02:30:21.210 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 02:30:20 smithi039 ceph-mon[30515]: Deploying daemon osd.3 on smithi039 2024-09-12T02:30:21.263 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 12 02:30:20 smithi172 ceph-mon[35609]: from='mgr.14150 172.21.15.39:0/408627207' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.3"}]: dispatch 2024-09-12T02:30:21.263 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 12 02:30:20 smithi172 ceph-mon[35609]: from='mgr.14150 172.21.15.39:0/408627207' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-12T02:30:21.263 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 12 02:30:20 smithi172 ceph-mon[35609]: Deploying daemon osd.3 on smithi039 2024-09-12T02:30:21.448 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 12 02:30:20 smithi044 ceph-mon[35411]: from='mgr.14150 172.21.15.39:0/408627207' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.3"}]: dispatch 2024-09-12T02:30:21.449 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 12 02:30:20 smithi044 ceph-mon[35411]: from='mgr.14150 172.21.15.39:0/408627207' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-12T02:30:21.449 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 12 02:30:20 smithi044 ceph-mon[35411]: Deploying daemon osd.3 on smithi039 2024-09-12T02:30:22.253 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 02:30:21 smithi039 ceph-mon[30515]: pgmap v91: 1 pgs: 1 active+clean; 577 KiB data, 86 MiB used, 268 GiB / 268 GiB avail; 1.7 KiB/s rd, 44 KiB/s wr, 4 op/s 2024-09-12T02:30:22.263 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 12 02:30:21 smithi172 ceph-mon[35609]: pgmap v91: 1 pgs: 1 active+clean; 577 KiB data, 86 MiB used, 268 GiB / 268 GiB avail; 1.7 KiB/s rd, 44 KiB/s wr, 4 op/s 2024-09-12T02:30:22.448 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 12 02:30:21 smithi044 ceph-mon[35411]: pgmap v91: 1 pgs: 1 active+clean; 577 KiB data, 86 MiB used, 268 GiB / 268 GiB avail; 1.7 KiB/s rd, 44 KiB/s wr, 4 op/s 2024-09-12T02:30:24.259 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 02:30:23 smithi039 ceph-mon[30515]: pgmap v92: 1 pgs: 1 active+clean; 577 KiB data, 86 MiB used, 268 GiB / 268 GiB avail; 1.2 KiB/s rd, 33 KiB/s wr, 3 op/s 2024-09-12T02:30:24.264 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 12 02:30:23 smithi172 ceph-mon[35609]: pgmap v92: 1 pgs: 1 active+clean; 577 KiB data, 86 MiB used, 268 GiB / 268 GiB avail; 1.2 KiB/s rd, 33 KiB/s wr, 3 op/s 2024-09-12T02:30:24.448 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 12 02:30:23 smithi044 ceph-mon[35411]: pgmap v92: 1 pgs: 1 active+clean; 577 KiB data, 86 MiB used, 268 GiB / 268 GiB avail; 1.2 KiB/s rd, 33 KiB/s wr, 3 op/s 2024-09-12T02:30:26.263 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 12 02:30:25 smithi172 ceph-mon[35609]: pgmap v93: 1 pgs: 1 active+clean; 577 KiB data, 86 MiB used, 268 GiB / 268 GiB avail; 1023 B/s rd, 26 KiB/s wr, 2 op/s 2024-09-12T02:30:26.277 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 02:30:25 smithi039 ceph-mon[30515]: pgmap v93: 1 pgs: 1 active+clean; 577 KiB data, 86 MiB used, 268 GiB / 268 GiB avail; 1023 B/s rd, 26 KiB/s wr, 2 op/s 2024-09-12T02:30:26.448 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 12 02:30:25 smithi044 ceph-mon[35411]: pgmap v93: 1 pgs: 1 active+clean; 577 KiB data, 86 MiB used, 268 GiB / 268 GiB avail; 1023 B/s rd, 26 KiB/s wr, 2 op/s 2024-09-12T02:30:28.263 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 12 02:30:28 smithi172 ceph-mon[35609]: pgmap v94: 1 pgs: 1 active+clean; 577 KiB data, 86 MiB used, 268 GiB / 268 GiB avail; 853 B/s rd, 22 KiB/s wr, 2 op/s 2024-09-12T02:30:28.349 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 02:30:27 smithi039 ceph-mon[30515]: pgmap v94: 1 pgs: 1 active+clean; 577 KiB data, 86 MiB used, 268 GiB / 268 GiB avail; 853 B/s rd, 22 KiB/s wr, 2 op/s 2024-09-12T02:30:28.448 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 12 02:30:28 smithi044 ceph-mon[35411]: pgmap v94: 1 pgs: 1 active+clean; 577 KiB data, 86 MiB used, 268 GiB / 268 GiB avail; 853 B/s rd, 22 KiB/s wr, 2 op/s 2024-09-12T02:30:29.263 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 12 02:30:29 smithi172 ceph-mon[35609]: from='mgr.14150 172.21.15.39:0/408627207' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-12T02:30:29.264 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 12 02:30:29 smithi172 ceph-mon[35609]: from='mgr.14150 172.21.15.39:0/408627207' entity='mgr.x' 2024-09-12T02:30:29.264 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 12 02:30:29 smithi172 ceph-mon[35609]: from='mgr.14150 172.21.15.39:0/408627207' entity='mgr.x' 2024-09-12T02:30:29.349 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 02:30:29 smithi039 ceph-mon[30515]: from='mgr.14150 172.21.15.39:0/408627207' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-12T02:30:29.350 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 02:30:29 smithi039 ceph-mon[30515]: from='mgr.14150 172.21.15.39:0/408627207' entity='mgr.x' 2024-09-12T02:30:29.350 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 02:30:29 smithi039 ceph-mon[30515]: from='mgr.14150 172.21.15.39:0/408627207' entity='mgr.x' 2024-09-12T02:30:29.448 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 12 02:30:29 smithi044 ceph-mon[35411]: from='mgr.14150 172.21.15.39:0/408627207' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-12T02:30:29.449 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 12 02:30:29 smithi044 ceph-mon[35411]: from='mgr.14150 172.21.15.39:0/408627207' entity='mgr.x' 2024-09-12T02:30:29.449 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 12 02:30:29 smithi044 ceph-mon[35411]: from='mgr.14150 172.21.15.39:0/408627207' entity='mgr.x' 2024-09-12T02:30:30.088 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 02:30:30 smithi039 ceph-mon[30515]: pgmap v95: 1 pgs: 1 active+clean; 577 KiB data, 86 MiB used, 268 GiB / 268 GiB avail; 853 B/s rd, 22 KiB/s wr, 2 op/s 2024-09-12T02:30:30.350 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 12 02:30:30 smithi044 ceph-mon[35411]: pgmap v95: 1 pgs: 1 active+clean; 577 KiB data, 86 MiB used, 268 GiB / 268 GiB avail; 853 B/s rd, 22 KiB/s wr, 2 op/s 2024-09-12T02:30:30.513 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 12 02:30:30 smithi172 ceph-mon[35609]: pgmap v95: 1 pgs: 1 active+clean; 577 KiB data, 86 MiB used, 268 GiB / 268 GiB avail; 853 B/s rd, 22 KiB/s wr, 2 op/s 2024-09-12T02:30:32.350 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 02:30:32 smithi039 ceph-mon[30515]: pgmap v96: 1 pgs: 1 active+clean; 577 KiB data, 86 MiB used, 268 GiB / 268 GiB avail 2024-09-12T02:30:32.350 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 02:30:32 smithi039 ceph-mon[30515]: from='mgr.14150 172.21.15.39:0/408627207' entity='mgr.x' 2024-09-12T02:30:32.350 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 02:30:32 smithi039 ceph-mon[30515]: from='mgr.14150 172.21.15.39:0/408627207' entity='mgr.x' 2024-09-12T02:30:32.350 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 02:30:32 smithi039 ceph-mon[30515]: from='mgr.14150 172.21.15.39:0/408627207' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-12T02:30:32.350 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 02:30:32 smithi039 ceph-mon[30515]: from='mgr.14150 172.21.15.39:0/408627207' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-12T02:30:32.350 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 02:30:32 smithi039 ceph-mon[30515]: from='mgr.14150 172.21.15.39:0/408627207' entity='mgr.x' 2024-09-12T02:30:32.448 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 12 02:30:32 smithi044 ceph-mon[35411]: pgmap v96: 1 pgs: 1 active+clean; 577 KiB data, 86 MiB used, 268 GiB / 268 GiB avail 2024-09-12T02:30:32.448 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 12 02:30:32 smithi044 ceph-mon[35411]: from='mgr.14150 172.21.15.39:0/408627207' entity='mgr.x' 2024-09-12T02:30:32.449 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 12 02:30:32 smithi044 ceph-mon[35411]: from='mgr.14150 172.21.15.39:0/408627207' entity='mgr.x' 2024-09-12T02:30:32.449 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 12 02:30:32 smithi044 ceph-mon[35411]: from='mgr.14150 172.21.15.39:0/408627207' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-12T02:30:32.449 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 12 02:30:32 smithi044 ceph-mon[35411]: from='mgr.14150 172.21.15.39:0/408627207' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-12T02:30:32.449 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 12 02:30:32 smithi044 ceph-mon[35411]: from='mgr.14150 172.21.15.39:0/408627207' entity='mgr.x' 2024-09-12T02:30:32.513 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 12 02:30:32 smithi172 ceph-mon[35609]: pgmap v96: 1 pgs: 1 active+clean; 577 KiB data, 86 MiB used, 268 GiB / 268 GiB avail 2024-09-12T02:30:32.514 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 12 02:30:32 smithi172 ceph-mon[35609]: from='mgr.14150 172.21.15.39:0/408627207' entity='mgr.x' 2024-09-12T02:30:32.514 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 12 02:30:32 smithi172 ceph-mon[35609]: from='mgr.14150 172.21.15.39:0/408627207' entity='mgr.x' 2024-09-12T02:30:32.514 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 12 02:30:32 smithi172 ceph-mon[35609]: from='mgr.14150 172.21.15.39:0/408627207' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-12T02:30:32.514 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 12 02:30:32 smithi172 ceph-mon[35609]: from='mgr.14150 172.21.15.39:0/408627207' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-12T02:30:32.514 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 12 02:30:32 smithi172 ceph-mon[35609]: from='mgr.14150 172.21.15.39:0/408627207' entity='mgr.x' 2024-09-12T02:30:32.747 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:30:32.745+0000 7fd4ab400640 1 -- 172.21.15.39:0/604026423 <== mgr.14150 v2:172.21.15.39:6800/1725006999 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+37 (secure 0 0 0) 0x7fd4b4062630 con 0x7fd4980a2b20 2024-09-12T02:30:32.747 INFO:teuthology.orchestra.run.smithi039.stdout:Created osd(s) 3 on host 'smithi039' 2024-09-12T02:30:32.749 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:30:32.748+0000 7fd4b8a00640 1 -- 172.21.15.39:0/604026423 >> [v2:172.21.15.39:6800/1725006999,v1:172.21.15.39:6801/1725006999] conn(0x7fd4980a2b20 msgr2=0x7fd4980a4fe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:30:32.749 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:30:32.748+0000 7fd4b8a00640 1 --2- 172.21.15.39:0/604026423 >> [v2:172.21.15.39:6800/1725006999,v1:172.21.15.39:6801/1725006999] conn(0x7fd4980a2b20 0x7fd4980a4fe0 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7fd4a4031440 tx=0x7fd4a40315b0 comp rx=0 tx=0).stop 2024-09-12T02:30:32.749 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:30:32.748+0000 7fd4b8a00640 1 -- 172.21.15.39:0/604026423 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fd4b40761a0 msgr2=0x7fd4b419a3f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:30:32.749 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:30:32.748+0000 7fd4b8a00640 1 --2- 172.21.15.39:0/604026423 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fd4b40761a0 0x7fd4b419a3f0 secure :-1 s=READY pgs=20 cs=0 l=1 rev1=1 crypto rx=0x7fd4a000d950 tx=0x7fd4a000de10 comp rx=0 tx=0).stop 2024-09-12T02:30:32.749 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:30:32.748+0000 7fd4b8a00640 1 -- 172.21.15.39:0/604026423 shutdown_connections 2024-09-12T02:30:32.749 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:30:32.748+0000 7fd4b8a00640 1 --2- 172.21.15.39:0/604026423 >> [v2:172.21.15.39:6800/1725006999,v1:172.21.15.39:6801/1725006999] conn(0x7fd4980a2b20 0x7fd4980a4fe0 unknown :-1 s=CLOSED pgs=65 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:30:32.749 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:30:32.748+0000 7fd4b8a00640 1 --2- 172.21.15.39:0/604026423 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fd4b41098b0 0x7fd4b41a1470 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:30:32.749 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:30:32.748+0000 7fd4b8a00640 1 --2- 172.21.15.39:0/604026423 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fd4b40761a0 0x7fd4b419a3f0 unknown :-1 s=CLOSED pgs=20 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:30:32.749 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:30:32.748+0000 7fd4b8a00640 1 --2- 172.21.15.39:0/604026423 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fd4b4074b40 0x7fd4b4199eb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:30:32.750 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:30:32.748+0000 7fd4b8a00640 1 -- 172.21.15.39:0/604026423 >> 172.21.15.39:0/604026423 conn(0x7fd4b40fd1f0 msgr2=0x7fd4b4105890 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:30:32.750 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:30:32.748+0000 7fd4b8a00640 1 -- 172.21.15.39:0/604026423 shutdown_connections 2024-09-12T02:30:32.750 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:30:32.749+0000 7fd4b8a00640 1 -- 172.21.15.39:0/604026423 wait complete. 2024-09-12T02:30:33.448 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 12 02:30:33 smithi044 ceph-mon[35411]: from='mgr.14150 172.21.15.39:0/408627207' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-12T02:30:33.449 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 12 02:30:33 smithi044 ceph-mon[35411]: from='mgr.14150 172.21.15.39:0/408627207' entity='mgr.x' 2024-09-12T02:30:33.449 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 12 02:30:33 smithi044 ceph-mon[35411]: from='mgr.14150 172.21.15.39:0/408627207' entity='mgr.x' 2024-09-12T02:30:33.503 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 02:30:33 smithi039 ceph-mon[30515]: from='mgr.14150 172.21.15.39:0/408627207' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-12T02:30:33.504 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 02:30:33 smithi039 ceph-mon[30515]: from='mgr.14150 172.21.15.39:0/408627207' entity='mgr.x' 2024-09-12T02:30:33.504 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 02:30:33 smithi039 ceph-mon[30515]: from='mgr.14150 172.21.15.39:0/408627207' entity='mgr.x' 2024-09-12T02:30:33.513 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 12 02:30:33 smithi172 ceph-mon[35609]: from='mgr.14150 172.21.15.39:0/408627207' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-12T02:30:33.513 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 12 02:30:33 smithi172 ceph-mon[35609]: from='mgr.14150 172.21.15.39:0/408627207' entity='mgr.x' 2024-09-12T02:30:33.513 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 12 02:30:33 smithi172 ceph-mon[35609]: from='mgr.14150 172.21.15.39:0/408627207' entity='mgr.x' 2024-09-12T02:30:33.544 DEBUG:teuthology.orchestra.run.smithi039:osd.3> sudo journalctl -f -n 0 -u ceph-4954ed46-70ae-11ef-bcea-c7b262605968@osd.3.service 2024-09-12T02:30:33.549 INFO:tasks.cephadm:Deploying osd.4 on smithi044 with /dev/vg_nvme/lv_3... 2024-09-12T02:30:33.549 DEBUG:teuthology.orchestra.run.smithi044:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc ceph-volume -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 4954ed46-70ae-11ef-bcea-c7b262605968 -- lvm zap /dev/vg_nvme/lv_3 2024-09-12T02:30:33.809 INFO:teuthology.orchestra.run.smithi044.stderr:Inferring config /var/lib/ceph/4954ed46-70ae-11ef-bcea-c7b262605968/mon.b/config 2024-09-12T02:30:34.064 INFO:journalctl@ceph.osd.3.smithi039.stdout:Sep 12 02:30:33 smithi039 ceph-4954ed46-70ae-11ef-bcea-c7b262605968-osd-3[50671]: 2024-09-12T02:30:33.820+0000 7f7ece093640 -1 osd.3 0 log_to_monitors true 2024-09-12T02:30:34.198 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 12 02:30:34 smithi044 ceph-mon[35411]: pgmap v97: 1 pgs: 1 active+clean; 577 KiB data, 86 MiB used, 268 GiB / 268 GiB avail 2024-09-12T02:30:34.198 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 12 02:30:34 smithi044 ceph-mon[35411]: from='osd.3 [v2:172.21.15.39:6810/2013565859,v1:172.21.15.39:6811/2013565859]' entity='osd.3' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["3"]}]: dispatch 2024-09-12T02:30:34.199 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 12 02:30:34 smithi044 ceph-mon[35411]: from='osd.3 ' entity='osd.3' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["3"]}]: dispatch 2024-09-12T02:30:34.349 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 02:30:34 smithi039 ceph-mon[30515]: pgmap v97: 1 pgs: 1 active+clean; 577 KiB data, 86 MiB used, 268 GiB / 268 GiB avail 2024-09-12T02:30:34.350 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 02:30:34 smithi039 ceph-mon[30515]: from='osd.3 [v2:172.21.15.39:6810/2013565859,v1:172.21.15.39:6811/2013565859]' entity='osd.3' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["3"]}]: dispatch 2024-09-12T02:30:34.350 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 02:30:34 smithi039 ceph-mon[30515]: from='osd.3 ' entity='osd.3' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["3"]}]: dispatch 2024-09-12T02:30:34.513 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 12 02:30:34 smithi172 ceph-mon[35609]: pgmap v97: 1 pgs: 1 active+clean; 577 KiB data, 86 MiB used, 268 GiB / 268 GiB avail 2024-09-12T02:30:34.513 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 12 02:30:34 smithi172 ceph-mon[35609]: from='osd.3 [v2:172.21.15.39:6810/2013565859,v1:172.21.15.39:6811/2013565859]' entity='osd.3' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["3"]}]: dispatch 2024-09-12T02:30:34.514 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 12 02:30:34 smithi172 ceph-mon[35609]: from='osd.3 ' entity='osd.3' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["3"]}]: dispatch 2024-09-12T02:30:36.010 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 02:30:35 smithi039 ceph-mon[30515]: from='osd.3 ' entity='osd.3' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["3"]}]': finished 2024-09-12T02:30:36.011 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 02:30:35 smithi039 ceph-mon[30515]: osdmap e24: 4 total, 3 up, 4 in 2024-09-12T02:30:36.011 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 02:30:35 smithi039 ceph-mon[30515]: from='mgr.14150 172.21.15.39:0/408627207' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-09-12T02:30:36.011 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 02:30:35 smithi039 ceph-mon[30515]: from='osd.3 [v2:172.21.15.39:6810/2013565859,v1:172.21.15.39:6811/2013565859]' entity='osd.3' cmd=[{"prefix": "osd crush create-or-move", "id": 3, "weight":0.0873, "args": ["host=smithi039", "root=default"]}]: dispatch 2024-09-12T02:30:36.011 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 02:30:35 smithi039 ceph-mon[30515]: from='osd.3 ' entity='osd.3' cmd=[{"prefix": "osd crush create-or-move", "id": 3, "weight":0.0873, "args": ["host=smithi039", "root=default"]}]: dispatch 2024-09-12T02:30:36.011 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 02:30:35 smithi039 ceph-mon[30515]: pgmap v99: 1 pgs: 1 active+clean; 577 KiB data, 86 MiB used, 268 GiB / 268 GiB avail 2024-09-12T02:30:36.013 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 12 02:30:35 smithi172 ceph-mon[35609]: from='osd.3 ' entity='osd.3' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["3"]}]': finished 2024-09-12T02:30:36.014 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 12 02:30:35 smithi172 ceph-mon[35609]: osdmap e24: 4 total, 3 up, 4 in 2024-09-12T02:30:36.014 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 12 02:30:35 smithi172 ceph-mon[35609]: from='mgr.14150 172.21.15.39:0/408627207' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-09-12T02:30:36.014 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 12 02:30:35 smithi172 ceph-mon[35609]: from='osd.3 [v2:172.21.15.39:6810/2013565859,v1:172.21.15.39:6811/2013565859]' entity='osd.3' cmd=[{"prefix": "osd crush create-or-move", "id": 3, "weight":0.0873, "args": ["host=smithi039", "root=default"]}]: dispatch 2024-09-12T02:30:36.014 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 12 02:30:35 smithi172 ceph-mon[35609]: from='osd.3 ' entity='osd.3' cmd=[{"prefix": "osd crush create-or-move", "id": 3, "weight":0.0873, "args": ["host=smithi039", "root=default"]}]: dispatch 2024-09-12T02:30:36.014 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 12 02:30:35 smithi172 ceph-mon[35609]: pgmap v99: 1 pgs: 1 active+clean; 577 KiB data, 86 MiB used, 268 GiB / 268 GiB avail 2024-09-12T02:30:36.179 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 12 02:30:35 smithi044 ceph-mon[35411]: from='osd.3 ' entity='osd.3' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["3"]}]': finished 2024-09-12T02:30:36.179 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 12 02:30:35 smithi044 ceph-mon[35411]: osdmap e24: 4 total, 3 up, 4 in 2024-09-12T02:30:36.179 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 12 02:30:35 smithi044 ceph-mon[35411]: from='mgr.14150 172.21.15.39:0/408627207' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-09-12T02:30:36.179 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 12 02:30:35 smithi044 ceph-mon[35411]: from='osd.3 [v2:172.21.15.39:6810/2013565859,v1:172.21.15.39:6811/2013565859]' entity='osd.3' cmd=[{"prefix": "osd crush create-or-move", "id": 3, "weight":0.0873, "args": ["host=smithi039", "root=default"]}]: dispatch 2024-09-12T02:30:36.179 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 12 02:30:35 smithi044 ceph-mon[35411]: from='osd.3 ' entity='osd.3' cmd=[{"prefix": "osd crush create-or-move", "id": 3, "weight":0.0873, "args": ["host=smithi039", "root=default"]}]: dispatch 2024-09-12T02:30:36.179 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 12 02:30:35 smithi044 ceph-mon[35411]: pgmap v99: 1 pgs: 1 active+clean; 577 KiB data, 86 MiB used, 268 GiB / 268 GiB avail 2024-09-12T02:30:36.181 INFO:teuthology.orchestra.run.smithi044.stdout: 2024-09-12T02:30:36.207 DEBUG:teuthology.orchestra.run.smithi044:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 4954ed46-70ae-11ef-bcea-c7b262605968 -- ceph orch daemon add osd smithi044:vg_nvme/lv_3 2024-09-12T02:30:36.461 INFO:teuthology.orchestra.run.smithi044.stderr:Inferring config /var/lib/ceph/4954ed46-70ae-11ef-bcea-c7b262605968/mon.b/config 2024-09-12T02:30:36.850 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 02:30:36 smithi039 ceph-mon[30515]: from='osd.3 ' entity='osd.3' cmd='[{"prefix": "osd crush create-or-move", "id": 3, "weight":0.0873, "args": ["host=smithi039", "root=default"]}]': finished 2024-09-12T02:30:36.850 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 02:30:36 smithi039 ceph-mon[30515]: osdmap e25: 4 total, 3 up, 4 in 2024-09-12T02:30:36.850 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 02:30:36 smithi039 ceph-mon[30515]: from='mgr.14150 172.21.15.39:0/408627207' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-09-12T02:30:36.850 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 02:30:36 smithi039 ceph-mon[30515]: from='mgr.14150 172.21.15.39:0/408627207' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-09-12T02:30:36.850 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 02:30:36 smithi039 ceph-mon[30515]: from='osd.3 ' entity='osd.3' 2024-09-12T02:30:36.850 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 02:30:36 smithi039 ceph-mon[30515]: osd.3 [v2:172.21.15.39:6810/2013565859,v1:172.21.15.39:6811/2013565859] boot 2024-09-12T02:30:36.850 INFO:journalctl@ceph.osd.3.smithi039.stdout:Sep 12 02:30:36 smithi039 ceph-4954ed46-70ae-11ef-bcea-c7b262605968-osd-3[50671]: 2024-09-12T02:30:36.539+0000 7f7ec9000640 -1 osd.3 0 waiting for initial osdmap 2024-09-12T02:30:36.850 INFO:journalctl@ceph.osd.3.smithi039.stdout:Sep 12 02:30:36 smithi039 ceph-4954ed46-70ae-11ef-bcea-c7b262605968-osd-3[50671]: 2024-09-12T02:30:36.557+0000 7f7ebf000640 -1 osd.3 25 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-09-12T02:30:36.916 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T02:30:36.902+0000 7fcb41892640 1 -- 172.21.15.44:0/2435369350 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fcb3c101c00 msgr2=0x7fcb3c102000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:30:36.916 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T02:30:36.902+0000 7fcb41892640 1 --2- 172.21.15.44:0/2435369350 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fcb3c101c00 0x7fcb3c102000 secure :-1 s=READY pgs=26 cs=0 l=1 rev1=1 crypto rx=0x7fcb2c009900 tx=0x7fcb2c02a410 comp rx=0 tx=0).stop 2024-09-12T02:30:36.916 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T02:30:36.902+0000 7fcb41892640 1 -- 172.21.15.44:0/2435369350 shutdown_connections 2024-09-12T02:30:36.917 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T02:30:36.902+0000 7fcb41892640 1 --2- 172.21.15.44:0/2435369350 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fcb3c1037c0 0x7fcb3c10a050 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:30:36.917 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T02:30:36.902+0000 7fcb41892640 1 --2- 172.21.15.44:0/2435369350 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fcb3c102e00 0x7fcb3c103280 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:30:36.917 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T02:30:36.902+0000 7fcb41892640 1 --2- 172.21.15.44:0/2435369350 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fcb3c101c00 0x7fcb3c102000 unknown :-1 s=CLOSED pgs=26 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:30:36.917 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T02:30:36.902+0000 7fcb41892640 1 -- 172.21.15.44:0/2435369350 >> 172.21.15.44:0/2435369350 conn(0x7fcb3c0fd390 msgr2=0x7fcb3c0ff7d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:30:36.917 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T02:30:36.902+0000 7fcb41892640 1 -- 172.21.15.44:0/2435369350 shutdown_connections 2024-09-12T02:30:36.917 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T02:30:36.902+0000 7fcb41892640 1 -- 172.21.15.44:0/2435369350 wait complete. 2024-09-12T02:30:36.917 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T02:30:36.903+0000 7fcb41892640 1 Processor -- start 2024-09-12T02:30:36.917 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T02:30:36.903+0000 7fcb41892640 1 -- start start 2024-09-12T02:30:36.917 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T02:30:36.903+0000 7fcb41892640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fcb3c101c00 0x7fcb3c197f60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:30:36.917 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T02:30:36.903+0000 7fcb41892640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fcb3c102e00 0x7fcb3c1984a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:30:36.917 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T02:30:36.903+0000 7fcb41892640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fcb3c1037c0 0x7fcb3c19f520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:30:36.918 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T02:30:36.903+0000 7fcb41892640 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 -- 0x7fcb3c10d8e0 con 0x7fcb3c1037c0 2024-09-12T02:30:36.918 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T02:30:36.903+0000 7fcb41892640 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x7fcb3c10d760 con 0x7fcb3c102e00 2024-09-12T02:30:36.918 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T02:30:36.903+0000 7fcb41892640 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7fcb3c10da60 con 0x7fcb3c101c00 2024-09-12T02:30:36.918 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T02:30:36.903+0000 7fcb3a7fc640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fcb3c102e00 0x7fcb3c1984a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:30:36.918 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T02:30:36.903+0000 7fcb3a7fc640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fcb3c102e00 0x7fcb3c1984a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.44:51018/0 (socket says 172.21.15.44:51018) 2024-09-12T02:30:36.918 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T02:30:36.903+0000 7fcb3a7fc640 1 -- 172.21.15.44:0/1845650534 learned_addr learned my addr 172.21.15.44:0/1845650534 (peer_addr_for_me v2:172.21.15.44:0/0) 2024-09-12T02:30:36.918 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T02:30:36.904+0000 7fcb3affd640 1 --2- 172.21.15.44:0/1845650534 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fcb3c101c00 0x7fcb3c197f60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:30:36.918 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T02:30:36.904+0000 7fcb3b7fe640 1 --2- 172.21.15.44:0/1845650534 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fcb3c1037c0 0x7fcb3c19f520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:30:36.918 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T02:30:36.904+0000 7fcb3a7fc640 1 -- 172.21.15.44:0/1845650534 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fcb3c101c00 msgr2=0x7fcb3c197f60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:30:36.918 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T02:30:36.904+0000 7fcb3a7fc640 1 --2- 172.21.15.44:0/1845650534 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fcb3c101c00 0x7fcb3c197f60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:30:36.919 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T02:30:36.904+0000 7fcb3a7fc640 1 -- 172.21.15.44:0/1845650534 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fcb3c1037c0 msgr2=0x7fcb3c19f520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:30:36.919 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T02:30:36.904+0000 7fcb3a7fc640 1 --2- 172.21.15.44:0/1845650534 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fcb3c1037c0 0x7fcb3c19f520 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:30:36.919 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T02:30:36.904+0000 7fcb3a7fc640 1 -- 172.21.15.44:0/1845650534 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fcb3c19fb90 con 0x7fcb3c102e00 2024-09-12T02:30:36.919 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T02:30:36.904+0000 7fcb3b7fe640 1 --2- 172.21.15.44:0/1845650534 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fcb3c1037c0 0x7fcb3c19f520 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-12T02:30:36.919 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T02:30:36.904+0000 7fcb3a7fc640 1 --2- 172.21.15.44:0/1845650534 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fcb3c102e00 0x7fcb3c1984a0 secure :-1 s=READY pgs=27 cs=0 l=1 rev1=1 crypto rx=0x7fcb2400b4a0 tx=0x7fcb2400b960 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:30:36.919 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T02:30:36.904+0000 7fcb40890640 1 -- 172.21.15.44:0/1845650534 <== mon.2 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcb24014070 con 0x7fcb3c102e00 2024-09-12T02:30:36.919 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T02:30:36.904+0000 7fcb40890640 1 -- 172.21.15.44:0/1845650534 <== mon.2 v2:172.21.15.44:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fcb24010af0 con 0x7fcb3c102e00 2024-09-12T02:30:36.919 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T02:30:36.904+0000 7fcb41892640 1 -- 172.21.15.44:0/1845650534 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fcb3c19fe80 con 0x7fcb3c102e00 2024-09-12T02:30:36.919 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T02:30:36.904+0000 7fcb40890640 1 -- 172.21.15.44:0/1845650534 <== mon.2 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcb24017d10 con 0x7fcb3c102e00 2024-09-12T02:30:36.919 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T02:30:36.904+0000 7fcb41892640 1 -- 172.21.15.44:0/1845650534 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fcb3c1a03b0 con 0x7fcb3c102e00 2024-09-12T02:30:36.919 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T02:30:36.905+0000 7fcb41892640 1 -- 172.21.15.44:0/1845650534 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fcb3c109050 con 0x7fcb3c102e00 2024-09-12T02:30:36.920 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T02:30:36.906+0000 7fcb40890640 1 -- 172.21.15.44:0/1845650534 <== mon.2 v2:172.21.15.44:3300/0 4 ==== mgrmap(e 16) ==== 137833+0+0 (secure 0 0 0) 0x7fcb24017070 con 0x7fcb3c102e00 2024-09-12T02:30:36.920 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T02:30:36.907+0000 7fcb40890640 1 --2- 172.21.15.44:0/1845650534 >> [v2:172.21.15.39:6800/1725006999,v1:172.21.15.39:6801/1725006999] conn(0x7fcb280a2c30 0x7fcb280a50f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:30:36.920 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T02:30:36.907+0000 7fcb40890640 1 -- 172.21.15.44:0/1845650534 <== mon.2 v2:172.21.15.44:3300/0 5 ==== osd_map(27..27 src has 1..27) ==== 3698+0+0 (secure 0 0 0) 0x7fcb240cd140 con 0x7fcb3c102e00 2024-09-12T02:30:36.920 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T02:30:36.907+0000 7fcb3affd640 1 --2- 172.21.15.44:0/1845650534 >> [v2:172.21.15.39:6800/1725006999,v1:172.21.15.39:6801/1725006999] conn(0x7fcb280a2c30 0x7fcb280a50f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:30:36.920 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T02:30:36.908+0000 7fcb3affd640 1 --2- 172.21.15.44:0/1845650534 >> [v2:172.21.15.39:6800/1725006999,v1:172.21.15.39:6801/1725006999] conn(0x7fcb280a2c30 0x7fcb280a50f0 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7fcb2c005ab0 tx=0x7fcb2c000bc0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:30:36.920 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T02:30:36.911+0000 7fcb40890640 1 -- 172.21.15.44:0/1845650534 <== mon.2 v2:172.21.15.44:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7fcb2409b2a0 con 0x7fcb3c102e00 2024-09-12T02:30:37.013 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 12 02:30:36 smithi172 ceph-mon[35609]: from='osd.3 ' entity='osd.3' cmd='[{"prefix": "osd crush create-or-move", "id": 3, "weight":0.0873, "args": ["host=smithi039", "root=default"]}]': finished 2024-09-12T02:30:37.014 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 12 02:30:36 smithi172 ceph-mon[35609]: osdmap e25: 4 total, 3 up, 4 in 2024-09-12T02:30:37.014 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 12 02:30:36 smithi172 ceph-mon[35609]: from='mgr.14150 172.21.15.39:0/408627207' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-09-12T02:30:37.014 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 12 02:30:36 smithi172 ceph-mon[35609]: from='mgr.14150 172.21.15.39:0/408627207' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-09-12T02:30:37.014 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 12 02:30:36 smithi172 ceph-mon[35609]: from='osd.3 ' entity='osd.3' 2024-09-12T02:30:37.014 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 12 02:30:36 smithi172 ceph-mon[35609]: osd.3 [v2:172.21.15.39:6810/2013565859,v1:172.21.15.39:6811/2013565859] boot 2024-09-12T02:30:37.099 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T02:30:37.098+0000 7fcb41892640 1 -- 172.21.15.44:0/1845650534 --> [v2:172.21.15.39:6800/1725006999,v1:172.21.15.39:6801/1725006999] -- mgr_command(tid 0: {"prefix": "orch daemon add osd", "svc_arg": "smithi044:vg_nvme/lv_3", "target": ["mon-mgr", ""]}) -- 0x7fcb3c062630 con 0x7fcb280a2c30 2024-09-12T02:30:37.099 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 12 02:30:36 smithi044 ceph-mon[35411]: from='osd.3 ' entity='osd.3' cmd='[{"prefix": "osd crush create-or-move", "id": 3, "weight":0.0873, "args": ["host=smithi039", "root=default"]}]': finished 2024-09-12T02:30:37.100 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 12 02:30:36 smithi044 ceph-mon[35411]: osdmap e25: 4 total, 3 up, 4 in 2024-09-12T02:30:37.100 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 12 02:30:36 smithi044 ceph-mon[35411]: from='mgr.14150 172.21.15.39:0/408627207' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-09-12T02:30:37.100 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 12 02:30:36 smithi044 ceph-mon[35411]: from='mgr.14150 172.21.15.39:0/408627207' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-09-12T02:30:37.100 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 12 02:30:36 smithi044 ceph-mon[35411]: from='osd.3 ' entity='osd.3' 2024-09-12T02:30:37.101 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 12 02:30:36 smithi044 ceph-mon[35411]: osd.3 [v2:172.21.15.39:6810/2013565859,v1:172.21.15.39:6811/2013565859] boot 2024-09-12T02:30:38.014 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 12 02:30:37 smithi172 ceph-mon[35609]: purged_snaps scrub starts 2024-09-12T02:30:38.014 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 12 02:30:37 smithi172 ceph-mon[35609]: purged_snaps scrub ok 2024-09-12T02:30:38.014 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 12 02:30:37 smithi172 ceph-mon[35609]: pgmap v102: 1 pgs: 1 active+clean; 577 KiB data, 86 MiB used, 268 GiB / 268 GiB avail 2024-09-12T02:30:38.014 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 12 02:30:37 smithi172 ceph-mon[35609]: osdmap e26: 4 total, 4 up, 4 in 2024-09-12T02:30:38.014 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 12 02:30:37 smithi172 ceph-mon[35609]: from='mgr.14150 172.21.15.39:0/408627207' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-09-12T02:30:38.014 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 12 02:30:37 smithi172 ceph-mon[35609]: osdmap e27: 4 total, 4 up, 4 in 2024-09-12T02:30:38.014 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 12 02:30:37 smithi172 ceph-mon[35609]: from='client.24221 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi044:vg_nvme/lv_3", "target": ["mon-mgr", ""]}]: dispatch 2024-09-12T02:30:38.014 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 12 02:30:37 smithi172 ceph-mon[35609]: from='mgr.14150 172.21.15.39:0/408627207' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-09-12T02:30:38.015 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 12 02:30:37 smithi172 ceph-mon[35609]: from='mgr.14150 172.21.15.39:0/408627207' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-09-12T02:30:38.015 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 12 02:30:37 smithi172 ceph-mon[35609]: from='mgr.14150 172.21.15.39:0/408627207' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-12T02:30:38.015 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 12 02:30:37 smithi172 ceph-mon[35609]: Detected new or changed devices on smithi039 2024-09-12T02:30:38.015 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 12 02:30:37 smithi172 ceph-mon[35609]: from='mgr.14150 172.21.15.39:0/408627207' entity='mgr.x' 2024-09-12T02:30:38.015 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 12 02:30:37 smithi172 ceph-mon[35609]: from='mgr.14150 172.21.15.39:0/408627207' entity='mgr.x' 2024-09-12T02:30:38.015 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 12 02:30:37 smithi172 ceph-mon[35609]: from='mgr.14150 172.21.15.39:0/408627207' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-09-12T02:30:38.015 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 12 02:30:37 smithi172 ceph-mon[35609]: from='mgr.14150 172.21.15.39:0/408627207' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2024-09-12T02:30:38.015 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 12 02:30:37 smithi172 ceph-mon[35609]: Adjusting osd_memory_target on smithi039 to 8544M 2024-09-12T02:30:38.015 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 12 02:30:37 smithi172 ceph-mon[35609]: from='mgr.14150 172.21.15.39:0/408627207' entity='mgr.x' 2024-09-12T02:30:38.015 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 12 02:30:37 smithi172 ceph-mon[35609]: from='mgr.14150 172.21.15.39:0/408627207' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-12T02:30:38.016 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 12 02:30:37 smithi172 ceph-mon[35609]: from='mgr.14150 172.21.15.39:0/408627207' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-12T02:30:38.016 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 12 02:30:37 smithi172 ceph-mon[35609]: from='mgr.14150 172.21.15.39:0/408627207' entity='mgr.x' 2024-09-12T02:30:38.100 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 02:30:37 smithi039 ceph-mon[30515]: purged_snaps scrub starts 2024-09-12T02:30:38.100 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 02:30:37 smithi039 ceph-mon[30515]: purged_snaps scrub ok 2024-09-12T02:30:38.100 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 02:30:37 smithi039 ceph-mon[30515]: pgmap v102: 1 pgs: 1 active+clean; 577 KiB data, 86 MiB used, 268 GiB / 268 GiB avail 2024-09-12T02:30:38.100 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 02:30:37 smithi039 ceph-mon[30515]: osdmap e26: 4 total, 4 up, 4 in 2024-09-12T02:30:38.100 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 02:30:37 smithi039 ceph-mon[30515]: from='mgr.14150 172.21.15.39:0/408627207' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-09-12T02:30:38.100 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 02:30:37 smithi039 ceph-mon[30515]: osdmap e27: 4 total, 4 up, 4 in 2024-09-12T02:30:38.100 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 02:30:37 smithi039 ceph-mon[30515]: from='client.24221 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi044:vg_nvme/lv_3", "target": ["mon-mgr", ""]}]: dispatch 2024-09-12T02:30:38.100 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 02:30:37 smithi039 ceph-mon[30515]: from='mgr.14150 172.21.15.39:0/408627207' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-09-12T02:30:38.100 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 02:30:37 smithi039 ceph-mon[30515]: from='mgr.14150 172.21.15.39:0/408627207' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-09-12T02:30:38.100 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 02:30:37 smithi039 ceph-mon[30515]: from='mgr.14150 172.21.15.39:0/408627207' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-12T02:30:38.101 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 02:30:37 smithi039 ceph-mon[30515]: Detected new or changed devices on smithi039 2024-09-12T02:30:38.101 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 02:30:37 smithi039 ceph-mon[30515]: from='mgr.14150 172.21.15.39:0/408627207' entity='mgr.x' 2024-09-12T02:30:38.101 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 02:30:37 smithi039 ceph-mon[30515]: from='mgr.14150 172.21.15.39:0/408627207' entity='mgr.x' 2024-09-12T02:30:38.101 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 02:30:37 smithi039 ceph-mon[30515]: from='mgr.14150 172.21.15.39:0/408627207' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-09-12T02:30:38.101 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 02:30:37 smithi039 ceph-mon[30515]: from='mgr.14150 172.21.15.39:0/408627207' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2024-09-12T02:30:38.101 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 02:30:37 smithi039 ceph-mon[30515]: Adjusting osd_memory_target on smithi039 to 8544M 2024-09-12T02:30:38.101 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 02:30:37 smithi039 ceph-mon[30515]: from='mgr.14150 172.21.15.39:0/408627207' entity='mgr.x' 2024-09-12T02:30:38.101 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 02:30:37 smithi039 ceph-mon[30515]: from='mgr.14150 172.21.15.39:0/408627207' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-12T02:30:38.101 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 02:30:37 smithi039 ceph-mon[30515]: from='mgr.14150 172.21.15.39:0/408627207' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-12T02:30:38.101 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 02:30:37 smithi039 ceph-mon[30515]: from='mgr.14150 172.21.15.39:0/408627207' entity='mgr.x' 2024-09-12T02:30:38.199 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 12 02:30:37 smithi044 ceph-mon[35411]: purged_snaps scrub starts 2024-09-12T02:30:38.199 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 12 02:30:37 smithi044 ceph-mon[35411]: purged_snaps scrub ok 2024-09-12T02:30:38.199 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 12 02:30:37 smithi044 ceph-mon[35411]: pgmap v102: 1 pgs: 1 active+clean; 577 KiB data, 86 MiB used, 268 GiB / 268 GiB avail 2024-09-12T02:30:38.199 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 12 02:30:37 smithi044 ceph-mon[35411]: osdmap e26: 4 total, 4 up, 4 in 2024-09-12T02:30:38.199 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 12 02:30:37 smithi044 ceph-mon[35411]: from='mgr.14150 172.21.15.39:0/408627207' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-09-12T02:30:38.199 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 12 02:30:37 smithi044 ceph-mon[35411]: osdmap e27: 4 total, 4 up, 4 in 2024-09-12T02:30:38.199 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 12 02:30:37 smithi044 ceph-mon[35411]: from='client.24221 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi044:vg_nvme/lv_3", "target": ["mon-mgr", ""]}]: dispatch 2024-09-12T02:30:38.199 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 12 02:30:37 smithi044 ceph-mon[35411]: from='mgr.14150 172.21.15.39:0/408627207' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-09-12T02:30:38.199 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 12 02:30:37 smithi044 ceph-mon[35411]: from='mgr.14150 172.21.15.39:0/408627207' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-09-12T02:30:38.199 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 12 02:30:37 smithi044 ceph-mon[35411]: from='mgr.14150 172.21.15.39:0/408627207' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-12T02:30:38.200 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 12 02:30:37 smithi044 ceph-mon[35411]: Detected new or changed devices on smithi039 2024-09-12T02:30:38.200 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 12 02:30:37 smithi044 ceph-mon[35411]: from='mgr.14150 172.21.15.39:0/408627207' entity='mgr.x' 2024-09-12T02:30:38.200 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 12 02:30:37 smithi044 ceph-mon[35411]: from='mgr.14150 172.21.15.39:0/408627207' entity='mgr.x' 2024-09-12T02:30:38.200 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 12 02:30:37 smithi044 ceph-mon[35411]: from='mgr.14150 172.21.15.39:0/408627207' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-09-12T02:30:38.200 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 12 02:30:37 smithi044 ceph-mon[35411]: from='mgr.14150 172.21.15.39:0/408627207' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2024-09-12T02:30:38.200 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 12 02:30:37 smithi044 ceph-mon[35411]: Adjusting osd_memory_target on smithi039 to 8544M 2024-09-12T02:30:38.200 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 12 02:30:37 smithi044 ceph-mon[35411]: from='mgr.14150 172.21.15.39:0/408627207' entity='mgr.x' 2024-09-12T02:30:38.200 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 12 02:30:37 smithi044 ceph-mon[35411]: from='mgr.14150 172.21.15.39:0/408627207' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-12T02:30:38.200 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 12 02:30:37 smithi044 ceph-mon[35411]: from='mgr.14150 172.21.15.39:0/408627207' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-12T02:30:38.200 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 12 02:30:37 smithi044 ceph-mon[35411]: from='mgr.14150 172.21.15.39:0/408627207' entity='mgr.x' 2024-09-12T02:30:39.110 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 12 02:30:38 smithi044 ceph-mon[35411]: osdmap e28: 4 total, 4 up, 4 in 2024-09-12T02:30:39.263 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 12 02:30:38 smithi172 ceph-mon[35609]: osdmap e28: 4 total, 4 up, 4 in 2024-09-12T02:30:39.349 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 02:30:38 smithi039 ceph-mon[30515]: osdmap e28: 4 total, 4 up, 4 in 2024-09-12T02:30:40.174 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 12 02:30:39 smithi044 ceph-mon[35411]: pgmap v105: 1 pgs: 1 activating+undersized+degraded+remapped; 577 KiB data, 116 MiB used, 357 GiB / 358 GiB avail; 2/6 objects degraded (33.333%) 2024-09-12T02:30:40.175 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 12 02:30:39 smithi044 ceph-mon[35411]: Health check failed: Degraded data redundancy: 2/6 objects degraded (33.333%), 1 pg degraded (PG_DEGRADED) 2024-09-12T02:30:40.175 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 12 02:30:39 smithi044 ceph-mon[35411]: osdmap e29: 4 total, 4 up, 4 in 2024-09-12T02:30:40.175 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 12 02:30:39 smithi044 ceph-mon[35411]: from='client.? 172.21.15.44:0/3120280987' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "e86b6756-e2b3-49fe-9b87-1a2b015bb17a"}]: dispatch 2024-09-12T02:30:40.175 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 12 02:30:39 smithi044 ceph-mon[35411]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "e86b6756-e2b3-49fe-9b87-1a2b015bb17a"}]: dispatch 2024-09-12T02:30:40.175 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 12 02:30:39 smithi044 ceph-mon[35411]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "e86b6756-e2b3-49fe-9b87-1a2b015bb17a"}]': finished 2024-09-12T02:30:40.175 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 12 02:30:39 smithi044 ceph-mon[35411]: osdmap e30: 5 total, 4 up, 5 in 2024-09-12T02:30:40.175 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 12 02:30:39 smithi044 ceph-mon[35411]: from='mgr.14150 172.21.15.39:0/408627207' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-09-12T02:30:40.264 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 12 02:30:39 smithi172 ceph-mon[35609]: pgmap v105: 1 pgs: 1 activating+undersized+degraded+remapped; 577 KiB data, 116 MiB used, 357 GiB / 358 GiB avail; 2/6 objects degraded (33.333%) 2024-09-12T02:30:40.264 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 12 02:30:39 smithi172 ceph-mon[35609]: Health check failed: Degraded data redundancy: 2/6 objects degraded (33.333%), 1 pg degraded (PG_DEGRADED) 2024-09-12T02:30:40.264 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 12 02:30:39 smithi172 ceph-mon[35609]: osdmap e29: 4 total, 4 up, 4 in 2024-09-12T02:30:40.264 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 12 02:30:39 smithi172 ceph-mon[35609]: from='client.? 172.21.15.44:0/3120280987' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "e86b6756-e2b3-49fe-9b87-1a2b015bb17a"}]: dispatch 2024-09-12T02:30:40.264 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 12 02:30:39 smithi172 ceph-mon[35609]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "e86b6756-e2b3-49fe-9b87-1a2b015bb17a"}]: dispatch 2024-09-12T02:30:40.264 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 12 02:30:39 smithi172 ceph-mon[35609]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "e86b6756-e2b3-49fe-9b87-1a2b015bb17a"}]': finished 2024-09-12T02:30:40.264 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 12 02:30:39 smithi172 ceph-mon[35609]: osdmap e30: 5 total, 4 up, 5 in 2024-09-12T02:30:40.264 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 12 02:30:39 smithi172 ceph-mon[35609]: from='mgr.14150 172.21.15.39:0/408627207' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-09-12T02:30:40.349 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 02:30:39 smithi039 ceph-mon[30515]: pgmap v105: 1 pgs: 1 activating+undersized+degraded+remapped; 577 KiB data, 116 MiB used, 357 GiB / 358 GiB avail; 2/6 objects degraded (33.333%) 2024-09-12T02:30:40.350 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 02:30:39 smithi039 ceph-mon[30515]: Health check failed: Degraded data redundancy: 2/6 objects degraded (33.333%), 1 pg degraded (PG_DEGRADED) 2024-09-12T02:30:40.350 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 02:30:39 smithi039 ceph-mon[30515]: osdmap e29: 4 total, 4 up, 4 in 2024-09-12T02:30:40.350 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 02:30:39 smithi039 ceph-mon[30515]: from='client.? 172.21.15.44:0/3120280987' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "e86b6756-e2b3-49fe-9b87-1a2b015bb17a"}]: dispatch 2024-09-12T02:30:40.350 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 02:30:39 smithi039 ceph-mon[30515]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "e86b6756-e2b3-49fe-9b87-1a2b015bb17a"}]: dispatch 2024-09-12T02:30:40.350 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 02:30:39 smithi039 ceph-mon[30515]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "e86b6756-e2b3-49fe-9b87-1a2b015bb17a"}]': finished 2024-09-12T02:30:40.350 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 02:30:39 smithi039 ceph-mon[30515]: osdmap e30: 5 total, 4 up, 5 in 2024-09-12T02:30:40.350 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 02:30:39 smithi039 ceph-mon[30515]: from='mgr.14150 172.21.15.39:0/408627207' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-09-12T02:30:41.198 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 12 02:30:40 smithi044 ceph-mon[35411]: from='client.? 172.21.15.44:0/4285182608' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-09-12T02:30:41.263 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 12 02:30:40 smithi172 ceph-mon[35609]: from='client.? 172.21.15.44:0/4285182608' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-09-12T02:30:41.349 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 02:30:40 smithi039 ceph-mon[30515]: from='client.? 172.21.15.44:0/4285182608' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-09-12T02:30:42.198 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 12 02:30:41 smithi044 ceph-mon[35411]: pgmap v108: 1 pgs: 1 activating+undersized+degraded+remapped; 577 KiB data, 116 MiB used, 357 GiB / 358 GiB avail; 2/6 objects degraded (33.333%) 2024-09-12T02:30:42.263 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 12 02:30:41 smithi172 ceph-mon[35609]: pgmap v108: 1 pgs: 1 activating+undersized+degraded+remapped; 577 KiB data, 116 MiB used, 357 GiB / 358 GiB avail; 2/6 objects degraded (33.333%) 2024-09-12T02:30:42.349 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 02:30:41 smithi039 ceph-mon[30515]: pgmap v108: 1 pgs: 1 activating+undersized+degraded+remapped; 577 KiB data, 116 MiB used, 357 GiB / 358 GiB avail; 2/6 objects degraded (33.333%) 2024-09-12T02:30:44.198 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 12 02:30:43 smithi044 ceph-mon[35411]: pgmap v109: 1 pgs: 1 activating+undersized+degraded+remapped; 577 KiB data, 117 MiB used, 357 GiB / 358 GiB avail; 2/6 objects degraded (33.333%) 2024-09-12T02:30:44.263 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 12 02:30:43 smithi172 ceph-mon[35609]: pgmap v109: 1 pgs: 1 activating+undersized+degraded+remapped; 577 KiB data, 117 MiB used, 357 GiB / 358 GiB avail; 2/6 objects degraded (33.333%) 2024-09-12T02:30:44.349 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 02:30:43 smithi039 ceph-mon[30515]: pgmap v109: 1 pgs: 1 activating+undersized+degraded+remapped; 577 KiB data, 117 MiB used, 357 GiB / 358 GiB avail; 2/6 objects degraded (33.333%) 2024-09-12T02:30:45.088 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 12 02:30:44 smithi044 ceph-mon[35411]: Health check cleared: PG_DEGRADED (was: Degraded data redundancy: 2/6 objects degraded (33.333%), 1 pg degraded) 2024-09-12T02:30:45.089 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 12 02:30:44 smithi044 ceph-mon[35411]: Cluster is now healthy 2024-09-12T02:30:45.263 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 12 02:30:44 smithi172 ceph-mon[35609]: Health check cleared: PG_DEGRADED (was: Degraded data redundancy: 2/6 objects degraded (33.333%), 1 pg degraded) 2024-09-12T02:30:45.263 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 12 02:30:44 smithi172 ceph-mon[35609]: Cluster is now healthy 2024-09-12T02:30:45.349 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 02:30:44 smithi039 ceph-mon[30515]: Health check cleared: PG_DEGRADED (was: Degraded data redundancy: 2/6 objects degraded (33.333%), 1 pg degraded) 2024-09-12T02:30:45.350 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 02:30:44 smithi039 ceph-mon[30515]: Cluster is now healthy 2024-09-12T02:30:46.151 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 12 02:30:45 smithi044 ceph-mon[35411]: pgmap v110: 1 pgs: 1 active+clean; 577 KiB data, 116 MiB used, 357 GiB / 358 GiB avail; 84 KiB/s, 0 objects/s recovering 2024-09-12T02:30:46.337 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 12 02:30:45 smithi172 ceph-mon[35609]: pgmap v110: 1 pgs: 1 active+clean; 577 KiB data, 116 MiB used, 357 GiB / 358 GiB avail; 84 KiB/s, 0 objects/s recovering 2024-09-12T02:30:46.349 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 02:30:45 smithi039 ceph-mon[30515]: pgmap v110: 1 pgs: 1 active+clean; 577 KiB data, 116 MiB used, 357 GiB / 358 GiB avail; 84 KiB/s, 0 objects/s recovering 2024-09-12T02:30:48.154 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 12 02:30:47 smithi044 ceph-mon[35411]: pgmap v111: 1 pgs: 1 active+clean; 577 KiB data, 116 MiB used, 357 GiB / 358 GiB avail; 72 KiB/s, 0 objects/s recovering 2024-09-12T02:30:48.263 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 12 02:30:47 smithi172 ceph-mon[35609]: pgmap v111: 1 pgs: 1 active+clean; 577 KiB data, 116 MiB used, 357 GiB / 358 GiB avail; 72 KiB/s, 0 objects/s recovering 2024-09-12T02:30:48.349 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 02:30:47 smithi039 ceph-mon[30515]: pgmap v111: 1 pgs: 1 active+clean; 577 KiB data, 116 MiB used, 357 GiB / 358 GiB avail; 72 KiB/s, 0 objects/s recovering 2024-09-12T02:30:49.198 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 12 02:30:48 smithi044 ceph-mon[35411]: from='mgr.14150 172.21.15.39:0/408627207' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.4"}]: dispatch 2024-09-12T02:30:49.198 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 12 02:30:48 smithi044 ceph-mon[35411]: from='mgr.14150 172.21.15.39:0/408627207' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-12T02:30:49.198 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 12 02:30:48 smithi044 ceph-mon[35411]: Deploying daemon osd.4 on smithi044 2024-09-12T02:30:49.263 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 12 02:30:48 smithi172 ceph-mon[35609]: from='mgr.14150 172.21.15.39:0/408627207' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.4"}]: dispatch 2024-09-12T02:30:49.263 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 12 02:30:48 smithi172 ceph-mon[35609]: from='mgr.14150 172.21.15.39:0/408627207' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-12T02:30:49.264 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 12 02:30:48 smithi172 ceph-mon[35609]: Deploying daemon osd.4 on smithi044 2024-09-12T02:30:49.351 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 02:30:48 smithi039 ceph-mon[30515]: from='mgr.14150 172.21.15.39:0/408627207' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.4"}]: dispatch 2024-09-12T02:30:49.351 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 02:30:48 smithi039 ceph-mon[30515]: from='mgr.14150 172.21.15.39:0/408627207' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-12T02:30:49.351 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 02:30:48 smithi039 ceph-mon[30515]: Deploying daemon osd.4 on smithi044 2024-09-12T02:30:50.139 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 12 02:30:49 smithi044 ceph-mon[35411]: pgmap v112: 1 pgs: 1 active+clean; 577 KiB data, 116 MiB used, 357 GiB / 358 GiB avail; 59 KiB/s, 0 objects/s recovering 2024-09-12T02:30:50.263 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 12 02:30:49 smithi172 ceph-mon[35609]: pgmap v112: 1 pgs: 1 active+clean; 577 KiB data, 116 MiB used, 357 GiB / 358 GiB avail; 59 KiB/s, 0 objects/s recovering 2024-09-12T02:30:50.349 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 02:30:49 smithi039 ceph-mon[30515]: pgmap v112: 1 pgs: 1 active+clean; 577 KiB data, 116 MiB used, 357 GiB / 358 GiB avail; 59 KiB/s, 0 objects/s recovering 2024-09-12T02:30:52.199 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 12 02:30:52 smithi044 ceph-mon[35411]: pgmap v113: 1 pgs: 1 active+clean; 577 KiB data, 116 MiB used, 357 GiB / 358 GiB avail; 52 KiB/s, 0 objects/s recovering 2024-09-12T02:30:52.263 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 12 02:30:52 smithi172 ceph-mon[35609]: pgmap v113: 1 pgs: 1 active+clean; 577 KiB data, 116 MiB used, 357 GiB / 358 GiB avail; 52 KiB/s, 0 objects/s recovering 2024-09-12T02:30:52.349 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 02:30:52 smithi039 ceph-mon[30515]: pgmap v113: 1 pgs: 1 active+clean; 577 KiB data, 116 MiB used, 357 GiB / 358 GiB avail; 52 KiB/s, 0 objects/s recovering 2024-09-12T02:30:54.178 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 12 02:30:54 smithi044 ceph-mon[35411]: pgmap v114: 1 pgs: 1 active+clean; 577 KiB data, 116 MiB used, 357 GiB / 358 GiB avail; 48 KiB/s, 0 objects/s recovering 2024-09-12T02:30:54.263 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 12 02:30:54 smithi172 ceph-mon[35609]: pgmap v114: 1 pgs: 1 active+clean; 577 KiB data, 116 MiB used, 357 GiB / 358 GiB avail; 48 KiB/s, 0 objects/s recovering 2024-09-12T02:30:54.349 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 02:30:54 smithi039 ceph-mon[30515]: pgmap v114: 1 pgs: 1 active+clean; 577 KiB data, 116 MiB used, 357 GiB / 358 GiB avail; 48 KiB/s, 0 objects/s recovering 2024-09-12T02:30:55.074 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 12 02:30:55 smithi044 ceph-mon[35411]: from='mgr.14150 172.21.15.39:0/408627207' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-12T02:30:55.074 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 12 02:30:55 smithi044 ceph-mon[35411]: from='mgr.14150 172.21.15.39:0/408627207' entity='mgr.x' 2024-09-12T02:30:55.074 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 12 02:30:55 smithi044 ceph-mon[35411]: from='mgr.14150 172.21.15.39:0/408627207' entity='mgr.x' 2024-09-12T02:30:55.350 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 02:30:55 smithi039 ceph-mon[30515]: from='mgr.14150 172.21.15.39:0/408627207' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-12T02:30:55.350 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 02:30:55 smithi039 ceph-mon[30515]: from='mgr.14150 172.21.15.39:0/408627207' entity='mgr.x' 2024-09-12T02:30:55.350 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 02:30:55 smithi039 ceph-mon[30515]: from='mgr.14150 172.21.15.39:0/408627207' entity='mgr.x' 2024-09-12T02:30:55.513 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 12 02:30:55 smithi172 ceph-mon[35609]: from='mgr.14150 172.21.15.39:0/408627207' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-12T02:30:55.514 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 12 02:30:55 smithi172 ceph-mon[35609]: from='mgr.14150 172.21.15.39:0/408627207' entity='mgr.x' 2024-09-12T02:30:55.514 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 12 02:30:55 smithi172 ceph-mon[35609]: from='mgr.14150 172.21.15.39:0/408627207' entity='mgr.x' 2024-09-12T02:30:56.599 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 02:30:56 smithi039 ceph-mon[30515]: pgmap v115: 1 pgs: 1 active+clean; 577 KiB data, 116 MiB used, 357 GiB / 358 GiB avail; 48 KiB/s, 0 objects/s recovering 2024-09-12T02:30:56.620 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 12 02:30:56 smithi044 ceph-mon[35411]: pgmap v115: 1 pgs: 1 active+clean; 577 KiB data, 116 MiB used, 357 GiB / 358 GiB avail; 48 KiB/s, 0 objects/s recovering 2024-09-12T02:30:56.763 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 12 02:30:56 smithi172 ceph-mon[35609]: pgmap v115: 1 pgs: 1 active+clean; 577 KiB data, 116 MiB used, 357 GiB / 358 GiB avail; 48 KiB/s, 0 objects/s recovering 2024-09-12T02:30:58.180 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 12 02:30:57 smithi044 ceph-mon[35411]: pgmap v116: 1 pgs: 1 active+clean; 577 KiB data, 116 MiB used, 357 GiB / 358 GiB avail 2024-09-12T02:30:58.180 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 12 02:30:57 smithi044 ceph-mon[35411]: from='mgr.14150 172.21.15.39:0/408627207' entity='mgr.x' 2024-09-12T02:30:58.180 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 12 02:30:57 smithi044 ceph-mon[35411]: from='mgr.14150 172.21.15.39:0/408627207' entity='mgr.x' 2024-09-12T02:30:58.180 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 12 02:30:57 smithi044 ceph-mon[35411]: from='mgr.14150 172.21.15.39:0/408627207' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-12T02:30:58.180 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 12 02:30:57 smithi044 ceph-mon[35411]: from='mgr.14150 172.21.15.39:0/408627207' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-12T02:30:58.180 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 12 02:30:57 smithi044 ceph-mon[35411]: from='mgr.14150 172.21.15.39:0/408627207' entity='mgr.x' 2024-09-12T02:30:58.229 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T02:30:58.228+0000 7fcb40890640 1 -- 172.21.15.44:0/1845650534 <== mgr.14150 v2:172.21.15.39:6800/1725006999 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+37 (secure 0 0 0) 0x7fcb3c062630 con 0x7fcb280a2c30 2024-09-12T02:30:58.229 INFO:teuthology.orchestra.run.smithi044.stdout:Created osd(s) 4 on host 'smithi044' 2024-09-12T02:30:58.231 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T02:30:58.230+0000 7fcb41892640 1 -- 172.21.15.44:0/1845650534 >> [v2:172.21.15.39:6800/1725006999,v1:172.21.15.39:6801/1725006999] conn(0x7fcb280a2c30 msgr2=0x7fcb280a50f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:30:58.231 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T02:30:58.231+0000 7fcb41892640 1 --2- 172.21.15.44:0/1845650534 >> [v2:172.21.15.39:6800/1725006999,v1:172.21.15.39:6801/1725006999] conn(0x7fcb280a2c30 0x7fcb280a50f0 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7fcb2c005ab0 tx=0x7fcb2c000bc0 comp rx=0 tx=0).stop 2024-09-12T02:30:58.232 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T02:30:58.231+0000 7fcb41892640 1 -- 172.21.15.44:0/1845650534 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fcb3c102e00 msgr2=0x7fcb3c1984a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:30:58.232 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T02:30:58.231+0000 7fcb41892640 1 --2- 172.21.15.44:0/1845650534 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fcb3c102e00 0x7fcb3c1984a0 secure :-1 s=READY pgs=27 cs=0 l=1 rev1=1 crypto rx=0x7fcb2400b4a0 tx=0x7fcb2400b960 comp rx=0 tx=0).stop 2024-09-12T02:30:58.232 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T02:30:58.231+0000 7fcb41892640 1 -- 172.21.15.44:0/1845650534 shutdown_connections 2024-09-12T02:30:58.232 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T02:30:58.231+0000 7fcb41892640 1 --2- 172.21.15.44:0/1845650534 >> [v2:172.21.15.39:6800/1725006999,v1:172.21.15.39:6801/1725006999] conn(0x7fcb280a2c30 0x7fcb280a50f0 unknown :-1 s=CLOSED pgs=72 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:30:58.232 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T02:30:58.231+0000 7fcb41892640 1 --2- 172.21.15.44:0/1845650534 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fcb3c1037c0 0x7fcb3c19f520 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:30:58.232 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T02:30:58.231+0000 7fcb41892640 1 --2- 172.21.15.44:0/1845650534 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fcb3c102e00 0x7fcb3c1984a0 unknown :-1 s=CLOSED pgs=27 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:30:58.232 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T02:30:58.231+0000 7fcb41892640 1 --2- 172.21.15.44:0/1845650534 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fcb3c101c00 0x7fcb3c197f60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:30:58.232 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T02:30:58.231+0000 7fcb41892640 1 -- 172.21.15.44:0/1845650534 >> 172.21.15.44:0/1845650534 conn(0x7fcb3c0fd390 msgr2=0x7fcb3c106220 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:30:58.232 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T02:30:58.231+0000 7fcb41892640 1 -- 172.21.15.44:0/1845650534 shutdown_connections 2024-09-12T02:30:58.232 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T02:30:58.231+0000 7fcb41892640 1 -- 172.21.15.44:0/1845650534 wait complete. 2024-09-12T02:30:58.263 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 12 02:30:57 smithi172 ceph-mon[35609]: pgmap v116: 1 pgs: 1 active+clean; 577 KiB data, 116 MiB used, 357 GiB / 358 GiB avail 2024-09-12T02:30:58.263 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 12 02:30:57 smithi172 ceph-mon[35609]: from='mgr.14150 172.21.15.39:0/408627207' entity='mgr.x' 2024-09-12T02:30:58.264 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 12 02:30:57 smithi172 ceph-mon[35609]: from='mgr.14150 172.21.15.39:0/408627207' entity='mgr.x' 2024-09-12T02:30:58.264 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 12 02:30:57 smithi172 ceph-mon[35609]: from='mgr.14150 172.21.15.39:0/408627207' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-12T02:30:58.264 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 12 02:30:57 smithi172 ceph-mon[35609]: from='mgr.14150 172.21.15.39:0/408627207' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-12T02:30:58.264 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 12 02:30:57 smithi172 ceph-mon[35609]: from='mgr.14150 172.21.15.39:0/408627207' entity='mgr.x' 2024-09-12T02:30:58.349 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 02:30:57 smithi039 ceph-mon[30515]: pgmap v116: 1 pgs: 1 active+clean; 577 KiB data, 116 MiB used, 357 GiB / 358 GiB avail 2024-09-12T02:30:58.350 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 02:30:57 smithi039 ceph-mon[30515]: from='mgr.14150 172.21.15.39:0/408627207' entity='mgr.x' 2024-09-12T02:30:58.350 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 02:30:57 smithi039 ceph-mon[30515]: from='mgr.14150 172.21.15.39:0/408627207' entity='mgr.x' 2024-09-12T02:30:58.350 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 02:30:57 smithi039 ceph-mon[30515]: from='mgr.14150 172.21.15.39:0/408627207' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-12T02:30:58.350 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 02:30:57 smithi039 ceph-mon[30515]: from='mgr.14150 172.21.15.39:0/408627207' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-12T02:30:58.350 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 02:30:57 smithi039 ceph-mon[30515]: from='mgr.14150 172.21.15.39:0/408627207' entity='mgr.x' 2024-09-12T02:30:59.026 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 12 02:30:58 smithi044 ceph-mon[35411]: from='mgr.14150 172.21.15.39:0/408627207' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-12T02:30:59.026 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 12 02:30:58 smithi044 ceph-mon[35411]: from='mgr.14150 172.21.15.39:0/408627207' entity='mgr.x' 2024-09-12T02:30:59.026 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 12 02:30:58 smithi044 ceph-mon[35411]: from='mgr.14150 172.21.15.39:0/408627207' entity='mgr.x' 2024-09-12T02:30:59.055 DEBUG:teuthology.orchestra.run.smithi044:osd.4> sudo journalctl -f -n 0 -u ceph-4954ed46-70ae-11ef-bcea-c7b262605968@osd.4.service 2024-09-12T02:30:59.057 INFO:tasks.cephadm:Deploying osd.5 on smithi172 with /dev/vg_nvme/lv_3... 2024-09-12T02:30:59.058 DEBUG:teuthology.orchestra.run.smithi172:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc ceph-volume -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 4954ed46-70ae-11ef-bcea-c7b262605968 -- lvm zap /dev/vg_nvme/lv_3 2024-09-12T02:30:59.263 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 12 02:30:58 smithi172 ceph-mon[35609]: from='mgr.14150 172.21.15.39:0/408627207' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-12T02:30:59.263 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 12 02:30:58 smithi172 ceph-mon[35609]: from='mgr.14150 172.21.15.39:0/408627207' entity='mgr.x' 2024-09-12T02:30:59.263 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 12 02:30:58 smithi172 ceph-mon[35609]: from='mgr.14150 172.21.15.39:0/408627207' entity='mgr.x' 2024-09-12T02:30:59.314 INFO:teuthology.orchestra.run.smithi172.stderr:Inferring config /var/lib/ceph/4954ed46-70ae-11ef-bcea-c7b262605968/mon.c/config 2024-09-12T02:30:59.349 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 02:30:58 smithi039 ceph-mon[30515]: from='mgr.14150 172.21.15.39:0/408627207' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-12T02:30:59.349 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 02:30:58 smithi039 ceph-mon[30515]: from='mgr.14150 172.21.15.39:0/408627207' entity='mgr.x' 2024-09-12T02:30:59.350 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 02:30:58 smithi039 ceph-mon[30515]: from='mgr.14150 172.21.15.39:0/408627207' entity='mgr.x' 2024-09-12T02:31:00.172 INFO:journalctl@ceph.osd.4.smithi044.stdout:Sep 12 02:30:59 smithi044 ceph-4954ed46-70ae-11ef-bcea-c7b262605968-osd-4[46474]: 2024-09-12T02:30:59.896+0000 7f7610971640 -1 osd.4 0 log_to_monitors true 2024-09-12T02:31:00.396 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 12 02:31:00 smithi172 ceph-mon[35609]: pgmap v117: 1 pgs: 1 active+clean; 577 KiB data, 116 MiB used, 357 GiB / 358 GiB avail 2024-09-12T02:31:00.396 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 12 02:31:00 smithi172 ceph-mon[35609]: from='osd.4 [v2:172.21.15.44:6808/3663639110,v1:172.21.15.44:6809/3663639110]' entity='osd.4' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["4"]}]: dispatch 2024-09-12T02:31:00.396 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 12 02:31:00 smithi172 ceph-mon[35609]: from='osd.4 ' entity='osd.4' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["4"]}]: dispatch 2024-09-12T02:31:00.426 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 12 02:31:00 smithi044 ceph-mon[35411]: pgmap v117: 1 pgs: 1 active+clean; 577 KiB data, 116 MiB used, 357 GiB / 358 GiB avail 2024-09-12T02:31:00.426 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 12 02:31:00 smithi044 ceph-mon[35411]: from='osd.4 [v2:172.21.15.44:6808/3663639110,v1:172.21.15.44:6809/3663639110]' entity='osd.4' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["4"]}]: dispatch 2024-09-12T02:31:00.426 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 12 02:31:00 smithi044 ceph-mon[35411]: from='osd.4 ' entity='osd.4' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["4"]}]: dispatch 2024-09-12T02:31:00.599 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 02:31:00 smithi039 ceph-mon[30515]: pgmap v117: 1 pgs: 1 active+clean; 577 KiB data, 116 MiB used, 357 GiB / 358 GiB avail 2024-09-12T02:31:00.600 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 02:31:00 smithi039 ceph-mon[30515]: from='osd.4 [v2:172.21.15.44:6808/3663639110,v1:172.21.15.44:6809/3663639110]' entity='osd.4' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["4"]}]: dispatch 2024-09-12T02:31:00.600 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 02:31:00 smithi039 ceph-mon[30515]: from='osd.4 ' entity='osd.4' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["4"]}]: dispatch 2024-09-12T02:31:01.442 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 12 02:31:01 smithi044 ceph-mon[35411]: from='osd.4 ' entity='osd.4' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["4"]}]': finished 2024-09-12T02:31:01.442 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 12 02:31:01 smithi044 ceph-mon[35411]: from='osd.4 [v2:172.21.15.44:6808/3663639110,v1:172.21.15.44:6809/3663639110]' entity='osd.4' cmd=[{"prefix": "osd crush create-or-move", "id": 4, "weight":0.0873, "args": ["host=smithi044", "root=default"]}]: dispatch 2024-09-12T02:31:01.442 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 12 02:31:01 smithi044 ceph-mon[35411]: osdmap e31: 5 total, 4 up, 5 in 2024-09-12T02:31:01.442 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 12 02:31:01 smithi044 ceph-mon[35411]: from='mgr.14150 172.21.15.39:0/408627207' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-09-12T02:31:01.442 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 12 02:31:01 smithi044 ceph-mon[35411]: from='osd.4 ' entity='osd.4' cmd=[{"prefix": "osd crush create-or-move", "id": 4, "weight":0.0873, "args": ["host=smithi044", "root=default"]}]: dispatch 2024-09-12T02:31:01.443 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 12 02:31:01 smithi044 ceph-mon[35411]: from='osd.4 ' entity='osd.4' cmd='[{"prefix": "osd crush create-or-move", "id": 4, "weight":0.0873, "args": ["host=smithi044", "root=default"]}]': finished 2024-09-12T02:31:01.443 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 12 02:31:01 smithi044 ceph-mon[35411]: osdmap e32: 5 total, 4 up, 5 in 2024-09-12T02:31:01.443 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 12 02:31:01 smithi044 ceph-mon[35411]: from='mgr.14150 172.21.15.39:0/408627207' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-09-12T02:31:01.599 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 02:31:01 smithi039 ceph-mon[30515]: from='osd.4 ' entity='osd.4' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["4"]}]': finished 2024-09-12T02:31:01.600 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 02:31:01 smithi039 ceph-mon[30515]: from='osd.4 [v2:172.21.15.44:6808/3663639110,v1:172.21.15.44:6809/3663639110]' entity='osd.4' cmd=[{"prefix": "osd crush create-or-move", "id": 4, "weight":0.0873, "args": ["host=smithi044", "root=default"]}]: dispatch 2024-09-12T02:31:01.600 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 02:31:01 smithi039 ceph-mon[30515]: osdmap e31: 5 total, 4 up, 5 in 2024-09-12T02:31:01.600 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 02:31:01 smithi039 ceph-mon[30515]: from='mgr.14150 172.21.15.39:0/408627207' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-09-12T02:31:01.600 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 02:31:01 smithi039 ceph-mon[30515]: from='osd.4 ' entity='osd.4' cmd=[{"prefix": "osd crush create-or-move", "id": 4, "weight":0.0873, "args": ["host=smithi044", "root=default"]}]: dispatch 2024-09-12T02:31:01.600 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 02:31:01 smithi039 ceph-mon[30515]: from='osd.4 ' entity='osd.4' cmd='[{"prefix": "osd crush create-or-move", "id": 4, "weight":0.0873, "args": ["host=smithi044", "root=default"]}]': finished 2024-09-12T02:31:01.600 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 02:31:01 smithi039 ceph-mon[30515]: osdmap e32: 5 total, 4 up, 5 in 2024-09-12T02:31:01.600 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 02:31:01 smithi039 ceph-mon[30515]: from='mgr.14150 172.21.15.39:0/408627207' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-09-12T02:31:01.607 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 12 02:31:01 smithi172 ceph-mon[35609]: from='osd.4 ' entity='osd.4' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["4"]}]': finished 2024-09-12T02:31:01.607 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 12 02:31:01 smithi172 ceph-mon[35609]: from='osd.4 [v2:172.21.15.44:6808/3663639110,v1:172.21.15.44:6809/3663639110]' entity='osd.4' cmd=[{"prefix": "osd crush create-or-move", "id": 4, "weight":0.0873, "args": ["host=smithi044", "root=default"]}]: dispatch 2024-09-12T02:31:01.607 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 12 02:31:01 smithi172 ceph-mon[35609]: osdmap e31: 5 total, 4 up, 5 in 2024-09-12T02:31:01.608 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 12 02:31:01 smithi172 ceph-mon[35609]: from='mgr.14150 172.21.15.39:0/408627207' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-09-12T02:31:01.608 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 12 02:31:01 smithi172 ceph-mon[35609]: from='osd.4 ' entity='osd.4' cmd=[{"prefix": "osd crush create-or-move", "id": 4, "weight":0.0873, "args": ["host=smithi044", "root=default"]}]: dispatch 2024-09-12T02:31:01.608 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 12 02:31:01 smithi172 ceph-mon[35609]: from='osd.4 ' entity='osd.4' cmd='[{"prefix": "osd crush create-or-move", "id": 4, "weight":0.0873, "args": ["host=smithi044", "root=default"]}]': finished 2024-09-12T02:31:01.608 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 12 02:31:01 smithi172 ceph-mon[35609]: osdmap e32: 5 total, 4 up, 5 in 2024-09-12T02:31:01.608 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 12 02:31:01 smithi172 ceph-mon[35609]: from='mgr.14150 172.21.15.39:0/408627207' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-09-12T02:31:01.799 INFO:teuthology.orchestra.run.smithi172.stdout: 2024-09-12T02:31:01.824 DEBUG:teuthology.orchestra.run.smithi172:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 4954ed46-70ae-11ef-bcea-c7b262605968 -- ceph orch daemon add osd smithi172:vg_nvme/lv_3 2024-09-12T02:31:02.077 INFO:teuthology.orchestra.run.smithi172.stderr:Inferring config /var/lib/ceph/4954ed46-70ae-11ef-bcea-c7b262605968/mon.c/config 2024-09-12T02:31:02.198 INFO:journalctl@ceph.osd.4.smithi044.stdout:Sep 12 02:31:01 smithi044 ceph-4954ed46-70ae-11ef-bcea-c7b262605968-osd-4[46474]: 2024-09-12T02:31:01.945+0000 7f760c8f4640 -1 osd.4 0 waiting for initial osdmap 2024-09-12T02:31:02.198 INFO:journalctl@ceph.osd.4.smithi044.stdout:Sep 12 02:31:01 smithi044 ceph-4954ed46-70ae-11ef-bcea-c7b262605968-osd-4[46474]: 2024-09-12T02:31:01.953+0000 7f7604714640 -1 osd.4 32 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-09-12T02:31:02.474 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 12 02:31:02 smithi172 ceph-mon[35609]: pgmap v119: 1 pgs: 1 active+clean; 577 KiB data, 116 MiB used, 357 GiB / 358 GiB avail 2024-09-12T02:31:02.474 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 12 02:31:02 smithi172 ceph-mon[35609]: from='mgr.14150 172.21.15.39:0/408627207' entity='mgr.x' 2024-09-12T02:31:02.474 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 12 02:31:02 smithi172 ceph-mon[35609]: from='mgr.14150 172.21.15.39:0/408627207' entity='mgr.x' 2024-09-12T02:31:02.475 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 12 02:31:02 smithi172 ceph-mon[35609]: from='mgr.14150 172.21.15.39:0/408627207' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2024-09-12T02:31:02.475 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 12 02:31:02 smithi172 ceph-mon[35609]: from='mgr.14150 172.21.15.39:0/408627207' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2024-09-12T02:31:02.475 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 12 02:31:02 smithi172 ceph-mon[35609]: from='mgr.14150 172.21.15.39:0/408627207' entity='mgr.x' 2024-09-12T02:31:02.475 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 12 02:31:02 smithi172 ceph-mon[35609]: from='mgr.14150 172.21.15.39:0/408627207' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-12T02:31:02.475 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 12 02:31:02 smithi172 ceph-mon[35609]: from='mgr.14150 172.21.15.39:0/408627207' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-12T02:31:02.475 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 12 02:31:02 smithi172 ceph-mon[35609]: from='mgr.14150 172.21.15.39:0/408627207' entity='mgr.x' 2024-09-12T02:31:02.475 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 12 02:31:02 smithi172 ceph-mon[35609]: from='osd.4 ' entity='osd.4' 2024-09-12T02:31:02.475 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 12 02:31:02 smithi172 ceph-mon[35609]: from='mgr.14150 172.21.15.39:0/408627207' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-09-12T02:31:02.559 INFO:teuthology.orchestra.run.smithi172.stderr:2024-09-12T02:31:02.557+0000 7f2e6e0dd640 1 -- 172.21.15.172:0/3052669542 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f2e68101cd0 msgr2=0x7f2e68102150 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:31:02.560 INFO:teuthology.orchestra.run.smithi172.stderr:2024-09-12T02:31:02.557+0000 7f2e6e0dd640 1 --2- 172.21.15.172:0/3052669542 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f2e68101cd0 0x7f2e68102150 secure :-1 s=READY pgs=22 cs=0 l=1 rev1=1 crypto rx=0x7f2e50009900 tx=0x7f2e5002a410 comp rx=0 tx=0).stop 2024-09-12T02:31:02.560 INFO:teuthology.orchestra.run.smithi172.stderr:2024-09-12T02:31:02.557+0000 7f2e6e0dd640 1 -- 172.21.15.172:0/3052669542 shutdown_connections 2024-09-12T02:31:02.560 INFO:teuthology.orchestra.run.smithi172.stderr:2024-09-12T02:31:02.557+0000 7f2e6e0dd640 1 --2- 172.21.15.172:0/3052669542 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f2e68102690 0x7f2e68108f20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:31:02.560 INFO:teuthology.orchestra.run.smithi172.stderr:2024-09-12T02:31:02.557+0000 7f2e6e0dd640 1 --2- 172.21.15.172:0/3052669542 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f2e68101cd0 0x7f2e68102150 unknown :-1 s=CLOSED pgs=22 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:31:02.560 INFO:teuthology.orchestra.run.smithi172.stderr:2024-09-12T02:31:02.557+0000 7f2e6e0dd640 1 --2- 172.21.15.172:0/3052669542 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f2e68100ad0 0x7f2e68100ed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:31:02.560 INFO:teuthology.orchestra.run.smithi172.stderr:2024-09-12T02:31:02.557+0000 7f2e6e0dd640 1 -- 172.21.15.172:0/3052669542 >> 172.21.15.172:0/3052669542 conn(0x7f2e680fc280 msgr2=0x7f2e680fe6a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:31:02.560 INFO:teuthology.orchestra.run.smithi172.stderr:2024-09-12T02:31:02.557+0000 7f2e6e0dd640 1 -- 172.21.15.172:0/3052669542 shutdown_connections 2024-09-12T02:31:02.560 INFO:teuthology.orchestra.run.smithi172.stderr:2024-09-12T02:31:02.557+0000 7f2e6e0dd640 1 -- 172.21.15.172:0/3052669542 wait complete. 2024-09-12T02:31:02.560 INFO:teuthology.orchestra.run.smithi172.stderr:2024-09-12T02:31:02.557+0000 7f2e6e0dd640 1 Processor -- start 2024-09-12T02:31:02.560 INFO:teuthology.orchestra.run.smithi172.stderr:2024-09-12T02:31:02.557+0000 7f2e6e0dd640 1 -- start start 2024-09-12T02:31:02.561 INFO:teuthology.orchestra.run.smithi172.stderr:2024-09-12T02:31:02.558+0000 7f2e6e0dd640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f2e68100ad0 0x7f2e68196e10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:31:02.561 INFO:teuthology.orchestra.run.smithi172.stderr:2024-09-12T02:31:02.558+0000 7f2e6e0dd640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f2e68101cd0 0x7f2e68197350 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:31:02.561 INFO:teuthology.orchestra.run.smithi172.stderr:2024-09-12T02:31:02.558+0000 7f2e6e0dd640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f2e68102690 0x7f2e6819e3d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:31:02.561 INFO:teuthology.orchestra.run.smithi172.stderr:2024-09-12T02:31:02.558+0000 7f2e6e0dd640 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 -- 0x7f2e6810c750 con 0x7f2e68102690 2024-09-12T02:31:02.561 INFO:teuthology.orchestra.run.smithi172.stderr:2024-09-12T02:31:02.558+0000 7f2e6e0dd640 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x7f2e6810c5d0 con 0x7f2e68101cd0 2024-09-12T02:31:02.561 INFO:teuthology.orchestra.run.smithi172.stderr:2024-09-12T02:31:02.558+0000 7f2e6e0dd640 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7f2e6810c8d0 con 0x7f2e68100ad0 2024-09-12T02:31:02.561 INFO:teuthology.orchestra.run.smithi172.stderr:2024-09-12T02:31:02.558+0000 7f2e677fe640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f2e68100ad0 0x7f2e68196e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:31:02.561 INFO:teuthology.orchestra.run.smithi172.stderr:2024-09-12T02:31:02.558+0000 7f2e677fe640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f2e68100ad0 0x7f2e68196e10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.172:3300/0 says I am v2:172.21.15.172:57006/0 (socket says 172.21.15.172:57006) 2024-09-12T02:31:02.561 INFO:teuthology.orchestra.run.smithi172.stderr:2024-09-12T02:31:02.558+0000 7f2e677fe640 1 -- 172.21.15.172:0/3373822559 learned_addr learned my addr 172.21.15.172:0/3373822559 (peer_addr_for_me v2:172.21.15.172:0/0) 2024-09-12T02:31:02.561 INFO:teuthology.orchestra.run.smithi172.stderr:2024-09-12T02:31:02.558+0000 7f2e5effd640 1 --2- 172.21.15.172:0/3373822559 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f2e68101cd0 0x7f2e68197350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:31:02.561 INFO:teuthology.orchestra.run.smithi172.stderr:2024-09-12T02:31:02.558+0000 7f2e677fe640 1 -- 172.21.15.172:0/3373822559 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f2e68101cd0 msgr2=0x7f2e68197350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:31:02.561 INFO:teuthology.orchestra.run.smithi172.stderr:2024-09-12T02:31:02.558+0000 7f2e67fff640 1 --2- 172.21.15.172:0/3373822559 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f2e68102690 0x7f2e6819e3d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:31:02.562 INFO:teuthology.orchestra.run.smithi172.stderr:2024-09-12T02:31:02.558+0000 7f2e677fe640 1 --2- 172.21.15.172:0/3373822559 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f2e68101cd0 0x7f2e68197350 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:31:02.562 INFO:teuthology.orchestra.run.smithi172.stderr:2024-09-12T02:31:02.558+0000 7f2e677fe640 1 -- 172.21.15.172:0/3373822559 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f2e68102690 msgr2=0x7f2e6819e3d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:31:02.562 INFO:teuthology.orchestra.run.smithi172.stderr:2024-09-12T02:31:02.558+0000 7f2e677fe640 1 --2- 172.21.15.172:0/3373822559 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f2e68102690 0x7f2e6819e3d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:31:02.562 INFO:teuthology.orchestra.run.smithi172.stderr:2024-09-12T02:31:02.558+0000 7f2e677fe640 1 -- 172.21.15.172:0/3373822559 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2e6819ea40 con 0x7f2e68100ad0 2024-09-12T02:31:02.562 INFO:teuthology.orchestra.run.smithi172.stderr:2024-09-12T02:31:02.558+0000 7f2e67fff640 1 --2- 172.21.15.172:0/3373822559 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f2e68102690 0x7f2e6819e3d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-12T02:31:02.562 INFO:teuthology.orchestra.run.smithi172.stderr:2024-09-12T02:31:02.558+0000 7f2e677fe640 1 --2- 172.21.15.172:0/3373822559 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f2e68100ad0 0x7f2e68196e10 secure :-1 s=READY pgs=23 cs=0 l=1 rev1=1 crypto rx=0x7f2e5800e9c0 tx=0x7f2e5800ee80 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:31:02.562 INFO:teuthology.orchestra.run.smithi172.stderr:2024-09-12T02:31:02.558+0000 7f2e657fa640 1 -- 172.21.15.172:0/3373822559 <== mon.1 v2:172.21.15.172:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2e5800cd80 con 0x7f2e68100ad0 2024-09-12T02:31:02.562 INFO:teuthology.orchestra.run.smithi172.stderr:2024-09-12T02:31:02.559+0000 7f2e657fa640 1 -- 172.21.15.172:0/3373822559 <== mon.1 v2:172.21.15.172:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f2e580035f0 con 0x7f2e68100ad0 2024-09-12T02:31:02.562 INFO:teuthology.orchestra.run.smithi172.stderr:2024-09-12T02:31:02.559+0000 7f2e6e0dd640 1 -- 172.21.15.172:0/3373822559 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f2e6819ed30 con 0x7f2e68100ad0 2024-09-12T02:31:02.562 INFO:teuthology.orchestra.run.smithi172.stderr:2024-09-12T02:31:02.559+0000 7f2e657fa640 1 -- 172.21.15.172:0/3373822559 <== mon.1 v2:172.21.15.172:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2e58010690 con 0x7f2e68100ad0 2024-09-12T02:31:02.562 INFO:teuthology.orchestra.run.smithi172.stderr:2024-09-12T02:31:02.559+0000 7f2e6e0dd640 1 -- 172.21.15.172:0/3373822559 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f2e6819f190 con 0x7f2e68100ad0 2024-09-12T02:31:02.563 INFO:teuthology.orchestra.run.smithi172.stderr:2024-09-12T02:31:02.560+0000 7f2e6e0dd640 1 -- 172.21.15.172:0/3373822559 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f2e68107f40 con 0x7f2e68100ad0 2024-09-12T02:31:02.563 INFO:teuthology.orchestra.run.smithi172.stderr:2024-09-12T02:31:02.561+0000 7f2e657fa640 1 -- 172.21.15.172:0/3373822559 <== mon.1 v2:172.21.15.172:3300/0 4 ==== mgrmap(e 16) ==== 137833+0+0 (secure 0 0 0) 0x7f2e580037a0 con 0x7f2e68100ad0 2024-09-12T02:31:02.563 INFO:teuthology.orchestra.run.smithi172.stderr:2024-09-12T02:31:02.562+0000 7f2e657fa640 1 --2- 172.21.15.172:0/3373822559 >> [v2:172.21.15.39:6800/1725006999,v1:172.21.15.39:6801/1725006999] conn(0x7f2e540a2bb0 0x7f2e540a5070 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:31:02.563 INFO:teuthology.orchestra.run.smithi172.stderr:2024-09-12T02:31:02.562+0000 7f2e657fa640 1 -- 172.21.15.172:0/3373822559 <== mon.1 v2:172.21.15.172:3300/0 5 ==== osd_map(32..32 src has 1..32) ==== 3821+0+0 (secure 0 0 0) 0x7f2e580ce290 con 0x7f2e68100ad0 2024-09-12T02:31:02.564 INFO:teuthology.orchestra.run.smithi172.stderr:2024-09-12T02:31:02.562+0000 7f2e5effd640 1 --2- 172.21.15.172:0/3373822559 >> [v2:172.21.15.39:6800/1725006999,v1:172.21.15.39:6801/1725006999] conn(0x7f2e540a2bb0 0x7f2e540a5070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:31:02.564 INFO:teuthology.orchestra.run.smithi172.stderr:2024-09-12T02:31:02.563+0000 7f2e5effd640 1 --2- 172.21.15.172:0/3373822559 >> [v2:172.21.15.39:6800/1725006999,v1:172.21.15.39:6801/1725006999] conn(0x7f2e540a2bb0 0x7f2e540a5070 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7f2e500314e0 tx=0x7f2e50000bc0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:31:02.567 INFO:teuthology.orchestra.run.smithi172.stderr:2024-09-12T02:31:02.566+0000 7f2e657fa640 1 -- 172.21.15.172:0/3373822559 <== mon.1 v2:172.21.15.172:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7f2e5809c380 con 0x7f2e68100ad0 2024-09-12T02:31:02.600 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 02:31:02 smithi039 ceph-mon[30515]: pgmap v119: 1 pgs: 1 active+clean; 577 KiB data, 116 MiB used, 357 GiB / 358 GiB avail 2024-09-12T02:31:02.600 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 02:31:02 smithi039 ceph-mon[30515]: from='mgr.14150 172.21.15.39:0/408627207' entity='mgr.x' 2024-09-12T02:31:02.600 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 02:31:02 smithi039 ceph-mon[30515]: from='mgr.14150 172.21.15.39:0/408627207' entity='mgr.x' 2024-09-12T02:31:02.600 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 02:31:02 smithi039 ceph-mon[30515]: from='mgr.14150 172.21.15.39:0/408627207' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2024-09-12T02:31:02.600 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 02:31:02 smithi039 ceph-mon[30515]: from='mgr.14150 172.21.15.39:0/408627207' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2024-09-12T02:31:02.600 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 02:31:02 smithi039 ceph-mon[30515]: from='mgr.14150 172.21.15.39:0/408627207' entity='mgr.x' 2024-09-12T02:31:02.600 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 02:31:02 smithi039 ceph-mon[30515]: from='mgr.14150 172.21.15.39:0/408627207' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-12T02:31:02.600 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 02:31:02 smithi039 ceph-mon[30515]: from='mgr.14150 172.21.15.39:0/408627207' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-12T02:31:02.600 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 02:31:02 smithi039 ceph-mon[30515]: from='mgr.14150 172.21.15.39:0/408627207' entity='mgr.x' 2024-09-12T02:31:02.600 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 02:31:02 smithi039 ceph-mon[30515]: from='osd.4 ' entity='osd.4' 2024-09-12T02:31:02.600 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 02:31:02 smithi039 ceph-mon[30515]: from='mgr.14150 172.21.15.39:0/408627207' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-09-12T02:31:02.698 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 12 02:31:02 smithi044 ceph-mon[35411]: pgmap v119: 1 pgs: 1 active+clean; 577 KiB data, 116 MiB used, 357 GiB / 358 GiB avail 2024-09-12T02:31:02.699 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 12 02:31:02 smithi044 ceph-mon[35411]: from='mgr.14150 172.21.15.39:0/408627207' entity='mgr.x' 2024-09-12T02:31:02.699 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 12 02:31:02 smithi044 ceph-mon[35411]: from='mgr.14150 172.21.15.39:0/408627207' entity='mgr.x' 2024-09-12T02:31:02.699 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 12 02:31:02 smithi044 ceph-mon[35411]: from='mgr.14150 172.21.15.39:0/408627207' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2024-09-12T02:31:02.699 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 12 02:31:02 smithi044 ceph-mon[35411]: from='mgr.14150 172.21.15.39:0/408627207' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2024-09-12T02:31:02.699 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 12 02:31:02 smithi044 ceph-mon[35411]: from='mgr.14150 172.21.15.39:0/408627207' entity='mgr.x' 2024-09-12T02:31:02.699 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 12 02:31:02 smithi044 ceph-mon[35411]: from='mgr.14150 172.21.15.39:0/408627207' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-12T02:31:02.699 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 12 02:31:02 smithi044 ceph-mon[35411]: from='mgr.14150 172.21.15.39:0/408627207' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-12T02:31:02.699 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 12 02:31:02 smithi044 ceph-mon[35411]: from='mgr.14150 172.21.15.39:0/408627207' entity='mgr.x' 2024-09-12T02:31:02.699 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 12 02:31:02 smithi044 ceph-mon[35411]: from='osd.4 ' entity='osd.4' 2024-09-12T02:31:02.699 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 12 02:31:02 smithi044 ceph-mon[35411]: from='mgr.14150 172.21.15.39:0/408627207' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-09-12T02:31:02.741 INFO:teuthology.orchestra.run.smithi172.stderr:2024-09-12T02:31:02.741+0000 7f2e6e0dd640 1 -- 172.21.15.172:0/3373822559 --> [v2:172.21.15.39:6800/1725006999,v1:172.21.15.39:6801/1725006999] -- mgr_command(tid 0: {"prefix": "orch daemon add osd", "svc_arg": "smithi172:vg_nvme/lv_3", "target": ["mon-mgr", ""]}) -- 0x7f2e68062630 con 0x7f2e540a2bb0 2024-09-12T02:31:03.406 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 12 02:31:03 smithi172 ceph-mon[35609]: purged_snaps scrub starts 2024-09-12T02:31:03.406 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 12 02:31:03 smithi172 ceph-mon[35609]: purged_snaps scrub ok 2024-09-12T02:31:03.406 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 12 02:31:03 smithi172 ceph-mon[35609]: Detected new or changed devices on smithi044 2024-09-12T02:31:03.406 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 12 02:31:03 smithi172 ceph-mon[35609]: Adjusting osd_memory_target on smithi044 to 8546M 2024-09-12T02:31:03.406 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 12 02:31:03 smithi172 ceph-mon[35609]: from='mgr.14150 172.21.15.39:0/408627207' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-09-12T02:31:03.406 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 12 02:31:03 smithi172 ceph-mon[35609]: from='mgr.14150 172.21.15.39:0/408627207' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-09-12T02:31:03.406 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 12 02:31:03 smithi172 ceph-mon[35609]: from='mgr.14150 172.21.15.39:0/408627207' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-12T02:31:03.406 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 12 02:31:03 smithi172 ceph-mon[35609]: osd.4 [v2:172.21.15.44:6808/3663639110,v1:172.21.15.44:6809/3663639110] boot 2024-09-12T02:31:03.406 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 12 02:31:03 smithi172 ceph-mon[35609]: osdmap e33: 5 total, 5 up, 5 in 2024-09-12T02:31:03.406 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 12 02:31:03 smithi172 ceph-mon[35609]: from='mgr.14150 172.21.15.39:0/408627207' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-09-12T02:31:03.600 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 02:31:03 smithi039 ceph-mon[30515]: purged_snaps scrub starts 2024-09-12T02:31:03.600 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 02:31:03 smithi039 ceph-mon[30515]: purged_snaps scrub ok 2024-09-12T02:31:03.600 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 02:31:03 smithi039 ceph-mon[30515]: Detected new or changed devices on smithi044 2024-09-12T02:31:03.600 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 02:31:03 smithi039 ceph-mon[30515]: Adjusting osd_memory_target on smithi044 to 8546M 2024-09-12T02:31:03.600 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 02:31:03 smithi039 ceph-mon[30515]: from='mgr.14150 172.21.15.39:0/408627207' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-09-12T02:31:03.600 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 02:31:03 smithi039 ceph-mon[30515]: from='mgr.14150 172.21.15.39:0/408627207' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-09-12T02:31:03.600 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 02:31:03 smithi039 ceph-mon[30515]: from='mgr.14150 172.21.15.39:0/408627207' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-12T02:31:03.600 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 02:31:03 smithi039 ceph-mon[30515]: osd.4 [v2:172.21.15.44:6808/3663639110,v1:172.21.15.44:6809/3663639110] boot 2024-09-12T02:31:03.600 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 02:31:03 smithi039 ceph-mon[30515]: osdmap e33: 5 total, 5 up, 5 in 2024-09-12T02:31:03.601 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 02:31:03 smithi039 ceph-mon[30515]: from='mgr.14150 172.21.15.39:0/408627207' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-09-12T02:31:03.698 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 12 02:31:03 smithi044 ceph-mon[35411]: purged_snaps scrub starts 2024-09-12T02:31:03.699 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 12 02:31:03 smithi044 ceph-mon[35411]: purged_snaps scrub ok 2024-09-12T02:31:03.699 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 12 02:31:03 smithi044 ceph-mon[35411]: Detected new or changed devices on smithi044 2024-09-12T02:31:03.699 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 12 02:31:03 smithi044 ceph-mon[35411]: Adjusting osd_memory_target on smithi044 to 8546M 2024-09-12T02:31:03.699 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 12 02:31:03 smithi044 ceph-mon[35411]: from='mgr.14150 172.21.15.39:0/408627207' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-09-12T02:31:03.699 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 12 02:31:03 smithi044 ceph-mon[35411]: from='mgr.14150 172.21.15.39:0/408627207' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-09-12T02:31:03.699 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 12 02:31:03 smithi044 ceph-mon[35411]: from='mgr.14150 172.21.15.39:0/408627207' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-12T02:31:03.699 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 12 02:31:03 smithi044 ceph-mon[35411]: osd.4 [v2:172.21.15.44:6808/3663639110,v1:172.21.15.44:6809/3663639110] boot 2024-09-12T02:31:03.699 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 12 02:31:03 smithi044 ceph-mon[35411]: osdmap e33: 5 total, 5 up, 5 in 2024-09-12T02:31:03.699 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 12 02:31:03 smithi044 ceph-mon[35411]: from='mgr.14150 172.21.15.39:0/408627207' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-09-12T02:31:04.370 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 12 02:31:04 smithi172 ceph-mon[35609]: from='client.24238 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi172:vg_nvme/lv_3", "target": ["mon-mgr", ""]}]: dispatch 2024-09-12T02:31:04.371 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 12 02:31:04 smithi172 ceph-mon[35609]: pgmap v121: 1 pgs: 1 active+clean; 577 KiB data, 116 MiB used, 357 GiB / 358 GiB avail 2024-09-12T02:31:04.371 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 12 02:31:04 smithi172 ceph-mon[35609]: osdmap e34: 5 total, 5 up, 5 in 2024-09-12T02:31:04.599 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 02:31:04 smithi039 ceph-mon[30515]: from='client.24238 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi172:vg_nvme/lv_3", "target": ["mon-mgr", ""]}]: dispatch 2024-09-12T02:31:04.600 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 02:31:04 smithi039 ceph-mon[30515]: pgmap v121: 1 pgs: 1 active+clean; 577 KiB data, 116 MiB used, 357 GiB / 358 GiB avail 2024-09-12T02:31:04.600 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 02:31:04 smithi039 ceph-mon[30515]: osdmap e34: 5 total, 5 up, 5 in 2024-09-12T02:31:04.698 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 12 02:31:04 smithi044 ceph-mon[35411]: from='client.24238 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi172:vg_nvme/lv_3", "target": ["mon-mgr", ""]}]: dispatch 2024-09-12T02:31:04.698 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 12 02:31:04 smithi044 ceph-mon[35411]: pgmap v121: 1 pgs: 1 active+clean; 577 KiB data, 116 MiB used, 357 GiB / 358 GiB avail 2024-09-12T02:31:04.699 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 12 02:31:04 smithi044 ceph-mon[35411]: osdmap e34: 5 total, 5 up, 5 in 2024-09-12T02:31:05.600 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 02:31:05 smithi039 ceph-mon[30515]: from='client.? 172.21.15.172:0/3282502541' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "9c907c92-b323-48e7-99ad-ec9756d26312"}]: dispatch 2024-09-12T02:31:05.600 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 02:31:05 smithi039 ceph-mon[30515]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "9c907c92-b323-48e7-99ad-ec9756d26312"}]: dispatch 2024-09-12T02:31:05.600 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 02:31:05 smithi039 ceph-mon[30515]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "9c907c92-b323-48e7-99ad-ec9756d26312"}]': finished 2024-09-12T02:31:05.600 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 02:31:05 smithi039 ceph-mon[30515]: osdmap e35: 6 total, 5 up, 6 in 2024-09-12T02:31:05.600 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 02:31:05 smithi039 ceph-mon[30515]: from='mgr.14150 172.21.15.39:0/408627207' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-09-12T02:31:05.641 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 12 02:31:05 smithi172 ceph-mon[35609]: from='client.? 172.21.15.172:0/3282502541' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "9c907c92-b323-48e7-99ad-ec9756d26312"}]: dispatch 2024-09-12T02:31:05.641 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 12 02:31:05 smithi172 ceph-mon[35609]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "9c907c92-b323-48e7-99ad-ec9756d26312"}]: dispatch 2024-09-12T02:31:05.641 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 12 02:31:05 smithi172 ceph-mon[35609]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "9c907c92-b323-48e7-99ad-ec9756d26312"}]': finished 2024-09-12T02:31:05.642 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 12 02:31:05 smithi172 ceph-mon[35609]: osdmap e35: 6 total, 5 up, 6 in 2024-09-12T02:31:05.642 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 12 02:31:05 smithi172 ceph-mon[35609]: from='mgr.14150 172.21.15.39:0/408627207' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-09-12T02:31:05.698 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 12 02:31:05 smithi044 ceph-mon[35411]: from='client.? 172.21.15.172:0/3282502541' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "9c907c92-b323-48e7-99ad-ec9756d26312"}]: dispatch 2024-09-12T02:31:05.698 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 12 02:31:05 smithi044 ceph-mon[35411]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "9c907c92-b323-48e7-99ad-ec9756d26312"}]: dispatch 2024-09-12T02:31:05.698 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 12 02:31:05 smithi044 ceph-mon[35411]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "9c907c92-b323-48e7-99ad-ec9756d26312"}]': finished 2024-09-12T02:31:05.698 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 12 02:31:05 smithi044 ceph-mon[35411]: osdmap e35: 6 total, 5 up, 6 in 2024-09-12T02:31:05.699 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 12 02:31:05 smithi044 ceph-mon[35411]: from='mgr.14150 172.21.15.39:0/408627207' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-09-12T02:31:06.599 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 02:31:06 smithi039 ceph-mon[30515]: pgmap v124: 1 pgs: 1 active+clean; 577 KiB data, 151 MiB used, 447 GiB / 447 GiB avail 2024-09-12T02:31:06.600 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 02:31:06 smithi039 ceph-mon[30515]: from='client.? 172.21.15.172:0/764664696' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-09-12T02:31:06.698 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 12 02:31:06 smithi044 ceph-mon[35411]: pgmap v124: 1 pgs: 1 active+clean; 577 KiB data, 151 MiB used, 447 GiB / 447 GiB avail 2024-09-12T02:31:06.699 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 12 02:31:06 smithi044 ceph-mon[35411]: from='client.? 172.21.15.172:0/764664696' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-09-12T02:31:06.763 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 12 02:31:06 smithi172 ceph-mon[35609]: pgmap v124: 1 pgs: 1 active+clean; 577 KiB data, 151 MiB used, 447 GiB / 447 GiB avail 2024-09-12T02:31:06.763 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 12 02:31:06 smithi172 ceph-mon[35609]: from='client.? 172.21.15.172:0/764664696' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-09-12T02:31:08.599 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 02:31:08 smithi039 ceph-mon[30515]: pgmap v126: 1 pgs: 1 active+clean; 577 KiB data, 151 MiB used, 447 GiB / 447 GiB avail 2024-09-12T02:31:08.698 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 12 02:31:08 smithi044 ceph-mon[35411]: pgmap v126: 1 pgs: 1 active+clean; 577 KiB data, 151 MiB used, 447 GiB / 447 GiB avail 2024-09-12T02:31:08.763 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 12 02:31:08 smithi172 ceph-mon[35609]: pgmap v126: 1 pgs: 1 active+clean; 577 KiB data, 151 MiB used, 447 GiB / 447 GiB avail 2024-09-12T02:31:10.599 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 02:31:10 smithi039 ceph-mon[30515]: pgmap v127: 1 pgs: 1 active+clean; 577 KiB data, 151 MiB used, 447 GiB / 447 GiB avail 2024-09-12T02:31:10.698 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 12 02:31:10 smithi044 ceph-mon[35411]: pgmap v127: 1 pgs: 1 active+clean; 577 KiB data, 151 MiB used, 447 GiB / 447 GiB avail 2024-09-12T02:31:10.763 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 12 02:31:10 smithi172 ceph-mon[35609]: pgmap v127: 1 pgs: 1 active+clean; 577 KiB data, 151 MiB used, 447 GiB / 447 GiB avail 2024-09-12T02:31:12.461 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 12 02:31:12 smithi172 ceph-mon[35609]: pgmap v128: 1 pgs: 1 active+clean; 577 KiB data, 151 MiB used, 447 GiB / 447 GiB avail 2024-09-12T02:31:12.599 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 02:31:12 smithi039 ceph-mon[30515]: pgmap v128: 1 pgs: 1 active+clean; 577 KiB data, 151 MiB used, 447 GiB / 447 GiB avail 2024-09-12T02:31:12.698 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 12 02:31:12 smithi044 ceph-mon[35411]: pgmap v128: 1 pgs: 1 active+clean; 577 KiB data, 151 MiB used, 447 GiB / 447 GiB avail 2024-09-12T02:31:14.513 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 12 02:31:14 smithi172 ceph-mon[35609]: pgmap v129: 1 pgs: 1 active+clean; 577 KiB data, 151 MiB used, 447 GiB / 447 GiB avail 2024-09-12T02:31:14.514 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 12 02:31:14 smithi172 ceph-mon[35609]: from='mgr.14150 172.21.15.39:0/408627207' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.5"}]: dispatch 2024-09-12T02:31:14.514 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 12 02:31:14 smithi172 ceph-mon[35609]: from='mgr.14150 172.21.15.39:0/408627207' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-12T02:31:14.514 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 12 02:31:14 smithi172 ceph-mon[35609]: Deploying daemon osd.5 on smithi172 2024-09-12T02:31:14.599 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 02:31:14 smithi039 ceph-mon[30515]: pgmap v129: 1 pgs: 1 active+clean; 577 KiB data, 151 MiB used, 447 GiB / 447 GiB avail 2024-09-12T02:31:14.600 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 02:31:14 smithi039 ceph-mon[30515]: from='mgr.14150 172.21.15.39:0/408627207' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.5"}]: dispatch 2024-09-12T02:31:14.600 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 02:31:14 smithi039 ceph-mon[30515]: from='mgr.14150 172.21.15.39:0/408627207' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-12T02:31:14.600 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 02:31:14 smithi039 ceph-mon[30515]: Deploying daemon osd.5 on smithi172 2024-09-12T02:31:14.698 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 12 02:31:14 smithi044 ceph-mon[35411]: pgmap v129: 1 pgs: 1 active+clean; 577 KiB data, 151 MiB used, 447 GiB / 447 GiB avail 2024-09-12T02:31:14.698 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 12 02:31:14 smithi044 ceph-mon[35411]: from='mgr.14150 172.21.15.39:0/408627207' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.5"}]: dispatch 2024-09-12T02:31:14.699 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 12 02:31:14 smithi044 ceph-mon[35411]: from='mgr.14150 172.21.15.39:0/408627207' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-12T02:31:14.699 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 12 02:31:14 smithi044 ceph-mon[35411]: Deploying daemon osd.5 on smithi172 2024-09-12T02:31:16.513 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 12 02:31:16 smithi172 ceph-mon[35609]: pgmap v130: 1 pgs: 1 active+clean; 577 KiB data, 151 MiB used, 447 GiB / 447 GiB avail 2024-09-12T02:31:16.599 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 02:31:16 smithi039 ceph-mon[30515]: pgmap v130: 1 pgs: 1 active+clean; 577 KiB data, 151 MiB used, 447 GiB / 447 GiB avail 2024-09-12T02:31:16.698 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 12 02:31:16 smithi044 ceph-mon[35411]: pgmap v130: 1 pgs: 1 active+clean; 577 KiB data, 151 MiB used, 447 GiB / 447 GiB avail 2024-09-12T02:31:18.431 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 12 02:31:18 smithi172 ceph-mon[35609]: pgmap v131: 1 pgs: 1 active+clean; 577 KiB data, 151 MiB used, 447 GiB / 447 GiB avail 2024-09-12T02:31:18.600 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 02:31:18 smithi039 ceph-mon[30515]: pgmap v131: 1 pgs: 1 active+clean; 577 KiB data, 151 MiB used, 447 GiB / 447 GiB avail 2024-09-12T02:31:18.698 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 12 02:31:18 smithi044 ceph-mon[35411]: pgmap v131: 1 pgs: 1 active+clean; 577 KiB data, 151 MiB used, 447 GiB / 447 GiB avail 2024-09-12T02:31:20.698 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 12 02:31:20 smithi044 ceph-mon[35411]: pgmap v132: 1 pgs: 1 active+clean; 577 KiB data, 151 MiB used, 447 GiB / 447 GiB avail 2024-09-12T02:31:20.796 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 12 02:31:20 smithi044 ceph-mon[35411]: from='mgr.14150 172.21.15.39:0/408627207' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-12T02:31:20.796 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 12 02:31:20 smithi044 ceph-mon[35411]: from='mgr.14150 172.21.15.39:0/408627207' entity='mgr.x' 2024-09-12T02:31:20.796 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 12 02:31:20 smithi044 ceph-mon[35411]: from='mgr.14150 172.21.15.39:0/408627207' entity='mgr.x' 2024-09-12T02:31:20.797 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 12 02:31:20 smithi172 ceph-mon[35609]: pgmap v132: 1 pgs: 1 active+clean; 577 KiB data, 151 MiB used, 447 GiB / 447 GiB avail 2024-09-12T02:31:20.797 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 12 02:31:20 smithi172 ceph-mon[35609]: from='mgr.14150 172.21.15.39:0/408627207' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-12T02:31:20.797 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 12 02:31:20 smithi172 ceph-mon[35609]: from='mgr.14150 172.21.15.39:0/408627207' entity='mgr.x' 2024-09-12T02:31:20.797 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 12 02:31:20 smithi172 ceph-mon[35609]: from='mgr.14150 172.21.15.39:0/408627207' entity='mgr.x' 2024-09-12T02:31:20.850 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 02:31:20 smithi039 ceph-mon[30515]: pgmap v132: 1 pgs: 1 active+clean; 577 KiB data, 151 MiB used, 447 GiB / 447 GiB avail 2024-09-12T02:31:20.851 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 02:31:20 smithi039 ceph-mon[30515]: from='mgr.14150 172.21.15.39:0/408627207' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-12T02:31:20.851 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 02:31:20 smithi039 ceph-mon[30515]: from='mgr.14150 172.21.15.39:0/408627207' entity='mgr.x' 2024-09-12T02:31:20.851 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 02:31:20 smithi039 ceph-mon[30515]: from='mgr.14150 172.21.15.39:0/408627207' entity='mgr.x' 2024-09-12T02:31:22.698 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 12 02:31:22 smithi044 ceph-mon[35411]: pgmap v133: 1 pgs: 1 active+clean; 577 KiB data, 151 MiB used, 447 GiB / 447 GiB avail 2024-09-12T02:31:22.699 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 12 02:31:22 smithi044 ceph-mon[35411]: from='mgr.14150 172.21.15.39:0/408627207' entity='mgr.x' 2024-09-12T02:31:22.699 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 12 02:31:22 smithi044 ceph-mon[35411]: from='mgr.14150 172.21.15.39:0/408627207' entity='mgr.x' 2024-09-12T02:31:22.699 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 12 02:31:22 smithi044 ceph-mon[35411]: from='mgr.14150 172.21.15.39:0/408627207' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-12T02:31:22.699 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 12 02:31:22 smithi044 ceph-mon[35411]: from='mgr.14150 172.21.15.39:0/408627207' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-12T02:31:22.700 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 12 02:31:22 smithi044 ceph-mon[35411]: from='mgr.14150 172.21.15.39:0/408627207' entity='mgr.x' 2024-09-12T02:31:22.763 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 12 02:31:22 smithi172 ceph-mon[35609]: pgmap v133: 1 pgs: 1 active+clean; 577 KiB data, 151 MiB used, 447 GiB / 447 GiB avail 2024-09-12T02:31:22.763 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 12 02:31:22 smithi172 ceph-mon[35609]: from='mgr.14150 172.21.15.39:0/408627207' entity='mgr.x' 2024-09-12T02:31:22.763 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 12 02:31:22 smithi172 ceph-mon[35609]: from='mgr.14150 172.21.15.39:0/408627207' entity='mgr.x' 2024-09-12T02:31:22.764 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 12 02:31:22 smithi172 ceph-mon[35609]: from='mgr.14150 172.21.15.39:0/408627207' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-12T02:31:22.764 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 12 02:31:22 smithi172 ceph-mon[35609]: from='mgr.14150 172.21.15.39:0/408627207' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-12T02:31:22.764 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 12 02:31:22 smithi172 ceph-mon[35609]: from='mgr.14150 172.21.15.39:0/408627207' entity='mgr.x' 2024-09-12T02:31:22.850 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 02:31:22 smithi039 ceph-mon[30515]: pgmap v133: 1 pgs: 1 active+clean; 577 KiB data, 151 MiB used, 447 GiB / 447 GiB avail 2024-09-12T02:31:22.850 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 02:31:22 smithi039 ceph-mon[30515]: from='mgr.14150 172.21.15.39:0/408627207' entity='mgr.x' 2024-09-12T02:31:22.850 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 02:31:22 smithi039 ceph-mon[30515]: from='mgr.14150 172.21.15.39:0/408627207' entity='mgr.x' 2024-09-12T02:31:22.850 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 02:31:22 smithi039 ceph-mon[30515]: from='mgr.14150 172.21.15.39:0/408627207' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-12T02:31:22.851 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 02:31:22 smithi039 ceph-mon[30515]: from='mgr.14150 172.21.15.39:0/408627207' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-12T02:31:22.851 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 02:31:22 smithi039 ceph-mon[30515]: from='mgr.14150 172.21.15.39:0/408627207' entity='mgr.x' 2024-09-12T02:31:23.487 INFO:teuthology.orchestra.run.smithi172.stdout:Created osd(s) 5 on host 'smithi172' 2024-09-12T02:31:23.487 INFO:teuthology.orchestra.run.smithi172.stderr:2024-09-12T02:31:23.486+0000 7f2e657fa640 1 -- 172.21.15.172:0/3373822559 <== mgr.14150 v2:172.21.15.39:6800/1725006999 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+37 (secure 0 0 0) 0x7f2e68062630 con 0x7f2e540a2bb0 2024-09-12T02:31:23.489 INFO:teuthology.orchestra.run.smithi172.stderr:2024-09-12T02:31:23.488+0000 7f2e6e0dd640 1 -- 172.21.15.172:0/3373822559 >> [v2:172.21.15.39:6800/1725006999,v1:172.21.15.39:6801/1725006999] conn(0x7f2e540a2bb0 msgr2=0x7f2e540a5070 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:31:23.489 INFO:teuthology.orchestra.run.smithi172.stderr:2024-09-12T02:31:23.488+0000 7f2e6e0dd640 1 --2- 172.21.15.172:0/3373822559 >> [v2:172.21.15.39:6800/1725006999,v1:172.21.15.39:6801/1725006999] conn(0x7f2e540a2bb0 0x7f2e540a5070 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7f2e500314e0 tx=0x7f2e50000bc0 comp rx=0 tx=0).stop 2024-09-12T02:31:23.489 INFO:teuthology.orchestra.run.smithi172.stderr:2024-09-12T02:31:23.488+0000 7f2e6e0dd640 1 -- 172.21.15.172:0/3373822559 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f2e68100ad0 msgr2=0x7f2e68196e10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:31:23.489 INFO:teuthology.orchestra.run.smithi172.stderr:2024-09-12T02:31:23.488+0000 7f2e6e0dd640 1 --2- 172.21.15.172:0/3373822559 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f2e68100ad0 0x7f2e68196e10 secure :-1 s=READY pgs=23 cs=0 l=1 rev1=1 crypto rx=0x7f2e5800e9c0 tx=0x7f2e5800ee80 comp rx=0 tx=0).stop 2024-09-12T02:31:23.490 INFO:teuthology.orchestra.run.smithi172.stderr:2024-09-12T02:31:23.489+0000 7f2e6e0dd640 1 -- 172.21.15.172:0/3373822559 shutdown_connections 2024-09-12T02:31:23.490 INFO:teuthology.orchestra.run.smithi172.stderr:2024-09-12T02:31:23.489+0000 7f2e6e0dd640 1 --2- 172.21.15.172:0/3373822559 >> [v2:172.21.15.39:6800/1725006999,v1:172.21.15.39:6801/1725006999] conn(0x7f2e540a2bb0 0x7f2e540a5070 unknown :-1 s=CLOSED pgs=77 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:31:23.490 INFO:teuthology.orchestra.run.smithi172.stderr:2024-09-12T02:31:23.489+0000 7f2e6e0dd640 1 --2- 172.21.15.172:0/3373822559 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f2e68102690 0x7f2e6819e3d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:31:23.490 INFO:teuthology.orchestra.run.smithi172.stderr:2024-09-12T02:31:23.489+0000 7f2e6e0dd640 1 --2- 172.21.15.172:0/3373822559 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f2e68101cd0 0x7f2e68197350 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:31:23.490 INFO:teuthology.orchestra.run.smithi172.stderr:2024-09-12T02:31:23.489+0000 7f2e6e0dd640 1 --2- 172.21.15.172:0/3373822559 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f2e68100ad0 0x7f2e68196e10 unknown :-1 s=CLOSED pgs=23 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:31:23.490 INFO:teuthology.orchestra.run.smithi172.stderr:2024-09-12T02:31:23.489+0000 7f2e6e0dd640 1 -- 172.21.15.172:0/3373822559 >> 172.21.15.172:0/3373822559 conn(0x7f2e680fc280 msgr2=0x7f2e68105110 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:31:23.490 INFO:teuthology.orchestra.run.smithi172.stderr:2024-09-12T02:31:23.489+0000 7f2e6e0dd640 1 -- 172.21.15.172:0/3373822559 shutdown_connections 2024-09-12T02:31:23.490 INFO:teuthology.orchestra.run.smithi172.stderr:2024-09-12T02:31:23.489+0000 7f2e6e0dd640 1 -- 172.21.15.172:0/3373822559 wait complete. 2024-09-12T02:31:24.076 DEBUG:teuthology.orchestra.run.smithi172:osd.5> sudo journalctl -f -n 0 -u ceph-4954ed46-70ae-11ef-bcea-c7b262605968@osd.5.service 2024-09-12T02:31:24.079 INFO:tasks.cephadm:Deploying osd.6 on smithi039 with /dev/vg_nvme/lv_2... 2024-09-12T02:31:24.079 DEBUG:teuthology.orchestra.run.smithi039:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc ceph-volume -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 4954ed46-70ae-11ef-bcea-c7b262605968 -- lvm zap /dev/vg_nvme/lv_2 2024-09-12T02:31:24.464 INFO:teuthology.orchestra.run.smithi039.stderr:Inferring config /var/lib/ceph/4954ed46-70ae-11ef-bcea-c7b262605968/mon.a/config 2024-09-12T02:31:24.600 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 02:31:24 smithi039 ceph-mon[30515]: pgmap v134: 1 pgs: 1 active+clean; 577 KiB data, 151 MiB used, 447 GiB / 447 GiB avail 2024-09-12T02:31:24.600 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 02:31:24 smithi039 ceph-mon[30515]: from='mgr.14150 172.21.15.39:0/408627207' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-12T02:31:24.600 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 02:31:24 smithi039 ceph-mon[30515]: from='mgr.14150 172.21.15.39:0/408627207' entity='mgr.x' 2024-09-12T02:31:24.600 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 02:31:24 smithi039 ceph-mon[30515]: from='mgr.14150 172.21.15.39:0/408627207' entity='mgr.x' 2024-09-12T02:31:24.698 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 12 02:31:24 smithi044 ceph-mon[35411]: pgmap v134: 1 pgs: 1 active+clean; 577 KiB data, 151 MiB used, 447 GiB / 447 GiB avail 2024-09-12T02:31:24.698 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 12 02:31:24 smithi044 ceph-mon[35411]: from='mgr.14150 172.21.15.39:0/408627207' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-12T02:31:24.698 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 12 02:31:24 smithi044 ceph-mon[35411]: from='mgr.14150 172.21.15.39:0/408627207' entity='mgr.x' 2024-09-12T02:31:24.699 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 12 02:31:24 smithi044 ceph-mon[35411]: from='mgr.14150 172.21.15.39:0/408627207' entity='mgr.x' 2024-09-12T02:31:24.764 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 12 02:31:24 smithi172 ceph-mon[35609]: pgmap v134: 1 pgs: 1 active+clean; 577 KiB data, 151 MiB used, 447 GiB / 447 GiB avail 2024-09-12T02:31:24.764 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 12 02:31:24 smithi172 ceph-mon[35609]: from='mgr.14150 172.21.15.39:0/408627207' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-12T02:31:24.764 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 12 02:31:24 smithi172 ceph-mon[35609]: from='mgr.14150 172.21.15.39:0/408627207' entity='mgr.x' 2024-09-12T02:31:24.764 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 12 02:31:24 smithi172 ceph-mon[35609]: from='mgr.14150 172.21.15.39:0/408627207' entity='mgr.x' 2024-09-12T02:31:25.747 INFO:journalctl@ceph.osd.5.smithi172.stdout:Sep 12 02:31:25 smithi172 ceph-4954ed46-70ae-11ef-bcea-c7b262605968-osd-5[47211]: 2024-09-12T02:31:25.675+0000 7ff98616f640 -1 osd.5 0 log_to_monitors true 2024-09-12T02:31:26.589 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 12 02:31:26 smithi172 ceph-mon[35609]: pgmap v135: 1 pgs: 1 active+clean; 577 KiB data, 151 MiB used, 447 GiB / 447 GiB avail 2024-09-12T02:31:26.589 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 12 02:31:26 smithi172 ceph-mon[35609]: from='osd.5 [v2:172.21.15.172:6808/998885347,v1:172.21.15.172:6809/998885347]' entity='osd.5' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["5"]}]: dispatch 2024-09-12T02:31:26.589 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 12 02:31:26 smithi172 ceph-mon[35609]: from='osd.5 ' entity='osd.5' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["5"]}]: dispatch 2024-09-12T02:31:26.698 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 12 02:31:26 smithi044 ceph-mon[35411]: pgmap v135: 1 pgs: 1 active+clean; 577 KiB data, 151 MiB used, 447 GiB / 447 GiB avail 2024-09-12T02:31:26.698 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 12 02:31:26 smithi044 ceph-mon[35411]: from='osd.5 [v2:172.21.15.172:6808/998885347,v1:172.21.15.172:6809/998885347]' entity='osd.5' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["5"]}]: dispatch 2024-09-12T02:31:26.698 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 12 02:31:26 smithi044 ceph-mon[35411]: from='osd.5 ' entity='osd.5' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["5"]}]: dispatch 2024-09-12T02:31:26.851 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 02:31:26 smithi039 ceph-mon[30515]: pgmap v135: 1 pgs: 1 active+clean; 577 KiB data, 151 MiB used, 447 GiB / 447 GiB avail 2024-09-12T02:31:26.851 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 02:31:26 smithi039 ceph-mon[30515]: from='osd.5 [v2:172.21.15.172:6808/998885347,v1:172.21.15.172:6809/998885347]' entity='osd.5' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["5"]}]: dispatch 2024-09-12T02:31:26.851 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 02:31:26 smithi039 ceph-mon[30515]: from='osd.5 ' entity='osd.5' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["5"]}]: dispatch 2024-09-12T02:31:27.680 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 02:31:27 smithi039 ceph-mon[30515]: from='osd.5 ' entity='osd.5' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["5"]}]': finished 2024-09-12T02:31:27.680 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 02:31:27 smithi039 ceph-mon[30515]: osdmap e36: 6 total, 5 up, 6 in 2024-09-12T02:31:27.680 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 02:31:27 smithi039 ceph-mon[30515]: from='mgr.14150 172.21.15.39:0/408627207' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-09-12T02:31:27.680 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 02:31:27 smithi039 ceph-mon[30515]: from='osd.5 [v2:172.21.15.172:6808/998885347,v1:172.21.15.172:6809/998885347]' entity='osd.5' cmd=[{"prefix": "osd crush create-or-move", "id": 5, "weight":0.0873, "args": ["host=smithi172", "root=default"]}]: dispatch 2024-09-12T02:31:27.680 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 02:31:27 smithi039 ceph-mon[30515]: from='osd.5 ' entity='osd.5' cmd=[{"prefix": "osd crush create-or-move", "id": 5, "weight":0.0873, "args": ["host=smithi172", "root=default"]}]: dispatch 2024-09-12T02:31:27.681 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 02:31:27 smithi039 ceph-mon[30515]: from='mgr.14150 172.21.15.39:0/408627207' entity='mgr.x' 2024-09-12T02:31:27.684 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 02:31:27 smithi039 ceph-mon[30515]: from='mgr.14150 172.21.15.39:0/408627207' entity='mgr.x' 2024-09-12T02:31:27.685 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 02:31:27 smithi039 ceph-mon[30515]: from='mgr.14150 172.21.15.39:0/408627207' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2024-09-12T02:31:27.685 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 02:31:27 smithi039 ceph-mon[30515]: from='mgr.14150 172.21.15.39:0/408627207' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2024-09-12T02:31:27.685 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 02:31:27 smithi039 ceph-mon[30515]: from='mgr.14150 172.21.15.39:0/408627207' entity='mgr.x' 2024-09-12T02:31:27.685 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 02:31:27 smithi039 ceph-mon[30515]: from='mgr.14150 172.21.15.39:0/408627207' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-12T02:31:27.685 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 02:31:27 smithi039 ceph-mon[30515]: from='mgr.14150 172.21.15.39:0/408627207' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-12T02:31:27.685 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 02:31:27 smithi039 ceph-mon[30515]: from='mgr.14150 172.21.15.39:0/408627207' entity='mgr.x' 2024-09-12T02:31:27.698 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 12 02:31:27 smithi044 ceph-mon[35411]: from='osd.5 ' entity='osd.5' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["5"]}]': finished 2024-09-12T02:31:27.699 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 12 02:31:27 smithi044 ceph-mon[35411]: osdmap e36: 6 total, 5 up, 6 in 2024-09-12T02:31:27.699 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 12 02:31:27 smithi044 ceph-mon[35411]: from='mgr.14150 172.21.15.39:0/408627207' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-09-12T02:31:27.699 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 12 02:31:27 smithi044 ceph-mon[35411]: from='osd.5 [v2:172.21.15.172:6808/998885347,v1:172.21.15.172:6809/998885347]' entity='osd.5' cmd=[{"prefix": "osd crush create-or-move", "id": 5, "weight":0.0873, "args": ["host=smithi172", "root=default"]}]: dispatch 2024-09-12T02:31:27.699 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 12 02:31:27 smithi044 ceph-mon[35411]: from='osd.5 ' entity='osd.5' cmd=[{"prefix": "osd crush create-or-move", "id": 5, "weight":0.0873, "args": ["host=smithi172", "root=default"]}]: dispatch 2024-09-12T02:31:27.699 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 12 02:31:27 smithi044 ceph-mon[35411]: from='mgr.14150 172.21.15.39:0/408627207' entity='mgr.x' 2024-09-12T02:31:27.699 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 12 02:31:27 smithi044 ceph-mon[35411]: from='mgr.14150 172.21.15.39:0/408627207' entity='mgr.x' 2024-09-12T02:31:27.699 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 12 02:31:27 smithi044 ceph-mon[35411]: from='mgr.14150 172.21.15.39:0/408627207' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2024-09-12T02:31:27.699 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 12 02:31:27 smithi044 ceph-mon[35411]: from='mgr.14150 172.21.15.39:0/408627207' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2024-09-12T02:31:27.699 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 12 02:31:27 smithi044 ceph-mon[35411]: from='mgr.14150 172.21.15.39:0/408627207' entity='mgr.x' 2024-09-12T02:31:27.699 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 12 02:31:27 smithi044 ceph-mon[35411]: from='mgr.14150 172.21.15.39:0/408627207' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-12T02:31:27.699 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 12 02:31:27 smithi044 ceph-mon[35411]: from='mgr.14150 172.21.15.39:0/408627207' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-12T02:31:27.700 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 12 02:31:27 smithi044 ceph-mon[35411]: from='mgr.14150 172.21.15.39:0/408627207' entity='mgr.x' 2024-09-12T02:31:27.764 INFO:journalctl@ceph.osd.5.smithi172.stdout:Sep 12 02:31:27 smithi172 ceph-4954ed46-70ae-11ef-bcea-c7b262605968-osd-5[47211]: 2024-09-12T02:31:27.392+0000 7ff9820f2640 -1 osd.5 0 waiting for initial osdmap 2024-09-12T02:31:27.764 INFO:journalctl@ceph.osd.5.smithi172.stdout:Sep 12 02:31:27 smithi172 ceph-4954ed46-70ae-11ef-bcea-c7b262605968-osd-5[47211]: 2024-09-12T02:31:27.398+0000 7ff97df1a640 -1 osd.5 37 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-09-12T02:31:27.764 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 12 02:31:27 smithi172 ceph-mon[35609]: from='osd.5 ' entity='osd.5' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["5"]}]': finished 2024-09-12T02:31:27.764 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 12 02:31:27 smithi172 ceph-mon[35609]: osdmap e36: 6 total, 5 up, 6 in 2024-09-12T02:31:27.764 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 12 02:31:27 smithi172 ceph-mon[35609]: from='mgr.14150 172.21.15.39:0/408627207' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-09-12T02:31:27.764 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 12 02:31:27 smithi172 ceph-mon[35609]: from='osd.5 [v2:172.21.15.172:6808/998885347,v1:172.21.15.172:6809/998885347]' entity='osd.5' cmd=[{"prefix": "osd crush create-or-move", "id": 5, "weight":0.0873, "args": ["host=smithi172", "root=default"]}]: dispatch 2024-09-12T02:31:27.765 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 12 02:31:27 smithi172 ceph-mon[35609]: from='osd.5 ' entity='osd.5' cmd=[{"prefix": "osd crush create-or-move", "id": 5, "weight":0.0873, "args": ["host=smithi172", "root=default"]}]: dispatch 2024-09-12T02:31:27.765 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 12 02:31:27 smithi172 ceph-mon[35609]: from='mgr.14150 172.21.15.39:0/408627207' entity='mgr.x' 2024-09-12T02:31:27.765 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 12 02:31:27 smithi172 ceph-mon[35609]: from='mgr.14150 172.21.15.39:0/408627207' entity='mgr.x' 2024-09-12T02:31:27.765 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 12 02:31:27 smithi172 ceph-mon[35609]: from='mgr.14150 172.21.15.39:0/408627207' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2024-09-12T02:31:27.765 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 12 02:31:27 smithi172 ceph-mon[35609]: from='mgr.14150 172.21.15.39:0/408627207' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2024-09-12T02:31:27.765 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 12 02:31:27 smithi172 ceph-mon[35609]: from='mgr.14150 172.21.15.39:0/408627207' entity='mgr.x' 2024-09-12T02:31:27.765 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 12 02:31:27 smithi172 ceph-mon[35609]: from='mgr.14150 172.21.15.39:0/408627207' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-12T02:31:27.765 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 12 02:31:27 smithi172 ceph-mon[35609]: from='mgr.14150 172.21.15.39:0/408627207' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-12T02:31:27.765 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 12 02:31:27 smithi172 ceph-mon[35609]: from='mgr.14150 172.21.15.39:0/408627207' entity='mgr.x' 2024-09-12T02:31:27.794 INFO:teuthology.orchestra.run.smithi039.stdout: 2024-09-12T02:31:27.827 DEBUG:teuthology.orchestra.run.smithi039:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 4954ed46-70ae-11ef-bcea-c7b262605968 -- ceph orch daemon add osd smithi039:vg_nvme/lv_2 2024-09-12T02:31:28.207 INFO:teuthology.orchestra.run.smithi039.stderr:Inferring config /var/lib/ceph/4954ed46-70ae-11ef-bcea-c7b262605968/mon.a/config 2024-09-12T02:31:28.600 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 02:31:28 smithi039 ceph-mon[30515]: pgmap v137: 1 pgs: 1 active+clean; 577 KiB data, 151 MiB used, 447 GiB / 447 GiB avail 2024-09-12T02:31:28.600 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 02:31:28 smithi039 ceph-mon[30515]: Detected new or changed devices on smithi172 2024-09-12T02:31:28.600 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 02:31:28 smithi039 ceph-mon[30515]: Adjusting osd_memory_target on smithi172 to 8544M 2024-09-12T02:31:28.600 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 02:31:28 smithi039 ceph-mon[30515]: from='osd.5 ' entity='osd.5' cmd='[{"prefix": "osd crush create-or-move", "id": 5, "weight":0.0873, "args": ["host=smithi172", "root=default"]}]': finished 2024-09-12T02:31:28.600 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 02:31:28 smithi039 ceph-mon[30515]: osdmap e37: 6 total, 5 up, 6 in 2024-09-12T02:31:28.600 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 02:31:28 smithi039 ceph-mon[30515]: from='mgr.14150 172.21.15.39:0/408627207' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-09-12T02:31:28.600 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 02:31:28 smithi039 ceph-mon[30515]: from='mgr.14150 172.21.15.39:0/408627207' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-09-12T02:31:28.698 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 12 02:31:28 smithi044 ceph-mon[35411]: pgmap v137: 1 pgs: 1 active+clean; 577 KiB data, 151 MiB used, 447 GiB / 447 GiB avail 2024-09-12T02:31:28.698 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 12 02:31:28 smithi044 ceph-mon[35411]: Detected new or changed devices on smithi172 2024-09-12T02:31:28.698 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 12 02:31:28 smithi044 ceph-mon[35411]: Adjusting osd_memory_target on smithi172 to 8544M 2024-09-12T02:31:28.698 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 12 02:31:28 smithi044 ceph-mon[35411]: from='osd.5 ' entity='osd.5' cmd='[{"prefix": "osd crush create-or-move", "id": 5, "weight":0.0873, "args": ["host=smithi172", "root=default"]}]': finished 2024-09-12T02:31:28.699 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 12 02:31:28 smithi044 ceph-mon[35411]: osdmap e37: 6 total, 5 up, 6 in 2024-09-12T02:31:28.699 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 12 02:31:28 smithi044 ceph-mon[35411]: from='mgr.14150 172.21.15.39:0/408627207' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-09-12T02:31:28.699 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 12 02:31:28 smithi044 ceph-mon[35411]: from='mgr.14150 172.21.15.39:0/408627207' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-09-12T02:31:28.763 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 12 02:31:28 smithi172 ceph-mon[35609]: pgmap v137: 1 pgs: 1 active+clean; 577 KiB data, 151 MiB used, 447 GiB / 447 GiB avail 2024-09-12T02:31:28.763 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 12 02:31:28 smithi172 ceph-mon[35609]: Detected new or changed devices on smithi172 2024-09-12T02:31:28.763 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 12 02:31:28 smithi172 ceph-mon[35609]: Adjusting osd_memory_target on smithi172 to 8544M 2024-09-12T02:31:28.764 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 12 02:31:28 smithi172 ceph-mon[35609]: from='osd.5 ' entity='osd.5' cmd='[{"prefix": "osd crush create-or-move", "id": 5, "weight":0.0873, "args": ["host=smithi172", "root=default"]}]': finished 2024-09-12T02:31:28.764 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 12 02:31:28 smithi172 ceph-mon[35609]: osdmap e37: 6 total, 5 up, 6 in 2024-09-12T02:31:28.764 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 12 02:31:28 smithi172 ceph-mon[35609]: from='mgr.14150 172.21.15.39:0/408627207' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-09-12T02:31:28.764 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 12 02:31:28 smithi172 ceph-mon[35609]: from='mgr.14150 172.21.15.39:0/408627207' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-09-12T02:31:28.815 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:31:28.814+0000 7fd1de000640 1 -- 172.21.15.39:0/2936478350 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fd1d8105920 msgr2=0x7fd1d810c240 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:31:28.815 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:31:28.814+0000 7fd1de000640 1 --2- 172.21.15.39:0/2936478350 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fd1d8105920 0x7fd1d810c240 secure :-1 s=READY pgs=119 cs=0 l=1 rev1=1 crypto rx=0x7fd1d0009ca0 tx=0x7fd1d002a8c0 comp rx=0 tx=0).stop 2024-09-12T02:31:28.815 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:31:28.814+0000 7fd1de000640 1 -- 172.21.15.39:0/2936478350 shutdown_connections 2024-09-12T02:31:28.815 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:31:28.814+0000 7fd1de000640 1 --2- 172.21.15.39:0/2936478350 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fd1d8105920 0x7fd1d810c240 unknown :-1 s=CLOSED pgs=119 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:31:28.815 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:31:28.814+0000 7fd1de000640 1 --2- 172.21.15.39:0/2936478350 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fd1d8104f60 0x7fd1d81053e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:31:28.815 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:31:28.814+0000 7fd1de000640 1 --2- 172.21.15.39:0/2936478350 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fd1d8103e00 0x7fd1d8104200 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:31:28.815 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:31:28.814+0000 7fd1de000640 1 -- 172.21.15.39:0/2936478350 >> 172.21.15.39:0/2936478350 conn(0x7fd1d80ff5b0 msgr2=0x7fd1d81019d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:31:28.815 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:31:28.814+0000 7fd1de000640 1 -- 172.21.15.39:0/2936478350 shutdown_connections 2024-09-12T02:31:28.816 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:31:28.814+0000 7fd1de000640 1 -- 172.21.15.39:0/2936478350 wait complete. 2024-09-12T02:31:28.817 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:31:28.815+0000 7fd1de000640 1 Processor -- start 2024-09-12T02:31:28.817 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:31:28.815+0000 7fd1de000640 1 -- start start 2024-09-12T02:31:28.817 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:31:28.815+0000 7fd1de000640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fd1d8103e00 0x7fd1d819a070 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:31:28.817 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:31:28.815+0000 7fd1de000640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fd1d8104f60 0x7fd1d819a5b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:31:28.817 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:31:28.815+0000 7fd1de000640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fd1d8105920 0x7fd1d81a1630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:31:28.817 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:31:28.815+0000 7fd1de000640 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 -- 0x7fd1d810fab0 con 0x7fd1d8105920 2024-09-12T02:31:28.817 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:31:28.815+0000 7fd1de000640 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x7fd1d810f930 con 0x7fd1d8104f60 2024-09-12T02:31:28.817 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:31:28.815+0000 7fd1de000640 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7fd1d810fc30 con 0x7fd1d8103e00 2024-09-12T02:31:28.817 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:31:28.816+0000 7fd1cfe00640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fd1d8104f60 0x7fd1d819a5b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:31:28.818 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:31:28.816+0000 7fd1d7e00640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fd1d8105920 0x7fd1d81a1630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:31:28.818 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:31:28.816+0000 7fd1cfe00640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fd1d8104f60 0x7fd1d819a5b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.39:35090/0 (socket says 172.21.15.39:35090) 2024-09-12T02:31:28.818 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:31:28.816+0000 7fd1cfe00640 1 -- 172.21.15.39:0/3132815738 learned_addr learned my addr 172.21.15.39:0/3132815738 (peer_addr_for_me v2:172.21.15.39:0/0) 2024-09-12T02:31:28.818 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:31:28.816+0000 7fd1d7400640 1 --2- 172.21.15.39:0/3132815738 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fd1d8103e00 0x7fd1d819a070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:31:28.818 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:31:28.816+0000 7fd1cfe00640 1 -- 172.21.15.39:0/3132815738 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fd1d8103e00 msgr2=0x7fd1d819a070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:31:28.818 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:31:28.816+0000 7fd1cfe00640 1 --2- 172.21.15.39:0/3132815738 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fd1d8103e00 0x7fd1d819a070 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:31:28.818 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:31:28.816+0000 7fd1cfe00640 1 -- 172.21.15.39:0/3132815738 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fd1d8105920 msgr2=0x7fd1d81a1630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:31:28.818 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:31:28.816+0000 7fd1cfe00640 1 --2- 172.21.15.39:0/3132815738 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fd1d8105920 0x7fd1d81a1630 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:31:28.818 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:31:28.816+0000 7fd1cfe00640 1 -- 172.21.15.39:0/3132815738 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd1d81a1ca0 con 0x7fd1d8104f60 2024-09-12T02:31:28.818 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:31:28.816+0000 7fd1cfe00640 1 --2- 172.21.15.39:0/3132815738 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fd1d8104f60 0x7fd1d819a5b0 secure :-1 s=READY pgs=35 cs=0 l=1 rev1=1 crypto rx=0x7fd1c000e9c0 tx=0x7fd1c000ee80 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:31:28.819 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:31:28.817+0000 7fd1d4c00640 1 -- 172.21.15.39:0/3132815738 <== mon.2 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd1c000cd80 con 0x7fd1d8104f60 2024-09-12T02:31:28.819 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:31:28.817+0000 7fd1d4c00640 1 -- 172.21.15.39:0/3132815738 <== mon.2 v2:172.21.15.44:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fd1c00035f0 con 0x7fd1d8104f60 2024-09-12T02:31:28.819 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:31:28.817+0000 7fd1de000640 1 -- 172.21.15.39:0/3132815738 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd1d81a1f90 con 0x7fd1d8104f60 2024-09-12T02:31:28.819 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:31:28.817+0000 7fd1d4c00640 1 -- 172.21.15.39:0/3132815738 <== mon.2 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd1c0010690 con 0x7fd1d8104f60 2024-09-12T02:31:28.819 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:31:28.817+0000 7fd1de000640 1 -- 172.21.15.39:0/3132815738 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd1d81a23f0 con 0x7fd1d8104f60 2024-09-12T02:31:28.819 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:31:28.818+0000 7fd1de000640 1 -- 172.21.15.39:0/3132815738 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fd1d810b120 con 0x7fd1d8104f60 2024-09-12T02:31:28.821 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:31:28.820+0000 7fd1d4c00640 1 -- 172.21.15.39:0/3132815738 <== mon.2 v2:172.21.15.44:3300/0 4 ==== mgrmap(e 16) ==== 137833+0+0 (secure 0 0 0) 0x7fd1c00037a0 con 0x7fd1d8104f60 2024-09-12T02:31:28.822 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:31:28.822+0000 7fd1d4c00640 1 --2- 172.21.15.39:0/3132815738 >> [v2:172.21.15.39:6800/1725006999,v1:172.21.15.39:6801/1725006999] conn(0x7fd1bc0a2bb0 0x7fd1bc0a5070 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:31:28.823 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:31:28.822+0000 7fd1d4c00640 1 -- 172.21.15.39:0/3132815738 <== mon.2 v2:172.21.15.44:3300/0 5 ==== osd_map(38..38 src has 1..38) ==== 4566+0+0 (secure 0 0 0) 0x7fd1c00ce4e0 con 0x7fd1d8104f60 2024-09-12T02:31:28.823 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:31:28.822+0000 7fd1d7400640 1 --2- 172.21.15.39:0/3132815738 >> [v2:172.21.15.39:6800/1725006999,v1:172.21.15.39:6801/1725006999] conn(0x7fd1bc0a2bb0 0x7fd1bc0a5070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:31:28.823 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:31:28.823+0000 7fd1d7400640 1 --2- 172.21.15.39:0/3132815738 >> [v2:172.21.15.39:6800/1725006999,v1:172.21.15.39:6801/1725006999] conn(0x7fd1bc0a2bb0 0x7fd1bc0a5070 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7fd1c8009bd0 tx=0x7fd1c8005f90 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:31:28.824 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:31:28.823+0000 7fd1d4c00640 1 -- 172.21.15.39:0/3132815738 <== mon.2 v2:172.21.15.44:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7fd1c009c240 con 0x7fd1d8104f60 2024-09-12T02:31:29.020 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:31:29.019+0000 7fd1de000640 1 -- 172.21.15.39:0/3132815738 --> [v2:172.21.15.39:6800/1725006999,v1:172.21.15.39:6801/1725006999] -- mgr_command(tid 0: {"prefix": "orch daemon add osd", "svc_arg": "smithi039:vg_nvme/lv_2", "target": ["mon-mgr", ""]}) -- 0x7fd1d8062630 con 0x7fd1bc0a2bb0 2024-09-12T02:31:29.664 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 02:31:29 smithi039 ceph-mon[30515]: purged_snaps scrub starts 2024-09-12T02:31:29.664 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 02:31:29 smithi039 ceph-mon[30515]: purged_snaps scrub ok 2024-09-12T02:31:29.665 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 02:31:29 smithi039 ceph-mon[30515]: osd.5 [v2:172.21.15.172:6808/998885347,v1:172.21.15.172:6809/998885347] boot 2024-09-12T02:31:29.665 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 02:31:29 smithi039 ceph-mon[30515]: osdmap e38: 6 total, 6 up, 6 in 2024-09-12T02:31:29.665 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 02:31:29 smithi039 ceph-mon[30515]: from='mgr.14150 172.21.15.39:0/408627207' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-09-12T02:31:29.665 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 02:31:29 smithi039 ceph-mon[30515]: from='mgr.14150 172.21.15.39:0/408627207' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-09-12T02:31:29.665 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 02:31:29 smithi039 ceph-mon[30515]: from='mgr.14150 172.21.15.39:0/408627207' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-09-12T02:31:29.665 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 02:31:29 smithi039 ceph-mon[30515]: from='mgr.14150 172.21.15.39:0/408627207' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-12T02:31:29.698 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 12 02:31:29 smithi044 ceph-mon[35411]: purged_snaps scrub starts 2024-09-12T02:31:29.698 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 12 02:31:29 smithi044 ceph-mon[35411]: purged_snaps scrub ok 2024-09-12T02:31:29.699 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 12 02:31:29 smithi044 ceph-mon[35411]: osd.5 [v2:172.21.15.172:6808/998885347,v1:172.21.15.172:6809/998885347] boot 2024-09-12T02:31:29.699 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 12 02:31:29 smithi044 ceph-mon[35411]: osdmap e38: 6 total, 6 up, 6 in 2024-09-12T02:31:29.699 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 12 02:31:29 smithi044 ceph-mon[35411]: from='mgr.14150 172.21.15.39:0/408627207' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-09-12T02:31:29.699 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 12 02:31:29 smithi044 ceph-mon[35411]: from='mgr.14150 172.21.15.39:0/408627207' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-09-12T02:31:29.699 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 12 02:31:29 smithi044 ceph-mon[35411]: from='mgr.14150 172.21.15.39:0/408627207' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-09-12T02:31:29.699 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 12 02:31:29 smithi044 ceph-mon[35411]: from='mgr.14150 172.21.15.39:0/408627207' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-12T02:31:29.764 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 12 02:31:29 smithi172 ceph-mon[35609]: purged_snaps scrub starts 2024-09-12T02:31:29.764 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 12 02:31:29 smithi172 ceph-mon[35609]: purged_snaps scrub ok 2024-09-12T02:31:29.764 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 12 02:31:29 smithi172 ceph-mon[35609]: osd.5 [v2:172.21.15.172:6808/998885347,v1:172.21.15.172:6809/998885347] boot 2024-09-12T02:31:29.764 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 12 02:31:29 smithi172 ceph-mon[35609]: osdmap e38: 6 total, 6 up, 6 in 2024-09-12T02:31:29.764 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 12 02:31:29 smithi172 ceph-mon[35609]: from='mgr.14150 172.21.15.39:0/408627207' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-09-12T02:31:29.764 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 12 02:31:29 smithi172 ceph-mon[35609]: from='mgr.14150 172.21.15.39:0/408627207' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-09-12T02:31:29.764 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 12 02:31:29 smithi172 ceph-mon[35609]: from='mgr.14150 172.21.15.39:0/408627207' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-09-12T02:31:29.764 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 12 02:31:29 smithi172 ceph-mon[35609]: from='mgr.14150 172.21.15.39:0/408627207' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-12T02:31:30.599 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 02:31:30 smithi039 ceph-mon[30515]: pgmap v140: 1 pgs: 1 remapped+peering; 577 KiB data, 178 MiB used, 536 GiB / 536 GiB avail 2024-09-12T02:31:30.600 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 02:31:30 smithi039 ceph-mon[30515]: from='client.24263 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi039:vg_nvme/lv_2", "target": ["mon-mgr", ""]}]: dispatch 2024-09-12T02:31:30.600 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 02:31:30 smithi039 ceph-mon[30515]: osdmap e39: 6 total, 6 up, 6 in 2024-09-12T02:31:30.600 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 02:31:30 smithi039 ceph-mon[30515]: osdmap e40: 6 total, 6 up, 6 in 2024-09-12T02:31:30.698 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 12 02:31:30 smithi044 ceph-mon[35411]: pgmap v140: 1 pgs: 1 remapped+peering; 577 KiB data, 178 MiB used, 536 GiB / 536 GiB avail 2024-09-12T02:31:30.698 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 12 02:31:30 smithi044 ceph-mon[35411]: from='client.24263 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi039:vg_nvme/lv_2", "target": ["mon-mgr", ""]}]: dispatch 2024-09-12T02:31:30.698 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 12 02:31:30 smithi044 ceph-mon[35411]: osdmap e39: 6 total, 6 up, 6 in 2024-09-12T02:31:30.698 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 12 02:31:30 smithi044 ceph-mon[35411]: osdmap e40: 6 total, 6 up, 6 in 2024-09-12T02:31:30.764 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 12 02:31:30 smithi172 ceph-mon[35609]: pgmap v140: 1 pgs: 1 remapped+peering; 577 KiB data, 178 MiB used, 536 GiB / 536 GiB avail 2024-09-12T02:31:30.764 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 12 02:31:30 smithi172 ceph-mon[35609]: from='client.24263 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi039:vg_nvme/lv_2", "target": ["mon-mgr", ""]}]: dispatch 2024-09-12T02:31:30.764 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 12 02:31:30 smithi172 ceph-mon[35609]: osdmap e39: 6 total, 6 up, 6 in 2024-09-12T02:31:30.764 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 12 02:31:30 smithi172 ceph-mon[35609]: osdmap e40: 6 total, 6 up, 6 in 2024-09-12T02:31:32.698 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 12 02:31:32 smithi044 ceph-mon[35411]: pgmap v143: 1 pgs: 1 remapped+peering; 577 KiB data, 178 MiB used, 536 GiB / 536 GiB avail 2024-09-12T02:31:32.699 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 12 02:31:32 smithi044 ceph-mon[35411]: osdmap e41: 6 total, 6 up, 6 in 2024-09-12T02:31:32.699 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 12 02:31:32 smithi044 ceph-mon[35411]: from='client.? 172.21.15.39:0/2686283709' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "1fcb9bb2-6f4b-4d97-a401-aeb6a9706613"}]: dispatch 2024-09-12T02:31:32.699 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 12 02:31:32 smithi044 ceph-mon[35411]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "1fcb9bb2-6f4b-4d97-a401-aeb6a9706613"}]: dispatch 2024-09-12T02:31:32.699 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 12 02:31:32 smithi044 ceph-mon[35411]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "1fcb9bb2-6f4b-4d97-a401-aeb6a9706613"}]': finished 2024-09-12T02:31:32.699 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 12 02:31:32 smithi044 ceph-mon[35411]: osdmap e42: 7 total, 6 up, 7 in 2024-09-12T02:31:32.699 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 12 02:31:32 smithi044 ceph-mon[35411]: from='mgr.14150 172.21.15.39:0/408627207' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2024-09-12T02:31:32.738 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 02:31:32 smithi039 ceph-mon[30515]: pgmap v143: 1 pgs: 1 remapped+peering; 577 KiB data, 178 MiB used, 536 GiB / 536 GiB avail 2024-09-12T02:31:32.738 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 02:31:32 smithi039 ceph-mon[30515]: osdmap e41: 6 total, 6 up, 6 in 2024-09-12T02:31:32.738 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 02:31:32 smithi039 ceph-mon[30515]: from='client.? 172.21.15.39:0/2686283709' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "1fcb9bb2-6f4b-4d97-a401-aeb6a9706613"}]: dispatch 2024-09-12T02:31:32.738 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 02:31:32 smithi039 ceph-mon[30515]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "1fcb9bb2-6f4b-4d97-a401-aeb6a9706613"}]: dispatch 2024-09-12T02:31:32.738 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 02:31:32 smithi039 ceph-mon[30515]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "1fcb9bb2-6f4b-4d97-a401-aeb6a9706613"}]': finished 2024-09-12T02:31:32.738 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 02:31:32 smithi039 ceph-mon[30515]: osdmap e42: 7 total, 6 up, 7 in 2024-09-12T02:31:32.738 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 02:31:32 smithi039 ceph-mon[30515]: from='mgr.14150 172.21.15.39:0/408627207' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2024-09-12T02:31:32.763 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 12 02:31:32 smithi172 ceph-mon[35609]: pgmap v143: 1 pgs: 1 remapped+peering; 577 KiB data, 178 MiB used, 536 GiB / 536 GiB avail 2024-09-12T02:31:32.764 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 12 02:31:32 smithi172 ceph-mon[35609]: osdmap e41: 6 total, 6 up, 6 in 2024-09-12T02:31:32.764 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 12 02:31:32 smithi172 ceph-mon[35609]: from='client.? 172.21.15.39:0/2686283709' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "1fcb9bb2-6f4b-4d97-a401-aeb6a9706613"}]: dispatch 2024-09-12T02:31:32.764 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 12 02:31:32 smithi172 ceph-mon[35609]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "1fcb9bb2-6f4b-4d97-a401-aeb6a9706613"}]: dispatch 2024-09-12T02:31:32.764 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 12 02:31:32 smithi172 ceph-mon[35609]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "1fcb9bb2-6f4b-4d97-a401-aeb6a9706613"}]': finished 2024-09-12T02:31:32.764 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 12 02:31:32 smithi172 ceph-mon[35609]: osdmap e42: 7 total, 6 up, 7 in 2024-09-12T02:31:32.764 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 12 02:31:32 smithi172 ceph-mon[35609]: from='mgr.14150 172.21.15.39:0/408627207' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2024-09-12T02:31:33.698 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 12 02:31:33 smithi044 ceph-mon[35411]: from='client.? 172.21.15.39:0/1314802158' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-09-12T02:31:33.763 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 12 02:31:33 smithi172 ceph-mon[35609]: from='client.? 172.21.15.39:0/1314802158' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-09-12T02:31:33.849 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 02:31:33 smithi039 ceph-mon[30515]: from='client.? 172.21.15.39:0/1314802158' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-09-12T02:31:34.698 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 12 02:31:34 smithi044 ceph-mon[35411]: pgmap v146: 1 pgs: 1 remapped+peering; 577 KiB data, 178 MiB used, 536 GiB / 536 GiB avail 2024-09-12T02:31:34.763 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 12 02:31:34 smithi172 ceph-mon[35609]: pgmap v146: 1 pgs: 1 remapped+peering; 577 KiB data, 178 MiB used, 536 GiB / 536 GiB avail 2024-09-12T02:31:34.849 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 02:31:34 smithi039 ceph-mon[30515]: pgmap v146: 1 pgs: 1 remapped+peering; 577 KiB data, 178 MiB used, 536 GiB / 536 GiB avail 2024-09-12T02:31:36.513 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 12 02:31:36 smithi172 ceph-mon[35609]: pgmap v147: 1 pgs: 1 active+clean; 577 KiB data, 179 MiB used, 536 GiB / 536 GiB avail; 107 KiB/s, 0 objects/s recovering 2024-09-12T02:31:36.698 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 12 02:31:36 smithi044 ceph-mon[35411]: pgmap v147: 1 pgs: 1 active+clean; 577 KiB data, 179 MiB used, 536 GiB / 536 GiB avail; 107 KiB/s, 0 objects/s recovering 2024-09-12T02:31:36.849 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 02:31:36 smithi039 ceph-mon[30515]: pgmap v147: 1 pgs: 1 active+clean; 577 KiB data, 179 MiB used, 536 GiB / 536 GiB avail; 107 KiB/s, 0 objects/s recovering 2024-09-12T02:31:38.698 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 12 02:31:38 smithi044 ceph-mon[35411]: pgmap v148: 1 pgs: 1 active+clean; 577 KiB data, 179 MiB used, 536 GiB / 536 GiB avail; 90 KiB/s, 0 objects/s recovering 2024-09-12T02:31:38.763 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 12 02:31:38 smithi172 ceph-mon[35609]: pgmap v148: 1 pgs: 1 active+clean; 577 KiB data, 179 MiB used, 536 GiB / 536 GiB avail; 90 KiB/s, 0 objects/s recovering 2024-09-12T02:31:38.849 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 02:31:38 smithi039 ceph-mon[30515]: pgmap v148: 1 pgs: 1 active+clean; 577 KiB data, 179 MiB used, 536 GiB / 536 GiB avail; 90 KiB/s, 0 objects/s recovering 2024-09-12T02:31:40.698 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 12 02:31:40 smithi044 ceph-mon[35411]: pgmap v149: 1 pgs: 1 active+clean; 577 KiB data, 179 MiB used, 536 GiB / 536 GiB avail; 72 KiB/s, 0 objects/s recovering 2024-09-12T02:31:40.763 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 12 02:31:40 smithi172 ceph-mon[35609]: pgmap v149: 1 pgs: 1 active+clean; 577 KiB data, 179 MiB used, 536 GiB / 536 GiB avail; 72 KiB/s, 0 objects/s recovering 2024-09-12T02:31:40.773 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 02:31:40 smithi039 ceph-mon[30515]: pgmap v149: 1 pgs: 1 active+clean; 577 KiB data, 179 MiB used, 536 GiB / 536 GiB avail; 72 KiB/s, 0 objects/s recovering 2024-09-12T02:31:42.573 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 02:31:42 smithi039 ceph-mon[30515]: pgmap v150: 1 pgs: 1 active+clean; 577 KiB data, 179 MiB used, 536 GiB / 536 GiB avail; 62 KiB/s, 0 objects/s recovering 2024-09-12T02:31:42.573 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 02:31:42 smithi039 ceph-mon[30515]: from='mgr.14150 172.21.15.39:0/408627207' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.6"}]: dispatch 2024-09-12T02:31:42.573 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 02:31:42 smithi039 ceph-mon[30515]: from='mgr.14150 172.21.15.39:0/408627207' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-12T02:31:42.698 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 12 02:31:42 smithi044 ceph-mon[35411]: pgmap v150: 1 pgs: 1 active+clean; 577 KiB data, 179 MiB used, 536 GiB / 536 GiB avail; 62 KiB/s, 0 objects/s recovering 2024-09-12T02:31:42.698 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 12 02:31:42 smithi044 ceph-mon[35411]: from='mgr.14150 172.21.15.39:0/408627207' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.6"}]: dispatch 2024-09-12T02:31:42.699 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 12 02:31:42 smithi044 ceph-mon[35411]: from='mgr.14150 172.21.15.39:0/408627207' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-12T02:31:42.763 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 12 02:31:42 smithi172 ceph-mon[35609]: pgmap v150: 1 pgs: 1 active+clean; 577 KiB data, 179 MiB used, 536 GiB / 536 GiB avail; 62 KiB/s, 0 objects/s recovering 2024-09-12T02:31:42.764 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 12 02:31:42 smithi172 ceph-mon[35609]: from='mgr.14150 172.21.15.39:0/408627207' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.6"}]: dispatch 2024-09-12T02:31:42.764 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 12 02:31:42 smithi172 ceph-mon[35609]: from='mgr.14150 172.21.15.39:0/408627207' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-12T02:31:43.599 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 02:31:43 smithi039 ceph-mon[30515]: Deploying daemon osd.6 on smithi039 2024-09-12T02:31:43.763 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 12 02:31:43 smithi172 ceph-mon[35609]: Deploying daemon osd.6 on smithi039 2024-09-12T02:31:43.948 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 12 02:31:43 smithi044 ceph-mon[35411]: Deploying daemon osd.6 on smithi039 2024-09-12T02:31:44.763 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 12 02:31:44 smithi172 ceph-mon[35609]: pgmap v151: 1 pgs: 1 active+clean; 577 KiB data, 179 MiB used, 536 GiB / 536 GiB avail; 54 KiB/s, 0 objects/s recovering 2024-09-12T02:31:44.850 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 02:31:44 smithi039 ceph-mon[30515]: pgmap v151: 1 pgs: 1 active+clean; 577 KiB data, 179 MiB used, 536 GiB / 536 GiB avail; 54 KiB/s, 0 objects/s recovering 2024-09-12T02:31:44.948 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 12 02:31:44 smithi044 ceph-mon[35411]: pgmap v151: 1 pgs: 1 active+clean; 577 KiB data, 179 MiB used, 536 GiB / 536 GiB avail; 54 KiB/s, 0 objects/s recovering 2024-09-12T02:31:46.764 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 12 02:31:46 smithi172 ceph-mon[35609]: pgmap v152: 1 pgs: 1 active+clean; 577 KiB data, 179 MiB used, 536 GiB / 536 GiB avail; 48 KiB/s, 0 objects/s recovering 2024-09-12T02:31:46.766 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 02:31:46 smithi039 ceph-mon[30515]: pgmap v152: 1 pgs: 1 active+clean; 577 KiB data, 179 MiB used, 536 GiB / 536 GiB avail; 48 KiB/s, 0 objects/s recovering 2024-09-12T02:31:46.948 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 12 02:31:46 smithi044 ceph-mon[35411]: pgmap v152: 1 pgs: 1 active+clean; 577 KiB data, 179 MiB used, 536 GiB / 536 GiB avail; 48 KiB/s, 0 objects/s recovering 2024-09-12T02:31:48.763 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 12 02:31:48 smithi172 ceph-mon[35609]: pgmap v153: 1 pgs: 1 active+clean; 577 KiB data, 179 MiB used, 536 GiB / 536 GiB avail 2024-09-12T02:31:48.850 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 02:31:48 smithi039 ceph-mon[30515]: pgmap v153: 1 pgs: 1 active+clean; 577 KiB data, 179 MiB used, 536 GiB / 536 GiB avail 2024-09-12T02:31:48.948 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 12 02:31:48 smithi044 ceph-mon[35411]: pgmap v153: 1 pgs: 1 active+clean; 577 KiB data, 179 MiB used, 536 GiB / 536 GiB avail 2024-09-12T02:31:50.745 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 02:31:50 smithi039 ceph-mon[30515]: pgmap v154: 1 pgs: 1 active+clean; 577 KiB data, 179 MiB used, 536 GiB / 536 GiB avail 2024-09-12T02:31:50.745 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 02:31:50 smithi039 ceph-mon[30515]: from='mgr.14150 172.21.15.39:0/408627207' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-12T02:31:50.745 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 02:31:50 smithi039 ceph-mon[30515]: from='mgr.14150 172.21.15.39:0/408627207' entity='mgr.x' 2024-09-12T02:31:50.745 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 02:31:50 smithi039 ceph-mon[30515]: from='mgr.14150 172.21.15.39:0/408627207' entity='mgr.x' 2024-09-12T02:31:50.763 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 12 02:31:50 smithi172 ceph-mon[35609]: pgmap v154: 1 pgs: 1 active+clean; 577 KiB data, 179 MiB used, 536 GiB / 536 GiB avail 2024-09-12T02:31:50.763 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 12 02:31:50 smithi172 ceph-mon[35609]: from='mgr.14150 172.21.15.39:0/408627207' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-12T02:31:50.763 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 12 02:31:50 smithi172 ceph-mon[35609]: from='mgr.14150 172.21.15.39:0/408627207' entity='mgr.x' 2024-09-12T02:31:50.764 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 12 02:31:50 smithi172 ceph-mon[35609]: from='mgr.14150 172.21.15.39:0/408627207' entity='mgr.x' 2024-09-12T02:31:50.948 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 12 02:31:50 smithi044 ceph-mon[35411]: pgmap v154: 1 pgs: 1 active+clean; 577 KiB data, 179 MiB used, 536 GiB / 536 GiB avail 2024-09-12T02:31:50.949 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 12 02:31:50 smithi044 ceph-mon[35411]: from='mgr.14150 172.21.15.39:0/408627207' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-12T02:31:50.949 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 12 02:31:50 smithi044 ceph-mon[35411]: from='mgr.14150 172.21.15.39:0/408627207' entity='mgr.x' 2024-09-12T02:31:50.949 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 12 02:31:50 smithi044 ceph-mon[35411]: from='mgr.14150 172.21.15.39:0/408627207' entity='mgr.x' 2024-09-12T02:31:52.599 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 02:31:52 smithi039 ceph-mon[30515]: pgmap v155: 1 pgs: 1 active+clean; 577 KiB data, 179 MiB used, 536 GiB / 536 GiB avail 2024-09-12T02:31:52.763 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 12 02:31:52 smithi172 ceph-mon[35609]: pgmap v155: 1 pgs: 1 active+clean; 577 KiB data, 179 MiB used, 536 GiB / 536 GiB avail 2024-09-12T02:31:52.948 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 12 02:31:52 smithi044 ceph-mon[35411]: pgmap v155: 1 pgs: 1 active+clean; 577 KiB data, 179 MiB used, 536 GiB / 536 GiB avail 2024-09-12T02:31:54.344 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 02:31:54 smithi039 ceph-mon[30515]: pgmap v156: 1 pgs: 1 active+clean; 577 KiB data, 179 MiB used, 536 GiB / 536 GiB avail 2024-09-12T02:31:54.344 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 02:31:54 smithi039 ceph-mon[30515]: from='mgr.14150 172.21.15.39:0/408627207' entity='mgr.x' 2024-09-12T02:31:54.344 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 02:31:54 smithi039 ceph-mon[30515]: from='mgr.14150 172.21.15.39:0/408627207' entity='mgr.x' 2024-09-12T02:31:54.344 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 02:31:54 smithi039 ceph-mon[30515]: from='mgr.14150 172.21.15.39:0/408627207' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-12T02:31:54.344 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 02:31:54 smithi039 ceph-mon[30515]: from='mgr.14150 172.21.15.39:0/408627207' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-12T02:31:54.344 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 02:31:54 smithi039 ceph-mon[30515]: from='mgr.14150 172.21.15.39:0/408627207' entity='mgr.x' 2024-09-12T02:31:54.395 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:31:54.393+0000 7fd1d4c00640 1 -- 172.21.15.39:0/3132815738 <== mgr.14150 v2:172.21.15.39:6800/1725006999 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+37 (secure 0 0 0) 0x7fd1d8062630 con 0x7fd1bc0a2bb0 2024-09-12T02:31:54.395 INFO:teuthology.orchestra.run.smithi039.stdout:Created osd(s) 6 on host 'smithi039' 2024-09-12T02:31:54.397 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:31:54.396+0000 7fd1de000640 1 -- 172.21.15.39:0/3132815738 >> [v2:172.21.15.39:6800/1725006999,v1:172.21.15.39:6801/1725006999] conn(0x7fd1bc0a2bb0 msgr2=0x7fd1bc0a5070 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:31:54.397 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:31:54.396+0000 7fd1de000640 1 --2- 172.21.15.39:0/3132815738 >> [v2:172.21.15.39:6800/1725006999,v1:172.21.15.39:6801/1725006999] conn(0x7fd1bc0a2bb0 0x7fd1bc0a5070 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7fd1c8009bd0 tx=0x7fd1c8005f90 comp rx=0 tx=0).stop 2024-09-12T02:31:54.397 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:31:54.396+0000 7fd1de000640 1 -- 172.21.15.39:0/3132815738 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fd1d8104f60 msgr2=0x7fd1d819a5b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:31:54.397 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:31:54.396+0000 7fd1de000640 1 --2- 172.21.15.39:0/3132815738 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fd1d8104f60 0x7fd1d819a5b0 secure :-1 s=READY pgs=35 cs=0 l=1 rev1=1 crypto rx=0x7fd1c000e9c0 tx=0x7fd1c000ee80 comp rx=0 tx=0).stop 2024-09-12T02:31:54.397 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:31:54.396+0000 7fd1de000640 1 -- 172.21.15.39:0/3132815738 shutdown_connections 2024-09-12T02:31:54.397 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:31:54.396+0000 7fd1de000640 1 --2- 172.21.15.39:0/3132815738 >> [v2:172.21.15.39:6800/1725006999,v1:172.21.15.39:6801/1725006999] conn(0x7fd1bc0a2bb0 0x7fd1bc0a5070 unknown :-1 s=CLOSED pgs=83 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:31:54.397 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:31:54.396+0000 7fd1de000640 1 --2- 172.21.15.39:0/3132815738 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fd1d8105920 0x7fd1d81a1630 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:31:54.398 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:31:54.396+0000 7fd1de000640 1 --2- 172.21.15.39:0/3132815738 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fd1d8104f60 0x7fd1d819a5b0 unknown :-1 s=CLOSED pgs=35 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:31:54.398 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:31:54.396+0000 7fd1de000640 1 --2- 172.21.15.39:0/3132815738 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fd1d8103e00 0x7fd1d819a070 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:31:54.398 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:31:54.396+0000 7fd1de000640 1 -- 172.21.15.39:0/3132815738 >> 172.21.15.39:0/3132815738 conn(0x7fd1d80ff5b0 msgr2=0x7fd1d81082f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:31:54.398 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:31:54.396+0000 7fd1de000640 1 -- 172.21.15.39:0/3132815738 shutdown_connections 2024-09-12T02:31:54.398 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:31:54.396+0000 7fd1de000640 1 -- 172.21.15.39:0/3132815738 wait complete. 2024-09-12T02:31:54.449 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 12 02:31:54 smithi044 ceph-mon[35411]: pgmap v156: 1 pgs: 1 active+clean; 577 KiB data, 179 MiB used, 536 GiB / 536 GiB avail 2024-09-12T02:31:54.449 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 12 02:31:54 smithi044 ceph-mon[35411]: from='mgr.14150 172.21.15.39:0/408627207' entity='mgr.x' 2024-09-12T02:31:54.449 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 12 02:31:54 smithi044 ceph-mon[35411]: from='mgr.14150 172.21.15.39:0/408627207' entity='mgr.x' 2024-09-12T02:31:54.449 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 12 02:31:54 smithi044 ceph-mon[35411]: from='mgr.14150 172.21.15.39:0/408627207' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-12T02:31:54.449 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 12 02:31:54 smithi044 ceph-mon[35411]: from='mgr.14150 172.21.15.39:0/408627207' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-12T02:31:54.449 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 12 02:31:54 smithi044 ceph-mon[35411]: from='mgr.14150 172.21.15.39:0/408627207' entity='mgr.x' 2024-09-12T02:31:54.515 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 12 02:31:54 smithi172 ceph-mon[35609]: pgmap v156: 1 pgs: 1 active+clean; 577 KiB data, 179 MiB used, 536 GiB / 536 GiB avail 2024-09-12T02:31:54.515 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 12 02:31:54 smithi172 ceph-mon[35609]: from='mgr.14150 172.21.15.39:0/408627207' entity='mgr.x' 2024-09-12T02:31:54.515 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 12 02:31:54 smithi172 ceph-mon[35609]: from='mgr.14150 172.21.15.39:0/408627207' entity='mgr.x' 2024-09-12T02:31:54.515 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 12 02:31:54 smithi172 ceph-mon[35609]: from='mgr.14150 172.21.15.39:0/408627207' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-12T02:31:54.515 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 12 02:31:54 smithi172 ceph-mon[35609]: from='mgr.14150 172.21.15.39:0/408627207' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-12T02:31:54.515 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 12 02:31:54 smithi172 ceph-mon[35609]: from='mgr.14150 172.21.15.39:0/408627207' entity='mgr.x' 2024-09-12T02:31:55.112 DEBUG:teuthology.orchestra.run.smithi039:osd.6> sudo journalctl -f -n 0 -u ceph-4954ed46-70ae-11ef-bcea-c7b262605968@osd.6.service 2024-09-12T02:31:55.116 INFO:tasks.cephadm:Deploying osd.7 on smithi044 with /dev/vg_nvme/lv_2... 2024-09-12T02:31:55.116 DEBUG:teuthology.orchestra.run.smithi044:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc ceph-volume -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 4954ed46-70ae-11ef-bcea-c7b262605968 -- lvm zap /dev/vg_nvme/lv_2 2024-09-12T02:31:55.349 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 02:31:55 smithi039 ceph-mon[30515]: from='mgr.14150 172.21.15.39:0/408627207' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-12T02:31:55.350 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 02:31:55 smithi039 ceph-mon[30515]: from='mgr.14150 172.21.15.39:0/408627207' entity='mgr.x' 2024-09-12T02:31:55.350 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 02:31:55 smithi039 ceph-mon[30515]: from='mgr.14150 172.21.15.39:0/408627207' entity='mgr.x' 2024-09-12T02:31:55.350 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 02:31:55 smithi039 ceph-mon[30515]: from='osd.6 [v2:172.21.15.39:6818/2569059542,v1:172.21.15.39:6819/2569059542]' entity='osd.6' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["6"]}]: dispatch 2024-09-12T02:31:55.350 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 02:31:55 smithi039 ceph-mon[30515]: from='osd.6 ' entity='osd.6' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["6"]}]: dispatch 2024-09-12T02:31:55.377 INFO:teuthology.orchestra.run.smithi044.stderr:Inferring config /var/lib/ceph/4954ed46-70ae-11ef-bcea-c7b262605968/mon.b/config 2024-09-12T02:31:55.448 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 12 02:31:55 smithi044 ceph-mon[35411]: from='mgr.14150 172.21.15.39:0/408627207' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-12T02:31:55.448 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 12 02:31:55 smithi044 ceph-mon[35411]: from='mgr.14150 172.21.15.39:0/408627207' entity='mgr.x' 2024-09-12T02:31:55.449 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 12 02:31:55 smithi044 ceph-mon[35411]: from='mgr.14150 172.21.15.39:0/408627207' entity='mgr.x' 2024-09-12T02:31:55.449 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 12 02:31:55 smithi044 ceph-mon[35411]: from='osd.6 [v2:172.21.15.39:6818/2569059542,v1:172.21.15.39:6819/2569059542]' entity='osd.6' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["6"]}]: dispatch 2024-09-12T02:31:55.449 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 12 02:31:55 smithi044 ceph-mon[35411]: from='osd.6 ' entity='osd.6' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["6"]}]: dispatch 2024-09-12T02:31:55.513 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 12 02:31:55 smithi172 ceph-mon[35609]: from='mgr.14150 172.21.15.39:0/408627207' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-12T02:31:55.513 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 12 02:31:55 smithi172 ceph-mon[35609]: from='mgr.14150 172.21.15.39:0/408627207' entity='mgr.x' 2024-09-12T02:31:55.513 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 12 02:31:55 smithi172 ceph-mon[35609]: from='mgr.14150 172.21.15.39:0/408627207' entity='mgr.x' 2024-09-12T02:31:55.514 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 12 02:31:55 smithi172 ceph-mon[35609]: from='osd.6 [v2:172.21.15.39:6818/2569059542,v1:172.21.15.39:6819/2569059542]' entity='osd.6' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["6"]}]: dispatch 2024-09-12T02:31:55.514 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 12 02:31:55 smithi172 ceph-mon[35609]: from='osd.6 ' entity='osd.6' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["6"]}]: dispatch 2024-09-12T02:31:56.648 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 02:31:56 smithi039 ceph-mon[30515]: pgmap v157: 1 pgs: 1 active+clean; 577 KiB data, 179 MiB used, 536 GiB / 536 GiB avail 2024-09-12T02:31:56.648 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 02:31:56 smithi039 ceph-mon[30515]: from='osd.6 ' entity='osd.6' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["6"]}]': finished 2024-09-12T02:31:56.649 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 02:31:56 smithi039 ceph-mon[30515]: osdmap e43: 7 total, 6 up, 7 in 2024-09-12T02:31:56.649 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 02:31:56 smithi039 ceph-mon[30515]: from='osd.6 [v2:172.21.15.39:6818/2569059542,v1:172.21.15.39:6819/2569059542]' entity='osd.6' cmd=[{"prefix": "osd crush create-or-move", "id": 6, "weight":0.0873, "args": ["host=smithi039", "root=default"]}]: dispatch 2024-09-12T02:31:56.649 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 02:31:56 smithi039 ceph-mon[30515]: from='mgr.14150 172.21.15.39:0/408627207' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2024-09-12T02:31:56.649 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 02:31:56 smithi039 ceph-mon[30515]: from='osd.6 ' entity='osd.6' cmd=[{"prefix": "osd crush create-or-move", "id": 6, "weight":0.0873, "args": ["host=smithi039", "root=default"]}]: dispatch 2024-09-12T02:31:56.649 INFO:journalctl@ceph.osd.6.smithi039.stdout:Sep 12 02:31:56 smithi039 ceph-4954ed46-70ae-11ef-bcea-c7b262605968-osd-6[57154]: 2024-09-12T02:31:56.409+0000 7fd250800640 -1 osd.6 0 waiting for initial osdmap 2024-09-12T02:31:56.649 INFO:journalctl@ceph.osd.6.smithi039.stdout:Sep 12 02:31:56 smithi039 ceph-4954ed46-70ae-11ef-bcea-c7b262605968-osd-6[57154]: 2024-09-12T02:31:56.420+0000 7fd24b800640 -1 osd.6 44 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-09-12T02:31:56.699 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 12 02:31:56 smithi044 ceph-mon[35411]: pgmap v157: 1 pgs: 1 active+clean; 577 KiB data, 179 MiB used, 536 GiB / 536 GiB avail 2024-09-12T02:31:56.699 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 12 02:31:56 smithi044 ceph-mon[35411]: from='osd.6 ' entity='osd.6' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["6"]}]': finished 2024-09-12T02:31:56.699 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 12 02:31:56 smithi044 ceph-mon[35411]: osdmap e43: 7 total, 6 up, 7 in 2024-09-12T02:31:56.699 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 12 02:31:56 smithi044 ceph-mon[35411]: from='osd.6 [v2:172.21.15.39:6818/2569059542,v1:172.21.15.39:6819/2569059542]' entity='osd.6' cmd=[{"prefix": "osd crush create-or-move", "id": 6, "weight":0.0873, "args": ["host=smithi039", "root=default"]}]: dispatch 2024-09-12T02:31:56.699 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 12 02:31:56 smithi044 ceph-mon[35411]: from='mgr.14150 172.21.15.39:0/408627207' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2024-09-12T02:31:56.699 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 12 02:31:56 smithi044 ceph-mon[35411]: from='osd.6 ' entity='osd.6' cmd=[{"prefix": "osd crush create-or-move", "id": 6, "weight":0.0873, "args": ["host=smithi039", "root=default"]}]: dispatch 2024-09-12T02:31:56.763 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 12 02:31:56 smithi172 ceph-mon[35609]: pgmap v157: 1 pgs: 1 active+clean; 577 KiB data, 179 MiB used, 536 GiB / 536 GiB avail 2024-09-12T02:31:56.764 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 12 02:31:56 smithi172 ceph-mon[35609]: from='osd.6 ' entity='osd.6' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["6"]}]': finished 2024-09-12T02:31:56.764 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 12 02:31:56 smithi172 ceph-mon[35609]: osdmap e43: 7 total, 6 up, 7 in 2024-09-12T02:31:56.764 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 12 02:31:56 smithi172 ceph-mon[35609]: from='osd.6 [v2:172.21.15.39:6818/2569059542,v1:172.21.15.39:6819/2569059542]' entity='osd.6' cmd=[{"prefix": "osd crush create-or-move", "id": 6, "weight":0.0873, "args": ["host=smithi039", "root=default"]}]: dispatch 2024-09-12T02:31:56.764 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 12 02:31:56 smithi172 ceph-mon[35609]: from='mgr.14150 172.21.15.39:0/408627207' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2024-09-12T02:31:56.764 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 12 02:31:56 smithi172 ceph-mon[35609]: from='osd.6 ' entity='osd.6' cmd=[{"prefix": "osd crush create-or-move", "id": 6, "weight":0.0873, "args": ["host=smithi039", "root=default"]}]: dispatch 2024-09-12T02:31:57.600 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 02:31:57 smithi039 ceph-mon[30515]: from='osd.6 ' entity='osd.6' cmd='[{"prefix": "osd crush create-or-move", "id": 6, "weight":0.0873, "args": ["host=smithi039", "root=default"]}]': finished 2024-09-12T02:31:57.600 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 02:31:57 smithi039 ceph-mon[30515]: osdmap e44: 7 total, 6 up, 7 in 2024-09-12T02:31:57.600 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 02:31:57 smithi039 ceph-mon[30515]: from='mgr.14150 172.21.15.39:0/408627207' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2024-09-12T02:31:57.600 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 02:31:57 smithi039 ceph-mon[30515]: from='mgr.14150 172.21.15.39:0/408627207' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2024-09-12T02:31:57.678 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 12 02:31:57 smithi044 ceph-mon[35411]: from='osd.6 ' entity='osd.6' cmd='[{"prefix": "osd crush create-or-move", "id": 6, "weight":0.0873, "args": ["host=smithi039", "root=default"]}]': finished 2024-09-12T02:31:57.678 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 12 02:31:57 smithi044 ceph-mon[35411]: osdmap e44: 7 total, 6 up, 7 in 2024-09-12T02:31:57.678 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 12 02:31:57 smithi044 ceph-mon[35411]: from='mgr.14150 172.21.15.39:0/408627207' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2024-09-12T02:31:57.678 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 12 02:31:57 smithi044 ceph-mon[35411]: from='mgr.14150 172.21.15.39:0/408627207' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2024-09-12T02:31:57.763 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 12 02:31:57 smithi172 ceph-mon[35609]: from='osd.6 ' entity='osd.6' cmd='[{"prefix": "osd crush create-or-move", "id": 6, "weight":0.0873, "args": ["host=smithi039", "root=default"]}]': finished 2024-09-12T02:31:57.764 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 12 02:31:57 smithi172 ceph-mon[35609]: osdmap e44: 7 total, 6 up, 7 in 2024-09-12T02:31:57.764 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 12 02:31:57 smithi172 ceph-mon[35609]: from='mgr.14150 172.21.15.39:0/408627207' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2024-09-12T02:31:57.764 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 12 02:31:57 smithi172 ceph-mon[35609]: from='mgr.14150 172.21.15.39:0/408627207' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2024-09-12T02:31:58.015 INFO:teuthology.orchestra.run.smithi044.stdout: 2024-09-12T02:31:58.042 DEBUG:teuthology.orchestra.run.smithi044:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 4954ed46-70ae-11ef-bcea-c7b262605968 -- ceph orch daemon add osd smithi044:vg_nvme/lv_2 2024-09-12T02:31:58.295 INFO:teuthology.orchestra.run.smithi044.stderr:Inferring config /var/lib/ceph/4954ed46-70ae-11ef-bcea-c7b262605968/mon.b/config 2024-09-12T02:31:58.600 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 02:31:58 smithi039 ceph-mon[30515]: purged_snaps scrub starts 2024-09-12T02:31:58.600 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 02:31:58 smithi039 ceph-mon[30515]: purged_snaps scrub ok 2024-09-12T02:31:58.600 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 02:31:58 smithi039 ceph-mon[30515]: pgmap v160: 1 pgs: 1 active+clean; 577 KiB data, 179 MiB used, 536 GiB / 536 GiB avail 2024-09-12T02:31:58.600 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 02:31:58 smithi039 ceph-mon[30515]: from='mgr.14150 172.21.15.39:0/408627207' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2024-09-12T02:31:58.600 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 02:31:58 smithi039 ceph-mon[30515]: osd.6 [v2:172.21.15.39:6818/2569059542,v1:172.21.15.39:6819/2569059542] boot 2024-09-12T02:31:58.600 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 02:31:58 smithi039 ceph-mon[30515]: osdmap e45: 7 total, 7 up, 7 in 2024-09-12T02:31:58.600 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 02:31:58 smithi039 ceph-mon[30515]: from='mgr.14150 172.21.15.39:0/408627207' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2024-09-12T02:31:58.698 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 12 02:31:58 smithi044 ceph-mon[35411]: purged_snaps scrub starts 2024-09-12T02:31:58.698 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 12 02:31:58 smithi044 ceph-mon[35411]: purged_snaps scrub ok 2024-09-12T02:31:58.698 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 12 02:31:58 smithi044 ceph-mon[35411]: pgmap v160: 1 pgs: 1 active+clean; 577 KiB data, 179 MiB used, 536 GiB / 536 GiB avail 2024-09-12T02:31:58.698 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 12 02:31:58 smithi044 ceph-mon[35411]: from='mgr.14150 172.21.15.39:0/408627207' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2024-09-12T02:31:58.699 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 12 02:31:58 smithi044 ceph-mon[35411]: osd.6 [v2:172.21.15.39:6818/2569059542,v1:172.21.15.39:6819/2569059542] boot 2024-09-12T02:31:58.699 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 12 02:31:58 smithi044 ceph-mon[35411]: osdmap e45: 7 total, 7 up, 7 in 2024-09-12T02:31:58.699 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 12 02:31:58 smithi044 ceph-mon[35411]: from='mgr.14150 172.21.15.39:0/408627207' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2024-09-12T02:31:58.763 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 12 02:31:58 smithi172 ceph-mon[35609]: purged_snaps scrub starts 2024-09-12T02:31:58.764 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 12 02:31:58 smithi172 ceph-mon[35609]: purged_snaps scrub ok 2024-09-12T02:31:58.764 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 12 02:31:58 smithi172 ceph-mon[35609]: pgmap v160: 1 pgs: 1 active+clean; 577 KiB data, 179 MiB used, 536 GiB / 536 GiB avail 2024-09-12T02:31:58.764 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 12 02:31:58 smithi172 ceph-mon[35609]: from='mgr.14150 172.21.15.39:0/408627207' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2024-09-12T02:31:58.764 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 12 02:31:58 smithi172 ceph-mon[35609]: osd.6 [v2:172.21.15.39:6818/2569059542,v1:172.21.15.39:6819/2569059542] boot 2024-09-12T02:31:58.764 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 12 02:31:58 smithi172 ceph-mon[35609]: osdmap e45: 7 total, 7 up, 7 in 2024-09-12T02:31:58.764 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 12 02:31:58 smithi172 ceph-mon[35609]: from='mgr.14150 172.21.15.39:0/408627207' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2024-09-12T02:31:58.799 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T02:31:58.783+0000 7feb5e9ce640 1 -- 172.21.15.44:0/70712313 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7feb58100b10 msgr2=0x7feb58100f10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:31:58.799 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T02:31:58.783+0000 7feb5e9ce640 1 --2- 172.21.15.44:0/70712313 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7feb58100b10 0x7feb58100f10 secure :-1 s=READY pgs=39 cs=0 l=1 rev1=1 crypto rx=0x7feb48009900 tx=0x7feb4802a410 comp rx=0 tx=0).stop 2024-09-12T02:31:58.799 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T02:31:58.783+0000 7feb5e9ce640 1 -- 172.21.15.44:0/70712313 shutdown_connections 2024-09-12T02:31:58.800 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T02:31:58.783+0000 7feb5e9ce640 1 --2- 172.21.15.44:0/70712313 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7feb581026d0 0x7feb58108f60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:31:58.800 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T02:31:58.783+0000 7feb5e9ce640 1 --2- 172.21.15.44:0/70712313 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7feb58101d10 0x7feb58102190 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:31:58.800 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T02:31:58.783+0000 7feb5e9ce640 1 --2- 172.21.15.44:0/70712313 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7feb58100b10 0x7feb58100f10 unknown :-1 s=CLOSED pgs=39 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:31:58.800 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T02:31:58.783+0000 7feb5e9ce640 1 -- 172.21.15.44:0/70712313 >> 172.21.15.44:0/70712313 conn(0x7feb580fc2a0 msgr2=0x7feb580fe6e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:31:58.800 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T02:31:58.783+0000 7feb5e9ce640 1 -- 172.21.15.44:0/70712313 shutdown_connections 2024-09-12T02:31:58.800 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T02:31:58.783+0000 7feb5e9ce640 1 -- 172.21.15.44:0/70712313 wait complete. 2024-09-12T02:31:58.800 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T02:31:58.784+0000 7feb5e9ce640 1 Processor -- start 2024-09-12T02:31:58.801 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T02:31:58.784+0000 7feb5e9ce640 1 -- start start 2024-09-12T02:31:58.801 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T02:31:58.784+0000 7feb5e9ce640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7feb58100b10 0x7feb5806b2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:31:58.801 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T02:31:58.784+0000 7feb5e9ce640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7feb58101d10 0x7feb5819cc70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:31:58.801 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T02:31:58.784+0000 7feb5e9ce640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7feb581026d0 0x7feb5819f290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:31:58.801 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T02:31:58.784+0000 7feb5e9ce640 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 -- 0x7feb5810c7f0 con 0x7feb581026d0 2024-09-12T02:31:58.801 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T02:31:58.784+0000 7feb5e9ce640 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x7feb5810c670 con 0x7feb58100b10 2024-09-12T02:31:58.801 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T02:31:58.784+0000 7feb5e9ce640 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7feb5810c970 con 0x7feb58101d10 2024-09-12T02:31:58.801 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T02:31:58.784+0000 7feb57fff640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7feb58100b10 0x7feb5806b2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:31:58.801 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T02:31:58.784+0000 7feb57fff640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7feb58100b10 0x7feb5806b2f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.44:47768/0 (socket says 172.21.15.44:47768) 2024-09-12T02:31:58.801 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T02:31:58.784+0000 7feb57fff640 1 -- 172.21.15.44:0/2726218533 learned_addr learned my addr 172.21.15.44:0/2726218533 (peer_addr_for_me v2:172.21.15.44:0/0) 2024-09-12T02:31:58.801 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T02:31:58.784+0000 7feb57fff640 1 -- 172.21.15.44:0/2726218533 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7feb58101d10 msgr2=0x7feb5819cc70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:31:58.801 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T02:31:58.784+0000 7feb57fff640 1 --2- 172.21.15.44:0/2726218533 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7feb58101d10 0x7feb5819cc70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:31:58.802 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T02:31:58.784+0000 7feb57fff640 1 -- 172.21.15.44:0/2726218533 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7feb581026d0 msgr2=0x7feb5819f290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:31:58.802 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T02:31:58.784+0000 7feb57fff640 1 --2- 172.21.15.44:0/2726218533 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7feb581026d0 0x7feb5819f290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:31:58.802 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T02:31:58.784+0000 7feb57fff640 1 -- 172.21.15.44:0/2726218533 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7feb5819fba0 con 0x7feb58100b10 2024-09-12T02:31:58.802 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T02:31:58.785+0000 7feb57fff640 1 --2- 172.21.15.44:0/2726218533 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7feb58100b10 0x7feb5806b2f0 secure :-1 s=READY pgs=40 cs=0 l=1 rev1=1 crypto rx=0x7feb48031610 tx=0x7feb480043b0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:31:58.802 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T02:31:58.785+0000 7feb557fa640 1 -- 172.21.15.44:0/2726218533 <== mon.2 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7feb4803f030 con 0x7feb58100b10 2024-09-12T02:31:58.802 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T02:31:58.785+0000 7feb5e9ce640 1 -- 172.21.15.44:0/2726218533 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7feb5819fdd0 con 0x7feb58100b10 2024-09-12T02:31:58.802 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T02:31:58.785+0000 7feb557fa640 1 -- 172.21.15.44:0/2726218533 <== mon.2 v2:172.21.15.44:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7feb48003ce0 con 0x7feb58100b10 2024-09-12T02:31:58.802 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T02:31:58.785+0000 7feb557fa640 1 -- 172.21.15.44:0/2726218533 <== mon.2 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7feb48035070 con 0x7feb58100b10 2024-09-12T02:31:58.803 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T02:31:58.785+0000 7feb5e9ce640 1 -- 172.21.15.44:0/2726218533 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7feb581a0300 con 0x7feb58100b10 2024-09-12T02:31:58.803 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T02:31:58.786+0000 7feb5e9ce640 1 -- 172.21.15.44:0/2726218533 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7feb58107f60 con 0x7feb58100b10 2024-09-12T02:31:58.803 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T02:31:58.787+0000 7feb557fa640 1 -- 172.21.15.44:0/2726218533 <== mon.2 v2:172.21.15.44:3300/0 4 ==== mgrmap(e 16) ==== 137833+0+0 (secure 0 0 0) 0x7feb48042030 con 0x7feb58100b10 2024-09-12T02:31:58.803 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T02:31:58.788+0000 7feb557fa640 1 --2- 172.21.15.44:0/2726218533 >> [v2:172.21.15.39:6800/1725006999,v1:172.21.15.39:6801/1725006999] conn(0x7feb400a2b80 0x7feb400a5040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:31:58.803 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T02:31:58.788+0000 7feb557fa640 1 -- 172.21.15.44:0/2726218533 <== mon.2 v2:172.21.15.44:3300/0 5 ==== osd_map(46..46 src has 1..46) ==== 4965+0+0 (secure 0 0 0) 0x7feb480eecb0 con 0x7feb58100b10 2024-09-12T02:31:58.803 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T02:31:58.788+0000 7feb577fe640 1 --2- 172.21.15.44:0/2726218533 >> [v2:172.21.15.39:6800/1725006999,v1:172.21.15.39:6801/1725006999] conn(0x7feb400a2b80 0x7feb400a5040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:31:58.803 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T02:31:58.789+0000 7feb577fe640 1 --2- 172.21.15.44:0/2726218533 >> [v2:172.21.15.39:6800/1725006999,v1:172.21.15.39:6801/1725006999] conn(0x7feb400a2b80 0x7feb400a5040 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7feb5806b870 tx=0x7feb4c006c90 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:31:58.803 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T02:31:58.791+0000 7feb557fa640 1 -- 172.21.15.44:0/2726218533 <== mon.2 v2:172.21.15.44:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7feb480bc920 con 0x7feb58100b10 2024-09-12T02:31:58.977 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T02:31:58.976+0000 7feb5e9ce640 1 -- 172.21.15.44:0/2726218533 --> [v2:172.21.15.39:6800/1725006999,v1:172.21.15.39:6801/1725006999] -- mgr_command(tid 0: {"prefix": "orch daemon add osd", "svc_arg": "smithi044:vg_nvme/lv_2", "target": ["mon-mgr", ""]}) -- 0x7feb58062630 con 0x7feb400a2b80 2024-09-12T02:31:59.652 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 12 02:31:59 smithi044 ceph-mon[35411]: osdmap e46: 7 total, 7 up, 7 in 2024-09-12T02:31:59.652 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 12 02:31:59 smithi044 ceph-mon[35411]: from='mgr.14150 172.21.15.39:0/408627207' entity='mgr.x' 2024-09-12T02:31:59.652 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 12 02:31:59 smithi044 ceph-mon[35411]: from='mgr.14150 172.21.15.39:0/408627207' entity='mgr.x' 2024-09-12T02:31:59.653 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 12 02:31:59 smithi044 ceph-mon[35411]: from='mgr.14150 172.21.15.39:0/408627207' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-09-12T02:31:59.653 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 12 02:31:59 smithi044 ceph-mon[35411]: from='mgr.14150 172.21.15.39:0/408627207' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2024-09-12T02:31:59.653 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 12 02:31:59 smithi044 ceph-mon[35411]: from='mgr.14150 172.21.15.39:0/408627207' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.6", "name": "osd_memory_target"}]: dispatch 2024-09-12T02:31:59.653 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 12 02:31:59 smithi044 ceph-mon[35411]: from='mgr.14150 172.21.15.39:0/408627207' entity='mgr.x' 2024-09-12T02:31:59.653 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 12 02:31:59 smithi044 ceph-mon[35411]: from='mgr.14150 172.21.15.39:0/408627207' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-12T02:31:59.653 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 12 02:31:59 smithi044 ceph-mon[35411]: from='mgr.14150 172.21.15.39:0/408627207' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-12T02:31:59.653 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 12 02:31:59 smithi044 ceph-mon[35411]: from='mgr.14150 172.21.15.39:0/408627207' entity='mgr.x' 2024-09-12T02:31:59.653 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 12 02:31:59 smithi044 ceph-mon[35411]: from='mgr.14150 172.21.15.39:0/408627207' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-09-12T02:31:59.654 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 12 02:31:59 smithi044 ceph-mon[35411]: from='mgr.14150 172.21.15.39:0/408627207' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-09-12T02:31:59.654 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 12 02:31:59 smithi044 ceph-mon[35411]: from='mgr.14150 172.21.15.39:0/408627207' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-12T02:31:59.764 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 12 02:31:59 smithi172 ceph-mon[35609]: osdmap e46: 7 total, 7 up, 7 in 2024-09-12T02:31:59.764 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 12 02:31:59 smithi172 ceph-mon[35609]: from='mgr.14150 172.21.15.39:0/408627207' entity='mgr.x' 2024-09-12T02:31:59.764 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 12 02:31:59 smithi172 ceph-mon[35609]: from='mgr.14150 172.21.15.39:0/408627207' entity='mgr.x' 2024-09-12T02:31:59.764 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 12 02:31:59 smithi172 ceph-mon[35609]: from='mgr.14150 172.21.15.39:0/408627207' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-09-12T02:31:59.764 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 12 02:31:59 smithi172 ceph-mon[35609]: from='mgr.14150 172.21.15.39:0/408627207' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2024-09-12T02:31:59.764 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 12 02:31:59 smithi172 ceph-mon[35609]: from='mgr.14150 172.21.15.39:0/408627207' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.6", "name": "osd_memory_target"}]: dispatch 2024-09-12T02:31:59.764 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 12 02:31:59 smithi172 ceph-mon[35609]: from='mgr.14150 172.21.15.39:0/408627207' entity='mgr.x' 2024-09-12T02:31:59.764 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 12 02:31:59 smithi172 ceph-mon[35609]: from='mgr.14150 172.21.15.39:0/408627207' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-12T02:31:59.764 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 12 02:31:59 smithi172 ceph-mon[35609]: from='mgr.14150 172.21.15.39:0/408627207' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-12T02:31:59.764 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 12 02:31:59 smithi172 ceph-mon[35609]: from='mgr.14150 172.21.15.39:0/408627207' entity='mgr.x' 2024-09-12T02:31:59.764 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 12 02:31:59 smithi172 ceph-mon[35609]: from='mgr.14150 172.21.15.39:0/408627207' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-09-12T02:31:59.765 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 12 02:31:59 smithi172 ceph-mon[35609]: from='mgr.14150 172.21.15.39:0/408627207' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-09-12T02:31:59.765 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 12 02:31:59 smithi172 ceph-mon[35609]: from='mgr.14150 172.21.15.39:0/408627207' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-12T02:31:59.850 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 02:31:59 smithi039 ceph-mon[30515]: osdmap e46: 7 total, 7 up, 7 in 2024-09-12T02:31:59.850 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 02:31:59 smithi039 ceph-mon[30515]: from='mgr.14150 172.21.15.39:0/408627207' entity='mgr.x' 2024-09-12T02:31:59.850 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 02:31:59 smithi039 ceph-mon[30515]: from='mgr.14150 172.21.15.39:0/408627207' entity='mgr.x' 2024-09-12T02:31:59.850 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 02:31:59 smithi039 ceph-mon[30515]: from='mgr.14150 172.21.15.39:0/408627207' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-09-12T02:31:59.850 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 02:31:59 smithi039 ceph-mon[30515]: from='mgr.14150 172.21.15.39:0/408627207' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2024-09-12T02:31:59.850 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 02:31:59 smithi039 ceph-mon[30515]: from='mgr.14150 172.21.15.39:0/408627207' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.6", "name": "osd_memory_target"}]: dispatch 2024-09-12T02:31:59.850 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 02:31:59 smithi039 ceph-mon[30515]: from='mgr.14150 172.21.15.39:0/408627207' entity='mgr.x' 2024-09-12T02:31:59.850 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 02:31:59 smithi039 ceph-mon[30515]: from='mgr.14150 172.21.15.39:0/408627207' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-12T02:31:59.850 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 02:31:59 smithi039 ceph-mon[30515]: from='mgr.14150 172.21.15.39:0/408627207' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-12T02:31:59.850 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 02:31:59 smithi039 ceph-mon[30515]: from='mgr.14150 172.21.15.39:0/408627207' entity='mgr.x' 2024-09-12T02:31:59.851 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 02:31:59 smithi039 ceph-mon[30515]: from='mgr.14150 172.21.15.39:0/408627207' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-09-12T02:31:59.851 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 02:31:59 smithi039 ceph-mon[30515]: from='mgr.14150 172.21.15.39:0/408627207' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-09-12T02:31:59.851 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 02:31:59 smithi039 ceph-mon[30515]: from='mgr.14150 172.21.15.39:0/408627207' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-12T02:32:00.686 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 12 02:32:00 smithi044 ceph-mon[35411]: pgmap v163: 1 pgs: 1 active+clean; 577 KiB data, 206 MiB used, 626 GiB / 626 GiB avail 2024-09-12T02:32:00.686 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 12 02:32:00 smithi044 ceph-mon[35411]: Detected new or changed devices on smithi039 2024-09-12T02:32:00.686 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 12 02:32:00 smithi044 ceph-mon[35411]: Adjusting osd_memory_target on smithi039 to 5696M 2024-09-12T02:32:00.686 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 12 02:32:00 smithi044 ceph-mon[35411]: from='client.24290 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi044:vg_nvme/lv_2", "target": ["mon-mgr", ""]}]: dispatch 2024-09-12T02:32:00.764 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 12 02:32:00 smithi172 ceph-mon[35609]: pgmap v163: 1 pgs: 1 active+clean; 577 KiB data, 206 MiB used, 626 GiB / 626 GiB avail 2024-09-12T02:32:00.764 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 12 02:32:00 smithi172 ceph-mon[35609]: Detected new or changed devices on smithi039 2024-09-12T02:32:00.764 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 12 02:32:00 smithi172 ceph-mon[35609]: Adjusting osd_memory_target on smithi039 to 5696M 2024-09-12T02:32:00.764 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 12 02:32:00 smithi172 ceph-mon[35609]: from='client.24290 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi044:vg_nvme/lv_2", "target": ["mon-mgr", ""]}]: dispatch 2024-09-12T02:32:00.849 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 02:32:00 smithi039 ceph-mon[30515]: pgmap v163: 1 pgs: 1 active+clean; 577 KiB data, 206 MiB used, 626 GiB / 626 GiB avail 2024-09-12T02:32:00.850 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 02:32:00 smithi039 ceph-mon[30515]: Detected new or changed devices on smithi039 2024-09-12T02:32:00.850 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 02:32:00 smithi039 ceph-mon[30515]: Adjusting osd_memory_target on smithi039 to 5696M 2024-09-12T02:32:00.850 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 02:32:00 smithi039 ceph-mon[30515]: from='client.24290 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi044:vg_nvme/lv_2", "target": ["mon-mgr", ""]}]: dispatch 2024-09-12T02:32:01.698 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 12 02:32:01 smithi044 ceph-mon[35411]: from='client.? 172.21.15.44:0/1723812733' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "59e0caf9-8ce5-4161-8875-84862eba743e"}]: dispatch 2024-09-12T02:32:01.699 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 12 02:32:01 smithi044 ceph-mon[35411]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "59e0caf9-8ce5-4161-8875-84862eba743e"}]: dispatch 2024-09-12T02:32:01.699 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 12 02:32:01 smithi044 ceph-mon[35411]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "59e0caf9-8ce5-4161-8875-84862eba743e"}]': finished 2024-09-12T02:32:01.699 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 12 02:32:01 smithi044 ceph-mon[35411]: osdmap e47: 8 total, 7 up, 8 in 2024-09-12T02:32:01.699 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 12 02:32:01 smithi044 ceph-mon[35411]: from='mgr.14150 172.21.15.39:0/408627207' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 7}]: dispatch 2024-09-12T02:32:01.763 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 12 02:32:01 smithi172 ceph-mon[35609]: from='client.? 172.21.15.44:0/1723812733' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "59e0caf9-8ce5-4161-8875-84862eba743e"}]: dispatch 2024-09-12T02:32:01.764 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 12 02:32:01 smithi172 ceph-mon[35609]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "59e0caf9-8ce5-4161-8875-84862eba743e"}]: dispatch 2024-09-12T02:32:01.764 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 12 02:32:01 smithi172 ceph-mon[35609]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "59e0caf9-8ce5-4161-8875-84862eba743e"}]': finished 2024-09-12T02:32:01.764 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 12 02:32:01 smithi172 ceph-mon[35609]: osdmap e47: 8 total, 7 up, 8 in 2024-09-12T02:32:01.764 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 12 02:32:01 smithi172 ceph-mon[35609]: from='mgr.14150 172.21.15.39:0/408627207' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 7}]: dispatch 2024-09-12T02:32:01.850 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 02:32:01 smithi039 ceph-mon[30515]: from='client.? 172.21.15.44:0/1723812733' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "59e0caf9-8ce5-4161-8875-84862eba743e"}]: dispatch 2024-09-12T02:32:01.850 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 02:32:01 smithi039 ceph-mon[30515]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "59e0caf9-8ce5-4161-8875-84862eba743e"}]: dispatch 2024-09-12T02:32:01.850 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 02:32:01 smithi039 ceph-mon[30515]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "59e0caf9-8ce5-4161-8875-84862eba743e"}]': finished 2024-09-12T02:32:01.850 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 02:32:01 smithi039 ceph-mon[30515]: osdmap e47: 8 total, 7 up, 8 in 2024-09-12T02:32:01.850 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 02:32:01 smithi039 ceph-mon[30515]: from='mgr.14150 172.21.15.39:0/408627207' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 7}]: dispatch 2024-09-12T02:32:02.698 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 12 02:32:02 smithi044 ceph-mon[35411]: pgmap v164: 1 pgs: 1 active+clean; 577 KiB data, 206 MiB used, 626 GiB / 626 GiB avail 2024-09-12T02:32:02.698 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 12 02:32:02 smithi044 ceph-mon[35411]: from='client.? 172.21.15.44:0/756897025' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-09-12T02:32:02.751 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 02:32:02 smithi039 ceph-mon[30515]: pgmap v164: 1 pgs: 1 active+clean; 577 KiB data, 206 MiB used, 626 GiB / 626 GiB avail 2024-09-12T02:32:02.751 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 02:32:02 smithi039 ceph-mon[30515]: from='client.? 172.21.15.44:0/756897025' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-09-12T02:32:02.763 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 12 02:32:02 smithi172 ceph-mon[35609]: pgmap v164: 1 pgs: 1 active+clean; 577 KiB data, 206 MiB used, 626 GiB / 626 GiB avail 2024-09-12T02:32:02.763 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 12 02:32:02 smithi172 ceph-mon[35609]: from='client.? 172.21.15.44:0/756897025' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-09-12T02:32:04.698 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 12 02:32:04 smithi044 ceph-mon[35411]: pgmap v166: 1 pgs: 1 active+clean; 577 KiB data, 206 MiB used, 626 GiB / 626 GiB avail 2024-09-12T02:32:04.763 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 12 02:32:04 smithi172 ceph-mon[35609]: pgmap v166: 1 pgs: 1 active+clean; 577 KiB data, 206 MiB used, 626 GiB / 626 GiB avail 2024-09-12T02:32:04.849 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 02:32:04 smithi039 ceph-mon[30515]: pgmap v166: 1 pgs: 1 active+clean; 577 KiB data, 206 MiB used, 626 GiB / 626 GiB avail 2024-09-12T02:32:06.598 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 12 02:32:06 smithi044 ceph-mon[35411]: pgmap v167: 1 pgs: 1 active+clean; 577 KiB data, 206 MiB used, 626 GiB / 626 GiB avail 2024-09-12T02:32:06.763 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 12 02:32:06 smithi172 ceph-mon[35609]: pgmap v167: 1 pgs: 1 active+clean; 577 KiB data, 206 MiB used, 626 GiB / 626 GiB avail 2024-09-12T02:32:06.849 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 02:32:06 smithi039 ceph-mon[30515]: pgmap v167: 1 pgs: 1 active+clean; 577 KiB data, 206 MiB used, 626 GiB / 626 GiB avail 2024-09-12T02:32:08.536 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 12 02:32:08 smithi044 ceph-mon[35411]: pgmap v168: 1 pgs: 1 active+clean; 577 KiB data, 206 MiB used, 626 GiB / 626 GiB avail 2024-09-12T02:32:08.763 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 12 02:32:08 smithi172 ceph-mon[35609]: pgmap v168: 1 pgs: 1 active+clean; 577 KiB data, 206 MiB used, 626 GiB / 626 GiB avail 2024-09-12T02:32:08.849 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 02:32:08 smithi039 ceph-mon[30515]: pgmap v168: 1 pgs: 1 active+clean; 577 KiB data, 206 MiB used, 626 GiB / 626 GiB avail 2024-09-12T02:32:10.698 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 12 02:32:10 smithi044 ceph-mon[35411]: pgmap v169: 1 pgs: 1 active+clean; 577 KiB data, 206 MiB used, 626 GiB / 626 GiB avail 2024-09-12T02:32:10.699 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 12 02:32:10 smithi044 ceph-mon[35411]: from='mgr.14150 172.21.15.39:0/408627207' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.7"}]: dispatch 2024-09-12T02:32:10.699 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 12 02:32:10 smithi044 ceph-mon[35411]: from='mgr.14150 172.21.15.39:0/408627207' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-12T02:32:10.699 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 12 02:32:10 smithi044 ceph-mon[35411]: Deploying daemon osd.7 on smithi044 2024-09-12T02:32:10.763 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 12 02:32:10 smithi172 ceph-mon[35609]: pgmap v169: 1 pgs: 1 active+clean; 577 KiB data, 206 MiB used, 626 GiB / 626 GiB avail 2024-09-12T02:32:10.764 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 12 02:32:10 smithi172 ceph-mon[35609]: from='mgr.14150 172.21.15.39:0/408627207' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.7"}]: dispatch 2024-09-12T02:32:10.764 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 12 02:32:10 smithi172 ceph-mon[35609]: from='mgr.14150 172.21.15.39:0/408627207' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-12T02:32:10.764 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 12 02:32:10 smithi172 ceph-mon[35609]: Deploying daemon osd.7 on smithi044 2024-09-12T02:32:10.849 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 02:32:10 smithi039 ceph-mon[30515]: pgmap v169: 1 pgs: 1 active+clean; 577 KiB data, 206 MiB used, 626 GiB / 626 GiB avail 2024-09-12T02:32:10.850 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 02:32:10 smithi039 ceph-mon[30515]: from='mgr.14150 172.21.15.39:0/408627207' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.7"}]: dispatch 2024-09-12T02:32:10.850 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 02:32:10 smithi039 ceph-mon[30515]: from='mgr.14150 172.21.15.39:0/408627207' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-12T02:32:10.850 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 02:32:10 smithi039 ceph-mon[30515]: Deploying daemon osd.7 on smithi044 2024-09-12T02:32:12.764 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 12 02:32:12 smithi172 ceph-mon[35609]: pgmap v170: 1 pgs: 1 active+clean; 577 KiB data, 206 MiB used, 626 GiB / 626 GiB avail 2024-09-12T02:32:12.849 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 02:32:12 smithi039 ceph-mon[30515]: pgmap v170: 1 pgs: 1 active+clean; 577 KiB data, 206 MiB used, 626 GiB / 626 GiB avail 2024-09-12T02:32:12.858 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 12 02:32:12 smithi044 ceph-mon[35411]: pgmap v170: 1 pgs: 1 active+clean; 577 KiB data, 206 MiB used, 626 GiB / 626 GiB avail 2024-09-12T02:32:14.635 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 12 02:32:14 smithi044 ceph-mon[35411]: pgmap v171: 1 pgs: 1 active+clean; 577 KiB data, 206 MiB used, 626 GiB / 626 GiB avail 2024-09-12T02:32:14.763 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 12 02:32:14 smithi172 ceph-mon[35609]: pgmap v171: 1 pgs: 1 active+clean; 577 KiB data, 206 MiB used, 626 GiB / 626 GiB avail 2024-09-12T02:32:14.849 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 02:32:14 smithi039 ceph-mon[30515]: pgmap v171: 1 pgs: 1 active+clean; 577 KiB data, 206 MiB used, 626 GiB / 626 GiB avail 2024-09-12T02:32:16.763 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 12 02:32:16 smithi172 ceph-mon[35609]: pgmap v172: 1 pgs: 1 active+clean; 577 KiB data, 206 MiB used, 626 GiB / 626 GiB avail 2024-09-12T02:32:16.764 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 12 02:32:16 smithi172 ceph-mon[35609]: from='mgr.14150 172.21.15.39:0/408627207' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-12T02:32:16.764 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 12 02:32:16 smithi172 ceph-mon[35609]: from='mgr.14150 172.21.15.39:0/408627207' entity='mgr.x' 2024-09-12T02:32:16.764 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 12 02:32:16 smithi172 ceph-mon[35609]: from='mgr.14150 172.21.15.39:0/408627207' entity='mgr.x' 2024-09-12T02:32:16.850 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 02:32:16 smithi039 ceph-mon[30515]: pgmap v172: 1 pgs: 1 active+clean; 577 KiB data, 206 MiB used, 626 GiB / 626 GiB avail 2024-09-12T02:32:16.850 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 02:32:16 smithi039 ceph-mon[30515]: from='mgr.14150 172.21.15.39:0/408627207' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-12T02:32:16.850 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 02:32:16 smithi039 ceph-mon[30515]: from='mgr.14150 172.21.15.39:0/408627207' entity='mgr.x' 2024-09-12T02:32:16.850 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 02:32:16 smithi039 ceph-mon[30515]: from='mgr.14150 172.21.15.39:0/408627207' entity='mgr.x' 2024-09-12T02:32:16.939 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 12 02:32:16 smithi044 ceph-mon[35411]: pgmap v172: 1 pgs: 1 active+clean; 577 KiB data, 206 MiB used, 626 GiB / 626 GiB avail 2024-09-12T02:32:16.939 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 12 02:32:16 smithi044 ceph-mon[35411]: from='mgr.14150 172.21.15.39:0/408627207' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-12T02:32:16.940 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 12 02:32:16 smithi044 ceph-mon[35411]: from='mgr.14150 172.21.15.39:0/408627207' entity='mgr.x' 2024-09-12T02:32:16.940 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 12 02:32:16 smithi044 ceph-mon[35411]: from='mgr.14150 172.21.15.39:0/408627207' entity='mgr.x' 2024-09-12T02:32:18.763 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 12 02:32:18 smithi172 ceph-mon[35609]: pgmap v173: 1 pgs: 1 active+clean; 577 KiB data, 206 MiB used, 626 GiB / 626 GiB avail 2024-09-12T02:32:18.763 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 12 02:32:18 smithi172 ceph-mon[35609]: from='mgr.14150 172.21.15.39:0/408627207' entity='mgr.x' 2024-09-12T02:32:18.764 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 12 02:32:18 smithi172 ceph-mon[35609]: from='mgr.14150 172.21.15.39:0/408627207' entity='mgr.x' 2024-09-12T02:32:18.764 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 12 02:32:18 smithi172 ceph-mon[35609]: from='mgr.14150 172.21.15.39:0/408627207' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-12T02:32:18.764 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 12 02:32:18 smithi172 ceph-mon[35609]: from='mgr.14150 172.21.15.39:0/408627207' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-12T02:32:18.764 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 12 02:32:18 smithi172 ceph-mon[35609]: from='mgr.14150 172.21.15.39:0/408627207' entity='mgr.x' 2024-09-12T02:32:18.850 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 02:32:18 smithi039 ceph-mon[30515]: pgmap v173: 1 pgs: 1 active+clean; 577 KiB data, 206 MiB used, 626 GiB / 626 GiB avail 2024-09-12T02:32:18.850 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 02:32:18 smithi039 ceph-mon[30515]: from='mgr.14150 172.21.15.39:0/408627207' entity='mgr.x' 2024-09-12T02:32:18.850 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 02:32:18 smithi039 ceph-mon[30515]: from='mgr.14150 172.21.15.39:0/408627207' entity='mgr.x' 2024-09-12T02:32:18.850 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 02:32:18 smithi039 ceph-mon[30515]: from='mgr.14150 172.21.15.39:0/408627207' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-12T02:32:18.850 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 02:32:18 smithi039 ceph-mon[30515]: from='mgr.14150 172.21.15.39:0/408627207' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-12T02:32:18.850 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 02:32:18 smithi039 ceph-mon[30515]: from='mgr.14150 172.21.15.39:0/408627207' entity='mgr.x' 2024-09-12T02:32:18.909 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 12 02:32:18 smithi044 ceph-mon[35411]: pgmap v173: 1 pgs: 1 active+clean; 577 KiB data, 206 MiB used, 626 GiB / 626 GiB avail 2024-09-12T02:32:18.909 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 12 02:32:18 smithi044 ceph-mon[35411]: from='mgr.14150 172.21.15.39:0/408627207' entity='mgr.x' 2024-09-12T02:32:18.909 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 12 02:32:18 smithi044 ceph-mon[35411]: from='mgr.14150 172.21.15.39:0/408627207' entity='mgr.x' 2024-09-12T02:32:18.909 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 12 02:32:18 smithi044 ceph-mon[35411]: from='mgr.14150 172.21.15.39:0/408627207' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-12T02:32:18.909 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 12 02:32:18 smithi044 ceph-mon[35411]: from='mgr.14150 172.21.15.39:0/408627207' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-12T02:32:18.909 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 12 02:32:18 smithi044 ceph-mon[35411]: from='mgr.14150 172.21.15.39:0/408627207' entity='mgr.x' 2024-09-12T02:32:18.955 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T02:32:18.955+0000 7feb557fa640 1 -- 172.21.15.44:0/2726218533 <== mgr.14150 v2:172.21.15.39:6800/1725006999 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+37 (secure 0 0 0) 0x7feb58062630 con 0x7feb400a2b80 2024-09-12T02:32:18.955 INFO:teuthology.orchestra.run.smithi044.stdout:Created osd(s) 7 on host 'smithi044' 2024-09-12T02:32:18.957 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T02:32:18.957+0000 7feb5e9ce640 1 -- 172.21.15.44:0/2726218533 >> [v2:172.21.15.39:6800/1725006999,v1:172.21.15.39:6801/1725006999] conn(0x7feb400a2b80 msgr2=0x7feb400a5040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:32:18.957 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T02:32:18.957+0000 7feb5e9ce640 1 --2- 172.21.15.44:0/2726218533 >> [v2:172.21.15.39:6800/1725006999,v1:172.21.15.39:6801/1725006999] conn(0x7feb400a2b80 0x7feb400a5040 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7feb5806b870 tx=0x7feb4c006c90 comp rx=0 tx=0).stop 2024-09-12T02:32:18.957 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T02:32:18.957+0000 7feb5e9ce640 1 -- 172.21.15.44:0/2726218533 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7feb58100b10 msgr2=0x7feb5806b2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:32:18.957 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T02:32:18.957+0000 7feb5e9ce640 1 --2- 172.21.15.44:0/2726218533 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7feb58100b10 0x7feb5806b2f0 secure :-1 s=READY pgs=40 cs=0 l=1 rev1=1 crypto rx=0x7feb48031610 tx=0x7feb480043b0 comp rx=0 tx=0).stop 2024-09-12T02:32:18.957 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T02:32:18.957+0000 7feb5e9ce640 1 -- 172.21.15.44:0/2726218533 shutdown_connections 2024-09-12T02:32:18.957 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T02:32:18.957+0000 7feb5e9ce640 1 --2- 172.21.15.44:0/2726218533 >> [v2:172.21.15.39:6800/1725006999,v1:172.21.15.39:6801/1725006999] conn(0x7feb400a2b80 0x7feb400a5040 unknown :-1 s=CLOSED pgs=89 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:32:18.958 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T02:32:18.957+0000 7feb5e9ce640 1 --2- 172.21.15.44:0/2726218533 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7feb581026d0 0x7feb5819f290 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:32:18.958 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T02:32:18.957+0000 7feb5e9ce640 1 --2- 172.21.15.44:0/2726218533 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7feb58101d10 0x7feb5819cc70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:32:18.958 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T02:32:18.957+0000 7feb5e9ce640 1 --2- 172.21.15.44:0/2726218533 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7feb58100b10 0x7feb5806b2f0 unknown :-1 s=CLOSED pgs=40 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:32:18.958 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T02:32:18.957+0000 7feb5e9ce640 1 -- 172.21.15.44:0/2726218533 >> 172.21.15.44:0/2726218533 conn(0x7feb580fc2a0 msgr2=0x7feb58105130 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:32:18.958 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T02:32:18.957+0000 7feb5e9ce640 1 -- 172.21.15.44:0/2726218533 shutdown_connections 2024-09-12T02:32:18.958 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T02:32:18.957+0000 7feb5e9ce640 1 -- 172.21.15.44:0/2726218533 wait complete. 2024-09-12T02:32:19.588 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 12 02:32:19 smithi044 ceph-mon[35411]: from='mgr.14150 172.21.15.39:0/408627207' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-12T02:32:19.588 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 12 02:32:19 smithi044 ceph-mon[35411]: from='mgr.14150 172.21.15.39:0/408627207' entity='mgr.x' 2024-09-12T02:32:19.588 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 12 02:32:19 smithi044 ceph-mon[35411]: from='mgr.14150 172.21.15.39:0/408627207' entity='mgr.x' 2024-09-12T02:32:19.616 DEBUG:teuthology.orchestra.run.smithi044:osd.7> sudo journalctl -f -n 0 -u ceph-4954ed46-70ae-11ef-bcea-c7b262605968@osd.7.service 2024-09-12T02:32:19.618 INFO:tasks.cephadm:Deploying osd.8 on smithi172 with /dev/vg_nvme/lv_2... 2024-09-12T02:32:19.618 DEBUG:teuthology.orchestra.run.smithi172:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc ceph-volume -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 4954ed46-70ae-11ef-bcea-c7b262605968 -- lvm zap /dev/vg_nvme/lv_2 2024-09-12T02:32:19.763 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 12 02:32:19 smithi172 ceph-mon[35609]: from='mgr.14150 172.21.15.39:0/408627207' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-12T02:32:19.763 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 12 02:32:19 smithi172 ceph-mon[35609]: from='mgr.14150 172.21.15.39:0/408627207' entity='mgr.x' 2024-09-12T02:32:19.764 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 12 02:32:19 smithi172 ceph-mon[35609]: from='mgr.14150 172.21.15.39:0/408627207' entity='mgr.x' 2024-09-12T02:32:19.849 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 02:32:19 smithi039 ceph-mon[30515]: from='mgr.14150 172.21.15.39:0/408627207' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-12T02:32:19.850 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 02:32:19 smithi039 ceph-mon[30515]: from='mgr.14150 172.21.15.39:0/408627207' entity='mgr.x' 2024-09-12T02:32:19.850 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 02:32:19 smithi039 ceph-mon[30515]: from='mgr.14150 172.21.15.39:0/408627207' entity='mgr.x' 2024-09-12T02:32:19.875 INFO:teuthology.orchestra.run.smithi172.stderr:Inferring config /var/lib/ceph/4954ed46-70ae-11ef-bcea-c7b262605968/mon.c/config 2024-09-12T02:32:20.513 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 12 02:32:20 smithi172 ceph-mon[35609]: pgmap v174: 1 pgs: 1 active+clean; 577 KiB data, 206 MiB used, 626 GiB / 626 GiB avail 2024-09-12T02:32:20.803 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 12 02:32:20 smithi044 ceph-mon[35411]: pgmap v174: 1 pgs: 1 active+clean; 577 KiB data, 206 MiB used, 626 GiB / 626 GiB avail 2024-09-12T02:32:20.849 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 02:32:20 smithi039 ceph-mon[30515]: pgmap v174: 1 pgs: 1 active+clean; 577 KiB data, 206 MiB used, 626 GiB / 626 GiB avail 2024-09-12T02:32:22.199 INFO:journalctl@ceph.osd.7.smithi044.stdout:Sep 12 02:32:21 smithi044 ceph-4954ed46-70ae-11ef-bcea-c7b262605968-osd-7[52975]: 2024-09-12T02:32:21.794+0000 7fa7342fd640 -1 osd.7 0 log_to_monitors true 2024-09-12T02:32:22.387 INFO:teuthology.orchestra.run.smithi172.stdout: 2024-09-12T02:32:22.416 DEBUG:teuthology.orchestra.run.smithi172:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 4954ed46-70ae-11ef-bcea-c7b262605968 -- ceph orch daemon add osd smithi172:vg_nvme/lv_2 2024-09-12T02:32:22.678 INFO:teuthology.orchestra.run.smithi172.stderr:Inferring config /var/lib/ceph/4954ed46-70ae-11ef-bcea-c7b262605968/mon.c/config 2024-09-12T02:32:22.700 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 12 02:32:22 smithi172 ceph-mon[35609]: pgmap v175: 1 pgs: 1 active+clean; 577 KiB data, 206 MiB used, 626 GiB / 626 GiB avail 2024-09-12T02:32:22.700 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 12 02:32:22 smithi172 ceph-mon[35609]: from='osd.7 [v2:172.21.15.44:6816/709635079,v1:172.21.15.44:6817/709635079]' entity='osd.7' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["7"]}]: dispatch 2024-09-12T02:32:22.700 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 12 02:32:22 smithi172 ceph-mon[35609]: from='osd.7 ' entity='osd.7' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["7"]}]: dispatch 2024-09-12T02:32:22.857 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 02:32:22 smithi039 ceph-mon[30515]: pgmap v175: 1 pgs: 1 active+clean; 577 KiB data, 206 MiB used, 626 GiB / 626 GiB avail 2024-09-12T02:32:22.857 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 02:32:22 smithi039 ceph-mon[30515]: from='osd.7 [v2:172.21.15.44:6816/709635079,v1:172.21.15.44:6817/709635079]' entity='osd.7' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["7"]}]: dispatch 2024-09-12T02:32:22.857 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 02:32:22 smithi039 ceph-mon[30515]: from='osd.7 ' entity='osd.7' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["7"]}]: dispatch 2024-09-12T02:32:22.949 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 12 02:32:22 smithi044 ceph-mon[35411]: pgmap v175: 1 pgs: 1 active+clean; 577 KiB data, 206 MiB used, 626 GiB / 626 GiB avail 2024-09-12T02:32:22.949 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 12 02:32:22 smithi044 ceph-mon[35411]: from='osd.7 [v2:172.21.15.44:6816/709635079,v1:172.21.15.44:6817/709635079]' entity='osd.7' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["7"]}]: dispatch 2024-09-12T02:32:22.949 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 12 02:32:22 smithi044 ceph-mon[35411]: from='osd.7 ' entity='osd.7' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["7"]}]: dispatch 2024-09-12T02:32:23.168 INFO:teuthology.orchestra.run.smithi172.stderr:2024-09-12T02:32:23.164+0000 7ff2d6462640 1 -- 172.21.15.172:0/1420392979 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7ff2d010e1f0 msgr2=0x7ff2d0114a80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:32:23.168 INFO:teuthology.orchestra.run.smithi172.stderr:2024-09-12T02:32:23.164+0000 7ff2d6462640 1 --2- 172.21.15.172:0/1420392979 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7ff2d010e1f0 0x7ff2d0114a80 secure :-1 s=READY pgs=32 cs=0 l=1 rev1=1 crypto rx=0x7ff2c8009ca0 tx=0x7ff2c802a8c0 comp rx=0 tx=0).stop 2024-09-12T02:32:23.168 INFO:teuthology.orchestra.run.smithi172.stderr:2024-09-12T02:32:23.165+0000 7ff2d6462640 1 -- 172.21.15.172:0/1420392979 shutdown_connections 2024-09-12T02:32:23.168 INFO:teuthology.orchestra.run.smithi172.stderr:2024-09-12T02:32:23.165+0000 7ff2d6462640 1 --2- 172.21.15.172:0/1420392979 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7ff2d010e1f0 0x7ff2d0114a80 unknown :-1 s=CLOSED pgs=32 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:32:23.168 INFO:teuthology.orchestra.run.smithi172.stderr:2024-09-12T02:32:23.165+0000 7ff2d6462640 1 --2- 172.21.15.172:0/1420392979 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7ff2d010d830 0x7ff2d010dcb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:32:23.168 INFO:teuthology.orchestra.run.smithi172.stderr:2024-09-12T02:32:23.165+0000 7ff2d6462640 1 --2- 172.21.15.172:0/1420392979 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7ff2d010c640 0x7ff2d010ca40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:32:23.168 INFO:teuthology.orchestra.run.smithi172.stderr:2024-09-12T02:32:23.165+0000 7ff2d6462640 1 -- 172.21.15.172:0/1420392979 >> 172.21.15.172:0/1420392979 conn(0x7ff2d006c860 msgr2=0x7ff2d006cc90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:32:23.168 INFO:teuthology.orchestra.run.smithi172.stderr:2024-09-12T02:32:23.165+0000 7ff2d6462640 1 -- 172.21.15.172:0/1420392979 shutdown_connections 2024-09-12T02:32:23.168 INFO:teuthology.orchestra.run.smithi172.stderr:2024-09-12T02:32:23.165+0000 7ff2d6462640 1 -- 172.21.15.172:0/1420392979 wait complete. 2024-09-12T02:32:23.168 INFO:teuthology.orchestra.run.smithi172.stderr:2024-09-12T02:32:23.165+0000 7ff2d6462640 1 Processor -- start 2024-09-12T02:32:23.169 INFO:teuthology.orchestra.run.smithi172.stderr:2024-09-12T02:32:23.165+0000 7ff2d6462640 1 -- start start 2024-09-12T02:32:23.169 INFO:teuthology.orchestra.run.smithi172.stderr:2024-09-12T02:32:23.166+0000 7ff2d6462640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7ff2d010c640 0x7ff2d01a2a20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:32:23.169 INFO:teuthology.orchestra.run.smithi172.stderr:2024-09-12T02:32:23.166+0000 7ff2d6462640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7ff2d010d830 0x7ff2d01a2f60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:32:23.169 INFO:teuthology.orchestra.run.smithi172.stderr:2024-09-12T02:32:23.166+0000 7ff2d6462640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7ff2d010e1f0 0x7ff2d01a9fe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:32:23.169 INFO:teuthology.orchestra.run.smithi172.stderr:2024-09-12T02:32:23.166+0000 7ff2d6462640 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 -- 0x7ff2d01183d0 con 0x7ff2d010c640 2024-09-12T02:32:23.169 INFO:teuthology.orchestra.run.smithi172.stderr:2024-09-12T02:32:23.166+0000 7ff2d6462640 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x7ff2d0118250 con 0x7ff2d010d830 2024-09-12T02:32:23.169 INFO:teuthology.orchestra.run.smithi172.stderr:2024-09-12T02:32:23.166+0000 7ff2d6462640 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7ff2d0118550 con 0x7ff2d010e1f0 2024-09-12T02:32:23.169 INFO:teuthology.orchestra.run.smithi172.stderr:2024-09-12T02:32:23.166+0000 7ff2d49ff640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7ff2d010e1f0 0x7ff2d01a9fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:32:23.169 INFO:teuthology.orchestra.run.smithi172.stderr:2024-09-12T02:32:23.166+0000 7ff2d49ff640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7ff2d010e1f0 0x7ff2d01a9fe0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.172:3300/0 says I am v2:172.21.15.172:54278/0 (socket says 172.21.15.172:54278) 2024-09-12T02:32:23.169 INFO:teuthology.orchestra.run.smithi172.stderr:2024-09-12T02:32:23.166+0000 7ff2d49ff640 1 -- 172.21.15.172:0/2735984586 learned_addr learned my addr 172.21.15.172:0/2735984586 (peer_addr_for_me v2:172.21.15.172:0/0) 2024-09-12T02:32:23.169 INFO:teuthology.orchestra.run.smithi172.stderr:2024-09-12T02:32:23.166+0000 7ff2cf7fe640 1 --2- 172.21.15.172:0/2735984586 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7ff2d010d830 0x7ff2d01a2f60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:32:23.169 INFO:teuthology.orchestra.run.smithi172.stderr:2024-09-12T02:32:23.166+0000 7ff2cffff640 1 --2- 172.21.15.172:0/2735984586 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7ff2d010c640 0x7ff2d01a2a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:32:23.169 INFO:teuthology.orchestra.run.smithi172.stderr:2024-09-12T02:32:23.166+0000 7ff2d49ff640 1 -- 172.21.15.172:0/2735984586 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7ff2d010d830 msgr2=0x7ff2d01a2f60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:32:23.169 INFO:teuthology.orchestra.run.smithi172.stderr:2024-09-12T02:32:23.166+0000 7ff2d49ff640 1 --2- 172.21.15.172:0/2735984586 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7ff2d010d830 0x7ff2d01a2f60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:32:23.171 INFO:teuthology.orchestra.run.smithi172.stderr:2024-09-12T02:32:23.166+0000 7ff2d49ff640 1 -- 172.21.15.172:0/2735984586 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7ff2d010c640 msgr2=0x7ff2d01a2a20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:32:23.171 INFO:teuthology.orchestra.run.smithi172.stderr:2024-09-12T02:32:23.166+0000 7ff2d49ff640 1 --2- 172.21.15.172:0/2735984586 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7ff2d010c640 0x7ff2d01a2a20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:32:23.171 INFO:teuthology.orchestra.run.smithi172.stderr:2024-09-12T02:32:23.166+0000 7ff2d49ff640 1 -- 172.21.15.172:0/2735984586 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff2d01aa650 con 0x7ff2d010e1f0 2024-09-12T02:32:23.171 INFO:teuthology.orchestra.run.smithi172.stderr:2024-09-12T02:32:23.166+0000 7ff2d49ff640 1 --2- 172.21.15.172:0/2735984586 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7ff2d010e1f0 0x7ff2d01a9fe0 secure :-1 s=READY pgs=33 cs=0 l=1 rev1=1 crypto rx=0x7ff2c80319f0 tx=0x7ff2c8003970 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:32:23.171 INFO:teuthology.orchestra.run.smithi172.stderr:2024-09-12T02:32:23.167+0000 7ff2cd7fa640 1 -- 172.21.15.172:0/2735984586 <== mon.1 v2:172.21.15.172:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff2c8003d90 con 0x7ff2d010e1f0 2024-09-12T02:32:23.172 INFO:teuthology.orchestra.run.smithi172.stderr:2024-09-12T02:32:23.167+0000 7ff2d6462640 1 -- 172.21.15.172:0/2735984586 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff2d01aa8e0 con 0x7ff2d010e1f0 2024-09-12T02:32:23.172 INFO:teuthology.orchestra.run.smithi172.stderr:2024-09-12T02:32:23.167+0000 7ff2cd7fa640 1 -- 172.21.15.172:0/2735984586 <== mon.1 v2:172.21.15.172:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7ff2c8004520 con 0x7ff2d010e1f0 2024-09-12T02:32:23.172 INFO:teuthology.orchestra.run.smithi172.stderr:2024-09-12T02:32:23.167+0000 7ff2cd7fa640 1 -- 172.21.15.172:0/2735984586 <== mon.1 v2:172.21.15.172:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff2c802fda0 con 0x7ff2d010e1f0 2024-09-12T02:32:23.172 INFO:teuthology.orchestra.run.smithi172.stderr:2024-09-12T02:32:23.167+0000 7ff2d6462640 1 -- 172.21.15.172:0/2735984586 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff2d01aaef0 con 0x7ff2d010e1f0 2024-09-12T02:32:23.172 INFO:teuthology.orchestra.run.smithi172.stderr:2024-09-12T02:32:23.168+0000 7ff2d6462640 1 -- 172.21.15.172:0/2735984586 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ff2d0113a20 con 0x7ff2d010e1f0 2024-09-12T02:32:23.172 INFO:teuthology.orchestra.run.smithi172.stderr:2024-09-12T02:32:23.169+0000 7ff2cd7fa640 1 -- 172.21.15.172:0/2735984586 <== mon.1 v2:172.21.15.172:3300/0 4 ==== mgrmap(e 16) ==== 137833+0+0 (secure 0 0 0) 0x7ff2c8004040 con 0x7ff2d010e1f0 2024-09-12T02:32:23.172 INFO:teuthology.orchestra.run.smithi172.stderr:2024-09-12T02:32:23.169+0000 7ff2cd7fa640 1 --2- 172.21.15.172:0/2735984586 >> [v2:172.21.15.39:6800/1725006999,v1:172.21.15.39:6801/1725006999] conn(0x7ff2b80a2bb0 0x7ff2b80a5070 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:32:23.172 INFO:teuthology.orchestra.run.smithi172.stderr:2024-09-12T02:32:23.169+0000 7ff2cd7fa640 1 -- 172.21.15.172:0/2735984586 <== mon.1 v2:172.21.15.172:3300/0 5 ==== osd_map(48..48 src has 1..48) ==== 5101+0+0 (secure 0 0 0) 0x7ff2c80ef980 con 0x7ff2d010e1f0 2024-09-12T02:32:23.172 INFO:teuthology.orchestra.run.smithi172.stderr:2024-09-12T02:32:23.170+0000 7ff2cffff640 1 --2- 172.21.15.172:0/2735984586 >> [v2:172.21.15.39:6800/1725006999,v1:172.21.15.39:6801/1725006999] conn(0x7ff2b80a2bb0 0x7ff2b80a5070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:32:23.172 INFO:teuthology.orchestra.run.smithi172.stderr:2024-09-12T02:32:23.171+0000 7ff2cffff640 1 --2- 172.21.15.172:0/2735984586 >> [v2:172.21.15.39:6800/1725006999,v1:172.21.15.39:6801/1725006999] conn(0x7ff2b80a2bb0 0x7ff2b80a5070 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0x7ff2d010d340 tx=0x7ff2c0009110 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:32:23.174 INFO:teuthology.orchestra.run.smithi172.stderr:2024-09-12T02:32:23.174+0000 7ff2cd7fa640 1 -- 172.21.15.172:0/2735984586 <== mon.1 v2:172.21.15.172:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7ff2c80bd570 con 0x7ff2d010e1f0 2024-09-12T02:32:23.357 INFO:teuthology.orchestra.run.smithi172.stderr:2024-09-12T02:32:23.356+0000 7ff2d6462640 1 -- 172.21.15.172:0/2735984586 --> [v2:172.21.15.39:6800/1725006999,v1:172.21.15.39:6801/1725006999] -- mgr_command(tid 0: {"prefix": "orch daemon add osd", "svc_arg": "smithi172:vg_nvme/lv_2", "target": ["mon-mgr", ""]}) -- 0x7ff2d0062630 con 0x7ff2b80a2bb0 2024-09-12T02:32:23.706 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 12 02:32:23 smithi172 ceph-mon[35609]: from='osd.7 ' entity='osd.7' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["7"]}]': finished 2024-09-12T02:32:23.706 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 12 02:32:23 smithi172 ceph-mon[35609]: from='osd.7 [v2:172.21.15.44:6816/709635079,v1:172.21.15.44:6817/709635079]' entity='osd.7' cmd=[{"prefix": "osd crush create-or-move", "id": 7, "weight":0.0873, "args": ["host=smithi044", "root=default"]}]: dispatch 2024-09-12T02:32:23.706 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 12 02:32:23 smithi172 ceph-mon[35609]: osdmap e48: 8 total, 7 up, 8 in 2024-09-12T02:32:23.706 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 12 02:32:23 smithi172 ceph-mon[35609]: from='mgr.14150 172.21.15.39:0/408627207' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 7}]: dispatch 2024-09-12T02:32:23.706 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 12 02:32:23 smithi172 ceph-mon[35609]: from='osd.7 ' entity='osd.7' cmd=[{"prefix": "osd crush create-or-move", "id": 7, "weight":0.0873, "args": ["host=smithi044", "root=default"]}]: dispatch 2024-09-12T02:32:23.707 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 12 02:32:23 smithi172 ceph-mon[35609]: Detected new or changed devices on smithi044 2024-09-12T02:32:23.707 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 12 02:32:23 smithi172 ceph-mon[35609]: from='mgr.14150 172.21.15.39:0/408627207' entity='mgr.x' 2024-09-12T02:32:23.707 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 12 02:32:23 smithi172 ceph-mon[35609]: from='mgr.14150 172.21.15.39:0/408627207' entity='mgr.x' 2024-09-12T02:32:23.707 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 12 02:32:23 smithi172 ceph-mon[35609]: from='mgr.14150 172.21.15.39:0/408627207' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2024-09-12T02:32:23.707 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 12 02:32:23 smithi172 ceph-mon[35609]: from='mgr.14150 172.21.15.39:0/408627207' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2024-09-12T02:32:23.707 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 12 02:32:23 smithi172 ceph-mon[35609]: from='mgr.14150 172.21.15.39:0/408627207' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"}]: dispatch 2024-09-12T02:32:23.707 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 12 02:32:23 smithi172 ceph-mon[35609]: Adjusting osd_memory_target on smithi044 to 5697M 2024-09-12T02:32:23.707 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 12 02:32:23 smithi172 ceph-mon[35609]: from='mgr.14150 172.21.15.39:0/408627207' entity='mgr.x' 2024-09-12T02:32:23.707 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 12 02:32:23 smithi172 ceph-mon[35609]: from='mgr.14150 172.21.15.39:0/408627207' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-12T02:32:23.707 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 12 02:32:23 smithi172 ceph-mon[35609]: from='mgr.14150 172.21.15.39:0/408627207' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-12T02:32:23.707 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 12 02:32:23 smithi172 ceph-mon[35609]: from='mgr.14150 172.21.15.39:0/408627207' entity='mgr.x' 2024-09-12T02:32:23.707 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 12 02:32:23 smithi172 ceph-mon[35609]: from='mgr.14150 172.21.15.39:0/408627207' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-09-12T02:32:23.707 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 12 02:32:23 smithi172 ceph-mon[35609]: from='mgr.14150 172.21.15.39:0/408627207' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-09-12T02:32:23.708 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 12 02:32:23 smithi172 ceph-mon[35609]: from='mgr.14150 172.21.15.39:0/408627207' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-12T02:32:23.708 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 12 02:32:23 smithi172 ceph-mon[35609]: from='osd.7 ' entity='osd.7' cmd='[{"prefix": "osd crush create-or-move", "id": 7, "weight":0.0873, "args": ["host=smithi044", "root=default"]}]': finished 2024-09-12T02:32:23.708 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 12 02:32:23 smithi172 ceph-mon[35609]: osdmap e49: 8 total, 7 up, 8 in 2024-09-12T02:32:23.850 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 02:32:23 smithi039 ceph-mon[30515]: from='osd.7 ' entity='osd.7' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["7"]}]': finished 2024-09-12T02:32:23.850 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 02:32:23 smithi039 ceph-mon[30515]: from='osd.7 [v2:172.21.15.44:6816/709635079,v1:172.21.15.44:6817/709635079]' entity='osd.7' cmd=[{"prefix": "osd crush create-or-move", "id": 7, "weight":0.0873, "args": ["host=smithi044", "root=default"]}]: dispatch 2024-09-12T02:32:23.850 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 02:32:23 smithi039 ceph-mon[30515]: osdmap e48: 8 total, 7 up, 8 in 2024-09-12T02:32:23.850 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 02:32:23 smithi039 ceph-mon[30515]: from='mgr.14150 172.21.15.39:0/408627207' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 7}]: dispatch 2024-09-12T02:32:23.850 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 02:32:23 smithi039 ceph-mon[30515]: from='osd.7 ' entity='osd.7' cmd=[{"prefix": "osd crush create-or-move", "id": 7, "weight":0.0873, "args": ["host=smithi044", "root=default"]}]: dispatch 2024-09-12T02:32:23.850 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 02:32:23 smithi039 ceph-mon[30515]: Detected new or changed devices on smithi044 2024-09-12T02:32:23.850 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 02:32:23 smithi039 ceph-mon[30515]: from='mgr.14150 172.21.15.39:0/408627207' entity='mgr.x' 2024-09-12T02:32:23.850 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 02:32:23 smithi039 ceph-mon[30515]: from='mgr.14150 172.21.15.39:0/408627207' entity='mgr.x' 2024-09-12T02:32:23.850 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 02:32:23 smithi039 ceph-mon[30515]: from='mgr.14150 172.21.15.39:0/408627207' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2024-09-12T02:32:23.850 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 02:32:23 smithi039 ceph-mon[30515]: from='mgr.14150 172.21.15.39:0/408627207' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2024-09-12T02:32:23.851 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 02:32:23 smithi039 ceph-mon[30515]: from='mgr.14150 172.21.15.39:0/408627207' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"}]: dispatch 2024-09-12T02:32:23.851 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 02:32:23 smithi039 ceph-mon[30515]: Adjusting osd_memory_target on smithi044 to 5697M 2024-09-12T02:32:23.851 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 02:32:23 smithi039 ceph-mon[30515]: from='mgr.14150 172.21.15.39:0/408627207' entity='mgr.x' 2024-09-12T02:32:23.851 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 02:32:23 smithi039 ceph-mon[30515]: from='mgr.14150 172.21.15.39:0/408627207' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-12T02:32:23.851 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 02:32:23 smithi039 ceph-mon[30515]: from='mgr.14150 172.21.15.39:0/408627207' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-12T02:32:23.851 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 02:32:23 smithi039 ceph-mon[30515]: from='mgr.14150 172.21.15.39:0/408627207' entity='mgr.x' 2024-09-12T02:32:23.851 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 02:32:23 smithi039 ceph-mon[30515]: from='mgr.14150 172.21.15.39:0/408627207' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-09-12T02:32:23.851 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 02:32:23 smithi039 ceph-mon[30515]: from='mgr.14150 172.21.15.39:0/408627207' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-09-12T02:32:23.851 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 02:32:23 smithi039 ceph-mon[30515]: from='mgr.14150 172.21.15.39:0/408627207' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-12T02:32:23.851 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 02:32:23 smithi039 ceph-mon[30515]: from='osd.7 ' entity='osd.7' cmd='[{"prefix": "osd crush create-or-move", "id": 7, "weight":0.0873, "args": ["host=smithi044", "root=default"]}]': finished 2024-09-12T02:32:23.851 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 02:32:23 smithi039 ceph-mon[30515]: osdmap e49: 8 total, 7 up, 8 in 2024-09-12T02:32:23.948 INFO:journalctl@ceph.osd.7.smithi044.stdout:Sep 12 02:32:23 smithi044 ceph-4954ed46-70ae-11ef-bcea-c7b262605968-osd-7[52975]: 2024-09-12T02:32:23.520+0000 7fa730280640 -1 osd.7 0 waiting for initial osdmap 2024-09-12T02:32:23.949 INFO:journalctl@ceph.osd.7.smithi044.stdout:Sep 12 02:32:23 smithi044 ceph-4954ed46-70ae-11ef-bcea-c7b262605968-osd-7[52975]: 2024-09-12T02:32:23.533+0000 7fa72c0a8640 -1 osd.7 49 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-09-12T02:32:23.949 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 12 02:32:23 smithi044 ceph-mon[35411]: from='osd.7 ' entity='osd.7' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["7"]}]': finished 2024-09-12T02:32:23.949 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 12 02:32:23 smithi044 ceph-mon[35411]: from='osd.7 [v2:172.21.15.44:6816/709635079,v1:172.21.15.44:6817/709635079]' entity='osd.7' cmd=[{"prefix": "osd crush create-or-move", "id": 7, "weight":0.0873, "args": ["host=smithi044", "root=default"]}]: dispatch 2024-09-12T02:32:23.949 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 12 02:32:23 smithi044 ceph-mon[35411]: osdmap e48: 8 total, 7 up, 8 in 2024-09-12T02:32:23.949 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 12 02:32:23 smithi044 ceph-mon[35411]: from='mgr.14150 172.21.15.39:0/408627207' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 7}]: dispatch 2024-09-12T02:32:23.949 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 12 02:32:23 smithi044 ceph-mon[35411]: from='osd.7 ' entity='osd.7' cmd=[{"prefix": "osd crush create-or-move", "id": 7, "weight":0.0873, "args": ["host=smithi044", "root=default"]}]: dispatch 2024-09-12T02:32:23.949 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 12 02:32:23 smithi044 ceph-mon[35411]: Detected new or changed devices on smithi044 2024-09-12T02:32:23.950 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 12 02:32:23 smithi044 ceph-mon[35411]: from='mgr.14150 172.21.15.39:0/408627207' entity='mgr.x' 2024-09-12T02:32:23.950 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 12 02:32:23 smithi044 ceph-mon[35411]: from='mgr.14150 172.21.15.39:0/408627207' entity='mgr.x' 2024-09-12T02:32:23.950 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 12 02:32:23 smithi044 ceph-mon[35411]: from='mgr.14150 172.21.15.39:0/408627207' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2024-09-12T02:32:23.950 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 12 02:32:23 smithi044 ceph-mon[35411]: from='mgr.14150 172.21.15.39:0/408627207' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2024-09-12T02:32:23.950 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 12 02:32:23 smithi044 ceph-mon[35411]: from='mgr.14150 172.21.15.39:0/408627207' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"}]: dispatch 2024-09-12T02:32:23.950 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 12 02:32:23 smithi044 ceph-mon[35411]: Adjusting osd_memory_target on smithi044 to 5697M 2024-09-12T02:32:23.950 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 12 02:32:23 smithi044 ceph-mon[35411]: from='mgr.14150 172.21.15.39:0/408627207' entity='mgr.x' 2024-09-12T02:32:23.951 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 12 02:32:23 smithi044 ceph-mon[35411]: from='mgr.14150 172.21.15.39:0/408627207' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-12T02:32:23.951 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 12 02:32:23 smithi044 ceph-mon[35411]: from='mgr.14150 172.21.15.39:0/408627207' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-12T02:32:23.951 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 12 02:32:23 smithi044 ceph-mon[35411]: from='mgr.14150 172.21.15.39:0/408627207' entity='mgr.x' 2024-09-12T02:32:23.951 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 12 02:32:23 smithi044 ceph-mon[35411]: from='mgr.14150 172.21.15.39:0/408627207' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-09-12T02:32:23.951 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 12 02:32:23 smithi044 ceph-mon[35411]: from='mgr.14150 172.21.15.39:0/408627207' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-09-12T02:32:23.951 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 12 02:32:23 smithi044 ceph-mon[35411]: from='mgr.14150 172.21.15.39:0/408627207' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-12T02:32:23.951 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 12 02:32:23 smithi044 ceph-mon[35411]: from='osd.7 ' entity='osd.7' cmd='[{"prefix": "osd crush create-or-move", "id": 7, "weight":0.0873, "args": ["host=smithi044", "root=default"]}]': finished 2024-09-12T02:32:23.951 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 12 02:32:23 smithi044 ceph-mon[35411]: osdmap e49: 8 total, 7 up, 8 in 2024-09-12T02:32:24.764 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 12 02:32:24 smithi172 ceph-mon[35609]: pgmap v177: 1 pgs: 1 active+clean; 577 KiB data, 206 MiB used, 626 GiB / 626 GiB avail 2024-09-12T02:32:24.764 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 12 02:32:24 smithi172 ceph-mon[35609]: from='client.24301 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi172:vg_nvme/lv_2", "target": ["mon-mgr", ""]}]: dispatch 2024-09-12T02:32:24.764 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 12 02:32:24 smithi172 ceph-mon[35609]: from='mgr.14150 172.21.15.39:0/408627207' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 7}]: dispatch 2024-09-12T02:32:24.849 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 02:32:24 smithi039 ceph-mon[30515]: pgmap v177: 1 pgs: 1 active+clean; 577 KiB data, 206 MiB used, 626 GiB / 626 GiB avail 2024-09-12T02:32:24.849 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 02:32:24 smithi039 ceph-mon[30515]: from='client.24301 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi172:vg_nvme/lv_2", "target": ["mon-mgr", ""]}]: dispatch 2024-09-12T02:32:24.850 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 02:32:24 smithi039 ceph-mon[30515]: from='mgr.14150 172.21.15.39:0/408627207' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 7}]: dispatch 2024-09-12T02:32:24.948 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 12 02:32:24 smithi044 ceph-mon[35411]: pgmap v177: 1 pgs: 1 active+clean; 577 KiB data, 206 MiB used, 626 GiB / 626 GiB avail 2024-09-12T02:32:24.948 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 12 02:32:24 smithi044 ceph-mon[35411]: from='client.24301 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi172:vg_nvme/lv_2", "target": ["mon-mgr", ""]}]: dispatch 2024-09-12T02:32:24.949 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 12 02:32:24 smithi044 ceph-mon[35411]: from='mgr.14150 172.21.15.39:0/408627207' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 7}]: dispatch 2024-09-12T02:32:25.763 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 12 02:32:25 smithi172 ceph-mon[35609]: purged_snaps scrub starts 2024-09-12T02:32:25.764 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 12 02:32:25 smithi172 ceph-mon[35609]: purged_snaps scrub ok 2024-09-12T02:32:25.764 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 12 02:32:25 smithi172 ceph-mon[35609]: osd.7 [v2:172.21.15.44:6816/709635079,v1:172.21.15.44:6817/709635079] boot 2024-09-12T02:32:25.764 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 12 02:32:25 smithi172 ceph-mon[35609]: osdmap e50: 8 total, 8 up, 8 in 2024-09-12T02:32:25.764 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 12 02:32:25 smithi172 ceph-mon[35609]: from='mgr.14150 172.21.15.39:0/408627207' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 7}]: dispatch 2024-09-12T02:32:25.849 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 02:32:25 smithi039 ceph-mon[30515]: purged_snaps scrub starts 2024-09-12T02:32:25.850 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 02:32:25 smithi039 ceph-mon[30515]: purged_snaps scrub ok 2024-09-12T02:32:25.850 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 02:32:25 smithi039 ceph-mon[30515]: osd.7 [v2:172.21.15.44:6816/709635079,v1:172.21.15.44:6817/709635079] boot 2024-09-12T02:32:25.850 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 02:32:25 smithi039 ceph-mon[30515]: osdmap e50: 8 total, 8 up, 8 in 2024-09-12T02:32:25.850 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 02:32:25 smithi039 ceph-mon[30515]: from='mgr.14150 172.21.15.39:0/408627207' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 7}]: dispatch 2024-09-12T02:32:25.949 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 12 02:32:25 smithi044 ceph-mon[35411]: purged_snaps scrub starts 2024-09-12T02:32:25.949 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 12 02:32:25 smithi044 ceph-mon[35411]: purged_snaps scrub ok 2024-09-12T02:32:25.949 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 12 02:32:25 smithi044 ceph-mon[35411]: osd.7 [v2:172.21.15.44:6816/709635079,v1:172.21.15.44:6817/709635079] boot 2024-09-12T02:32:25.949 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 12 02:32:25 smithi044 ceph-mon[35411]: osdmap e50: 8 total, 8 up, 8 in 2024-09-12T02:32:25.950 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 12 02:32:25 smithi044 ceph-mon[35411]: from='mgr.14150 172.21.15.39:0/408627207' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 7}]: dispatch 2024-09-12T02:32:26.763 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 12 02:32:26 smithi172 ceph-mon[35609]: pgmap v180: 1 pgs: 1 active+clean; 577 KiB data, 206 MiB used, 626 GiB / 626 GiB avail 2024-09-12T02:32:26.764 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 12 02:32:26 smithi172 ceph-mon[35609]: osdmap e51: 8 total, 8 up, 8 in 2024-09-12T02:32:26.764 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 12 02:32:26 smithi172 ceph-mon[35609]: from='client.? 172.21.15.172:0/3559150976' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "2f6fb5c7-86cc-43eb-bdfb-45a69316937e"}]: dispatch 2024-09-12T02:32:26.764 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 12 02:32:26 smithi172 ceph-mon[35609]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "2f6fb5c7-86cc-43eb-bdfb-45a69316937e"}]: dispatch 2024-09-12T02:32:26.764 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 12 02:32:26 smithi172 ceph-mon[35609]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "2f6fb5c7-86cc-43eb-bdfb-45a69316937e"}]': finished 2024-09-12T02:32:26.764 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 12 02:32:26 smithi172 ceph-mon[35609]: osdmap e52: 9 total, 8 up, 9 in 2024-09-12T02:32:26.764 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 12 02:32:26 smithi172 ceph-mon[35609]: from='mgr.14150 172.21.15.39:0/408627207' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 8}]: dispatch 2024-09-12T02:32:26.764 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 12 02:32:26 smithi172 ceph-mon[35609]: from='client.? 172.21.15.172:0/3188040482' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-09-12T02:32:26.849 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 02:32:26 smithi039 ceph-mon[30515]: pgmap v180: 1 pgs: 1 active+clean; 577 KiB data, 206 MiB used, 626 GiB / 626 GiB avail 2024-09-12T02:32:26.850 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 02:32:26 smithi039 ceph-mon[30515]: osdmap e51: 8 total, 8 up, 8 in 2024-09-12T02:32:26.850 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 02:32:26 smithi039 ceph-mon[30515]: from='client.? 172.21.15.172:0/3559150976' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "2f6fb5c7-86cc-43eb-bdfb-45a69316937e"}]: dispatch 2024-09-12T02:32:26.850 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 02:32:26 smithi039 ceph-mon[30515]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "2f6fb5c7-86cc-43eb-bdfb-45a69316937e"}]: dispatch 2024-09-12T02:32:26.850 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 02:32:26 smithi039 ceph-mon[30515]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "2f6fb5c7-86cc-43eb-bdfb-45a69316937e"}]': finished 2024-09-12T02:32:26.850 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 02:32:26 smithi039 ceph-mon[30515]: osdmap e52: 9 total, 8 up, 9 in 2024-09-12T02:32:26.850 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 02:32:26 smithi039 ceph-mon[30515]: from='mgr.14150 172.21.15.39:0/408627207' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 8}]: dispatch 2024-09-12T02:32:26.850 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 02:32:26 smithi039 ceph-mon[30515]: from='client.? 172.21.15.172:0/3188040482' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-09-12T02:32:26.948 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 12 02:32:26 smithi044 ceph-mon[35411]: pgmap v180: 1 pgs: 1 active+clean; 577 KiB data, 206 MiB used, 626 GiB / 626 GiB avail 2024-09-12T02:32:26.949 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 12 02:32:26 smithi044 ceph-mon[35411]: osdmap e51: 8 total, 8 up, 8 in 2024-09-12T02:32:26.949 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 12 02:32:26 smithi044 ceph-mon[35411]: from='client.? 172.21.15.172:0/3559150976' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "2f6fb5c7-86cc-43eb-bdfb-45a69316937e"}]: dispatch 2024-09-12T02:32:26.949 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 12 02:32:26 smithi044 ceph-mon[35411]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "2f6fb5c7-86cc-43eb-bdfb-45a69316937e"}]: dispatch 2024-09-12T02:32:26.949 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 12 02:32:26 smithi044 ceph-mon[35411]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "2f6fb5c7-86cc-43eb-bdfb-45a69316937e"}]': finished 2024-09-12T02:32:26.949 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 12 02:32:26 smithi044 ceph-mon[35411]: osdmap e52: 9 total, 8 up, 9 in 2024-09-12T02:32:26.949 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 12 02:32:26 smithi044 ceph-mon[35411]: from='mgr.14150 172.21.15.39:0/408627207' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 8}]: dispatch 2024-09-12T02:32:26.949 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 12 02:32:26 smithi044 ceph-mon[35411]: from='client.? 172.21.15.172:0/3188040482' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-09-12T02:32:28.099 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 02:32:27 smithi039 ceph-mon[30515]: pgmap v183: 1 pgs: 1 active+clean; 577 KiB data, 233 MiB used, 715 GiB / 715 GiB avail 2024-09-12T02:32:28.100 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 02:32:27 smithi039 ceph-mon[30515]: osdmap e53: 9 total, 8 up, 9 in 2024-09-12T02:32:28.100 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 02:32:27 smithi039 ceph-mon[30515]: from='mgr.14150 172.21.15.39:0/408627207' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 8}]: dispatch 2024-09-12T02:32:28.198 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 12 02:32:27 smithi044 ceph-mon[35411]: pgmap v183: 1 pgs: 1 active+clean; 577 KiB data, 233 MiB used, 715 GiB / 715 GiB avail 2024-09-12T02:32:28.199 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 12 02:32:27 smithi044 ceph-mon[35411]: osdmap e53: 9 total, 8 up, 9 in 2024-09-12T02:32:28.199 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 12 02:32:27 smithi044 ceph-mon[35411]: from='mgr.14150 172.21.15.39:0/408627207' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 8}]: dispatch 2024-09-12T02:32:28.263 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 12 02:32:27 smithi172 ceph-mon[35609]: pgmap v183: 1 pgs: 1 active+clean; 577 KiB data, 233 MiB used, 715 GiB / 715 GiB avail 2024-09-12T02:32:28.263 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 12 02:32:27 smithi172 ceph-mon[35609]: osdmap e53: 9 total, 8 up, 9 in 2024-09-12T02:32:28.263 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 12 02:32:27 smithi172 ceph-mon[35609]: from='mgr.14150 172.21.15.39:0/408627207' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 8}]: dispatch 2024-09-12T02:32:29.099 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 02:32:28 smithi039 ceph-mon[30515]: osdmap e54: 9 total, 8 up, 9 in 2024-09-12T02:32:29.100 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 02:32:28 smithi039 ceph-mon[30515]: from='mgr.14150 172.21.15.39:0/408627207' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 8}]: dispatch 2024-09-12T02:32:29.198 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 12 02:32:28 smithi044 ceph-mon[35411]: osdmap e54: 9 total, 8 up, 9 in 2024-09-12T02:32:29.198 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 12 02:32:28 smithi044 ceph-mon[35411]: from='mgr.14150 172.21.15.39:0/408627207' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 8}]: dispatch 2024-09-12T02:32:29.263 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 12 02:32:28 smithi172 ceph-mon[35609]: osdmap e54: 9 total, 8 up, 9 in 2024-09-12T02:32:29.263 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 12 02:32:28 smithi172 ceph-mon[35609]: from='mgr.14150 172.21.15.39:0/408627207' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 8}]: dispatch 2024-09-12T02:32:30.095 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 12 02:32:29 smithi172 ceph-mon[35609]: pgmap v186: 1 pgs: 1 active+clean; 577 KiB data, 232 MiB used, 715 GiB / 715 GiB avail 2024-09-12T02:32:30.099 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 02:32:29 smithi039 ceph-mon[30515]: pgmap v186: 1 pgs: 1 active+clean; 577 KiB data, 232 MiB used, 715 GiB / 715 GiB avail 2024-09-12T02:32:30.100 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 12 02:32:29 smithi044 ceph-mon[35411]: pgmap v186: 1 pgs: 1 active+clean; 577 KiB data, 232 MiB used, 715 GiB / 715 GiB avail 2024-09-12T02:32:31.941 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 12 02:32:31 smithi172 ceph-mon[35609]: pgmap v187: 1 pgs: 1 active+clean; 577 KiB data, 233 MiB used, 715 GiB / 715 GiB avail 2024-09-12T02:32:32.099 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 02:32:31 smithi039 ceph-mon[30515]: pgmap v187: 1 pgs: 1 active+clean; 577 KiB data, 233 MiB used, 715 GiB / 715 GiB avail 2024-09-12T02:32:32.198 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 12 02:32:31 smithi044 ceph-mon[35411]: pgmap v187: 1 pgs: 1 active+clean; 577 KiB data, 233 MiB used, 715 GiB / 715 GiB avail 2024-09-12T02:32:34.059 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 12 02:32:33 smithi172 ceph-mon[35609]: pgmap v188: 1 pgs: 1 active+clean; 577 KiB data, 233 MiB used, 715 GiB / 715 GiB avail 2024-09-12T02:32:34.099 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 02:32:33 smithi039 ceph-mon[30515]: pgmap v188: 1 pgs: 1 active+clean; 577 KiB data, 233 MiB used, 715 GiB / 715 GiB avail 2024-09-12T02:32:34.198 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 12 02:32:33 smithi044 ceph-mon[35411]: pgmap v188: 1 pgs: 1 active+clean; 577 KiB data, 233 MiB used, 715 GiB / 715 GiB avail 2024-09-12T02:32:35.013 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 12 02:32:34 smithi172 ceph-mon[35609]: from='mgr.14150 172.21.15.39:0/408627207' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.8"}]: dispatch 2024-09-12T02:32:35.013 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 12 02:32:34 smithi172 ceph-mon[35609]: from='mgr.14150 172.21.15.39:0/408627207' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-12T02:32:35.014 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 12 02:32:34 smithi172 ceph-mon[35609]: Deploying daemon osd.8 on smithi172 2024-09-12T02:32:35.099 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 02:32:34 smithi039 ceph-mon[30515]: from='mgr.14150 172.21.15.39:0/408627207' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.8"}]: dispatch 2024-09-12T02:32:35.099 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 02:32:34 smithi039 ceph-mon[30515]: from='mgr.14150 172.21.15.39:0/408627207' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-12T02:32:35.100 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 02:32:34 smithi039 ceph-mon[30515]: Deploying daemon osd.8 on smithi172 2024-09-12T02:32:35.198 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 12 02:32:34 smithi044 ceph-mon[35411]: from='mgr.14150 172.21.15.39:0/408627207' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.8"}]: dispatch 2024-09-12T02:32:35.198 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 12 02:32:34 smithi044 ceph-mon[35411]: from='mgr.14150 172.21.15.39:0/408627207' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-12T02:32:35.199 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 12 02:32:34 smithi044 ceph-mon[35411]: Deploying daemon osd.8 on smithi172 2024-09-12T02:32:36.008 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 12 02:32:35 smithi172 ceph-mon[35609]: pgmap v189: 1 pgs: 1 active+clean; 577 KiB data, 233 MiB used, 715 GiB / 715 GiB avail 2024-09-12T02:32:36.099 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 02:32:35 smithi039 ceph-mon[30515]: pgmap v189: 1 pgs: 1 active+clean; 577 KiB data, 233 MiB used, 715 GiB / 715 GiB avail 2024-09-12T02:32:36.198 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 12 02:32:35 smithi044 ceph-mon[35411]: pgmap v189: 1 pgs: 1 active+clean; 577 KiB data, 233 MiB used, 715 GiB / 715 GiB avail 2024-09-12T02:32:38.014 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 12 02:32:37 smithi172 ceph-mon[35609]: pgmap v190: 1 pgs: 1 active+clean; 577 KiB data, 233 MiB used, 715 GiB / 715 GiB avail 2024-09-12T02:32:38.198 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 12 02:32:37 smithi044 ceph-mon[35411]: pgmap v190: 1 pgs: 1 active+clean; 577 KiB data, 233 MiB used, 715 GiB / 715 GiB avail 2024-09-12T02:32:38.349 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 02:32:37 smithi039 ceph-mon[30515]: pgmap v190: 1 pgs: 1 active+clean; 577 KiB data, 233 MiB used, 715 GiB / 715 GiB avail 2024-09-12T02:32:40.198 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 12 02:32:39 smithi044 ceph-mon[35411]: pgmap v191: 1 pgs: 1 active+clean; 577 KiB data, 233 MiB used, 715 GiB / 715 GiB avail 2024-09-12T02:32:40.263 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 12 02:32:39 smithi172 ceph-mon[35609]: pgmap v191: 1 pgs: 1 active+clean; 577 KiB data, 233 MiB used, 715 GiB / 715 GiB avail 2024-09-12T02:32:40.349 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 02:32:39 smithi039 ceph-mon[30515]: pgmap v191: 1 pgs: 1 active+clean; 577 KiB data, 233 MiB used, 715 GiB / 715 GiB avail 2024-09-12T02:32:41.013 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 12 02:32:40 smithi172 ceph-mon[35609]: from='mgr.14150 172.21.15.39:0/408627207' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-12T02:32:41.013 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 12 02:32:40 smithi172 ceph-mon[35609]: from='mgr.14150 172.21.15.39:0/408627207' entity='mgr.x' 2024-09-12T02:32:41.013 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 12 02:32:40 smithi172 ceph-mon[35609]: from='mgr.14150 172.21.15.39:0/408627207' entity='mgr.x' 2024-09-12T02:32:41.198 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 12 02:32:40 smithi044 ceph-mon[35411]: from='mgr.14150 172.21.15.39:0/408627207' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-12T02:32:41.199 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 12 02:32:40 smithi044 ceph-mon[35411]: from='mgr.14150 172.21.15.39:0/408627207' entity='mgr.x' 2024-09-12T02:32:41.199 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 12 02:32:40 smithi044 ceph-mon[35411]: from='mgr.14150 172.21.15.39:0/408627207' entity='mgr.x' 2024-09-12T02:32:41.349 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 02:32:40 smithi039 ceph-mon[30515]: from='mgr.14150 172.21.15.39:0/408627207' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-12T02:32:41.350 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 02:32:40 smithi039 ceph-mon[30515]: from='mgr.14150 172.21.15.39:0/408627207' entity='mgr.x' 2024-09-12T02:32:41.350 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 02:32:40 smithi039 ceph-mon[30515]: from='mgr.14150 172.21.15.39:0/408627207' entity='mgr.x' 2024-09-12T02:32:41.997 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 12 02:32:41 smithi172 ceph-mon[35609]: pgmap v192: 1 pgs: 1 active+clean; 577 KiB data, 233 MiB used, 715 GiB / 715 GiB avail 2024-09-12T02:32:42.198 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 12 02:32:41 smithi044 ceph-mon[35411]: pgmap v192: 1 pgs: 1 active+clean; 577 KiB data, 233 MiB used, 715 GiB / 715 GiB avail 2024-09-12T02:32:42.349 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 02:32:41 smithi039 ceph-mon[30515]: pgmap v192: 1 pgs: 1 active+clean; 577 KiB data, 233 MiB used, 715 GiB / 715 GiB avail 2024-09-12T02:32:43.438 INFO:teuthology.orchestra.run.smithi172.stdout:Created osd(s) 8 on host 'smithi172' 2024-09-12T02:32:43.438 INFO:teuthology.orchestra.run.smithi172.stderr:2024-09-12T02:32:43.436+0000 7ff2cd7fa640 1 -- 172.21.15.172:0/2735984586 <== mgr.14150 v2:172.21.15.39:6800/1725006999 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+37 (secure 0 0 0) 0x7ff2d0062630 con 0x7ff2b80a2bb0 2024-09-12T02:32:43.440 INFO:teuthology.orchestra.run.smithi172.stderr:2024-09-12T02:32:43.439+0000 7ff2d6462640 1 -- 172.21.15.172:0/2735984586 >> [v2:172.21.15.39:6800/1725006999,v1:172.21.15.39:6801/1725006999] conn(0x7ff2b80a2bb0 msgr2=0x7ff2b80a5070 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:32:43.441 INFO:teuthology.orchestra.run.smithi172.stderr:2024-09-12T02:32:43.439+0000 7ff2d6462640 1 --2- 172.21.15.172:0/2735984586 >> [v2:172.21.15.39:6800/1725006999,v1:172.21.15.39:6801/1725006999] conn(0x7ff2b80a2bb0 0x7ff2b80a5070 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0x7ff2d010d340 tx=0x7ff2c0009110 comp rx=0 tx=0).stop 2024-09-12T02:32:43.441 INFO:teuthology.orchestra.run.smithi172.stderr:2024-09-12T02:32:43.439+0000 7ff2d6462640 1 -- 172.21.15.172:0/2735984586 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7ff2d010e1f0 msgr2=0x7ff2d01a9fe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:32:43.441 INFO:teuthology.orchestra.run.smithi172.stderr:2024-09-12T02:32:43.439+0000 7ff2d6462640 1 --2- 172.21.15.172:0/2735984586 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7ff2d010e1f0 0x7ff2d01a9fe0 secure :-1 s=READY pgs=33 cs=0 l=1 rev1=1 crypto rx=0x7ff2c80319f0 tx=0x7ff2c8003970 comp rx=0 tx=0).stop 2024-09-12T02:32:43.441 INFO:teuthology.orchestra.run.smithi172.stderr:2024-09-12T02:32:43.440+0000 7ff2d6462640 1 -- 172.21.15.172:0/2735984586 shutdown_connections 2024-09-12T02:32:43.441 INFO:teuthology.orchestra.run.smithi172.stderr:2024-09-12T02:32:43.440+0000 7ff2d6462640 1 --2- 172.21.15.172:0/2735984586 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7ff2d010e1f0 0x7ff2d01a9fe0 unknown :-1 s=CLOSED pgs=33 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:32:43.441 INFO:teuthology.orchestra.run.smithi172.stderr:2024-09-12T02:32:43.440+0000 7ff2d6462640 1 --2- 172.21.15.172:0/2735984586 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7ff2d010d830 0x7ff2d01a2f60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:32:43.441 INFO:teuthology.orchestra.run.smithi172.stderr:2024-09-12T02:32:43.440+0000 7ff2d6462640 1 --2- 172.21.15.172:0/2735984586 >> [v2:172.21.15.39:6800/1725006999,v1:172.21.15.39:6801/1725006999] conn(0x7ff2b80a2bb0 0x7ff2b80a5070 unknown :-1 s=CLOSED pgs=92 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:32:43.441 INFO:teuthology.orchestra.run.smithi172.stderr:2024-09-12T02:32:43.440+0000 7ff2d6462640 1 --2- 172.21.15.172:0/2735984586 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7ff2d010c640 0x7ff2d01a2a20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:32:43.441 INFO:teuthology.orchestra.run.smithi172.stderr:2024-09-12T02:32:43.440+0000 7ff2d6462640 1 -- 172.21.15.172:0/2735984586 >> 172.21.15.172:0/2735984586 conn(0x7ff2d006c860 msgr2=0x7ff2d0110bf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:32:43.441 INFO:teuthology.orchestra.run.smithi172.stderr:2024-09-12T02:32:43.440+0000 7ff2d6462640 1 -- 172.21.15.172:0/2735984586 shutdown_connections 2024-09-12T02:32:43.441 INFO:teuthology.orchestra.run.smithi172.stderr:2024-09-12T02:32:43.440+0000 7ff2d6462640 1 -- 172.21.15.172:0/2735984586 wait complete. 2024-09-12T02:32:44.014 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 12 02:32:43 smithi172 ceph-mon[35609]: pgmap v193: 1 pgs: 1 active+clean; 577 KiB data, 233 MiB used, 715 GiB / 715 GiB avail 2024-09-12T02:32:44.014 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 12 02:32:43 smithi172 ceph-mon[35609]: from='mgr.14150 172.21.15.39:0/408627207' entity='mgr.x' 2024-09-12T02:32:44.014 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 12 02:32:43 smithi172 ceph-mon[35609]: from='mgr.14150 172.21.15.39:0/408627207' entity='mgr.x' 2024-09-12T02:32:44.014 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 12 02:32:43 smithi172 ceph-mon[35609]: from='mgr.14150 172.21.15.39:0/408627207' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-12T02:32:44.014 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 12 02:32:43 smithi172 ceph-mon[35609]: from='mgr.14150 172.21.15.39:0/408627207' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-12T02:32:44.014 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 12 02:32:43 smithi172 ceph-mon[35609]: from='mgr.14150 172.21.15.39:0/408627207' entity='mgr.x' 2024-09-12T02:32:44.014 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 12 02:32:43 smithi172 ceph-mon[35609]: from='mgr.14150 172.21.15.39:0/408627207' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-12T02:32:44.014 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 12 02:32:43 smithi172 ceph-mon[35609]: from='mgr.14150 172.21.15.39:0/408627207' entity='mgr.x' 2024-09-12T02:32:44.014 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 12 02:32:43 smithi172 ceph-mon[35609]: from='mgr.14150 172.21.15.39:0/408627207' entity='mgr.x' 2024-09-12T02:32:44.078 DEBUG:teuthology.orchestra.run.smithi172:osd.8> sudo journalctl -f -n 0 -u ceph-4954ed46-70ae-11ef-bcea-c7b262605968@osd.8.service 2024-09-12T02:32:44.080 INFO:tasks.cephadm:Deploying osd.9 on smithi039 with /dev/vg_nvme/lv_1... 2024-09-12T02:32:44.080 DEBUG:teuthology.orchestra.run.smithi039:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc ceph-volume -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 4954ed46-70ae-11ef-bcea-c7b262605968 -- lvm zap /dev/vg_nvme/lv_1 2024-09-12T02:32:44.100 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 02:32:43 smithi039 ceph-mon[30515]: pgmap v193: 1 pgs: 1 active+clean; 577 KiB data, 233 MiB used, 715 GiB / 715 GiB avail 2024-09-12T02:32:44.100 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 02:32:43 smithi039 ceph-mon[30515]: from='mgr.14150 172.21.15.39:0/408627207' entity='mgr.x' 2024-09-12T02:32:44.100 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 02:32:43 smithi039 ceph-mon[30515]: from='mgr.14150 172.21.15.39:0/408627207' entity='mgr.x' 2024-09-12T02:32:44.100 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 02:32:43 smithi039 ceph-mon[30515]: from='mgr.14150 172.21.15.39:0/408627207' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-12T02:32:44.101 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 02:32:43 smithi039 ceph-mon[30515]: from='mgr.14150 172.21.15.39:0/408627207' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-12T02:32:44.101 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 02:32:43 smithi039 ceph-mon[30515]: from='mgr.14150 172.21.15.39:0/408627207' entity='mgr.x' 2024-09-12T02:32:44.101 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 02:32:43 smithi039 ceph-mon[30515]: from='mgr.14150 172.21.15.39:0/408627207' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-12T02:32:44.101 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 02:32:43 smithi039 ceph-mon[30515]: from='mgr.14150 172.21.15.39:0/408627207' entity='mgr.x' 2024-09-12T02:32:44.101 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 02:32:43 smithi039 ceph-mon[30515]: from='mgr.14150 172.21.15.39:0/408627207' entity='mgr.x' 2024-09-12T02:32:44.198 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 12 02:32:43 smithi044 ceph-mon[35411]: pgmap v193: 1 pgs: 1 active+clean; 577 KiB data, 233 MiB used, 715 GiB / 715 GiB avail 2024-09-12T02:32:44.199 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 12 02:32:43 smithi044 ceph-mon[35411]: from='mgr.14150 172.21.15.39:0/408627207' entity='mgr.x' 2024-09-12T02:32:44.199 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 12 02:32:43 smithi044 ceph-mon[35411]: from='mgr.14150 172.21.15.39:0/408627207' entity='mgr.x' 2024-09-12T02:32:44.199 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 12 02:32:43 smithi044 ceph-mon[35411]: from='mgr.14150 172.21.15.39:0/408627207' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-12T02:32:44.199 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 12 02:32:43 smithi044 ceph-mon[35411]: from='mgr.14150 172.21.15.39:0/408627207' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-12T02:32:44.199 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 12 02:32:43 smithi044 ceph-mon[35411]: from='mgr.14150 172.21.15.39:0/408627207' entity='mgr.x' 2024-09-12T02:32:44.199 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 12 02:32:43 smithi044 ceph-mon[35411]: from='mgr.14150 172.21.15.39:0/408627207' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-12T02:32:44.199 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 12 02:32:43 smithi044 ceph-mon[35411]: from='mgr.14150 172.21.15.39:0/408627207' entity='mgr.x' 2024-09-12T02:32:44.199 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 12 02:32:43 smithi044 ceph-mon[35411]: from='mgr.14150 172.21.15.39:0/408627207' entity='mgr.x' 2024-09-12T02:32:44.464 INFO:teuthology.orchestra.run.smithi039.stderr:Inferring config /var/lib/ceph/4954ed46-70ae-11ef-bcea-c7b262605968/mon.a/config 2024-09-12T02:32:45.873 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 02:32:45 smithi039 ceph-mon[30515]: pgmap v194: 1 pgs: 1 active+clean; 577 KiB data, 233 MiB used, 715 GiB / 715 GiB avail 2024-09-12T02:32:45.873 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 02:32:45 smithi039 ceph-mon[30515]: from='osd.8 [v2:172.21.15.172:6816/1162792895,v1:172.21.15.172:6817/1162792895]' entity='osd.8' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["8"]}]: dispatch 2024-09-12T02:32:45.873 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 02:32:45 smithi039 ceph-mon[30515]: from='osd.8 ' entity='osd.8' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["8"]}]: dispatch 2024-09-12T02:32:46.201 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 12 02:32:45 smithi044 ceph-mon[35411]: pgmap v194: 1 pgs: 1 active+clean; 577 KiB data, 233 MiB used, 715 GiB / 715 GiB avail 2024-09-12T02:32:46.201 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 12 02:32:45 smithi044 ceph-mon[35411]: from='osd.8 [v2:172.21.15.172:6816/1162792895,v1:172.21.15.172:6817/1162792895]' entity='osd.8' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["8"]}]: dispatch 2024-09-12T02:32:46.201 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 12 02:32:45 smithi044 ceph-mon[35411]: from='osd.8 ' entity='osd.8' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["8"]}]: dispatch 2024-09-12T02:32:46.257 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 12 02:32:45 smithi172 ceph-mon[35609]: pgmap v194: 1 pgs: 1 active+clean; 577 KiB data, 233 MiB used, 715 GiB / 715 GiB avail 2024-09-12T02:32:46.257 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 12 02:32:45 smithi172 ceph-mon[35609]: from='osd.8 [v2:172.21.15.172:6816/1162792895,v1:172.21.15.172:6817/1162792895]' entity='osd.8' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["8"]}]: dispatch 2024-09-12T02:32:46.257 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 12 02:32:45 smithi172 ceph-mon[35609]: from='osd.8 ' entity='osd.8' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["8"]}]: dispatch 2024-09-12T02:32:46.257 INFO:journalctl@ceph.osd.8.smithi172.stdout:Sep 12 02:32:45 smithi172 ceph-4954ed46-70ae-11ef-bcea-c7b262605968-osd-8[54149]: 2024-09-12T02:32:45.765+0000 7f07d66b6640 -1 osd.8 0 log_to_monitors true 2024-09-12T02:32:46.882 INFO:journalctl@ceph.osd.8.smithi172.stdout:Sep 12 02:32:46 smithi172 ceph-4954ed46-70ae-11ef-bcea-c7b262605968-osd-8[54149]: 2024-09-12T02:32:46.828+0000 7f07d2639640 -1 osd.8 0 waiting for initial osdmap 2024-09-12T02:32:46.882 INFO:journalctl@ceph.osd.8.smithi172.stdout:Sep 12 02:32:46 smithi172 ceph-4954ed46-70ae-11ef-bcea-c7b262605968-osd-8[54149]: 2024-09-12T02:32:46.836+0000 7f07ce461640 -1 osd.8 56 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-09-12T02:32:46.882 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 12 02:32:46 smithi172 ceph-mon[35609]: from='osd.8 ' entity='osd.8' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["8"]}]': finished 2024-09-12T02:32:46.882 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 12 02:32:46 smithi172 ceph-mon[35609]: from='osd.8 [v2:172.21.15.172:6816/1162792895,v1:172.21.15.172:6817/1162792895]' entity='osd.8' cmd=[{"prefix": "osd crush create-or-move", "id": 8, "weight":0.0873, "args": ["host=smithi172", "root=default"]}]: dispatch 2024-09-12T02:32:46.882 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 12 02:32:46 smithi172 ceph-mon[35609]: osdmap e55: 9 total, 8 up, 9 in 2024-09-12T02:32:46.882 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 12 02:32:46 smithi172 ceph-mon[35609]: from='mgr.14150 172.21.15.39:0/408627207' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 8}]: dispatch 2024-09-12T02:32:46.882 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 12 02:32:46 smithi172 ceph-mon[35609]: from='osd.8 ' entity='osd.8' cmd=[{"prefix": "osd crush create-or-move", "id": 8, "weight":0.0873, "args": ["host=smithi172", "root=default"]}]: dispatch 2024-09-12T02:32:46.882 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 12 02:32:46 smithi172 ceph-mon[35609]: from='osd.8 ' entity='osd.8' cmd='[{"prefix": "osd crush create-or-move", "id": 8, "weight":0.0873, "args": ["host=smithi172", "root=default"]}]': finished 2024-09-12T02:32:47.099 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 02:32:46 smithi039 ceph-mon[30515]: from='osd.8 ' entity='osd.8' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["8"]}]': finished 2024-09-12T02:32:47.100 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 02:32:46 smithi039 ceph-mon[30515]: from='osd.8 [v2:172.21.15.172:6816/1162792895,v1:172.21.15.172:6817/1162792895]' entity='osd.8' cmd=[{"prefix": "osd crush create-or-move", "id": 8, "weight":0.0873, "args": ["host=smithi172", "root=default"]}]: dispatch 2024-09-12T02:32:47.100 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 02:32:46 smithi039 ceph-mon[30515]: osdmap e55: 9 total, 8 up, 9 in 2024-09-12T02:32:47.100 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 02:32:46 smithi039 ceph-mon[30515]: from='mgr.14150 172.21.15.39:0/408627207' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 8}]: dispatch 2024-09-12T02:32:47.100 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 02:32:46 smithi039 ceph-mon[30515]: from='osd.8 ' entity='osd.8' cmd=[{"prefix": "osd crush create-or-move", "id": 8, "weight":0.0873, "args": ["host=smithi172", "root=default"]}]: dispatch 2024-09-12T02:32:47.100 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 02:32:46 smithi039 ceph-mon[30515]: from='osd.8 ' entity='osd.8' cmd='[{"prefix": "osd crush create-or-move", "id": 8, "weight":0.0873, "args": ["host=smithi172", "root=default"]}]': finished 2024-09-12T02:32:47.198 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 12 02:32:46 smithi044 ceph-mon[35411]: from='osd.8 ' entity='osd.8' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["8"]}]': finished 2024-09-12T02:32:47.198 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 12 02:32:46 smithi044 ceph-mon[35411]: from='osd.8 [v2:172.21.15.172:6816/1162792895,v1:172.21.15.172:6817/1162792895]' entity='osd.8' cmd=[{"prefix": "osd crush create-or-move", "id": 8, "weight":0.0873, "args": ["host=smithi172", "root=default"]}]: dispatch 2024-09-12T02:32:47.199 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 12 02:32:46 smithi044 ceph-mon[35411]: osdmap e55: 9 total, 8 up, 9 in 2024-09-12T02:32:47.199 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 12 02:32:46 smithi044 ceph-mon[35411]: from='mgr.14150 172.21.15.39:0/408627207' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 8}]: dispatch 2024-09-12T02:32:47.199 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 12 02:32:46 smithi044 ceph-mon[35411]: from='osd.8 ' entity='osd.8' cmd=[{"prefix": "osd crush create-or-move", "id": 8, "weight":0.0873, "args": ["host=smithi172", "root=default"]}]: dispatch 2024-09-12T02:32:47.199 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 12 02:32:46 smithi044 ceph-mon[35411]: from='osd.8 ' entity='osd.8' cmd='[{"prefix": "osd crush create-or-move", "id": 8, "weight":0.0873, "args": ["host=smithi172", "root=default"]}]': finished 2024-09-12T02:32:47.760 INFO:teuthology.orchestra.run.smithi039.stdout: 2024-09-12T02:32:47.792 DEBUG:teuthology.orchestra.run.smithi039:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 4954ed46-70ae-11ef-bcea-c7b262605968 -- ceph orch daemon add osd smithi039:vg_nvme/lv_1 2024-09-12T02:32:48.100 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 02:32:47 smithi039 ceph-mon[30515]: pgmap v196: 1 pgs: 1 active+clean; 577 KiB data, 233 MiB used, 715 GiB / 715 GiB avail 2024-09-12T02:32:48.100 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 02:32:47 smithi039 ceph-mon[30515]: osdmap e56: 9 total, 8 up, 9 in 2024-09-12T02:32:48.100 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 02:32:47 smithi039 ceph-mon[30515]: from='mgr.14150 172.21.15.39:0/408627207' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 8}]: dispatch 2024-09-12T02:32:48.100 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 02:32:47 smithi039 ceph-mon[30515]: Detected new or changed devices on smithi172 2024-09-12T02:32:48.100 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 02:32:47 smithi039 ceph-mon[30515]: from='mgr.14150 172.21.15.39:0/408627207' entity='mgr.x' 2024-09-12T02:32:48.100 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 02:32:47 smithi039 ceph-mon[30515]: osd.8 [v2:172.21.15.172:6816/1162792895,v1:172.21.15.172:6817/1162792895] boot 2024-09-12T02:32:48.100 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 02:32:47 smithi039 ceph-mon[30515]: osdmap e57: 9 total, 9 up, 9 in 2024-09-12T02:32:48.100 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 02:32:47 smithi039 ceph-mon[30515]: from='mgr.14150 172.21.15.39:0/408627207' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 8}]: dispatch 2024-09-12T02:32:48.100 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 02:32:47 smithi039 ceph-mon[30515]: from='mgr.14150 172.21.15.39:0/408627207' entity='mgr.x' 2024-09-12T02:32:48.100 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 02:32:47 smithi039 ceph-mon[30515]: from='mgr.14150 172.21.15.39:0/408627207' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2024-09-12T02:32:48.101 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 02:32:47 smithi039 ceph-mon[30515]: from='mgr.14150 172.21.15.39:0/408627207' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2024-09-12T02:32:48.101 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 02:32:47 smithi039 ceph-mon[30515]: from='mgr.14150 172.21.15.39:0/408627207' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.8", "name": "osd_memory_target"}]: dispatch 2024-09-12T02:32:48.101 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 02:32:47 smithi039 ceph-mon[30515]: Adjusting osd_memory_target on smithi172 to 5696M 2024-09-12T02:32:48.101 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 02:32:47 smithi039 ceph-mon[30515]: from='mgr.14150 172.21.15.39:0/408627207' entity='mgr.x' 2024-09-12T02:32:48.101 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 02:32:47 smithi039 ceph-mon[30515]: from='mgr.14150 172.21.15.39:0/408627207' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-12T02:32:48.101 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 02:32:47 smithi039 ceph-mon[30515]: from='mgr.14150 172.21.15.39:0/408627207' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-12T02:32:48.101 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 02:32:47 smithi039 ceph-mon[30515]: from='mgr.14150 172.21.15.39:0/408627207' entity='mgr.x' 2024-09-12T02:32:48.198 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 12 02:32:47 smithi044 ceph-mon[35411]: pgmap v196: 1 pgs: 1 active+clean; 577 KiB data, 233 MiB used, 715 GiB / 715 GiB avail 2024-09-12T02:32:48.199 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 12 02:32:47 smithi044 ceph-mon[35411]: osdmap e56: 9 total, 8 up, 9 in 2024-09-12T02:32:48.199 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 12 02:32:47 smithi044 ceph-mon[35411]: from='mgr.14150 172.21.15.39:0/408627207' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 8}]: dispatch 2024-09-12T02:32:48.199 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 12 02:32:47 smithi044 ceph-mon[35411]: Detected new or changed devices on smithi172 2024-09-12T02:32:48.199 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 12 02:32:47 smithi044 ceph-mon[35411]: from='mgr.14150 172.21.15.39:0/408627207' entity='mgr.x' 2024-09-12T02:32:48.199 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 12 02:32:47 smithi044 ceph-mon[35411]: osd.8 [v2:172.21.15.172:6816/1162792895,v1:172.21.15.172:6817/1162792895] boot 2024-09-12T02:32:48.199 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 12 02:32:47 smithi044 ceph-mon[35411]: osdmap e57: 9 total, 9 up, 9 in 2024-09-12T02:32:48.199 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 12 02:32:47 smithi044 ceph-mon[35411]: from='mgr.14150 172.21.15.39:0/408627207' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 8}]: dispatch 2024-09-12T02:32:48.199 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 12 02:32:47 smithi044 ceph-mon[35411]: from='mgr.14150 172.21.15.39:0/408627207' entity='mgr.x' 2024-09-12T02:32:48.199 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 12 02:32:47 smithi044 ceph-mon[35411]: from='mgr.14150 172.21.15.39:0/408627207' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2024-09-12T02:32:48.199 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 12 02:32:47 smithi044 ceph-mon[35411]: from='mgr.14150 172.21.15.39:0/408627207' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2024-09-12T02:32:48.199 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 12 02:32:47 smithi044 ceph-mon[35411]: from='mgr.14150 172.21.15.39:0/408627207' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.8", "name": "osd_memory_target"}]: dispatch 2024-09-12T02:32:48.199 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 12 02:32:47 smithi044 ceph-mon[35411]: Adjusting osd_memory_target on smithi172 to 5696M 2024-09-12T02:32:48.199 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 12 02:32:47 smithi044 ceph-mon[35411]: from='mgr.14150 172.21.15.39:0/408627207' entity='mgr.x' 2024-09-12T02:32:48.200 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 12 02:32:47 smithi044 ceph-mon[35411]: from='mgr.14150 172.21.15.39:0/408627207' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-12T02:32:48.200 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 12 02:32:47 smithi044 ceph-mon[35411]: from='mgr.14150 172.21.15.39:0/408627207' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-12T02:32:48.200 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 12 02:32:47 smithi044 ceph-mon[35411]: from='mgr.14150 172.21.15.39:0/408627207' entity='mgr.x' 2024-09-12T02:32:48.212 INFO:teuthology.orchestra.run.smithi039.stderr:Inferring config /var/lib/ceph/4954ed46-70ae-11ef-bcea-c7b262605968/mon.a/config 2024-09-12T02:32:48.264 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 12 02:32:47 smithi172 ceph-mon[35609]: pgmap v196: 1 pgs: 1 active+clean; 577 KiB data, 233 MiB used, 715 GiB / 715 GiB avail 2024-09-12T02:32:48.264 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 12 02:32:47 smithi172 ceph-mon[35609]: osdmap e56: 9 total, 8 up, 9 in 2024-09-12T02:32:48.264 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 12 02:32:47 smithi172 ceph-mon[35609]: from='mgr.14150 172.21.15.39:0/408627207' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 8}]: dispatch 2024-09-12T02:32:48.264 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 12 02:32:47 smithi172 ceph-mon[35609]: Detected new or changed devices on smithi172 2024-09-12T02:32:48.264 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 12 02:32:47 smithi172 ceph-mon[35609]: from='mgr.14150 172.21.15.39:0/408627207' entity='mgr.x' 2024-09-12T02:32:48.264 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 12 02:32:47 smithi172 ceph-mon[35609]: osd.8 [v2:172.21.15.172:6816/1162792895,v1:172.21.15.172:6817/1162792895] boot 2024-09-12T02:32:48.264 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 12 02:32:47 smithi172 ceph-mon[35609]: osdmap e57: 9 total, 9 up, 9 in 2024-09-12T02:32:48.264 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 12 02:32:47 smithi172 ceph-mon[35609]: from='mgr.14150 172.21.15.39:0/408627207' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 8}]: dispatch 2024-09-12T02:32:48.264 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 12 02:32:47 smithi172 ceph-mon[35609]: from='mgr.14150 172.21.15.39:0/408627207' entity='mgr.x' 2024-09-12T02:32:48.264 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 12 02:32:47 smithi172 ceph-mon[35609]: from='mgr.14150 172.21.15.39:0/408627207' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2024-09-12T02:32:48.265 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 12 02:32:47 smithi172 ceph-mon[35609]: from='mgr.14150 172.21.15.39:0/408627207' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2024-09-12T02:32:48.265 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 12 02:32:47 smithi172 ceph-mon[35609]: from='mgr.14150 172.21.15.39:0/408627207' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.8", "name": "osd_memory_target"}]: dispatch 2024-09-12T02:32:48.265 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 12 02:32:47 smithi172 ceph-mon[35609]: Adjusting osd_memory_target on smithi172 to 5696M 2024-09-12T02:32:48.265 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 12 02:32:47 smithi172 ceph-mon[35609]: from='mgr.14150 172.21.15.39:0/408627207' entity='mgr.x' 2024-09-12T02:32:48.265 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 12 02:32:47 smithi172 ceph-mon[35609]: from='mgr.14150 172.21.15.39:0/408627207' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-12T02:32:48.265 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 12 02:32:47 smithi172 ceph-mon[35609]: from='mgr.14150 172.21.15.39:0/408627207' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-12T02:32:48.265 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 12 02:32:47 smithi172 ceph-mon[35609]: from='mgr.14150 172.21.15.39:0/408627207' entity='mgr.x' 2024-09-12T02:32:48.817 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:32:48.816+0000 7fd5a1400640 1 -- 172.21.15.39:0/297470744 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fd59c101c00 msgr2=0x7fd59c102000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:32:48.818 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:32:48.816+0000 7fd5a1400640 1 --2- 172.21.15.39:0/297470744 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fd59c101c00 0x7fd59c102000 secure :-1 s=READY pgs=123 cs=0 l=1 rev1=1 crypto rx=0x7fd58c009ca0 tx=0x7fd58c02a8c0 comp rx=0 tx=0).stop 2024-09-12T02:32:48.818 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:32:48.816+0000 7fd5a1400640 1 -- 172.21.15.39:0/297470744 shutdown_connections 2024-09-12T02:32:48.818 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:32:48.816+0000 7fd5a1400640 1 --2- 172.21.15.39:0/297470744 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fd59c1037c0 0x7fd59c10a050 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:32:48.818 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:32:48.816+0000 7fd5a1400640 1 --2- 172.21.15.39:0/297470744 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fd59c102e00 0x7fd59c103280 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:32:48.818 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:32:48.816+0000 7fd5a1400640 1 --2- 172.21.15.39:0/297470744 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fd59c101c00 0x7fd59c102000 unknown :-1 s=CLOSED pgs=123 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:32:48.818 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:32:48.816+0000 7fd5a1400640 1 -- 172.21.15.39:0/297470744 >> 172.21.15.39:0/297470744 conn(0x7fd59c0fd390 msgr2=0x7fd59c0ff7d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:32:48.818 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:32:48.816+0000 7fd5a1400640 1 -- 172.21.15.39:0/297470744 shutdown_connections 2024-09-12T02:32:48.818 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:32:48.816+0000 7fd5a1400640 1 -- 172.21.15.39:0/297470744 wait complete. 2024-09-12T02:32:48.818 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:32:48.817+0000 7fd5a1400640 1 Processor -- start 2024-09-12T02:32:48.820 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:32:48.817+0000 7fd5a1400640 1 -- start start 2024-09-12T02:32:48.820 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:32:48.817+0000 7fd5a1400640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fd59c101c00 0x7fd59c19a110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:32:48.820 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:32:48.817+0000 7fd5a1400640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fd59c102e00 0x7fd59c19a650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:32:48.820 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:32:48.818+0000 7fd5a1400640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fd59c1037c0 0x7fd59c1a16d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:32:48.820 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:32:48.818+0000 7fd5a1400640 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 -- 0x7fd59c10d8b0 con 0x7fd59c101c00 2024-09-12T02:32:48.820 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:32:48.818+0000 7fd5a1400640 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x7fd59c10d730 con 0x7fd59c102e00 2024-09-12T02:32:48.820 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:32:48.818+0000 7fd5a1400640 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7fd59c10da30 con 0x7fd59c1037c0 2024-09-12T02:32:48.820 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:32:48.818+0000 7fd59a800640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fd59c101c00 0x7fd59c19a110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:32:48.820 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:32:48.818+0000 7fd59a800640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fd59c101c00 0x7fd59c19a110 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.39:3300/0 says I am v2:172.21.15.39:37864/0 (socket says 172.21.15.39:37864) 2024-09-12T02:32:48.820 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:32:48.818+0000 7fd591e00640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fd59c102e00 0x7fd59c19a650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:32:48.820 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:32:48.818+0000 7fd59a800640 1 -- 172.21.15.39:0/3930076144 learned_addr learned my addr 172.21.15.39:0/3930076144 (peer_addr_for_me v2:172.21.15.39:0/0) 2024-09-12T02:32:48.821 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:32:48.818+0000 7fd591e00640 1 -- 172.21.15.39:0/3930076144 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fd59c1037c0 msgr2=0x7fd59c1a16d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:32:48.821 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:32:48.818+0000 7fd591e00640 1 --2- 172.21.15.39:0/3930076144 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fd59c1037c0 0x7fd59c1a16d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:32:48.821 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:32:48.818+0000 7fd591e00640 1 -- 172.21.15.39:0/3930076144 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fd59c101c00 msgr2=0x7fd59c19a110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:32:48.821 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:32:48.818+0000 7fd591e00640 1 --2- 172.21.15.39:0/3930076144 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fd59c101c00 0x7fd59c19a110 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:32:48.821 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:32:48.818+0000 7fd591e00640 1 -- 172.21.15.39:0/3930076144 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd59c1a1d40 con 0x7fd59c102e00 2024-09-12T02:32:48.821 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:32:48.819+0000 7fd591e00640 1 --2- 172.21.15.39:0/3930076144 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fd59c102e00 0x7fd59c19a650 secure :-1 s=READY pgs=48 cs=0 l=1 rev1=1 crypto rx=0x7fd58400e9f0 tx=0x7fd58400eeb0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:32:48.821 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:32:48.819+0000 7fd593e00640 1 -- 172.21.15.39:0/3930076144 <== mon.2 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd58400ccc0 con 0x7fd59c102e00 2024-09-12T02:32:48.821 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:32:48.819+0000 7fd5a1400640 1 -- 172.21.15.39:0/3930076144 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd59c1a1fd0 con 0x7fd59c102e00 2024-09-12T02:32:48.821 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:32:48.819+0000 7fd593e00640 1 -- 172.21.15.39:0/3930076144 <== mon.2 v2:172.21.15.44:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fd584010910 con 0x7fd59c102e00 2024-09-12T02:32:48.821 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:32:48.819+0000 7fd593e00640 1 -- 172.21.15.39:0/3930076144 <== mon.2 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd584018960 con 0x7fd59c102e00 2024-09-12T02:32:48.821 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:32:48.819+0000 7fd5a1400640 1 -- 172.21.15.39:0/3930076144 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd59c1a24e0 con 0x7fd59c102e00 2024-09-12T02:32:48.822 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:32:48.820+0000 7fd5a1400640 1 -- 172.21.15.39:0/3930076144 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fd59c1a2740 con 0x7fd59c102e00 2024-09-12T02:32:48.823 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:32:48.822+0000 7fd593e00640 1 -- 172.21.15.39:0/3930076144 <== mon.2 v2:172.21.15.44:3300/0 4 ==== mgrmap(e 16) ==== 137833+0+0 (secure 0 0 0) 0x7fd584010ac0 con 0x7fd59c102e00 2024-09-12T02:32:48.824 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:32:48.823+0000 7fd593e00640 1 --2- 172.21.15.39:0/3930076144 >> [v2:172.21.15.39:6800/1725006999,v1:172.21.15.39:6801/1725006999] conn(0x7fd5800a2bb0 0x7fd5800a5070 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:32:48.824 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:32:48.824+0000 7fd593e00640 1 -- 172.21.15.39:0/3930076144 <== mon.2 v2:172.21.15.44:3300/0 5 ==== osd_map(58..58 src has 1..58) ==== 5858+0+0 (secure 0 0 0) 0x7fd5840cefe0 con 0x7fd59c102e00 2024-09-12T02:32:48.825 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:32:48.824+0000 7fd59a800640 1 --2- 172.21.15.39:0/3930076144 >> [v2:172.21.15.39:6800/1725006999,v1:172.21.15.39:6801/1725006999] conn(0x7fd5800a2bb0 0x7fd5800a5070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:32:48.825 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:32:48.824+0000 7fd59a800640 1 --2- 172.21.15.39:0/3930076144 >> [v2:172.21.15.39:6800/1725006999,v1:172.21.15.39:6801/1725006999] conn(0x7fd5800a2bb0 0x7fd5800a5070 secure :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0x7fd58c005fe0 tx=0x7fd58c005f70 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:32:48.826 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:32:48.826+0000 7fd593e00640 1 -- 172.21.15.39:0/3930076144 <== mon.2 v2:172.21.15.44:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7fd58409c890 con 0x7fd59c102e00 2024-09-12T02:32:49.022 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:32:49.021+0000 7fd5a1400640 1 -- 172.21.15.39:0/3930076144 --> [v2:172.21.15.39:6800/1725006999,v1:172.21.15.39:6801/1725006999] -- mgr_command(tid 0: {"prefix": "orch daemon add osd", "svc_arg": "smithi039:vg_nvme/lv_1", "target": ["mon-mgr", ""]}) -- 0x7fd59c075b40 con 0x7fd5800a2bb0 2024-09-12T02:32:49.022 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 02:32:48 smithi039 ceph-mon[30515]: purged_snaps scrub starts 2024-09-12T02:32:49.022 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 02:32:48 smithi039 ceph-mon[30515]: purged_snaps scrub ok 2024-09-12T02:32:49.022 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 02:32:48 smithi039 ceph-mon[30515]: osdmap e58: 9 total, 9 up, 9 in 2024-09-12T02:32:49.198 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 12 02:32:48 smithi044 ceph-mon[35411]: purged_snaps scrub starts 2024-09-12T02:32:49.198 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 12 02:32:48 smithi044 ceph-mon[35411]: purged_snaps scrub ok 2024-09-12T02:32:49.199 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 12 02:32:48 smithi044 ceph-mon[35411]: osdmap e58: 9 total, 9 up, 9 in 2024-09-12T02:32:49.263 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 12 02:32:48 smithi172 ceph-mon[35609]: purged_snaps scrub starts 2024-09-12T02:32:49.263 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 12 02:32:48 smithi172 ceph-mon[35609]: purged_snaps scrub ok 2024-09-12T02:32:49.264 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 12 02:32:48 smithi172 ceph-mon[35609]: osdmap e58: 9 total, 9 up, 9 in 2024-09-12T02:32:50.198 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 12 02:32:49 smithi044 ceph-mon[35411]: pgmap v200: 1 pgs: 1 active+clean; 577 KiB data, 260 MiB used, 804 GiB / 805 GiB avail 2024-09-12T02:32:50.198 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 12 02:32:49 smithi044 ceph-mon[35411]: osdmap e59: 9 total, 9 up, 9 in 2024-09-12T02:32:50.198 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 12 02:32:49 smithi044 ceph-mon[35411]: from='client.24323 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi039:vg_nvme/lv_1", "target": ["mon-mgr", ""]}]: dispatch 2024-09-12T02:32:50.199 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 12 02:32:49 smithi044 ceph-mon[35411]: from='mgr.14150 172.21.15.39:0/408627207' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-09-12T02:32:50.199 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 12 02:32:49 smithi044 ceph-mon[35411]: from='mgr.14150 172.21.15.39:0/408627207' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-09-12T02:32:50.199 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 12 02:32:49 smithi044 ceph-mon[35411]: from='mgr.14150 172.21.15.39:0/408627207' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-12T02:32:50.261 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 02:32:49 smithi039 ceph-mon[30515]: pgmap v200: 1 pgs: 1 active+clean; 577 KiB data, 260 MiB used, 804 GiB / 805 GiB avail 2024-09-12T02:32:50.261 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 02:32:49 smithi039 ceph-mon[30515]: osdmap e59: 9 total, 9 up, 9 in 2024-09-12T02:32:50.261 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 02:32:49 smithi039 ceph-mon[30515]: from='client.24323 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi039:vg_nvme/lv_1", "target": ["mon-mgr", ""]}]: dispatch 2024-09-12T02:32:50.261 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 02:32:49 smithi039 ceph-mon[30515]: from='mgr.14150 172.21.15.39:0/408627207' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-09-12T02:32:50.261 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 02:32:49 smithi039 ceph-mon[30515]: from='mgr.14150 172.21.15.39:0/408627207' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-09-12T02:32:50.261 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 02:32:49 smithi039 ceph-mon[30515]: from='mgr.14150 172.21.15.39:0/408627207' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-12T02:32:50.263 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 12 02:32:49 smithi172 ceph-mon[35609]: pgmap v200: 1 pgs: 1 active+clean; 577 KiB data, 260 MiB used, 804 GiB / 805 GiB avail 2024-09-12T02:32:50.263 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 12 02:32:49 smithi172 ceph-mon[35609]: osdmap e59: 9 total, 9 up, 9 in 2024-09-12T02:32:50.263 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 12 02:32:49 smithi172 ceph-mon[35609]: from='client.24323 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi039:vg_nvme/lv_1", "target": ["mon-mgr", ""]}]: dispatch 2024-09-12T02:32:50.263 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 12 02:32:49 smithi172 ceph-mon[35609]: from='mgr.14150 172.21.15.39:0/408627207' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-09-12T02:32:50.264 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 12 02:32:49 smithi172 ceph-mon[35609]: from='mgr.14150 172.21.15.39:0/408627207' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-09-12T02:32:50.264 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 12 02:32:49 smithi172 ceph-mon[35609]: from='mgr.14150 172.21.15.39:0/408627207' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-12T02:32:51.263 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 12 02:32:50 smithi172 ceph-mon[35609]: osdmap e60: 9 total, 9 up, 9 in 2024-09-12T02:32:51.264 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 12 02:32:50 smithi172 ceph-mon[35609]: osdmap e61: 9 total, 9 up, 9 in 2024-09-12T02:32:51.286 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 02:32:50 smithi039 ceph-mon[30515]: osdmap e60: 9 total, 9 up, 9 in 2024-09-12T02:32:51.286 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 02:32:50 smithi039 ceph-mon[30515]: osdmap e61: 9 total, 9 up, 9 in 2024-09-12T02:32:51.448 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 12 02:32:50 smithi044 ceph-mon[35411]: osdmap e60: 9 total, 9 up, 9 in 2024-09-12T02:32:51.449 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 12 02:32:50 smithi044 ceph-mon[35411]: osdmap e61: 9 total, 9 up, 9 in 2024-09-12T02:32:52.099 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 02:32:51 smithi039 ceph-mon[30515]: pgmap v203: 1 pgs: 1 peering; 577 KiB data, 260 MiB used, 804 GiB / 805 GiB avail; 146 KiB/s, 0 objects/s recovering 2024-09-12T02:32:52.263 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 12 02:32:51 smithi172 ceph-mon[35609]: pgmap v203: 1 pgs: 1 peering; 577 KiB data, 260 MiB used, 804 GiB / 805 GiB avail; 146 KiB/s, 0 objects/s recovering 2024-09-12T02:32:52.448 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 12 02:32:51 smithi044 ceph-mon[35411]: pgmap v203: 1 pgs: 1 peering; 577 KiB data, 260 MiB used, 804 GiB / 805 GiB avail; 146 KiB/s, 0 objects/s recovering 2024-09-12T02:32:53.263 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 12 02:32:52 smithi172 ceph-mon[35609]: from='client.? 172.21.15.39:0/3417870665' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "87e5dd9e-8191-4db6-83fa-cfff7c31e17e"}]: dispatch 2024-09-12T02:32:53.264 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 12 02:32:52 smithi172 ceph-mon[35609]: from='client.? 172.21.15.39:0/3417870665' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "87e5dd9e-8191-4db6-83fa-cfff7c31e17e"}]': finished 2024-09-12T02:32:53.264 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 12 02:32:52 smithi172 ceph-mon[35609]: osdmap e62: 10 total, 9 up, 10 in 2024-09-12T02:32:53.264 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 12 02:32:52 smithi172 ceph-mon[35609]: from='mgr.14150 172.21.15.39:0/408627207' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 9}]: dispatch 2024-09-12T02:32:53.264 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 12 02:32:52 smithi172 ceph-mon[35609]: from='client.? 172.21.15.39:0/2251632484' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-09-12T02:32:53.349 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 02:32:52 smithi039 ceph-mon[30515]: from='client.? 172.21.15.39:0/3417870665' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "87e5dd9e-8191-4db6-83fa-cfff7c31e17e"}]: dispatch 2024-09-12T02:32:53.349 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 02:32:52 smithi039 ceph-mon[30515]: from='client.? 172.21.15.39:0/3417870665' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "87e5dd9e-8191-4db6-83fa-cfff7c31e17e"}]': finished 2024-09-12T02:32:53.350 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 02:32:52 smithi039 ceph-mon[30515]: osdmap e62: 10 total, 9 up, 10 in 2024-09-12T02:32:53.350 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 02:32:52 smithi039 ceph-mon[30515]: from='mgr.14150 172.21.15.39:0/408627207' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 9}]: dispatch 2024-09-12T02:32:53.350 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 02:32:52 smithi039 ceph-mon[30515]: from='client.? 172.21.15.39:0/2251632484' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-09-12T02:32:53.448 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 12 02:32:52 smithi044 ceph-mon[35411]: from='client.? 172.21.15.39:0/3417870665' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "87e5dd9e-8191-4db6-83fa-cfff7c31e17e"}]: dispatch 2024-09-12T02:32:53.448 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 12 02:32:52 smithi044 ceph-mon[35411]: from='client.? 172.21.15.39:0/3417870665' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "87e5dd9e-8191-4db6-83fa-cfff7c31e17e"}]': finished 2024-09-12T02:32:53.449 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 12 02:32:52 smithi044 ceph-mon[35411]: osdmap e62: 10 total, 9 up, 10 in 2024-09-12T02:32:53.449 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 12 02:32:52 smithi044 ceph-mon[35411]: from='mgr.14150 172.21.15.39:0/408627207' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 9}]: dispatch 2024-09-12T02:32:53.449 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 12 02:32:52 smithi044 ceph-mon[35411]: from='client.? 172.21.15.39:0/2251632484' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-09-12T02:32:54.599 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 02:32:54 smithi039 ceph-mon[30515]: pgmap v206: 1 pgs: 1 peering; 577 KiB data, 260 MiB used, 804 GiB / 805 GiB avail; 144 KiB/s, 0 objects/s recovering 2024-09-12T02:32:54.698 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 12 02:32:54 smithi044 ceph-mon[35411]: pgmap v206: 1 pgs: 1 peering; 577 KiB data, 260 MiB used, 804 GiB / 805 GiB avail; 144 KiB/s, 0 objects/s recovering 2024-09-12T02:32:54.763 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 12 02:32:54 smithi172 ceph-mon[35609]: pgmap v206: 1 pgs: 1 peering; 577 KiB data, 260 MiB used, 804 GiB / 805 GiB avail; 144 KiB/s, 0 objects/s recovering 2024-09-12T02:32:56.543 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 02:32:56 smithi039 ceph-mon[30515]: pgmap v207: 1 pgs: 1 peering; 577 KiB data, 261 MiB used, 804 GiB / 805 GiB avail; 99 KiB/s, 0 objects/s recovering 2024-09-12T02:32:56.698 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 12 02:32:56 smithi044 ceph-mon[35411]: pgmap v207: 1 pgs: 1 peering; 577 KiB data, 261 MiB used, 804 GiB / 805 GiB avail; 99 KiB/s, 0 objects/s recovering 2024-09-12T02:32:56.764 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 12 02:32:56 smithi172 ceph-mon[35609]: pgmap v207: 1 pgs: 1 peering; 577 KiB data, 261 MiB used, 804 GiB / 805 GiB avail; 99 KiB/s, 0 objects/s recovering 2024-09-12T02:32:58.587 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 02:32:58 smithi039 ceph-mon[30515]: pgmap v208: 1 pgs: 1 active+clean; 577 KiB data, 261 MiB used, 804 GiB / 805 GiB avail; 84 KiB/s, 0 objects/s recovering 2024-09-12T02:32:58.698 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 12 02:32:58 smithi044 ceph-mon[35411]: pgmap v208: 1 pgs: 1 active+clean; 577 KiB data, 261 MiB used, 804 GiB / 805 GiB avail; 84 KiB/s, 0 objects/s recovering 2024-09-12T02:32:58.763 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 12 02:32:58 smithi172 ceph-mon[35609]: pgmap v208: 1 pgs: 1 active+clean; 577 KiB data, 261 MiB used, 804 GiB / 805 GiB avail; 84 KiB/s, 0 objects/s recovering 2024-09-12T02:33:00.350 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 02:33:00 smithi039 ceph-mon[30515]: pgmap v209: 1 pgs: 1 active+clean; 577 KiB data, 261 MiB used, 804 GiB / 805 GiB avail 2024-09-12T02:33:00.698 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 12 02:33:00 smithi044 ceph-mon[35411]: pgmap v209: 1 pgs: 1 active+clean; 577 KiB data, 261 MiB used, 804 GiB / 805 GiB avail 2024-09-12T02:33:00.763 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 12 02:33:00 smithi172 ceph-mon[35609]: pgmap v209: 1 pgs: 1 active+clean; 577 KiB data, 261 MiB used, 804 GiB / 805 GiB avail 2024-09-12T02:33:01.599 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 02:33:01 smithi039 ceph-mon[30515]: from='mgr.14150 172.21.15.39:0/408627207' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.9"}]: dispatch 2024-09-12T02:33:01.600 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 02:33:01 smithi039 ceph-mon[30515]: from='mgr.14150 172.21.15.39:0/408627207' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-12T02:33:01.698 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 12 02:33:01 smithi044 ceph-mon[35411]: from='mgr.14150 172.21.15.39:0/408627207' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.9"}]: dispatch 2024-09-12T02:33:01.698 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 12 02:33:01 smithi044 ceph-mon[35411]: from='mgr.14150 172.21.15.39:0/408627207' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-12T02:33:01.763 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 12 02:33:01 smithi172 ceph-mon[35609]: from='mgr.14150 172.21.15.39:0/408627207' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.9"}]: dispatch 2024-09-12T02:33:01.764 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 12 02:33:01 smithi172 ceph-mon[35609]: from='mgr.14150 172.21.15.39:0/408627207' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-12T02:33:02.600 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 02:33:02 smithi039 ceph-mon[30515]: pgmap v210: 1 pgs: 1 active+clean; 577 KiB data, 261 MiB used, 804 GiB / 805 GiB avail 2024-09-12T02:33:02.600 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 02:33:02 smithi039 ceph-mon[30515]: Deploying daemon osd.9 on smithi039 2024-09-12T02:33:02.698 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 12 02:33:02 smithi044 ceph-mon[35411]: pgmap v210: 1 pgs: 1 active+clean; 577 KiB data, 261 MiB used, 804 GiB / 805 GiB avail 2024-09-12T02:33:02.698 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 12 02:33:02 smithi044 ceph-mon[35411]: Deploying daemon osd.9 on smithi039 2024-09-12T02:33:02.763 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 12 02:33:02 smithi172 ceph-mon[35609]: pgmap v210: 1 pgs: 1 active+clean; 577 KiB data, 261 MiB used, 804 GiB / 805 GiB avail 2024-09-12T02:33:02.764 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 12 02:33:02 smithi172 ceph-mon[35609]: Deploying daemon osd.9 on smithi039 2024-09-12T02:33:04.600 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 02:33:04 smithi039 ceph-mon[30515]: pgmap v211: 1 pgs: 1 active+clean; 577 KiB data, 261 MiB used, 804 GiB / 805 GiB avail 2024-09-12T02:33:04.698 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 12 02:33:04 smithi044 ceph-mon[35411]: pgmap v211: 1 pgs: 1 active+clean; 577 KiB data, 261 MiB used, 804 GiB / 805 GiB avail 2024-09-12T02:33:04.763 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 12 02:33:04 smithi172 ceph-mon[35609]: pgmap v211: 1 pgs: 1 active+clean; 577 KiB data, 261 MiB used, 804 GiB / 805 GiB avail 2024-09-12T02:33:06.600 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 02:33:06 smithi039 ceph-mon[30515]: pgmap v212: 1 pgs: 1 active+clean; 577 KiB data, 261 MiB used, 804 GiB / 805 GiB avail 2024-09-12T02:33:06.698 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 12 02:33:06 smithi044 ceph-mon[35411]: pgmap v212: 1 pgs: 1 active+clean; 577 KiB data, 261 MiB used, 804 GiB / 805 GiB avail 2024-09-12T02:33:06.763 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 12 02:33:06 smithi172 ceph-mon[35609]: pgmap v212: 1 pgs: 1 active+clean; 577 KiB data, 261 MiB used, 804 GiB / 805 GiB avail 2024-09-12T02:33:08.599 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 02:33:08 smithi039 ceph-mon[30515]: pgmap v213: 1 pgs: 1 active+clean; 577 KiB data, 261 MiB used, 804 GiB / 805 GiB avail 2024-09-12T02:33:08.698 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 12 02:33:08 smithi044 ceph-mon[35411]: pgmap v213: 1 pgs: 1 active+clean; 577 KiB data, 261 MiB used, 804 GiB / 805 GiB avail 2024-09-12T02:33:08.763 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 12 02:33:08 smithi172 ceph-mon[35609]: pgmap v213: 1 pgs: 1 active+clean; 577 KiB data, 261 MiB used, 804 GiB / 805 GiB avail 2024-09-12T02:33:09.631 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 02:33:09 smithi039 ceph-mon[30515]: from='mgr.14150 172.21.15.39:0/408627207' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-12T02:33:09.631 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 02:33:09 smithi039 ceph-mon[30515]: from='mgr.14150 172.21.15.39:0/408627207' entity='mgr.x' 2024-09-12T02:33:09.631 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 02:33:09 smithi039 ceph-mon[30515]: from='mgr.14150 172.21.15.39:0/408627207' entity='mgr.x' 2024-09-12T02:33:09.698 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 12 02:33:09 smithi044 ceph-mon[35411]: from='mgr.14150 172.21.15.39:0/408627207' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-12T02:33:09.699 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 12 02:33:09 smithi044 ceph-mon[35411]: from='mgr.14150 172.21.15.39:0/408627207' entity='mgr.x' 2024-09-12T02:33:09.699 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 12 02:33:09 smithi044 ceph-mon[35411]: from='mgr.14150 172.21.15.39:0/408627207' entity='mgr.x' 2024-09-12T02:33:09.763 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 12 02:33:09 smithi172 ceph-mon[35609]: from='mgr.14150 172.21.15.39:0/408627207' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-12T02:33:09.764 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 12 02:33:09 smithi172 ceph-mon[35609]: from='mgr.14150 172.21.15.39:0/408627207' entity='mgr.x' 2024-09-12T02:33:09.764 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 12 02:33:09 smithi172 ceph-mon[35609]: from='mgr.14150 172.21.15.39:0/408627207' entity='mgr.x' 2024-09-12T02:33:10.637 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 02:33:10 smithi039 ceph-mon[30515]: pgmap v214: 1 pgs: 1 active+clean; 577 KiB data, 261 MiB used, 804 GiB / 805 GiB avail 2024-09-12T02:33:10.698 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 12 02:33:10 smithi044 ceph-mon[35411]: pgmap v214: 1 pgs: 1 active+clean; 577 KiB data, 261 MiB used, 804 GiB / 805 GiB avail 2024-09-12T02:33:10.763 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 12 02:33:10 smithi172 ceph-mon[35609]: pgmap v214: 1 pgs: 1 active+clean; 577 KiB data, 261 MiB used, 804 GiB / 805 GiB avail 2024-09-12T02:33:12.698 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 12 02:33:12 smithi044 ceph-mon[35411]: pgmap v215: 1 pgs: 1 active+clean; 577 KiB data, 261 MiB used, 804 GiB / 805 GiB avail 2024-09-12T02:33:12.698 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 12 02:33:12 smithi044 ceph-mon[35411]: from='mgr.14150 172.21.15.39:0/408627207' entity='mgr.x' 2024-09-12T02:33:12.698 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 12 02:33:12 smithi044 ceph-mon[35411]: from='mgr.14150 172.21.15.39:0/408627207' entity='mgr.x' 2024-09-12T02:33:12.699 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 12 02:33:12 smithi044 ceph-mon[35411]: from='mgr.14150 172.21.15.39:0/408627207' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-12T02:33:12.699 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 12 02:33:12 smithi044 ceph-mon[35411]: from='mgr.14150 172.21.15.39:0/408627207' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-12T02:33:12.699 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 12 02:33:12 smithi044 ceph-mon[35411]: from='mgr.14150 172.21.15.39:0/408627207' entity='mgr.x' 2024-09-12T02:33:12.763 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 12 02:33:12 smithi172 ceph-mon[35609]: pgmap v215: 1 pgs: 1 active+clean; 577 KiB data, 261 MiB used, 804 GiB / 805 GiB avail 2024-09-12T02:33:12.764 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 12 02:33:12 smithi172 ceph-mon[35609]: from='mgr.14150 172.21.15.39:0/408627207' entity='mgr.x' 2024-09-12T02:33:12.764 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 12 02:33:12 smithi172 ceph-mon[35609]: from='mgr.14150 172.21.15.39:0/408627207' entity='mgr.x' 2024-09-12T02:33:12.764 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 12 02:33:12 smithi172 ceph-mon[35609]: from='mgr.14150 172.21.15.39:0/408627207' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-12T02:33:12.764 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 12 02:33:12 smithi172 ceph-mon[35609]: from='mgr.14150 172.21.15.39:0/408627207' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-12T02:33:12.764 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 12 02:33:12 smithi172 ceph-mon[35609]: from='mgr.14150 172.21.15.39:0/408627207' entity='mgr.x' 2024-09-12T02:33:12.833 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 02:33:12 smithi039 ceph-mon[30515]: pgmap v215: 1 pgs: 1 active+clean; 577 KiB data, 261 MiB used, 804 GiB / 805 GiB avail 2024-09-12T02:33:12.834 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 02:33:12 smithi039 ceph-mon[30515]: from='mgr.14150 172.21.15.39:0/408627207' entity='mgr.x' 2024-09-12T02:33:12.834 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 02:33:12 smithi039 ceph-mon[30515]: from='mgr.14150 172.21.15.39:0/408627207' entity='mgr.x' 2024-09-12T02:33:12.834 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 02:33:12 smithi039 ceph-mon[30515]: from='mgr.14150 172.21.15.39:0/408627207' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-12T02:33:12.834 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 02:33:12 smithi039 ceph-mon[30515]: from='mgr.14150 172.21.15.39:0/408627207' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-12T02:33:12.835 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 02:33:12 smithi039 ceph-mon[30515]: from='mgr.14150 172.21.15.39:0/408627207' entity='mgr.x' 2024-09-12T02:33:13.465 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:33:13.464+0000 7fd593e00640 1 -- 172.21.15.39:0/3930076144 <== mgr.14150 v2:172.21.15.39:6800/1725006999 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+37 (secure 0 0 0) 0x7fd59c075b40 con 0x7fd5800a2bb0 2024-09-12T02:33:13.465 INFO:teuthology.orchestra.run.smithi039.stdout:Created osd(s) 9 on host 'smithi039' 2024-09-12T02:33:13.467 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:33:13.466+0000 7fd5a1400640 1 -- 172.21.15.39:0/3930076144 >> [v2:172.21.15.39:6800/1725006999,v1:172.21.15.39:6801/1725006999] conn(0x7fd5800a2bb0 msgr2=0x7fd5800a5070 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:33:13.467 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:33:13.466+0000 7fd5a1400640 1 --2- 172.21.15.39:0/3930076144 >> [v2:172.21.15.39:6800/1725006999,v1:172.21.15.39:6801/1725006999] conn(0x7fd5800a2bb0 0x7fd5800a5070 secure :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0x7fd58c005fe0 tx=0x7fd58c005f70 comp rx=0 tx=0).stop 2024-09-12T02:33:13.468 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:33:13.467+0000 7fd5a1400640 1 -- 172.21.15.39:0/3930076144 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fd59c102e00 msgr2=0x7fd59c19a650 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:33:13.468 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:33:13.467+0000 7fd5a1400640 1 --2- 172.21.15.39:0/3930076144 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fd59c102e00 0x7fd59c19a650 secure :-1 s=READY pgs=48 cs=0 l=1 rev1=1 crypto rx=0x7fd58400e9f0 tx=0x7fd58400eeb0 comp rx=0 tx=0).stop 2024-09-12T02:33:13.468 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:33:13.467+0000 7fd5a1400640 1 -- 172.21.15.39:0/3930076144 shutdown_connections 2024-09-12T02:33:13.468 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:33:13.467+0000 7fd5a1400640 1 --2- 172.21.15.39:0/3930076144 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fd59c1037c0 0x7fd59c1a16d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:33:13.468 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:33:13.467+0000 7fd5a1400640 1 --2- 172.21.15.39:0/3930076144 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fd59c102e00 0x7fd59c19a650 unknown :-1 s=CLOSED pgs=48 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:33:13.469 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:33:13.467+0000 7fd5a1400640 1 --2- 172.21.15.39:0/3930076144 >> [v2:172.21.15.39:6800/1725006999,v1:172.21.15.39:6801/1725006999] conn(0x7fd5800a2bb0 0x7fd5800a5070 unknown :-1 s=CLOSED pgs=100 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:33:13.469 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:33:13.467+0000 7fd5a1400640 1 --2- 172.21.15.39:0/3930076144 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fd59c101c00 0x7fd59c19a110 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:33:13.469 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:33:13.467+0000 7fd5a1400640 1 -- 172.21.15.39:0/3930076144 >> 172.21.15.39:0/3930076144 conn(0x7fd59c0fd390 msgr2=0x7fd59c074420 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:33:13.469 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:33:13.467+0000 7fd5a1400640 1 -- 172.21.15.39:0/3930076144 shutdown_connections 2024-09-12T02:33:13.469 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:33:13.467+0000 7fd5a1400640 1 -- 172.21.15.39:0/3930076144 wait complete. 2024-09-12T02:33:14.182 DEBUG:teuthology.orchestra.run.smithi039:osd.9> sudo journalctl -f -n 0 -u ceph-4954ed46-70ae-11ef-bcea-c7b262605968@osd.9.service 2024-09-12T02:33:14.186 INFO:tasks.cephadm:Deploying osd.10 on smithi044 with /dev/vg_nvme/lv_1... 2024-09-12T02:33:14.186 DEBUG:teuthology.orchestra.run.smithi044:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc ceph-volume -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 4954ed46-70ae-11ef-bcea-c7b262605968 -- lvm zap /dev/vg_nvme/lv_1 2024-09-12T02:33:14.416 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 02:33:14 smithi039 ceph-mon[30515]: pgmap v216: 1 pgs: 1 active+clean; 577 KiB data, 261 MiB used, 804 GiB / 805 GiB avail 2024-09-12T02:33:14.416 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 02:33:14 smithi039 ceph-mon[30515]: from='mgr.14150 172.21.15.39:0/408627207' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-12T02:33:14.416 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 02:33:14 smithi039 ceph-mon[30515]: from='mgr.14150 172.21.15.39:0/408627207' entity='mgr.x' 2024-09-12T02:33:14.416 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 02:33:14 smithi039 ceph-mon[30515]: from='mgr.14150 172.21.15.39:0/408627207' entity='mgr.x' 2024-09-12T02:33:14.446 INFO:teuthology.orchestra.run.smithi044.stderr:Inferring config /var/lib/ceph/4954ed46-70ae-11ef-bcea-c7b262605968/mon.b/config 2024-09-12T02:33:14.566 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 12 02:33:14 smithi044 ceph-mon[35411]: pgmap v216: 1 pgs: 1 active+clean; 577 KiB data, 261 MiB used, 804 GiB / 805 GiB avail 2024-09-12T02:33:14.566 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 12 02:33:14 smithi044 ceph-mon[35411]: from='mgr.14150 172.21.15.39:0/408627207' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-12T02:33:14.566 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 12 02:33:14 smithi044 ceph-mon[35411]: from='mgr.14150 172.21.15.39:0/408627207' entity='mgr.x' 2024-09-12T02:33:14.567 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 12 02:33:14 smithi044 ceph-mon[35411]: from='mgr.14150 172.21.15.39:0/408627207' entity='mgr.x' 2024-09-12T02:33:14.764 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 12 02:33:14 smithi172 ceph-mon[35609]: pgmap v216: 1 pgs: 1 active+clean; 577 KiB data, 261 MiB used, 804 GiB / 805 GiB avail 2024-09-12T02:33:14.764 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 12 02:33:14 smithi172 ceph-mon[35609]: from='mgr.14150 172.21.15.39:0/408627207' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-12T02:33:14.764 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 12 02:33:14 smithi172 ceph-mon[35609]: from='mgr.14150 172.21.15.39:0/408627207' entity='mgr.x' 2024-09-12T02:33:14.764 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 12 02:33:14 smithi172 ceph-mon[35609]: from='mgr.14150 172.21.15.39:0/408627207' entity='mgr.x' 2024-09-12T02:33:15.600 INFO:journalctl@ceph.osd.9.smithi039.stdout:Sep 12 02:33:15 smithi039 ceph-4954ed46-70ae-11ef-bcea-c7b262605968-osd-9[63678]: 2024-09-12T02:33:15.382+0000 7f6d20437640 -1 osd.9 0 log_to_monitors true 2024-09-12T02:33:16.424 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 12 02:33:16 smithi044 ceph-mon[35411]: pgmap v217: 1 pgs: 1 active+clean; 577 KiB data, 261 MiB used, 804 GiB / 805 GiB avail 2024-09-12T02:33:16.424 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 12 02:33:16 smithi044 ceph-mon[35411]: from='osd.9 [v2:172.21.15.39:6826/945860346,v1:172.21.15.39:6827/945860346]' entity='osd.9' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["9"]}]: dispatch 2024-09-12T02:33:16.600 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 02:33:16 smithi039 ceph-mon[30515]: pgmap v217: 1 pgs: 1 active+clean; 577 KiB data, 261 MiB used, 804 GiB / 805 GiB avail 2024-09-12T02:33:16.600 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 02:33:16 smithi039 ceph-mon[30515]: from='osd.9 [v2:172.21.15.39:6826/945860346,v1:172.21.15.39:6827/945860346]' entity='osd.9' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["9"]}]: dispatch 2024-09-12T02:33:16.763 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 12 02:33:16 smithi172 ceph-mon[35609]: pgmap v217: 1 pgs: 1 active+clean; 577 KiB data, 261 MiB used, 804 GiB / 805 GiB avail 2024-09-12T02:33:16.763 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 12 02:33:16 smithi172 ceph-mon[35609]: from='osd.9 [v2:172.21.15.39:6826/945860346,v1:172.21.15.39:6827/945860346]' entity='osd.9' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["9"]}]: dispatch 2024-09-12T02:33:17.520 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 12 02:33:17 smithi044 ceph-mon[35411]: from='osd.9 [v2:172.21.15.39:6826/945860346,v1:172.21.15.39:6827/945860346]' entity='osd.9' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["9"]}]': finished 2024-09-12T02:33:17.520 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 12 02:33:17 smithi044 ceph-mon[35411]: osdmap e63: 10 total, 9 up, 10 in 2024-09-12T02:33:17.520 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 12 02:33:17 smithi044 ceph-mon[35411]: from='osd.9 [v2:172.21.15.39:6826/945860346,v1:172.21.15.39:6827/945860346]' entity='osd.9' cmd=[{"prefix": "osd crush create-or-move", "id": 9, "weight":0.0873, "args": ["host=smithi039", "root=default"]}]: dispatch 2024-09-12T02:33:17.520 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 12 02:33:17 smithi044 ceph-mon[35411]: from='mgr.14150 172.21.15.39:0/408627207' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 9}]: dispatch 2024-09-12T02:33:17.523 INFO:teuthology.orchestra.run.smithi044.stdout: 2024-09-12T02:33:17.549 DEBUG:teuthology.orchestra.run.smithi044:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 4954ed46-70ae-11ef-bcea-c7b262605968 -- ceph orch daemon add osd smithi044:vg_nvme/lv_1 2024-09-12T02:33:17.599 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 02:33:17 smithi039 ceph-mon[30515]: from='osd.9 [v2:172.21.15.39:6826/945860346,v1:172.21.15.39:6827/945860346]' entity='osd.9' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["9"]}]': finished 2024-09-12T02:33:17.600 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 02:33:17 smithi039 ceph-mon[30515]: osdmap e63: 10 total, 9 up, 10 in 2024-09-12T02:33:17.600 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 02:33:17 smithi039 ceph-mon[30515]: from='osd.9 [v2:172.21.15.39:6826/945860346,v1:172.21.15.39:6827/945860346]' entity='osd.9' cmd=[{"prefix": "osd crush create-or-move", "id": 9, "weight":0.0873, "args": ["host=smithi039", "root=default"]}]: dispatch 2024-09-12T02:33:17.600 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 02:33:17 smithi039 ceph-mon[30515]: from='mgr.14150 172.21.15.39:0/408627207' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 9}]: dispatch 2024-09-12T02:33:17.600 INFO:journalctl@ceph.osd.9.smithi039.stdout:Sep 12 02:33:17 smithi039 ceph-4954ed46-70ae-11ef-bcea-c7b262605968-osd-9[63678]: 2024-09-12T02:33:17.390+0000 7f6d1ac00640 -1 osd.9 0 waiting for initial osdmap 2024-09-12T02:33:17.600 INFO:journalctl@ceph.osd.9.smithi039.stdout:Sep 12 02:33:17 smithi039 ceph-4954ed46-70ae-11ef-bcea-c7b262605968-osd-9[63678]: 2024-09-12T02:33:17.408+0000 7f6d15c00640 -1 osd.9 64 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-09-12T02:33:17.763 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 12 02:33:17 smithi172 ceph-mon[35609]: from='osd.9 [v2:172.21.15.39:6826/945860346,v1:172.21.15.39:6827/945860346]' entity='osd.9' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["9"]}]': finished 2024-09-12T02:33:17.764 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 12 02:33:17 smithi172 ceph-mon[35609]: osdmap e63: 10 total, 9 up, 10 in 2024-09-12T02:33:17.764 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 12 02:33:17 smithi172 ceph-mon[35609]: from='osd.9 [v2:172.21.15.39:6826/945860346,v1:172.21.15.39:6827/945860346]' entity='osd.9' cmd=[{"prefix": "osd crush create-or-move", "id": 9, "weight":0.0873, "args": ["host=smithi039", "root=default"]}]: dispatch 2024-09-12T02:33:17.764 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 12 02:33:17 smithi172 ceph-mon[35609]: from='mgr.14150 172.21.15.39:0/408627207' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 9}]: dispatch 2024-09-12T02:33:17.798 INFO:teuthology.orchestra.run.smithi044.stderr:Inferring config /var/lib/ceph/4954ed46-70ae-11ef-bcea-c7b262605968/mon.b/config 2024-09-12T02:33:18.293 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T02:33:18.259+0000 7fb245d02640 1 -- 172.21.15.44:0/3869305065 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fb240102690 msgr2=0x7fb240108f20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:33:18.293 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T02:33:18.259+0000 7fb245d02640 1 --2- 172.21.15.44:0/3869305065 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fb240102690 0x7fb240108f20 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0x7fb238009ca0 tx=0x7fb23802a8c0 comp rx=0 tx=0).stop 2024-09-12T02:33:18.293 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T02:33:18.259+0000 7fb245d02640 1 -- 172.21.15.44:0/3869305065 shutdown_connections 2024-09-12T02:33:18.293 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T02:33:18.259+0000 7fb245d02640 1 --2- 172.21.15.44:0/3869305065 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fb240102690 0x7fb240108f20 unknown :-1 s=CLOSED pgs=51 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:33:18.294 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T02:33:18.259+0000 7fb245d02640 1 --2- 172.21.15.44:0/3869305065 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fb240101cd0 0x7fb240102150 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:33:18.294 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T02:33:18.259+0000 7fb245d02640 1 --2- 172.21.15.44:0/3869305065 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fb240100ad0 0x7fb240100ed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:33:18.294 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T02:33:18.259+0000 7fb245d02640 1 -- 172.21.15.44:0/3869305065 >> 172.21.15.44:0/3869305065 conn(0x7fb2400fc280 msgr2=0x7fb2400fe6a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:33:18.294 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T02:33:18.259+0000 7fb245d02640 1 -- 172.21.15.44:0/3869305065 shutdown_connections 2024-09-12T02:33:18.294 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T02:33:18.259+0000 7fb245d02640 1 -- 172.21.15.44:0/3869305065 wait complete. 2024-09-12T02:33:18.294 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T02:33:18.260+0000 7fb245d02640 1 Processor -- start 2024-09-12T02:33:18.294 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T02:33:18.260+0000 7fb245d02640 1 -- start start 2024-09-12T02:33:18.294 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T02:33:18.260+0000 7fb245d02640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fb240100ad0 0x7fb240196d40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:33:18.294 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T02:33:18.260+0000 7fb245d02640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fb240101cd0 0x7fb240197280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:33:18.294 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T02:33:18.260+0000 7fb245d02640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fb240102690 0x7fb24019e300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:33:18.294 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T02:33:18.260+0000 7fb245d02640 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 -- 0x7fb24010c7b0 con 0x7fb240102690 2024-09-12T02:33:18.295 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T02:33:18.260+0000 7fb245d02640 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x7fb24010c630 con 0x7fb240101cd0 2024-09-12T02:33:18.295 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T02:33:18.260+0000 7fb245d02640 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7fb24010c930 con 0x7fb240100ad0 2024-09-12T02:33:18.295 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T02:33:18.260+0000 7fb23effd640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fb240101cd0 0x7fb240197280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:33:18.295 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T02:33:18.260+0000 7fb23effd640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fb240101cd0 0x7fb240197280 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.44:44988/0 (socket says 172.21.15.44:44988) 2024-09-12T02:33:18.295 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T02:33:18.260+0000 7fb23effd640 1 -- 172.21.15.44:0/1571366347 learned_addr learned my addr 172.21.15.44:0/1571366347 (peer_addr_for_me v2:172.21.15.44:0/0) 2024-09-12T02:33:18.295 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T02:33:18.260+0000 7fb23f7fe640 1 --2- 172.21.15.44:0/1571366347 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fb240100ad0 0x7fb240196d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:33:18.295 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T02:33:18.260+0000 7fb23ffff640 1 --2- 172.21.15.44:0/1571366347 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fb240102690 0x7fb24019e300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:33:18.295 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T02:33:18.261+0000 7fb23effd640 1 -- 172.21.15.44:0/1571366347 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fb240100ad0 msgr2=0x7fb240196d40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:33:18.295 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T02:33:18.261+0000 7fb23effd640 1 --2- 172.21.15.44:0/1571366347 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fb240100ad0 0x7fb240196d40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:33:18.296 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T02:33:18.261+0000 7fb23effd640 1 -- 172.21.15.44:0/1571366347 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fb240102690 msgr2=0x7fb24019e300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:33:18.296 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T02:33:18.261+0000 7fb23effd640 1 --2- 172.21.15.44:0/1571366347 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fb240102690 0x7fb24019e300 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:33:18.296 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T02:33:18.261+0000 7fb23effd640 1 -- 172.21.15.44:0/1571366347 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb24019e970 con 0x7fb240101cd0 2024-09-12T02:33:18.296 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T02:33:18.261+0000 7fb23f7fe640 1 --2- 172.21.15.44:0/1571366347 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fb240100ad0 0x7fb240196d40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-12T02:33:18.296 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T02:33:18.261+0000 7fb23effd640 1 --2- 172.21.15.44:0/1571366347 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fb240101cd0 0x7fb240197280 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7fb23400b4a0 tx=0x7fb23400b960 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:33:18.296 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T02:33:18.261+0000 7fb23cff9640 1 -- 172.21.15.44:0/1571366347 <== mon.2 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb234014070 con 0x7fb240101cd0 2024-09-12T02:33:18.296 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T02:33:18.261+0000 7fb23cff9640 1 -- 172.21.15.44:0/1571366347 <== mon.2 v2:172.21.15.44:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fb234010af0 con 0x7fb240101cd0 2024-09-12T02:33:18.296 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T02:33:18.261+0000 7fb245d02640 1 -- 172.21.15.44:0/1571366347 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb24019ec60 con 0x7fb240101cd0 2024-09-12T02:33:18.296 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T02:33:18.261+0000 7fb23cff9640 1 -- 172.21.15.44:0/1571366347 <== mon.2 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb234017d10 con 0x7fb240101cd0 2024-09-12T02:33:18.296 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T02:33:18.261+0000 7fb245d02640 1 -- 172.21.15.44:0/1571366347 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb24019f1a0 con 0x7fb240101cd0 2024-09-12T02:33:18.297 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T02:33:18.262+0000 7fb245d02640 1 -- 172.21.15.44:0/1571366347 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fb240107e80 con 0x7fb240101cd0 2024-09-12T02:33:18.297 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T02:33:18.263+0000 7fb23cff9640 1 -- 172.21.15.44:0/1571366347 <== mon.2 v2:172.21.15.44:3300/0 4 ==== mgrmap(e 16) ==== 137833+0+0 (secure 0 0 0) 0x7fb234017070 con 0x7fb240101cd0 2024-09-12T02:33:18.297 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T02:33:18.264+0000 7fb23cff9640 1 --2- 172.21.15.44:0/1571366347 >> [v2:172.21.15.39:6800/1725006999,v1:172.21.15.39:6801/1725006999] conn(0x7fb2280a2bb0 0x7fb2280a5070 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:33:18.297 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T02:33:18.264+0000 7fb23cff9640 1 -- 172.21.15.44:0/1571366347 <== mon.2 v2:172.21.15.44:3300/0 5 ==== osd_map(64..64 src has 1..64) ==== 5981+0+0 (secure 0 0 0) 0x7fb2340cdb30 con 0x7fb240101cd0 2024-09-12T02:33:18.297 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T02:33:18.264+0000 7fb23f7fe640 1 --2- 172.21.15.44:0/1571366347 >> [v2:172.21.15.39:6800/1725006999,v1:172.21.15.39:6801/1725006999] conn(0x7fb2280a2bb0 0x7fb2280a5070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:33:18.297 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T02:33:18.265+0000 7fb23f7fe640 1 --2- 172.21.15.44:0/1571366347 >> [v2:172.21.15.39:6800/1725006999,v1:172.21.15.39:6801/1725006999] conn(0x7fb2280a2bb0 0x7fb2280a5070 secure :-1 s=READY pgs=104 cs=0 l=1 rev1=1 crypto rx=0x7fb240101b30 tx=0x7fb23000a5e0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:33:18.297 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T02:33:18.269+0000 7fb23cff9640 1 -- 172.21.15.44:0/1571366347 <== mon.2 v2:172.21.15.44:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7fb23409b3b0 con 0x7fb240101cd0 2024-09-12T02:33:18.448 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 12 02:33:18 smithi044 ceph-mon[35411]: pgmap v219: 1 pgs: 1 active+clean; 577 KiB data, 261 MiB used, 804 GiB / 805 GiB avail 2024-09-12T02:33:18.448 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 12 02:33:18 smithi044 ceph-mon[35411]: from='osd.9 [v2:172.21.15.39:6826/945860346,v1:172.21.15.39:6827/945860346]' entity='osd.9' cmd='[{"prefix": "osd crush create-or-move", "id": 9, "weight":0.0873, "args": ["host=smithi039", "root=default"]}]': finished 2024-09-12T02:33:18.448 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 12 02:33:18 smithi044 ceph-mon[35411]: osdmap e64: 10 total, 9 up, 10 in 2024-09-12T02:33:18.449 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 12 02:33:18 smithi044 ceph-mon[35411]: from='mgr.14150 172.21.15.39:0/408627207' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 9}]: dispatch 2024-09-12T02:33:18.449 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 12 02:33:18 smithi044 ceph-mon[35411]: from='mgr.14150 172.21.15.39:0/408627207' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 9}]: dispatch 2024-09-12T02:33:18.449 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 12 02:33:18 smithi044 ceph-mon[35411]: from='mgr.14150 172.21.15.39:0/408627207' entity='mgr.x' 2024-09-12T02:33:18.457 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T02:33:18.457+0000 7fb245d02640 1 -- 172.21.15.44:0/1571366347 --> [v2:172.21.15.39:6800/1725006999,v1:172.21.15.39:6801/1725006999] -- mgr_command(tid 0: {"prefix": "orch daemon add osd", "svc_arg": "smithi044:vg_nvme/lv_1", "target": ["mon-mgr", ""]}) -- 0x7fb240062630 con 0x7fb2280a2bb0 2024-09-12T02:33:18.599 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 02:33:18 smithi039 ceph-mon[30515]: pgmap v219: 1 pgs: 1 active+clean; 577 KiB data, 261 MiB used, 804 GiB / 805 GiB avail 2024-09-12T02:33:18.600 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 02:33:18 smithi039 ceph-mon[30515]: from='osd.9 [v2:172.21.15.39:6826/945860346,v1:172.21.15.39:6827/945860346]' entity='osd.9' cmd='[{"prefix": "osd crush create-or-move", "id": 9, "weight":0.0873, "args": ["host=smithi039", "root=default"]}]': finished 2024-09-12T02:33:18.600 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 02:33:18 smithi039 ceph-mon[30515]: osdmap e64: 10 total, 9 up, 10 in 2024-09-12T02:33:18.600 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 02:33:18 smithi039 ceph-mon[30515]: from='mgr.14150 172.21.15.39:0/408627207' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 9}]: dispatch 2024-09-12T02:33:18.600 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 02:33:18 smithi039 ceph-mon[30515]: from='mgr.14150 172.21.15.39:0/408627207' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 9}]: dispatch 2024-09-12T02:33:18.600 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 02:33:18 smithi039 ceph-mon[30515]: from='mgr.14150 172.21.15.39:0/408627207' entity='mgr.x' 2024-09-12T02:33:18.764 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 12 02:33:18 smithi172 ceph-mon[35609]: pgmap v219: 1 pgs: 1 active+clean; 577 KiB data, 261 MiB used, 804 GiB / 805 GiB avail 2024-09-12T02:33:18.764 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 12 02:33:18 smithi172 ceph-mon[35609]: from='osd.9 [v2:172.21.15.39:6826/945860346,v1:172.21.15.39:6827/945860346]' entity='osd.9' cmd='[{"prefix": "osd crush create-or-move", "id": 9, "weight":0.0873, "args": ["host=smithi039", "root=default"]}]': finished 2024-09-12T02:33:18.764 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 12 02:33:18 smithi172 ceph-mon[35609]: osdmap e64: 10 total, 9 up, 10 in 2024-09-12T02:33:18.764 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 12 02:33:18 smithi172 ceph-mon[35609]: from='mgr.14150 172.21.15.39:0/408627207' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 9}]: dispatch 2024-09-12T02:33:18.764 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 12 02:33:18 smithi172 ceph-mon[35609]: from='mgr.14150 172.21.15.39:0/408627207' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 9}]: dispatch 2024-09-12T02:33:18.764 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 12 02:33:18 smithi172 ceph-mon[35609]: from='mgr.14150 172.21.15.39:0/408627207' entity='mgr.x' 2024-09-12T02:33:19.699 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 12 02:33:19 smithi044 ceph-mon[35411]: purged_snaps scrub starts 2024-09-12T02:33:19.699 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 12 02:33:19 smithi044 ceph-mon[35411]: purged_snaps scrub ok 2024-09-12T02:33:19.700 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 12 02:33:19 smithi044 ceph-mon[35411]: Detected new or changed devices on smithi039 2024-09-12T02:33:19.700 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 12 02:33:19 smithi044 ceph-mon[35411]: from='mgr.14150 172.21.15.39:0/408627207' entity='mgr.x' 2024-09-12T02:33:19.700 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 12 02:33:19 smithi044 ceph-mon[35411]: from='mgr.14150 172.21.15.39:0/408627207' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 9}]: dispatch 2024-09-12T02:33:19.700 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 12 02:33:19 smithi044 ceph-mon[35411]: from='mgr.14150 172.21.15.39:0/408627207' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-09-12T02:33:19.700 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 12 02:33:19 smithi044 ceph-mon[35411]: osd.9 [v2:172.21.15.39:6826/945860346,v1:172.21.15.39:6827/945860346] boot 2024-09-12T02:33:19.700 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 12 02:33:19 smithi044 ceph-mon[35411]: osdmap e65: 10 total, 10 up, 10 in 2024-09-12T02:33:19.700 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 12 02:33:19 smithi044 ceph-mon[35411]: from='mgr.14150 172.21.15.39:0/408627207' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2024-09-12T02:33:19.700 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 12 02:33:19 smithi044 ceph-mon[35411]: from='mgr.14150 172.21.15.39:0/408627207' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 9}]: dispatch 2024-09-12T02:33:19.700 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 12 02:33:19 smithi044 ceph-mon[35411]: from='mgr.14150 172.21.15.39:0/408627207' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.6", "name": "osd_memory_target"}]: dispatch 2024-09-12T02:33:19.700 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 12 02:33:19 smithi044 ceph-mon[35411]: from='mgr.14150 172.21.15.39:0/408627207' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.9", "name": "osd_memory_target"}]: dispatch 2024-09-12T02:33:19.700 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 12 02:33:19 smithi044 ceph-mon[35411]: Adjusting osd_memory_target on smithi039 to 4272M 2024-09-12T02:33:19.700 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 12 02:33:19 smithi044 ceph-mon[35411]: from='mgr.14150 172.21.15.39:0/408627207' entity='mgr.x' 2024-09-12T02:33:19.700 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 12 02:33:19 smithi044 ceph-mon[35411]: from='mgr.14150 172.21.15.39:0/408627207' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-12T02:33:19.701 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 12 02:33:19 smithi044 ceph-mon[35411]: from='mgr.14150 172.21.15.39:0/408627207' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-12T02:33:19.701 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 12 02:33:19 smithi044 ceph-mon[35411]: from='mgr.14150 172.21.15.39:0/408627207' entity='mgr.x' 2024-09-12T02:33:19.701 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 12 02:33:19 smithi044 ceph-mon[35411]: from='client.24350 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi044:vg_nvme/lv_1", "target": ["mon-mgr", ""]}]: dispatch 2024-09-12T02:33:19.701 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 12 02:33:19 smithi044 ceph-mon[35411]: from='mgr.14150 172.21.15.39:0/408627207' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-09-12T02:33:19.701 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 12 02:33:19 smithi044 ceph-mon[35411]: from='mgr.14150 172.21.15.39:0/408627207' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-09-12T02:33:19.701 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 12 02:33:19 smithi044 ceph-mon[35411]: from='mgr.14150 172.21.15.39:0/408627207' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-12T02:33:19.764 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 12 02:33:19 smithi172 ceph-mon[35609]: purged_snaps scrub starts 2024-09-12T02:33:19.764 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 12 02:33:19 smithi172 ceph-mon[35609]: purged_snaps scrub ok 2024-09-12T02:33:19.764 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 12 02:33:19 smithi172 ceph-mon[35609]: Detected new or changed devices on smithi039 2024-09-12T02:33:19.764 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 12 02:33:19 smithi172 ceph-mon[35609]: from='mgr.14150 172.21.15.39:0/408627207' entity='mgr.x' 2024-09-12T02:33:19.764 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 12 02:33:19 smithi172 ceph-mon[35609]: from='mgr.14150 172.21.15.39:0/408627207' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 9}]: dispatch 2024-09-12T02:33:19.764 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 12 02:33:19 smithi172 ceph-mon[35609]: from='mgr.14150 172.21.15.39:0/408627207' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-09-12T02:33:19.764 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 12 02:33:19 smithi172 ceph-mon[35609]: osd.9 [v2:172.21.15.39:6826/945860346,v1:172.21.15.39:6827/945860346] boot 2024-09-12T02:33:19.764 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 12 02:33:19 smithi172 ceph-mon[35609]: osdmap e65: 10 total, 10 up, 10 in 2024-09-12T02:33:19.764 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 12 02:33:19 smithi172 ceph-mon[35609]: from='mgr.14150 172.21.15.39:0/408627207' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2024-09-12T02:33:19.764 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 12 02:33:19 smithi172 ceph-mon[35609]: from='mgr.14150 172.21.15.39:0/408627207' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 9}]: dispatch 2024-09-12T02:33:19.765 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 12 02:33:19 smithi172 ceph-mon[35609]: from='mgr.14150 172.21.15.39:0/408627207' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.6", "name": "osd_memory_target"}]: dispatch 2024-09-12T02:33:19.765 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 12 02:33:19 smithi172 ceph-mon[35609]: from='mgr.14150 172.21.15.39:0/408627207' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.9", "name": "osd_memory_target"}]: dispatch 2024-09-12T02:33:19.765 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 12 02:33:19 smithi172 ceph-mon[35609]: Adjusting osd_memory_target on smithi039 to 4272M 2024-09-12T02:33:19.765 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 12 02:33:19 smithi172 ceph-mon[35609]: from='mgr.14150 172.21.15.39:0/408627207' entity='mgr.x' 2024-09-12T02:33:19.765 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 12 02:33:19 smithi172 ceph-mon[35609]: from='mgr.14150 172.21.15.39:0/408627207' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-12T02:33:19.765 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 12 02:33:19 smithi172 ceph-mon[35609]: from='mgr.14150 172.21.15.39:0/408627207' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-12T02:33:19.765 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 12 02:33:19 smithi172 ceph-mon[35609]: from='mgr.14150 172.21.15.39:0/408627207' entity='mgr.x' 2024-09-12T02:33:19.765 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 12 02:33:19 smithi172 ceph-mon[35609]: from='client.24350 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi044:vg_nvme/lv_1", "target": ["mon-mgr", ""]}]: dispatch 2024-09-12T02:33:19.765 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 12 02:33:19 smithi172 ceph-mon[35609]: from='mgr.14150 172.21.15.39:0/408627207' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-09-12T02:33:19.765 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 12 02:33:19 smithi172 ceph-mon[35609]: from='mgr.14150 172.21.15.39:0/408627207' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-09-12T02:33:19.765 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 12 02:33:19 smithi172 ceph-mon[35609]: from='mgr.14150 172.21.15.39:0/408627207' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-12T02:33:19.850 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 02:33:19 smithi039 ceph-mon[30515]: purged_snaps scrub starts 2024-09-12T02:33:19.850 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 02:33:19 smithi039 ceph-mon[30515]: purged_snaps scrub ok 2024-09-12T02:33:19.850 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 02:33:19 smithi039 ceph-mon[30515]: Detected new or changed devices on smithi039 2024-09-12T02:33:19.850 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 02:33:19 smithi039 ceph-mon[30515]: from='mgr.14150 172.21.15.39:0/408627207' entity='mgr.x' 2024-09-12T02:33:19.850 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 02:33:19 smithi039 ceph-mon[30515]: from='mgr.14150 172.21.15.39:0/408627207' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 9}]: dispatch 2024-09-12T02:33:19.850 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 02:33:19 smithi039 ceph-mon[30515]: from='mgr.14150 172.21.15.39:0/408627207' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-09-12T02:33:19.850 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 02:33:19 smithi039 ceph-mon[30515]: osd.9 [v2:172.21.15.39:6826/945860346,v1:172.21.15.39:6827/945860346] boot 2024-09-12T02:33:19.850 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 02:33:19 smithi039 ceph-mon[30515]: osdmap e65: 10 total, 10 up, 10 in 2024-09-12T02:33:19.851 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 02:33:19 smithi039 ceph-mon[30515]: from='mgr.14150 172.21.15.39:0/408627207' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2024-09-12T02:33:19.851 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 02:33:19 smithi039 ceph-mon[30515]: from='mgr.14150 172.21.15.39:0/408627207' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 9}]: dispatch 2024-09-12T02:33:19.851 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 02:33:19 smithi039 ceph-mon[30515]: from='mgr.14150 172.21.15.39:0/408627207' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.6", "name": "osd_memory_target"}]: dispatch 2024-09-12T02:33:19.851 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 02:33:19 smithi039 ceph-mon[30515]: from='mgr.14150 172.21.15.39:0/408627207' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.9", "name": "osd_memory_target"}]: dispatch 2024-09-12T02:33:19.851 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 02:33:19 smithi039 ceph-mon[30515]: Adjusting osd_memory_target on smithi039 to 4272M 2024-09-12T02:33:19.851 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 02:33:19 smithi039 ceph-mon[30515]: from='mgr.14150 172.21.15.39:0/408627207' entity='mgr.x' 2024-09-12T02:33:19.851 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 02:33:19 smithi039 ceph-mon[30515]: from='mgr.14150 172.21.15.39:0/408627207' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-12T02:33:19.851 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 02:33:19 smithi039 ceph-mon[30515]: from='mgr.14150 172.21.15.39:0/408627207' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-12T02:33:19.851 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 02:33:19 smithi039 ceph-mon[30515]: from='mgr.14150 172.21.15.39:0/408627207' entity='mgr.x' 2024-09-12T02:33:19.851 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 02:33:19 smithi039 ceph-mon[30515]: from='client.24350 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi044:vg_nvme/lv_1", "target": ["mon-mgr", ""]}]: dispatch 2024-09-12T02:33:19.851 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 02:33:19 smithi039 ceph-mon[30515]: from='mgr.14150 172.21.15.39:0/408627207' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-09-12T02:33:19.851 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 02:33:19 smithi039 ceph-mon[30515]: from='mgr.14150 172.21.15.39:0/408627207' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-09-12T02:33:19.852 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 02:33:19 smithi039 ceph-mon[30515]: from='mgr.14150 172.21.15.39:0/408627207' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-12T02:33:20.621 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 12 02:33:20 smithi044 ceph-mon[35411]: pgmap v222: 1 pgs: 1 active+clean; 577 KiB data, 261 MiB used, 804 GiB / 805 GiB avail 2024-09-12T02:33:20.622 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 12 02:33:20 smithi044 ceph-mon[35411]: osdmap e66: 10 total, 10 up, 10 in 2024-09-12T02:33:20.763 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 12 02:33:20 smithi172 ceph-mon[35609]: pgmap v222: 1 pgs: 1 active+clean; 577 KiB data, 261 MiB used, 804 GiB / 805 GiB avail 2024-09-12T02:33:20.763 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 12 02:33:20 smithi172 ceph-mon[35609]: osdmap e66: 10 total, 10 up, 10 in 2024-09-12T02:33:20.850 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 02:33:20 smithi039 ceph-mon[30515]: pgmap v222: 1 pgs: 1 active+clean; 577 KiB data, 261 MiB used, 804 GiB / 805 GiB avail 2024-09-12T02:33:20.850 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 02:33:20 smithi039 ceph-mon[30515]: osdmap e66: 10 total, 10 up, 10 in 2024-09-12T02:33:21.448 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 12 02:33:21 smithi044 ceph-mon[35411]: from='client.? 172.21.15.44:0/664261983' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "b55d8a00-850f-4910-a5bf-97d9ed545be7"}]: dispatch 2024-09-12T02:33:21.448 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 12 02:33:21 smithi044 ceph-mon[35411]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "b55d8a00-850f-4910-a5bf-97d9ed545be7"}]: dispatch 2024-09-12T02:33:21.449 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 12 02:33:21 smithi044 ceph-mon[35411]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "b55d8a00-850f-4910-a5bf-97d9ed545be7"}]': finished 2024-09-12T02:33:21.449 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 12 02:33:21 smithi044 ceph-mon[35411]: osdmap e67: 11 total, 10 up, 11 in 2024-09-12T02:33:21.449 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 12 02:33:21 smithi044 ceph-mon[35411]: from='mgr.14150 172.21.15.39:0/408627207' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 10}]: dispatch 2024-09-12T02:33:21.763 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 12 02:33:21 smithi172 ceph-mon[35609]: from='client.? 172.21.15.44:0/664261983' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "b55d8a00-850f-4910-a5bf-97d9ed545be7"}]: dispatch 2024-09-12T02:33:21.763 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 12 02:33:21 smithi172 ceph-mon[35609]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "b55d8a00-850f-4910-a5bf-97d9ed545be7"}]: dispatch 2024-09-12T02:33:21.764 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 12 02:33:21 smithi172 ceph-mon[35609]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "b55d8a00-850f-4910-a5bf-97d9ed545be7"}]': finished 2024-09-12T02:33:21.764 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 12 02:33:21 smithi172 ceph-mon[35609]: osdmap e67: 11 total, 10 up, 11 in 2024-09-12T02:33:21.764 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 12 02:33:21 smithi172 ceph-mon[35609]: from='mgr.14150 172.21.15.39:0/408627207' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 10}]: dispatch 2024-09-12T02:33:21.850 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 02:33:21 smithi039 ceph-mon[30515]: from='client.? 172.21.15.44:0/664261983' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "b55d8a00-850f-4910-a5bf-97d9ed545be7"}]: dispatch 2024-09-12T02:33:21.850 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 02:33:21 smithi039 ceph-mon[30515]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "b55d8a00-850f-4910-a5bf-97d9ed545be7"}]: dispatch 2024-09-12T02:33:21.850 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 02:33:21 smithi039 ceph-mon[30515]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "b55d8a00-850f-4910-a5bf-97d9ed545be7"}]': finished 2024-09-12T02:33:21.850 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 02:33:21 smithi039 ceph-mon[30515]: osdmap e67: 11 total, 10 up, 11 in 2024-09-12T02:33:21.850 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 02:33:21 smithi039 ceph-mon[30515]: from='mgr.14150 172.21.15.39:0/408627207' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 10}]: dispatch 2024-09-12T02:33:22.698 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 12 02:33:22 smithi044 ceph-mon[35411]: pgmap v224: 1 pgs: 1 active+clean; 577 KiB data, 288 MiB used, 894 GiB / 894 GiB avail 2024-09-12T02:33:22.698 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 12 02:33:22 smithi044 ceph-mon[35411]: from='client.? 172.21.15.44:0/2637382779' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-09-12T02:33:22.763 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 12 02:33:22 smithi172 ceph-mon[35609]: pgmap v224: 1 pgs: 1 active+clean; 577 KiB data, 288 MiB used, 894 GiB / 894 GiB avail 2024-09-12T02:33:22.763 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 12 02:33:22 smithi172 ceph-mon[35609]: from='client.? 172.21.15.44:0/2637382779' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-09-12T02:33:22.849 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 02:33:22 smithi039 ceph-mon[30515]: pgmap v224: 1 pgs: 1 active+clean; 577 KiB data, 288 MiB used, 894 GiB / 894 GiB avail 2024-09-12T02:33:22.850 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 02:33:22 smithi039 ceph-mon[30515]: from='client.? 172.21.15.44:0/2637382779' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-09-12T02:33:24.698 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 12 02:33:24 smithi044 ceph-mon[35411]: pgmap v226: 1 pgs: 1 active+clean; 577 KiB data, 288 MiB used, 894 GiB / 894 GiB avail 2024-09-12T02:33:24.764 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 12 02:33:24 smithi172 ceph-mon[35609]: pgmap v226: 1 pgs: 1 active+clean; 577 KiB data, 288 MiB used, 894 GiB / 894 GiB avail 2024-09-12T02:33:24.849 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 02:33:24 smithi039 ceph-mon[30515]: pgmap v226: 1 pgs: 1 active+clean; 577 KiB data, 288 MiB used, 894 GiB / 894 GiB avail 2024-09-12T02:33:26.591 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 12 02:33:26 smithi044 ceph-mon[35411]: pgmap v227: 1 pgs: 1 active+clean; 577 KiB data, 288 MiB used, 894 GiB / 894 GiB avail 2024-09-12T02:33:26.763 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 12 02:33:26 smithi172 ceph-mon[35609]: pgmap v227: 1 pgs: 1 active+clean; 577 KiB data, 288 MiB used, 894 GiB / 894 GiB avail 2024-09-12T02:33:26.849 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 02:33:26 smithi039 ceph-mon[30515]: pgmap v227: 1 pgs: 1 active+clean; 577 KiB data, 288 MiB used, 894 GiB / 894 GiB avail 2024-09-12T02:33:28.664 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 12 02:33:28 smithi044 ceph-mon[35411]: pgmap v228: 1 pgs: 1 active+clean; 577 KiB data, 289 MiB used, 894 GiB / 894 GiB avail 2024-09-12T02:33:28.764 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 12 02:33:28 smithi172 ceph-mon[35609]: pgmap v228: 1 pgs: 1 active+clean; 577 KiB data, 289 MiB used, 894 GiB / 894 GiB avail 2024-09-12T02:33:28.849 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 02:33:28 smithi039 ceph-mon[30515]: pgmap v228: 1 pgs: 1 active+clean; 577 KiB data, 289 MiB used, 894 GiB / 894 GiB avail 2024-09-12T02:33:29.699 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 12 02:33:29 smithi044 ceph-mon[35411]: from='mgr.14150 172.21.15.39:0/408627207' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.10"}]: dispatch 2024-09-12T02:33:29.699 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 12 02:33:29 smithi044 ceph-mon[35411]: from='mgr.14150 172.21.15.39:0/408627207' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-12T02:33:29.765 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 12 02:33:29 smithi172 ceph-mon[35609]: from='mgr.14150 172.21.15.39:0/408627207' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.10"}]: dispatch 2024-09-12T02:33:29.765 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 12 02:33:29 smithi172 ceph-mon[35609]: from='mgr.14150 172.21.15.39:0/408627207' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-12T02:33:29.849 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 02:33:29 smithi039 ceph-mon[30515]: from='mgr.14150 172.21.15.39:0/408627207' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.10"}]: dispatch 2024-09-12T02:33:29.850 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 02:33:29 smithi039 ceph-mon[30515]: from='mgr.14150 172.21.15.39:0/408627207' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-12T02:33:30.698 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 12 02:33:30 smithi044 ceph-mon[35411]: pgmap v229: 1 pgs: 1 active+clean; 577 KiB data, 289 MiB used, 894 GiB / 894 GiB avail 2024-09-12T02:33:30.698 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 12 02:33:30 smithi044 ceph-mon[35411]: Deploying daemon osd.10 on smithi044 2024-09-12T02:33:30.763 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 12 02:33:30 smithi172 ceph-mon[35609]: pgmap v229: 1 pgs: 1 active+clean; 577 KiB data, 289 MiB used, 894 GiB / 894 GiB avail 2024-09-12T02:33:30.763 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 12 02:33:30 smithi172 ceph-mon[35609]: Deploying daemon osd.10 on smithi044 2024-09-12T02:33:30.850 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 02:33:30 smithi039 ceph-mon[30515]: pgmap v229: 1 pgs: 1 active+clean; 577 KiB data, 289 MiB used, 894 GiB / 894 GiB avail 2024-09-12T02:33:30.850 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 02:33:30 smithi039 ceph-mon[30515]: Deploying daemon osd.10 on smithi044 2024-09-12T02:33:32.763 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 12 02:33:32 smithi172 ceph-mon[35609]: pgmap v230: 1 pgs: 1 active+clean; 577 KiB data, 289 MiB used, 894 GiB / 894 GiB avail 2024-09-12T02:33:32.849 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 02:33:32 smithi039 ceph-mon[30515]: pgmap v230: 1 pgs: 1 active+clean; 577 KiB data, 289 MiB used, 894 GiB / 894 GiB avail 2024-09-12T02:33:32.905 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 12 02:33:32 smithi044 ceph-mon[35411]: pgmap v230: 1 pgs: 1 active+clean; 577 KiB data, 289 MiB used, 894 GiB / 894 GiB avail 2024-09-12T02:33:34.699 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 12 02:33:34 smithi044 ceph-mon[35411]: pgmap v231: 1 pgs: 1 active+clean; 577 KiB data, 289 MiB used, 894 GiB / 894 GiB avail 2024-09-12T02:33:34.763 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 12 02:33:34 smithi172 ceph-mon[35609]: pgmap v231: 1 pgs: 1 active+clean; 577 KiB data, 289 MiB used, 894 GiB / 894 GiB avail 2024-09-12T02:33:34.850 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 02:33:34 smithi039 ceph-mon[30515]: pgmap v231: 1 pgs: 1 active+clean; 577 KiB data, 289 MiB used, 894 GiB / 894 GiB avail 2024-09-12T02:33:35.763 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 12 02:33:35 smithi172 ceph-mon[35609]: from='mgr.14150 172.21.15.39:0/408627207' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-12T02:33:35.764 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 12 02:33:35 smithi172 ceph-mon[35609]: from='mgr.14150 172.21.15.39:0/408627207' entity='mgr.x' 2024-09-12T02:33:35.764 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 12 02:33:35 smithi172 ceph-mon[35609]: from='mgr.14150 172.21.15.39:0/408627207' entity='mgr.x' 2024-09-12T02:33:35.830 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 12 02:33:35 smithi044 ceph-mon[35411]: from='mgr.14150 172.21.15.39:0/408627207' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-12T02:33:35.831 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 12 02:33:35 smithi044 ceph-mon[35411]: from='mgr.14150 172.21.15.39:0/408627207' entity='mgr.x' 2024-09-12T02:33:35.831 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 12 02:33:35 smithi044 ceph-mon[35411]: from='mgr.14150 172.21.15.39:0/408627207' entity='mgr.x' 2024-09-12T02:33:35.850 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 02:33:35 smithi039 ceph-mon[30515]: from='mgr.14150 172.21.15.39:0/408627207' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-12T02:33:35.850 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 02:33:35 smithi039 ceph-mon[30515]: from='mgr.14150 172.21.15.39:0/408627207' entity='mgr.x' 2024-09-12T02:33:35.850 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 02:33:35 smithi039 ceph-mon[30515]: from='mgr.14150 172.21.15.39:0/408627207' entity='mgr.x' 2024-09-12T02:33:36.599 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 02:33:36 smithi039 ceph-mon[30515]: pgmap v232: 1 pgs: 1 active+clean; 577 KiB data, 289 MiB used, 894 GiB / 894 GiB avail 2024-09-12T02:33:36.763 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 12 02:33:36 smithi172 ceph-mon[35609]: pgmap v232: 1 pgs: 1 active+clean; 577 KiB data, 289 MiB used, 894 GiB / 894 GiB avail 2024-09-12T02:33:36.779 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 12 02:33:36 smithi044 ceph-mon[35411]: pgmap v232: 1 pgs: 1 active+clean; 577 KiB data, 289 MiB used, 894 GiB / 894 GiB avail 2024-09-12T02:33:38.607 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 12 02:33:38 smithi044 ceph-mon[35411]: pgmap v233: 1 pgs: 1 active+clean; 577 KiB data, 289 MiB used, 894 GiB / 894 GiB avail 2024-09-12T02:33:38.652 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T02:33:38.651+0000 7fb23cff9640 1 -- 172.21.15.44:0/1571366347 <== mgr.14150 v2:172.21.15.39:6800/1725006999 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+38 (secure 0 0 0) 0x7fb240062630 con 0x7fb2280a2bb0 2024-09-12T02:33:38.653 INFO:teuthology.orchestra.run.smithi044.stdout:Created osd(s) 10 on host 'smithi044' 2024-09-12T02:33:38.654 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T02:33:38.653+0000 7fb245d02640 1 -- 172.21.15.44:0/1571366347 >> [v2:172.21.15.39:6800/1725006999,v1:172.21.15.39:6801/1725006999] conn(0x7fb2280a2bb0 msgr2=0x7fb2280a5070 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:33:38.654 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T02:33:38.653+0000 7fb245d02640 1 --2- 172.21.15.44:0/1571366347 >> [v2:172.21.15.39:6800/1725006999,v1:172.21.15.39:6801/1725006999] conn(0x7fb2280a2bb0 0x7fb2280a5070 secure :-1 s=READY pgs=104 cs=0 l=1 rev1=1 crypto rx=0x7fb240101b30 tx=0x7fb23000a5e0 comp rx=0 tx=0).stop 2024-09-12T02:33:38.654 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T02:33:38.653+0000 7fb245d02640 1 -- 172.21.15.44:0/1571366347 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fb240101cd0 msgr2=0x7fb240197280 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:33:38.654 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T02:33:38.653+0000 7fb245d02640 1 --2- 172.21.15.44:0/1571366347 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fb240101cd0 0x7fb240197280 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7fb23400b4a0 tx=0x7fb23400b960 comp rx=0 tx=0).stop 2024-09-12T02:33:38.654 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T02:33:38.653+0000 7fb245d02640 1 -- 172.21.15.44:0/1571366347 shutdown_connections 2024-09-12T02:33:38.654 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T02:33:38.653+0000 7fb245d02640 1 --2- 172.21.15.44:0/1571366347 >> [v2:172.21.15.39:6800/1725006999,v1:172.21.15.39:6801/1725006999] conn(0x7fb2280a2bb0 0x7fb2280a5070 unknown :-1 s=CLOSED pgs=104 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:33:38.654 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T02:33:38.653+0000 7fb245d02640 1 --2- 172.21.15.44:0/1571366347 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fb240102690 0x7fb24019e300 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:33:38.654 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T02:33:38.653+0000 7fb245d02640 1 --2- 172.21.15.44:0/1571366347 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fb240101cd0 0x7fb240197280 unknown :-1 s=CLOSED pgs=52 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:33:38.654 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T02:33:38.653+0000 7fb245d02640 1 --2- 172.21.15.44:0/1571366347 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fb240100ad0 0x7fb240196d40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:33:38.655 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T02:33:38.653+0000 7fb245d02640 1 -- 172.21.15.44:0/1571366347 >> 172.21.15.44:0/1571366347 conn(0x7fb2400fc280 msgr2=0x7fb240105050 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:33:38.655 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T02:33:38.653+0000 7fb245d02640 1 -- 172.21.15.44:0/1571366347 shutdown_connections 2024-09-12T02:33:38.655 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-12T02:33:38.653+0000 7fb245d02640 1 -- 172.21.15.44:0/1571366347 wait complete. 2024-09-12T02:33:38.763 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 12 02:33:38 smithi172 ceph-mon[35609]: pgmap v233: 1 pgs: 1 active+clean; 577 KiB data, 289 MiB used, 894 GiB / 894 GiB avail 2024-09-12T02:33:38.849 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 02:33:38 smithi039 ceph-mon[30515]: pgmap v233: 1 pgs: 1 active+clean; 577 KiB data, 289 MiB used, 894 GiB / 894 GiB avail 2024-09-12T02:33:39.237 DEBUG:teuthology.orchestra.run.smithi044:osd.10> sudo journalctl -f -n 0 -u ceph-4954ed46-70ae-11ef-bcea-c7b262605968@osd.10.service 2024-09-12T02:33:39.240 INFO:tasks.cephadm:Deploying osd.11 on smithi172 with /dev/vg_nvme/lv_1... 2024-09-12T02:33:39.240 DEBUG:teuthology.orchestra.run.smithi172:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc ceph-volume -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 4954ed46-70ae-11ef-bcea-c7b262605968 -- lvm zap /dev/vg_nvme/lv_1 2024-09-12T02:33:39.499 INFO:teuthology.orchestra.run.smithi172.stderr:Inferring config /var/lib/ceph/4954ed46-70ae-11ef-bcea-c7b262605968/mon.c/config 2024-09-12T02:33:39.889 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 12 02:33:39 smithi172 ceph-mon[35609]: from='mgr.14150 172.21.15.39:0/408627207' entity='mgr.x' 2024-09-12T02:33:39.889 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 12 02:33:39 smithi172 ceph-mon[35609]: from='mgr.14150 172.21.15.39:0/408627207' entity='mgr.x' 2024-09-12T02:33:39.889 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 12 02:33:39 smithi172 ceph-mon[35609]: from='mgr.14150 172.21.15.39:0/408627207' entity='mgr.x' 2024-09-12T02:33:39.889 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 12 02:33:39 smithi172 ceph-mon[35609]: from='mgr.14150 172.21.15.39:0/408627207' entity='mgr.x' 2024-09-12T02:33:39.928 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 12 02:33:39 smithi044 ceph-mon[35411]: from='mgr.14150 172.21.15.39:0/408627207' entity='mgr.x' 2024-09-12T02:33:39.929 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 12 02:33:39 smithi044 ceph-mon[35411]: from='mgr.14150 172.21.15.39:0/408627207' entity='mgr.x' 2024-09-12T02:33:39.929 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 12 02:33:39 smithi044 ceph-mon[35411]: from='mgr.14150 172.21.15.39:0/408627207' entity='mgr.x' 2024-09-12T02:33:39.930 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 12 02:33:39 smithi044 ceph-mon[35411]: from='mgr.14150 172.21.15.39:0/408627207' entity='mgr.x' 2024-09-12T02:33:40.100 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 02:33:39 smithi039 ceph-mon[30515]: from='mgr.14150 172.21.15.39:0/408627207' entity='mgr.x' 2024-09-12T02:33:40.100 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 02:33:39 smithi039 ceph-mon[30515]: from='mgr.14150 172.21.15.39:0/408627207' entity='mgr.x' 2024-09-12T02:33:40.100 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 02:33:39 smithi039 ceph-mon[30515]: from='mgr.14150 172.21.15.39:0/408627207' entity='mgr.x' 2024-09-12T02:33:40.100 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 02:33:39 smithi039 ceph-mon[30515]: from='mgr.14150 172.21.15.39:0/408627207' entity='mgr.x' 2024-09-12T02:33:40.878 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 12 02:33:40 smithi172 ceph-mon[35609]: pgmap v234: 1 pgs: 1 active+clean; 577 KiB data, 289 MiB used, 894 GiB / 894 GiB avail 2024-09-12T02:33:40.948 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 12 02:33:40 smithi044 ceph-mon[35411]: pgmap v234: 1 pgs: 1 active+clean; 577 KiB data, 289 MiB used, 894 GiB / 894 GiB avail 2024-09-12T02:33:41.099 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 02:33:40 smithi039 ceph-mon[30515]: pgmap v234: 1 pgs: 1 active+clean; 577 KiB data, 289 MiB used, 894 GiB / 894 GiB avail 2024-09-12T02:33:41.231 INFO:journalctl@ceph.osd.10.smithi044.stdout:Sep 12 02:33:41 smithi044 ceph-4954ed46-70ae-11ef-bcea-c7b262605968-osd-10[59969]: 2024-09-12T02:33:41.192+0000 7faa4d818640 -1 osd.10 0 log_to_monitors true 2024-09-12T02:33:41.764 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 12 02:33:41 smithi172 ceph-mon[35609]: from='osd.10 [v2:172.21.15.44:6824/3899352344,v1:172.21.15.44:6825/3899352344]' entity='osd.10' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["10"]}]: dispatch 2024-09-12T02:33:41.764 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 12 02:33:41 smithi172 ceph-mon[35609]: from='osd.10 ' entity='osd.10' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["10"]}]: dispatch 2024-09-12T02:33:41.948 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 12 02:33:41 smithi044 ceph-mon[35411]: from='osd.10 [v2:172.21.15.44:6824/3899352344,v1:172.21.15.44:6825/3899352344]' entity='osd.10' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["10"]}]: dispatch 2024-09-12T02:33:41.948 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 12 02:33:41 smithi044 ceph-mon[35411]: from='osd.10 ' entity='osd.10' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["10"]}]: dispatch 2024-09-12T02:33:42.099 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 02:33:41 smithi039 ceph-mon[30515]: from='osd.10 [v2:172.21.15.44:6824/3899352344,v1:172.21.15.44:6825/3899352344]' entity='osd.10' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["10"]}]: dispatch 2024-09-12T02:33:42.100 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 02:33:41 smithi039 ceph-mon[30515]: from='osd.10 ' entity='osd.10' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["10"]}]: dispatch 2024-09-12T02:33:42.181 INFO:teuthology.orchestra.run.smithi172.stdout: 2024-09-12T02:33:42.207 DEBUG:teuthology.orchestra.run.smithi172:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 4954ed46-70ae-11ef-bcea-c7b262605968 -- ceph orch daemon add osd smithi172:vg_nvme/lv_1 2024-09-12T02:33:42.459 INFO:teuthology.orchestra.run.smithi172.stderr:Inferring config /var/lib/ceph/4954ed46-70ae-11ef-bcea-c7b262605968/mon.c/config 2024-09-12T02:33:42.759 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 12 02:33:42 smithi172 ceph-mon[35609]: pgmap v235: 1 pgs: 1 active+clean; 577 KiB data, 289 MiB used, 894 GiB / 894 GiB avail 2024-09-12T02:33:42.759 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 12 02:33:42 smithi172 ceph-mon[35609]: from='osd.10 ' entity='osd.10' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["10"]}]': finished 2024-09-12T02:33:42.759 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 12 02:33:42 smithi172 ceph-mon[35609]: from='osd.10 [v2:172.21.15.44:6824/3899352344,v1:172.21.15.44:6825/3899352344]' entity='osd.10' cmd=[{"prefix": "osd crush create-or-move", "id": 10, "weight":0.0873, "args": ["host=smithi044", "root=default"]}]: dispatch 2024-09-12T02:33:42.759 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 12 02:33:42 smithi172 ceph-mon[35609]: osdmap e68: 11 total, 10 up, 11 in 2024-09-12T02:33:42.759 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 12 02:33:42 smithi172 ceph-mon[35609]: from='mgr.14150 172.21.15.39:0/408627207' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 10}]: dispatch 2024-09-12T02:33:42.759 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 12 02:33:42 smithi172 ceph-mon[35609]: from='osd.10 ' entity='osd.10' cmd=[{"prefix": "osd crush create-or-move", "id": 10, "weight":0.0873, "args": ["host=smithi044", "root=default"]}]: dispatch 2024-09-12T02:33:42.948 INFO:journalctl@ceph.osd.10.smithi044.stdout:Sep 12 02:33:42 smithi044 ceph-4954ed46-70ae-11ef-bcea-c7b262605968-osd-10[59969]: 2024-09-12T02:33:42.688+0000 7faa4979b640 -1 osd.10 0 waiting for initial osdmap 2024-09-12T02:33:42.948 INFO:journalctl@ceph.osd.10.smithi044.stdout:Sep 12 02:33:42 smithi044 ceph-4954ed46-70ae-11ef-bcea-c7b262605968-osd-10[59969]: 2024-09-12T02:33:42.702+0000 7faa455c3640 -1 osd.10 69 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-09-12T02:33:42.949 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 12 02:33:42 smithi044 ceph-mon[35411]: pgmap v235: 1 pgs: 1 active+clean; 577 KiB data, 289 MiB used, 894 GiB / 894 GiB avail 2024-09-12T02:33:42.949 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 12 02:33:42 smithi044 ceph-mon[35411]: from='osd.10 ' entity='osd.10' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["10"]}]': finished 2024-09-12T02:33:42.949 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 12 02:33:42 smithi044 ceph-mon[35411]: from='osd.10 [v2:172.21.15.44:6824/3899352344,v1:172.21.15.44:6825/3899352344]' entity='osd.10' cmd=[{"prefix": "osd crush create-or-move", "id": 10, "weight":0.0873, "args": ["host=smithi044", "root=default"]}]: dispatch 2024-09-12T02:33:42.949 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 12 02:33:42 smithi044 ceph-mon[35411]: osdmap e68: 11 total, 10 up, 11 in 2024-09-12T02:33:42.949 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 12 02:33:42 smithi044 ceph-mon[35411]: from='mgr.14150 172.21.15.39:0/408627207' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 10}]: dispatch 2024-09-12T02:33:42.949 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 12 02:33:42 smithi044 ceph-mon[35411]: from='osd.10 ' entity='osd.10' cmd=[{"prefix": "osd crush create-or-move", "id": 10, "weight":0.0873, "args": ["host=smithi044", "root=default"]}]: dispatch 2024-09-12T02:33:42.957 INFO:teuthology.orchestra.run.smithi172.stderr:2024-09-12T02:33:42.941+0000 7fd8a6e20640 1 -- 172.21.15.172:0/1719975004 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fd8a0101d10 msgr2=0x7fd8a0102190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:33:42.957 INFO:teuthology.orchestra.run.smithi172.stderr:2024-09-12T02:33:42.941+0000 7fd8a6e20640 1 --2- 172.21.15.172:0/1719975004 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fd8a0101d10 0x7fd8a0102190 secure :-1 s=READY pgs=42 cs=0 l=1 rev1=1 crypto rx=0x7fd88c009900 tx=0x7fd88c02a410 comp rx=0 tx=0).stop 2024-09-12T02:33:42.957 INFO:teuthology.orchestra.run.smithi172.stderr:2024-09-12T02:33:42.941+0000 7fd8a6e20640 1 -- 172.21.15.172:0/1719975004 shutdown_connections 2024-09-12T02:33:42.957 INFO:teuthology.orchestra.run.smithi172.stderr:2024-09-12T02:33:42.941+0000 7fd8a6e20640 1 --2- 172.21.15.172:0/1719975004 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fd8a01026d0 0x7fd8a0108f60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:33:42.957 INFO:teuthology.orchestra.run.smithi172.stderr:2024-09-12T02:33:42.941+0000 7fd8a6e20640 1 --2- 172.21.15.172:0/1719975004 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fd8a0101d10 0x7fd8a0102190 unknown :-1 s=CLOSED pgs=42 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:33:42.958 INFO:teuthology.orchestra.run.smithi172.stderr:2024-09-12T02:33:42.941+0000 7fd8a6e20640 1 --2- 172.21.15.172:0/1719975004 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fd8a0100b10 0x7fd8a0100f10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:33:42.958 INFO:teuthology.orchestra.run.smithi172.stderr:2024-09-12T02:33:42.941+0000 7fd8a6e20640 1 -- 172.21.15.172:0/1719975004 >> 172.21.15.172:0/1719975004 conn(0x7fd8a00fc2a0 msgr2=0x7fd8a00fe6e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:33:42.958 INFO:teuthology.orchestra.run.smithi172.stderr:2024-09-12T02:33:42.941+0000 7fd8a6e20640 1 -- 172.21.15.172:0/1719975004 shutdown_connections 2024-09-12T02:33:42.958 INFO:teuthology.orchestra.run.smithi172.stderr:2024-09-12T02:33:42.941+0000 7fd8a6e20640 1 -- 172.21.15.172:0/1719975004 wait complete. 2024-09-12T02:33:42.958 INFO:teuthology.orchestra.run.smithi172.stderr:2024-09-12T02:33:42.942+0000 7fd8a6e20640 1 Processor -- start 2024-09-12T02:33:42.958 INFO:teuthology.orchestra.run.smithi172.stderr:2024-09-12T02:33:42.942+0000 7fd8a6e20640 1 -- start start 2024-09-12T02:33:42.958 INFO:teuthology.orchestra.run.smithi172.stderr:2024-09-12T02:33:42.942+0000 7fd8a6e20640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fd8a0100b10 0x7fd8a019a110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:33:42.958 INFO:teuthology.orchestra.run.smithi172.stderr:2024-09-12T02:33:42.942+0000 7fd8a6e20640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fd8a0101d10 0x7fd8a019a650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:33:42.958 INFO:teuthology.orchestra.run.smithi172.stderr:2024-09-12T02:33:42.942+0000 7fd8a6e20640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fd8a01026d0 0x7fd8a01a16d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:33:42.958 INFO:teuthology.orchestra.run.smithi172.stderr:2024-09-12T02:33:42.942+0000 7fd8a6e20640 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 -- 0x7fd8a010c790 con 0x7fd8a0100b10 2024-09-12T02:33:42.958 INFO:teuthology.orchestra.run.smithi172.stderr:2024-09-12T02:33:42.942+0000 7fd8a6e20640 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x7fd8a010c610 con 0x7fd8a0101d10 2024-09-12T02:33:42.958 INFO:teuthology.orchestra.run.smithi172.stderr:2024-09-12T02:33:42.942+0000 7fd8a6e20640 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7fd8a010c910 con 0x7fd8a01026d0 2024-09-12T02:33:42.959 INFO:teuthology.orchestra.run.smithi172.stderr:2024-09-12T02:33:42.942+0000 7fd8a53bd640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fd8a01026d0 0x7fd8a01a16d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:33:42.959 INFO:teuthology.orchestra.run.smithi172.stderr:2024-09-12T02:33:42.942+0000 7fd8a53bd640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fd8a01026d0 0x7fd8a01a16d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.172:3300/0 says I am v2:172.21.15.172:33152/0 (socket says 172.21.15.172:33152) 2024-09-12T02:33:42.959 INFO:teuthology.orchestra.run.smithi172.stderr:2024-09-12T02:33:42.942+0000 7fd8a53bd640 1 -- 172.21.15.172:0/3191910300 learned_addr learned my addr 172.21.15.172:0/3191910300 (peer_addr_for_me v2:172.21.15.172:0/0) 2024-09-12T02:33:42.959 INFO:teuthology.orchestra.run.smithi172.stderr:2024-09-12T02:33:42.942+0000 7fd8a4bbc640 1 --2- 172.21.15.172:0/3191910300 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fd8a0100b10 0x7fd8a019a110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:33:42.959 INFO:teuthology.orchestra.run.smithi172.stderr:2024-09-12T02:33:42.942+0000 7fd8a53bd640 1 -- 172.21.15.172:0/3191910300 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fd8a0101d10 msgr2=0x7fd8a019a650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:33:42.959 INFO:teuthology.orchestra.run.smithi172.stderr:2024-09-12T02:33:42.942+0000 7fd89ffff640 1 --2- 172.21.15.172:0/3191910300 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fd8a0101d10 0x7fd8a019a650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:33:42.959 INFO:teuthology.orchestra.run.smithi172.stderr:2024-09-12T02:33:42.942+0000 7fd8a53bd640 1 --2- 172.21.15.172:0/3191910300 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fd8a0101d10 0x7fd8a019a650 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:33:42.959 INFO:teuthology.orchestra.run.smithi172.stderr:2024-09-12T02:33:42.942+0000 7fd8a53bd640 1 -- 172.21.15.172:0/3191910300 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fd8a0100b10 msgr2=0x7fd8a019a110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:33:42.959 INFO:teuthology.orchestra.run.smithi172.stderr:2024-09-12T02:33:42.942+0000 7fd8a53bd640 1 --2- 172.21.15.172:0/3191910300 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fd8a0100b10 0x7fd8a019a110 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:33:42.959 INFO:teuthology.orchestra.run.smithi172.stderr:2024-09-12T02:33:42.942+0000 7fd8a53bd640 1 -- 172.21.15.172:0/3191910300 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd8a01a1d40 con 0x7fd8a01026d0 2024-09-12T02:33:42.959 INFO:teuthology.orchestra.run.smithi172.stderr:2024-09-12T02:33:42.942+0000 7fd8a4bbc640 1 --2- 172.21.15.172:0/3191910300 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fd8a0100b10 0x7fd8a019a110 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-12T02:33:42.959 INFO:teuthology.orchestra.run.smithi172.stderr:2024-09-12T02:33:42.942+0000 7fd8a53bd640 1 --2- 172.21.15.172:0/3191910300 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fd8a01026d0 0x7fd8a01a16d0 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0x7fd89800eaa0 tx=0x7fd89800ef60 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:33:42.960 INFO:teuthology.orchestra.run.smithi172.stderr:2024-09-12T02:33:42.943+0000 7fd89dffb640 1 -- 172.21.15.172:0/3191910300 <== mon.1 v2:172.21.15.172:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd89800cdb0 con 0x7fd8a01026d0 2024-09-12T02:33:42.960 INFO:teuthology.orchestra.run.smithi172.stderr:2024-09-12T02:33:42.943+0000 7fd89dffb640 1 -- 172.21.15.172:0/3191910300 <== mon.1 v2:172.21.15.172:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fd898005020 con 0x7fd8a01026d0 2024-09-12T02:33:42.960 INFO:teuthology.orchestra.run.smithi172.stderr:2024-09-12T02:33:42.943+0000 7fd8a6e20640 1 -- 172.21.15.172:0/3191910300 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd8a01a1fd0 con 0x7fd8a01026d0 2024-09-12T02:33:42.960 INFO:teuthology.orchestra.run.smithi172.stderr:2024-09-12T02:33:42.943+0000 7fd89dffb640 1 -- 172.21.15.172:0/3191910300 <== mon.1 v2:172.21.15.172:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd8980116b0 con 0x7fd8a01026d0 2024-09-12T02:33:42.960 INFO:teuthology.orchestra.run.smithi172.stderr:2024-09-12T02:33:42.943+0000 7fd8a6e20640 1 -- 172.21.15.172:0/3191910300 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd8a01a2490 con 0x7fd8a01026d0 2024-09-12T02:33:42.960 INFO:teuthology.orchestra.run.smithi172.stderr:2024-09-12T02:33:42.944+0000 7fd8a6e20640 1 -- 172.21.15.172:0/3191910300 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fd8a01a2750 con 0x7fd8a01026d0 2024-09-12T02:33:42.960 INFO:teuthology.orchestra.run.smithi172.stderr:2024-09-12T02:33:42.945+0000 7fd89dffb640 1 -- 172.21.15.172:0/3191910300 <== mon.1 v2:172.21.15.172:3300/0 4 ==== mgrmap(e 16) ==== 137833+0+0 (secure 0 0 0) 0x7fd898005560 con 0x7fd8a01026d0 2024-09-12T02:33:42.960 INFO:teuthology.orchestra.run.smithi172.stderr:2024-09-12T02:33:42.945+0000 7fd89dffb640 1 --2- 172.21.15.172:0/3191910300 >> [v2:172.21.15.39:6800/1725006999,v1:172.21.15.39:6801/1725006999] conn(0x7fd8900a2bb0 0x7fd8900a5070 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:33:42.960 INFO:teuthology.orchestra.run.smithi172.stderr:2024-09-12T02:33:42.946+0000 7fd89dffb640 1 -- 172.21.15.172:0/3191910300 <== mon.1 v2:172.21.15.172:3300/0 5 ==== osd_map(69..69 src has 1..69) ==== 6414+0+0 (secure 0 0 0) 0x7fd8980cebb0 con 0x7fd8a01026d0 2024-09-12T02:33:42.960 INFO:teuthology.orchestra.run.smithi172.stderr:2024-09-12T02:33:42.946+0000 7fd8a4bbc640 1 --2- 172.21.15.172:0/3191910300 >> [v2:172.21.15.39:6800/1725006999,v1:172.21.15.39:6801/1725006999] conn(0x7fd8900a2bb0 0x7fd8900a5070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:33:42.960 INFO:teuthology.orchestra.run.smithi172.stderr:2024-09-12T02:33:42.946+0000 7fd8a4bbc640 1 --2- 172.21.15.172:0/3191910300 >> [v2:172.21.15.39:6800/1725006999,v1:172.21.15.39:6801/1725006999] conn(0x7fd8900a2bb0 0x7fd8900a5070 secure :-1 s=READY pgs=110 cs=0 l=1 rev1=1 crypto rx=0x7fd8a0101b70 tx=0x7fd894005f90 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:33:42.960 INFO:teuthology.orchestra.run.smithi172.stderr:2024-09-12T02:33:42.949+0000 7fd89dffb640 1 -- 172.21.15.172:0/3191910300 <== mon.1 v2:172.21.15.172:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7fd898016030 con 0x7fd8a01026d0 2024-09-12T02:33:43.099 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 02:33:42 smithi039 ceph-mon[30515]: pgmap v235: 1 pgs: 1 active+clean; 577 KiB data, 289 MiB used, 894 GiB / 894 GiB avail 2024-09-12T02:33:43.099 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 02:33:42 smithi039 ceph-mon[30515]: from='osd.10 ' entity='osd.10' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["10"]}]': finished 2024-09-12T02:33:43.100 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 02:33:42 smithi039 ceph-mon[30515]: from='osd.10 [v2:172.21.15.44:6824/3899352344,v1:172.21.15.44:6825/3899352344]' entity='osd.10' cmd=[{"prefix": "osd crush create-or-move", "id": 10, "weight":0.0873, "args": ["host=smithi044", "root=default"]}]: dispatch 2024-09-12T02:33:43.100 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 02:33:42 smithi039 ceph-mon[30515]: osdmap e68: 11 total, 10 up, 11 in 2024-09-12T02:33:43.100 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 02:33:42 smithi039 ceph-mon[30515]: from='mgr.14150 172.21.15.39:0/408627207' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 10}]: dispatch 2024-09-12T02:33:43.100 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 02:33:42 smithi039 ceph-mon[30515]: from='osd.10 ' entity='osd.10' cmd=[{"prefix": "osd crush create-or-move", "id": 10, "weight":0.0873, "args": ["host=smithi044", "root=default"]}]: dispatch 2024-09-12T02:33:43.128 INFO:teuthology.orchestra.run.smithi172.stderr:2024-09-12T02:33:43.128+0000 7fd8a6e20640 1 -- 172.21.15.172:0/3191910300 --> [v2:172.21.15.39:6800/1725006999,v1:172.21.15.39:6801/1725006999] -- mgr_command(tid 0: {"prefix": "orch daemon add osd", "svc_arg": "smithi172:vg_nvme/lv_1", "target": ["mon-mgr", ""]}) -- 0x7fd8a01a2920 con 0x7fd8900a2bb0 2024-09-12T02:33:43.861 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 12 02:33:43 smithi172 ceph-mon[35609]: from='osd.10 ' entity='osd.10' cmd='[{"prefix": "osd crush create-or-move", "id": 10, "weight":0.0873, "args": ["host=smithi044", "root=default"]}]': finished 2024-09-12T02:33:43.862 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 12 02:33:43 smithi172 ceph-mon[35609]: osdmap e69: 11 total, 10 up, 11 in 2024-09-12T02:33:43.862 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 12 02:33:43 smithi172 ceph-mon[35609]: from='mgr.14150 172.21.15.39:0/408627207' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 10}]: dispatch 2024-09-12T02:33:43.862 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 12 02:33:43 smithi172 ceph-mon[35609]: from='mgr.14150 172.21.15.39:0/408627207' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 10}]: dispatch 2024-09-12T02:33:43.862 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 12 02:33:43 smithi172 ceph-mon[35609]: Detected new or changed devices on smithi044 2024-09-12T02:33:43.862 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 12 02:33:43 smithi172 ceph-mon[35609]: from='mgr.14150 172.21.15.39:0/408627207' entity='mgr.x' 2024-09-12T02:33:43.862 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 12 02:33:43 smithi172 ceph-mon[35609]: from='mgr.14150 172.21.15.39:0/408627207' entity='mgr.x' 2024-09-12T02:33:43.862 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 12 02:33:43 smithi172 ceph-mon[35609]: from='mgr.14150 172.21.15.39:0/408627207' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2024-09-12T02:33:43.863 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 12 02:33:43 smithi172 ceph-mon[35609]: from='mgr.14150 172.21.15.39:0/408627207' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2024-09-12T02:33:43.863 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 12 02:33:43 smithi172 ceph-mon[35609]: from='mgr.14150 172.21.15.39:0/408627207' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"}]: dispatch 2024-09-12T02:33:43.863 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 12 02:33:43 smithi172 ceph-mon[35609]: from='mgr.14150 172.21.15.39:0/408627207' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.10", "name": "osd_memory_target"}]: dispatch 2024-09-12T02:33:43.863 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 12 02:33:43 smithi172 ceph-mon[35609]: Adjusting osd_memory_target on smithi044 to 4273M 2024-09-12T02:33:43.863 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 12 02:33:43 smithi172 ceph-mon[35609]: from='mgr.14150 172.21.15.39:0/408627207' entity='mgr.x' 2024-09-12T02:33:43.863 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 12 02:33:43 smithi172 ceph-mon[35609]: from='mgr.14150 172.21.15.39:0/408627207' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-12T02:33:43.863 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 12 02:33:43 smithi172 ceph-mon[35609]: from='mgr.14150 172.21.15.39:0/408627207' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-12T02:33:43.863 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 12 02:33:43 smithi172 ceph-mon[35609]: from='mgr.14150 172.21.15.39:0/408627207' entity='mgr.x' 2024-09-12T02:33:43.863 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 12 02:33:43 smithi172 ceph-mon[35609]: from='mgr.14150 172.21.15.39:0/408627207' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-12T02:33:43.863 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 12 02:33:43 smithi172 ceph-mon[35609]: from='mgr.14150 172.21.15.39:0/408627207' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-09-12T02:33:43.864 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 12 02:33:43 smithi172 ceph-mon[35609]: from='mgr.14150 172.21.15.39:0/408627207' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-09-12T02:33:43.864 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 12 02:33:43 smithi172 ceph-mon[35609]: from='mgr.14150 172.21.15.39:0/408627207' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-12T02:33:43.864 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 12 02:33:43 smithi172 ceph-mon[35609]: from='mgr.14150 172.21.15.39:0/408627207' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-12T02:33:43.864 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 12 02:33:43 smithi172 ceph-mon[35609]: from='mgr.14150 172.21.15.39:0/408627207' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-12T02:33:43.864 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 12 02:33:43 smithi172 ceph-mon[35609]: from='mgr.14150 172.21.15.39:0/408627207' entity='mgr.x' 2024-09-12T02:33:43.949 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 12 02:33:43 smithi044 ceph-mon[35411]: from='osd.10 ' entity='osd.10' cmd='[{"prefix": "osd crush create-or-move", "id": 10, "weight":0.0873, "args": ["host=smithi044", "root=default"]}]': finished 2024-09-12T02:33:43.949 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 12 02:33:43 smithi044 ceph-mon[35411]: osdmap e69: 11 total, 10 up, 11 in 2024-09-12T02:33:43.949 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 12 02:33:43 smithi044 ceph-mon[35411]: from='mgr.14150 172.21.15.39:0/408627207' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 10}]: dispatch 2024-09-12T02:33:43.949 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 12 02:33:43 smithi044 ceph-mon[35411]: from='mgr.14150 172.21.15.39:0/408627207' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 10}]: dispatch 2024-09-12T02:33:43.949 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 12 02:33:43 smithi044 ceph-mon[35411]: Detected new or changed devices on smithi044 2024-09-12T02:33:43.949 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 12 02:33:43 smithi044 ceph-mon[35411]: from='mgr.14150 172.21.15.39:0/408627207' entity='mgr.x' 2024-09-12T02:33:43.949 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 12 02:33:43 smithi044 ceph-mon[35411]: from='mgr.14150 172.21.15.39:0/408627207' entity='mgr.x' 2024-09-12T02:33:43.950 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 12 02:33:43 smithi044 ceph-mon[35411]: from='mgr.14150 172.21.15.39:0/408627207' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2024-09-12T02:33:43.950 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 12 02:33:43 smithi044 ceph-mon[35411]: from='mgr.14150 172.21.15.39:0/408627207' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2024-09-12T02:33:43.950 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 12 02:33:43 smithi044 ceph-mon[35411]: from='mgr.14150 172.21.15.39:0/408627207' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"}]: dispatch 2024-09-12T02:33:43.950 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 12 02:33:43 smithi044 ceph-mon[35411]: from='mgr.14150 172.21.15.39:0/408627207' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.10", "name": "osd_memory_target"}]: dispatch 2024-09-12T02:33:43.950 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 12 02:33:43 smithi044 ceph-mon[35411]: Adjusting osd_memory_target on smithi044 to 4273M 2024-09-12T02:33:43.950 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 12 02:33:43 smithi044 ceph-mon[35411]: from='mgr.14150 172.21.15.39:0/408627207' entity='mgr.x' 2024-09-12T02:33:43.950 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 12 02:33:43 smithi044 ceph-mon[35411]: from='mgr.14150 172.21.15.39:0/408627207' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-12T02:33:43.950 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 12 02:33:43 smithi044 ceph-mon[35411]: from='mgr.14150 172.21.15.39:0/408627207' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-12T02:33:43.950 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 12 02:33:43 smithi044 ceph-mon[35411]: from='mgr.14150 172.21.15.39:0/408627207' entity='mgr.x' 2024-09-12T02:33:43.950 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 12 02:33:43 smithi044 ceph-mon[35411]: from='mgr.14150 172.21.15.39:0/408627207' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-12T02:33:43.950 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 12 02:33:43 smithi044 ceph-mon[35411]: from='mgr.14150 172.21.15.39:0/408627207' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-09-12T02:33:43.950 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 12 02:33:43 smithi044 ceph-mon[35411]: from='mgr.14150 172.21.15.39:0/408627207' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-09-12T02:33:43.950 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 12 02:33:43 smithi044 ceph-mon[35411]: from='mgr.14150 172.21.15.39:0/408627207' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-12T02:33:43.950 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 12 02:33:43 smithi044 ceph-mon[35411]: from='mgr.14150 172.21.15.39:0/408627207' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-12T02:33:43.950 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 12 02:33:43 smithi044 ceph-mon[35411]: from='mgr.14150 172.21.15.39:0/408627207' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-12T02:33:43.951 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 12 02:33:43 smithi044 ceph-mon[35411]: from='mgr.14150 172.21.15.39:0/408627207' entity='mgr.x' 2024-09-12T02:33:44.100 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 02:33:43 smithi039 ceph-mon[30515]: from='osd.10 ' entity='osd.10' cmd='[{"prefix": "osd crush create-or-move", "id": 10, "weight":0.0873, "args": ["host=smithi044", "root=default"]}]': finished 2024-09-12T02:33:44.100 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 02:33:43 smithi039 ceph-mon[30515]: osdmap e69: 11 total, 10 up, 11 in 2024-09-12T02:33:44.100 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 02:33:43 smithi039 ceph-mon[30515]: from='mgr.14150 172.21.15.39:0/408627207' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 10}]: dispatch 2024-09-12T02:33:44.100 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 02:33:43 smithi039 ceph-mon[30515]: from='mgr.14150 172.21.15.39:0/408627207' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 10}]: dispatch 2024-09-12T02:33:44.100 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 02:33:43 smithi039 ceph-mon[30515]: Detected new or changed devices on smithi044 2024-09-12T02:33:44.100 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 02:33:43 smithi039 ceph-mon[30515]: from='mgr.14150 172.21.15.39:0/408627207' entity='mgr.x' 2024-09-12T02:33:44.100 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 02:33:43 smithi039 ceph-mon[30515]: from='mgr.14150 172.21.15.39:0/408627207' entity='mgr.x' 2024-09-12T02:33:44.100 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 02:33:43 smithi039 ceph-mon[30515]: from='mgr.14150 172.21.15.39:0/408627207' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2024-09-12T02:33:44.100 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 02:33:43 smithi039 ceph-mon[30515]: from='mgr.14150 172.21.15.39:0/408627207' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2024-09-12T02:33:44.100 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 02:33:43 smithi039 ceph-mon[30515]: from='mgr.14150 172.21.15.39:0/408627207' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"}]: dispatch 2024-09-12T02:33:44.101 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 02:33:43 smithi039 ceph-mon[30515]: from='mgr.14150 172.21.15.39:0/408627207' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.10", "name": "osd_memory_target"}]: dispatch 2024-09-12T02:33:44.101 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 02:33:43 smithi039 ceph-mon[30515]: Adjusting osd_memory_target on smithi044 to 4273M 2024-09-12T02:33:44.101 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 02:33:43 smithi039 ceph-mon[30515]: from='mgr.14150 172.21.15.39:0/408627207' entity='mgr.x' 2024-09-12T02:33:44.101 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 02:33:43 smithi039 ceph-mon[30515]: from='mgr.14150 172.21.15.39:0/408627207' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-12T02:33:44.101 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 02:33:43 smithi039 ceph-mon[30515]: from='mgr.14150 172.21.15.39:0/408627207' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-12T02:33:44.101 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 02:33:43 smithi039 ceph-mon[30515]: from='mgr.14150 172.21.15.39:0/408627207' entity='mgr.x' 2024-09-12T02:33:44.101 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 02:33:43 smithi039 ceph-mon[30515]: from='mgr.14150 172.21.15.39:0/408627207' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-12T02:33:44.102 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 02:33:43 smithi039 ceph-mon[30515]: from='mgr.14150 172.21.15.39:0/408627207' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-09-12T02:33:44.102 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 02:33:43 smithi039 ceph-mon[30515]: from='mgr.14150 172.21.15.39:0/408627207' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-09-12T02:33:44.102 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 02:33:43 smithi039 ceph-mon[30515]: from='mgr.14150 172.21.15.39:0/408627207' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-12T02:33:44.102 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 02:33:43 smithi039 ceph-mon[30515]: from='mgr.14150 172.21.15.39:0/408627207' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-12T02:33:44.102 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 02:33:43 smithi039 ceph-mon[30515]: from='mgr.14150 172.21.15.39:0/408627207' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-12T02:33:44.102 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 02:33:43 smithi039 ceph-mon[30515]: from='mgr.14150 172.21.15.39:0/408627207' entity='mgr.x' 2024-09-12T02:33:44.859 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 12 02:33:44 smithi172 ceph-mon[35609]: purged_snaps scrub starts 2024-09-12T02:33:44.859 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 12 02:33:44 smithi172 ceph-mon[35609]: purged_snaps scrub ok 2024-09-12T02:33:44.859 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 12 02:33:44 smithi172 ceph-mon[35609]: pgmap v238: 1 pgs: 1 active+clean; 577 KiB data, 289 MiB used, 894 GiB / 894 GiB avail 2024-09-12T02:33:44.859 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 12 02:33:44 smithi172 ceph-mon[35609]: from='client.24367 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi172:vg_nvme/lv_1", "target": ["mon-mgr", ""]}]: dispatch 2024-09-12T02:33:44.859 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 12 02:33:44 smithi172 ceph-mon[35609]: osd.10 [v2:172.21.15.44:6824/3899352344,v1:172.21.15.44:6825/3899352344] boot 2024-09-12T02:33:44.859 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 12 02:33:44 smithi172 ceph-mon[35609]: osdmap e70: 11 total, 11 up, 11 in 2024-09-12T02:33:44.859 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 12 02:33:44 smithi172 ceph-mon[35609]: from='mgr.14150 172.21.15.39:0/408627207' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 10}]: dispatch 2024-09-12T02:33:45.100 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 02:33:44 smithi039 ceph-mon[30515]: purged_snaps scrub starts 2024-09-12T02:33:45.100 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 02:33:44 smithi039 ceph-mon[30515]: purged_snaps scrub ok 2024-09-12T02:33:45.100 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 02:33:44 smithi039 ceph-mon[30515]: pgmap v238: 1 pgs: 1 active+clean; 577 KiB data, 289 MiB used, 894 GiB / 894 GiB avail 2024-09-12T02:33:45.100 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 02:33:44 smithi039 ceph-mon[30515]: from='client.24367 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi172:vg_nvme/lv_1", "target": ["mon-mgr", ""]}]: dispatch 2024-09-12T02:33:45.100 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 02:33:44 smithi039 ceph-mon[30515]: osd.10 [v2:172.21.15.44:6824/3899352344,v1:172.21.15.44:6825/3899352344] boot 2024-09-12T02:33:45.100 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 02:33:44 smithi039 ceph-mon[30515]: osdmap e70: 11 total, 11 up, 11 in 2024-09-12T02:33:45.100 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 02:33:44 smithi039 ceph-mon[30515]: from='mgr.14150 172.21.15.39:0/408627207' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 10}]: dispatch 2024-09-12T02:33:45.198 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 12 02:33:44 smithi044 ceph-mon[35411]: purged_snaps scrub starts 2024-09-12T02:33:45.199 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 12 02:33:44 smithi044 ceph-mon[35411]: purged_snaps scrub ok 2024-09-12T02:33:45.199 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 12 02:33:44 smithi044 ceph-mon[35411]: pgmap v238: 1 pgs: 1 active+clean; 577 KiB data, 289 MiB used, 894 GiB / 894 GiB avail 2024-09-12T02:33:45.199 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 12 02:33:44 smithi044 ceph-mon[35411]: from='client.24367 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi172:vg_nvme/lv_1", "target": ["mon-mgr", ""]}]: dispatch 2024-09-12T02:33:45.199 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 12 02:33:44 smithi044 ceph-mon[35411]: osd.10 [v2:172.21.15.44:6824/3899352344,v1:172.21.15.44:6825/3899352344] boot 2024-09-12T02:33:45.199 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 12 02:33:44 smithi044 ceph-mon[35411]: osdmap e70: 11 total, 11 up, 11 in 2024-09-12T02:33:45.199 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 12 02:33:44 smithi044 ceph-mon[35411]: from='mgr.14150 172.21.15.39:0/408627207' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 10}]: dispatch 2024-09-12T02:33:46.014 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 12 02:33:45 smithi172 ceph-mon[35609]: osdmap e71: 11 total, 11 up, 11 in 2024-09-12T02:33:46.014 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 12 02:33:45 smithi172 ceph-mon[35609]: from='client.? 172.21.15.172:0/1153804529' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "20cf5df1-5a80-4272-acc0-919c6a1da55a"}]: dispatch 2024-09-12T02:33:46.014 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 12 02:33:45 smithi172 ceph-mon[35609]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "20cf5df1-5a80-4272-acc0-919c6a1da55a"}]: dispatch 2024-09-12T02:33:46.014 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 12 02:33:45 smithi172 ceph-mon[35609]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "20cf5df1-5a80-4272-acc0-919c6a1da55a"}]': finished 2024-09-12T02:33:46.014 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 12 02:33:45 smithi172 ceph-mon[35609]: osdmap e72: 12 total, 11 up, 12 in 2024-09-12T02:33:46.015 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 12 02:33:45 smithi172 ceph-mon[35609]: from='mgr.14150 172.21.15.39:0/408627207' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 11}]: dispatch 2024-09-12T02:33:46.100 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 02:33:45 smithi039 ceph-mon[30515]: osdmap e71: 11 total, 11 up, 11 in 2024-09-12T02:33:46.100 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 02:33:45 smithi039 ceph-mon[30515]: from='client.? 172.21.15.172:0/1153804529' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "20cf5df1-5a80-4272-acc0-919c6a1da55a"}]: dispatch 2024-09-12T02:33:46.100 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 02:33:45 smithi039 ceph-mon[30515]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "20cf5df1-5a80-4272-acc0-919c6a1da55a"}]: dispatch 2024-09-12T02:33:46.100 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 02:33:45 smithi039 ceph-mon[30515]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "20cf5df1-5a80-4272-acc0-919c6a1da55a"}]': finished 2024-09-12T02:33:46.100 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 02:33:45 smithi039 ceph-mon[30515]: osdmap e72: 12 total, 11 up, 12 in 2024-09-12T02:33:46.100 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 02:33:45 smithi039 ceph-mon[30515]: from='mgr.14150 172.21.15.39:0/408627207' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 11}]: dispatch 2024-09-12T02:33:46.198 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 12 02:33:45 smithi044 ceph-mon[35411]: osdmap e71: 11 total, 11 up, 11 in 2024-09-12T02:33:46.199 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 12 02:33:45 smithi044 ceph-mon[35411]: from='client.? 172.21.15.172:0/1153804529' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "20cf5df1-5a80-4272-acc0-919c6a1da55a"}]: dispatch 2024-09-12T02:33:46.199 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 12 02:33:45 smithi044 ceph-mon[35411]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "20cf5df1-5a80-4272-acc0-919c6a1da55a"}]: dispatch 2024-09-12T02:33:46.199 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 12 02:33:45 smithi044 ceph-mon[35411]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "20cf5df1-5a80-4272-acc0-919c6a1da55a"}]': finished 2024-09-12T02:33:46.199 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 12 02:33:45 smithi044 ceph-mon[35411]: osdmap e72: 12 total, 11 up, 12 in 2024-09-12T02:33:46.199 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 12 02:33:45 smithi044 ceph-mon[35411]: from='mgr.14150 172.21.15.39:0/408627207' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 11}]: dispatch 2024-09-12T02:33:47.013 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 12 02:33:46 smithi172 ceph-mon[35609]: pgmap v241: 1 pgs: 1 active+clean; 577 KiB data, 316 MiB used, 983 GiB / 983 GiB avail 2024-09-12T02:33:47.014 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 12 02:33:46 smithi172 ceph-mon[35609]: from='client.? 172.21.15.172:0/1955814285' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-09-12T02:33:47.100 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 02:33:46 smithi039 ceph-mon[30515]: pgmap v241: 1 pgs: 1 active+clean; 577 KiB data, 316 MiB used, 983 GiB / 983 GiB avail 2024-09-12T02:33:47.100 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 02:33:46 smithi039 ceph-mon[30515]: from='client.? 172.21.15.172:0/1955814285' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-09-12T02:33:47.198 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 12 02:33:46 smithi044 ceph-mon[35411]: pgmap v241: 1 pgs: 1 active+clean; 577 KiB data, 316 MiB used, 983 GiB / 983 GiB avail 2024-09-12T02:33:47.198 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 12 02:33:46 smithi044 ceph-mon[35411]: from='client.? 172.21.15.172:0/1955814285' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-09-12T02:33:48.013 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 12 02:33:47 smithi172 ceph-mon[35609]: osdmap e73: 12 total, 11 up, 12 in 2024-09-12T02:33:48.013 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 12 02:33:47 smithi172 ceph-mon[35609]: from='mgr.14150 172.21.15.39:0/408627207' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 11}]: dispatch 2024-09-12T02:33:48.100 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 02:33:47 smithi039 ceph-mon[30515]: osdmap e73: 12 total, 11 up, 12 in 2024-09-12T02:33:48.100 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 02:33:47 smithi039 ceph-mon[30515]: from='mgr.14150 172.21.15.39:0/408627207' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 11}]: dispatch 2024-09-12T02:33:48.198 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 12 02:33:47 smithi044 ceph-mon[35411]: osdmap e73: 12 total, 11 up, 12 in 2024-09-12T02:33:48.198 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 12 02:33:47 smithi044 ceph-mon[35411]: from='mgr.14150 172.21.15.39:0/408627207' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 11}]: dispatch 2024-09-12T02:33:49.013 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 12 02:33:48 smithi172 ceph-mon[35609]: pgmap v244: 1 pgs: 1 remapped+peering; 577 KiB data, 316 MiB used, 983 GiB / 983 GiB avail 2024-09-12T02:33:49.013 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 12 02:33:48 smithi172 ceph-mon[35609]: osdmap e74: 12 total, 11 up, 12 in 2024-09-12T02:33:49.013 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 12 02:33:48 smithi172 ceph-mon[35609]: from='mgr.14150 172.21.15.39:0/408627207' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 11}]: dispatch 2024-09-12T02:33:49.099 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 02:33:48 smithi039 ceph-mon[30515]: pgmap v244: 1 pgs: 1 remapped+peering; 577 KiB data, 316 MiB used, 983 GiB / 983 GiB avail 2024-09-12T02:33:49.099 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 02:33:48 smithi039 ceph-mon[30515]: osdmap e74: 12 total, 11 up, 12 in 2024-09-12T02:33:49.100 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 02:33:48 smithi039 ceph-mon[30515]: from='mgr.14150 172.21.15.39:0/408627207' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 11}]: dispatch 2024-09-12T02:33:49.198 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 12 02:33:48 smithi044 ceph-mon[35411]: pgmap v244: 1 pgs: 1 remapped+peering; 577 KiB data, 316 MiB used, 983 GiB / 983 GiB avail 2024-09-12T02:33:49.199 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 12 02:33:48 smithi044 ceph-mon[35411]: osdmap e74: 12 total, 11 up, 12 in 2024-09-12T02:33:49.199 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 12 02:33:48 smithi044 ceph-mon[35411]: from='mgr.14150 172.21.15.39:0/408627207' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 11}]: dispatch 2024-09-12T02:33:51.013 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 12 02:33:50 smithi172 ceph-mon[35609]: pgmap v246: 1 pgs: 1 remapped+peering; 577 KiB data, 317 MiB used, 983 GiB / 983 GiB avail 2024-09-12T02:33:51.099 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 02:33:50 smithi039 ceph-mon[30515]: pgmap v246: 1 pgs: 1 remapped+peering; 577 KiB data, 317 MiB used, 983 GiB / 983 GiB avail 2024-09-12T02:33:51.198 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 12 02:33:50 smithi044 ceph-mon[35411]: pgmap v246: 1 pgs: 1 remapped+peering; 577 KiB data, 317 MiB used, 983 GiB / 983 GiB avail 2024-09-12T02:33:52.763 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 12 02:33:52 smithi172 ceph-mon[35609]: pgmap v247: 1 pgs: 1 active+clean; 577 KiB data, 317 MiB used, 983 GiB / 983 GiB avail; 96 KiB/s, 0 objects/s recovering 2024-09-12T02:33:53.099 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 02:33:52 smithi039 ceph-mon[30515]: pgmap v247: 1 pgs: 1 active+clean; 577 KiB data, 317 MiB used, 983 GiB / 983 GiB avail; 96 KiB/s, 0 objects/s recovering 2024-09-12T02:33:53.198 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 12 02:33:52 smithi044 ceph-mon[35411]: pgmap v247: 1 pgs: 1 active+clean; 577 KiB data, 317 MiB used, 983 GiB / 983 GiB avail; 96 KiB/s, 0 objects/s recovering 2024-09-12T02:33:54.946 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 12 02:33:54 smithi172 ceph-mon[35609]: pgmap v248: 1 pgs: 1 active+clean; 577 KiB data, 317 MiB used, 983 GiB / 983 GiB avail; 80 KiB/s, 0 objects/s recovering 2024-09-12T02:33:54.946 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 12 02:33:54 smithi172 ceph-mon[35609]: from='mgr.14150 172.21.15.39:0/408627207' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.11"}]: dispatch 2024-09-12T02:33:54.946 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 12 02:33:54 smithi172 ceph-mon[35609]: from='mgr.14150 172.21.15.39:0/408627207' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-12T02:33:55.099 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 02:33:54 smithi039 ceph-mon[30515]: pgmap v248: 1 pgs: 1 active+clean; 577 KiB data, 317 MiB used, 983 GiB / 983 GiB avail; 80 KiB/s, 0 objects/s recovering 2024-09-12T02:33:55.100 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 02:33:54 smithi039 ceph-mon[30515]: from='mgr.14150 172.21.15.39:0/408627207' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.11"}]: dispatch 2024-09-12T02:33:55.100 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 02:33:54 smithi039 ceph-mon[30515]: from='mgr.14150 172.21.15.39:0/408627207' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-12T02:33:55.198 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 12 02:33:54 smithi044 ceph-mon[35411]: pgmap v248: 1 pgs: 1 active+clean; 577 KiB data, 317 MiB used, 983 GiB / 983 GiB avail; 80 KiB/s, 0 objects/s recovering 2024-09-12T02:33:55.198 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 12 02:33:54 smithi044 ceph-mon[35411]: from='mgr.14150 172.21.15.39:0/408627207' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.11"}]: dispatch 2024-09-12T02:33:55.199 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 12 02:33:54 smithi044 ceph-mon[35411]: from='mgr.14150 172.21.15.39:0/408627207' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-12T02:33:55.981 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 12 02:33:55 smithi172 ceph-mon[35609]: Deploying daemon osd.11 on smithi172 2024-09-12T02:33:56.100 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 02:33:55 smithi039 ceph-mon[30515]: Deploying daemon osd.11 on smithi172 2024-09-12T02:33:56.198 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 12 02:33:55 smithi044 ceph-mon[35411]: Deploying daemon osd.11 on smithi172 2024-09-12T02:33:56.993 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 12 02:33:56 smithi172 ceph-mon[35609]: pgmap v249: 1 pgs: 1 active+clean; 577 KiB data, 316 MiB used, 983 GiB / 983 GiB avail; 71 KiB/s, 0 objects/s recovering 2024-09-12T02:33:57.099 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 02:33:56 smithi039 ceph-mon[30515]: pgmap v249: 1 pgs: 1 active+clean; 577 KiB data, 316 MiB used, 983 GiB / 983 GiB avail; 71 KiB/s, 0 objects/s recovering 2024-09-12T02:33:57.198 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 12 02:33:56 smithi044 ceph-mon[35411]: pgmap v249: 1 pgs: 1 active+clean; 577 KiB data, 316 MiB used, 983 GiB / 983 GiB avail; 71 KiB/s, 0 objects/s recovering 2024-09-12T02:33:57.896 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 12 02:33:57 smithi172 ceph-mon[35609]: pgmap v250: 1 pgs: 1 active+clean; 577 KiB data, 316 MiB used, 983 GiB / 983 GiB avail; 58 KiB/s, 0 objects/s recovering 2024-09-12T02:33:58.099 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 02:33:57 smithi039 ceph-mon[30515]: pgmap v250: 1 pgs: 1 active+clean; 577 KiB data, 316 MiB used, 983 GiB / 983 GiB avail; 58 KiB/s, 0 objects/s recovering 2024-09-12T02:33:58.198 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 12 02:33:57 smithi044 ceph-mon[35411]: pgmap v250: 1 pgs: 1 active+clean; 577 KiB data, 316 MiB used, 983 GiB / 983 GiB avail; 58 KiB/s, 0 objects/s recovering 2024-09-12T02:34:00.148 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 12 02:33:59 smithi172 ceph-mon[35609]: pgmap v251: 1 pgs: 1 active+clean; 577 KiB data, 316 MiB used, 983 GiB / 983 GiB avail; 52 KiB/s, 0 objects/s recovering 2024-09-12T02:34:00.198 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 12 02:33:59 smithi044 ceph-mon[35411]: pgmap v251: 1 pgs: 1 active+clean; 577 KiB data, 316 MiB used, 983 GiB / 983 GiB avail; 52 KiB/s, 0 objects/s recovering 2024-09-12T02:34:00.349 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 02:33:59 smithi039 ceph-mon[30515]: pgmap v251: 1 pgs: 1 active+clean; 577 KiB data, 316 MiB used, 983 GiB / 983 GiB avail; 52 KiB/s, 0 objects/s recovering 2024-09-12T02:34:00.970 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 12 02:34:00 smithi172 ceph-mon[35609]: from='mgr.14150 172.21.15.39:0/408627207' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-12T02:34:00.970 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 12 02:34:00 smithi172 ceph-mon[35609]: from='mgr.14150 172.21.15.39:0/408627207' entity='mgr.x' 2024-09-12T02:34:00.970 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 12 02:34:00 smithi172 ceph-mon[35609]: from='mgr.14150 172.21.15.39:0/408627207' entity='mgr.x' 2024-09-12T02:34:01.198 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 12 02:34:00 smithi044 ceph-mon[35411]: from='mgr.14150 172.21.15.39:0/408627207' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-12T02:34:01.198 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 12 02:34:00 smithi044 ceph-mon[35411]: from='mgr.14150 172.21.15.39:0/408627207' entity='mgr.x' 2024-09-12T02:34:01.198 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 12 02:34:00 smithi044 ceph-mon[35411]: from='mgr.14150 172.21.15.39:0/408627207' entity='mgr.x' 2024-09-12T02:34:01.349 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 02:34:00 smithi039 ceph-mon[30515]: from='mgr.14150 172.21.15.39:0/408627207' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-12T02:34:01.350 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 02:34:00 smithi039 ceph-mon[30515]: from='mgr.14150 172.21.15.39:0/408627207' entity='mgr.x' 2024-09-12T02:34:01.350 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 02:34:00 smithi039 ceph-mon[30515]: from='mgr.14150 172.21.15.39:0/408627207' entity='mgr.x' 2024-09-12T02:34:02.513 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 12 02:34:02 smithi172 ceph-mon[35609]: pgmap v252: 1 pgs: 1 active+clean; 577 KiB data, 316 MiB used, 983 GiB / 983 GiB avail; 48 KiB/s, 0 objects/s recovering 2024-09-12T02:34:02.599 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 02:34:02 smithi039 ceph-mon[30515]: pgmap v252: 1 pgs: 1 active+clean; 577 KiB data, 316 MiB used, 983 GiB / 983 GiB avail; 48 KiB/s, 0 objects/s recovering 2024-09-12T02:34:02.699 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 12 02:34:02 smithi044 ceph-mon[35411]: pgmap v252: 1 pgs: 1 active+clean; 577 KiB data, 316 MiB used, 983 GiB / 983 GiB avail; 48 KiB/s, 0 objects/s recovering 2024-09-12T02:34:03.605 INFO:teuthology.orchestra.run.smithi172.stderr:2024-09-12T02:34:03.604+0000 7fd89dffb640 1 -- 172.21.15.172:0/3191910300 <== mgr.14150 v2:172.21.15.39:6800/1725006999 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+38 (secure 0 0 0) 0x7fd8a01a2920 con 0x7fd8900a2bb0 2024-09-12T02:34:03.605 INFO:teuthology.orchestra.run.smithi172.stdout:Created osd(s) 11 on host 'smithi172' 2024-09-12T02:34:03.607 INFO:teuthology.orchestra.run.smithi172.stderr:2024-09-12T02:34:03.607+0000 7fd8a6e20640 1 -- 172.21.15.172:0/3191910300 >> [v2:172.21.15.39:6800/1725006999,v1:172.21.15.39:6801/1725006999] conn(0x7fd8900a2bb0 msgr2=0x7fd8900a5070 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:34:03.607 INFO:teuthology.orchestra.run.smithi172.stderr:2024-09-12T02:34:03.607+0000 7fd8a6e20640 1 --2- 172.21.15.172:0/3191910300 >> [v2:172.21.15.39:6800/1725006999,v1:172.21.15.39:6801/1725006999] conn(0x7fd8900a2bb0 0x7fd8900a5070 secure :-1 s=READY pgs=110 cs=0 l=1 rev1=1 crypto rx=0x7fd8a0101b70 tx=0x7fd894005f90 comp rx=0 tx=0).stop 2024-09-12T02:34:03.607 INFO:teuthology.orchestra.run.smithi172.stderr:2024-09-12T02:34:03.607+0000 7fd8a6e20640 1 -- 172.21.15.172:0/3191910300 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fd8a01026d0 msgr2=0x7fd8a01a16d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:34:03.608 INFO:teuthology.orchestra.run.smithi172.stderr:2024-09-12T02:34:03.607+0000 7fd8a6e20640 1 --2- 172.21.15.172:0/3191910300 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fd8a01026d0 0x7fd8a01a16d0 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0x7fd89800eaa0 tx=0x7fd89800ef60 comp rx=0 tx=0).stop 2024-09-12T02:34:03.608 INFO:teuthology.orchestra.run.smithi172.stderr:2024-09-12T02:34:03.607+0000 7fd8a6e20640 1 -- 172.21.15.172:0/3191910300 shutdown_connections 2024-09-12T02:34:03.608 INFO:teuthology.orchestra.run.smithi172.stderr:2024-09-12T02:34:03.607+0000 7fd8a6e20640 1 --2- 172.21.15.172:0/3191910300 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fd8a01026d0 0x7fd8a01a16d0 unknown :-1 s=CLOSED pgs=43 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:34:03.608 INFO:teuthology.orchestra.run.smithi172.stderr:2024-09-12T02:34:03.607+0000 7fd8a6e20640 1 --2- 172.21.15.172:0/3191910300 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fd8a0101d10 0x7fd8a019a650 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:34:03.608 INFO:teuthology.orchestra.run.smithi172.stderr:2024-09-12T02:34:03.607+0000 7fd8a6e20640 1 --2- 172.21.15.172:0/3191910300 >> [v2:172.21.15.39:6800/1725006999,v1:172.21.15.39:6801/1725006999] conn(0x7fd8900a2bb0 0x7fd8900a5070 unknown :-1 s=CLOSED pgs=110 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:34:03.608 INFO:teuthology.orchestra.run.smithi172.stderr:2024-09-12T02:34:03.607+0000 7fd8a6e20640 1 --2- 172.21.15.172:0/3191910300 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fd8a0100b10 0x7fd8a019a110 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:34:03.608 INFO:teuthology.orchestra.run.smithi172.stderr:2024-09-12T02:34:03.607+0000 7fd8a6e20640 1 -- 172.21.15.172:0/3191910300 >> 172.21.15.172:0/3191910300 conn(0x7fd8a00fc2a0 msgr2=0x7fd8a006a790 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:34:03.608 INFO:teuthology.orchestra.run.smithi172.stderr:2024-09-12T02:34:03.607+0000 7fd8a6e20640 1 -- 172.21.15.172:0/3191910300 shutdown_connections 2024-09-12T02:34:03.608 INFO:teuthology.orchestra.run.smithi172.stderr:2024-09-12T02:34:03.607+0000 7fd8a6e20640 1 -- 172.21.15.172:0/3191910300 wait complete. 2024-09-12T02:34:04.309 DEBUG:teuthology.orchestra.run.smithi172:osd.11> sudo journalctl -f -n 0 -u ceph-4954ed46-70ae-11ef-bcea-c7b262605968@osd.11.service 2024-09-12T02:34:04.311 INFO:tasks.cephadm:Waiting for 12 OSDs to come up... 2024-09-12T02:34:04.312 DEBUG:teuthology.orchestra.run.smithi039:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 4954ed46-70ae-11ef-bcea-c7b262605968 -- ceph osd stat -f json 2024-09-12T02:34:04.714 INFO:teuthology.orchestra.run.smithi039.stderr:Inferring config /var/lib/ceph/4954ed46-70ae-11ef-bcea-c7b262605968/mon.a/config 2024-09-12T02:34:04.748 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 02:34:04 smithi039 ceph-mon[30515]: pgmap v253: 1 pgs: 1 active+clean; 577 KiB data, 316 MiB used, 983 GiB / 983 GiB avail 2024-09-12T02:34:04.748 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 02:34:04 smithi039 ceph-mon[30515]: from='mgr.14150 172.21.15.39:0/408627207' entity='mgr.x' 2024-09-12T02:34:04.749 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 02:34:04 smithi039 ceph-mon[30515]: from='mgr.14150 172.21.15.39:0/408627207' entity='mgr.x' 2024-09-12T02:34:04.749 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 02:34:04 smithi039 ceph-mon[30515]: from='mgr.14150 172.21.15.39:0/408627207' entity='mgr.x' 2024-09-12T02:34:04.749 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 02:34:04 smithi039 ceph-mon[30515]: from='mgr.14150 172.21.15.39:0/408627207' entity='mgr.x' 2024-09-12T02:34:04.948 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 12 02:34:04 smithi044 ceph-mon[35411]: pgmap v253: 1 pgs: 1 active+clean; 577 KiB data, 316 MiB used, 983 GiB / 983 GiB avail 2024-09-12T02:34:04.948 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 12 02:34:04 smithi044 ceph-mon[35411]: from='mgr.14150 172.21.15.39:0/408627207' entity='mgr.x' 2024-09-12T02:34:04.948 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 12 02:34:04 smithi044 ceph-mon[35411]: from='mgr.14150 172.21.15.39:0/408627207' entity='mgr.x' 2024-09-12T02:34:04.949 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 12 02:34:04 smithi044 ceph-mon[35411]: from='mgr.14150 172.21.15.39:0/408627207' entity='mgr.x' 2024-09-12T02:34:04.949 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 12 02:34:04 smithi044 ceph-mon[35411]: from='mgr.14150 172.21.15.39:0/408627207' entity='mgr.x' 2024-09-12T02:34:05.013 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 12 02:34:04 smithi172 ceph-mon[35609]: pgmap v253: 1 pgs: 1 active+clean; 577 KiB data, 316 MiB used, 983 GiB / 983 GiB avail 2024-09-12T02:34:05.014 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 12 02:34:04 smithi172 ceph-mon[35609]: from='mgr.14150 172.21.15.39:0/408627207' entity='mgr.x' 2024-09-12T02:34:05.014 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 12 02:34:04 smithi172 ceph-mon[35609]: from='mgr.14150 172.21.15.39:0/408627207' entity='mgr.x' 2024-09-12T02:34:05.014 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 12 02:34:04 smithi172 ceph-mon[35609]: from='mgr.14150 172.21.15.39:0/408627207' entity='mgr.x' 2024-09-12T02:34:05.014 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 12 02:34:04 smithi172 ceph-mon[35609]: from='mgr.14150 172.21.15.39:0/408627207' entity='mgr.x' 2024-09-12T02:34:05.283 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:34:05.281+0000 7f1be5600640 1 -- 172.21.15.39:0/1159937980 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f1be0103600 msgr2=0x7f1be0109e90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:34:05.283 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:34:05.281+0000 7f1be5600640 1 --2- 172.21.15.39:0/1159937980 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f1be0103600 0x7f1be0109e90 secure :-1 s=READY pgs=128 cs=0 l=1 rev1=1 crypto rx=0x7f1bd8009ca0 tx=0x7f1bd802a8c0 comp rx=0 tx=0).stop 2024-09-12T02:34:05.283 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:34:05.281+0000 7f1be5600640 1 -- 172.21.15.39:0/1159937980 shutdown_connections 2024-09-12T02:34:05.283 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:34:05.281+0000 7f1be5600640 1 --2- 172.21.15.39:0/1159937980 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f1be0103600 0x7f1be0109e90 unknown :-1 s=CLOSED pgs=128 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:34:05.283 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:34:05.281+0000 7f1be5600640 1 --2- 172.21.15.39:0/1159937980 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f1be0102c40 0x7f1be01030c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:34:05.283 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:34:05.281+0000 7f1be5600640 1 --2- 172.21.15.39:0/1159937980 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f1be0101a40 0x7f1be0101e40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:34:05.283 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:34:05.281+0000 7f1be5600640 1 -- 172.21.15.39:0/1159937980 >> 172.21.15.39:0/1159937980 conn(0x7f1be00fd1f0 msgr2=0x7f1be00ff610 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:34:05.283 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:34:05.281+0000 7f1be5600640 1 -- 172.21.15.39:0/1159937980 shutdown_connections 2024-09-12T02:34:05.283 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:34:05.281+0000 7f1be5600640 1 -- 172.21.15.39:0/1159937980 wait complete. 2024-09-12T02:34:05.284 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:34:05.282+0000 7f1be5600640 1 Processor -- start 2024-09-12T02:34:05.284 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:34:05.282+0000 7f1be5600640 1 -- start start 2024-09-12T02:34:05.285 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:34:05.283+0000 7f1be5600640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f1be0101a40 0x7f1be0199f40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:34:05.285 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:34:05.283+0000 7f1be5600640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f1be0102c40 0x7f1be019a480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:34:05.285 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:34:05.283+0000 7f1be5600640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f1be0103600 0x7f1be01a1500 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:34:05.285 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:34:05.283+0000 7f1be5600640 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 -- 0x7f1be010d710 con 0x7f1be0103600 2024-09-12T02:34:05.286 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:34:05.283+0000 7f1be5600640 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x7f1be010d590 con 0x7f1be0101a40 2024-09-12T02:34:05.286 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:34:05.283+0000 7f1be5600640 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7f1be010d890 con 0x7f1be0102c40 2024-09-12T02:34:05.286 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:34:05.283+0000 7f1bdfe00640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f1be0101a40 0x7f1be0199f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:34:05.286 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:34:05.283+0000 7f1bdfe00640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f1be0101a40 0x7f1be0199f40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.39:35130/0 (socket says 172.21.15.39:35130) 2024-09-12T02:34:05.286 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:34:05.283+0000 7f1bdfe00640 1 -- 172.21.15.39:0/2895990554 learned_addr learned my addr 172.21.15.39:0/2895990554 (peer_addr_for_me v2:172.21.15.39:0/0) 2024-09-12T02:34:05.286 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:34:05.283+0000 7f1be4c00640 1 --2- 172.21.15.39:0/2895990554 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f1be0103600 0x7f1be01a1500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:34:05.286 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:34:05.283+0000 7f1bdf400640 1 --2- 172.21.15.39:0/2895990554 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f1be0102c40 0x7f1be019a480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:34:05.286 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:34:05.283+0000 7f1bdfe00640 1 -- 172.21.15.39:0/2895990554 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f1be0102c40 msgr2=0x7f1be019a480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:34:05.286 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:34:05.283+0000 7f1bdfe00640 1 --2- 172.21.15.39:0/2895990554 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f1be0102c40 0x7f1be019a480 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:34:05.286 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:34:05.283+0000 7f1bdfe00640 1 -- 172.21.15.39:0/2895990554 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f1be0103600 msgr2=0x7f1be01a1500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:34:05.286 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:34:05.283+0000 7f1bdfe00640 1 --2- 172.21.15.39:0/2895990554 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f1be0103600 0x7f1be01a1500 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:34:05.286 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:34:05.283+0000 7f1bdfe00640 1 -- 172.21.15.39:0/2895990554 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1be01a1b70 con 0x7f1be0101a40 2024-09-12T02:34:05.286 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:34:05.283+0000 7f1be4c00640 1 --2- 172.21.15.39:0/2895990554 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f1be0103600 0x7f1be01a1500 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-12T02:34:05.287 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:34:05.284+0000 7f1bdfe00640 1 --2- 172.21.15.39:0/2895990554 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f1be0101a40 0x7f1be0199f40 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7f1bd000d950 tx=0x7f1bd000de10 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:34:05.287 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:34:05.284+0000 7f1bdcc00640 1 -- 172.21.15.39:0/2895990554 <== mon.2 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1bd0017020 con 0x7f1be0101a40 2024-09-12T02:34:05.287 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:34:05.284+0000 7f1bdcc00640 1 -- 172.21.15.39:0/2895990554 <== mon.2 v2:172.21.15.44:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f1bd0009c30 con 0x7f1be0101a40 2024-09-12T02:34:05.287 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:34:05.284+0000 7f1be5600640 1 -- 172.21.15.39:0/2895990554 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f1be01a1e60 con 0x7f1be0101a40 2024-09-12T02:34:05.287 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:34:05.284+0000 7f1bdcc00640 1 -- 172.21.15.39:0/2895990554 <== mon.2 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1bd000f720 con 0x7f1be0101a40 2024-09-12T02:34:05.287 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:34:05.284+0000 7f1be5600640 1 -- 172.21.15.39:0/2895990554 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f1be01a22b0 con 0x7f1be0101a40 2024-09-12T02:34:05.287 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:34:05.285+0000 7f1be5600640 1 -- 172.21.15.39:0/2895990554 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f1be01a2570 con 0x7f1be0101a40 2024-09-12T02:34:05.289 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:34:05.289+0000 7f1bdcc00640 1 -- 172.21.15.39:0/2895990554 <== mon.2 v2:172.21.15.44:3300/0 4 ==== mgrmap(e 16) ==== 137833+0+0 (secure 0 0 0) 0x7f1bd001a020 con 0x7f1be0101a40 2024-09-12T02:34:05.290 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:34:05.290+0000 7f1bdcc00640 1 --2- 172.21.15.39:0/2895990554 >> [v2:172.21.15.39:6800/1725006999,v1:172.21.15.39:6801/1725006999] conn(0x7f1bc40a2bb0 0x7f1bc40a5070 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:34:05.290 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:34:05.290+0000 7f1bdcc00640 1 -- 172.21.15.39:0/2895990554 <== mon.2 v2:172.21.15.44:3300/0 5 ==== osd_map(74..74 src has 1..74) ==== 6809+0+0 (secure 0 0 0) 0x7f1bd00ce970 con 0x7f1be0101a40 2024-09-12T02:34:05.291 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:34:05.290+0000 7f1bdf400640 1 --2- 172.21.15.39:0/2895990554 >> [v2:172.21.15.39:6800/1725006999,v1:172.21.15.39:6801/1725006999] conn(0x7f1bc40a2bb0 0x7f1bc40a5070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:34:05.291 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:34:05.291+0000 7f1bdf400640 1 --2- 172.21.15.39:0/2895990554 >> [v2:172.21.15.39:6800/1725006999,v1:172.21.15.39:6801/1725006999] conn(0x7f1bc40a2bb0 0x7f1bc40a5070 secure :-1 s=READY pgs=114 cs=0 l=1 rev1=1 crypto rx=0x7f1be019b460 tx=0x7f1bcc005f90 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:34:05.295 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:34:05.294+0000 7f1bdcc00640 1 -- 172.21.15.39:0/2895990554 <== mon.2 v2:172.21.15.44:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7f1bd0021020 con 0x7f1be0101a40 2024-09-12T02:34:05.480 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:34:05.479+0000 7f1be5600640 1 -- 172.21.15.39:0/2895990554 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_command({"prefix": "osd stat", "format": "json"} v 0) -- 0x7f1be01a2d70 con 0x7f1be0101a40 2024-09-12T02:34:05.480 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:34:05.479+0000 7f1bdcc00640 1 -- 172.21.15.39:0/2895990554 <== mon.2 v2:172.21.15.44:3300/0 7 ==== mon_command_ack([{"prefix": "osd stat", "format": "json"}]=0 v74) ==== 74+0+133 (secure 0 0 0) 0x7f1bd009beb0 con 0x7f1be0101a40 2024-09-12T02:34:05.481 INFO:teuthology.orchestra.run.smithi039.stdout: 2024-09-12T02:34:05.483 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:34:05.482+0000 7f1be5600640 1 -- 172.21.15.39:0/2895990554 >> [v2:172.21.15.39:6800/1725006999,v1:172.21.15.39:6801/1725006999] conn(0x7f1bc40a2bb0 msgr2=0x7f1bc40a5070 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:34:05.483 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:34:05.482+0000 7f1be5600640 1 --2- 172.21.15.39:0/2895990554 >> [v2:172.21.15.39:6800/1725006999,v1:172.21.15.39:6801/1725006999] conn(0x7f1bc40a2bb0 0x7f1bc40a5070 secure :-1 s=READY pgs=114 cs=0 l=1 rev1=1 crypto rx=0x7f1be019b460 tx=0x7f1bcc005f90 comp rx=0 tx=0).stop 2024-09-12T02:34:05.483 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:34:05.482+0000 7f1be5600640 1 -- 172.21.15.39:0/2895990554 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f1be0101a40 msgr2=0x7f1be0199f40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:34:05.483 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:34:05.482+0000 7f1be5600640 1 --2- 172.21.15.39:0/2895990554 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f1be0101a40 0x7f1be0199f40 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7f1bd000d950 tx=0x7f1bd000de10 comp rx=0 tx=0).stop 2024-09-12T02:34:05.483 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:34:05.482+0000 7f1be5600640 1 -- 172.21.15.39:0/2895990554 shutdown_connections 2024-09-12T02:34:05.483 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:34:05.482+0000 7f1be5600640 1 --2- 172.21.15.39:0/2895990554 >> [v2:172.21.15.39:6800/1725006999,v1:172.21.15.39:6801/1725006999] conn(0x7f1bc40a2bb0 0x7f1bc40a5070 unknown :-1 s=CLOSED pgs=114 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:34:05.483 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:34:05.482+0000 7f1be5600640 1 --2- 172.21.15.39:0/2895990554 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f1be0103600 0x7f1be01a1500 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:34:05.483 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:34:05.482+0000 7f1be5600640 1 --2- 172.21.15.39:0/2895990554 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f1be0102c40 0x7f1be019a480 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:34:05.483 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:34:05.482+0000 7f1be5600640 1 --2- 172.21.15.39:0/2895990554 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f1be0101a40 0x7f1be0199f40 unknown :-1 s=CLOSED pgs=60 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:34:05.483 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:34:05.482+0000 7f1be5600640 1 -- 172.21.15.39:0/2895990554 >> 172.21.15.39:0/2895990554 conn(0x7f1be00fd1f0 msgr2=0x7f1be0074420 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:34:05.483 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:34:05.482+0000 7f1be5600640 1 -- 172.21.15.39:0/2895990554 shutdown_connections 2024-09-12T02:34:05.484 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:34:05.482+0000 7f1be5600640 1 -- 172.21.15.39:0/2895990554 wait complete. 2024-09-12T02:34:05.718 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 12 02:34:05 smithi172 ceph-mon[35609]: from='client.? 172.21.15.39:0/2895990554' entity='client.admin' cmd=[{"prefix": "osd stat", "format": "json"}]: dispatch 2024-09-12T02:34:05.937 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 02:34:05 smithi039 ceph-mon[30515]: from='client.? 172.21.15.39:0/2895990554' entity='client.admin' cmd=[{"prefix": "osd stat", "format": "json"}]: dispatch 2024-09-12T02:34:05.948 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 12 02:34:05 smithi044 ceph-mon[35411]: from='client.? 172.21.15.39:0/2895990554' entity='client.admin' cmd=[{"prefix": "osd stat", "format": "json"}]: dispatch 2024-09-12T02:34:06.491 INFO:teuthology.orchestra.run.smithi039.stdout:{"epoch":74,"num_osds":12,"num_up_osds":11,"osd_up_since":1726108423,"num_in_osds":12,"osd_in_since":1726108425,"num_remapped_pgs":0} 2024-09-12T02:34:06.620 INFO:journalctl@ceph.osd.11.smithi172.stdout:Sep 12 02:34:06 smithi172 ceph-4954ed46-70ae-11ef-bcea-c7b262605968-osd-11[61129]: 2024-09-12T02:34:06.279+0000 7ff14d9fe640 -1 osd.11 0 log_to_monitors true 2024-09-12T02:34:06.948 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 12 02:34:06 smithi044 ceph-mon[35411]: pgmap v254: 1 pgs: 1 active+clean; 577 KiB data, 316 MiB used, 983 GiB / 983 GiB avail 2024-09-12T02:34:06.948 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 12 02:34:06 smithi044 ceph-mon[35411]: from='osd.11 [v2:172.21.15.172:6824/3627635035,v1:172.21.15.172:6825/3627635035]' entity='osd.11' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["11"]}]: dispatch 2024-09-12T02:34:06.949 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 12 02:34:06 smithi044 ceph-mon[35411]: from='osd.11 ' entity='osd.11' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["11"]}]: dispatch 2024-09-12T02:34:07.013 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 12 02:34:06 smithi172 ceph-mon[35609]: pgmap v254: 1 pgs: 1 active+clean; 577 KiB data, 316 MiB used, 983 GiB / 983 GiB avail 2024-09-12T02:34:07.014 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 12 02:34:06 smithi172 ceph-mon[35609]: from='osd.11 [v2:172.21.15.172:6824/3627635035,v1:172.21.15.172:6825/3627635035]' entity='osd.11' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["11"]}]: dispatch 2024-09-12T02:34:07.014 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 12 02:34:06 smithi172 ceph-mon[35609]: from='osd.11 ' entity='osd.11' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["11"]}]: dispatch 2024-09-12T02:34:07.099 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 02:34:06 smithi039 ceph-mon[30515]: pgmap v254: 1 pgs: 1 active+clean; 577 KiB data, 316 MiB used, 983 GiB / 983 GiB avail 2024-09-12T02:34:07.100 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 02:34:06 smithi039 ceph-mon[30515]: from='osd.11 [v2:172.21.15.172:6824/3627635035,v1:172.21.15.172:6825/3627635035]' entity='osd.11' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["11"]}]: dispatch 2024-09-12T02:34:07.100 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 02:34:06 smithi039 ceph-mon[30515]: from='osd.11 ' entity='osd.11' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["11"]}]: dispatch 2024-09-12T02:34:07.492 DEBUG:teuthology.orchestra.run.smithi039:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 4954ed46-70ae-11ef-bcea-c7b262605968 -- ceph osd stat -f json 2024-09-12T02:34:07.850 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 02:34:07 smithi039 ceph-mon[30515]: from='osd.11 ' entity='osd.11' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["11"]}]': finished 2024-09-12T02:34:07.850 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 02:34:07 smithi039 ceph-mon[30515]: from='osd.11 [v2:172.21.15.172:6824/3627635035,v1:172.21.15.172:6825/3627635035]' entity='osd.11' cmd=[{"prefix": "osd crush create-or-move", "id": 11, "weight":0.0873, "args": ["host=smithi172", "root=default"]}]: dispatch 2024-09-12T02:34:07.850 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 02:34:07 smithi039 ceph-mon[30515]: osdmap e75: 12 total, 11 up, 12 in 2024-09-12T02:34:07.850 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 02:34:07 smithi039 ceph-mon[30515]: from='mgr.14150 172.21.15.39:0/408627207' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 11}]: dispatch 2024-09-12T02:34:07.850 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 02:34:07 smithi039 ceph-mon[30515]: from='osd.11 ' entity='osd.11' cmd=[{"prefix": "osd crush create-or-move", "id": 11, "weight":0.0873, "args": ["host=smithi172", "root=default"]}]: dispatch 2024-09-12T02:34:07.850 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 02:34:07 smithi039 ceph-mon[30515]: from='mgr.14150 172.21.15.39:0/408627207' entity='mgr.x' 2024-09-12T02:34:07.850 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 02:34:07 smithi039 ceph-mon[30515]: from='mgr.14150 172.21.15.39:0/408627207' entity='mgr.x' 2024-09-12T02:34:07.850 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 02:34:07 smithi039 ceph-mon[30515]: from='mgr.14150 172.21.15.39:0/408627207' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2024-09-12T02:34:07.850 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 02:34:07 smithi039 ceph-mon[30515]: from='mgr.14150 172.21.15.39:0/408627207' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2024-09-12T02:34:07.851 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 02:34:07 smithi039 ceph-mon[30515]: from='mgr.14150 172.21.15.39:0/408627207' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.8", "name": "osd_memory_target"}]: dispatch 2024-09-12T02:34:07.851 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 02:34:07 smithi039 ceph-mon[30515]: from='mgr.14150 172.21.15.39:0/408627207' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.11", "name": "osd_memory_target"}]: dispatch 2024-09-12T02:34:07.851 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 02:34:07 smithi039 ceph-mon[30515]: from='mgr.14150 172.21.15.39:0/408627207' entity='mgr.x' 2024-09-12T02:34:07.851 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 02:34:07 smithi039 ceph-mon[30515]: from='mgr.14150 172.21.15.39:0/408627207' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-12T02:34:07.851 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 02:34:07 smithi039 ceph-mon[30515]: from='mgr.14150 172.21.15.39:0/408627207' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-12T02:34:07.851 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 02:34:07 smithi039 ceph-mon[30515]: from='mgr.14150 172.21.15.39:0/408627207' entity='mgr.x' 2024-09-12T02:34:07.851 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 02:34:07 smithi039 ceph-mon[30515]: from='mgr.14150 172.21.15.39:0/408627207' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-12T02:34:07.851 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 02:34:07 smithi039 ceph-mon[30515]: from='mgr.14150 172.21.15.39:0/408627207' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-12T02:34:07.851 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 02:34:07 smithi039 ceph-mon[30515]: from='mgr.14150 172.21.15.39:0/408627207' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-12T02:34:07.851 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 02:34:07 smithi039 ceph-mon[30515]: from='mgr.14150 172.21.15.39:0/408627207' entity='mgr.x' 2024-09-12T02:34:07.851 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 02:34:07 smithi039 ceph-mon[30515]: from='osd.11 ' entity='osd.11' cmd='[{"prefix": "osd crush create-or-move", "id": 11, "weight":0.0873, "args": ["host=smithi172", "root=default"]}]': finished 2024-09-12T02:34:07.851 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 02:34:07 smithi039 ceph-mon[30515]: osdmap e76: 12 total, 11 up, 12 in 2024-09-12T02:34:07.851 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 02:34:07 smithi039 ceph-mon[30515]: from='mgr.14150 172.21.15.39:0/408627207' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 11}]: dispatch 2024-09-12T02:34:07.868 INFO:teuthology.orchestra.run.smithi039.stderr:Inferring config /var/lib/ceph/4954ed46-70ae-11ef-bcea-c7b262605968/mon.a/config 2024-09-12T02:34:07.949 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 12 02:34:07 smithi044 ceph-mon[35411]: from='osd.11 ' entity='osd.11' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["11"]}]': finished 2024-09-12T02:34:07.949 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 12 02:34:07 smithi044 ceph-mon[35411]: from='osd.11 [v2:172.21.15.172:6824/3627635035,v1:172.21.15.172:6825/3627635035]' entity='osd.11' cmd=[{"prefix": "osd crush create-or-move", "id": 11, "weight":0.0873, "args": ["host=smithi172", "root=default"]}]: dispatch 2024-09-12T02:34:07.949 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 12 02:34:07 smithi044 ceph-mon[35411]: osdmap e75: 12 total, 11 up, 12 in 2024-09-12T02:34:07.949 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 12 02:34:07 smithi044 ceph-mon[35411]: from='mgr.14150 172.21.15.39:0/408627207' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 11}]: dispatch 2024-09-12T02:34:07.949 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 12 02:34:07 smithi044 ceph-mon[35411]: from='osd.11 ' entity='osd.11' cmd=[{"prefix": "osd crush create-or-move", "id": 11, "weight":0.0873, "args": ["host=smithi172", "root=default"]}]: dispatch 2024-09-12T02:34:07.949 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 12 02:34:07 smithi044 ceph-mon[35411]: from='mgr.14150 172.21.15.39:0/408627207' entity='mgr.x' 2024-09-12T02:34:07.949 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 12 02:34:07 smithi044 ceph-mon[35411]: from='mgr.14150 172.21.15.39:0/408627207' entity='mgr.x' 2024-09-12T02:34:07.949 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 12 02:34:07 smithi044 ceph-mon[35411]: from='mgr.14150 172.21.15.39:0/408627207' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2024-09-12T02:34:07.949 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 12 02:34:07 smithi044 ceph-mon[35411]: from='mgr.14150 172.21.15.39:0/408627207' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2024-09-12T02:34:07.949 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 12 02:34:07 smithi044 ceph-mon[35411]: from='mgr.14150 172.21.15.39:0/408627207' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.8", "name": "osd_memory_target"}]: dispatch 2024-09-12T02:34:07.950 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 12 02:34:07 smithi044 ceph-mon[35411]: from='mgr.14150 172.21.15.39:0/408627207' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.11", "name": "osd_memory_target"}]: dispatch 2024-09-12T02:34:07.950 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 12 02:34:07 smithi044 ceph-mon[35411]: from='mgr.14150 172.21.15.39:0/408627207' entity='mgr.x' 2024-09-12T02:34:07.950 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 12 02:34:07 smithi044 ceph-mon[35411]: from='mgr.14150 172.21.15.39:0/408627207' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-12T02:34:07.950 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 12 02:34:07 smithi044 ceph-mon[35411]: from='mgr.14150 172.21.15.39:0/408627207' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-12T02:34:07.950 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 12 02:34:07 smithi044 ceph-mon[35411]: from='mgr.14150 172.21.15.39:0/408627207' entity='mgr.x' 2024-09-12T02:34:07.950 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 12 02:34:07 smithi044 ceph-mon[35411]: from='mgr.14150 172.21.15.39:0/408627207' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-12T02:34:07.950 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 12 02:34:07 smithi044 ceph-mon[35411]: from='mgr.14150 172.21.15.39:0/408627207' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-12T02:34:07.950 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 12 02:34:07 smithi044 ceph-mon[35411]: from='mgr.14150 172.21.15.39:0/408627207' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-12T02:34:07.950 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 12 02:34:07 smithi044 ceph-mon[35411]: from='mgr.14150 172.21.15.39:0/408627207' entity='mgr.x' 2024-09-12T02:34:07.950 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 12 02:34:07 smithi044 ceph-mon[35411]: from='osd.11 ' entity='osd.11' cmd='[{"prefix": "osd crush create-or-move", "id": 11, "weight":0.0873, "args": ["host=smithi172", "root=default"]}]': finished 2024-09-12T02:34:07.950 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 12 02:34:07 smithi044 ceph-mon[35411]: osdmap e76: 12 total, 11 up, 12 in 2024-09-12T02:34:07.950 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 12 02:34:07 smithi044 ceph-mon[35411]: from='mgr.14150 172.21.15.39:0/408627207' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 11}]: dispatch 2024-09-12T02:34:08.013 INFO:journalctl@ceph.osd.11.smithi172.stdout:Sep 12 02:34:07 smithi172 ceph-4954ed46-70ae-11ef-bcea-c7b262605968-osd-11[61129]: 2024-09-12T02:34:07.620+0000 7ff149981640 -1 osd.11 0 waiting for initial osdmap 2024-09-12T02:34:08.014 INFO:journalctl@ceph.osd.11.smithi172.stdout:Sep 12 02:34:07 smithi172 ceph-4954ed46-70ae-11ef-bcea-c7b262605968-osd-11[61129]: 2024-09-12T02:34:07.634+0000 7ff1457a9640 -1 osd.11 76 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-09-12T02:34:08.014 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 12 02:34:07 smithi172 ceph-mon[35609]: from='osd.11 ' entity='osd.11' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["11"]}]': finished 2024-09-12T02:34:08.014 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 12 02:34:07 smithi172 ceph-mon[35609]: from='osd.11 [v2:172.21.15.172:6824/3627635035,v1:172.21.15.172:6825/3627635035]' entity='osd.11' cmd=[{"prefix": "osd crush create-or-move", "id": 11, "weight":0.0873, "args": ["host=smithi172", "root=default"]}]: dispatch 2024-09-12T02:34:08.014 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 12 02:34:07 smithi172 ceph-mon[35609]: osdmap e75: 12 total, 11 up, 12 in 2024-09-12T02:34:08.014 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 12 02:34:07 smithi172 ceph-mon[35609]: from='mgr.14150 172.21.15.39:0/408627207' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 11}]: dispatch 2024-09-12T02:34:08.014 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 12 02:34:07 smithi172 ceph-mon[35609]: from='osd.11 ' entity='osd.11' cmd=[{"prefix": "osd crush create-or-move", "id": 11, "weight":0.0873, "args": ["host=smithi172", "root=default"]}]: dispatch 2024-09-12T02:34:08.014 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 12 02:34:07 smithi172 ceph-mon[35609]: from='mgr.14150 172.21.15.39:0/408627207' entity='mgr.x' 2024-09-12T02:34:08.014 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 12 02:34:07 smithi172 ceph-mon[35609]: from='mgr.14150 172.21.15.39:0/408627207' entity='mgr.x' 2024-09-12T02:34:08.014 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 12 02:34:07 smithi172 ceph-mon[35609]: from='mgr.14150 172.21.15.39:0/408627207' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2024-09-12T02:34:08.014 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 12 02:34:07 smithi172 ceph-mon[35609]: from='mgr.14150 172.21.15.39:0/408627207' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2024-09-12T02:34:08.015 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 12 02:34:07 smithi172 ceph-mon[35609]: from='mgr.14150 172.21.15.39:0/408627207' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.8", "name": "osd_memory_target"}]: dispatch 2024-09-12T02:34:08.015 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 12 02:34:07 smithi172 ceph-mon[35609]: from='mgr.14150 172.21.15.39:0/408627207' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.11", "name": "osd_memory_target"}]: dispatch 2024-09-12T02:34:08.015 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 12 02:34:07 smithi172 ceph-mon[35609]: from='mgr.14150 172.21.15.39:0/408627207' entity='mgr.x' 2024-09-12T02:34:08.015 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 12 02:34:07 smithi172 ceph-mon[35609]: from='mgr.14150 172.21.15.39:0/408627207' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-12T02:34:08.015 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 12 02:34:07 smithi172 ceph-mon[35609]: from='mgr.14150 172.21.15.39:0/408627207' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-12T02:34:08.015 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 12 02:34:07 smithi172 ceph-mon[35609]: from='mgr.14150 172.21.15.39:0/408627207' entity='mgr.x' 2024-09-12T02:34:08.015 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 12 02:34:07 smithi172 ceph-mon[35609]: from='mgr.14150 172.21.15.39:0/408627207' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-12T02:34:08.015 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 12 02:34:07 smithi172 ceph-mon[35609]: from='mgr.14150 172.21.15.39:0/408627207' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-12T02:34:08.015 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 12 02:34:07 smithi172 ceph-mon[35609]: from='mgr.14150 172.21.15.39:0/408627207' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-12T02:34:08.015 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 12 02:34:07 smithi172 ceph-mon[35609]: from='mgr.14150 172.21.15.39:0/408627207' entity='mgr.x' 2024-09-12T02:34:08.015 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 12 02:34:07 smithi172 ceph-mon[35609]: from='osd.11 ' entity='osd.11' cmd='[{"prefix": "osd crush create-or-move", "id": 11, "weight":0.0873, "args": ["host=smithi172", "root=default"]}]': finished 2024-09-12T02:34:08.015 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 12 02:34:07 smithi172 ceph-mon[35609]: osdmap e76: 12 total, 11 up, 12 in 2024-09-12T02:34:08.015 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 12 02:34:07 smithi172 ceph-mon[35609]: from='mgr.14150 172.21.15.39:0/408627207' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 11}]: dispatch 2024-09-12T02:34:08.455 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:34:08.455+0000 7feba7e00640 1 -- 172.21.15.39:0/3644533299 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7feba81055d0 msgr2=0x7feba8105a80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:34:08.455 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:34:08.455+0000 7feba7e00640 1 --2- 172.21.15.39:0/3644533299 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7feba81055d0 0x7feba8105a80 secure :-1 s=READY pgs=129 cs=0 l=1 rev1=1 crypto rx=0x7feba0009ca0 tx=0x7feba002a8c0 comp rx=0 tx=0).stop 2024-09-12T02:34:08.455 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:34:08.455+0000 7feba7e00640 1 -- 172.21.15.39:0/3644533299 shutdown_connections 2024-09-12T02:34:08.455 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:34:08.455+0000 7feba7e00640 1 --2- 172.21.15.39:0/3644533299 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7feba81055d0 0x7feba8105a80 unknown :-1 s=CLOSED pgs=129 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:34:08.455 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:34:08.455+0000 7feba7e00640 1 --2- 172.21.15.39:0/3644533299 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7feba8102c20 0x7feba8105090 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:34:08.455 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:34:08.455+0000 7feba7e00640 1 --2- 172.21.15.39:0/3644533299 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7feba81002d0 0x7feba81026e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:34:08.456 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:34:08.455+0000 7feba7e00640 1 -- 172.21.15.39:0/3644533299 >> 172.21.15.39:0/3644533299 conn(0x7feba80fc0e0 msgr2=0x7feba80fe520 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:34:08.456 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:34:08.455+0000 7feba7e00640 1 -- 172.21.15.39:0/3644533299 shutdown_connections 2024-09-12T02:34:08.456 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:34:08.455+0000 7feba7e00640 1 -- 172.21.15.39:0/3644533299 wait complete. 2024-09-12T02:34:08.457 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:34:08.456+0000 7feba7e00640 1 Processor -- start 2024-09-12T02:34:08.457 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:34:08.456+0000 7feba7e00640 1 -- start start 2024-09-12T02:34:08.457 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:34:08.456+0000 7feba7e00640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7feba81002d0 0x7feba819e290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:34:08.457 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:34:08.457+0000 7feba7e00640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7feba8102c20 0x7feba819e7d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:34:08.457 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:34:08.457+0000 7feba7e00640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7feba81055d0 0x7feba81a5850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:34:08.458 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:34:08.457+0000 7feba7e00640 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 -- 0x7feba8113ce0 con 0x7feba8102c20 2024-09-12T02:34:08.458 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:34:08.457+0000 7feba7e00640 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x7feba8113b60 con 0x7feba81002d0 2024-09-12T02:34:08.458 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:34:08.457+0000 7feba7e00640 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7feba8113e60 con 0x7feba81055d0 2024-09-12T02:34:08.458 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:34:08.457+0000 7feba6a00640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7feba81002d0 0x7feba819e290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:34:08.458 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:34:08.457+0000 7feb9e000640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7feba8102c20 0x7feba819e7d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:34:08.458 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:34:08.457+0000 7feba7400640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7feba81055d0 0x7feba81a5850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:34:08.458 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:34:08.457+0000 7feba6a00640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7feba81002d0 0x7feba819e290 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.39:49304/0 (socket says 172.21.15.39:49304) 2024-09-12T02:34:08.458 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:34:08.457+0000 7feba6a00640 1 -- 172.21.15.39:0/1364765916 learned_addr learned my addr 172.21.15.39:0/1364765916 (peer_addr_for_me v2:172.21.15.39:0/0) 2024-09-12T02:34:08.458 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:34:08.457+0000 7feba7400640 1 -- 172.21.15.39:0/1364765916 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7feba81002d0 msgr2=0x7feba819e290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:34:08.458 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:34:08.457+0000 7feba7400640 1 --2- 172.21.15.39:0/1364765916 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7feba81002d0 0x7feba819e290 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:34:08.458 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:34:08.457+0000 7feba7400640 1 -- 172.21.15.39:0/1364765916 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7feba8102c20 msgr2=0x7feba819e7d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:34:08.458 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:34:08.457+0000 7feba7400640 1 --2- 172.21.15.39:0/1364765916 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7feba8102c20 0x7feba819e7d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:34:08.459 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:34:08.457+0000 7feba7400640 1 -- 172.21.15.39:0/1364765916 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7feba81a5ec0 con 0x7feba81055d0 2024-09-12T02:34:08.459 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:34:08.458+0000 7feba7400640 1 --2- 172.21.15.39:0/1364765916 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7feba81055d0 0x7feba81a5850 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0x7feba0031ae0 tx=0x7feba0004ab0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:34:08.459 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:34:08.458+0000 7feb9fe00640 1 -- 172.21.15.39:0/1364765916 <== mon.1 v2:172.21.15.172:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7feba0003b70 con 0x7feba81055d0 2024-09-12T02:34:08.459 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:34:08.458+0000 7feba7e00640 1 -- 172.21.15.39:0/1364765916 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7feba81a6150 con 0x7feba81055d0 2024-09-12T02:34:08.460 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:34:08.458+0000 7feb9fe00640 1 -- 172.21.15.39:0/1364765916 <== mon.1 v2:172.21.15.172:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7feba0003d10 con 0x7feba81055d0 2024-09-12T02:34:08.460 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:34:08.458+0000 7feb9fe00640 1 -- 172.21.15.39:0/1364765916 <== mon.1 v2:172.21.15.172:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7feba002fc40 con 0x7feba81055d0 2024-09-12T02:34:08.460 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:34:08.458+0000 7feba7e00640 1 -- 172.21.15.39:0/1364765916 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7feba81a66b0 con 0x7feba81055d0 2024-09-12T02:34:08.460 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:34:08.459+0000 7feba7e00640 1 -- 172.21.15.39:0/1364765916 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7feba80fdbd0 con 0x7feba81055d0 2024-09-12T02:34:08.461 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:34:08.461+0000 7feb9fe00640 1 -- 172.21.15.39:0/1364765916 <== mon.1 v2:172.21.15.172:3300/0 4 ==== mgrmap(e 16) ==== 137833+0+0 (secure 0 0 0) 0x7feba0070b30 con 0x7feba81055d0 2024-09-12T02:34:08.463 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:34:08.463+0000 7feb9fe00640 1 --2- 172.21.15.39:0/1364765916 >> [v2:172.21.15.39:6800/1725006999,v1:172.21.15.39:6801/1725006999] conn(0x7feb8c0a2c30 0x7feb8c0a50f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:34:08.463 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:34:08.463+0000 7feb9fe00640 1 -- 172.21.15.39:0/1364765916 <== mon.1 v2:172.21.15.172:3300/0 5 ==== osd_map(76..76 src has 1..76) ==== 6847+0+0 (secure 0 0 0) 0x7feba00efc10 con 0x7feba81055d0 2024-09-12T02:34:08.463 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:34:08.463+0000 7feba6a00640 1 --2- 172.21.15.39:0/1364765916 >> [v2:172.21.15.39:6800/1725006999,v1:172.21.15.39:6801/1725006999] conn(0x7feb8c0a2c30 0x7feb8c0a50f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:34:08.463 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:34:08.464+0000 7feba6a00640 1 --2- 172.21.15.39:0/1364765916 >> [v2:172.21.15.39:6800/1725006999,v1:172.21.15.39:6801/1725006999] conn(0x7feb8c0a2c30 0x7feb8c0a50f0 secure :-1 s=READY pgs=116 cs=0 l=1 rev1=1 crypto rx=0x7feb98009c90 tx=0x7feb98005f90 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:34:08.464 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:34:08.465+0000 7feb9fe00640 1 -- 172.21.15.39:0/1364765916 <== mon.1 v2:172.21.15.172:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7feba0070e20 con 0x7feba81055d0 2024-09-12T02:34:08.651 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:34:08.651+0000 7feba7e00640 1 -- 172.21.15.39:0/1364765916 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_command({"prefix": "osd stat", "format": "json"} v 0) -- 0x7feba8062df0 con 0x7feba81055d0 2024-09-12T02:34:08.651 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:34:08.652+0000 7feb9fe00640 1 -- 172.21.15.39:0/1364765916 <== mon.1 v2:172.21.15.172:3300/0 7 ==== mon_command_ack([{"prefix": "osd stat", "format": "json"}]=0 v77) ==== 74+0+133 (secure 0 0 0) 0x7feba00bd090 con 0x7feba81055d0 2024-09-12T02:34:08.652 INFO:teuthology.orchestra.run.smithi039.stdout: 2024-09-12T02:34:08.654 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:34:08.654+0000 7feba7e00640 1 -- 172.21.15.39:0/1364765916 >> [v2:172.21.15.39:6800/1725006999,v1:172.21.15.39:6801/1725006999] conn(0x7feb8c0a2c30 msgr2=0x7feb8c0a50f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:34:08.654 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:34:08.654+0000 7feba7e00640 1 --2- 172.21.15.39:0/1364765916 >> [v2:172.21.15.39:6800/1725006999,v1:172.21.15.39:6801/1725006999] conn(0x7feb8c0a2c30 0x7feb8c0a50f0 secure :-1 s=READY pgs=116 cs=0 l=1 rev1=1 crypto rx=0x7feb98009c90 tx=0x7feb98005f90 comp rx=0 tx=0).stop 2024-09-12T02:34:08.654 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:34:08.654+0000 7feba7e00640 1 -- 172.21.15.39:0/1364765916 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7feba81055d0 msgr2=0x7feba81a5850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:34:08.654 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:34:08.654+0000 7feba7e00640 1 --2- 172.21.15.39:0/1364765916 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7feba81055d0 0x7feba81a5850 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0x7feba0031ae0 tx=0x7feba0004ab0 comp rx=0 tx=0).stop 2024-09-12T02:34:08.654 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:34:08.654+0000 7feba7e00640 1 -- 172.21.15.39:0/1364765916 shutdown_connections 2024-09-12T02:34:08.654 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:34:08.654+0000 7feba7e00640 1 --2- 172.21.15.39:0/1364765916 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7feba81055d0 0x7feba81a5850 unknown :-1 s=CLOSED pgs=51 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:34:08.654 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:34:08.654+0000 7feba7e00640 1 --2- 172.21.15.39:0/1364765916 >> [v2:172.21.15.39:6800/1725006999,v1:172.21.15.39:6801/1725006999] conn(0x7feb8c0a2c30 0x7feb8c0a50f0 unknown :-1 s=CLOSED pgs=116 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:34:08.655 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:34:08.654+0000 7feba7e00640 1 --2- 172.21.15.39:0/1364765916 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7feba8102c20 0x7feba819e7d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:34:08.655 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:34:08.654+0000 7feba7e00640 1 --2- 172.21.15.39:0/1364765916 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7feba81002d0 0x7feba819e290 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:34:08.655 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:34:08.654+0000 7feba7e00640 1 -- 172.21.15.39:0/1364765916 >> 172.21.15.39:0/1364765916 conn(0x7feba80fc0e0 msgr2=0x7feba8100b90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:34:08.655 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:34:08.654+0000 7feba7e00640 1 -- 172.21.15.39:0/1364765916 shutdown_connections 2024-09-12T02:34:08.655 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:34:08.654+0000 7feba7e00640 1 -- 172.21.15.39:0/1364765916 wait complete. 2024-09-12T02:34:08.948 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 12 02:34:08 smithi044 ceph-mon[35411]: pgmap v256: 1 pgs: 1 active+clean; 577 KiB data, 316 MiB used, 983 GiB / 983 GiB avail 2024-09-12T02:34:08.949 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 12 02:34:08 smithi044 ceph-mon[35411]: Detected new or changed devices on smithi172 2024-09-12T02:34:08.949 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 12 02:34:08 smithi044 ceph-mon[35411]: Adjusting osd_memory_target on smithi172 to 4272M 2024-09-12T02:34:08.949 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 12 02:34:08 smithi044 ceph-mon[35411]: from='mgr.14150 172.21.15.39:0/408627207' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 11}]: dispatch 2024-09-12T02:34:08.949 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 12 02:34:08 smithi044 ceph-mon[35411]: from='mgr.14150 172.21.15.39:0/408627207' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 11}]: dispatch 2024-09-12T02:34:09.013 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 12 02:34:08 smithi172 ceph-mon[35609]: pgmap v256: 1 pgs: 1 active+clean; 577 KiB data, 316 MiB used, 983 GiB / 983 GiB avail 2024-09-12T02:34:09.014 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 12 02:34:08 smithi172 ceph-mon[35609]: Detected new or changed devices on smithi172 2024-09-12T02:34:09.014 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 12 02:34:08 smithi172 ceph-mon[35609]: Adjusting osd_memory_target on smithi172 to 4272M 2024-09-12T02:34:09.014 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 12 02:34:08 smithi172 ceph-mon[35609]: from='mgr.14150 172.21.15.39:0/408627207' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 11}]: dispatch 2024-09-12T02:34:09.014 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 12 02:34:08 smithi172 ceph-mon[35609]: from='mgr.14150 172.21.15.39:0/408627207' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 11}]: dispatch 2024-09-12T02:34:09.025 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 02:34:08 smithi039 ceph-mon[30515]: pgmap v256: 1 pgs: 1 active+clean; 577 KiB data, 316 MiB used, 983 GiB / 983 GiB avail 2024-09-12T02:34:09.026 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 02:34:08 smithi039 ceph-mon[30515]: Detected new or changed devices on smithi172 2024-09-12T02:34:09.026 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 02:34:08 smithi039 ceph-mon[30515]: Adjusting osd_memory_target on smithi172 to 4272M 2024-09-12T02:34:09.026 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 02:34:08 smithi039 ceph-mon[30515]: from='mgr.14150 172.21.15.39:0/408627207' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 11}]: dispatch 2024-09-12T02:34:09.026 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 02:34:08 smithi039 ceph-mon[30515]: from='mgr.14150 172.21.15.39:0/408627207' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 11}]: dispatch 2024-09-12T02:34:09.534 INFO:teuthology.orchestra.run.smithi039.stdout:{"epoch":77,"num_osds":12,"num_up_osds":12,"osd_up_since":1726108448,"num_in_osds":12,"osd_in_since":1726108425,"num_remapped_pgs":0} 2024-09-12T02:34:09.534 DEBUG:teuthology.orchestra.run.smithi039:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc shell --fsid 4954ed46-70ae-11ef-bcea-c7b262605968 -- ceph osd dump --format=json 2024-09-12T02:34:09.849 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 02:34:09 smithi039 ceph-mon[30515]: purged_snaps scrub starts 2024-09-12T02:34:09.850 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 02:34:09 smithi039 ceph-mon[30515]: purged_snaps scrub ok 2024-09-12T02:34:09.850 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 02:34:09 smithi039 ceph-mon[30515]: osd.11 [v2:172.21.15.172:6824/3627635035,v1:172.21.15.172:6825/3627635035] boot 2024-09-12T02:34:09.850 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 02:34:09 smithi039 ceph-mon[30515]: osdmap e77: 12 total, 12 up, 12 in 2024-09-12T02:34:09.850 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 02:34:09 smithi039 ceph-mon[30515]: from='mgr.14150 172.21.15.39:0/408627207' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 11}]: dispatch 2024-09-12T02:34:09.850 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 02:34:09 smithi039 ceph-mon[30515]: from='client.? 172.21.15.39:0/1364765916' entity='client.admin' cmd=[{"prefix": "osd stat", "format": "json"}]: dispatch 2024-09-12T02:34:09.910 INFO:teuthology.orchestra.run.smithi039.stderr:Inferring config /var/lib/ceph/4954ed46-70ae-11ef-bcea-c7b262605968/mon.a/config 2024-09-12T02:34:09.948 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 12 02:34:09 smithi044 ceph-mon[35411]: purged_snaps scrub starts 2024-09-12T02:34:09.948 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 12 02:34:09 smithi044 ceph-mon[35411]: purged_snaps scrub ok 2024-09-12T02:34:09.949 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 12 02:34:09 smithi044 ceph-mon[35411]: osd.11 [v2:172.21.15.172:6824/3627635035,v1:172.21.15.172:6825/3627635035] boot 2024-09-12T02:34:09.949 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 12 02:34:09 smithi044 ceph-mon[35411]: osdmap e77: 12 total, 12 up, 12 in 2024-09-12T02:34:09.949 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 12 02:34:09 smithi044 ceph-mon[35411]: from='mgr.14150 172.21.15.39:0/408627207' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 11}]: dispatch 2024-09-12T02:34:09.949 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 12 02:34:09 smithi044 ceph-mon[35411]: from='client.? 172.21.15.39:0/1364765916' entity='client.admin' cmd=[{"prefix": "osd stat", "format": "json"}]: dispatch 2024-09-12T02:34:10.017 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 12 02:34:09 smithi172 ceph-mon[35609]: purged_snaps scrub starts 2024-09-12T02:34:10.017 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 12 02:34:09 smithi172 ceph-mon[35609]: purged_snaps scrub ok 2024-09-12T02:34:10.017 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 12 02:34:09 smithi172 ceph-mon[35609]: osd.11 [v2:172.21.15.172:6824/3627635035,v1:172.21.15.172:6825/3627635035] boot 2024-09-12T02:34:10.017 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 12 02:34:09 smithi172 ceph-mon[35609]: osdmap e77: 12 total, 12 up, 12 in 2024-09-12T02:34:10.017 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 12 02:34:09 smithi172 ceph-mon[35609]: from='mgr.14150 172.21.15.39:0/408627207' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 11}]: dispatch 2024-09-12T02:34:10.018 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 12 02:34:09 smithi172 ceph-mon[35609]: from='client.? 172.21.15.39:0/1364765916' entity='client.admin' cmd=[{"prefix": "osd stat", "format": "json"}]: dispatch 2024-09-12T02:34:10.630 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:34:10.628+0000 7f9b8be00640 1 -- 172.21.15.39:0/416567007 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f9b84102790 msgr2=0x7f9b841067e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:34:10.630 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:34:10.628+0000 7f9b8be00640 1 --2- 172.21.15.39:0/416567007 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f9b84102790 0x7f9b841067e0 secure :-1 s=READY pgs=130 cs=0 l=1 rev1=1 crypto rx=0x7f9b70009900 tx=0x7f9b7002a410 comp rx=0 tx=0).stop 2024-09-12T02:34:10.630 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:34:10.628+0000 7f9b8be00640 1 -- 172.21.15.39:0/416567007 shutdown_connections 2024-09-12T02:34:10.630 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:34:10.628+0000 7f9b8be00640 1 --2- 172.21.15.39:0/416567007 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f9b84106f10 0x7f9b8410ea90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:34:10.630 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:34:10.628+0000 7f9b8be00640 1 --2- 172.21.15.39:0/416567007 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f9b84102790 0x7f9b841067e0 unknown :-1 s=CLOSED pgs=130 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:34:10.630 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:34:10.628+0000 7f9b8be00640 1 --2- 172.21.15.39:0/416567007 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f9b84101de0 0x7f9b841021c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:34:10.630 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:34:10.628+0000 7f9b8be00640 1 -- 172.21.15.39:0/416567007 >> 172.21.15.39:0/416567007 conn(0x7f9b840fd8c0 msgr2=0x7f9b840ffce0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:34:10.630 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:34:10.628+0000 7f9b8be00640 1 -- 172.21.15.39:0/416567007 shutdown_connections 2024-09-12T02:34:10.630 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:34:10.628+0000 7f9b8be00640 1 -- 172.21.15.39:0/416567007 wait complete. 2024-09-12T02:34:10.631 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:34:10.629+0000 7f9b8be00640 1 Processor -- start 2024-09-12T02:34:10.631 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:34:10.629+0000 7f9b8be00640 1 -- start start 2024-09-12T02:34:10.632 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:34:10.630+0000 7f9b8be00640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f9b84101de0 0x7f9b840744f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:34:10.632 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:34:10.630+0000 7f9b8be00640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f9b84102790 0x7f9b84074a30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:34:10.632 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:34:10.630+0000 7f9b8be00640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f9b84106f10 0x7f9b84074f70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:34:10.632 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:34:10.630+0000 7f9b8be00640 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 -- 0x7f9b84111f70 con 0x7f9b84106f10 2024-09-12T02:34:10.632 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:34:10.630+0000 7f9b8be00640 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x7f9b84111df0 con 0x7f9b84102790 2024-09-12T02:34:10.633 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:34:10.630+0000 7f9b8be00640 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7f9b841120f0 con 0x7f9b84101de0 2024-09-12T02:34:10.633 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:34:10.630+0000 7f9b89e00640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f9b84106f10 0x7f9b84074f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:34:10.633 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:34:10.630+0000 7f9b88a00640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f9b84102790 0x7f9b84074a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:34:10.633 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:34:10.630+0000 7f9b89e00640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f9b84106f10 0x7f9b84074f70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.39:3300/0 says I am v2:172.21.15.39:52946/0 (socket says 172.21.15.39:52946) 2024-09-12T02:34:10.633 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:34:10.630+0000 7f9b89e00640 1 -- 172.21.15.39:0/13794857 learned_addr learned my addr 172.21.15.39:0/13794857 (peer_addr_for_me v2:172.21.15.39:0/0) 2024-09-12T02:34:10.633 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:34:10.630+0000 7f9b89400640 1 --2- 172.21.15.39:0/13794857 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f9b84101de0 0x7f9b840744f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:34:10.633 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:34:10.630+0000 7f9b89e00640 1 -- 172.21.15.39:0/13794857 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f9b84101de0 msgr2=0x7f9b840744f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:34:10.633 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:34:10.630+0000 7f9b89e00640 1 --2- 172.21.15.39:0/13794857 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f9b84101de0 0x7f9b840744f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:34:10.633 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:34:10.630+0000 7f9b89e00640 1 -- 172.21.15.39:0/13794857 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f9b84102790 msgr2=0x7f9b84074a30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:34:10.633 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:34:10.630+0000 7f9b89e00640 1 --2- 172.21.15.39:0/13794857 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f9b84102790 0x7f9b84074a30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:34:10.633 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:34:10.630+0000 7f9b89e00640 1 -- 172.21.15.39:0/13794857 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9b841a6910 con 0x7f9b84106f10 2024-09-12T02:34:10.633 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:34:10.631+0000 7f9b89e00640 1 --2- 172.21.15.39:0/13794857 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f9b84106f10 0x7f9b84074f70 secure :-1 s=READY pgs=131 cs=0 l=1 rev1=1 crypto rx=0x7f9b7c00eaa0 tx=0x7f9b7c00ef60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:34:10.634 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:34:10.631+0000 7f9b82000640 1 -- 172.21.15.39:0/13794857 <== mon.0 v2:172.21.15.39:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9b7c00cdb0 con 0x7f9b84106f10 2024-09-12T02:34:10.634 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:34:10.631+0000 7f9b82000640 1 -- 172.21.15.39:0/13794857 <== mon.0 v2:172.21.15.39:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f9b7c005020 con 0x7f9b84106f10 2024-09-12T02:34:10.634 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:34:10.631+0000 7f9b82000640 1 -- 172.21.15.39:0/13794857 <== mon.0 v2:172.21.15.39:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9b7c0116b0 con 0x7f9b84106f10 2024-09-12T02:34:10.634 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:34:10.631+0000 7f9b8be00640 1 -- 172.21.15.39:0/13794857 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f9b841a6c00 con 0x7f9b84106f10 2024-09-12T02:34:10.634 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:34:10.631+0000 7f9b8be00640 1 -- 172.21.15.39:0/13794857 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f9b841a70c0 con 0x7f9b84106f10 2024-09-12T02:34:10.634 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:34:10.632+0000 7f9b8be00640 1 -- 172.21.15.39:0/13794857 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f9b841021c0 con 0x7f9b84106f10 2024-09-12T02:34:10.635 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:34:10.634+0000 7f9b82000640 1 -- 172.21.15.39:0/13794857 <== mon.0 v2:172.21.15.39:3300/0 4 ==== mgrmap(e 16) ==== 137833+0+0 (secure 0 0 0) 0x7f9b7c005560 con 0x7f9b84106f10 2024-09-12T02:34:10.636 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:34:10.636+0000 7f9b82000640 1 --2- 172.21.15.39:0/13794857 >> [v2:172.21.15.39:6800/1725006999,v1:172.21.15.39:6801/1725006999] conn(0x7f9b6c0a2c00 0x7f9b6c0a50c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:34:10.636 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:34:10.636+0000 7f9b82000640 1 -- 172.21.15.39:0/13794857 <== mon.0 v2:172.21.15.39:3300/0 5 ==== osd_map(78..78 src has 1..78) ==== 7127+0+0 (secure 0 0 0) 0x7f9b7c0cf060 con 0x7f9b84106f10 2024-09-12T02:34:10.637 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:34:10.636+0000 7f9b89400640 1 --2- 172.21.15.39:0/13794857 >> [v2:172.21.15.39:6800/1725006999,v1:172.21.15.39:6801/1725006999] conn(0x7f9b6c0a2c00 0x7f9b6c0a50c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:34:10.637 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:34:10.637+0000 7f9b89400640 1 --2- 172.21.15.39:0/13794857 >> [v2:172.21.15.39:6800/1725006999,v1:172.21.15.39:6801/1725006999] conn(0x7f9b6c0a2c00 0x7f9b6c0a50c0 secure :-1 s=READY pgs=119 cs=0 l=1 rev1=1 crypto rx=0x7f9b780095f0 tx=0x7f9b78005f90 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:34:10.639 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:34:10.638+0000 7f9b82000640 1 -- 172.21.15.39:0/13794857 <== mon.0 v2:172.21.15.39:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7f9b7c016030 con 0x7f9b84106f10 2024-09-12T02:34:10.827 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:34:10.826+0000 7f9b8be00640 1 -- 172.21.15.39:0/13794857 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f9b84075a20 con 0x7f9b84106f10 2024-09-12T02:34:10.828 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 02:34:10 smithi039 ceph-mon[30515]: pgmap v259: 1 pgs: 1 active+clean; 577 KiB data, 317 MiB used, 983 GiB / 983 GiB avail 2024-09-12T02:34:10.828 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 02:34:10 smithi039 ceph-mon[30515]: osdmap e78: 12 total, 12 up, 12 in 2024-09-12T02:34:10.828 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:34:10.827+0000 7f9b82000640 1 -- 172.21.15.39:0/13794857 <== mon.0 v2:172.21.15.39:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v78) ==== 74+0+18434 (secure 0 0 0) 0x7f9b84075a20 con 0x7f9b84106f10 2024-09-12T02:34:10.829 INFO:teuthology.orchestra.run.smithi039.stdout: 2024-09-12T02:34:10.829 INFO:teuthology.orchestra.run.smithi039.stdout:{"epoch":78,"fsid":"4954ed46-70ae-11ef-bcea-c7b262605968","created":"2024-09-12T02:26:43.086467+0000","modified":"2024-09-12T02:34:09.634648+0000","last_up_change":"2024-09-12T02:34:08.626341+0000","last_in_change":"2024-09-12T02:33:45.553591+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":26,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":1,"max_osd":12,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-12T02:30:09.347905+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":12,"score_stable":12,"optimal_score":0.25,"raw_score_acting":3,"raw_score_stable":3,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"c967b48e-8a39-4797-871b-8b1b83d9472f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6802","nonce":2437586899},{"type":"v1","addr":"172.21.15.39:6803","nonce":2437586899}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6804","nonce":2437586899},{"type":"v1","addr":"172.21.15.39:6805","nonce":2437586899}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6808","nonce":2437586899},{"type":"v1","addr":"172.21.15.39:6809","nonce":2437586899}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6806","nonce":2437586899},{"type":"v1","addr":"172.21.15.39:6807","nonce":2437586899}]},"public_addr":"172.21.15.39:6803/2437586899","cluster_addr":"172.21.15.39:6805/2437586899","heartbeat_back_addr":"172.21.15.39:6809/2437586899","heartbeat_front_addr":"172.21.15.39:6807/2437586899","state":["exists","up"]},{"osd":1,"uuid":"30e1e4f4-1d50-4003-8978-cb183dca7fbb","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":41,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6800","nonce":2349287000},{"type":"v1","addr":"172.21.15.44:6801","nonce":2349287000}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6802","nonce":2349287000},{"type":"v1","addr":"172.21.15.44:6803","nonce":2349287000}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6806","nonce":2349287000},{"type":"v1","addr":"172.21.15.44:6807","nonce":2349287000}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6804","nonce":2349287000},{"type":"v1","addr":"172.21.15.44:6805","nonce":2349287000}]},"public_addr":"172.21.15.44:6801/2349287000","cluster_addr":"172.21.15.44:6803/2349287000","heartbeat_back_addr":"172.21.15.44:6807/2349287000","heartbeat_front_addr":"172.21.15.44:6805/2349287000","state":["exists","up"]},{"osd":2,"uuid":"a758803f-8668-4fc8-9417-b8d080cd9a7c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":18,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6800","nonce":1176898232},{"type":"v1","addr":"172.21.15.172:6801","nonce":1176898232}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6802","nonce":1176898232},{"type":"v1","addr":"172.21.15.172:6803","nonce":1176898232}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6806","nonce":1176898232},{"type":"v1","addr":"172.21.15.172:6807","nonce":1176898232}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6804","nonce":1176898232},{"type":"v1","addr":"172.21.15.172:6805","nonce":1176898232}]},"public_addr":"172.21.15.172:6801/1176898232","cluster_addr":"172.21.15.172:6803/1176898232","heartbeat_back_addr":"172.21.15.172:6807/1176898232","heartbeat_front_addr":"172.21.15.172:6805/1176898232","state":["exists","up"]},{"osd":3,"uuid":"8b256567-7efe-429c-bc4c-80e93228f139","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":26,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6810","nonce":2013565859},{"type":"v1","addr":"172.21.15.39:6811","nonce":2013565859}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6812","nonce":2013565859},{"type":"v1","addr":"172.21.15.39:6813","nonce":2013565859}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6816","nonce":2013565859},{"type":"v1","addr":"172.21.15.39:6817","nonce":2013565859}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6814","nonce":2013565859},{"type":"v1","addr":"172.21.15.39:6815","nonce":2013565859}]},"public_addr":"172.21.15.39:6811/2013565859","cluster_addr":"172.21.15.39:6813/2013565859","heartbeat_back_addr":"172.21.15.39:6817/2013565859","heartbeat_front_addr":"172.21.15.39:6815/2013565859","state":["exists","up"]},{"osd":4,"uuid":"e86b6756-e2b3-49fe-9b87-1a2b015bb17a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":33,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6808","nonce":3663639110},{"type":"v1","addr":"172.21.15.44:6809","nonce":3663639110}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6810","nonce":3663639110},{"type":"v1","addr":"172.21.15.44:6811","nonce":3663639110}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6814","nonce":3663639110},{"type":"v1","addr":"172.21.15.44:6815","nonce":3663639110}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6812","nonce":3663639110},{"type":"v1","addr":"172.21.15.44:6813","nonce":3663639110}]},"public_addr":"172.21.15.44:6809/3663639110","cluster_addr":"172.21.15.44:6811/3663639110","heartbeat_back_addr":"172.21.15.44:6815/3663639110","heartbeat_front_addr":"172.21.15.44:6813/3663639110","state":["exists","up"]},{"osd":5,"uuid":"9c907c92-b323-48e7-99ad-ec9756d26312","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":38,"up_thru":52,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6808","nonce":998885347},{"type":"v1","addr":"172.21.15.172:6809","nonce":998885347}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6810","nonce":998885347},{"type":"v1","addr":"172.21.15.172:6811","nonce":998885347}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6814","nonce":998885347},{"type":"v1","addr":"172.21.15.172:6815","nonce":998885347}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6812","nonce":998885347},{"type":"v1","addr":"172.21.15.172:6813","nonce":998885347}]},"public_addr":"172.21.15.172:6809/998885347","cluster_addr":"172.21.15.172:6811/998885347","heartbeat_back_addr":"172.21.15.172:6815/998885347","heartbeat_front_addr":"172.21.15.172:6813/998885347","state":["exists","up"]},{"osd":6,"uuid":"1fcb9bb2-6f4b-4d97-a401-aeb6a9706613","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":45,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6818","nonce":2569059542},{"type":"v1","addr":"172.21.15.39:6819","nonce":2569059542}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6820","nonce":2569059542},{"type":"v1","addr":"172.21.15.39:6821","nonce":2569059542}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6824","nonce":2569059542},{"type":"v1","addr":"172.21.15.39:6825","nonce":2569059542}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6822","nonce":2569059542},{"type":"v1","addr":"172.21.15.39:6823","nonce":2569059542}]},"public_addr":"172.21.15.39:6819/2569059542","cluster_addr":"172.21.15.39:6821/2569059542","heartbeat_back_addr":"172.21.15.39:6825/2569059542","heartbeat_front_addr":"172.21.15.39:6823/2569059542","state":["exists","up"]},{"osd":7,"uuid":"59e0caf9-8ce5-4161-8875-84862eba743e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":50,"up_thru":73,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6816","nonce":709635079},{"type":"v1","addr":"172.21.15.44:6817","nonce":709635079}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6818","nonce":709635079},{"type":"v1","addr":"172.21.15.44:6819","nonce":709635079}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6822","nonce":709635079},{"type":"v1","addr":"172.21.15.44:6823","nonce":709635079}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6820","nonce":709635079},{"type":"v1","addr":"172.21.15.44:6821","nonce":709635079}]},"public_addr":"172.21.15.44:6817/709635079","cluster_addr":"172.21.15.44:6819/709635079","heartbeat_back_addr":"172.21.15.44:6823/709635079","heartbeat_front_addr":"172.21.15.44:6821/709635079","state":["exists","up"]},{"osd":8,"uuid":"2f6fb5c7-86cc-43eb-bdfb-45a69316937e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":57,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6816","nonce":1162792895},{"type":"v1","addr":"172.21.15.172:6817","nonce":1162792895}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6818","nonce":1162792895},{"type":"v1","addr":"172.21.15.172:6819","nonce":1162792895}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6822","nonce":1162792895},{"type":"v1","addr":"172.21.15.172:6823","nonce":1162792895}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6820","nonce":1162792895},{"type":"v1","addr":"172.21.15.172:6821","nonce":1162792895}]},"public_addr":"172.21.15.172:6817/1162792895","cluster_addr":"172.21.15.172:6819/1162792895","heartbeat_back_addr":"172.21.15.172:6823/1162792895","heartbeat_front_addr":"172.21.15.172:6821/1162792895","state":["exists","up"]},{"osd":9,"uuid":"87e5dd9e-8191-4db6-83fa-cfff7c31e17e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":65,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6826","nonce":945860346},{"type":"v1","addr":"172.21.15.39:6827","nonce":945860346}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6828","nonce":945860346},{"type":"v1","addr":"172.21.15.39:6829","nonce":945860346}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6832","nonce":945860346},{"type":"v1","addr":"172.21.15.39:6833","nonce":945860346}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6830","nonce":945860346},{"type":"v1","addr":"172.21.15.39:6831","nonce":945860346}]},"public_addr":"172.21.15.39:6827/945860346","cluster_addr":"172.21.15.39:6829/945860346","heartbeat_back_addr":"172.21.15.39:6833/945860346","heartbeat_front_addr":"172.21.15.39:6831/945860346","state":["exists","up"]},{"osd":10,"uuid":"b55d8a00-850f-4910-a5bf-97d9ed545be7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":70,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6824","nonce":3899352344},{"type":"v1","addr":"172.21.15.44:6825","nonce":3899352344}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6826","nonce":3899352344},{"type":"v1","addr":"172.21.15.44:6827","nonce":3899352344}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6830","nonce":3899352344},{"type":"v1","addr":"172.21.15.44:6831","nonce":3899352344}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6828","nonce":3899352344},{"type":"v1","addr":"172.21.15.44:6829","nonce":3899352344}]},"public_addr":"172.21.15.44:6825/3899352344","cluster_addr":"172.21.15.44:6827/3899352344","heartbeat_back_addr":"172.21.15.44:6831/3899352344","heartbeat_front_addr":"172.21.15.44:6829/3899352344","state":["exists","up"]},{"osd":11,"uuid":"20cf5df1-5a80-4272-acc0-919c6a1da55a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":77,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6824","nonce":3627635035},{"type":"v1","addr":"172.21.15.172:6825","nonce":3627635035}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6826","nonce":3627635035},{"type":"v1","addr":"172.21.15.172:6827","nonce":3627635035}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6830","nonce":3627635035},{"type":"v1","addr":"172.21.15.172:6831","nonce":3627635035}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6828","nonce":3627635035},{"type":"v1","addr":"172.21.15.172:6829","nonce":3627635035}]},"public_addr":"172.21.15.172:6825/3627635035","cluster_addr":"172.21.15.172:6827/3627635035","heartbeat_back_addr":"172.21.15.172:6831/3627635035","heartbeat_front_addr":"172.21.15.172:6829/3627635035","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T02:29:15.367468+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T02:29:41.518207+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T02:30:06.004371+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T02:30:34.793371+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T02:31:00.878517+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T02:31:26.675956+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T02:31:55.950748+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T02:32:22.824017+0000","dead_epoch":0},{"osd":8,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T02:32:46.775880+0000","dead_epoch":0},{"osd":9,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T02:33:16.420347+0000","dead_epoch":0},{"osd":10,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T02:33:42.185837+0000","dead_epoch":0},{"osd":11,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T02:34:07.312555+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.39:6800/3152613618":"2024-09-13T02:27:44.717224+0000","172.21.15.39:0/2301206766":"2024-09-13T02:27:44.717224+0000","172.21.15.39:0/1941318538":"2024-09-13T02:27:44.717224+0000","172.21.15.39:0/1527429435":"2024-09-13T02:27:44.717224+0000","172.21.15.39:0/2913347539":"2024-09-13T02:27:16.531986+0000","172.21.15.39:0/2827440002":"2024-09-13T02:27:16.531986+0000","172.21.15.39:0/4075322467":"2024-09-13T02:27:16.531986+0000","172.21.15.39:6801/1074685700":"2024-09-13T02:27:16.531986+0000","172.21.15.39:6801/3152613618":"2024-09-13T02:27:44.717224+0000","172.21.15.39:6800/1074685700":"2024-09-13T02:27:16.531986+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-12T02:34:10.831 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:34:10.830+0000 7f9b8be00640 1 -- 172.21.15.39:0/13794857 >> [v2:172.21.15.39:6800/1725006999,v1:172.21.15.39:6801/1725006999] conn(0x7f9b6c0a2c00 msgr2=0x7f9b6c0a50c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:34:10.831 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:34:10.830+0000 7f9b8be00640 1 --2- 172.21.15.39:0/13794857 >> [v2:172.21.15.39:6800/1725006999,v1:172.21.15.39:6801/1725006999] conn(0x7f9b6c0a2c00 0x7f9b6c0a50c0 secure :-1 s=READY pgs=119 cs=0 l=1 rev1=1 crypto rx=0x7f9b780095f0 tx=0x7f9b78005f90 comp rx=0 tx=0).stop 2024-09-12T02:34:10.831 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:34:10.830+0000 7f9b8be00640 1 -- 172.21.15.39:0/13794857 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f9b84106f10 msgr2=0x7f9b84074f70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:34:10.831 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:34:10.830+0000 7f9b8be00640 1 --2- 172.21.15.39:0/13794857 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f9b84106f10 0x7f9b84074f70 secure :-1 s=READY pgs=131 cs=0 l=1 rev1=1 crypto rx=0x7f9b7c00eaa0 tx=0x7f9b7c00ef60 comp rx=0 tx=0).stop 2024-09-12T02:34:10.831 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:34:10.830+0000 7f9b8be00640 1 -- 172.21.15.39:0/13794857 shutdown_connections 2024-09-12T02:34:10.831 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:34:10.830+0000 7f9b8be00640 1 --2- 172.21.15.39:0/13794857 >> [v2:172.21.15.39:6800/1725006999,v1:172.21.15.39:6801/1725006999] conn(0x7f9b6c0a2c00 0x7f9b6c0a50c0 unknown :-1 s=CLOSED pgs=119 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:34:10.832 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:34:10.830+0000 7f9b8be00640 1 --2- 172.21.15.39:0/13794857 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f9b84106f10 0x7f9b84074f70 unknown :-1 s=CLOSED pgs=131 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:34:10.832 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:34:10.830+0000 7f9b8be00640 1 --2- 172.21.15.39:0/13794857 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f9b84102790 0x7f9b84074a30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:34:10.832 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:34:10.830+0000 7f9b8be00640 1 --2- 172.21.15.39:0/13794857 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f9b84101de0 0x7f9b840744f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:34:10.832 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:34:10.830+0000 7f9b8be00640 1 -- 172.21.15.39:0/13794857 >> 172.21.15.39:0/13794857 conn(0x7f9b840fd8c0 msgr2=0x7f9b840fec00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:34:10.832 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:34:10.830+0000 7f9b8be00640 1 -- 172.21.15.39:0/13794857 shutdown_connections 2024-09-12T02:34:10.832 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:34:10.831+0000 7f9b8be00640 1 -- 172.21.15.39:0/13794857 wait complete. 2024-09-12T02:34:10.948 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 12 02:34:10 smithi044 ceph-mon[35411]: pgmap v259: 1 pgs: 1 active+clean; 577 KiB data, 317 MiB used, 983 GiB / 983 GiB avail 2024-09-12T02:34:10.948 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 12 02:34:10 smithi044 ceph-mon[35411]: osdmap e78: 12 total, 12 up, 12 in 2024-09-12T02:34:11.013 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 12 02:34:10 smithi172 ceph-mon[35609]: pgmap v259: 1 pgs: 1 active+clean; 577 KiB data, 317 MiB used, 983 GiB / 983 GiB avail 2024-09-12T02:34:11.013 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 12 02:34:10 smithi172 ceph-mon[35609]: osdmap e78: 12 total, 12 up, 12 in 2024-09-12T02:34:11.645 INFO:tasks.cephadm.ceph_manager.ceph:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-09-12T02:30:09.347905+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 3, 'min_size': 2, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'is_stretch_pool': False, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '22', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 12, 'score_stable': 12, 'optimal_score': 0.25, 'raw_score_acting': 3, 'raw_score_stable': 3, 'primary_affinity_weighted': 0.9999998807907104, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2024-09-12T02:34:11.645 DEBUG:teuthology.orchestra.run.smithi039:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc shell --fsid 4954ed46-70ae-11ef-bcea-c7b262605968 -- ceph osd pool get .mgr pg_num 2024-09-12T02:34:11.948 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 12 02:34:11 smithi044 ceph-mon[35411]: from='client.? 172.21.15.39:0/13794857' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-09-12T02:34:12.013 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 12 02:34:11 smithi172 ceph-mon[35609]: from='client.? 172.21.15.39:0/13794857' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-09-12T02:34:12.017 INFO:teuthology.orchestra.run.smithi039.stderr:Inferring config /var/lib/ceph/4954ed46-70ae-11ef-bcea-c7b262605968/mon.a/config 2024-09-12T02:34:12.099 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 02:34:11 smithi039 ceph-mon[30515]: from='client.? 172.21.15.39:0/13794857' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-09-12T02:34:12.584 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:34:12.563+0000 7feb09e00640 1 -- 172.21.15.39:0/3411549057 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7feb04076720 msgr2=0x7feb04076b00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:34:12.584 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:34:12.563+0000 7feb09e00640 1 --2- 172.21.15.39:0/3411549057 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7feb04076720 0x7feb04076b00 secure :-1 s=READY pgs=132 cs=0 l=1 rev1=1 crypto rx=0x7feaf4009900 tx=0x7feaf402a3f0 comp rx=0 tx=0).stop 2024-09-12T02:34:12.584 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:34:12.564+0000 7feb09e00640 1 -- 172.21.15.39:0/3411549057 shutdown_connections 2024-09-12T02:34:12.584 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:34:12.564+0000 7feb09e00640 1 --2- 172.21.15.39:0/3411549057 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7feb04112a30 0x7feb04114e20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:34:12.584 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:34:12.564+0000 7feb09e00640 1 --2- 172.21.15.39:0/3411549057 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7feb04077040 0x7feb041124f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:34:12.584 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:34:12.564+0000 7feb09e00640 1 --2- 172.21.15.39:0/3411549057 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7feb04076720 0x7feb04076b00 unknown :-1 s=CLOSED pgs=132 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:34:12.584 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:34:12.564+0000 7feb09e00640 1 -- 172.21.15.39:0/3411549057 >> 172.21.15.39:0/3411549057 conn(0x7feb040ffa90 msgr2=0x7feb04101eb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:34:12.584 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:34:12.564+0000 7feb09e00640 1 -- 172.21.15.39:0/3411549057 shutdown_connections 2024-09-12T02:34:12.584 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:34:12.564+0000 7feb09e00640 1 -- 172.21.15.39:0/3411549057 wait complete. 2024-09-12T02:34:12.585 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:34:12.565+0000 7feb09e00640 1 Processor -- start 2024-09-12T02:34:12.585 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:34:12.565+0000 7feb09e00640 1 -- start start 2024-09-12T02:34:12.585 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:34:12.566+0000 7feb09e00640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7feb04076720 0x7feb041a46f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:34:12.585 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:34:12.566+0000 7feb09e00640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7feb04077040 0x7feb041a4c30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:34:12.585 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:34:12.566+0000 7feb09e00640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7feb04112a30 0x7feb0419e8b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:34:12.585 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:34:12.566+0000 7feb09e00640 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 -- 0x7feb041185c0 con 0x7feb04112a30 2024-09-12T02:34:12.585 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:34:12.566+0000 7feb09e00640 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x7feb04118440 con 0x7feb04076720 2024-09-12T02:34:12.585 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:34:12.566+0000 7feb09e00640 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7feb04118740 con 0x7feb04077040 2024-09-12T02:34:12.585 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:34:12.566+0000 7feb02a00640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7feb04076720 0x7feb041a46f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:34:12.585 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:34:12.566+0000 7feb02a00640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7feb04076720 0x7feb041a46f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.39:49350/0 (socket says 172.21.15.39:49350) 2024-09-12T02:34:12.585 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:34:12.566+0000 7feb02a00640 1 -- 172.21.15.39:0/4070079781 learned_addr learned my addr 172.21.15.39:0/4070079781 (peer_addr_for_me v2:172.21.15.39:0/0) 2024-09-12T02:34:12.585 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:34:12.566+0000 7feb03400640 1 --2- 172.21.15.39:0/4070079781 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7feb04112a30 0x7feb0419e8b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:34:12.586 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:34:12.566+0000 7feafa000640 1 --2- 172.21.15.39:0/4070079781 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7feb04077040 0x7feb041a4c30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:34:12.586 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:34:12.566+0000 7feb02a00640 1 -- 172.21.15.39:0/4070079781 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7feb04077040 msgr2=0x7feb041a4c30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:34:12.586 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:34:12.566+0000 7feb02a00640 1 --2- 172.21.15.39:0/4070079781 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7feb04077040 0x7feb041a4c30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:34:12.586 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:34:12.566+0000 7feb02a00640 1 -- 172.21.15.39:0/4070079781 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7feb04112a30 msgr2=0x7feb0419e8b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:34:12.586 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:34:12.566+0000 7feb02a00640 1 --2- 172.21.15.39:0/4070079781 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7feb04112a30 0x7feb0419e8b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:34:12.586 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:34:12.566+0000 7feb02a00640 1 -- 172.21.15.39:0/4070079781 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7feb0419efe0 con 0x7feb04076720 2024-09-12T02:34:12.586 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:34:12.567+0000 7feb02a00640 1 --2- 172.21.15.39:0/4070079781 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7feb04076720 0x7feb041a46f0 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7feaf4006010 tx=0x7feaf40042f0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:34:12.586 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:34:12.567+0000 7feb08a00640 1 -- 172.21.15.39:0/4070079781 <== mon.2 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7feaf403f030 con 0x7feb04076720 2024-09-12T02:34:12.586 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:34:12.567+0000 7feb08a00640 1 -- 172.21.15.39:0/4070079781 <== mon.2 v2:172.21.15.44:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7feaf4003ce0 con 0x7feb04076720 2024-09-12T02:34:12.586 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:34:12.567+0000 7feb08a00640 1 -- 172.21.15.39:0/4070079781 <== mon.2 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7feaf4035070 con 0x7feb04076720 2024-09-12T02:34:12.586 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:34:12.567+0000 7feb09e00640 1 -- 172.21.15.39:0/4070079781 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7feb0419f270 con 0x7feb04076720 2024-09-12T02:34:12.586 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:34:12.567+0000 7feb09e00640 1 -- 172.21.15.39:0/4070079781 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7feb041ab5c0 con 0x7feb04076720 2024-09-12T02:34:12.586 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:34:12.568+0000 7feb09e00640 1 -- 172.21.15.39:0/4070079781 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7feb04076b00 con 0x7feb04076720 2024-09-12T02:34:12.586 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:34:12.570+0000 7feb08a00640 1 -- 172.21.15.39:0/4070079781 <== mon.2 v2:172.21.15.44:3300/0 4 ==== mgrmap(e 16) ==== 137833+0+0 (secure 0 0 0) 0x7feaf4042030 con 0x7feb04076720 2024-09-12T02:34:12.587 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:34:12.571+0000 7feb08a00640 1 --2- 172.21.15.39:0/4070079781 >> [v2:172.21.15.39:6800/1725006999,v1:172.21.15.39:6801/1725006999] conn(0x7feae80a2c00 0x7feae80a50c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:34:12.587 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:34:12.572+0000 7feb08a00640 1 -- 172.21.15.39:0/4070079781 <== mon.2 v2:172.21.15.44:3300/0 5 ==== osd_map(78..78 src has 1..78) ==== 7127+0+0 (secure 0 0 0) 0x7feaf40ef300 con 0x7feb04076720 2024-09-12T02:34:12.587 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:34:12.572+0000 7feafa000640 1 --2- 172.21.15.39:0/4070079781 >> [v2:172.21.15.39:6800/1725006999,v1:172.21.15.39:6801/1725006999] conn(0x7feae80a2c00 0x7feae80a50c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:34:12.587 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:34:12.572+0000 7feafa000640 1 --2- 172.21.15.39:0/4070079781 >> [v2:172.21.15.39:6800/1725006999,v1:172.21.15.39:6801/1725006999] conn(0x7feae80a2c00 0x7feae80a50c0 secure :-1 s=READY pgs=120 cs=0 l=1 rev1=1 crypto rx=0x7feb04079d60 tx=0x7feaec005f90 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:34:12.587 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:34:12.574+0000 7feb08a00640 1 -- 172.21.15.39:0/4070079781 <== mon.2 v2:172.21.15.44:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7feaf40bc0d0 con 0x7feb04076720 2024-09-12T02:34:12.759 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:34:12.758+0000 7feb09e00640 1 -- 172.21.15.39:0/4070079781 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) -- 0x7feb041ab790 con 0x7feb04076720 2024-09-12T02:34:12.760 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 02:34:12 smithi039 ceph-mon[30515]: pgmap v261: 1 pgs: 1 active+clean; 577 KiB data, 344 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-12T02:34:12.760 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:34:12.759+0000 7feb08a00640 1 -- 172.21.15.39:0/4070079781 <== mon.2 v2:172.21.15.44:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v78) ==== 93+0+10 (secure 0 0 0) 0x7feaf40c03d0 con 0x7feb04076720 2024-09-12T02:34:12.760 INFO:teuthology.orchestra.run.smithi039.stdout:pg_num: 1 2024-09-12T02:34:12.762 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:34:12.761+0000 7feb09e00640 1 -- 172.21.15.39:0/4070079781 >> [v2:172.21.15.39:6800/1725006999,v1:172.21.15.39:6801/1725006999] conn(0x7feae80a2c00 msgr2=0x7feae80a50c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:34:12.762 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:34:12.761+0000 7feb09e00640 1 --2- 172.21.15.39:0/4070079781 >> [v2:172.21.15.39:6800/1725006999,v1:172.21.15.39:6801/1725006999] conn(0x7feae80a2c00 0x7feae80a50c0 secure :-1 s=READY pgs=120 cs=0 l=1 rev1=1 crypto rx=0x7feb04079d60 tx=0x7feaec005f90 comp rx=0 tx=0).stop 2024-09-12T02:34:12.762 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:34:12.761+0000 7feb09e00640 1 -- 172.21.15.39:0/4070079781 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7feb04076720 msgr2=0x7feb041a46f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:34:12.763 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:34:12.761+0000 7feb09e00640 1 --2- 172.21.15.39:0/4070079781 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7feb04076720 0x7feb041a46f0 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7feaf4006010 tx=0x7feaf40042f0 comp rx=0 tx=0).stop 2024-09-12T02:34:12.763 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:34:12.761+0000 7feb09e00640 1 -- 172.21.15.39:0/4070079781 shutdown_connections 2024-09-12T02:34:12.763 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:34:12.761+0000 7feb09e00640 1 --2- 172.21.15.39:0/4070079781 >> [v2:172.21.15.39:6800/1725006999,v1:172.21.15.39:6801/1725006999] conn(0x7feae80a2c00 0x7feae80a50c0 unknown :-1 s=CLOSED pgs=120 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:34:12.763 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:34:12.761+0000 7feb09e00640 1 --2- 172.21.15.39:0/4070079781 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7feb04112a30 0x7feb0419e8b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:34:12.763 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:34:12.761+0000 7feb09e00640 1 --2- 172.21.15.39:0/4070079781 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7feb04077040 0x7feb041a4c30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:34:12.763 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:34:12.761+0000 7feb09e00640 1 --2- 172.21.15.39:0/4070079781 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7feb04076720 0x7feb041a46f0 unknown :-1 s=CLOSED pgs=61 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:34:12.763 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:34:12.761+0000 7feb09e00640 1 -- 172.21.15.39:0/4070079781 >> 172.21.15.39:0/4070079781 conn(0x7feb040ffa90 msgr2=0x7feb04101e80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:34:12.763 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:34:12.762+0000 7feb09e00640 1 -- 172.21.15.39:0/4070079781 shutdown_connections 2024-09-12T02:34:12.763 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:34:12.762+0000 7feb09e00640 1 -- 172.21.15.39:0/4070079781 wait complete. 2024-09-12T02:34:12.948 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 12 02:34:12 smithi044 ceph-mon[35411]: pgmap v261: 1 pgs: 1 active+clean; 577 KiB data, 344 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-12T02:34:13.013 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 12 02:34:12 smithi172 ceph-mon[35609]: pgmap v261: 1 pgs: 1 active+clean; 577 KiB data, 344 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-12T02:34:13.591 INFO:tasks.cephadm:Adding mds.a on smithi039 2024-09-12T02:34:13.591 INFO:tasks.cephadm:Adding mds.d on smithi039 2024-09-12T02:34:13.591 INFO:tasks.cephadm:Adding mds.g on smithi039 2024-09-12T02:34:13.592 INFO:tasks.cephadm:Adding mds.j on smithi039 2024-09-12T02:34:13.592 INFO:tasks.cephadm:Adding mds.b on smithi044 2024-09-12T02:34:13.592 INFO:tasks.cephadm:Adding mds.e on smithi044 2024-09-12T02:34:13.592 INFO:tasks.cephadm:Adding mds.h on smithi044 2024-09-12T02:34:13.592 INFO:tasks.cephadm:Adding mds.k on smithi044 2024-09-12T02:34:13.592 INFO:tasks.cephadm:Adding mds.c on smithi172 2024-09-12T02:34:13.592 INFO:tasks.cephadm:Adding mds.f on smithi172 2024-09-12T02:34:13.592 INFO:tasks.cephadm:Adding mds.i on smithi172 2024-09-12T02:34:13.592 INFO:tasks.cephadm:Adding mds.l on smithi172 2024-09-12T02:34:13.592 DEBUG:teuthology.orchestra.run.smithi172:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 4954ed46-70ae-11ef-bcea-c7b262605968 -- ceph orch apply mds all '12;smithi039=a;smithi039=d;smithi039=g;smithi039=j;smithi044=b;smithi044=e;smithi044=h;smithi044=k;smithi172=c;smithi172=f;smithi172=i;smithi172=l' 2024-09-12T02:34:13.849 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 02:34:13 smithi039 ceph-mon[30515]: from='client.? 172.21.15.39:0/4070079781' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]: dispatch 2024-09-12T02:34:13.853 INFO:teuthology.orchestra.run.smithi172.stderr:Inferring config /var/lib/ceph/4954ed46-70ae-11ef-bcea-c7b262605968/mon.c/config 2024-09-12T02:34:13.948 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 12 02:34:13 smithi044 ceph-mon[35411]: from='client.? 172.21.15.39:0/4070079781' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]: dispatch 2024-09-12T02:34:13.974 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 12 02:34:13 smithi172 ceph-mon[35609]: from='client.? 172.21.15.39:0/4070079781' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]: dispatch 2024-09-12T02:34:14.347 INFO:teuthology.orchestra.run.smithi172.stderr:2024-09-12T02:34:14.339+0000 7f064d313640 1 -- 172.21.15.172:0/1318053025 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f06481026e0 msgr2=0x7f0648104ad0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:34:14.347 INFO:teuthology.orchestra.run.smithi172.stderr:2024-09-12T02:34:14.339+0000 7f064d313640 1 --2- 172.21.15.172:0/1318053025 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f06481026e0 0x7f0648104ad0 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7f0638009900 tx=0x7f063802a410 comp rx=0 tx=0).stop 2024-09-12T02:34:14.347 INFO:teuthology.orchestra.run.smithi172.stderr:2024-09-12T02:34:14.339+0000 7f064d313640 1 -- 172.21.15.172:0/1318053025 shutdown_connections 2024-09-12T02:34:14.348 INFO:teuthology.orchestra.run.smithi172.stderr:2024-09-12T02:34:14.339+0000 7f064d313640 1 --2- 172.21.15.172:0/1318053025 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f0648107940 0x7f0648109d30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:34:14.348 INFO:teuthology.orchestra.run.smithi172.stderr:2024-09-12T02:34:14.339+0000 7f064d313640 1 --2- 172.21.15.172:0/1318053025 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f0648105010 0x7f0648107400 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:34:14.348 INFO:teuthology.orchestra.run.smithi172.stderr:2024-09-12T02:34:14.339+0000 7f064d313640 1 --2- 172.21.15.172:0/1318053025 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f06481026e0 0x7f0648104ad0 unknown :-1 s=CLOSED pgs=52 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:34:14.348 INFO:teuthology.orchestra.run.smithi172.stderr:2024-09-12T02:34:14.339+0000 7f064d313640 1 -- 172.21.15.172:0/1318053025 >> 172.21.15.172:0/1318053025 conn(0x7f06480fc280 msgr2=0x7f06480fe6a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:34:14.348 INFO:teuthology.orchestra.run.smithi172.stderr:2024-09-12T02:34:14.339+0000 7f064d313640 1 -- 172.21.15.172:0/1318053025 shutdown_connections 2024-09-12T02:34:14.348 INFO:teuthology.orchestra.run.smithi172.stderr:2024-09-12T02:34:14.339+0000 7f064d313640 1 -- 172.21.15.172:0/1318053025 wait complete. 2024-09-12T02:34:14.348 INFO:teuthology.orchestra.run.smithi172.stderr:2024-09-12T02:34:14.340+0000 7f064d313640 1 Processor -- start 2024-09-12T02:34:14.348 INFO:teuthology.orchestra.run.smithi172.stderr:2024-09-12T02:34:14.340+0000 7f064d313640 1 -- start start 2024-09-12T02:34:14.348 INFO:teuthology.orchestra.run.smithi172.stderr:2024-09-12T02:34:14.340+0000 7f064d313640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f06481026e0 0x7f0648197f00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:34:14.348 INFO:teuthology.orchestra.run.smithi172.stderr:2024-09-12T02:34:14.340+0000 7f064d313640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f0648105010 0x7f0648198440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:34:14.348 INFO:teuthology.orchestra.run.smithi172.stderr:2024-09-12T02:34:14.340+0000 7f064d313640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f0648107940 0x7f064819f4c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:34:14.348 INFO:teuthology.orchestra.run.smithi172.stderr:2024-09-12T02:34:14.340+0000 7f064d313640 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 -- 0x7f064810d880 con 0x7f06481026e0 2024-09-12T02:34:14.349 INFO:teuthology.orchestra.run.smithi172.stderr:2024-09-12T02:34:14.340+0000 7f064d313640 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x7f064810d700 con 0x7f0648107940 2024-09-12T02:34:14.349 INFO:teuthology.orchestra.run.smithi172.stderr:2024-09-12T02:34:14.340+0000 7f064d313640 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7f064810da00 con 0x7f0648105010 2024-09-12T02:34:14.349 INFO:teuthology.orchestra.run.smithi172.stderr:2024-09-12T02:34:14.340+0000 7f06467fc640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f0648105010 0x7f0648198440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:34:14.349 INFO:teuthology.orchestra.run.smithi172.stderr:2024-09-12T02:34:14.340+0000 7f06467fc640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f0648105010 0x7f0648198440 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.172:3300/0 says I am v2:172.21.15.172:40382/0 (socket says 172.21.15.172:40382) 2024-09-12T02:34:14.349 INFO:teuthology.orchestra.run.smithi172.stderr:2024-09-12T02:34:14.340+0000 7f06467fc640 1 -- 172.21.15.172:0/2917243194 learned_addr learned my addr 172.21.15.172:0/2917243194 (peer_addr_for_me v2:172.21.15.172:0/0) 2024-09-12T02:34:14.349 INFO:teuthology.orchestra.run.smithi172.stderr:2024-09-12T02:34:14.340+0000 7f0646ffd640 1 --2- 172.21.15.172:0/2917243194 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f06481026e0 0x7f0648197f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:34:14.349 INFO:teuthology.orchestra.run.smithi172.stderr:2024-09-12T02:34:14.341+0000 7f06477fe640 1 --2- 172.21.15.172:0/2917243194 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f0648107940 0x7f064819f4c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:34:14.349 INFO:teuthology.orchestra.run.smithi172.stderr:2024-09-12T02:34:14.341+0000 7f06467fc640 1 -- 172.21.15.172:0/2917243194 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f0648107940 msgr2=0x7f064819f4c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:34:14.349 INFO:teuthology.orchestra.run.smithi172.stderr:2024-09-12T02:34:14.341+0000 7f06467fc640 1 --2- 172.21.15.172:0/2917243194 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f0648107940 0x7f064819f4c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:34:14.349 INFO:teuthology.orchestra.run.smithi172.stderr:2024-09-12T02:34:14.341+0000 7f06467fc640 1 -- 172.21.15.172:0/2917243194 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f06481026e0 msgr2=0x7f0648197f00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:34:14.349 INFO:teuthology.orchestra.run.smithi172.stderr:2024-09-12T02:34:14.341+0000 7f06467fc640 1 --2- 172.21.15.172:0/2917243194 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f06481026e0 0x7f0648197f00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:34:14.349 INFO:teuthology.orchestra.run.smithi172.stderr:2024-09-12T02:34:14.341+0000 7f06467fc640 1 -- 172.21.15.172:0/2917243194 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f064819fb30 con 0x7f0648105010 2024-09-12T02:34:14.349 INFO:teuthology.orchestra.run.smithi172.stderr:2024-09-12T02:34:14.341+0000 7f06467fc640 1 --2- 172.21.15.172:0/2917243194 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f0648105010 0x7f0648198440 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7f063c00c970 tx=0x7f063c00ce30 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:34:14.350 INFO:teuthology.orchestra.run.smithi172.stderr:2024-09-12T02:34:14.341+0000 7f062ffff640 1 -- 172.21.15.172:0/2917243194 <== mon.1 v2:172.21.15.172:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f063c007bb0 con 0x7f0648105010 2024-09-12T02:34:14.350 INFO:teuthology.orchestra.run.smithi172.stderr:2024-09-12T02:34:14.341+0000 7f064d313640 1 -- 172.21.15.172:0/2917243194 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f064819fe20 con 0x7f0648105010 2024-09-12T02:34:14.350 INFO:teuthology.orchestra.run.smithi172.stderr:2024-09-12T02:34:14.341+0000 7f062ffff640 1 -- 172.21.15.172:0/2917243194 <== mon.1 v2:172.21.15.172:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f063c007d50 con 0x7f0648105010 2024-09-12T02:34:14.350 INFO:teuthology.orchestra.run.smithi172.stderr:2024-09-12T02:34:14.341+0000 7f062ffff640 1 -- 172.21.15.172:0/2917243194 <== mon.1 v2:172.21.15.172:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f063c0187a0 con 0x7f0648105010 2024-09-12T02:34:14.350 INFO:teuthology.orchestra.run.smithi172.stderr:2024-09-12T02:34:14.341+0000 7f064d313640 1 -- 172.21.15.172:0/2917243194 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f06481a0280 con 0x7f0648105010 2024-09-12T02:34:14.350 INFO:teuthology.orchestra.run.smithi172.stderr:2024-09-12T02:34:14.342+0000 7f064d313640 1 -- 172.21.15.172:0/2917243194 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f06480fdd70 con 0x7f0648105010 2024-09-12T02:34:14.350 INFO:teuthology.orchestra.run.smithi172.stderr:2024-09-12T02:34:14.343+0000 7f062ffff640 1 -- 172.21.15.172:0/2917243194 <== mon.1 v2:172.21.15.172:3300/0 4 ==== mgrmap(e 16) ==== 137833+0+0 (secure 0 0 0) 0x7f063c00f450 con 0x7f0648105010 2024-09-12T02:34:14.350 INFO:teuthology.orchestra.run.smithi172.stderr:2024-09-12T02:34:14.344+0000 7f062ffff640 1 --2- 172.21.15.172:0/2917243194 >> [v2:172.21.15.39:6800/1725006999,v1:172.21.15.39:6801/1725006999] conn(0x7f06300a2bb0 0x7f06300a5070 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:34:14.353 INFO:teuthology.orchestra.run.smithi172.stderr:2024-09-12T02:34:14.344+0000 7f062ffff640 1 -- 172.21.15.172:0/2917243194 <== mon.1 v2:172.21.15.172:3300/0 5 ==== osd_map(78..78 src has 1..78) ==== 7127+0+0 (secure 0 0 0) 0x7f063c0cec30 con 0x7f0648105010 2024-09-12T02:34:14.353 INFO:teuthology.orchestra.run.smithi172.stderr:2024-09-12T02:34:14.345+0000 7f0646ffd640 1 --2- 172.21.15.172:0/2917243194 >> [v2:172.21.15.39:6800/1725006999,v1:172.21.15.39:6801/1725006999] conn(0x7f06300a2bb0 0x7f06300a5070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:34:14.353 INFO:teuthology.orchestra.run.smithi172.stderr:2024-09-12T02:34:14.345+0000 7f0646ffd640 1 --2- 172.21.15.172:0/2917243194 >> [v2:172.21.15.39:6800/1725006999,v1:172.21.15.39:6801/1725006999] conn(0x7f06300a2bb0 0x7f06300a5070 secure :-1 s=READY pgs=121 cs=0 l=1 rev1=1 crypto rx=0x7f06380314e0 tx=0x7f0638000bc0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:34:14.354 INFO:teuthology.orchestra.run.smithi172.stderr:2024-09-12T02:34:14.348+0000 7f062ffff640 1 -- 172.21.15.172:0/2917243194 <== mon.1 v2:172.21.15.172:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7f063c014030 con 0x7f0648105010 2024-09-12T02:34:14.530 INFO:teuthology.orchestra.run.smithi172.stderr:2024-09-12T02:34:14.528+0000 7f064d313640 1 -- 172.21.15.172:0/2917243194 --> [v2:172.21.15.39:6800/1725006999,v1:172.21.15.39:6801/1725006999] -- mgr_command(tid 0: {"prefix": "orch apply mds", "fs_name": "all", "placement": "12;smithi039=a;smithi039=d;smithi039=g;smithi039=j;smithi044=b;smithi044=e;smithi044=h;smithi044=k;smithi172=c;smithi172=f;smithi172=i;smithi172=l", "target": ["mon-mgr", ""]}) -- 0x7f0648062830 con 0x7f06300a2bb0 2024-09-12T02:34:14.539 INFO:teuthology.orchestra.run.smithi172.stderr:2024-09-12T02:34:14.537+0000 7f062ffff640 1 -- 172.21.15.172:0/2917243194 <== mgr.14150 v2:172.21.15.39:6800/1725006999 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+28 (secure 0 0 0) 0x7f0648062830 con 0x7f06300a2bb0 2024-09-12T02:34:14.539 INFO:teuthology.orchestra.run.smithi172.stdout:Scheduled mds.all update... 2024-09-12T02:34:14.541 INFO:teuthology.orchestra.run.smithi172.stderr:2024-09-12T02:34:14.540+0000 7f064d313640 1 -- 172.21.15.172:0/2917243194 >> [v2:172.21.15.39:6800/1725006999,v1:172.21.15.39:6801/1725006999] conn(0x7f06300a2bb0 msgr2=0x7f06300a5070 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:34:14.541 INFO:teuthology.orchestra.run.smithi172.stderr:2024-09-12T02:34:14.540+0000 7f064d313640 1 --2- 172.21.15.172:0/2917243194 >> [v2:172.21.15.39:6800/1725006999,v1:172.21.15.39:6801/1725006999] conn(0x7f06300a2bb0 0x7f06300a5070 secure :-1 s=READY pgs=121 cs=0 l=1 rev1=1 crypto rx=0x7f06380314e0 tx=0x7f0638000bc0 comp rx=0 tx=0).stop 2024-09-12T02:34:14.542 INFO:teuthology.orchestra.run.smithi172.stderr:2024-09-12T02:34:14.540+0000 7f064d313640 1 -- 172.21.15.172:0/2917243194 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f0648105010 msgr2=0x7f0648198440 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:34:14.542 INFO:teuthology.orchestra.run.smithi172.stderr:2024-09-12T02:34:14.540+0000 7f064d313640 1 --2- 172.21.15.172:0/2917243194 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f0648105010 0x7f0648198440 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7f063c00c970 tx=0x7f063c00ce30 comp rx=0 tx=0).stop 2024-09-12T02:34:14.542 INFO:teuthology.orchestra.run.smithi172.stderr:2024-09-12T02:34:14.540+0000 7f064d313640 1 -- 172.21.15.172:0/2917243194 shutdown_connections 2024-09-12T02:34:14.542 INFO:teuthology.orchestra.run.smithi172.stderr:2024-09-12T02:34:14.540+0000 7f064d313640 1 --2- 172.21.15.172:0/2917243194 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f0648107940 0x7f064819f4c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:34:14.542 INFO:teuthology.orchestra.run.smithi172.stderr:2024-09-12T02:34:14.540+0000 7f064d313640 1 --2- 172.21.15.172:0/2917243194 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f0648105010 0x7f0648198440 unknown :-1 s=CLOSED pgs=53 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:34:14.542 INFO:teuthology.orchestra.run.smithi172.stderr:2024-09-12T02:34:14.540+0000 7f064d313640 1 --2- 172.21.15.172:0/2917243194 >> [v2:172.21.15.39:6800/1725006999,v1:172.21.15.39:6801/1725006999] conn(0x7f06300a2bb0 0x7f06300a5070 unknown :-1 s=CLOSED pgs=121 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:34:14.542 INFO:teuthology.orchestra.run.smithi172.stderr:2024-09-12T02:34:14.540+0000 7f064d313640 1 --2- 172.21.15.172:0/2917243194 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f06481026e0 0x7f0648197f00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:34:14.542 INFO:teuthology.orchestra.run.smithi172.stderr:2024-09-12T02:34:14.540+0000 7f064d313640 1 -- 172.21.15.172:0/2917243194 >> 172.21.15.172:0/2917243194 conn(0x7f06480fc280 msgr2=0x7f0648103140 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:34:14.542 INFO:teuthology.orchestra.run.smithi172.stderr:2024-09-12T02:34:14.540+0000 7f064d313640 1 -- 172.21.15.172:0/2917243194 shutdown_connections 2024-09-12T02:34:14.542 INFO:teuthology.orchestra.run.smithi172.stderr:2024-09-12T02:34:14.540+0000 7f064d313640 1 -- 172.21.15.172:0/2917243194 wait complete. 2024-09-12T02:34:14.858 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 12 02:34:14 smithi172 ceph-mon[35609]: pgmap v262: 1 pgs: 1 active+clean; 577 KiB data, 344 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-12T02:34:14.858 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 12 02:34:14 smithi172 ceph-mon[35609]: from='mgr.14150 172.21.15.39:0/408627207' entity='mgr.x' 2024-09-12T02:34:14.858 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 12 02:34:14 smithi172 ceph-mon[35609]: from='mgr.14150 172.21.15.39:0/408627207' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-12T02:34:14.948 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 12 02:34:14 smithi044 ceph-mon[35411]: pgmap v262: 1 pgs: 1 active+clean; 577 KiB data, 344 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-12T02:34:14.948 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 12 02:34:14 smithi044 ceph-mon[35411]: from='mgr.14150 172.21.15.39:0/408627207' entity='mgr.x' 2024-09-12T02:34:14.948 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 12 02:34:14 smithi044 ceph-mon[35411]: from='mgr.14150 172.21.15.39:0/408627207' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-12T02:34:15.100 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 02:34:14 smithi039 ceph-mon[30515]: pgmap v262: 1 pgs: 1 active+clean; 577 KiB data, 344 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-12T02:34:15.100 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 02:34:14 smithi039 ceph-mon[30515]: from='mgr.14150 172.21.15.39:0/408627207' entity='mgr.x' 2024-09-12T02:34:15.100 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 02:34:14 smithi039 ceph-mon[30515]: from='mgr.14150 172.21.15.39:0/408627207' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-12T02:34:15.205 DEBUG:teuthology.orchestra.run.smithi039:mds.a> sudo journalctl -f -n 0 -u ceph-4954ed46-70ae-11ef-bcea-c7b262605968@mds.a.service 2024-09-12T02:34:15.210 DEBUG:teuthology.orchestra.run.smithi039:mds.d> sudo journalctl -f -n 0 -u ceph-4954ed46-70ae-11ef-bcea-c7b262605968@mds.d.service 2024-09-12T02:34:15.255 DEBUG:teuthology.orchestra.run.smithi039:mds.g> sudo journalctl -f -n 0 -u ceph-4954ed46-70ae-11ef-bcea-c7b262605968@mds.g.service 2024-09-12T02:34:15.300 DEBUG:teuthology.orchestra.run.smithi039:mds.j> sudo journalctl -f -n 0 -u ceph-4954ed46-70ae-11ef-bcea-c7b262605968@mds.j.service 2024-09-12T02:34:15.345 DEBUG:teuthology.orchestra.run.smithi044:mds.b> sudo journalctl -f -n 0 -u ceph-4954ed46-70ae-11ef-bcea-c7b262605968@mds.b.service 2024-09-12T02:34:15.348 DEBUG:teuthology.orchestra.run.smithi044:mds.e> sudo journalctl -f -n 0 -u ceph-4954ed46-70ae-11ef-bcea-c7b262605968@mds.e.service 2024-09-12T02:34:15.392 DEBUG:teuthology.orchestra.run.smithi044:mds.h> sudo journalctl -f -n 0 -u ceph-4954ed46-70ae-11ef-bcea-c7b262605968@mds.h.service 2024-09-12T02:34:15.435 DEBUG:teuthology.orchestra.run.smithi044:mds.k> sudo journalctl -f -n 0 -u ceph-4954ed46-70ae-11ef-bcea-c7b262605968@mds.k.service 2024-09-12T02:34:15.477 DEBUG:teuthology.orchestra.run.smithi172:mds.c> sudo journalctl -f -n 0 -u ceph-4954ed46-70ae-11ef-bcea-c7b262605968@mds.c.service 2024-09-12T02:34:15.480 DEBUG:teuthology.orchestra.run.smithi172:mds.f> sudo journalctl -f -n 0 -u ceph-4954ed46-70ae-11ef-bcea-c7b262605968@mds.f.service 2024-09-12T02:34:15.523 DEBUG:teuthology.orchestra.run.smithi172:mds.i> sudo journalctl -f -n 0 -u ceph-4954ed46-70ae-11ef-bcea-c7b262605968@mds.i.service 2024-09-12T02:34:15.566 DEBUG:teuthology.orchestra.run.smithi172:mds.l> sudo journalctl -f -n 0 -u ceph-4954ed46-70ae-11ef-bcea-c7b262605968@mds.l.service 2024-09-12T02:34:15.609 INFO:tasks.cephadm:Setting up CephFS filesystem(s)... 2024-09-12T02:34:15.610 DEBUG:teuthology.orchestra.run.smithi039:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc shell --fsid 4954ed46-70ae-11ef-bcea-c7b262605968 -- ceph fs dump --format=json 2024-09-12T02:34:15.763 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 12 02:34:15 smithi172 ceph-mon[35609]: from='client.24418 -' entity='client.admin' cmd=[{"prefix": "orch apply mds", "fs_name": "all", "placement": "12;smithi039=a;smithi039=d;smithi039=g;smithi039=j;smithi044=b;smithi044=e;smithi044=h;smithi044=k;smithi172=c;smithi172=f;smithi172=i;smithi172=l", "target": ["mon-mgr", ""]}]: dispatch 2024-09-12T02:34:15.764 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 12 02:34:15 smithi172 ceph-mon[35609]: Saving service mds.all spec with placement smithi039=a;smithi039=d;smithi039=g;smithi039=j;smithi044=b;smithi044=e;smithi044=h;smithi044=k;smithi172=c;smithi172=f;smithi172=i;smithi172=l;count:12 2024-09-12T02:34:15.764 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 12 02:34:15 smithi172 ceph-mon[35609]: from='mgr.14150 172.21.15.39:0/408627207' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-12T02:34:15.764 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 12 02:34:15 smithi172 ceph-mon[35609]: from='mgr.14150 172.21.15.39:0/408627207' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-12T02:34:15.764 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 12 02:34:15 smithi172 ceph-mon[35609]: from='mgr.14150 172.21.15.39:0/408627207' entity='mgr.x' 2024-09-12T02:34:15.764 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 12 02:34:15 smithi172 ceph-mon[35609]: from='mgr.14150 172.21.15.39:0/408627207' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.l", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-09-12T02:34:15.764 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 12 02:34:15 smithi172 ceph-mon[35609]: from='mgr.14150 172.21.15.39:0/408627207' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.l", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-09-12T02:34:15.764 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 12 02:34:15 smithi172 ceph-mon[35609]: from='mgr.14150 172.21.15.39:0/408627207' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-12T02:34:15.948 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 12 02:34:15 smithi044 ceph-mon[35411]: from='client.24418 -' entity='client.admin' cmd=[{"prefix": "orch apply mds", "fs_name": "all", "placement": "12;smithi039=a;smithi039=d;smithi039=g;smithi039=j;smithi044=b;smithi044=e;smithi044=h;smithi044=k;smithi172=c;smithi172=f;smithi172=i;smithi172=l", "target": ["mon-mgr", ""]}]: dispatch 2024-09-12T02:34:15.949 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 12 02:34:15 smithi044 ceph-mon[35411]: Saving service mds.all spec with placement smithi039=a;smithi039=d;smithi039=g;smithi039=j;smithi044=b;smithi044=e;smithi044=h;smithi044=k;smithi172=c;smithi172=f;smithi172=i;smithi172=l;count:12 2024-09-12T02:34:15.949 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 12 02:34:15 smithi044 ceph-mon[35411]: from='mgr.14150 172.21.15.39:0/408627207' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-12T02:34:15.949 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 12 02:34:15 smithi044 ceph-mon[35411]: from='mgr.14150 172.21.15.39:0/408627207' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-12T02:34:15.949 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 12 02:34:15 smithi044 ceph-mon[35411]: from='mgr.14150 172.21.15.39:0/408627207' entity='mgr.x' 2024-09-12T02:34:15.949 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 12 02:34:15 smithi044 ceph-mon[35411]: from='mgr.14150 172.21.15.39:0/408627207' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.l", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-09-12T02:34:15.949 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 12 02:34:15 smithi044 ceph-mon[35411]: from='mgr.14150 172.21.15.39:0/408627207' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.l", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-09-12T02:34:15.949 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 12 02:34:15 smithi044 ceph-mon[35411]: from='mgr.14150 172.21.15.39:0/408627207' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-12T02:34:15.983 INFO:teuthology.orchestra.run.smithi039.stderr:Inferring config /var/lib/ceph/4954ed46-70ae-11ef-bcea-c7b262605968/mon.a/config 2024-09-12T02:34:16.028 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 02:34:15 smithi039 ceph-mon[30515]: from='client.24418 -' entity='client.admin' cmd=[{"prefix": "orch apply mds", "fs_name": "all", "placement": "12;smithi039=a;smithi039=d;smithi039=g;smithi039=j;smithi044=b;smithi044=e;smithi044=h;smithi044=k;smithi172=c;smithi172=f;smithi172=i;smithi172=l", "target": ["mon-mgr", ""]}]: dispatch 2024-09-12T02:34:16.028 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 02:34:15 smithi039 ceph-mon[30515]: Saving service mds.all spec with placement smithi039=a;smithi039=d;smithi039=g;smithi039=j;smithi044=b;smithi044=e;smithi044=h;smithi044=k;smithi172=c;smithi172=f;smithi172=i;smithi172=l;count:12 2024-09-12T02:34:16.028 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 02:34:15 smithi039 ceph-mon[30515]: from='mgr.14150 172.21.15.39:0/408627207' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-12T02:34:16.028 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 02:34:15 smithi039 ceph-mon[30515]: from='mgr.14150 172.21.15.39:0/408627207' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-12T02:34:16.028 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 02:34:15 smithi039 ceph-mon[30515]: from='mgr.14150 172.21.15.39:0/408627207' entity='mgr.x' 2024-09-12T02:34:16.028 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 02:34:15 smithi039 ceph-mon[30515]: from='mgr.14150 172.21.15.39:0/408627207' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.l", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-09-12T02:34:16.029 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 02:34:15 smithi039 ceph-mon[30515]: from='mgr.14150 172.21.15.39:0/408627207' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.l", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-09-12T02:34:16.029 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 02:34:15 smithi039 ceph-mon[30515]: from='mgr.14150 172.21.15.39:0/408627207' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-12T02:34:16.605 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:34:16.604+0000 7f92cbe00640 1 -- 172.21.15.39:0/2311125325 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f92cc103e30 msgr2=0x7f92cc104210 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:34:16.606 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:34:16.604+0000 7f92cbe00640 1 --2- 172.21.15.39:0/2311125325 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f92cc103e30 0x7f92cc104210 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7f92bc009860 tx=0x7f92bc02a340 comp rx=0 tx=0).stop 2024-09-12T02:34:16.606 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:34:16.604+0000 7f92cbe00640 1 -- 172.21.15.39:0/2311125325 shutdown_connections 2024-09-12T02:34:16.606 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:34:16.604+0000 7f92cbe00640 1 --2- 172.21.15.39:0/2311125325 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f92cc108f60 0x7f92cc110ae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:34:16.606 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:34:16.604+0000 7f92cbe00640 1 --2- 172.21.15.39:0/2311125325 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f92cc1047e0 0x7f92cc108830 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:34:16.606 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:34:16.604+0000 7f92cbe00640 1 --2- 172.21.15.39:0/2311125325 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f92cc103e30 0x7f92cc104210 unknown :-1 s=CLOSED pgs=54 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:34:16.606 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:34:16.604+0000 7f92cbe00640 1 -- 172.21.15.39:0/2311125325 >> 172.21.15.39:0/2311125325 conn(0x7f92cc0ff8d0 msgr2=0x7f92cc101cf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:34:16.606 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:34:16.604+0000 7f92cbe00640 1 -- 172.21.15.39:0/2311125325 shutdown_connections 2024-09-12T02:34:16.606 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:34:16.604+0000 7f92cbe00640 1 -- 172.21.15.39:0/2311125325 wait complete. 2024-09-12T02:34:16.609 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:34:16.605+0000 7f92cbe00640 1 Processor -- start 2024-09-12T02:34:16.609 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:34:16.605+0000 7f92cbe00640 1 -- start start 2024-09-12T02:34:16.609 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:34:16.606+0000 7f92cbe00640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f92cc103e30 0x7f92cc19a4e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:34:16.609 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:34:16.606+0000 7f92cbe00640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f92cc1047e0 0x7f92cc19aa20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:34:16.609 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:34:16.606+0000 7f92cbe00640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f92cc108f60 0x7f92cc19edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:34:16.609 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:34:16.606+0000 7f92cbe00640 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 -- 0x7f92cc113fc0 con 0x7f92cc108f60 2024-09-12T02:34:16.609 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:34:16.606+0000 7f92cbe00640 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x7f92cc113e40 con 0x7f92cc1047e0 2024-09-12T02:34:16.609 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:34:16.606+0000 7f92cbe00640 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7f92cc114140 con 0x7f92cc103e30 2024-09-12T02:34:16.609 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:34:16.606+0000 7f92caa00640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f92cc103e30 0x7f92cc19a4e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:34:16.609 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:34:16.606+0000 7f92cb400640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f92cc108f60 0x7f92cc19edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:34:16.610 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:34:16.606+0000 7f92c3e00640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f92cc1047e0 0x7f92cc19aa20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:34:16.610 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:34:16.606+0000 7f92c3e00640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f92cc1047e0 0x7f92cc19aa20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.39:49368/0 (socket says 172.21.15.39:49368) 2024-09-12T02:34:16.610 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:34:16.606+0000 7f92caa00640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f92cc103e30 0x7f92cc19a4e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.172:3300/0 says I am v2:172.21.15.39:54472/0 (socket says 172.21.15.39:54472) 2024-09-12T02:34:16.610 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:34:16.606+0000 7f92c3e00640 1 -- 172.21.15.39:0/1064391792 learned_addr learned my addr 172.21.15.39:0/1064391792 (peer_addr_for_me v2:172.21.15.39:0/0) 2024-09-12T02:34:16.610 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:34:16.606+0000 7f92caa00640 1 -- 172.21.15.39:0/1064391792 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f92cc1047e0 msgr2=0x7f92cc19aa20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:34:16.610 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:34:16.606+0000 7f92caa00640 1 --2- 172.21.15.39:0/1064391792 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f92cc1047e0 0x7f92cc19aa20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:34:16.611 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:34:16.606+0000 7f92caa00640 1 -- 172.21.15.39:0/1064391792 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f92cc108f60 msgr2=0x7f92cc19edb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:34:16.611 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:34:16.606+0000 7f92caa00640 1 --2- 172.21.15.39:0/1064391792 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f92cc108f60 0x7f92cc19edb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:34:16.611 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:34:16.606+0000 7f92caa00640 1 -- 172.21.15.39:0/1064391792 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f92cc19f490 con 0x7f92cc103e30 2024-09-12T02:34:16.611 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:34:16.607+0000 7f92caa00640 1 --2- 172.21.15.39:0/1064391792 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f92cc103e30 0x7f92cc19a4e0 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7f92bc02a860 tx=0x7f92bc033d90 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:34:16.611 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:34:16.607+0000 7f92c3400640 1 -- 172.21.15.39:0/1064391792 <== mon.1 v2:172.21.15.172:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f92bc037040 con 0x7f92cc103e30 2024-09-12T02:34:16.611 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:34:16.607+0000 7f92c3400640 1 -- 172.21.15.39:0/1064391792 <== mon.1 v2:172.21.15.172:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f92bc030550 con 0x7f92cc103e30 2024-09-12T02:34:16.611 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:34:16.607+0000 7f92cbe00640 1 -- 172.21.15.39:0/1064391792 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f92cc19f720 con 0x7f92cc103e30 2024-09-12T02:34:16.611 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:34:16.607+0000 7f92c3400640 1 -- 172.21.15.39:0/1064391792 <== mon.1 v2:172.21.15.172:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f92bc003a30 con 0x7f92cc103e30 2024-09-12T02:34:16.611 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:34:16.607+0000 7f92cbe00640 1 -- 172.21.15.39:0/1064391792 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f92cc1a7060 con 0x7f92cc103e30 2024-09-12T02:34:16.611 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:34:16.608+0000 7f92cbe00640 1 -- 172.21.15.39:0/1064391792 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f92cc105310 con 0x7f92cc103e30 2024-09-12T02:34:16.612 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:34:16.610+0000 7f92c3400640 1 -- 172.21.15.39:0/1064391792 <== mon.1 v2:172.21.15.172:3300/0 4 ==== mgrmap(e 16) ==== 137833+0+0 (secure 0 0 0) 0x7f92bc042020 con 0x7f92cc103e30 2024-09-12T02:34:16.612 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:34:16.611+0000 7f92c3400640 1 --2- 172.21.15.39:0/1064391792 >> [v2:172.21.15.39:6800/1725006999,v1:172.21.15.39:6801/1725006999] conn(0x7f92b00a2b80 0x7f92b00a5040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:34:16.613 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:34:16.611+0000 7f92c3400640 1 -- 172.21.15.39:0/1064391792 <== mon.1 v2:172.21.15.172:3300/0 5 ==== osd_map(78..78 src has 1..78) ==== 7127+0+0 (secure 0 0 0) 0x7f92bc0ee290 con 0x7f92cc103e30 2024-09-12T02:34:16.613 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:34:16.612+0000 7f92c3e00640 1 --2- 172.21.15.39:0/1064391792 >> [v2:172.21.15.39:6800/1725006999,v1:172.21.15.39:6801/1725006999] conn(0x7f92b00a2b80 0x7f92b00a5040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:34:16.613 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:34:16.612+0000 7f92c3e00640 1 --2- 172.21.15.39:0/1064391792 >> [v2:172.21.15.39:6800/1725006999,v1:172.21.15.39:6801/1725006999] conn(0x7f92b00a2b80 0x7f92b00a5040 secure :-1 s=READY pgs=122 cs=0 l=1 rev1=1 crypto rx=0x7f92cc0ffd80 tx=0x7f92b400b480 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:34:16.616 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:34:16.615+0000 7f92c3400640 1 -- 172.21.15.39:0/1064391792 <== mon.1 v2:172.21.15.172:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7f92bc049020 con 0x7f92cc103e30 2024-09-12T02:34:16.764 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 12 02:34:16 smithi172 ceph-mon[35609]: pgmap v263: 1 pgs: 1 active+clean; 577 KiB data, 344 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-12T02:34:16.764 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 12 02:34:16 smithi172 ceph-mon[35609]: Deploying daemon mds.l on smithi172 2024-09-12T02:34:16.837 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:34:16.836+0000 7f92cbe00640 1 -- 172.21.15.39:0/1064391792 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f92cc10c140 con 0x7f92cc103e30 2024-09-12T02:34:16.837 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 02:34:16 smithi039 ceph-mon[30515]: pgmap v263: 1 pgs: 1 active+clean; 577 KiB data, 344 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-12T02:34:16.838 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 02:34:16 smithi039 ceph-mon[30515]: Deploying daemon mds.l on smithi172 2024-09-12T02:34:16.838 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:34:16.837+0000 7f92c3400640 1 -- 172.21.15.39:0/1064391792 <== mon.1 v2:172.21.15.172:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 1 v1) ==== 93+0+611 (secure 0 0 0) 0x7f92bc0bb5f0 con 0x7f92cc103e30 2024-09-12T02:34:16.838 INFO:teuthology.orchestra.run.smithi039.stdout: 2024-09-12T02:34:16.838 INFO:teuthology.orchestra.run.smithi039.stdout:{"epoch":1,"btime":"2024-09-12T02:26:43:086025+0000","default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[],"filesystems":[]} 2024-09-12T02:34:16.838 INFO:teuthology.orchestra.run.smithi039.stderr:dumped fsmap epoch 1 2024-09-12T02:34:16.840 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:34:16.839+0000 7f92cbe00640 1 -- 172.21.15.39:0/1064391792 >> [v2:172.21.15.39:6800/1725006999,v1:172.21.15.39:6801/1725006999] conn(0x7f92b00a2b80 msgr2=0x7f92b00a5040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:34:16.840 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:34:16.839+0000 7f92cbe00640 1 --2- 172.21.15.39:0/1064391792 >> [v2:172.21.15.39:6800/1725006999,v1:172.21.15.39:6801/1725006999] conn(0x7f92b00a2b80 0x7f92b00a5040 secure :-1 s=READY pgs=122 cs=0 l=1 rev1=1 crypto rx=0x7f92cc0ffd80 tx=0x7f92b400b480 comp rx=0 tx=0).stop 2024-09-12T02:34:16.841 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:34:16.839+0000 7f92cbe00640 1 -- 172.21.15.39:0/1064391792 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f92cc103e30 msgr2=0x7f92cc19a4e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:34:16.841 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:34:16.839+0000 7f92cbe00640 1 --2- 172.21.15.39:0/1064391792 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f92cc103e30 0x7f92cc19a4e0 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7f92bc02a860 tx=0x7f92bc033d90 comp rx=0 tx=0).stop 2024-09-12T02:34:16.841 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:34:16.839+0000 7f92cbe00640 1 -- 172.21.15.39:0/1064391792 shutdown_connections 2024-09-12T02:34:16.841 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:34:16.839+0000 7f92cbe00640 1 --2- 172.21.15.39:0/1064391792 >> [v2:172.21.15.39:6800/1725006999,v1:172.21.15.39:6801/1725006999] conn(0x7f92b00a2b80 0x7f92b00a5040 unknown :-1 s=CLOSED pgs=122 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:34:16.841 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:34:16.839+0000 7f92cbe00640 1 --2- 172.21.15.39:0/1064391792 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f92cc108f60 0x7f92cc19edb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:34:16.841 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:34:16.839+0000 7f92cbe00640 1 --2- 172.21.15.39:0/1064391792 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f92cc1047e0 0x7f92cc19aa20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:34:16.841 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:34:16.839+0000 7f92cbe00640 1 --2- 172.21.15.39:0/1064391792 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f92cc103e30 0x7f92cc19a4e0 unknown :-1 s=CLOSED pgs=55 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:34:16.841 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:34:16.839+0000 7f92cbe00640 1 -- 172.21.15.39:0/1064391792 >> 172.21.15.39:0/1064391792 conn(0x7f92cc0ff8d0 msgr2=0x7f92cc100c30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:34:16.841 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:34:16.840+0000 7f92cbe00640 1 -- 172.21.15.39:0/1064391792 shutdown_connections 2024-09-12T02:34:16.841 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:34:16.840+0000 7f92cbe00640 1 -- 172.21.15.39:0/1064391792 wait complete. 2024-09-12T02:34:16.948 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 12 02:34:16 smithi044 ceph-mon[35411]: pgmap v263: 1 pgs: 1 active+clean; 577 KiB data, 344 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-12T02:34:16.948 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 12 02:34:16 smithi044 ceph-mon[35411]: Deploying daemon mds.l on smithi172 2024-09-12T02:34:17.443 INFO:journalctl@ceph.mds.l.smithi172.stdout:Sep 12 02:34:17 smithi172 systemd[1]: Starting Ceph mds.l for 4954ed46-70ae-11ef-bcea-c7b262605968... 2024-09-12T02:34:17.443 INFO:journalctl@ceph.mds.l.smithi172.stdout:Sep 12 02:34:17 smithi172 podman[65606]: 2024-09-12 02:34:17.344653875 +0000 UTC m=+0.015537999 image pull 54467abc55f864c4f73dfaf9c6ac3bb3e87b773123d5badaf790bee57321d594 quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:3be30d720e37ec4df7f667e60f22b4d221c4ce7b408e68b90f9ac10220535e66 2024-09-12T02:34:17.715 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 12 02:34:17 smithi172 ceph-mon[35609]: from='client.? 172.21.15.39:0/1064391792' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-12T02:34:17.715 INFO:journalctl@ceph.mds.l.smithi172.stdout:Sep 12 02:34:17 smithi172 podman[65606]: 2024-09-12 02:34:17.48795451 +0000 UTC m=+0.158838627 container create 0d261ee5edd65a9add2f207901d0126d4109c62517aeffcc6779f7edc4585b57 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:3be30d720e37ec4df7f667e60f22b4d221c4ce7b408e68b90f9ac10220535e66, name=ceph-4954ed46-70ae-11ef-bcea-c7b262605968-mds-l, RELEASE=squid-b53b6d3, CEPH_POINT_RELEASE=, maintainer=Guillaume Abrioux , ceph=True, org.label-schema.name=CentOS Stream 9 Base Image, GIT_CLEAN=True, io.buildah.version=1.37.2, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.license=GPLv2, org.label-schema.schema-version=1.0, GIT_BRANCH=HEAD, org.label-schema.build-date=20240731, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.vendor=CentOS) 2024-09-12T02:34:17.948 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 12 02:34:17 smithi044 ceph-mon[35411]: from='client.? 172.21.15.39:0/1064391792' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-12T02:34:18.013 INFO:journalctl@ceph.mds.l.smithi172.stdout:Sep 12 02:34:17 smithi172 podman[65606]: 2024-09-12 02:34:17.715698326 +0000 UTC m=+0.386582452 container init 0d261ee5edd65a9add2f207901d0126d4109c62517aeffcc6779f7edc4585b57 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:3be30d720e37ec4df7f667e60f22b4d221c4ce7b408e68b90f9ac10220535e66, name=ceph-4954ed46-70ae-11ef-bcea-c7b262605968-mds-l, org.label-schema.vendor=CentOS, io.buildah.version=1.37.2, ceph=True, org.label-schema.license=GPLv2, org.label-schema.build-date=20240731, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, CEPH_POINT_RELEASE=, org.label-schema.schema-version=1.0, GIT_CLEAN=True, GIT_REPO=git@github.com:ceph/ceph-container.git, maintainer=Guillaume Abrioux , GIT_BRANCH=HEAD, org.label-schema.name=CentOS Stream 9 Base Image, RELEASE=squid-b53b6d3) 2024-09-12T02:34:18.014 INFO:journalctl@ceph.mds.l.smithi172.stdout:Sep 12 02:34:17 smithi172 podman[65606]: 2024-09-12 02:34:17.718733434 +0000 UTC m=+0.389617554 container start 0d261ee5edd65a9add2f207901d0126d4109c62517aeffcc6779f7edc4585b57 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:3be30d720e37ec4df7f667e60f22b4d221c4ce7b408e68b90f9ac10220535e66, name=ceph-4954ed46-70ae-11ef-bcea-c7b262605968-mds-l, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.license=GPLv2, GIT_BRANCH=HEAD, org.label-schema.name=CentOS Stream 9 Base Image, GIT_CLEAN=True, maintainer=Guillaume Abrioux , org.label-schema.vendor=CentOS, RELEASE=squid-b53b6d3, io.buildah.version=1.37.2, org.label-schema.schema-version=1.0, CEPH_POINT_RELEASE=, org.label-schema.build-date=20240731, ceph=True, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7) 2024-09-12T02:34:18.014 INFO:journalctl@ceph.mds.l.smithi172.stdout:Sep 12 02:34:17 smithi172 ceph-mds[65626]: -- 172.21.15.172:0/1490766502 <== mon.1 v2:172.21.15.172:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 194+0+0 (secure 0 0 0) 0x5598055df860 con 0x5598055bd400 2024-09-12T02:34:18.014 INFO:journalctl@ceph.mds.l.smithi172.stdout:Sep 12 02:34:17 smithi172 ceph-4954ed46-70ae-11ef-bcea-c7b262605968-mds-l[65622]: starting mds.l at 2024-09-12T02:34:18.014 INFO:journalctl@ceph.mds.l.smithi172.stdout:Sep 12 02:34:17 smithi172 bash[65606]: 0d261ee5edd65a9add2f207901d0126d4109c62517aeffcc6779f7edc4585b57 2024-09-12T02:34:18.014 INFO:journalctl@ceph.mds.l.smithi172.stdout:Sep 12 02:34:17 smithi172 systemd[1]: Started Ceph mds.l for 4954ed46-70ae-11ef-bcea-c7b262605968. 2024-09-12T02:34:18.099 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 02:34:17 smithi039 ceph-mon[30515]: from='client.? 172.21.15.39:0/1064391792' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-12T02:34:18.948 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 12 02:34:18 smithi044 ceph-mon[35411]: pgmap v264: 1 pgs: 1 active+clean; 577 KiB data, 344 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-12T02:34:18.949 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 12 02:34:18 smithi044 ceph-mon[35411]: mds.? [v2:172.21.15.172:6832/3232434105,v1:172.21.15.172:6833/3232434105] up:boot 2024-09-12T02:34:18.949 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 12 02:34:18 smithi044 ceph-mon[35411]: fsmap 1 up:standby 2024-09-12T02:34:18.949 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 12 02:34:18 smithi044 ceph-mon[35411]: from='mgr.14150 172.21.15.39:0/408627207' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "l"}]: dispatch 2024-09-12T02:34:18.949 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 12 02:34:18 smithi044 ceph-mon[35411]: from='mgr.14150 172.21.15.39:0/408627207' entity='mgr.x' 2024-09-12T02:34:18.949 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 12 02:34:18 smithi044 ceph-mon[35411]: from='mgr.14150 172.21.15.39:0/408627207' entity='mgr.x' 2024-09-12T02:34:18.949 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 12 02:34:18 smithi044 ceph-mon[35411]: from='mgr.14150 172.21.15.39:0/408627207' entity='mgr.x' 2024-09-12T02:34:18.949 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 12 02:34:18 smithi044 ceph-mon[35411]: from='mgr.14150 172.21.15.39:0/408627207' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.k", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-09-12T02:34:18.949 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 12 02:34:18 smithi044 ceph-mon[35411]: from='mgr.14150 172.21.15.39:0/408627207' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.k", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-09-12T02:34:18.949 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 12 02:34:18 smithi044 ceph-mon[35411]: from='mgr.14150 172.21.15.39:0/408627207' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-12T02:34:19.013 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 12 02:34:18 smithi172 ceph-mon[35609]: pgmap v264: 1 pgs: 1 active+clean; 577 KiB data, 344 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-12T02:34:19.014 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 12 02:34:18 smithi172 ceph-mon[35609]: mds.? [v2:172.21.15.172:6832/3232434105,v1:172.21.15.172:6833/3232434105] up:boot 2024-09-12T02:34:19.014 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 12 02:34:18 smithi172 ceph-mon[35609]: fsmap 1 up:standby 2024-09-12T02:34:19.014 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 12 02:34:18 smithi172 ceph-mon[35609]: from='mgr.14150 172.21.15.39:0/408627207' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "l"}]: dispatch 2024-09-12T02:34:19.014 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 12 02:34:18 smithi172 ceph-mon[35609]: from='mgr.14150 172.21.15.39:0/408627207' entity='mgr.x' 2024-09-12T02:34:19.014 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 12 02:34:18 smithi172 ceph-mon[35609]: from='mgr.14150 172.21.15.39:0/408627207' entity='mgr.x' 2024-09-12T02:34:19.014 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 12 02:34:18 smithi172 ceph-mon[35609]: from='mgr.14150 172.21.15.39:0/408627207' entity='mgr.x' 2024-09-12T02:34:19.014 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 12 02:34:18 smithi172 ceph-mon[35609]: from='mgr.14150 172.21.15.39:0/408627207' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.k", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-09-12T02:34:19.014 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 12 02:34:18 smithi172 ceph-mon[35609]: from='mgr.14150 172.21.15.39:0/408627207' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.k", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-09-12T02:34:19.014 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 12 02:34:18 smithi172 ceph-mon[35609]: from='mgr.14150 172.21.15.39:0/408627207' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-12T02:34:19.100 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 02:34:18 smithi039 ceph-mon[30515]: pgmap v264: 1 pgs: 1 active+clean; 577 KiB data, 344 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-12T02:34:19.100 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 02:34:18 smithi039 ceph-mon[30515]: mds.? [v2:172.21.15.172:6832/3232434105,v1:172.21.15.172:6833/3232434105] up:boot 2024-09-12T02:34:19.100 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 02:34:18 smithi039 ceph-mon[30515]: fsmap 1 up:standby 2024-09-12T02:34:19.100 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 02:34:18 smithi039 ceph-mon[30515]: from='mgr.14150 172.21.15.39:0/408627207' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "l"}]: dispatch 2024-09-12T02:34:19.100 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 02:34:18 smithi039 ceph-mon[30515]: from='mgr.14150 172.21.15.39:0/408627207' entity='mgr.x' 2024-09-12T02:34:19.100 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 02:34:18 smithi039 ceph-mon[30515]: from='mgr.14150 172.21.15.39:0/408627207' entity='mgr.x' 2024-09-12T02:34:19.100 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 02:34:18 smithi039 ceph-mon[30515]: from='mgr.14150 172.21.15.39:0/408627207' entity='mgr.x' 2024-09-12T02:34:19.100 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 02:34:18 smithi039 ceph-mon[30515]: from='mgr.14150 172.21.15.39:0/408627207' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.k", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-09-12T02:34:19.100 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 02:34:18 smithi039 ceph-mon[30515]: from='mgr.14150 172.21.15.39:0/408627207' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.k", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-09-12T02:34:19.100 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 02:34:18 smithi039 ceph-mon[30515]: from='mgr.14150 172.21.15.39:0/408627207' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-12T02:34:19.688 DEBUG:teuthology.orchestra.run.smithi039:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc shell --fsid 4954ed46-70ae-11ef-bcea-c7b262605968 -- ceph fs dump --format=json 2024-09-12T02:34:19.948 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 12 02:34:19 smithi044 ceph-mon[35411]: Deploying daemon mds.k on smithi044 2024-09-12T02:34:20.013 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 12 02:34:19 smithi172 ceph-mon[35609]: Deploying daemon mds.k on smithi044 2024-09-12T02:34:20.071 INFO:teuthology.orchestra.run.smithi039.stderr:Inferring config /var/lib/ceph/4954ed46-70ae-11ef-bcea-c7b262605968/mon.a/config 2024-09-12T02:34:20.099 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 02:34:19 smithi039 ceph-mon[30515]: Deploying daemon mds.k on smithi044 2024-09-12T02:34:20.332 INFO:journalctl@ceph.mds.k.smithi044.stdout:Sep 12 02:34:20 smithi044 podman[64399]: 2024-09-12 02:34:20.332006523 +0000 UTC m=+0.231600305 container create d6812fe96b08a3e7c327c4452a62d760a2092dfb323fd0b2acd5f69fdc9dda24 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:3be30d720e37ec4df7f667e60f22b4d221c4ce7b408e68b90f9ac10220535e66, name=ceph-4954ed46-70ae-11ef-bcea-c7b262605968-mds-k, org.label-schema.vendor=CentOS, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, GIT_BRANCH=HEAD, maintainer=Guillaume Abrioux , GIT_REPO=git@github.com:ceph/ceph-container.git, ceph=True, GIT_CLEAN=True, org.label-schema.build-date=20240731, org.label-schema.license=GPLv2, RELEASE=squid-b53b6d3, io.buildah.version=1.37.2, org.label-schema.schema-version=1.0, CEPH_POINT_RELEASE=, org.label-schema.name=CentOS Stream 9 Base Image) 2024-09-12T02:34:20.594 INFO:journalctl@ceph.mds.k.smithi044.stdout:Sep 12 02:34:20 smithi044 podman[64399]: 2024-09-12 02:34:20.568032287 +0000 UTC m=+0.467626079 container init d6812fe96b08a3e7c327c4452a62d760a2092dfb323fd0b2acd5f69fdc9dda24 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:3be30d720e37ec4df7f667e60f22b4d221c4ce7b408e68b90f9ac10220535e66, name=ceph-4954ed46-70ae-11ef-bcea-c7b262605968-mds-k, org.label-schema.vendor=CentOS, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, CEPH_POINT_RELEASE=, GIT_BRANCH=HEAD, maintainer=Guillaume Abrioux , io.buildah.version=1.37.2, org.label-schema.schema-version=1.0, RELEASE=squid-b53b6d3, GIT_CLEAN=True, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.license=GPLv2, ceph=True, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.build-date=20240731) 2024-09-12T02:34:20.594 INFO:journalctl@ceph.mds.k.smithi044.stdout:Sep 12 02:34:20 smithi044 podman[64399]: 2024-09-12 02:34:20.57078587 +0000 UTC m=+0.470379650 container start d6812fe96b08a3e7c327c4452a62d760a2092dfb323fd0b2acd5f69fdc9dda24 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:3be30d720e37ec4df7f667e60f22b4d221c4ce7b408e68b90f9ac10220535e66, name=ceph-4954ed46-70ae-11ef-bcea-c7b262605968-mds-k, org.label-schema.schema-version=1.0, org.label-schema.license=GPLv2, ceph=True, GIT_BRANCH=HEAD, org.label-schema.build-date=20240731, org.label-schema.vendor=CentOS, io.buildah.version=1.37.2, CEPH_POINT_RELEASE=, org.label-schema.name=CentOS Stream 9 Base Image, maintainer=Guillaume Abrioux , GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, GIT_CLEAN=True, RELEASE=squid-b53b6d3) 2024-09-12T02:34:20.617 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:34:20.612+0000 7f7324000640 1 -- 172.21.15.39:0/3066611450 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f731c112a50 msgr2=0x7f731c114e40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:34:20.617 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:34:20.612+0000 7f7324000640 1 --2- 172.21.15.39:0/3066611450 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f731c112a50 0x7f731c114e40 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7f7314009be0 tx=0x7f731402a6c0 comp rx=0 tx=0).stop 2024-09-12T02:34:20.617 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:34:20.612+0000 7f7324000640 1 -- 172.21.15.39:0/3066611450 shutdown_connections 2024-09-12T02:34:20.618 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:34:20.612+0000 7f7324000640 1 --2- 172.21.15.39:0/3066611450 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f731c112a50 0x7f731c114e40 unknown :-1 s=CLOSED pgs=64 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:34:20.618 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:34:20.612+0000 7f7324000640 1 --2- 172.21.15.39:0/3066611450 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f731c077040 0x7f731c112510 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:34:20.618 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:34:20.612+0000 7f7324000640 1 --2- 172.21.15.39:0/3066611450 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f731c076720 0x7f731c076b00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:34:20.618 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:34:20.612+0000 7f7324000640 1 -- 172.21.15.39:0/3066611450 >> 172.21.15.39:0/3066611450 conn(0x7f731c0ffa50 msgr2=0x7f731c101e70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:34:20.618 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:34:20.612+0000 7f7324000640 1 -- 172.21.15.39:0/3066611450 shutdown_connections 2024-09-12T02:34:20.618 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:34:20.612+0000 7f7324000640 1 -- 172.21.15.39:0/3066611450 wait complete. 2024-09-12T02:34:20.618 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:34:20.613+0000 7f7324000640 1 Processor -- start 2024-09-12T02:34:20.618 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:34:20.613+0000 7f7324000640 1 -- start start 2024-09-12T02:34:20.618 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:34:20.614+0000 7f7324000640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f731c076720 0x7f731c1a46e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:34:20.618 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:34:20.614+0000 7f7324000640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f731c077040 0x7f731c1a4c20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:34:20.618 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:34:20.614+0000 7f7324000640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f731c112a50 0x7f731c19e8a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:34:20.618 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:34:20.614+0000 7f7324000640 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 -- 0x7f731c118550 con 0x7f731c077040 2024-09-12T02:34:20.618 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:34:20.614+0000 7f7324000640 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x7f731c1183d0 con 0x7f731c112a50 2024-09-12T02:34:20.619 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:34:20.614+0000 7f7324000640 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7f731c1186d0 con 0x7f731c076720 2024-09-12T02:34:20.619 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:34:20.614+0000 7f7320c00640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f731c077040 0x7f731c1a4c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:34:20.619 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:34:20.614+0000 7f7320c00640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f731c077040 0x7f731c1a4c20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.39:3300/0 says I am v2:172.21.15.39:39182/0 (socket says 172.21.15.39:39182) 2024-09-12T02:34:20.619 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:34:20.614+0000 7f7320c00640 1 -- 172.21.15.39:0/361152648 learned_addr learned my addr 172.21.15.39:0/361152648 (peer_addr_for_me v2:172.21.15.39:0/0) 2024-09-12T02:34:20.619 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:34:20.614+0000 7f7321600640 1 --2- 172.21.15.39:0/361152648 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f731c076720 0x7f731c1a46e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:34:20.619 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:34:20.614+0000 7f7322000640 1 --2- 172.21.15.39:0/361152648 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f731c112a50 0x7f731c19e8a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:34:20.619 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:34:20.614+0000 7f7320c00640 1 -- 172.21.15.39:0/361152648 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f731c076720 msgr2=0x7f731c1a46e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:34:20.619 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:34:20.614+0000 7f7320c00640 1 --2- 172.21.15.39:0/361152648 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f731c076720 0x7f731c1a46e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:34:20.619 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:34:20.614+0000 7f7320c00640 1 -- 172.21.15.39:0/361152648 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f731c112a50 msgr2=0x7f731c19e8a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:34:20.619 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:34:20.614+0000 7f7320c00640 1 --2- 172.21.15.39:0/361152648 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f731c112a50 0x7f731c19e8a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:34:20.619 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:34:20.614+0000 7f7320c00640 1 -- 172.21.15.39:0/361152648 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f731c19efd0 con 0x7f731c077040 2024-09-12T02:34:20.619 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:34:20.615+0000 7f7320c00640 1 --2- 172.21.15.39:0/361152648 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f731c077040 0x7f731c1a4c20 secure :-1 s=READY pgs=133 cs=0 l=1 rev1=1 crypto rx=0x7f730800e9c0 tx=0x7f730800ee80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:34:20.619 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:34:20.615+0000 7f731a000640 1 -- 172.21.15.39:0/361152648 <== mon.0 v2:172.21.15.39:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f730800cde0 con 0x7f731c077040 2024-09-12T02:34:20.620 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:34:20.615+0000 7f731a000640 1 -- 172.21.15.39:0/361152648 <== mon.0 v2:172.21.15.39:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f73080035f0 con 0x7f731c077040 2024-09-12T02:34:20.620 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:34:20.615+0000 7f7324000640 1 -- 172.21.15.39:0/361152648 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f731c19f2c0 con 0x7f731c077040 2024-09-12T02:34:20.620 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:34:20.615+0000 7f731a000640 1 -- 172.21.15.39:0/361152648 <== mon.0 v2:172.21.15.39:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7308010690 con 0x7f731c077040 2024-09-12T02:34:20.620 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:34:20.615+0000 7f7324000640 1 -- 172.21.15.39:0/361152648 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f731c1ab5b0 con 0x7f731c077040 2024-09-12T02:34:20.620 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:34:20.616+0000 7f7324000640 1 -- 172.21.15.39:0/361152648 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f731c076b00 con 0x7f731c077040 2024-09-12T02:34:20.620 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:34:20.618+0000 7f731a000640 1 -- 172.21.15.39:0/361152648 <== mon.0 v2:172.21.15.39:3300/0 4 ==== mgrmap(e 16) ==== 137833+0+0 (secure 0 0 0) 0x7f73080037a0 con 0x7f731c077040 2024-09-12T02:34:20.621 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:34:20.620+0000 7f731a000640 1 --2- 172.21.15.39:0/361152648 >> [v2:172.21.15.39:6800/1725006999,v1:172.21.15.39:6801/1725006999] conn(0x7f73040a2b80 0x7f73040a5040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:34:20.621 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:34:20.620+0000 7f731a000640 1 -- 172.21.15.39:0/361152648 <== mon.0 v2:172.21.15.39:3300/0 5 ==== osd_map(78..78 src has 1..78) ==== 7127+0+0 (secure 0 0 0) 0x7f73080cefc0 con 0x7f731c077040 2024-09-12T02:34:20.621 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:34:20.620+0000 7f7321600640 1 --2- 172.21.15.39:0/361152648 >> [v2:172.21.15.39:6800/1725006999,v1:172.21.15.39:6801/1725006999] conn(0x7f73040a2b80 0x7f73040a5040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:34:20.621 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:34:20.621+0000 7f7321600640 1 --2- 172.21.15.39:0/361152648 >> [v2:172.21.15.39:6800/1725006999,v1:172.21.15.39:6801/1725006999] conn(0x7f73040a2b80 0x7f73040a5040 secure :-1 s=READY pgs=124 cs=0 l=1 rev1=1 crypto rx=0x7f731c19f9e0 tx=0x7f731000b390 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:34:20.623 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:34:20.622+0000 7f731a000640 1 -- 172.21.15.39:0/361152648 <== mon.0 v2:172.21.15.39:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7f730809c3b0 con 0x7f731c077040 2024-09-12T02:34:20.852 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:34:20.851+0000 7f7324000640 1 -- 172.21.15.39:0/361152648 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f731c19fdd0 con 0x7f731c077040 2024-09-12T02:34:20.852 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:34:20.851+0000 7f731a000640 1 -- 172.21.15.39:0/361152648 <== mon.0 v2:172.21.15.39:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 3 v3) ==== 93+0+2263 (secure 0 0 0) 0x7f731c19fdd0 con 0x7f731c077040 2024-09-12T02:34:20.852 INFO:teuthology.orchestra.run.smithi039.stdout: 2024-09-12T02:34:20.853 INFO:teuthology.orchestra.run.smithi039.stdout:{"epoch":3,"btime":"2024-09-12T02:34:20:758788+0000","default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":24422,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.44:6833/2359724364","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6832","nonce":2359724364},{"type":"v1","addr":"172.21.15.44:6833","nonce":2359724364}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":24430,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.172:6833/3232434105","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6832","nonce":3232434105},{"type":"v1","addr":"172.21.15.172:6833","nonce":3232434105}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2}],"filesystems":[]} 2024-09-12T02:34:20.853 INFO:teuthology.orchestra.run.smithi039.stderr:dumped fsmap epoch 3 2024-09-12T02:34:20.854 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:34:20.854+0000 7f7324000640 1 -- 172.21.15.39:0/361152648 >> [v2:172.21.15.39:6800/1725006999,v1:172.21.15.39:6801/1725006999] conn(0x7f73040a2b80 msgr2=0x7f73040a5040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:34:20.854 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:34:20.854+0000 7f7324000640 1 --2- 172.21.15.39:0/361152648 >> [v2:172.21.15.39:6800/1725006999,v1:172.21.15.39:6801/1725006999] conn(0x7f73040a2b80 0x7f73040a5040 secure :-1 s=READY pgs=124 cs=0 l=1 rev1=1 crypto rx=0x7f731c19f9e0 tx=0x7f731000b390 comp rx=0 tx=0).stop 2024-09-12T02:34:20.854 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:34:20.854+0000 7f7324000640 1 -- 172.21.15.39:0/361152648 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f731c077040 msgr2=0x7f731c1a4c20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:34:20.855 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:34:20.854+0000 7f7324000640 1 --2- 172.21.15.39:0/361152648 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f731c077040 0x7f731c1a4c20 secure :-1 s=READY pgs=133 cs=0 l=1 rev1=1 crypto rx=0x7f730800e9c0 tx=0x7f730800ee80 comp rx=0 tx=0).stop 2024-09-12T02:34:20.855 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:34:20.854+0000 7f7324000640 1 -- 172.21.15.39:0/361152648 shutdown_connections 2024-09-12T02:34:20.855 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:34:20.854+0000 7f7324000640 1 --2- 172.21.15.39:0/361152648 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f731c112a50 0x7f731c19e8a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:34:20.855 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:34:20.854+0000 7f7324000640 1 --2- 172.21.15.39:0/361152648 >> [v2:172.21.15.39:6800/1725006999,v1:172.21.15.39:6801/1725006999] conn(0x7f73040a2b80 0x7f73040a5040 unknown :-1 s=CLOSED pgs=124 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:34:20.855 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:34:20.854+0000 7f7324000640 1 --2- 172.21.15.39:0/361152648 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f731c077040 0x7f731c1a4c20 unknown :-1 s=CLOSED pgs=133 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:34:20.855 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:34:20.854+0000 7f7324000640 1 --2- 172.21.15.39:0/361152648 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f731c076720 0x7f731c1a46e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:34:20.855 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:34:20.854+0000 7f7324000640 1 -- 172.21.15.39:0/361152648 >> 172.21.15.39:0/361152648 conn(0x7f731c0ffa50 msgr2=0x7f731c101e40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:34:20.856 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:34:20.854+0000 7f7324000640 1 -- 172.21.15.39:0/361152648 shutdown_connections 2024-09-12T02:34:20.856 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:34:20.854+0000 7f7324000640 1 -- 172.21.15.39:0/361152648 wait complete. 2024-09-12T02:34:20.949 INFO:journalctl@ceph.mds.k.smithi044.stdout:Sep 12 02:34:20 smithi044 ceph-mds[64418]: -- 172.21.15.44:0/2216267272 <== mon.2 v2:172.21.15.44:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 194+0+0 (secure 0 0 0) 0x560c485c3860 con 0x560c485a0800 2024-09-12T02:34:20.949 INFO:journalctl@ceph.mds.k.smithi044.stdout:Sep 12 02:34:20 smithi044 ceph-4954ed46-70ae-11ef-bcea-c7b262605968-mds-k[64414]: starting mds.k at 2024-09-12T02:34:20.949 INFO:journalctl@ceph.mds.k.smithi044.stdout:Sep 12 02:34:20 smithi044 bash[64399]: d6812fe96b08a3e7c327c4452a62d760a2092dfb323fd0b2acd5f69fdc9dda24 2024-09-12T02:34:20.949 INFO:journalctl@ceph.mds.k.smithi044.stdout:Sep 12 02:34:20 smithi044 systemd[1]: Started Ceph mds.k for 4954ed46-70ae-11ef-bcea-c7b262605968. 2024-09-12T02:34:20.949 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 12 02:34:20 smithi044 ceph-mon[35411]: pgmap v265: 1 pgs: 1 active+clean; 577 KiB data, 344 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-12T02:34:20.949 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 12 02:34:20 smithi044 ceph-mon[35411]: from='mgr.14150 172.21.15.39:0/408627207' entity='mgr.x' 2024-09-12T02:34:20.949 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 12 02:34:20 smithi044 ceph-mon[35411]: from='mgr.14150 172.21.15.39:0/408627207' entity='mgr.x' 2024-09-12T02:34:20.949 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 12 02:34:20 smithi044 ceph-mon[35411]: from='mgr.14150 172.21.15.39:0/408627207' entity='mgr.x' 2024-09-12T02:34:20.949 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 12 02:34:20 smithi044 ceph-mon[35411]: from='mgr.14150 172.21.15.39:0/408627207' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.j", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-09-12T02:34:20.950 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 12 02:34:20 smithi044 ceph-mon[35411]: from='mgr.14150 172.21.15.39:0/408627207' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.j", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-09-12T02:34:20.950 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 12 02:34:20 smithi044 ceph-mon[35411]: from='mgr.14150 172.21.15.39:0/408627207' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-12T02:34:20.950 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 12 02:34:20 smithi044 ceph-mon[35411]: Deploying daemon mds.j on smithi039 2024-09-12T02:34:21.013 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 12 02:34:20 smithi172 ceph-mon[35609]: pgmap v265: 1 pgs: 1 active+clean; 577 KiB data, 344 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-12T02:34:21.014 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 12 02:34:20 smithi172 ceph-mon[35609]: from='mgr.14150 172.21.15.39:0/408627207' entity='mgr.x' 2024-09-12T02:34:21.014 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 12 02:34:20 smithi172 ceph-mon[35609]: from='mgr.14150 172.21.15.39:0/408627207' entity='mgr.x' 2024-09-12T02:34:21.014 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 12 02:34:20 smithi172 ceph-mon[35609]: from='mgr.14150 172.21.15.39:0/408627207' entity='mgr.x' 2024-09-12T02:34:21.014 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 12 02:34:20 smithi172 ceph-mon[35609]: from='mgr.14150 172.21.15.39:0/408627207' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.j", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-09-12T02:34:21.014 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 12 02:34:20 smithi172 ceph-mon[35609]: from='mgr.14150 172.21.15.39:0/408627207' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.j", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-09-12T02:34:21.014 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 12 02:34:20 smithi172 ceph-mon[35609]: from='mgr.14150 172.21.15.39:0/408627207' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-12T02:34:21.014 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 12 02:34:20 smithi172 ceph-mon[35609]: Deploying daemon mds.j on smithi039 2024-09-12T02:34:21.100 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 02:34:20 smithi039 ceph-mon[30515]: pgmap v265: 1 pgs: 1 active+clean; 577 KiB data, 344 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-12T02:34:21.100 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 02:34:20 smithi039 ceph-mon[30515]: from='mgr.14150 172.21.15.39:0/408627207' entity='mgr.x' 2024-09-12T02:34:21.100 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 02:34:20 smithi039 ceph-mon[30515]: from='mgr.14150 172.21.15.39:0/408627207' entity='mgr.x' 2024-09-12T02:34:21.100 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 02:34:20 smithi039 ceph-mon[30515]: from='mgr.14150 172.21.15.39:0/408627207' entity='mgr.x' 2024-09-12T02:34:21.100 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 02:34:20 smithi039 ceph-mon[30515]: from='mgr.14150 172.21.15.39:0/408627207' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.j", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-09-12T02:34:21.100 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 02:34:20 smithi039 ceph-mon[30515]: from='mgr.14150 172.21.15.39:0/408627207' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.j", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-09-12T02:34:21.100 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 02:34:20 smithi039 ceph-mon[30515]: from='mgr.14150 172.21.15.39:0/408627207' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-12T02:34:21.100 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 02:34:20 smithi039 ceph-mon[30515]: Deploying daemon mds.j on smithi039 2024-09-12T02:34:22.005 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 02:34:21 smithi039 ceph-mon[30515]: mds.? [v2:172.21.15.44:6832/2359724364,v1:172.21.15.44:6833/2359724364] up:boot 2024-09-12T02:34:22.005 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 02:34:21 smithi039 ceph-mon[30515]: fsmap 2 up:standby 2024-09-12T02:34:22.005 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 02:34:21 smithi039 ceph-mon[30515]: from='mgr.14150 172.21.15.39:0/408627207' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "k"}]: dispatch 2024-09-12T02:34:22.005 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 02:34:21 smithi039 ceph-mon[30515]: pgmap v266: 1 pgs: 1 active+clean; 577 KiB data, 344 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-12T02:34:22.005 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 02:34:21 smithi039 ceph-mon[30515]: from='client.? 172.21.15.39:0/361152648' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-12T02:34:22.013 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 12 02:34:21 smithi044 ceph-mon[35411]: mds.? [v2:172.21.15.44:6832/2359724364,v1:172.21.15.44:6833/2359724364] up:boot 2024-09-12T02:34:22.013 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 12 02:34:21 smithi044 ceph-mon[35411]: fsmap 2 up:standby 2024-09-12T02:34:22.013 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 12 02:34:21 smithi044 ceph-mon[35411]: from='mgr.14150 172.21.15.39:0/408627207' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "k"}]: dispatch 2024-09-12T02:34:22.013 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 12 02:34:21 smithi044 ceph-mon[35411]: pgmap v266: 1 pgs: 1 active+clean; 577 KiB data, 344 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-12T02:34:22.013 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 12 02:34:21 smithi044 ceph-mon[35411]: from='client.? 172.21.15.39:0/361152648' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-12T02:34:22.263 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 12 02:34:21 smithi172 ceph-mon[35609]: mds.? [v2:172.21.15.44:6832/2359724364,v1:172.21.15.44:6833/2359724364] up:boot 2024-09-12T02:34:22.264 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 12 02:34:21 smithi172 ceph-mon[35609]: fsmap 2 up:standby 2024-09-12T02:34:22.264 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 12 02:34:21 smithi172 ceph-mon[35609]: from='mgr.14150 172.21.15.39:0/408627207' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "k"}]: dispatch 2024-09-12T02:34:22.264 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 12 02:34:21 smithi172 ceph-mon[35609]: pgmap v266: 1 pgs: 1 active+clean; 577 KiB data, 344 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-12T02:34:22.264 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 12 02:34:21 smithi172 ceph-mon[35609]: from='client.? 172.21.15.39:0/361152648' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-12T02:34:23.728 DEBUG:teuthology.orchestra.run.smithi039:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc shell --fsid 4954ed46-70ae-11ef-bcea-c7b262605968 -- ceph fs dump --format=json 2024-09-12T02:34:24.099 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 02:34:23 smithi039 ceph-mon[30515]: pgmap v267: 1 pgs: 1 active+clean; 577 KiB data, 344 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-12T02:34:24.199 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 12 02:34:23 smithi044 ceph-mon[35411]: pgmap v267: 1 pgs: 1 active+clean; 577 KiB data, 344 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-12T02:34:24.264 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 12 02:34:23 smithi172 ceph-mon[35609]: pgmap v267: 1 pgs: 1 active+clean; 577 KiB data, 344 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-12T02:34:24.350 INFO:journalctl@ceph.mds.j.smithi039.stdout:Sep 12 02:34:24 smithi039 podman[69154]: 2024-09-12 02:34:24.12373236 +0000 UTC m=+0.150450339 container create 80f513251c79309e69ebff41206476219bd1a40ee22e746486eac8e1e57f55e9 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:3be30d720e37ec4df7f667e60f22b4d221c4ce7b408e68b90f9ac10220535e66, name=ceph-4954ed46-70ae-11ef-bcea-c7b262605968-mds-j, RELEASE=squid-b53b6d3, GIT_CLEAN=True, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.build-date=20240731, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.schema-version=1.0, org.label-schema.license=GPLv2, io.buildah.version=1.37.2, GIT_REPO=git@github.com:ceph/ceph-container.git, CEPH_POINT_RELEASE=, GIT_BRANCH=HEAD, maintainer=Guillaume Abrioux , ceph=True, org.label-schema.vendor=CentOS) 2024-09-12T02:34:24.543 INFO:teuthology.orchestra.run.smithi039.stderr:Inferring config /var/lib/ceph/4954ed46-70ae-11ef-bcea-c7b262605968/mon.a/config 2024-09-12T02:34:24.689 INFO:journalctl@ceph.mds.j.smithi039.stdout:Sep 12 02:34:24 smithi039 podman[69154]: 2024-09-12 02:34:24.372471675 +0000 UTC m=+0.399189683 container init 80f513251c79309e69ebff41206476219bd1a40ee22e746486eac8e1e57f55e9 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:3be30d720e37ec4df7f667e60f22b4d221c4ce7b408e68b90f9ac10220535e66, name=ceph-4954ed46-70ae-11ef-bcea-c7b262605968-mds-j, io.buildah.version=1.37.2, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.build-date=20240731, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, RELEASE=squid-b53b6d3, org.label-schema.license=GPLv2, CEPH_POINT_RELEASE=, maintainer=Guillaume Abrioux , org.label-schema.schema-version=1.0, org.label-schema.vendor=CentOS, GIT_BRANCH=HEAD, GIT_CLEAN=True, ceph=True) 2024-09-12T02:34:24.689 INFO:journalctl@ceph.mds.j.smithi039.stdout:Sep 12 02:34:24 smithi039 podman[69154]: 2024-09-12 02:34:24.378593317 +0000 UTC m=+0.405311307 container start 80f513251c79309e69ebff41206476219bd1a40ee22e746486eac8e1e57f55e9 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:3be30d720e37ec4df7f667e60f22b4d221c4ce7b408e68b90f9ac10220535e66, name=ceph-4954ed46-70ae-11ef-bcea-c7b262605968-mds-j, GIT_CLEAN=True, org.label-schema.schema-version=1.0, org.label-schema.build-date=20240731, org.label-schema.license=GPLv2, CEPH_POINT_RELEASE=, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.name=CentOS Stream 9 Base Image, RELEASE=squid-b53b6d3, GIT_BRANCH=HEAD, org.label-schema.vendor=CentOS, maintainer=Guillaume Abrioux , io.buildah.version=1.37.2, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, ceph=True) 2024-09-12T02:34:24.689 INFO:journalctl@ceph.mds.j.smithi039.stdout:Sep 12 02:34:24 smithi039 ceph-mds[69196]: -- 172.21.15.39:0/962510348 <== mon.1 v2:172.21.15.172:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 194+0+0 (secure 0 0 0) 0x55e1d3411860 con 0x55e1d33ef000 2024-09-12T02:34:24.689 INFO:journalctl@ceph.mds.j.smithi039.stdout:Sep 12 02:34:24 smithi039 ceph-4954ed46-70ae-11ef-bcea-c7b262605968-mds-j[69192]: starting mds.j at 2024-09-12T02:34:24.689 INFO:journalctl@ceph.mds.j.smithi039.stdout:Sep 12 02:34:24 smithi039 bash[69154]: 80f513251c79309e69ebff41206476219bd1a40ee22e746486eac8e1e57f55e9 2024-09-12T02:34:24.689 INFO:journalctl@ceph.mds.j.smithi039.stdout:Sep 12 02:34:24 smithi039 systemd[1]: Started Ceph mds.j for 4954ed46-70ae-11ef-bcea-c7b262605968. 2024-09-12T02:34:25.136 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:34:25.135+0000 7f80af000640 1 -- 172.21.15.39:0/4012108531 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f80a81049a0 msgr2=0x7f80a81089f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:34:25.136 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:34:25.135+0000 7f80af000640 1 --2- 172.21.15.39:0/4012108531 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f80a81049a0 0x7f80a81089f0 secure :-1 s=READY pgs=135 cs=0 l=1 rev1=1 crypto rx=0x7f8094009900 tx=0x7f809402a410 comp rx=0 tx=0).stop 2024-09-12T02:34:25.136 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:34:25.135+0000 7f80af000640 1 -- 172.21.15.39:0/4012108531 shutdown_connections 2024-09-12T02:34:25.136 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:34:25.135+0000 7f80af000640 1 --2- 172.21.15.39:0/4012108531 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f80a8109120 0x7f80a8110ca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:34:25.136 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:34:25.135+0000 7f80af000640 1 --2- 172.21.15.39:0/4012108531 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f80a81049a0 0x7f80a81089f0 unknown :-1 s=CLOSED pgs=135 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:34:25.136 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:34:25.135+0000 7f80af000640 1 --2- 172.21.15.39:0/4012108531 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f80a8103ff0 0x7f80a81043d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:34:25.136 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:34:25.135+0000 7f80af000640 1 -- 172.21.15.39:0/4012108531 >> 172.21.15.39:0/4012108531 conn(0x7f80a80ffa90 msgr2=0x7f80a8101eb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:34:25.137 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:34:25.135+0000 7f80af000640 1 -- 172.21.15.39:0/4012108531 shutdown_connections 2024-09-12T02:34:25.137 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:34:25.135+0000 7f80af000640 1 -- 172.21.15.39:0/4012108531 wait complete. 2024-09-12T02:34:25.138 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:34:25.136+0000 7f80af000640 1 Processor -- start 2024-09-12T02:34:25.138 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:34:25.136+0000 7f80af000640 1 -- start start 2024-09-12T02:34:25.138 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:34:25.136+0000 7f80af000640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f80a8103ff0 0x7f80a819a620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:34:25.139 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:34:25.136+0000 7f80af000640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f80a81049a0 0x7f80a819ab60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:34:25.139 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:34:25.136+0000 7f80af000640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f80a8109120 0x7f80a819eef0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:34:25.139 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:34:25.136+0000 7f80af000640 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 -- 0x7f80a8114140 con 0x7f80a81049a0 2024-09-12T02:34:25.139 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:34:25.136+0000 7f80af000640 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x7f80a8113fc0 con 0x7f80a8109120 2024-09-12T02:34:25.139 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:34:25.136+0000 7f80af000640 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7f80a81142c0 con 0x7f80a8103ff0 2024-09-12T02:34:25.139 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:34:25.137+0000 7f80a7400640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f80a81049a0 0x7f80a819ab60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:34:25.139 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:34:25.137+0000 7f80a7e00640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f80a8103ff0 0x7f80a819a620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:34:25.139 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:34:25.137+0000 7f80ad000640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f80a8109120 0x7f80a819eef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:34:25.139 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:34:25.137+0000 7f80a7400640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f80a81049a0 0x7f80a819ab60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.39:3300/0 says I am v2:172.21.15.39:39216/0 (socket says 172.21.15.39:39216) 2024-09-12T02:34:25.139 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:34:25.137+0000 7f80a7400640 1 -- 172.21.15.39:0/2140028869 learned_addr learned my addr 172.21.15.39:0/2140028869 (peer_addr_for_me v2:172.21.15.39:0/0) 2024-09-12T02:34:25.139 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:34:25.137+0000 7f80ad000640 1 -- 172.21.15.39:0/2140028869 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f80a8103ff0 msgr2=0x7f80a819a620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:34:25.139 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:34:25.137+0000 7f80ad000640 1 --2- 172.21.15.39:0/2140028869 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f80a8103ff0 0x7f80a819a620 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:34:25.139 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:34:25.137+0000 7f80ad000640 1 -- 172.21.15.39:0/2140028869 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f80a81049a0 msgr2=0x7f80a819ab60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:34:25.140 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:34:25.137+0000 7f80ad000640 1 --2- 172.21.15.39:0/2140028869 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f80a81049a0 0x7f80a819ab60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:34:25.140 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:34:25.137+0000 7f80ad000640 1 -- 172.21.15.39:0/2140028869 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f80a819f5d0 con 0x7f80a8109120 2024-09-12T02:34:25.140 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:34:25.137+0000 7f80a7e00640 1 --2- 172.21.15.39:0/2140028869 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f80a8103ff0 0x7f80a819a620 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-12T02:34:25.140 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:34:25.137+0000 7f80ad000640 1 --2- 172.21.15.39:0/2140028869 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f80a8109120 0x7f80a819eef0 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7f80a0009fd0 tx=0x7f80a000ef10 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:34:25.140 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:34:25.138+0000 7f80a4c00640 1 -- 172.21.15.39:0/2140028869 <== mon.2 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f80a000ce20 con 0x7f80a8109120 2024-09-12T02:34:25.140 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:34:25.138+0000 7f80a4c00640 1 -- 172.21.15.39:0/2140028869 <== mon.2 v2:172.21.15.44:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f80a0005020 con 0x7f80a8109120 2024-09-12T02:34:25.140 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:34:25.138+0000 7f80af000640 1 -- 172.21.15.39:0/2140028869 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f80a819f8c0 con 0x7f80a8109120 2024-09-12T02:34:25.140 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:34:25.138+0000 7f80a4c00640 1 -- 172.21.15.39:0/2140028869 <== mon.2 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f80a0010720 con 0x7f80a8109120 2024-09-12T02:34:25.140 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:34:25.138+0000 7f80af000640 1 -- 172.21.15.39:0/2140028869 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f80a81a71a0 con 0x7f80a8109120 2024-09-12T02:34:25.140 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:34:25.139+0000 7f80af000640 1 -- 172.21.15.39:0/2140028869 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f80a81043d0 con 0x7f80a8109120 2024-09-12T02:34:25.141 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:34:25.141+0000 7f80a4c00640 1 -- 172.21.15.39:0/2140028869 <== mon.2 v2:172.21.15.44:3300/0 4 ==== mgrmap(e 16) ==== 137833+0+0 (secure 0 0 0) 0x7f80a0005540 con 0x7f80a8109120 2024-09-12T02:34:25.143 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:34:25.142+0000 7f80a4c00640 1 --2- 172.21.15.39:0/2140028869 >> [v2:172.21.15.39:6800/1725006999,v1:172.21.15.39:6801/1725006999] conn(0x7f808c0a2b80 0x7f808c0a5040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:34:25.143 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:34:25.142+0000 7f80a4c00640 1 -- 172.21.15.39:0/2140028869 <== mon.2 v2:172.21.15.44:3300/0 5 ==== osd_map(78..78 src has 1..78) ==== 7127+0+0 (secure 0 0 0) 0x7f80a00cf260 con 0x7f80a8109120 2024-09-12T02:34:25.143 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:34:25.142+0000 7f80a7e00640 1 --2- 172.21.15.39:0/2140028869 >> [v2:172.21.15.39:6800/1725006999,v1:172.21.15.39:6801/1725006999] conn(0x7f808c0a2b80 0x7f808c0a5040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:34:25.143 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:34:25.143+0000 7f80a7e00640 1 --2- 172.21.15.39:0/2140028869 >> [v2:172.21.15.39:6800/1725006999,v1:172.21.15.39:6801/1725006999] conn(0x7f808c0a2b80 0x7f808c0a5040 secure :-1 s=READY pgs=127 cs=0 l=1 rev1=1 crypto rx=0x7f8098009fc0 tx=0x7f8098005f90 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:34:25.147 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:34:25.146+0000 7f80a4c00640 1 -- 172.21.15.39:0/2140028869 <== mon.2 v2:172.21.15.44:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7f80a009c5c0 con 0x7f80a8109120 2024-09-12T02:34:25.374 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:34:25.373+0000 7f80af000640 1 -- 172.21.15.39:0/2140028869 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f80a802d7c0 con 0x7f80a8109120 2024-09-12T02:34:25.374 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:34:25.374+0000 7f80a4c00640 1 -- 172.21.15.39:0/2140028869 <== mon.2 v2:172.21.15.44:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 4 v4) ==== 93+0+3088 (secure 0 0 0) 0x7f80a009bec0 con 0x7f80a8109120 2024-09-12T02:34:25.375 INFO:teuthology.orchestra.run.smithi039.stdout: 2024-09-12T02:34:25.375 INFO:teuthology.orchestra.run.smithi039.stdout:{"epoch":4,"btime":"2024-09-12T02:34:24:855448+0000","default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14451,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.39:6835/2325642381","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6834","nonce":2325642381},{"type":"v1","addr":"172.21.15.39:6835","nonce":2325642381}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":24422,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.44:6833/2359724364","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6832","nonce":2359724364},{"type":"v1","addr":"172.21.15.44:6833","nonce":2359724364}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":24430,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.172:6833/3232434105","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6832","nonce":3232434105},{"type":"v1","addr":"172.21.15.172:6833","nonce":3232434105}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2}],"filesystems":[]} 2024-09-12T02:34:25.375 INFO:teuthology.orchestra.run.smithi039.stderr:dumped fsmap epoch 4 2024-09-12T02:34:25.377 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:34:25.376+0000 7f80af000640 1 -- 172.21.15.39:0/2140028869 >> [v2:172.21.15.39:6800/1725006999,v1:172.21.15.39:6801/1725006999] conn(0x7f808c0a2b80 msgr2=0x7f808c0a5040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:34:25.377 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:34:25.376+0000 7f80af000640 1 --2- 172.21.15.39:0/2140028869 >> [v2:172.21.15.39:6800/1725006999,v1:172.21.15.39:6801/1725006999] conn(0x7f808c0a2b80 0x7f808c0a5040 secure :-1 s=READY pgs=127 cs=0 l=1 rev1=1 crypto rx=0x7f8098009fc0 tx=0x7f8098005f90 comp rx=0 tx=0).stop 2024-09-12T02:34:25.377 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:34:25.376+0000 7f80af000640 1 -- 172.21.15.39:0/2140028869 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f80a8109120 msgr2=0x7f80a819eef0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:34:25.377 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:34:25.376+0000 7f80af000640 1 --2- 172.21.15.39:0/2140028869 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f80a8109120 0x7f80a819eef0 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7f80a0009fd0 tx=0x7f80a000ef10 comp rx=0 tx=0).stop 2024-09-12T02:34:25.377 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:34:25.376+0000 7f80af000640 1 -- 172.21.15.39:0/2140028869 shutdown_connections 2024-09-12T02:34:25.378 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:34:25.376+0000 7f80af000640 1 --2- 172.21.15.39:0/2140028869 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f80a8109120 0x7f80a819eef0 unknown :-1 s=CLOSED pgs=65 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:34:25.378 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:34:25.376+0000 7f80af000640 1 --2- 172.21.15.39:0/2140028869 >> [v2:172.21.15.39:6800/1725006999,v1:172.21.15.39:6801/1725006999] conn(0x7f808c0a2b80 0x7f808c0a5040 unknown :-1 s=CLOSED pgs=127 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:34:25.378 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:34:25.376+0000 7f80af000640 1 --2- 172.21.15.39:0/2140028869 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f80a81049a0 0x7f80a819ab60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:34:25.378 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:34:25.376+0000 7f80af000640 1 --2- 172.21.15.39:0/2140028869 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f80a8103ff0 0x7f80a819a620 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:34:25.378 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:34:25.376+0000 7f80af000640 1 -- 172.21.15.39:0/2140028869 >> 172.21.15.39:0/2140028869 conn(0x7f80a80ffa90 msgr2=0x7f80a8100d30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:34:25.378 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:34:25.377+0000 7f80af000640 1 -- 172.21.15.39:0/2140028869 shutdown_connections 2024-09-12T02:34:25.378 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:34:25.377+0000 7f80af000640 1 -- 172.21.15.39:0/2140028869 wait complete. 2024-09-12T02:34:25.633 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 02:34:25 smithi039 ceph-mon[30515]: from='mgr.14150 172.21.15.39:0/408627207' entity='mgr.x' 2024-09-12T02:34:25.633 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 02:34:25 smithi039 ceph-mon[30515]: from='mgr.14150 172.21.15.39:0/408627207' entity='mgr.x' 2024-09-12T02:34:25.633 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 02:34:25 smithi039 ceph-mon[30515]: from='mgr.14150 172.21.15.39:0/408627207' entity='mgr.x' 2024-09-12T02:34:25.633 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 02:34:25 smithi039 ceph-mon[30515]: from='mgr.14150 172.21.15.39:0/408627207' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.d", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-09-12T02:34:25.633 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 02:34:25 smithi039 ceph-mon[30515]: from='mgr.14150 172.21.15.39:0/408627207' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.d", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-09-12T02:34:25.633 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 02:34:25 smithi039 ceph-mon[30515]: from='mgr.14150 172.21.15.39:0/408627207' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-12T02:34:25.633 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 02:34:25 smithi039 ceph-mon[30515]: Deploying daemon mds.d on smithi039 2024-09-12T02:34:25.633 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 02:34:25 smithi039 ceph-mon[30515]: mds.? [v2:172.21.15.39:6834/2325642381,v1:172.21.15.39:6835/2325642381] up:boot 2024-09-12T02:34:25.633 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 02:34:25 smithi039 ceph-mon[30515]: fsmap 3 up:standby 2024-09-12T02:34:25.634 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 02:34:25 smithi039 ceph-mon[30515]: from='mgr.14150 172.21.15.39:0/408627207' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "j"}]: dispatch 2024-09-12T02:34:25.634 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 02:34:25 smithi039 ceph-mon[30515]: from='client.? 172.21.15.39:0/2140028869' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-12T02:34:25.948 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 12 02:34:25 smithi044 ceph-mon[35411]: from='mgr.14150 172.21.15.39:0/408627207' entity='mgr.x' 2024-09-12T02:34:25.949 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 12 02:34:25 smithi044 ceph-mon[35411]: from='mgr.14150 172.21.15.39:0/408627207' entity='mgr.x' 2024-09-12T02:34:25.949 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 12 02:34:25 smithi044 ceph-mon[35411]: from='mgr.14150 172.21.15.39:0/408627207' entity='mgr.x' 2024-09-12T02:34:25.949 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 12 02:34:25 smithi044 ceph-mon[35411]: from='mgr.14150 172.21.15.39:0/408627207' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.d", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-09-12T02:34:25.949 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 12 02:34:25 smithi044 ceph-mon[35411]: from='mgr.14150 172.21.15.39:0/408627207' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.d", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-09-12T02:34:25.949 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 12 02:34:25 smithi044 ceph-mon[35411]: from='mgr.14150 172.21.15.39:0/408627207' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-12T02:34:25.949 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 12 02:34:25 smithi044 ceph-mon[35411]: Deploying daemon mds.d on smithi039 2024-09-12T02:34:25.949 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 12 02:34:25 smithi044 ceph-mon[35411]: mds.? [v2:172.21.15.39:6834/2325642381,v1:172.21.15.39:6835/2325642381] up:boot 2024-09-12T02:34:25.949 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 12 02:34:25 smithi044 ceph-mon[35411]: fsmap 3 up:standby 2024-09-12T02:34:25.949 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 12 02:34:25 smithi044 ceph-mon[35411]: from='mgr.14150 172.21.15.39:0/408627207' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "j"}]: dispatch 2024-09-12T02:34:25.950 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 12 02:34:25 smithi044 ceph-mon[35411]: from='client.? 172.21.15.39:0/2140028869' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-12T02:34:26.014 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 12 02:34:25 smithi172 ceph-mon[35609]: from='mgr.14150 172.21.15.39:0/408627207' entity='mgr.x' 2024-09-12T02:34:26.014 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 12 02:34:25 smithi172 ceph-mon[35609]: from='mgr.14150 172.21.15.39:0/408627207' entity='mgr.x' 2024-09-12T02:34:26.014 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 12 02:34:25 smithi172 ceph-mon[35609]: from='mgr.14150 172.21.15.39:0/408627207' entity='mgr.x' 2024-09-12T02:34:26.014 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 12 02:34:25 smithi172 ceph-mon[35609]: from='mgr.14150 172.21.15.39:0/408627207' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.d", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-09-12T02:34:26.014 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 12 02:34:25 smithi172 ceph-mon[35609]: from='mgr.14150 172.21.15.39:0/408627207' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.d", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-09-12T02:34:26.014 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 12 02:34:25 smithi172 ceph-mon[35609]: from='mgr.14150 172.21.15.39:0/408627207' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-12T02:34:26.014 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 12 02:34:25 smithi172 ceph-mon[35609]: Deploying daemon mds.d on smithi039 2024-09-12T02:34:26.014 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 12 02:34:25 smithi172 ceph-mon[35609]: mds.? [v2:172.21.15.39:6834/2325642381,v1:172.21.15.39:6835/2325642381] up:boot 2024-09-12T02:34:26.014 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 12 02:34:25 smithi172 ceph-mon[35609]: fsmap 3 up:standby 2024-09-12T02:34:26.015 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 12 02:34:25 smithi172 ceph-mon[35609]: from='mgr.14150 172.21.15.39:0/408627207' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "j"}]: dispatch 2024-09-12T02:34:26.015 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 12 02:34:25 smithi172 ceph-mon[35609]: from='client.? 172.21.15.39:0/2140028869' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-12T02:34:26.850 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 02:34:26 smithi039 ceph-mon[30515]: pgmap v268: 1 pgs: 1 active+clean; 577 KiB data, 344 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-12T02:34:26.948 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 12 02:34:26 smithi044 ceph-mon[35411]: pgmap v268: 1 pgs: 1 active+clean; 577 KiB data, 344 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-12T02:34:27.013 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 12 02:34:26 smithi172 ceph-mon[35609]: pgmap v268: 1 pgs: 1 active+clean; 577 KiB data, 344 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-12T02:34:28.100 INFO:journalctl@ceph.mds.d.smithi039.stdout:Sep 12 02:34:27 smithi039 systemd[1]: Starting Ceph mds.d for 4954ed46-70ae-11ef-bcea-c7b262605968... 2024-09-12T02:34:28.384 INFO:journalctl@ceph.mds.d.smithi039.stdout:Sep 12 02:34:28 smithi039 podman[69541]: 2024-09-12 02:34:28.010419816 +0000 UTC m=+0.026363245 image pull 54467abc55f864c4f73dfaf9c6ac3bb3e87b773123d5badaf790bee57321d594 quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:3be30d720e37ec4df7f667e60f22b4d221c4ce7b408e68b90f9ac10220535e66 2024-09-12T02:34:28.384 INFO:journalctl@ceph.mds.d.smithi039.stdout:Sep 12 02:34:28 smithi039 podman[69541]: 2024-09-12 02:34:28.147973684 +0000 UTC m=+0.163917099 container create f31fd87cec948a9209584a190e2f47d5b97f2fcfe939ab578562deb9c49bfebb (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:3be30d720e37ec4df7f667e60f22b4d221c4ce7b408e68b90f9ac10220535e66, name=ceph-4954ed46-70ae-11ef-bcea-c7b262605968-mds-d, maintainer=Guillaume Abrioux , org.label-schema.vendor=CentOS, ceph=True, org.label-schema.license=GPLv2, RELEASE=squid-b53b6d3, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, io.buildah.version=1.37.2, org.label-schema.schema-version=1.0, org.label-schema.build-date=20240731, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_BRANCH=HEAD, GIT_CLEAN=True, org.label-schema.name=CentOS Stream 9 Base Image, CEPH_POINT_RELEASE=) 2024-09-12T02:34:28.384 INFO:journalctl@ceph.mds.d.smithi039.stdout:Sep 12 02:34:28 smithi039 podman[69541]: 2024-09-12 02:34:28.38378143 +0000 UTC m=+0.399724856 container init f31fd87cec948a9209584a190e2f47d5b97f2fcfe939ab578562deb9c49bfebb (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:3be30d720e37ec4df7f667e60f22b4d221c4ce7b408e68b90f9ac10220535e66, name=ceph-4954ed46-70ae-11ef-bcea-c7b262605968-mds-d, org.label-schema.schema-version=1.0, GIT_REPO=git@github.com:ceph/ceph-container.git, RELEASE=squid-b53b6d3, org.label-schema.name=CentOS Stream 9 Base Image, GIT_CLEAN=True, org.label-schema.build-date=20240731, io.buildah.version=1.37.2, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, ceph=True, org.label-schema.license=GPLv2, GIT_BRANCH=HEAD, org.label-schema.vendor=CentOS, CEPH_POINT_RELEASE=, maintainer=Guillaume Abrioux ) 2024-09-12T02:34:28.849 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 02:34:28 smithi039 ceph-mon[30515]: pgmap v269: 1 pgs: 1 active+clean; 577 KiB data, 344 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-12T02:34:28.850 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 02:34:28 smithi039 ceph-mon[30515]: from='mgr.14150 172.21.15.39:0/408627207' entity='mgr.x' 2024-09-12T02:34:28.850 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 02:34:28 smithi039 ceph-mon[30515]: from='mgr.14150 172.21.15.39:0/408627207' entity='mgr.x' 2024-09-12T02:34:28.850 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 02:34:28 smithi039 ceph-mon[30515]: from='mgr.14150 172.21.15.39:0/408627207' entity='mgr.x' 2024-09-12T02:34:28.850 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 02:34:28 smithi039 ceph-mon[30515]: from='mgr.14150 172.21.15.39:0/408627207' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.e", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-09-12T02:34:28.850 INFO:journalctl@ceph.mds.d.smithi039.stdout:Sep 12 02:34:28 smithi039 podman[69541]: 2024-09-12 02:34:28.389957057 +0000 UTC m=+0.405900481 container start f31fd87cec948a9209584a190e2f47d5b97f2fcfe939ab578562deb9c49bfebb (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:3be30d720e37ec4df7f667e60f22b4d221c4ce7b408e68b90f9ac10220535e66, name=ceph-4954ed46-70ae-11ef-bcea-c7b262605968-mds-d, org.label-schema.license=GPLv2, GIT_BRANCH=HEAD, maintainer=Guillaume Abrioux , RELEASE=squid-b53b6d3, ceph=True, CEPH_POINT_RELEASE=, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.vendor=CentOS, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, GIT_CLEAN=True, GIT_REPO=git@github.com:ceph/ceph-container.git, io.buildah.version=1.37.2, org.label-schema.schema-version=1.0, org.label-schema.build-date=20240731) 2024-09-12T02:34:28.850 INFO:journalctl@ceph.mds.d.smithi039.stdout:Sep 12 02:34:28 smithi039 ceph-mds[69560]: -- 172.21.15.39:0/3840128247 <== mon.0 v2:172.21.15.39:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 194+0+0 (secure 0 0 0) 0x5568e315f860 con 0x5568e313d400 2024-09-12T02:34:28.850 INFO:journalctl@ceph.mds.d.smithi039.stdout:Sep 12 02:34:28 smithi039 ceph-4954ed46-70ae-11ef-bcea-c7b262605968-mds-d[69556]: starting mds.d at 2024-09-12T02:34:28.850 INFO:journalctl@ceph.mds.d.smithi039.stdout:Sep 12 02:34:28 smithi039 bash[69541]: f31fd87cec948a9209584a190e2f47d5b97f2fcfe939ab578562deb9c49bfebb 2024-09-12T02:34:28.851 INFO:journalctl@ceph.mds.d.smithi039.stdout:Sep 12 02:34:28 smithi039 systemd[1]: Started Ceph mds.d for 4954ed46-70ae-11ef-bcea-c7b262605968. 2024-09-12T02:34:28.948 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 12 02:34:28 smithi044 ceph-mon[35411]: pgmap v269: 1 pgs: 1 active+clean; 577 KiB data, 344 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-12T02:34:28.948 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 12 02:34:28 smithi044 ceph-mon[35411]: from='mgr.14150 172.21.15.39:0/408627207' entity='mgr.x' 2024-09-12T02:34:28.949 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 12 02:34:28 smithi044 ceph-mon[35411]: from='mgr.14150 172.21.15.39:0/408627207' entity='mgr.x' 2024-09-12T02:34:28.949 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 12 02:34:28 smithi044 ceph-mon[35411]: from='mgr.14150 172.21.15.39:0/408627207' entity='mgr.x' 2024-09-12T02:34:28.949 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 12 02:34:28 smithi044 ceph-mon[35411]: from='mgr.14150 172.21.15.39:0/408627207' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.e", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-09-12T02:34:29.013 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 12 02:34:28 smithi172 ceph-mon[35609]: pgmap v269: 1 pgs: 1 active+clean; 577 KiB data, 344 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-12T02:34:29.013 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 12 02:34:28 smithi172 ceph-mon[35609]: from='mgr.14150 172.21.15.39:0/408627207' entity='mgr.x' 2024-09-12T02:34:29.014 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 12 02:34:28 smithi172 ceph-mon[35609]: from='mgr.14150 172.21.15.39:0/408627207' entity='mgr.x' 2024-09-12T02:34:29.014 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 12 02:34:28 smithi172 ceph-mon[35609]: from='mgr.14150 172.21.15.39:0/408627207' entity='mgr.x' 2024-09-12T02:34:29.014 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 12 02:34:28 smithi172 ceph-mon[35609]: from='mgr.14150 172.21.15.39:0/408627207' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.e", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-09-12T02:34:29.511 DEBUG:teuthology.orchestra.run.smithi039:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc shell --fsid 4954ed46-70ae-11ef-bcea-c7b262605968 -- ceph fs dump --format=json 2024-09-12T02:34:29.850 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 02:34:29 smithi039 ceph-mon[30515]: from='mgr.14150 172.21.15.39:0/408627207' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.e", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-09-12T02:34:29.850 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 02:34:29 smithi039 ceph-mon[30515]: from='mgr.14150 172.21.15.39:0/408627207' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-12T02:34:29.850 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 02:34:29 smithi039 ceph-mon[30515]: Deploying daemon mds.e on smithi044 2024-09-12T02:34:29.850 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 02:34:29 smithi039 ceph-mon[30515]: mds.? [v2:172.21.15.39:6836/2743237008,v1:172.21.15.39:6837/2743237008] up:boot 2024-09-12T02:34:29.850 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 02:34:29 smithi039 ceph-mon[30515]: fsmap 4 up:standby 2024-09-12T02:34:29.850 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 02:34:29 smithi039 ceph-mon[30515]: from='mgr.14150 172.21.15.39:0/408627207' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "d"}]: dispatch 2024-09-12T02:34:29.905 INFO:teuthology.orchestra.run.smithi039.stderr:Inferring config /var/lib/ceph/4954ed46-70ae-11ef-bcea-c7b262605968/mon.a/config 2024-09-12T02:34:29.949 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 12 02:34:29 smithi044 ceph-mon[35411]: from='mgr.14150 172.21.15.39:0/408627207' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.e", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-09-12T02:34:29.949 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 12 02:34:29 smithi044 ceph-mon[35411]: from='mgr.14150 172.21.15.39:0/408627207' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-12T02:34:29.949 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 12 02:34:29 smithi044 ceph-mon[35411]: Deploying daemon mds.e on smithi044 2024-09-12T02:34:29.949 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 12 02:34:29 smithi044 ceph-mon[35411]: mds.? [v2:172.21.15.39:6836/2743237008,v1:172.21.15.39:6837/2743237008] up:boot 2024-09-12T02:34:29.949 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 12 02:34:29 smithi044 ceph-mon[35411]: fsmap 4 up:standby 2024-09-12T02:34:29.949 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 12 02:34:29 smithi044 ceph-mon[35411]: from='mgr.14150 172.21.15.39:0/408627207' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "d"}]: dispatch 2024-09-12T02:34:30.013 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 12 02:34:29 smithi172 ceph-mon[35609]: from='mgr.14150 172.21.15.39:0/408627207' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.e", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-09-12T02:34:30.013 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 12 02:34:29 smithi172 ceph-mon[35609]: from='mgr.14150 172.21.15.39:0/408627207' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-12T02:34:30.014 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 12 02:34:29 smithi172 ceph-mon[35609]: Deploying daemon mds.e on smithi044 2024-09-12T02:34:30.014 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 12 02:34:29 smithi172 ceph-mon[35609]: mds.? [v2:172.21.15.39:6836/2743237008,v1:172.21.15.39:6837/2743237008] up:boot 2024-09-12T02:34:30.014 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 12 02:34:29 smithi172 ceph-mon[35609]: fsmap 4 up:standby 2024-09-12T02:34:30.014 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 12 02:34:29 smithi172 ceph-mon[35609]: from='mgr.14150 172.21.15.39:0/408627207' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "d"}]: dispatch 2024-09-12T02:34:30.555 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:34:30.551+0000 7fcf31600640 1 -- 172.21.15.39:0/840668038 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fcf2c102360 msgr2=0x7fcf2c10e890 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:34:30.555 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:34:30.551+0000 7fcf31600640 1 --2- 172.21.15.39:0/840668038 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fcf2c102360 0x7fcf2c10e890 secure :-1 s=READY pgs=137 cs=0 l=1 rev1=1 crypto rx=0x7fcf24009cd0 tx=0x7fcf2402a8e0 comp rx=0 tx=0).stop 2024-09-12T02:34:30.555 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:34:30.551+0000 7fcf31600640 1 -- 172.21.15.39:0/840668038 shutdown_connections 2024-09-12T02:34:30.555 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:34:30.551+0000 7fcf31600640 1 --2- 172.21.15.39:0/840668038 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fcf2c102360 0x7fcf2c10e890 unknown :-1 s=CLOSED pgs=137 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:34:30.555 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:34:30.551+0000 7fcf31600640 1 --2- 172.21.15.39:0/840668038 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fcf2c1019c0 0x7fcf2c101e20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:34:30.555 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:34:30.551+0000 7fcf31600640 1 --2- 172.21.15.39:0/840668038 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fcf2c1079c0 0x7fcf2c107da0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:34:30.555 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:34:30.551+0000 7fcf31600640 1 -- 172.21.15.39:0/840668038 >> 172.21.15.39:0/840668038 conn(0x7fcf2c0fd6e0 msgr2=0x7fcf2c0ffb00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:34:30.556 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:34:30.551+0000 7fcf31600640 1 -- 172.21.15.39:0/840668038 shutdown_connections 2024-09-12T02:34:30.556 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:34:30.551+0000 7fcf31600640 1 -- 172.21.15.39:0/840668038 wait complete. 2024-09-12T02:34:30.556 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:34:30.552+0000 7fcf31600640 1 Processor -- start 2024-09-12T02:34:30.556 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:34:30.552+0000 7fcf31600640 1 -- start start 2024-09-12T02:34:30.556 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:34:30.552+0000 7fcf31600640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fcf2c1019c0 0x7fcf2c0744f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:34:30.556 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:34:30.552+0000 7fcf31600640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fcf2c102360 0x7fcf2c074a30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:34:30.556 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:34:30.552+0000 7fcf31600640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fcf2c1079c0 0x7fcf2c074f70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:34:30.556 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:34:30.553+0000 7fcf31600640 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 -- 0x7fcf2c111dc0 con 0x7fcf2c102360 2024-09-12T02:34:30.556 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:34:30.553+0000 7fcf31600640 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x7fcf2c111c40 con 0x7fcf2c1019c0 2024-09-12T02:34:30.556 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:34:30.553+0000 7fcf31600640 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7fcf2c111f40 con 0x7fcf2c1079c0 2024-09-12T02:34:30.556 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:34:30.553+0000 7fcf2be00640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fcf2c1019c0 0x7fcf2c0744f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:34:30.556 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:34:30.553+0000 7fcf23400640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fcf2c102360 0x7fcf2c074a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:34:30.556 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:34:30.553+0000 7fcf2be00640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fcf2c1019c0 0x7fcf2c0744f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.39:59568/0 (socket says 172.21.15.39:59568) 2024-09-12T02:34:30.557 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:34:30.553+0000 7fcf2be00640 1 -- 172.21.15.39:0/811698585 learned_addr learned my addr 172.21.15.39:0/811698585 (peer_addr_for_me v2:172.21.15.39:0/0) 2024-09-12T02:34:30.557 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:34:30.553+0000 7fcf30c00640 1 --2- 172.21.15.39:0/811698585 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fcf2c1079c0 0x7fcf2c074f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:34:30.557 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:34:30.553+0000 7fcf2be00640 1 -- 172.21.15.39:0/811698585 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fcf2c1079c0 msgr2=0x7fcf2c074f70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:34:30.557 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:34:30.553+0000 7fcf2be00640 1 --2- 172.21.15.39:0/811698585 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fcf2c1079c0 0x7fcf2c074f70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:34:30.557 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:34:30.553+0000 7fcf2be00640 1 -- 172.21.15.39:0/811698585 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fcf2c102360 msgr2=0x7fcf2c074a30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:34:30.557 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:34:30.553+0000 7fcf2be00640 1 --2- 172.21.15.39:0/811698585 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fcf2c102360 0x7fcf2c074a30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:34:30.557 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:34:30.553+0000 7fcf2be00640 1 -- 172.21.15.39:0/811698585 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fcf2c1aac10 con 0x7fcf2c1019c0 2024-09-12T02:34:30.557 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:34:30.553+0000 7fcf23400640 1 --2- 172.21.15.39:0/811698585 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fcf2c102360 0x7fcf2c074a30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-12T02:34:30.557 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:34:30.554+0000 7fcf2be00640 1 --2- 172.21.15.39:0/811698585 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fcf2c1019c0 0x7fcf2c0744f0 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7fcf1c00e9f0 tx=0x7fcf1c00edf0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:34:30.557 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:34:30.554+0000 7fcf29600640 1 -- 172.21.15.39:0/811698585 <== mon.2 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcf1c00cd80 con 0x7fcf2c1019c0 2024-09-12T02:34:30.557 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:34:30.554+0000 7fcf29600640 1 -- 172.21.15.39:0/811698585 <== mon.2 v2:172.21.15.44:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fcf1c005500 con 0x7fcf2c1019c0 2024-09-12T02:34:30.557 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:34:30.554+0000 7fcf31600640 1 -- 172.21.15.39:0/811698585 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fcf2c1aae40 con 0x7fcf2c1019c0 2024-09-12T02:34:30.557 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:34:30.554+0000 7fcf29600640 1 -- 172.21.15.39:0/811698585 <== mon.2 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcf1c010690 con 0x7fcf2c1019c0 2024-09-12T02:34:30.558 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:34:30.554+0000 7fcf31600640 1 -- 172.21.15.39:0/811698585 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fcf2c1ab290 con 0x7fcf2c1019c0 2024-09-12T02:34:30.558 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:34:30.555+0000 7fcf31600640 1 -- 172.21.15.39:0/811698585 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fcf2c103100 con 0x7fcf2c1019c0 2024-09-12T02:34:30.558 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:34:30.557+0000 7fcf29600640 1 -- 172.21.15.39:0/811698585 <== mon.2 v2:172.21.15.44:3300/0 4 ==== mgrmap(e 16) ==== 137833+0+0 (secure 0 0 0) 0x7fcf1c0046c0 con 0x7fcf2c1019c0 2024-09-12T02:34:30.559 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:34:30.558+0000 7fcf29600640 1 --2- 172.21.15.39:0/811698585 >> [v2:172.21.15.39:6800/1725006999,v1:172.21.15.39:6801/1725006999] conn(0x7fcf100a2b80 0x7fcf100a5040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:34:30.559 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:34:30.558+0000 7fcf29600640 1 -- 172.21.15.39:0/811698585 <== mon.2 v2:172.21.15.44:3300/0 5 ==== osd_map(78..78 src has 1..78) ==== 7127+0+0 (secure 0 0 0) 0x7fcf1c0cefe0 con 0x7fcf2c1019c0 2024-09-12T02:34:30.559 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:34:30.558+0000 7fcf23400640 1 --2- 172.21.15.39:0/811698585 >> [v2:172.21.15.39:6800/1725006999,v1:172.21.15.39:6801/1725006999] conn(0x7fcf100a2b80 0x7fcf100a5040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:34:30.559 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:34:30.559+0000 7fcf23400640 1 --2- 172.21.15.39:0/811698585 >> [v2:172.21.15.39:6800/1725006999,v1:172.21.15.39:6801/1725006999] conn(0x7fcf100a2b80 0x7fcf100a5040 secure :-1 s=READY pgs=129 cs=0 l=1 rev1=1 crypto rx=0x7fcf2c075cb0 tx=0x7fcf1400b410 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:34:30.561 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:34:30.560+0000 7fcf29600640 1 -- 172.21.15.39:0/811698585 <== mon.2 v2:172.21.15.44:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7fcf1c09c340 con 0x7fcf2c1019c0 2024-09-12T02:34:30.787 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:34:30.786+0000 7fcf31600640 1 -- 172.21.15.39:0/811698585 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fcf2c101e20 con 0x7fcf2c1019c0 2024-09-12T02:34:30.788 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 02:34:30 smithi039 ceph-mon[30515]: pgmap v270: 1 pgs: 1 active+clean; 577 KiB data, 344 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-12T02:34:30.788 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:34:30.787+0000 7fcf29600640 1 -- 172.21.15.39:0/811698585 <== mon.2 v2:172.21.15.44:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 5 v5) ==== 93+0+3913 (secure 0 0 0) 0x7fcf2c101e20 con 0x7fcf2c1019c0 2024-09-12T02:34:30.788 INFO:teuthology.orchestra.run.smithi039.stdout: 2024-09-12T02:34:30.788 INFO:teuthology.orchestra.run.smithi039.stdout:{"epoch":5,"btime":"2024-09-12T02:34:28:583528+0000","default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14451,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.39:6835/2325642381","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6834","nonce":2325642381},{"type":"v1","addr":"172.21.15.39:6835","nonce":2325642381}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":24422,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.44:6833/2359724364","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6832","nonce":2359724364},{"type":"v1","addr":"172.21.15.44:6833","nonce":2359724364}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":24430,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.172:6833/3232434105","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6832","nonce":3232434105},{"type":"v1","addr":"172.21.15.172:6833","nonce":3232434105}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":24446,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.39:6837/2743237008","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6836","nonce":2743237008},{"type":"v1","addr":"172.21.15.39:6837","nonce":2743237008}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5}],"filesystems":[]} 2024-09-12T02:34:30.789 INFO:teuthology.orchestra.run.smithi039.stderr:dumped fsmap epoch 5 2024-09-12T02:34:30.790 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:34:30.789+0000 7fcf31600640 1 -- 172.21.15.39:0/811698585 >> [v2:172.21.15.39:6800/1725006999,v1:172.21.15.39:6801/1725006999] conn(0x7fcf100a2b80 msgr2=0x7fcf100a5040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:34:30.790 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:34:30.789+0000 7fcf31600640 1 --2- 172.21.15.39:0/811698585 >> [v2:172.21.15.39:6800/1725006999,v1:172.21.15.39:6801/1725006999] conn(0x7fcf100a2b80 0x7fcf100a5040 secure :-1 s=READY pgs=129 cs=0 l=1 rev1=1 crypto rx=0x7fcf2c075cb0 tx=0x7fcf1400b410 comp rx=0 tx=0).stop 2024-09-12T02:34:30.790 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:34:30.789+0000 7fcf31600640 1 -- 172.21.15.39:0/811698585 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fcf2c1019c0 msgr2=0x7fcf2c0744f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:34:30.790 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:34:30.789+0000 7fcf31600640 1 --2- 172.21.15.39:0/811698585 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fcf2c1019c0 0x7fcf2c0744f0 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7fcf1c00e9f0 tx=0x7fcf1c00edf0 comp rx=0 tx=0).stop 2024-09-12T02:34:30.791 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:34:30.790+0000 7fcf31600640 1 -- 172.21.15.39:0/811698585 shutdown_connections 2024-09-12T02:34:30.791 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:34:30.790+0000 7fcf31600640 1 --2- 172.21.15.39:0/811698585 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fcf2c1079c0 0x7fcf2c074f70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:34:30.791 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:34:30.790+0000 7fcf31600640 1 --2- 172.21.15.39:0/811698585 >> [v2:172.21.15.39:6800/1725006999,v1:172.21.15.39:6801/1725006999] conn(0x7fcf100a2b80 0x7fcf100a5040 unknown :-1 s=CLOSED pgs=129 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:34:30.791 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:34:30.790+0000 7fcf31600640 1 --2- 172.21.15.39:0/811698585 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fcf2c102360 0x7fcf2c074a30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:34:30.791 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:34:30.790+0000 7fcf31600640 1 --2- 172.21.15.39:0/811698585 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fcf2c1019c0 0x7fcf2c0744f0 unknown :-1 s=CLOSED pgs=67 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:34:30.791 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:34:30.790+0000 7fcf31600640 1 -- 172.21.15.39:0/811698585 >> 172.21.15.39:0/811698585 conn(0x7fcf2c0fd6e0 msgr2=0x7fcf2c0fde80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:34:30.791 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:34:30.790+0000 7fcf31600640 1 -- 172.21.15.39:0/811698585 shutdown_connections 2024-09-12T02:34:30.791 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:34:30.790+0000 7fcf31600640 1 -- 172.21.15.39:0/811698585 wait complete. 2024-09-12T02:34:30.903 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 12 02:34:30 smithi044 ceph-mon[35411]: pgmap v270: 1 pgs: 1 active+clean; 577 KiB data, 344 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-12T02:34:30.903 INFO:journalctl@ceph.mds.e.smithi044.stdout:Sep 12 02:34:30 smithi044 systemd[1]: Starting Ceph mds.e for 4954ed46-70ae-11ef-bcea-c7b262605968... 2024-09-12T02:34:31.013 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 12 02:34:30 smithi172 ceph-mon[35609]: pgmap v270: 1 pgs: 1 active+clean; 577 KiB data, 344 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-12T02:34:31.164 INFO:journalctl@ceph.mds.e.smithi044.stdout:Sep 12 02:34:30 smithi044 podman[64715]: 2024-09-12 02:34:30.805520825 +0000 UTC m=+0.015807247 image pull 54467abc55f864c4f73dfaf9c6ac3bb3e87b773123d5badaf790bee57321d594 quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:3be30d720e37ec4df7f667e60f22b4d221c4ce7b408e68b90f9ac10220535e66 2024-09-12T02:34:31.164 INFO:journalctl@ceph.mds.e.smithi044.stdout:Sep 12 02:34:31 smithi044 podman[64715]: 2024-09-12 02:34:31.030360385 +0000 UTC m=+0.240646807 container create 12f1740ebc2ca4f2b7675792f9d17ff64c031d6b814d216d1579ca0ab43b585f (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:3be30d720e37ec4df7f667e60f22b4d221c4ce7b408e68b90f9ac10220535e66, name=ceph-4954ed46-70ae-11ef-bcea-c7b262605968-mds-e, org.label-schema.license=GPLv2, RELEASE=squid-b53b6d3, io.buildah.version=1.37.2, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.build-date=20240731, GIT_CLEAN=True, GIT_REPO=git@github.com:ceph/ceph-container.git, CEPH_POINT_RELEASE=, GIT_BRANCH=HEAD, maintainer=Guillaume Abrioux , org.label-schema.vendor=CentOS, ceph=True, org.label-schema.schema-version=1.0, org.label-schema.name=CentOS Stream 9 Base Image) 2024-09-12T02:34:31.448 INFO:journalctl@ceph.mds.e.smithi044.stdout:Sep 12 02:34:31 smithi044 podman[64715]: 2024-09-12 02:34:31.283116425 +0000 UTC m=+0.493402862 container init 12f1740ebc2ca4f2b7675792f9d17ff64c031d6b814d216d1579ca0ab43b585f (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:3be30d720e37ec4df7f667e60f22b4d221c4ce7b408e68b90f9ac10220535e66, name=ceph-4954ed46-70ae-11ef-bcea-c7b262605968-mds-e, RELEASE=squid-b53b6d3, io.buildah.version=1.37.2, org.label-schema.build-date=20240731, ceph=True, org.label-schema.schema-version=1.0, org.label-schema.license=GPLv2, GIT_BRANCH=HEAD, maintainer=Guillaume Abrioux , GIT_REPO=git@github.com:ceph/ceph-container.git, CEPH_POINT_RELEASE=, org.label-schema.vendor=CentOS, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.name=CentOS Stream 9 Base Image, GIT_CLEAN=True) 2024-09-12T02:34:31.449 INFO:journalctl@ceph.mds.e.smithi044.stdout:Sep 12 02:34:31 smithi044 podman[64715]: 2024-09-12 02:34:31.286032989 +0000 UTC m=+0.496319411 container start 12f1740ebc2ca4f2b7675792f9d17ff64c031d6b814d216d1579ca0ab43b585f (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:3be30d720e37ec4df7f667e60f22b4d221c4ce7b408e68b90f9ac10220535e66, name=ceph-4954ed46-70ae-11ef-bcea-c7b262605968-mds-e, GIT_REPO=git@github.com:ceph/ceph-container.git, CEPH_POINT_RELEASE=, org.label-schema.vendor=CentOS, RELEASE=squid-b53b6d3, io.buildah.version=1.37.2, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.schema-version=1.0, GIT_BRANCH=HEAD, maintainer=Guillaume Abrioux , org.label-schema.license=GPLv2, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.build-date=20240731, GIT_CLEAN=True, ceph=True) 2024-09-12T02:34:31.449 INFO:journalctl@ceph.mds.e.smithi044.stdout:Sep 12 02:34:31 smithi044 ceph-mds[64734]: -- 172.21.15.44:0/4037600859 <== mon.2 v2:172.21.15.44:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 194+0+0 (secure 0 0 0) 0x56207e5ef860 con 0x56207e5cc800 2024-09-12T02:34:31.449 INFO:journalctl@ceph.mds.e.smithi044.stdout:Sep 12 02:34:31 smithi044 ceph-4954ed46-70ae-11ef-bcea-c7b262605968-mds-e[64730]: starting mds.e at 2024-09-12T02:34:31.449 INFO:journalctl@ceph.mds.e.smithi044.stdout:Sep 12 02:34:31 smithi044 bash[64715]: 12f1740ebc2ca4f2b7675792f9d17ff64c031d6b814d216d1579ca0ab43b585f 2024-09-12T02:34:31.449 INFO:journalctl@ceph.mds.e.smithi044.stdout:Sep 12 02:34:31 smithi044 systemd[1]: Started Ceph mds.e for 4954ed46-70ae-11ef-bcea-c7b262605968. 2024-09-12T02:34:31.849 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 02:34:31 smithi039 ceph-mon[30515]: from='client.? 172.21.15.39:0/811698585' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-12T02:34:31.850 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 02:34:31 smithi039 ceph-mon[30515]: from='mgr.14150 172.21.15.39:0/408627207' entity='mgr.x' 2024-09-12T02:34:31.850 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 02:34:31 smithi039 ceph-mon[30515]: from='mgr.14150 172.21.15.39:0/408627207' entity='mgr.x' 2024-09-12T02:34:31.850 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 02:34:31 smithi039 ceph-mon[30515]: from='mgr.14150 172.21.15.39:0/408627207' entity='mgr.x' 2024-09-12T02:34:31.850 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 02:34:31 smithi039 ceph-mon[30515]: from='mgr.14150 172.21.15.39:0/408627207' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.f", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-09-12T02:34:31.850 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 02:34:31 smithi039 ceph-mon[30515]: from='mgr.14150 172.21.15.39:0/408627207' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.f", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-09-12T02:34:31.850 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 02:34:31 smithi039 ceph-mon[30515]: from='mgr.14150 172.21.15.39:0/408627207' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-12T02:34:31.878 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 12 02:34:31 smithi172 ceph-mon[35609]: from='client.? 172.21.15.39:0/811698585' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-12T02:34:31.878 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 12 02:34:31 smithi172 ceph-mon[35609]: from='mgr.14150 172.21.15.39:0/408627207' entity='mgr.x' 2024-09-12T02:34:31.878 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 12 02:34:31 smithi172 ceph-mon[35609]: from='mgr.14150 172.21.15.39:0/408627207' entity='mgr.x' 2024-09-12T02:34:31.878 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 12 02:34:31 smithi172 ceph-mon[35609]: from='mgr.14150 172.21.15.39:0/408627207' entity='mgr.x' 2024-09-12T02:34:31.878 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 12 02:34:31 smithi172 ceph-mon[35609]: from='mgr.14150 172.21.15.39:0/408627207' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.f", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-09-12T02:34:31.878 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 12 02:34:31 smithi172 ceph-mon[35609]: from='mgr.14150 172.21.15.39:0/408627207' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.f", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-09-12T02:34:31.880 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 12 02:34:31 smithi172 ceph-mon[35609]: from='mgr.14150 172.21.15.39:0/408627207' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-12T02:34:31.948 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 12 02:34:31 smithi044 ceph-mon[35411]: from='client.? 172.21.15.39:0/811698585' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-12T02:34:31.948 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 12 02:34:31 smithi044 ceph-mon[35411]: from='mgr.14150 172.21.15.39:0/408627207' entity='mgr.x' 2024-09-12T02:34:31.949 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 12 02:34:31 smithi044 ceph-mon[35411]: from='mgr.14150 172.21.15.39:0/408627207' entity='mgr.x' 2024-09-12T02:34:31.949 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 12 02:34:31 smithi044 ceph-mon[35411]: from='mgr.14150 172.21.15.39:0/408627207' entity='mgr.x' 2024-09-12T02:34:31.949 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 12 02:34:31 smithi044 ceph-mon[35411]: from='mgr.14150 172.21.15.39:0/408627207' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.f", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-09-12T02:34:31.949 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 12 02:34:31 smithi044 ceph-mon[35411]: from='mgr.14150 172.21.15.39:0/408627207' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.f", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-09-12T02:34:31.949 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 12 02:34:31 smithi044 ceph-mon[35411]: from='mgr.14150 172.21.15.39:0/408627207' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-12T02:34:32.913 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 12 02:34:32 smithi172 ceph-mon[35609]: pgmap v271: 1 pgs: 1 active+clean; 577 KiB data, 344 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-12T02:34:32.913 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 12 02:34:32 smithi172 ceph-mon[35609]: Deploying daemon mds.f on smithi172 2024-09-12T02:34:32.913 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 12 02:34:32 smithi172 ceph-mon[35609]: mds.? [v2:172.21.15.44:6834/4063842354,v1:172.21.15.44:6835/4063842354] up:boot 2024-09-12T02:34:32.913 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 12 02:34:32 smithi172 ceph-mon[35609]: fsmap 5 up:standby 2024-09-12T02:34:32.914 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 12 02:34:32 smithi172 ceph-mon[35609]: from='mgr.14150 172.21.15.39:0/408627207' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "e"}]: dispatch 2024-09-12T02:34:32.948 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 12 02:34:32 smithi044 ceph-mon[35411]: pgmap v271: 1 pgs: 1 active+clean; 577 KiB data, 344 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-12T02:34:32.949 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 12 02:34:32 smithi044 ceph-mon[35411]: Deploying daemon mds.f on smithi172 2024-09-12T02:34:32.949 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 12 02:34:32 smithi044 ceph-mon[35411]: mds.? [v2:172.21.15.44:6834/4063842354,v1:172.21.15.44:6835/4063842354] up:boot 2024-09-12T02:34:32.949 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 12 02:34:32 smithi044 ceph-mon[35411]: fsmap 5 up:standby 2024-09-12T02:34:32.949 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 12 02:34:32 smithi044 ceph-mon[35411]: from='mgr.14150 172.21.15.39:0/408627207' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "e"}]: dispatch 2024-09-12T02:34:33.100 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 02:34:32 smithi039 ceph-mon[30515]: pgmap v271: 1 pgs: 1 active+clean; 577 KiB data, 344 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-12T02:34:33.100 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 02:34:32 smithi039 ceph-mon[30515]: Deploying daemon mds.f on smithi172 2024-09-12T02:34:33.100 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 02:34:32 smithi039 ceph-mon[30515]: mds.? [v2:172.21.15.44:6834/4063842354,v1:172.21.15.44:6835/4063842354] up:boot 2024-09-12T02:34:33.100 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 02:34:32 smithi039 ceph-mon[30515]: fsmap 5 up:standby 2024-09-12T02:34:33.100 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 02:34:32 smithi039 ceph-mon[30515]: from='mgr.14150 172.21.15.39:0/408627207' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "e"}]: dispatch 2024-09-12T02:34:33.514 INFO:journalctl@ceph.mds.f.smithi172.stdout:Sep 12 02:34:33 smithi172 systemd[1]: Starting Ceph mds.f for 4954ed46-70ae-11ef-bcea-c7b262605968... 2024-09-12T02:34:33.549 DEBUG:teuthology.orchestra.run.smithi039:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc shell --fsid 4954ed46-70ae-11ef-bcea-c7b262605968 -- ceph fs dump --format=json 2024-09-12T02:34:33.890 INFO:journalctl@ceph.mds.f.smithi172.stdout:Sep 12 02:34:33 smithi172 podman[65906]: 2024-09-12 02:34:33.521107639 +0000 UTC m=+0.016229893 image pull 54467abc55f864c4f73dfaf9c6ac3bb3e87b773123d5badaf790bee57321d594 quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:3be30d720e37ec4df7f667e60f22b4d221c4ce7b408e68b90f9ac10220535e66 2024-09-12T02:34:33.891 INFO:journalctl@ceph.mds.f.smithi172.stdout:Sep 12 02:34:33 smithi172 podman[65906]: 2024-09-12 02:34:33.619757579 +0000 UTC m=+0.114879837 container create 054236d1dd920da392122c3235d9c817469fc161ad25a013954e28a900f7dd6f (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:3be30d720e37ec4df7f667e60f22b4d221c4ce7b408e68b90f9ac10220535e66, name=ceph-4954ed46-70ae-11ef-bcea-c7b262605968-mds-f, org.label-schema.license=GPLv2, org.label-schema.build-date=20240731, GIT_BRANCH=HEAD, org.label-schema.schema-version=1.0, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, CEPH_POINT_RELEASE=, io.buildah.version=1.37.2, GIT_REPO=git@github.com:ceph/ceph-container.git, maintainer=Guillaume Abrioux , org.label-schema.vendor=CentOS, org.label-schema.name=CentOS Stream 9 Base Image, ceph=True, RELEASE=squid-b53b6d3, GIT_CLEAN=True) 2024-09-12T02:34:33.891 INFO:journalctl@ceph.mds.f.smithi172.stdout:Sep 12 02:34:33 smithi172 podman[65906]: 2024-09-12 02:34:33.86424986 +0000 UTC m=+0.359372121 container init 054236d1dd920da392122c3235d9c817469fc161ad25a013954e28a900f7dd6f (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:3be30d720e37ec4df7f667e60f22b4d221c4ce7b408e68b90f9ac10220535e66, name=ceph-4954ed46-70ae-11ef-bcea-c7b262605968-mds-f, maintainer=Guillaume Abrioux , GIT_CLEAN=True, org.label-schema.build-date=20240731, ceph=True, org.label-schema.schema-version=1.0, io.buildah.version=1.37.2, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.license=GPLv2, RELEASE=squid-b53b6d3, org.label-schema.vendor=CentOS, GIT_BRANCH=HEAD, CEPH_POINT_RELEASE=, org.label-schema.name=CentOS Stream 9 Base Image, GIT_REPO=git@github.com:ceph/ceph-container.git) 2024-09-12T02:34:33.891 INFO:journalctl@ceph.mds.f.smithi172.stdout:Sep 12 02:34:33 smithi172 podman[65906]: 2024-09-12 02:34:33.86717304 +0000 UTC m=+0.362295291 container start 054236d1dd920da392122c3235d9c817469fc161ad25a013954e28a900f7dd6f (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:3be30d720e37ec4df7f667e60f22b4d221c4ce7b408e68b90f9ac10220535e66, name=ceph-4954ed46-70ae-11ef-bcea-c7b262605968-mds-f, maintainer=Guillaume Abrioux , GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, GIT_BRANCH=HEAD, org.label-schema.license=GPLv2, org.label-schema.build-date=20240731, io.buildah.version=1.37.2, org.label-schema.name=CentOS Stream 9 Base Image, GIT_REPO=git@github.com:ceph/ceph-container.git, RELEASE=squid-b53b6d3, org.label-schema.vendor=CentOS, GIT_CLEAN=True, org.label-schema.schema-version=1.0, CEPH_POINT_RELEASE=, ceph=True) 2024-09-12T02:34:33.937 INFO:teuthology.orchestra.run.smithi039.stderr:Inferring config /var/lib/ceph/4954ed46-70ae-11ef-bcea-c7b262605968/mon.a/config 2024-09-12T02:34:34.150 INFO:journalctl@ceph.mds.f.smithi172.stdout:Sep 12 02:34:33 smithi172 ceph-mds[65925]: -- 172.21.15.172:0/631872924 <== mon.1 v2:172.21.15.172:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 194+0+0 (secure 0 0 0) 0x55cf156cf860 con 0x55cf156ad000 2024-09-12T02:34:34.150 INFO:journalctl@ceph.mds.f.smithi172.stdout:Sep 12 02:34:33 smithi172 ceph-4954ed46-70ae-11ef-bcea-c7b262605968-mds-f[65921]: starting mds.f at 2024-09-12T02:34:34.150 INFO:journalctl@ceph.mds.f.smithi172.stdout:Sep 12 02:34:33 smithi172 bash[65906]: 054236d1dd920da392122c3235d9c817469fc161ad25a013954e28a900f7dd6f 2024-09-12T02:34:34.150 INFO:journalctl@ceph.mds.f.smithi172.stdout:Sep 12 02:34:33 smithi172 systemd[1]: Started Ceph mds.f for 4954ed46-70ae-11ef-bcea-c7b262605968. 2024-09-12T02:34:34.561 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:34:34.541+0000 7ff0d7e00640 1 -- 172.21.15.39:0/3165812920 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7ff0d8074510 msgr2=0x7ff0d80748f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:34:34.561 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:34:34.541+0000 7ff0d7e00640 1 --2- 172.21.15.39:0/3165812920 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7ff0d8074510 0x7ff0d80748f0 secure :-1 s=READY pgs=138 cs=0 l=1 rev1=1 crypto rx=0x7ff0c8009900 tx=0x7ff0c802a480 comp rx=0 tx=0).stop 2024-09-12T02:34:34.561 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:34:34.541+0000 7ff0d7e00640 1 -- 172.21.15.39:0/3165812920 shutdown_connections 2024-09-12T02:34:34.561 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:34:34.541+0000 7ff0d7e00640 1 --2- 172.21.15.39:0/3165812920 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7ff0d810e280 0x7ff0d8110670 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:34:34.561 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:34:34.541+0000 7ff0d7e00640 1 --2- 172.21.15.39:0/3165812920 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7ff0d8074e30 0x7ff0d810dd40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:34:34.561 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:34:34.541+0000 7ff0d7e00640 1 --2- 172.21.15.39:0/3165812920 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7ff0d8074510 0x7ff0d80748f0 unknown :-1 s=CLOSED pgs=138 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:34:34.562 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:34:34.541+0000 7ff0d7e00640 1 -- 172.21.15.39:0/3165812920 >> 172.21.15.39:0/3165812920 conn(0x7ff0d80fd740 msgr2=0x7ff0d80ffb60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:34:34.562 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:34:34.541+0000 7ff0d7e00640 1 -- 172.21.15.39:0/3165812920 shutdown_connections 2024-09-12T02:34:34.562 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:34:34.541+0000 7ff0d7e00640 1 -- 172.21.15.39:0/3165812920 wait complete. 2024-09-12T02:34:34.562 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:34:34.543+0000 7ff0d7e00640 1 Processor -- start 2024-09-12T02:34:34.562 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:34:34.543+0000 7ff0d7e00640 1 -- start start 2024-09-12T02:34:34.562 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:34:34.543+0000 7ff0d7e00640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7ff0d8074510 0x7ff0d819a4a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:34:34.562 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:34:34.543+0000 7ff0d7e00640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7ff0d8074e30 0x7ff0d819a9e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:34:34.562 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:34:34.543+0000 7ff0d7e00640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7ff0d810e280 0x7ff0d819ed70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:34:34.562 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:34:34.544+0000 7ff0d7e00640 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 -- 0x7ff0d8114000 con 0x7ff0d810e280 2024-09-12T02:34:34.562 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:34:34.544+0000 7ff0d7e00640 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x7ff0d8113e80 con 0x7ff0d8074e30 2024-09-12T02:34:34.562 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:34:34.544+0000 7ff0d7e00640 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7ff0d8114180 con 0x7ff0d8074510 2024-09-12T02:34:34.562 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:34:34.544+0000 7ff0d7400640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7ff0d810e280 0x7ff0d819ed70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:34:34.562 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:34:34.544+0000 7ff0d6000640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7ff0d8074e30 0x7ff0d819a9e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:34:34.563 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:34:34.544+0000 7ff0d6a00640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7ff0d8074510 0x7ff0d819a4a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:34:34.563 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:34:34.544+0000 7ff0d6000640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7ff0d8074e30 0x7ff0d819a9e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.39:59590/0 (socket says 172.21.15.39:59590) 2024-09-12T02:34:34.563 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:34:34.544+0000 7ff0d7400640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7ff0d810e280 0x7ff0d819ed70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.39:3300/0 says I am v2:172.21.15.39:60560/0 (socket says 172.21.15.39:60560) 2024-09-12T02:34:34.563 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:34:34.544+0000 7ff0d6000640 1 -- 172.21.15.39:0/3013730583 learned_addr learned my addr 172.21.15.39:0/3013730583 (peer_addr_for_me v2:172.21.15.39:0/0) 2024-09-12T02:34:34.563 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:34:34.544+0000 7ff0d7400640 1 -- 172.21.15.39:0/3013730583 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7ff0d8074510 msgr2=0x7ff0d819a4a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:34:34.563 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:34:34.544+0000 7ff0d7400640 1 --2- 172.21.15.39:0/3013730583 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7ff0d8074510 0x7ff0d819a4a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:34:34.563 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:34:34.544+0000 7ff0d7400640 1 -- 172.21.15.39:0/3013730583 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7ff0d8074e30 msgr2=0x7ff0d819a9e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:34:34.563 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:34:34.544+0000 7ff0d7400640 1 --2- 172.21.15.39:0/3013730583 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7ff0d8074e30 0x7ff0d819a9e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:34:34.563 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:34:34.544+0000 7ff0d7400640 1 -- 172.21.15.39:0/3013730583 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff0d819f450 con 0x7ff0d810e280 2024-09-12T02:34:34.563 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:34:34.544+0000 7ff0d6000640 1 --2- 172.21.15.39:0/3013730583 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7ff0d8074e30 0x7ff0d819a9e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-12T02:34:34.563 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:34:34.545+0000 7ff0d7400640 1 --2- 172.21.15.39:0/3013730583 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7ff0d810e280 0x7ff0d819ed70 secure :-1 s=READY pgs=139 cs=0 l=1 rev1=1 crypto rx=0x7ff0d0005fd0 tx=0x7ff0d000edd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:34:34.563 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:34:34.545+0000 7ff0cf400640 1 -- 172.21.15.39:0/3013730583 <== mon.0 v2:172.21.15.39:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff0d0004d20 con 0x7ff0d810e280 2024-09-12T02:34:34.564 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:34:34.545+0000 7ff0cf400640 1 -- 172.21.15.39:0/3013730583 <== mon.0 v2:172.21.15.39:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7ff0d0005020 con 0x7ff0d810e280 2024-09-12T02:34:34.564 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:34:34.545+0000 7ff0cf400640 1 -- 172.21.15.39:0/3013730583 <== mon.0 v2:172.21.15.39:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff0d00116d0 con 0x7ff0d810e280 2024-09-12T02:34:34.564 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:34:34.545+0000 7ff0d7e00640 1 -- 172.21.15.39:0/3013730583 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff0d819f740 con 0x7ff0d810e280 2024-09-12T02:34:34.564 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:34:34.545+0000 7ff0d7e00640 1 -- 172.21.15.39:0/3013730583 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff0d81a7020 con 0x7ff0d810e280 2024-09-12T02:34:34.564 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:34:34.546+0000 7ff0d7e00640 1 -- 172.21.15.39:0/3013730583 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ff0d80748f0 con 0x7ff0d810e280 2024-09-12T02:34:34.564 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:34:34.549+0000 7ff0cf400640 1 -- 172.21.15.39:0/3013730583 <== mon.0 v2:172.21.15.39:3300/0 4 ==== mgrmap(e 16) ==== 137833+0+0 (secure 0 0 0) 0x7ff0d0005540 con 0x7ff0d810e280 2024-09-12T02:34:34.564 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:34:34.550+0000 7ff0cf400640 1 --2- 172.21.15.39:0/3013730583 >> [v2:172.21.15.39:6800/1725006999,v1:172.21.15.39:6801/1725006999] conn(0x7ff0bc0a2c00 0x7ff0bc0a50c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:34:34.564 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:34:34.550+0000 7ff0cf400640 1 -- 172.21.15.39:0/3013730583 <== mon.0 v2:172.21.15.39:3300/0 5 ==== osd_map(78..78 src has 1..78) ==== 7127+0+0 (secure 0 0 0) 0x7ff0d00cef80 con 0x7ff0d810e280 2024-09-12T02:34:34.564 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:34:34.550+0000 7ff0d6a00640 1 --2- 172.21.15.39:0/3013730583 >> [v2:172.21.15.39:6800/1725006999,v1:172.21.15.39:6801/1725006999] conn(0x7ff0bc0a2c00 0x7ff0bc0a50c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:34:34.564 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:34:34.551+0000 7ff0d6a00640 1 --2- 172.21.15.39:0/3013730583 >> [v2:172.21.15.39:6800/1725006999,v1:172.21.15.39:6801/1725006999] conn(0x7ff0bc0a2c00 0x7ff0bc0a50c0 secure :-1 s=READY pgs=131 cs=0 l=1 rev1=1 crypto rx=0x7ff0c8000c00 tx=0x7ff0c8005b50 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:34:34.564 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:34:34.553+0000 7ff0cf400640 1 -- 172.21.15.39:0/3013730583 <== mon.0 v2:172.21.15.39:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7ff0d0016030 con 0x7ff0d810e280 2024-09-12T02:34:34.744 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 12 02:34:34 smithi172 ceph-mon[35609]: pgmap v272: 1 pgs: 1 active+clean; 577 KiB data, 344 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-12T02:34:34.744 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 12 02:34:34 smithi172 ceph-mon[35609]: from='mgr.14150 172.21.15.39:0/408627207' entity='mgr.x' 2024-09-12T02:34:34.745 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 12 02:34:34 smithi172 ceph-mon[35609]: from='mgr.14150 172.21.15.39:0/408627207' entity='mgr.x' 2024-09-12T02:34:34.745 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 12 02:34:34 smithi172 ceph-mon[35609]: from='mgr.14150 172.21.15.39:0/408627207' entity='mgr.x' 2024-09-12T02:34:34.745 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 12 02:34:34 smithi172 ceph-mon[35609]: from='mgr.14150 172.21.15.39:0/408627207' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.c", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-09-12T02:34:34.745 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 12 02:34:34 smithi172 ceph-mon[35609]: from='mgr.14150 172.21.15.39:0/408627207' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.c", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-09-12T02:34:34.745 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 12 02:34:34 smithi172 ceph-mon[35609]: from='mgr.14150 172.21.15.39:0/408627207' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-12T02:34:34.778 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:34:34.777+0000 7ff0d7e00640 1 -- 172.21.15.39:0/3013730583 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7ff0d819b800 con 0x7ff0d810e280 2024-09-12T02:34:34.778 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:34:34.778+0000 7ff0cf400640 1 -- 172.21.15.39:0/3013730583 <== mon.0 v2:172.21.15.39:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 7 v7) ==== 93+0+5566 (secure 0 0 0) 0x7ff0d819b800 con 0x7ff0d810e280 2024-09-12T02:34:34.779 INFO:teuthology.orchestra.run.smithi039.stdout: 2024-09-12T02:34:34.779 INFO:teuthology.orchestra.run.smithi039.stdout:{"epoch":7,"btime":"2024-09-12T02:34:34:624405+0000","default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14451,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.39:6835/2325642381","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6834","nonce":2325642381},{"type":"v1","addr":"172.21.15.39:6835","nonce":2325642381}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":24422,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.44:6833/2359724364","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6832","nonce":2359724364},{"type":"v1","addr":"172.21.15.44:6833","nonce":2359724364}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":24430,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.172:6833/3232434105","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6832","nonce":3232434105},{"type":"v1","addr":"172.21.15.172:6833","nonce":3232434105}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":24446,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.39:6837/2743237008","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6836","nonce":2743237008},{"type":"v1","addr":"172.21.15.39:6837","nonce":2743237008}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5},{"gid":24458,"name":"e","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.44:6835/4063842354","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6834","nonce":4063842354},{"type":"v1","addr":"172.21.15.44:6835","nonce":4063842354}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":6},{"gid":24472,"name":"f","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.172:6835/3274676014","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6834","nonce":3274676014},{"type":"v1","addr":"172.21.15.172:6835","nonce":3274676014}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":7}],"filesystems":[]} 2024-09-12T02:34:34.779 INFO:teuthology.orchestra.run.smithi039.stderr:dumped fsmap epoch 7 2024-09-12T02:34:34.781 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:34:34.780+0000 7ff0d7e00640 1 -- 172.21.15.39:0/3013730583 >> [v2:172.21.15.39:6800/1725006999,v1:172.21.15.39:6801/1725006999] conn(0x7ff0bc0a2c00 msgr2=0x7ff0bc0a50c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:34:34.781 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:34:34.780+0000 7ff0d7e00640 1 --2- 172.21.15.39:0/3013730583 >> [v2:172.21.15.39:6800/1725006999,v1:172.21.15.39:6801/1725006999] conn(0x7ff0bc0a2c00 0x7ff0bc0a50c0 secure :-1 s=READY pgs=131 cs=0 l=1 rev1=1 crypto rx=0x7ff0c8000c00 tx=0x7ff0c8005b50 comp rx=0 tx=0).stop 2024-09-12T02:34:34.781 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:34:34.780+0000 7ff0d7e00640 1 -- 172.21.15.39:0/3013730583 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7ff0d810e280 msgr2=0x7ff0d819ed70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:34:34.781 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:34:34.780+0000 7ff0d7e00640 1 --2- 172.21.15.39:0/3013730583 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7ff0d810e280 0x7ff0d819ed70 secure :-1 s=READY pgs=139 cs=0 l=1 rev1=1 crypto rx=0x7ff0d0005fd0 tx=0x7ff0d000edd0 comp rx=0 tx=0).stop 2024-09-12T02:34:34.781 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:34:34.780+0000 7ff0d7e00640 1 -- 172.21.15.39:0/3013730583 shutdown_connections 2024-09-12T02:34:34.781 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:34:34.780+0000 7ff0d7e00640 1 --2- 172.21.15.39:0/3013730583 >> [v2:172.21.15.39:6800/1725006999,v1:172.21.15.39:6801/1725006999] conn(0x7ff0bc0a2c00 0x7ff0bc0a50c0 unknown :-1 s=CLOSED pgs=131 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:34:34.781 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:34:34.780+0000 7ff0d7e00640 1 --2- 172.21.15.39:0/3013730583 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7ff0d810e280 0x7ff0d819ed70 unknown :-1 s=CLOSED pgs=139 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:34:34.781 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:34:34.780+0000 7ff0d7e00640 1 --2- 172.21.15.39:0/3013730583 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7ff0d8074e30 0x7ff0d819a9e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:34:34.781 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:34:34.780+0000 7ff0d7e00640 1 --2- 172.21.15.39:0/3013730583 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7ff0d8074510 0x7ff0d819a4a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:34:34.782 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:34:34.780+0000 7ff0d7e00640 1 -- 172.21.15.39:0/3013730583 >> 172.21.15.39:0/3013730583 conn(0x7ff0d80fd740 msgr2=0x7ff0d80fe3e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:34:34.782 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:34:34.780+0000 7ff0d7e00640 1 -- 172.21.15.39:0/3013730583 shutdown_connections 2024-09-12T02:34:34.782 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:34:34.780+0000 7ff0d7e00640 1 -- 172.21.15.39:0/3013730583 wait complete. 2024-09-12T02:34:34.795 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 02:34:34 smithi039 ceph-mon[30515]: pgmap v272: 1 pgs: 1 active+clean; 577 KiB data, 344 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-12T02:34:34.795 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 02:34:34 smithi039 ceph-mon[30515]: from='mgr.14150 172.21.15.39:0/408627207' entity='mgr.x' 2024-09-12T02:34:34.795 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 02:34:34 smithi039 ceph-mon[30515]: from='mgr.14150 172.21.15.39:0/408627207' entity='mgr.x' 2024-09-12T02:34:34.795 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 02:34:34 smithi039 ceph-mon[30515]: from='mgr.14150 172.21.15.39:0/408627207' entity='mgr.x' 2024-09-12T02:34:34.795 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 02:34:34 smithi039 ceph-mon[30515]: from='mgr.14150 172.21.15.39:0/408627207' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.c", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-09-12T02:34:34.795 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 02:34:34 smithi039 ceph-mon[30515]: from='mgr.14150 172.21.15.39:0/408627207' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.c", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-09-12T02:34:34.795 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 02:34:34 smithi039 ceph-mon[30515]: from='mgr.14150 172.21.15.39:0/408627207' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-12T02:34:34.948 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 12 02:34:34 smithi044 ceph-mon[35411]: pgmap v272: 1 pgs: 1 active+clean; 577 KiB data, 344 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-12T02:34:34.948 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 12 02:34:34 smithi044 ceph-mon[35411]: from='mgr.14150 172.21.15.39:0/408627207' entity='mgr.x' 2024-09-12T02:34:34.949 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 12 02:34:34 smithi044 ceph-mon[35411]: from='mgr.14150 172.21.15.39:0/408627207' entity='mgr.x' 2024-09-12T02:34:34.949 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 12 02:34:34 smithi044 ceph-mon[35411]: from='mgr.14150 172.21.15.39:0/408627207' entity='mgr.x' 2024-09-12T02:34:34.949 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 12 02:34:34 smithi044 ceph-mon[35411]: from='mgr.14150 172.21.15.39:0/408627207' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.c", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-09-12T02:34:34.949 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 12 02:34:34 smithi044 ceph-mon[35411]: from='mgr.14150 172.21.15.39:0/408627207' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.c", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-09-12T02:34:34.949 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 12 02:34:34 smithi044 ceph-mon[35411]: from='mgr.14150 172.21.15.39:0/408627207' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-12T02:34:35.764 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 12 02:34:35 smithi172 ceph-mon[35609]: Deploying daemon mds.c on smithi172 2024-09-12T02:34:35.764 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 12 02:34:35 smithi172 ceph-mon[35609]: mds.? [v2:172.21.15.172:6834/3274676014,v1:172.21.15.172:6835/3274676014] up:boot 2024-09-12T02:34:35.764 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 12 02:34:35 smithi172 ceph-mon[35609]: fsmap 6 up:standby 2024-09-12T02:34:35.764 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 12 02:34:35 smithi172 ceph-mon[35609]: from='mgr.14150 172.21.15.39:0/408627207' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "f"}]: dispatch 2024-09-12T02:34:35.764 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 12 02:34:35 smithi172 ceph-mon[35609]: from='client.? 172.21.15.39:0/3013730583' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-12T02:34:35.843 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 02:34:35 smithi039 ceph-mon[30515]: Deploying daemon mds.c on smithi172 2024-09-12T02:34:35.843 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 02:34:35 smithi039 ceph-mon[30515]: mds.? [v2:172.21.15.172:6834/3274676014,v1:172.21.15.172:6835/3274676014] up:boot 2024-09-12T02:34:35.843 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 02:34:35 smithi039 ceph-mon[30515]: fsmap 6 up:standby 2024-09-12T02:34:35.843 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 02:34:35 smithi039 ceph-mon[30515]: from='mgr.14150 172.21.15.39:0/408627207' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "f"}]: dispatch 2024-09-12T02:34:35.843 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 02:34:35 smithi039 ceph-mon[30515]: from='client.? 172.21.15.39:0/3013730583' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-12T02:34:35.948 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 12 02:34:35 smithi044 ceph-mon[35411]: Deploying daemon mds.c on smithi172 2024-09-12T02:34:35.949 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 12 02:34:35 smithi044 ceph-mon[35411]: mds.? [v2:172.21.15.172:6834/3274676014,v1:172.21.15.172:6835/3274676014] up:boot 2024-09-12T02:34:35.949 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 12 02:34:35 smithi044 ceph-mon[35411]: fsmap 6 up:standby 2024-09-12T02:34:35.949 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 12 02:34:35 smithi044 ceph-mon[35411]: from='mgr.14150 172.21.15.39:0/408627207' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "f"}]: dispatch 2024-09-12T02:34:35.949 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 12 02:34:35 smithi044 ceph-mon[35411]: from='client.? 172.21.15.39:0/3013730583' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-12T02:34:36.196 INFO:journalctl@ceph.mds.c.smithi172.stdout:Sep 12 02:34:35 smithi172 systemd[1]: Starting Ceph mds.c for 4954ed46-70ae-11ef-bcea-c7b262605968... 2024-09-12T02:34:36.446 INFO:journalctl@ceph.mds.c.smithi172.stdout:Sep 12 02:34:36 smithi172 podman[66205]: 2024-09-12 02:34:36.098205307 +0000 UTC m=+0.016111182 image pull 54467abc55f864c4f73dfaf9c6ac3bb3e87b773123d5badaf790bee57321d594 quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:3be30d720e37ec4df7f667e60f22b4d221c4ce7b408e68b90f9ac10220535e66 2024-09-12T02:34:36.446 INFO:journalctl@ceph.mds.c.smithi172.stdout:Sep 12 02:34:36 smithi172 podman[66205]: 2024-09-12 02:34:36.218163096 +0000 UTC m=+0.136069000 container create ff35a3c0915dbbcb3e6d43664cc1a0cba42f46a9c4b717a7267132ce259629c1 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:3be30d720e37ec4df7f667e60f22b4d221c4ce7b408e68b90f9ac10220535e66, name=ceph-4954ed46-70ae-11ef-bcea-c7b262605968-mds-c, CEPH_POINT_RELEASE=, GIT_CLEAN=True, org.label-schema.name=CentOS Stream 9 Base Image, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.build-date=20240731, GIT_BRANCH=HEAD, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.license=GPLv2, org.label-schema.vendor=CentOS, io.buildah.version=1.37.2, RELEASE=squid-b53b6d3, maintainer=Guillaume Abrioux , org.label-schema.schema-version=1.0, ceph=True) 2024-09-12T02:34:36.447 INFO:journalctl@ceph.mds.c.smithi172.stdout:Sep 12 02:34:36 smithi172 podman[66205]: 2024-09-12 02:34:36.446048784 +0000 UTC m=+0.363954652 container init ff35a3c0915dbbcb3e6d43664cc1a0cba42f46a9c4b717a7267132ce259629c1 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:3be30d720e37ec4df7f667e60f22b4d221c4ce7b408e68b90f9ac10220535e66, name=ceph-4954ed46-70ae-11ef-bcea-c7b262605968-mds-c, io.buildah.version=1.37.2, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.license=GPLv2, CEPH_POINT_RELEASE=, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.build-date=20240731, RELEASE=squid-b53b6d3, maintainer=Guillaume Abrioux , GIT_CLEAN=True, ceph=True, org.label-schema.vendor=CentOS, GIT_BRANCH=HEAD, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.schema-version=1.0) 2024-09-12T02:34:36.764 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 12 02:34:36 smithi172 ceph-mon[35609]: pgmap v273: 1 pgs: 1 active+clean; 577 KiB data, 344 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-12T02:34:36.764 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 12 02:34:36 smithi172 ceph-mon[35609]: from='mgr.14150 172.21.15.39:0/408627207' entity='mgr.x' 2024-09-12T02:34:36.764 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 12 02:34:36 smithi172 ceph-mon[35609]: from='mgr.14150 172.21.15.39:0/408627207' entity='mgr.x' 2024-09-12T02:34:36.765 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 12 02:34:36 smithi172 ceph-mon[35609]: from='mgr.14150 172.21.15.39:0/408627207' entity='mgr.x' 2024-09-12T02:34:36.765 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 12 02:34:36 smithi172 ceph-mon[35609]: from='mgr.14150 172.21.15.39:0/408627207' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.h", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-09-12T02:34:36.765 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 12 02:34:36 smithi172 ceph-mon[35609]: from='mgr.14150 172.21.15.39:0/408627207' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.h", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-09-12T02:34:36.765 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 12 02:34:36 smithi172 ceph-mon[35609]: from='mgr.14150 172.21.15.39:0/408627207' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-12T02:34:36.765 INFO:journalctl@ceph.mds.c.smithi172.stdout:Sep 12 02:34:36 smithi172 podman[66205]: 2024-09-12 02:34:36.448929928 +0000 UTC m=+0.366835788 container start ff35a3c0915dbbcb3e6d43664cc1a0cba42f46a9c4b717a7267132ce259629c1 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:3be30d720e37ec4df7f667e60f22b4d221c4ce7b408e68b90f9ac10220535e66, name=ceph-4954ed46-70ae-11ef-bcea-c7b262605968-mds-c, RELEASE=squid-b53b6d3, org.label-schema.vendor=CentOS, ceph=True, GIT_BRANCH=HEAD, maintainer=Guillaume Abrioux , org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.license=GPLv2, org.label-schema.schema-version=1.0, GIT_REPO=git@github.com:ceph/ceph-container.git, CEPH_POINT_RELEASE=, GIT_CLEAN=True, io.buildah.version=1.37.2, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.build-date=20240731) 2024-09-12T02:34:36.766 INFO:journalctl@ceph.mds.c.smithi172.stdout:Sep 12 02:34:36 smithi172 ceph-mds[66224]: -- 172.21.15.172:0/4289576879 <== mon.1 v2:172.21.15.172:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 194+0+0 (secure 0 0 0) 0x561c6e33f860 con 0x561c6e31c800 2024-09-12T02:34:36.766 INFO:journalctl@ceph.mds.c.smithi172.stdout:Sep 12 02:34:36 smithi172 ceph-4954ed46-70ae-11ef-bcea-c7b262605968-mds-c[66220]: starting mds.c at 2024-09-12T02:34:36.766 INFO:journalctl@ceph.mds.c.smithi172.stdout:Sep 12 02:34:36 smithi172 bash[66205]: ff35a3c0915dbbcb3e6d43664cc1a0cba42f46a9c4b717a7267132ce259629c1 2024-09-12T02:34:36.766 INFO:journalctl@ceph.mds.c.smithi172.stdout:Sep 12 02:34:36 smithi172 systemd[1]: Started Ceph mds.c for 4954ed46-70ae-11ef-bcea-c7b262605968. 2024-09-12T02:34:36.948 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 12 02:34:36 smithi044 ceph-mon[35411]: pgmap v273: 1 pgs: 1 active+clean; 577 KiB data, 344 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-12T02:34:36.948 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 12 02:34:36 smithi044 ceph-mon[35411]: from='mgr.14150 172.21.15.39:0/408627207' entity='mgr.x' 2024-09-12T02:34:36.949 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 12 02:34:36 smithi044 ceph-mon[35411]: from='mgr.14150 172.21.15.39:0/408627207' entity='mgr.x' 2024-09-12T02:34:36.949 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 12 02:34:36 smithi044 ceph-mon[35411]: from='mgr.14150 172.21.15.39:0/408627207' entity='mgr.x' 2024-09-12T02:34:36.949 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 12 02:34:36 smithi044 ceph-mon[35411]: from='mgr.14150 172.21.15.39:0/408627207' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.h", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-09-12T02:34:36.949 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 12 02:34:36 smithi044 ceph-mon[35411]: from='mgr.14150 172.21.15.39:0/408627207' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.h", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-09-12T02:34:36.949 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 12 02:34:36 smithi044 ceph-mon[35411]: from='mgr.14150 172.21.15.39:0/408627207' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-12T02:34:37.100 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 02:34:36 smithi039 ceph-mon[30515]: pgmap v273: 1 pgs: 1 active+clean; 577 KiB data, 344 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-12T02:34:37.100 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 02:34:36 smithi039 ceph-mon[30515]: from='mgr.14150 172.21.15.39:0/408627207' entity='mgr.x' 2024-09-12T02:34:37.100 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 02:34:36 smithi039 ceph-mon[30515]: from='mgr.14150 172.21.15.39:0/408627207' entity='mgr.x' 2024-09-12T02:34:37.100 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 02:34:36 smithi039 ceph-mon[30515]: from='mgr.14150 172.21.15.39:0/408627207' entity='mgr.x' 2024-09-12T02:34:37.100 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 02:34:36 smithi039 ceph-mon[30515]: from='mgr.14150 172.21.15.39:0/408627207' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.h", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-09-12T02:34:37.100 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 02:34:36 smithi039 ceph-mon[30515]: from='mgr.14150 172.21.15.39:0/408627207' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.h", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-09-12T02:34:37.100 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 02:34:36 smithi039 ceph-mon[30515]: from='mgr.14150 172.21.15.39:0/408627207' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-12T02:34:37.631 DEBUG:teuthology.orchestra.run.smithi039:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc shell --fsid 4954ed46-70ae-11ef-bcea-c7b262605968 -- ceph fs dump --format=json 2024-09-12T02:34:37.948 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 12 02:34:37 smithi044 ceph-mon[35411]: Deploying daemon mds.h on smithi044 2024-09-12T02:34:37.948 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 12 02:34:37 smithi044 ceph-mon[35411]: mds.? [v2:172.21.15.172:6836/493506747,v1:172.21.15.172:6837/493506747] up:boot 2024-09-12T02:34:37.949 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 12 02:34:37 smithi044 ceph-mon[35411]: fsmap 7 up:standby 2024-09-12T02:34:37.949 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 12 02:34:37 smithi044 ceph-mon[35411]: from='mgr.14150 172.21.15.39:0/408627207' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "c"}]: dispatch 2024-09-12T02:34:38.013 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 12 02:34:37 smithi172 ceph-mon[35609]: Deploying daemon mds.h on smithi044 2024-09-12T02:34:38.014 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 12 02:34:37 smithi172 ceph-mon[35609]: mds.? [v2:172.21.15.172:6836/493506747,v1:172.21.15.172:6837/493506747] up:boot 2024-09-12T02:34:38.014 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 12 02:34:37 smithi172 ceph-mon[35609]: fsmap 7 up:standby 2024-09-12T02:34:38.014 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 12 02:34:37 smithi172 ceph-mon[35609]: from='mgr.14150 172.21.15.39:0/408627207' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "c"}]: dispatch 2024-09-12T02:34:38.024 INFO:teuthology.orchestra.run.smithi039.stderr:Inferring config /var/lib/ceph/4954ed46-70ae-11ef-bcea-c7b262605968/mon.a/config 2024-09-12T02:34:38.099 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 02:34:37 smithi039 ceph-mon[30515]: Deploying daemon mds.h on smithi044 2024-09-12T02:34:38.100 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 02:34:37 smithi039 ceph-mon[30515]: mds.? [v2:172.21.15.172:6836/493506747,v1:172.21.15.172:6837/493506747] up:boot 2024-09-12T02:34:38.100 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 02:34:37 smithi039 ceph-mon[30515]: fsmap 7 up:standby 2024-09-12T02:34:38.100 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 02:34:37 smithi039 ceph-mon[30515]: from='mgr.14150 172.21.15.39:0/408627207' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "c"}]: dispatch 2024-09-12T02:34:38.577 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:34:38.572+0000 7fbe32200640 1 -- 172.21.15.39:0/2744256760 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fbe2c109120 msgr2=0x7fbe2c110ca0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:34:38.577 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:34:38.572+0000 7fbe32200640 1 --2- 172.21.15.39:0/2744256760 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fbe2c109120 0x7fbe2c110ca0 secure :-1 s=READY pgs=140 cs=0 l=1 rev1=1 crypto rx=0x7fbe24009ca0 tx=0x7fbe2402a8c0 comp rx=0 tx=0).stop 2024-09-12T02:34:38.577 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:34:38.572+0000 7fbe32200640 1 -- 172.21.15.39:0/2744256760 shutdown_connections 2024-09-12T02:34:38.578 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:34:38.572+0000 7fbe32200640 1 --2- 172.21.15.39:0/2744256760 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fbe2c109120 0x7fbe2c110ca0 unknown :-1 s=CLOSED pgs=140 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:34:38.578 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:34:38.572+0000 7fbe32200640 1 --2- 172.21.15.39:0/2744256760 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fbe2c1049a0 0x7fbe2c1089f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:34:38.578 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:34:38.572+0000 7fbe32200640 1 --2- 172.21.15.39:0/2744256760 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fbe2c103ff0 0x7fbe2c1043d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:34:38.578 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:34:38.572+0000 7fbe32200640 1 -- 172.21.15.39:0/2744256760 >> 172.21.15.39:0/2744256760 conn(0x7fbe2c0ffa90 msgr2=0x7fbe2c101eb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:34:38.578 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:34:38.572+0000 7fbe32200640 1 -- 172.21.15.39:0/2744256760 shutdown_connections 2024-09-12T02:34:38.578 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:34:38.572+0000 7fbe32200640 1 -- 172.21.15.39:0/2744256760 wait complete. 2024-09-12T02:34:38.578 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:34:38.573+0000 7fbe32200640 1 Processor -- start 2024-09-12T02:34:38.578 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:34:38.574+0000 7fbe32200640 1 -- start start 2024-09-12T02:34:38.578 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:34:38.574+0000 7fbe32200640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fbe2c103ff0 0x7fbe2c19a5a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:34:38.578 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:34:38.574+0000 7fbe32200640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fbe2c1049a0 0x7fbe2c19aae0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:34:38.578 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:34:38.574+0000 7fbe32200640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fbe2c109120 0x7fbe2c19ee70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:34:38.579 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:34:38.574+0000 7fbe32200640 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 -- 0x7fbe2c114180 con 0x7fbe2c1049a0 2024-09-12T02:34:38.579 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:34:38.574+0000 7fbe32200640 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x7fbe2c114000 con 0x7fbe2c103ff0 2024-09-12T02:34:38.579 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:34:38.574+0000 7fbe32200640 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7fbe2c114300 con 0x7fbe2c109120 2024-09-12T02:34:38.579 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:34:38.574+0000 7fbe2b400640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fbe2c103ff0 0x7fbe2c19a5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:34:38.579 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:34:38.574+0000 7fbe2aa00640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fbe2c1049a0 0x7fbe2c19aae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:34:38.579 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:34:38.574+0000 7fbe2b400640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fbe2c103ff0 0x7fbe2c19a5a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.39:41214/0 (socket says 172.21.15.39:41214) 2024-09-12T02:34:38.579 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:34:38.574+0000 7fbe2b400640 1 -- 172.21.15.39:0/1682256504 learned_addr learned my addr 172.21.15.39:0/1682256504 (peer_addr_for_me v2:172.21.15.39:0/0) 2024-09-12T02:34:38.579 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:34:38.575+0000 7fbe2be00640 1 --2- 172.21.15.39:0/1682256504 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fbe2c109120 0x7fbe2c19ee70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:34:38.579 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:34:38.575+0000 7fbe2b400640 1 -- 172.21.15.39:0/1682256504 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fbe2c109120 msgr2=0x7fbe2c19ee70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:34:38.579 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:34:38.575+0000 7fbe2b400640 1 --2- 172.21.15.39:0/1682256504 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fbe2c109120 0x7fbe2c19ee70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:34:38.579 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:34:38.575+0000 7fbe2b400640 1 -- 172.21.15.39:0/1682256504 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fbe2c1049a0 msgr2=0x7fbe2c19aae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:34:38.579 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:34:38.575+0000 7fbe2b400640 1 --2- 172.21.15.39:0/1682256504 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fbe2c1049a0 0x7fbe2c19aae0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:34:38.579 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:34:38.575+0000 7fbe2b400640 1 -- 172.21.15.39:0/1682256504 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fbe2c19f550 con 0x7fbe2c103ff0 2024-09-12T02:34:38.580 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:34:38.575+0000 7fbe2be00640 1 --2- 172.21.15.39:0/1682256504 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fbe2c109120 0x7fbe2c19ee70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-12T02:34:38.580 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:34:38.575+0000 7fbe2aa00640 1 --2- 172.21.15.39:0/1682256504 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fbe2c1049a0 0x7fbe2c19aae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-12T02:34:38.580 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:34:38.575+0000 7fbe2b400640 1 --2- 172.21.15.39:0/1682256504 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fbe2c103ff0 0x7fbe2c19a5a0 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7fbe1c00d950 tx=0x7fbe1c00de10 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:34:38.580 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:34:38.575+0000 7fbe23e00640 1 -- 172.21.15.39:0/1682256504 <== mon.2 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbe1c017070 con 0x7fbe2c103ff0 2024-09-12T02:34:38.580 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:34:38.576+0000 7fbe32200640 1 -- 172.21.15.39:0/1682256504 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fbe2c19f840 con 0x7fbe2c103ff0 2024-09-12T02:34:38.580 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:34:38.576+0000 7fbe23e00640 1 -- 172.21.15.39:0/1682256504 <== mon.2 v2:172.21.15.44:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fbe1c009c30 con 0x7fbe2c103ff0 2024-09-12T02:34:38.580 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:34:38.576+0000 7fbe23e00640 1 -- 172.21.15.39:0/1682256504 <== mon.2 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbe1c00f6b0 con 0x7fbe2c103ff0 2024-09-12T02:34:38.580 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:34:38.576+0000 7fbe32200640 1 -- 172.21.15.39:0/1682256504 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fbe2c1a7120 con 0x7fbe2c103ff0 2024-09-12T02:34:38.580 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:34:38.577+0000 7fbe32200640 1 -- 172.21.15.39:0/1682256504 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fbe2c1043d0 con 0x7fbe2c103ff0 2024-09-12T02:34:38.581 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:34:38.579+0000 7fbe23e00640 1 -- 172.21.15.39:0/1682256504 <== mon.2 v2:172.21.15.44:3300/0 4 ==== mgrmap(e 16) ==== 137833+0+0 (secure 0 0 0) 0x7fbe1c0109d0 con 0x7fbe2c103ff0 2024-09-12T02:34:38.581 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:34:38.580+0000 7fbe23e00640 1 --2- 172.21.15.39:0/1682256504 >> [v2:172.21.15.39:6800/1725006999,v1:172.21.15.39:6801/1725006999] conn(0x7fbe100a2c00 0x7fbe100a50c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:34:38.581 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:34:38.580+0000 7fbe23e00640 1 -- 172.21.15.39:0/1682256504 <== mon.2 v2:172.21.15.44:3300/0 5 ==== osd_map(78..78 src has 1..78) ==== 7127+0+0 (secure 0 0 0) 0x7fbe1c0ce7f0 con 0x7fbe2c103ff0 2024-09-12T02:34:38.581 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:34:38.580+0000 7fbe2aa00640 1 --2- 172.21.15.39:0/1682256504 >> [v2:172.21.15.39:6800/1725006999,v1:172.21.15.39:6801/1725006999] conn(0x7fbe100a2c00 0x7fbe100a50c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:34:38.581 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:34:38.581+0000 7fbe2aa00640 1 --2- 172.21.15.39:0/1682256504 >> [v2:172.21.15.39:6800/1725006999,v1:172.21.15.39:6801/1725006999] conn(0x7fbe100a2c00 0x7fbe100a50c0 secure :-1 s=READY pgs=134 cs=0 l=1 rev1=1 crypto rx=0x7fbe180095f0 tx=0x7fbe18005f90 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:34:38.583 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:34:38.582+0000 7fbe23e00640 1 -- 172.21.15.39:0/1682256504 <== mon.2 v2:172.21.15.44:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7fbe1c009de0 con 0x7fbe2c103ff0 2024-09-12T02:34:38.805 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:34:38.805+0000 7fbe32200640 1 -- 172.21.15.39:0/1682256504 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fbe2c19b900 con 0x7fbe2c103ff0 2024-09-12T02:34:38.806 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 02:34:38 smithi039 ceph-mon[30515]: pgmap v274: 1 pgs: 1 active+clean; 577 KiB data, 344 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-12T02:34:38.806 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:34:38.805+0000 7fbe23e00640 1 -- 172.21.15.39:0/1682256504 <== mon.2 v2:172.21.15.44:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 8 v8) ==== 93+0+6391 (secure 0 0 0) 0x7fbe2c19b900 con 0x7fbe2c103ff0 2024-09-12T02:34:38.807 INFO:teuthology.orchestra.run.smithi039.stdout: 2024-09-12T02:34:38.807 INFO:teuthology.orchestra.run.smithi039.stdout:{"epoch":8,"btime":"2024-09-12T02:34:36:657130+0000","default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14451,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.39:6835/2325642381","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6834","nonce":2325642381},{"type":"v1","addr":"172.21.15.39:6835","nonce":2325642381}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":24422,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.44:6833/2359724364","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6832","nonce":2359724364},{"type":"v1","addr":"172.21.15.44:6833","nonce":2359724364}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":24430,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.172:6833/3232434105","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6832","nonce":3232434105},{"type":"v1","addr":"172.21.15.172:6833","nonce":3232434105}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":24446,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.39:6837/2743237008","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6836","nonce":2743237008},{"type":"v1","addr":"172.21.15.39:6837","nonce":2743237008}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5},{"gid":24458,"name":"e","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.44:6835/4063842354","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6834","nonce":4063842354},{"type":"v1","addr":"172.21.15.44:6835","nonce":4063842354}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":6},{"gid":24472,"name":"f","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.172:6835/3274676014","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6834","nonce":3274676014},{"type":"v1","addr":"172.21.15.172:6835","nonce":3274676014}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":7},{"gid":24484,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.172:6837/493506747","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6836","nonce":493506747},{"type":"v1","addr":"172.21.15.172:6837","nonce":493506747}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":8}],"filesystems":[]} 2024-09-12T02:34:38.807 INFO:teuthology.orchestra.run.smithi039.stderr:dumped fsmap epoch 8 2024-09-12T02:34:38.809 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:34:38.808+0000 7fbe32200640 1 -- 172.21.15.39:0/1682256504 >> [v2:172.21.15.39:6800/1725006999,v1:172.21.15.39:6801/1725006999] conn(0x7fbe100a2c00 msgr2=0x7fbe100a50c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:34:38.809 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:34:38.808+0000 7fbe32200640 1 --2- 172.21.15.39:0/1682256504 >> [v2:172.21.15.39:6800/1725006999,v1:172.21.15.39:6801/1725006999] conn(0x7fbe100a2c00 0x7fbe100a50c0 secure :-1 s=READY pgs=134 cs=0 l=1 rev1=1 crypto rx=0x7fbe180095f0 tx=0x7fbe18005f90 comp rx=0 tx=0).stop 2024-09-12T02:34:38.809 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:34:38.808+0000 7fbe32200640 1 -- 172.21.15.39:0/1682256504 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fbe2c103ff0 msgr2=0x7fbe2c19a5a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:34:38.809 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:34:38.808+0000 7fbe32200640 1 --2- 172.21.15.39:0/1682256504 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fbe2c103ff0 0x7fbe2c19a5a0 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7fbe1c00d950 tx=0x7fbe1c00de10 comp rx=0 tx=0).stop 2024-09-12T02:34:38.809 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:34:38.808+0000 7fbe32200640 1 -- 172.21.15.39:0/1682256504 shutdown_connections 2024-09-12T02:34:38.809 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:34:38.808+0000 7fbe32200640 1 --2- 172.21.15.39:0/1682256504 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fbe2c109120 0x7fbe2c19ee70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:34:38.809 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:34:38.808+0000 7fbe32200640 1 --2- 172.21.15.39:0/1682256504 >> [v2:172.21.15.39:6800/1725006999,v1:172.21.15.39:6801/1725006999] conn(0x7fbe100a2c00 0x7fbe100a50c0 unknown :-1 s=CLOSED pgs=134 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:34:38.810 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:34:38.808+0000 7fbe32200640 1 --2- 172.21.15.39:0/1682256504 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fbe2c1049a0 0x7fbe2c19aae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:34:38.810 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:34:38.808+0000 7fbe32200640 1 --2- 172.21.15.39:0/1682256504 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fbe2c103ff0 0x7fbe2c19a5a0 unknown :-1 s=CLOSED pgs=70 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:34:38.810 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:34:38.808+0000 7fbe32200640 1 -- 172.21.15.39:0/1682256504 >> 172.21.15.39:0/1682256504 conn(0x7fbe2c0ffa90 msgr2=0x7fbe2c1005b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:34:38.810 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:34:38.808+0000 7fbe32200640 1 -- 172.21.15.39:0/1682256504 shutdown_connections 2024-09-12T02:34:38.810 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:34:38.808+0000 7fbe32200640 1 -- 172.21.15.39:0/1682256504 wait complete. 2024-09-12T02:34:38.949 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 12 02:34:38 smithi044 ceph-mon[35411]: pgmap v274: 1 pgs: 1 active+clean; 577 KiB data, 344 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-12T02:34:38.949 INFO:journalctl@ceph.mds.h.smithi044.stdout:Sep 12 02:34:38 smithi044 systemd[1]: Starting Ceph mds.h for 4954ed46-70ae-11ef-bcea-c7b262605968... 2024-09-12T02:34:39.013 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 12 02:34:38 smithi172 ceph-mon[35609]: pgmap v274: 1 pgs: 1 active+clean; 577 KiB data, 344 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-12T02:34:39.222 INFO:journalctl@ceph.mds.h.smithi044.stdout:Sep 12 02:34:38 smithi044 podman[65020]: 2024-09-12 02:34:38.871203552 +0000 UTC m=+0.016006156 image pull 54467abc55f864c4f73dfaf9c6ac3bb3e87b773123d5badaf790bee57321d594 quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:3be30d720e37ec4df7f667e60f22b4d221c4ce7b408e68b90f9ac10220535e66 2024-09-12T02:34:39.223 INFO:journalctl@ceph.mds.h.smithi044.stdout:Sep 12 02:34:38 smithi044 podman[65020]: 2024-09-12 02:34:38.978278101 +0000 UTC m=+0.123080727 container create 6a8800c1dc396dfc2f246d28c7fc7ff09898e6512da784fe60ef012a22f8ef11 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:3be30d720e37ec4df7f667e60f22b4d221c4ce7b408e68b90f9ac10220535e66, name=ceph-4954ed46-70ae-11ef-bcea-c7b262605968-mds-h, maintainer=Guillaume Abrioux , org.label-schema.license=GPLv2, CEPH_POINT_RELEASE=, org.label-schema.vendor=CentOS, org.label-schema.build-date=20240731, org.label-schema.schema-version=1.0, io.buildah.version=1.37.2, GIT_CLEAN=True, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_BRANCH=HEAD, org.label-schema.name=CentOS Stream 9 Base Image, ceph=True, RELEASE=squid-b53b6d3, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7) 2024-09-12T02:34:39.223 INFO:journalctl@ceph.mds.h.smithi044.stdout:Sep 12 02:34:39 smithi044 podman[65020]: 2024-09-12 02:34:39.223017052 +0000 UTC m=+0.367819636 container init 6a8800c1dc396dfc2f246d28c7fc7ff09898e6512da784fe60ef012a22f8ef11 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:3be30d720e37ec4df7f667e60f22b4d221c4ce7b408e68b90f9ac10220535e66, name=ceph-4954ed46-70ae-11ef-bcea-c7b262605968-mds-h, org.label-schema.build-date=20240731, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_BRANCH=HEAD, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.schema-version=1.0, org.label-schema.vendor=CentOS, RELEASE=squid-b53b6d3, maintainer=Guillaume Abrioux , org.label-schema.license=GPLv2, io.buildah.version=1.37.2, GIT_CLEAN=True, CEPH_POINT_RELEASE=, org.label-schema.name=CentOS Stream 9 Base Image, ceph=True) 2024-09-12T02:34:39.680 INFO:journalctl@ceph.mds.h.smithi044.stdout:Sep 12 02:34:39 smithi044 podman[65020]: 2024-09-12 02:34:39.225883989 +0000 UTC m=+0.370686574 container start 6a8800c1dc396dfc2f246d28c7fc7ff09898e6512da784fe60ef012a22f8ef11 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:3be30d720e37ec4df7f667e60f22b4d221c4ce7b408e68b90f9ac10220535e66, name=ceph-4954ed46-70ae-11ef-bcea-c7b262605968-mds-h, maintainer=Guillaume Abrioux , RELEASE=squid-b53b6d3, io.buildah.version=1.37.2, GIT_CLEAN=True, CEPH_POINT_RELEASE=, GIT_BRANCH=HEAD, org.label-schema.name=CentOS Stream 9 Base Image, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.schema-version=1.0, org.label-schema.vendor=CentOS, ceph=True, org.label-schema.license=GPLv2, org.label-schema.build-date=20240731) 2024-09-12T02:34:39.680 INFO:journalctl@ceph.mds.h.smithi044.stdout:Sep 12 02:34:39 smithi044 ceph-mds[65039]: -- 172.21.15.44:0/2328357368 <== mon.2 v2:172.21.15.44:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 194+0+0 (secure 0 0 0) 0x559ac0891c20 con 0x559ac086f400 2024-09-12T02:34:39.680 INFO:journalctl@ceph.mds.h.smithi044.stdout:Sep 12 02:34:39 smithi044 ceph-4954ed46-70ae-11ef-bcea-c7b262605968-mds-h[65035]: starting mds.h at 2024-09-12T02:34:39.680 INFO:journalctl@ceph.mds.h.smithi044.stdout:Sep 12 02:34:39 smithi044 bash[65020]: 6a8800c1dc396dfc2f246d28c7fc7ff09898e6512da784fe60ef012a22f8ef11 2024-09-12T02:34:39.680 INFO:journalctl@ceph.mds.h.smithi044.stdout:Sep 12 02:34:39 smithi044 systemd[1]: Started Ceph mds.h for 4954ed46-70ae-11ef-bcea-c7b262605968. 2024-09-12T02:34:39.938 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 12 02:34:39 smithi172 ceph-mon[35609]: from='client.? 172.21.15.39:0/1682256504' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-12T02:34:39.939 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 12 02:34:39 smithi172 ceph-mon[35609]: from='mgr.14150 172.21.15.39:0/408627207' entity='mgr.x' 2024-09-12T02:34:39.939 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 12 02:34:39 smithi172 ceph-mon[35609]: from='mgr.14150 172.21.15.39:0/408627207' entity='mgr.x' 2024-09-12T02:34:39.939 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 12 02:34:39 smithi172 ceph-mon[35609]: from='mgr.14150 172.21.15.39:0/408627207' entity='mgr.x' 2024-09-12T02:34:39.939 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 12 02:34:39 smithi172 ceph-mon[35609]: from='mgr.14150 172.21.15.39:0/408627207' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.i", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-09-12T02:34:39.939 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 12 02:34:39 smithi172 ceph-mon[35609]: from='mgr.14150 172.21.15.39:0/408627207' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.i", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-09-12T02:34:39.939 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 12 02:34:39 smithi172 ceph-mon[35609]: from='mgr.14150 172.21.15.39:0/408627207' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-12T02:34:39.948 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 12 02:34:39 smithi044 ceph-mon[35411]: from='client.? 172.21.15.39:0/1682256504' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-12T02:34:39.948 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 12 02:34:39 smithi044 ceph-mon[35411]: from='mgr.14150 172.21.15.39:0/408627207' entity='mgr.x' 2024-09-12T02:34:39.949 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 12 02:34:39 smithi044 ceph-mon[35411]: from='mgr.14150 172.21.15.39:0/408627207' entity='mgr.x' 2024-09-12T02:34:39.949 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 12 02:34:39 smithi044 ceph-mon[35411]: from='mgr.14150 172.21.15.39:0/408627207' entity='mgr.x' 2024-09-12T02:34:39.949 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 12 02:34:39 smithi044 ceph-mon[35411]: from='mgr.14150 172.21.15.39:0/408627207' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.i", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-09-12T02:34:39.949 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 12 02:34:39 smithi044 ceph-mon[35411]: from='mgr.14150 172.21.15.39:0/408627207' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.i", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-09-12T02:34:39.949 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 12 02:34:39 smithi044 ceph-mon[35411]: from='mgr.14150 172.21.15.39:0/408627207' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-12T02:34:40.100 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 02:34:39 smithi039 ceph-mon[30515]: from='client.? 172.21.15.39:0/1682256504' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-12T02:34:40.100 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 02:34:39 smithi039 ceph-mon[30515]: from='mgr.14150 172.21.15.39:0/408627207' entity='mgr.x' 2024-09-12T02:34:40.100 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 02:34:39 smithi039 ceph-mon[30515]: from='mgr.14150 172.21.15.39:0/408627207' entity='mgr.x' 2024-09-12T02:34:40.100 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 02:34:39 smithi039 ceph-mon[30515]: from='mgr.14150 172.21.15.39:0/408627207' entity='mgr.x' 2024-09-12T02:34:40.100 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 02:34:39 smithi039 ceph-mon[30515]: from='mgr.14150 172.21.15.39:0/408627207' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.i", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-09-12T02:34:40.100 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 02:34:39 smithi039 ceph-mon[30515]: from='mgr.14150 172.21.15.39:0/408627207' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.i", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-09-12T02:34:40.101 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 02:34:39 smithi039 ceph-mon[30515]: from='mgr.14150 172.21.15.39:0/408627207' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-12T02:34:40.948 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 12 02:34:40 smithi044 ceph-mon[35411]: pgmap v275: 1 pgs: 1 active+clean; 577 KiB data, 344 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-12T02:34:40.949 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 12 02:34:40 smithi044 ceph-mon[35411]: Deploying daemon mds.i on smithi172 2024-09-12T02:34:40.949 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 12 02:34:40 smithi044 ceph-mon[35411]: mds.? [v2:172.21.15.44:6836/1501493978,v1:172.21.15.44:6837/1501493978] up:boot 2024-09-12T02:34:40.949 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 12 02:34:40 smithi044 ceph-mon[35411]: fsmap 8 up:standby 2024-09-12T02:34:40.949 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 12 02:34:40 smithi044 ceph-mon[35411]: from='mgr.14150 172.21.15.39:0/408627207' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "h"}]: dispatch 2024-09-12T02:34:40.954 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 12 02:34:40 smithi172 ceph-mon[35609]: pgmap v275: 1 pgs: 1 active+clean; 577 KiB data, 344 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-12T02:34:40.954 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 12 02:34:40 smithi172 ceph-mon[35609]: Deploying daemon mds.i on smithi172 2024-09-12T02:34:40.954 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 12 02:34:40 smithi172 ceph-mon[35609]: mds.? [v2:172.21.15.44:6836/1501493978,v1:172.21.15.44:6837/1501493978] up:boot 2024-09-12T02:34:40.954 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 12 02:34:40 smithi172 ceph-mon[35609]: fsmap 8 up:standby 2024-09-12T02:34:40.954 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 12 02:34:40 smithi172 ceph-mon[35609]: from='mgr.14150 172.21.15.39:0/408627207' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "h"}]: dispatch 2024-09-12T02:34:41.099 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 02:34:40 smithi039 ceph-mon[30515]: pgmap v275: 1 pgs: 1 active+clean; 577 KiB data, 344 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-12T02:34:41.100 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 02:34:40 smithi039 ceph-mon[30515]: Deploying daemon mds.i on smithi172 2024-09-12T02:34:41.100 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 02:34:40 smithi039 ceph-mon[30515]: mds.? [v2:172.21.15.44:6836/1501493978,v1:172.21.15.44:6837/1501493978] up:boot 2024-09-12T02:34:41.100 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 02:34:40 smithi039 ceph-mon[30515]: fsmap 8 up:standby 2024-09-12T02:34:41.100 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 02:34:40 smithi039 ceph-mon[30515]: from='mgr.14150 172.21.15.39:0/408627207' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "h"}]: dispatch 2024-09-12T02:34:41.653 DEBUG:teuthology.orchestra.run.smithi039:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc shell --fsid 4954ed46-70ae-11ef-bcea-c7b262605968 -- ceph fs dump --format=json 2024-09-12T02:34:42.047 INFO:teuthology.orchestra.run.smithi039.stderr:Inferring config /var/lib/ceph/4954ed46-70ae-11ef-bcea-c7b262605968/mon.a/config 2024-09-12T02:34:42.264 INFO:journalctl@ceph.mds.i.smithi172.stdout:Sep 12 02:34:41 smithi172 systemd[1]: Started Ceph mds.i for 4954ed46-70ae-11ef-bcea-c7b262605968. 2024-09-12T02:34:42.682 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:34:42.681+0000 7f8245e00640 1 -- 172.21.15.39:0/580588769 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f8240074590 msgr2=0x7f8240074970 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:34:42.683 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:34:42.681+0000 7f8245e00640 1 --2- 172.21.15.39:0/580588769 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f8240074590 0x7f8240074970 secure :-1 s=READY pgs=141 cs=0 l=1 rev1=1 crypto rx=0x7f8230009900 tx=0x7f823002a480 comp rx=0 tx=0).stop 2024-09-12T02:34:42.683 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:34:42.681+0000 7f8245e00640 1 -- 172.21.15.39:0/580588769 shutdown_connections 2024-09-12T02:34:42.683 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:34:42.681+0000 7f8245e00640 1 --2- 172.21.15.39:0/580588769 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f8240112b90 0x7f8240114f80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:34:42.683 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:34:42.681+0000 7f8245e00640 1 --2- 172.21.15.39:0/580588769 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f8240074eb0 0x7f8240112650 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:34:42.683 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:34:42.681+0000 7f8245e00640 1 --2- 172.21.15.39:0/580588769 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f8240074590 0x7f8240074970 unknown :-1 s=CLOSED pgs=141 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:34:42.683 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:34:42.681+0000 7f8245e00640 1 -- 172.21.15.39:0/580588769 >> 172.21.15.39:0/580588769 conn(0x7f82400fd8c0 msgr2=0x7f82400ffce0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:34:42.683 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:34:42.681+0000 7f8245e00640 1 -- 172.21.15.39:0/580588769 shutdown_connections 2024-09-12T02:34:42.683 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:34:42.681+0000 7f8245e00640 1 -- 172.21.15.39:0/580588769 wait complete. 2024-09-12T02:34:42.684 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:34:42.682+0000 7f8245e00640 1 Processor -- start 2024-09-12T02:34:42.684 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:34:42.683+0000 7f8245e00640 1 -- start start 2024-09-12T02:34:42.684 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:34:42.683+0000 7f8245e00640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f8240074590 0x7f82401a4710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:34:42.684 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:34:42.683+0000 7f8245e00640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f8240074eb0 0x7f82401a4c50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:34:42.684 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:34:42.683+0000 7f8245e00640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f8240112b90 0x7f824019e8d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:34:42.684 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:34:42.683+0000 7f8245e00640 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 -- 0x7f82401185a0 con 0x7f8240074eb0 2024-09-12T02:34:42.685 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:34:42.683+0000 7f8245e00640 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x7f8240118420 con 0x7f8240074590 2024-09-12T02:34:42.685 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:34:42.683+0000 7f8245e00640 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7f8240118720 con 0x7f8240112b90 2024-09-12T02:34:42.685 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:34:42.683+0000 7f823ea00640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f8240074590 0x7f82401a4710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:34:42.685 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:34:42.683+0000 7f823ea00640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f8240074590 0x7f82401a4710 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.39:41232/0 (socket says 172.21.15.39:41232) 2024-09-12T02:34:42.685 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:34:42.683+0000 7f823ea00640 1 -- 172.21.15.39:0/755596578 learned_addr learned my addr 172.21.15.39:0/755596578 (peer_addr_for_me v2:172.21.15.39:0/0) 2024-09-12T02:34:42.685 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:34:42.683+0000 7f823e000640 1 --2- 172.21.15.39:0/755596578 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f8240074eb0 0x7f82401a4c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:34:42.685 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:34:42.683+0000 7f823f400640 1 --2- 172.21.15.39:0/755596578 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f8240112b90 0x7f824019e8d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:34:42.686 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:34:42.684+0000 7f823f400640 1 -- 172.21.15.39:0/755596578 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f8240074590 msgr2=0x7f82401a4710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:34:42.686 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:34:42.684+0000 7f823f400640 1 --2- 172.21.15.39:0/755596578 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f8240074590 0x7f82401a4710 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:34:42.686 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:34:42.684+0000 7f823f400640 1 -- 172.21.15.39:0/755596578 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f8240074eb0 msgr2=0x7f82401a4c50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:34:42.686 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:34:42.684+0000 7f823f400640 1 --2- 172.21.15.39:0/755596578 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f8240074eb0 0x7f82401a4c50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:34:42.686 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:34:42.684+0000 7f823f400640 1 -- 172.21.15.39:0/755596578 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f824019f000 con 0x7f8240112b90 2024-09-12T02:34:42.686 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:34:42.684+0000 7f823f400640 1 --2- 172.21.15.39:0/755596578 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f8240112b90 0x7f824019e8d0 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7f8238005fd0 tx=0x7f823800ef10 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:34:42.686 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:34:42.684+0000 7f8244a00640 1 -- 172.21.15.39:0/755596578 <== mon.1 v2:172.21.15.172:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f823800cdf0 con 0x7f8240112b90 2024-09-12T02:34:42.686 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:34:42.684+0000 7f8245e00640 1 -- 172.21.15.39:0/755596578 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f824019f2f0 con 0x7f8240112b90 2024-09-12T02:34:42.686 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:34:42.685+0000 7f8244a00640 1 -- 172.21.15.39:0/755596578 <== mon.1 v2:172.21.15.172:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f8238005020 con 0x7f8240112b90 2024-09-12T02:34:42.686 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:34:42.685+0000 7f8244a00640 1 -- 172.21.15.39:0/755596578 <== mon.1 v2:172.21.15.172:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f82380106d0 con 0x7f8240112b90 2024-09-12T02:34:42.686 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:34:42.685+0000 7f8245e00640 1 -- 172.21.15.39:0/755596578 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f82401ab5e0 con 0x7f8240112b90 2024-09-12T02:34:42.687 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:34:42.686+0000 7f8245e00640 1 -- 172.21.15.39:0/755596578 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f8240074970 con 0x7f8240112b90 2024-09-12T02:34:42.689 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:34:42.688+0000 7f8244a00640 1 -- 172.21.15.39:0/755596578 <== mon.1 v2:172.21.15.172:3300/0 4 ==== mgrmap(e 16) ==== 137833+0+0 (secure 0 0 0) 0x7f82380054d0 con 0x7f8240112b90 2024-09-12T02:34:42.690 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:34:42.689+0000 7f8244a00640 1 --2- 172.21.15.39:0/755596578 >> [v2:172.21.15.39:6800/1725006999,v1:172.21.15.39:6801/1725006999] conn(0x7f82240a2c00 0x7f82240a50c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:34:42.690 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:34:42.690+0000 7f823ea00640 1 --2- 172.21.15.39:0/755596578 >> [v2:172.21.15.39:6800/1725006999,v1:172.21.15.39:6801/1725006999] conn(0x7f82240a2c00 0x7f82240a50c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:34:42.691 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:34:42.690+0000 7f823ea00640 1 --2- 172.21.15.39:0/755596578 >> [v2:172.21.15.39:6800/1725006999,v1:172.21.15.39:6801/1725006999] conn(0x7f82240a2c00 0x7f82240a50c0 secure :-1 s=READY pgs=136 cs=0 l=1 rev1=1 crypto rx=0x7f82300096c0 tx=0x7f82300046c0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:34:42.691 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:34:42.691+0000 7f8244a00640 1 -- 172.21.15.39:0/755596578 <== mon.1 v2:172.21.15.172:3300/0 5 ==== osd_map(78..78 src has 1..78) ==== 7127+0+0 (secure 0 0 0) 0x7f82380cd270 con 0x7f8240112b90 2024-09-12T02:34:42.696 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:34:42.695+0000 7f8244a00640 1 -- 172.21.15.39:0/755596578 <== mon.1 v2:172.21.15.172:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7f823809c5c0 con 0x7f8240112b90 2024-09-12T02:34:42.850 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 02:34:42 smithi039 ceph-mon[30515]: pgmap v276: 1 pgs: 1 active+clean; 577 KiB data, 344 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-12T02:34:42.850 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 02:34:42 smithi039 ceph-mon[30515]: from='mgr.14150 172.21.15.39:0/408627207' entity='mgr.x' 2024-09-12T02:34:42.850 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 02:34:42 smithi039 ceph-mon[30515]: from='mgr.14150 172.21.15.39:0/408627207' entity='mgr.x' 2024-09-12T02:34:42.850 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 02:34:42 smithi039 ceph-mon[30515]: from='mgr.14150 172.21.15.39:0/408627207' entity='mgr.x' 2024-09-12T02:34:42.850 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 02:34:42 smithi039 ceph-mon[30515]: from='mgr.14150 172.21.15.39:0/408627207' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.g", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-09-12T02:34:42.850 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 02:34:42 smithi039 ceph-mon[30515]: from='mgr.14150 172.21.15.39:0/408627207' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.g", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-09-12T02:34:42.850 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 02:34:42 smithi039 ceph-mon[30515]: from='mgr.14150 172.21.15.39:0/408627207' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-12T02:34:42.937 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:34:42.936+0000 7f8245e00640 1 -- 172.21.15.39:0/755596578 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f824002d7c0 con 0x7f8240112b90 2024-09-12T02:34:42.938 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:34:42.937+0000 7f8244a00640 1 -- 172.21.15.39:0/755596578 <== mon.1 v2:172.21.15.172:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 10 v10) ==== 94+0+8046 (secure 0 0 0) 0x7f823809bec0 con 0x7f8240112b90 2024-09-12T02:34:42.938 INFO:teuthology.orchestra.run.smithi039.stdout: 2024-09-12T02:34:42.938 INFO:teuthology.orchestra.run.smithi039.stdout:{"epoch":10,"btime":"2024-09-12T02:34:42:684074+0000","default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14451,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.39:6835/2325642381","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6834","nonce":2325642381},{"type":"v1","addr":"172.21.15.39:6835","nonce":2325642381}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":24422,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.44:6833/2359724364","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6832","nonce":2359724364},{"type":"v1","addr":"172.21.15.44:6833","nonce":2359724364}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":24430,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.172:6833/3232434105","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6832","nonce":3232434105},{"type":"v1","addr":"172.21.15.172:6833","nonce":3232434105}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":24446,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.39:6837/2743237008","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6836","nonce":2743237008},{"type":"v1","addr":"172.21.15.39:6837","nonce":2743237008}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5},{"gid":24458,"name":"e","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.44:6835/4063842354","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6834","nonce":4063842354},{"type":"v1","addr":"172.21.15.44:6835","nonce":4063842354}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":6},{"gid":24472,"name":"f","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.172:6835/3274676014","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6834","nonce":3274676014},{"type":"v1","addr":"172.21.15.172:6835","nonce":3274676014}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":7},{"gid":24482,"name":"h","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.44:6837/1501493978","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6836","nonce":1501493978},{"type":"v1","addr":"172.21.15.44:6837","nonce":1501493978}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":9},{"gid":24484,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.172:6837/493506747","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6836","nonce":493506747},{"type":"v1","addr":"172.21.15.172:6837","nonce":493506747}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":8},{"gid":24499,"name":"i","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.172:6839/3742537097","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6838","nonce":3742537097},{"type":"v1","addr":"172.21.15.172:6839","nonce":3742537097}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":10}],"filesystems":[]} 2024-09-12T02:34:42.939 INFO:teuthology.orchestra.run.smithi039.stderr:dumped fsmap epoch 10 2024-09-12T02:34:42.941 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:34:42.940+0000 7f8245e00640 1 -- 172.21.15.39:0/755596578 >> [v2:172.21.15.39:6800/1725006999,v1:172.21.15.39:6801/1725006999] conn(0x7f82240a2c00 msgr2=0x7f82240a50c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:34:42.941 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:34:42.940+0000 7f8245e00640 1 --2- 172.21.15.39:0/755596578 >> [v2:172.21.15.39:6800/1725006999,v1:172.21.15.39:6801/1725006999] conn(0x7f82240a2c00 0x7f82240a50c0 secure :-1 s=READY pgs=136 cs=0 l=1 rev1=1 crypto rx=0x7f82300096c0 tx=0x7f82300046c0 comp rx=0 tx=0).stop 2024-09-12T02:34:42.941 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:34:42.940+0000 7f8245e00640 1 -- 172.21.15.39:0/755596578 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f8240112b90 msgr2=0x7f824019e8d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:34:42.941 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:34:42.940+0000 7f8245e00640 1 --2- 172.21.15.39:0/755596578 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f8240112b90 0x7f824019e8d0 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7f8238005fd0 tx=0x7f823800ef10 comp rx=0 tx=0).stop 2024-09-12T02:34:42.941 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:34:42.940+0000 7f8245e00640 1 -- 172.21.15.39:0/755596578 shutdown_connections 2024-09-12T02:34:42.942 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:34:42.940+0000 7f8245e00640 1 --2- 172.21.15.39:0/755596578 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f8240112b90 0x7f824019e8d0 unknown :-1 s=CLOSED pgs=65 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:34:42.942 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:34:42.940+0000 7f8245e00640 1 --2- 172.21.15.39:0/755596578 >> [v2:172.21.15.39:6800/1725006999,v1:172.21.15.39:6801/1725006999] conn(0x7f82240a2c00 0x7f82240a50c0 unknown :-1 s=CLOSED pgs=136 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:34:42.942 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:34:42.940+0000 7f8245e00640 1 --2- 172.21.15.39:0/755596578 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f8240074eb0 0x7f82401a4c50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:34:42.942 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:34:42.940+0000 7f8245e00640 1 --2- 172.21.15.39:0/755596578 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f8240074590 0x7f82401a4710 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:34:42.942 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:34:42.940+0000 7f8245e00640 1 -- 172.21.15.39:0/755596578 >> 172.21.15.39:0/755596578 conn(0x7f82400fd8c0 msgr2=0x7f82400ff010 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:34:42.942 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:34:42.940+0000 7f8245e00640 1 -- 172.21.15.39:0/755596578 shutdown_connections 2024-09-12T02:34:42.942 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:34:42.941+0000 7f8245e00640 1 -- 172.21.15.39:0/755596578 wait complete. 2024-09-12T02:34:42.948 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 12 02:34:42 smithi044 ceph-mon[35411]: pgmap v276: 1 pgs: 1 active+clean; 577 KiB data, 344 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-12T02:34:42.948 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 12 02:34:42 smithi044 ceph-mon[35411]: from='mgr.14150 172.21.15.39:0/408627207' entity='mgr.x' 2024-09-12T02:34:42.948 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 12 02:34:42 smithi044 ceph-mon[35411]: from='mgr.14150 172.21.15.39:0/408627207' entity='mgr.x' 2024-09-12T02:34:42.948 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 12 02:34:42 smithi044 ceph-mon[35411]: from='mgr.14150 172.21.15.39:0/408627207' entity='mgr.x' 2024-09-12T02:34:42.948 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 12 02:34:42 smithi044 ceph-mon[35411]: from='mgr.14150 172.21.15.39:0/408627207' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.g", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-09-12T02:34:42.949 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 12 02:34:42 smithi044 ceph-mon[35411]: from='mgr.14150 172.21.15.39:0/408627207' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.g", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-09-12T02:34:42.949 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 12 02:34:42 smithi044 ceph-mon[35411]: from='mgr.14150 172.21.15.39:0/408627207' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-12T02:34:43.014 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 12 02:34:42 smithi172 ceph-mon[35609]: pgmap v276: 1 pgs: 1 active+clean; 577 KiB data, 344 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-12T02:34:43.014 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 12 02:34:42 smithi172 ceph-mon[35609]: from='mgr.14150 172.21.15.39:0/408627207' entity='mgr.x' 2024-09-12T02:34:43.014 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 12 02:34:42 smithi172 ceph-mon[35609]: from='mgr.14150 172.21.15.39:0/408627207' entity='mgr.x' 2024-09-12T02:34:43.014 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 12 02:34:42 smithi172 ceph-mon[35609]: from='mgr.14150 172.21.15.39:0/408627207' entity='mgr.x' 2024-09-12T02:34:43.014 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 12 02:34:42 smithi172 ceph-mon[35609]: from='mgr.14150 172.21.15.39:0/408627207' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.g", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-09-12T02:34:43.014 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 12 02:34:42 smithi172 ceph-mon[35609]: from='mgr.14150 172.21.15.39:0/408627207' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.g", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-09-12T02:34:43.014 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 12 02:34:42 smithi172 ceph-mon[35609]: from='mgr.14150 172.21.15.39:0/408627207' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-12T02:34:44.013 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 12 02:34:43 smithi172 ceph-mon[35609]: Deploying daemon mds.g on smithi039 2024-09-12T02:34:44.013 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 12 02:34:43 smithi172 ceph-mon[35609]: mds.? [v2:172.21.15.172:6838/3742537097,v1:172.21.15.172:6839/3742537097] up:boot 2024-09-12T02:34:44.014 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 12 02:34:43 smithi172 ceph-mon[35609]: fsmap 9 up:standby 2024-09-12T02:34:44.014 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 12 02:34:43 smithi172 ceph-mon[35609]: from='mgr.14150 172.21.15.39:0/408627207' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "i"}]: dispatch 2024-09-12T02:34:44.014 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 12 02:34:43 smithi172 ceph-mon[35609]: from='client.? 172.21.15.39:0/755596578' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-12T02:34:44.033 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 02:34:43 smithi039 ceph-mon[30515]: Deploying daemon mds.g on smithi039 2024-09-12T02:34:44.033 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 02:34:43 smithi039 ceph-mon[30515]: mds.? [v2:172.21.15.172:6838/3742537097,v1:172.21.15.172:6839/3742537097] up:boot 2024-09-12T02:34:44.033 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 02:34:43 smithi039 ceph-mon[30515]: fsmap 9 up:standby 2024-09-12T02:34:44.033 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 02:34:43 smithi039 ceph-mon[30515]: from='mgr.14150 172.21.15.39:0/408627207' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "i"}]: dispatch 2024-09-12T02:34:44.033 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 02:34:43 smithi039 ceph-mon[30515]: from='client.? 172.21.15.39:0/755596578' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-12T02:34:44.198 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 12 02:34:43 smithi044 ceph-mon[35411]: Deploying daemon mds.g on smithi039 2024-09-12T02:34:44.198 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 12 02:34:43 smithi044 ceph-mon[35411]: mds.? [v2:172.21.15.172:6838/3742537097,v1:172.21.15.172:6839/3742537097] up:boot 2024-09-12T02:34:44.199 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 12 02:34:43 smithi044 ceph-mon[35411]: fsmap 9 up:standby 2024-09-12T02:34:44.199 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 12 02:34:43 smithi044 ceph-mon[35411]: from='mgr.14150 172.21.15.39:0/408627207' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "i"}]: dispatch 2024-09-12T02:34:44.199 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 12 02:34:43 smithi044 ceph-mon[35411]: from='client.? 172.21.15.39:0/755596578' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-12T02:34:45.013 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 12 02:34:44 smithi172 ceph-mon[35609]: pgmap v277: 1 pgs: 1 active+clean; 577 KiB data, 344 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-12T02:34:45.099 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 02:34:44 smithi039 ceph-mon[30515]: pgmap v277: 1 pgs: 1 active+clean; 577 KiB data, 344 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-12T02:34:45.198 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 12 02:34:44 smithi044 ceph-mon[35411]: pgmap v277: 1 pgs: 1 active+clean; 577 KiB data, 344 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-12T02:34:45.436 INFO:journalctl@ceph.mds.g.smithi039.stdout:Sep 12 02:34:45 smithi039 systemd[1]: Starting Ceph mds.g for 4954ed46-70ae-11ef-bcea-c7b262605968... 2024-09-12T02:34:45.784 INFO:journalctl@ceph.mds.g.smithi039.stdout:Sep 12 02:34:45 smithi039 podman[70302]: 2024-09-12 02:34:45.339924857 +0000 UTC m=+0.027993657 image pull 54467abc55f864c4f73dfaf9c6ac3bb3e87b773123d5badaf790bee57321d594 quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:3be30d720e37ec4df7f667e60f22b4d221c4ce7b408e68b90f9ac10220535e66 2024-09-12T02:34:45.784 INFO:journalctl@ceph.mds.g.smithi039.stdout:Sep 12 02:34:45 smithi039 podman[70302]: 2024-09-12 02:34:45.520462008 +0000 UTC m=+0.208530806 container create 13f74e89fc496bea7df398119551da5461ea3af6d9f0a2d55d421de84fbd9f14 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:3be30d720e37ec4df7f667e60f22b4d221c4ce7b408e68b90f9ac10220535e66, name=ceph-4954ed46-70ae-11ef-bcea-c7b262605968-mds-g, GIT_BRANCH=HEAD, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.vendor=CentOS, io.buildah.version=1.37.2, ceph=True, CEPH_POINT_RELEASE=, org.label-schema.build-date=20240731, maintainer=Guillaume Abrioux , org.label-schema.license=GPLv2, GIT_CLEAN=True, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, RELEASE=squid-b53b6d3, org.label-schema.schema-version=1.0, GIT_REPO=git@github.com:ceph/ceph-container.git) 2024-09-12T02:34:45.784 INFO:journalctl@ceph.mds.g.smithi039.stdout:Sep 12 02:34:45 smithi039 podman[70302]: 2024-09-12 02:34:45.784301872 +0000 UTC m=+0.472370671 container init 13f74e89fc496bea7df398119551da5461ea3af6d9f0a2d55d421de84fbd9f14 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:3be30d720e37ec4df7f667e60f22b4d221c4ce7b408e68b90f9ac10220535e66, name=ceph-4954ed46-70ae-11ef-bcea-c7b262605968-mds-g, ceph=True, GIT_BRANCH=HEAD, GIT_CLEAN=True, org.label-schema.vendor=CentOS, io.buildah.version=1.37.2, RELEASE=squid-b53b6d3, org.label-schema.build-date=20240731, maintainer=Guillaume Abrioux , org.label-schema.schema-version=1.0, org.label-schema.name=CentOS Stream 9 Base Image, CEPH_POINT_RELEASE=, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.license=GPLv2, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7) 2024-09-12T02:34:46.099 INFO:journalctl@ceph.mds.g.smithi039.stdout:Sep 12 02:34:45 smithi039 podman[70302]: 2024-09-12 02:34:45.790850435 +0000 UTC m=+0.478919234 container start 13f74e89fc496bea7df398119551da5461ea3af6d9f0a2d55d421de84fbd9f14 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:3be30d720e37ec4df7f667e60f22b4d221c4ce7b408e68b90f9ac10220535e66, name=ceph-4954ed46-70ae-11ef-bcea-c7b262605968-mds-g, ceph=True, RELEASE=squid-b53b6d3, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.build-date=20240731, org.label-schema.vendor=CentOS, GIT_CLEAN=True, io.buildah.version=1.37.2, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, maintainer=Guillaume Abrioux , org.label-schema.schema-version=1.0, GIT_BRANCH=HEAD, org.label-schema.license=GPLv2, CEPH_POINT_RELEASE=, org.label-schema.name=CentOS Stream 9 Base Image) 2024-09-12T02:34:46.100 INFO:journalctl@ceph.mds.g.smithi039.stdout:Sep 12 02:34:45 smithi039 ceph-mds[70321]: -- 172.21.15.39:0/2142712674 <== mon.0 v2:172.21.15.39:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 194+0+0 (secure 0 0 0) 0x555f3d31f860 con 0x555f3d2fc800 2024-09-12T02:34:46.100 INFO:journalctl@ceph.mds.g.smithi039.stdout:Sep 12 02:34:45 smithi039 ceph-4954ed46-70ae-11ef-bcea-c7b262605968-mds-g[70317]: starting mds.g at 2024-09-12T02:34:46.100 INFO:journalctl@ceph.mds.g.smithi039.stdout:Sep 12 02:34:45 smithi039 bash[70302]: 13f74e89fc496bea7df398119551da5461ea3af6d9f0a2d55d421de84fbd9f14 2024-09-12T02:34:46.100 INFO:journalctl@ceph.mds.g.smithi039.stdout:Sep 12 02:34:45 smithi039 systemd[1]: Started Ceph mds.g for 4954ed46-70ae-11ef-bcea-c7b262605968. 2024-09-12T02:34:46.797 DEBUG:teuthology.orchestra.run.smithi039:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc shell --fsid 4954ed46-70ae-11ef-bcea-c7b262605968 -- ceph fs dump --format=json 2024-09-12T02:34:46.938 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 02:34:46 smithi039 ceph-mon[30515]: pgmap v278: 1 pgs: 1 active+clean; 577 KiB data, 344 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-12T02:34:46.938 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 02:34:46 smithi039 ceph-mon[30515]: from='mgr.14150 172.21.15.39:0/408627207' entity='mgr.x' 2024-09-12T02:34:46.938 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 02:34:46 smithi039 ceph-mon[30515]: from='mgr.14150 172.21.15.39:0/408627207' entity='mgr.x' 2024-09-12T02:34:46.938 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 02:34:46 smithi039 ceph-mon[30515]: from='mgr.14150 172.21.15.39:0/408627207' entity='mgr.x' 2024-09-12T02:34:46.938 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 02:34:46 smithi039 ceph-mon[30515]: from='mgr.14150 172.21.15.39:0/408627207' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.a", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-09-12T02:34:46.938 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 02:34:46 smithi039 ceph-mon[30515]: from='mgr.14150 172.21.15.39:0/408627207' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.a", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-09-12T02:34:46.938 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 02:34:46 smithi039 ceph-mon[30515]: from='mgr.14150 172.21.15.39:0/408627207' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-12T02:34:47.013 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 12 02:34:46 smithi172 ceph-mon[35609]: pgmap v278: 1 pgs: 1 active+clean; 577 KiB data, 344 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-12T02:34:47.014 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 12 02:34:46 smithi172 ceph-mon[35609]: from='mgr.14150 172.21.15.39:0/408627207' entity='mgr.x' 2024-09-12T02:34:47.014 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 12 02:34:46 smithi172 ceph-mon[35609]: from='mgr.14150 172.21.15.39:0/408627207' entity='mgr.x' 2024-09-12T02:34:47.014 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 12 02:34:46 smithi172 ceph-mon[35609]: from='mgr.14150 172.21.15.39:0/408627207' entity='mgr.x' 2024-09-12T02:34:47.014 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 12 02:34:46 smithi172 ceph-mon[35609]: from='mgr.14150 172.21.15.39:0/408627207' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.a", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-09-12T02:34:47.014 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 12 02:34:46 smithi172 ceph-mon[35609]: from='mgr.14150 172.21.15.39:0/408627207' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.a", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-09-12T02:34:47.014 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 12 02:34:46 smithi172 ceph-mon[35609]: from='mgr.14150 172.21.15.39:0/408627207' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-12T02:34:47.198 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 12 02:34:46 smithi044 ceph-mon[35411]: pgmap v278: 1 pgs: 1 active+clean; 577 KiB data, 344 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-12T02:34:47.198 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 12 02:34:46 smithi044 ceph-mon[35411]: from='mgr.14150 172.21.15.39:0/408627207' entity='mgr.x' 2024-09-12T02:34:47.199 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 12 02:34:46 smithi044 ceph-mon[35411]: from='mgr.14150 172.21.15.39:0/408627207' entity='mgr.x' 2024-09-12T02:34:47.199 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 12 02:34:46 smithi044 ceph-mon[35411]: from='mgr.14150 172.21.15.39:0/408627207' entity='mgr.x' 2024-09-12T02:34:47.199 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 12 02:34:46 smithi044 ceph-mon[35411]: from='mgr.14150 172.21.15.39:0/408627207' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.a", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-09-12T02:34:47.199 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 12 02:34:46 smithi044 ceph-mon[35411]: from='mgr.14150 172.21.15.39:0/408627207' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.a", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-09-12T02:34:47.199 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 12 02:34:46 smithi044 ceph-mon[35411]: from='mgr.14150 172.21.15.39:0/408627207' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-12T02:34:47.906 INFO:teuthology.orchestra.run.smithi039.stderr:Inferring config /var/lib/ceph/4954ed46-70ae-11ef-bcea-c7b262605968/mon.a/config 2024-09-12T02:34:48.013 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 12 02:34:47 smithi172 ceph-mon[35609]: Deploying daemon mds.a on smithi039 2024-09-12T02:34:48.014 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 12 02:34:47 smithi172 ceph-mon[35609]: mds.? [v2:172.21.15.39:6838/936905514,v1:172.21.15.39:6839/936905514] up:boot 2024-09-12T02:34:48.014 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 12 02:34:47 smithi172 ceph-mon[35609]: fsmap 10 up:standby 2024-09-12T02:34:48.014 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 12 02:34:47 smithi172 ceph-mon[35609]: from='mgr.14150 172.21.15.39:0/408627207' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "g"}]: dispatch 2024-09-12T02:34:48.045 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 02:34:47 smithi039 ceph-mon[30515]: Deploying daemon mds.a on smithi039 2024-09-12T02:34:48.045 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 02:34:47 smithi039 ceph-mon[30515]: mds.? [v2:172.21.15.39:6838/936905514,v1:172.21.15.39:6839/936905514] up:boot 2024-09-12T02:34:48.045 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 02:34:47 smithi039 ceph-mon[30515]: fsmap 10 up:standby 2024-09-12T02:34:48.045 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 02:34:47 smithi039 ceph-mon[30515]: from='mgr.14150 172.21.15.39:0/408627207' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "g"}]: dispatch 2024-09-12T02:34:48.198 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 12 02:34:47 smithi044 ceph-mon[35411]: Deploying daemon mds.a on smithi039 2024-09-12T02:34:48.198 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 12 02:34:47 smithi044 ceph-mon[35411]: mds.? [v2:172.21.15.39:6838/936905514,v1:172.21.15.39:6839/936905514] up:boot 2024-09-12T02:34:48.199 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 12 02:34:47 smithi044 ceph-mon[35411]: fsmap 10 up:standby 2024-09-12T02:34:48.199 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 12 02:34:47 smithi044 ceph-mon[35411]: from='mgr.14150 172.21.15.39:0/408627207' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "g"}]: dispatch 2024-09-12T02:34:48.504 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:34:48.502+0000 7f8bcb200640 1 -- 172.21.15.39:0/2704012616 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f8bcc1019d0 msgr2=0x7f8bcc101e30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:34:48.504 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:34:48.502+0000 7f8bcb200640 1 --2- 172.21.15.39:0/2704012616 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f8bcc1019d0 0x7f8bcc101e30 secure :-1 s=READY pgs=144 cs=0 l=1 rev1=1 crypto rx=0x7f8bb8009930 tx=0x7f8bb802a420 comp rx=0 tx=0).stop 2024-09-12T02:34:48.504 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:34:48.502+0000 7f8bcb200640 1 -- 172.21.15.39:0/2704012616 shutdown_connections 2024-09-12T02:34:48.504 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:34:48.502+0000 7f8bcb200640 1 --2- 172.21.15.39:0/2704012616 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f8bcc102370 0x7f8bcc10e8a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:34:48.505 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:34:48.502+0000 7f8bcb200640 1 --2- 172.21.15.39:0/2704012616 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f8bcc1019d0 0x7f8bcc101e30 unknown :-1 s=CLOSED pgs=144 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:34:48.505 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:34:48.502+0000 7f8bcb200640 1 --2- 172.21.15.39:0/2704012616 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f8bcc1079d0 0x7f8bcc107db0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:34:48.505 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:34:48.502+0000 7f8bcb200640 1 -- 172.21.15.39:0/2704012616 >> 172.21.15.39:0/2704012616 conn(0x7f8bcc0fd710 msgr2=0x7f8bcc0ffb30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:34:48.505 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:34:48.503+0000 7f8bcb200640 1 -- 172.21.15.39:0/2704012616 shutdown_connections 2024-09-12T02:34:48.505 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:34:48.503+0000 7f8bcb200640 1 -- 172.21.15.39:0/2704012616 wait complete. 2024-09-12T02:34:48.505 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:34:48.504+0000 7f8bcb200640 1 Processor -- start 2024-09-12T02:34:48.506 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:34:48.504+0000 7f8bcb200640 1 -- start start 2024-09-12T02:34:48.506 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:34:48.504+0000 7f8bcb200640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f8bcc1019d0 0x7f8bcc19a570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:34:48.506 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:34:48.504+0000 7f8bcb200640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f8bcc102370 0x7f8bcc19aab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:34:48.506 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:34:48.504+0000 7f8bcb200640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f8bcc1079d0 0x7f8bcc19ee40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:34:48.507 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:34:48.504+0000 7f8bcb200640 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 -- 0x7f8bcc111e20 con 0x7f8bcc1019d0 2024-09-12T02:34:48.507 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:34:48.504+0000 7f8bcb200640 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x7f8bcc111ca0 con 0x7f8bcc102370 2024-09-12T02:34:48.507 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:34:48.504+0000 7f8bcb200640 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7f8bcc111fa0 con 0x7f8bcc1079d0 2024-09-12T02:34:48.507 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:34:48.504+0000 7f8bc9e00640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f8bcc1019d0 0x7f8bcc19a570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:34:48.507 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:34:48.505+0000 7f8bc9400640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f8bcc102370 0x7f8bcc19aab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:34:48.507 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:34:48.505+0000 7f8bc9400640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f8bcc102370 0x7f8bcc19aab0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.39:44688/0 (socket says 172.21.15.39:44688) 2024-09-12T02:34:48.507 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:34:48.505+0000 7f8bc9400640 1 -- 172.21.15.39:0/2906920089 learned_addr learned my addr 172.21.15.39:0/2906920089 (peer_addr_for_me v2:172.21.15.39:0/0) 2024-09-12T02:34:48.507 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:34:48.505+0000 7f8bc9e00640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f8bcc1019d0 0x7f8bcc19a570 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.39:3300/0 says I am v2:172.21.15.39:44760/0 (socket says 172.21.15.39:44760) 2024-09-12T02:34:48.507 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:34:48.505+0000 7f8bca800640 1 --2- 172.21.15.39:0/2906920089 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f8bcc1079d0 0x7f8bcc19ee40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:34:48.507 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:34:48.505+0000 7f8bc9400640 1 -- 172.21.15.39:0/2906920089 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f8bcc1079d0 msgr2=0x7f8bcc19ee40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:34:48.507 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:34:48.505+0000 7f8bc9400640 1 --2- 172.21.15.39:0/2906920089 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f8bcc1079d0 0x7f8bcc19ee40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:34:48.507 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:34:48.505+0000 7f8bc9400640 1 -- 172.21.15.39:0/2906920089 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f8bcc1019d0 msgr2=0x7f8bcc19a570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:34:48.507 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:34:48.505+0000 7f8bc9400640 1 --2- 172.21.15.39:0/2906920089 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f8bcc1019d0 0x7f8bcc19a570 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:34:48.508 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:34:48.505+0000 7f8bc9400640 1 -- 172.21.15.39:0/2906920089 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8bcc19f520 con 0x7f8bcc102370 2024-09-12T02:34:48.508 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:34:48.505+0000 7f8bc9400640 1 --2- 172.21.15.39:0/2906920089 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f8bcc102370 0x7f8bcc19aab0 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7f8bb802a940 tx=0x7f8bb8003b20 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:34:48.508 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:34:48.506+0000 7f8bc2a00640 1 -- 172.21.15.39:0/2906920089 <== mon.2 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8bb803f070 con 0x7f8bcc102370 2024-09-12T02:34:48.508 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:34:48.506+0000 7f8bcb200640 1 -- 172.21.15.39:0/2906920089 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f8bcc19f7b0 con 0x7f8bcc102370 2024-09-12T02:34:48.508 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:34:48.506+0000 7f8bcb200640 1 -- 172.21.15.39:0/2906920089 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f8bcc1a70f0 con 0x7f8bcc102370 2024-09-12T02:34:48.508 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:34:48.506+0000 7f8bc2a00640 1 -- 172.21.15.39:0/2906920089 <== mon.2 v2:172.21.15.44:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f8bb8031c90 con 0x7f8bcc102370 2024-09-12T02:34:48.508 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:34:48.506+0000 7f8bc2a00640 1 -- 172.21.15.39:0/2906920089 <== mon.2 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8bb8049060 con 0x7f8bcc102370 2024-09-12T02:34:48.508 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:34:48.508+0000 7f8bcb200640 1 -- 172.21.15.39:0/2906920089 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f8bcc101e30 con 0x7f8bcc102370 2024-09-12T02:34:48.510 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:34:48.509+0000 7f8bc2a00640 1 -- 172.21.15.39:0/2906920089 <== mon.2 v2:172.21.15.44:3300/0 4 ==== mgrmap(e 16) ==== 137833+0+0 (secure 0 0 0) 0x7f8bb8042070 con 0x7f8bcc102370 2024-09-12T02:34:48.512 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:34:48.511+0000 7f8bc2a00640 1 --2- 172.21.15.39:0/2906920089 >> [v2:172.21.15.39:6800/1725006999,v1:172.21.15.39:6801/1725006999] conn(0x7f8bb00a2c00 0x7f8bb00a50c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:34:48.512 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:34:48.511+0000 7f8bc2a00640 1 -- 172.21.15.39:0/2906920089 <== mon.2 v2:172.21.15.44:3300/0 5 ==== osd_map(78..78 src has 1..78) ==== 7127+0+0 (secure 0 0 0) 0x7f8bb80eee60 con 0x7f8bcc102370 2024-09-12T02:34:48.512 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:34:48.511+0000 7f8bc9e00640 1 --2- 172.21.15.39:0/2906920089 >> [v2:172.21.15.39:6800/1725006999,v1:172.21.15.39:6801/1725006999] conn(0x7f8bb00a2c00 0x7f8bb00a50c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:34:48.512 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:34:48.512+0000 7f8bc9e00640 1 --2- 172.21.15.39:0/2906920089 >> [v2:172.21.15.39:6800/1725006999,v1:172.21.15.39:6801/1725006999] conn(0x7f8bb00a2c00 0x7f8bb00a50c0 secure :-1 s=READY pgs=139 cs=0 l=1 rev1=1 crypto rx=0x7f8bbc009b50 tx=0x7f8bbc005f90 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:34:48.516 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:34:48.515+0000 7f8bc2a00640 1 -- 172.21.15.39:0/2906920089 <== mon.2 v2:172.21.15.44:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7f8bb80bbb70 con 0x7f8bcc102370 2024-09-12T02:34:48.726 INFO:journalctl@ceph.mds.a.smithi039.stdout:Sep 12 02:34:48 smithi039 systemd[1]: Starting Ceph mds.a for 4954ed46-70ae-11ef-bcea-c7b262605968... 2024-09-12T02:34:48.770 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:34:48.769+0000 7f8bcb200640 1 -- 172.21.15.39:0/2906920089 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f8bcc1a72c0 con 0x7f8bcc102370 2024-09-12T02:34:48.771 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:34:48.770+0000 7f8bc2a00640 1 -- 172.21.15.39:0/2906920089 <== mon.2 v2:172.21.15.44:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 11 v11) ==== 94+0+8869 (secure 0 0 0) 0x7f8bb80bfe70 con 0x7f8bcc102370 2024-09-12T02:34:48.771 INFO:teuthology.orchestra.run.smithi039.stdout: 2024-09-12T02:34:48.772 INFO:teuthology.orchestra.run.smithi039.stdout:{"epoch":11,"btime":"2024-09-12T02:34:46:708626+0000","default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14451,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.39:6835/2325642381","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6834","nonce":2325642381},{"type":"v1","addr":"172.21.15.39:6835","nonce":2325642381}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14511,"name":"g","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.39:6839/936905514","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6838","nonce":936905514},{"type":"v1","addr":"172.21.15.39:6839","nonce":936905514}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":11},{"gid":24422,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.44:6833/2359724364","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6832","nonce":2359724364},{"type":"v1","addr":"172.21.15.44:6833","nonce":2359724364}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":24430,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.172:6833/3232434105","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6832","nonce":3232434105},{"type":"v1","addr":"172.21.15.172:6833","nonce":3232434105}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":24446,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.39:6837/2743237008","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6836","nonce":2743237008},{"type":"v1","addr":"172.21.15.39:6837","nonce":2743237008}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5},{"gid":24458,"name":"e","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.44:6835/4063842354","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6834","nonce":4063842354},{"type":"v1","addr":"172.21.15.44:6835","nonce":4063842354}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":6},{"gid":24472,"name":"f","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.172:6835/3274676014","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6834","nonce":3274676014},{"type":"v1","addr":"172.21.15.172:6835","nonce":3274676014}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":7},{"gid":24482,"name":"h","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.44:6837/1501493978","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6836","nonce":1501493978},{"type":"v1","addr":"172.21.15.44:6837","nonce":1501493978}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":9},{"gid":24484,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.172:6837/493506747","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6836","nonce":493506747},{"type":"v1","addr":"172.21.15.172:6837","nonce":493506747}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":8},{"gid":24499,"name":"i","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.172:6839/3742537097","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6838","nonce":3742537097},{"type":"v1","addr":"172.21.15.172:6839","nonce":3742537097}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":10}],"filesystems":[]} 2024-09-12T02:34:48.772 INFO:teuthology.orchestra.run.smithi039.stderr:dumped fsmap epoch 11 2024-09-12T02:34:48.776 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:34:48.773+0000 7f8bcb200640 1 -- 172.21.15.39:0/2906920089 >> [v2:172.21.15.39:6800/1725006999,v1:172.21.15.39:6801/1725006999] conn(0x7f8bb00a2c00 msgr2=0x7f8bb00a50c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:34:48.776 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:34:48.773+0000 7f8bcb200640 1 --2- 172.21.15.39:0/2906920089 >> [v2:172.21.15.39:6800/1725006999,v1:172.21.15.39:6801/1725006999] conn(0x7f8bb00a2c00 0x7f8bb00a50c0 secure :-1 s=READY pgs=139 cs=0 l=1 rev1=1 crypto rx=0x7f8bbc009b50 tx=0x7f8bbc005f90 comp rx=0 tx=0).stop 2024-09-12T02:34:48.777 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:34:48.773+0000 7f8bcb200640 1 -- 172.21.15.39:0/2906920089 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f8bcc102370 msgr2=0x7f8bcc19aab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:34:48.777 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:34:48.773+0000 7f8bcb200640 1 --2- 172.21.15.39:0/2906920089 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f8bcc102370 0x7f8bcc19aab0 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7f8bb802a940 tx=0x7f8bb8003b20 comp rx=0 tx=0).stop 2024-09-12T02:34:48.777 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:34:48.773+0000 7f8bcb200640 1 -- 172.21.15.39:0/2906920089 shutdown_connections 2024-09-12T02:34:48.777 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:34:48.773+0000 7f8bcb200640 1 --2- 172.21.15.39:0/2906920089 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f8bcc1079d0 0x7f8bcc19ee40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:34:48.777 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:34:48.773+0000 7f8bcb200640 1 --2- 172.21.15.39:0/2906920089 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f8bcc102370 0x7f8bcc19aab0 unknown :-1 s=CLOSED pgs=73 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:34:48.777 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:34:48.773+0000 7f8bcb200640 1 --2- 172.21.15.39:0/2906920089 >> [v2:172.21.15.39:6800/1725006999,v1:172.21.15.39:6801/1725006999] conn(0x7f8bb00a2c00 0x7f8bb00a50c0 unknown :-1 s=CLOSED pgs=139 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:34:48.777 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:34:48.773+0000 7f8bcb200640 1 --2- 172.21.15.39:0/2906920089 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f8bcc1019d0 0x7f8bcc19a570 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:34:48.777 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:34:48.773+0000 7f8bcb200640 1 -- 172.21.15.39:0/2906920089 >> 172.21.15.39:0/2906920089 conn(0x7f8bcc0fd710 msgr2=0x7f8bcc0fdcf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:34:48.777 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:34:48.773+0000 7f8bcb200640 1 -- 172.21.15.39:0/2906920089 shutdown_connections 2024-09-12T02:34:48.777 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:34:48.773+0000 7f8bcb200640 1 -- 172.21.15.39:0/2906920089 wait complete. 2024-09-12T02:34:49.013 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 12 02:34:48 smithi172 ceph-mon[35609]: pgmap v279: 1 pgs: 1 active+clean; 577 KiB data, 344 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-12T02:34:49.074 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 02:34:48 smithi039 ceph-mon[30515]: pgmap v279: 1 pgs: 1 active+clean; 577 KiB data, 344 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-12T02:34:49.074 INFO:journalctl@ceph.mds.a.smithi039.stdout:Sep 12 02:34:48 smithi039 podman[70696]: 2024-09-12 02:34:48.814520382 +0000 UTC m=+0.029844728 image pull 54467abc55f864c4f73dfaf9c6ac3bb3e87b773123d5badaf790bee57321d594 quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:3be30d720e37ec4df7f667e60f22b4d221c4ce7b408e68b90f9ac10220535e66 2024-09-12T02:34:49.075 INFO:journalctl@ceph.mds.a.smithi039.stdout:Sep 12 02:34:48 smithi039 podman[70696]: 2024-09-12 02:34:48.97247309 +0000 UTC m=+0.187797444 container create 47f9ba6d6ffa82ef102bf2d190d7cb4146b3d5b945afe4ab164067752ea7e1ce (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:3be30d720e37ec4df7f667e60f22b4d221c4ce7b408e68b90f9ac10220535e66, name=ceph-4954ed46-70ae-11ef-bcea-c7b262605968-mds-a, CEPH_POINT_RELEASE=, GIT_CLEAN=True, GIT_BRANCH=HEAD, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.vendor=CentOS, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, maintainer=Guillaume Abrioux , GIT_REPO=git@github.com:ceph/ceph-container.git, ceph=True, org.label-schema.schema-version=1.0, org.label-schema.license=GPLv2, io.buildah.version=1.37.2, org.label-schema.build-date=20240731, RELEASE=squid-b53b6d3) 2024-09-12T02:34:49.198 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 12 02:34:48 smithi044 ceph-mon[35411]: pgmap v279: 1 pgs: 1 active+clean; 577 KiB data, 344 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-12T02:34:49.735 INFO:journalctl@ceph.mds.a.smithi039.stdout:Sep 12 02:34:49 smithi039 podman[70696]: 2024-09-12 02:34:49.48457388 +0000 UTC m=+0.699898228 container init 47f9ba6d6ffa82ef102bf2d190d7cb4146b3d5b945afe4ab164067752ea7e1ce (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:3be30d720e37ec4df7f667e60f22b4d221c4ce7b408e68b90f9ac10220535e66, name=ceph-4954ed46-70ae-11ef-bcea-c7b262605968-mds-a, ceph=True, org.label-schema.name=CentOS Stream 9 Base Image, maintainer=Guillaume Abrioux , RELEASE=squid-b53b6d3, GIT_REPO=git@github.com:ceph/ceph-container.git, CEPH_POINT_RELEASE=, org.label-schema.license=GPLv2, org.label-schema.schema-version=1.0, org.label-schema.build-date=20240731, GIT_CLEAN=True, GIT_BRANCH=HEAD, org.label-schema.vendor=CentOS, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, io.buildah.version=1.37.2) 2024-09-12T02:34:49.735 INFO:journalctl@ceph.mds.a.smithi039.stdout:Sep 12 02:34:49 smithi039 podman[70696]: 2024-09-12 02:34:49.490817501 +0000 UTC m=+0.706141855 container start 47f9ba6d6ffa82ef102bf2d190d7cb4146b3d5b945afe4ab164067752ea7e1ce (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:3be30d720e37ec4df7f667e60f22b4d221c4ce7b408e68b90f9ac10220535e66, name=ceph-4954ed46-70ae-11ef-bcea-c7b262605968-mds-a, GIT_BRANCH=HEAD, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.schema-version=1.0, org.label-schema.build-date=20240731, CEPH_POINT_RELEASE=, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_CLEAN=True, org.label-schema.vendor=CentOS, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, RELEASE=squid-b53b6d3, org.label-schema.license=GPLv2, io.buildah.version=1.37.2, maintainer=Guillaume Abrioux , ceph=True) 2024-09-12T02:34:49.735 INFO:journalctl@ceph.mds.a.smithi039.stdout:Sep 12 02:34:49 smithi039 ceph-mds[70726]: -- 172.21.15.39:0/228710238 <== mon.0 v2:172.21.15.39:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 194+0+0 (secure 0 0 0) 0x55629f91dc20 con 0x55629f8fb000 2024-09-12T02:34:49.735 INFO:journalctl@ceph.mds.a.smithi039.stdout:Sep 12 02:34:49 smithi039 ceph-4954ed46-70ae-11ef-bcea-c7b262605968-mds-a[70722]: starting mds.a at 2024-09-12T02:34:49.736 INFO:journalctl@ceph.mds.a.smithi039.stdout:Sep 12 02:34:49 smithi039 bash[70696]: 47f9ba6d6ffa82ef102bf2d190d7cb4146b3d5b945afe4ab164067752ea7e1ce 2024-09-12T02:34:49.736 INFO:journalctl@ceph.mds.a.smithi039.stdout:Sep 12 02:34:49 smithi039 systemd[1]: Started Ceph mds.a for 4954ed46-70ae-11ef-bcea-c7b262605968. 2024-09-12T02:34:50.013 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 12 02:34:49 smithi172 ceph-mon[35609]: from='client.? 172.21.15.39:0/2906920089' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-12T02:34:50.013 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 12 02:34:49 smithi172 ceph-mon[35609]: from='mgr.14150 172.21.15.39:0/408627207' entity='mgr.x' 2024-09-12T02:34:50.014 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 12 02:34:49 smithi172 ceph-mon[35609]: from='mgr.14150 172.21.15.39:0/408627207' entity='mgr.x' 2024-09-12T02:34:50.014 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 12 02:34:49 smithi172 ceph-mon[35609]: from='mgr.14150 172.21.15.39:0/408627207' entity='mgr.x' 2024-09-12T02:34:50.014 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 12 02:34:49 smithi172 ceph-mon[35609]: from='mgr.14150 172.21.15.39:0/408627207' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.b", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-09-12T02:34:50.014 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 12 02:34:49 smithi172 ceph-mon[35609]: from='mgr.14150 172.21.15.39:0/408627207' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.b", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-09-12T02:34:50.014 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 12 02:34:49 smithi172 ceph-mon[35609]: from='mgr.14150 172.21.15.39:0/408627207' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-12T02:34:50.100 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 02:34:49 smithi039 ceph-mon[30515]: from='client.? 172.21.15.39:0/2906920089' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-12T02:34:50.100 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 02:34:49 smithi039 ceph-mon[30515]: from='mgr.14150 172.21.15.39:0/408627207' entity='mgr.x' 2024-09-12T02:34:50.100 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 02:34:49 smithi039 ceph-mon[30515]: from='mgr.14150 172.21.15.39:0/408627207' entity='mgr.x' 2024-09-12T02:34:50.100 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 02:34:49 smithi039 ceph-mon[30515]: from='mgr.14150 172.21.15.39:0/408627207' entity='mgr.x' 2024-09-12T02:34:50.100 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 02:34:49 smithi039 ceph-mon[30515]: from='mgr.14150 172.21.15.39:0/408627207' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.b", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-09-12T02:34:50.100 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 02:34:49 smithi039 ceph-mon[30515]: from='mgr.14150 172.21.15.39:0/408627207' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.b", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-09-12T02:34:50.100 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 02:34:49 smithi039 ceph-mon[30515]: from='mgr.14150 172.21.15.39:0/408627207' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-12T02:34:50.103 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 12 02:34:49 smithi044 ceph-mon[35411]: from='client.? 172.21.15.39:0/2906920089' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-12T02:34:50.103 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 12 02:34:49 smithi044 ceph-mon[35411]: from='mgr.14150 172.21.15.39:0/408627207' entity='mgr.x' 2024-09-12T02:34:50.104 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 12 02:34:49 smithi044 ceph-mon[35411]: from='mgr.14150 172.21.15.39:0/408627207' entity='mgr.x' 2024-09-12T02:34:50.104 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 12 02:34:49 smithi044 ceph-mon[35411]: from='mgr.14150 172.21.15.39:0/408627207' entity='mgr.x' 2024-09-12T02:34:50.104 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 12 02:34:49 smithi044 ceph-mon[35411]: from='mgr.14150 172.21.15.39:0/408627207' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.b", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-09-12T02:34:50.104 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 12 02:34:49 smithi044 ceph-mon[35411]: from='mgr.14150 172.21.15.39:0/408627207' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.b", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-09-12T02:34:50.104 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 12 02:34:49 smithi044 ceph-mon[35411]: from='mgr.14150 172.21.15.39:0/408627207' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-12T02:34:51.013 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 12 02:34:50 smithi172 ceph-mon[35609]: pgmap v280: 1 pgs: 1 active+clean; 577 KiB data, 344 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-12T02:34:51.013 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 12 02:34:50 smithi172 ceph-mon[35609]: Deploying daemon mds.b on smithi044 2024-09-12T02:34:51.014 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 12 02:34:50 smithi172 ceph-mon[35609]: mds.? [v2:172.21.15.39:6840/2829712180,v1:172.21.15.39:6841/2829712180] up:boot 2024-09-12T02:34:51.014 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 12 02:34:50 smithi172 ceph-mon[35609]: fsmap 11 up:standby 2024-09-12T02:34:51.014 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 12 02:34:50 smithi172 ceph-mon[35609]: from='mgr.14150 172.21.15.39:0/408627207' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "a"}]: dispatch 2024-09-12T02:34:51.100 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 02:34:50 smithi039 ceph-mon[30515]: pgmap v280: 1 pgs: 1 active+clean; 577 KiB data, 344 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-12T02:34:51.100 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 02:34:50 smithi039 ceph-mon[30515]: Deploying daemon mds.b on smithi044 2024-09-12T02:34:51.100 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 02:34:50 smithi039 ceph-mon[30515]: mds.? [v2:172.21.15.39:6840/2829712180,v1:172.21.15.39:6841/2829712180] up:boot 2024-09-12T02:34:51.100 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 02:34:50 smithi039 ceph-mon[30515]: fsmap 11 up:standby 2024-09-12T02:34:51.100 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 02:34:50 smithi039 ceph-mon[30515]: from='mgr.14150 172.21.15.39:0/408627207' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "a"}]: dispatch 2024-09-12T02:34:51.135 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 12 02:34:50 smithi044 ceph-mon[35411]: pgmap v280: 1 pgs: 1 active+clean; 577 KiB data, 344 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-12T02:34:51.135 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 12 02:34:50 smithi044 ceph-mon[35411]: Deploying daemon mds.b on smithi044 2024-09-12T02:34:51.135 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 12 02:34:50 smithi044 ceph-mon[35411]: mds.? [v2:172.21.15.39:6840/2829712180,v1:172.21.15.39:6841/2829712180] up:boot 2024-09-12T02:34:51.135 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 12 02:34:50 smithi044 ceph-mon[35411]: fsmap 11 up:standby 2024-09-12T02:34:51.135 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 12 02:34:50 smithi044 ceph-mon[35411]: from='mgr.14150 172.21.15.39:0/408627207' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "a"}]: dispatch 2024-09-12T02:34:51.908 INFO:journalctl@ceph.mds.b.smithi044.stdout:Sep 12 02:34:51 smithi044 systemd[1]: Starting Ceph mds.b for 4954ed46-70ae-11ef-bcea-c7b262605968... 2024-09-12T02:34:52.170 INFO:journalctl@ceph.mds.b.smithi044.stdout:Sep 12 02:34:51 smithi044 podman[65319]: 2024-09-12 02:34:51.81100728 +0000 UTC m=+0.016200492 image pull 54467abc55f864c4f73dfaf9c6ac3bb3e87b773123d5badaf790bee57321d594 quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:3be30d720e37ec4df7f667e60f22b4d221c4ce7b408e68b90f9ac10220535e66 2024-09-12T02:34:52.170 INFO:journalctl@ceph.mds.b.smithi044.stdout:Sep 12 02:34:51 smithi044 podman[65319]: 2024-09-12 02:34:51.942621327 +0000 UTC m=+0.147814529 container create 77d1fe5b803d91e2bdf13ee4c4d19d323882ce09afdd5067c5939e34c96b942f (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:3be30d720e37ec4df7f667e60f22b4d221c4ce7b408e68b90f9ac10220535e66, name=ceph-4954ed46-70ae-11ef-bcea-c7b262605968-mds-b, CEPH_POINT_RELEASE=, GIT_BRANCH=HEAD, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.schema-version=1.0, org.label-schema.build-date=20240731, GIT_CLEAN=True, maintainer=Guillaume Abrioux , GIT_REPO=git@github.com:ceph/ceph-container.git, ceph=True, RELEASE=squid-b53b6d3, org.label-schema.vendor=CentOS, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.license=GPLv2, io.buildah.version=1.37.2) 2024-09-12T02:34:52.170 INFO:journalctl@ceph.mds.b.smithi044.stdout:Sep 12 02:34:52 smithi044 podman[65319]: 2024-09-12 02:34:52.170190804 +0000 UTC m=+0.375384003 container init 77d1fe5b803d91e2bdf13ee4c4d19d323882ce09afdd5067c5939e34c96b942f (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:3be30d720e37ec4df7f667e60f22b4d221c4ce7b408e68b90f9ac10220535e66, name=ceph-4954ed46-70ae-11ef-bcea-c7b262605968-mds-b, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.build-date=20240731, RELEASE=squid-b53b6d3, org.label-schema.schema-version=1.0, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.license=GPLv2, ceph=True, org.label-schema.vendor=CentOS, CEPH_POINT_RELEASE=, maintainer=Guillaume Abrioux , GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_BRANCH=HEAD, io.buildah.version=1.37.2, GIT_CLEAN=True) 2024-09-12T02:34:52.212 DEBUG:teuthology.orchestra.run.smithi039:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc shell --fsid 4954ed46-70ae-11ef-bcea-c7b262605968 -- ceph fs dump --format=json 2024-09-12T02:34:52.448 INFO:journalctl@ceph.mds.b.smithi044.stdout:Sep 12 02:34:52 smithi044 podman[65319]: 2024-09-12 02:34:52.173169903 +0000 UTC m=+0.378363111 container start 77d1fe5b803d91e2bdf13ee4c4d19d323882ce09afdd5067c5939e34c96b942f (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:3be30d720e37ec4df7f667e60f22b4d221c4ce7b408e68b90f9ac10220535e66, name=ceph-4954ed46-70ae-11ef-bcea-c7b262605968-mds-b, io.buildah.version=1.37.2, org.label-schema.schema-version=1.0, GIT_CLEAN=True, ceph=True, RELEASE=squid-b53b6d3, GIT_BRANCH=HEAD, org.label-schema.build-date=20240731, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.license=GPLv2, org.label-schema.vendor=CentOS, maintainer=Guillaume Abrioux , GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.name=CentOS Stream 9 Base Image, CEPH_POINT_RELEASE=) 2024-09-12T02:34:52.449 INFO:journalctl@ceph.mds.b.smithi044.stdout:Sep 12 02:34:52 smithi044 ceph-mds[65338]: -- 172.21.15.44:0/1434281023 <== mon.2 v2:172.21.15.44:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 194+0+0 (secure 0 0 0) 0x55df83c95860 con 0x55df83c73400 2024-09-12T02:34:52.449 INFO:journalctl@ceph.mds.b.smithi044.stdout:Sep 12 02:34:52 smithi044 ceph-4954ed46-70ae-11ef-bcea-c7b262605968-mds-b[65334]: starting mds.b at 2024-09-12T02:34:52.449 INFO:journalctl@ceph.mds.b.smithi044.stdout:Sep 12 02:34:52 smithi044 bash[65319]: 77d1fe5b803d91e2bdf13ee4c4d19d323882ce09afdd5067c5939e34c96b942f 2024-09-12T02:34:52.449 INFO:journalctl@ceph.mds.b.smithi044.stdout:Sep 12 02:34:52 smithi044 systemd[1]: Started Ceph mds.b for 4954ed46-70ae-11ef-bcea-c7b262605968. 2024-09-12T02:34:52.615 INFO:teuthology.orchestra.run.smithi039.stderr:Inferring config /var/lib/ceph/4954ed46-70ae-11ef-bcea-c7b262605968/mon.a/config 2024-09-12T02:34:53.006 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 02:34:52 smithi039 ceph-mon[30515]: pgmap v281: 1 pgs: 1 active+clean; 577 KiB data, 344 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-12T02:34:53.006 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 02:34:52 smithi039 ceph-mon[30515]: from='mgr.14150 172.21.15.39:0/408627207' entity='mgr.x' 2024-09-12T02:34:53.007 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 02:34:52 smithi039 ceph-mon[30515]: from='mgr.14150 172.21.15.39:0/408627207' entity='mgr.x' 2024-09-12T02:34:53.007 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 02:34:52 smithi039 ceph-mon[30515]: from='mgr.14150 172.21.15.39:0/408627207' entity='mgr.x' 2024-09-12T02:34:53.007 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 02:34:52 smithi039 ceph-mon[30515]: from='mgr.14150 172.21.15.39:0/408627207' entity='mgr.x' 2024-09-12T02:34:53.007 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 02:34:52 smithi039 ceph-mon[30515]: from='mgr.14150 172.21.15.39:0/408627207' entity='mgr.x' 2024-09-12T02:34:53.007 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 02:34:52 smithi039 ceph-mon[30515]: from='mgr.14150 172.21.15.39:0/408627207' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-12T02:34:53.013 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 12 02:34:52 smithi172 ceph-mon[35609]: pgmap v281: 1 pgs: 1 active+clean; 577 KiB data, 344 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-12T02:34:53.013 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 12 02:34:52 smithi172 ceph-mon[35609]: from='mgr.14150 172.21.15.39:0/408627207' entity='mgr.x' 2024-09-12T02:34:53.013 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 12 02:34:52 smithi172 ceph-mon[35609]: from='mgr.14150 172.21.15.39:0/408627207' entity='mgr.x' 2024-09-12T02:34:53.014 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 12 02:34:52 smithi172 ceph-mon[35609]: from='mgr.14150 172.21.15.39:0/408627207' entity='mgr.x' 2024-09-12T02:34:53.014 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 12 02:34:52 smithi172 ceph-mon[35609]: from='mgr.14150 172.21.15.39:0/408627207' entity='mgr.x' 2024-09-12T02:34:53.014 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 12 02:34:52 smithi172 ceph-mon[35609]: from='mgr.14150 172.21.15.39:0/408627207' entity='mgr.x' 2024-09-12T02:34:53.014 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 12 02:34:52 smithi172 ceph-mon[35609]: from='mgr.14150 172.21.15.39:0/408627207' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-12T02:34:53.151 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 12 02:34:52 smithi044 ceph-mon[35411]: pgmap v281: 1 pgs: 1 active+clean; 577 KiB data, 344 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-12T02:34:53.151 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 12 02:34:52 smithi044 ceph-mon[35411]: from='mgr.14150 172.21.15.39:0/408627207' entity='mgr.x' 2024-09-12T02:34:53.151 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 12 02:34:52 smithi044 ceph-mon[35411]: from='mgr.14150 172.21.15.39:0/408627207' entity='mgr.x' 2024-09-12T02:34:53.151 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 12 02:34:52 smithi044 ceph-mon[35411]: from='mgr.14150 172.21.15.39:0/408627207' entity='mgr.x' 2024-09-12T02:34:53.151 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 12 02:34:52 smithi044 ceph-mon[35411]: from='mgr.14150 172.21.15.39:0/408627207' entity='mgr.x' 2024-09-12T02:34:53.151 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 12 02:34:52 smithi044 ceph-mon[35411]: from='mgr.14150 172.21.15.39:0/408627207' entity='mgr.x' 2024-09-12T02:34:53.151 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 12 02:34:52 smithi044 ceph-mon[35411]: from='mgr.14150 172.21.15.39:0/408627207' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-12T02:34:53.249 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:34:53.247+0000 7f67a7e00640 1 -- 172.21.15.39:0/2623629026 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f67a81019d0 msgr2=0x7f67a8101e30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:34:53.249 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:34:53.247+0000 7f67a7e00640 1 --2- 172.21.15.39:0/2623629026 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f67a81019d0 0x7f67a8101e30 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7f6794009930 tx=0x7f679402a420 comp rx=0 tx=0).stop 2024-09-12T02:34:53.250 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:34:53.248+0000 7f67a7e00640 1 -- 172.21.15.39:0/2623629026 shutdown_connections 2024-09-12T02:34:53.250 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:34:53.248+0000 7f67a7e00640 1 --2- 172.21.15.39:0/2623629026 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f67a8102370 0x7f67a810e8a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:34:53.250 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:34:53.248+0000 7f67a7e00640 1 --2- 172.21.15.39:0/2623629026 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f67a81019d0 0x7f67a8101e30 unknown :-1 s=CLOSED pgs=66 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:34:53.250 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:34:53.248+0000 7f67a7e00640 1 --2- 172.21.15.39:0/2623629026 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f67a81079d0 0x7f67a8107db0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:34:53.250 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:34:53.248+0000 7f67a7e00640 1 -- 172.21.15.39:0/2623629026 >> 172.21.15.39:0/2623629026 conn(0x7f67a80fd710 msgr2=0x7f67a80ffb30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:34:53.250 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:34:53.248+0000 7f67a7e00640 1 -- 172.21.15.39:0/2623629026 shutdown_connections 2024-09-12T02:34:53.250 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:34:53.248+0000 7f67a7e00640 1 -- 172.21.15.39:0/2623629026 wait complete. 2024-09-12T02:34:53.250 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:34:53.249+0000 7f67a7e00640 1 Processor -- start 2024-09-12T02:34:53.250 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:34:53.249+0000 7f67a7e00640 1 -- start start 2024-09-12T02:34:53.251 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:34:53.249+0000 7f67a7e00640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f67a81019d0 0x7f67a80744f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:34:53.251 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:34:53.249+0000 7f67a7e00640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f67a8102370 0x7f67a8074a30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:34:53.251 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:34:53.249+0000 7f67a7e00640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f67a81079d0 0x7f67a8074f70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:34:53.251 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:34:53.249+0000 7f67a7e00640 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 -- 0x7f67a8111e20 con 0x7f67a8102370 2024-09-12T02:34:53.251 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:34:53.249+0000 7f67a7e00640 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x7f67a8111ca0 con 0x7f67a81079d0 2024-09-12T02:34:53.252 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:34:53.249+0000 7f67a7e00640 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7f67a8111fa0 con 0x7f67a81019d0 2024-09-12T02:34:53.252 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:34:53.250+0000 7f67a6a00640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f67a81019d0 0x7f67a80744f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:34:53.252 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:34:53.250+0000 7f67a6a00640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f67a81019d0 0x7f67a80744f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.172:3300/0 says I am v2:172.21.15.39:33894/0 (socket says 172.21.15.39:33894) 2024-09-12T02:34:53.252 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:34:53.250+0000 7f67a7400640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f67a81079d0 0x7f67a8074f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:34:53.252 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:34:53.250+0000 7f67a6a00640 1 -- 172.21.15.39:0/4198154421 learned_addr learned my addr 172.21.15.39:0/4198154421 (peer_addr_for_me v2:172.21.15.39:0/0) 2024-09-12T02:34:53.252 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:34:53.250+0000 7f67a6000640 1 --2- 172.21.15.39:0/4198154421 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f67a8102370 0x7f67a8074a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:34:53.252 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:34:53.250+0000 7f67a6a00640 1 -- 172.21.15.39:0/4198154421 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f67a81079d0 msgr2=0x7f67a8074f70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:34:53.252 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:34:53.250+0000 7f67a6a00640 1 --2- 172.21.15.39:0/4198154421 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f67a81079d0 0x7f67a8074f70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:34:53.252 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:34:53.250+0000 7f67a6a00640 1 -- 172.21.15.39:0/4198154421 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f67a8102370 msgr2=0x7f67a8074a30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:34:53.252 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:34:53.250+0000 7f67a6a00640 1 --2- 172.21.15.39:0/4198154421 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f67a8102370 0x7f67a8074a30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:34:53.252 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:34:53.250+0000 7f67a6a00640 1 -- 172.21.15.39:0/4198154421 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f67a81a6780 con 0x7f67a81019d0 2024-09-12T02:34:53.252 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:34:53.250+0000 7f67a7400640 1 --2- 172.21.15.39:0/4198154421 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f67a81079d0 0x7f67a8074f70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-12T02:34:53.253 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:34:53.251+0000 7f67a6a00640 1 --2- 172.21.15.39:0/4198154421 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f67a81019d0 0x7f67a80744f0 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7f679800e9f0 tx=0x7f679800edf0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:34:53.253 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:34:53.251+0000 7f679f400640 1 -- 172.21.15.39:0/4198154421 <== mon.1 v2:172.21.15.172:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f679800cd80 con 0x7f67a81019d0 2024-09-12T02:34:53.253 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:34:53.251+0000 7f679f400640 1 -- 172.21.15.39:0/4198154421 <== mon.1 v2:172.21.15.172:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f6798005500 con 0x7f67a81019d0 2024-09-12T02:34:53.253 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:34:53.251+0000 7f679f400640 1 -- 172.21.15.39:0/4198154421 <== mon.1 v2:172.21.15.172:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6798010690 con 0x7f67a81019d0 2024-09-12T02:34:53.253 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:34:53.251+0000 7f67a7e00640 1 -- 172.21.15.39:0/4198154421 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f67a81a6a70 con 0x7f67a81019d0 2024-09-12T02:34:53.253 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:34:53.251+0000 7f67a7e00640 1 -- 172.21.15.39:0/4198154421 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f67a81a6f80 con 0x7f67a81019d0 2024-09-12T02:34:53.254 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:34:53.253+0000 7f67a7e00640 1 -- 172.21.15.39:0/4198154421 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f67a8101e30 con 0x7f67a81019d0 2024-09-12T02:34:53.254 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:34:53.254+0000 7f679f400640 1 -- 172.21.15.39:0/4198154421 <== mon.1 v2:172.21.15.172:3300/0 4 ==== mgrmap(e 16) ==== 137833+0+0 (secure 0 0 0) 0x7f67980046c0 con 0x7f67a81019d0 2024-09-12T02:34:53.256 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:34:53.255+0000 7f679f400640 1 --2- 172.21.15.39:0/4198154421 >> [v2:172.21.15.39:6800/1725006999,v1:172.21.15.39:6801/1725006999] conn(0x7f678c0a2c00 0x7f678c0a50c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:34:53.256 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:34:53.255+0000 7f679f400640 1 -- 172.21.15.39:0/4198154421 <== mon.1 v2:172.21.15.172:3300/0 5 ==== osd_map(78..78 src has 1..78) ==== 7127+0+0 (secure 0 0 0) 0x7f67980cef30 con 0x7f67a81019d0 2024-09-12T02:34:53.256 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:34:53.255+0000 7f67a6000640 1 --2- 172.21.15.39:0/4198154421 >> [v2:172.21.15.39:6800/1725006999,v1:172.21.15.39:6801/1725006999] conn(0x7f678c0a2c00 0x7f678c0a50c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:34:53.257 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:34:53.256+0000 7f67a6000640 1 --2- 172.21.15.39:0/4198154421 >> [v2:172.21.15.39:6800/1725006999,v1:172.21.15.39:6801/1725006999] conn(0x7f678c0a2c00 0x7f678c0a50c0 secure :-1 s=READY pgs=142 cs=0 l=1 rev1=1 crypto rx=0x7f6794006010 tx=0x7f6794000bc0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:34:53.260 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:34:53.259+0000 7f679f400640 1 -- 172.21.15.39:0/4198154421 <== mon.1 v2:172.21.15.172:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7f679809c290 con 0x7f67a81019d0 2024-09-12T02:34:53.501 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:34:53.500+0000 7f67a7e00640 1 -- 172.21.15.39:0/4198154421 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f67a8109f40 con 0x7f67a81019d0 2024-09-12T02:34:53.502 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:34:53.501+0000 7f679f400640 1 -- 172.21.15.39:0/4198154421 <== mon.1 v2:172.21.15.172:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 13 v13) ==== 94+0+10521 (secure 0 0 0) 0x7f679809bb90 con 0x7f67a81019d0 2024-09-12T02:34:53.502 INFO:teuthology.orchestra.run.smithi039.stdout: 2024-09-12T02:34:53.503 INFO:teuthology.orchestra.run.smithi039.stdout:{"epoch":13,"btime":"2024-09-12T02:34:52:742698+0000","default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14451,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.39:6835/2325642381","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6834","nonce":2325642381},{"type":"v1","addr":"172.21.15.39:6835","nonce":2325642381}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14511,"name":"g","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.39:6839/936905514","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6838","nonce":936905514},{"type":"v1","addr":"172.21.15.39:6839","nonce":936905514}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":11},{"gid":14523,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.39:6841/2829712180","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6840","nonce":2829712180},{"type":"v1","addr":"172.21.15.39:6841","nonce":2829712180}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":12},{"gid":24422,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.44:6833/2359724364","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6832","nonce":2359724364},{"type":"v1","addr":"172.21.15.44:6833","nonce":2359724364}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":24430,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.172:6833/3232434105","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6832","nonce":3232434105},{"type":"v1","addr":"172.21.15.172:6833","nonce":3232434105}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":24446,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.39:6837/2743237008","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6836","nonce":2743237008},{"type":"v1","addr":"172.21.15.39:6837","nonce":2743237008}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5},{"gid":24458,"name":"e","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.44:6835/4063842354","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6834","nonce":4063842354},{"type":"v1","addr":"172.21.15.44:6835","nonce":4063842354}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":6},{"gid":24472,"name":"f","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.172:6835/3274676014","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6834","nonce":3274676014},{"type":"v1","addr":"172.21.15.172:6835","nonce":3274676014}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":7},{"gid":24482,"name":"h","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.44:6837/1501493978","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6836","nonce":1501493978},{"type":"v1","addr":"172.21.15.44:6837","nonce":1501493978}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":9},{"gid":24484,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.172:6837/493506747","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6836","nonce":493506747},{"type":"v1","addr":"172.21.15.172:6837","nonce":493506747}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":8},{"gid":24499,"name":"i","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.172:6839/3742537097","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6838","nonce":3742537097},{"type":"v1","addr":"172.21.15.172:6839","nonce":3742537097}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":10},{"gid":24515,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.44:6839/2556532723","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6838","nonce":2556532723},{"type":"v1","addr":"172.21.15.44:6839","nonce":2556532723}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":13}],"filesystems":[]} 2024-09-12T02:34:53.503 INFO:teuthology.orchestra.run.smithi039.stderr:dumped fsmap epoch 13 2024-09-12T02:34:53.505 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:34:53.504+0000 7f67a7e00640 1 -- 172.21.15.39:0/4198154421 >> [v2:172.21.15.39:6800/1725006999,v1:172.21.15.39:6801/1725006999] conn(0x7f678c0a2c00 msgr2=0x7f678c0a50c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:34:53.505 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:34:53.504+0000 7f67a7e00640 1 --2- 172.21.15.39:0/4198154421 >> [v2:172.21.15.39:6800/1725006999,v1:172.21.15.39:6801/1725006999] conn(0x7f678c0a2c00 0x7f678c0a50c0 secure :-1 s=READY pgs=142 cs=0 l=1 rev1=1 crypto rx=0x7f6794006010 tx=0x7f6794000bc0 comp rx=0 tx=0).stop 2024-09-12T02:34:53.505 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:34:53.504+0000 7f67a7e00640 1 -- 172.21.15.39:0/4198154421 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f67a81019d0 msgr2=0x7f67a80744f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:34:53.505 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:34:53.504+0000 7f67a7e00640 1 --2- 172.21.15.39:0/4198154421 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f67a81019d0 0x7f67a80744f0 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7f679800e9f0 tx=0x7f679800edf0 comp rx=0 tx=0).stop 2024-09-12T02:34:53.505 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:34:53.504+0000 7f67a7e00640 1 -- 172.21.15.39:0/4198154421 shutdown_connections 2024-09-12T02:34:53.505 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:34:53.504+0000 7f67a7e00640 1 --2- 172.21.15.39:0/4198154421 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f67a81079d0 0x7f67a8074f70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:34:53.505 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:34:53.504+0000 7f67a7e00640 1 --2- 172.21.15.39:0/4198154421 >> [v2:172.21.15.39:6800/1725006999,v1:172.21.15.39:6801/1725006999] conn(0x7f678c0a2c00 0x7f678c0a50c0 unknown :-1 s=CLOSED pgs=142 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:34:53.505 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:34:53.504+0000 7f67a7e00640 1 --2- 172.21.15.39:0/4198154421 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f67a8102370 0x7f67a8074a30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:34:53.505 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:34:53.504+0000 7f67a7e00640 1 --2- 172.21.15.39:0/4198154421 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f67a81019d0 0x7f67a80744f0 unknown :-1 s=CLOSED pgs=67 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:34:53.505 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:34:53.504+0000 7f67a7e00640 1 -- 172.21.15.39:0/4198154421 >> 172.21.15.39:0/4198154421 conn(0x7f67a80fd710 msgr2=0x7f67a80fdec0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:34:53.505 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:34:53.504+0000 7f67a7e00640 1 -- 172.21.15.39:0/4198154421 shutdown_connections 2024-09-12T02:34:53.505 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:34:53.504+0000 7f67a7e00640 1 -- 172.21.15.39:0/4198154421 wait complete. 2024-09-12T02:34:53.891 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 12 02:34:53 smithi044 ceph-mon[35411]: mds.? [v2:172.21.15.44:6838/2556532723,v1:172.21.15.44:6839/2556532723] up:boot 2024-09-12T02:34:53.891 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 12 02:34:53 smithi044 ceph-mon[35411]: fsmap 12 up:standby 2024-09-12T02:34:53.891 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 12 02:34:53 smithi044 ceph-mon[35411]: from='mgr.14150 172.21.15.39:0/408627207' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "b"}]: dispatch 2024-09-12T02:34:53.891 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 12 02:34:53 smithi044 ceph-mon[35411]: from='client.? 172.21.15.39:0/4198154421' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-12T02:34:54.099 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 02:34:53 smithi039 ceph-mon[30515]: mds.? [v2:172.21.15.44:6838/2556532723,v1:172.21.15.44:6839/2556532723] up:boot 2024-09-12T02:34:54.100 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 02:34:53 smithi039 ceph-mon[30515]: fsmap 12 up:standby 2024-09-12T02:34:54.100 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 02:34:53 smithi039 ceph-mon[30515]: from='mgr.14150 172.21.15.39:0/408627207' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "b"}]: dispatch 2024-09-12T02:34:54.100 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 02:34:53 smithi039 ceph-mon[30515]: from='client.? 172.21.15.39:0/4198154421' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-12T02:34:54.264 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 12 02:34:53 smithi172 ceph-mon[35609]: mds.? [v2:172.21.15.44:6838/2556532723,v1:172.21.15.44:6839/2556532723] up:boot 2024-09-12T02:34:54.264 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 12 02:34:53 smithi172 ceph-mon[35609]: fsmap 12 up:standby 2024-09-12T02:34:54.264 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 12 02:34:53 smithi172 ceph-mon[35609]: from='mgr.14150 172.21.15.39:0/408627207' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "b"}]: dispatch 2024-09-12T02:34:54.264 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 12 02:34:53 smithi172 ceph-mon[35609]: from='client.? 172.21.15.39:0/4198154421' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-12T02:34:54.869 DEBUG:teuthology.orchestra.run.smithi039:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc shell --fsid 4954ed46-70ae-11ef-bcea-c7b262605968 -- ceph --format=json-pretty osd lspools 2024-09-12T02:34:55.013 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 12 02:34:54 smithi172 ceph-mon[35609]: pgmap v282: 1 pgs: 1 active+clean; 577 KiB data, 344 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-12T02:34:55.014 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 12 02:34:54 smithi172 ceph-mon[35609]: from='mgr.14150 172.21.15.39:0/408627207' entity='mgr.x' 2024-09-12T02:34:55.014 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 12 02:34:54 smithi172 ceph-mon[35609]: from='mgr.14150 172.21.15.39:0/408627207' entity='mgr.x' 2024-09-12T02:34:55.014 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 12 02:34:54 smithi172 ceph-mon[35609]: from='mgr.14150 172.21.15.39:0/408627207' entity='mgr.x' 2024-09-12T02:34:55.014 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 12 02:34:54 smithi172 ceph-mon[35609]: from='mgr.14150 172.21.15.39:0/408627207' entity='mgr.x' 2024-09-12T02:34:55.099 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 02:34:54 smithi039 ceph-mon[30515]: pgmap v282: 1 pgs: 1 active+clean; 577 KiB data, 344 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-12T02:34:55.100 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 02:34:54 smithi039 ceph-mon[30515]: from='mgr.14150 172.21.15.39:0/408627207' entity='mgr.x' 2024-09-12T02:34:55.100 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 02:34:54 smithi039 ceph-mon[30515]: from='mgr.14150 172.21.15.39:0/408627207' entity='mgr.x' 2024-09-12T02:34:55.100 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 02:34:54 smithi039 ceph-mon[30515]: from='mgr.14150 172.21.15.39:0/408627207' entity='mgr.x' 2024-09-12T02:34:55.100 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 02:34:54 smithi039 ceph-mon[30515]: from='mgr.14150 172.21.15.39:0/408627207' entity='mgr.x' 2024-09-12T02:34:55.198 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 12 02:34:54 smithi044 ceph-mon[35411]: pgmap v282: 1 pgs: 1 active+clean; 577 KiB data, 344 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-12T02:34:55.198 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 12 02:34:54 smithi044 ceph-mon[35411]: from='mgr.14150 172.21.15.39:0/408627207' entity='mgr.x' 2024-09-12T02:34:55.198 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 12 02:34:54 smithi044 ceph-mon[35411]: from='mgr.14150 172.21.15.39:0/408627207' entity='mgr.x' 2024-09-12T02:34:55.198 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 12 02:34:54 smithi044 ceph-mon[35411]: from='mgr.14150 172.21.15.39:0/408627207' entity='mgr.x' 2024-09-12T02:34:55.199 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 12 02:34:54 smithi044 ceph-mon[35411]: from='mgr.14150 172.21.15.39:0/408627207' entity='mgr.x' 2024-09-12T02:34:55.283 INFO:teuthology.orchestra.run.smithi039.stderr:Inferring config /var/lib/ceph/4954ed46-70ae-11ef-bcea-c7b262605968/mon.a/config 2024-09-12T02:34:55.884 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:34:55.883+0000 7f88a8e00640 1 -- 172.21.15.39:0/2089711027 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f88a4108f60 msgr2=0x7f88a4110ae0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:34:55.885 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:34:55.883+0000 7f88a8e00640 1 --2- 172.21.15.39:0/2089711027 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f88a4108f60 0x7f88a4110ae0 secure :-1 s=READY pgs=147 cs=0 l=1 rev1=1 crypto rx=0x7f889c009ca0 tx=0x7f889c02a8c0 comp rx=0 tx=0).stop 2024-09-12T02:34:55.885 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:34:55.883+0000 7f88a8e00640 1 -- 172.21.15.39:0/2089711027 shutdown_connections 2024-09-12T02:34:55.885 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:34:55.883+0000 7f88a8e00640 1 --2- 172.21.15.39:0/2089711027 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f88a4108f60 0x7f88a4110ae0 unknown :-1 s=CLOSED pgs=147 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:34:55.885 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:34:55.883+0000 7f88a8e00640 1 --2- 172.21.15.39:0/2089711027 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f88a41047e0 0x7f88a4108830 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:34:55.885 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:34:55.883+0000 7f88a8e00640 1 --2- 172.21.15.39:0/2089711027 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f88a4103e30 0x7f88a4104210 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:34:55.885 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:34:55.883+0000 7f88a8e00640 1 -- 172.21.15.39:0/2089711027 >> 172.21.15.39:0/2089711027 conn(0x7f88a40ff910 msgr2=0x7f88a4101d30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:34:55.885 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:34:55.883+0000 7f88a8e00640 1 -- 172.21.15.39:0/2089711027 shutdown_connections 2024-09-12T02:34:55.885 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:34:55.883+0000 7f88a8e00640 1 -- 172.21.15.39:0/2089711027 wait complete. 2024-09-12T02:34:55.886 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:34:55.885+0000 7f88a8e00640 1 Processor -- start 2024-09-12T02:34:55.886 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:34:55.885+0000 7f88a8e00640 1 -- start start 2024-09-12T02:34:55.886 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:34:55.885+0000 7f88a8e00640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f88a4103e30 0x7f88a410ee20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:34:55.886 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:34:55.885+0000 7f88a8e00640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f88a41047e0 0x7f88a410f360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:34:55.886 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:34:55.885+0000 7f88a8e00640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f88a4108f60 0x7f88a410f8a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:34:55.886 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:34:55.885+0000 7f88a8e00640 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 -- 0x7f88a4077280 con 0x7f88a41047e0 2024-09-12T02:34:55.886 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:34:55.885+0000 7f88a8e00640 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x7f88a4077100 con 0x7f88a4103e30 2024-09-12T02:34:55.886 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:34:55.885+0000 7f88a8e00640 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7f88a4077400 con 0x7f88a4108f60 2024-09-12T02:34:55.887 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:34:55.885+0000 7f88a2a00640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f88a41047e0 0x7f88a410f360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:34:55.887 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:34:55.886+0000 7f88a3e00640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f88a4108f60 0x7f88a410f8a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:34:55.887 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:34:55.886+0000 7f88a3400640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f88a4103e30 0x7f88a410ee20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:34:55.888 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:34:55.886+0000 7f88a2a00640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f88a41047e0 0x7f88a410f360 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.39:3300/0 says I am v2:172.21.15.39:44814/0 (socket says 172.21.15.39:44814) 2024-09-12T02:34:55.888 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:34:55.886+0000 7f88a3e00640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f88a4108f60 0x7f88a410f8a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.172:3300/0 says I am v2:172.21.15.39:33916/0 (socket says 172.21.15.39:33916) 2024-09-12T02:34:55.888 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:34:55.886+0000 7f88a2a00640 1 -- 172.21.15.39:0/633068652 learned_addr learned my addr 172.21.15.39:0/633068652 (peer_addr_for_me v2:172.21.15.39:0/0) 2024-09-12T02:34:55.888 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:34:55.886+0000 7f88a3e00640 1 -- 172.21.15.39:0/633068652 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f88a4103e30 msgr2=0x7f88a410ee20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:34:55.888 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:34:55.886+0000 7f88a3e00640 1 --2- 172.21.15.39:0/633068652 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f88a4103e30 0x7f88a410ee20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:34:55.888 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:34:55.886+0000 7f88a3e00640 1 -- 172.21.15.39:0/633068652 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f88a41047e0 msgr2=0x7f88a410f360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:34:55.888 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:34:55.886+0000 7f88a3e00640 1 --2- 172.21.15.39:0/633068652 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f88a41047e0 0x7f88a410f360 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:34:55.888 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:34:55.886+0000 7f88a3e00640 1 -- 172.21.15.39:0/633068652 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f88a41aab90 con 0x7f88a4108f60 2024-09-12T02:34:55.888 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:34:55.886+0000 7f88a3e00640 1 --2- 172.21.15.39:0/633068652 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f88a4108f60 0x7f88a410f8a0 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7f889c005e30 tx=0x7f889c003f10 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:34:55.888 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:34:55.887+0000 7f889be00640 1 -- 172.21.15.39:0/633068652 <== mon.1 v2:172.21.15.172:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f889c031650 con 0x7f88a4108f60 2024-09-12T02:34:55.888 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:34:55.887+0000 7f889be00640 1 -- 172.21.15.39:0/633068652 <== mon.1 v2:172.21.15.172:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f889c0317f0 con 0x7f88a4108f60 2024-09-12T02:34:55.889 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:34:55.887+0000 7f88a8e00640 1 -- 172.21.15.39:0/633068652 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f88a41aae20 con 0x7f88a4108f60 2024-09-12T02:34:55.889 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:34:55.887+0000 7f889be00640 1 -- 172.21.15.39:0/633068652 <== mon.1 v2:172.21.15.172:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f889c02fb70 con 0x7f88a4108f60 2024-09-12T02:34:55.889 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:34:55.887+0000 7f88a8e00640 1 -- 172.21.15.39:0/633068652 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f88a41ab380 con 0x7f88a4108f60 2024-09-12T02:34:55.889 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:34:55.888+0000 7f88a8e00640 1 -- 172.21.15.39:0/633068652 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f88a4105310 con 0x7f88a4108f60 2024-09-12T02:34:55.890 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:34:55.889+0000 7f889be00640 1 -- 172.21.15.39:0/633068652 <== mon.1 v2:172.21.15.172:3300/0 4 ==== mgrmap(e 16) ==== 137833+0+0 (secure 0 0 0) 0x7f889c02fd10 con 0x7f88a4108f60 2024-09-12T02:34:55.891 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:34:55.891+0000 7f889be00640 1 --2- 172.21.15.39:0/633068652 >> [v2:172.21.15.39:6800/1725006999,v1:172.21.15.39:6801/1725006999] conn(0x7f88880a2c00 0x7f88880a50c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:34:55.892 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:34:55.891+0000 7f889be00640 1 -- 172.21.15.39:0/633068652 <== mon.1 v2:172.21.15.172:3300/0 5 ==== osd_map(78..78 src has 1..78) ==== 7127+0+0 (secure 0 0 0) 0x7f889c0efeb0 con 0x7f88a4108f60 2024-09-12T02:34:55.892 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:34:55.891+0000 7f88a3400640 1 --2- 172.21.15.39:0/633068652 >> [v2:172.21.15.39:6800/1725006999,v1:172.21.15.39:6801/1725006999] conn(0x7f88880a2c00 0x7f88880a50c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:34:55.892 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:34:55.892+0000 7f88a3400640 1 --2- 172.21.15.39:0/633068652 >> [v2:172.21.15.39:6800/1725006999,v1:172.21.15.39:6801/1725006999] conn(0x7f88880a2c00 0x7f88880a50c0 secure :-1 s=READY pgs=143 cs=0 l=1 rev1=1 crypto rx=0x7f8894005d00 tx=0x7f889400b410 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:34:55.895 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:34:55.895+0000 7f889be00640 1 -- 172.21.15.39:0/633068652 <== mon.1 v2:172.21.15.172:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7f889c0bd210 con 0x7f88a4108f60 2024-09-12T02:34:56.089 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:34:56.088+0000 7f88a8e00640 1 -- 172.21.15.39:0/633068652 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_command({"prefix": "osd lspools", "format": "json-pretty"} v 0) -- 0x7f88a4106f10 con 0x7f88a4108f60 2024-09-12T02:34:56.089 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 02:34:55 smithi039 ceph-mon[30515]: from='mgr.14150 172.21.15.39:0/408627207' entity='mgr.x' 2024-09-12T02:34:56.089 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 02:34:55 smithi039 ceph-mon[30515]: pgmap v283: 1 pgs: 1 active+clean; 577 KiB data, 344 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-12T02:34:56.089 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:34:56.088+0000 7f889be00640 1 -- 172.21.15.39:0/633068652 <== mon.1 v2:172.21.15.172:3300/0 7 ==== mon_command_ack([{"prefix": "osd lspools", "format": "json-pretty"}]=0 v78) ==== 84+0+65 (secure 0 0 0) 0x7f889c0bcb10 con 0x7f88a4108f60 2024-09-12T02:34:56.090 INFO:teuthology.orchestra.run.smithi039.stdout: 2024-09-12T02:34:56.090 INFO:teuthology.orchestra.run.smithi039.stdout:[ 2024-09-12T02:34:56.090 INFO:teuthology.orchestra.run.smithi039.stdout: { 2024-09-12T02:34:56.090 INFO:teuthology.orchestra.run.smithi039.stdout: "poolnum": 1, 2024-09-12T02:34:56.090 INFO:teuthology.orchestra.run.smithi039.stdout: "poolname": ".mgr" 2024-09-12T02:34:56.090 INFO:teuthology.orchestra.run.smithi039.stdout: } 2024-09-12T02:34:56.090 INFO:teuthology.orchestra.run.smithi039.stdout:] 2024-09-12T02:34:56.092 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:34:56.091+0000 7f88a8e00640 1 -- 172.21.15.39:0/633068652 >> [v2:172.21.15.39:6800/1725006999,v1:172.21.15.39:6801/1725006999] conn(0x7f88880a2c00 msgr2=0x7f88880a50c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:34:56.092 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:34:56.091+0000 7f88a8e00640 1 --2- 172.21.15.39:0/633068652 >> [v2:172.21.15.39:6800/1725006999,v1:172.21.15.39:6801/1725006999] conn(0x7f88880a2c00 0x7f88880a50c0 secure :-1 s=READY pgs=143 cs=0 l=1 rev1=1 crypto rx=0x7f8894005d00 tx=0x7f889400b410 comp rx=0 tx=0).stop 2024-09-12T02:34:56.092 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:34:56.091+0000 7f88a8e00640 1 -- 172.21.15.39:0/633068652 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f88a4108f60 msgr2=0x7f88a410f8a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:34:56.092 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:34:56.091+0000 7f88a8e00640 1 --2- 172.21.15.39:0/633068652 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f88a4108f60 0x7f88a410f8a0 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7f889c005e30 tx=0x7f889c003f10 comp rx=0 tx=0).stop 2024-09-12T02:34:56.093 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:34:56.091+0000 7f88a8e00640 1 -- 172.21.15.39:0/633068652 shutdown_connections 2024-09-12T02:34:56.093 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:34:56.092+0000 7f88a8e00640 1 --2- 172.21.15.39:0/633068652 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f88a4108f60 0x7f88a410f8a0 unknown :-1 s=CLOSED pgs=68 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:34:56.093 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:34:56.092+0000 7f88a8e00640 1 --2- 172.21.15.39:0/633068652 >> [v2:172.21.15.39:6800/1725006999,v1:172.21.15.39:6801/1725006999] conn(0x7f88880a2c00 0x7f88880a50c0 unknown :-1 s=CLOSED pgs=143 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:34:56.093 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:34:56.092+0000 7f88a8e00640 1 --2- 172.21.15.39:0/633068652 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f88a41047e0 0x7f88a410f360 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:34:56.093 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:34:56.092+0000 7f88a8e00640 1 --2- 172.21.15.39:0/633068652 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f88a4103e30 0x7f88a410ee20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:34:56.093 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:34:56.092+0000 7f88a8e00640 1 -- 172.21.15.39:0/633068652 >> 172.21.15.39:0/633068652 conn(0x7f88a40ff910 msgr2=0x7f88a4100bf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:34:56.093 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:34:56.092+0000 7f88a8e00640 1 -- 172.21.15.39:0/633068652 shutdown_connections 2024-09-12T02:34:56.094 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:34:56.092+0000 7f88a8e00640 1 -- 172.21.15.39:0/633068652 wait complete. 2024-09-12T02:34:56.198 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 12 02:34:55 smithi044 ceph-mon[35411]: from='mgr.14150 172.21.15.39:0/408627207' entity='mgr.x' 2024-09-12T02:34:56.198 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 12 02:34:55 smithi044 ceph-mon[35411]: pgmap v283: 1 pgs: 1 active+clean; 577 KiB data, 344 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-12T02:34:56.263 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 12 02:34:55 smithi172 ceph-mon[35609]: from='mgr.14150 172.21.15.39:0/408627207' entity='mgr.x' 2024-09-12T02:34:56.264 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 12 02:34:55 smithi172 ceph-mon[35609]: pgmap v283: 1 pgs: 1 active+clean; 577 KiB data, 344 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-12T02:34:56.859 DEBUG:tasks.cephfs.filesystem:Creating filesystem 'cephfs' 2024-09-12T02:34:56.859 DEBUG:teuthology.orchestra.run.smithi039:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc shell --fsid 4954ed46-70ae-11ef-bcea-c7b262605968 -- ceph osd pool create cephfs_metadata --pg_num_min 64 2024-09-12T02:34:57.099 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 02:34:57 smithi039 ceph-mon[30515]: from='mgr.14150 172.21.15.39:0/408627207' entity='mgr.x' 2024-09-12T02:34:57.100 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 02:34:57 smithi039 ceph-mon[30515]: from='mgr.14150 172.21.15.39:0/408627207' entity='mgr.x' 2024-09-12T02:34:57.100 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 02:34:57 smithi039 ceph-mon[30515]: from='client.? 172.21.15.39:0/633068652' entity='client.admin' cmd=[{"prefix": "osd lspools", "format": "json-pretty"}]: dispatch 2024-09-12T02:34:57.100 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 02:34:57 smithi039 ceph-mon[30515]: from='mgr.14150 172.21.15.39:0/408627207' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-12T02:34:57.100 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 02:34:57 smithi039 ceph-mon[30515]: from='mgr.14150 172.21.15.39:0/408627207' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-12T02:34:57.100 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 02:34:57 smithi039 ceph-mon[30515]: from='mgr.14150 172.21.15.39:0/408627207' entity='mgr.x' 2024-09-12T02:34:57.100 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 02:34:57 smithi039 ceph-mon[30515]: from='mgr.14150 172.21.15.39:0/408627207' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-12T02:34:57.252 INFO:teuthology.orchestra.run.smithi039.stderr:Inferring config /var/lib/ceph/4954ed46-70ae-11ef-bcea-c7b262605968/mon.a/config 2024-09-12T02:34:57.263 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 12 02:34:57 smithi172 ceph-mon[35609]: from='mgr.14150 172.21.15.39:0/408627207' entity='mgr.x' 2024-09-12T02:34:57.263 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 12 02:34:57 smithi172 ceph-mon[35609]: from='mgr.14150 172.21.15.39:0/408627207' entity='mgr.x' 2024-09-12T02:34:57.263 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 12 02:34:57 smithi172 ceph-mon[35609]: from='client.? 172.21.15.39:0/633068652' entity='client.admin' cmd=[{"prefix": "osd lspools", "format": "json-pretty"}]: dispatch 2024-09-12T02:34:57.263 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 12 02:34:57 smithi172 ceph-mon[35609]: from='mgr.14150 172.21.15.39:0/408627207' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-12T02:34:57.263 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 12 02:34:57 smithi172 ceph-mon[35609]: from='mgr.14150 172.21.15.39:0/408627207' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-12T02:34:57.264 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 12 02:34:57 smithi172 ceph-mon[35609]: from='mgr.14150 172.21.15.39:0/408627207' entity='mgr.x' 2024-09-12T02:34:57.264 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 12 02:34:57 smithi172 ceph-mon[35609]: from='mgr.14150 172.21.15.39:0/408627207' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-12T02:34:57.448 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 12 02:34:57 smithi044 ceph-mon[35411]: from='mgr.14150 172.21.15.39:0/408627207' entity='mgr.x' 2024-09-12T02:34:57.448 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 12 02:34:57 smithi044 ceph-mon[35411]: from='mgr.14150 172.21.15.39:0/408627207' entity='mgr.x' 2024-09-12T02:34:57.449 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 12 02:34:57 smithi044 ceph-mon[35411]: from='client.? 172.21.15.39:0/633068652' entity='client.admin' cmd=[{"prefix": "osd lspools", "format": "json-pretty"}]: dispatch 2024-09-12T02:34:57.449 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 12 02:34:57 smithi044 ceph-mon[35411]: from='mgr.14150 172.21.15.39:0/408627207' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-12T02:34:57.449 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 12 02:34:57 smithi044 ceph-mon[35411]: from='mgr.14150 172.21.15.39:0/408627207' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-12T02:34:57.449 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 12 02:34:57 smithi044 ceph-mon[35411]: from='mgr.14150 172.21.15.39:0/408627207' entity='mgr.x' 2024-09-12T02:34:57.449 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 12 02:34:57 smithi044 ceph-mon[35411]: from='mgr.14150 172.21.15.39:0/408627207' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-12T02:34:57.843 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:34:57.818+0000 7f73c0600640 1 -- 172.21.15.39:0/1723679809 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f73b81049a0 msgr2=0x7f73b81089f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:34:57.843 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:34:57.818+0000 7f73c0600640 1 --2- 172.21.15.39:0/1723679809 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f73b81049a0 0x7f73b81089f0 secure :-1 s=READY pgs=148 cs=0 l=1 rev1=1 crypto rx=0x7f73a4009900 tx=0x7f73a402a3f0 comp rx=0 tx=0).stop 2024-09-12T02:34:57.843 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:34:57.818+0000 7f73c0600640 1 -- 172.21.15.39:0/1723679809 shutdown_connections 2024-09-12T02:34:57.844 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:34:57.818+0000 7f73c0600640 1 --2- 172.21.15.39:0/1723679809 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f73b8109120 0x7f73b8110ca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:34:57.844 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:34:57.818+0000 7f73c0600640 1 --2- 172.21.15.39:0/1723679809 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f73b81049a0 0x7f73b81089f0 unknown :-1 s=CLOSED pgs=148 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:34:57.844 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:34:57.818+0000 7f73c0600640 1 --2- 172.21.15.39:0/1723679809 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f73b8103ff0 0x7f73b81043d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:34:57.844 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:34:57.818+0000 7f73c0600640 1 -- 172.21.15.39:0/1723679809 >> 172.21.15.39:0/1723679809 conn(0x7f73b80ffa90 msgr2=0x7f73b8101eb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:34:57.844 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:34:57.818+0000 7f73c0600640 1 -- 172.21.15.39:0/1723679809 shutdown_connections 2024-09-12T02:34:57.844 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:34:57.818+0000 7f73c0600640 1 -- 172.21.15.39:0/1723679809 wait complete. 2024-09-12T02:34:57.844 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:34:57.819+0000 7f73c0600640 1 Processor -- start 2024-09-12T02:34:57.844 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:34:57.819+0000 7f73c0600640 1 -- start start 2024-09-12T02:34:57.844 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:34:57.819+0000 7f73c0600640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f73b8103ff0 0x7f73b819a6a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:34:57.844 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:34:57.819+0000 7f73c0600640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f73b81049a0 0x7f73b819abe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:34:57.844 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:34:57.819+0000 7f73c0600640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f73b8109120 0x7f73b819ef70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:34:57.844 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:34:57.819+0000 7f73c0600640 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 -- 0x7f73b8114140 con 0x7f73b8103ff0 2024-09-12T02:34:57.845 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:34:57.819+0000 7f73c0600640 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x7f73b8113fc0 con 0x7f73b81049a0 2024-09-12T02:34:57.845 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:34:57.819+0000 7f73c0600640 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7f73b81142c0 con 0x7f73b8109120 2024-09-12T02:34:57.845 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:34:57.820+0000 7f73bdc00640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f73b8103ff0 0x7f73b819a6a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:34:57.845 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:34:57.820+0000 7f73be600640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f73b8109120 0x7f73b819ef70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:34:57.845 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:34:57.820+0000 7f73be600640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f73b8109120 0x7f73b819ef70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.172:3300/0 says I am v2:172.21.15.39:33938/0 (socket says 172.21.15.39:33938) 2024-09-12T02:34:57.845 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:34:57.820+0000 7f73be600640 1 -- 172.21.15.39:0/2376058597 learned_addr learned my addr 172.21.15.39:0/2376058597 (peer_addr_for_me v2:172.21.15.39:0/0) 2024-09-12T02:34:57.845 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:34:57.820+0000 7f73bd200640 1 --2- 172.21.15.39:0/2376058597 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f73b81049a0 0x7f73b819abe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:34:57.845 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:34:57.820+0000 7f73be600640 1 -- 172.21.15.39:0/2376058597 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f73b81049a0 msgr2=0x7f73b819abe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:34:57.845 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:34:57.820+0000 7f73be600640 1 --2- 172.21.15.39:0/2376058597 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f73b81049a0 0x7f73b819abe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:34:57.845 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:34:57.820+0000 7f73be600640 1 -- 172.21.15.39:0/2376058597 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f73b8103ff0 msgr2=0x7f73b819a6a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:34:57.845 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:34:57.820+0000 7f73be600640 1 --2- 172.21.15.39:0/2376058597 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f73b8103ff0 0x7f73b819a6a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:34:57.845 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:34:57.820+0000 7f73be600640 1 -- 172.21.15.39:0/2376058597 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f73b819f650 con 0x7f73b8109120 2024-09-12T02:34:57.845 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:34:57.820+0000 7f73be600640 1 --2- 172.21.15.39:0/2376058597 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f73b8109120 0x7f73b819ef70 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7f73b000eb10 tx=0x7f73b000c2d0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:34:57.846 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:34:57.820+0000 7f73b6000640 1 -- 172.21.15.39:0/2376058597 <== mon.1 v2:172.21.15.172:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f73b0004b20 con 0x7f73b8109120 2024-09-12T02:34:57.846 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:34:57.820+0000 7f73b6000640 1 -- 172.21.15.39:0/2376058597 <== mon.1 v2:172.21.15.172:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f73b0004cc0 con 0x7f73b8109120 2024-09-12T02:34:57.846 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:34:57.820+0000 7f73b6000640 1 -- 172.21.15.39:0/2376058597 <== mon.1 v2:172.21.15.172:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f73b0010760 con 0x7f73b8109120 2024-09-12T02:34:57.846 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:34:57.820+0000 7f73c0600640 1 -- 172.21.15.39:0/2376058597 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f73b819f940 con 0x7f73b8109120 2024-09-12T02:34:57.846 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:34:57.821+0000 7f73c0600640 1 -- 172.21.15.39:0/2376058597 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f73b81a7220 con 0x7f73b8109120 2024-09-12T02:34:57.846 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:34:57.822+0000 7f73c0600640 1 -- 172.21.15.39:0/2376058597 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f73b81043d0 con 0x7f73b8109120 2024-09-12T02:34:57.846 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:34:57.823+0000 7f73b6000640 1 -- 172.21.15.39:0/2376058597 <== mon.1 v2:172.21.15.172:3300/0 4 ==== mgrmap(e 16) ==== 137833+0+0 (secure 0 0 0) 0x7f73b0005020 con 0x7f73b8109120 2024-09-12T02:34:57.846 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:34:57.825+0000 7f73b6000640 1 --2- 172.21.15.39:0/2376058597 >> [v2:172.21.15.39:6800/1725006999,v1:172.21.15.39:6801/1725006999] conn(0x7f73a00a2b80 0x7f73a00a5040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:34:57.846 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:34:57.825+0000 7f73b6000640 1 -- 172.21.15.39:0/2376058597 <== mon.1 v2:172.21.15.172:3300/0 5 ==== osd_map(78..78 src has 1..78) ==== 7127+0+0 (secure 0 0 0) 0x7f73b00cf280 con 0x7f73b8109120 2024-09-12T02:34:57.846 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:34:57.825+0000 7f73bdc00640 1 --2- 172.21.15.39:0/2376058597 >> [v2:172.21.15.39:6800/1725006999,v1:172.21.15.39:6801/1725006999] conn(0x7f73a00a2b80 0x7f73a00a5040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:34:57.846 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:34:57.825+0000 7f73bdc00640 1 --2- 172.21.15.39:0/2376058597 >> [v2:172.21.15.39:6800/1725006999,v1:172.21.15.39:6801/1725006999] conn(0x7f73a00a2b80 0x7f73a00a5040 secure :-1 s=READY pgs=144 cs=0 l=1 rev1=1 crypto rx=0x7f73ac009bd0 tx=0x7f73ac005f90 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:34:57.846 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:34:57.829+0000 7f73b6000640 1 -- 172.21.15.39:0/2376058597 <== mon.1 v2:172.21.15.172:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7f73b009c5e0 con 0x7f73b8109120 2024-09-12T02:34:58.028 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 02:34:58 smithi039 ceph-mon[30515]: pgmap v284: 1 pgs: 1 active+clean; 577 KiB data, 344 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-12T02:34:58.029 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:34:58.027+0000 7f73c0600640 1 -- 172.21.15.39:0/2376058597 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64} v 0) -- 0x7f73b810c3c0 con 0x7f73b8109120 2024-09-12T02:34:58.198 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 12 02:34:58 smithi044 ceph-mon[35411]: pgmap v284: 1 pgs: 1 active+clean; 577 KiB data, 344 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-12T02:34:58.513 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 12 02:34:58 smithi172 ceph-mon[35609]: pgmap v284: 1 pgs: 1 active+clean; 577 KiB data, 344 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-12T02:34:59.044 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:34:59.044+0000 7f73b6000640 1 -- 172.21.15.39:0/2376058597 <== mon.1 v2:172.21.15.172:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64}]=0 pool 'cephfs_metadata' created v79) ==== 138+0+0 (secure 0 0 0) 0x7f73b009bee0 con 0x7f73b8109120 2024-09-12T02:34:59.045 INFO:teuthology.orchestra.run.smithi039.stderr:pool 'cephfs_metadata' created 2024-09-12T02:34:59.050 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:34:59.050+0000 7f73c0600640 1 -- 172.21.15.39:0/2376058597 >> [v2:172.21.15.39:6800/1725006999,v1:172.21.15.39:6801/1725006999] conn(0x7f73a00a2b80 msgr2=0x7f73a00a5040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:34:59.050 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:34:59.050+0000 7f73c0600640 1 --2- 172.21.15.39:0/2376058597 >> [v2:172.21.15.39:6800/1725006999,v1:172.21.15.39:6801/1725006999] conn(0x7f73a00a2b80 0x7f73a00a5040 secure :-1 s=READY pgs=144 cs=0 l=1 rev1=1 crypto rx=0x7f73ac009bd0 tx=0x7f73ac005f90 comp rx=0 tx=0).stop 2024-09-12T02:34:59.050 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:34:59.050+0000 7f73c0600640 1 -- 172.21.15.39:0/2376058597 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f73b8109120 msgr2=0x7f73b819ef70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:34:59.050 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:34:59.050+0000 7f73c0600640 1 --2- 172.21.15.39:0/2376058597 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f73b8109120 0x7f73b819ef70 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7f73b000eb10 tx=0x7f73b000c2d0 comp rx=0 tx=0).stop 2024-09-12T02:34:59.051 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:34:59.051+0000 7f73c0600640 1 -- 172.21.15.39:0/2376058597 shutdown_connections 2024-09-12T02:34:59.051 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:34:59.051+0000 7f73c0600640 1 --2- 172.21.15.39:0/2376058597 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f73b8109120 0x7f73b819ef70 unknown :-1 s=CLOSED pgs=69 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:34:59.051 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:34:59.051+0000 7f73c0600640 1 --2- 172.21.15.39:0/2376058597 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f73b81049a0 0x7f73b819abe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:34:59.051 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:34:59.051+0000 7f73c0600640 1 --2- 172.21.15.39:0/2376058597 >> [v2:172.21.15.39:6800/1725006999,v1:172.21.15.39:6801/1725006999] conn(0x7f73a00a2b80 0x7f73a00a5040 unknown :-1 s=CLOSED pgs=144 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:34:59.051 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:34:59.051+0000 7f73c0600640 1 --2- 172.21.15.39:0/2376058597 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f73b8103ff0 0x7f73b819a6a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:34:59.051 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:34:59.051+0000 7f73c0600640 1 -- 172.21.15.39:0/2376058597 >> 172.21.15.39:0/2376058597 conn(0x7f73b80ffa90 msgr2=0x7f73b8100d70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:34:59.051 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:34:59.051+0000 7f73c0600640 1 -- 172.21.15.39:0/2376058597 shutdown_connections 2024-09-12T02:34:59.052 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:34:59.052+0000 7f73c0600640 1 -- 172.21.15.39:0/2376058597 wait complete. 2024-09-12T02:34:59.349 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 02:34:59 smithi039 ceph-mon[30515]: from='client.? 172.21.15.39:0/2376058597' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64}]: dispatch 2024-09-12T02:34:59.350 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 02:34:59 smithi039 ceph-mon[30515]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64}]: dispatch 2024-09-12T02:34:59.350 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 02:34:59 smithi039 ceph-mon[30515]: from='mgr.14150 172.21.15.39:0/408627207' entity='mgr.x' 2024-09-12T02:34:59.350 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 02:34:59 smithi039 ceph-mon[30515]: from='mgr.14150 172.21.15.39:0/408627207' entity='mgr.x' 2024-09-12T02:34:59.350 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 02:34:59 smithi039 ceph-mon[30515]: from='mgr.14150 172.21.15.39:0/408627207' entity='mgr.x' 2024-09-12T02:34:59.350 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 02:34:59 smithi039 ceph-mon[30515]: from='mgr.14150 172.21.15.39:0/408627207' entity='mgr.x' 2024-09-12T02:34:59.448 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 12 02:34:59 smithi044 ceph-mon[35411]: from='client.? 172.21.15.39:0/2376058597' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64}]: dispatch 2024-09-12T02:34:59.449 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 12 02:34:59 smithi044 ceph-mon[35411]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64}]: dispatch 2024-09-12T02:34:59.449 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 12 02:34:59 smithi044 ceph-mon[35411]: from='mgr.14150 172.21.15.39:0/408627207' entity='mgr.x' 2024-09-12T02:34:59.449 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 12 02:34:59 smithi044 ceph-mon[35411]: from='mgr.14150 172.21.15.39:0/408627207' entity='mgr.x' 2024-09-12T02:34:59.449 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 12 02:34:59 smithi044 ceph-mon[35411]: from='mgr.14150 172.21.15.39:0/408627207' entity='mgr.x' 2024-09-12T02:34:59.449 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 12 02:34:59 smithi044 ceph-mon[35411]: from='mgr.14150 172.21.15.39:0/408627207' entity='mgr.x' 2024-09-12T02:34:59.514 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 12 02:34:59 smithi172 ceph-mon[35609]: from='client.? 172.21.15.39:0/2376058597' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64}]: dispatch 2024-09-12T02:34:59.514 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 12 02:34:59 smithi172 ceph-mon[35609]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64}]: dispatch 2024-09-12T02:34:59.514 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 12 02:34:59 smithi172 ceph-mon[35609]: from='mgr.14150 172.21.15.39:0/408627207' entity='mgr.x' 2024-09-12T02:34:59.514 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 12 02:34:59 smithi172 ceph-mon[35609]: from='mgr.14150 172.21.15.39:0/408627207' entity='mgr.x' 2024-09-12T02:34:59.514 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 12 02:34:59 smithi172 ceph-mon[35609]: from='mgr.14150 172.21.15.39:0/408627207' entity='mgr.x' 2024-09-12T02:34:59.514 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 12 02:34:59 smithi172 ceph-mon[35609]: from='mgr.14150 172.21.15.39:0/408627207' entity='mgr.x' 2024-09-12T02:34:59.762 DEBUG:teuthology.orchestra.run.smithi039:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc shell --fsid 4954ed46-70ae-11ef-bcea-c7b262605968 -- ceph osd pool create cephfs_data 64 --pg_num_min 64 --target_size_ratio 0.05 2024-09-12T02:35:00.168 INFO:teuthology.orchestra.run.smithi039.stderr:Inferring config /var/lib/ceph/4954ed46-70ae-11ef-bcea-c7b262605968/mon.a/config 2024-09-12T02:35:00.309 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 02:35:00 smithi039 ceph-mon[30515]: pgmap v285: 1 pgs: 1 active+clean; 577 KiB data, 344 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-12T02:35:00.309 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 02:35:00 smithi039 ceph-mon[30515]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64}]': finished 2024-09-12T02:35:00.309 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 02:35:00 smithi039 ceph-mon[30515]: osdmap e79: 12 total, 12 up, 12 in 2024-09-12T02:35:00.350 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 12 02:35:00 smithi044 ceph-mon[35411]: pgmap v285: 1 pgs: 1 active+clean; 577 KiB data, 344 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-12T02:35:00.350 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 12 02:35:00 smithi044 ceph-mon[35411]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64}]': finished 2024-09-12T02:35:00.350 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 12 02:35:00 smithi044 ceph-mon[35411]: osdmap e79: 12 total, 12 up, 12 in 2024-09-12T02:35:00.513 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 12 02:35:00 smithi172 ceph-mon[35609]: pgmap v285: 1 pgs: 1 active+clean; 577 KiB data, 344 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-12T02:35:00.514 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 12 02:35:00 smithi172 ceph-mon[35609]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64}]': finished 2024-09-12T02:35:00.514 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 12 02:35:00 smithi172 ceph-mon[35609]: osdmap e79: 12 total, 12 up, 12 in 2024-09-12T02:35:00.740 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:35:00.739+0000 7f7282800640 1 -- 172.21.15.39:0/1962324203 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f727c106f10 msgr2=0x7f727c10ea90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:35:00.740 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:35:00.739+0000 7f7282800640 1 --2- 172.21.15.39:0/1962324203 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f727c106f10 0x7f727c10ea90 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7f7274009ca0 tx=0x7f727402a8c0 comp rx=0 tx=0).stop 2024-09-12T02:35:00.740 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:35:00.739+0000 7f7282800640 1 -- 172.21.15.39:0/1962324203 shutdown_connections 2024-09-12T02:35:00.740 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:35:00.739+0000 7f7282800640 1 --2- 172.21.15.39:0/1962324203 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f727c106f10 0x7f727c10ea90 unknown :-1 s=CLOSED pgs=70 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:35:00.740 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:35:00.739+0000 7f7282800640 1 --2- 172.21.15.39:0/1962324203 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f727c102790 0x7f727c1067e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:35:00.741 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:35:00.739+0000 7f7282800640 1 --2- 172.21.15.39:0/1962324203 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f727c101de0 0x7f727c1021c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:35:00.741 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:35:00.739+0000 7f7282800640 1 -- 172.21.15.39:0/1962324203 >> 172.21.15.39:0/1962324203 conn(0x7f727c0fd8c0 msgr2=0x7f727c0ffce0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:35:00.741 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:35:00.739+0000 7f7282800640 1 -- 172.21.15.39:0/1962324203 shutdown_connections 2024-09-12T02:35:00.741 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:35:00.739+0000 7f7282800640 1 -- 172.21.15.39:0/1962324203 wait complete. 2024-09-12T02:35:00.743 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:35:00.740+0000 7f7282800640 1 Processor -- start 2024-09-12T02:35:00.743 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:35:00.740+0000 7f7282800640 1 -- start start 2024-09-12T02:35:00.743 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:35:00.740+0000 7f7282800640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f727c101de0 0x7f727c0744f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:35:00.743 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:35:00.740+0000 7f7282800640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f727c102790 0x7f727c074a30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:35:00.743 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:35:00.740+0000 7f7282800640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f727c106f10 0x7f727c074f70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:35:00.743 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:35:00.741+0000 7f7282800640 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 -- 0x7f727c111fc0 con 0x7f727c101de0 2024-09-12T02:35:00.744 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:35:00.741+0000 7f7282800640 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x7f727c111e40 con 0x7f727c106f10 2024-09-12T02:35:00.744 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:35:00.741+0000 7f7282800640 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7f727c112140 con 0x7f727c102790 2024-09-12T02:35:00.744 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:35:00.741+0000 7f7272a00640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f727c102790 0x7f727c074a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:35:00.744 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:35:00.741+0000 7f727be00640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f727c106f10 0x7f727c074f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:35:00.744 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:35:00.741+0000 7f7272a00640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f727c102790 0x7f727c074a30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.172:3300/0 says I am v2:172.21.15.39:38334/0 (socket says 172.21.15.39:38334) 2024-09-12T02:35:00.744 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:35:00.741+0000 7f7272a00640 1 -- 172.21.15.39:0/2416552315 learned_addr learned my addr 172.21.15.39:0/2416552315 (peer_addr_for_me v2:172.21.15.39:0/0) 2024-09-12T02:35:00.744 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:35:00.741+0000 7f727b400640 1 --2- 172.21.15.39:0/2416552315 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f727c101de0 0x7f727c0744f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:35:00.744 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:35:00.741+0000 7f7272a00640 1 -- 172.21.15.39:0/2416552315 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f727c106f10 msgr2=0x7f727c074f70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:35:00.744 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:35:00.741+0000 7f7272a00640 1 --2- 172.21.15.39:0/2416552315 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f727c106f10 0x7f727c074f70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:35:00.744 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:35:00.741+0000 7f7272a00640 1 -- 172.21.15.39:0/2416552315 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f727c101de0 msgr2=0x7f727c0744f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:35:00.744 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:35:00.741+0000 7f7272a00640 1 --2- 172.21.15.39:0/2416552315 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f727c101de0 0x7f727c0744f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:35:00.744 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:35:00.741+0000 7f7272a00640 1 -- 172.21.15.39:0/2416552315 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f727c1a68f0 con 0x7f727c102790 2024-09-12T02:35:00.744 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:35:00.742+0000 7f7272a00640 1 --2- 172.21.15.39:0/2416552315 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f727c102790 0x7f727c074a30 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7f726400e9f0 tx=0x7f726400eeb0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:35:00.745 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:35:00.742+0000 7f7278c00640 1 -- 172.21.15.39:0/2416552315 <== mon.1 v2:172.21.15.172:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f726400cd80 con 0x7f727c102790 2024-09-12T02:35:00.745 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:35:00.742+0000 7f7282800640 1 -- 172.21.15.39:0/2416552315 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f727c1a6be0 con 0x7f727c102790 2024-09-12T02:35:00.745 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:35:00.742+0000 7f7282800640 1 -- 172.21.15.39:0/2416552315 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f727c1a7170 con 0x7f727c102790 2024-09-12T02:35:00.745 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:35:00.742+0000 7f7278c00640 1 -- 172.21.15.39:0/2416552315 <== mon.1 v2:172.21.15.172:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f7264010910 con 0x7f727c102790 2024-09-12T02:35:00.745 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:35:00.742+0000 7f7278c00640 1 -- 172.21.15.39:0/2416552315 <== mon.1 v2:172.21.15.172:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7264026060 con 0x7f727c102790 2024-09-12T02:35:00.745 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:35:00.743+0000 7f7282800640 1 -- 172.21.15.39:0/2416552315 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f7258005290 con 0x7f727c102790 2024-09-12T02:35:00.746 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:35:00.746+0000 7f7278c00640 1 -- 172.21.15.39:0/2416552315 <== mon.1 v2:172.21.15.172:3300/0 4 ==== mgrmap(e 16) ==== 137833+0+0 (secure 0 0 0) 0x7f7264010ac0 con 0x7f727c102790 2024-09-12T02:35:00.748 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:35:00.747+0000 7f7278c00640 1 --2- 172.21.15.39:0/2416552315 >> [v2:172.21.15.39:6800/1725006999,v1:172.21.15.39:6801/1725006999] conn(0x7f72600a2c00 0x7f72600a50c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:35:00.748 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:35:00.747+0000 7f7278c00640 1 -- 172.21.15.39:0/2416552315 <== mon.1 v2:172.21.15.172:3300/0 5 ==== osd_map(80..80 src has 1..80) ==== 7497+0+0 (secure 0 0 0) 0x7f72640cef60 con 0x7f727c102790 2024-09-12T02:35:00.748 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:35:00.748+0000 7f727b400640 1 --2- 172.21.15.39:0/2416552315 >> [v2:172.21.15.39:6800/1725006999,v1:172.21.15.39:6801/1725006999] conn(0x7f72600a2c00 0x7f72600a50c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:35:00.749 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:35:00.748+0000 7f727b400640 1 --2- 172.21.15.39:0/2416552315 >> [v2:172.21.15.39:6800/1725006999,v1:172.21.15.39:6801/1725006999] conn(0x7f72600a2c00 0x7f72600a50c0 secure :-1 s=READY pgs=145 cs=0 l=1 rev1=1 crypto rx=0x7f726c0095f0 tx=0x7f726c005f90 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:35:00.749 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:35:00.749+0000 7f7278c00640 1 -- 172.21.15.39:0/2416552315 <== mon.1 v2:172.21.15.172:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7f726409bb00 con 0x7f727c102790 2024-09-12T02:35:00.938 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:35:00.938+0000 7f7282800640 1 -- 172.21.15.39:0/2416552315 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.05} v 0) -- 0x7f7258005580 con 0x7f727c102790 2024-09-12T02:35:01.484 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:35:01.483+0000 7f7278c00640 1 -- 172.21.15.39:0/2416552315 <== mon.1 v2:172.21.15.172:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.05}]=0 pool 'cephfs_data' created v81) ==== 171+0+0 (secure 0 0 0) 0x7f726409fe00 con 0x7f727c102790 2024-09-12T02:35:01.485 INFO:teuthology.orchestra.run.smithi039.stderr:pool 'cephfs_data' created 2024-09-12T02:35:01.491 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:35:01.490+0000 7f7282800640 1 -- 172.21.15.39:0/2416552315 >> [v2:172.21.15.39:6800/1725006999,v1:172.21.15.39:6801/1725006999] conn(0x7f72600a2c00 msgr2=0x7f72600a50c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:35:01.491 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:35:01.490+0000 7f7282800640 1 --2- 172.21.15.39:0/2416552315 >> [v2:172.21.15.39:6800/1725006999,v1:172.21.15.39:6801/1725006999] conn(0x7f72600a2c00 0x7f72600a50c0 secure :-1 s=READY pgs=145 cs=0 l=1 rev1=1 crypto rx=0x7f726c0095f0 tx=0x7f726c005f90 comp rx=0 tx=0).stop 2024-09-12T02:35:01.491 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:35:01.490+0000 7f7282800640 1 -- 172.21.15.39:0/2416552315 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f727c102790 msgr2=0x7f727c074a30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:35:01.491 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:35:01.490+0000 7f7282800640 1 --2- 172.21.15.39:0/2416552315 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f727c102790 0x7f727c074a30 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7f726400e9f0 tx=0x7f726400eeb0 comp rx=0 tx=0).stop 2024-09-12T02:35:01.491 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:35:01.490+0000 7f7282800640 1 -- 172.21.15.39:0/2416552315 shutdown_connections 2024-09-12T02:35:01.492 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:35:01.490+0000 7f7282800640 1 --2- 172.21.15.39:0/2416552315 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f727c106f10 0x7f727c074f70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:35:01.492 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:35:01.490+0000 7f7282800640 1 --2- 172.21.15.39:0/2416552315 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f727c102790 0x7f727c074a30 secure :-1 s=CLOSED pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7f726400e9f0 tx=0x7f726400eeb0 comp rx=0 tx=0).stop 2024-09-12T02:35:01.492 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:35:01.490+0000 7f7282800640 1 --2- 172.21.15.39:0/2416552315 >> [v2:172.21.15.39:6800/1725006999,v1:172.21.15.39:6801/1725006999] conn(0x7f72600a2c00 0x7f72600a50c0 unknown :-1 s=CLOSED pgs=145 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:35:01.492 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:35:01.490+0000 7f7282800640 1 --2- 172.21.15.39:0/2416552315 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f727c101de0 0x7f727c0744f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:35:01.492 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:35:01.490+0000 7f7282800640 1 -- 172.21.15.39:0/2416552315 >> 172.21.15.39:0/2416552315 conn(0x7f727c0fd8c0 msgr2=0x7f727c0febf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:35:01.492 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:35:01.490+0000 7f7282800640 1 -- 172.21.15.39:0/2416552315 shutdown_connections 2024-09-12T02:35:01.492 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:35:01.491+0000 7f7282800640 1 -- 172.21.15.39:0/2416552315 wait complete. 2024-09-12T02:35:01.698 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 12 02:35:01 smithi044 ceph-mon[35411]: osdmap e80: 12 total, 12 up, 12 in 2024-09-12T02:35:01.698 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 12 02:35:01 smithi044 ceph-mon[35411]: from='mgr.14150 172.21.15.39:0/408627207' entity='mgr.x' 2024-09-12T02:35:01.699 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 12 02:35:01 smithi044 ceph-mon[35411]: from='mgr.14150 172.21.15.39:0/408627207' entity='mgr.x' 2024-09-12T02:35:01.699 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 12 02:35:01 smithi044 ceph-mon[35411]: from='mgr.14150 172.21.15.39:0/408627207' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-12T02:35:01.699 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 12 02:35:01 smithi044 ceph-mon[35411]: from='mgr.14150 172.21.15.39:0/408627207' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-12T02:35:01.699 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 12 02:35:01 smithi044 ceph-mon[35411]: from='mgr.14150 172.21.15.39:0/408627207' entity='mgr.x' 2024-09-12T02:35:01.764 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 12 02:35:01 smithi172 ceph-mon[35609]: osdmap e80: 12 total, 12 up, 12 in 2024-09-12T02:35:01.764 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 12 02:35:01 smithi172 ceph-mon[35609]: from='mgr.14150 172.21.15.39:0/408627207' entity='mgr.x' 2024-09-12T02:35:01.764 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 12 02:35:01 smithi172 ceph-mon[35609]: from='mgr.14150 172.21.15.39:0/408627207' entity='mgr.x' 2024-09-12T02:35:01.764 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 12 02:35:01 smithi172 ceph-mon[35609]: from='mgr.14150 172.21.15.39:0/408627207' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-12T02:35:01.764 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 12 02:35:01 smithi172 ceph-mon[35609]: from='mgr.14150 172.21.15.39:0/408627207' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-12T02:35:01.764 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 12 02:35:01 smithi172 ceph-mon[35609]: from='mgr.14150 172.21.15.39:0/408627207' entity='mgr.x' 2024-09-12T02:35:01.849 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 02:35:01 smithi039 ceph-mon[30515]: osdmap e80: 12 total, 12 up, 12 in 2024-09-12T02:35:01.850 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 02:35:01 smithi039 ceph-mon[30515]: from='mgr.14150 172.21.15.39:0/408627207' entity='mgr.x' 2024-09-12T02:35:01.850 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 02:35:01 smithi039 ceph-mon[30515]: from='mgr.14150 172.21.15.39:0/408627207' entity='mgr.x' 2024-09-12T02:35:01.850 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 02:35:01 smithi039 ceph-mon[30515]: from='mgr.14150 172.21.15.39:0/408627207' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-12T02:35:01.850 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 02:35:01 smithi039 ceph-mon[30515]: from='mgr.14150 172.21.15.39:0/408627207' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-12T02:35:01.850 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 02:35:01 smithi039 ceph-mon[30515]: from='mgr.14150 172.21.15.39:0/408627207' entity='mgr.x' 2024-09-12T02:35:02.287 DEBUG:teuthology.orchestra.run.smithi039:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc shell --fsid 4954ed46-70ae-11ef-bcea-c7b262605968 -- ceph fs new cephfs cephfs_metadata cephfs_data 2024-09-12T02:35:02.599 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 02:35:02 smithi039 ceph-mon[30515]: pgmap v288: 33 pgs: 4 active+clean, 3 creating+peering, 26 unknown; 577 KiB data, 344 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-12T02:35:02.599 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 02:35:02 smithi039 ceph-mon[30515]: from='client.? 172.21.15.39:0/2416552315' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.05}]: dispatch 2024-09-12T02:35:02.600 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 02:35:02 smithi039 ceph-mon[30515]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.05}]: dispatch 2024-09-12T02:35:02.600 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 02:35:02 smithi039 ceph-mon[30515]: Health check failed: 1 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2024-09-12T02:35:02.600 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 02:35:02 smithi039 ceph-mon[30515]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.05}]': finished 2024-09-12T02:35:02.600 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 02:35:02 smithi039 ceph-mon[30515]: osdmap e81: 12 total, 12 up, 12 in 2024-09-12T02:35:02.682 INFO:teuthology.orchestra.run.smithi039.stderr:Inferring config /var/lib/ceph/4954ed46-70ae-11ef-bcea-c7b262605968/mon.a/config 2024-09-12T02:35:02.763 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 12 02:35:02 smithi172 ceph-mon[35609]: pgmap v288: 33 pgs: 4 active+clean, 3 creating+peering, 26 unknown; 577 KiB data, 344 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-12T02:35:02.764 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 12 02:35:02 smithi172 ceph-mon[35609]: from='client.? 172.21.15.39:0/2416552315' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.05}]: dispatch 2024-09-12T02:35:02.764 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 12 02:35:02 smithi172 ceph-mon[35609]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.05}]: dispatch 2024-09-12T02:35:02.764 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 12 02:35:02 smithi172 ceph-mon[35609]: Health check failed: 1 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2024-09-12T02:35:02.764 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 12 02:35:02 smithi172 ceph-mon[35609]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.05}]': finished 2024-09-12T02:35:02.764 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 12 02:35:02 smithi172 ceph-mon[35609]: osdmap e81: 12 total, 12 up, 12 in 2024-09-12T02:35:02.948 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 12 02:35:02 smithi044 ceph-mon[35411]: pgmap v288: 33 pgs: 4 active+clean, 3 creating+peering, 26 unknown; 577 KiB data, 344 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-12T02:35:02.948 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 12 02:35:02 smithi044 ceph-mon[35411]: from='client.? 172.21.15.39:0/2416552315' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.05}]: dispatch 2024-09-12T02:35:02.949 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 12 02:35:02 smithi044 ceph-mon[35411]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.05}]: dispatch 2024-09-12T02:35:02.949 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 12 02:35:02 smithi044 ceph-mon[35411]: Health check failed: 1 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2024-09-12T02:35:02.949 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 12 02:35:02 smithi044 ceph-mon[35411]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.05}]': finished 2024-09-12T02:35:02.949 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 12 02:35:02 smithi044 ceph-mon[35411]: osdmap e81: 12 total, 12 up, 12 in 2024-09-12T02:35:03.295 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:35:03.285+0000 7fec50400640 1 -- 172.21.15.39:0/2336777844 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fec48077040 msgr2=0x7fec481124f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:35:03.296 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:35:03.285+0000 7fec50400640 1 --2- 172.21.15.39:0/2336777844 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fec48077040 0x7fec481124f0 secure :-1 s=READY pgs=149 cs=0 l=1 rev1=1 crypto rx=0x7fec34009900 tx=0x7fec3402a3f0 comp rx=0 tx=0).stop 2024-09-12T02:35:03.296 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:35:03.285+0000 7fec50400640 1 -- 172.21.15.39:0/2336777844 shutdown_connections 2024-09-12T02:35:03.296 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:35:03.285+0000 7fec50400640 1 --2- 172.21.15.39:0/2336777844 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fec48112a30 0x7fec48114e20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:35:03.296 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:35:03.285+0000 7fec50400640 1 --2- 172.21.15.39:0/2336777844 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fec48077040 0x7fec481124f0 unknown :-1 s=CLOSED pgs=149 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:35:03.296 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:35:03.285+0000 7fec50400640 1 --2- 172.21.15.39:0/2336777844 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fec48076720 0x7fec48076b00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:35:03.296 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:35:03.285+0000 7fec50400640 1 -- 172.21.15.39:0/2336777844 >> 172.21.15.39:0/2336777844 conn(0x7fec480ffa90 msgr2=0x7fec48101eb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:35:03.296 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:35:03.285+0000 7fec50400640 1 -- 172.21.15.39:0/2336777844 shutdown_connections 2024-09-12T02:35:03.296 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:35:03.285+0000 7fec50400640 1 -- 172.21.15.39:0/2336777844 wait complete. 2024-09-12T02:35:03.298 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:35:03.286+0000 7fec50400640 1 Processor -- start 2024-09-12T02:35:03.298 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:35:03.286+0000 7fec50400640 1 -- start start 2024-09-12T02:35:03.299 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:35:03.286+0000 7fec50400640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fec48076720 0x7fec481a46d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:35:03.299 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:35:03.286+0000 7fec50400640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fec48077040 0x7fec481a4c10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:35:03.299 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:35:03.286+0000 7fec50400640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fec48112a30 0x7fec4819e890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:35:03.299 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:35:03.286+0000 7fec50400640 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 -- 0x7fec481185a0 con 0x7fec48076720 2024-09-12T02:35:03.299 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:35:03.286+0000 7fec50400640 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x7fec48118420 con 0x7fec48112a30 2024-09-12T02:35:03.299 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:35:03.286+0000 7fec50400640 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7fec48118720 con 0x7fec48077040 2024-09-12T02:35:03.299 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:35:03.286+0000 7fec4da00640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fec48076720 0x7fec481a46d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:35:03.299 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:35:03.287+0000 7fec4da00640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fec48076720 0x7fec481a46d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.39:3300/0 says I am v2:172.21.15.39:34232/0 (socket says 172.21.15.39:34232) 2024-09-12T02:35:03.299 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:35:03.287+0000 7fec4da00640 1 -- 172.21.15.39:0/2486317636 learned_addr learned my addr 172.21.15.39:0/2486317636 (peer_addr_for_me v2:172.21.15.39:0/0) 2024-09-12T02:35:03.299 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:35:03.287+0000 7fec4e400640 1 --2- 172.21.15.39:0/2486317636 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fec48112a30 0x7fec4819e890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:35:03.299 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:35:03.287+0000 7fec4d000640 1 --2- 172.21.15.39:0/2486317636 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fec48077040 0x7fec481a4c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:35:03.299 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:35:03.287+0000 7fec4da00640 1 -- 172.21.15.39:0/2486317636 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fec48077040 msgr2=0x7fec481a4c10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:35:03.300 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:35:03.287+0000 7fec4da00640 1 --2- 172.21.15.39:0/2486317636 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fec48077040 0x7fec481a4c10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:35:03.300 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:35:03.287+0000 7fec4da00640 1 -- 172.21.15.39:0/2486317636 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fec48112a30 msgr2=0x7fec4819e890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:35:03.300 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:35:03.287+0000 7fec4da00640 1 --2- 172.21.15.39:0/2486317636 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fec48112a30 0x7fec4819e890 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:35:03.300 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:35:03.287+0000 7fec4da00640 1 -- 172.21.15.39:0/2486317636 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fec4819efc0 con 0x7fec48076720 2024-09-12T02:35:03.300 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:35:03.287+0000 7fec4da00640 1 --2- 172.21.15.39:0/2486317636 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fec48076720 0x7fec481a46d0 secure :-1 s=READY pgs=150 cs=0 l=1 rev1=1 crypto rx=0x7fec3c00e9f0 tx=0x7fec3c00eeb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:35:03.300 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:35:03.288+0000 7fec46000640 1 -- 172.21.15.39:0/2486317636 <== mon.0 v2:172.21.15.39:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fec3c00cd80 con 0x7fec48076720 2024-09-12T02:35:03.300 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:35:03.288+0000 7fec46000640 1 -- 172.21.15.39:0/2486317636 <== mon.0 v2:172.21.15.39:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fec3c010910 con 0x7fec48076720 2024-09-12T02:35:03.300 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:35:03.288+0000 7fec46000640 1 -- 172.21.15.39:0/2486317636 <== mon.0 v2:172.21.15.39:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fec3c018990 con 0x7fec48076720 2024-09-12T02:35:03.300 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:35:03.288+0000 7fec50400640 1 -- 172.21.15.39:0/2486317636 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fec4819f2b0 con 0x7fec48076720 2024-09-12T02:35:03.300 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:35:03.288+0000 7fec50400640 1 -- 172.21.15.39:0/2486317636 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fec481ab5a0 con 0x7fec48076720 2024-09-12T02:35:03.300 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:35:03.289+0000 7fec50400640 1 -- 172.21.15.39:0/2486317636 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fec48077e60 con 0x7fec48076720 2024-09-12T02:35:03.300 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:35:03.291+0000 7fec46000640 1 -- 172.21.15.39:0/2486317636 <== mon.0 v2:172.21.15.39:3300/0 4 ==== mgrmap(e 16) ==== 137833+0+0 (secure 0 0 0) 0x7fec3c010ac0 con 0x7fec48076720 2024-09-12T02:35:03.300 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:35:03.292+0000 7fec46000640 1 --2- 172.21.15.39:0/2486317636 >> [v2:172.21.15.39:6800/1725006999,v1:172.21.15.39:6801/1725006999] conn(0x7fec300a2b80 0x7fec300a5040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:35:03.301 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:35:03.292+0000 7fec46000640 1 -- 172.21.15.39:0/2486317636 <== mon.0 v2:172.21.15.39:3300/0 5 ==== osd_map(82..82 src has 1..82) ==== 7879+0+0 (secure 0 0 0) 0x7fec3c0cf680 con 0x7fec48076720 2024-09-12T02:35:03.301 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:35:03.292+0000 7fec4d000640 1 --2- 172.21.15.39:0/2486317636 >> [v2:172.21.15.39:6800/1725006999,v1:172.21.15.39:6801/1725006999] conn(0x7fec300a2b80 0x7fec300a5040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:35:03.301 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:35:03.293+0000 7fec4d000640 1 --2- 172.21.15.39:0/2486317636 >> [v2:172.21.15.39:6800/1725006999,v1:172.21.15.39:6801/1725006999] conn(0x7fec300a2b80 0x7fec300a5040 secure :-1 s=READY pgs=146 cs=0 l=1 rev1=1 crypto rx=0x7fec34009230 tx=0x7fec340058d0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:35:03.301 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:35:03.295+0000 7fec46000640 1 -- 172.21.15.39:0/2486317636 <== mon.0 v2:172.21.15.39:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7fec3c09c0a0 con 0x7fec48076720 2024-09-12T02:35:03.521 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:35:03.520+0000 7fec50400640 1 -- 172.21.15.39:0/2486317636 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_command({"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"} v 0) -- 0x7fec481ab7e0 con 0x7fec48076720 2024-09-12T02:35:03.763 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 12 02:35:03 smithi172 ceph-mon[35609]: osdmap e82: 12 total, 12 up, 12 in 2024-09-12T02:35:03.849 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 02:35:03 smithi039 ceph-mon[30515]: osdmap e82: 12 total, 12 up, 12 in 2024-09-12T02:35:03.948 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 12 02:35:03 smithi044 ceph-mon[35411]: osdmap e82: 12 total, 12 up, 12 in 2024-09-12T02:35:04.500 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:35:04.499+0000 7fec46000640 1 -- 172.21.15.39:0/2486317636 <== mon.0 v2:172.21.15.39:3300/0 7 ==== mon_command_ack([{"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"}]=0 new fs with metadata pool 2 and data pool 3 v14) ==== 172+0+0 (secure 0 0 0) 0x7fec3c0a03a0 con 0x7fec48076720 2024-09-12T02:35:04.501 INFO:teuthology.orchestra.run.smithi039.stderr:new fs with metadata pool 2 and data pool 3 2024-09-12T02:35:04.504 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:35:04.503+0000 7fec50400640 1 -- 172.21.15.39:0/2486317636 >> [v2:172.21.15.39:6800/1725006999,v1:172.21.15.39:6801/1725006999] conn(0x7fec300a2b80 msgr2=0x7fec300a5040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:35:04.504 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:35:04.503+0000 7fec50400640 1 --2- 172.21.15.39:0/2486317636 >> [v2:172.21.15.39:6800/1725006999,v1:172.21.15.39:6801/1725006999] conn(0x7fec300a2b80 0x7fec300a5040 secure :-1 s=READY pgs=146 cs=0 l=1 rev1=1 crypto rx=0x7fec34009230 tx=0x7fec340058d0 comp rx=0 tx=0).stop 2024-09-12T02:35:04.504 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:35:04.503+0000 7fec50400640 1 -- 172.21.15.39:0/2486317636 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fec48076720 msgr2=0x7fec481a46d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:35:04.504 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:35:04.503+0000 7fec50400640 1 --2- 172.21.15.39:0/2486317636 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fec48076720 0x7fec481a46d0 secure :-1 s=READY pgs=150 cs=0 l=1 rev1=1 crypto rx=0x7fec3c00e9f0 tx=0x7fec3c00eeb0 comp rx=0 tx=0).stop 2024-09-12T02:35:04.504 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:35:04.503+0000 7fec50400640 1 -- 172.21.15.39:0/2486317636 shutdown_connections 2024-09-12T02:35:04.504 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:35:04.503+0000 7fec50400640 1 --2- 172.21.15.39:0/2486317636 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fec48112a30 0x7fec4819e890 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:35:04.505 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:35:04.503+0000 7fec50400640 1 --2- 172.21.15.39:0/2486317636 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fec48077040 0x7fec481a4c10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:35:04.505 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:35:04.503+0000 7fec50400640 1 --2- 172.21.15.39:0/2486317636 >> [v2:172.21.15.39:6800/1725006999,v1:172.21.15.39:6801/1725006999] conn(0x7fec300a2b80 0x7fec300a5040 unknown :-1 s=CLOSED pgs=146 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:35:04.505 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:35:04.503+0000 7fec50400640 1 --2- 172.21.15.39:0/2486317636 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fec48076720 0x7fec481a46d0 unknown :-1 s=CLOSED pgs=150 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:35:04.505 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:35:04.503+0000 7fec50400640 1 -- 172.21.15.39:0/2486317636 >> 172.21.15.39:0/2486317636 conn(0x7fec480ffa90 msgr2=0x7fec48101e80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:35:04.505 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:35:04.503+0000 7fec50400640 1 -- 172.21.15.39:0/2486317636 shutdown_connections 2024-09-12T02:35:04.505 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:35:04.503+0000 7fec50400640 1 -- 172.21.15.39:0/2486317636 wait complete. 2024-09-12T02:35:04.751 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 02:35:04 smithi039 ceph-mon[30515]: pgmap v291: 97 pgs: 6 active+clean, 11 creating+peering, 80 unknown; 577 KiB data, 344 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-12T02:35:04.751 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 02:35:04 smithi039 ceph-mon[30515]: osdmap e83: 12 total, 12 up, 12 in 2024-09-12T02:35:04.751 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 02:35:04 smithi039 ceph-mon[30515]: from='client.? 172.21.15.39:0/2486317636' entity='client.admin' cmd=[{"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"}]: dispatch 2024-09-12T02:35:04.752 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 02:35:04 smithi039 ceph-mon[30515]: daemon mds.b assigned to filesystem cephfs as rank 0 2024-09-12T02:35:04.948 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 12 02:35:04 smithi044 ceph-mon[35411]: pgmap v291: 97 pgs: 6 active+clean, 11 creating+peering, 80 unknown; 577 KiB data, 344 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-12T02:35:04.949 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 12 02:35:04 smithi044 ceph-mon[35411]: osdmap e83: 12 total, 12 up, 12 in 2024-09-12T02:35:04.949 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 12 02:35:04 smithi044 ceph-mon[35411]: from='client.? 172.21.15.39:0/2486317636' entity='client.admin' cmd=[{"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"}]: dispatch 2024-09-12T02:35:04.949 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 12 02:35:04 smithi044 ceph-mon[35411]: daemon mds.b assigned to filesystem cephfs as rank 0 2024-09-12T02:35:05.002 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 12 02:35:04 smithi172 ceph-mon[35609]: pgmap v291: 97 pgs: 6 active+clean, 11 creating+peering, 80 unknown; 577 KiB data, 344 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-12T02:35:05.003 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 12 02:35:04 smithi172 ceph-mon[35609]: osdmap e83: 12 total, 12 up, 12 in 2024-09-12T02:35:05.003 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 12 02:35:04 smithi172 ceph-mon[35609]: from='client.? 172.21.15.39:0/2486317636' entity='client.admin' cmd=[{"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"}]: dispatch 2024-09-12T02:35:05.003 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 12 02:35:04 smithi172 ceph-mon[35609]: daemon mds.b assigned to filesystem cephfs as rank 0 2024-09-12T02:35:05.539 DEBUG:tasks.cephfs.filesystem:EC profile is ['m=2', 'k=2', 'crush-failure-domain=osd'] 2024-09-12T02:35:05.539 DEBUG:teuthology.orchestra.run.smithi039:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc shell --fsid 4954ed46-70ae-11ef-bcea-c7b262605968 -- ceph osd erasure-code-profile set cephfs_data_ec m=2 k=2 crush-failure-domain=osd 2024-09-12T02:35:05.849 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 02:35:05 smithi039 ceph-mon[30515]: from='client.? 172.21.15.39:0/2486317636' entity='client.admin' cmd='[{"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"}]': finished 2024-09-12T02:35:05.850 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 02:35:05 smithi039 ceph-mon[30515]: osdmap e84: 12 total, 12 up, 12 in 2024-09-12T02:35:05.850 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 02:35:05 smithi039 ceph-mon[30515]: fsmap cephfs:1 {0=b=up:creating} 11 up:standby 2024-09-12T02:35:05.850 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 02:35:05 smithi039 ceph-mon[30515]: daemon mds.b is now active in filesystem cephfs as rank 0 2024-09-12T02:35:05.923 INFO:teuthology.orchestra.run.smithi039.stderr:Inferring config /var/lib/ceph/4954ed46-70ae-11ef-bcea-c7b262605968/mon.a/config 2024-09-12T02:35:05.948 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 12 02:35:05 smithi044 ceph-mon[35411]: from='client.? 172.21.15.39:0/2486317636' entity='client.admin' cmd='[{"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"}]': finished 2024-09-12T02:35:05.949 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 12 02:35:05 smithi044 ceph-mon[35411]: osdmap e84: 12 total, 12 up, 12 in 2024-09-12T02:35:05.949 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 12 02:35:05 smithi044 ceph-mon[35411]: fsmap cephfs:1 {0=b=up:creating} 11 up:standby 2024-09-12T02:35:05.949 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 12 02:35:05 smithi044 ceph-mon[35411]: daemon mds.b is now active in filesystem cephfs as rank 0 2024-09-12T02:35:06.013 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 12 02:35:05 smithi172 ceph-mon[35609]: from='client.? 172.21.15.39:0/2486317636' entity='client.admin' cmd='[{"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"}]': finished 2024-09-12T02:35:06.013 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 12 02:35:05 smithi172 ceph-mon[35609]: osdmap e84: 12 total, 12 up, 12 in 2024-09-12T02:35:06.014 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 12 02:35:05 smithi172 ceph-mon[35609]: fsmap cephfs:1 {0=b=up:creating} 11 up:standby 2024-09-12T02:35:06.014 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 12 02:35:05 smithi172 ceph-mon[35609]: daemon mds.b is now active in filesystem cephfs as rank 0 2024-09-12T02:35:06.505 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:35:06.504+0000 7f2ec6800640 1 -- 172.21.15.39:0/3925900346 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f2ec01049c0 msgr2=0x7f2ec0108a10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:35:06.505 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:35:06.504+0000 7f2ec6800640 1 --2- 172.21.15.39:0/3925900346 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f2ec01049c0 0x7f2ec0108a10 secure :-1 s=READY pgs=151 cs=0 l=1 rev1=1 crypto rx=0x7f2eac009900 tx=0x7f2eac02a410 comp rx=0 tx=0).stop 2024-09-12T02:35:06.505 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:35:06.504+0000 7f2ec6800640 1 -- 172.21.15.39:0/3925900346 shutdown_connections 2024-09-12T02:35:06.505 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:35:06.504+0000 7f2ec6800640 1 --2- 172.21.15.39:0/3925900346 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f2ec0109140 0x7f2ec0110cc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:35:06.506 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:35:06.504+0000 7f2ec6800640 1 --2- 172.21.15.39:0/3925900346 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f2ec01049c0 0x7f2ec0108a10 unknown :-1 s=CLOSED pgs=151 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:35:06.506 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:35:06.504+0000 7f2ec6800640 1 --2- 172.21.15.39:0/3925900346 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f2ec0104010 0x7f2ec01043f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:35:06.506 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:35:06.504+0000 7f2ec6800640 1 -- 172.21.15.39:0/3925900346 >> 172.21.15.39:0/3925900346 conn(0x7f2ec00ffa50 msgr2=0x7f2ec0101e70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:35:06.506 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:35:06.504+0000 7f2ec6800640 1 -- 172.21.15.39:0/3925900346 shutdown_connections 2024-09-12T02:35:06.506 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:35:06.504+0000 7f2ec6800640 1 -- 172.21.15.39:0/3925900346 wait complete. 2024-09-12T02:35:06.507 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:35:06.505+0000 7f2ec6800640 1 Processor -- start 2024-09-12T02:35:06.507 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:35:06.505+0000 7f2ec6800640 1 -- start start 2024-09-12T02:35:06.507 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:35:06.506+0000 7f2ec6800640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f2ec0104010 0x7f2ec019a670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:35:06.507 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:35:06.506+0000 7f2ec6800640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f2ec01049c0 0x7f2ec019abb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:35:06.507 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:35:06.506+0000 7f2ec6800640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f2ec0109140 0x7f2ec019ef40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:35:06.507 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:35:06.506+0000 7f2ec6800640 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 -- 0x7f2ec01141b0 con 0x7f2ec0109140 2024-09-12T02:35:06.508 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:35:06.506+0000 7f2ec6800640 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x7f2ec0114030 con 0x7f2ec0104010 2024-09-12T02:35:06.508 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:35:06.506+0000 7f2ec6800640 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7f2ec0114330 con 0x7f2ec01049c0 2024-09-12T02:35:06.508 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:35:06.506+0000 7f2ebf400640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f2ec0104010 0x7f2ec019a670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:35:06.508 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:35:06.506+0000 7f2ebf400640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f2ec0104010 0x7f2ec019a670 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.39:60712/0 (socket says 172.21.15.39:60712) 2024-09-12T02:35:06.508 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:35:06.506+0000 7f2ebf400640 1 -- 172.21.15.39:0/3913791395 learned_addr learned my addr 172.21.15.39:0/3913791395 (peer_addr_for_me v2:172.21.15.39:0/0) 2024-09-12T02:35:06.508 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:35:06.506+0000 7f2ebea00640 1 --2- 172.21.15.39:0/3913791395 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f2ec01049c0 0x7f2ec019abb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:35:06.509 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:35:06.507+0000 7f2ebfe00640 1 --2- 172.21.15.39:0/3913791395 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f2ec0109140 0x7f2ec019ef40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:35:06.509 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:35:06.507+0000 7f2ebea00640 1 -- 172.21.15.39:0/3913791395 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f2ec0104010 msgr2=0x7f2ec019a670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:35:06.509 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:35:06.507+0000 7f2ebea00640 1 --2- 172.21.15.39:0/3913791395 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f2ec0104010 0x7f2ec019a670 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:35:06.509 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:35:06.507+0000 7f2ebea00640 1 -- 172.21.15.39:0/3913791395 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f2ec0109140 msgr2=0x7f2ec019ef40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:35:06.509 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:35:06.507+0000 7f2ebea00640 1 --2- 172.21.15.39:0/3913791395 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f2ec0109140 0x7f2ec019ef40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:35:06.509 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:35:06.507+0000 7f2ebea00640 1 -- 172.21.15.39:0/3913791395 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2ec019f620 con 0x7f2ec01049c0 2024-09-12T02:35:06.509 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:35:06.507+0000 7f2ebf400640 1 --2- 172.21.15.39:0/3913791395 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f2ec0104010 0x7f2ec019a670 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-12T02:35:06.509 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:35:06.507+0000 7f2ebea00640 1 --2- 172.21.15.39:0/3913791395 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f2ec01049c0 0x7f2ec019abb0 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7f2eac02a930 tx=0x7f2eac003b20 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:35:06.509 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:35:06.508+0000 7f2eb7e00640 1 -- 172.21.15.39:0/3913791395 <== mon.1 v2:172.21.15.172:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2eac03f070 con 0x7f2ec01049c0 2024-09-12T02:35:06.510 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:35:06.508+0000 7f2eb7e00640 1 -- 172.21.15.39:0/3913791395 <== mon.1 v2:172.21.15.172:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f2eac031c90 con 0x7f2ec01049c0 2024-09-12T02:35:06.510 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:35:06.508+0000 7f2ec6800640 1 -- 172.21.15.39:0/3913791395 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f2ec019f8b0 con 0x7f2ec01049c0 2024-09-12T02:35:06.510 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:35:06.508+0000 7f2eb7e00640 1 -- 172.21.15.39:0/3913791395 <== mon.1 v2:172.21.15.172:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2eac035030 con 0x7f2ec01049c0 2024-09-12T02:35:06.510 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:35:06.508+0000 7f2ec6800640 1 -- 172.21.15.39:0/3913791395 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f2ec01a71f0 con 0x7f2ec01049c0 2024-09-12T02:35:06.510 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:35:06.509+0000 7f2ec6800640 1 -- 172.21.15.39:0/3913791395 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f2ec01043f0 con 0x7f2ec01049c0 2024-09-12T02:35:06.511 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:35:06.511+0000 7f2eb7e00640 1 -- 172.21.15.39:0/3913791395 <== mon.1 v2:172.21.15.172:3300/0 4 ==== mgrmap(e 16) ==== 137833+0+0 (secure 0 0 0) 0x7f2eac042070 con 0x7f2ec01049c0 2024-09-12T02:35:06.513 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:35:06.512+0000 7f2eb7e00640 1 --2- 172.21.15.39:0/3913791395 >> [v2:172.21.15.39:6800/1725006999,v1:172.21.15.39:6801/1725006999] conn(0x7f2ea40a2c00 0x7f2ea40a50c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:35:06.513 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:35:06.512+0000 7f2eb7e00640 1 -- 172.21.15.39:0/3913791395 <== mon.1 v2:172.21.15.172:3300/0 5 ==== osd_map(84..84 src has 1..84) ==== 7979+0+0 (secure 0 0 0) 0x7f2eac0ef8b0 con 0x7f2ec01049c0 2024-09-12T02:35:06.513 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:35:06.513+0000 7f2ebf400640 1 --2- 172.21.15.39:0/3913791395 >> [v2:172.21.15.39:6800/1725006999,v1:172.21.15.39:6801/1725006999] conn(0x7f2ea40a2c00 0x7f2ea40a50c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:35:06.514 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:35:06.513+0000 7f2ebf400640 1 --2- 172.21.15.39:0/3913791395 >> [v2:172.21.15.39:6800/1725006999,v1:172.21.15.39:6801/1725006999] conn(0x7f2ea40a2c00 0x7f2ea40a50c0 secure :-1 s=READY pgs=147 cs=0 l=1 rev1=1 crypto rx=0x7f2eb0011500 tx=0x7f2eb0005f90 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:35:06.517 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:35:06.516+0000 7f2eb7e00640 1 -- 172.21.15.39:0/3913791395 <== mon.1 v2:172.21.15.172:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7f2eac0bc8c0 con 0x7f2ec01049c0 2024-09-12T02:35:06.713 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:35:06.711+0000 7f2ec6800640 1 -- 172.21.15.39:0/3913791395 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_command({"prefix": "osd erasure-code-profile set", "name": "cephfs_data_ec", "profile": ["m=2", "k=2", "crush-failure-domain=osd"]} v 0) -- 0x7f2ec019b9d0 con 0x7f2ec01049c0 2024-09-12T02:35:06.713 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 02:35:06 smithi039 ceph-mon[30515]: pgmap v294: 97 pgs: 81 active+clean, 8 creating+peering, 8 unknown; 577 KiB data, 345 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-12T02:35:06.713 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 02:35:06 smithi039 ceph-mon[30515]: Health check cleared: POOL_APP_NOT_ENABLED (was: 2 pool(s) do not have an application enabled) 2024-09-12T02:35:06.713 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 02:35:06 smithi039 ceph-mon[30515]: Cluster is now healthy 2024-09-12T02:35:06.713 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 02:35:06 smithi039 ceph-mon[30515]: mds.? [v2:172.21.15.44:6838/2556532723,v1:172.21.15.44:6839/2556532723] up:active 2024-09-12T02:35:06.714 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 02:35:06 smithi039 ceph-mon[30515]: fsmap cephfs:1 {0=b=up:active} 11 up:standby 2024-09-12T02:35:06.714 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 02:35:06 smithi039 ceph-mon[30515]: fsmap cephfs:1 {0=b=up:active} 11 up:standby 2024-09-12T02:35:06.948 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 12 02:35:06 smithi044 ceph-mon[35411]: pgmap v294: 97 pgs: 81 active+clean, 8 creating+peering, 8 unknown; 577 KiB data, 345 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-12T02:35:06.949 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 12 02:35:06 smithi044 ceph-mon[35411]: Health check cleared: POOL_APP_NOT_ENABLED (was: 2 pool(s) do not have an application enabled) 2024-09-12T02:35:06.949 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 12 02:35:06 smithi044 ceph-mon[35411]: Cluster is now healthy 2024-09-12T02:35:06.949 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 12 02:35:06 smithi044 ceph-mon[35411]: mds.? [v2:172.21.15.44:6838/2556532723,v1:172.21.15.44:6839/2556532723] up:active 2024-09-12T02:35:06.949 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 12 02:35:06 smithi044 ceph-mon[35411]: fsmap cephfs:1 {0=b=up:active} 11 up:standby 2024-09-12T02:35:06.949 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 12 02:35:06 smithi044 ceph-mon[35411]: fsmap cephfs:1 {0=b=up:active} 11 up:standby 2024-09-12T02:35:07.013 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 12 02:35:06 smithi172 ceph-mon[35609]: pgmap v294: 97 pgs: 81 active+clean, 8 creating+peering, 8 unknown; 577 KiB data, 345 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-12T02:35:07.014 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 12 02:35:06 smithi172 ceph-mon[35609]: Health check cleared: POOL_APP_NOT_ENABLED (was: 2 pool(s) do not have an application enabled) 2024-09-12T02:35:07.014 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 12 02:35:06 smithi172 ceph-mon[35609]: Cluster is now healthy 2024-09-12T02:35:07.014 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 12 02:35:06 smithi172 ceph-mon[35609]: mds.? [v2:172.21.15.44:6838/2556532723,v1:172.21.15.44:6839/2556532723] up:active 2024-09-12T02:35:07.014 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 12 02:35:06 smithi172 ceph-mon[35609]: fsmap cephfs:1 {0=b=up:active} 11 up:standby 2024-09-12T02:35:07.014 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 12 02:35:06 smithi172 ceph-mon[35609]: fsmap cephfs:1 {0=b=up:active} 11 up:standby 2024-09-12T02:35:07.547 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:35:07.546+0000 7f2eb7e00640 1 -- 172.21.15.39:0/3913791395 <== mon.1 v2:172.21.15.172:3300/0 7 ==== mon_command_ack([{"prefix": "osd erasure-code-profile set", "name": "cephfs_data_ec", "profile": ["m=2", "k=2", "crush-failure-domain=osd"]}]=0 v85) ==== 157+0+0 (secure 0 0 0) 0x7f2ec019b9d0 con 0x7f2ec01049c0 2024-09-12T02:35:07.549 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:35:07.548+0000 7f2ec6800640 1 -- 172.21.15.39:0/3913791395 >> [v2:172.21.15.39:6800/1725006999,v1:172.21.15.39:6801/1725006999] conn(0x7f2ea40a2c00 msgr2=0x7f2ea40a50c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:35:07.549 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:35:07.548+0000 7f2ec6800640 1 --2- 172.21.15.39:0/3913791395 >> [v2:172.21.15.39:6800/1725006999,v1:172.21.15.39:6801/1725006999] conn(0x7f2ea40a2c00 0x7f2ea40a50c0 secure :-1 s=READY pgs=147 cs=0 l=1 rev1=1 crypto rx=0x7f2eb0011500 tx=0x7f2eb0005f90 comp rx=0 tx=0).stop 2024-09-12T02:35:07.549 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:35:07.548+0000 7f2ec6800640 1 -- 172.21.15.39:0/3913791395 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f2ec01049c0 msgr2=0x7f2ec019abb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:35:07.549 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:35:07.548+0000 7f2ec6800640 1 --2- 172.21.15.39:0/3913791395 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f2ec01049c0 0x7f2ec019abb0 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7f2eac02a930 tx=0x7f2eac003b20 comp rx=0 tx=0).stop 2024-09-12T02:35:07.549 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:35:07.548+0000 7f2ec6800640 1 -- 172.21.15.39:0/3913791395 shutdown_connections 2024-09-12T02:35:07.550 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:35:07.548+0000 7f2ec6800640 1 --2- 172.21.15.39:0/3913791395 >> [v2:172.21.15.39:6800/1725006999,v1:172.21.15.39:6801/1725006999] conn(0x7f2ea40a2c00 0x7f2ea40a50c0 unknown :-1 s=CLOSED pgs=147 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:35:07.550 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:35:07.548+0000 7f2ec6800640 1 --2- 172.21.15.39:0/3913791395 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f2ec0109140 0x7f2ec019ef40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:35:07.550 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:35:07.548+0000 7f2ec6800640 1 --2- 172.21.15.39:0/3913791395 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f2ec01049c0 0x7f2ec019abb0 unknown :-1 s=CLOSED pgs=72 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:35:07.550 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:35:07.548+0000 7f2ec6800640 1 --2- 172.21.15.39:0/3913791395 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f2ec0104010 0x7f2ec019a670 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:35:07.550 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:35:07.548+0000 7f2ec6800640 1 -- 172.21.15.39:0/3913791395 >> 172.21.15.39:0/3913791395 conn(0x7f2ec00ffa50 msgr2=0x7f2ec0100d50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:35:07.550 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:35:07.549+0000 7f2ec6800640 1 -- 172.21.15.39:0/3913791395 shutdown_connections 2024-09-12T02:35:07.550 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:35:07.549+0000 7f2ec6800640 1 -- 172.21.15.39:0/3913791395 wait complete. 2024-09-12T02:35:07.789 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 02:35:07 smithi039 ceph-mon[30515]: from='client.? 172.21.15.39:0/3913791395' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile set", "name": "cephfs_data_ec", "profile": ["m=2", "k=2", "crush-failure-domain=osd"]}]: dispatch 2024-09-12T02:35:07.790 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 02:35:07 smithi039 ceph-mon[30515]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile set", "name": "cephfs_data_ec", "profile": ["m=2", "k=2", "crush-failure-domain=osd"]}]: dispatch 2024-09-12T02:35:07.949 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 12 02:35:07 smithi044 ceph-mon[35411]: from='client.? 172.21.15.39:0/3913791395' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile set", "name": "cephfs_data_ec", "profile": ["m=2", "k=2", "crush-failure-domain=osd"]}]: dispatch 2024-09-12T02:35:07.949 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 12 02:35:07 smithi044 ceph-mon[35411]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile set", "name": "cephfs_data_ec", "profile": ["m=2", "k=2", "crush-failure-domain=osd"]}]: dispatch 2024-09-12T02:35:07.949 INFO:journalctl@ceph.mds.b.smithi044.stdout:Sep 12 02:35:07 smithi044 ceph-4954ed46-70ae-11ef-bcea-c7b262605968-mds-b[65334]: 2024-09-12T02:35:07.761+0000 7f75da051640 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2024-09-12T02:35:08.013 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 12 02:35:07 smithi172 ceph-mon[35609]: from='client.? 172.21.15.39:0/3913791395' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile set", "name": "cephfs_data_ec", "profile": ["m=2", "k=2", "crush-failure-domain=osd"]}]: dispatch 2024-09-12T02:35:08.013 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 12 02:35:07 smithi172 ceph-mon[35609]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile set", "name": "cephfs_data_ec", "profile": ["m=2", "k=2", "crush-failure-domain=osd"]}]: dispatch 2024-09-12T02:35:08.463 DEBUG:teuthology.orchestra.run.smithi039:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc shell --fsid 4954ed46-70ae-11ef-bcea-c7b262605968 -- ceph osd pool create cephfs_data_ec erasure cephfs_data_ec --pg_num_min 64 --target_size_ratio 0.9 2024-09-12T02:35:08.845 INFO:teuthology.orchestra.run.smithi039.stderr:Inferring config /var/lib/ceph/4954ed46-70ae-11ef-bcea-c7b262605968/mon.a/config 2024-09-12T02:35:08.849 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 02:35:08 smithi039 ceph-mon[30515]: pgmap v295: 97 pgs: 97 active+clean; 577 KiB data, 345 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-12T02:35:08.849 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 02:35:08 smithi039 ceph-mon[30515]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile set", "name": "cephfs_data_ec", "profile": ["m=2", "k=2", "crush-failure-domain=osd"]}]': finished 2024-09-12T02:35:08.849 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 02:35:08 smithi039 ceph-mon[30515]: osdmap e85: 12 total, 12 up, 12 in 2024-09-12T02:35:08.948 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 12 02:35:08 smithi044 ceph-mon[35411]: pgmap v295: 97 pgs: 97 active+clean; 577 KiB data, 345 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-12T02:35:08.948 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 12 02:35:08 smithi044 ceph-mon[35411]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile set", "name": "cephfs_data_ec", "profile": ["m=2", "k=2", "crush-failure-domain=osd"]}]': finished 2024-09-12T02:35:08.949 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 12 02:35:08 smithi044 ceph-mon[35411]: osdmap e85: 12 total, 12 up, 12 in 2024-09-12T02:35:09.014 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 12 02:35:08 smithi172 ceph-mon[35609]: pgmap v295: 97 pgs: 97 active+clean; 577 KiB data, 345 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-12T02:35:09.014 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 12 02:35:08 smithi172 ceph-mon[35609]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile set", "name": "cephfs_data_ec", "profile": ["m=2", "k=2", "crush-failure-domain=osd"]}]': finished 2024-09-12T02:35:09.014 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 12 02:35:08 smithi172 ceph-mon[35609]: osdmap e85: 12 total, 12 up, 12 in 2024-09-12T02:35:09.415 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:35:09.414+0000 7feb75200640 1 -- 172.21.15.39:0/1096718736 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7feb70101de0 msgr2=0x7feb701021c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:35:09.415 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:35:09.414+0000 7feb75200640 1 --2- 172.21.15.39:0/1096718736 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7feb70101de0 0x7feb701021c0 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7feb60009860 tx=0x7feb6002a340 comp rx=0 tx=0).stop 2024-09-12T02:35:09.415 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:35:09.414+0000 7feb75200640 1 -- 172.21.15.39:0/1096718736 shutdown_connections 2024-09-12T02:35:09.415 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:35:09.414+0000 7feb75200640 1 --2- 172.21.15.39:0/1096718736 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7feb70106f10 0x7feb7010ea90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:35:09.415 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:35:09.414+0000 7feb75200640 1 --2- 172.21.15.39:0/1096718736 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7feb70102790 0x7feb701067e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:35:09.416 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:35:09.414+0000 7feb75200640 1 --2- 172.21.15.39:0/1096718736 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7feb70101de0 0x7feb701021c0 unknown :-1 s=CLOSED pgs=76 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:35:09.416 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:35:09.414+0000 7feb75200640 1 -- 172.21.15.39:0/1096718736 >> 172.21.15.39:0/1096718736 conn(0x7feb700fd8c0 msgr2=0x7feb700ffce0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:35:09.416 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:35:09.414+0000 7feb75200640 1 -- 172.21.15.39:0/1096718736 shutdown_connections 2024-09-12T02:35:09.416 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:35:09.414+0000 7feb75200640 1 -- 172.21.15.39:0/1096718736 wait complete. 2024-09-12T02:35:09.422 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:35:09.415+0000 7feb75200640 1 Processor -- start 2024-09-12T02:35:09.422 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:35:09.415+0000 7feb75200640 1 -- start start 2024-09-12T02:35:09.422 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:35:09.415+0000 7feb75200640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7feb70101de0 0x7feb700744f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:35:09.422 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:35:09.415+0000 7feb75200640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7feb70102790 0x7feb70074a30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:35:09.422 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:35:09.415+0000 7feb75200640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7feb70106f10 0x7feb70074f70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:35:09.422 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:35:09.415+0000 7feb75200640 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 -- 0x7feb70111f30 con 0x7feb70102790 2024-09-12T02:35:09.422 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:35:09.415+0000 7feb75200640 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x7feb70111db0 con 0x7feb70101de0 2024-09-12T02:35:09.422 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:35:09.415+0000 7feb75200640 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7feb701120b0 con 0x7feb70106f10 2024-09-12T02:35:09.422 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:35:09.416+0000 7feb65400640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7feb70102790 0x7feb70074a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:35:09.422 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:35:09.416+0000 7feb65400640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7feb70102790 0x7feb70074a30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.39:3300/0 says I am v2:172.21.15.39:45354/0 (socket says 172.21.15.39:45354) 2024-09-12T02:35:09.423 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:35:09.416+0000 7feb6de00640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7feb70101de0 0x7feb700744f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:35:09.423 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:35:09.416+0000 7feb65400640 1 -- 172.21.15.39:0/776098333 learned_addr learned my addr 172.21.15.39:0/776098333 (peer_addr_for_me v2:172.21.15.39:0/0) 2024-09-12T02:35:09.423 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:35:09.416+0000 7feb6e800640 1 --2- 172.21.15.39:0/776098333 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7feb70106f10 0x7feb70074f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:35:09.423 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:35:09.416+0000 7feb6de00640 1 -- 172.21.15.39:0/776098333 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7feb70106f10 msgr2=0x7feb70074f70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:35:09.423 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:35:09.416+0000 7feb6de00640 1 --2- 172.21.15.39:0/776098333 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7feb70106f10 0x7feb70074f70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:35:09.423 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:35:09.416+0000 7feb6de00640 1 -- 172.21.15.39:0/776098333 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7feb70102790 msgr2=0x7feb70074a30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:35:09.423 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:35:09.416+0000 7feb6de00640 1 --2- 172.21.15.39:0/776098333 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7feb70102790 0x7feb70074a30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:35:09.423 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:35:09.416+0000 7feb6de00640 1 -- 172.21.15.39:0/776098333 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7feb701a68e0 con 0x7feb70101de0 2024-09-12T02:35:09.423 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:35:09.416+0000 7feb6e800640 1 --2- 172.21.15.39:0/776098333 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7feb70106f10 0x7feb70074f70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-12T02:35:09.423 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:35:09.416+0000 7feb6de00640 1 --2- 172.21.15.39:0/776098333 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7feb70101de0 0x7feb700744f0 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7feb6002a860 tx=0x7feb60033b60 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:35:09.423 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:35:09.417+0000 7feb67400640 1 -- 172.21.15.39:0/776098333 <== mon.2 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7feb60037040 con 0x7feb70101de0 2024-09-12T02:35:09.423 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:35:09.417+0000 7feb67400640 1 -- 172.21.15.39:0/776098333 <== mon.2 v2:172.21.15.44:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7feb60033d50 con 0x7feb70101de0 2024-09-12T02:35:09.423 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:35:09.417+0000 7feb67400640 1 -- 172.21.15.39:0/776098333 <== mon.2 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7feb60003960 con 0x7feb70101de0 2024-09-12T02:35:09.424 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:35:09.417+0000 7feb75200640 1 -- 172.21.15.39:0/776098333 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7feb701a6b70 con 0x7feb70101de0 2024-09-12T02:35:09.424 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:35:09.417+0000 7feb75200640 1 -- 172.21.15.39:0/776098333 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7feb701a7000 con 0x7feb70101de0 2024-09-12T02:35:09.424 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:35:09.418+0000 7feb75200640 1 -- 172.21.15.39:0/776098333 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7feb701021c0 con 0x7feb70101de0 2024-09-12T02:35:09.424 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:35:09.420+0000 7feb67400640 1 -- 172.21.15.39:0/776098333 <== mon.2 v2:172.21.15.44:3300/0 4 ==== mgrmap(e 16) ==== 137833+0+0 (secure 0 0 0) 0x7feb60042020 con 0x7feb70101de0 2024-09-12T02:35:09.425 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:35:09.421+0000 7feb67400640 1 --2- 172.21.15.39:0/776098333 >> [v2:172.21.15.39:6800/1725006999,v1:172.21.15.39:6801/1725006999] conn(0x7feb540a2c00 0x7feb540a50c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:35:09.425 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:35:09.422+0000 7feb67400640 1 -- 172.21.15.39:0/776098333 <== mon.2 v2:172.21.15.44:3300/0 5 ==== osd_map(85..85 src has 1..85) ==== 8277+0+0 (secure 0 0 0) 0x7feb600eeb70 con 0x7feb70101de0 2024-09-12T02:35:09.425 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:35:09.422+0000 7feb65400640 1 --2- 172.21.15.39:0/776098333 >> [v2:172.21.15.39:6800/1725006999,v1:172.21.15.39:6801/1725006999] conn(0x7feb540a2c00 0x7feb540a50c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:35:09.425 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:35:09.422+0000 7feb65400640 1 --2- 172.21.15.39:0/776098333 >> [v2:172.21.15.39:6800/1725006999,v1:172.21.15.39:6801/1725006999] conn(0x7feb540a2c00 0x7feb540a50c0 secure :-1 s=READY pgs=148 cs=0 l=1 rev1=1 crypto rx=0x7feb70075f80 tx=0x7feb58005f90 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:35:09.425 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:35:09.424+0000 7feb67400640 1 -- 172.21.15.39:0/776098333 <== mon.2 v2:172.21.15.44:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7feb60049020 con 0x7feb70101de0 2024-09-12T02:35:09.612 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:35:09.612+0000 7feb75200640 1 -- 172.21.15.39:0/776098333 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_data_ec", "pool_type": "erasure", "erasure_code_profile": "cephfs_data_ec", "pg_num_min": 64, "target_size_ratio": 0.9} v 0) -- 0x7feb7002d7c0 con 0x7feb70101de0 2024-09-12T02:35:11.349 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 02:35:11 smithi039 ceph-mon[30515]: pgmap v297: 97 pgs: 97 active+clean; 578 KiB data, 345 MiB used, 1.0 TiB / 1.0 TiB avail; 2.2 KiB/s wr, 6 op/s 2024-09-12T02:35:11.350 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 02:35:11 smithi039 ceph-mon[30515]: from='client.? 172.21.15.39:0/776098333' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "cephfs_data_ec", "pool_type": "erasure", "erasure_code_profile": "cephfs_data_ec", "pg_num_min": 64, "target_size_ratio": 0.9}]: dispatch 2024-09-12T02:35:11.350 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 02:35:11 smithi039 ceph-mon[30515]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "cephfs_data_ec", "pool_type": "erasure", "erasure_code_profile": "cephfs_data_ec", "pg_num_min": 64, "target_size_ratio": 0.9}]: dispatch 2024-09-12T02:35:11.411 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 12 02:35:11 smithi044 ceph-mon[35411]: pgmap v297: 97 pgs: 97 active+clean; 578 KiB data, 345 MiB used, 1.0 TiB / 1.0 TiB avail; 2.2 KiB/s wr, 6 op/s 2024-09-12T02:35:11.411 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 12 02:35:11 smithi044 ceph-mon[35411]: from='client.? 172.21.15.39:0/776098333' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "cephfs_data_ec", "pool_type": "erasure", "erasure_code_profile": "cephfs_data_ec", "pg_num_min": 64, "target_size_ratio": 0.9}]: dispatch 2024-09-12T02:35:11.411 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 12 02:35:11 smithi044 ceph-mon[35411]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "cephfs_data_ec", "pool_type": "erasure", "erasure_code_profile": "cephfs_data_ec", "pg_num_min": 64, "target_size_ratio": 0.9}]: dispatch 2024-09-12T02:35:11.513 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 12 02:35:11 smithi172 ceph-mon[35609]: pgmap v297: 97 pgs: 97 active+clean; 578 KiB data, 345 MiB used, 1.0 TiB / 1.0 TiB avail; 2.2 KiB/s wr, 6 op/s 2024-09-12T02:35:11.513 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 12 02:35:11 smithi172 ceph-mon[35609]: from='client.? 172.21.15.39:0/776098333' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "cephfs_data_ec", "pool_type": "erasure", "erasure_code_profile": "cephfs_data_ec", "pg_num_min": 64, "target_size_ratio": 0.9}]: dispatch 2024-09-12T02:35:11.514 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 12 02:35:11 smithi172 ceph-mon[35609]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "cephfs_data_ec", "pool_type": "erasure", "erasure_code_profile": "cephfs_data_ec", "pg_num_min": 64, "target_size_ratio": 0.9}]: dispatch 2024-09-12T02:35:11.565 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:35:11.564+0000 7feb67400640 1 -- 172.21.15.39:0/776098333 <== mon.2 v2:172.21.15.44:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_data_ec", "pool_type": "erasure", "erasure_code_profile": "cephfs_data_ec", "pg_num_min": 64, "target_size_ratio": 0.9}]=0 pool 'cephfs_data_ec' created v87) ==== 228+0+0 (secure 0 0 0) 0x7feb600bba40 con 0x7feb70101de0 2024-09-12T02:35:11.565 INFO:teuthology.orchestra.run.smithi039.stderr:pool 'cephfs_data_ec' created 2024-09-12T02:35:11.570 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:35:11.568+0000 7feb75200640 1 -- 172.21.15.39:0/776098333 >> [v2:172.21.15.39:6800/1725006999,v1:172.21.15.39:6801/1725006999] conn(0x7feb540a2c00 msgr2=0x7feb540a50c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:35:11.570 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:35:11.568+0000 7feb75200640 1 --2- 172.21.15.39:0/776098333 >> [v2:172.21.15.39:6800/1725006999,v1:172.21.15.39:6801/1725006999] conn(0x7feb540a2c00 0x7feb540a50c0 secure :-1 s=READY pgs=148 cs=0 l=1 rev1=1 crypto rx=0x7feb70075f80 tx=0x7feb58005f90 comp rx=0 tx=0).stop 2024-09-12T02:35:11.570 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:35:11.568+0000 7feb75200640 1 -- 172.21.15.39:0/776098333 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7feb70101de0 msgr2=0x7feb700744f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:35:11.570 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:35:11.568+0000 7feb75200640 1 --2- 172.21.15.39:0/776098333 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7feb70101de0 0x7feb700744f0 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7feb6002a860 tx=0x7feb60033b60 comp rx=0 tx=0).stop 2024-09-12T02:35:11.570 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:35:11.569+0000 7feb75200640 1 -- 172.21.15.39:0/776098333 shutdown_connections 2024-09-12T02:35:11.571 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:35:11.569+0000 7feb75200640 1 --2- 172.21.15.39:0/776098333 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7feb70106f10 0x7feb70074f70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:35:11.571 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:35:11.569+0000 7feb75200640 1 --2- 172.21.15.39:0/776098333 >> [v2:172.21.15.39:6800/1725006999,v1:172.21.15.39:6801/1725006999] conn(0x7feb540a2c00 0x7feb540a50c0 unknown :-1 s=CLOSED pgs=148 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:35:11.571 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:35:11.569+0000 7feb75200640 1 --2- 172.21.15.39:0/776098333 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7feb70102790 0x7feb70074a30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:35:11.571 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:35:11.569+0000 7feb75200640 1 --2- 172.21.15.39:0/776098333 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7feb70101de0 0x7feb700744f0 unknown :-1 s=CLOSED pgs=77 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:35:11.571 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:35:11.569+0000 7feb75200640 1 -- 172.21.15.39:0/776098333 >> 172.21.15.39:0/776098333 conn(0x7feb700fd8c0 msgr2=0x7feb700feba0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:35:11.572 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:35:11.569+0000 7feb75200640 1 -- 172.21.15.39:0/776098333 shutdown_connections 2024-09-12T02:35:11.572 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:35:11.570+0000 7feb75200640 1 -- 172.21.15.39:0/776098333 wait complete. 2024-09-12T02:35:12.350 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 02:35:12 smithi039 ceph-mon[30515]: pgmap v299: 97 pgs: 97 active+clean; 579 KiB data, 345 MiB used, 1.0 TiB / 1.0 TiB avail; 2.2 KiB/s wr, 7 op/s 2024-09-12T02:35:12.350 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 02:35:12 smithi039 ceph-mon[30515]: osdmap e86: 12 total, 12 up, 12 in 2024-09-12T02:35:12.350 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 02:35:12 smithi039 ceph-mon[30515]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "cephfs_data_ec", "pool_type": "erasure", "erasure_code_profile": "cephfs_data_ec", "pg_num_min": 64, "target_size_ratio": 0.9}]': finished 2024-09-12T02:35:12.350 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 02:35:12 smithi039 ceph-mon[30515]: osdmap e87: 12 total, 12 up, 12 in 2024-09-12T02:35:12.445 DEBUG:teuthology.orchestra.run.smithi039:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc shell --fsid 4954ed46-70ae-11ef-bcea-c7b262605968 -- ceph osd pool set cephfs_data_ec allow_ec_overwrites true 2024-09-12T02:35:12.448 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 12 02:35:12 smithi044 ceph-mon[35411]: pgmap v299: 97 pgs: 97 active+clean; 579 KiB data, 345 MiB used, 1.0 TiB / 1.0 TiB avail; 2.2 KiB/s wr, 7 op/s 2024-09-12T02:35:12.448 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 12 02:35:12 smithi044 ceph-mon[35411]: osdmap e86: 12 total, 12 up, 12 in 2024-09-12T02:35:12.448 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 12 02:35:12 smithi044 ceph-mon[35411]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "cephfs_data_ec", "pool_type": "erasure", "erasure_code_profile": "cephfs_data_ec", "pg_num_min": 64, "target_size_ratio": 0.9}]': finished 2024-09-12T02:35:12.448 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 12 02:35:12 smithi044 ceph-mon[35411]: osdmap e87: 12 total, 12 up, 12 in 2024-09-12T02:35:12.513 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 12 02:35:12 smithi172 ceph-mon[35609]: pgmap v299: 97 pgs: 97 active+clean; 579 KiB data, 345 MiB used, 1.0 TiB / 1.0 TiB avail; 2.2 KiB/s wr, 7 op/s 2024-09-12T02:35:12.514 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 12 02:35:12 smithi172 ceph-mon[35609]: osdmap e86: 12 total, 12 up, 12 in 2024-09-12T02:35:12.514 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 12 02:35:12 smithi172 ceph-mon[35609]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "cephfs_data_ec", "pool_type": "erasure", "erasure_code_profile": "cephfs_data_ec", "pg_num_min": 64, "target_size_ratio": 0.9}]': finished 2024-09-12T02:35:12.514 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 12 02:35:12 smithi172 ceph-mon[35609]: osdmap e87: 12 total, 12 up, 12 in 2024-09-12T02:35:12.839 INFO:teuthology.orchestra.run.smithi039.stderr:Inferring config /var/lib/ceph/4954ed46-70ae-11ef-bcea-c7b262605968/mon.a/config 2024-09-12T02:35:13.410 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:35:13.409+0000 7ff773e00640 1 -- 172.21.15.39:0/1714946163 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7ff774103e30 msgr2=0x7ff774104210 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:35:13.411 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:35:13.409+0000 7ff773e00640 1 --2- 172.21.15.39:0/1714946163 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7ff774103e30 0x7ff774104210 secure :-1 s=READY pgs=152 cs=0 l=1 rev1=1 crypto rx=0x7ff764009ca0 tx=0x7ff76402a8c0 comp rx=0 tx=0).stop 2024-09-12T02:35:13.411 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:35:13.409+0000 7ff773e00640 1 -- 172.21.15.39:0/1714946163 shutdown_connections 2024-09-12T02:35:13.411 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:35:13.409+0000 7ff773e00640 1 --2- 172.21.15.39:0/1714946163 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7ff774108f60 0x7ff774110ae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:35:13.411 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:35:13.409+0000 7ff773e00640 1 --2- 172.21.15.39:0/1714946163 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7ff7741047e0 0x7ff774108830 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:35:13.411 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:35:13.409+0000 7ff773e00640 1 --2- 172.21.15.39:0/1714946163 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7ff774103e30 0x7ff774104210 unknown :-1 s=CLOSED pgs=152 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:35:13.411 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:35:13.409+0000 7ff773e00640 1 -- 172.21.15.39:0/1714946163 >> 172.21.15.39:0/1714946163 conn(0x7ff7740ff910 msgr2=0x7ff774101d30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:35:13.411 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:35:13.409+0000 7ff773e00640 1 -- 172.21.15.39:0/1714946163 shutdown_connections 2024-09-12T02:35:13.411 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:35:13.410+0000 7ff773e00640 1 -- 172.21.15.39:0/1714946163 wait complete. 2024-09-12T02:35:13.412 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:35:13.410+0000 7ff773e00640 1 Processor -- start 2024-09-12T02:35:13.413 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:35:13.411+0000 7ff773e00640 1 -- start start 2024-09-12T02:35:13.413 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:35:13.411+0000 7ff773e00640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7ff774103e30 0x7ff77419a410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:35:13.413 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:35:13.411+0000 7ff773e00640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7ff7741047e0 0x7ff77419a950 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:35:13.413 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:35:13.411+0000 7ff773e00640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7ff774108f60 0x7ff77419ece0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:35:13.413 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:35:13.411+0000 7ff773e00640 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 -- 0x7ff774114010 con 0x7ff7741047e0 2024-09-12T02:35:13.413 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:35:13.411+0000 7ff773e00640 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x7ff774113e90 con 0x7ff774108f60 2024-09-12T02:35:13.413 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:35:13.411+0000 7ff773e00640 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7ff774114190 con 0x7ff774103e30 2024-09-12T02:35:13.413 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:35:13.411+0000 7ff76a000640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7ff7741047e0 0x7ff77419a950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:35:13.413 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:35:13.411+0000 7ff76a000640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7ff7741047e0 0x7ff77419a950 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.39:3300/0 says I am v2:172.21.15.39:45368/0 (socket says 172.21.15.39:45368) 2024-09-12T02:35:13.413 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:35:13.411+0000 7ff76a000640 1 -- 172.21.15.39:0/1137179197 learned_addr learned my addr 172.21.15.39:0/1137179197 (peer_addr_for_me v2:172.21.15.39:0/0) 2024-09-12T02:35:13.413 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:35:13.411+0000 7ff772a00640 1 --2- 172.21.15.39:0/1137179197 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7ff774103e30 0x7ff77419a410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:35:13.413 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:35:13.411+0000 7ff773400640 1 --2- 172.21.15.39:0/1137179197 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7ff774108f60 0x7ff77419ece0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:35:13.413 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:35:13.412+0000 7ff76a000640 1 -- 172.21.15.39:0/1137179197 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7ff774103e30 msgr2=0x7ff77419a410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:35:13.414 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:35:13.412+0000 7ff76a000640 1 --2- 172.21.15.39:0/1137179197 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7ff774103e30 0x7ff77419a410 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:35:13.414 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:35:13.412+0000 7ff76a000640 1 -- 172.21.15.39:0/1137179197 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7ff774108f60 msgr2=0x7ff77419ece0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:35:13.414 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:35:13.412+0000 7ff76a000640 1 --2- 172.21.15.39:0/1137179197 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7ff774108f60 0x7ff77419ece0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:35:13.414 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:35:13.412+0000 7ff76a000640 1 -- 172.21.15.39:0/1137179197 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff77419f3c0 con 0x7ff7741047e0 2024-09-12T02:35:13.415 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:35:13.412+0000 7ff76a000640 1 --2- 172.21.15.39:0/1137179197 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7ff7741047e0 0x7ff77419a950 secure :-1 s=READY pgs=153 cs=0 l=1 rev1=1 crypto rx=0x7ff75c00e9f0 tx=0x7ff75c00eeb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:35:13.415 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:35:13.413+0000 7ff778a00640 1 -- 172.21.15.39:0/1137179197 <== mon.0 v2:172.21.15.39:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff75c00cd80 con 0x7ff7741047e0 2024-09-12T02:35:13.415 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:35:13.413+0000 7ff773e00640 1 -- 172.21.15.39:0/1137179197 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff77419f6b0 con 0x7ff7741047e0 2024-09-12T02:35:13.415 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:35:13.413+0000 7ff778a00640 1 -- 172.21.15.39:0/1137179197 <== mon.0 v2:172.21.15.39:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7ff75c010910 con 0x7ff7741047e0 2024-09-12T02:35:13.415 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:35:13.413+0000 7ff778a00640 1 -- 172.21.15.39:0/1137179197 <== mon.0 v2:172.21.15.39:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff75c0188f0 con 0x7ff7741047e0 2024-09-12T02:35:13.415 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:35:13.413+0000 7ff773e00640 1 -- 172.21.15.39:0/1137179197 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff7741a6f90 con 0x7ff7741047e0 2024-09-12T02:35:13.415 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:35:13.414+0000 7ff773e00640 1 -- 172.21.15.39:0/1137179197 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ff774105310 con 0x7ff7741047e0 2024-09-12T02:35:13.418 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:35:13.417+0000 7ff778a00640 1 -- 172.21.15.39:0/1137179197 <== mon.0 v2:172.21.15.39:3300/0 4 ==== mgrmap(e 16) ==== 137833+0+0 (secure 0 0 0) 0x7ff75c010ac0 con 0x7ff7741047e0 2024-09-12T02:35:13.419 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:35:13.419+0000 7ff778a00640 1 --2- 172.21.15.39:0/1137179197 >> [v2:172.21.15.39:6800/1725006999,v1:172.21.15.39:6801/1725006999] conn(0x7ff7580a2b80 0x7ff7580a5040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:35:13.420 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:35:13.419+0000 7ff778a00640 1 -- 172.21.15.39:0/1137179197 <== mon.0 v2:172.21.15.39:3300/0 5 ==== osd_map(88..88 src has 1..88) ==== 8770+0+0 (secure 0 0 0) 0x7ff75c0cfa50 con 0x7ff7741047e0 2024-09-12T02:35:13.420 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:35:13.419+0000 7ff772a00640 1 --2- 172.21.15.39:0/1137179197 >> [v2:172.21.15.39:6800/1725006999,v1:172.21.15.39:6801/1725006999] conn(0x7ff7580a2b80 0x7ff7580a5040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:35:13.420 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:35:13.420+0000 7ff772a00640 1 --2- 172.21.15.39:0/1137179197 >> [v2:172.21.15.39:6800/1725006999,v1:172.21.15.39:6801/1725006999] conn(0x7ff7580a2b80 0x7ff7580a5040 secure :-1 s=READY pgs=149 cs=0 l=1 rev1=1 crypto rx=0x7ff764006010 tx=0x7ff764009820 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:35:13.422 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:35:13.422+0000 7ff778a00640 1 -- 172.21.15.39:0/1137179197 <== mon.0 v2:172.21.15.39:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7ff75c09c0e0 con 0x7ff7741047e0 2024-09-12T02:35:13.612 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:35:13.611+0000 7ff773e00640 1 -- 172.21.15.39:0/1137179197 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_command({"prefix": "osd pool set", "pool": "cephfs_data_ec", "var": "allow_ec_overwrites", "val": "true"} v 0) -- 0x7ff77410c1a0 con 0x7ff7741047e0 2024-09-12T02:35:13.849 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 02:35:13 smithi039 ceph-mon[30515]: osdmap e88: 12 total, 12 up, 12 in 2024-09-12T02:35:13.948 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 12 02:35:13 smithi044 ceph-mon[35411]: osdmap e88: 12 total, 12 up, 12 in 2024-09-12T02:35:14.013 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 12 02:35:13 smithi172 ceph-mon[35609]: osdmap e88: 12 total, 12 up, 12 in 2024-09-12T02:35:14.577 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:35:14.576+0000 7ff778a00640 1 -- 172.21.15.39:0/1137179197 <== mon.0 v2:172.21.15.39:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool set", "pool": "cephfs_data_ec", "var": "allow_ec_overwrites", "val": "true"}]=0 set pool 4 allow_ec_overwrites to true v90) ==== 169+0+0 (secure 0 0 0) 0x7ff75c0a03e0 con 0x7ff7741047e0 2024-09-12T02:35:14.577 INFO:teuthology.orchestra.run.smithi039.stderr:set pool 4 allow_ec_overwrites to true 2024-09-12T02:35:14.580 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:35:14.579+0000 7ff773e00640 1 -- 172.21.15.39:0/1137179197 >> [v2:172.21.15.39:6800/1725006999,v1:172.21.15.39:6801/1725006999] conn(0x7ff7580a2b80 msgr2=0x7ff7580a5040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:35:14.580 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:35:14.579+0000 7ff773e00640 1 --2- 172.21.15.39:0/1137179197 >> [v2:172.21.15.39:6800/1725006999,v1:172.21.15.39:6801/1725006999] conn(0x7ff7580a2b80 0x7ff7580a5040 secure :-1 s=READY pgs=149 cs=0 l=1 rev1=1 crypto rx=0x7ff764006010 tx=0x7ff764009820 comp rx=0 tx=0).stop 2024-09-12T02:35:14.580 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:35:14.579+0000 7ff773e00640 1 -- 172.21.15.39:0/1137179197 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7ff7741047e0 msgr2=0x7ff77419a950 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:35:14.580 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:35:14.579+0000 7ff773e00640 1 --2- 172.21.15.39:0/1137179197 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7ff7741047e0 0x7ff77419a950 secure :-1 s=READY pgs=153 cs=0 l=1 rev1=1 crypto rx=0x7ff75c00e9f0 tx=0x7ff75c00eeb0 comp rx=0 tx=0).stop 2024-09-12T02:35:14.581 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:35:14.580+0000 7ff773e00640 1 -- 172.21.15.39:0/1137179197 shutdown_connections 2024-09-12T02:35:14.581 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:35:14.580+0000 7ff773e00640 1 --2- 172.21.15.39:0/1137179197 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7ff774108f60 0x7ff77419ece0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:35:14.581 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:35:14.580+0000 7ff773e00640 1 --2- 172.21.15.39:0/1137179197 >> [v2:172.21.15.39:6800/1725006999,v1:172.21.15.39:6801/1725006999] conn(0x7ff7580a2b80 0x7ff7580a5040 unknown :-1 s=CLOSED pgs=149 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:35:14.581 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:35:14.580+0000 7ff773e00640 1 --2- 172.21.15.39:0/1137179197 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7ff7741047e0 0x7ff77419a950 unknown :-1 s=CLOSED pgs=153 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:35:14.581 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:35:14.580+0000 7ff773e00640 1 --2- 172.21.15.39:0/1137179197 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7ff774103e30 0x7ff77419a410 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:35:14.581 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:35:14.580+0000 7ff773e00640 1 -- 172.21.15.39:0/1137179197 >> 172.21.15.39:0/1137179197 conn(0x7ff7740ff910 msgr2=0x7ff774100bd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:35:14.581 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:35:14.580+0000 7ff773e00640 1 -- 172.21.15.39:0/1137179197 shutdown_connections 2024-09-12T02:35:14.581 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:35:14.580+0000 7ff773e00640 1 -- 172.21.15.39:0/1137179197 wait complete. 2024-09-12T02:35:14.849 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 02:35:14 smithi039 ceph-mon[30515]: pgmap v302: 129 pgs: 2 creating+peering, 30 unknown, 97 active+clean; 579 KiB data, 345 MiB used, 1.0 TiB / 1.0 TiB avail; 2.7 KiB/s wr, 8 op/s 2024-09-12T02:35:14.850 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 02:35:14 smithi039 ceph-mon[30515]: Health check failed: 1 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2024-09-12T02:35:14.850 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 02:35:14 smithi039 ceph-mon[30515]: osdmap e89: 12 total, 12 up, 12 in 2024-09-12T02:35:14.850 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 02:35:14 smithi039 ceph-mon[30515]: from='client.? 172.21.15.39:0/1137179197' entity='client.admin' cmd=[{"prefix": "osd pool set", "pool": "cephfs_data_ec", "var": "allow_ec_overwrites", "val": "true"}]: dispatch 2024-09-12T02:35:14.948 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 12 02:35:14 smithi044 ceph-mon[35411]: pgmap v302: 129 pgs: 2 creating+peering, 30 unknown, 97 active+clean; 579 KiB data, 345 MiB used, 1.0 TiB / 1.0 TiB avail; 2.7 KiB/s wr, 8 op/s 2024-09-12T02:35:14.949 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 12 02:35:14 smithi044 ceph-mon[35411]: Health check failed: 1 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2024-09-12T02:35:14.949 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 12 02:35:14 smithi044 ceph-mon[35411]: osdmap e89: 12 total, 12 up, 12 in 2024-09-12T02:35:14.949 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 12 02:35:14 smithi044 ceph-mon[35411]: from='client.? 172.21.15.39:0/1137179197' entity='client.admin' cmd=[{"prefix": "osd pool set", "pool": "cephfs_data_ec", "var": "allow_ec_overwrites", "val": "true"}]: dispatch 2024-09-12T02:35:15.013 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 12 02:35:14 smithi172 ceph-mon[35609]: pgmap v302: 129 pgs: 2 creating+peering, 30 unknown, 97 active+clean; 579 KiB data, 345 MiB used, 1.0 TiB / 1.0 TiB avail; 2.7 KiB/s wr, 8 op/s 2024-09-12T02:35:15.014 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 12 02:35:14 smithi172 ceph-mon[35609]: Health check failed: 1 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2024-09-12T02:35:15.014 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 12 02:35:14 smithi172 ceph-mon[35609]: osdmap e89: 12 total, 12 up, 12 in 2024-09-12T02:35:15.014 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 12 02:35:14 smithi172 ceph-mon[35609]: from='client.? 172.21.15.39:0/1137179197' entity='client.admin' cmd=[{"prefix": "osd pool set", "pool": "cephfs_data_ec", "var": "allow_ec_overwrites", "val": "true"}]: dispatch 2024-09-12T02:35:15.410 DEBUG:teuthology.orchestra.run.smithi039:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc shell --fsid 4954ed46-70ae-11ef-bcea-c7b262605968 -- ceph fs add_data_pool cephfs cephfs_data_ec 2024-09-12T02:35:15.794 INFO:teuthology.orchestra.run.smithi039.stderr:Inferring config /var/lib/ceph/4954ed46-70ae-11ef-bcea-c7b262605968/mon.a/config 2024-09-12T02:35:15.849 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 02:35:15 smithi039 ceph-mon[30515]: from='client.? 172.21.15.39:0/1137179197' entity='client.admin' cmd='[{"prefix": "osd pool set", "pool": "cephfs_data_ec", "var": "allow_ec_overwrites", "val": "true"}]': finished 2024-09-12T02:35:15.850 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 02:35:15 smithi039 ceph-mon[30515]: osdmap e90: 12 total, 12 up, 12 in 2024-09-12T02:35:15.948 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 12 02:35:15 smithi044 ceph-mon[35411]: from='client.? 172.21.15.39:0/1137179197' entity='client.admin' cmd='[{"prefix": "osd pool set", "pool": "cephfs_data_ec", "var": "allow_ec_overwrites", "val": "true"}]': finished 2024-09-12T02:35:15.949 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 12 02:35:15 smithi044 ceph-mon[35411]: osdmap e90: 12 total, 12 up, 12 in 2024-09-12T02:35:16.013 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 12 02:35:15 smithi172 ceph-mon[35609]: from='client.? 172.21.15.39:0/1137179197' entity='client.admin' cmd='[{"prefix": "osd pool set", "pool": "cephfs_data_ec", "var": "allow_ec_overwrites", "val": "true"}]': finished 2024-09-12T02:35:16.014 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 12 02:35:15 smithi172 ceph-mon[35609]: osdmap e90: 12 total, 12 up, 12 in 2024-09-12T02:35:16.351 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:35:16.339+0000 7f5177e00640 1 -- 172.21.15.39:0/750479751 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f5178108f60 msgr2=0x7f5178110ae0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:35:16.351 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:35:16.339+0000 7f5177e00640 1 --2- 172.21.15.39:0/750479751 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f5178108f60 0x7f5178110ae0 secure :-1 s=READY pgs=154 cs=0 l=1 rev1=1 crypto rx=0x7f5170009be0 tx=0x7f517002a6c0 comp rx=0 tx=0).stop 2024-09-12T02:35:16.351 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:35:16.339+0000 7f5177e00640 1 -- 172.21.15.39:0/750479751 shutdown_connections 2024-09-12T02:35:16.351 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:35:16.339+0000 7f5177e00640 1 --2- 172.21.15.39:0/750479751 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f5178108f60 0x7f5178110ae0 unknown :-1 s=CLOSED pgs=154 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:35:16.351 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:35:16.339+0000 7f5177e00640 1 --2- 172.21.15.39:0/750479751 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f51781047e0 0x7f5178108830 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:35:16.351 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:35:16.339+0000 7f5177e00640 1 --2- 172.21.15.39:0/750479751 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f5178103e30 0x7f5178104210 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:35:16.351 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:35:16.339+0000 7f5177e00640 1 -- 172.21.15.39:0/750479751 >> 172.21.15.39:0/750479751 conn(0x7f51780ff8d0 msgr2=0x7f5178101cf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:35:16.351 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:35:16.339+0000 7f5177e00640 1 -- 172.21.15.39:0/750479751 shutdown_connections 2024-09-12T02:35:16.351 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:35:16.339+0000 7f5177e00640 1 -- 172.21.15.39:0/750479751 wait complete. 2024-09-12T02:35:16.351 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:35:16.340+0000 7f5177e00640 1 Processor -- start 2024-09-12T02:35:16.351 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:35:16.340+0000 7f5177e00640 1 -- start start 2024-09-12T02:35:16.351 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:35:16.341+0000 7f5177e00640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f5178103e30 0x7f517819a3f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:35:16.352 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:35:16.341+0000 7f5177e00640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f51781047e0 0x7f517819a930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:35:16.352 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:35:16.341+0000 7f5177e00640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f5178108f60 0x7f517819ecc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:35:16.352 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:35:16.341+0000 7f5177e00640 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 -- 0x7f5178113f70 con 0x7f5178103e30 2024-09-12T02:35:16.352 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:35:16.341+0000 7f5177e00640 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x7f5178113df0 con 0x7f51781047e0 2024-09-12T02:35:16.352 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:35:16.341+0000 7f5177e00640 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7f51781140f0 con 0x7f5178108f60 2024-09-12T02:35:16.352 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:35:16.341+0000 7f5176a00640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f5178103e30 0x7f517819a3f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:35:16.352 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:35:16.341+0000 7f5176a00640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f5178103e30 0x7f517819a3f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.39:3300/0 says I am v2:172.21.15.39:45386/0 (socket says 172.21.15.39:45386) 2024-09-12T02:35:16.352 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:35:16.341+0000 7f5176a00640 1 -- 172.21.15.39:0/3219400306 learned_addr learned my addr 172.21.15.39:0/3219400306 (peer_addr_for_me v2:172.21.15.39:0/0) 2024-09-12T02:35:16.352 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:35:16.341+0000 7f516fe00640 1 --2- 172.21.15.39:0/3219400306 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f51781047e0 0x7f517819a930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:35:16.352 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:35:16.341+0000 7f5177400640 1 --2- 172.21.15.39:0/3219400306 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f5178108f60 0x7f517819ecc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:35:16.352 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:35:16.341+0000 7f5176a00640 1 -- 172.21.15.39:0/3219400306 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f5178108f60 msgr2=0x7f517819ecc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:35:16.352 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:35:16.341+0000 7f5176a00640 1 --2- 172.21.15.39:0/3219400306 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f5178108f60 0x7f517819ecc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:35:16.353 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:35:16.341+0000 7f5176a00640 1 -- 172.21.15.39:0/3219400306 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f51781047e0 msgr2=0x7f517819a930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:35:16.353 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:35:16.341+0000 7f5176a00640 1 --2- 172.21.15.39:0/3219400306 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f51781047e0 0x7f517819a930 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:35:16.353 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:35:16.341+0000 7f5176a00640 1 -- 172.21.15.39:0/3219400306 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f517819f3a0 con 0x7f5178103e30 2024-09-12T02:35:16.353 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:35:16.342+0000 7f5176a00640 1 --2- 172.21.15.39:0/3219400306 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f5178103e30 0x7f517819a3f0 secure :-1 s=READY pgs=155 cs=0 l=1 rev1=1 crypto rx=0x7f516800e9c0 tx=0x7f516800ee80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:35:16.353 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:35:16.342+0000 7f516f400640 1 -- 172.21.15.39:0/3219400306 <== mon.0 v2:172.21.15.39:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f516800cde0 con 0x7f5178103e30 2024-09-12T02:35:16.353 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:35:16.342+0000 7f516f400640 1 -- 172.21.15.39:0/3219400306 <== mon.0 v2:172.21.15.39:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f51680035f0 con 0x7f5178103e30 2024-09-12T02:35:16.353 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:35:16.342+0000 7f516f400640 1 -- 172.21.15.39:0/3219400306 <== mon.0 v2:172.21.15.39:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5168010690 con 0x7f5178103e30 2024-09-12T02:35:16.353 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:35:16.342+0000 7f5177e00640 1 -- 172.21.15.39:0/3219400306 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f517819f690 con 0x7f5178103e30 2024-09-12T02:35:16.353 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:35:16.342+0000 7f5177e00640 1 -- 172.21.15.39:0/3219400306 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f51781a6f70 con 0x7f5178103e30 2024-09-12T02:35:16.353 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:35:16.343+0000 7f5177e00640 1 -- 172.21.15.39:0/3219400306 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f5178104210 con 0x7f5178103e30 2024-09-12T02:35:16.353 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:35:16.345+0000 7f516f400640 1 -- 172.21.15.39:0/3219400306 <== mon.0 v2:172.21.15.39:3300/0 4 ==== mgrmap(e 16) ==== 137833+0+0 (secure 0 0 0) 0x7f51680037a0 con 0x7f5178103e30 2024-09-12T02:35:16.353 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:35:16.347+0000 7f516f400640 1 --2- 172.21.15.39:0/3219400306 >> [v2:172.21.15.39:6800/1725006999,v1:172.21.15.39:6801/1725006999] conn(0x7f515c0a2b80 0x7f515c0a5040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:35:16.353 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:35:16.347+0000 7f516f400640 1 -- 172.21.15.39:0/3219400306 <== mon.0 v2:172.21.15.39:3300/0 5 ==== osd_map(90..90 src has 1..90) ==== 8770+0+0 (secure 0 0 0) 0x7f51680cf5b0 con 0x7f5178103e30 2024-09-12T02:35:16.354 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:35:16.347+0000 7f516fe00640 1 --2- 172.21.15.39:0/3219400306 >> [v2:172.21.15.39:6800/1725006999,v1:172.21.15.39:6801/1725006999] conn(0x7f515c0a2b80 0x7f515c0a5040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:35:16.354 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:35:16.348+0000 7f516fe00640 1 --2- 172.21.15.39:0/3219400306 >> [v2:172.21.15.39:6800/1725006999,v1:172.21.15.39:6801/1725006999] conn(0x7f515c0a2b80 0x7f515c0a5040 secure :-1 s=READY pgs=150 cs=0 l=1 rev1=1 crypto rx=0x7f51780ffcf0 tx=0x7f5160005f90 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:35:16.354 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:35:16.350+0000 7f516f400640 1 -- 172.21.15.39:0/3219400306 <== mon.0 v2:172.21.15.39:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7f516809c290 con 0x7f5178103e30 2024-09-12T02:35:16.578 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:35:16.577+0000 7f5177e00640 1 -- 172.21.15.39:0/3219400306 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_command({"prefix": "fs add_data_pool", "fs_name": "cephfs", "pool": "cephfs_data_ec"} v 0) -- 0x7f517810bbb0 con 0x7f5178103e30 2024-09-12T02:35:16.592 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:35:16.591+0000 7f516f400640 1 -- 172.21.15.39:0/3219400306 <== mon.0 v2:172.21.15.39:3300/0 7 ==== mon_command_ack([{"prefix": "fs add_data_pool", "fs_name": "cephfs", "pool": "cephfs_data_ec"}]=0 added data pool 4 to fsmap v17) ==== 137+0+0 (secure 0 0 0) 0x7f516809bb90 con 0x7f5178103e30 2024-09-12T02:35:16.592 INFO:teuthology.orchestra.run.smithi039.stderr:added data pool 4 to fsmap 2024-09-12T02:35:16.595 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:35:16.594+0000 7f5177e00640 1 -- 172.21.15.39:0/3219400306 >> [v2:172.21.15.39:6800/1725006999,v1:172.21.15.39:6801/1725006999] conn(0x7f515c0a2b80 msgr2=0x7f515c0a5040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:35:16.596 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:35:16.594+0000 7f5177e00640 1 --2- 172.21.15.39:0/3219400306 >> [v2:172.21.15.39:6800/1725006999,v1:172.21.15.39:6801/1725006999] conn(0x7f515c0a2b80 0x7f515c0a5040 secure :-1 s=READY pgs=150 cs=0 l=1 rev1=1 crypto rx=0x7f51780ffcf0 tx=0x7f5160005f90 comp rx=0 tx=0).stop 2024-09-12T02:35:16.596 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:35:16.594+0000 7f5177e00640 1 -- 172.21.15.39:0/3219400306 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f5178103e30 msgr2=0x7f517819a3f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:35:16.596 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:35:16.594+0000 7f5177e00640 1 --2- 172.21.15.39:0/3219400306 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f5178103e30 0x7f517819a3f0 secure :-1 s=READY pgs=155 cs=0 l=1 rev1=1 crypto rx=0x7f516800e9c0 tx=0x7f516800ee80 comp rx=0 tx=0).stop 2024-09-12T02:35:16.596 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:35:16.594+0000 7f5177e00640 1 -- 172.21.15.39:0/3219400306 shutdown_connections 2024-09-12T02:35:16.596 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:35:16.595+0000 7f5177e00640 1 --2- 172.21.15.39:0/3219400306 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f5178108f60 0x7f517819ecc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:35:16.596 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:35:16.595+0000 7f5177e00640 1 --2- 172.21.15.39:0/3219400306 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f51781047e0 0x7f517819a930 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:35:16.596 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:35:16.595+0000 7f5177e00640 1 --2- 172.21.15.39:0/3219400306 >> [v2:172.21.15.39:6800/1725006999,v1:172.21.15.39:6801/1725006999] conn(0x7f515c0a2b80 0x7f515c0a5040 unknown :-1 s=CLOSED pgs=150 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:35:16.596 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:35:16.595+0000 7f5177e00640 1 --2- 172.21.15.39:0/3219400306 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f5178103e30 0x7f517819a3f0 unknown :-1 s=CLOSED pgs=155 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:35:16.596 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:35:16.595+0000 7f5177e00640 1 -- 172.21.15.39:0/3219400306 >> 172.21.15.39:0/3219400306 conn(0x7f51780ff8d0 msgr2=0x7f5178100bf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:35:16.596 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:35:16.595+0000 7f5177e00640 1 -- 172.21.15.39:0/3219400306 shutdown_connections 2024-09-12T02:35:16.596 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:35:16.595+0000 7f5177e00640 1 -- 172.21.15.39:0/3219400306 wait complete. 2024-09-12T02:35:16.849 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 02:35:16 smithi039 ceph-mon[30515]: pgmap v305: 129 pgs: 2 creating+peering, 1 unknown, 126 active+clean; 579 KiB data, 346 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-12T02:35:16.850 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 02:35:16 smithi039 ceph-mon[30515]: from='client.? 172.21.15.39:0/3219400306' entity='client.admin' cmd=[{"prefix": "fs add_data_pool", "fs_name": "cephfs", "pool": "cephfs_data_ec"}]: dispatch 2024-09-12T02:35:16.948 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 12 02:35:16 smithi044 ceph-mon[35411]: pgmap v305: 129 pgs: 2 creating+peering, 1 unknown, 126 active+clean; 579 KiB data, 346 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-12T02:35:16.949 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 12 02:35:16 smithi044 ceph-mon[35411]: from='client.? 172.21.15.39:0/3219400306' entity='client.admin' cmd=[{"prefix": "fs add_data_pool", "fs_name": "cephfs", "pool": "cephfs_data_ec"}]: dispatch 2024-09-12T02:35:17.013 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 12 02:35:16 smithi172 ceph-mon[35609]: pgmap v305: 129 pgs: 2 creating+peering, 1 unknown, 126 active+clean; 579 KiB data, 346 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-12T02:35:17.014 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 12 02:35:16 smithi172 ceph-mon[35609]: from='client.? 172.21.15.39:0/3219400306' entity='client.admin' cmd=[{"prefix": "fs add_data_pool", "fs_name": "cephfs", "pool": "cephfs_data_ec"}]: dispatch 2024-09-12T02:35:17.613 DEBUG:teuthology.orchestra.run.smithi039:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc shell --fsid 4954ed46-70ae-11ef-bcea-c7b262605968 -- ceph fs dump --format=json 2024-09-12T02:35:17.849 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 02:35:17 smithi039 ceph-mon[30515]: osdmap e91: 12 total, 12 up, 12 in 2024-09-12T02:35:17.850 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 02:35:17 smithi039 ceph-mon[30515]: from='client.? 172.21.15.39:0/3219400306' entity='client.admin' cmd='[{"prefix": "fs add_data_pool", "fs_name": "cephfs", "pool": "cephfs_data_ec"}]': finished 2024-09-12T02:35:17.850 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 02:35:17 smithi039 ceph-mon[30515]: fsmap cephfs:1 {0=b=up:active} 11 up:standby 2024-09-12T02:35:17.948 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 12 02:35:17 smithi044 ceph-mon[35411]: osdmap e91: 12 total, 12 up, 12 in 2024-09-12T02:35:17.949 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 12 02:35:17 smithi044 ceph-mon[35411]: from='client.? 172.21.15.39:0/3219400306' entity='client.admin' cmd='[{"prefix": "fs add_data_pool", "fs_name": "cephfs", "pool": "cephfs_data_ec"}]': finished 2024-09-12T02:35:17.949 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 12 02:35:17 smithi044 ceph-mon[35411]: fsmap cephfs:1 {0=b=up:active} 11 up:standby 2024-09-12T02:35:17.991 INFO:teuthology.orchestra.run.smithi039.stderr:Inferring config /var/lib/ceph/4954ed46-70ae-11ef-bcea-c7b262605968/mon.a/config 2024-09-12T02:35:18.013 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 12 02:35:17 smithi172 ceph-mon[35609]: osdmap e91: 12 total, 12 up, 12 in 2024-09-12T02:35:18.014 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 12 02:35:17 smithi172 ceph-mon[35609]: from='client.? 172.21.15.39:0/3219400306' entity='client.admin' cmd='[{"prefix": "fs add_data_pool", "fs_name": "cephfs", "pool": "cephfs_data_ec"}]': finished 2024-09-12T02:35:18.014 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 12 02:35:17 smithi172 ceph-mon[35609]: fsmap cephfs:1 {0=b=up:active} 11 up:standby 2024-09-12T02:35:18.575 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:35:18.556+0000 7f7081000640 1 -- 172.21.15.39:0/4121581124 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f707c103ff0 msgr2=0x7f707c1043d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:35:18.575 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:35:18.556+0000 7f7081000640 1 --2- 172.21.15.39:0/4121581124 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f707c103ff0 0x7f707c1043d0 secure :-1 s=READY pgs=156 cs=0 l=1 rev1=1 crypto rx=0x7f706c009900 tx=0x7f706c02a410 comp rx=0 tx=0).stop 2024-09-12T02:35:18.575 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:35:18.556+0000 7f7081000640 1 -- 172.21.15.39:0/4121581124 shutdown_connections 2024-09-12T02:35:18.575 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:35:18.556+0000 7f7081000640 1 --2- 172.21.15.39:0/4121581124 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f707c109120 0x7f707c110ca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:35:18.576 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:35:18.556+0000 7f7081000640 1 --2- 172.21.15.39:0/4121581124 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f707c1049a0 0x7f707c1089f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:35:18.576 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:35:18.556+0000 7f7081000640 1 --2- 172.21.15.39:0/4121581124 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f707c103ff0 0x7f707c1043d0 unknown :-1 s=CLOSED pgs=156 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:35:18.576 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:35:18.556+0000 7f7081000640 1 -- 172.21.15.39:0/4121581124 >> 172.21.15.39:0/4121581124 conn(0x7f707c0ffa90 msgr2=0x7f707c101eb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:35:18.576 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:35:18.557+0000 7f7081000640 1 -- 172.21.15.39:0/4121581124 shutdown_connections 2024-09-12T02:35:18.576 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:35:18.557+0000 7f7081000640 1 -- 172.21.15.39:0/4121581124 wait complete. 2024-09-12T02:35:18.576 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:35:18.557+0000 7f7081000640 1 Processor -- start 2024-09-12T02:35:18.576 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:35:18.558+0000 7f7081000640 1 -- start start 2024-09-12T02:35:18.576 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:35:18.558+0000 7f7081000640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f707c103ff0 0x7f707c19a610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:35:18.576 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:35:18.558+0000 7f7081000640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f707c1049a0 0x7f707c19ab50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:35:18.576 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:35:18.558+0000 7f7081000640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f707c109120 0x7f707c19eee0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:35:18.576 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:35:18.558+0000 7f7081000640 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 -- 0x7f707c114190 con 0x7f707c109120 2024-09-12T02:35:18.577 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:35:18.558+0000 7f7081000640 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x7f707c114010 con 0x7f707c1049a0 2024-09-12T02:35:18.577 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:35:18.558+0000 7f7081000640 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7f707c114310 con 0x7f707c103ff0 2024-09-12T02:35:18.577 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:35:18.558+0000 7f707a800640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f707c109120 0x7f707c19eee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:35:18.577 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:35:18.558+0000 7f7079400640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f707c1049a0 0x7f707c19ab50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:35:18.577 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:35:18.558+0000 7f707a800640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f707c109120 0x7f707c19eee0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.39:3300/0 says I am v2:172.21.15.39:60738/0 (socket says 172.21.15.39:60738) 2024-09-12T02:35:18.577 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:35:18.558+0000 7f707a800640 1 -- 172.21.15.39:0/4050521873 learned_addr learned my addr 172.21.15.39:0/4050521873 (peer_addr_for_me v2:172.21.15.39:0/0) 2024-09-12T02:35:18.577 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:35:18.558+0000 7f7079e00640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f707c103ff0 0x7f707c19a610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:35:18.577 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:35:18.559+0000 7f7079400640 1 -- 172.21.15.39:0/4050521873 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f707c103ff0 msgr2=0x7f707c19a610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:35:18.577 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:35:18.559+0000 7f7079400640 1 --2- 172.21.15.39:0/4050521873 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f707c103ff0 0x7f707c19a610 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:35:18.577 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:35:18.559+0000 7f7079400640 1 -- 172.21.15.39:0/4050521873 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f707c109120 msgr2=0x7f707c19eee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:35:18.578 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:35:18.559+0000 7f7079400640 1 --2- 172.21.15.39:0/4050521873 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f707c109120 0x7f707c19eee0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:35:18.578 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:35:18.559+0000 7f7079400640 1 -- 172.21.15.39:0/4050521873 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f707c19f5c0 con 0x7f707c1049a0 2024-09-12T02:35:18.578 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:35:18.559+0000 7f707a800640 1 --2- 172.21.15.39:0/4050521873 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f707c109120 0x7f707c19eee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-12T02:35:18.578 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:35:18.559+0000 7f7079400640 1 --2- 172.21.15.39:0/4050521873 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f707c1049a0 0x7f707c19ab50 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7f706800e9f0 tx=0x7f706800eeb0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:35:18.578 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:35:18.559+0000 7f7072a00640 1 -- 172.21.15.39:0/4050521873 <== mon.2 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f706800ccc0 con 0x7f707c1049a0 2024-09-12T02:35:18.578 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:35:18.559+0000 7f7081000640 1 -- 172.21.15.39:0/4050521873 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f707c19f8b0 con 0x7f707c1049a0 2024-09-12T02:35:18.578 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:35:18.559+0000 7f7072a00640 1 -- 172.21.15.39:0/4050521873 <== mon.2 v2:172.21.15.44:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f7068005020 con 0x7f707c1049a0 2024-09-12T02:35:18.578 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:35:18.559+0000 7f7072a00640 1 -- 172.21.15.39:0/4050521873 <== mon.2 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f70680049e0 con 0x7f707c1049a0 2024-09-12T02:35:18.578 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:35:18.559+0000 7f7081000640 1 -- 172.21.15.39:0/4050521873 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f707c1a7190 con 0x7f707c1049a0 2024-09-12T02:35:18.579 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:35:18.560+0000 7f7081000640 1 -- 172.21.15.39:0/4050521873 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f707c1043d0 con 0x7f707c1049a0 2024-09-12T02:35:18.579 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:35:18.562+0000 7f7072a00640 1 -- 172.21.15.39:0/4050521873 <== mon.2 v2:172.21.15.44:3300/0 4 ==== mgrmap(e 16) ==== 137833+0+0 (secure 0 0 0) 0x7f7068005560 con 0x7f707c1049a0 2024-09-12T02:35:18.579 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:35:18.564+0000 7f7072a00640 1 --2- 172.21.15.39:0/4050521873 >> [v2:172.21.15.39:6800/1725006999,v1:172.21.15.39:6801/1725006999] conn(0x7f70600a2b80 0x7f70600a5040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:35:18.579 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:35:18.564+0000 7f7072a00640 1 -- 172.21.15.39:0/4050521873 <== mon.2 v2:172.21.15.44:3300/0 5 ==== osd_map(91..91 src has 1..91) ==== 8802+0+0 (secure 0 0 0) 0x7f70680cf290 con 0x7f707c1049a0 2024-09-12T02:35:18.579 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:35:18.564+0000 7f7079e00640 1 --2- 172.21.15.39:0/4050521873 >> [v2:172.21.15.39:6800/1725006999,v1:172.21.15.39:6801/1725006999] conn(0x7f70600a2b80 0x7f70600a5040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:35:18.579 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:35:18.565+0000 7f7079e00640 1 --2- 172.21.15.39:0/4050521873 >> [v2:172.21.15.39:6800/1725006999,v1:172.21.15.39:6801/1725006999] conn(0x7f70600a2b80 0x7f70600a5040 secure :-1 s=READY pgs=151 cs=0 l=1 rev1=1 crypto rx=0x7f706c000c00 tx=0x7f706c005b50 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:35:18.579 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:35:18.566+0000 7f7072a00640 1 -- 172.21.15.39:0/4050521873 <== mon.2 v2:172.21.15.44:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7f70680051d0 con 0x7f707c1049a0 2024-09-12T02:35:18.791 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:35:18.790+0000 7f7081000640 1 -- 172.21.15.39:0/4050521873 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f707c19b970 con 0x7f707c1049a0 2024-09-12T02:35:18.792 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 02:35:18 smithi039 ceph-mon[30515]: pgmap v307: 129 pgs: 129 active+clean; 579 KiB data, 346 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-12T02:35:18.792 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 02:35:18 smithi039 ceph-mon[30515]: Health check cleared: POOL_APP_NOT_ENABLED (was: 1 pool(s) do not have an application enabled) 2024-09-12T02:35:18.792 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 02:35:18 smithi039 ceph-mon[30515]: Cluster is now healthy 2024-09-12T02:35:18.793 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:35:18.791+0000 7f7072a00640 1 -- 172.21.15.39:0/4050521873 <== mon.2 v2:172.21.15.44:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 17 v17) ==== 94+0+11839 (secure 0 0 0) 0x7f707c19b970 con 0x7f707c1049a0 2024-09-12T02:35:18.793 INFO:teuthology.orchestra.run.smithi039.stdout: 2024-09-12T02:35:18.793 INFO:teuthology.orchestra.run.smithi039.stdout:{"epoch":17,"btime":"2024-09-12T02:35:16:583637+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14451,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.39:6835/2325642381","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6834","nonce":2325642381},{"type":"v1","addr":"172.21.15.39:6835","nonce":2325642381}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14511,"name":"g","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.39:6839/936905514","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6838","nonce":936905514},{"type":"v1","addr":"172.21.15.39:6839","nonce":936905514}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":11},{"gid":14523,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.39:6841/2829712180","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6840","nonce":2829712180},{"type":"v1","addr":"172.21.15.39:6841","nonce":2829712180}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":12},{"gid":24422,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.44:6833/2359724364","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6832","nonce":2359724364},{"type":"v1","addr":"172.21.15.44:6833","nonce":2359724364}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":24430,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.172:6833/3232434105","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6832","nonce":3232434105},{"type":"v1","addr":"172.21.15.172:6833","nonce":3232434105}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":24446,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.39:6837/2743237008","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6836","nonce":2743237008},{"type":"v1","addr":"172.21.15.39:6837","nonce":2743237008}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5},{"gid":24458,"name":"e","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.44:6835/4063842354","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6834","nonce":4063842354},{"type":"v1","addr":"172.21.15.44:6835","nonce":4063842354}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":6},{"gid":24472,"name":"f","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.172:6835/3274676014","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6834","nonce":3274676014},{"type":"v1","addr":"172.21.15.172:6835","nonce":3274676014}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":7},{"gid":24482,"name":"h","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.44:6837/1501493978","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6836","nonce":1501493978},{"type":"v1","addr":"172.21.15.44:6837","nonce":1501493978}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":9},{"gid":24484,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.172:6837/493506747","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6836","nonce":493506747},{"type":"v1","addr":"172.21.15.172:6837","nonce":493506747}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":8},{"gid":24499,"name":"i","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.172:6839/3742537097","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6838","nonce":3742537097},{"type":"v1","addr":"172.21.15.172:6839","nonce":3742537097}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":10}],"filesystems":[{"mdsmap":{"epoch":17,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-12T02:35:03.522182+0000","modified":"2024-09-12T02:35:16.579584+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":24515},"failed":[],"damaged":[],"stopped":[],"info":{"gid_24515":{"gid":24515,"name":"b","rank":0,"incarnation":14,"state":"up:active","state_seq":5,"addr":"172.21.15.44:6839/2556532723","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6838","nonce":2556532723},{"type":"v1","addr":"172.21.15.44:6839","nonce":2556532723}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":1,"qdb_leader":24515,"qdb_cluster":[24515]},"id":1}]} 2024-09-12T02:35:18.793 INFO:teuthology.orchestra.run.smithi039.stderr:dumped fsmap epoch 17 2024-09-12T02:35:18.795 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:35:18.794+0000 7f7081000640 1 -- 172.21.15.39:0/4050521873 >> [v2:172.21.15.39:6800/1725006999,v1:172.21.15.39:6801/1725006999] conn(0x7f70600a2b80 msgr2=0x7f70600a5040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:35:18.795 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:35:18.794+0000 7f7081000640 1 --2- 172.21.15.39:0/4050521873 >> [v2:172.21.15.39:6800/1725006999,v1:172.21.15.39:6801/1725006999] conn(0x7f70600a2b80 0x7f70600a5040 secure :-1 s=READY pgs=151 cs=0 l=1 rev1=1 crypto rx=0x7f706c000c00 tx=0x7f706c005b50 comp rx=0 tx=0).stop 2024-09-12T02:35:18.795 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:35:18.794+0000 7f7081000640 1 -- 172.21.15.39:0/4050521873 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f707c1049a0 msgr2=0x7f707c19ab50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:35:18.795 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:35:18.794+0000 7f7081000640 1 --2- 172.21.15.39:0/4050521873 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f707c1049a0 0x7f707c19ab50 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7f706800e9f0 tx=0x7f706800eeb0 comp rx=0 tx=0).stop 2024-09-12T02:35:18.796 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:35:18.794+0000 7f7081000640 1 -- 172.21.15.39:0/4050521873 shutdown_connections 2024-09-12T02:35:18.796 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:35:18.794+0000 7f7081000640 1 --2- 172.21.15.39:0/4050521873 >> [v2:172.21.15.39:6800/1725006999,v1:172.21.15.39:6801/1725006999] conn(0x7f70600a2b80 0x7f70600a5040 unknown :-1 s=CLOSED pgs=151 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:35:18.796 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:35:18.794+0000 7f7081000640 1 --2- 172.21.15.39:0/4050521873 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f707c109120 0x7f707c19eee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:35:18.796 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:35:18.794+0000 7f7081000640 1 --2- 172.21.15.39:0/4050521873 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f707c1049a0 0x7f707c19ab50 unknown :-1 s=CLOSED pgs=78 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:35:18.796 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:35:18.794+0000 7f7081000640 1 --2- 172.21.15.39:0/4050521873 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f707c103ff0 0x7f707c19a610 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:35:18.796 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:35:18.794+0000 7f7081000640 1 -- 172.21.15.39:0/4050521873 >> 172.21.15.39:0/4050521873 conn(0x7f707c0ffa90 msgr2=0x7f707c100d70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:35:18.796 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:35:18.795+0000 7f7081000640 1 -- 172.21.15.39:0/4050521873 shutdown_connections 2024-09-12T02:35:18.796 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:35:18.795+0000 7f7081000640 1 -- 172.21.15.39:0/4050521873 wait complete. 2024-09-12T02:35:18.948 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 12 02:35:18 smithi044 ceph-mon[35411]: pgmap v307: 129 pgs: 129 active+clean; 579 KiB data, 346 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-12T02:35:18.948 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 12 02:35:18 smithi044 ceph-mon[35411]: Health check cleared: POOL_APP_NOT_ENABLED (was: 1 pool(s) do not have an application enabled) 2024-09-12T02:35:18.948 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 12 02:35:18 smithi044 ceph-mon[35411]: Cluster is now healthy 2024-09-12T02:35:19.013 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 12 02:35:18 smithi172 ceph-mon[35609]: pgmap v307: 129 pgs: 129 active+clean; 579 KiB data, 346 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-12T02:35:19.014 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 12 02:35:18 smithi172 ceph-mon[35609]: Health check cleared: POOL_APP_NOT_ENABLED (was: 1 pool(s) do not have an application enabled) 2024-09-12T02:35:19.014 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 12 02:35:18 smithi172 ceph-mon[35609]: Cluster is now healthy 2024-09-12T02:35:19.735 DEBUG:teuthology.orchestra.run.smithi039:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc shell --fsid 4954ed46-70ae-11ef-bcea-c7b262605968 -- ceph osd dump --format=json 2024-09-12T02:35:19.849 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 02:35:19 smithi039 ceph-mon[30515]: from='client.? 172.21.15.39:0/4050521873' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-12T02:35:19.948 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 12 02:35:19 smithi044 ceph-mon[35411]: from='client.? 172.21.15.39:0/4050521873' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-12T02:35:20.013 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 12 02:35:19 smithi172 ceph-mon[35609]: from='client.? 172.21.15.39:0/4050521873' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-12T02:35:20.110 INFO:teuthology.orchestra.run.smithi039.stderr:Inferring config /var/lib/ceph/4954ed46-70ae-11ef-bcea-c7b262605968/mon.a/config 2024-09-12T02:35:20.708 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:35:20.689+0000 7f705c200640 1 -- 172.21.15.39:0/3492400190 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f7054112b90 msgr2=0x7f7054114f80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:35:20.708 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:35:20.689+0000 7f705c200640 1 --2- 172.21.15.39:0/3492400190 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f7054112b90 0x7f7054114f80 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7f704c009be0 tx=0x7f704c02a750 comp rx=0 tx=0).stop 2024-09-12T02:35:20.708 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:35:20.690+0000 7f705c200640 1 -- 172.21.15.39:0/3492400190 shutdown_connections 2024-09-12T02:35:20.708 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:35:20.690+0000 7f705c200640 1 --2- 172.21.15.39:0/3492400190 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f7054112b90 0x7f7054114f80 unknown :-1 s=CLOSED pgs=79 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:35:20.708 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:35:20.690+0000 7f705c200640 1 --2- 172.21.15.39:0/3492400190 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f7054074eb0 0x7f7054112650 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:35:20.708 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:35:20.690+0000 7f705c200640 1 --2- 172.21.15.39:0/3492400190 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f7054074590 0x7f7054074970 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:35:20.709 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:35:20.690+0000 7f705c200640 1 -- 172.21.15.39:0/3492400190 >> 172.21.15.39:0/3492400190 conn(0x7f70540fd8c0 msgr2=0x7f70540ffce0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:35:20.709 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:35:20.690+0000 7f705c200640 1 -- 172.21.15.39:0/3492400190 shutdown_connections 2024-09-12T02:35:20.709 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:35:20.690+0000 7f705c200640 1 -- 172.21.15.39:0/3492400190 wait complete. 2024-09-12T02:35:20.709 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:35:20.691+0000 7f705c200640 1 Processor -- start 2024-09-12T02:35:20.709 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:35:20.691+0000 7f705c200640 1 -- start start 2024-09-12T02:35:20.709 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:35:20.692+0000 7f705c200640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f7054074590 0x7f705419eab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:35:20.709 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:35:20.692+0000 7f705c200640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f7054074eb0 0x7f705419eff0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:35:20.709 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:35:20.692+0000 7f705c200640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f7054112b90 0x7f70541a33b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:35:20.709 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:35:20.692+0000 7f705c200640 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 -- 0x7f7054118560 con 0x7f7054074590 2024-09-12T02:35:20.709 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:35:20.692+0000 7f705c200640 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x7f70541183e0 con 0x7f7054074eb0 2024-09-12T02:35:20.709 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:35:20.692+0000 7f705c200640 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7f70541186e0 con 0x7f7054112b90 2024-09-12T02:35:20.709 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:35:20.692+0000 7f7059800640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f7054074590 0x7f705419eab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:35:20.709 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:35:20.692+0000 7f7059800640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f7054074590 0x7f705419eab0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.39:3300/0 says I am v2:172.21.15.39:60756/0 (socket says 172.21.15.39:60756) 2024-09-12T02:35:20.710 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:35:20.692+0000 7f7059800640 1 -- 172.21.15.39:0/998290912 learned_addr learned my addr 172.21.15.39:0/998290912 (peer_addr_for_me v2:172.21.15.39:0/0) 2024-09-12T02:35:20.710 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:35:20.692+0000 7f7058e00640 1 --2- 172.21.15.39:0/998290912 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f7054074eb0 0x7f705419eff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:35:20.710 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:35:20.692+0000 7f705a200640 1 --2- 172.21.15.39:0/998290912 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f7054112b90 0x7f70541a33b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:35:20.710 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:35:20.692+0000 7f7059800640 1 -- 172.21.15.39:0/998290912 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f7054112b90 msgr2=0x7f70541a33b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:35:20.710 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:35:20.692+0000 7f7059800640 1 --2- 172.21.15.39:0/998290912 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f7054112b90 0x7f70541a33b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:35:20.710 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:35:20.692+0000 7f7059800640 1 -- 172.21.15.39:0/998290912 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f7054074eb0 msgr2=0x7f705419eff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:35:20.710 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:35:20.692+0000 7f7059800640 1 --2- 172.21.15.39:0/998290912 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f7054074eb0 0x7f705419eff0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:35:20.710 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:35:20.692+0000 7f7059800640 1 -- 172.21.15.39:0/998290912 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f70541a3ae0 con 0x7f7054074590 2024-09-12T02:35:20.710 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:35:20.692+0000 7f7059800640 1 --2- 172.21.15.39:0/998290912 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f7054074590 0x7f705419eab0 secure :-1 s=READY pgs=157 cs=0 l=1 rev1=1 crypto rx=0x7f704800e9f0 tx=0x7f704800edf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:35:20.710 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:35:20.693+0000 7f7052000640 1 -- 172.21.15.39:0/998290912 <== mon.0 v2:172.21.15.39:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f704800cd80 con 0x7f7054074590 2024-09-12T02:35:20.710 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:35:20.693+0000 7f705c200640 1 -- 172.21.15.39:0/998290912 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f70541a3dd0 con 0x7f7054074590 2024-09-12T02:35:20.710 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:35:20.693+0000 7f7052000640 1 -- 172.21.15.39:0/998290912 <== mon.0 v2:172.21.15.39:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f7048005500 con 0x7f7054074590 2024-09-12T02:35:20.711 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:35:20.693+0000 7f7052000640 1 -- 172.21.15.39:0/998290912 <== mon.0 v2:172.21.15.39:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7048010690 con 0x7f7054074590 2024-09-12T02:35:20.711 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:35:20.693+0000 7f705c200640 1 -- 172.21.15.39:0/998290912 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f70541ab660 con 0x7f7054074590 2024-09-12T02:35:20.711 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:35:20.694+0000 7f705c200640 1 -- 172.21.15.39:0/998290912 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f7054074970 con 0x7f7054074590 2024-09-12T02:35:20.711 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:35:20.696+0000 7f7052000640 1 -- 172.21.15.39:0/998290912 <== mon.0 v2:172.21.15.39:3300/0 4 ==== mgrmap(e 16) ==== 137833+0+0 (secure 0 0 0) 0x7f70480046c0 con 0x7f7054074590 2024-09-12T02:35:20.711 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:35:20.698+0000 7f7052000640 1 --2- 172.21.15.39:0/998290912 >> [v2:172.21.15.39:6800/1725006999,v1:172.21.15.39:6801/1725006999] conn(0x7f703c0a2c00 0x7f703c0a50c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:35:20.711 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:35:20.698+0000 7f7052000640 1 -- 172.21.15.39:0/998290912 <== mon.0 v2:172.21.15.39:3300/0 5 ==== osd_map(91..91 src has 1..91) ==== 8802+0+0 (secure 0 0 0) 0x7f70480cf660 con 0x7f7054074590 2024-09-12T02:35:20.711 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:35:20.698+0000 7f7058e00640 1 --2- 172.21.15.39:0/998290912 >> [v2:172.21.15.39:6800/1725006999,v1:172.21.15.39:6801/1725006999] conn(0x7f703c0a2c00 0x7f703c0a50c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:35:20.711 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:35:20.699+0000 7f7058e00640 1 --2- 172.21.15.39:0/998290912 >> [v2:172.21.15.39:6800/1725006999,v1:172.21.15.39:6801/1725006999] conn(0x7f703c0a2c00 0x7f703c0a50c0 secure :-1 s=READY pgs=152 cs=0 l=1 rev1=1 crypto rx=0x7f70400096c0 tx=0x7f7040009260 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:35:20.711 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:35:20.703+0000 7f7052000640 1 -- 172.21.15.39:0/998290912 <== mon.0 v2:172.21.15.39:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7f704809c320 con 0x7f7054074590 2024-09-12T02:35:20.849 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 02:35:20 smithi039 ceph-mon[30515]: pgmap v308: 129 pgs: 129 active+clean; 579 KiB data, 346 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-12T02:35:20.895 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:35:20.894+0000 7f705c200640 1 -- 172.21.15.39:0/998290912 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f7054104fd0 con 0x7f7054074590 2024-09-12T02:35:20.896 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:35:20.895+0000 7f7052000640 1 -- 172.21.15.39:0/998290912 <== mon.0 v2:172.21.15.39:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v91) ==== 74+0+24178 (secure 0 0 0) 0x7f7048086020 con 0x7f7054074590 2024-09-12T02:35:20.897 INFO:teuthology.orchestra.run.smithi039.stdout: 2024-09-12T02:35:20.897 INFO:teuthology.orchestra.run.smithi039.stdout:{"epoch":91,"fsid":"4954ed46-70ae-11ef-bcea-c7b262605968","created":"2024-09-12T02:26:43.086467+0000","modified":"2024-09-12T02:35:16.579407+0000","last_up_change":"2024-09-12T02:34:08.626341+0000","last_in_change":"2024-09-12T02:33:45.553591+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":27,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":12,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-12T02:30:09.347905+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":12,"score_stable":12,"optimal_score":0.25,"raw_score_acting":3,"raw_score_stable":3,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-09-12T02:34:58.580872+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"84","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":2.25,"score_stable":2.25,"optimal_score":1,"raw_score_acting":2.25,"raw_score_stable":2.25,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-09-12T02:35:01.469805+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"84","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2024-09-12T02:35:11.088109+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"91","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"c967b48e-8a39-4797-871b-8b1b83d9472f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":87,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6802","nonce":2437586899},{"type":"v1","addr":"172.21.15.39:6803","nonce":2437586899}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6804","nonce":2437586899},{"type":"v1","addr":"172.21.15.39:6805","nonce":2437586899}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6808","nonce":2437586899},{"type":"v1","addr":"172.21.15.39:6809","nonce":2437586899}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6806","nonce":2437586899},{"type":"v1","addr":"172.21.15.39:6807","nonce":2437586899}]},"public_addr":"172.21.15.39:6803/2437586899","cluster_addr":"172.21.15.39:6805/2437586899","heartbeat_back_addr":"172.21.15.39:6809/2437586899","heartbeat_front_addr":"172.21.15.39:6807/2437586899","state":["exists","up"]},{"osd":1,"uuid":"30e1e4f4-1d50-4003-8978-cb183dca7fbb","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":87,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6800","nonce":2349287000},{"type":"v1","addr":"172.21.15.44:6801","nonce":2349287000}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6802","nonce":2349287000},{"type":"v1","addr":"172.21.15.44:6803","nonce":2349287000}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6806","nonce":2349287000},{"type":"v1","addr":"172.21.15.44:6807","nonce":2349287000}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6804","nonce":2349287000},{"type":"v1","addr":"172.21.15.44:6805","nonce":2349287000}]},"public_addr":"172.21.15.44:6801/2349287000","cluster_addr":"172.21.15.44:6803/2349287000","heartbeat_back_addr":"172.21.15.44:6807/2349287000","heartbeat_front_addr":"172.21.15.44:6805/2349287000","state":["exists","up"]},{"osd":2,"uuid":"a758803f-8668-4fc8-9417-b8d080cd9a7c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":18,"up_thru":87,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6800","nonce":1176898232},{"type":"v1","addr":"172.21.15.172:6801","nonce":1176898232}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6802","nonce":1176898232},{"type":"v1","addr":"172.21.15.172:6803","nonce":1176898232}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6806","nonce":1176898232},{"type":"v1","addr":"172.21.15.172:6807","nonce":1176898232}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6804","nonce":1176898232},{"type":"v1","addr":"172.21.15.172:6805","nonce":1176898232}]},"public_addr":"172.21.15.172:6801/1176898232","cluster_addr":"172.21.15.172:6803/1176898232","heartbeat_back_addr":"172.21.15.172:6807/1176898232","heartbeat_front_addr":"172.21.15.172:6805/1176898232","state":["exists","up"]},{"osd":3,"uuid":"8b256567-7efe-429c-bc4c-80e93228f139","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":26,"up_thru":87,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6810","nonce":2013565859},{"type":"v1","addr":"172.21.15.39:6811","nonce":2013565859}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6812","nonce":2013565859},{"type":"v1","addr":"172.21.15.39:6813","nonce":2013565859}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6816","nonce":2013565859},{"type":"v1","addr":"172.21.15.39:6817","nonce":2013565859}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6814","nonce":2013565859},{"type":"v1","addr":"172.21.15.39:6815","nonce":2013565859}]},"public_addr":"172.21.15.39:6811/2013565859","cluster_addr":"172.21.15.39:6813/2013565859","heartbeat_back_addr":"172.21.15.39:6817/2013565859","heartbeat_front_addr":"172.21.15.39:6815/2013565859","state":["exists","up"]},{"osd":4,"uuid":"e86b6756-e2b3-49fe-9b87-1a2b015bb17a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":33,"up_thru":87,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6808","nonce":3663639110},{"type":"v1","addr":"172.21.15.44:6809","nonce":3663639110}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6810","nonce":3663639110},{"type":"v1","addr":"172.21.15.44:6811","nonce":3663639110}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6814","nonce":3663639110},{"type":"v1","addr":"172.21.15.44:6815","nonce":3663639110}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6812","nonce":3663639110},{"type":"v1","addr":"172.21.15.44:6813","nonce":3663639110}]},"public_addr":"172.21.15.44:6809/3663639110","cluster_addr":"172.21.15.44:6811/3663639110","heartbeat_back_addr":"172.21.15.44:6815/3663639110","heartbeat_front_addr":"172.21.15.44:6813/3663639110","state":["exists","up"]},{"osd":5,"uuid":"9c907c92-b323-48e7-99ad-ec9756d26312","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":38,"up_thru":87,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6808","nonce":998885347},{"type":"v1","addr":"172.21.15.172:6809","nonce":998885347}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6810","nonce":998885347},{"type":"v1","addr":"172.21.15.172:6811","nonce":998885347}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6814","nonce":998885347},{"type":"v1","addr":"172.21.15.172:6815","nonce":998885347}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6812","nonce":998885347},{"type":"v1","addr":"172.21.15.172:6813","nonce":998885347}]},"public_addr":"172.21.15.172:6809/998885347","cluster_addr":"172.21.15.172:6811/998885347","heartbeat_back_addr":"172.21.15.172:6815/998885347","heartbeat_front_addr":"172.21.15.172:6813/998885347","state":["exists","up"]},{"osd":6,"uuid":"1fcb9bb2-6f4b-4d97-a401-aeb6a9706613","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":45,"up_thru":87,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6818","nonce":2569059542},{"type":"v1","addr":"172.21.15.39:6819","nonce":2569059542}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6820","nonce":2569059542},{"type":"v1","addr":"172.21.15.39:6821","nonce":2569059542}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6824","nonce":2569059542},{"type":"v1","addr":"172.21.15.39:6825","nonce":2569059542}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6822","nonce":2569059542},{"type":"v1","addr":"172.21.15.39:6823","nonce":2569059542}]},"public_addr":"172.21.15.39:6819/2569059542","cluster_addr":"172.21.15.39:6821/2569059542","heartbeat_back_addr":"172.21.15.39:6825/2569059542","heartbeat_front_addr":"172.21.15.39:6823/2569059542","state":["exists","up"]},{"osd":7,"uuid":"59e0caf9-8ce5-4161-8875-84862eba743e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":50,"up_thru":87,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6816","nonce":709635079},{"type":"v1","addr":"172.21.15.44:6817","nonce":709635079}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6818","nonce":709635079},{"type":"v1","addr":"172.21.15.44:6819","nonce":709635079}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6822","nonce":709635079},{"type":"v1","addr":"172.21.15.44:6823","nonce":709635079}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6820","nonce":709635079},{"type":"v1","addr":"172.21.15.44:6821","nonce":709635079}]},"public_addr":"172.21.15.44:6817/709635079","cluster_addr":"172.21.15.44:6819/709635079","heartbeat_back_addr":"172.21.15.44:6823/709635079","heartbeat_front_addr":"172.21.15.44:6821/709635079","state":["exists","up"]},{"osd":8,"uuid":"2f6fb5c7-86cc-43eb-bdfb-45a69316937e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":57,"up_thru":87,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6816","nonce":1162792895},{"type":"v1","addr":"172.21.15.172:6817","nonce":1162792895}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6818","nonce":1162792895},{"type":"v1","addr":"172.21.15.172:6819","nonce":1162792895}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6822","nonce":1162792895},{"type":"v1","addr":"172.21.15.172:6823","nonce":1162792895}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6820","nonce":1162792895},{"type":"v1","addr":"172.21.15.172:6821","nonce":1162792895}]},"public_addr":"172.21.15.172:6817/1162792895","cluster_addr":"172.21.15.172:6819/1162792895","heartbeat_back_addr":"172.21.15.172:6823/1162792895","heartbeat_front_addr":"172.21.15.172:6821/1162792895","state":["exists","up"]},{"osd":9,"uuid":"87e5dd9e-8191-4db6-83fa-cfff7c31e17e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":65,"up_thru":87,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6826","nonce":945860346},{"type":"v1","addr":"172.21.15.39:6827","nonce":945860346}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6828","nonce":945860346},{"type":"v1","addr":"172.21.15.39:6829","nonce":945860346}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6832","nonce":945860346},{"type":"v1","addr":"172.21.15.39:6833","nonce":945860346}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6830","nonce":945860346},{"type":"v1","addr":"172.21.15.39:6831","nonce":945860346}]},"public_addr":"172.21.15.39:6827/945860346","cluster_addr":"172.21.15.39:6829/945860346","heartbeat_back_addr":"172.21.15.39:6833/945860346","heartbeat_front_addr":"172.21.15.39:6831/945860346","state":["exists","up"]},{"osd":10,"uuid":"b55d8a00-850f-4910-a5bf-97d9ed545be7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":70,"up_thru":81,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6824","nonce":3899352344},{"type":"v1","addr":"172.21.15.44:6825","nonce":3899352344}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6826","nonce":3899352344},{"type":"v1","addr":"172.21.15.44:6827","nonce":3899352344}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6830","nonce":3899352344},{"type":"v1","addr":"172.21.15.44:6831","nonce":3899352344}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6828","nonce":3899352344},{"type":"v1","addr":"172.21.15.44:6829","nonce":3899352344}]},"public_addr":"172.21.15.44:6825/3899352344","cluster_addr":"172.21.15.44:6827/3899352344","heartbeat_back_addr":"172.21.15.44:6831/3899352344","heartbeat_front_addr":"172.21.15.44:6829/3899352344","state":["exists","up"]},{"osd":11,"uuid":"20cf5df1-5a80-4272-acc0-919c6a1da55a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":77,"up_thru":87,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6824","nonce":3627635035},{"type":"v1","addr":"172.21.15.172:6825","nonce":3627635035}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6826","nonce":3627635035},{"type":"v1","addr":"172.21.15.172:6827","nonce":3627635035}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6830","nonce":3627635035},{"type":"v1","addr":"172.21.15.172:6831","nonce":3627635035}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6828","nonce":3627635035},{"type":"v1","addr":"172.21.15.172:6829","nonce":3627635035}]},"public_addr":"172.21.15.172:6825/3627635035","cluster_addr":"172.21.15.172:6827/3627635035","heartbeat_back_addr":"172.21.15.172:6831/3627635035","heartbeat_front_addr":"172.21.15.172:6829/3627635035","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T02:29:15.367468+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T02:29:41.518207+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T02:30:06.004371+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T02:30:34.793371+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T02:31:00.878517+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T02:31:26.675956+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T02:31:55.950748+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T02:32:22.824017+0000","dead_epoch":0},{"osd":8,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T02:32:46.775880+0000","dead_epoch":0},{"osd":9,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T02:33:16.420347+0000","dead_epoch":0},{"osd":10,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T02:33:42.185837+0000","dead_epoch":0},{"osd":11,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T02:34:07.312555+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.39:6800/3152613618":"2024-09-13T02:27:44.717224+0000","172.21.15.39:0/2301206766":"2024-09-13T02:27:44.717224+0000","172.21.15.39:0/1941318538":"2024-09-13T02:27:44.717224+0000","172.21.15.39:0/1527429435":"2024-09-13T02:27:44.717224+0000","172.21.15.39:0/2913347539":"2024-09-13T02:27:16.531986+0000","172.21.15.39:0/2827440002":"2024-09-13T02:27:16.531986+0000","172.21.15.39:0/4075322467":"2024-09-13T02:27:16.531986+0000","172.21.15.39:6801/1074685700":"2024-09-13T02:27:16.531986+0000","172.21.15.39:6801/3152613618":"2024-09-13T02:27:44.717224+0000","172.21.15.39:6800/1074685700":"2024-09-13T02:27:16.531986+0000"},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-12T02:35:20.899 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:35:20.898+0000 7f705c200640 1 -- 172.21.15.39:0/998290912 >> [v2:172.21.15.39:6800/1725006999,v1:172.21.15.39:6801/1725006999] conn(0x7f703c0a2c00 msgr2=0x7f703c0a50c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:35:20.899 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:35:20.898+0000 7f705c200640 1 --2- 172.21.15.39:0/998290912 >> [v2:172.21.15.39:6800/1725006999,v1:172.21.15.39:6801/1725006999] conn(0x7f703c0a2c00 0x7f703c0a50c0 secure :-1 s=READY pgs=152 cs=0 l=1 rev1=1 crypto rx=0x7f70400096c0 tx=0x7f7040009260 comp rx=0 tx=0).stop 2024-09-12T02:35:20.899 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:35:20.898+0000 7f705c200640 1 -- 172.21.15.39:0/998290912 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f7054074590 msgr2=0x7f705419eab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:35:20.899 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:35:20.898+0000 7f705c200640 1 --2- 172.21.15.39:0/998290912 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f7054074590 0x7f705419eab0 secure :-1 s=READY pgs=157 cs=0 l=1 rev1=1 crypto rx=0x7f704800e9f0 tx=0x7f704800edf0 comp rx=0 tx=0).stop 2024-09-12T02:35:20.899 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:35:20.898+0000 7f705c200640 1 -- 172.21.15.39:0/998290912 shutdown_connections 2024-09-12T02:35:20.899 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:35:20.898+0000 7f705c200640 1 --2- 172.21.15.39:0/998290912 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f7054112b90 0x7f70541a33b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:35:20.899 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:35:20.898+0000 7f705c200640 1 --2- 172.21.15.39:0/998290912 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f7054074eb0 0x7f705419eff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:35:20.900 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:35:20.898+0000 7f705c200640 1 --2- 172.21.15.39:0/998290912 >> [v2:172.21.15.39:6800/1725006999,v1:172.21.15.39:6801/1725006999] conn(0x7f703c0a2c00 0x7f703c0a50c0 unknown :-1 s=CLOSED pgs=152 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:35:20.900 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:35:20.898+0000 7f705c200640 1 --2- 172.21.15.39:0/998290912 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f7054074590 0x7f705419eab0 unknown :-1 s=CLOSED pgs=157 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:35:20.900 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:35:20.898+0000 7f705c200640 1 -- 172.21.15.39:0/998290912 >> 172.21.15.39:0/998290912 conn(0x7f70540fd8c0 msgr2=0x7f70540ff050 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:35:20.900 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:35:20.898+0000 7f705c200640 1 -- 172.21.15.39:0/998290912 shutdown_connections 2024-09-12T02:35:20.900 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:35:20.898+0000 7f705c200640 1 -- 172.21.15.39:0/998290912 wait complete. 2024-09-12T02:35:20.948 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 12 02:35:20 smithi044 ceph-mon[35411]: pgmap v308: 129 pgs: 129 active+clean; 579 KiB data, 346 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-12T02:35:21.013 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 12 02:35:20 smithi172 ceph-mon[35609]: pgmap v308: 129 pgs: 129 active+clean; 579 KiB data, 346 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-12T02:35:21.734 DEBUG:teuthology.orchestra.run.smithi039:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc shell --fsid 4954ed46-70ae-11ef-bcea-c7b262605968 -- ceph osd dump --format=json 2024-09-12T02:35:21.948 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 12 02:35:21 smithi044 ceph-mon[35411]: from='client.? 172.21.15.39:0/998290912' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-09-12T02:35:22.013 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 12 02:35:21 smithi172 ceph-mon[35609]: from='client.? 172.21.15.39:0/998290912' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-09-12T02:35:22.101 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 02:35:21 smithi039 ceph-mon[30515]: from='client.? 172.21.15.39:0/998290912' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-09-12T02:35:22.115 INFO:teuthology.orchestra.run.smithi039.stderr:Inferring config /var/lib/ceph/4954ed46-70ae-11ef-bcea-c7b262605968/mon.a/config 2024-09-12T02:35:22.703 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:35:22.702+0000 7f8843e00640 1 -- 172.21.15.39:0/1796397591 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f8844108f60 msgr2=0x7f8844110ae0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:35:22.703 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:35:22.702+0000 7f8843e00640 1 --2- 172.21.15.39:0/1796397591 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f8844108f60 0x7f8844110ae0 secure :-1 s=READY pgs=158 cs=0 l=1 rev1=1 crypto rx=0x7f883c009ca0 tx=0x7f883c02a8c0 comp rx=0 tx=0).stop 2024-09-12T02:35:22.703 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:35:22.702+0000 7f8843e00640 1 -- 172.21.15.39:0/1796397591 shutdown_connections 2024-09-12T02:35:22.703 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:35:22.702+0000 7f8843e00640 1 --2- 172.21.15.39:0/1796397591 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f8844108f60 0x7f8844110ae0 unknown :-1 s=CLOSED pgs=158 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:35:22.703 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:35:22.702+0000 7f8843e00640 1 --2- 172.21.15.39:0/1796397591 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f88441047e0 0x7f8844108830 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:35:22.704 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:35:22.702+0000 7f8843e00640 1 --2- 172.21.15.39:0/1796397591 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f8844103e30 0x7f8844104210 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:35:22.704 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:35:22.702+0000 7f8843e00640 1 -- 172.21.15.39:0/1796397591 >> 172.21.15.39:0/1796397591 conn(0x7f88440ff8d0 msgr2=0x7f8844101cf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:35:22.704 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:35:22.702+0000 7f8843e00640 1 -- 172.21.15.39:0/1796397591 shutdown_connections 2024-09-12T02:35:22.704 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:35:22.702+0000 7f8843e00640 1 -- 172.21.15.39:0/1796397591 wait complete. 2024-09-12T02:35:22.705 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:35:22.703+0000 7f8843e00640 1 Processor -- start 2024-09-12T02:35:22.705 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:35:22.703+0000 7f8843e00640 1 -- start start 2024-09-12T02:35:22.705 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:35:22.703+0000 7f8843e00640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f8844103e30 0x7f884419a3e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:35:22.705 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:35:22.703+0000 7f8843e00640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f88441047e0 0x7f884419a920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:35:22.705 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:35:22.703+0000 7f8843e00640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f8844108f60 0x7f884419ecb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:35:22.706 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:35:22.704+0000 7f8843e00640 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 -- 0x7f8844113fc0 con 0x7f8844103e30 2024-09-12T02:35:22.706 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:35:22.704+0000 7f8843e00640 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x7f8844113e40 con 0x7f8844108f60 2024-09-12T02:35:22.706 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:35:22.704+0000 7f8843e00640 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7f8844114140 con 0x7f88441047e0 2024-09-12T02:35:22.706 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:35:22.704+0000 7f8842a00640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f8844103e30 0x7f884419a3e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:35:22.706 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:35:22.704+0000 7f8842000640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f88441047e0 0x7f884419a920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:35:22.706 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:35:22.704+0000 7f8842a00640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f8844103e30 0x7f884419a3e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.39:3300/0 says I am v2:172.21.15.39:60776/0 (socket says 172.21.15.39:60776) 2024-09-12T02:35:22.706 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:35:22.704+0000 7f8842a00640 1 -- 172.21.15.39:0/437778918 learned_addr learned my addr 172.21.15.39:0/437778918 (peer_addr_for_me v2:172.21.15.39:0/0) 2024-09-12T02:35:22.706 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:35:22.704+0000 7f8843400640 1 --2- 172.21.15.39:0/437778918 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f8844108f60 0x7f884419ecb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:35:22.706 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:35:22.704+0000 7f8842000640 1 -- 172.21.15.39:0/437778918 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f8844108f60 msgr2=0x7f884419ecb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:35:22.706 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:35:22.704+0000 7f8842000640 1 --2- 172.21.15.39:0/437778918 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f8844108f60 0x7f884419ecb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:35:22.706 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:35:22.704+0000 7f8842000640 1 -- 172.21.15.39:0/437778918 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f8844103e30 msgr2=0x7f884419a3e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:35:22.706 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:35:22.704+0000 7f8842000640 1 --2- 172.21.15.39:0/437778918 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f8844103e30 0x7f884419a3e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:35:22.706 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:35:22.704+0000 7f8842000640 1 -- 172.21.15.39:0/437778918 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f884419f390 con 0x7f88441047e0 2024-09-12T02:35:22.707 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:35:22.705+0000 7f8842000640 1 --2- 172.21.15.39:0/437778918 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f88441047e0 0x7f884419a920 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7f883000e9f0 tx=0x7f883000eeb0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:35:22.707 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:35:22.705+0000 7f883b400640 1 -- 172.21.15.39:0/437778918 <== mon.1 v2:172.21.15.172:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f883000ccc0 con 0x7f88441047e0 2024-09-12T02:35:22.707 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:35:22.705+0000 7f8843e00640 1 -- 172.21.15.39:0/437778918 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f884419f680 con 0x7f88441047e0 2024-09-12T02:35:22.707 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:35:22.705+0000 7f883b400640 1 -- 172.21.15.39:0/437778918 <== mon.1 v2:172.21.15.172:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f8830010910 con 0x7f88441047e0 2024-09-12T02:35:22.707 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:35:22.705+0000 7f883b400640 1 -- 172.21.15.39:0/437778918 <== mon.1 v2:172.21.15.172:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8830018960 con 0x7f88441047e0 2024-09-12T02:35:22.708 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:35:22.705+0000 7f8843e00640 1 -- 172.21.15.39:0/437778918 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f88441a6f60 con 0x7f88441047e0 2024-09-12T02:35:22.708 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:35:22.706+0000 7f8843e00640 1 -- 172.21.15.39:0/437778918 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f8844104210 con 0x7f88441047e0 2024-09-12T02:35:22.713 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:35:22.709+0000 7f883b400640 1 -- 172.21.15.39:0/437778918 <== mon.1 v2:172.21.15.172:3300/0 4 ==== mgrmap(e 16) ==== 137833+0+0 (secure 0 0 0) 0x7f8830010ac0 con 0x7f88441047e0 2024-09-12T02:35:22.713 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:35:22.710+0000 7f883b400640 1 --2- 172.21.15.39:0/437778918 >> [v2:172.21.15.39:6800/1725006999,v1:172.21.15.39:6801/1725006999] conn(0x7f88280a2b80 0x7f88280a5040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:35:22.713 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:35:22.710+0000 7f883b400640 1 -- 172.21.15.39:0/437778918 <== mon.1 v2:172.21.15.172:3300/0 5 ==== osd_map(91..91 src has 1..91) ==== 8802+0+0 (secure 0 0 0) 0x7f88300cf600 con 0x7f88441047e0 2024-09-12T02:35:22.713 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:35:22.710+0000 7f8842a00640 1 --2- 172.21.15.39:0/437778918 >> [v2:172.21.15.39:6800/1725006999,v1:172.21.15.39:6801/1725006999] conn(0x7f88280a2b80 0x7f88280a5040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:35:22.713 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:35:22.711+0000 7f8842a00640 1 --2- 172.21.15.39:0/437778918 >> [v2:172.21.15.39:6800/1725006999,v1:172.21.15.39:6801/1725006999] conn(0x7f88280a2b80 0x7f88280a5040 secure :-1 s=READY pgs=153 cs=0 l=1 rev1=1 crypto rx=0x7f8834009c90 tx=0x7f8834005f90 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:35:22.715 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:35:22.715+0000 7f883b400640 1 -- 172.21.15.39:0/437778918 <== mon.1 v2:172.21.15.172:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7f883009bc70 con 0x7f88441047e0 2024-09-12T02:35:22.849 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 02:35:22 smithi039 ceph-mon[30515]: pgmap v309: 129 pgs: 129 active+clean; 579 KiB data, 346 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-12T02:35:22.902 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:35:22.902+0000 7f8843e00640 1 -- 172.21.15.39:0/437778918 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f884410c200 con 0x7f88441047e0 2024-09-12T02:35:22.904 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:35:22.904+0000 7f883b400640 1 -- 172.21.15.39:0/437778918 <== mon.1 v2:172.21.15.172:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v91) ==== 74+0+24178 (secure 0 0 0) 0x7f883009ff70 con 0x7f88441047e0 2024-09-12T02:35:22.905 INFO:teuthology.orchestra.run.smithi039.stdout: 2024-09-12T02:35:22.905 INFO:teuthology.orchestra.run.smithi039.stdout:{"epoch":91,"fsid":"4954ed46-70ae-11ef-bcea-c7b262605968","created":"2024-09-12T02:26:43.086467+0000","modified":"2024-09-12T02:35:16.579407+0000","last_up_change":"2024-09-12T02:34:08.626341+0000","last_in_change":"2024-09-12T02:33:45.553591+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":27,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":12,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-12T02:30:09.347905+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":12,"score_stable":12,"optimal_score":0.25,"raw_score_acting":3,"raw_score_stable":3,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-09-12T02:34:58.580872+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"84","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":2.25,"score_stable":2.25,"optimal_score":1,"raw_score_acting":2.25,"raw_score_stable":2.25,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-09-12T02:35:01.469805+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"84","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2024-09-12T02:35:11.088109+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"91","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"c967b48e-8a39-4797-871b-8b1b83d9472f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":87,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6802","nonce":2437586899},{"type":"v1","addr":"172.21.15.39:6803","nonce":2437586899}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6804","nonce":2437586899},{"type":"v1","addr":"172.21.15.39:6805","nonce":2437586899}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6808","nonce":2437586899},{"type":"v1","addr":"172.21.15.39:6809","nonce":2437586899}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6806","nonce":2437586899},{"type":"v1","addr":"172.21.15.39:6807","nonce":2437586899}]},"public_addr":"172.21.15.39:6803/2437586899","cluster_addr":"172.21.15.39:6805/2437586899","heartbeat_back_addr":"172.21.15.39:6809/2437586899","heartbeat_front_addr":"172.21.15.39:6807/2437586899","state":["exists","up"]},{"osd":1,"uuid":"30e1e4f4-1d50-4003-8978-cb183dca7fbb","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":87,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6800","nonce":2349287000},{"type":"v1","addr":"172.21.15.44:6801","nonce":2349287000}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6802","nonce":2349287000},{"type":"v1","addr":"172.21.15.44:6803","nonce":2349287000}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6806","nonce":2349287000},{"type":"v1","addr":"172.21.15.44:6807","nonce":2349287000}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6804","nonce":2349287000},{"type":"v1","addr":"172.21.15.44:6805","nonce":2349287000}]},"public_addr":"172.21.15.44:6801/2349287000","cluster_addr":"172.21.15.44:6803/2349287000","heartbeat_back_addr":"172.21.15.44:6807/2349287000","heartbeat_front_addr":"172.21.15.44:6805/2349287000","state":["exists","up"]},{"osd":2,"uuid":"a758803f-8668-4fc8-9417-b8d080cd9a7c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":18,"up_thru":87,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6800","nonce":1176898232},{"type":"v1","addr":"172.21.15.172:6801","nonce":1176898232}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6802","nonce":1176898232},{"type":"v1","addr":"172.21.15.172:6803","nonce":1176898232}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6806","nonce":1176898232},{"type":"v1","addr":"172.21.15.172:6807","nonce":1176898232}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6804","nonce":1176898232},{"type":"v1","addr":"172.21.15.172:6805","nonce":1176898232}]},"public_addr":"172.21.15.172:6801/1176898232","cluster_addr":"172.21.15.172:6803/1176898232","heartbeat_back_addr":"172.21.15.172:6807/1176898232","heartbeat_front_addr":"172.21.15.172:6805/1176898232","state":["exists","up"]},{"osd":3,"uuid":"8b256567-7efe-429c-bc4c-80e93228f139","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":26,"up_thru":87,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6810","nonce":2013565859},{"type":"v1","addr":"172.21.15.39:6811","nonce":2013565859}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6812","nonce":2013565859},{"type":"v1","addr":"172.21.15.39:6813","nonce":2013565859}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6816","nonce":2013565859},{"type":"v1","addr":"172.21.15.39:6817","nonce":2013565859}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6814","nonce":2013565859},{"type":"v1","addr":"172.21.15.39:6815","nonce":2013565859}]},"public_addr":"172.21.15.39:6811/2013565859","cluster_addr":"172.21.15.39:6813/2013565859","heartbeat_back_addr":"172.21.15.39:6817/2013565859","heartbeat_front_addr":"172.21.15.39:6815/2013565859","state":["exists","up"]},{"osd":4,"uuid":"e86b6756-e2b3-49fe-9b87-1a2b015bb17a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":33,"up_thru":87,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6808","nonce":3663639110},{"type":"v1","addr":"172.21.15.44:6809","nonce":3663639110}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6810","nonce":3663639110},{"type":"v1","addr":"172.21.15.44:6811","nonce":3663639110}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6814","nonce":3663639110},{"type":"v1","addr":"172.21.15.44:6815","nonce":3663639110}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6812","nonce":3663639110},{"type":"v1","addr":"172.21.15.44:6813","nonce":3663639110}]},"public_addr":"172.21.15.44:6809/3663639110","cluster_addr":"172.21.15.44:6811/3663639110","heartbeat_back_addr":"172.21.15.44:6815/3663639110","heartbeat_front_addr":"172.21.15.44:6813/3663639110","state":["exists","up"]},{"osd":5,"uuid":"9c907c92-b323-48e7-99ad-ec9756d26312","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":38,"up_thru":87,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6808","nonce":998885347},{"type":"v1","addr":"172.21.15.172:6809","nonce":998885347}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6810","nonce":998885347},{"type":"v1","addr":"172.21.15.172:6811","nonce":998885347}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6814","nonce":998885347},{"type":"v1","addr":"172.21.15.172:6815","nonce":998885347}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6812","nonce":998885347},{"type":"v1","addr":"172.21.15.172:6813","nonce":998885347}]},"public_addr":"172.21.15.172:6809/998885347","cluster_addr":"172.21.15.172:6811/998885347","heartbeat_back_addr":"172.21.15.172:6815/998885347","heartbeat_front_addr":"172.21.15.172:6813/998885347","state":["exists","up"]},{"osd":6,"uuid":"1fcb9bb2-6f4b-4d97-a401-aeb6a9706613","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":45,"up_thru":87,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6818","nonce":2569059542},{"type":"v1","addr":"172.21.15.39:6819","nonce":2569059542}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6820","nonce":2569059542},{"type":"v1","addr":"172.21.15.39:6821","nonce":2569059542}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6824","nonce":2569059542},{"type":"v1","addr":"172.21.15.39:6825","nonce":2569059542}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6822","nonce":2569059542},{"type":"v1","addr":"172.21.15.39:6823","nonce":2569059542}]},"public_addr":"172.21.15.39:6819/2569059542","cluster_addr":"172.21.15.39:6821/2569059542","heartbeat_back_addr":"172.21.15.39:6825/2569059542","heartbeat_front_addr":"172.21.15.39:6823/2569059542","state":["exists","up"]},{"osd":7,"uuid":"59e0caf9-8ce5-4161-8875-84862eba743e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":50,"up_thru":87,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6816","nonce":709635079},{"type":"v1","addr":"172.21.15.44:6817","nonce":709635079}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6818","nonce":709635079},{"type":"v1","addr":"172.21.15.44:6819","nonce":709635079}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6822","nonce":709635079},{"type":"v1","addr":"172.21.15.44:6823","nonce":709635079}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6820","nonce":709635079},{"type":"v1","addr":"172.21.15.44:6821","nonce":709635079}]},"public_addr":"172.21.15.44:6817/709635079","cluster_addr":"172.21.15.44:6819/709635079","heartbeat_back_addr":"172.21.15.44:6823/709635079","heartbeat_front_addr":"172.21.15.44:6821/709635079","state":["exists","up"]},{"osd":8,"uuid":"2f6fb5c7-86cc-43eb-bdfb-45a69316937e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":57,"up_thru":87,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6816","nonce":1162792895},{"type":"v1","addr":"172.21.15.172:6817","nonce":1162792895}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6818","nonce":1162792895},{"type":"v1","addr":"172.21.15.172:6819","nonce":1162792895}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6822","nonce":1162792895},{"type":"v1","addr":"172.21.15.172:6823","nonce":1162792895}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6820","nonce":1162792895},{"type":"v1","addr":"172.21.15.172:6821","nonce":1162792895}]},"public_addr":"172.21.15.172:6817/1162792895","cluster_addr":"172.21.15.172:6819/1162792895","heartbeat_back_addr":"172.21.15.172:6823/1162792895","heartbeat_front_addr":"172.21.15.172:6821/1162792895","state":["exists","up"]},{"osd":9,"uuid":"87e5dd9e-8191-4db6-83fa-cfff7c31e17e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":65,"up_thru":87,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6826","nonce":945860346},{"type":"v1","addr":"172.21.15.39:6827","nonce":945860346}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6828","nonce":945860346},{"type":"v1","addr":"172.21.15.39:6829","nonce":945860346}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6832","nonce":945860346},{"type":"v1","addr":"172.21.15.39:6833","nonce":945860346}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6830","nonce":945860346},{"type":"v1","addr":"172.21.15.39:6831","nonce":945860346}]},"public_addr":"172.21.15.39:6827/945860346","cluster_addr":"172.21.15.39:6829/945860346","heartbeat_back_addr":"172.21.15.39:6833/945860346","heartbeat_front_addr":"172.21.15.39:6831/945860346","state":["exists","up"]},{"osd":10,"uuid":"b55d8a00-850f-4910-a5bf-97d9ed545be7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":70,"up_thru":81,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6824","nonce":3899352344},{"type":"v1","addr":"172.21.15.44:6825","nonce":3899352344}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6826","nonce":3899352344},{"type":"v1","addr":"172.21.15.44:6827","nonce":3899352344}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6830","nonce":3899352344},{"type":"v1","addr":"172.21.15.44:6831","nonce":3899352344}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6828","nonce":3899352344},{"type":"v1","addr":"172.21.15.44:6829","nonce":3899352344}]},"public_addr":"172.21.15.44:6825/3899352344","cluster_addr":"172.21.15.44:6827/3899352344","heartbeat_back_addr":"172.21.15.44:6831/3899352344","heartbeat_front_addr":"172.21.15.44:6829/3899352344","state":["exists","up"]},{"osd":11,"uuid":"20cf5df1-5a80-4272-acc0-919c6a1da55a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":77,"up_thru":87,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6824","nonce":3627635035},{"type":"v1","addr":"172.21.15.172:6825","nonce":3627635035}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6826","nonce":3627635035},{"type":"v1","addr":"172.21.15.172:6827","nonce":3627635035}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6830","nonce":3627635035},{"type":"v1","addr":"172.21.15.172:6831","nonce":3627635035}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6828","nonce":3627635035},{"type":"v1","addr":"172.21.15.172:6829","nonce":3627635035}]},"public_addr":"172.21.15.172:6825/3627635035","cluster_addr":"172.21.15.172:6827/3627635035","heartbeat_back_addr":"172.21.15.172:6831/3627635035","heartbeat_front_addr":"172.21.15.172:6829/3627635035","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T02:29:15.367468+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T02:29:41.518207+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T02:30:06.004371+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T02:30:34.793371+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T02:31:00.878517+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T02:31:26.675956+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T02:31:55.950748+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T02:32:22.824017+0000","dead_epoch":0},{"osd":8,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T02:32:46.775880+0000","dead_epoch":0},{"osd":9,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T02:33:16.420347+0000","dead_epoch":0},{"osd":10,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T02:33:42.185837+0000","dead_epoch":0},{"osd":11,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T02:34:07.312555+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.39:6800/3152613618":"2024-09-13T02:27:44.717224+0000","172.21.15.39:0/2301206766":"2024-09-13T02:27:44.717224+0000","172.21.15.39:0/1941318538":"2024-09-13T02:27:44.717224+0000","172.21.15.39:0/1527429435":"2024-09-13T02:27:44.717224+0000","172.21.15.39:0/2913347539":"2024-09-13T02:27:16.531986+0000","172.21.15.39:0/2827440002":"2024-09-13T02:27:16.531986+0000","172.21.15.39:0/4075322467":"2024-09-13T02:27:16.531986+0000","172.21.15.39:6801/1074685700":"2024-09-13T02:27:16.531986+0000","172.21.15.39:6801/3152613618":"2024-09-13T02:27:44.717224+0000","172.21.15.39:6800/1074685700":"2024-09-13T02:27:16.531986+0000"},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-12T02:35:22.907 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:35:22.906+0000 7f8843e00640 1 -- 172.21.15.39:0/437778918 >> [v2:172.21.15.39:6800/1725006999,v1:172.21.15.39:6801/1725006999] conn(0x7f88280a2b80 msgr2=0x7f88280a5040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:35:22.907 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:35:22.906+0000 7f8843e00640 1 --2- 172.21.15.39:0/437778918 >> [v2:172.21.15.39:6800/1725006999,v1:172.21.15.39:6801/1725006999] conn(0x7f88280a2b80 0x7f88280a5040 secure :-1 s=READY pgs=153 cs=0 l=1 rev1=1 crypto rx=0x7f8834009c90 tx=0x7f8834005f90 comp rx=0 tx=0).stop 2024-09-12T02:35:22.907 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:35:22.906+0000 7f8843e00640 1 -- 172.21.15.39:0/437778918 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f88441047e0 msgr2=0x7f884419a920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:35:22.907 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:35:22.906+0000 7f8843e00640 1 --2- 172.21.15.39:0/437778918 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f88441047e0 0x7f884419a920 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7f883000e9f0 tx=0x7f883000eeb0 comp rx=0 tx=0).stop 2024-09-12T02:35:22.907 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:35:22.906+0000 7f8843e00640 1 -- 172.21.15.39:0/437778918 shutdown_connections 2024-09-12T02:35:22.908 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:35:22.906+0000 7f8843e00640 1 --2- 172.21.15.39:0/437778918 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f8844108f60 0x7f884419ecb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:35:22.908 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:35:22.906+0000 7f8843e00640 1 --2- 172.21.15.39:0/437778918 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f88441047e0 0x7f884419a920 unknown :-1 s=CLOSED pgs=73 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:35:22.908 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:35:22.906+0000 7f8843e00640 1 --2- 172.21.15.39:0/437778918 >> [v2:172.21.15.39:6800/1725006999,v1:172.21.15.39:6801/1725006999] conn(0x7f88280a2b80 0x7f88280a5040 unknown :-1 s=CLOSED pgs=153 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:35:22.908 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:35:22.906+0000 7f8843e00640 1 --2- 172.21.15.39:0/437778918 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f8844103e30 0x7f884419a3e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:35:22.908 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:35:22.906+0000 7f8843e00640 1 -- 172.21.15.39:0/437778918 >> 172.21.15.39:0/437778918 conn(0x7f88440ff8d0 msgr2=0x7f8844100bf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:35:22.908 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:35:22.906+0000 7f8843e00640 1 -- 172.21.15.39:0/437778918 shutdown_connections 2024-09-12T02:35:22.908 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:35:22.906+0000 7f8843e00640 1 -- 172.21.15.39:0/437778918 wait complete. 2024-09-12T02:35:22.948 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 12 02:35:22 smithi044 ceph-mon[35411]: pgmap v309: 129 pgs: 129 active+clean; 579 KiB data, 346 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-12T02:35:23.013 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 12 02:35:22 smithi172 ceph-mon[35609]: pgmap v309: 129 pgs: 129 active+clean; 579 KiB data, 346 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-12T02:35:23.867 DEBUG:teuthology.orchestra.run.smithi039:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc shell --fsid 4954ed46-70ae-11ef-bcea-c7b262605968 -- ceph fs dump --format=json 2024-09-12T02:35:23.916 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 02:35:23 smithi039 ceph-mon[30515]: from='client.? 172.21.15.39:0/437778918' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-09-12T02:35:23.948 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 12 02:35:23 smithi044 ceph-mon[35411]: from='client.? 172.21.15.39:0/437778918' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-09-12T02:35:24.013 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 12 02:35:23 smithi172 ceph-mon[35609]: from='client.? 172.21.15.39:0/437778918' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-09-12T02:35:24.249 INFO:teuthology.orchestra.run.smithi039.stderr:Inferring config /var/lib/ceph/4954ed46-70ae-11ef-bcea-c7b262605968/mon.a/config 2024-09-12T02:35:24.691 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 02:35:24 smithi039 ceph-mon[30515]: pgmap v310: 129 pgs: 129 active+clean; 579 KiB data, 346 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-12T02:35:24.808 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:35:24.803+0000 7f3e1b200640 1 -- 172.21.15.39:0/2901899859 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f3e141047e0 msgr2=0x7f3e14108830 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:35:24.808 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:35:24.803+0000 7f3e1b200640 1 --2- 172.21.15.39:0/2901899859 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f3e141047e0 0x7f3e14108830 secure :-1 s=READY pgs=159 cs=0 l=1 rev1=1 crypto rx=0x7f3e04009900 tx=0x7f3e0402a3f0 comp rx=0 tx=0).stop 2024-09-12T02:35:24.808 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:35:24.803+0000 7f3e1b200640 1 -- 172.21.15.39:0/2901899859 shutdown_connections 2024-09-12T02:35:24.808 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:35:24.803+0000 7f3e1b200640 1 --2- 172.21.15.39:0/2901899859 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f3e14108f60 0x7f3e14110ae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:35:24.808 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:35:24.803+0000 7f3e1b200640 1 --2- 172.21.15.39:0/2901899859 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f3e141047e0 0x7f3e14108830 unknown :-1 s=CLOSED pgs=159 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:35:24.808 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:35:24.803+0000 7f3e1b200640 1 --2- 172.21.15.39:0/2901899859 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f3e14103e30 0x7f3e14104210 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:35:24.808 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:35:24.803+0000 7f3e1b200640 1 -- 172.21.15.39:0/2901899859 >> 172.21.15.39:0/2901899859 conn(0x7f3e140ff8d0 msgr2=0x7f3e14101cf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:35:24.808 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:35:24.804+0000 7f3e1b200640 1 -- 172.21.15.39:0/2901899859 shutdown_connections 2024-09-12T02:35:24.808 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:35:24.804+0000 7f3e1b200640 1 -- 172.21.15.39:0/2901899859 wait complete. 2024-09-12T02:35:24.809 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:35:24.805+0000 7f3e1b200640 1 Processor -- start 2024-09-12T02:35:24.809 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:35:24.805+0000 7f3e1b200640 1 -- start start 2024-09-12T02:35:24.809 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:35:24.805+0000 7f3e1b200640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f3e14103e30 0x7f3e1419a460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:35:24.809 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:35:24.805+0000 7f3e1b200640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f3e141047e0 0x7f3e1419a9a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:35:24.809 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:35:24.805+0000 7f3e1b200640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f3e14108f60 0x7f3e1419ed30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:35:24.809 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:35:24.805+0000 7f3e1b200640 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 -- 0x7f3e14113fc0 con 0x7f3e14108f60 2024-09-12T02:35:24.809 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:35:24.805+0000 7f3e1b200640 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x7f3e14113e40 con 0x7f3e141047e0 2024-09-12T02:35:24.809 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:35:24.805+0000 7f3e1b200640 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7f3e14114140 con 0x7f3e14103e30 2024-09-12T02:35:24.809 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:35:24.805+0000 7f3e1a800640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f3e14108f60 0x7f3e1419ed30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:35:24.809 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:35:24.805+0000 7f3e19e00640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f3e14103e30 0x7f3e1419a460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:35:24.809 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:35:24.805+0000 7f3e1a800640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f3e14108f60 0x7f3e1419ed30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.39:3300/0 says I am v2:172.21.15.39:60790/0 (socket says 172.21.15.39:60790) 2024-09-12T02:35:24.809 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:35:24.805+0000 7f3e1a800640 1 -- 172.21.15.39:0/3587587321 learned_addr learned my addr 172.21.15.39:0/3587587321 (peer_addr_for_me v2:172.21.15.39:0/0) 2024-09-12T02:35:24.810 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:35:24.806+0000 7f3e19400640 1 --2- 172.21.15.39:0/3587587321 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f3e141047e0 0x7f3e1419a9a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:35:24.810 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:35:24.806+0000 7f3e1a800640 1 -- 172.21.15.39:0/3587587321 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f3e14103e30 msgr2=0x7f3e1419a460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:35:24.810 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:35:24.806+0000 7f3e1a800640 1 --2- 172.21.15.39:0/3587587321 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f3e14103e30 0x7f3e1419a460 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:35:24.810 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:35:24.806+0000 7f3e1a800640 1 -- 172.21.15.39:0/3587587321 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f3e141047e0 msgr2=0x7f3e1419a9a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:35:24.810 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:35:24.806+0000 7f3e1a800640 1 --2- 172.21.15.39:0/3587587321 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f3e141047e0 0x7f3e1419a9a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:35:24.810 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:35:24.806+0000 7f3e1a800640 1 -- 172.21.15.39:0/3587587321 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3e1419f410 con 0x7f3e14108f60 2024-09-12T02:35:24.810 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:35:24.806+0000 7f3e19e00640 1 --2- 172.21.15.39:0/3587587321 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f3e14103e30 0x7f3e1419a460 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-12T02:35:24.810 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:35:24.806+0000 7f3e1a800640 1 --2- 172.21.15.39:0/3587587321 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f3e14108f60 0x7f3e1419ed30 secure :-1 s=READY pgs=160 cs=0 l=1 rev1=1 crypto rx=0x7f3e1000eb10 tx=0x7f3e1000c2d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:35:24.810 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:35:24.806+0000 7f3e0ea00640 1 -- 172.21.15.39:0/3587587321 <== mon.0 v2:172.21.15.39:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3e10004b20 con 0x7f3e14108f60 2024-09-12T02:35:24.810 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:35:24.807+0000 7f3e0ea00640 1 -- 172.21.15.39:0/3587587321 <== mon.0 v2:172.21.15.39:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f3e10004cc0 con 0x7f3e14108f60 2024-09-12T02:35:24.810 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:35:24.807+0000 7f3e1b200640 1 -- 172.21.15.39:0/3587587321 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f3e1419f700 con 0x7f3e14108f60 2024-09-12T02:35:24.810 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:35:24.807+0000 7f3e0ea00640 1 -- 172.21.15.39:0/3587587321 <== mon.0 v2:172.21.15.39:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3e10010760 con 0x7f3e14108f60 2024-09-12T02:35:24.810 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:35:24.807+0000 7f3e1b200640 1 -- 172.21.15.39:0/3587587321 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f3e141a6fe0 con 0x7f3e14108f60 2024-09-12T02:35:24.811 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:35:24.808+0000 7f3e1b200640 1 -- 172.21.15.39:0/3587587321 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f3e14104210 con 0x7f3e14108f60 2024-09-12T02:35:24.811 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:35:24.810+0000 7f3e0ea00640 1 -- 172.21.15.39:0/3587587321 <== mon.0 v2:172.21.15.39:3300/0 4 ==== mgrmap(e 16) ==== 137833+0+0 (secure 0 0 0) 0x7f3e10005020 con 0x7f3e14108f60 2024-09-12T02:35:24.812 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:35:24.811+0000 7f3e0ea00640 1 --2- 172.21.15.39:0/3587587321 >> [v2:172.21.15.39:6800/1725006999,v1:172.21.15.39:6801/1725006999] conn(0x7f3dfc0a2c00 0x7f3dfc0a50c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:35:24.812 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:35:24.811+0000 7f3e0ea00640 1 -- 172.21.15.39:0/3587587321 <== mon.0 v2:172.21.15.39:3300/0 5 ==== osd_map(91..91 src has 1..91) ==== 8802+0+0 (secure 0 0 0) 0x7f3e100cf8b0 con 0x7f3e14108f60 2024-09-12T02:35:24.812 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:35:24.811+0000 7f3e19e00640 1 --2- 172.21.15.39:0/3587587321 >> [v2:172.21.15.39:6800/1725006999,v1:172.21.15.39:6801/1725006999] conn(0x7f3dfc0a2c00 0x7f3dfc0a50c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:35:24.812 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:35:24.812+0000 7f3e19e00640 1 --2- 172.21.15.39:0/3587587321 >> [v2:172.21.15.39:6800/1725006999,v1:172.21.15.39:6801/1725006999] conn(0x7f3dfc0a2c00 0x7f3dfc0a50c0 secure :-1 s=READY pgs=154 cs=0 l=1 rev1=1 crypto rx=0x7f3e08009fc0 tx=0x7f3e08005f90 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:35:24.816 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:35:24.815+0000 7f3e0ea00640 1 -- 172.21.15.39:0/3587587321 <== mon.0 v2:172.21.15.39:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7f3e1009c570 con 0x7f3e14108f60 2024-09-12T02:35:24.915 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 12 02:35:24 smithi172 ceph-mon[35609]: pgmap v310: 129 pgs: 129 active+clean; 579 KiB data, 346 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-12T02:35:24.948 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 12 02:35:24 smithi044 ceph-mon[35411]: pgmap v310: 129 pgs: 129 active+clean; 579 KiB data, 346 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-12T02:35:25.039 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:35:25.038+0000 7f3e1b200640 1 -- 172.21.15.39:0/3587587321 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f3e1402d7c0 con 0x7f3e14108f60 2024-09-12T02:35:25.039 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:35:25.039+0000 7f3e0ea00640 1 -- 172.21.15.39:0/3587587321 <== mon.0 v2:172.21.15.39:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 17 v17) ==== 94+0+11839 (secure 0 0 0) 0x7f3e1009be70 con 0x7f3e14108f60 2024-09-12T02:35:25.040 INFO:teuthology.orchestra.run.smithi039.stdout: 2024-09-12T02:35:25.040 INFO:teuthology.orchestra.run.smithi039.stdout:{"epoch":17,"btime":"2024-09-12T02:35:16:583637+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14451,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.39:6835/2325642381","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6834","nonce":2325642381},{"type":"v1","addr":"172.21.15.39:6835","nonce":2325642381}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14511,"name":"g","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.39:6839/936905514","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6838","nonce":936905514},{"type":"v1","addr":"172.21.15.39:6839","nonce":936905514}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":11},{"gid":14523,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.39:6841/2829712180","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6840","nonce":2829712180},{"type":"v1","addr":"172.21.15.39:6841","nonce":2829712180}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":12},{"gid":24422,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.44:6833/2359724364","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6832","nonce":2359724364},{"type":"v1","addr":"172.21.15.44:6833","nonce":2359724364}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":24430,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.172:6833/3232434105","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6832","nonce":3232434105},{"type":"v1","addr":"172.21.15.172:6833","nonce":3232434105}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":24446,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.39:6837/2743237008","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6836","nonce":2743237008},{"type":"v1","addr":"172.21.15.39:6837","nonce":2743237008}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5},{"gid":24458,"name":"e","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.44:6835/4063842354","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6834","nonce":4063842354},{"type":"v1","addr":"172.21.15.44:6835","nonce":4063842354}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":6},{"gid":24472,"name":"f","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.172:6835/3274676014","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6834","nonce":3274676014},{"type":"v1","addr":"172.21.15.172:6835","nonce":3274676014}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":7},{"gid":24482,"name":"h","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.44:6837/1501493978","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6836","nonce":1501493978},{"type":"v1","addr":"172.21.15.44:6837","nonce":1501493978}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":9},{"gid":24484,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.172:6837/493506747","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6836","nonce":493506747},{"type":"v1","addr":"172.21.15.172:6837","nonce":493506747}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":8},{"gid":24499,"name":"i","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.172:6839/3742537097","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6838","nonce":3742537097},{"type":"v1","addr":"172.21.15.172:6839","nonce":3742537097}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":10}],"filesystems":[{"mdsmap":{"epoch":17,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-12T02:35:03.522182+0000","modified":"2024-09-12T02:35:16.579584+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":24515},"failed":[],"damaged":[],"stopped":[],"info":{"gid_24515":{"gid":24515,"name":"b","rank":0,"incarnation":14,"state":"up:active","state_seq":5,"addr":"172.21.15.44:6839/2556532723","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6838","nonce":2556532723},{"type":"v1","addr":"172.21.15.44:6839","nonce":2556532723}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":1,"qdb_leader":24515,"qdb_cluster":[24515]},"id":1}]} 2024-09-12T02:35:25.041 INFO:teuthology.orchestra.run.smithi039.stderr:dumped fsmap epoch 17 2024-09-12T02:35:25.042 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:35:25.041+0000 7f3e1b200640 1 -- 172.21.15.39:0/3587587321 >> [v2:172.21.15.39:6800/1725006999,v1:172.21.15.39:6801/1725006999] conn(0x7f3dfc0a2c00 msgr2=0x7f3dfc0a50c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:35:25.042 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:35:25.041+0000 7f3e1b200640 1 --2- 172.21.15.39:0/3587587321 >> [v2:172.21.15.39:6800/1725006999,v1:172.21.15.39:6801/1725006999] conn(0x7f3dfc0a2c00 0x7f3dfc0a50c0 secure :-1 s=READY pgs=154 cs=0 l=1 rev1=1 crypto rx=0x7f3e08009fc0 tx=0x7f3e08005f90 comp rx=0 tx=0).stop 2024-09-12T02:35:25.042 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:35:25.041+0000 7f3e1b200640 1 -- 172.21.15.39:0/3587587321 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f3e14108f60 msgr2=0x7f3e1419ed30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:35:25.042 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:35:25.041+0000 7f3e1b200640 1 --2- 172.21.15.39:0/3587587321 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f3e14108f60 0x7f3e1419ed30 secure :-1 s=READY pgs=160 cs=0 l=1 rev1=1 crypto rx=0x7f3e1000eb10 tx=0x7f3e1000c2d0 comp rx=0 tx=0).stop 2024-09-12T02:35:25.043 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:35:25.041+0000 7f3e1b200640 1 -- 172.21.15.39:0/3587587321 shutdown_connections 2024-09-12T02:35:25.043 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:35:25.041+0000 7f3e1b200640 1 --2- 172.21.15.39:0/3587587321 >> [v2:172.21.15.39:6800/1725006999,v1:172.21.15.39:6801/1725006999] conn(0x7f3dfc0a2c00 0x7f3dfc0a50c0 unknown :-1 s=CLOSED pgs=154 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:35:25.043 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:35:25.041+0000 7f3e1b200640 1 --2- 172.21.15.39:0/3587587321 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f3e14108f60 0x7f3e1419ed30 unknown :-1 s=CLOSED pgs=160 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:35:25.043 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:35:25.041+0000 7f3e1b200640 1 --2- 172.21.15.39:0/3587587321 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f3e141047e0 0x7f3e1419a9a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:35:25.043 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:35:25.041+0000 7f3e1b200640 1 --2- 172.21.15.39:0/3587587321 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f3e14103e30 0x7f3e1419a460 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:35:25.043 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:35:25.041+0000 7f3e1b200640 1 -- 172.21.15.39:0/3587587321 >> 172.21.15.39:0/3587587321 conn(0x7f3e140ff8d0 msgr2=0x7f3e14100c50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:35:25.043 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:35:25.042+0000 7f3e1b200640 1 -- 172.21.15.39:0/3587587321 shutdown_connections 2024-09-12T02:35:25.043 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:35:25.042+0000 7f3e1b200640 1 -- 172.21.15.39:0/3587587321 wait complete. 2024-09-12T02:35:25.737 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 02:35:25 smithi039 ceph-mon[30515]: from='client.? 172.21.15.39:0/3587587321' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-12T02:35:25.776 DEBUG:teuthology.orchestra.run.smithi039:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc shell --fsid 4954ed46-70ae-11ef-bcea-c7b262605968 -- ceph osd dump --format=json 2024-09-12T02:35:25.948 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 12 02:35:25 smithi044 ceph-mon[35411]: from='client.? 172.21.15.39:0/3587587321' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-12T02:35:26.013 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 12 02:35:25 smithi172 ceph-mon[35609]: from='client.? 172.21.15.39:0/3587587321' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-12T02:35:26.154 INFO:teuthology.orchestra.run.smithi039.stderr:Inferring config /var/lib/ceph/4954ed46-70ae-11ef-bcea-c7b262605968/mon.a/config 2024-09-12T02:35:26.723 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:35:26.703+0000 7fd1b2600640 1 -- 172.21.15.39:0/4274752050 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fd1ac1079c0 msgr2=0x7fd1ac107da0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:35:26.723 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:35:26.703+0000 7fd1b2600640 1 --2- 172.21.15.39:0/4274752050 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fd1ac1079c0 0x7fd1ac107da0 secure :-1 s=READY pgs=161 cs=0 l=1 rev1=1 crypto rx=0x7fd19c009930 tx=0x7fd19c02a420 comp rx=0 tx=0).stop 2024-09-12T02:35:26.723 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:35:26.703+0000 7fd1b2600640 1 -- 172.21.15.39:0/4274752050 shutdown_connections 2024-09-12T02:35:26.723 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:35:26.703+0000 7fd1b2600640 1 --2- 172.21.15.39:0/4274752050 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fd1ac102360 0x7fd1ac10e890 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:35:26.723 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:35:26.703+0000 7fd1b2600640 1 --2- 172.21.15.39:0/4274752050 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fd1ac1019c0 0x7fd1ac101e20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:35:26.723 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:35:26.703+0000 7fd1b2600640 1 --2- 172.21.15.39:0/4274752050 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fd1ac1079c0 0x7fd1ac107da0 unknown :-1 s=CLOSED pgs=161 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:35:26.723 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:35:26.703+0000 7fd1b2600640 1 -- 172.21.15.39:0/4274752050 >> 172.21.15.39:0/4274752050 conn(0x7fd1ac0fd740 msgr2=0x7fd1ac0ffb60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:35:26.723 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:35:26.703+0000 7fd1b2600640 1 -- 172.21.15.39:0/4274752050 shutdown_connections 2024-09-12T02:35:26.724 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:35:26.703+0000 7fd1b2600640 1 -- 172.21.15.39:0/4274752050 wait complete. 2024-09-12T02:35:26.724 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:35:26.704+0000 7fd1b2600640 1 Processor -- start 2024-09-12T02:35:26.724 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:35:26.704+0000 7fd1b2600640 1 -- start start 2024-09-12T02:35:26.724 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:35:26.704+0000 7fd1b2600640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fd1ac1019c0 0x7fd1ac19a520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:35:26.724 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:35:26.705+0000 7fd1b2600640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fd1ac102360 0x7fd1ac19aa60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:35:26.724 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:35:26.705+0000 7fd1b2600640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fd1ac1079c0 0x7fd1ac19edf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:35:26.724 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:35:26.705+0000 7fd1b2600640 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 -- 0x7fd1ac111dc0 con 0x7fd1ac102360 2024-09-12T02:35:26.724 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:35:26.705+0000 7fd1b2600640 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x7fd1ac111c40 con 0x7fd1ac1019c0 2024-09-12T02:35:26.724 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:35:26.705+0000 7fd1b2600640 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7fd1ac111f40 con 0x7fd1ac1079c0 2024-09-12T02:35:26.724 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:35:26.705+0000 7fd1a3e00640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fd1ac102360 0x7fd1ac19aa60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:35:26.724 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:35:26.705+0000 7fd1b1200640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fd1ac1019c0 0x7fd1ac19a520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:35:26.724 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:35:26.705+0000 7fd1b1200640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fd1ac1019c0 0x7fd1ac19a520 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.39:40824/0 (socket says 172.21.15.39:40824) 2024-09-12T02:35:26.725 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:35:26.705+0000 7fd1a3e00640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fd1ac102360 0x7fd1ac19aa60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.39:3300/0 says I am v2:172.21.15.39:60804/0 (socket says 172.21.15.39:60804) 2024-09-12T02:35:26.725 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:35:26.705+0000 7fd1b1200640 1 -- 172.21.15.39:0/1524818534 learned_addr learned my addr 172.21.15.39:0/1524818534 (peer_addr_for_me v2:172.21.15.39:0/0) 2024-09-12T02:35:26.725 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:35:26.705+0000 7fd1b1c00640 1 --2- 172.21.15.39:0/1524818534 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fd1ac1079c0 0x7fd1ac19edf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:35:26.725 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:35:26.705+0000 7fd1a3e00640 1 -- 172.21.15.39:0/1524818534 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fd1ac1079c0 msgr2=0x7fd1ac19edf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:35:26.725 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:35:26.705+0000 7fd1a3e00640 1 --2- 172.21.15.39:0/1524818534 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fd1ac1079c0 0x7fd1ac19edf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:35:26.725 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:35:26.705+0000 7fd1a3e00640 1 -- 172.21.15.39:0/1524818534 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fd1ac1019c0 msgr2=0x7fd1ac19a520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:35:26.725 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:35:26.705+0000 7fd1a3e00640 1 --2- 172.21.15.39:0/1524818534 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fd1ac1019c0 0x7fd1ac19a520 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:35:26.725 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:35:26.705+0000 7fd1a3e00640 1 -- 172.21.15.39:0/1524818534 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd1ac19f4d0 con 0x7fd1ac102360 2024-09-12T02:35:26.725 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:35:26.706+0000 7fd1a3e00640 1 --2- 172.21.15.39:0/1524818534 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fd1ac102360 0x7fd1ac19aa60 secure :-1 s=READY pgs=162 cs=0 l=1 rev1=1 crypto rx=0x7fd19400e9f0 tx=0x7fd19400eeb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:35:26.725 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:35:26.706+0000 7fd1aa000640 1 -- 172.21.15.39:0/1524818534 <== mon.0 v2:172.21.15.39:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd19400ccc0 con 0x7fd1ac102360 2024-09-12T02:35:26.725 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:35:26.706+0000 7fd1aa000640 1 -- 172.21.15.39:0/1524818534 <== mon.0 v2:172.21.15.39:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fd194005020 con 0x7fd1ac102360 2024-09-12T02:35:26.725 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:35:26.706+0000 7fd1b2600640 1 -- 172.21.15.39:0/1524818534 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd1ac19f7c0 con 0x7fd1ac102360 2024-09-12T02:35:26.725 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:35:26.706+0000 7fd1aa000640 1 -- 172.21.15.39:0/1524818534 <== mon.0 v2:172.21.15.39:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd1940049e0 con 0x7fd1ac102360 2024-09-12T02:35:26.725 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:35:26.706+0000 7fd1b2600640 1 -- 172.21.15.39:0/1524818534 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd1ac1a70a0 con 0x7fd1ac102360 2024-09-12T02:35:26.726 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:35:26.707+0000 7fd1b2600640 1 -- 172.21.15.39:0/1524818534 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fd1ac101e20 con 0x7fd1ac102360 2024-09-12T02:35:26.726 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:35:26.709+0000 7fd1aa000640 1 -- 172.21.15.39:0/1524818534 <== mon.0 v2:172.21.15.39:3300/0 4 ==== mgrmap(e 16) ==== 137833+0+0 (secure 0 0 0) 0x7fd194005560 con 0x7fd1ac102360 2024-09-12T02:35:26.726 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:35:26.710+0000 7fd1aa000640 1 --2- 172.21.15.39:0/1524818534 >> [v2:172.21.15.39:6800/1725006999,v1:172.21.15.39:6801/1725006999] conn(0x7fd1900a2b80 0x7fd1900a5040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:35:26.726 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:35:26.710+0000 7fd1aa000640 1 -- 172.21.15.39:0/1524818534 <== mon.0 v2:172.21.15.39:3300/0 5 ==== osd_map(91..91 src has 1..91) ==== 8802+0+0 (secure 0 0 0) 0x7fd1940cf2a0 con 0x7fd1ac102360 2024-09-12T02:35:26.726 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:35:26.711+0000 7fd1b1200640 1 --2- 172.21.15.39:0/1524818534 >> [v2:172.21.15.39:6800/1725006999,v1:172.21.15.39:6801/1725006999] conn(0x7fd1900a2b80 0x7fd1900a5040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:35:26.726 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:35:26.711+0000 7fd1b1200640 1 --2- 172.21.15.39:0/1524818534 >> [v2:172.21.15.39:6800/1725006999,v1:172.21.15.39:6801/1725006999] conn(0x7fd1900a2b80 0x7fd1900a5040 secure :-1 s=READY pgs=155 cs=0 l=1 rev1=1 crypto rx=0x7fd19c000c00 tx=0x7fd19c009560 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:35:26.726 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:35:26.715+0000 7fd1aa000640 1 -- 172.21.15.39:0/1524818534 <== mon.0 v2:172.21.15.39:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7fd1940051d0 con 0x7fd1ac102360 2024-09-12T02:35:26.849 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 02:35:26 smithi039 ceph-mon[30515]: pgmap v311: 129 pgs: 129 active+clean; 579 KiB data, 346 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-12T02:35:26.902 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:35:26.901+0000 7fd1b2600640 1 -- 172.21.15.39:0/1524818534 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7fd1ac1a73d0 con 0x7fd1ac102360 2024-09-12T02:35:26.904 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:35:26.903+0000 7fd1aa000640 1 -- 172.21.15.39:0/1524818534 <== mon.0 v2:172.21.15.39:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v91) ==== 74+0+24178 (secure 0 0 0) 0x7fd19409bfc0 con 0x7fd1ac102360 2024-09-12T02:35:26.904 INFO:teuthology.orchestra.run.smithi039.stdout: 2024-09-12T02:35:26.905 INFO:teuthology.orchestra.run.smithi039.stdout:{"epoch":91,"fsid":"4954ed46-70ae-11ef-bcea-c7b262605968","created":"2024-09-12T02:26:43.086467+0000","modified":"2024-09-12T02:35:16.579407+0000","last_up_change":"2024-09-12T02:34:08.626341+0000","last_in_change":"2024-09-12T02:33:45.553591+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":27,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":12,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-12T02:30:09.347905+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":12,"score_stable":12,"optimal_score":0.25,"raw_score_acting":3,"raw_score_stable":3,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-09-12T02:34:58.580872+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"84","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":2.25,"score_stable":2.25,"optimal_score":1,"raw_score_acting":2.25,"raw_score_stable":2.25,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-09-12T02:35:01.469805+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"84","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2024-09-12T02:35:11.088109+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"91","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"c967b48e-8a39-4797-871b-8b1b83d9472f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":87,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6802","nonce":2437586899},{"type":"v1","addr":"172.21.15.39:6803","nonce":2437586899}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6804","nonce":2437586899},{"type":"v1","addr":"172.21.15.39:6805","nonce":2437586899}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6808","nonce":2437586899},{"type":"v1","addr":"172.21.15.39:6809","nonce":2437586899}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6806","nonce":2437586899},{"type":"v1","addr":"172.21.15.39:6807","nonce":2437586899}]},"public_addr":"172.21.15.39:6803/2437586899","cluster_addr":"172.21.15.39:6805/2437586899","heartbeat_back_addr":"172.21.15.39:6809/2437586899","heartbeat_front_addr":"172.21.15.39:6807/2437586899","state":["exists","up"]},{"osd":1,"uuid":"30e1e4f4-1d50-4003-8978-cb183dca7fbb","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":87,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6800","nonce":2349287000},{"type":"v1","addr":"172.21.15.44:6801","nonce":2349287000}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6802","nonce":2349287000},{"type":"v1","addr":"172.21.15.44:6803","nonce":2349287000}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6806","nonce":2349287000},{"type":"v1","addr":"172.21.15.44:6807","nonce":2349287000}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6804","nonce":2349287000},{"type":"v1","addr":"172.21.15.44:6805","nonce":2349287000}]},"public_addr":"172.21.15.44:6801/2349287000","cluster_addr":"172.21.15.44:6803/2349287000","heartbeat_back_addr":"172.21.15.44:6807/2349287000","heartbeat_front_addr":"172.21.15.44:6805/2349287000","state":["exists","up"]},{"osd":2,"uuid":"a758803f-8668-4fc8-9417-b8d080cd9a7c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":18,"up_thru":87,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6800","nonce":1176898232},{"type":"v1","addr":"172.21.15.172:6801","nonce":1176898232}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6802","nonce":1176898232},{"type":"v1","addr":"172.21.15.172:6803","nonce":1176898232}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6806","nonce":1176898232},{"type":"v1","addr":"172.21.15.172:6807","nonce":1176898232}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6804","nonce":1176898232},{"type":"v1","addr":"172.21.15.172:6805","nonce":1176898232}]},"public_addr":"172.21.15.172:6801/1176898232","cluster_addr":"172.21.15.172:6803/1176898232","heartbeat_back_addr":"172.21.15.172:6807/1176898232","heartbeat_front_addr":"172.21.15.172:6805/1176898232","state":["exists","up"]},{"osd":3,"uuid":"8b256567-7efe-429c-bc4c-80e93228f139","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":26,"up_thru":87,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6810","nonce":2013565859},{"type":"v1","addr":"172.21.15.39:6811","nonce":2013565859}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6812","nonce":2013565859},{"type":"v1","addr":"172.21.15.39:6813","nonce":2013565859}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6816","nonce":2013565859},{"type":"v1","addr":"172.21.15.39:6817","nonce":2013565859}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6814","nonce":2013565859},{"type":"v1","addr":"172.21.15.39:6815","nonce":2013565859}]},"public_addr":"172.21.15.39:6811/2013565859","cluster_addr":"172.21.15.39:6813/2013565859","heartbeat_back_addr":"172.21.15.39:6817/2013565859","heartbeat_front_addr":"172.21.15.39:6815/2013565859","state":["exists","up"]},{"osd":4,"uuid":"e86b6756-e2b3-49fe-9b87-1a2b015bb17a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":33,"up_thru":87,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6808","nonce":3663639110},{"type":"v1","addr":"172.21.15.44:6809","nonce":3663639110}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6810","nonce":3663639110},{"type":"v1","addr":"172.21.15.44:6811","nonce":3663639110}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6814","nonce":3663639110},{"type":"v1","addr":"172.21.15.44:6815","nonce":3663639110}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6812","nonce":3663639110},{"type":"v1","addr":"172.21.15.44:6813","nonce":3663639110}]},"public_addr":"172.21.15.44:6809/3663639110","cluster_addr":"172.21.15.44:6811/3663639110","heartbeat_back_addr":"172.21.15.44:6815/3663639110","heartbeat_front_addr":"172.21.15.44:6813/3663639110","state":["exists","up"]},{"osd":5,"uuid":"9c907c92-b323-48e7-99ad-ec9756d26312","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":38,"up_thru":87,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6808","nonce":998885347},{"type":"v1","addr":"172.21.15.172:6809","nonce":998885347}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6810","nonce":998885347},{"type":"v1","addr":"172.21.15.172:6811","nonce":998885347}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6814","nonce":998885347},{"type":"v1","addr":"172.21.15.172:6815","nonce":998885347}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6812","nonce":998885347},{"type":"v1","addr":"172.21.15.172:6813","nonce":998885347}]},"public_addr":"172.21.15.172:6809/998885347","cluster_addr":"172.21.15.172:6811/998885347","heartbeat_back_addr":"172.21.15.172:6815/998885347","heartbeat_front_addr":"172.21.15.172:6813/998885347","state":["exists","up"]},{"osd":6,"uuid":"1fcb9bb2-6f4b-4d97-a401-aeb6a9706613","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":45,"up_thru":87,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6818","nonce":2569059542},{"type":"v1","addr":"172.21.15.39:6819","nonce":2569059542}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6820","nonce":2569059542},{"type":"v1","addr":"172.21.15.39:6821","nonce":2569059542}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6824","nonce":2569059542},{"type":"v1","addr":"172.21.15.39:6825","nonce":2569059542}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6822","nonce":2569059542},{"type":"v1","addr":"172.21.15.39:6823","nonce":2569059542}]},"public_addr":"172.21.15.39:6819/2569059542","cluster_addr":"172.21.15.39:6821/2569059542","heartbeat_back_addr":"172.21.15.39:6825/2569059542","heartbeat_front_addr":"172.21.15.39:6823/2569059542","state":["exists","up"]},{"osd":7,"uuid":"59e0caf9-8ce5-4161-8875-84862eba743e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":50,"up_thru":87,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6816","nonce":709635079},{"type":"v1","addr":"172.21.15.44:6817","nonce":709635079}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6818","nonce":709635079},{"type":"v1","addr":"172.21.15.44:6819","nonce":709635079}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6822","nonce":709635079},{"type":"v1","addr":"172.21.15.44:6823","nonce":709635079}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6820","nonce":709635079},{"type":"v1","addr":"172.21.15.44:6821","nonce":709635079}]},"public_addr":"172.21.15.44:6817/709635079","cluster_addr":"172.21.15.44:6819/709635079","heartbeat_back_addr":"172.21.15.44:6823/709635079","heartbeat_front_addr":"172.21.15.44:6821/709635079","state":["exists","up"]},{"osd":8,"uuid":"2f6fb5c7-86cc-43eb-bdfb-45a69316937e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":57,"up_thru":87,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6816","nonce":1162792895},{"type":"v1","addr":"172.21.15.172:6817","nonce":1162792895}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6818","nonce":1162792895},{"type":"v1","addr":"172.21.15.172:6819","nonce":1162792895}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6822","nonce":1162792895},{"type":"v1","addr":"172.21.15.172:6823","nonce":1162792895}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6820","nonce":1162792895},{"type":"v1","addr":"172.21.15.172:6821","nonce":1162792895}]},"public_addr":"172.21.15.172:6817/1162792895","cluster_addr":"172.21.15.172:6819/1162792895","heartbeat_back_addr":"172.21.15.172:6823/1162792895","heartbeat_front_addr":"172.21.15.172:6821/1162792895","state":["exists","up"]},{"osd":9,"uuid":"87e5dd9e-8191-4db6-83fa-cfff7c31e17e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":65,"up_thru":87,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6826","nonce":945860346},{"type":"v1","addr":"172.21.15.39:6827","nonce":945860346}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6828","nonce":945860346},{"type":"v1","addr":"172.21.15.39:6829","nonce":945860346}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6832","nonce":945860346},{"type":"v1","addr":"172.21.15.39:6833","nonce":945860346}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6830","nonce":945860346},{"type":"v1","addr":"172.21.15.39:6831","nonce":945860346}]},"public_addr":"172.21.15.39:6827/945860346","cluster_addr":"172.21.15.39:6829/945860346","heartbeat_back_addr":"172.21.15.39:6833/945860346","heartbeat_front_addr":"172.21.15.39:6831/945860346","state":["exists","up"]},{"osd":10,"uuid":"b55d8a00-850f-4910-a5bf-97d9ed545be7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":70,"up_thru":81,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6824","nonce":3899352344},{"type":"v1","addr":"172.21.15.44:6825","nonce":3899352344}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6826","nonce":3899352344},{"type":"v1","addr":"172.21.15.44:6827","nonce":3899352344}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6830","nonce":3899352344},{"type":"v1","addr":"172.21.15.44:6831","nonce":3899352344}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6828","nonce":3899352344},{"type":"v1","addr":"172.21.15.44:6829","nonce":3899352344}]},"public_addr":"172.21.15.44:6825/3899352344","cluster_addr":"172.21.15.44:6827/3899352344","heartbeat_back_addr":"172.21.15.44:6831/3899352344","heartbeat_front_addr":"172.21.15.44:6829/3899352344","state":["exists","up"]},{"osd":11,"uuid":"20cf5df1-5a80-4272-acc0-919c6a1da55a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":77,"up_thru":87,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6824","nonce":3627635035},{"type":"v1","addr":"172.21.15.172:6825","nonce":3627635035}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6826","nonce":3627635035},{"type":"v1","addr":"172.21.15.172:6827","nonce":3627635035}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6830","nonce":3627635035},{"type":"v1","addr":"172.21.15.172:6831","nonce":3627635035}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6828","nonce":3627635035},{"type":"v1","addr":"172.21.15.172:6829","nonce":3627635035}]},"public_addr":"172.21.15.172:6825/3627635035","cluster_addr":"172.21.15.172:6827/3627635035","heartbeat_back_addr":"172.21.15.172:6831/3627635035","heartbeat_front_addr":"172.21.15.172:6829/3627635035","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T02:29:15.367468+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T02:29:41.518207+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T02:30:06.004371+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T02:30:34.793371+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T02:31:00.878517+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T02:31:26.675956+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T02:31:55.950748+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T02:32:22.824017+0000","dead_epoch":0},{"osd":8,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T02:32:46.775880+0000","dead_epoch":0},{"osd":9,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T02:33:16.420347+0000","dead_epoch":0},{"osd":10,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T02:33:42.185837+0000","dead_epoch":0},{"osd":11,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T02:34:07.312555+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.39:6800/3152613618":"2024-09-13T02:27:44.717224+0000","172.21.15.39:0/2301206766":"2024-09-13T02:27:44.717224+0000","172.21.15.39:0/1941318538":"2024-09-13T02:27:44.717224+0000","172.21.15.39:0/1527429435":"2024-09-13T02:27:44.717224+0000","172.21.15.39:0/2913347539":"2024-09-13T02:27:16.531986+0000","172.21.15.39:0/2827440002":"2024-09-13T02:27:16.531986+0000","172.21.15.39:0/4075322467":"2024-09-13T02:27:16.531986+0000","172.21.15.39:6801/1074685700":"2024-09-13T02:27:16.531986+0000","172.21.15.39:6801/3152613618":"2024-09-13T02:27:44.717224+0000","172.21.15.39:6800/1074685700":"2024-09-13T02:27:16.531986+0000"},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-12T02:35:26.906 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:35:26.905+0000 7fd1b2600640 1 -- 172.21.15.39:0/1524818534 >> [v2:172.21.15.39:6800/1725006999,v1:172.21.15.39:6801/1725006999] conn(0x7fd1900a2b80 msgr2=0x7fd1900a5040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:35:26.907 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:35:26.905+0000 7fd1b2600640 1 --2- 172.21.15.39:0/1524818534 >> [v2:172.21.15.39:6800/1725006999,v1:172.21.15.39:6801/1725006999] conn(0x7fd1900a2b80 0x7fd1900a5040 secure :-1 s=READY pgs=155 cs=0 l=1 rev1=1 crypto rx=0x7fd19c000c00 tx=0x7fd19c009560 comp rx=0 tx=0).stop 2024-09-12T02:35:26.907 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:35:26.905+0000 7fd1b2600640 1 -- 172.21.15.39:0/1524818534 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fd1ac102360 msgr2=0x7fd1ac19aa60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:35:26.907 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:35:26.905+0000 7fd1b2600640 1 --2- 172.21.15.39:0/1524818534 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fd1ac102360 0x7fd1ac19aa60 secure :-1 s=READY pgs=162 cs=0 l=1 rev1=1 crypto rx=0x7fd19400e9f0 tx=0x7fd19400eeb0 comp rx=0 tx=0).stop 2024-09-12T02:35:26.907 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:35:26.906+0000 7fd1b2600640 1 -- 172.21.15.39:0/1524818534 shutdown_connections 2024-09-12T02:35:26.907 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:35:26.906+0000 7fd1b2600640 1 --2- 172.21.15.39:0/1524818534 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fd1ac1079c0 0x7fd1ac19edf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:35:26.907 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:35:26.906+0000 7fd1b2600640 1 --2- 172.21.15.39:0/1524818534 >> [v2:172.21.15.39:6800/1725006999,v1:172.21.15.39:6801/1725006999] conn(0x7fd1900a2b80 0x7fd1900a5040 unknown :-1 s=CLOSED pgs=155 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:35:26.907 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:35:26.906+0000 7fd1b2600640 1 --2- 172.21.15.39:0/1524818534 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fd1ac102360 0x7fd1ac19aa60 unknown :-1 s=CLOSED pgs=162 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:35:26.907 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:35:26.906+0000 7fd1b2600640 1 --2- 172.21.15.39:0/1524818534 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fd1ac1019c0 0x7fd1ac19a520 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:35:26.907 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:35:26.906+0000 7fd1b2600640 1 -- 172.21.15.39:0/1524818534 >> 172.21.15.39:0/1524818534 conn(0x7fd1ac0fd740 msgr2=0x7fd1ac0fde50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:35:26.907 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:35:26.906+0000 7fd1b2600640 1 -- 172.21.15.39:0/1524818534 shutdown_connections 2024-09-12T02:35:26.907 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:35:26.906+0000 7fd1b2600640 1 -- 172.21.15.39:0/1524818534 wait complete. 2024-09-12T02:35:26.948 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 12 02:35:26 smithi044 ceph-mon[35411]: pgmap v311: 129 pgs: 129 active+clean; 579 KiB data, 346 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-12T02:35:27.013 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 12 02:35:26 smithi172 ceph-mon[35609]: pgmap v311: 129 pgs: 129 active+clean; 579 KiB data, 346 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-12T02:35:27.907 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 02:35:27 smithi039 ceph-mon[30515]: from='client.? 172.21.15.39:0/1524818534' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-09-12T02:35:27.910 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 17, 'flags': 18, 'flags_state': {'joinable': True, 'allow_snaps': True, 'allow_multimds_snaps': True, 'allow_standby_replay': False, 'refuse_client_session': False, 'refuse_standby_for_another_fs': False, 'balance_automate': False}, 'ever_allowed_features': 0, 'explicitly_allowed_features': 0, 'created': '2024-09-12T02:35:03.522182+0000', 'modified': '2024-09-12T02:35:16.579584+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 60, 'session_autoclose': 300, 'required_client_features': {}, 'max_file_size': 1099511627776, 'max_xattr_size': 65536, 'last_failure': 0, 'last_failure_osd_epoch': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}, 'max_mds': 1, 'in': [0], 'up': {'mds_0': 24515}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_24515': {'gid': 24515, 'name': 'b', 'rank': 0, 'incarnation': 14, 'state': 'up:active', 'state_seq': 5, 'addr': '172.21.15.44:6839/2556532723', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.44:6838', 'nonce': 2556532723}, {'type': 'v1', 'addr': '172.21.15.44:6839', 'nonce': 2556532723}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540701547738038271, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}}, 'data_pools': [3, 4], 'metadata_pool': 2, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'bal_rank_mask': '-1', 'standby_count_wanted': 1, 'qdb_leader': 24515, 'qdb_cluster': [24515]} 2024-09-12T02:35:27.911 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: 1/1 2024-09-12T02:35:27.911 DEBUG:teuthology.orchestra.run.smithi039:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc shell --fsid 4954ed46-70ae-11ef-bcea-c7b262605968 -- ceph tell mds.b status 2024-09-12T02:35:27.948 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 12 02:35:27 smithi044 ceph-mon[35411]: from='client.? 172.21.15.39:0/1524818534' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-09-12T02:35:28.013 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 12 02:35:27 smithi172 ceph-mon[35609]: from='client.? 172.21.15.39:0/1524818534' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-09-12T02:35:28.289 INFO:teuthology.orchestra.run.smithi039.stderr:Inferring config /var/lib/ceph/4954ed46-70ae-11ef-bcea-c7b262605968/mon.a/config 2024-09-12T02:35:28.706 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 02:35:28 smithi039 ceph-mon[30515]: pgmap v312: 129 pgs: 129 active+clean; 579 KiB data, 346 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-12T02:35:28.820 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:35:28.818+0000 7f101b800640 1 -- 172.21.15.39:0/18591893 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f1014102790 msgr2=0x7f10141067e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:35:28.820 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:35:28.818+0000 7f101b800640 1 --2- 172.21.15.39:0/18591893 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f1014102790 0x7f10141067e0 secure :-1 s=READY pgs=163 cs=0 l=1 rev1=1 crypto rx=0x7f1000009900 tx=0x7f100002a3f0 comp rx=0 tx=0).stop 2024-09-12T02:35:28.820 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:35:28.818+0000 7f101b800640 1 -- 172.21.15.39:0/18591893 shutdown_connections 2024-09-12T02:35:28.820 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:35:28.818+0000 7f101b800640 1 --2- 172.21.15.39:0/18591893 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f1014106f10 0x7f101410ea90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:35:28.820 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:35:28.818+0000 7f101b800640 1 --2- 172.21.15.39:0/18591893 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f1014102790 0x7f10141067e0 unknown :-1 s=CLOSED pgs=163 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:35:28.820 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:35:28.818+0000 7f101b800640 1 --2- 172.21.15.39:0/18591893 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f1014101de0 0x7f10141021c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:35:28.820 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:35:28.818+0000 7f101b800640 1 -- 172.21.15.39:0/18591893 >> 172.21.15.39:0/18591893 conn(0x7f10140fd8c0 msgr2=0x7f10140ffce0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:35:28.821 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:35:28.818+0000 7f101b800640 1 -- 172.21.15.39:0/18591893 shutdown_connections 2024-09-12T02:35:28.821 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:35:28.819+0000 7f101b800640 1 -- 172.21.15.39:0/18591893 wait complete. 2024-09-12T02:35:28.822 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:35:28.819+0000 7f101b800640 1 Processor -- start 2024-09-12T02:35:28.822 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:35:28.820+0000 7f101b800640 1 -- start start 2024-09-12T02:35:28.822 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:35:28.820+0000 7f101b800640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f1014101de0 0x7f101419a690 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:35:28.822 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:35:28.820+0000 7f101b800640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f1014102790 0x7f101419abd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:35:28.822 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:35:28.820+0000 7f101b800640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f1014106f10 0x7f101419ef60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:35:28.822 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:35:28.820+0000 7f101b800640 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 -- 0x7f1014111fc0 con 0x7f1014101de0 2024-09-12T02:35:28.822 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:35:28.820+0000 7f101b800640 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x7f1014111e40 con 0x7f1014106f10 2024-09-12T02:35:28.823 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:35:28.820+0000 7f101b800640 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7f1014112140 con 0x7f1014102790 2024-09-12T02:35:28.823 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:35:28.820+0000 7f1018e00640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f1014101de0 0x7f101419a690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:35:28.823 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:35:28.820+0000 7f1018e00640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f1014101de0 0x7f101419a690 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.39:3300/0 says I am v2:172.21.15.39:33538/0 (socket says 172.21.15.39:33538) 2024-09-12T02:35:28.823 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:35:28.820+0000 7f1018e00640 1 -- 172.21.15.39:0/3319791894 learned_addr learned my addr 172.21.15.39:0/3319791894 (peer_addr_for_me v2:172.21.15.39:0/0) 2024-09-12T02:35:28.823 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:35:28.820+0000 7f1019800640 1 --2- 172.21.15.39:0/3319791894 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f1014106f10 0x7f101419ef60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:35:28.823 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:35:28.820+0000 7f1013e00640 1 --2- 172.21.15.39:0/3319791894 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f1014102790 0x7f101419abd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:35:28.823 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:35:28.821+0000 7f1018e00640 1 -- 172.21.15.39:0/3319791894 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f1014102790 msgr2=0x7f101419abd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:35:28.823 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:35:28.821+0000 7f1018e00640 1 --2- 172.21.15.39:0/3319791894 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f1014102790 0x7f101419abd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:35:28.823 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:35:28.821+0000 7f1018e00640 1 -- 172.21.15.39:0/3319791894 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f1014106f10 msgr2=0x7f101419ef60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:35:28.823 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:35:28.821+0000 7f1018e00640 1 --2- 172.21.15.39:0/3319791894 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f1014106f10 0x7f101419ef60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:35:28.823 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:35:28.821+0000 7f1018e00640 1 -- 172.21.15.39:0/3319791894 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f101419f640 con 0x7f1014101de0 2024-09-12T02:35:28.824 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:35:28.821+0000 7f1019800640 1 --2- 172.21.15.39:0/3319791894 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f1014106f10 0x7f101419ef60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-12T02:35:28.824 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:35:28.821+0000 7f1018e00640 1 --2- 172.21.15.39:0/3319791894 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f1014101de0 0x7f101419a690 secure :-1 s=READY pgs=164 cs=0 l=1 rev1=1 crypto rx=0x7f100800d950 tx=0x7f100800de10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:35:28.825 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:35:28.821+0000 7f1011600640 1 -- 172.21.15.39:0/3319791894 <== mon.0 v2:172.21.15.39:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1008017030 con 0x7f1014101de0 2024-09-12T02:35:28.825 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:35:28.821+0000 7f1011600640 1 -- 172.21.15.39:0/3319791894 <== mon.0 v2:172.21.15.39:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f1008004020 con 0x7f1014101de0 2024-09-12T02:35:28.825 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:35:28.821+0000 7f1011600640 1 -- 172.21.15.39:0/3319791894 <== mon.0 v2:172.21.15.39:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f10080047a0 con 0x7f1014101de0 2024-09-12T02:35:28.825 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:35:28.821+0000 7f101b800640 1 -- 172.21.15.39:0/3319791894 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f101419f930 con 0x7f1014101de0 2024-09-12T02:35:28.825 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:35:28.822+0000 7f101b800640 1 -- 172.21.15.39:0/3319791894 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f10141a7210 con 0x7f1014101de0 2024-09-12T02:35:28.826 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:35:28.825+0000 7f1011600640 1 -- 172.21.15.39:0/3319791894 <== mon.0 v2:172.21.15.39:3300/0 4 ==== mgrmap(e 16) ==== 137833+0+0 (secure 0 0 0) 0x7f10080041d0 con 0x7f1014101de0 2024-09-12T02:35:28.826 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:35:28.825+0000 7f101e24f740 1 Processor -- start 2024-09-12T02:35:28.826 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:35:28.825+0000 7f101e24f740 1 -- start start 2024-09-12T02:35:28.826 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:35:28.825+0000 7f101e24f740 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x564c1c406330 0x564c1c406710 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:35:28.827 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:35:28.825+0000 7f101e24f740 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x564c1c406c50 0x564c1c410fd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:35:28.827 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:35:28.825+0000 7f101e24f740 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x564c1c411510 0x564c1c413900 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:35:28.827 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:35:28.825+0000 7f101e24f740 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 -- 0x564c1c36c0b0 con 0x564c1c406330 2024-09-12T02:35:28.827 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:35:28.825+0000 7f101e24f740 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x564c1c313ab0 con 0x564c1c406c50 2024-09-12T02:35:28.827 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:35:28.825+0000 7f101e24f740 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x564c1c368070 con 0x564c1c411510 2024-09-12T02:35:28.833 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:35:28.826+0000 7f1013e00640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x564c1c411510 0x564c1c413900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:35:28.833 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:35:28.826+0000 7f1019800640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x564c1c406330 0x564c1c406710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:35:28.833 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:35:28.826+0000 7f1013e00640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x564c1c411510 0x564c1c413900 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.172:3300/0 says I am v2:172.21.15.39:51202/0 (socket says 172.21.15.39:51202) 2024-09-12T02:35:28.833 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:35:28.826+0000 7f1019800640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x564c1c406330 0x564c1c406710 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.39:3300/0 says I am v2:172.21.15.39:33554/0 (socket says 172.21.15.39:33554) 2024-09-12T02:35:28.833 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:35:28.826+0000 7f1013e00640 1 -- 172.21.15.39:0/928974435 learned_addr learned my addr 172.21.15.39:0/928974435 (peer_addr_for_me v2:172.21.15.39:0/0) 2024-09-12T02:35:28.833 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:35:28.826+0000 7f1018e00640 1 --2- 172.21.15.39:0/928974435 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x564c1c406c50 0x564c1c410fd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:35:28.834 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:35:28.826+0000 7f1013e00640 1 -- 172.21.15.39:0/928974435 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x564c1c406c50 msgr2=0x564c1c410fd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:35:28.834 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:35:28.826+0000 7f1013e00640 1 --2- 172.21.15.39:0/928974435 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x564c1c406c50 0x564c1c410fd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:35:28.834 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:35:28.826+0000 7f1013e00640 1 -- 172.21.15.39:0/928974435 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x564c1c406330 msgr2=0x564c1c406710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:35:28.834 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:35:28.826+0000 7f1013e00640 1 --2- 172.21.15.39:0/928974435 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x564c1c406330 0x564c1c406710 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:35:28.834 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:35:28.826+0000 7f1013e00640 1 -- 172.21.15.39:0/928974435 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x564c1c3204a0 con 0x564c1c411510 2024-09-12T02:35:28.834 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:35:28.826+0000 7f1019800640 1 --2- 172.21.15.39:0/928974435 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x564c1c406330 0x564c1c406710 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-12T02:35:28.834 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:35:28.826+0000 7f1011600640 1 --2- 172.21.15.39:0/3319791894 >> [v2:172.21.15.39:6800/1725006999,v1:172.21.15.39:6801/1725006999] conn(0x7f0ffc0a2b80 0x7f0ffc0a5040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:35:28.834 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:35:28.827+0000 7f1011600640 1 -- 172.21.15.39:0/3319791894 <== mon.0 v2:172.21.15.39:3300/0 5 ==== osd_map(91..91 src has 1..91) ==== 8802+0+0 (secure 0 0 0) 0x7f10080cebc0 con 0x7f1014101de0 2024-09-12T02:35:28.834 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:35:28.827+0000 7f1013e00640 1 --2- 172.21.15.39:0/928974435 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x564c1c411510 0x564c1c413900 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7f1000009900 tx=0x7f1000004040 comp rx=0 tx=0).ready entity=mon.1 client_cookie=29c9b3c14b4a66f3 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:35:28.834 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:35:28.827+0000 7f1019800640 1 --2- 172.21.15.39:0/3319791894 >> [v2:172.21.15.39:6800/1725006999,v1:172.21.15.39:6801/1725006999] conn(0x7f0ffc0a2b80 0x7f0ffc0a5040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:35:28.835 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:35:28.827+0000 7f1006000640 1 -- 172.21.15.39:0/928974435 <== mon.1 v2:172.21.15.172:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1000035040 con 0x564c1c411510 2024-09-12T02:35:28.835 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:35:28.827+0000 7f1006000640 1 -- 172.21.15.39:0/928974435 <== mon.1 v2:172.21.15.172:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f1000005520 con 0x564c1c411510 2024-09-12T02:35:28.835 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:35:28.827+0000 7f1006000640 1 -- 172.21.15.39:0/928974435 <== mon.1 v2:172.21.15.172:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1000003850 con 0x564c1c411510 2024-09-12T02:35:28.835 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:35:28.828+0000 7f101e24f740 1 -- 172.21.15.39:0/928974435 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x564c1c411510 msgr2=0x564c1c413900 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:35:28.835 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:35:28.828+0000 7f101e24f740 1 --2- 172.21.15.39:0/928974435 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x564c1c411510 0x564c1c413900 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7f1000009900 tx=0x7f1000004040 comp rx=0 tx=0).stop 2024-09-12T02:35:28.836 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:35:28.828+0000 7f1019800640 1 --2- 172.21.15.39:0/3319791894 >> [v2:172.21.15.39:6800/1725006999,v1:172.21.15.39:6801/1725006999] conn(0x7f0ffc0a2b80 0x7f0ffc0a5040 secure :-1 s=READY pgs=156 cs=0 l=1 rev1=1 crypto rx=0x7f100c009fd0 tx=0x7f100c009500 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:35:28.836 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:35:28.828+0000 7f101e24f740 1 -- 172.21.15.39:0/928974435 shutdown_connections 2024-09-12T02:35:28.836 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:35:28.828+0000 7f101e24f740 1 --2- 172.21.15.39:0/928974435 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x564c1c411510 0x564c1c413900 unknown :-1 s=CLOSED pgs=74 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:35:28.836 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:35:28.828+0000 7f101e24f740 1 --2- 172.21.15.39:0/928974435 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x564c1c406c50 0x564c1c410fd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:35:28.836 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:35:28.828+0000 7f101e24f740 1 --2- 172.21.15.39:0/928974435 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x564c1c406330 0x564c1c406710 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:35:28.836 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:35:28.828+0000 7f101e24f740 1 -- 172.21.15.39:0/928974435 >> 172.21.15.39:0/928974435 conn(0x564c1c4028c0 msgr2=0x564c1c402ca0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:35:28.836 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:35:28.828+0000 7f101e24f740 1 -- 172.21.15.39:0/928974435 shutdown_connections 2024-09-12T02:35:28.837 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:35:28.828+0000 7f101e24f740 1 -- 172.21.15.39:0/928974435 wait complete. 2024-09-12T02:35:28.837 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:35:28.828+0000 7f101e24f740 1 -- start start 2024-09-12T02:35:28.837 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:35:28.829+0000 7f101e24f740 1 Processor -- start 2024-09-12T02:35:28.837 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:35:28.829+0000 7f101e24f740 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x564c1c406330 0x564c1c40e550 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:35:28.837 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:35:28.829+0000 7f101e24f740 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x564c1c406c50 0x564c1c40ea90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:35:28.837 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:35:28.829+0000 7f101e24f740 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x564c1c411510 0x564c1c40efd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:35:28.837 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:35:28.829+0000 7f101e24f740 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 -- 0x564c1c414060 con 0x564c1c406c50 2024-09-12T02:35:28.837 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:35:28.829+0000 7f101e24f740 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x564c1c2f4920 con 0x564c1c406330 2024-09-12T02:35:28.837 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:35:28.829+0000 7f101e24f740 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x564c1c4141e0 con 0x564c1c411510 2024-09-12T02:35:28.838 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:35:28.829+0000 7f101e24f740 10 client.0 _ll_register_callbacks cb 0x564c1c3188a0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-12T02:35:28.838 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:35:28.829+0000 7f1013e00640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x564c1c406c50 0x564c1c40ea90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:35:28.838 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:35:28.829+0000 7f1019800640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x564c1c411510 0x564c1c40efd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:35:28.838 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:35:28.829+0000 7f1013e00640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x564c1c406c50 0x564c1c40ea90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.39:3300/0 says I am v2:172.21.15.39:33560/0 (socket says 172.21.15.39:33560) 2024-09-12T02:35:28.838 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:35:28.829+0000 7f1013e00640 1 -- 172.21.15.39:0/1627606441 learned_addr learned my addr 172.21.15.39:0/1627606441 (peer_addr_for_me v2:172.21.15.39:0/0) 2024-09-12T02:35:28.838 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:35:28.830+0000 7f1018e00640 1 --2- 172.21.15.39:0/1627606441 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x564c1c406330 0x564c1c40e550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:35:28.838 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:35:28.830+0000 7f1019800640 1 -- 172.21.15.39:0/1627606441 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x564c1c406330 msgr2=0x564c1c40e550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:35:28.838 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:35:28.830+0000 7f1019800640 1 --2- 172.21.15.39:0/1627606441 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x564c1c406330 0x564c1c40e550 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:35:28.839 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:35:28.830+0000 7f1019800640 1 -- 172.21.15.39:0/1627606441 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x564c1c406c50 msgr2=0x564c1c40ea90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:35:28.839 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:35:28.830+0000 7f1019800640 1 --2- 172.21.15.39:0/1627606441 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x564c1c406c50 0x564c1c40ea90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:35:28.839 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:35:28.830+0000 7f1019800640 1 -- 172.21.15.39:0/1627606441 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({osdmap=0}) -- 0x564c1c0dd2b0 con 0x564c1c411510 2024-09-12T02:35:28.839 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:35:28.830+0000 7f1013e00640 1 --2- 172.21.15.39:0/1627606441 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x564c1c406c50 0x564c1c40ea90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-12T02:35:28.839 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:35:28.830+0000 7f1019800640 1 --2- 172.21.15.39:0/1627606441 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x564c1c411510 0x564c1c40efd0 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7f100c00ff90 tx=0x7f100c004ab0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=cccfb4cf7d93d50e server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:35:28.840 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:35:28.830+0000 7f0ffaa00640 10 client.0 ms_handle_connect on v2:172.21.15.172:3300/0 2024-09-12T02:35:28.840 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:35:28.831+0000 7f0ffaa00640 1 -- 172.21.15.39:0/1627606441 <== mon.1 v2:172.21.15.172:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f100c011bd0 con 0x564c1c411510 2024-09-12T02:35:28.840 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:35:28.831+0000 7f101e24f740 1 -- 172.21.15.39:0/1627606441 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f1000005520 con 0x564c1c411510 2024-09-12T02:35:28.840 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:35:28.831+0000 7f0ffaa00640 1 -- 172.21.15.39:0/1627606441 <== mon.1 v2:172.21.15.172:3300/0 2 ==== osd_map(91..91 src has 1..91) ==== 8802+0+0 (secure 0 0 0) 0x7f100c011d70 con 0x564c1c411510 2024-09-12T02:35:28.840 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:35:28.831+0000 7f0ffaa00640 1 -- 172.21.15.39:0/1627606441 <== mon.1 v2:172.21.15.172:3300/0 3 ==== mon_get_version_reply(handle=1 version=17) ==== 24+0+0 (secure 0 0 0) 0x7f100c029440 con 0x564c1c411510 2024-09-12T02:35:28.840 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:35:28.831+0000 7f101e24f740 10 client.24622 fetch_fsmap learned FSMap version 17 2024-09-12T02:35:28.840 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:35:28.831+0000 7f101e24f740 1 -- 172.21.15.39:0/1627606441 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({config=0+,fsmap=17,monmap=4+}) -- 0x564c1c41ff00 con 0x564c1c411510 2024-09-12T02:35:28.841 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:35:28.831+0000 7f0ffaa00640 1 -- 172.21.15.39:0/1627606441 <== mon.1 v2:172.21.15.172:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f1000005520 con 0x564c1c411510 2024-09-12T02:35:28.841 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:35:28.831+0000 7f0ffaa00640 1 -- 172.21.15.39:0/1627606441 <== mon.1 v2:172.21.15.172:3300/0 5 ==== fsmap(e 17) ==== 8350+0+0 (secure 0 0 0) 0x7f100c027070 con 0x564c1c411510 2024-09-12T02:35:28.841 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:35:28.831+0000 7f101e24f740 10 client.24622 fetch_fsmap finished waiting for FSMap version 17 2024-09-12T02:35:28.841 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:35:28.832+0000 7f101e24f740 10 client.24622 resolve_mds: resolved name 'b' to daemon mds.b 2024-09-12T02:35:28.841 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:35:28.832+0000 7f101e24f740 20 client.24622 populate_metadata read hostname 'smithi039' 2024-09-12T02:35:28.841 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:35:28.832+0000 7f101e24f740 1 --2- 172.21.15.39:0/1627606441 >> [v2:172.21.15.44:6838/2556532723,v1:172.21.15.44:6839/2556532723] conn(0x564c1c4225c0 0x564c1c423a30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:35:28.841 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:35:28.832+0000 7f101e24f740 4 client.24622 mds_command: new command op to 24515 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-12T02:35:28.841 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:35:28.832+0000 7f101e24f740 1 -- 172.21.15.39:0/1627606441 --> [v2:172.21.15.44:6838/2556532723,v1:172.21.15.44:6839/2556532723] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x564c1c379620 con 0x564c1c4225c0 2024-09-12T02:35:28.841 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:35:28.832+0000 7f1018e00640 1 --2- 172.21.15.39:0/1627606441 >> [v2:172.21.15.44:6838/2556532723,v1:172.21.15.44:6839/2556532723] conn(0x564c1c4225c0 0x564c1c423a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:35:28.843 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:35:28.832+0000 7f1018e00640 1 --2- 172.21.15.39:0/1627606441 >> [v2:172.21.15.44:6838/2556532723,v1:172.21.15.44:6839/2556532723] conn(0x564c1c4225c0 0x564c1c423a30 crc :-1 s=READY pgs=13 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=1783c0723790925f server_cookie=e991457bda904b90 in_seq=0 out_seq=0 2024-09-12T02:35:28.843 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:35:28.832+0000 7f0ffaa00640 10 client.24622 ms_handle_connect on v2:172.21.15.44:6838/2556532723 2024-09-12T02:35:28.843 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:35:28.833+0000 7f0ffaa00640 1 -- 172.21.15.39:0/1627606441 <== mds.0 v2:172.21.15.44:6838/2556532723 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x564c1c379620 con 0x564c1c4225c0 2024-09-12T02:35:28.843 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:35:28.833+0000 7f0ffaa00640 10 client.24622 handle_command_reply: tid=0 2024-09-12T02:35:28.843 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:35:28.833+0000 7f101e24f740 1 client.24622 shutdown 2024-09-12T02:35:28.843 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:35:28.833+0000 7f101e24f740 1 -- 172.21.15.39:0/1627606441 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x564c1c411510 msgr2=0x564c1c40efd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:35:28.843 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:35:28.833+0000 7f101e24f740 1 --2- 172.21.15.39:0/1627606441 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x564c1c411510 0x564c1c40efd0 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7f100c00ff90 tx=0x7f100c004ab0 comp rx=0 tx=0).stop 2024-09-12T02:35:28.843 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:35:28.834+0000 7f101e24f740 1 -- 172.21.15.39:0/1627606441 shutdown_connections 2024-09-12T02:35:28.844 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:35:28.834+0000 7f101e24f740 1 --2- 172.21.15.39:0/1627606441 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x564c1c411510 0x564c1c40efd0 unknown :-1 s=CLOSED pgs=75 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:35:28.844 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:35:28.834+0000 7f101e24f740 1 --2- 172.21.15.39:0/1627606441 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x564c1c406c50 0x564c1c40ea90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:35:28.844 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:35:28.834+0000 7f101e24f740 1 --2- 172.21.15.39:0/1627606441 >> [v2:172.21.15.44:6838/2556532723,v1:172.21.15.44:6839/2556532723] conn(0x564c1c4225c0 0x564c1c423a30 crc :-1 s=READY pgs=13 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:35:28.844 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:35:28.834+0000 7f101e24f740 1 --2- 172.21.15.39:0/1627606441 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x564c1c406330 0x564c1c40e550 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:35:28.844 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:35:28.834+0000 7f0ffaa00640 0 client.24622 ms_handle_reset on v2:172.21.15.44:6838/2556532723 2024-09-12T02:35:28.844 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:35:28.834+0000 7f101e24f740 1 -- 172.21.15.39:0/1627606441 >> 172.21.15.39:0/1627606441 conn(0x564c1c4028c0 msgr2=0x564c1c4085f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:35:28.844 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:35:28.834+0000 7f101e24f740 1 -- 172.21.15.39:0/1627606441 shutdown_connections 2024-09-12T02:35:28.845 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:35:28.834+0000 7f101e24f740 1 -- 172.21.15.39:0/1627606441 wait complete. 2024-09-12T02:35:28.845 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:35:28.834+0000 7f101e24f740 20 client.24622 trim_cache size 0 max 16384 2024-09-12T02:35:28.854 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:35:28.852+0000 7f101e24f740 1 Processor -- start 2024-09-12T02:35:28.854 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:35:28.853+0000 7f101e24f740 1 -- start start 2024-09-12T02:35:28.854 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:35:28.853+0000 7f101e24f740 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x564c1c406330 0x564c1c423360 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:35:28.854 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:35:28.853+0000 7f101e24f740 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x564c1c406c50 0x564c1c40ce40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:35:28.854 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:35:28.853+0000 7f101e24f740 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x564c1c411510 0x564c1c40d380 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:35:28.854 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:35:28.853+0000 7f101e24f740 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 -- 0x564c1c421d70 con 0x564c1c411510 2024-09-12T02:35:28.855 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:35:28.853+0000 7f101e24f740 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x564c1c422440 con 0x564c1c406330 2024-09-12T02:35:28.855 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:35:28.853+0000 7f101e24f740 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x564c1c422b10 con 0x564c1c406c50 2024-09-12T02:35:28.859 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:35:28.853+0000 7f1019800640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x564c1c411510 0x564c1c40d380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:35:28.859 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:35:28.853+0000 7f1018e00640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x564c1c406330 0x564c1c423360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:35:28.859 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:35:28.853+0000 7f1019800640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x564c1c411510 0x564c1c40d380 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.39:3300/0 says I am v2:172.21.15.39:33570/0 (socket says 172.21.15.39:33570) 2024-09-12T02:35:28.859 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:35:28.853+0000 7f1019800640 1 -- 172.21.15.39:0/4228994639 learned_addr learned my addr 172.21.15.39:0/4228994639 (peer_addr_for_me v2:172.21.15.39:0/0) 2024-09-12T02:35:28.859 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:35:28.853+0000 7f1018e00640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x564c1c406330 0x564c1c423360 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.39:52898/0 (socket says 172.21.15.39:52898) 2024-09-12T02:35:28.859 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:35:28.853+0000 7f1013e00640 1 --2- 172.21.15.39:0/4228994639 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x564c1c406c50 0x564c1c40ce40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:35:28.859 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:35:28.854+0000 7f1019800640 1 -- 172.21.15.39:0/4228994639 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x564c1c406c50 msgr2=0x564c1c40ce40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:35:28.859 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:35:28.854+0000 7f1019800640 1 --2- 172.21.15.39:0/4228994639 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x564c1c406c50 0x564c1c40ce40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:35:28.860 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:35:28.854+0000 7f1019800640 1 -- 172.21.15.39:0/4228994639 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x564c1c406330 msgr2=0x564c1c423360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:35:28.860 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:35:28.854+0000 7f1019800640 1 --2- 172.21.15.39:0/4228994639 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x564c1c406330 0x564c1c423360 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:35:28.860 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:35:28.854+0000 7f1019800640 1 -- 172.21.15.39:0/4228994639 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x564c1c406a40 con 0x564c1c411510 2024-09-12T02:35:28.860 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:35:28.854+0000 7f1018e00640 1 --2- 172.21.15.39:0/4228994639 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x564c1c406330 0x564c1c423360 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-12T02:35:28.860 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:35:28.854+0000 7f1019800640 1 --2- 172.21.15.39:0/4228994639 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x564c1c411510 0x564c1c40d380 secure :-1 s=READY pgs=165 cs=0 l=1 rev1=1 crypto rx=0x7f100c005c40 tx=0x7f100c005f30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=73916c69d285536e server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:35:28.860 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:35:28.854+0000 7f1005600640 1 -- 172.21.15.39:0/4228994639 <== mon.0 v2:172.21.15.39:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f100c01d9d0 con 0x564c1c411510 2024-09-12T02:35:28.860 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:35:28.854+0000 7f1005600640 1 -- 172.21.15.39:0/4228994639 <== mon.0 v2:172.21.15.39:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f100c011bd0 con 0x564c1c411510 2024-09-12T02:35:28.860 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:35:28.854+0000 7f1005600640 1 -- 172.21.15.39:0/4228994639 <== mon.0 v2:172.21.15.39:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f100c01f620 con 0x564c1c411510 2024-09-12T02:35:28.861 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:35:28.855+0000 7f101e24f740 1 -- 172.21.15.39:0/4228994639 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x564c1c411510 msgr2=0x564c1c40d380 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:35:28.861 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:35:28.855+0000 7f101e24f740 1 --2- 172.21.15.39:0/4228994639 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x564c1c411510 0x564c1c40d380 secure :-1 s=READY pgs=165 cs=0 l=1 rev1=1 crypto rx=0x7f100c005c40 tx=0x7f100c005f30 comp rx=0 tx=0).stop 2024-09-12T02:35:28.861 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:35:28.855+0000 7f101e24f740 1 -- 172.21.15.39:0/4228994639 shutdown_connections 2024-09-12T02:35:28.861 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:35:28.855+0000 7f101e24f740 1 --2- 172.21.15.39:0/4228994639 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x564c1c411510 0x564c1c40d380 unknown :-1 s=CLOSED pgs=165 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:35:28.861 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:35:28.855+0000 7f101e24f740 1 --2- 172.21.15.39:0/4228994639 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x564c1c406c50 0x564c1c40ce40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:35:28.861 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:35:28.855+0000 7f101e24f740 1 --2- 172.21.15.39:0/4228994639 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x564c1c406330 0x564c1c423360 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:35:28.861 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:35:28.855+0000 7f101e24f740 1 -- 172.21.15.39:0/4228994639 >> 172.21.15.39:0/4228994639 conn(0x564c1c4028c0 msgr2=0x564c1c402ca0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:35:28.861 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:35:28.855+0000 7f101e24f740 1 -- 172.21.15.39:0/4228994639 shutdown_connections 2024-09-12T02:35:28.861 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:35:28.855+0000 7f101e24f740 1 -- 172.21.15.39:0/4228994639 wait complete. 2024-09-12T02:35:28.862 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:35:28.855+0000 7f101e24f740 1 -- start start 2024-09-12T02:35:28.862 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:35:28.856+0000 7f101e24f740 1 Processor -- start 2024-09-12T02:35:28.862 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:35:28.856+0000 7f101e24f740 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x564c1c406330 0x564c1c40b500 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:35:28.862 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:35:28.856+0000 7f101e24f740 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x564c1c406c50 0x564c1c40ba40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:35:28.862 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:35:28.856+0000 7f101e24f740 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x564c1c411510 0x564c1c40bf80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:35:28.862 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:35:28.856+0000 7f101e24f740 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 -- 0x564c1c4238b0 con 0x564c1c411510 2024-09-12T02:35:28.862 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:35:28.856+0000 7f101e24f740 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x564c1c4231e0 con 0x564c1c406330 2024-09-12T02:35:28.862 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:35:28.856+0000 7f101e24f740 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x564c1c423f80 con 0x564c1c406c50 2024-09-12T02:35:28.862 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:35:28.856+0000 7f101e24f740 10 client.0 _ll_register_callbacks cb 0x7f100c00fea0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-12T02:35:28.863 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:35:28.856+0000 7f1019800640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x564c1c411510 0x564c1c40bf80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:35:28.863 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:35:28.856+0000 7f1019800640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x564c1c411510 0x564c1c40bf80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.39:3300/0 says I am v2:172.21.15.39:33580/0 (socket says 172.21.15.39:33580) 2024-09-12T02:35:28.863 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:35:28.856+0000 7f1019800640 1 -- 172.21.15.39:0/968525198 learned_addr learned my addr 172.21.15.39:0/968525198 (peer_addr_for_me v2:172.21.15.39:0/0) 2024-09-12T02:35:28.863 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:35:28.856+0000 7f1013e00640 1 --2- 172.21.15.39:0/968525198 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x564c1c406c50 0x564c1c40ba40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:35:28.863 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:35:28.856+0000 7f1018e00640 1 --2- 172.21.15.39:0/968525198 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x564c1c406330 0x564c1c40b500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:35:28.863 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:35:28.857+0000 7f1019800640 1 -- 172.21.15.39:0/968525198 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x564c1c406c50 msgr2=0x564c1c40ba40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:35:28.863 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:35:28.857+0000 7f1019800640 1 --2- 172.21.15.39:0/968525198 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x564c1c406c50 0x564c1c40ba40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:35:28.863 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:35:28.857+0000 7f1019800640 1 -- 172.21.15.39:0/968525198 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x564c1c406330 msgr2=0x564c1c40b500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:35:28.864 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:35:28.857+0000 7f1019800640 1 --2- 172.21.15.39:0/968525198 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x564c1c406330 0x564c1c40b500 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:35:28.864 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:35:28.857+0000 7f1019800640 1 -- 172.21.15.39:0/968525198 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({osdmap=0}) -- 0x564c1c42a100 con 0x564c1c411510 2024-09-12T02:35:28.864 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:35:28.857+0000 7f1019800640 1 --2- 172.21.15.39:0/968525198 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x564c1c411510 0x564c1c40bf80 secure :-1 s=READY pgs=166 cs=0 l=1 rev1=1 crypto rx=0x7f100c01d6d0 tx=0x7f100c011fb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=997697a08be15eda server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:35:28.864 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:35:28.857+0000 7f0ffaa00640 10 client.0 ms_handle_connect on v2:172.21.15.39:3300/0 2024-09-12T02:35:28.864 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:35:28.857+0000 7f0ffaa00640 1 -- 172.21.15.39:0/968525198 <== mon.0 v2:172.21.15.39:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f100c03f070 con 0x564c1c411510 2024-09-12T02:35:28.864 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:35:28.857+0000 7f101e24f740 1 -- 172.21.15.39:0/968525198 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f100c011bd0 con 0x564c1c411510 2024-09-12T02:35:28.864 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:35:28.857+0000 7f0ffaa00640 1 -- 172.21.15.39:0/968525198 <== mon.0 v2:172.21.15.39:3300/0 2 ==== osd_map(91..91 src has 1..91) ==== 8802+0+0 (secure 0 0 0) 0x7f100c0299f0 con 0x564c1c411510 2024-09-12T02:35:28.864 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:35:28.858+0000 7f0ffaa00640 1 -- 172.21.15.39:0/968525198 <== mon.0 v2:172.21.15.39:3300/0 3 ==== mon_get_version_reply(handle=1 version=17) ==== 24+0+0 (secure 0 0 0) 0x7f100c023040 con 0x564c1c411510 2024-09-12T02:35:28.864 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:35:28.858+0000 7f101e24f740 10 client.14625 fetch_fsmap learned FSMap version 17 2024-09-12T02:35:28.865 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:35:28.858+0000 7f101e24f740 1 -- 172.21.15.39:0/968525198 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({config=0+,fsmap=17,monmap=4+}) -- 0x564c1c48ceb0 con 0x564c1c411510 2024-09-12T02:35:28.865 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:35:28.858+0000 7f0ffaa00640 1 -- 172.21.15.39:0/968525198 <== mon.0 v2:172.21.15.39:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f100c011bd0 con 0x564c1c411510 2024-09-12T02:35:28.865 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:35:28.858+0000 7f0ffaa00640 1 -- 172.21.15.39:0/968525198 <== mon.0 v2:172.21.15.39:3300/0 5 ==== fsmap(e 17) ==== 8350+0+0 (secure 0 0 0) 0x7f100c037070 con 0x564c1c411510 2024-09-12T02:35:28.865 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:35:28.858+0000 7f101e24f740 10 client.14625 fetch_fsmap finished waiting for FSMap version 17 2024-09-12T02:35:28.865 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:35:28.858+0000 7f101e24f740 10 client.14625 resolve_mds: resolved name 'b' to daemon mds.b 2024-09-12T02:35:28.865 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:35:28.858+0000 7f101e24f740 20 client.14625 populate_metadata read hostname 'smithi039' 2024-09-12T02:35:28.865 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:35:28.858+0000 7f101e24f740 1 --2- 172.21.15.39:0/968525198 >> [v2:172.21.15.44:6838/2556532723,v1:172.21.15.44:6839/2556532723] conn(0x564c1c491580 0x564c1c490290 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:35:28.865 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:35:28.858+0000 7f101e24f740 4 client.14625 mds_command: new command op to 24515 tid=0 multi_id=0 [{"prefix": "status"}] 2024-09-12T02:35:28.866 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:35:28.858+0000 7f101e24f740 1 -- 172.21.15.39:0/968525198 --> [v2:172.21.15.44:6838/2556532723,v1:172.21.15.44:6839/2556532723] -- command(tid 0: {"prefix": "status"}) -- 0x564c1c373b30 con 0x564c1c491580 2024-09-12T02:35:28.867 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:35:28.859+0000 7f1018e00640 1 --2- 172.21.15.39:0/968525198 >> [v2:172.21.15.44:6838/2556532723,v1:172.21.15.44:6839/2556532723] conn(0x564c1c491580 0x564c1c490290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:35:28.867 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:35:28.859+0000 7f1018e00640 1 --2- 172.21.15.39:0/968525198 >> [v2:172.21.15.44:6838/2556532723,v1:172.21.15.44:6839/2556532723] conn(0x564c1c491580 0x564c1c490290 crc :-1 s=READY pgs=14 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=6ca85c4c0fe749ab server_cookie=86e589fbf3f82cc2 in_seq=0 out_seq=0 2024-09-12T02:35:28.868 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:35:28.859+0000 7f0ffaa00640 10 client.14625 ms_handle_connect on v2:172.21.15.44:6838/2556532723 2024-09-12T02:35:28.868 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:35:28.859+0000 7f0ffaa00640 1 -- 172.21.15.39:0/968525198 <== mds.0 v2:172.21.15.44:6838/2556532723 1 ==== command_reply(tid 0: 0 ) ==== 8+0+326 (crc 0 0 0) 0x564c1c373b30 con 0x564c1c491580 2024-09-12T02:35:28.868 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:35:28.859+0000 7f0ffaa00640 10 client.14625 handle_command_reply: tid=0 2024-09-12T02:35:28.868 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:35:28.859+0000 7f101e24f740 1 client.14625 shutdown 2024-09-12T02:35:28.868 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:35:28.860+0000 7f101e24f740 1 -- 172.21.15.39:0/968525198 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x564c1c411510 msgr2=0x564c1c40bf80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:35:28.868 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:35:28.860+0000 7f101e24f740 1 --2- 172.21.15.39:0/968525198 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x564c1c411510 0x564c1c40bf80 secure :-1 s=READY pgs=166 cs=0 l=1 rev1=1 crypto rx=0x7f100c01d6d0 tx=0x7f100c011fb0 comp rx=0 tx=0).stop 2024-09-12T02:35:28.868 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:35:28.860+0000 7f101e24f740 1 -- 172.21.15.39:0/968525198 shutdown_connections 2024-09-12T02:35:28.868 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:35:28.860+0000 7f101e24f740 1 --2- 172.21.15.39:0/968525198 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x564c1c411510 0x564c1c40bf80 unknown :-1 s=CLOSED pgs=166 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:35:28.868 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:35:28.860+0000 7f101e24f740 1 --2- 172.21.15.39:0/968525198 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x564c1c406c50 0x564c1c40ba40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:35:28.869 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:35:28.860+0000 7f101e24f740 1 --2- 172.21.15.39:0/968525198 >> [v2:172.21.15.44:6838/2556532723,v1:172.21.15.44:6839/2556532723] conn(0x564c1c491580 0x564c1c490290 crc :-1 s=READY pgs=14 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:35:28.869 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:35:28.860+0000 7f101e24f740 1 --2- 172.21.15.39:0/968525198 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x564c1c406330 0x564c1c40b500 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:35:28.869 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:35:28.860+0000 7f101e24f740 1 -- 172.21.15.39:0/968525198 >> 172.21.15.39:0/968525198 conn(0x564c1c4028c0 msgr2=0x564c1c407dd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:35:28.869 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:35:28.860+0000 7f0ffaa00640 0 client.14625 ms_handle_reset on v2:172.21.15.44:6838/2556532723 2024-09-12T02:35:28.869 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:35:28.860+0000 7f101e24f740 1 -- 172.21.15.39:0/968525198 shutdown_connections 2024-09-12T02:35:28.869 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:35:28.860+0000 7f101e24f740 1 -- 172.21.15.39:0/968525198 wait complete. 2024-09-12T02:35:28.869 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:35:28.860+0000 7f101e24f740 20 client.14625 trim_cache size 0 max 16384 2024-09-12T02:35:28.870 INFO:teuthology.orchestra.run.smithi039.stdout:{ 2024-09-12T02:35:28.870 INFO:teuthology.orchestra.run.smithi039.stdout: "cluster_fsid": "4954ed46-70ae-11ef-bcea-c7b262605968", 2024-09-12T02:35:28.870 INFO:teuthology.orchestra.run.smithi039.stdout: "whoami": 0, 2024-09-12T02:35:28.870 INFO:teuthology.orchestra.run.smithi039.stdout: "id": 24515, 2024-09-12T02:35:28.870 INFO:teuthology.orchestra.run.smithi039.stdout: "want_state": "up:active", 2024-09-12T02:35:28.870 INFO:teuthology.orchestra.run.smithi039.stdout: "state": "up:active", 2024-09-12T02:35:28.871 INFO:teuthology.orchestra.run.smithi039.stdout: "fs_name": "cephfs", 2024-09-12T02:35:28.871 INFO:teuthology.orchestra.run.smithi039.stdout: "rank_uptime": 24.358107677, 2024-09-12T02:35:28.871 INFO:teuthology.orchestra.run.smithi039.stdout: "mdsmap_epoch": 17, 2024-09-12T02:35:28.871 INFO:teuthology.orchestra.run.smithi039.stdout: "osdmap_epoch": 91, 2024-09-12T02:35:28.871 INFO:teuthology.orchestra.run.smithi039.stdout: "osdmap_epoch_barrier": 91, 2024-09-12T02:35:28.871 INFO:teuthology.orchestra.run.smithi039.stdout: "uptime": 36.661608383999997 2024-09-12T02:35:28.871 INFO:teuthology.orchestra.run.smithi039.stdout:} 2024-09-12T02:35:28.872 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:35:28.861+0000 7f101b800640 1 -- 172.21.15.39:0/3319791894 >> [v2:172.21.15.39:6800/1725006999,v1:172.21.15.39:6801/1725006999] conn(0x7f0ffc0a2b80 msgr2=0x7f0ffc0a5040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:35:28.873 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:35:28.861+0000 7f101b800640 1 --2- 172.21.15.39:0/3319791894 >> [v2:172.21.15.39:6800/1725006999,v1:172.21.15.39:6801/1725006999] conn(0x7f0ffc0a2b80 0x7f0ffc0a5040 secure :-1 s=READY pgs=156 cs=0 l=1 rev1=1 crypto rx=0x7f100c009fd0 tx=0x7f100c009500 comp rx=0 tx=0).stop 2024-09-12T02:35:28.873 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:35:28.861+0000 7f101b800640 1 -- 172.21.15.39:0/3319791894 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f1014101de0 msgr2=0x7f101419a690 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:35:28.873 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:35:28.861+0000 7f101b800640 1 --2- 172.21.15.39:0/3319791894 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f1014101de0 0x7f101419a690 secure :-1 s=READY pgs=164 cs=0 l=1 rev1=1 crypto rx=0x7f100800d950 tx=0x7f100800de10 comp rx=0 tx=0).stop 2024-09-12T02:35:28.873 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:35:28.861+0000 7f101b800640 1 -- 172.21.15.39:0/3319791894 shutdown_connections 2024-09-12T02:35:28.873 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:35:28.861+0000 7f101b800640 1 --2- 172.21.15.39:0/3319791894 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f1014106f10 0x7f101419ef60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:35:28.873 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:35:28.861+0000 7f101b800640 1 --2- 172.21.15.39:0/3319791894 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f1014102790 0x7f101419abd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:35:28.874 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:35:28.861+0000 7f101b800640 1 --2- 172.21.15.39:0/3319791894 >> [v2:172.21.15.39:6800/1725006999,v1:172.21.15.39:6801/1725006999] conn(0x7f0ffc0a2b80 0x7f0ffc0a5040 unknown :-1 s=CLOSED pgs=156 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:35:28.874 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:35:28.861+0000 7f101b800640 1 --2- 172.21.15.39:0/3319791894 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f1014101de0 0x7f101419a690 unknown :-1 s=CLOSED pgs=164 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:35:28.874 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:35:28.861+0000 7f101b800640 1 -- 172.21.15.39:0/3319791894 >> 172.21.15.39:0/3319791894 conn(0x7f10140fd8c0 msgr2=0x7f10140ffbf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:35:28.874 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:35:28.861+0000 7f101b800640 1 -- 172.21.15.39:0/3319791894 shutdown_connections 2024-09-12T02:35:28.874 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:35:28.861+0000 7f101b800640 1 -- 172.21.15.39:0/3319791894 wait complete. 2024-09-12T02:35:28.948 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 12 02:35:28 smithi044 ceph-mon[35411]: pgmap v312: 129 pgs: 129 active+clean; 579 KiB data, 346 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-12T02:35:29.014 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 12 02:35:28 smithi172 ceph-mon[35609]: pgmap v312: 129 pgs: 129 active+clean; 579 KiB data, 346 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-12T02:35:29.876 INFO:tasks.cephfs.mount:cephfs_mntpt = None 2024-09-12T02:35:29.876 INFO:tasks.cephfs.mount:hostfs_mntpt = /home/ubuntu/cephtest/mnt.admin 2024-09-12T02:35:29.876 DEBUG:teuthology.orchestra.run.smithi039:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc shell --fsid 4954ed46-70ae-11ef-bcea-c7b262605968 -- ceph fs ls 2024-09-12T02:35:30.255 INFO:teuthology.orchestra.run.smithi039.stderr:Inferring config /var/lib/ceph/4954ed46-70ae-11ef-bcea-c7b262605968/mon.a/config 2024-09-12T02:35:30.872 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:35:30.867+0000 7ff6c2a00640 1 -- 172.21.15.39:0/1260674491 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7ff6bc104800 msgr2=0x7ff6bc108960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:35:30.873 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:35:30.867+0000 7ff6c2a00640 1 --2- 172.21.15.39:0/1260674491 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7ff6bc104800 0x7ff6bc108960 secure :-1 s=READY pgs=167 cs=0 l=1 rev1=1 crypto rx=0x7ff6a8009900 tx=0x7ff6a802a410 comp rx=0 tx=0).stop 2024-09-12T02:35:30.873 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:35:30.867+0000 7ff6c2a00640 1 -- 172.21.15.39:0/1260674491 shutdown_connections 2024-09-12T02:35:30.873 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:35:30.867+0000 7ff6c2a00640 1 --2- 172.21.15.39:0/1260674491 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7ff6bc109090 0x7ff6bc110c10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:35:30.873 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:35:30.867+0000 7ff6c2a00640 1 --2- 172.21.15.39:0/1260674491 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7ff6bc104800 0x7ff6bc108960 unknown :-1 s=CLOSED pgs=167 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:35:30.873 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:35:30.867+0000 7ff6c2a00640 1 --2- 172.21.15.39:0/1260674491 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7ff6bc103e50 0x7ff6bc104230 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:35:30.873 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:35:30.867+0000 7ff6c2a00640 1 -- 172.21.15.39:0/1260674491 >> 172.21.15.39:0/1260674491 conn(0x7ff6bc0ff8b0 msgr2=0x7ff6bc101cd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:35:30.873 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:35:30.867+0000 7ff6c2a00640 1 -- 172.21.15.39:0/1260674491 shutdown_connections 2024-09-12T02:35:30.873 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:35:30.867+0000 7ff6c2a00640 1 -- 172.21.15.39:0/1260674491 wait complete. 2024-09-12T02:35:30.873 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:35:30.868+0000 7ff6c2a00640 1 Processor -- start 2024-09-12T02:35:30.873 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:35:30.868+0000 7ff6c2a00640 1 -- start start 2024-09-12T02:35:30.873 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:35:30.868+0000 7ff6c2a00640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7ff6bc103e50 0x7ff6bc19a5a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:35:30.874 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:35:30.868+0000 7ff6c2a00640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7ff6bc104800 0x7ff6bc19aae0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:35:30.874 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:35:30.868+0000 7ff6c2a00640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7ff6bc109090 0x7ff6bc19ee70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:35:30.874 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:35:30.868+0000 7ff6c2a00640 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 -- 0x7ff6bc114100 con 0x7ff6bc104800 2024-09-12T02:35:30.874 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:35:30.868+0000 7ff6c2a00640 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x7ff6bc113f80 con 0x7ff6bc103e50 2024-09-12T02:35:30.874 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:35:30.868+0000 7ff6c2a00640 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7ff6bc114280 con 0x7ff6bc109090 2024-09-12T02:35:30.874 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:35:30.868+0000 7ff6c0c00640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7ff6bc104800 0x7ff6bc19aae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:35:30.874 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:35:30.869+0000 7ff6c0c00640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7ff6bc104800 0x7ff6bc19aae0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.39:3300/0 says I am v2:172.21.15.39:33606/0 (socket says 172.21.15.39:33606) 2024-09-12T02:35:30.874 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:35:30.869+0000 7ff6c0c00640 1 -- 172.21.15.39:0/3542186597 learned_addr learned my addr 172.21.15.39:0/3542186597 (peer_addr_for_me v2:172.21.15.39:0/0) 2024-09-12T02:35:30.874 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:35:30.869+0000 7ff6c1600640 1 --2- 172.21.15.39:0/3542186597 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7ff6bc103e50 0x7ff6bc19a5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:35:30.874 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:35:30.869+0000 7ff6c2000640 1 --2- 172.21.15.39:0/3542186597 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7ff6bc109090 0x7ff6bc19ee70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:35:30.874 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:35:30.869+0000 7ff6c0c00640 1 -- 172.21.15.39:0/3542186597 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7ff6bc109090 msgr2=0x7ff6bc19ee70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:35:30.874 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:35:30.869+0000 7ff6c0c00640 1 --2- 172.21.15.39:0/3542186597 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7ff6bc109090 0x7ff6bc19ee70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:35:30.874 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:35:30.869+0000 7ff6c0c00640 1 -- 172.21.15.39:0/3542186597 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7ff6bc103e50 msgr2=0x7ff6bc19a5a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:35:30.875 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:35:30.869+0000 7ff6c0c00640 1 --2- 172.21.15.39:0/3542186597 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7ff6bc103e50 0x7ff6bc19a5a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:35:30.875 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:35:30.869+0000 7ff6c0c00640 1 -- 172.21.15.39:0/3542186597 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff6bc19f550 con 0x7ff6bc104800 2024-09-12T02:35:30.875 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:35:30.869+0000 7ff6c0c00640 1 --2- 172.21.15.39:0/3542186597 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7ff6bc104800 0x7ff6bc19aae0 secure :-1 s=READY pgs=168 cs=0 l=1 rev1=1 crypto rx=0x7ff6a8004770 tx=0x7ff6a8003c10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:35:30.875 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:35:30.870+0000 7ff6ba000640 1 -- 172.21.15.39:0/3542186597 <== mon.0 v2:172.21.15.39:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff6a803f070 con 0x7ff6bc104800 2024-09-12T02:35:30.875 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:35:30.870+0000 7ff6ba000640 1 -- 172.21.15.39:0/3542186597 <== mon.0 v2:172.21.15.39:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7ff6a8031ca0 con 0x7ff6bc104800 2024-09-12T02:35:30.875 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:35:30.870+0000 7ff6ba000640 1 -- 172.21.15.39:0/3542186597 <== mon.0 v2:172.21.15.39:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff6a8035030 con 0x7ff6bc104800 2024-09-12T02:35:30.875 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:35:30.870+0000 7ff6c2a00640 1 -- 172.21.15.39:0/3542186597 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff6bc19f7e0 con 0x7ff6bc104800 2024-09-12T02:35:30.875 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:35:30.870+0000 7ff6c2a00640 1 -- 172.21.15.39:0/3542186597 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff6bc1a7120 con 0x7ff6bc104800 2024-09-12T02:35:30.875 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:35:30.871+0000 7ff6c2a00640 1 -- 172.21.15.39:0/3542186597 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ff6bc105330 con 0x7ff6bc104800 2024-09-12T02:35:30.876 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:35:30.873+0000 7ff6ba000640 1 -- 172.21.15.39:0/3542186597 <== mon.0 v2:172.21.15.39:3300/0 4 ==== mgrmap(e 16) ==== 137833+0+0 (secure 0 0 0) 0x7ff6a8042070 con 0x7ff6bc104800 2024-09-12T02:35:30.876 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:35:30.875+0000 7ff6ba000640 1 --2- 172.21.15.39:0/3542186597 >> [v2:172.21.15.39:6800/1725006999,v1:172.21.15.39:6801/1725006999] conn(0x7ff6a40a2b80 0x7ff6a40a5040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:35:30.876 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:35:30.875+0000 7ff6ba000640 1 -- 172.21.15.39:0/3542186597 <== mon.0 v2:172.21.15.39:3300/0 5 ==== osd_map(91..91 src has 1..91) ==== 8802+0+0 (secure 0 0 0) 0x7ff6a80ef8c0 con 0x7ff6bc104800 2024-09-12T02:35:30.876 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:35:30.875+0000 7ff6c1600640 1 --2- 172.21.15.39:0/3542186597 >> [v2:172.21.15.39:6800/1725006999,v1:172.21.15.39:6801/1725006999] conn(0x7ff6a40a2b80 0x7ff6a40a5040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:35:30.876 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:35:30.876+0000 7ff6c1600640 1 --2- 172.21.15.39:0/3542186597 >> [v2:172.21.15.39:6800/1725006999,v1:172.21.15.39:6801/1725006999] conn(0x7ff6a40a2b80 0x7ff6a40a5040 secure :-1 s=READY pgs=157 cs=0 l=1 rev1=1 crypto rx=0x7ff6b0009bd0 tx=0x7ff6b0005f90 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:35:30.879 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:35:30.878+0000 7ff6ba000640 1 -- 172.21.15.39:0/3542186597 <== mon.0 v2:172.21.15.39:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7ff6a80bbff0 con 0x7ff6bc104800 2024-09-12T02:35:30.948 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 12 02:35:30 smithi044 ceph-mon[35411]: pgmap v313: 129 pgs: 129 active+clean; 579 KiB data, 346 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-12T02:35:31.013 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 12 02:35:30 smithi172 ceph-mon[35609]: pgmap v313: 129 pgs: 129 active+clean; 579 KiB data, 346 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-12T02:35:31.099 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 02:35:30 smithi039 ceph-mon[30515]: pgmap v313: 129 pgs: 129 active+clean; 579 KiB data, 346 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-12T02:35:31.113 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:35:31.113+0000 7ff6c2a00640 1 -- 172.21.15.39:0/3542186597 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_command({"prefix": "fs ls"} v 0) -- 0x7ff6bc10c2d0 con 0x7ff6bc104800 2024-09-12T02:35:31.114 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:35:31.113+0000 7ff6ba000640 1 -- 172.21.15.39:0/3542186597 <== mon.0 v2:172.21.15.39:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v17) ==== 53+0+88 (secure 0 0 0) 0x7ff6a80c02f0 con 0x7ff6bc104800 2024-09-12T02:35:31.114 INFO:teuthology.orchestra.run.smithi039.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data cephfs_data_ec ] 2024-09-12T02:35:31.116 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:35:31.115+0000 7ff6c2a00640 1 -- 172.21.15.39:0/3542186597 >> [v2:172.21.15.39:6800/1725006999,v1:172.21.15.39:6801/1725006999] conn(0x7ff6a40a2b80 msgr2=0x7ff6a40a5040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:35:31.116 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:35:31.115+0000 7ff6c2a00640 1 --2- 172.21.15.39:0/3542186597 >> [v2:172.21.15.39:6800/1725006999,v1:172.21.15.39:6801/1725006999] conn(0x7ff6a40a2b80 0x7ff6a40a5040 secure :-1 s=READY pgs=157 cs=0 l=1 rev1=1 crypto rx=0x7ff6b0009bd0 tx=0x7ff6b0005f90 comp rx=0 tx=0).stop 2024-09-12T02:35:31.116 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:35:31.115+0000 7ff6c2a00640 1 -- 172.21.15.39:0/3542186597 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7ff6bc104800 msgr2=0x7ff6bc19aae0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:35:31.116 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:35:31.115+0000 7ff6c2a00640 1 --2- 172.21.15.39:0/3542186597 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7ff6bc104800 0x7ff6bc19aae0 secure :-1 s=READY pgs=168 cs=0 l=1 rev1=1 crypto rx=0x7ff6a8004770 tx=0x7ff6a8003c10 comp rx=0 tx=0).stop 2024-09-12T02:35:31.116 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:35:31.115+0000 7ff6c2a00640 1 -- 172.21.15.39:0/3542186597 shutdown_connections 2024-09-12T02:35:31.116 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:35:31.115+0000 7ff6c2a00640 1 --2- 172.21.15.39:0/3542186597 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7ff6bc109090 0x7ff6bc19ee70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:35:31.116 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:35:31.115+0000 7ff6c2a00640 1 --2- 172.21.15.39:0/3542186597 >> [v2:172.21.15.39:6800/1725006999,v1:172.21.15.39:6801/1725006999] conn(0x7ff6a40a2b80 0x7ff6a40a5040 unknown :-1 s=CLOSED pgs=157 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:35:31.117 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:35:31.115+0000 7ff6c2a00640 1 --2- 172.21.15.39:0/3542186597 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7ff6bc104800 0x7ff6bc19aae0 unknown :-1 s=CLOSED pgs=168 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:35:31.117 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:35:31.115+0000 7ff6c2a00640 1 --2- 172.21.15.39:0/3542186597 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7ff6bc103e50 0x7ff6bc19a5a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:35:31.117 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:35:31.115+0000 7ff6c2a00640 1 -- 172.21.15.39:0/3542186597 >> 172.21.15.39:0/3542186597 conn(0x7ff6bc0ff8b0 msgr2=0x7ff6bc100b70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:35:31.117 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:35:31.115+0000 7ff6c2a00640 1 -- 172.21.15.39:0/3542186597 shutdown_connections 2024-09-12T02:35:31.117 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:35:31.116+0000 7ff6c2a00640 1 -- 172.21.15.39:0/3542186597 wait complete. 2024-09-12T02:35:31.850 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 02:35:31 smithi039 ceph-mon[30515]: from='client.? 172.21.15.39:0/3542186597' entity='client.admin' cmd=[{"prefix": "fs ls"}]: dispatch 2024-09-12T02:35:31.928 INFO:tasks.cephfs.mount:Mounting Ceph FS cephfs; just confirmed its presence on cluster 2024-09-12T02:35:31.928 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2024-09-12T02:35:31.928 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi039.front.sepia.ceph.com 2024-09-12T02:35:31.928 INFO:tasks.cephfs.mount:self.client.name = client.admin 2024-09-12T02:35:31.928 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.admin 2024-09-12T02:35:31.928 INFO:tasks.cephfs.mount:self.cephfs_name = cephfs 2024-09-12T02:35:31.928 INFO:tasks.cephfs.mount:self.cephfs_mntpt = None 2024-09-12T02:35:31.928 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2024-09-12T02:35:31.929 INFO:tasks.cephfs.mount:Setting the 'None' netns for '/home/ubuntu/cephtest/mnt.admin' 2024-09-12T02:35:31.929 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-12T02:35:31.929 DEBUG:teuthology.orchestra.run.smithi039:> ip addr 2024-09-12T02:35:31.948 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 12 02:35:31 smithi044 ceph-mon[35411]: from='client.? 172.21.15.39:0/3542186597' entity='client.admin' cmd=[{"prefix": "fs ls"}]: dispatch 2024-09-12T02:35:31.965 INFO:teuthology.orchestra.run.smithi039.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2024-09-12T02:35:31.966 INFO:teuthology.orchestra.run.smithi039.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2024-09-12T02:35:31.966 INFO:teuthology.orchestra.run.smithi039.stdout: inet 127.0.0.1/8 scope host lo 2024-09-12T02:35:31.966 INFO:teuthology.orchestra.run.smithi039.stdout: valid_lft forever preferred_lft forever 2024-09-12T02:35:31.966 INFO:teuthology.orchestra.run.smithi039.stdout: inet6 ::1/128 scope host 2024-09-12T02:35:31.966 INFO:teuthology.orchestra.run.smithi039.stdout: valid_lft forever preferred_lft forever 2024-09-12T02:35:31.966 INFO:teuthology.orchestra.run.smithi039.stdout:2: eno1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-09-12T02:35:31.966 INFO:teuthology.orchestra.run.smithi039.stdout: link/ether 0c:c4:7a:6b:fe:c6 brd ff:ff:ff:ff:ff:ff 2024-09-12T02:35:31.966 INFO:teuthology.orchestra.run.smithi039.stdout: altname enp7s0f0 2024-09-12T02:35:31.966 INFO:teuthology.orchestra.run.smithi039.stdout:3: eno2: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-09-12T02:35:31.966 INFO:teuthology.orchestra.run.smithi039.stdout: link/ether 0c:c4:7a:6b:fe:c7 brd ff:ff:ff:ff:ff:ff 2024-09-12T02:35:31.966 INFO:teuthology.orchestra.run.smithi039.stdout: altname enp7s0f1 2024-09-12T02:35:31.966 INFO:teuthology.orchestra.run.smithi039.stdout:4: ens1f0: mtu 1500 qdisc mq state UP group default qlen 1000 2024-09-12T02:35:31.967 INFO:teuthology.orchestra.run.smithi039.stdout: link/ether 0c:c4:7a:bd:13:70 brd ff:ff:ff:ff:ff:ff 2024-09-12T02:35:31.967 INFO:teuthology.orchestra.run.smithi039.stdout: altname enp1s0f0 2024-09-12T02:35:31.967 INFO:teuthology.orchestra.run.smithi039.stdout: inet 172.21.15.39/20 brd 172.21.15.255 scope global dynamic noprefixroute ens1f0 2024-09-12T02:35:31.967 INFO:teuthology.orchestra.run.smithi039.stdout: valid_lft 42153sec preferred_lft 42153sec 2024-09-12T02:35:31.967 INFO:teuthology.orchestra.run.smithi039.stdout: inet6 fe80::ec4:7aff:febd:1370/64 scope link 2024-09-12T02:35:31.967 INFO:teuthology.orchestra.run.smithi039.stdout: valid_lft forever preferred_lft forever 2024-09-12T02:35:31.967 INFO:teuthology.orchestra.run.smithi039.stdout:5: ens1f1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-09-12T02:35:31.967 INFO:teuthology.orchestra.run.smithi039.stdout: link/ether 0c:c4:7a:bd:13:71 brd ff:ff:ff:ff:ff:ff 2024-09-12T02:35:31.967 INFO:teuthology.orchestra.run.smithi039.stdout: altname enp1s0f1 2024-09-12T02:35:31.968 INFO:tasks.cephfs.mount:Setuping the 'ceph-brx' with 192.168.255.254/16 2024-09-12T02:35:31.968 DEBUG:teuthology.orchestra.run.smithi039:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-09-12T02:35:31.968 DEBUG:teuthology.orchestra.run.smithi039:> set -e 2024-09-12T02:35:31.968 DEBUG:teuthology.orchestra.run.smithi039:> sudo ip link add name ceph-brx type bridge 2024-09-12T02:35:31.968 DEBUG:teuthology.orchestra.run.smithi039:> sudo ip addr flush dev ceph-brx 2024-09-12T02:35:31.968 DEBUG:teuthology.orchestra.run.smithi039:> sudo ip link set ceph-brx up 2024-09-12T02:35:31.969 DEBUG:teuthology.orchestra.run.smithi039:> sudo ip addr add 192.168.255.254/16 brd 192.168.255.255 dev ceph-brx 2024-09-12T02:35:31.969 DEBUG:teuthology.orchestra.run.smithi039:> ') 2024-09-12T02:35:32.013 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 12 02:35:31 smithi172 ceph-mon[35609]: from='client.? 172.21.15.39:0/3542186597' entity='client.admin' cmd=[{"prefix": "fs ls"}]: dispatch 2024-09-12T02:35:32.085 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:35:32 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-09-12T02:35:32.374 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:35:32 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-12T02:35:32.383 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-12T02:35:32.383 DEBUG:teuthology.orchestra.run.smithi039:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2024-09-12T02:35:32.439 INFO:teuthology.orchestra.run.smithi039.stdout:1 2024-09-12T02:35:32.442 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-12T02:35:32.442 DEBUG:teuthology.orchestra.run.smithi039:> route 2024-09-12T02:35:32.492 INFO:teuthology.orchestra.run.smithi039.stdout:Kernel IP routing table 2024-09-12T02:35:32.492 INFO:teuthology.orchestra.run.smithi039.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2024-09-12T02:35:32.492 INFO:teuthology.orchestra.run.smithi039.stdout:default _gateway 0.0.0.0 UG 100 0 0 ens1f0 2024-09-12T02:35:32.492 INFO:teuthology.orchestra.run.smithi039.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 100 0 0 ens1f0 2024-09-12T02:35:32.492 INFO:teuthology.orchestra.run.smithi039.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2024-09-12T02:35:32.492 DEBUG:teuthology.orchestra.run.smithi039:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-09-12T02:35:32.492 DEBUG:teuthology.orchestra.run.smithi039:> set -e 2024-09-12T02:35:32.493 DEBUG:teuthology.orchestra.run.smithi039:> sudo iptables -A FORWARD -o ens1f0 -i ceph-brx -j ACCEPT 2024-09-12T02:35:32.493 DEBUG:teuthology.orchestra.run.smithi039:> sudo iptables -A FORWARD -i ens1f0 -o ceph-brx -j ACCEPT 2024-09-12T02:35:32.493 DEBUG:teuthology.orchestra.run.smithi039:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o ens1f0 -j MASQUERADE 2024-09-12T02:35:32.493 DEBUG:teuthology.orchestra.run.smithi039:> ') 2024-09-12T02:35:32.571 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:35:32 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-09-12T02:35:32.849 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 02:35:32 smithi039 ceph-mon[30515]: pgmap v314: 129 pgs: 129 active+clean; 579 KiB data, 346 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-12T02:35:32.948 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 12 02:35:32 smithi044 ceph-mon[35411]: pgmap v314: 129 pgs: 129 active+clean; 579 KiB data, 346 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-12T02:35:33.013 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 12 02:35:32 smithi172 ceph-mon[35609]: pgmap v314: 129 pgs: 129 active+clean; 579 KiB data, 346 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-12T02:35:33.119 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:35:33 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-12T02:35:33.127 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-12T02:35:33.127 DEBUG:teuthology.orchestra.run.smithi039:> ip netns list 2024-09-12T02:35:33.163 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-12T02:35:33.163 DEBUG:teuthology.orchestra.run.smithi039:> ip netns list-id 2024-09-12T02:35:33.239 DEBUG:teuthology.orchestra.run.smithi039:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-09-12T02:35:33.239 DEBUG:teuthology.orchestra.run.smithi039:> set -e 2024-09-12T02:35:33.239 DEBUG:teuthology.orchestra.run.smithi039:> sudo ip netns add ceph-ns--home-ubuntu-cephtest-mnt.admin 2024-09-12T02:35:33.239 DEBUG:teuthology.orchestra.run.smithi039:> sudo ip netns set ceph-ns--home-ubuntu-cephtest-mnt.admin 0 2024-09-12T02:35:33.239 DEBUG:teuthology.orchestra.run.smithi039:> ') 2024-09-12T02:35:33.357 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:35:33 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-09-12T02:35:33.409 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:35:33 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-12T02:35:33.417 INFO:tasks.cephfs.mount:Setuping the netns 'ceph-ns--home-ubuntu-cephtest-mnt.admin' with 192.168.0.1/16 2024-09-12T02:35:33.417 DEBUG:teuthology.orchestra.run.smithi039:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-09-12T02:35:33.417 DEBUG:teuthology.orchestra.run.smithi039:> set -e 2024-09-12T02:35:33.417 DEBUG:teuthology.orchestra.run.smithi039:> sudo ip link add veth0 netns ceph-ns--home-ubuntu-cephtest-mnt.admin type veth peer name brx.0 2024-09-12T02:35:33.417 DEBUG:teuthology.orchestra.run.smithi039:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.admin ip addr add 192.168.0.1/16 brd 192.168.255.255 dev veth0 2024-09-12T02:35:33.417 DEBUG:teuthology.orchestra.run.smithi039:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.admin ip link set veth0 up 2024-09-12T02:35:33.418 DEBUG:teuthology.orchestra.run.smithi039:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.admin ip link set lo up 2024-09-12T02:35:33.418 DEBUG:teuthology.orchestra.run.smithi039:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.admin ip route add default via 192.168.255.254 2024-09-12T02:35:33.418 DEBUG:teuthology.orchestra.run.smithi039:> ') 2024-09-12T02:35:33.497 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:35:33 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-09-12T02:35:33.661 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:35:33 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-12T02:35:33.670 DEBUG:teuthology.orchestra.run.smithi039:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-09-12T02:35:33.670 DEBUG:teuthology.orchestra.run.smithi039:> set -e 2024-09-12T02:35:33.670 DEBUG:teuthology.orchestra.run.smithi039:> sudo ip link set brx.0 up 2024-09-12T02:35:33.670 DEBUG:teuthology.orchestra.run.smithi039:> sudo ip link set dev brx.0 master ceph-brx 2024-09-12T02:35:33.670 DEBUG:teuthology.orchestra.run.smithi039:> ') 2024-09-12T02:35:33.749 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:35:33 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-09-12T02:35:33.831 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:35:33 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-12T02:35:33.871 INFO:tasks.cephfs.fuse_mount:Client client.admin config is {} 2024-09-12T02:35:33.871 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-09-12T02:35:33.871 DEBUG:teuthology.orchestra.run.smithi039:> mkdir -p -v /home/ubuntu/cephtest/mnt.admin 2024-09-12T02:35:33.907 INFO:teuthology.orchestra.run.smithi039.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.admin' 2024-09-12T02:35:33.907 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-09-12T02:35:33.907 DEBUG:teuthology.orchestra.run.smithi039:> chmod 0000 /home/ubuntu/cephtest/mnt.admin 2024-09-12T02:35:33.982 DEBUG:teuthology.orchestra.run.smithi039:> sudo modprobe fuse 2024-09-12T02:35:34.081 DEBUG:teuthology.orchestra.run.smithi039:> cat /proc/self/mounts | awk '{print $2}' 2024-09-12T02:35:34.118 INFO:teuthology.orchestra.run.smithi039.stdout:/proc 2024-09-12T02:35:34.119 INFO:teuthology.orchestra.run.smithi039.stdout:/sys 2024-09-12T02:35:34.119 INFO:teuthology.orchestra.run.smithi039.stdout:/dev 2024-09-12T02:35:34.119 INFO:teuthology.orchestra.run.smithi039.stdout:/sys/kernel/security 2024-09-12T02:35:34.119 INFO:teuthology.orchestra.run.smithi039.stdout:/dev/shm 2024-09-12T02:35:34.119 INFO:teuthology.orchestra.run.smithi039.stdout:/dev/pts 2024-09-12T02:35:34.119 INFO:teuthology.orchestra.run.smithi039.stdout:/run 2024-09-12T02:35:34.119 INFO:teuthology.orchestra.run.smithi039.stdout:/sys/fs/cgroup 2024-09-12T02:35:34.119 INFO:teuthology.orchestra.run.smithi039.stdout:/sys/fs/pstore 2024-09-12T02:35:34.119 INFO:teuthology.orchestra.run.smithi039.stdout:/sys/fs/bpf 2024-09-12T02:35:34.119 INFO:teuthology.orchestra.run.smithi039.stdout:/ 2024-09-12T02:35:34.119 INFO:teuthology.orchestra.run.smithi039.stdout:/sys/fs/selinux 2024-09-12T02:35:34.120 INFO:teuthology.orchestra.run.smithi039.stdout:/proc/sys/fs/binfmt_misc 2024-09-12T02:35:34.120 INFO:teuthology.orchestra.run.smithi039.stdout:/dev/hugepages 2024-09-12T02:35:34.120 INFO:teuthology.orchestra.run.smithi039.stdout:/dev/mqueue 2024-09-12T02:35:34.120 INFO:teuthology.orchestra.run.smithi039.stdout:/sys/kernel/debug 2024-09-12T02:35:34.120 INFO:teuthology.orchestra.run.smithi039.stdout:/sys/kernel/tracing 2024-09-12T02:35:34.120 INFO:teuthology.orchestra.run.smithi039.stdout:/sys/fs/fuse/connections 2024-09-12T02:35:34.120 INFO:teuthology.orchestra.run.smithi039.stdout:/sys/kernel/config 2024-09-12T02:35:34.120 INFO:teuthology.orchestra.run.smithi039.stdout:/run/credentials/systemd-sysctl.service 2024-09-12T02:35:34.120 INFO:teuthology.orchestra.run.smithi039.stdout:/run/credentials/systemd-tmpfiles-setup-dev.service 2024-09-12T02:35:34.120 INFO:teuthology.orchestra.run.smithi039.stdout:/run/credentials/systemd-tmpfiles-setup.service 2024-09-12T02:35:34.120 INFO:teuthology.orchestra.run.smithi039.stdout:/var/lib/nfs/rpc_pipefs 2024-09-12T02:35:34.120 INFO:teuthology.orchestra.run.smithi039.stdout:/run/user/1000 2024-09-12T02:35:34.120 INFO:teuthology.orchestra.run.smithi039.stdout:/var/lib/ceph 2024-09-12T02:35:34.121 INFO:teuthology.orchestra.run.smithi039.stdout:/var/lib/containers/storage/overlay 2024-09-12T02:35:34.121 INFO:teuthology.orchestra.run.smithi039.stdout:/var/lib/containers/storage/overlay/c70ead858e8e7f0a56cb6ea98bf246eebaa129d7d30951eb688cecd9e2cd5a73/merged 2024-09-12T02:35:34.121 INFO:teuthology.orchestra.run.smithi039.stdout:/var/lib/containers/storage/overlay/ae1e32ea00ee8710591441165d6cf7ec4e4ab52a3b4a620a119fb5967baa67da/merged 2024-09-12T02:35:34.121 INFO:teuthology.orchestra.run.smithi039.stdout:/run/user/0 2024-09-12T02:35:34.121 INFO:teuthology.orchestra.run.smithi039.stdout:/proc/sys/fs/binfmt_misc 2024-09-12T02:35:34.121 INFO:teuthology.orchestra.run.smithi039.stdout:/var/lib/containers/storage/overlay/c64524426628072ac497c8df3ddd1941d7b3341fec127addfe29f373ab6d3eb2/merged 2024-09-12T02:35:34.121 INFO:teuthology.orchestra.run.smithi039.stdout:/var/lib/containers/storage/overlay/b81cd18358a06aa100045ddb123113b47300590fb03da02cabd8b221fe47ef2c/merged 2024-09-12T02:35:34.121 INFO:teuthology.orchestra.run.smithi039.stdout:/var/lib/containers/storage/overlay/411832e26d5ce29d368b041705587622506b9634a1bf9d837fae4e7608a0e78e/merged 2024-09-12T02:35:34.121 INFO:teuthology.orchestra.run.smithi039.stdout:/var/lib/containers/storage/overlay/202d87372645a4a567cb6a5a4e3ffcef2c0fa8cfcbec78b9dfaf4a9ef35fbed1/merged 2024-09-12T02:35:34.121 INFO:teuthology.orchestra.run.smithi039.stdout:/var/lib/containers/storage/overlay/ad21c994f7989765949314bdbb57c5d7afea11bf411944b65fd643ad84da7297/merged 2024-09-12T02:35:34.121 INFO:teuthology.orchestra.run.smithi039.stdout:/var/lib/containers/storage/overlay/4e6c5e317752f1c99f1dbedfabc3b36f49c9ea9ed15c5673b298390a2bae7d84/merged 2024-09-12T02:35:34.121 INFO:teuthology.orchestra.run.smithi039.stdout:/var/lib/containers/storage/overlay/33beaddf657214b0886f017c70ac0383e5f2112b410eb643f7d535679dd82ce5/merged 2024-09-12T02:35:34.121 INFO:teuthology.orchestra.run.smithi039.stdout:/var/lib/containers/storage/overlay/60fccec7cc665d8945174a5d5a57b7fdf965cb2fd816736b0369494d839be8f1/merged 2024-09-12T02:35:34.121 INFO:teuthology.orchestra.run.smithi039.stdout:/run/netns 2024-09-12T02:35:34.122 INFO:teuthology.orchestra.run.smithi039.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.admin 2024-09-12T02:35:34.122 INFO:teuthology.orchestra.run.smithi039.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.admin 2024-09-12T02:35:34.123 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-12T02:35:34.123 DEBUG:teuthology.orchestra.run.smithi039:> ls /sys/fs/fuse/connections 2024-09-12T02:35:34.205 INFO:tasks.cephfs.fuse_mount:Pre-mount connections: [] 2024-09-12T02:35:34.205 DEBUG:teuthology.orchestra.run.smithi039:> (cd /home/ubuntu/cephtest && exec sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.admin sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-fuse -f --admin-socket '/var/run/ceph/$cluster-$name.$pid.asok' /home/ubuntu/cephtest/mnt.admin --id admin --client_fs=cephfs) 2024-09-12T02:35:34.251 DEBUG:teuthology.orchestra.run.smithi039:> sudo modprobe fuse 2024-09-12T02:35:34.311 DEBUG:teuthology.orchestra.run.smithi039:> cat /proc/self/mounts | awk '{print $2}' 2024-09-12T02:35:34.355 INFO:teuthology.orchestra.run.smithi039.stdout:/proc 2024-09-12T02:35:34.355 INFO:teuthology.orchestra.run.smithi039.stdout:/sys 2024-09-12T02:35:34.355 INFO:teuthology.orchestra.run.smithi039.stdout:/dev 2024-09-12T02:35:34.356 INFO:teuthology.orchestra.run.smithi039.stdout:/sys/kernel/security 2024-09-12T02:35:34.356 INFO:teuthology.orchestra.run.smithi039.stdout:/dev/shm 2024-09-12T02:35:34.356 INFO:teuthology.orchestra.run.smithi039.stdout:/dev/pts 2024-09-12T02:35:34.356 INFO:teuthology.orchestra.run.smithi039.stdout:/run 2024-09-12T02:35:34.356 INFO:teuthology.orchestra.run.smithi039.stdout:/sys/fs/cgroup 2024-09-12T02:35:34.356 INFO:teuthology.orchestra.run.smithi039.stdout:/sys/fs/pstore 2024-09-12T02:35:34.357 INFO:teuthology.orchestra.run.smithi039.stdout:/sys/fs/bpf 2024-09-12T02:35:34.357 INFO:teuthology.orchestra.run.smithi039.stdout:/ 2024-09-12T02:35:34.357 INFO:teuthology.orchestra.run.smithi039.stdout:/sys/fs/selinux 2024-09-12T02:35:34.357 INFO:teuthology.orchestra.run.smithi039.stdout:/proc/sys/fs/binfmt_misc 2024-09-12T02:35:34.357 INFO:teuthology.orchestra.run.smithi039.stdout:/dev/hugepages 2024-09-12T02:35:34.357 INFO:teuthology.orchestra.run.smithi039.stdout:/dev/mqueue 2024-09-12T02:35:34.357 INFO:teuthology.orchestra.run.smithi039.stdout:/sys/kernel/debug 2024-09-12T02:35:34.357 INFO:teuthology.orchestra.run.smithi039.stdout:/sys/kernel/tracing 2024-09-12T02:35:34.357 INFO:teuthology.orchestra.run.smithi039.stdout:/sys/fs/fuse/connections 2024-09-12T02:35:34.357 INFO:teuthology.orchestra.run.smithi039.stdout:/sys/kernel/config 2024-09-12T02:35:34.357 INFO:teuthology.orchestra.run.smithi039.stdout:/run/credentials/systemd-sysctl.service 2024-09-12T02:35:34.357 INFO:teuthology.orchestra.run.smithi039.stdout:/run/credentials/systemd-tmpfiles-setup-dev.service 2024-09-12T02:35:34.358 INFO:teuthology.orchestra.run.smithi039.stdout:/run/credentials/systemd-tmpfiles-setup.service 2024-09-12T02:35:34.358 INFO:teuthology.orchestra.run.smithi039.stdout:/var/lib/nfs/rpc_pipefs 2024-09-12T02:35:34.358 INFO:teuthology.orchestra.run.smithi039.stdout:/run/user/1000 2024-09-12T02:35:34.358 INFO:teuthology.orchestra.run.smithi039.stdout:/var/lib/ceph 2024-09-12T02:35:34.358 INFO:teuthology.orchestra.run.smithi039.stdout:/var/lib/containers/storage/overlay 2024-09-12T02:35:34.358 INFO:teuthology.orchestra.run.smithi039.stdout:/var/lib/containers/storage/overlay/c70ead858e8e7f0a56cb6ea98bf246eebaa129d7d30951eb688cecd9e2cd5a73/merged 2024-09-12T02:35:34.358 INFO:teuthology.orchestra.run.smithi039.stdout:/var/lib/containers/storage/overlay/ae1e32ea00ee8710591441165d6cf7ec4e4ab52a3b4a620a119fb5967baa67da/merged 2024-09-12T02:35:34.358 INFO:teuthology.orchestra.run.smithi039.stdout:/run/user/0 2024-09-12T02:35:34.358 INFO:teuthology.orchestra.run.smithi039.stdout:/proc/sys/fs/binfmt_misc 2024-09-12T02:35:34.358 INFO:teuthology.orchestra.run.smithi039.stdout:/var/lib/containers/storage/overlay/c64524426628072ac497c8df3ddd1941d7b3341fec127addfe29f373ab6d3eb2/merged 2024-09-12T02:35:34.359 INFO:teuthology.orchestra.run.smithi039.stdout:/var/lib/containers/storage/overlay/b81cd18358a06aa100045ddb123113b47300590fb03da02cabd8b221fe47ef2c/merged 2024-09-12T02:35:34.359 INFO:teuthology.orchestra.run.smithi039.stdout:/var/lib/containers/storage/overlay/411832e26d5ce29d368b041705587622506b9634a1bf9d837fae4e7608a0e78e/merged 2024-09-12T02:35:34.359 INFO:teuthology.orchestra.run.smithi039.stdout:/var/lib/containers/storage/overlay/202d87372645a4a567cb6a5a4e3ffcef2c0fa8cfcbec78b9dfaf4a9ef35fbed1/merged 2024-09-12T02:35:34.359 INFO:teuthology.orchestra.run.smithi039.stdout:/var/lib/containers/storage/overlay/ad21c994f7989765949314bdbb57c5d7afea11bf411944b65fd643ad84da7297/merged 2024-09-12T02:35:34.359 INFO:teuthology.orchestra.run.smithi039.stdout:/var/lib/containers/storage/overlay/4e6c5e317752f1c99f1dbedfabc3b36f49c9ea9ed15c5673b298390a2bae7d84/merged 2024-09-12T02:35:34.359 INFO:teuthology.orchestra.run.smithi039.stdout:/var/lib/containers/storage/overlay/33beaddf657214b0886f017c70ac0383e5f2112b410eb643f7d535679dd82ce5/merged 2024-09-12T02:35:34.359 INFO:teuthology.orchestra.run.smithi039.stdout:/var/lib/containers/storage/overlay/60fccec7cc665d8945174a5d5a57b7fdf965cb2fd816736b0369494d839be8f1/merged 2024-09-12T02:35:34.359 INFO:teuthology.orchestra.run.smithi039.stdout:/run/netns 2024-09-12T02:35:34.359 INFO:teuthology.orchestra.run.smithi039.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.admin 2024-09-12T02:35:34.359 INFO:teuthology.orchestra.run.smithi039.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.admin 2024-09-12T02:35:34.360 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-12T02:35:34.360 DEBUG:teuthology.orchestra.run.smithi039:> ls /sys/fs/fuse/connections 2024-09-12T02:35:34.428 INFO:tasks.cephfs.fuse_mount.ceph-fuse.admin.smithi039.stderr:2024-09-12T02:35:34.427+0000 7fa40e723480 -1 init, newargv = 0x55c26eb4b200 newargc=15 2024-09-12T02:35:34.428 INFO:tasks.cephfs.fuse_mount.ceph-fuse.admin.smithi039.stderr:ceph-fuse[73867]: starting ceph client 2024-09-12T02:35:34.439 INFO:tasks.cephfs.fuse_mount.ceph-fuse.admin.smithi039.stderr:ceph-fuse[73867]: starting fuse 2024-09-12T02:35:34.948 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 12 02:35:34 smithi044 ceph-mon[35411]: pgmap v315: 129 pgs: 129 active+clean; 579 KiB data, 346 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-12T02:35:35.013 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 12 02:35:34 smithi172 ceph-mon[35609]: pgmap v315: 129 pgs: 129 active+clean; 579 KiB data, 346 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-12T02:35:35.099 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 02:35:34 smithi039 ceph-mon[30515]: pgmap v315: 129 pgs: 129 active+clean; 579 KiB data, 346 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-12T02:35:35.535 DEBUG:teuthology.orchestra.run.smithi039:> sudo modprobe fuse 2024-09-12T02:35:35.594 DEBUG:teuthology.orchestra.run.smithi039:> cat /proc/self/mounts | awk '{print $2}' 2024-09-12T02:35:35.631 INFO:teuthology.orchestra.run.smithi039.stdout:/proc 2024-09-12T02:35:35.631 INFO:teuthology.orchestra.run.smithi039.stdout:/sys 2024-09-12T02:35:35.631 INFO:teuthology.orchestra.run.smithi039.stdout:/dev 2024-09-12T02:35:35.631 INFO:teuthology.orchestra.run.smithi039.stdout:/sys/kernel/security 2024-09-12T02:35:35.632 INFO:teuthology.orchestra.run.smithi039.stdout:/dev/shm 2024-09-12T02:35:35.632 INFO:teuthology.orchestra.run.smithi039.stdout:/dev/pts 2024-09-12T02:35:35.632 INFO:teuthology.orchestra.run.smithi039.stdout:/run 2024-09-12T02:35:35.632 INFO:teuthology.orchestra.run.smithi039.stdout:/sys/fs/cgroup 2024-09-12T02:35:35.632 INFO:teuthology.orchestra.run.smithi039.stdout:/sys/fs/pstore 2024-09-12T02:35:35.632 INFO:teuthology.orchestra.run.smithi039.stdout:/sys/fs/bpf 2024-09-12T02:35:35.632 INFO:teuthology.orchestra.run.smithi039.stdout:/ 2024-09-12T02:35:35.632 INFO:teuthology.orchestra.run.smithi039.stdout:/sys/fs/selinux 2024-09-12T02:35:35.632 INFO:teuthology.orchestra.run.smithi039.stdout:/proc/sys/fs/binfmt_misc 2024-09-12T02:35:35.632 INFO:teuthology.orchestra.run.smithi039.stdout:/dev/hugepages 2024-09-12T02:35:35.633 INFO:teuthology.orchestra.run.smithi039.stdout:/dev/mqueue 2024-09-12T02:35:35.633 INFO:teuthology.orchestra.run.smithi039.stdout:/sys/kernel/debug 2024-09-12T02:35:35.633 INFO:teuthology.orchestra.run.smithi039.stdout:/sys/kernel/tracing 2024-09-12T02:35:35.633 INFO:teuthology.orchestra.run.smithi039.stdout:/sys/fs/fuse/connections 2024-09-12T02:35:35.633 INFO:teuthology.orchestra.run.smithi039.stdout:/sys/kernel/config 2024-09-12T02:35:35.633 INFO:teuthology.orchestra.run.smithi039.stdout:/run/credentials/systemd-sysctl.service 2024-09-12T02:35:35.633 INFO:teuthology.orchestra.run.smithi039.stdout:/run/credentials/systemd-tmpfiles-setup-dev.service 2024-09-12T02:35:35.633 INFO:teuthology.orchestra.run.smithi039.stdout:/run/credentials/systemd-tmpfiles-setup.service 2024-09-12T02:35:35.633 INFO:teuthology.orchestra.run.smithi039.stdout:/var/lib/nfs/rpc_pipefs 2024-09-12T02:35:35.633 INFO:teuthology.orchestra.run.smithi039.stdout:/run/user/1000 2024-09-12T02:35:35.634 INFO:teuthology.orchestra.run.smithi039.stdout:/var/lib/ceph 2024-09-12T02:35:35.634 INFO:teuthology.orchestra.run.smithi039.stdout:/var/lib/containers/storage/overlay 2024-09-12T02:35:35.634 INFO:teuthology.orchestra.run.smithi039.stdout:/var/lib/containers/storage/overlay/c70ead858e8e7f0a56cb6ea98bf246eebaa129d7d30951eb688cecd9e2cd5a73/merged 2024-09-12T02:35:35.634 INFO:teuthology.orchestra.run.smithi039.stdout:/var/lib/containers/storage/overlay/ae1e32ea00ee8710591441165d6cf7ec4e4ab52a3b4a620a119fb5967baa67da/merged 2024-09-12T02:35:35.634 INFO:teuthology.orchestra.run.smithi039.stdout:/run/user/0 2024-09-12T02:35:35.634 INFO:teuthology.orchestra.run.smithi039.stdout:/proc/sys/fs/binfmt_misc 2024-09-12T02:35:35.634 INFO:teuthology.orchestra.run.smithi039.stdout:/var/lib/containers/storage/overlay/c64524426628072ac497c8df3ddd1941d7b3341fec127addfe29f373ab6d3eb2/merged 2024-09-12T02:35:35.634 INFO:teuthology.orchestra.run.smithi039.stdout:/var/lib/containers/storage/overlay/b81cd18358a06aa100045ddb123113b47300590fb03da02cabd8b221fe47ef2c/merged 2024-09-12T02:35:35.634 INFO:teuthology.orchestra.run.smithi039.stdout:/var/lib/containers/storage/overlay/411832e26d5ce29d368b041705587622506b9634a1bf9d837fae4e7608a0e78e/merged 2024-09-12T02:35:35.634 INFO:teuthology.orchestra.run.smithi039.stdout:/var/lib/containers/storage/overlay/202d87372645a4a567cb6a5a4e3ffcef2c0fa8cfcbec78b9dfaf4a9ef35fbed1/merged 2024-09-12T02:35:35.634 INFO:teuthology.orchestra.run.smithi039.stdout:/var/lib/containers/storage/overlay/ad21c994f7989765949314bdbb57c5d7afea11bf411944b65fd643ad84da7297/merged 2024-09-12T02:35:35.635 INFO:teuthology.orchestra.run.smithi039.stdout:/var/lib/containers/storage/overlay/4e6c5e317752f1c99f1dbedfabc3b36f49c9ea9ed15c5673b298390a2bae7d84/merged 2024-09-12T02:35:35.635 INFO:teuthology.orchestra.run.smithi039.stdout:/var/lib/containers/storage/overlay/33beaddf657214b0886f017c70ac0383e5f2112b410eb643f7d535679dd82ce5/merged 2024-09-12T02:35:35.635 INFO:teuthology.orchestra.run.smithi039.stdout:/var/lib/containers/storage/overlay/60fccec7cc665d8945174a5d5a57b7fdf965cb2fd816736b0369494d839be8f1/merged 2024-09-12T02:35:35.635 INFO:teuthology.orchestra.run.smithi039.stdout:/run/netns 2024-09-12T02:35:35.635 INFO:teuthology.orchestra.run.smithi039.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.admin 2024-09-12T02:35:35.635 INFO:teuthology.orchestra.run.smithi039.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.admin 2024-09-12T02:35:35.635 INFO:teuthology.orchestra.run.smithi039.stdout:/home/ubuntu/cephtest/mnt.admin 2024-09-12T02:35:35.636 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-12T02:35:35.636 DEBUG:teuthology.orchestra.run.smithi039:> ls /sys/fs/fuse/connections 2024-09-12T02:35:35.713 INFO:teuthology.orchestra.run.smithi039.stdout:108 2024-09-12T02:35:35.713 INFO:tasks.cephfs.fuse_mount:Post-mount connections: [108] 2024-09-12T02:35:35.714 DEBUG:teuthology.orchestra.run.smithi039:> sudo stdin-killer -- python3 -c ' 2024-09-12T02:35:35.714 DEBUG:teuthology.orchestra.run.smithi039:> import glob 2024-09-12T02:35:35.714 DEBUG:teuthology.orchestra.run.smithi039:> import re 2024-09-12T02:35:35.714 DEBUG:teuthology.orchestra.run.smithi039:> import os 2024-09-12T02:35:35.714 DEBUG:teuthology.orchestra.run.smithi039:> import subprocess 2024-09-12T02:35:35.714 DEBUG:teuthology.orchestra.run.smithi039:> 2024-09-12T02:35:35.714 DEBUG:teuthology.orchestra.run.smithi039:> def _find_admin_socket(client_name): 2024-09-12T02:35:35.714 DEBUG:teuthology.orchestra.run.smithi039:> asok_path = "/var/run/ceph/ceph-client.admin.*.asok" 2024-09-12T02:35:35.714 DEBUG:teuthology.orchestra.run.smithi039:> files = glob.glob(asok_path) 2024-09-12T02:35:35.715 DEBUG:teuthology.orchestra.run.smithi039:> mountpoint = "/home/ubuntu/cephtest/mnt.admin" 2024-09-12T02:35:35.715 DEBUG:teuthology.orchestra.run.smithi039:> 2024-09-12T02:35:35.715 DEBUG:teuthology.orchestra.run.smithi039:> # Given a non-glob path, it better be there 2024-09-12T02:35:35.715 DEBUG:teuthology.orchestra.run.smithi039:> if "*" not in asok_path: 2024-09-12T02:35:35.715 DEBUG:teuthology.orchestra.run.smithi039:> assert(len(files) == 1) 2024-09-12T02:35:35.715 DEBUG:teuthology.orchestra.run.smithi039:> return files[0] 2024-09-12T02:35:35.715 DEBUG:teuthology.orchestra.run.smithi039:> 2024-09-12T02:35:35.715 DEBUG:teuthology.orchestra.run.smithi039:> for f in files: 2024-09-12T02:35:35.715 DEBUG:teuthology.orchestra.run.smithi039:> pid = re.match(".*\.(\d+)\.asok$", f).group(1) 2024-09-12T02:35:35.715 DEBUG:teuthology.orchestra.run.smithi039:> if os.path.exists("/proc/{0}".format(pid)): 2024-09-12T02:35:35.715 DEBUG:teuthology.orchestra.run.smithi039:> with open("/proc/{0}/cmdline".format(pid), '"'"'r'"'"') as proc_f: 2024-09-12T02:35:35.715 DEBUG:teuthology.orchestra.run.smithi039:> contents = proc_f.read() 2024-09-12T02:35:35.715 DEBUG:teuthology.orchestra.run.smithi039:> if mountpoint in contents: 2024-09-12T02:35:35.715 DEBUG:teuthology.orchestra.run.smithi039:> return f 2024-09-12T02:35:35.715 DEBUG:teuthology.orchestra.run.smithi039:> raise RuntimeError("Client socket {0} not found".format(client_name)) 2024-09-12T02:35:35.716 DEBUG:teuthology.orchestra.run.smithi039:> 2024-09-12T02:35:35.716 DEBUG:teuthology.orchestra.run.smithi039:> print(_find_admin_socket("client.admin")) 2024-09-12T02:35:35.716 DEBUG:teuthology.orchestra.run.smithi039:> ' 2024-09-12T02:35:35.877 INFO:teuthology.orchestra.run.smithi039.stdout:/var/run/ceph/ceph-client.admin.73867.asok 2024-09-12T02:35:35.881 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:35:35 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-12T02:35:35.891 INFO:tasks.cephfs.fuse_mount:Found client admin socket at /var/run/ceph/ceph-client.admin.73867.asok 2024-09-12T02:35:35.891 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-12T02:35:35.892 DEBUG:teuthology.orchestra.run.smithi039:> sudo ceph --admin-daemon /var/run/ceph/ceph-client.admin.73867.asok status 2024-09-12T02:35:36.076 INFO:teuthology.orchestra.run.smithi039.stdout:{ 2024-09-12T02:35:36.077 INFO:teuthology.orchestra.run.smithi039.stdout: "metadata": { 2024-09-12T02:35:36.077 INFO:teuthology.orchestra.run.smithi039.stdout: "ceph_sha1": "b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc", 2024-09-12T02:35:36.077 INFO:teuthology.orchestra.run.smithi039.stdout: "ceph_version": "ceph version 19.1.1-298-gb53b6d3e (b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc) squid (stable)", 2024-09-12T02:35:36.077 INFO:teuthology.orchestra.run.smithi039.stdout: "entity_id": "admin", 2024-09-12T02:35:36.077 INFO:teuthology.orchestra.run.smithi039.stdout: "hostname": "smithi039", 2024-09-12T02:35:36.077 INFO:teuthology.orchestra.run.smithi039.stdout: "mount_point": "/home/ubuntu/cephtest/mnt.admin", 2024-09-12T02:35:36.077 INFO:teuthology.orchestra.run.smithi039.stdout: "pid": "73867", 2024-09-12T02:35:36.077 INFO:teuthology.orchestra.run.smithi039.stdout: "root": "/" 2024-09-12T02:35:36.078 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-09-12T02:35:36.078 INFO:teuthology.orchestra.run.smithi039.stdout: "dentry_count": 0, 2024-09-12T02:35:36.078 INFO:teuthology.orchestra.run.smithi039.stdout: "dentry_pinned_count": 0, 2024-09-12T02:35:36.078 INFO:teuthology.orchestra.run.smithi039.stdout: "id": 24629, 2024-09-12T02:35:36.078 INFO:teuthology.orchestra.run.smithi039.stdout: "inst": { 2024-09-12T02:35:36.078 INFO:teuthology.orchestra.run.smithi039.stdout: "name": { 2024-09-12T02:35:36.078 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "client", 2024-09-12T02:35:36.078 INFO:teuthology.orchestra.run.smithi039.stdout: "num": 24629 2024-09-12T02:35:36.078 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-09-12T02:35:36.078 INFO:teuthology.orchestra.run.smithi039.stdout: "addr": { 2024-09-12T02:35:36.078 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "v1", 2024-09-12T02:35:36.079 INFO:teuthology.orchestra.run.smithi039.stdout: "addr": "192.168.0.1:0", 2024-09-12T02:35:36.079 INFO:teuthology.orchestra.run.smithi039.stdout: "nonce": 822194004 2024-09-12T02:35:36.079 INFO:teuthology.orchestra.run.smithi039.stdout: } 2024-09-12T02:35:36.079 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-09-12T02:35:36.079 INFO:teuthology.orchestra.run.smithi039.stdout: "addr": { 2024-09-12T02:35:36.079 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "v1", 2024-09-12T02:35:36.079 INFO:teuthology.orchestra.run.smithi039.stdout: "addr": "192.168.0.1:0", 2024-09-12T02:35:36.079 INFO:teuthology.orchestra.run.smithi039.stdout: "nonce": 822194004 2024-09-12T02:35:36.079 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-09-12T02:35:36.079 INFO:teuthology.orchestra.run.smithi039.stdout: "inst_str": "client.24629 192.168.0.1:0/822194004", 2024-09-12T02:35:36.079 INFO:teuthology.orchestra.run.smithi039.stdout: "addr_str": "192.168.0.1:0/822194004", 2024-09-12T02:35:36.080 INFO:teuthology.orchestra.run.smithi039.stdout: "inode_count": 1, 2024-09-12T02:35:36.080 INFO:teuthology.orchestra.run.smithi039.stdout: "mds_epoch": 17, 2024-09-12T02:35:36.080 INFO:teuthology.orchestra.run.smithi039.stdout: "osd_epoch": 91, 2024-09-12T02:35:36.080 INFO:teuthology.orchestra.run.smithi039.stdout: "osd_epoch_barrier": 0, 2024-09-12T02:35:36.080 INFO:teuthology.orchestra.run.smithi039.stdout: "blocklisted": false, 2024-09-12T02:35:36.080 INFO:teuthology.orchestra.run.smithi039.stdout: "fs_name": "cephfs" 2024-09-12T02:35:36.080 INFO:teuthology.orchestra.run.smithi039.stdout:} 2024-09-12T02:35:36.090 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-12T02:35:36.090 DEBUG:teuthology.orchestra.run.smithi039:> stat --file-system '--printf=%T 2024-09-12T02:35:36.090 DEBUG:teuthology.orchestra.run.smithi039:> ' -- /home/ubuntu/cephtest/mnt.admin 2024-09-12T02:35:36.126 INFO:teuthology.orchestra.run.smithi039.stdout:fuseblk 2024-09-12T02:35:36.126 INFO:tasks.cephfs.fuse_mount:ceph-fuse is mounted on /home/ubuntu/cephtest/mnt.admin 2024-09-12T02:35:36.126 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-12T02:35:36.126 DEBUG:teuthology.orchestra.run.smithi039:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.admin 2024-09-12T02:35:36.225 DEBUG:teuthology.orchestra.run.smithi039:> (cd /home/ubuntu/cephtest/mnt.admin && exec stdin-killer --timeout=900 -- bash -c 'setfattr -n ceph.dir.layout.pool -v cephfs_data_ec . && getfattr -n ceph.dir.layout .') 2024-09-12T02:35:36.308 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:35:36 stdin-killer INFO: expiration expected; waiting 900 seconds for command to complete 2024-09-12T02:35:36.334 INFO:teuthology.orchestra.run.smithi039.stdout:# file: . 2024-09-12T02:35:36.334 INFO:teuthology.orchestra.run.smithi039.stdout:ceph.dir.layout="stripe_unit=4194304 stripe_count=1 object_size=4194304 pool=cephfs_data_ec" 2024-09-12T02:35:36.334 INFO:teuthology.orchestra.run.smithi039.stdout: 2024-09-12T02:35:36.334 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:35:36 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-12T02:35:36.342 DEBUG:teuthology.orchestra.run.smithi039:> set -ex 2024-09-12T02:35:36.342 DEBUG:teuthology.orchestra.run.smithi039:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-12T02:35:36.378 DEBUG:teuthology.orchestra.run.smithi039:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc shell --fsid 4954ed46-70ae-11ef-bcea-c7b262605968 -- ceph osd blocklist ls 2024-09-12T02:35:36.799 INFO:teuthology.orchestra.run.smithi039.stderr:Inferring config /var/lib/ceph/4954ed46-70ae-11ef-bcea-c7b262605968/mon.a/config 2024-09-12T02:35:36.850 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 02:35:36 smithi039 ceph-mon[30515]: pgmap v316: 129 pgs: 129 active+clean; 579 KiB data, 346 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-12T02:35:36.948 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 12 02:35:36 smithi044 ceph-mon[35411]: pgmap v316: 129 pgs: 129 active+clean; 579 KiB data, 346 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-12T02:35:37.013 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 12 02:35:36 smithi172 ceph-mon[35609]: pgmap v316: 129 pgs: 129 active+clean; 579 KiB data, 346 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-12T02:35:37.375 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:35:37.373+0000 7fe509800640 1 -- 172.21.15.39:0/302433320 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fe50410bfc0 msgr2=0x7fe50410e460 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:35:37.375 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:35:37.373+0000 7fe509800640 1 --2- 172.21.15.39:0/302433320 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fe50410bfc0 0x7fe50410e460 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7fe4fc009ca0 tx=0x7fe4fc02a950 comp rx=0 tx=0).stop 2024-09-12T02:35:37.375 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:35:37.374+0000 7fe509800640 1 -- 172.21.15.39:0/302433320 shutdown_connections 2024-09-12T02:35:37.375 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:35:37.374+0000 7fe509800640 1 --2- 172.21.15.39:0/302433320 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fe50410bfc0 0x7fe50410e460 unknown :-1 s=CLOSED pgs=77 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:35:37.375 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:35:37.374+0000 7fe509800640 1 --2- 172.21.15.39:0/302433320 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fe5041034b0 0x7fe50410b9a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:35:37.375 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:35:37.374+0000 7fe509800640 1 --2- 172.21.15.39:0/302433320 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fe504102b90 0x7fe504102f70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:35:37.375 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:35:37.374+0000 7fe509800640 1 -- 172.21.15.39:0/302433320 >> 172.21.15.39:0/302433320 conn(0x7fe5040fc610 msgr2=0x7fe5040fea30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:35:37.376 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:35:37.374+0000 7fe509800640 1 -- 172.21.15.39:0/302433320 shutdown_connections 2024-09-12T02:35:37.376 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:35:37.374+0000 7fe509800640 1 -- 172.21.15.39:0/302433320 wait complete. 2024-09-12T02:35:37.377 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:35:37.375+0000 7fe509800640 1 Processor -- start 2024-09-12T02:35:37.377 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:35:37.375+0000 7fe509800640 1 -- start start 2024-09-12T02:35:37.377 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:35:37.375+0000 7fe509800640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fe504102b90 0x7fe50419a450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:35:37.377 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:35:37.375+0000 7fe509800640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fe5041034b0 0x7fe50419a990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:35:37.377 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:35:37.375+0000 7fe509800640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fe50410bfc0 0x7fe50419ed20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:35:37.377 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:35:37.375+0000 7fe509800640 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 -- 0x7fe504111dd0 con 0x7fe504102b90 2024-09-12T02:35:37.377 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:35:37.375+0000 7fe509800640 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x7fe504111c50 con 0x7fe50410bfc0 2024-09-12T02:35:37.377 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:35:37.375+0000 7fe509800640 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7fe504111f50 con 0x7fe5041034b0 2024-09-12T02:35:37.378 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:35:37.376+0000 7fe503e00640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fe504102b90 0x7fe50419a450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:35:37.378 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:35:37.376+0000 7fe4fbe00640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fe5041034b0 0x7fe50419a990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:35:37.378 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:35:37.376+0000 7fe503e00640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fe504102b90 0x7fe50419a450 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.39:3300/0 says I am v2:172.21.15.39:33626/0 (socket says 172.21.15.39:33626) 2024-09-12T02:35:37.378 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:35:37.376+0000 7fe503e00640 1 -- 172.21.15.39:0/812273666 learned_addr learned my addr 172.21.15.39:0/812273666 (peer_addr_for_me v2:172.21.15.39:0/0) 2024-09-12T02:35:37.378 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:35:37.376+0000 7fe4fbe00640 1 --2- 172.21.15.39:0/812273666 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fe5041034b0 0x7fe50419a990 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.172:3300/0 says I am v2:172.21.15.39:51282/0 (socket says 172.21.15.39:51282) 2024-09-12T02:35:37.378 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:35:37.376+0000 7fe508e00640 1 --2- 172.21.15.39:0/812273666 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fe50410bfc0 0x7fe50419ed20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:35:37.378 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:35:37.376+0000 7fe4fbe00640 1 -- 172.21.15.39:0/812273666 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fe50410bfc0 msgr2=0x7fe50419ed20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:35:37.378 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:35:37.376+0000 7fe4fbe00640 1 --2- 172.21.15.39:0/812273666 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fe50410bfc0 0x7fe50419ed20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:35:37.378 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:35:37.376+0000 7fe4fbe00640 1 -- 172.21.15.39:0/812273666 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fe504102b90 msgr2=0x7fe50419a450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:35:37.378 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:35:37.376+0000 7fe4fbe00640 1 --2- 172.21.15.39:0/812273666 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fe504102b90 0x7fe50419a450 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:35:37.378 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:35:37.376+0000 7fe4fbe00640 1 -- 172.21.15.39:0/812273666 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe50419f400 con 0x7fe5041034b0 2024-09-12T02:35:37.378 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:35:37.376+0000 7fe4fbe00640 1 --2- 172.21.15.39:0/812273666 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fe5041034b0 0x7fe50419a990 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7fe4ec00e7a0 tx=0x7fe4ec00ec60 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:35:37.379 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:35:37.377+0000 7fe501600640 1 -- 172.21.15.39:0/812273666 <== mon.1 v2:172.21.15.172:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe4ec00ccc0 con 0x7fe5041034b0 2024-09-12T02:35:37.379 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:35:37.377+0000 7fe501600640 1 -- 172.21.15.39:0/812273666 <== mon.1 v2:172.21.15.172:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fe4ec009530 con 0x7fe5041034b0 2024-09-12T02:35:37.379 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:35:37.377+0000 7fe501600640 1 -- 172.21.15.39:0/812273666 <== mon.1 v2:172.21.15.172:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe4ec018880 con 0x7fe5041034b0 2024-09-12T02:35:37.379 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:35:37.377+0000 7fe509800640 1 -- 172.21.15.39:0/812273666 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe50419f6f0 con 0x7fe5041034b0 2024-09-12T02:35:37.379 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:35:37.377+0000 7fe509800640 1 -- 172.21.15.39:0/812273666 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe5041a6fd0 con 0x7fe5041034b0 2024-09-12T02:35:37.379 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:35:37.378+0000 7fe509800640 1 -- 172.21.15.39:0/812273666 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fe504102f70 con 0x7fe5041034b0 2024-09-12T02:35:37.380 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:35:37.380+0000 7fe501600640 1 -- 172.21.15.39:0/812273666 <== mon.1 v2:172.21.15.172:3300/0 4 ==== mgrmap(e 16) ==== 137833+0+0 (secure 0 0 0) 0x7fe4ec018a20 con 0x7fe5041034b0 2024-09-12T02:35:37.382 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:35:37.381+0000 7fe501600640 1 --2- 172.21.15.39:0/812273666 >> [v2:172.21.15.39:6800/1725006999,v1:172.21.15.39:6801/1725006999] conn(0x7fe4e80a2c00 0x7fe4e80a50c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:35:37.382 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:35:37.381+0000 7fe501600640 1 -- 172.21.15.39:0/812273666 <== mon.1 v2:172.21.15.172:3300/0 5 ==== osd_map(91..91 src has 1..91) ==== 8802+0+0 (secure 0 0 0) 0x7fe4ec0cf390 con 0x7fe5041034b0 2024-09-12T02:35:37.382 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:35:37.381+0000 7fe503e00640 1 --2- 172.21.15.39:0/812273666 >> [v2:172.21.15.39:6800/1725006999,v1:172.21.15.39:6801/1725006999] conn(0x7fe4e80a2c00 0x7fe4e80a50c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:35:37.383 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:35:37.382+0000 7fe503e00640 1 --2- 172.21.15.39:0/812273666 >> [v2:172.21.15.39:6800/1725006999,v1:172.21.15.39:6801/1725006999] conn(0x7fe4e80a2c00 0x7fe4e80a50c0 secure :-1 s=READY pgs=158 cs=0 l=1 rev1=1 crypto rx=0x7fe4f4009c90 tx=0x7fe4f4005f90 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:35:37.386 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:35:37.385+0000 7fe501600640 1 -- 172.21.15.39:0/812273666 <== mon.1 v2:172.21.15.172:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7fe4ec09ba00 con 0x7fe5041034b0 2024-09-12T02:35:37.584 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:35:37.583+0000 7fe509800640 1 -- 172.21.15.39:0/812273666 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) -- 0x7fe5041a7270 con 0x7fe5041034b0 2024-09-12T02:35:37.585 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:35:37.584+0000 7fe501600640 1 -- 172.21.15.39:0/812273666 <== mon.1 v2:172.21.15.172:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 10 entries v91) ==== 81+0+592 (secure 0 0 0) 0x7fe4ec09fd00 con 0x7fe5041034b0 2024-09-12T02:35:37.585 INFO:teuthology.orchestra.run.smithi039.stdout:172.21.15.39:6800/3152613618 2024-09-13T02:27:44.717224+0000 2024-09-12T02:35:37.585 INFO:teuthology.orchestra.run.smithi039.stdout:172.21.15.39:0/2301206766 2024-09-13T02:27:44.717224+0000 2024-09-12T02:35:37.585 INFO:teuthology.orchestra.run.smithi039.stdout:172.21.15.39:0/1941318538 2024-09-13T02:27:44.717224+0000 2024-09-12T02:35:37.585 INFO:teuthology.orchestra.run.smithi039.stdout:172.21.15.39:0/1527429435 2024-09-13T02:27:44.717224+0000 2024-09-12T02:35:37.585 INFO:teuthology.orchestra.run.smithi039.stdout:172.21.15.39:0/2913347539 2024-09-13T02:27:16.531986+0000 2024-09-12T02:35:37.586 INFO:teuthology.orchestra.run.smithi039.stdout:172.21.15.39:0/2827440002 2024-09-13T02:27:16.531986+0000 2024-09-12T02:35:37.586 INFO:teuthology.orchestra.run.smithi039.stdout:172.21.15.39:0/4075322467 2024-09-13T02:27:16.531986+0000 2024-09-12T02:35:37.586 INFO:teuthology.orchestra.run.smithi039.stdout:172.21.15.39:6801/1074685700 2024-09-13T02:27:16.531986+0000 2024-09-12T02:35:37.586 INFO:teuthology.orchestra.run.smithi039.stdout:172.21.15.39:6801/3152613618 2024-09-13T02:27:44.717224+0000 2024-09-12T02:35:37.586 INFO:teuthology.orchestra.run.smithi039.stdout:172.21.15.39:6800/1074685700 2024-09-13T02:27:16.531986+0000 2024-09-12T02:35:37.586 INFO:teuthology.orchestra.run.smithi039.stderr:listed 10 entries 2024-09-12T02:35:37.589 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:35:37.588+0000 7fe509800640 1 -- 172.21.15.39:0/812273666 >> [v2:172.21.15.39:6800/1725006999,v1:172.21.15.39:6801/1725006999] conn(0x7fe4e80a2c00 msgr2=0x7fe4e80a50c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:35:37.589 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:35:37.588+0000 7fe509800640 1 --2- 172.21.15.39:0/812273666 >> [v2:172.21.15.39:6800/1725006999,v1:172.21.15.39:6801/1725006999] conn(0x7fe4e80a2c00 0x7fe4e80a50c0 secure :-1 s=READY pgs=158 cs=0 l=1 rev1=1 crypto rx=0x7fe4f4009c90 tx=0x7fe4f4005f90 comp rx=0 tx=0).stop 2024-09-12T02:35:37.589 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:35:37.588+0000 7fe509800640 1 -- 172.21.15.39:0/812273666 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fe5041034b0 msgr2=0x7fe50419a990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:35:37.589 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:35:37.588+0000 7fe509800640 1 --2- 172.21.15.39:0/812273666 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fe5041034b0 0x7fe50419a990 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7fe4ec00e7a0 tx=0x7fe4ec00ec60 comp rx=0 tx=0).stop 2024-09-12T02:35:37.589 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:35:37.588+0000 7fe509800640 1 -- 172.21.15.39:0/812273666 shutdown_connections 2024-09-12T02:35:37.589 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:35:37.588+0000 7fe509800640 1 --2- 172.21.15.39:0/812273666 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fe50410bfc0 0x7fe50419ed20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:35:37.589 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:35:37.588+0000 7fe509800640 1 --2- 172.21.15.39:0/812273666 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fe5041034b0 0x7fe50419a990 unknown :-1 s=CLOSED pgs=78 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:35:37.589 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:35:37.588+0000 7fe509800640 1 --2- 172.21.15.39:0/812273666 >> [v2:172.21.15.39:6800/1725006999,v1:172.21.15.39:6801/1725006999] conn(0x7fe4e80a2c00 0x7fe4e80a50c0 unknown :-1 s=CLOSED pgs=158 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:35:37.590 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:35:37.588+0000 7fe509800640 1 --2- 172.21.15.39:0/812273666 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fe504102b90 0x7fe50419a450 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:35:37.590 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:35:37.588+0000 7fe509800640 1 -- 172.21.15.39:0/812273666 >> 172.21.15.39:0/812273666 conn(0x7fe5040fc610 msgr2=0x7fe5040fd210 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:35:37.590 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:35:37.588+0000 7fe509800640 1 -- 172.21.15.39:0/812273666 shutdown_connections 2024-09-12T02:35:37.590 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:35:37.588+0000 7fe509800640 1 -- 172.21.15.39:0/812273666 wait complete. 2024-09-12T02:35:37.850 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 02:35:37 smithi039 ceph-mon[30515]: from='client.? 172.21.15.39:0/812273666' entity='client.admin' cmd=[{"prefix": "osd blocklist ls"}]: dispatch 2024-09-12T02:35:37.948 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 12 02:35:37 smithi044 ceph-mon[35411]: from='client.? 172.21.15.39:0/812273666' entity='client.admin' cmd=[{"prefix": "osd blocklist ls"}]: dispatch 2024-09-12T02:35:38.013 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 12 02:35:37 smithi172 ceph-mon[35609]: from='client.? 172.21.15.39:0/812273666' entity='client.admin' cmd=[{"prefix": "osd blocklist ls"}]: dispatch 2024-09-12T02:35:38.595 DEBUG:teuthology.orchestra.run.smithi039:> set -ex 2024-09-12T02:35:38.595 DEBUG:teuthology.orchestra.run.smithi039:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-12T02:35:38.634 DEBUG:teuthology.orchestra.run.smithi039:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc shell --fsid 4954ed46-70ae-11ef-bcea-c7b262605968 -- ceph osd blocklist ls 2024-09-12T02:35:38.853 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 02:35:38 smithi039 ceph-mon[30515]: pgmap v317: 129 pgs: 129 active+clean; 579 KiB data, 346 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-12T02:35:39.015 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 12 02:35:38 smithi172 ceph-mon[35609]: pgmap v317: 129 pgs: 129 active+clean; 579 KiB data, 346 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-12T02:35:39.054 INFO:teuthology.orchestra.run.smithi039.stderr:Inferring config /var/lib/ceph/4954ed46-70ae-11ef-bcea-c7b262605968/mon.a/config 2024-09-12T02:35:39.198 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 12 02:35:38 smithi044 ceph-mon[35411]: pgmap v317: 129 pgs: 129 active+clean; 579 KiB data, 346 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-12T02:35:39.647 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:35:39.646+0000 7fc90e200640 1 -- 172.21.15.39:0/1105666733 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fc908104010 msgr2=0x7fc9081043f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:35:39.648 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:35:39.646+0000 7fc90e200640 1 --2- 172.21.15.39:0/1105666733 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fc908104010 0x7fc9081043f0 secure :-1 s=READY pgs=169 cs=0 l=1 rev1=1 crypto rx=0x7fc8f8009900 tx=0x7fc8f802a410 comp rx=0 tx=0).stop 2024-09-12T02:35:39.648 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:35:39.646+0000 7fc90e200640 1 -- 172.21.15.39:0/1105666733 shutdown_connections 2024-09-12T02:35:39.648 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:35:39.646+0000 7fc90e200640 1 --2- 172.21.15.39:0/1105666733 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fc908109140 0x7fc908110cc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:35:39.648 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:35:39.646+0000 7fc90e200640 1 --2- 172.21.15.39:0/1105666733 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fc9081049c0 0x7fc908108a10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:35:39.648 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:35:39.646+0000 7fc90e200640 1 --2- 172.21.15.39:0/1105666733 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fc908104010 0x7fc9081043f0 unknown :-1 s=CLOSED pgs=169 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:35:39.648 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:35:39.646+0000 7fc90e200640 1 -- 172.21.15.39:0/1105666733 >> 172.21.15.39:0/1105666733 conn(0x7fc9080ffa50 msgr2=0x7fc908101e70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:35:39.648 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:35:39.646+0000 7fc90e200640 1 -- 172.21.15.39:0/1105666733 shutdown_connections 2024-09-12T02:35:39.648 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:35:39.646+0000 7fc90e200640 1 -- 172.21.15.39:0/1105666733 wait complete. 2024-09-12T02:35:39.649 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:35:39.648+0000 7fc90e200640 1 Processor -- start 2024-09-12T02:35:39.649 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:35:39.648+0000 7fc90e200640 1 -- start start 2024-09-12T02:35:39.649 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:35:39.648+0000 7fc90e200640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fc908104010 0x7fc90819a630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:35:39.649 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:35:39.648+0000 7fc90e200640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fc9081049c0 0x7fc90819ab70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:35:39.649 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:35:39.648+0000 7fc90e200640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fc908109140 0x7fc90819ef00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:35:39.649 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:35:39.648+0000 7fc90e200640 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 -- 0x7fc908114170 con 0x7fc908104010 2024-09-12T02:35:39.650 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:35:39.648+0000 7fc90e200640 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x7fc908113ff0 con 0x7fc9081049c0 2024-09-12T02:35:39.650 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:35:39.648+0000 7fc90e200640 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7fc9081142f0 con 0x7fc908109140 2024-09-12T02:35:39.651 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:35:39.649+0000 7fc907400640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fc908104010 0x7fc90819a630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:35:39.651 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:35:39.649+0000 7fc906a00640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fc9081049c0 0x7fc90819ab70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:35:39.651 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:35:39.649+0000 7fc907e00640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fc908109140 0x7fc90819ef00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:35:39.651 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:35:39.649+0000 7fc906a00640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fc9081049c0 0x7fc90819ab70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.39:55212/0 (socket says 172.21.15.39:55212) 2024-09-12T02:35:39.651 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:35:39.649+0000 7fc906a00640 1 -- 172.21.15.39:0/3210837768 learned_addr learned my addr 172.21.15.39:0/3210837768 (peer_addr_for_me v2:172.21.15.39:0/0) 2024-09-12T02:35:39.651 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:35:39.649+0000 7fc907e00640 1 -- 172.21.15.39:0/3210837768 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fc9081049c0 msgr2=0x7fc90819ab70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:35:39.652 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:35:39.649+0000 7fc907e00640 1 --2- 172.21.15.39:0/3210837768 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fc9081049c0 0x7fc90819ab70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:35:39.652 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:35:39.649+0000 7fc907e00640 1 -- 172.21.15.39:0/3210837768 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fc908104010 msgr2=0x7fc90819a630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:35:39.652 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:35:39.649+0000 7fc907e00640 1 --2- 172.21.15.39:0/3210837768 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fc908104010 0x7fc90819a630 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:35:39.652 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:35:39.649+0000 7fc907e00640 1 -- 172.21.15.39:0/3210837768 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc90819f5e0 con 0x7fc908109140 2024-09-12T02:35:39.652 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:35:39.649+0000 7fc906a00640 1 --2- 172.21.15.39:0/3210837768 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fc9081049c0 0x7fc90819ab70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-12T02:35:39.652 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:35:39.649+0000 7fc907400640 1 --2- 172.21.15.39:0/3210837768 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fc908104010 0x7fc90819a630 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-12T02:35:39.652 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:35:39.650+0000 7fc907e00640 1 --2- 172.21.15.39:0/3210837768 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fc908109140 0x7fc90819ef00 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7fc900009fd0 tx=0x7fc90000ef10 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:35:39.652 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:35:39.650+0000 7fc8ffe00640 1 -- 172.21.15.39:0/3210837768 <== mon.1 v2:172.21.15.172:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc90000ce20 con 0x7fc908109140 2024-09-12T02:35:39.652 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:35:39.650+0000 7fc8ffe00640 1 -- 172.21.15.39:0/3210837768 <== mon.1 v2:172.21.15.172:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fc900005020 con 0x7fc908109140 2024-09-12T02:35:39.652 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:35:39.650+0000 7fc8ffe00640 1 -- 172.21.15.39:0/3210837768 <== mon.1 v2:172.21.15.172:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc900010720 con 0x7fc908109140 2024-09-12T02:35:39.652 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:35:39.650+0000 7fc90e200640 1 -- 172.21.15.39:0/3210837768 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc90819f8d0 con 0x7fc908109140 2024-09-12T02:35:39.653 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:35:39.650+0000 7fc90e200640 1 -- 172.21.15.39:0/3210837768 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc9081a71b0 con 0x7fc908109140 2024-09-12T02:35:39.653 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:35:39.651+0000 7fc90e200640 1 -- 172.21.15.39:0/3210837768 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fc9081043f0 con 0x7fc908109140 2024-09-12T02:35:39.654 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:35:39.653+0000 7fc8ffe00640 1 -- 172.21.15.39:0/3210837768 <== mon.1 v2:172.21.15.172:3300/0 4 ==== mgrmap(e 16) ==== 137833+0+0 (secure 0 0 0) 0x7fc900005540 con 0x7fc908109140 2024-09-12T02:35:39.656 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:35:39.655+0000 7fc8ffe00640 1 --2- 172.21.15.39:0/3210837768 >> [v2:172.21.15.39:6800/1725006999,v1:172.21.15.39:6801/1725006999] conn(0x7fc8ec0a2c00 0x7fc8ec0a50c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:35:39.656 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:35:39.655+0000 7fc8ffe00640 1 -- 172.21.15.39:0/3210837768 <== mon.1 v2:172.21.15.172:3300/0 5 ==== osd_map(91..91 src has 1..91) ==== 8802+0+0 (secure 0 0 0) 0x7fc9000cfad0 con 0x7fc908109140 2024-09-12T02:35:39.656 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:35:39.655+0000 7fc907400640 1 --2- 172.21.15.39:0/3210837768 >> [v2:172.21.15.39:6800/1725006999,v1:172.21.15.39:6801/1725006999] conn(0x7fc8ec0a2c00 0x7fc8ec0a50c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:35:39.656 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:35:39.656+0000 7fc907400640 1 --2- 172.21.15.39:0/3210837768 >> [v2:172.21.15.39:6800/1725006999,v1:172.21.15.39:6801/1725006999] conn(0x7fc8ec0a2c00 0x7fc8ec0a50c0 secure :-1 s=READY pgs=159 cs=0 l=1 rev1=1 crypto rx=0x7fc8f8009230 tx=0x7fc8f80058d0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:35:39.657 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:35:39.657+0000 7fc8ffe00640 1 -- 172.21.15.39:0/3210837768 <== mon.1 v2:172.21.15.172:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7fc90009c820 con 0x7fc908109140 2024-09-12T02:35:39.856 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:35:39.855+0000 7fc90e200640 1 -- 172.21.15.39:0/3210837768 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) -- 0x7fc90819b990 con 0x7fc908109140 2024-09-12T02:35:39.856 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:35:39.856+0000 7fc8ffe00640 1 -- 172.21.15.39:0/3210837768 <== mon.1 v2:172.21.15.172:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 10 entries v91) ==== 81+0+592 (secure 0 0 0) 0x7fc90009c120 con 0x7fc908109140 2024-09-12T02:35:39.857 INFO:teuthology.orchestra.run.smithi039.stdout:172.21.15.39:6800/3152613618 2024-09-13T02:27:44.717224+0000 2024-09-12T02:35:39.857 INFO:teuthology.orchestra.run.smithi039.stdout:172.21.15.39:0/2301206766 2024-09-13T02:27:44.717224+0000 2024-09-12T02:35:39.857 INFO:teuthology.orchestra.run.smithi039.stdout:172.21.15.39:0/1941318538 2024-09-13T02:27:44.717224+0000 2024-09-12T02:35:39.857 INFO:teuthology.orchestra.run.smithi039.stdout:172.21.15.39:0/1527429435 2024-09-13T02:27:44.717224+0000 2024-09-12T02:35:39.857 INFO:teuthology.orchestra.run.smithi039.stdout:172.21.15.39:0/2913347539 2024-09-13T02:27:16.531986+0000 2024-09-12T02:35:39.857 INFO:teuthology.orchestra.run.smithi039.stdout:172.21.15.39:0/2827440002 2024-09-13T02:27:16.531986+0000 2024-09-12T02:35:39.857 INFO:teuthology.orchestra.run.smithi039.stdout:172.21.15.39:0/4075322467 2024-09-13T02:27:16.531986+0000 2024-09-12T02:35:39.857 INFO:teuthology.orchestra.run.smithi039.stdout:172.21.15.39:6801/1074685700 2024-09-13T02:27:16.531986+0000 2024-09-12T02:35:39.858 INFO:teuthology.orchestra.run.smithi039.stdout:172.21.15.39:6801/3152613618 2024-09-13T02:27:44.717224+0000 2024-09-12T02:35:39.858 INFO:teuthology.orchestra.run.smithi039.stdout:172.21.15.39:6800/1074685700 2024-09-13T02:27:16.531986+0000 2024-09-12T02:35:39.858 INFO:teuthology.orchestra.run.smithi039.stderr:listed 10 entries 2024-09-12T02:35:39.859 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:35:39.858+0000 7fc90e200640 1 -- 172.21.15.39:0/3210837768 >> [v2:172.21.15.39:6800/1725006999,v1:172.21.15.39:6801/1725006999] conn(0x7fc8ec0a2c00 msgr2=0x7fc8ec0a50c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:35:39.859 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:35:39.858+0000 7fc90e200640 1 --2- 172.21.15.39:0/3210837768 >> [v2:172.21.15.39:6800/1725006999,v1:172.21.15.39:6801/1725006999] conn(0x7fc8ec0a2c00 0x7fc8ec0a50c0 secure :-1 s=READY pgs=159 cs=0 l=1 rev1=1 crypto rx=0x7fc8f8009230 tx=0x7fc8f80058d0 comp rx=0 tx=0).stop 2024-09-12T02:35:39.859 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:35:39.858+0000 7fc90e200640 1 -- 172.21.15.39:0/3210837768 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fc908109140 msgr2=0x7fc90819ef00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:35:39.859 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:35:39.858+0000 7fc90e200640 1 --2- 172.21.15.39:0/3210837768 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fc908109140 0x7fc90819ef00 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7fc900009fd0 tx=0x7fc90000ef10 comp rx=0 tx=0).stop 2024-09-12T02:35:39.860 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:35:39.858+0000 7fc90e200640 1 -- 172.21.15.39:0/3210837768 shutdown_connections 2024-09-12T02:35:39.860 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:35:39.858+0000 7fc90e200640 1 --2- 172.21.15.39:0/3210837768 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fc908109140 0x7fc90819ef00 unknown :-1 s=CLOSED pgs=79 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:35:39.860 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:35:39.858+0000 7fc90e200640 1 --2- 172.21.15.39:0/3210837768 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fc9081049c0 0x7fc90819ab70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:35:39.860 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:35:39.858+0000 7fc90e200640 1 --2- 172.21.15.39:0/3210837768 >> [v2:172.21.15.39:6800/1725006999,v1:172.21.15.39:6801/1725006999] conn(0x7fc8ec0a2c00 0x7fc8ec0a50c0 unknown :-1 s=CLOSED pgs=159 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:35:39.860 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:35:39.858+0000 7fc90e200640 1 --2- 172.21.15.39:0/3210837768 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fc908104010 0x7fc90819a630 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:35:39.860 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:35:39.858+0000 7fc90e200640 1 -- 172.21.15.39:0/3210837768 >> 172.21.15.39:0/3210837768 conn(0x7fc9080ffa50 msgr2=0x7fc908100de0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:35:39.860 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:35:39.858+0000 7fc90e200640 1 -- 172.21.15.39:0/3210837768 shutdown_connections 2024-09-12T02:35:39.860 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:35:39.858+0000 7fc90e200640 1 -- 172.21.15.39:0/3210837768 wait complete. 2024-09-12T02:35:40.667 INFO:tasks.cephfs.fuse_mount:Running fusermount -u on ubuntu@smithi039.front.sepia.ceph.com... 2024-09-12T02:35:40.667 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-12T02:35:40.667 DEBUG:teuthology.orchestra.run.smithi039:> sudo fusermount -u /home/ubuntu/cephtest/mnt.admin 2024-09-12T02:35:40.722 INFO:tasks.cephfs.fuse_mount.ceph-fuse.admin.smithi039.stderr:ceph-fuse[73867]: fuse finished with error 0 and tester_r 0 2024-09-12T02:35:40.727 INFO:teuthology.orchestra.run:waiting for 300 2024-09-12T02:35:40.808 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi039.front.sepia.ceph.com 2024-09-12T02:35:40.808 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-12T02:35:40.808 DEBUG:teuthology.orchestra.run.smithi039:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.admin) 2024-09-12T02:35:40.861 DEBUG:teuthology.orchestra.run.smithi039:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc shell --fsid 4954ed46-70ae-11ef-bcea-c7b262605968 -- ceph osd dump --format=json 2024-09-12T02:35:40.909 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 02:35:40 smithi039 ceph-mon[30515]: pgmap v318: 129 pgs: 129 active+clean; 581 KiB data, 346 MiB used, 1.0 TiB / 1.0 TiB avail; 341 B/s wr, 0 op/s 2024-09-12T02:35:40.909 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 02:35:40 smithi039 ceph-mon[30515]: from='client.? 172.21.15.39:0/3210837768' entity='client.admin' cmd=[{"prefix": "osd blocklist ls"}]: dispatch 2024-09-12T02:35:41.013 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 12 02:35:40 smithi172 ceph-mon[35609]: pgmap v318: 129 pgs: 129 active+clean; 581 KiB data, 346 MiB used, 1.0 TiB / 1.0 TiB avail; 341 B/s wr, 0 op/s 2024-09-12T02:35:41.014 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 12 02:35:40 smithi172 ceph-mon[35609]: from='client.? 172.21.15.39:0/3210837768' entity='client.admin' cmd=[{"prefix": "osd blocklist ls"}]: dispatch 2024-09-12T02:35:41.198 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 12 02:35:40 smithi044 ceph-mon[35411]: pgmap v318: 129 pgs: 129 active+clean; 581 KiB data, 346 MiB used, 1.0 TiB / 1.0 TiB avail; 341 B/s wr, 0 op/s 2024-09-12T02:35:41.198 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 12 02:35:40 smithi044 ceph-mon[35411]: from='client.? 172.21.15.39:0/3210837768' entity='client.admin' cmd=[{"prefix": "osd blocklist ls"}]: dispatch 2024-09-12T02:35:41.238 INFO:teuthology.orchestra.run.smithi039.stderr:Inferring config /var/lib/ceph/4954ed46-70ae-11ef-bcea-c7b262605968/mon.a/config 2024-09-12T02:35:41.797 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:35:41.796+0000 7fbd04e00640 1 -- 172.21.15.39:0/192184122 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fbd00109120 msgr2=0x7fbd00110ca0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:35:41.797 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:35:41.796+0000 7fbd04e00640 1 --2- 172.21.15.39:0/192184122 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fbd00109120 0x7fbd00110ca0 secure :-1 s=READY pgs=170 cs=0 l=1 rev1=1 crypto rx=0x7fbcf8009ca0 tx=0x7fbcf802a8c0 comp rx=0 tx=0).stop 2024-09-12T02:35:41.797 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:35:41.796+0000 7fbd04e00640 1 -- 172.21.15.39:0/192184122 shutdown_connections 2024-09-12T02:35:41.797 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:35:41.796+0000 7fbd04e00640 1 --2- 172.21.15.39:0/192184122 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fbd00109120 0x7fbd00110ca0 unknown :-1 s=CLOSED pgs=170 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:35:41.798 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:35:41.796+0000 7fbd04e00640 1 --2- 172.21.15.39:0/192184122 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fbd001049a0 0x7fbd001089f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:35:41.798 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:35:41.796+0000 7fbd04e00640 1 --2- 172.21.15.39:0/192184122 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fbd00103ff0 0x7fbd001043d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:35:41.798 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:35:41.796+0000 7fbd04e00640 1 -- 172.21.15.39:0/192184122 >> 172.21.15.39:0/192184122 conn(0x7fbd000ffa90 msgr2=0x7fbd00101eb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:35:41.798 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:35:41.796+0000 7fbd04e00640 1 -- 172.21.15.39:0/192184122 shutdown_connections 2024-09-12T02:35:41.798 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:35:41.796+0000 7fbd04e00640 1 -- 172.21.15.39:0/192184122 wait complete. 2024-09-12T02:35:41.799 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:35:41.797+0000 7fbd04e00640 1 Processor -- start 2024-09-12T02:35:41.799 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:35:41.797+0000 7fbd04e00640 1 -- start start 2024-09-12T02:35:41.799 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:35:41.797+0000 7fbd04e00640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fbd00103ff0 0x7fbd0019a5b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:35:41.799 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:35:41.797+0000 7fbd04e00640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fbd001049a0 0x7fbd0019aaf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:35:41.800 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:35:41.798+0000 7fbd04e00640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fbd00109120 0x7fbd0019ee80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:35:41.800 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:35:41.798+0000 7fbd04e00640 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 -- 0x7fbd00114150 con 0x7fbd00109120 2024-09-12T02:35:41.800 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:35:41.798+0000 7fbd04e00640 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x7fbd00113fd0 con 0x7fbd001049a0 2024-09-12T02:35:41.800 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:35:41.798+0000 7fbd04e00640 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7fbd001142d0 con 0x7fbd00103ff0 2024-09-12T02:35:41.800 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:35:41.798+0000 7fbcf5400640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fbd001049a0 0x7fbd0019aaf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:35:41.800 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:35:41.798+0000 7fbcfe800640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fbd00109120 0x7fbd0019ee80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:35:41.800 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:35:41.798+0000 7fbcfde00640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fbd00103ff0 0x7fbd0019a5b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:35:41.800 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:35:41.798+0000 7fbcfe800640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fbd00109120 0x7fbd0019ee80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.39:3300/0 says I am v2:172.21.15.39:53154/0 (socket says 172.21.15.39:53154) 2024-09-12T02:35:41.800 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:35:41.798+0000 7fbcfe800640 1 -- 172.21.15.39:0/1961444841 learned_addr learned my addr 172.21.15.39:0/1961444841 (peer_addr_for_me v2:172.21.15.39:0/0) 2024-09-12T02:35:41.800 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:35:41.798+0000 7fbcf5400640 1 -- 172.21.15.39:0/1961444841 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fbd00103ff0 msgr2=0x7fbd0019a5b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:35:41.800 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:35:41.798+0000 7fbcf5400640 1 --2- 172.21.15.39:0/1961444841 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fbd00103ff0 0x7fbd0019a5b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:35:41.800 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:35:41.798+0000 7fbcf5400640 1 -- 172.21.15.39:0/1961444841 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fbd00109120 msgr2=0x7fbd0019ee80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:35:41.800 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:35:41.798+0000 7fbcf5400640 1 --2- 172.21.15.39:0/1961444841 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fbd00109120 0x7fbd0019ee80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:35:41.801 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:35:41.798+0000 7fbcf5400640 1 -- 172.21.15.39:0/1961444841 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fbd0019f560 con 0x7fbd001049a0 2024-09-12T02:35:41.801 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:35:41.798+0000 7fbcfe800640 1 --2- 172.21.15.39:0/1961444841 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fbd00109120 0x7fbd0019ee80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-12T02:35:41.801 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:35:41.799+0000 7fbcf5400640 1 --2- 172.21.15.39:0/1961444841 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fbd001049a0 0x7fbd0019aaf0 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7fbce800e9f0 tx=0x7fbce800eeb0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:35:41.801 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:35:41.799+0000 7fbcf7400640 1 -- 172.21.15.39:0/1961444841 <== mon.2 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbce800ccc0 con 0x7fbd001049a0 2024-09-12T02:35:41.802 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:35:41.799+0000 7fbcf7400640 1 -- 172.21.15.39:0/1961444841 <== mon.2 v2:172.21.15.44:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fbce8005020 con 0x7fbd001049a0 2024-09-12T02:35:41.802 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:35:41.799+0000 7fbd04e00640 1 -- 172.21.15.39:0/1961444841 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fbd0019f850 con 0x7fbd001049a0 2024-09-12T02:35:41.802 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:35:41.799+0000 7fbcf7400640 1 -- 172.21.15.39:0/1961444841 <== mon.2 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbce80049e0 con 0x7fbd001049a0 2024-09-12T02:35:41.802 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:35:41.799+0000 7fbd04e00640 1 -- 172.21.15.39:0/1961444841 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fbd001a7130 con 0x7fbd001049a0 2024-09-12T02:35:41.802 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:35:41.800+0000 7fbd04e00640 1 -- 172.21.15.39:0/1961444841 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fbd001043d0 con 0x7fbd001049a0 2024-09-12T02:35:41.803 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:35:41.802+0000 7fbcf7400640 1 -- 172.21.15.39:0/1961444841 <== mon.2 v2:172.21.15.44:3300/0 4 ==== mgrmap(e 16) ==== 137833+0+0 (secure 0 0 0) 0x7fbce8005560 con 0x7fbd001049a0 2024-09-12T02:35:41.804 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:35:41.803+0000 7fbcf7400640 1 --2- 172.21.15.39:0/1961444841 >> [v2:172.21.15.39:6800/1725006999,v1:172.21.15.39:6801/1725006999] conn(0x7fbce40a2b80 0x7fbce40a5040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:35:41.804 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:35:41.804+0000 7fbcf7400640 1 -- 172.21.15.39:0/1961444841 <== mon.2 v2:172.21.15.44:3300/0 5 ==== osd_map(91..91 src has 1..91) ==== 8802+0+0 (secure 0 0 0) 0x7fbce80cf1d0 con 0x7fbd001049a0 2024-09-12T02:35:41.804 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:35:41.804+0000 7fbcfde00640 1 --2- 172.21.15.39:0/1961444841 >> [v2:172.21.15.39:6800/1725006999,v1:172.21.15.39:6801/1725006999] conn(0x7fbce40a2b80 0x7fbce40a5040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:35:41.805 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:35:41.804+0000 7fbcfde00640 1 --2- 172.21.15.39:0/1961444841 >> [v2:172.21.15.39:6800/1725006999,v1:172.21.15.39:6801/1725006999] conn(0x7fbce40a2b80 0x7fbce40a5040 secure :-1 s=READY pgs=160 cs=0 l=1 rev1=1 crypto rx=0x7fbcf0009bd0 tx=0x7fbcf0005f90 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:35:41.808 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:35:41.808+0000 7fbcf7400640 1 -- 172.21.15.39:0/1961444841 <== mon.2 v2:172.21.15.44:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7fbce80051d0 con 0x7fbd001049a0 2024-09-12T02:35:41.997 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:35:41.996+0000 7fbd04e00640 1 -- 172.21.15.39:0/1961444841 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7fbd001a73d0 con 0x7fbd001049a0 2024-09-12T02:35:41.999 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:35:41.998+0000 7fbcf7400640 1 -- 172.21.15.39:0/1961444841 <== mon.2 v2:172.21.15.44:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v91) ==== 74+0+24178 (secure 0 0 0) 0x7fbce809be90 con 0x7fbd001049a0 2024-09-12T02:35:41.999 INFO:teuthology.orchestra.run.smithi039.stdout: 2024-09-12T02:35:41.999 INFO:teuthology.orchestra.run.smithi039.stdout:{"epoch":91,"fsid":"4954ed46-70ae-11ef-bcea-c7b262605968","created":"2024-09-12T02:26:43.086467+0000","modified":"2024-09-12T02:35:16.579407+0000","last_up_change":"2024-09-12T02:34:08.626341+0000","last_in_change":"2024-09-12T02:33:45.553591+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":27,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":12,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-12T02:30:09.347905+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":12,"score_stable":12,"optimal_score":0.25,"raw_score_acting":3,"raw_score_stable":3,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-09-12T02:34:58.580872+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"84","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":2.25,"score_stable":2.25,"optimal_score":1,"raw_score_acting":2.25,"raw_score_stable":2.25,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-09-12T02:35:01.469805+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"84","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2024-09-12T02:35:11.088109+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"91","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"c967b48e-8a39-4797-871b-8b1b83d9472f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":87,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6802","nonce":2437586899},{"type":"v1","addr":"172.21.15.39:6803","nonce":2437586899}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6804","nonce":2437586899},{"type":"v1","addr":"172.21.15.39:6805","nonce":2437586899}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6808","nonce":2437586899},{"type":"v1","addr":"172.21.15.39:6809","nonce":2437586899}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6806","nonce":2437586899},{"type":"v1","addr":"172.21.15.39:6807","nonce":2437586899}]},"public_addr":"172.21.15.39:6803/2437586899","cluster_addr":"172.21.15.39:6805/2437586899","heartbeat_back_addr":"172.21.15.39:6809/2437586899","heartbeat_front_addr":"172.21.15.39:6807/2437586899","state":["exists","up"]},{"osd":1,"uuid":"30e1e4f4-1d50-4003-8978-cb183dca7fbb","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":87,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6800","nonce":2349287000},{"type":"v1","addr":"172.21.15.44:6801","nonce":2349287000}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6802","nonce":2349287000},{"type":"v1","addr":"172.21.15.44:6803","nonce":2349287000}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6806","nonce":2349287000},{"type":"v1","addr":"172.21.15.44:6807","nonce":2349287000}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6804","nonce":2349287000},{"type":"v1","addr":"172.21.15.44:6805","nonce":2349287000}]},"public_addr":"172.21.15.44:6801/2349287000","cluster_addr":"172.21.15.44:6803/2349287000","heartbeat_back_addr":"172.21.15.44:6807/2349287000","heartbeat_front_addr":"172.21.15.44:6805/2349287000","state":["exists","up"]},{"osd":2,"uuid":"a758803f-8668-4fc8-9417-b8d080cd9a7c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":18,"up_thru":87,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6800","nonce":1176898232},{"type":"v1","addr":"172.21.15.172:6801","nonce":1176898232}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6802","nonce":1176898232},{"type":"v1","addr":"172.21.15.172:6803","nonce":1176898232}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6806","nonce":1176898232},{"type":"v1","addr":"172.21.15.172:6807","nonce":1176898232}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6804","nonce":1176898232},{"type":"v1","addr":"172.21.15.172:6805","nonce":1176898232}]},"public_addr":"172.21.15.172:6801/1176898232","cluster_addr":"172.21.15.172:6803/1176898232","heartbeat_back_addr":"172.21.15.172:6807/1176898232","heartbeat_front_addr":"172.21.15.172:6805/1176898232","state":["exists","up"]},{"osd":3,"uuid":"8b256567-7efe-429c-bc4c-80e93228f139","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":26,"up_thru":87,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6810","nonce":2013565859},{"type":"v1","addr":"172.21.15.39:6811","nonce":2013565859}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6812","nonce":2013565859},{"type":"v1","addr":"172.21.15.39:6813","nonce":2013565859}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6816","nonce":2013565859},{"type":"v1","addr":"172.21.15.39:6817","nonce":2013565859}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6814","nonce":2013565859},{"type":"v1","addr":"172.21.15.39:6815","nonce":2013565859}]},"public_addr":"172.21.15.39:6811/2013565859","cluster_addr":"172.21.15.39:6813/2013565859","heartbeat_back_addr":"172.21.15.39:6817/2013565859","heartbeat_front_addr":"172.21.15.39:6815/2013565859","state":["exists","up"]},{"osd":4,"uuid":"e86b6756-e2b3-49fe-9b87-1a2b015bb17a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":33,"up_thru":87,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6808","nonce":3663639110},{"type":"v1","addr":"172.21.15.44:6809","nonce":3663639110}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6810","nonce":3663639110},{"type":"v1","addr":"172.21.15.44:6811","nonce":3663639110}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6814","nonce":3663639110},{"type":"v1","addr":"172.21.15.44:6815","nonce":3663639110}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6812","nonce":3663639110},{"type":"v1","addr":"172.21.15.44:6813","nonce":3663639110}]},"public_addr":"172.21.15.44:6809/3663639110","cluster_addr":"172.21.15.44:6811/3663639110","heartbeat_back_addr":"172.21.15.44:6815/3663639110","heartbeat_front_addr":"172.21.15.44:6813/3663639110","state":["exists","up"]},{"osd":5,"uuid":"9c907c92-b323-48e7-99ad-ec9756d26312","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":38,"up_thru":87,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6808","nonce":998885347},{"type":"v1","addr":"172.21.15.172:6809","nonce":998885347}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6810","nonce":998885347},{"type":"v1","addr":"172.21.15.172:6811","nonce":998885347}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6814","nonce":998885347},{"type":"v1","addr":"172.21.15.172:6815","nonce":998885347}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6812","nonce":998885347},{"type":"v1","addr":"172.21.15.172:6813","nonce":998885347}]},"public_addr":"172.21.15.172:6809/998885347","cluster_addr":"172.21.15.172:6811/998885347","heartbeat_back_addr":"172.21.15.172:6815/998885347","heartbeat_front_addr":"172.21.15.172:6813/998885347","state":["exists","up"]},{"osd":6,"uuid":"1fcb9bb2-6f4b-4d97-a401-aeb6a9706613","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":45,"up_thru":87,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6818","nonce":2569059542},{"type":"v1","addr":"172.21.15.39:6819","nonce":2569059542}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6820","nonce":2569059542},{"type":"v1","addr":"172.21.15.39:6821","nonce":2569059542}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6824","nonce":2569059542},{"type":"v1","addr":"172.21.15.39:6825","nonce":2569059542}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6822","nonce":2569059542},{"type":"v1","addr":"172.21.15.39:6823","nonce":2569059542}]},"public_addr":"172.21.15.39:6819/2569059542","cluster_addr":"172.21.15.39:6821/2569059542","heartbeat_back_addr":"172.21.15.39:6825/2569059542","heartbeat_front_addr":"172.21.15.39:6823/2569059542","state":["exists","up"]},{"osd":7,"uuid":"59e0caf9-8ce5-4161-8875-84862eba743e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":50,"up_thru":87,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6816","nonce":709635079},{"type":"v1","addr":"172.21.15.44:6817","nonce":709635079}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6818","nonce":709635079},{"type":"v1","addr":"172.21.15.44:6819","nonce":709635079}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6822","nonce":709635079},{"type":"v1","addr":"172.21.15.44:6823","nonce":709635079}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6820","nonce":709635079},{"type":"v1","addr":"172.21.15.44:6821","nonce":709635079}]},"public_addr":"172.21.15.44:6817/709635079","cluster_addr":"172.21.15.44:6819/709635079","heartbeat_back_addr":"172.21.15.44:6823/709635079","heartbeat_front_addr":"172.21.15.44:6821/709635079","state":["exists","up"]},{"osd":8,"uuid":"2f6fb5c7-86cc-43eb-bdfb-45a69316937e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":57,"up_thru":87,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6816","nonce":1162792895},{"type":"v1","addr":"172.21.15.172:6817","nonce":1162792895}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6818","nonce":1162792895},{"type":"v1","addr":"172.21.15.172:6819","nonce":1162792895}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6822","nonce":1162792895},{"type":"v1","addr":"172.21.15.172:6823","nonce":1162792895}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6820","nonce":1162792895},{"type":"v1","addr":"172.21.15.172:6821","nonce":1162792895}]},"public_addr":"172.21.15.172:6817/1162792895","cluster_addr":"172.21.15.172:6819/1162792895","heartbeat_back_addr":"172.21.15.172:6823/1162792895","heartbeat_front_addr":"172.21.15.172:6821/1162792895","state":["exists","up"]},{"osd":9,"uuid":"87e5dd9e-8191-4db6-83fa-cfff7c31e17e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":65,"up_thru":87,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6826","nonce":945860346},{"type":"v1","addr":"172.21.15.39:6827","nonce":945860346}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6828","nonce":945860346},{"type":"v1","addr":"172.21.15.39:6829","nonce":945860346}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6832","nonce":945860346},{"type":"v1","addr":"172.21.15.39:6833","nonce":945860346}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6830","nonce":945860346},{"type":"v1","addr":"172.21.15.39:6831","nonce":945860346}]},"public_addr":"172.21.15.39:6827/945860346","cluster_addr":"172.21.15.39:6829/945860346","heartbeat_back_addr":"172.21.15.39:6833/945860346","heartbeat_front_addr":"172.21.15.39:6831/945860346","state":["exists","up"]},{"osd":10,"uuid":"b55d8a00-850f-4910-a5bf-97d9ed545be7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":70,"up_thru":81,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6824","nonce":3899352344},{"type":"v1","addr":"172.21.15.44:6825","nonce":3899352344}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6826","nonce":3899352344},{"type":"v1","addr":"172.21.15.44:6827","nonce":3899352344}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6830","nonce":3899352344},{"type":"v1","addr":"172.21.15.44:6831","nonce":3899352344}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6828","nonce":3899352344},{"type":"v1","addr":"172.21.15.44:6829","nonce":3899352344}]},"public_addr":"172.21.15.44:6825/3899352344","cluster_addr":"172.21.15.44:6827/3899352344","heartbeat_back_addr":"172.21.15.44:6831/3899352344","heartbeat_front_addr":"172.21.15.44:6829/3899352344","state":["exists","up"]},{"osd":11,"uuid":"20cf5df1-5a80-4272-acc0-919c6a1da55a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":77,"up_thru":87,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6824","nonce":3627635035},{"type":"v1","addr":"172.21.15.172:6825","nonce":3627635035}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6826","nonce":3627635035},{"type":"v1","addr":"172.21.15.172:6827","nonce":3627635035}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6830","nonce":3627635035},{"type":"v1","addr":"172.21.15.172:6831","nonce":3627635035}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6828","nonce":3627635035},{"type":"v1","addr":"172.21.15.172:6829","nonce":3627635035}]},"public_addr":"172.21.15.172:6825/3627635035","cluster_addr":"172.21.15.172:6827/3627635035","heartbeat_back_addr":"172.21.15.172:6831/3627635035","heartbeat_front_addr":"172.21.15.172:6829/3627635035","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T02:29:15.367468+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T02:29:41.518207+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T02:30:06.004371+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T02:30:34.793371+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T02:31:00.878517+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T02:31:26.675956+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T02:31:55.950748+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T02:32:22.824017+0000","dead_epoch":0},{"osd":8,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T02:32:46.775880+0000","dead_epoch":0},{"osd":9,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T02:33:16.420347+0000","dead_epoch":0},{"osd":10,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T02:33:42.185837+0000","dead_epoch":0},{"osd":11,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T02:34:07.312555+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.39:6800/3152613618":"2024-09-13T02:27:44.717224+0000","172.21.15.39:0/2301206766":"2024-09-13T02:27:44.717224+0000","172.21.15.39:0/1941318538":"2024-09-13T02:27:44.717224+0000","172.21.15.39:0/1527429435":"2024-09-13T02:27:44.717224+0000","172.21.15.39:0/2913347539":"2024-09-13T02:27:16.531986+0000","172.21.15.39:0/2827440002":"2024-09-13T02:27:16.531986+0000","172.21.15.39:0/4075322467":"2024-09-13T02:27:16.531986+0000","172.21.15.39:6801/1074685700":"2024-09-13T02:27:16.531986+0000","172.21.15.39:6801/3152613618":"2024-09-13T02:27:44.717224+0000","172.21.15.39:6800/1074685700":"2024-09-13T02:27:16.531986+0000"},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-12T02:35:42.002 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:35:42.001+0000 7fbd04e00640 1 -- 172.21.15.39:0/1961444841 >> [v2:172.21.15.39:6800/1725006999,v1:172.21.15.39:6801/1725006999] conn(0x7fbce40a2b80 msgr2=0x7fbce40a5040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:35:42.002 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:35:42.001+0000 7fbd04e00640 1 --2- 172.21.15.39:0/1961444841 >> [v2:172.21.15.39:6800/1725006999,v1:172.21.15.39:6801/1725006999] conn(0x7fbce40a2b80 0x7fbce40a5040 secure :-1 s=READY pgs=160 cs=0 l=1 rev1=1 crypto rx=0x7fbcf0009bd0 tx=0x7fbcf0005f90 comp rx=0 tx=0).stop 2024-09-12T02:35:42.002 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:35:42.001+0000 7fbd04e00640 1 -- 172.21.15.39:0/1961444841 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fbd001049a0 msgr2=0x7fbd0019aaf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:35:42.002 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:35:42.001+0000 7fbd04e00640 1 --2- 172.21.15.39:0/1961444841 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fbd001049a0 0x7fbd0019aaf0 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7fbce800e9f0 tx=0x7fbce800eeb0 comp rx=0 tx=0).stop 2024-09-12T02:35:42.002 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:35:42.001+0000 7fbd04e00640 1 -- 172.21.15.39:0/1961444841 shutdown_connections 2024-09-12T02:35:42.002 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:35:42.001+0000 7fbd04e00640 1 --2- 172.21.15.39:0/1961444841 >> [v2:172.21.15.39:6800/1725006999,v1:172.21.15.39:6801/1725006999] conn(0x7fbce40a2b80 0x7fbce40a5040 unknown :-1 s=CLOSED pgs=160 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:35:42.002 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:35:42.001+0000 7fbd04e00640 1 --2- 172.21.15.39:0/1961444841 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fbd00109120 0x7fbd0019ee80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:35:42.002 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:35:42.001+0000 7fbd04e00640 1 --2- 172.21.15.39:0/1961444841 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fbd001049a0 0x7fbd0019aaf0 unknown :-1 s=CLOSED pgs=81 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:35:42.002 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:35:42.001+0000 7fbd04e00640 1 --2- 172.21.15.39:0/1961444841 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fbd00103ff0 0x7fbd0019a5b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:35:42.002 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:35:42.001+0000 7fbd04e00640 1 -- 172.21.15.39:0/1961444841 >> 172.21.15.39:0/1961444841 conn(0x7fbd000ffa90 msgr2=0x7fbd00101eb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:35:42.003 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:35:42.001+0000 7fbd04e00640 1 -- 172.21.15.39:0/1961444841 shutdown_connections 2024-09-12T02:35:42.003 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:35:42.001+0000 7fbd04e00640 1 -- 172.21.15.39:0/1961444841 wait complete. 2024-09-12T02:35:42.801 DEBUG:teuthology.orchestra.run.smithi039:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc shell --fsid 4954ed46-70ae-11ef-bcea-c7b262605968 -- ceph osd dump --format=json 2024-09-12T02:35:43.013 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 12 02:35:42 smithi172 ceph-mon[35609]: pgmap v319: 129 pgs: 129 active+clean; 581 KiB data, 346 MiB used, 1.0 TiB / 1.0 TiB avail; 341 B/s wr, 0 op/s 2024-09-12T02:35:43.013 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 12 02:35:42 smithi172 ceph-mon[35609]: from='client.? 172.21.15.39:0/1961444841' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-09-12T02:35:43.099 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 02:35:42 smithi039 ceph-mon[30515]: pgmap v319: 129 pgs: 129 active+clean; 581 KiB data, 346 MiB used, 1.0 TiB / 1.0 TiB avail; 341 B/s wr, 0 op/s 2024-09-12T02:35:43.100 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 02:35:42 smithi039 ceph-mon[30515]: from='client.? 172.21.15.39:0/1961444841' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-09-12T02:35:43.178 INFO:teuthology.orchestra.run.smithi039.stderr:Inferring config /var/lib/ceph/4954ed46-70ae-11ef-bcea-c7b262605968/mon.a/config 2024-09-12T02:35:43.198 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 12 02:35:42 smithi044 ceph-mon[35411]: pgmap v319: 129 pgs: 129 active+clean; 581 KiB data, 346 MiB used, 1.0 TiB / 1.0 TiB avail; 341 B/s wr, 0 op/s 2024-09-12T02:35:43.198 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 12 02:35:42 smithi044 ceph-mon[35411]: from='client.? 172.21.15.39:0/1961444841' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-09-12T02:35:43.850 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:35:43.831+0000 7fd6fa200640 1 -- 172.21.15.39:0/2889182658 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fd6f4103ff0 msgr2=0x7fd6f41043d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:35:43.850 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:35:43.831+0000 7fd6fa200640 1 --2- 172.21.15.39:0/2889182658 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fd6f4103ff0 0x7fd6f41043d0 secure :-1 s=READY pgs=171 cs=0 l=1 rev1=1 crypto rx=0x7fd6e4009900 tx=0x7fd6e402a410 comp rx=0 tx=0).stop 2024-09-12T02:35:43.850 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:35:43.831+0000 7fd6fa200640 1 -- 172.21.15.39:0/2889182658 shutdown_connections 2024-09-12T02:35:43.851 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:35:43.831+0000 7fd6fa200640 1 --2- 172.21.15.39:0/2889182658 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fd6f4109120 0x7fd6f4110ca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:35:43.851 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:35:43.831+0000 7fd6fa200640 1 --2- 172.21.15.39:0/2889182658 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fd6f41049a0 0x7fd6f41089f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:35:43.851 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:35:43.831+0000 7fd6fa200640 1 --2- 172.21.15.39:0/2889182658 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fd6f4103ff0 0x7fd6f41043d0 unknown :-1 s=CLOSED pgs=171 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:35:43.851 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:35:43.831+0000 7fd6fa200640 1 -- 172.21.15.39:0/2889182658 >> 172.21.15.39:0/2889182658 conn(0x7fd6f40ffa90 msgr2=0x7fd6f4101eb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:35:43.851 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:35:43.831+0000 7fd6fa200640 1 -- 172.21.15.39:0/2889182658 shutdown_connections 2024-09-12T02:35:43.851 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:35:43.831+0000 7fd6fa200640 1 -- 172.21.15.39:0/2889182658 wait complete. 2024-09-12T02:35:43.851 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:35:43.832+0000 7fd6fa200640 1 Processor -- start 2024-09-12T02:35:43.851 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:35:43.832+0000 7fd6fa200640 1 -- start start 2024-09-12T02:35:43.851 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:35:43.832+0000 7fd6fa200640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fd6f4103ff0 0x7fd6f419a690 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:35:43.851 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:35:43.832+0000 7fd6fa200640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fd6f41049a0 0x7fd6f419abd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:35:43.851 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:35:43.832+0000 7fd6fa200640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fd6f4109120 0x7fd6f419ef60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:35:43.851 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:35:43.832+0000 7fd6fa200640 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 -- 0x7fd6f4114170 con 0x7fd6f41049a0 2024-09-12T02:35:43.851 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:35:43.832+0000 7fd6fa200640 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x7fd6f4113ff0 con 0x7fd6f4109120 2024-09-12T02:35:43.852 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:35:43.832+0000 7fd6fa200640 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7fd6f41142f0 con 0x7fd6f4103ff0 2024-09-12T02:35:43.852 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:35:43.833+0000 7fd6f2a00640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fd6f41049a0 0x7fd6f419abd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:35:43.852 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:35:43.833+0000 7fd6f2a00640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fd6f41049a0 0x7fd6f419abd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.39:3300/0 says I am v2:172.21.15.39:53174/0 (socket says 172.21.15.39:53174) 2024-09-12T02:35:43.852 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:35:43.833+0000 7fd6f2a00640 1 -- 172.21.15.39:0/4105079339 learned_addr learned my addr 172.21.15.39:0/4105079339 (peer_addr_for_me v2:172.21.15.39:0/0) 2024-09-12T02:35:43.852 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:35:43.833+0000 7fd6f3400640 1 --2- 172.21.15.39:0/4105079339 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fd6f4103ff0 0x7fd6f419a690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:35:43.852 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:35:43.833+0000 7fd6f3e00640 1 --2- 172.21.15.39:0/4105079339 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fd6f4109120 0x7fd6f419ef60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:35:43.852 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:35:43.833+0000 7fd6f2a00640 1 -- 172.21.15.39:0/4105079339 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fd6f4103ff0 msgr2=0x7fd6f419a690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:35:43.852 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:35:43.833+0000 7fd6f2a00640 1 --2- 172.21.15.39:0/4105079339 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fd6f4103ff0 0x7fd6f419a690 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:35:43.852 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:35:43.833+0000 7fd6f2a00640 1 -- 172.21.15.39:0/4105079339 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fd6f4109120 msgr2=0x7fd6f419ef60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:35:43.852 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:35:43.833+0000 7fd6f2a00640 1 --2- 172.21.15.39:0/4105079339 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fd6f4109120 0x7fd6f419ef60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:35:43.852 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:35:43.833+0000 7fd6f2a00640 1 -- 172.21.15.39:0/4105079339 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd6f419f640 con 0x7fd6f41049a0 2024-09-12T02:35:43.852 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:35:43.834+0000 7fd6f2a00640 1 --2- 172.21.15.39:0/4105079339 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fd6f41049a0 0x7fd6f419abd0 secure :-1 s=READY pgs=172 cs=0 l=1 rev1=1 crypto rx=0x7fd6e000d950 tx=0x7fd6e000de10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:35:43.852 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:35:43.834+0000 7fd6ebe00640 1 -- 172.21.15.39:0/4105079339 <== mon.0 v2:172.21.15.39:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd6e0017030 con 0x7fd6f41049a0 2024-09-12T02:35:43.853 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:35:43.834+0000 7fd6ebe00640 1 -- 172.21.15.39:0/4105079339 <== mon.0 v2:172.21.15.39:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fd6e0004020 con 0x7fd6f41049a0 2024-09-12T02:35:43.853 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:35:43.834+0000 7fd6fa200640 1 -- 172.21.15.39:0/4105079339 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd6f419f930 con 0x7fd6f41049a0 2024-09-12T02:35:43.853 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:35:43.834+0000 7fd6ebe00640 1 -- 172.21.15.39:0/4105079339 <== mon.0 v2:172.21.15.39:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd6e00047a0 con 0x7fd6f41049a0 2024-09-12T02:35:43.853 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:35:43.834+0000 7fd6fa200640 1 -- 172.21.15.39:0/4105079339 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd6f41a7210 con 0x7fd6f41049a0 2024-09-12T02:35:43.853 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:35:43.835+0000 7fd6fa200640 1 -- 172.21.15.39:0/4105079339 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fd6f41043d0 con 0x7fd6f41049a0 2024-09-12T02:35:43.853 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:35:43.838+0000 7fd6ebe00640 1 -- 172.21.15.39:0/4105079339 <== mon.0 v2:172.21.15.39:3300/0 4 ==== mgrmap(e 16) ==== 137833+0+0 (secure 0 0 0) 0x7fd6e00041d0 con 0x7fd6f41049a0 2024-09-12T02:35:43.853 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:35:43.839+0000 7fd6ebe00640 1 --2- 172.21.15.39:0/4105079339 >> [v2:172.21.15.39:6800/1725006999,v1:172.21.15.39:6801/1725006999] conn(0x7fd6d80a2b80 0x7fd6d80a5040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:35:43.853 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:35:43.839+0000 7fd6ebe00640 1 -- 172.21.15.39:0/4105079339 <== mon.0 v2:172.21.15.39:3300/0 5 ==== osd_map(91..91 src has 1..91) ==== 8802+0+0 (secure 0 0 0) 0x7fd6e00cec10 con 0x7fd6f41049a0 2024-09-12T02:35:43.853 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:35:43.839+0000 7fd6f3400640 1 --2- 172.21.15.39:0/4105079339 >> [v2:172.21.15.39:6800/1725006999,v1:172.21.15.39:6801/1725006999] conn(0x7fd6d80a2b80 0x7fd6d80a5040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:35:43.853 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:35:43.840+0000 7fd6f3400640 1 --2- 172.21.15.39:0/4105079339 >> [v2:172.21.15.39:6800/1725006999,v1:172.21.15.39:6801/1725006999] conn(0x7fd6d80a2b80 0x7fd6d80a5040 secure :-1 s=READY pgs=161 cs=0 l=1 rev1=1 crypto rx=0x7fd6e4000c00 tx=0x7fd6e4005b50 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:35:43.853 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:35:43.844+0000 7fd6ebe00640 1 -- 172.21.15.39:0/4105079339 <== mon.0 v2:172.21.15.39:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7fd6e009b8d0 con 0x7fd6f41049a0 2024-09-12T02:35:44.030 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:35:44.029+0000 7fd6fa200640 1 -- 172.21.15.39:0/4105079339 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7fd6f410bd70 con 0x7fd6f41049a0 2024-09-12T02:35:44.032 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:35:44.031+0000 7fd6ebe00640 1 -- 172.21.15.39:0/4105079339 <== mon.0 v2:172.21.15.39:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v91) ==== 74+0+24178 (secure 0 0 0) 0x7fd6e009b1d0 con 0x7fd6f41049a0 2024-09-12T02:35:44.032 INFO:teuthology.orchestra.run.smithi039.stdout: 2024-09-12T02:35:44.032 INFO:teuthology.orchestra.run.smithi039.stdout:{"epoch":91,"fsid":"4954ed46-70ae-11ef-bcea-c7b262605968","created":"2024-09-12T02:26:43.086467+0000","modified":"2024-09-12T02:35:16.579407+0000","last_up_change":"2024-09-12T02:34:08.626341+0000","last_in_change":"2024-09-12T02:33:45.553591+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":27,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":12,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-12T02:30:09.347905+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":12,"score_stable":12,"optimal_score":0.25,"raw_score_acting":3,"raw_score_stable":3,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-09-12T02:34:58.580872+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"84","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":2.25,"score_stable":2.25,"optimal_score":1,"raw_score_acting":2.25,"raw_score_stable":2.25,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-09-12T02:35:01.469805+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"84","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2024-09-12T02:35:11.088109+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"91","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"c967b48e-8a39-4797-871b-8b1b83d9472f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":87,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6802","nonce":2437586899},{"type":"v1","addr":"172.21.15.39:6803","nonce":2437586899}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6804","nonce":2437586899},{"type":"v1","addr":"172.21.15.39:6805","nonce":2437586899}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6808","nonce":2437586899},{"type":"v1","addr":"172.21.15.39:6809","nonce":2437586899}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6806","nonce":2437586899},{"type":"v1","addr":"172.21.15.39:6807","nonce":2437586899}]},"public_addr":"172.21.15.39:6803/2437586899","cluster_addr":"172.21.15.39:6805/2437586899","heartbeat_back_addr":"172.21.15.39:6809/2437586899","heartbeat_front_addr":"172.21.15.39:6807/2437586899","state":["exists","up"]},{"osd":1,"uuid":"30e1e4f4-1d50-4003-8978-cb183dca7fbb","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":87,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6800","nonce":2349287000},{"type":"v1","addr":"172.21.15.44:6801","nonce":2349287000}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6802","nonce":2349287000},{"type":"v1","addr":"172.21.15.44:6803","nonce":2349287000}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6806","nonce":2349287000},{"type":"v1","addr":"172.21.15.44:6807","nonce":2349287000}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6804","nonce":2349287000},{"type":"v1","addr":"172.21.15.44:6805","nonce":2349287000}]},"public_addr":"172.21.15.44:6801/2349287000","cluster_addr":"172.21.15.44:6803/2349287000","heartbeat_back_addr":"172.21.15.44:6807/2349287000","heartbeat_front_addr":"172.21.15.44:6805/2349287000","state":["exists","up"]},{"osd":2,"uuid":"a758803f-8668-4fc8-9417-b8d080cd9a7c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":18,"up_thru":87,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6800","nonce":1176898232},{"type":"v1","addr":"172.21.15.172:6801","nonce":1176898232}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6802","nonce":1176898232},{"type":"v1","addr":"172.21.15.172:6803","nonce":1176898232}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6806","nonce":1176898232},{"type":"v1","addr":"172.21.15.172:6807","nonce":1176898232}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6804","nonce":1176898232},{"type":"v1","addr":"172.21.15.172:6805","nonce":1176898232}]},"public_addr":"172.21.15.172:6801/1176898232","cluster_addr":"172.21.15.172:6803/1176898232","heartbeat_back_addr":"172.21.15.172:6807/1176898232","heartbeat_front_addr":"172.21.15.172:6805/1176898232","state":["exists","up"]},{"osd":3,"uuid":"8b256567-7efe-429c-bc4c-80e93228f139","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":26,"up_thru":87,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6810","nonce":2013565859},{"type":"v1","addr":"172.21.15.39:6811","nonce":2013565859}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6812","nonce":2013565859},{"type":"v1","addr":"172.21.15.39:6813","nonce":2013565859}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6816","nonce":2013565859},{"type":"v1","addr":"172.21.15.39:6817","nonce":2013565859}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6814","nonce":2013565859},{"type":"v1","addr":"172.21.15.39:6815","nonce":2013565859}]},"public_addr":"172.21.15.39:6811/2013565859","cluster_addr":"172.21.15.39:6813/2013565859","heartbeat_back_addr":"172.21.15.39:6817/2013565859","heartbeat_front_addr":"172.21.15.39:6815/2013565859","state":["exists","up"]},{"osd":4,"uuid":"e86b6756-e2b3-49fe-9b87-1a2b015bb17a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":33,"up_thru":87,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6808","nonce":3663639110},{"type":"v1","addr":"172.21.15.44:6809","nonce":3663639110}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6810","nonce":3663639110},{"type":"v1","addr":"172.21.15.44:6811","nonce":3663639110}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6814","nonce":3663639110},{"type":"v1","addr":"172.21.15.44:6815","nonce":3663639110}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6812","nonce":3663639110},{"type":"v1","addr":"172.21.15.44:6813","nonce":3663639110}]},"public_addr":"172.21.15.44:6809/3663639110","cluster_addr":"172.21.15.44:6811/3663639110","heartbeat_back_addr":"172.21.15.44:6815/3663639110","heartbeat_front_addr":"172.21.15.44:6813/3663639110","state":["exists","up"]},{"osd":5,"uuid":"9c907c92-b323-48e7-99ad-ec9756d26312","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":38,"up_thru":87,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6808","nonce":998885347},{"type":"v1","addr":"172.21.15.172:6809","nonce":998885347}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6810","nonce":998885347},{"type":"v1","addr":"172.21.15.172:6811","nonce":998885347}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6814","nonce":998885347},{"type":"v1","addr":"172.21.15.172:6815","nonce":998885347}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6812","nonce":998885347},{"type":"v1","addr":"172.21.15.172:6813","nonce":998885347}]},"public_addr":"172.21.15.172:6809/998885347","cluster_addr":"172.21.15.172:6811/998885347","heartbeat_back_addr":"172.21.15.172:6815/998885347","heartbeat_front_addr":"172.21.15.172:6813/998885347","state":["exists","up"]},{"osd":6,"uuid":"1fcb9bb2-6f4b-4d97-a401-aeb6a9706613","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":45,"up_thru":87,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6818","nonce":2569059542},{"type":"v1","addr":"172.21.15.39:6819","nonce":2569059542}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6820","nonce":2569059542},{"type":"v1","addr":"172.21.15.39:6821","nonce":2569059542}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6824","nonce":2569059542},{"type":"v1","addr":"172.21.15.39:6825","nonce":2569059542}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6822","nonce":2569059542},{"type":"v1","addr":"172.21.15.39:6823","nonce":2569059542}]},"public_addr":"172.21.15.39:6819/2569059542","cluster_addr":"172.21.15.39:6821/2569059542","heartbeat_back_addr":"172.21.15.39:6825/2569059542","heartbeat_front_addr":"172.21.15.39:6823/2569059542","state":["exists","up"]},{"osd":7,"uuid":"59e0caf9-8ce5-4161-8875-84862eba743e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":50,"up_thru":87,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6816","nonce":709635079},{"type":"v1","addr":"172.21.15.44:6817","nonce":709635079}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6818","nonce":709635079},{"type":"v1","addr":"172.21.15.44:6819","nonce":709635079}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6822","nonce":709635079},{"type":"v1","addr":"172.21.15.44:6823","nonce":709635079}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6820","nonce":709635079},{"type":"v1","addr":"172.21.15.44:6821","nonce":709635079}]},"public_addr":"172.21.15.44:6817/709635079","cluster_addr":"172.21.15.44:6819/709635079","heartbeat_back_addr":"172.21.15.44:6823/709635079","heartbeat_front_addr":"172.21.15.44:6821/709635079","state":["exists","up"]},{"osd":8,"uuid":"2f6fb5c7-86cc-43eb-bdfb-45a69316937e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":57,"up_thru":87,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6816","nonce":1162792895},{"type":"v1","addr":"172.21.15.172:6817","nonce":1162792895}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6818","nonce":1162792895},{"type":"v1","addr":"172.21.15.172:6819","nonce":1162792895}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6822","nonce":1162792895},{"type":"v1","addr":"172.21.15.172:6823","nonce":1162792895}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6820","nonce":1162792895},{"type":"v1","addr":"172.21.15.172:6821","nonce":1162792895}]},"public_addr":"172.21.15.172:6817/1162792895","cluster_addr":"172.21.15.172:6819/1162792895","heartbeat_back_addr":"172.21.15.172:6823/1162792895","heartbeat_front_addr":"172.21.15.172:6821/1162792895","state":["exists","up"]},{"osd":9,"uuid":"87e5dd9e-8191-4db6-83fa-cfff7c31e17e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":65,"up_thru":87,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6826","nonce":945860346},{"type":"v1","addr":"172.21.15.39:6827","nonce":945860346}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6828","nonce":945860346},{"type":"v1","addr":"172.21.15.39:6829","nonce":945860346}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6832","nonce":945860346},{"type":"v1","addr":"172.21.15.39:6833","nonce":945860346}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6830","nonce":945860346},{"type":"v1","addr":"172.21.15.39:6831","nonce":945860346}]},"public_addr":"172.21.15.39:6827/945860346","cluster_addr":"172.21.15.39:6829/945860346","heartbeat_back_addr":"172.21.15.39:6833/945860346","heartbeat_front_addr":"172.21.15.39:6831/945860346","state":["exists","up"]},{"osd":10,"uuid":"b55d8a00-850f-4910-a5bf-97d9ed545be7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":70,"up_thru":81,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6824","nonce":3899352344},{"type":"v1","addr":"172.21.15.44:6825","nonce":3899352344}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6826","nonce":3899352344},{"type":"v1","addr":"172.21.15.44:6827","nonce":3899352344}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6830","nonce":3899352344},{"type":"v1","addr":"172.21.15.44:6831","nonce":3899352344}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6828","nonce":3899352344},{"type":"v1","addr":"172.21.15.44:6829","nonce":3899352344}]},"public_addr":"172.21.15.44:6825/3899352344","cluster_addr":"172.21.15.44:6827/3899352344","heartbeat_back_addr":"172.21.15.44:6831/3899352344","heartbeat_front_addr":"172.21.15.44:6829/3899352344","state":["exists","up"]},{"osd":11,"uuid":"20cf5df1-5a80-4272-acc0-919c6a1da55a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":77,"up_thru":87,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6824","nonce":3627635035},{"type":"v1","addr":"172.21.15.172:6825","nonce":3627635035}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6826","nonce":3627635035},{"type":"v1","addr":"172.21.15.172:6827","nonce":3627635035}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6830","nonce":3627635035},{"type":"v1","addr":"172.21.15.172:6831","nonce":3627635035}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6828","nonce":3627635035},{"type":"v1","addr":"172.21.15.172:6829","nonce":3627635035}]},"public_addr":"172.21.15.172:6825/3627635035","cluster_addr":"172.21.15.172:6827/3627635035","heartbeat_back_addr":"172.21.15.172:6831/3627635035","heartbeat_front_addr":"172.21.15.172:6829/3627635035","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T02:29:15.367468+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T02:29:41.518207+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T02:30:06.004371+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T02:30:34.793371+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T02:31:00.878517+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T02:31:26.675956+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T02:31:55.950748+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T02:32:22.824017+0000","dead_epoch":0},{"osd":8,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T02:32:46.775880+0000","dead_epoch":0},{"osd":9,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T02:33:16.420347+0000","dead_epoch":0},{"osd":10,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T02:33:42.185837+0000","dead_epoch":0},{"osd":11,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T02:34:07.312555+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.39:6800/3152613618":"2024-09-13T02:27:44.717224+0000","172.21.15.39:0/2301206766":"2024-09-13T02:27:44.717224+0000","172.21.15.39:0/1941318538":"2024-09-13T02:27:44.717224+0000","172.21.15.39:0/1527429435":"2024-09-13T02:27:44.717224+0000","172.21.15.39:0/2913347539":"2024-09-13T02:27:16.531986+0000","172.21.15.39:0/2827440002":"2024-09-13T02:27:16.531986+0000","172.21.15.39:0/4075322467":"2024-09-13T02:27:16.531986+0000","172.21.15.39:6801/1074685700":"2024-09-13T02:27:16.531986+0000","172.21.15.39:6801/3152613618":"2024-09-13T02:27:44.717224+0000","172.21.15.39:6800/1074685700":"2024-09-13T02:27:16.531986+0000"},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-12T02:35:44.034 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:35:44.033+0000 7fd6fa200640 1 -- 172.21.15.39:0/4105079339 >> [v2:172.21.15.39:6800/1725006999,v1:172.21.15.39:6801/1725006999] conn(0x7fd6d80a2b80 msgr2=0x7fd6d80a5040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:35:44.035 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:35:44.033+0000 7fd6fa200640 1 --2- 172.21.15.39:0/4105079339 >> [v2:172.21.15.39:6800/1725006999,v1:172.21.15.39:6801/1725006999] conn(0x7fd6d80a2b80 0x7fd6d80a5040 secure :-1 s=READY pgs=161 cs=0 l=1 rev1=1 crypto rx=0x7fd6e4000c00 tx=0x7fd6e4005b50 comp rx=0 tx=0).stop 2024-09-12T02:35:44.035 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:35:44.033+0000 7fd6fa200640 1 -- 172.21.15.39:0/4105079339 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fd6f41049a0 msgr2=0x7fd6f419abd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:35:44.035 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:35:44.033+0000 7fd6fa200640 1 --2- 172.21.15.39:0/4105079339 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fd6f41049a0 0x7fd6f419abd0 secure :-1 s=READY pgs=172 cs=0 l=1 rev1=1 crypto rx=0x7fd6e000d950 tx=0x7fd6e000de10 comp rx=0 tx=0).stop 2024-09-12T02:35:44.035 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:35:44.034+0000 7fd6fa200640 1 -- 172.21.15.39:0/4105079339 shutdown_connections 2024-09-12T02:35:44.035 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:35:44.034+0000 7fd6fa200640 1 --2- 172.21.15.39:0/4105079339 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fd6f4109120 0x7fd6f419ef60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:35:44.035 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:35:44.034+0000 7fd6fa200640 1 --2- 172.21.15.39:0/4105079339 >> [v2:172.21.15.39:6800/1725006999,v1:172.21.15.39:6801/1725006999] conn(0x7fd6d80a2b80 0x7fd6d80a5040 unknown :-1 s=CLOSED pgs=161 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:35:44.035 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:35:44.034+0000 7fd6fa200640 1 --2- 172.21.15.39:0/4105079339 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fd6f41049a0 0x7fd6f419abd0 unknown :-1 s=CLOSED pgs=172 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:35:44.035 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:35:44.034+0000 7fd6fa200640 1 --2- 172.21.15.39:0/4105079339 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fd6f4103ff0 0x7fd6f419a690 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:35:44.035 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:35:44.034+0000 7fd6fa200640 1 -- 172.21.15.39:0/4105079339 >> 172.21.15.39:0/4105079339 conn(0x7fd6f40ffa90 msgr2=0x7fd6f4100d70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:35:44.035 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:35:44.034+0000 7fd6fa200640 1 -- 172.21.15.39:0/4105079339 shutdown_connections 2024-09-12T02:35:44.035 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:35:44.034+0000 7fd6fa200640 1 -- 172.21.15.39:0/4105079339 wait complete. 2024-09-12T02:35:44.833 DEBUG:teuthology.orchestra.run.smithi039:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc shell --fsid 4954ed46-70ae-11ef-bcea-c7b262605968 -- ceph fs set cephfs standby_count_wanted 0 2024-09-12T02:35:45.013 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 12 02:35:44 smithi172 ceph-mon[35609]: pgmap v320: 129 pgs: 129 active+clean; 581 KiB data, 346 MiB used, 1.0 TiB / 1.0 TiB avail; 341 B/s wr, 0 op/s 2024-09-12T02:35:45.014 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 12 02:35:44 smithi172 ceph-mon[35609]: from='client.? 172.21.15.39:0/4105079339' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-09-12T02:35:45.099 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 02:35:44 smithi039 ceph-mon[30515]: pgmap v320: 129 pgs: 129 active+clean; 581 KiB data, 346 MiB used, 1.0 TiB / 1.0 TiB avail; 341 B/s wr, 0 op/s 2024-09-12T02:35:45.100 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 02:35:44 smithi039 ceph-mon[30515]: from='client.? 172.21.15.39:0/4105079339' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-09-12T02:35:45.198 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 12 02:35:44 smithi044 ceph-mon[35411]: pgmap v320: 129 pgs: 129 active+clean; 581 KiB data, 346 MiB used, 1.0 TiB / 1.0 TiB avail; 341 B/s wr, 0 op/s 2024-09-12T02:35:45.198 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 12 02:35:44 smithi044 ceph-mon[35411]: from='client.? 172.21.15.39:0/4105079339' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-09-12T02:35:45.213 INFO:teuthology.orchestra.run.smithi039.stderr:Inferring config /var/lib/ceph/4954ed46-70ae-11ef-bcea-c7b262605968/mon.a/config 2024-09-12T02:35:45.789 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:35:45.787+0000 7f847ba00640 1 -- 172.21.15.39:0/1369319895 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f8474103ff0 msgr2=0x7f84741043d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:35:45.789 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:35:45.787+0000 7f847ba00640 1 --2- 172.21.15.39:0/1369319895 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f8474103ff0 0x7f84741043d0 secure :-1 s=READY pgs=173 cs=0 l=1 rev1=1 crypto rx=0x7f8468009900 tx=0x7f846802a410 comp rx=0 tx=0).stop 2024-09-12T02:35:45.789 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:35:45.788+0000 7f847ba00640 1 -- 172.21.15.39:0/1369319895 shutdown_connections 2024-09-12T02:35:45.789 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:35:45.788+0000 7f847ba00640 1 --2- 172.21.15.39:0/1369319895 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f8474109120 0x7f8474110ca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:35:45.789 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:35:45.788+0000 7f847ba00640 1 --2- 172.21.15.39:0/1369319895 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f84741049a0 0x7f84741089f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:35:45.789 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:35:45.788+0000 7f847ba00640 1 --2- 172.21.15.39:0/1369319895 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f8474103ff0 0x7f84741043d0 unknown :-1 s=CLOSED pgs=173 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:35:45.790 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:35:45.788+0000 7f847ba00640 1 -- 172.21.15.39:0/1369319895 >> 172.21.15.39:0/1369319895 conn(0x7f84740ffa90 msgr2=0x7f8474101eb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:35:45.790 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:35:45.788+0000 7f847ba00640 1 -- 172.21.15.39:0/1369319895 shutdown_connections 2024-09-12T02:35:45.790 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:35:45.788+0000 7f847ba00640 1 -- 172.21.15.39:0/1369319895 wait complete. 2024-09-12T02:35:45.792 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:35:45.789+0000 7f847ba00640 1 Processor -- start 2024-09-12T02:35:45.792 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:35:45.789+0000 7f847ba00640 1 -- start start 2024-09-12T02:35:45.792 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:35:45.789+0000 7f847ba00640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f8474103ff0 0x7f847419a690 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:35:45.792 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:35:45.789+0000 7f847ba00640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f84741049a0 0x7f847419abd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:35:45.792 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:35:45.789+0000 7f847ba00640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f8474109120 0x7f847419ef60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:35:45.792 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:35:45.789+0000 7f847ba00640 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 -- 0x7f8474114190 con 0x7f84741049a0 2024-09-12T02:35:45.792 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:35:45.789+0000 7f847ba00640 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x7f8474114010 con 0x7f8474103ff0 2024-09-12T02:35:45.792 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:35:45.789+0000 7f847ba00640 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7f8474114310 con 0x7f8474109120 2024-09-12T02:35:45.792 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:35:45.790+0000 7f8479000640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f8474103ff0 0x7f847419a690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:35:45.793 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:35:45.790+0000 7f8479000640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f8474103ff0 0x7f847419a690 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.39:55260/0 (socket says 172.21.15.39:55260) 2024-09-12T02:35:45.793 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:35:45.790+0000 7f8479000640 1 -- 172.21.15.39:0/4114389990 learned_addr learned my addr 172.21.15.39:0/4114389990 (peer_addr_for_me v2:172.21.15.39:0/0) 2024-09-12T02:35:45.793 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:35:45.790+0000 7f8473e00640 1 --2- 172.21.15.39:0/4114389990 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f84741049a0 0x7f847419abd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:35:45.793 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:35:45.790+0000 7f8479a00640 1 --2- 172.21.15.39:0/4114389990 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f8474109120 0x7f847419ef60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:35:45.793 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:35:45.790+0000 7f8479000640 1 -- 172.21.15.39:0/4114389990 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f8474109120 msgr2=0x7f847419ef60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:35:45.793 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:35:45.790+0000 7f8479000640 1 --2- 172.21.15.39:0/4114389990 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f8474109120 0x7f847419ef60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:35:45.793 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:35:45.790+0000 7f8479000640 1 -- 172.21.15.39:0/4114389990 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f84741049a0 msgr2=0x7f847419abd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:35:45.793 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:35:45.790+0000 7f8479000640 1 --2- 172.21.15.39:0/4114389990 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f84741049a0 0x7f847419abd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:35:45.793 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:35:45.790+0000 7f8479000640 1 -- 172.21.15.39:0/4114389990 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f847419f640 con 0x7f8474103ff0 2024-09-12T02:35:45.794 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:35:45.790+0000 7f8479a00640 1 --2- 172.21.15.39:0/4114389990 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f8474109120 0x7f847419ef60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-12T02:35:45.794 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:35:45.790+0000 7f8473e00640 1 --2- 172.21.15.39:0/4114389990 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f84741049a0 0x7f847419abd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-12T02:35:45.794 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:35:45.790+0000 7f8479000640 1 --2- 172.21.15.39:0/4114389990 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f8474103ff0 0x7f847419a690 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7f8468004770 tx=0x7f8468003c10 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:35:45.794 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:35:45.791+0000 7f8471600640 1 -- 172.21.15.39:0/4114389990 <== mon.2 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f846803f070 con 0x7f8474103ff0 2024-09-12T02:35:45.794 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:35:45.791+0000 7f8471600640 1 -- 172.21.15.39:0/4114389990 <== mon.2 v2:172.21.15.44:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f8468031ca0 con 0x7f8474103ff0 2024-09-12T02:35:45.794 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:35:45.791+0000 7f8471600640 1 -- 172.21.15.39:0/4114389990 <== mon.2 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8468035030 con 0x7f8474103ff0 2024-09-12T02:35:45.794 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:35:45.791+0000 7f847ba00640 1 -- 172.21.15.39:0/4114389990 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f847419f8d0 con 0x7f8474103ff0 2024-09-12T02:35:45.794 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:35:45.791+0000 7f847ba00640 1 -- 172.21.15.39:0/4114389990 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f847419fd60 con 0x7f8474103ff0 2024-09-12T02:35:45.795 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:35:45.792+0000 7f847ba00640 1 -- 172.21.15.39:0/4114389990 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f84741043d0 con 0x7f8474103ff0 2024-09-12T02:35:45.795 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:35:45.794+0000 7f8471600640 1 -- 172.21.15.39:0/4114389990 <== mon.2 v2:172.21.15.44:3300/0 4 ==== mgrmap(e 16) ==== 137833+0+0 (secure 0 0 0) 0x7f8468042070 con 0x7f8474103ff0 2024-09-12T02:35:45.796 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:35:45.795+0000 7f8471600640 1 --2- 172.21.15.39:0/4114389990 >> [v2:172.21.15.39:6800/1725006999,v1:172.21.15.39:6801/1725006999] conn(0x7f845c0a2b80 0x7f845c0a5040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:35:45.796 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:35:45.796+0000 7f8471600640 1 -- 172.21.15.39:0/4114389990 <== mon.2 v2:172.21.15.44:3300/0 5 ==== osd_map(92..92 src has 1..92) ==== 9092+0+0 (secure 0 0 0) 0x7f84680f0100 con 0x7f8474103ff0 2024-09-12T02:35:45.796 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:35:45.796+0000 7f8473e00640 1 --2- 172.21.15.39:0/4114389990 >> [v2:172.21.15.39:6800/1725006999,v1:172.21.15.39:6801/1725006999] conn(0x7f845c0a2b80 0x7f845c0a5040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:35:45.798 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:35:45.796+0000 7f8473e00640 1 --2- 172.21.15.39:0/4114389990 >> [v2:172.21.15.39:6800/1725006999,v1:172.21.15.39:6801/1725006999] conn(0x7f845c0a2b80 0x7f845c0a5040 secure :-1 s=READY pgs=162 cs=0 l=1 rev1=1 crypto rx=0x7f84740fffb0 tx=0x7f8460005f90 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:35:45.799 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:35:45.797+0000 7f8471600640 1 -- 172.21.15.39:0/4114389990 <== mon.2 v2:172.21.15.44:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7f84680bcd60 con 0x7f8474103ff0 2024-09-12T02:35:46.013 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 12 02:35:45 smithi172 ceph-mon[35609]: from='mgr.14150 172.21.15.39:0/408627207' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.0", "id": [7, 11]}]: dispatch 2024-09-12T02:35:46.014 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 12 02:35:45 smithi172 ceph-mon[35609]: from='mgr.14150 172.21.15.39:0/408627207' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.b", "id": [2, 1]}]: dispatch 2024-09-12T02:35:46.014 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 12 02:35:45 smithi172 ceph-mon[35609]: from='mgr.14150 172.21.15.39:0/408627207' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.10", "id": [8, 11]}]: dispatch 2024-09-12T02:35:46.014 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 12 02:35:45 smithi172 ceph-mon[35609]: from='mgr.14150 172.21.15.39:0/408627207' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.1b", "id": [2, 4]}]: dispatch 2024-09-12T02:35:46.014 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 12 02:35:45 smithi172 ceph-mon[35609]: from='mgr.14150 172.21.15.39:0/408627207' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.11", "id": [4, 8]}]: dispatch 2024-09-12T02:35:46.014 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 12 02:35:45 smithi172 ceph-mon[35609]: from='mgr.14150 172.21.15.39:0/408627207' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.24", "id": [4, 9]}]: dispatch 2024-09-12T02:35:46.014 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 12 02:35:45 smithi172 ceph-mon[35609]: from='mgr.14150 172.21.15.39:0/408627207' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.33", "id": [5, 9]}]: dispatch 2024-09-12T02:35:46.014 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 12 02:35:45 smithi172 ceph-mon[35609]: from='mgr.14150 172.21.15.39:0/408627207' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.34", "id": [4, 9]}]: dispatch 2024-09-12T02:35:46.014 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 12 02:35:45 smithi172 ceph-mon[35609]: from='mgr.14150 172.21.15.39:0/408627207' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.2", "id": [9, 1]}]: dispatch 2024-09-12T02:35:46.014 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 12 02:35:45 smithi172 ceph-mon[35609]: from='mgr.14150 172.21.15.39:0/408627207' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.6", "id": [9, 11]}]: dispatch 2024-09-12T02:35:46.022 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:35:46.021+0000 7f847ba00640 1 -- 172.21.15.39:0/4114389990 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"} v 0) -- 0x7f847419b9f0 con 0x7f8474103ff0 2024-09-12T02:35:46.022 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 02:35:45 smithi039 ceph-mon[30515]: from='mgr.14150 172.21.15.39:0/408627207' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.0", "id": [7, 11]}]: dispatch 2024-09-12T02:35:46.022 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 02:35:45 smithi039 ceph-mon[30515]: from='mgr.14150 172.21.15.39:0/408627207' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.b", "id": [2, 1]}]: dispatch 2024-09-12T02:35:46.022 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 02:35:45 smithi039 ceph-mon[30515]: from='mgr.14150 172.21.15.39:0/408627207' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.10", "id": [8, 11]}]: dispatch 2024-09-12T02:35:46.022 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 02:35:45 smithi039 ceph-mon[30515]: from='mgr.14150 172.21.15.39:0/408627207' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.1b", "id": [2, 4]}]: dispatch 2024-09-12T02:35:46.022 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 02:35:45 smithi039 ceph-mon[30515]: from='mgr.14150 172.21.15.39:0/408627207' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.11", "id": [4, 8]}]: dispatch 2024-09-12T02:35:46.023 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 02:35:45 smithi039 ceph-mon[30515]: from='mgr.14150 172.21.15.39:0/408627207' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.24", "id": [4, 9]}]: dispatch 2024-09-12T02:35:46.023 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 02:35:45 smithi039 ceph-mon[30515]: from='mgr.14150 172.21.15.39:0/408627207' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.33", "id": [5, 9]}]: dispatch 2024-09-12T02:35:46.023 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 02:35:45 smithi039 ceph-mon[30515]: from='mgr.14150 172.21.15.39:0/408627207' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.34", "id": [4, 9]}]: dispatch 2024-09-12T02:35:46.023 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 02:35:45 smithi039 ceph-mon[30515]: from='mgr.14150 172.21.15.39:0/408627207' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.2", "id": [9, 1]}]: dispatch 2024-09-12T02:35:46.023 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 02:35:45 smithi039 ceph-mon[30515]: from='mgr.14150 172.21.15.39:0/408627207' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.6", "id": [9, 11]}]: dispatch 2024-09-12T02:35:46.198 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 12 02:35:45 smithi044 ceph-mon[35411]: from='mgr.14150 172.21.15.39:0/408627207' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.0", "id": [7, 11]}]: dispatch 2024-09-12T02:35:46.199 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 12 02:35:45 smithi044 ceph-mon[35411]: from='mgr.14150 172.21.15.39:0/408627207' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.b", "id": [2, 1]}]: dispatch 2024-09-12T02:35:46.199 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 12 02:35:45 smithi044 ceph-mon[35411]: from='mgr.14150 172.21.15.39:0/408627207' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.10", "id": [8, 11]}]: dispatch 2024-09-12T02:35:46.199 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 12 02:35:45 smithi044 ceph-mon[35411]: from='mgr.14150 172.21.15.39:0/408627207' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.1b", "id": [2, 4]}]: dispatch 2024-09-12T02:35:46.199 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 12 02:35:45 smithi044 ceph-mon[35411]: from='mgr.14150 172.21.15.39:0/408627207' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.11", "id": [4, 8]}]: dispatch 2024-09-12T02:35:46.199 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 12 02:35:45 smithi044 ceph-mon[35411]: from='mgr.14150 172.21.15.39:0/408627207' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.24", "id": [4, 9]}]: dispatch 2024-09-12T02:35:46.199 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 12 02:35:45 smithi044 ceph-mon[35411]: from='mgr.14150 172.21.15.39:0/408627207' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.33", "id": [5, 9]}]: dispatch 2024-09-12T02:35:46.199 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 12 02:35:45 smithi044 ceph-mon[35411]: from='mgr.14150 172.21.15.39:0/408627207' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.34", "id": [4, 9]}]: dispatch 2024-09-12T02:35:46.199 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 12 02:35:45 smithi044 ceph-mon[35411]: from='mgr.14150 172.21.15.39:0/408627207' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.2", "id": [9, 1]}]: dispatch 2024-09-12T02:35:46.199 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 12 02:35:45 smithi044 ceph-mon[35411]: from='mgr.14150 172.21.15.39:0/408627207' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.6", "id": [9, 11]}]: dispatch 2024-09-12T02:35:46.736 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:35:46.735+0000 7f8471600640 1 -- 172.21.15.39:0/4114389990 <== mon.2 v2:172.21.15.44:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"}]=0 v18) ==== 118+0+0 (secure 0 0 0) 0x7f84680bc660 con 0x7f8474103ff0 2024-09-12T02:35:46.740 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:35:46.739+0000 7f847ba00640 1 -- 172.21.15.39:0/4114389990 >> [v2:172.21.15.39:6800/1725006999,v1:172.21.15.39:6801/1725006999] conn(0x7f845c0a2b80 msgr2=0x7f845c0a5040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:35:46.740 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:35:46.739+0000 7f847ba00640 1 --2- 172.21.15.39:0/4114389990 >> [v2:172.21.15.39:6800/1725006999,v1:172.21.15.39:6801/1725006999] conn(0x7f845c0a2b80 0x7f845c0a5040 secure :-1 s=READY pgs=162 cs=0 l=1 rev1=1 crypto rx=0x7f84740fffb0 tx=0x7f8460005f90 comp rx=0 tx=0).stop 2024-09-12T02:35:46.740 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:35:46.739+0000 7f847ba00640 1 -- 172.21.15.39:0/4114389990 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f8474103ff0 msgr2=0x7f847419a690 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:35:46.740 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:35:46.739+0000 7f847ba00640 1 --2- 172.21.15.39:0/4114389990 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f8474103ff0 0x7f847419a690 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7f8468004770 tx=0x7f8468003c10 comp rx=0 tx=0).stop 2024-09-12T02:35:46.740 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:35:46.739+0000 7f847ba00640 1 -- 172.21.15.39:0/4114389990 shutdown_connections 2024-09-12T02:35:46.740 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:35:46.739+0000 7f847ba00640 1 --2- 172.21.15.39:0/4114389990 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f8474109120 0x7f847419ef60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:35:46.740 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:35:46.739+0000 7f847ba00640 1 --2- 172.21.15.39:0/4114389990 >> [v2:172.21.15.39:6800/1725006999,v1:172.21.15.39:6801/1725006999] conn(0x7f845c0a2b80 0x7f845c0a5040 unknown :-1 s=CLOSED pgs=162 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:35:46.740 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:35:46.739+0000 7f847ba00640 1 --2- 172.21.15.39:0/4114389990 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f84741049a0 0x7f847419abd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:35:46.741 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:35:46.739+0000 7f847ba00640 1 --2- 172.21.15.39:0/4114389990 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f8474103ff0 0x7f847419a690 unknown :-1 s=CLOSED pgs=82 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:35:46.741 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:35:46.739+0000 7f847ba00640 1 -- 172.21.15.39:0/4114389990 >> 172.21.15.39:0/4114389990 conn(0x7f84740ffa90 msgr2=0x7f8474100d70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:35:46.741 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:35:46.739+0000 7f847ba00640 1 -- 172.21.15.39:0/4114389990 shutdown_connections 2024-09-12T02:35:46.741 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:35:46.739+0000 7f847ba00640 1 -- 172.21.15.39:0/4114389990 wait complete. 2024-09-12T02:35:47.014 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 12 02:35:46 smithi172 ceph-mon[35609]: pgmap v321: 129 pgs: 129 active+clean; 581 KiB data, 346 MiB used, 1.0 TiB / 1.0 TiB avail; 426 B/s wr, 0 op/s 2024-09-12T02:35:47.014 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 12 02:35:46 smithi172 ceph-mon[35609]: from='mgr.14150 172.21.15.39:0/408627207' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.0", "id": [7, 11]}]': finished 2024-09-12T02:35:47.014 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 12 02:35:46 smithi172 ceph-mon[35609]: from='mgr.14150 172.21.15.39:0/408627207' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.b", "id": [2, 1]}]': finished 2024-09-12T02:35:47.014 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 12 02:35:46 smithi172 ceph-mon[35609]: from='mgr.14150 172.21.15.39:0/408627207' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.10", "id": [8, 11]}]': finished 2024-09-12T02:35:47.014 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 12 02:35:46 smithi172 ceph-mon[35609]: from='mgr.14150 172.21.15.39:0/408627207' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.1b", "id": [2, 4]}]': finished 2024-09-12T02:35:47.014 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 12 02:35:46 smithi172 ceph-mon[35609]: from='mgr.14150 172.21.15.39:0/408627207' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.11", "id": [4, 8]}]': finished 2024-09-12T02:35:47.014 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 12 02:35:46 smithi172 ceph-mon[35609]: from='mgr.14150 172.21.15.39:0/408627207' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.24", "id": [4, 9]}]': finished 2024-09-12T02:35:47.014 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 12 02:35:46 smithi172 ceph-mon[35609]: from='mgr.14150 172.21.15.39:0/408627207' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.33", "id": [5, 9]}]': finished 2024-09-12T02:35:47.014 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 12 02:35:46 smithi172 ceph-mon[35609]: from='mgr.14150 172.21.15.39:0/408627207' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.34", "id": [4, 9]}]': finished 2024-09-12T02:35:47.014 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 12 02:35:46 smithi172 ceph-mon[35609]: from='mgr.14150 172.21.15.39:0/408627207' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.2", "id": [9, 1]}]': finished 2024-09-12T02:35:47.014 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 12 02:35:46 smithi172 ceph-mon[35609]: from='mgr.14150 172.21.15.39:0/408627207' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.6", "id": [9, 11]}]': finished 2024-09-12T02:35:47.015 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 12 02:35:46 smithi172 ceph-mon[35609]: osdmap e92: 12 total, 12 up, 12 in 2024-09-12T02:35:47.015 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 12 02:35:46 smithi172 ceph-mon[35609]: from='client.? 172.21.15.39:0/4114389990' entity='client.admin' cmd=[{"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"}]: dispatch 2024-09-12T02:35:47.015 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 12 02:35:46 smithi172 ceph-mon[35609]: from='client.? ' entity='client.admin' cmd=[{"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"}]: dispatch 2024-09-12T02:35:47.100 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 02:35:46 smithi039 ceph-mon[30515]: pgmap v321: 129 pgs: 129 active+clean; 581 KiB data, 346 MiB used, 1.0 TiB / 1.0 TiB avail; 426 B/s wr, 0 op/s 2024-09-12T02:35:47.100 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 02:35:46 smithi039 ceph-mon[30515]: from='mgr.14150 172.21.15.39:0/408627207' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.0", "id": [7, 11]}]': finished 2024-09-12T02:35:47.100 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 02:35:46 smithi039 ceph-mon[30515]: from='mgr.14150 172.21.15.39:0/408627207' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.b", "id": [2, 1]}]': finished 2024-09-12T02:35:47.100 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 02:35:46 smithi039 ceph-mon[30515]: from='mgr.14150 172.21.15.39:0/408627207' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.10", "id": [8, 11]}]': finished 2024-09-12T02:35:47.100 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 02:35:46 smithi039 ceph-mon[30515]: from='mgr.14150 172.21.15.39:0/408627207' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.1b", "id": [2, 4]}]': finished 2024-09-12T02:35:47.100 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 02:35:46 smithi039 ceph-mon[30515]: from='mgr.14150 172.21.15.39:0/408627207' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.11", "id": [4, 8]}]': finished 2024-09-12T02:35:47.100 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 02:35:46 smithi039 ceph-mon[30515]: from='mgr.14150 172.21.15.39:0/408627207' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.24", "id": [4, 9]}]': finished 2024-09-12T02:35:47.100 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 02:35:46 smithi039 ceph-mon[30515]: from='mgr.14150 172.21.15.39:0/408627207' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.33", "id": [5, 9]}]': finished 2024-09-12T02:35:47.101 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 02:35:46 smithi039 ceph-mon[30515]: from='mgr.14150 172.21.15.39:0/408627207' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.34", "id": [4, 9]}]': finished 2024-09-12T02:35:47.101 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 02:35:46 smithi039 ceph-mon[30515]: from='mgr.14150 172.21.15.39:0/408627207' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.2", "id": [9, 1]}]': finished 2024-09-12T02:35:47.101 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 02:35:46 smithi039 ceph-mon[30515]: from='mgr.14150 172.21.15.39:0/408627207' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.6", "id": [9, 11]}]': finished 2024-09-12T02:35:47.101 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 02:35:46 smithi039 ceph-mon[30515]: osdmap e92: 12 total, 12 up, 12 in 2024-09-12T02:35:47.101 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 02:35:46 smithi039 ceph-mon[30515]: from='client.? 172.21.15.39:0/4114389990' entity='client.admin' cmd=[{"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"}]: dispatch 2024-09-12T02:35:47.101 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 02:35:46 smithi039 ceph-mon[30515]: from='client.? ' entity='client.admin' cmd=[{"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"}]: dispatch 2024-09-12T02:35:47.198 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 12 02:35:46 smithi044 ceph-mon[35411]: pgmap v321: 129 pgs: 129 active+clean; 581 KiB data, 346 MiB used, 1.0 TiB / 1.0 TiB avail; 426 B/s wr, 0 op/s 2024-09-12T02:35:47.199 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 12 02:35:46 smithi044 ceph-mon[35411]: from='mgr.14150 172.21.15.39:0/408627207' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.0", "id": [7, 11]}]': finished 2024-09-12T02:35:47.199 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 12 02:35:46 smithi044 ceph-mon[35411]: from='mgr.14150 172.21.15.39:0/408627207' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.b", "id": [2, 1]}]': finished 2024-09-12T02:35:47.199 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 12 02:35:46 smithi044 ceph-mon[35411]: from='mgr.14150 172.21.15.39:0/408627207' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.10", "id": [8, 11]}]': finished 2024-09-12T02:35:47.199 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 12 02:35:46 smithi044 ceph-mon[35411]: from='mgr.14150 172.21.15.39:0/408627207' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.1b", "id": [2, 4]}]': finished 2024-09-12T02:35:47.199 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 12 02:35:46 smithi044 ceph-mon[35411]: from='mgr.14150 172.21.15.39:0/408627207' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.11", "id": [4, 8]}]': finished 2024-09-12T02:35:47.199 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 12 02:35:46 smithi044 ceph-mon[35411]: from='mgr.14150 172.21.15.39:0/408627207' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.24", "id": [4, 9]}]': finished 2024-09-12T02:35:47.199 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 12 02:35:46 smithi044 ceph-mon[35411]: from='mgr.14150 172.21.15.39:0/408627207' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.33", "id": [5, 9]}]': finished 2024-09-12T02:35:47.199 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 12 02:35:46 smithi044 ceph-mon[35411]: from='mgr.14150 172.21.15.39:0/408627207' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.34", "id": [4, 9]}]': finished 2024-09-12T02:35:47.199 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 12 02:35:46 smithi044 ceph-mon[35411]: from='mgr.14150 172.21.15.39:0/408627207' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.2", "id": [9, 1]}]': finished 2024-09-12T02:35:47.199 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 12 02:35:46 smithi044 ceph-mon[35411]: from='mgr.14150 172.21.15.39:0/408627207' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.6", "id": [9, 11]}]': finished 2024-09-12T02:35:47.200 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 12 02:35:46 smithi044 ceph-mon[35411]: osdmap e92: 12 total, 12 up, 12 in 2024-09-12T02:35:47.200 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 12 02:35:46 smithi044 ceph-mon[35411]: from='client.? 172.21.15.39:0/4114389990' entity='client.admin' cmd=[{"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"}]: dispatch 2024-09-12T02:35:47.200 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 12 02:35:46 smithi044 ceph-mon[35411]: from='client.? ' entity='client.admin' cmd=[{"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"}]: dispatch 2024-09-12T02:35:47.475 DEBUG:tasks.cephfs.filesystem:fs_config: {'ec_profile': ['m=2', 'k=2', 'crush-failure-domain=osd'], 'max_mds': 5, 'session_timeout': 300, 'standby_replay': True, 'subvols': {'create': 2, 'subvol_options': '--size 25000000000'}} 2024-09-12T02:35:47.476 DEBUG:teuthology.orchestra.run.smithi039:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc shell --fsid 4954ed46-70ae-11ef-bcea-c7b262605968 -- ceph fs set cephfs max_mds 5 2024-09-12T02:35:47.856 INFO:teuthology.orchestra.run.smithi039.stderr:Inferring config /var/lib/ceph/4954ed46-70ae-11ef-bcea-c7b262605968/mon.a/config 2024-09-12T02:35:47.995 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 02:35:47 smithi039 ceph-mon[30515]: osdmap e93: 12 total, 12 up, 12 in 2024-09-12T02:35:47.996 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 02:35:47 smithi039 ceph-mon[30515]: from='client.? ' entity='client.admin' cmd='[{"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"}]': finished 2024-09-12T02:35:47.996 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 02:35:47 smithi039 ceph-mon[30515]: fsmap cephfs:1 {0=b=up:active} 11 up:standby 2024-09-12T02:35:48.013 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 12 02:35:47 smithi172 ceph-mon[35609]: osdmap e93: 12 total, 12 up, 12 in 2024-09-12T02:35:48.013 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 12 02:35:47 smithi172 ceph-mon[35609]: from='client.? ' entity='client.admin' cmd='[{"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"}]': finished 2024-09-12T02:35:48.014 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 12 02:35:47 smithi172 ceph-mon[35609]: fsmap cephfs:1 {0=b=up:active} 11 up:standby 2024-09-12T02:35:48.198 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 12 02:35:47 smithi044 ceph-mon[35411]: osdmap e93: 12 total, 12 up, 12 in 2024-09-12T02:35:48.198 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 12 02:35:47 smithi044 ceph-mon[35411]: from='client.? ' entity='client.admin' cmd='[{"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"}]': finished 2024-09-12T02:35:48.199 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 12 02:35:47 smithi044 ceph-mon[35411]: fsmap cephfs:1 {0=b=up:active} 11 up:standby 2024-09-12T02:35:48.448 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:35:48.447+0000 7feaa8200640 1 -- 172.21.15.39:0/3827292151 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7feaa0103ff0 msgr2=0x7feaa01043d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:35:48.448 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:35:48.447+0000 7feaa8200640 1 --2- 172.21.15.39:0/3827292151 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7feaa0103ff0 0x7feaa01043d0 secure :-1 s=READY pgs=174 cs=0 l=1 rev1=1 crypto rx=0x7fea94009900 tx=0x7fea9402a3f0 comp rx=0 tx=0).stop 2024-09-12T02:35:48.448 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:35:48.447+0000 7feaa8200640 1 -- 172.21.15.39:0/3827292151 shutdown_connections 2024-09-12T02:35:48.448 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:35:48.447+0000 7feaa8200640 1 --2- 172.21.15.39:0/3827292151 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7feaa0109120 0x7feaa0110ca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:35:48.449 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:35:48.447+0000 7feaa8200640 1 --2- 172.21.15.39:0/3827292151 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7feaa01049a0 0x7feaa01089f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:35:48.449 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:35:48.447+0000 7feaa8200640 1 --2- 172.21.15.39:0/3827292151 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7feaa0103ff0 0x7feaa01043d0 unknown :-1 s=CLOSED pgs=174 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:35:48.449 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:35:48.447+0000 7feaa8200640 1 -- 172.21.15.39:0/3827292151 >> 172.21.15.39:0/3827292151 conn(0x7feaa00ffa90 msgr2=0x7feaa0101eb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:35:48.449 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:35:48.447+0000 7feaa8200640 1 -- 172.21.15.39:0/3827292151 shutdown_connections 2024-09-12T02:35:48.449 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:35:48.447+0000 7feaa8200640 1 -- 172.21.15.39:0/3827292151 wait complete. 2024-09-12T02:35:48.450 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:35:48.448+0000 7feaa8200640 1 Processor -- start 2024-09-12T02:35:48.451 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:35:48.448+0000 7feaa8200640 1 -- start start 2024-09-12T02:35:48.451 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:35:48.448+0000 7feaa8200640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7feaa0103ff0 0x7feaa019a620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:35:48.451 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:35:48.448+0000 7feaa8200640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7feaa01049a0 0x7feaa019ab60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:35:48.451 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:35:48.448+0000 7feaa8200640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7feaa0109120 0x7feaa019eef0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:35:48.451 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:35:48.448+0000 7feaa8200640 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 -- 0x7feaa01141a0 con 0x7feaa01049a0 2024-09-12T02:35:48.451 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:35:48.448+0000 7feaa8200640 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x7feaa0114020 con 0x7feaa0109120 2024-09-12T02:35:48.451 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:35:48.448+0000 7feaa8200640 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7feaa0114320 con 0x7feaa0103ff0 2024-09-12T02:35:48.451 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:35:48.449+0000 7feaa4e00640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7feaa01049a0 0x7feaa019ab60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:35:48.451 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:35:48.449+0000 7feaa5800640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7feaa0103ff0 0x7feaa019a620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:35:48.451 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:35:48.449+0000 7feaa6200640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7feaa0109120 0x7feaa019eef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:35:48.451 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:35:48.449+0000 7feaa5800640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7feaa0103ff0 0x7feaa019a620 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.172:3300/0 says I am v2:172.21.15.39:43336/0 (socket says 172.21.15.39:43336) 2024-09-12T02:35:48.452 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:35:48.449+0000 7feaa5800640 1 -- 172.21.15.39:0/1195712305 learned_addr learned my addr 172.21.15.39:0/1195712305 (peer_addr_for_me v2:172.21.15.39:0/0) 2024-09-12T02:35:48.452 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:35:48.449+0000 7feaa6200640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7feaa0109120 0x7feaa019eef0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.39:37166/0 (socket says 172.21.15.39:37166) 2024-09-12T02:35:48.452 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:35:48.449+0000 7feaa5800640 1 -- 172.21.15.39:0/1195712305 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7feaa0109120 msgr2=0x7feaa019eef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:35:48.452 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:35:48.449+0000 7feaa5800640 1 --2- 172.21.15.39:0/1195712305 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7feaa0109120 0x7feaa019eef0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:35:48.452 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:35:48.449+0000 7feaa5800640 1 -- 172.21.15.39:0/1195712305 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7feaa01049a0 msgr2=0x7feaa019ab60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:35:48.452 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:35:48.449+0000 7feaa5800640 1 --2- 172.21.15.39:0/1195712305 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7feaa01049a0 0x7feaa019ab60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:35:48.452 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:35:48.449+0000 7feaa5800640 1 -- 172.21.15.39:0/1195712305 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7feaa019f5d0 con 0x7feaa0103ff0 2024-09-12T02:35:48.452 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:35:48.449+0000 7feaa6200640 1 --2- 172.21.15.39:0/1195712305 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7feaa0109120 0x7feaa019eef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-12T02:35:48.452 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:35:48.450+0000 7feaa5800640 1 --2- 172.21.15.39:0/1195712305 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7feaa0103ff0 0x7feaa019a620 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7fea94004770 tx=0x7fea94003c10 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:35:48.452 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:35:48.450+0000 7fea9e000640 1 -- 172.21.15.39:0/1195712305 <== mon.1 v2:172.21.15.172:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fea9403f070 con 0x7feaa0103ff0 2024-09-12T02:35:48.452 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:35:48.450+0000 7feaa8200640 1 -- 172.21.15.39:0/1195712305 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7feaa019f860 con 0x7feaa0103ff0 2024-09-12T02:35:48.452 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:35:48.450+0000 7fea9e000640 1 -- 172.21.15.39:0/1195712305 <== mon.1 v2:172.21.15.172:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fea94031ca0 con 0x7feaa0103ff0 2024-09-12T02:35:48.453 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:35:48.450+0000 7fea9e000640 1 -- 172.21.15.39:0/1195712305 <== mon.1 v2:172.21.15.172:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fea94035030 con 0x7feaa0103ff0 2024-09-12T02:35:48.453 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:35:48.450+0000 7feaa8200640 1 -- 172.21.15.39:0/1195712305 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7feaa01a71a0 con 0x7feaa0103ff0 2024-09-12T02:35:48.453 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:35:48.451+0000 7feaa8200640 1 -- 172.21.15.39:0/1195712305 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7feaa01043d0 con 0x7feaa0103ff0 2024-09-12T02:35:48.454 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:35:48.453+0000 7fea9e000640 1 -- 172.21.15.39:0/1195712305 <== mon.1 v2:172.21.15.172:3300/0 4 ==== mgrmap(e 16) ==== 137833+0+0 (secure 0 0 0) 0x7fea94042070 con 0x7feaa0103ff0 2024-09-12T02:35:48.455 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:35:48.454+0000 7fea9e000640 1 --2- 172.21.15.39:0/1195712305 >> [v2:172.21.15.39:6800/1725006999,v1:172.21.15.39:6801/1725006999] conn(0x7fea880a2b80 0x7fea880a5040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:35:48.455 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:35:48.454+0000 7fea9e000640 1 -- 172.21.15.39:0/1195712305 <== mon.1 v2:172.21.15.172:3300/0 5 ==== osd_map(93..93 src has 1..93) ==== 9092+0+0 (secure 0 0 0) 0x7fea940eff80 con 0x7feaa0103ff0 2024-09-12T02:35:48.455 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:35:48.455+0000 7feaa4e00640 1 --2- 172.21.15.39:0/1195712305 >> [v2:172.21.15.39:6800/1725006999,v1:172.21.15.39:6801/1725006999] conn(0x7fea880a2b80 0x7fea880a5040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:35:48.456 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:35:48.455+0000 7feaa4e00640 1 --2- 172.21.15.39:0/1195712305 >> [v2:172.21.15.39:6800/1725006999,v1:172.21.15.39:6801/1725006999] conn(0x7fea880a2b80 0x7fea880a5040 secure :-1 s=READY pgs=163 cs=0 l=1 rev1=1 crypto rx=0x7feaa00fff20 tx=0x7fea8c005f90 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:35:48.457 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:35:48.456+0000 7fea9e000640 1 -- 172.21.15.39:0/1195712305 <== mon.1 v2:172.21.15.172:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7fea940bc590 con 0x7feaa0103ff0 2024-09-12T02:35:48.684 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:35:48.683+0000 7feaa8200640 1 -- 172.21.15.39:0/1195712305 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "max_mds", "val": "5"} v 0) -- 0x7feaa010c300 con 0x7feaa0103ff0 2024-09-12T02:35:48.743 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:35:48.742+0000 7fea9e000640 1 -- 172.21.15.39:0/1195712305 <== mon.1 v2:172.21.15.172:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "max_mds", "val": "5"}]=0 v19) ==== 105+0+0 (secure 0 0 0) 0x7fea940c0890 con 0x7feaa0103ff0 2024-09-12T02:35:48.746 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:35:48.745+0000 7feaa8200640 1 -- 172.21.15.39:0/1195712305 >> [v2:172.21.15.39:6800/1725006999,v1:172.21.15.39:6801/1725006999] conn(0x7fea880a2b80 msgr2=0x7fea880a5040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:35:48.746 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:35:48.745+0000 7feaa8200640 1 --2- 172.21.15.39:0/1195712305 >> [v2:172.21.15.39:6800/1725006999,v1:172.21.15.39:6801/1725006999] conn(0x7fea880a2b80 0x7fea880a5040 secure :-1 s=READY pgs=163 cs=0 l=1 rev1=1 crypto rx=0x7feaa00fff20 tx=0x7fea8c005f90 comp rx=0 tx=0).stop 2024-09-12T02:35:48.746 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:35:48.745+0000 7feaa8200640 1 -- 172.21.15.39:0/1195712305 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7feaa0103ff0 msgr2=0x7feaa019a620 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:35:48.746 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:35:48.745+0000 7feaa8200640 1 --2- 172.21.15.39:0/1195712305 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7feaa0103ff0 0x7feaa019a620 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7fea94004770 tx=0x7fea94003c10 comp rx=0 tx=0).stop 2024-09-12T02:35:48.746 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:35:48.745+0000 7feaa8200640 1 -- 172.21.15.39:0/1195712305 shutdown_connections 2024-09-12T02:35:48.746 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:35:48.745+0000 7feaa8200640 1 --2- 172.21.15.39:0/1195712305 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7feaa0109120 0x7feaa019eef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:35:48.746 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:35:48.745+0000 7feaa8200640 1 --2- 172.21.15.39:0/1195712305 >> [v2:172.21.15.39:6800/1725006999,v1:172.21.15.39:6801/1725006999] conn(0x7fea880a2b80 0x7fea880a5040 unknown :-1 s=CLOSED pgs=163 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:35:48.746 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:35:48.745+0000 7feaa8200640 1 --2- 172.21.15.39:0/1195712305 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7feaa01049a0 0x7feaa019ab60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:35:48.746 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:35:48.745+0000 7feaa8200640 1 --2- 172.21.15.39:0/1195712305 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7feaa0103ff0 0x7feaa019a620 unknown :-1 s=CLOSED pgs=80 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:35:48.746 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:35:48.745+0000 7feaa8200640 1 -- 172.21.15.39:0/1195712305 >> 172.21.15.39:0/1195712305 conn(0x7feaa00ffa90 msgr2=0x7feaa0100d70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:35:48.746 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:35:48.745+0000 7feaa8200640 1 -- 172.21.15.39:0/1195712305 shutdown_connections 2024-09-12T02:35:48.746 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:35:48.745+0000 7feaa8200640 1 -- 172.21.15.39:0/1195712305 wait complete. 2024-09-12T02:35:49.013 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 12 02:35:48 smithi172 ceph-mon[35609]: pgmap v324: 129 pgs: 129 active+clean; 581 KiB data, 346 MiB used, 1.0 TiB / 1.0 TiB avail; 127 B/s wr, 0 op/s 2024-09-12T02:35:49.014 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 12 02:35:48 smithi172 ceph-mon[35609]: from='client.? 172.21.15.39:0/1195712305' entity='client.admin' cmd=[{"prefix": "fs set", "fs_name": "cephfs", "var": "max_mds", "val": "5"}]: dispatch 2024-09-12T02:35:49.014 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 12 02:35:48 smithi172 ceph-mon[35609]: from='client.? ' entity='client.admin' cmd=[{"prefix": "fs set", "fs_name": "cephfs", "var": "max_mds", "val": "5"}]: dispatch 2024-09-12T02:35:49.100 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 02:35:48 smithi039 ceph-mon[30515]: pgmap v324: 129 pgs: 129 active+clean; 581 KiB data, 346 MiB used, 1.0 TiB / 1.0 TiB avail; 127 B/s wr, 0 op/s 2024-09-12T02:35:49.100 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 02:35:48 smithi039 ceph-mon[30515]: from='client.? 172.21.15.39:0/1195712305' entity='client.admin' cmd=[{"prefix": "fs set", "fs_name": "cephfs", "var": "max_mds", "val": "5"}]: dispatch 2024-09-12T02:35:49.100 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 02:35:48 smithi039 ceph-mon[30515]: from='client.? ' entity='client.admin' cmd=[{"prefix": "fs set", "fs_name": "cephfs", "var": "max_mds", "val": "5"}]: dispatch 2024-09-12T02:35:49.198 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 12 02:35:48 smithi044 ceph-mon[35411]: pgmap v324: 129 pgs: 129 active+clean; 581 KiB data, 346 MiB used, 1.0 TiB / 1.0 TiB avail; 127 B/s wr, 0 op/s 2024-09-12T02:35:49.198 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 12 02:35:48 smithi044 ceph-mon[35411]: from='client.? 172.21.15.39:0/1195712305' entity='client.admin' cmd=[{"prefix": "fs set", "fs_name": "cephfs", "var": "max_mds", "val": "5"}]: dispatch 2024-09-12T02:35:49.199 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 12 02:35:48 smithi044 ceph-mon[35411]: from='client.? ' entity='client.admin' cmd=[{"prefix": "fs set", "fs_name": "cephfs", "var": "max_mds", "val": "5"}]: dispatch 2024-09-12T02:35:49.682 DEBUG:teuthology.orchestra.run.smithi039:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc shell --fsid 4954ed46-70ae-11ef-bcea-c7b262605968 -- ceph fs set cephfs allow_standby_replay true 2024-09-12T02:35:50.013 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 12 02:35:49 smithi172 ceph-mon[35609]: Health check failed: 1 filesystem is online with fewer MDS than max_mds (MDS_UP_LESS_THAN_MAX) 2024-09-12T02:35:50.014 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 12 02:35:49 smithi172 ceph-mon[35609]: from='client.? ' entity='client.admin' cmd='[{"prefix": "fs set", "fs_name": "cephfs", "var": "max_mds", "val": "5"}]': finished 2024-09-12T02:35:50.014 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 12 02:35:49 smithi172 ceph-mon[35609]: daemon mds.i assigned to filesystem cephfs as rank 1 (now has 2 ranks) 2024-09-12T02:35:50.014 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 12 02:35:49 smithi172 ceph-mon[35609]: fsmap cephfs:1 {0=b=up:active} 11 up:standby 2024-09-12T02:35:50.014 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 12 02:35:49 smithi172 ceph-mon[35609]: fsmap cephfs:2 {0=b=up:active,1=i=up:creating} 10 up:standby 2024-09-12T02:35:50.014 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 12 02:35:49 smithi172 ceph-mon[35609]: daemon mds.i is now active in filesystem cephfs as rank 1 2024-09-12T02:35:50.069 INFO:teuthology.orchestra.run.smithi039.stderr:Inferring config /var/lib/ceph/4954ed46-70ae-11ef-bcea-c7b262605968/mon.a/config 2024-09-12T02:35:50.099 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 02:35:49 smithi039 ceph-mon[30515]: Health check failed: 1 filesystem is online with fewer MDS than max_mds (MDS_UP_LESS_THAN_MAX) 2024-09-12T02:35:50.100 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 02:35:49 smithi039 ceph-mon[30515]: from='client.? ' entity='client.admin' cmd='[{"prefix": "fs set", "fs_name": "cephfs", "var": "max_mds", "val": "5"}]': finished 2024-09-12T02:35:50.100 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 02:35:49 smithi039 ceph-mon[30515]: daemon mds.i assigned to filesystem cephfs as rank 1 (now has 2 ranks) 2024-09-12T02:35:50.100 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 02:35:49 smithi039 ceph-mon[30515]: fsmap cephfs:1 {0=b=up:active} 11 up:standby 2024-09-12T02:35:50.100 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 02:35:49 smithi039 ceph-mon[30515]: fsmap cephfs:2 {0=b=up:active,1=i=up:creating} 10 up:standby 2024-09-12T02:35:50.100 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 02:35:49 smithi039 ceph-mon[30515]: daemon mds.i is now active in filesystem cephfs as rank 1 2024-09-12T02:35:50.198 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 12 02:35:49 smithi044 ceph-mon[35411]: Health check failed: 1 filesystem is online with fewer MDS than max_mds (MDS_UP_LESS_THAN_MAX) 2024-09-12T02:35:50.199 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 12 02:35:49 smithi044 ceph-mon[35411]: from='client.? ' entity='client.admin' cmd='[{"prefix": "fs set", "fs_name": "cephfs", "var": "max_mds", "val": "5"}]': finished 2024-09-12T02:35:50.199 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 12 02:35:49 smithi044 ceph-mon[35411]: daemon mds.i assigned to filesystem cephfs as rank 1 (now has 2 ranks) 2024-09-12T02:35:50.199 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 12 02:35:49 smithi044 ceph-mon[35411]: fsmap cephfs:1 {0=b=up:active} 11 up:standby 2024-09-12T02:35:50.199 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 12 02:35:49 smithi044 ceph-mon[35411]: fsmap cephfs:2 {0=b=up:active,1=i=up:creating} 10 up:standby 2024-09-12T02:35:50.199 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 12 02:35:49 smithi044 ceph-mon[35411]: daemon mds.i is now active in filesystem cephfs as rank 1 2024-09-12T02:35:50.675 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:35:50.672+0000 7f16d1a00640 1 -- 172.21.15.39:0/3127772765 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f16cc109120 msgr2=0x7f16cc110ca0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:35:50.675 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:35:50.672+0000 7f16d1a00640 1 --2- 172.21.15.39:0/3127772765 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f16cc109120 0x7f16cc110ca0 secure :-1 s=READY pgs=175 cs=0 l=1 rev1=1 crypto rx=0x7f16c4009ca0 tx=0x7f16c402a8c0 comp rx=0 tx=0).stop 2024-09-12T02:35:50.675 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:35:50.672+0000 7f16d1a00640 1 -- 172.21.15.39:0/3127772765 shutdown_connections 2024-09-12T02:35:50.675 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:35:50.672+0000 7f16d1a00640 1 --2- 172.21.15.39:0/3127772765 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f16cc109120 0x7f16cc110ca0 unknown :-1 s=CLOSED pgs=175 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:35:50.675 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:35:50.672+0000 7f16d1a00640 1 --2- 172.21.15.39:0/3127772765 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f16cc1049a0 0x7f16cc1089f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:35:50.675 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:35:50.672+0000 7f16d1a00640 1 --2- 172.21.15.39:0/3127772765 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f16cc103ff0 0x7f16cc1043d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:35:50.675 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:35:50.672+0000 7f16d1a00640 1 -- 172.21.15.39:0/3127772765 >> 172.21.15.39:0/3127772765 conn(0x7f16cc0ffa90 msgr2=0x7f16cc101eb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:35:50.676 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:35:50.672+0000 7f16d1a00640 1 -- 172.21.15.39:0/3127772765 shutdown_connections 2024-09-12T02:35:50.676 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:35:50.673+0000 7f16d1a00640 1 -- 172.21.15.39:0/3127772765 wait complete. 2024-09-12T02:35:50.676 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:35:50.673+0000 7f16d1a00640 1 Processor -- start 2024-09-12T02:35:50.676 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:35:50.674+0000 7f16d1a00640 1 -- start start 2024-09-12T02:35:50.676 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:35:50.674+0000 7f16d1a00640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f16cc103ff0 0x7f16cc19a5e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:35:50.676 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:35:50.674+0000 7f16d1a00640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f16cc1049a0 0x7f16cc19ab20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:35:50.676 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:35:50.674+0000 7f16d1a00640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f16cc109120 0x7f16cc19eeb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:35:50.676 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:35:50.674+0000 7f16d1a00640 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 -- 0x7f16cc1141a0 con 0x7f16cc109120 2024-09-12T02:35:50.677 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:35:50.674+0000 7f16d1a00640 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x7f16cc114020 con 0x7f16cc103ff0 2024-09-12T02:35:50.677 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:35:50.674+0000 7f16d1a00640 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7f16cc114320 con 0x7f16cc1049a0 2024-09-12T02:35:50.678 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:35:50.674+0000 7f16cb400640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f16cc109120 0x7f16cc19eeb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:35:50.679 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:35:50.674+0000 7f16cb400640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f16cc109120 0x7f16cc19eeb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.39:3300/0 says I am v2:172.21.15.39:38208/0 (socket says 172.21.15.39:38208) 2024-09-12T02:35:50.679 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:35:50.674+0000 7f16cb400640 1 -- 172.21.15.39:0/632695336 learned_addr learned my addr 172.21.15.39:0/632695336 (peer_addr_for_me v2:172.21.15.39:0/0) 2024-09-12T02:35:50.679 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:35:50.674+0000 7f16caa00640 1 --2- 172.21.15.39:0/632695336 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f16cc103ff0 0x7f16cc19a5e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:35:50.679 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:35:50.674+0000 7f16c3e00640 1 --2- 172.21.15.39:0/632695336 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f16cc1049a0 0x7f16cc19ab20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:35:50.679 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:35:50.675+0000 7f16caa00640 1 -- 172.21.15.39:0/632695336 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f16cc1049a0 msgr2=0x7f16cc19ab20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:35:50.679 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:35:50.675+0000 7f16caa00640 1 --2- 172.21.15.39:0/632695336 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f16cc1049a0 0x7f16cc19ab20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:35:50.679 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:35:50.675+0000 7f16caa00640 1 -- 172.21.15.39:0/632695336 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f16cc109120 msgr2=0x7f16cc19eeb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:35:50.680 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:35:50.675+0000 7f16caa00640 1 --2- 172.21.15.39:0/632695336 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f16cc109120 0x7f16cc19eeb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:35:50.680 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:35:50.675+0000 7f16caa00640 1 -- 172.21.15.39:0/632695336 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f16cc19f590 con 0x7f16cc103ff0 2024-09-12T02:35:50.680 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:35:50.675+0000 7f16caa00640 1 --2- 172.21.15.39:0/632695336 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f16cc103ff0 0x7f16cc19a5e0 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7f16bc005fd0 tx=0x7f16bc00dde0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:35:50.680 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:35:50.675+0000 7f16c3400640 1 -- 172.21.15.39:0/632695336 <== mon.2 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f16bc009c30 con 0x7f16cc103ff0 2024-09-12T02:35:50.680 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:35:50.675+0000 7f16d1a00640 1 -- 172.21.15.39:0/632695336 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f16cc19f880 con 0x7f16cc103ff0 2024-09-12T02:35:50.680 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:35:50.676+0000 7f16c3400640 1 -- 172.21.15.39:0/632695336 <== mon.2 v2:172.21.15.44:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f16bc009dd0 con 0x7f16cc103ff0 2024-09-12T02:35:50.680 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:35:50.676+0000 7f16c3400640 1 -- 172.21.15.39:0/632695336 <== mon.2 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f16bc010460 con 0x7f16cc103ff0 2024-09-12T02:35:50.680 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:35:50.676+0000 7f16d1a00640 1 -- 172.21.15.39:0/632695336 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f16cc1a7160 con 0x7f16cc103ff0 2024-09-12T02:35:50.681 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:35:50.677+0000 7f16d1a00640 1 -- 172.21.15.39:0/632695336 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f16cc1043d0 con 0x7f16cc103ff0 2024-09-12T02:35:50.682 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:35:50.679+0000 7f16c3400640 1 -- 172.21.15.39:0/632695336 <== mon.2 v2:172.21.15.44:3300/0 4 ==== mgrmap(e 16) ==== 137833+0+0 (secure 0 0 0) 0x7f16bc003f50 con 0x7f16cc103ff0 2024-09-12T02:35:50.682 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:35:50.680+0000 7f16c3400640 1 --2- 172.21.15.39:0/632695336 >> [v2:172.21.15.39:6800/1725006999,v1:172.21.15.39:6801/1725006999] conn(0x7f16b00a2b80 0x7f16b00a5040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:35:50.682 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:35:50.680+0000 7f16c3400640 1 -- 172.21.15.39:0/632695336 <== mon.2 v2:172.21.15.44:3300/0 5 ==== osd_map(93..93 src has 1..93) ==== 9092+0+0 (secure 0 0 0) 0x7f16bc0cf2a0 con 0x7f16cc103ff0 2024-09-12T02:35:50.682 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:35:50.680+0000 7f16c3e00640 1 --2- 172.21.15.39:0/632695336 >> [v2:172.21.15.39:6800/1725006999,v1:172.21.15.39:6801/1725006999] conn(0x7f16b00a2b80 0x7f16b00a5040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:35:50.682 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:35:50.681+0000 7f16c3e00640 1 --2- 172.21.15.39:0/632695336 >> [v2:172.21.15.39:6800/1725006999,v1:172.21.15.39:6801/1725006999] conn(0x7f16b00a2b80 0x7f16b00a5040 secure :-1 s=READY pgs=164 cs=0 l=1 rev1=1 crypto rx=0x7f16cc10ab00 tx=0x7f16b4005f90 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:35:50.683 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:35:50.682+0000 7f16c3400640 1 -- 172.21.15.39:0/632695336 <== mon.2 v2:172.21.15.44:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7f16bc017020 con 0x7f16cc103ff0 2024-09-12T02:35:50.849 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 02:35:50 smithi039 ceph-mon[30515]: pgmap v325: 129 pgs: 129 active+clean; 581 KiB data, 347 MiB used, 1.0 TiB / 1.0 TiB avail; 127 B/s wr, 0 op/s; 0 B/s, 0 objects/s recovering 2024-09-12T02:35:50.850 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 02:35:50 smithi039 ceph-mon[30515]: mds.? [v2:172.21.15.172:6838/3742537097,v1:172.21.15.172:6839/3742537097] up:active 2024-09-12T02:35:50.850 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 02:35:50 smithi039 ceph-mon[30515]: daemon mds.c assigned to filesystem cephfs as rank 2 (now has 3 ranks) 2024-09-12T02:35:50.850 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 02:35:50 smithi039 ceph-mon[30515]: fsmap cephfs:2 {0=b=up:active,1=i=up:active} 10 up:standby 2024-09-12T02:35:50.850 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 02:35:50 smithi039 ceph-mon[30515]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:creating} 9 up:standby 2024-09-12T02:35:50.850 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 02:35:50 smithi039 ceph-mon[30515]: daemon mds.c is now active in filesystem cephfs as rank 2 2024-09-12T02:35:50.919 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:35:50.918+0000 7f16d1a00640 1 -- 172.21.15.39:0/632695336 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "true"} v 0) -- 0x7f16cc1a7400 con 0x7f16cc103ff0 2024-09-12T02:35:51.014 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 12 02:35:50 smithi172 ceph-mon[35609]: pgmap v325: 129 pgs: 129 active+clean; 581 KiB data, 347 MiB used, 1.0 TiB / 1.0 TiB avail; 127 B/s wr, 0 op/s; 0 B/s, 0 objects/s recovering 2024-09-12T02:35:51.014 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 12 02:35:50 smithi172 ceph-mon[35609]: mds.? [v2:172.21.15.172:6838/3742537097,v1:172.21.15.172:6839/3742537097] up:active 2024-09-12T02:35:51.014 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 12 02:35:50 smithi172 ceph-mon[35609]: daemon mds.c assigned to filesystem cephfs as rank 2 (now has 3 ranks) 2024-09-12T02:35:51.014 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 12 02:35:50 smithi172 ceph-mon[35609]: fsmap cephfs:2 {0=b=up:active,1=i=up:active} 10 up:standby 2024-09-12T02:35:51.014 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 12 02:35:50 smithi172 ceph-mon[35609]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:creating} 9 up:standby 2024-09-12T02:35:51.014 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 12 02:35:50 smithi172 ceph-mon[35609]: daemon mds.c is now active in filesystem cephfs as rank 2 2024-09-12T02:35:51.198 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 12 02:35:50 smithi044 ceph-mon[35411]: pgmap v325: 129 pgs: 129 active+clean; 581 KiB data, 347 MiB used, 1.0 TiB / 1.0 TiB avail; 127 B/s wr, 0 op/s; 0 B/s, 0 objects/s recovering 2024-09-12T02:35:51.199 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 12 02:35:50 smithi044 ceph-mon[35411]: mds.? [v2:172.21.15.172:6838/3742537097,v1:172.21.15.172:6839/3742537097] up:active 2024-09-12T02:35:51.199 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 12 02:35:50 smithi044 ceph-mon[35411]: daemon mds.c assigned to filesystem cephfs as rank 2 (now has 3 ranks) 2024-09-12T02:35:51.199 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 12 02:35:50 smithi044 ceph-mon[35411]: fsmap cephfs:2 {0=b=up:active,1=i=up:active} 10 up:standby 2024-09-12T02:35:51.199 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 12 02:35:50 smithi044 ceph-mon[35411]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:creating} 9 up:standby 2024-09-12T02:35:51.199 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 12 02:35:50 smithi044 ceph-mon[35411]: daemon mds.c is now active in filesystem cephfs as rank 2 2024-09-12T02:35:51.793 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:35:51.792+0000 7f16c3400640 1 -- 172.21.15.39:0/632695336 <== mon.2 v2:172.21.15.44:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "true"}]=0 v25) ==== 121+0+0 (secure 0 0 0) 0x7f16bc09b7f0 con 0x7f16cc103ff0 2024-09-12T02:35:51.795 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:35:51.794+0000 7f16d1a00640 1 -- 172.21.15.39:0/632695336 >> [v2:172.21.15.39:6800/1725006999,v1:172.21.15.39:6801/1725006999] conn(0x7f16b00a2b80 msgr2=0x7f16b00a5040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:35:51.795 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:35:51.794+0000 7f16d1a00640 1 --2- 172.21.15.39:0/632695336 >> [v2:172.21.15.39:6800/1725006999,v1:172.21.15.39:6801/1725006999] conn(0x7f16b00a2b80 0x7f16b00a5040 secure :-1 s=READY pgs=164 cs=0 l=1 rev1=1 crypto rx=0x7f16cc10ab00 tx=0x7f16b4005f90 comp rx=0 tx=0).stop 2024-09-12T02:35:51.796 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:35:51.794+0000 7f16d1a00640 1 -- 172.21.15.39:0/632695336 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f16cc103ff0 msgr2=0x7f16cc19a5e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:35:51.796 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:35:51.794+0000 7f16d1a00640 1 --2- 172.21.15.39:0/632695336 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f16cc103ff0 0x7f16cc19a5e0 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7f16bc005fd0 tx=0x7f16bc00dde0 comp rx=0 tx=0).stop 2024-09-12T02:35:51.796 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:35:51.795+0000 7f16d1a00640 1 -- 172.21.15.39:0/632695336 shutdown_connections 2024-09-12T02:35:51.796 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:35:51.795+0000 7f16d1a00640 1 --2- 172.21.15.39:0/632695336 >> [v2:172.21.15.39:6800/1725006999,v1:172.21.15.39:6801/1725006999] conn(0x7f16b00a2b80 0x7f16b00a5040 unknown :-1 s=CLOSED pgs=164 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:35:51.796 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:35:51.795+0000 7f16d1a00640 1 --2- 172.21.15.39:0/632695336 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f16cc109120 0x7f16cc19eeb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:35:51.796 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:35:51.795+0000 7f16d1a00640 1 --2- 172.21.15.39:0/632695336 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f16cc1049a0 0x7f16cc19ab20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:35:51.796 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:35:51.795+0000 7f16d1a00640 1 --2- 172.21.15.39:0/632695336 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f16cc103ff0 0x7f16cc19a5e0 unknown :-1 s=CLOSED pgs=83 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:35:51.796 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:35:51.795+0000 7f16d1a00640 1 -- 172.21.15.39:0/632695336 >> 172.21.15.39:0/632695336 conn(0x7f16cc0ffa90 msgr2=0x7f16cc1005b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:35:51.797 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:35:51.795+0000 7f16d1a00640 1 -- 172.21.15.39:0/632695336 shutdown_connections 2024-09-12T02:35:51.797 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:35:51.795+0000 7f16d1a00640 1 -- 172.21.15.39:0/632695336 wait complete. 2024-09-12T02:35:52.099 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 02:35:51 smithi039 ceph-mon[30515]: mds.? [v2:172.21.15.172:6836/493506747,v1:172.21.15.172:6837/493506747] up:active 2024-09-12T02:35:52.100 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 02:35:51 smithi039 ceph-mon[30515]: daemon mds.h assigned to filesystem cephfs as rank 3 (now has 4 ranks) 2024-09-12T02:35:52.100 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 02:35:51 smithi039 ceph-mon[30515]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 9 up:standby 2024-09-12T02:35:52.100 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 02:35:51 smithi039 ceph-mon[30515]: fsmap cephfs:4 {0=b=up:active,1=i=up:active,2=c=up:active,3=h=up:creating} 8 up:standby 2024-09-12T02:35:52.100 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 02:35:51 smithi039 ceph-mon[30515]: daemon mds.h is now active in filesystem cephfs as rank 3 2024-09-12T02:35:52.100 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 02:35:51 smithi039 ceph-mon[30515]: pgmap v326: 129 pgs: 129 active+clean; 581 KiB data, 347 MiB used, 1.0 TiB / 1.0 TiB avail; 127 B/s wr, 0 op/s; 0 B/s, 0 objects/s recovering 2024-09-12T02:35:52.100 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 02:35:51 smithi039 ceph-mon[30515]: from='client.? 172.21.15.39:0/632695336' entity='client.admin' cmd=[{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "true"}]: dispatch 2024-09-12T02:35:52.100 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 02:35:51 smithi039 ceph-mon[30515]: from='client.? ' entity='client.admin' cmd=[{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "true"}]: dispatch 2024-09-12T02:35:52.198 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 12 02:35:51 smithi044 ceph-mon[35411]: mds.? [v2:172.21.15.172:6836/493506747,v1:172.21.15.172:6837/493506747] up:active 2024-09-12T02:35:52.199 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 12 02:35:51 smithi044 ceph-mon[35411]: daemon mds.h assigned to filesystem cephfs as rank 3 (now has 4 ranks) 2024-09-12T02:35:52.199 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 12 02:35:51 smithi044 ceph-mon[35411]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 9 up:standby 2024-09-12T02:35:52.199 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 12 02:35:51 smithi044 ceph-mon[35411]: fsmap cephfs:4 {0=b=up:active,1=i=up:active,2=c=up:active,3=h=up:creating} 8 up:standby 2024-09-12T02:35:52.199 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 12 02:35:51 smithi044 ceph-mon[35411]: daemon mds.h is now active in filesystem cephfs as rank 3 2024-09-12T02:35:52.199 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 12 02:35:51 smithi044 ceph-mon[35411]: pgmap v326: 129 pgs: 129 active+clean; 581 KiB data, 347 MiB used, 1.0 TiB / 1.0 TiB avail; 127 B/s wr, 0 op/s; 0 B/s, 0 objects/s recovering 2024-09-12T02:35:52.199 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 12 02:35:51 smithi044 ceph-mon[35411]: from='client.? 172.21.15.39:0/632695336' entity='client.admin' cmd=[{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "true"}]: dispatch 2024-09-12T02:35:52.199 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 12 02:35:51 smithi044 ceph-mon[35411]: from='client.? ' entity='client.admin' cmd=[{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "true"}]: dispatch 2024-09-12T02:35:52.263 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 12 02:35:51 smithi172 ceph-mon[35609]: mds.? [v2:172.21.15.172:6836/493506747,v1:172.21.15.172:6837/493506747] up:active 2024-09-12T02:35:52.264 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 12 02:35:51 smithi172 ceph-mon[35609]: daemon mds.h assigned to filesystem cephfs as rank 3 (now has 4 ranks) 2024-09-12T02:35:52.264 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 12 02:35:51 smithi172 ceph-mon[35609]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 9 up:standby 2024-09-12T02:35:52.264 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 12 02:35:51 smithi172 ceph-mon[35609]: fsmap cephfs:4 {0=b=up:active,1=i=up:active,2=c=up:active,3=h=up:creating} 8 up:standby 2024-09-12T02:35:52.264 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 12 02:35:51 smithi172 ceph-mon[35609]: daemon mds.h is now active in filesystem cephfs as rank 3 2024-09-12T02:35:52.264 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 12 02:35:51 smithi172 ceph-mon[35609]: pgmap v326: 129 pgs: 129 active+clean; 581 KiB data, 347 MiB used, 1.0 TiB / 1.0 TiB avail; 127 B/s wr, 0 op/s; 0 B/s, 0 objects/s recovering 2024-09-12T02:35:52.264 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 12 02:35:51 smithi172 ceph-mon[35609]: from='client.? 172.21.15.39:0/632695336' entity='client.admin' cmd=[{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "true"}]: dispatch 2024-09-12T02:35:52.264 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 12 02:35:51 smithi172 ceph-mon[35609]: from='client.? ' entity='client.admin' cmd=[{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "true"}]: dispatch 2024-09-12T02:35:52.565 DEBUG:teuthology.orchestra.run.smithi039:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc shell --fsid 4954ed46-70ae-11ef-bcea-c7b262605968 -- ceph fs set cephfs session_timeout 300 2024-09-12T02:35:52.948 INFO:teuthology.orchestra.run.smithi039.stderr:Inferring config /var/lib/ceph/4954ed46-70ae-11ef-bcea-c7b262605968/mon.a/config 2024-09-12T02:35:53.088 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 02:35:52 smithi039 ceph-mon[30515]: from='client.? ' entity='client.admin' cmd='[{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "true"}]': finished 2024-09-12T02:35:53.088 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 02:35:52 smithi039 ceph-mon[30515]: mds.? [v2:172.21.15.44:6836/1501493978,v1:172.21.15.44:6837/1501493978] up:active 2024-09-12T02:35:53.088 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 02:35:52 smithi039 ceph-mon[30515]: daemon mds.f assigned to filesystem cephfs as rank 4 (now has 5 ranks) 2024-09-12T02:35:53.089 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 02:35:52 smithi039 ceph-mon[30515]: Health check cleared: MDS_UP_LESS_THAN_MAX (was: 1 filesystem is online with fewer MDS than max_mds) 2024-09-12T02:35:53.089 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 02:35:52 smithi039 ceph-mon[30515]: Cluster is now healthy 2024-09-12T02:35:53.089 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 02:35:52 smithi039 ceph-mon[30515]: fsmap cephfs:4 {0=b=up:active,1=i=up:active,2=c=up:active,3=h=up:active} 8 up:standby 2024-09-12T02:35:53.089 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 02:35:52 smithi039 ceph-mon[30515]: fsmap cephfs:5 1 up:creating 7 up:standby 4 up:active 2024-09-12T02:35:53.089 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 02:35:52 smithi039 ceph-mon[30515]: daemon mds.f is now active in filesystem cephfs as rank 4 2024-09-12T02:35:53.089 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 02:35:52 smithi039 ceph-mon[30515]: mds.? [v2:172.21.15.172:6834/3274676014,v1:172.21.15.172:6835/3274676014] up:active 2024-09-12T02:35:53.089 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 02:35:52 smithi039 ceph-mon[30515]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2024-09-12T02:35:53.199 INFO:journalctl@ceph.mds.b.smithi044.stdout:Sep 12 02:35:52 smithi044 ceph-4954ed46-70ae-11ef-bcea-c7b262605968-mds-b[65334]: 2024-09-12T02:35:52.764+0000 7f75da051640 -1 mds.pinger is_rank_lagging: rank=2 was never sent ping request. 2024-09-12T02:35:53.199 INFO:journalctl@ceph.mds.b.smithi044.stdout:Sep 12 02:35:52 smithi044 ceph-4954ed46-70ae-11ef-bcea-c7b262605968-mds-b[65334]: 2024-09-12T02:35:52.764+0000 7f75da051640 -1 mds.pinger is_rank_lagging: rank=3 was never sent ping request. 2024-09-12T02:35:53.199 INFO:journalctl@ceph.mds.b.smithi044.stdout:Sep 12 02:35:52 smithi044 ceph-4954ed46-70ae-11ef-bcea-c7b262605968-mds-b[65334]: 2024-09-12T02:35:52.764+0000 7f75da051640 -1 mds.pinger is_rank_lagging: rank=4 was never sent ping request. 2024-09-12T02:35:53.199 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 12 02:35:52 smithi044 ceph-mon[35411]: from='client.? ' entity='client.admin' cmd='[{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "true"}]': finished 2024-09-12T02:35:53.199 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 12 02:35:52 smithi044 ceph-mon[35411]: mds.? [v2:172.21.15.44:6836/1501493978,v1:172.21.15.44:6837/1501493978] up:active 2024-09-12T02:35:53.199 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 12 02:35:52 smithi044 ceph-mon[35411]: daemon mds.f assigned to filesystem cephfs as rank 4 (now has 5 ranks) 2024-09-12T02:35:53.199 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 12 02:35:52 smithi044 ceph-mon[35411]: Health check cleared: MDS_UP_LESS_THAN_MAX (was: 1 filesystem is online with fewer MDS than max_mds) 2024-09-12T02:35:53.199 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 12 02:35:52 smithi044 ceph-mon[35411]: Cluster is now healthy 2024-09-12T02:35:53.199 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 12 02:35:52 smithi044 ceph-mon[35411]: fsmap cephfs:4 {0=b=up:active,1=i=up:active,2=c=up:active,3=h=up:active} 8 up:standby 2024-09-12T02:35:53.200 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 12 02:35:52 smithi044 ceph-mon[35411]: fsmap cephfs:5 1 up:creating 7 up:standby 4 up:active 2024-09-12T02:35:53.200 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 12 02:35:52 smithi044 ceph-mon[35411]: daemon mds.f is now active in filesystem cephfs as rank 4 2024-09-12T02:35:53.200 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 12 02:35:52 smithi044 ceph-mon[35411]: mds.? [v2:172.21.15.172:6834/3274676014,v1:172.21.15.172:6835/3274676014] up:active 2024-09-12T02:35:53.200 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 12 02:35:52 smithi044 ceph-mon[35411]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2024-09-12T02:35:53.264 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 12 02:35:52 smithi172 ceph-mon[35609]: from='client.? ' entity='client.admin' cmd='[{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "true"}]': finished 2024-09-12T02:35:53.264 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 12 02:35:52 smithi172 ceph-mon[35609]: mds.? [v2:172.21.15.44:6836/1501493978,v1:172.21.15.44:6837/1501493978] up:active 2024-09-12T02:35:53.264 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 12 02:35:52 smithi172 ceph-mon[35609]: daemon mds.f assigned to filesystem cephfs as rank 4 (now has 5 ranks) 2024-09-12T02:35:53.264 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 12 02:35:52 smithi172 ceph-mon[35609]: Health check cleared: MDS_UP_LESS_THAN_MAX (was: 1 filesystem is online with fewer MDS than max_mds) 2024-09-12T02:35:53.264 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 12 02:35:52 smithi172 ceph-mon[35609]: Cluster is now healthy 2024-09-12T02:35:53.264 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 12 02:35:52 smithi172 ceph-mon[35609]: fsmap cephfs:4 {0=b=up:active,1=i=up:active,2=c=up:active,3=h=up:active} 8 up:standby 2024-09-12T02:35:53.264 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 12 02:35:52 smithi172 ceph-mon[35609]: fsmap cephfs:5 1 up:creating 7 up:standby 4 up:active 2024-09-12T02:35:53.264 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 12 02:35:52 smithi172 ceph-mon[35609]: daemon mds.f is now active in filesystem cephfs as rank 4 2024-09-12T02:35:53.264 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 12 02:35:52 smithi172 ceph-mon[35609]: mds.? [v2:172.21.15.172:6834/3274676014,v1:172.21.15.172:6835/3274676014] up:active 2024-09-12T02:35:53.265 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 12 02:35:52 smithi172 ceph-mon[35609]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2024-09-12T02:35:53.530 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:35:53.528+0000 7f5c29c00640 1 -- 172.21.15.39:0/1925668506 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f5c24108f60 msgr2=0x7f5c24110ae0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:35:53.530 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:35:53.528+0000 7f5c29c00640 1 --2- 172.21.15.39:0/1925668506 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f5c24108f60 0x7f5c24110ae0 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7f5c1c009900 tx=0x7f5c1c02a3f0 comp rx=0 tx=0).stop 2024-09-12T02:35:53.530 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:35:53.528+0000 7f5c29c00640 1 -- 172.21.15.39:0/1925668506 shutdown_connections 2024-09-12T02:35:53.530 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:35:53.528+0000 7f5c29c00640 1 --2- 172.21.15.39:0/1925668506 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f5c24108f60 0x7f5c24110ae0 unknown :-1 s=CLOSED pgs=81 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:35:53.530 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:35:53.528+0000 7f5c29c00640 1 --2- 172.21.15.39:0/1925668506 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f5c241047e0 0x7f5c24108830 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:35:53.530 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:35:53.528+0000 7f5c29c00640 1 --2- 172.21.15.39:0/1925668506 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f5c24103e30 0x7f5c24104210 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:35:53.530 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:35:53.528+0000 7f5c29c00640 1 -- 172.21.15.39:0/1925668506 >> 172.21.15.39:0/1925668506 conn(0x7f5c240ff910 msgr2=0x7f5c24101d30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:35:53.531 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:35:53.528+0000 7f5c29c00640 1 -- 172.21.15.39:0/1925668506 shutdown_connections 2024-09-12T02:35:53.531 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:35:53.528+0000 7f5c29c00640 1 -- 172.21.15.39:0/1925668506 wait complete. 2024-09-12T02:35:53.532 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:35:53.529+0000 7f5c29c00640 1 Processor -- start 2024-09-12T02:35:53.533 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:35:53.530+0000 7f5c29c00640 1 -- start start 2024-09-12T02:35:53.533 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:35:53.530+0000 7f5c29c00640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f5c24103e30 0x7f5c2419a410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:35:53.533 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:35:53.530+0000 7f5c29c00640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f5c241047e0 0x7f5c2419a950 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:35:53.533 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:35:53.530+0000 7f5c29c00640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f5c24108f60 0x7f5c2419ece0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:35:53.533 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:35:53.530+0000 7f5c29c00640 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 -- 0x7f5c24114010 con 0x7f5c241047e0 2024-09-12T02:35:53.533 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:35:53.530+0000 7f5c29c00640 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x7f5c24113e90 con 0x7f5c24103e30 2024-09-12T02:35:53.533 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:35:53.530+0000 7f5c29c00640 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7f5c24114190 con 0x7f5c24108f60 2024-09-12T02:35:53.533 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:35:53.530+0000 7f5c23400640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f5c241047e0 0x7f5c2419a950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:35:53.533 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:35:53.530+0000 7f5c23400640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f5c241047e0 0x7f5c2419a950 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.39:3300/0 says I am v2:172.21.15.39:38228/0 (socket says 172.21.15.39:38228) 2024-09-12T02:35:53.533 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:35:53.530+0000 7f5c23400640 1 -- 172.21.15.39:0/823187058 learned_addr learned my addr 172.21.15.39:0/823187058 (peer_addr_for_me v2:172.21.15.39:0/0) 2024-09-12T02:35:53.533 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:35:53.531+0000 7f5c29200640 1 --2- 172.21.15.39:0/823187058 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f5c24108f60 0x7f5c2419ece0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:35:53.533 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:35:53.531+0000 7f5c23e00640 1 --2- 172.21.15.39:0/823187058 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f5c24103e30 0x7f5c2419a410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:35:53.534 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:35:53.531+0000 7f5c29200640 1 -- 172.21.15.39:0/823187058 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f5c24103e30 msgr2=0x7f5c2419a410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:35:53.534 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:35:53.531+0000 7f5c29200640 1 --2- 172.21.15.39:0/823187058 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f5c24103e30 0x7f5c2419a410 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:35:53.534 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:35:53.531+0000 7f5c29200640 1 -- 172.21.15.39:0/823187058 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f5c241047e0 msgr2=0x7f5c2419a950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:35:53.534 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:35:53.531+0000 7f5c29200640 1 --2- 172.21.15.39:0/823187058 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f5c241047e0 0x7f5c2419a950 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:35:53.534 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:35:53.531+0000 7f5c29200640 1 -- 172.21.15.39:0/823187058 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5c2419f3c0 con 0x7f5c24108f60 2024-09-12T02:35:53.534 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:35:53.531+0000 7f5c23400640 1 --2- 172.21.15.39:0/823187058 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f5c241047e0 0x7f5c2419a950 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-12T02:35:53.534 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:35:53.531+0000 7f5c29200640 1 --2- 172.21.15.39:0/823187058 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f5c24108f60 0x7f5c2419ece0 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7f5c1c02a910 tx=0x7f5c1c003b90 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:35:53.534 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:35:53.532+0000 7f5c20c00640 1 -- 172.21.15.39:0/823187058 <== mon.1 v2:172.21.15.172:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5c1c03f070 con 0x7f5c24108f60 2024-09-12T02:35:53.534 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:35:53.532+0000 7f5c20c00640 1 -- 172.21.15.39:0/823187058 <== mon.1 v2:172.21.15.172:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f5c1c031c90 con 0x7f5c24108f60 2024-09-12T02:35:53.534 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:35:53.532+0000 7f5c29c00640 1 -- 172.21.15.39:0/823187058 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f5c2419f650 con 0x7f5c24108f60 2024-09-12T02:35:53.534 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:35:53.532+0000 7f5c20c00640 1 -- 172.21.15.39:0/823187058 <== mon.1 v2:172.21.15.172:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5c1c035030 con 0x7f5c24108f60 2024-09-12T02:35:53.534 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:35:53.532+0000 7f5c29c00640 1 -- 172.21.15.39:0/823187058 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f5c2419fb00 con 0x7f5c24108f60 2024-09-12T02:35:53.535 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:35:53.533+0000 7f5c29c00640 1 -- 172.21.15.39:0/823187058 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f5c24105310 con 0x7f5c24108f60 2024-09-12T02:35:53.535 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:35:53.535+0000 7f5c20c00640 1 -- 172.21.15.39:0/823187058 <== mon.1 v2:172.21.15.172:3300/0 4 ==== mgrmap(e 16) ==== 137833+0+0 (secure 0 0 0) 0x7f5c1c042070 con 0x7f5c24108f60 2024-09-12T02:35:53.537 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:35:53.536+0000 7f5c20c00640 1 --2- 172.21.15.39:0/823187058 >> [v2:172.21.15.39:6800/1725006999,v1:172.21.15.39:6801/1725006999] conn(0x7f5c080a2b80 0x7f5c080a5040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:35:53.537 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:35:53.536+0000 7f5c20c00640 1 -- 172.21.15.39:0/823187058 <== mon.1 v2:172.21.15.172:3300/0 5 ==== osd_map(93..93 src has 1..93) ==== 9092+0+0 (secure 0 0 0) 0x7f5c1c0efe70 con 0x7f5c24108f60 2024-09-12T02:35:53.537 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:35:53.537+0000 7f5c23e00640 1 --2- 172.21.15.39:0/823187058 >> [v2:172.21.15.39:6800/1725006999,v1:172.21.15.39:6801/1725006999] conn(0x7f5c080a2b80 0x7f5c080a5040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:35:53.538 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:35:53.537+0000 7f5c23e00640 1 --2- 172.21.15.39:0/823187058 >> [v2:172.21.15.39:6800/1725006999,v1:172.21.15.39:6801/1725006999] conn(0x7f5c080a2b80 0x7f5c080a5040 secure :-1 s=READY pgs=165 cs=0 l=1 rev1=1 crypto rx=0x7f5c140099a0 tx=0x7f5c14009500 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:35:53.539 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:35:53.538+0000 7f5c20c00640 1 -- 172.21.15.39:0/823187058 <== mon.1 v2:172.21.15.172:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7f5c1c0bc480 con 0x7f5c24108f60 2024-09-12T02:35:53.761 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:35:53.760+0000 7f5c29c00640 1 -- 172.21.15.39:0/823187058 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "session_timeout", "val": "300"} v 0) -- 0x7f5c24104210 con 0x7f5c24108f60 2024-09-12T02:35:53.807 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:35:53.806+0000 7f5c20c00640 1 -- 172.21.15.39:0/823187058 <== mon.1 v2:172.21.15.172:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "session_timeout", "val": "300"}]=0 v28) ==== 115+0+0 (secure 0 0 0) 0x7f5c24104210 con 0x7f5c24108f60 2024-09-12T02:35:53.809 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:35:53.808+0000 7f5c29c00640 1 -- 172.21.15.39:0/823187058 >> [v2:172.21.15.39:6800/1725006999,v1:172.21.15.39:6801/1725006999] conn(0x7f5c080a2b80 msgr2=0x7f5c080a5040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:35:53.810 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:35:53.808+0000 7f5c29c00640 1 --2- 172.21.15.39:0/823187058 >> [v2:172.21.15.39:6800/1725006999,v1:172.21.15.39:6801/1725006999] conn(0x7f5c080a2b80 0x7f5c080a5040 secure :-1 s=READY pgs=165 cs=0 l=1 rev1=1 crypto rx=0x7f5c140099a0 tx=0x7f5c14009500 comp rx=0 tx=0).stop 2024-09-12T02:35:53.810 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:35:53.808+0000 7f5c29c00640 1 -- 172.21.15.39:0/823187058 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f5c24108f60 msgr2=0x7f5c2419ece0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:35:53.810 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:35:53.808+0000 7f5c29c00640 1 --2- 172.21.15.39:0/823187058 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f5c24108f60 0x7f5c2419ece0 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7f5c1c02a910 tx=0x7f5c1c003b90 comp rx=0 tx=0).stop 2024-09-12T02:35:53.810 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:35:53.809+0000 7f5c29c00640 1 -- 172.21.15.39:0/823187058 shutdown_connections 2024-09-12T02:35:53.810 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:35:53.809+0000 7f5c29c00640 1 --2- 172.21.15.39:0/823187058 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f5c24108f60 0x7f5c2419ece0 unknown :-1 s=CLOSED pgs=82 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:35:53.810 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:35:53.809+0000 7f5c29c00640 1 --2- 172.21.15.39:0/823187058 >> [v2:172.21.15.39:6800/1725006999,v1:172.21.15.39:6801/1725006999] conn(0x7f5c080a2b80 0x7f5c080a5040 unknown :-1 s=CLOSED pgs=165 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:35:53.810 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:35:53.809+0000 7f5c29c00640 1 --2- 172.21.15.39:0/823187058 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f5c241047e0 0x7f5c2419a950 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:35:53.810 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:35:53.809+0000 7f5c29c00640 1 --2- 172.21.15.39:0/823187058 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f5c24103e30 0x7f5c2419a410 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:35:53.810 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:35:53.809+0000 7f5c29c00640 1 -- 172.21.15.39:0/823187058 >> 172.21.15.39:0/823187058 conn(0x7f5c240ff910 msgr2=0x7f5c24100bd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:35:53.810 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:35:53.809+0000 7f5c29c00640 1 -- 172.21.15.39:0/823187058 shutdown_connections 2024-09-12T02:35:53.811 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:35:53.809+0000 7f5c29c00640 1 -- 172.21.15.39:0/823187058 wait complete. 2024-09-12T02:35:54.100 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 02:35:53 smithi039 ceph-mon[30515]: pgmap v327: 129 pgs: 129 active+clean; 581 KiB data, 347 MiB used, 1.0 TiB / 1.0 TiB avail; 127 B/s wr, 1 op/s; 0 B/s, 0 objects/s recovering 2024-09-12T02:35:54.100 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 02:35:53 smithi039 ceph-mon[30515]: from='client.? 172.21.15.39:0/823187058' entity='client.admin' cmd=[{"prefix": "fs set", "fs_name": "cephfs", "var": "session_timeout", "val": "300"}]: dispatch 2024-09-12T02:35:54.100 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 02:35:53 smithi039 ceph-mon[30515]: from='client.? ' entity='client.admin' cmd=[{"prefix": "fs set", "fs_name": "cephfs", "var": "session_timeout", "val": "300"}]: dispatch 2024-09-12T02:35:54.165 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 12 02:35:53 smithi172 ceph-mon[35609]: pgmap v327: 129 pgs: 129 active+clean; 581 KiB data, 347 MiB used, 1.0 TiB / 1.0 TiB avail; 127 B/s wr, 1 op/s; 0 B/s, 0 objects/s recovering 2024-09-12T02:35:54.165 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 12 02:35:53 smithi172 ceph-mon[35609]: from='client.? 172.21.15.39:0/823187058' entity='client.admin' cmd=[{"prefix": "fs set", "fs_name": "cephfs", "var": "session_timeout", "val": "300"}]: dispatch 2024-09-12T02:35:54.165 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 12 02:35:53 smithi172 ceph-mon[35609]: from='client.? ' entity='client.admin' cmd=[{"prefix": "fs set", "fs_name": "cephfs", "var": "session_timeout", "val": "300"}]: dispatch 2024-09-12T02:35:54.198 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 12 02:35:53 smithi044 ceph-mon[35411]: pgmap v327: 129 pgs: 129 active+clean; 581 KiB data, 347 MiB used, 1.0 TiB / 1.0 TiB avail; 127 B/s wr, 1 op/s; 0 B/s, 0 objects/s recovering 2024-09-12T02:35:54.198 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 12 02:35:53 smithi044 ceph-mon[35411]: from='client.? 172.21.15.39:0/823187058' entity='client.admin' cmd=[{"prefix": "fs set", "fs_name": "cephfs", "var": "session_timeout", "val": "300"}]: dispatch 2024-09-12T02:35:54.199 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 12 02:35:53 smithi044 ceph-mon[35411]: from='client.? ' entity='client.admin' cmd=[{"prefix": "fs set", "fs_name": "cephfs", "var": "session_timeout", "val": "300"}]: dispatch 2024-09-12T02:35:54.546 DEBUG:tasks.cephfs.filesystem:Creating {'create': 2, 'subvol_options': '--size 25000000000'} subvols for filesystem 'cephfs' 2024-09-12T02:35:54.546 DEBUG:teuthology.orchestra.run.smithi039:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc shell --fsid 4954ed46-70ae-11ef-bcea-c7b262605968 -- ceph fs subvolumegroup create cephfs qa 2024-09-12T02:35:54.926 INFO:teuthology.orchestra.run.smithi039.stderr:Inferring config /var/lib/ceph/4954ed46-70ae-11ef-bcea-c7b262605968/mon.a/config 2024-09-12T02:35:55.065 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 02:35:54 smithi039 ceph-mon[30515]: from='client.? ' entity='client.admin' cmd='[{"prefix": "fs set", "fs_name": "cephfs", "var": "session_timeout", "val": "300"}]': finished 2024-09-12T02:35:55.065 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 02:35:54 smithi039 ceph-mon[30515]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2024-09-12T02:35:55.198 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 12 02:35:54 smithi044 ceph-mon[35411]: from='client.? ' entity='client.admin' cmd='[{"prefix": "fs set", "fs_name": "cephfs", "var": "session_timeout", "val": "300"}]': finished 2024-09-12T02:35:55.198 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 12 02:35:54 smithi044 ceph-mon[35411]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2024-09-12T02:35:55.264 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 12 02:35:54 smithi172 ceph-mon[35609]: from='client.? ' entity='client.admin' cmd='[{"prefix": "fs set", "fs_name": "cephfs", "var": "session_timeout", "val": "300"}]': finished 2024-09-12T02:35:55.264 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 12 02:35:54 smithi172 ceph-mon[35609]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2024-09-12T02:35:55.495 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:35:55.494+0000 7f4b71800640 1 -- 172.21.15.39:0/4152934328 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f4b6c112a50 msgr2=0x7f4b6c114e40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:35:55.495 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:35:55.494+0000 7f4b71800640 1 --2- 172.21.15.39:0/4152934328 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f4b6c112a50 0x7f4b6c114e40 secure :-1 s=READY pgs=176 cs=0 l=1 rev1=1 crypto rx=0x7f4b64009ca0 tx=0x7f4b6402a8c0 comp rx=0 tx=0).stop 2024-09-12T02:35:55.495 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:35:55.494+0000 7f4b71800640 1 -- 172.21.15.39:0/4152934328 shutdown_connections 2024-09-12T02:35:55.495 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:35:55.494+0000 7f4b71800640 1 --2- 172.21.15.39:0/4152934328 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f4b6c112a50 0x7f4b6c114e40 unknown :-1 s=CLOSED pgs=176 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:35:55.496 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:35:55.494+0000 7f4b71800640 1 --2- 172.21.15.39:0/4152934328 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f4b6c077040 0x7f4b6c112510 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:35:55.496 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:35:55.494+0000 7f4b71800640 1 --2- 172.21.15.39:0/4152934328 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f4b6c076720 0x7f4b6c076b00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:35:55.496 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:35:55.494+0000 7f4b71800640 1 -- 172.21.15.39:0/4152934328 >> 172.21.15.39:0/4152934328 conn(0x7f4b6c0ffa50 msgr2=0x7f4b6c101e70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:35:55.496 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:35:55.494+0000 7f4b71800640 1 -- 172.21.15.39:0/4152934328 shutdown_connections 2024-09-12T02:35:55.496 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:35:55.494+0000 7f4b71800640 1 -- 172.21.15.39:0/4152934328 wait complete. 2024-09-12T02:35:55.497 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:35:55.495+0000 7f4b71800640 1 Processor -- start 2024-09-12T02:35:55.497 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:35:55.495+0000 7f4b71800640 1 -- start start 2024-09-12T02:35:55.497 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:35:55.496+0000 7f4b71800640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f4b6c076720 0x7f4b6c19eb90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:35:55.497 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:35:55.496+0000 7f4b71800640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f4b6c077040 0x7f4b6c19f0d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:35:55.498 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:35:55.496+0000 7f4b71800640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f4b6c112a50 0x7f4b6c1a3490 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:35:55.498 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:35:55.496+0000 7f4b71800640 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 -- 0x7f4b6c1185f0 con 0x7f4b6c077040 2024-09-12T02:35:55.498 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:35:55.496+0000 7f4b71800640 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x7f4b6c118470 con 0x7f4b6c112a50 2024-09-12T02:35:55.498 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:35:55.496+0000 7f4b71800640 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7f4b6c118770 con 0x7f4b6c076720 2024-09-12T02:35:55.498 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:35:55.496+0000 7f4b62000640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f4b6c077040 0x7f4b6c19f0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:35:55.498 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:35:55.496+0000 7f4b6aa00640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f4b6c076720 0x7f4b6c19eb90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:35:55.498 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:35:55.496+0000 7f4b62000640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f4b6c077040 0x7f4b6c19f0d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.39:3300/0 says I am v2:172.21.15.39:38236/0 (socket says 172.21.15.39:38236) 2024-09-12T02:35:55.498 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:35:55.496+0000 7f4b62000640 1 -- 172.21.15.39:0/1447439514 learned_addr learned my addr 172.21.15.39:0/1447439514 (peer_addr_for_me v2:172.21.15.39:0/0) 2024-09-12T02:35:55.498 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:35:55.496+0000 7f4b6aa00640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f4b6c076720 0x7f4b6c19eb90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.172:3300/0 says I am v2:172.21.15.39:43396/0 (socket says 172.21.15.39:43396) 2024-09-12T02:35:55.498 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:35:55.496+0000 7f4b6b400640 1 --2- 172.21.15.39:0/1447439514 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f4b6c112a50 0x7f4b6c1a3490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:35:55.498 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:35:55.496+0000 7f4b6aa00640 1 -- 172.21.15.39:0/1447439514 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f4b6c112a50 msgr2=0x7f4b6c1a3490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:35:55.499 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:35:55.496+0000 7f4b6aa00640 1 --2- 172.21.15.39:0/1447439514 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f4b6c112a50 0x7f4b6c1a3490 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:35:55.499 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:35:55.496+0000 7f4b6aa00640 1 -- 172.21.15.39:0/1447439514 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f4b6c077040 msgr2=0x7f4b6c19f0d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:35:55.499 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:35:55.496+0000 7f4b6aa00640 1 --2- 172.21.15.39:0/1447439514 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f4b6c077040 0x7f4b6c19f0d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:35:55.499 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:35:55.496+0000 7f4b6aa00640 1 -- 172.21.15.39:0/1447439514 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4b6c1a3bc0 con 0x7f4b6c076720 2024-09-12T02:35:55.499 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:35:55.496+0000 7f4b62000640 1 --2- 172.21.15.39:0/1447439514 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f4b6c077040 0x7f4b6c19f0d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-12T02:35:55.499 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:35:55.497+0000 7f4b6aa00640 1 --2- 172.21.15.39:0/1447439514 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f4b6c076720 0x7f4b6c19eb90 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7f4b5c00e9f0 tx=0x7f4b5c00eeb0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:35:55.500 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:35:55.497+0000 7f4b63e00640 1 -- 172.21.15.39:0/1447439514 <== mon.1 v2:172.21.15.172:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4b5c00ccc0 con 0x7f4b6c076720 2024-09-12T02:35:55.500 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:35:55.497+0000 7f4b71800640 1 -- 172.21.15.39:0/1447439514 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f4b6c1a3eb0 con 0x7f4b6c076720 2024-09-12T02:35:55.500 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:35:55.497+0000 7f4b63e00640 1 -- 172.21.15.39:0/1447439514 <== mon.1 v2:172.21.15.172:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f4b5c005020 con 0x7f4b6c076720 2024-09-12T02:35:55.500 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:35:55.497+0000 7f4b63e00640 1 -- 172.21.15.39:0/1447439514 <== mon.1 v2:172.21.15.172:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4b5c01c070 con 0x7f4b6c076720 2024-09-12T02:35:55.500 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:35:55.497+0000 7f4b71800640 1 -- 172.21.15.39:0/1447439514 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f4b6c1ab740 con 0x7f4b6c076720 2024-09-12T02:35:55.500 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:35:55.498+0000 7f4b71800640 1 -- 172.21.15.39:0/1447439514 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f4b6c076b00 con 0x7f4b6c076720 2024-09-12T02:35:55.501 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:35:55.500+0000 7f4b63e00640 1 -- 172.21.15.39:0/1447439514 <== mon.1 v2:172.21.15.172:3300/0 4 ==== mgrmap(e 16) ==== 137833+0+0 (secure 0 0 0) 0x7f4b5c005540 con 0x7f4b6c076720 2024-09-12T02:35:55.502 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:35:55.502+0000 7f4b63e00640 1 --2- 172.21.15.39:0/1447439514 >> [v2:172.21.15.39:6800/1725006999,v1:172.21.15.39:6801/1725006999] conn(0x7f4b500a2c00 0x7f4b500a50c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:35:55.502 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:35:55.502+0000 7f4b63e00640 1 -- 172.21.15.39:0/1447439514 <== mon.1 v2:172.21.15.172:3300/0 5 ==== osd_map(93..93 src has 1..93) ==== 9092+0+0 (secure 0 0 0) 0x7f4b5c0cf290 con 0x7f4b6c076720 2024-09-12T02:35:55.503 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:35:55.502+0000 7f4b62000640 1 --2- 172.21.15.39:0/1447439514 >> [v2:172.21.15.39:6800/1725006999,v1:172.21.15.39:6801/1725006999] conn(0x7f4b500a2c00 0x7f4b500a50c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:35:55.503 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:35:55.503+0000 7f4b62000640 1 --2- 172.21.15.39:0/1447439514 >> [v2:172.21.15.39:6800/1725006999,v1:172.21.15.39:6801/1725006999] conn(0x7f4b500a2c00 0x7f4b500a50c0 secure :-1 s=READY pgs=166 cs=0 l=1 rev1=1 crypto rx=0x7f4b540095f0 tx=0x7f4b54005f90 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:35:55.504 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:35:55.504+0000 7f4b63e00640 1 -- 172.21.15.39:0/1447439514 <== mon.1 v2:172.21.15.172:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7f4b5c09be30 con 0x7f4b6c076720 2024-09-12T02:35:55.717 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:35:55.716+0000 7f4b71800640 1 -- 172.21.15.39:0/1447439514 --> [v2:172.21.15.39:6800/1725006999,v1:172.21.15.39:6801/1725006999] -- mgr_command(tid 0: {"prefix": "fs subvolumegroup create", "vol_name": "cephfs", "group_name": "qa", "target": ["mon-mgr", ""]}) -- 0x7f4b6c062630 con 0x7f4b500a2c00 2024-09-12T02:35:55.753 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:35:55.752+0000 7f4b63e00640 1 -- 172.21.15.39:0/1447439514 <== mgr.14150 v2:172.21.15.39:6800/1725006999 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+0 (secure 0 0 0) 0x7f4b6c062630 con 0x7f4b500a2c00 2024-09-12T02:35:55.755 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:35:55.754+0000 7f4b71800640 1 -- 172.21.15.39:0/1447439514 >> [v2:172.21.15.39:6800/1725006999,v1:172.21.15.39:6801/1725006999] conn(0x7f4b500a2c00 msgr2=0x7f4b500a50c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:35:55.755 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:35:55.754+0000 7f4b71800640 1 --2- 172.21.15.39:0/1447439514 >> [v2:172.21.15.39:6800/1725006999,v1:172.21.15.39:6801/1725006999] conn(0x7f4b500a2c00 0x7f4b500a50c0 secure :-1 s=READY pgs=166 cs=0 l=1 rev1=1 crypto rx=0x7f4b540095f0 tx=0x7f4b54005f90 comp rx=0 tx=0).stop 2024-09-12T02:35:55.755 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:35:55.754+0000 7f4b71800640 1 -- 172.21.15.39:0/1447439514 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f4b6c076720 msgr2=0x7f4b6c19eb90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:35:55.755 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:35:55.754+0000 7f4b71800640 1 --2- 172.21.15.39:0/1447439514 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f4b6c076720 0x7f4b6c19eb90 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7f4b5c00e9f0 tx=0x7f4b5c00eeb0 comp rx=0 tx=0).stop 2024-09-12T02:35:55.755 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:35:55.754+0000 7f4b71800640 1 -- 172.21.15.39:0/1447439514 shutdown_connections 2024-09-12T02:35:55.755 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:35:55.754+0000 7f4b71800640 1 --2- 172.21.15.39:0/1447439514 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f4b6c112a50 0x7f4b6c1a3490 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:35:55.755 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:35:55.754+0000 7f4b71800640 1 --2- 172.21.15.39:0/1447439514 >> [v2:172.21.15.39:6800/1725006999,v1:172.21.15.39:6801/1725006999] conn(0x7f4b500a2c00 0x7f4b500a50c0 unknown :-1 s=CLOSED pgs=166 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:35:55.756 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:35:55.754+0000 7f4b71800640 1 --2- 172.21.15.39:0/1447439514 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f4b6c077040 0x7f4b6c19f0d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:35:55.756 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:35:55.754+0000 7f4b71800640 1 --2- 172.21.15.39:0/1447439514 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f4b6c076720 0x7f4b6c19eb90 unknown :-1 s=CLOSED pgs=83 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:35:55.756 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:35:55.754+0000 7f4b71800640 1 -- 172.21.15.39:0/1447439514 >> 172.21.15.39:0/1447439514 conn(0x7f4b6c0ffa50 msgr2=0x7f4b6c101e40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:35:55.756 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:35:55.754+0000 7f4b71800640 1 -- 172.21.15.39:0/1447439514 shutdown_connections 2024-09-12T02:35:55.756 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:35:55.754+0000 7f4b71800640 1 -- 172.21.15.39:0/1447439514 wait complete. 2024-09-12T02:35:56.100 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 02:35:55 smithi039 ceph-mon[30515]: pgmap v328: 129 pgs: 129 active+clean; 586 KiB data, 347 MiB used, 1.0 TiB / 1.0 TiB avail; 4.9 KiB/s rd, 5.2 KiB/s wr, 21 op/s; 0 B/s, 0 objects/s recovering 2024-09-12T02:35:56.100 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 02:35:55 smithi039 ceph-mon[30515]: from='client.24694 -' entity='client.admin' cmd=[{"prefix": "fs subvolumegroup create", "vol_name": "cephfs", "group_name": "qa", "target": ["mon-mgr", ""]}]: dispatch 2024-09-12T02:35:56.100 INFO:journalctl@ceph.mgr.x.smithi039.stdout:Sep 12 02:35:55 smithi039 ceph-4954ed46-70ae-11ef-bcea-c7b262605968-mgr-x[30736]: 2024-09-12T02:35:55.723+0000 7f3160c00640 -1 client.0 error registering admin socket command: (17) File exists 2024-09-12T02:35:56.100 INFO:journalctl@ceph.mgr.x.smithi039.stdout:Sep 12 02:35:55 smithi039 ceph-4954ed46-70ae-11ef-bcea-c7b262605968-mgr-x[30736]: 2024-09-12T02:35:55.723+0000 7f3160c00640 -1 client.0 error registering admin socket command: (17) File exists 2024-09-12T02:35:56.100 INFO:journalctl@ceph.mgr.x.smithi039.stdout:Sep 12 02:35:55 smithi039 ceph-4954ed46-70ae-11ef-bcea-c7b262605968-mgr-x[30736]: 2024-09-12T02:35:55.723+0000 7f3160c00640 -1 client.0 error registering admin socket command: (17) File exists 2024-09-12T02:35:56.100 INFO:journalctl@ceph.mgr.x.smithi039.stdout:Sep 12 02:35:55 smithi039 ceph-4954ed46-70ae-11ef-bcea-c7b262605968-mgr-x[30736]: 2024-09-12T02:35:55.723+0000 7f3160c00640 -1 client.0 error registering admin socket command: (17) File exists 2024-09-12T02:35:56.100 INFO:journalctl@ceph.mgr.x.smithi039.stdout:Sep 12 02:35:55 smithi039 ceph-4954ed46-70ae-11ef-bcea-c7b262605968-mgr-x[30736]: 2024-09-12T02:35:55.723+0000 7f3160c00640 -1 client.0 error registering admin socket command: (17) File exists 2024-09-12T02:35:56.198 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 12 02:35:55 smithi044 ceph-mon[35411]: pgmap v328: 129 pgs: 129 active+clean; 586 KiB data, 347 MiB used, 1.0 TiB / 1.0 TiB avail; 4.9 KiB/s rd, 5.2 KiB/s wr, 21 op/s; 0 B/s, 0 objects/s recovering 2024-09-12T02:35:56.199 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 12 02:35:55 smithi044 ceph-mon[35411]: from='client.24694 -' entity='client.admin' cmd=[{"prefix": "fs subvolumegroup create", "vol_name": "cephfs", "group_name": "qa", "target": ["mon-mgr", ""]}]: dispatch 2024-09-12T02:35:56.263 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 12 02:35:55 smithi172 ceph-mon[35609]: pgmap v328: 129 pgs: 129 active+clean; 586 KiB data, 347 MiB used, 1.0 TiB / 1.0 TiB avail; 4.9 KiB/s rd, 5.2 KiB/s wr, 21 op/s; 0 B/s, 0 objects/s recovering 2024-09-12T02:35:56.264 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 12 02:35:55 smithi172 ceph-mon[35609]: from='client.24694 -' entity='client.admin' cmd=[{"prefix": "fs subvolumegroup create", "vol_name": "cephfs", "group_name": "qa", "target": ["mon-mgr", ""]}]: dispatch 2024-09-12T02:35:56.539 DEBUG:teuthology.orchestra.run.smithi039:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc shell --fsid 4954ed46-70ae-11ef-bcea-c7b262605968 -- ceph fs subvolume create cephfs sv_0 --group_name qa 2024-09-12T02:35:56.921 INFO:teuthology.orchestra.run.smithi039.stderr:Inferring config /var/lib/ceph/4954ed46-70ae-11ef-bcea-c7b262605968/mon.a/config 2024-09-12T02:35:57.481 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:35:57.480+0000 7f9ec4a00640 1 -- 172.21.15.39:0/2348017628 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f9ec0100980 msgr2=0x7f9ec0100d60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:35:57.481 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:35:57.480+0000 7f9ec4a00640 1 --2- 172.21.15.39:0/2348017628 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f9ec0100980 0x7f9ec0100d60 secure :-1 s=READY pgs=179 cs=0 l=1 rev1=1 crypto rx=0x7f9eb0009900 tx=0x7f9eb002a470 comp rx=0 tx=0).stop 2024-09-12T02:35:57.482 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:35:57.480+0000 7f9ec4a00640 1 -- 172.21.15.39:0/2348017628 shutdown_connections 2024-09-12T02:35:57.482 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:35:57.480+0000 7f9ec4a00640 1 --2- 172.21.15.39:0/2348017628 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f9ec0105d90 0x7f9ec0106220 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:35:57.482 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:35:57.480+0000 7f9ec4a00640 1 --2- 172.21.15.39:0/2348017628 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f9ec01012a0 0x7f9ec0105770 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:35:57.482 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:35:57.480+0000 7f9ec4a00640 1 --2- 172.21.15.39:0/2348017628 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f9ec0100980 0x7f9ec0100d60 unknown :-1 s=CLOSED pgs=179 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:35:57.482 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:35:57.480+0000 7f9ec4a00640 1 -- 172.21.15.39:0/2348017628 >> 172.21.15.39:0/2348017628 conn(0x7f9ec00fc610 msgr2=0x7f9ec00fea30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:35:57.482 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:35:57.480+0000 7f9ec4a00640 1 -- 172.21.15.39:0/2348017628 shutdown_connections 2024-09-12T02:35:57.482 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:35:57.480+0000 7f9ec4a00640 1 -- 172.21.15.39:0/2348017628 wait complete. 2024-09-12T02:35:57.483 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:35:57.481+0000 7f9ec4a00640 1 Processor -- start 2024-09-12T02:35:57.483 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:35:57.481+0000 7f9ec4a00640 1 -- start start 2024-09-12T02:35:57.484 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:35:57.482+0000 7f9ec4a00640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f9ec0100980 0x7f9ec01a4670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:35:57.484 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:35:57.482+0000 7f9ec4a00640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f9ec01012a0 0x7f9ec01a4bb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:35:57.484 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:35:57.482+0000 7f9ec4a00640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f9ec0105d90 0x7f9ec019e740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:35:57.484 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:35:57.482+0000 7f9ec4a00640 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 -- 0x7f9ec0118410 con 0x7f9ec0100980 2024-09-12T02:35:57.484 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:35:57.482+0000 7f9ec4a00640 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x7f9ec0118290 con 0x7f9ec0105d90 2024-09-12T02:35:57.484 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:35:57.482+0000 7f9ec4a00640 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7f9ec0118590 con 0x7f9ec01012a0 2024-09-12T02:35:57.484 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:35:57.482+0000 7f9ebf400640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f9ec0100980 0x7f9ec01a4670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:35:57.484 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:35:57.482+0000 7f9ebf400640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f9ec0100980 0x7f9ec01a4670 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.39:3300/0 says I am v2:172.21.15.39:38278/0 (socket says 172.21.15.39:38278) 2024-09-12T02:35:57.484 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:35:57.482+0000 7f9ebf400640 1 -- 172.21.15.39:0/3797834400 learned_addr learned my addr 172.21.15.39:0/3797834400 (peer_addr_for_me v2:172.21.15.39:0/0) 2024-09-12T02:35:57.484 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:35:57.482+0000 7f9ebfe00640 1 --2- 172.21.15.39:0/3797834400 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f9ec0105d90 0x7f9ec019e740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:35:57.484 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:35:57.482+0000 7f9eb7e00640 1 --2- 172.21.15.39:0/3797834400 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f9ec01012a0 0x7f9ec01a4bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:35:57.484 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:35:57.482+0000 7f9ebf400640 1 -- 172.21.15.39:0/3797834400 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f9ec01012a0 msgr2=0x7f9ec01a4bb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:35:57.485 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:35:57.483+0000 7f9ebf400640 1 --2- 172.21.15.39:0/3797834400 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f9ec01012a0 0x7f9ec01a4bb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:35:57.485 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:35:57.483+0000 7f9ebf400640 1 -- 172.21.15.39:0/3797834400 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f9ec0105d90 msgr2=0x7f9ec019e740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:35:57.485 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:35:57.483+0000 7f9ebf400640 1 --2- 172.21.15.39:0/3797834400 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f9ec0105d90 0x7f9ec019e740 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:35:57.485 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:35:57.483+0000 7f9ebf400640 1 -- 172.21.15.39:0/3797834400 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9ec019efb0 con 0x7f9ec0100980 2024-09-12T02:35:57.485 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:35:57.483+0000 7f9ebf400640 1 --2- 172.21.15.39:0/3797834400 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f9ec0100980 0x7f9ec01a4670 secure :-1 s=READY pgs=180 cs=0 l=1 rev1=1 crypto rx=0x7f9eb0004770 tx=0x7f9eb0003c10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:35:57.486 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:35:57.483+0000 7f9ebcc00640 1 -- 172.21.15.39:0/3797834400 <== mon.0 v2:172.21.15.39:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9eb003f070 con 0x7f9ec0100980 2024-09-12T02:35:57.486 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:35:57.483+0000 7f9ebcc00640 1 -- 172.21.15.39:0/3797834400 <== mon.0 v2:172.21.15.39:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f9eb0031ca0 con 0x7f9ec0100980 2024-09-12T02:35:57.486 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:35:57.483+0000 7f9ec4a00640 1 -- 172.21.15.39:0/3797834400 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f9ec019f240 con 0x7f9ec0100980 2024-09-12T02:35:57.486 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:35:57.483+0000 7f9ebcc00640 1 -- 172.21.15.39:0/3797834400 <== mon.0 v2:172.21.15.39:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9eb0035030 con 0x7f9ec0100980 2024-09-12T02:35:57.486 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:35:57.483+0000 7f9ec4a00640 1 -- 172.21.15.39:0/3797834400 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f9ec01ab420 con 0x7f9ec0100980 2024-09-12T02:35:57.486 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:35:57.484+0000 7f9ec4a00640 1 -- 172.21.15.39:0/3797834400 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f9ec006a850 con 0x7f9ec0100980 2024-09-12T02:35:57.487 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:35:57.486+0000 7f9ebcc00640 1 -- 172.21.15.39:0/3797834400 <== mon.0 v2:172.21.15.39:3300/0 4 ==== mgrmap(e 16) ==== 137833+0+0 (secure 0 0 0) 0x7f9eb0042070 con 0x7f9ec0100980 2024-09-12T02:35:57.488 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:35:57.488+0000 7f9ebcc00640 1 --2- 172.21.15.39:0/3797834400 >> [v2:172.21.15.39:6800/1725006999,v1:172.21.15.39:6801/1725006999] conn(0x7f9ea40a2c00 0x7f9ea40a50c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:35:57.489 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:35:57.488+0000 7f9ebcc00640 1 -- 172.21.15.39:0/3797834400 <== mon.0 v2:172.21.15.39:3300/0 5 ==== osd_map(93..93 src has 1..93) ==== 9092+0+0 (secure 0 0 0) 0x7f9eb00ef910 con 0x7f9ec0100980 2024-09-12T02:35:57.489 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:35:57.488+0000 7f9eb7e00640 1 --2- 172.21.15.39:0/3797834400 >> [v2:172.21.15.39:6800/1725006999,v1:172.21.15.39:6801/1725006999] conn(0x7f9ea40a2c00 0x7f9ea40a50c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:35:57.489 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:35:57.489+0000 7f9eb7e00640 1 --2- 172.21.15.39:0/3797834400 >> [v2:172.21.15.39:6800/1725006999,v1:172.21.15.39:6801/1725006999] conn(0x7f9ea40a2c00 0x7f9ea40a50c0 secure :-1 s=READY pgs=167 cs=0 l=1 rev1=1 crypto rx=0x7f9ec019ff90 tx=0x7f9ea8005f90 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:35:57.493 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:35:57.492+0000 7f9ebcc00640 1 -- 172.21.15.39:0/3797834400 <== mon.0 v2:172.21.15.39:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7f9eb00bbf20 con 0x7f9ec0100980 2024-09-12T02:35:57.707 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:35:57.706+0000 7f9ec4a00640 1 -- 172.21.15.39:0/3797834400 --> [v2:172.21.15.39:6800/1725006999,v1:172.21.15.39:6801/1725006999] -- mgr_command(tid 0: {"prefix": "fs subvolume create", "vol_name": "cephfs", "sub_name": "sv_0", "group_name": "qa", "target": ["mon-mgr", ""]}) -- 0x7f9ec0104e30 con 0x7f9ea40a2c00 2024-09-12T02:35:57.737 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:35:57.735+0000 7f9ebcc00640 1 -- 172.21.15.39:0/3797834400 <== mgr.14150 v2:172.21.15.39:6800/1725006999 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+0 (secure 0 0 0) 0x7f9ec0104e30 con 0x7f9ea40a2c00 2024-09-12T02:35:57.738 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:35:57.737+0000 7f9ec4a00640 1 -- 172.21.15.39:0/3797834400 >> [v2:172.21.15.39:6800/1725006999,v1:172.21.15.39:6801/1725006999] conn(0x7f9ea40a2c00 msgr2=0x7f9ea40a50c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:35:57.739 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:35:57.738+0000 7f9ec4a00640 1 --2- 172.21.15.39:0/3797834400 >> [v2:172.21.15.39:6800/1725006999,v1:172.21.15.39:6801/1725006999] conn(0x7f9ea40a2c00 0x7f9ea40a50c0 secure :-1 s=READY pgs=167 cs=0 l=1 rev1=1 crypto rx=0x7f9ec019ff90 tx=0x7f9ea8005f90 comp rx=0 tx=0).stop 2024-09-12T02:35:57.739 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:35:57.738+0000 7f9ec4a00640 1 -- 172.21.15.39:0/3797834400 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f9ec0100980 msgr2=0x7f9ec01a4670 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:35:57.739 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:35:57.738+0000 7f9ec4a00640 1 --2- 172.21.15.39:0/3797834400 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f9ec0100980 0x7f9ec01a4670 secure :-1 s=READY pgs=180 cs=0 l=1 rev1=1 crypto rx=0x7f9eb0004770 tx=0x7f9eb0003c10 comp rx=0 tx=0).stop 2024-09-12T02:35:57.739 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:35:57.738+0000 7f9ec4a00640 1 -- 172.21.15.39:0/3797834400 shutdown_connections 2024-09-12T02:35:57.739 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:35:57.738+0000 7f9ec4a00640 1 --2- 172.21.15.39:0/3797834400 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f9ec0105d90 0x7f9ec019e740 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:35:57.739 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:35:57.738+0000 7f9ec4a00640 1 --2- 172.21.15.39:0/3797834400 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f9ec01012a0 0x7f9ec01a4bb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:35:57.739 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:35:57.738+0000 7f9ec4a00640 1 --2- 172.21.15.39:0/3797834400 >> [v2:172.21.15.39:6800/1725006999,v1:172.21.15.39:6801/1725006999] conn(0x7f9ea40a2c00 0x7f9ea40a50c0 unknown :-1 s=CLOSED pgs=167 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:35:57.739 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:35:57.738+0000 7f9ec4a00640 1 --2- 172.21.15.39:0/3797834400 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f9ec0100980 0x7f9ec01a4670 unknown :-1 s=CLOSED pgs=180 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:35:57.739 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:35:57.738+0000 7f9ec4a00640 1 -- 172.21.15.39:0/3797834400 >> 172.21.15.39:0/3797834400 conn(0x7f9ec00fc610 msgr2=0x7f9ec0103710 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:35:57.739 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:35:57.738+0000 7f9ec4a00640 1 -- 172.21.15.39:0/3797834400 shutdown_connections 2024-09-12T02:35:57.739 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:35:57.738+0000 7f9ec4a00640 1 -- 172.21.15.39:0/3797834400 wait complete. 2024-09-12T02:35:58.099 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 02:35:57 smithi039 ceph-mon[30515]: pgmap v329: 129 pgs: 129 active+clean; 587 KiB data, 347 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 4.8 KiB/s wr, 21 op/s; 0 B/s, 0 objects/s recovering 2024-09-12T02:35:58.099 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 02:35:57 smithi039 ceph-mon[30515]: from='client.14703 -' entity='client.admin' cmd=[{"prefix": "fs subvolume create", "vol_name": "cephfs", "sub_name": "sv_0", "group_name": "qa", "target": ["mon-mgr", ""]}]: dispatch 2024-09-12T02:35:58.198 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 12 02:35:57 smithi044 ceph-mon[35411]: pgmap v329: 129 pgs: 129 active+clean; 587 KiB data, 347 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 4.8 KiB/s wr, 21 op/s; 0 B/s, 0 objects/s recovering 2024-09-12T02:35:58.198 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 12 02:35:57 smithi044 ceph-mon[35411]: from='client.14703 -' entity='client.admin' cmd=[{"prefix": "fs subvolume create", "vol_name": "cephfs", "sub_name": "sv_0", "group_name": "qa", "target": ["mon-mgr", ""]}]: dispatch 2024-09-12T02:35:58.263 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 12 02:35:57 smithi172 ceph-mon[35609]: pgmap v329: 129 pgs: 129 active+clean; 587 KiB data, 347 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 4.8 KiB/s wr, 21 op/s; 0 B/s, 0 objects/s recovering 2024-09-12T02:35:58.264 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 12 02:35:57 smithi172 ceph-mon[35609]: from='client.14703 -' entity='client.admin' cmd=[{"prefix": "fs subvolume create", "vol_name": "cephfs", "sub_name": "sv_0", "group_name": "qa", "target": ["mon-mgr", ""]}]: dispatch 2024-09-12T02:35:58.503 DEBUG:teuthology.orchestra.run.smithi039:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc shell --fsid 4954ed46-70ae-11ef-bcea-c7b262605968 -- ceph fs subvolume getpath cephfs --group_name qa sv_0 2024-09-12T02:35:58.884 INFO:teuthology.orchestra.run.smithi039.stderr:Inferring config /var/lib/ceph/4954ed46-70ae-11ef-bcea-c7b262605968/mon.a/config 2024-09-12T02:35:59.198 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 12 02:35:58 smithi044 ceph-mon[35411]: mgrmap e17: x(active, since 8m), standbys: z, y 2024-09-12T02:35:59.207 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 02:35:58 smithi039 ceph-mon[30515]: mgrmap e17: x(active, since 8m), standbys: z, y 2024-09-12T02:35:59.263 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 12 02:35:58 smithi172 ceph-mon[35609]: mgrmap e17: x(active, since 8m), standbys: z, y 2024-09-12T02:35:59.453 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:35:59.452+0000 7f474b600640 1 -- 172.21.15.39:0/201479012 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f4744103ff0 msgr2=0x7f47441043d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:35:59.453 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:35:59.452+0000 7f474b600640 1 --2- 172.21.15.39:0/201479012 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f4744103ff0 0x7f47441043d0 secure :-1 s=READY pgs=181 cs=0 l=1 rev1=1 crypto rx=0x7f4738009900 tx=0x7f473802a410 comp rx=0 tx=0).stop 2024-09-12T02:35:59.454 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:35:59.452+0000 7f474b600640 1 -- 172.21.15.39:0/201479012 shutdown_connections 2024-09-12T02:35:59.454 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:35:59.452+0000 7f474b600640 1 --2- 172.21.15.39:0/201479012 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f4744109120 0x7f4744110ca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:35:59.454 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:35:59.452+0000 7f474b600640 1 --2- 172.21.15.39:0/201479012 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f47441049a0 0x7f47441089f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:35:59.454 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:35:59.452+0000 7f474b600640 1 --2- 172.21.15.39:0/201479012 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f4744103ff0 0x7f47441043d0 unknown :-1 s=CLOSED pgs=181 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:35:59.454 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:35:59.452+0000 7f474b600640 1 -- 172.21.15.39:0/201479012 >> 172.21.15.39:0/201479012 conn(0x7f47440ffa90 msgr2=0x7f4744101eb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:35:59.454 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:35:59.452+0000 7f474b600640 1 -- 172.21.15.39:0/201479012 shutdown_connections 2024-09-12T02:35:59.454 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:35:59.452+0000 7f474b600640 1 -- 172.21.15.39:0/201479012 wait complete. 2024-09-12T02:35:59.456 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:35:59.453+0000 7f474b600640 1 Processor -- start 2024-09-12T02:35:59.456 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:35:59.453+0000 7f474b600640 1 -- start start 2024-09-12T02:35:59.456 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:35:59.454+0000 7f474b600640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f4744103ff0 0x7f474419a670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:35:59.456 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:35:59.454+0000 7f474b600640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f47441049a0 0x7f474419abb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:35:59.456 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:35:59.454+0000 7f474b600640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f4744109120 0x7f474419ef40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:35:59.456 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:35:59.454+0000 7f474b600640 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 -- 0x7f4744114170 con 0x7f4744109120 2024-09-12T02:35:59.456 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:35:59.454+0000 7f474b600640 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x7f4744113ff0 con 0x7f4744103ff0 2024-09-12T02:35:59.456 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:35:59.454+0000 7f474b600640 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7f47441142f0 con 0x7f47441049a0 2024-09-12T02:35:59.456 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:35:59.454+0000 7f4749600640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f4744109120 0x7f474419ef40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:35:59.456 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:35:59.454+0000 7f4748c00640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f4744103ff0 0x7f474419a670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:35:59.457 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:35:59.454+0000 7f4749600640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f4744109120 0x7f474419ef40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.39:3300/0 says I am v2:172.21.15.39:49562/0 (socket says 172.21.15.39:49562) 2024-09-12T02:35:59.457 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:35:59.454+0000 7f4749600640 1 -- 172.21.15.39:0/4200342949 learned_addr learned my addr 172.21.15.39:0/4200342949 (peer_addr_for_me v2:172.21.15.39:0/0) 2024-09-12T02:35:59.457 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:35:59.454+0000 7f4743e00640 1 --2- 172.21.15.39:0/4200342949 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f47441049a0 0x7f474419abb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:35:59.457 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:35:59.454+0000 7f4749600640 1 -- 172.21.15.39:0/4200342949 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f47441049a0 msgr2=0x7f474419abb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:35:59.457 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:35:59.454+0000 7f4749600640 1 --2- 172.21.15.39:0/4200342949 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f47441049a0 0x7f474419abb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:35:59.457 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:35:59.454+0000 7f4749600640 1 -- 172.21.15.39:0/4200342949 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f4744103ff0 msgr2=0x7f474419a670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:35:59.457 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:35:59.454+0000 7f4749600640 1 --2- 172.21.15.39:0/4200342949 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f4744103ff0 0x7f474419a670 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:35:59.457 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:35:59.454+0000 7f4749600640 1 -- 172.21.15.39:0/4200342949 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f474419f620 con 0x7f4744109120 2024-09-12T02:35:59.457 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:35:59.454+0000 7f4748c00640 1 --2- 172.21.15.39:0/4200342949 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f4744103ff0 0x7f474419a670 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-12T02:35:59.457 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:35:59.455+0000 7f4749600640 1 --2- 172.21.15.39:0/4200342949 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f4744109120 0x7f474419ef40 secure :-1 s=READY pgs=182 cs=0 l=1 rev1=1 crypto rx=0x7f473c00eb10 tx=0x7f473c00c2d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:35:59.457 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:35:59.455+0000 7f4741600640 1 -- 172.21.15.39:0/4200342949 <== mon.0 v2:172.21.15.39:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f473c004b20 con 0x7f4744109120 2024-09-12T02:35:59.457 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:35:59.455+0000 7f4741600640 1 -- 172.21.15.39:0/4200342949 <== mon.0 v2:172.21.15.39:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f473c004cc0 con 0x7f4744109120 2024-09-12T02:35:59.457 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:35:59.455+0000 7f4741600640 1 -- 172.21.15.39:0/4200342949 <== mon.0 v2:172.21.15.39:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f473c010760 con 0x7f4744109120 2024-09-12T02:35:59.458 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:35:59.455+0000 7f474b600640 1 -- 172.21.15.39:0/4200342949 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f474419f910 con 0x7f4744109120 2024-09-12T02:35:59.458 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:35:59.455+0000 7f474b600640 1 -- 172.21.15.39:0/4200342949 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f47441a71f0 con 0x7f4744109120 2024-09-12T02:35:59.458 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:35:59.456+0000 7f474b600640 1 -- 172.21.15.39:0/4200342949 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f47441043d0 con 0x7f4744109120 2024-09-12T02:35:59.459 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:35:59.458+0000 7f4741600640 1 -- 172.21.15.39:0/4200342949 <== mon.0 v2:172.21.15.39:3300/0 4 ==== mgrmap(e 17) ==== 137884+0+0 (secure 0 0 0) 0x7f473c005020 con 0x7f4744109120 2024-09-12T02:35:59.460 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:35:59.459+0000 7f4741600640 1 --2- 172.21.15.39:0/4200342949 >> [v2:172.21.15.39:6800/1725006999,v1:172.21.15.39:6801/1725006999] conn(0x7f472c0a2c90 0x7f472c0a5150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:35:59.460 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:35:59.460+0000 7f4741600640 1 -- 172.21.15.39:0/4200342949 <== mon.0 v2:172.21.15.39:3300/0 5 ==== osd_map(93..93 src has 1..93) ==== 9092+0+0 (secure 0 0 0) 0x7f473c0cfa20 con 0x7f4744109120 2024-09-12T02:35:59.461 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:35:59.460+0000 7f4748c00640 1 --2- 172.21.15.39:0/4200342949 >> [v2:172.21.15.39:6800/1725006999,v1:172.21.15.39:6801/1725006999] conn(0x7f472c0a2c90 0x7f472c0a5150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:35:59.461 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:35:59.461+0000 7f4748c00640 1 --2- 172.21.15.39:0/4200342949 >> [v2:172.21.15.39:6800/1725006999,v1:172.21.15.39:6801/1725006999] conn(0x7f472c0a2c90 0x7f472c0a5150 secure :-1 s=READY pgs=168 cs=0 l=1 rev1=1 crypto rx=0x7f4738000c00 tx=0x7f4738031510 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:35:59.465 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:35:59.464+0000 7f4741600640 1 -- 172.21.15.39:0/4200342949 <== mon.0 v2:172.21.15.39:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7f473c09c460 con 0x7f4744109120 2024-09-12T02:35:59.678 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:35:59.677+0000 7f474b600640 1 -- 172.21.15.39:0/4200342949 --> [v2:172.21.15.39:6800/1725006999,v1:172.21.15.39:6801/1725006999] -- mgr_command(tid 0: {"prefix": "fs subvolume getpath", "vol_name": "cephfs", "group_name": "qa", "sub_name": "sv_0", "target": ["mon-mgr", ""]}) -- 0x7f4744062630 con 0x7f472c0a2c90 2024-09-12T02:35:59.684 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:35:59.683+0000 7f4741600640 1 -- 172.21.15.39:0/4200342949 <== mgr.14150 v2:172.21.15.39:6800/1725006999 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+54 (secure 0 0 0) 0x7f4744062630 con 0x7f472c0a2c90 2024-09-12T02:35:59.684 INFO:teuthology.orchestra.run.smithi039.stdout:/volumes/qa/sv_0/1398e0eb-7b8b-4d5e-ac91-7fb9a64a04a6 2024-09-12T02:35:59.687 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:35:59.686+0000 7f474b600640 1 -- 172.21.15.39:0/4200342949 >> [v2:172.21.15.39:6800/1725006999,v1:172.21.15.39:6801/1725006999] conn(0x7f472c0a2c90 msgr2=0x7f472c0a5150 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:35:59.687 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:35:59.686+0000 7f474b600640 1 --2- 172.21.15.39:0/4200342949 >> [v2:172.21.15.39:6800/1725006999,v1:172.21.15.39:6801/1725006999] conn(0x7f472c0a2c90 0x7f472c0a5150 secure :-1 s=READY pgs=168 cs=0 l=1 rev1=1 crypto rx=0x7f4738000c00 tx=0x7f4738031510 comp rx=0 tx=0).stop 2024-09-12T02:35:59.687 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:35:59.686+0000 7f474b600640 1 -- 172.21.15.39:0/4200342949 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f4744109120 msgr2=0x7f474419ef40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:35:59.687 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:35:59.686+0000 7f474b600640 1 --2- 172.21.15.39:0/4200342949 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f4744109120 0x7f474419ef40 secure :-1 s=READY pgs=182 cs=0 l=1 rev1=1 crypto rx=0x7f473c00eb10 tx=0x7f473c00c2d0 comp rx=0 tx=0).stop 2024-09-12T02:35:59.687 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:35:59.686+0000 7f474b600640 1 -- 172.21.15.39:0/4200342949 shutdown_connections 2024-09-12T02:35:59.687 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:35:59.686+0000 7f474b600640 1 --2- 172.21.15.39:0/4200342949 >> [v2:172.21.15.39:6800/1725006999,v1:172.21.15.39:6801/1725006999] conn(0x7f472c0a2c90 0x7f472c0a5150 unknown :-1 s=CLOSED pgs=168 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:35:59.687 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:35:59.686+0000 7f474b600640 1 --2- 172.21.15.39:0/4200342949 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f4744109120 0x7f474419ef40 unknown :-1 s=CLOSED pgs=182 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:35:59.688 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:35:59.686+0000 7f474b600640 1 --2- 172.21.15.39:0/4200342949 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f47441049a0 0x7f474419abb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:35:59.688 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:35:59.686+0000 7f474b600640 1 --2- 172.21.15.39:0/4200342949 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f4744103ff0 0x7f474419a670 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:35:59.688 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:35:59.686+0000 7f474b600640 1 -- 172.21.15.39:0/4200342949 >> 172.21.15.39:0/4200342949 conn(0x7f47440ffa90 msgr2=0x7f4744100d70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:35:59.688 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:35:59.686+0000 7f474b600640 1 -- 172.21.15.39:0/4200342949 shutdown_connections 2024-09-12T02:35:59.688 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:35:59.686+0000 7f474b600640 1 -- 172.21.15.39:0/4200342949 wait complete. 2024-09-12T02:36:00.198 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 12 02:35:59 smithi044 ceph-mon[35411]: pgmap v330: 129 pgs: 129 active+clean; 608 KiB data, 347 MiB used, 1.0 TiB / 1.0 TiB avail; 7.4 KiB/s rd, 6.2 KiB/s wr, 22 op/s; 0 B/s, 0 objects/s recovering 2024-09-12T02:36:00.198 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 12 02:35:59 smithi044 ceph-mon[35411]: from='client.14709 -' entity='client.admin' cmd=[{"prefix": "fs subvolume getpath", "vol_name": "cephfs", "group_name": "qa", "sub_name": "sv_0", "target": ["mon-mgr", ""]}]: dispatch 2024-09-12T02:36:00.263 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 12 02:35:59 smithi172 ceph-mon[35609]: pgmap v330: 129 pgs: 129 active+clean; 608 KiB data, 347 MiB used, 1.0 TiB / 1.0 TiB avail; 7.4 KiB/s rd, 6.2 KiB/s wr, 22 op/s; 0 B/s, 0 objects/s recovering 2024-09-12T02:36:00.264 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 12 02:35:59 smithi172 ceph-mon[35609]: from='client.14709 -' entity='client.admin' cmd=[{"prefix": "fs subvolume getpath", "vol_name": "cephfs", "group_name": "qa", "sub_name": "sv_0", "target": ["mon-mgr", ""]}]: dispatch 2024-09-12T02:36:00.349 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 02:35:59 smithi039 ceph-mon[30515]: pgmap v330: 129 pgs: 129 active+clean; 608 KiB data, 347 MiB used, 1.0 TiB / 1.0 TiB avail; 7.4 KiB/s rd, 6.2 KiB/s wr, 22 op/s; 0 B/s, 0 objects/s recovering 2024-09-12T02:36:00.350 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 02:35:59 smithi039 ceph-mon[30515]: from='client.14709 -' entity='client.admin' cmd=[{"prefix": "fs subvolume getpath", "vol_name": "cephfs", "group_name": "qa", "sub_name": "sv_0", "target": ["mon-mgr", ""]}]: dispatch 2024-09-12T02:36:00.564 DEBUG:teuthology.orchestra.run.smithi039:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc shell --fsid 4954ed46-70ae-11ef-bcea-c7b262605968 -- ceph fs subvolume create cephfs sv_1 --group_name qa 2024-09-12T02:36:01.139 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 12 02:36:00 smithi044 ceph-mon[35411]: from='mgr.14150 172.21.15.39:0/408627207' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-12T02:36:01.262 INFO:teuthology.orchestra.run.smithi039.stderr:Inferring config /var/lib/ceph/4954ed46-70ae-11ef-bcea-c7b262605968/mon.a/config 2024-09-12T02:36:01.263 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 12 02:36:00 smithi172 ceph-mon[35609]: from='mgr.14150 172.21.15.39:0/408627207' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-12T02:36:01.270 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 02:36:00 smithi039 ceph-mon[30515]: from='mgr.14150 172.21.15.39:0/408627207' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-12T02:36:02.170 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:36:02.169+0000 7fc960e00640 1 -- 172.21.15.39:0/4165015859 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fc95c076720 msgr2=0x7fc95c076b00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:36:02.170 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:36:02.169+0000 7fc960e00640 1 --2- 172.21.15.39:0/4165015859 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fc95c076720 0x7fc95c076b00 secure :-1 s=READY pgs=183 cs=0 l=1 rev1=1 crypto rx=0x7fc94c009900 tx=0x7fc94c02a3f0 comp rx=0 tx=0).stop 2024-09-12T02:36:02.170 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:36:02.169+0000 7fc960e00640 1 -- 172.21.15.39:0/4165015859 shutdown_connections 2024-09-12T02:36:02.170 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:36:02.169+0000 7fc960e00640 1 --2- 172.21.15.39:0/4165015859 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fc95c112a50 0x7fc95c114e40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:36:02.170 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:36:02.169+0000 7fc960e00640 1 --2- 172.21.15.39:0/4165015859 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fc95c077040 0x7fc95c112510 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:36:02.170 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:36:02.169+0000 7fc960e00640 1 --2- 172.21.15.39:0/4165015859 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fc95c076720 0x7fc95c076b00 unknown :-1 s=CLOSED pgs=183 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:36:02.170 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:36:02.169+0000 7fc960e00640 1 -- 172.21.15.39:0/4165015859 >> 172.21.15.39:0/4165015859 conn(0x7fc95c0ffa50 msgr2=0x7fc95c101e70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:36:02.171 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:36:02.169+0000 7fc960e00640 1 -- 172.21.15.39:0/4165015859 shutdown_connections 2024-09-12T02:36:02.171 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:36:02.169+0000 7fc960e00640 1 -- 172.21.15.39:0/4165015859 wait complete. 2024-09-12T02:36:02.171 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:36:02.170+0000 7fc960e00640 1 Processor -- start 2024-09-12T02:36:02.171 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:36:02.170+0000 7fc960e00640 1 -- start start 2024-09-12T02:36:02.172 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:36:02.171+0000 7fc960e00640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fc95c076720 0x7fc95c1a4710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:36:02.172 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:36:02.171+0000 7fc960e00640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fc95c077040 0x7fc95c1a4c50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:36:02.172 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:36:02.171+0000 7fc960e00640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fc95c112a50 0x7fc95c19e8d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:36:02.172 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:36:02.171+0000 7fc960e00640 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 -- 0x7fc95c1185e0 con 0x7fc95c076720 2024-09-12T02:36:02.172 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:36:02.171+0000 7fc960e00640 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x7fc95c118460 con 0x7fc95c112a50 2024-09-12T02:36:02.172 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:36:02.171+0000 7fc960e00640 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7fc95c118760 con 0x7fc95c077040 2024-09-12T02:36:02.172 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:36:02.171+0000 7fc959e00640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fc95c076720 0x7fc95c1a4710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:36:02.172 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:36:02.171+0000 7fc951400640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fc95c077040 0x7fc95c1a4c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:36:02.172 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:36:02.171+0000 7fc95a800640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fc95c112a50 0x7fc95c19e8d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:36:02.172 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:36:02.171+0000 7fc951400640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fc95c077040 0x7fc95c1a4c50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.172:3300/0 says I am v2:172.21.15.39:47920/0 (socket says 172.21.15.39:47920) 2024-09-12T02:36:02.173 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:36:02.171+0000 7fc951400640 1 -- 172.21.15.39:0/1713436043 learned_addr learned my addr 172.21.15.39:0/1713436043 (peer_addr_for_me v2:172.21.15.39:0/0) 2024-09-12T02:36:02.173 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:36:02.171+0000 7fc95a800640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fc95c112a50 0x7fc95c19e8d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.39:59908/0 (socket says 172.21.15.39:59908) 2024-09-12T02:36:02.173 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:36:02.172+0000 7fc95a800640 1 -- 172.21.15.39:0/1713436043 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fc95c077040 msgr2=0x7fc95c1a4c50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:36:02.173 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:36:02.172+0000 7fc95a800640 1 --2- 172.21.15.39:0/1713436043 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fc95c077040 0x7fc95c1a4c50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:36:02.174 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:36:02.172+0000 7fc95a800640 1 -- 172.21.15.39:0/1713436043 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fc95c076720 msgr2=0x7fc95c1a4710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:36:02.174 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:36:02.172+0000 7fc95a800640 1 --2- 172.21.15.39:0/1713436043 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fc95c076720 0x7fc95c1a4710 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:36:02.174 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:36:02.172+0000 7fc95a800640 1 -- 172.21.15.39:0/1713436043 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc95c19f000 con 0x7fc95c112a50 2024-09-12T02:36:02.174 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:36:02.172+0000 7fc95a800640 1 --2- 172.21.15.39:0/1713436043 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fc95c112a50 0x7fc95c19e8d0 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7fc95c07aa10 tx=0x7fc95400ef10 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:36:02.174 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:36:02.172+0000 7fc953400640 1 -- 172.21.15.39:0/1713436043 <== mon.2 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc95400cdf0 con 0x7fc95c112a50 2024-09-12T02:36:02.174 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:36:02.172+0000 7fc960e00640 1 -- 172.21.15.39:0/1713436043 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc95c19f2f0 con 0x7fc95c112a50 2024-09-12T02:36:02.174 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:36:02.172+0000 7fc953400640 1 -- 172.21.15.39:0/1713436043 <== mon.2 v2:172.21.15.44:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fc954005020 con 0x7fc95c112a50 2024-09-12T02:36:02.174 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:36:02.172+0000 7fc953400640 1 -- 172.21.15.39:0/1713436043 <== mon.2 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc954010670 con 0x7fc95c112a50 2024-09-12T02:36:02.174 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:36:02.172+0000 7fc960e00640 1 -- 172.21.15.39:0/1713436043 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc95c1ab5e0 con 0x7fc95c112a50 2024-09-12T02:36:02.174 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:36:02.173+0000 7fc960e00640 1 -- 172.21.15.39:0/1713436043 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fc95c076b00 con 0x7fc95c112a50 2024-09-12T02:36:02.176 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:36:02.175+0000 7fc953400640 1 -- 172.21.15.39:0/1713436043 <== mon.2 v2:172.21.15.44:3300/0 4 ==== mgrmap(e 17) ==== 137884+0+0 (secure 0 0 0) 0x7fc9540054d0 con 0x7fc95c112a50 2024-09-12T02:36:02.177 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:36:02.176+0000 7fc953400640 1 --2- 172.21.15.39:0/1713436043 >> [v2:172.21.15.39:6800/1725006999,v1:172.21.15.39:6801/1725006999] conn(0x7fc9400a2c90 0x7fc9400a5150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:36:02.177 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:36:02.176+0000 7fc953400640 1 -- 172.21.15.39:0/1713436043 <== mon.2 v2:172.21.15.44:3300/0 5 ==== osd_map(93..93 src has 1..93) ==== 9092+0+0 (secure 0 0 0) 0x7fc9540cfb40 con 0x7fc95c112a50 2024-09-12T02:36:02.177 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:36:02.177+0000 7fc959e00640 1 --2- 172.21.15.39:0/1713436043 >> [v2:172.21.15.39:6800/1725006999,v1:172.21.15.39:6801/1725006999] conn(0x7fc9400a2c90 0x7fc9400a5150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:36:02.178 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:36:02.177+0000 7fc959e00640 1 --2- 172.21.15.39:0/1713436043 >> [v2:172.21.15.39:6800/1725006999,v1:172.21.15.39:6801/1725006999] conn(0x7fc9400a2c90 0x7fc9400a5150 secure :-1 s=READY pgs=169 cs=0 l=1 rev1=1 crypto rx=0x7fc95c19fa10 tx=0x7fc94c0058d0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:36:02.181 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:36:02.180+0000 7fc953400640 1 -- 172.21.15.39:0/1713436043 <== mon.2 v2:172.21.15.44:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7fc95409c580 con 0x7fc95c112a50 2024-09-12T02:36:02.411 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:36:02.410+0000 7fc960e00640 1 -- 172.21.15.39:0/1713436043 --> [v2:172.21.15.39:6800/1725006999,v1:172.21.15.39:6801/1725006999] -- mgr_command(tid 0: {"prefix": "fs subvolume create", "vol_name": "cephfs", "sub_name": "sv_1", "group_name": "qa", "target": ["mon-mgr", ""]}) -- 0x7fc95c114700 con 0x7fc9400a2c90 2024-09-12T02:36:02.436 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:36:02.435+0000 7fc953400640 1 -- 172.21.15.39:0/1713436043 <== mgr.14150 v2:172.21.15.39:6800/1725006999 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+0 (secure 0 0 0) 0x7fc95c114700 con 0x7fc9400a2c90 2024-09-12T02:36:02.438 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:36:02.437+0000 7fc960e00640 1 -- 172.21.15.39:0/1713436043 >> [v2:172.21.15.39:6800/1725006999,v1:172.21.15.39:6801/1725006999] conn(0x7fc9400a2c90 msgr2=0x7fc9400a5150 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:36:02.439 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:36:02.437+0000 7fc960e00640 1 --2- 172.21.15.39:0/1713436043 >> [v2:172.21.15.39:6800/1725006999,v1:172.21.15.39:6801/1725006999] conn(0x7fc9400a2c90 0x7fc9400a5150 secure :-1 s=READY pgs=169 cs=0 l=1 rev1=1 crypto rx=0x7fc95c19fa10 tx=0x7fc94c0058d0 comp rx=0 tx=0).stop 2024-09-12T02:36:02.439 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:36:02.438+0000 7fc960e00640 1 -- 172.21.15.39:0/1713436043 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fc95c112a50 msgr2=0x7fc95c19e8d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:36:02.439 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:36:02.438+0000 7fc960e00640 1 --2- 172.21.15.39:0/1713436043 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fc95c112a50 0x7fc95c19e8d0 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7fc95c07aa10 tx=0x7fc95400ef10 comp rx=0 tx=0).stop 2024-09-12T02:36:02.439 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:36:02.438+0000 7fc960e00640 1 -- 172.21.15.39:0/1713436043 shutdown_connections 2024-09-12T02:36:02.439 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:36:02.438+0000 7fc960e00640 1 --2- 172.21.15.39:0/1713436043 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fc95c112a50 0x7fc95c19e8d0 unknown :-1 s=CLOSED pgs=84 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:36:02.439 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:36:02.438+0000 7fc960e00640 1 --2- 172.21.15.39:0/1713436043 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fc95c077040 0x7fc95c1a4c50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:36:02.439 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:36:02.438+0000 7fc960e00640 1 --2- 172.21.15.39:0/1713436043 >> [v2:172.21.15.39:6800/1725006999,v1:172.21.15.39:6801/1725006999] conn(0x7fc9400a2c90 0x7fc9400a5150 unknown :-1 s=CLOSED pgs=169 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:36:02.439 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:36:02.438+0000 7fc960e00640 1 --2- 172.21.15.39:0/1713436043 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fc95c076720 0x7fc95c1a4710 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:36:02.439 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:36:02.438+0000 7fc960e00640 1 -- 172.21.15.39:0/1713436043 >> 172.21.15.39:0/1713436043 conn(0x7fc95c0ffa50 msgr2=0x7fc95c101e40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:36:02.439 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:36:02.438+0000 7fc960e00640 1 -- 172.21.15.39:0/1713436043 shutdown_connections 2024-09-12T02:36:02.439 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:36:02.438+0000 7fc960e00640 1 -- 172.21.15.39:0/1713436043 wait complete. 2024-09-12T02:36:03.014 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 12 02:36:02 smithi172 ceph-mon[35609]: pgmap v331: 129 pgs: 129 active+clean; 608 KiB data, 347 MiB used, 1.0 TiB / 1.0 TiB avail; 7.9 KiB/s rd, 6.5 KiB/s wr, 23 op/s; 0 B/s, 0 objects/s recovering 2024-09-12T02:36:03.014 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 12 02:36:02 smithi172 ceph-mon[35609]: from='mgr.14150 172.21.15.39:0/408627207' entity='mgr.x' 2024-09-12T02:36:03.014 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 12 02:36:02 smithi172 ceph-mon[35609]: from='mgr.14150 172.21.15.39:0/408627207' entity='mgr.x' 2024-09-12T02:36:03.014 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 12 02:36:02 smithi172 ceph-mon[35609]: from='mgr.14150 172.21.15.39:0/408627207' entity='mgr.x' 2024-09-12T02:36:03.014 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 12 02:36:02 smithi172 ceph-mon[35609]: from='mgr.14150 172.21.15.39:0/408627207' entity='mgr.x' 2024-09-12T02:36:03.100 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 02:36:02 smithi039 ceph-mon[30515]: pgmap v331: 129 pgs: 129 active+clean; 608 KiB data, 347 MiB used, 1.0 TiB / 1.0 TiB avail; 7.9 KiB/s rd, 6.5 KiB/s wr, 23 op/s; 0 B/s, 0 objects/s recovering 2024-09-12T02:36:03.100 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 02:36:02 smithi039 ceph-mon[30515]: from='mgr.14150 172.21.15.39:0/408627207' entity='mgr.x' 2024-09-12T02:36:03.100 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 02:36:02 smithi039 ceph-mon[30515]: from='mgr.14150 172.21.15.39:0/408627207' entity='mgr.x' 2024-09-12T02:36:03.100 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 02:36:02 smithi039 ceph-mon[30515]: from='mgr.14150 172.21.15.39:0/408627207' entity='mgr.x' 2024-09-12T02:36:03.100 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 02:36:02 smithi039 ceph-mon[30515]: from='mgr.14150 172.21.15.39:0/408627207' entity='mgr.x' 2024-09-12T02:36:03.198 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 12 02:36:02 smithi044 ceph-mon[35411]: pgmap v331: 129 pgs: 129 active+clean; 608 KiB data, 347 MiB used, 1.0 TiB / 1.0 TiB avail; 7.9 KiB/s rd, 6.5 KiB/s wr, 23 op/s; 0 B/s, 0 objects/s recovering 2024-09-12T02:36:03.199 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 12 02:36:02 smithi044 ceph-mon[35411]: from='mgr.14150 172.21.15.39:0/408627207' entity='mgr.x' 2024-09-12T02:36:03.199 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 12 02:36:02 smithi044 ceph-mon[35411]: from='mgr.14150 172.21.15.39:0/408627207' entity='mgr.x' 2024-09-12T02:36:03.199 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 12 02:36:02 smithi044 ceph-mon[35411]: from='mgr.14150 172.21.15.39:0/408627207' entity='mgr.x' 2024-09-12T02:36:03.199 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 12 02:36:02 smithi044 ceph-mon[35411]: from='mgr.14150 172.21.15.39:0/408627207' entity='mgr.x' 2024-09-12T02:36:03.247 DEBUG:teuthology.orchestra.run.smithi039:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc shell --fsid 4954ed46-70ae-11ef-bcea-c7b262605968 -- ceph fs subvolume getpath cephfs --group_name qa sv_1 2024-09-12T02:36:03.649 INFO:teuthology.orchestra.run.smithi039.stderr:Inferring config /var/lib/ceph/4954ed46-70ae-11ef-bcea-c7b262605968/mon.a/config 2024-09-12T02:36:03.985 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 02:36:03 smithi039 ceph-mon[30515]: from='client.24707 -' entity='client.admin' cmd=[{"prefix": "fs subvolume create", "vol_name": "cephfs", "sub_name": "sv_1", "group_name": "qa", "target": ["mon-mgr", ""]}]: dispatch 2024-09-12T02:36:03.985 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 02:36:03 smithi039 ceph-mon[30515]: from='mgr.14150 172.21.15.39:0/408627207' entity='mgr.x' 2024-09-12T02:36:03.985 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 02:36:03 smithi039 ceph-mon[30515]: from='mgr.14150 172.21.15.39:0/408627207' entity='mgr.x' 2024-09-12T02:36:04.013 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 12 02:36:03 smithi172 ceph-mon[35609]: from='client.24707 -' entity='client.admin' cmd=[{"prefix": "fs subvolume create", "vol_name": "cephfs", "sub_name": "sv_1", "group_name": "qa", "target": ["mon-mgr", ""]}]: dispatch 2024-09-12T02:36:04.014 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 12 02:36:03 smithi172 ceph-mon[35609]: from='mgr.14150 172.21.15.39:0/408627207' entity='mgr.x' 2024-09-12T02:36:04.014 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 12 02:36:03 smithi172 ceph-mon[35609]: from='mgr.14150 172.21.15.39:0/408627207' entity='mgr.x' 2024-09-12T02:36:04.198 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 12 02:36:03 smithi044 ceph-mon[35411]: from='client.24707 -' entity='client.admin' cmd=[{"prefix": "fs subvolume create", "vol_name": "cephfs", "sub_name": "sv_1", "group_name": "qa", "target": ["mon-mgr", ""]}]: dispatch 2024-09-12T02:36:04.198 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 12 02:36:03 smithi044 ceph-mon[35411]: from='mgr.14150 172.21.15.39:0/408627207' entity='mgr.x' 2024-09-12T02:36:04.198 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 12 02:36:03 smithi044 ceph-mon[35411]: from='mgr.14150 172.21.15.39:0/408627207' entity='mgr.x' 2024-09-12T02:36:04.233 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:36:04.232+0000 7f130fa00640 1 -- 172.21.15.39:0/391308050 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f1308101dd0 msgr2=0x7f13081021b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:36:04.233 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:36:04.232+0000 7f130fa00640 1 --2- 172.21.15.39:0/391308050 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f1308101dd0 0x7f13081021b0 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7f12fc009860 tx=0x7f12fc02a340 comp rx=0 tx=0).stop 2024-09-12T02:36:04.233 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:36:04.232+0000 7f130fa00640 1 -- 172.21.15.39:0/391308050 shutdown_connections 2024-09-12T02:36:04.234 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:36:04.232+0000 7f130fa00640 1 --2- 172.21.15.39:0/391308050 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f1308106f00 0x7f130810ea80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:36:04.234 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:36:04.232+0000 7f130fa00640 1 --2- 172.21.15.39:0/391308050 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f1308102780 0x7f13081067d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:36:04.234 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:36:04.232+0000 7f130fa00640 1 --2- 172.21.15.39:0/391308050 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f1308101dd0 0x7f13081021b0 unknown :-1 s=CLOSED pgs=84 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:36:04.234 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:36:04.232+0000 7f130fa00640 1 -- 172.21.15.39:0/391308050 >> 172.21.15.39:0/391308050 conn(0x7f13080fd8b0 msgr2=0x7f13080ffcd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:36:04.234 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:36:04.232+0000 7f130fa00640 1 -- 172.21.15.39:0/391308050 shutdown_connections 2024-09-12T02:36:04.234 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:36:04.232+0000 7f130fa00640 1 -- 172.21.15.39:0/391308050 wait complete. 2024-09-12T02:36:04.234 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:36:04.233+0000 7f130fa00640 1 Processor -- start 2024-09-12T02:36:04.235 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:36:04.233+0000 7f130fa00640 1 -- start start 2024-09-12T02:36:04.235 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:36:04.233+0000 7f130fa00640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f1308101dd0 0x7f1308198400 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:36:04.235 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:36:04.233+0000 7f130fa00640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f1308102780 0x7f1308198940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:36:04.235 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:36:04.233+0000 7f130fa00640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f1308106f00 0x7f130819ccd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:36:04.236 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:36:04.233+0000 7f130fa00640 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 -- 0x7f1308111f20 con 0x7f1308101dd0 2024-09-12T02:36:04.236 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:36:04.233+0000 7f130fa00640 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x7f1308111da0 con 0x7f1308106f00 2024-09-12T02:36:04.236 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:36:04.233+0000 7f130fa00640 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7f13081120a0 con 0x7f1308102780 2024-09-12T02:36:04.236 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:36:04.234+0000 7f130d000640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f1308101dd0 0x7f1308198400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:36:04.236 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:36:04.234+0000 7f130d000640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f1308101dd0 0x7f1308198400 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.39:3300/0 says I am v2:172.21.15.39:49600/0 (socket says 172.21.15.39:49600) 2024-09-12T02:36:04.236 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:36:04.234+0000 7f130d000640 1 -- 172.21.15.39:0/3525538840 learned_addr learned my addr 172.21.15.39:0/3525538840 (peer_addr_for_me v2:172.21.15.39:0/0) 2024-09-12T02:36:04.236 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:36:04.234+0000 7f1307e00640 1 --2- 172.21.15.39:0/3525538840 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f1308102780 0x7f1308198940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:36:04.236 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:36:04.234+0000 7f130da00640 1 --2- 172.21.15.39:0/3525538840 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f1308106f00 0x7f130819ccd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:36:04.236 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:36:04.234+0000 7f130d000640 1 -- 172.21.15.39:0/3525538840 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f1308102780 msgr2=0x7f1308198940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:36:04.236 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:36:04.234+0000 7f130d000640 1 --2- 172.21.15.39:0/3525538840 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f1308102780 0x7f1308198940 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:36:04.236 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:36:04.234+0000 7f130d000640 1 -- 172.21.15.39:0/3525538840 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f1308106f00 msgr2=0x7f130819ccd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:36:04.236 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:36:04.234+0000 7f130d000640 1 --2- 172.21.15.39:0/3525538840 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f1308106f00 0x7f130819ccd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:36:04.236 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:36:04.234+0000 7f130d000640 1 -- 172.21.15.39:0/3525538840 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f130819d3b0 con 0x7f1308101dd0 2024-09-12T02:36:04.237 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:36:04.235+0000 7f130d000640 1 --2- 172.21.15.39:0/3525538840 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f1308101dd0 0x7f1308198400 secure :-1 s=READY pgs=184 cs=0 l=1 rev1=1 crypto rx=0x7f12fc035040 tx=0x7f12fc033d90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:36:04.237 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:36:04.235+0000 7f1305600640 1 -- 172.21.15.39:0/3525538840 <== mon.0 v2:172.21.15.39:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f12fc03f020 con 0x7f1308101dd0 2024-09-12T02:36:04.237 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:36:04.235+0000 7f1305600640 1 -- 172.21.15.39:0/3525538840 <== mon.0 v2:172.21.15.39:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f12fc032770 con 0x7f1308101dd0 2024-09-12T02:36:04.237 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:36:04.235+0000 7f1305600640 1 -- 172.21.15.39:0/3525538840 <== mon.0 v2:172.21.15.39:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f12fc037040 con 0x7f1308101dd0 2024-09-12T02:36:04.237 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:36:04.235+0000 7f130fa00640 1 -- 172.21.15.39:0/3525538840 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f130819d640 con 0x7f1308101dd0 2024-09-12T02:36:04.237 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:36:04.236+0000 7f130fa00640 1 -- 172.21.15.39:0/3525538840 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f130819dad0 con 0x7f1308101dd0 2024-09-12T02:36:04.238 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:36:04.237+0000 7f130fa00640 1 -- 172.21.15.39:0/3525538840 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f13081021b0 con 0x7f1308101dd0 2024-09-12T02:36:04.239 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:36:04.239+0000 7f1305600640 1 -- 172.21.15.39:0/3525538840 <== mon.0 v2:172.21.15.39:3300/0 4 ==== mgrmap(e 17) ==== 137884+0+0 (secure 0 0 0) 0x7f12fc042020 con 0x7f1308101dd0 2024-09-12T02:36:04.241 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:36:04.241+0000 7f1305600640 1 --2- 172.21.15.39:0/3525538840 >> [v2:172.21.15.39:6800/1725006999,v1:172.21.15.39:6801/1725006999] conn(0x7f12f00a2c10 0x7f12f00a50d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:36:04.242 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:36:04.241+0000 7f1305600640 1 -- 172.21.15.39:0/3525538840 <== mon.0 v2:172.21.15.39:3300/0 5 ==== osd_map(93..93 src has 1..93) ==== 9092+0+0 (secure 0 0 0) 0x7f12fc0ef340 con 0x7f1308101dd0 2024-09-12T02:36:04.242 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:36:04.241+0000 7f1307e00640 1 --2- 172.21.15.39:0/3525538840 >> [v2:172.21.15.39:6800/1725006999,v1:172.21.15.39:6801/1725006999] conn(0x7f12f00a2c10 0x7f12f00a50d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:36:04.242 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:36:04.242+0000 7f1307e00640 1 --2- 172.21.15.39:0/3525538840 >> [v2:172.21.15.39:6800/1725006999,v1:172.21.15.39:6801/1725006999] conn(0x7f12f00a2c10 0x7f12f00a50d0 secure :-1 s=READY pgs=170 cs=0 l=1 rev1=1 crypto rx=0x7f13080fdcd0 tx=0x7f12f4009260 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:36:04.245 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:36:04.244+0000 7f1305600640 1 -- 172.21.15.39:0/3525538840 <== mon.0 v2:172.21.15.39:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7f12fc049030 con 0x7f1308101dd0 2024-09-12T02:36:04.478 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:36:04.477+0000 7f130fa00640 1 -- 172.21.15.39:0/3525538840 --> [v2:172.21.15.39:6800/1725006999,v1:172.21.15.39:6801/1725006999] -- mgr_command(tid 0: {"prefix": "fs subvolume getpath", "vol_name": "cephfs", "group_name": "qa", "sub_name": "sv_1", "target": ["mon-mgr", ""]}) -- 0x7f1308062630 con 0x7f12f00a2c10 2024-09-12T02:36:04.483 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:36:04.482+0000 7f1305600640 1 -- 172.21.15.39:0/3525538840 <== mgr.14150 v2:172.21.15.39:6800/1725006999 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+54 (secure 0 0 0) 0x7f1308062630 con 0x7f12f00a2c10 2024-09-12T02:36:04.483 INFO:teuthology.orchestra.run.smithi039.stdout:/volumes/qa/sv_1/c0d2c7d5-847b-407e-9538-c804b4cffaac 2024-09-12T02:36:04.485 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:36:04.484+0000 7f130fa00640 1 -- 172.21.15.39:0/3525538840 >> [v2:172.21.15.39:6800/1725006999,v1:172.21.15.39:6801/1725006999] conn(0x7f12f00a2c10 msgr2=0x7f12f00a50d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:36:04.485 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:36:04.484+0000 7f130fa00640 1 --2- 172.21.15.39:0/3525538840 >> [v2:172.21.15.39:6800/1725006999,v1:172.21.15.39:6801/1725006999] conn(0x7f12f00a2c10 0x7f12f00a50d0 secure :-1 s=READY pgs=170 cs=0 l=1 rev1=1 crypto rx=0x7f13080fdcd0 tx=0x7f12f4009260 comp rx=0 tx=0).stop 2024-09-12T02:36:04.486 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:36:04.484+0000 7f130fa00640 1 -- 172.21.15.39:0/3525538840 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f1308101dd0 msgr2=0x7f1308198400 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:36:04.486 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:36:04.484+0000 7f130fa00640 1 --2- 172.21.15.39:0/3525538840 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f1308101dd0 0x7f1308198400 secure :-1 s=READY pgs=184 cs=0 l=1 rev1=1 crypto rx=0x7f12fc035040 tx=0x7f12fc033d90 comp rx=0 tx=0).stop 2024-09-12T02:36:04.486 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:36:04.484+0000 7f130fa00640 1 -- 172.21.15.39:0/3525538840 shutdown_connections 2024-09-12T02:36:04.486 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:36:04.485+0000 7f130fa00640 1 --2- 172.21.15.39:0/3525538840 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f1308106f00 0x7f130819ccd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:36:04.486 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:36:04.485+0000 7f130fa00640 1 --2- 172.21.15.39:0/3525538840 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f1308102780 0x7f1308198940 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:36:04.486 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:36:04.485+0000 7f130fa00640 1 --2- 172.21.15.39:0/3525538840 >> [v2:172.21.15.39:6800/1725006999,v1:172.21.15.39:6801/1725006999] conn(0x7f12f00a2c10 0x7f12f00a50d0 unknown :-1 s=CLOSED pgs=170 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:36:04.486 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:36:04.485+0000 7f130fa00640 1 --2- 172.21.15.39:0/3525538840 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f1308101dd0 0x7f1308198400 unknown :-1 s=CLOSED pgs=184 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:36:04.486 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:36:04.485+0000 7f130fa00640 1 -- 172.21.15.39:0/3525538840 >> 172.21.15.39:0/3525538840 conn(0x7f13080fd8b0 msgr2=0x7f13080fec50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:36:04.486 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:36:04.485+0000 7f130fa00640 1 -- 172.21.15.39:0/3525538840 shutdown_connections 2024-09-12T02:36:04.486 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:36:04.485+0000 7f130fa00640 1 -- 172.21.15.39:0/3525538840 wait complete. 2024-09-12T02:36:04.853 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 02:36:04 smithi039 ceph-mon[30515]: pgmap v332: 129 pgs: 129 active+clean; 608 KiB data, 347 MiB used, 1.0 TiB / 1.0 TiB avail; 7.9 KiB/s rd, 6.5 KiB/s wr, 23 op/s 2024-09-12T02:36:05.005 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 02:36:04 smithi039 ceph-mon[30515]: from='mgr.14150 172.21.15.39:0/408627207' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-12T02:36:05.005 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 02:36:04 smithi039 ceph-mon[30515]: from='mgr.14150 172.21.15.39:0/408627207' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-12T02:36:05.005 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 02:36:04 smithi039 ceph-mon[30515]: from='mgr.14150 172.21.15.39:0/408627207' entity='mgr.x' 2024-09-12T02:36:05.014 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 12 02:36:04 smithi172 ceph-mon[35609]: pgmap v332: 129 pgs: 129 active+clean; 608 KiB data, 347 MiB used, 1.0 TiB / 1.0 TiB avail; 7.9 KiB/s rd, 6.5 KiB/s wr, 23 op/s 2024-09-12T02:36:05.014 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 12 02:36:04 smithi172 ceph-mon[35609]: from='mgr.14150 172.21.15.39:0/408627207' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-12T02:36:05.014 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 12 02:36:04 smithi172 ceph-mon[35609]: from='mgr.14150 172.21.15.39:0/408627207' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-12T02:36:05.014 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 12 02:36:04 smithi172 ceph-mon[35609]: from='mgr.14150 172.21.15.39:0/408627207' entity='mgr.x' 2024-09-12T02:36:05.199 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 12 02:36:04 smithi044 ceph-mon[35411]: pgmap v332: 129 pgs: 129 active+clean; 608 KiB data, 347 MiB used, 1.0 TiB / 1.0 TiB avail; 7.9 KiB/s rd, 6.5 KiB/s wr, 23 op/s 2024-09-12T02:36:05.199 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 12 02:36:04 smithi044 ceph-mon[35411]: from='mgr.14150 172.21.15.39:0/408627207' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-12T02:36:05.199 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 12 02:36:04 smithi044 ceph-mon[35411]: from='mgr.14150 172.21.15.39:0/408627207' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-12T02:36:05.199 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 12 02:36:04 smithi044 ceph-mon[35411]: from='mgr.14150 172.21.15.39:0/408627207' entity='mgr.x' 2024-09-12T02:36:05.338 DEBUG:teuthology.orchestra.run.smithi039:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc shell --fsid 4954ed46-70ae-11ef-bcea-c7b262605968 -- ceph fs dump --format=json 2024-09-12T02:36:05.732 INFO:teuthology.orchestra.run.smithi039.stderr:Inferring config /var/lib/ceph/4954ed46-70ae-11ef-bcea-c7b262605968/mon.a/config 2024-09-12T02:36:06.013 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 12 02:36:05 smithi172 ceph-mon[35609]: from='client.14721 -' entity='client.admin' cmd=[{"prefix": "fs subvolume getpath", "vol_name": "cephfs", "group_name": "qa", "sub_name": "sv_1", "target": ["mon-mgr", ""]}]: dispatch 2024-09-12T02:36:06.058 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 02:36:05 smithi039 ceph-mon[30515]: from='client.14721 -' entity='client.admin' cmd=[{"prefix": "fs subvolume getpath", "vol_name": "cephfs", "group_name": "qa", "sub_name": "sv_1", "target": ["mon-mgr", ""]}]: dispatch 2024-09-12T02:36:06.198 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 12 02:36:05 smithi044 ceph-mon[35411]: from='client.14721 -' entity='client.admin' cmd=[{"prefix": "fs subvolume getpath", "vol_name": "cephfs", "group_name": "qa", "sub_name": "sv_1", "target": ["mon-mgr", ""]}]: dispatch 2024-09-12T02:36:06.326 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:36:06.324+0000 7f3f58e00640 1 -- 172.21.15.39:0/3455257528 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f3f54109120 msgr2=0x7f3f54110ca0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:36:06.326 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:36:06.324+0000 7f3f58e00640 1 --2- 172.21.15.39:0/3455257528 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f3f54109120 0x7f3f54110ca0 secure :-1 s=READY pgs=185 cs=0 l=1 rev1=1 crypto rx=0x7f3f4c009ca0 tx=0x7f3f4c02a8c0 comp rx=0 tx=0).stop 2024-09-12T02:36:06.326 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:36:06.324+0000 7f3f58e00640 1 -- 172.21.15.39:0/3455257528 shutdown_connections 2024-09-12T02:36:06.326 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:36:06.324+0000 7f3f58e00640 1 --2- 172.21.15.39:0/3455257528 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f3f54109120 0x7f3f54110ca0 unknown :-1 s=CLOSED pgs=185 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:36:06.326 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:36:06.324+0000 7f3f58e00640 1 --2- 172.21.15.39:0/3455257528 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f3f541049a0 0x7f3f541089f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:36:06.326 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:36:06.324+0000 7f3f58e00640 1 --2- 172.21.15.39:0/3455257528 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f3f54103ff0 0x7f3f541043d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:36:06.326 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:36:06.324+0000 7f3f58e00640 1 -- 172.21.15.39:0/3455257528 >> 172.21.15.39:0/3455257528 conn(0x7f3f540ffa90 msgr2=0x7f3f54101eb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:36:06.326 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:36:06.324+0000 7f3f58e00640 1 -- 172.21.15.39:0/3455257528 shutdown_connections 2024-09-12T02:36:06.326 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:36:06.324+0000 7f3f58e00640 1 -- 172.21.15.39:0/3455257528 wait complete. 2024-09-12T02:36:06.326 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:36:06.325+0000 7f3f58e00640 1 Processor -- start 2024-09-12T02:36:06.326 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:36:06.325+0000 7f3f58e00640 1 -- start start 2024-09-12T02:36:06.328 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:36:06.326+0000 7f3f58e00640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f3f54103ff0 0x7f3f5419a590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:36:06.328 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:36:06.326+0000 7f3f58e00640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f3f541049a0 0x7f3f5419aad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:36:06.328 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:36:06.326+0000 7f3f58e00640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f3f54109120 0x7f3f5419ee60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:36:06.328 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:36:06.326+0000 7f3f58e00640 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 -- 0x7f3f54114130 con 0x7f3f541049a0 2024-09-12T02:36:06.328 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:36:06.326+0000 7f3f58e00640 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x7f3f54113fb0 con 0x7f3f54103ff0 2024-09-12T02:36:06.328 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:36:06.326+0000 7f3f58e00640 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7f3f541142b0 con 0x7f3f54109120 2024-09-12T02:36:06.328 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:36:06.326+0000 7f3f51e00640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f3f54103ff0 0x7f3f5419a590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:36:06.329 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:36:06.326+0000 7f3f4be00640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f3f541049a0 0x7f3f5419aad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:36:06.329 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:36:06.326+0000 7f3f51e00640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f3f54103ff0 0x7f3f5419a590 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.39:59940/0 (socket says 172.21.15.39:59940) 2024-09-12T02:36:06.329 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:36:06.326+0000 7f3f51e00640 1 -- 172.21.15.39:0/1607718752 learned_addr learned my addr 172.21.15.39:0/1607718752 (peer_addr_for_me v2:172.21.15.39:0/0) 2024-09-12T02:36:06.329 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:36:06.326+0000 7f3f52800640 1 --2- 172.21.15.39:0/1607718752 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f3f54109120 0x7f3f5419ee60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:36:06.329 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:36:06.326+0000 7f3f51e00640 1 -- 172.21.15.39:0/1607718752 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f3f54109120 msgr2=0x7f3f5419ee60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:36:06.329 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:36:06.326+0000 7f3f51e00640 1 --2- 172.21.15.39:0/1607718752 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f3f54109120 0x7f3f5419ee60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:36:06.329 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:36:06.326+0000 7f3f51e00640 1 -- 172.21.15.39:0/1607718752 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f3f541049a0 msgr2=0x7f3f5419aad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:36:06.329 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:36:06.326+0000 7f3f51e00640 1 --2- 172.21.15.39:0/1607718752 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f3f541049a0 0x7f3f5419aad0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:36:06.329 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:36:06.326+0000 7f3f51e00640 1 -- 172.21.15.39:0/1607718752 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3f5419f540 con 0x7f3f54103ff0 2024-09-12T02:36:06.329 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:36:06.327+0000 7f3f51e00640 1 --2- 172.21.15.39:0/1607718752 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f3f54103ff0 0x7f3f5419a590 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7f3f4400e9f0 tx=0x7f3f4400eeb0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:36:06.329 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:36:06.327+0000 7f3f4aa00640 1 -- 172.21.15.39:0/1607718752 <== mon.2 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3f4400cd80 con 0x7f3f54103ff0 2024-09-12T02:36:06.329 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:36:06.327+0000 7f3f58e00640 1 -- 172.21.15.39:0/1607718752 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f3f5419f830 con 0x7f3f54103ff0 2024-09-12T02:36:06.329 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:36:06.327+0000 7f3f4aa00640 1 -- 172.21.15.39:0/1607718752 <== mon.2 v2:172.21.15.44:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f3f44010910 con 0x7f3f54103ff0 2024-09-12T02:36:06.330 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:36:06.327+0000 7f3f4aa00640 1 -- 172.21.15.39:0/1607718752 <== mon.2 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3f440188f0 con 0x7f3f54103ff0 2024-09-12T02:36:06.330 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:36:06.327+0000 7f3f58e00640 1 -- 172.21.15.39:0/1607718752 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f3f541a7110 con 0x7f3f54103ff0 2024-09-12T02:36:06.330 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:36:06.328+0000 7f3f58e00640 1 -- 172.21.15.39:0/1607718752 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f3f541043d0 con 0x7f3f54103ff0 2024-09-12T02:36:06.331 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:36:06.330+0000 7f3f4aa00640 1 -- 172.21.15.39:0/1607718752 <== mon.2 v2:172.21.15.44:3300/0 4 ==== mgrmap(e 17) ==== 137884+0+0 (secure 0 0 0) 0x7f3f44010ac0 con 0x7f3f54103ff0 2024-09-12T02:36:06.332 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:36:06.331+0000 7f3f4aa00640 1 --2- 172.21.15.39:0/1607718752 >> [v2:172.21.15.39:6800/1725006999,v1:172.21.15.39:6801/1725006999] conn(0x7f3f380a2c10 0x7f3f380a50d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:36:06.332 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:36:06.332+0000 7f3f4aa00640 1 -- 172.21.15.39:0/1607718752 <== mon.2 v2:172.21.15.44:3300/0 5 ==== osd_map(93..93 src has 1..93) ==== 9092+0+0 (secure 0 0 0) 0x7f3f440cfd20 con 0x7f3f54103ff0 2024-09-12T02:36:06.332 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:36:06.332+0000 7f3f4be00640 1 --2- 172.21.15.39:0/1607718752 >> [v2:172.21.15.39:6800/1725006999,v1:172.21.15.39:6801/1725006999] conn(0x7f3f380a2c10 0x7f3f380a50d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:36:06.333 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:36:06.332+0000 7f3f4be00640 1 --2- 172.21.15.39:0/1607718752 >> [v2:172.21.15.39:6800/1725006999,v1:172.21.15.39:6801/1725006999] conn(0x7f3f380a2c10 0x7f3f380a50d0 secure :-1 s=READY pgs=171 cs=0 l=1 rev1=1 crypto rx=0x7f3f5410aa90 tx=0x7f3f3c005f90 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:36:06.334 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:36:06.334+0000 7f3f4aa00640 1 -- 172.21.15.39:0/1607718752 <== mon.2 v2:172.21.15.44:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7f3f4409c110 con 0x7f3f54103ff0 2024-09-12T02:36:06.559 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:36:06.558+0000 7f3f58e00640 1 -- 172.21.15.39:0/1607718752 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f3f5419b8f0 con 0x7f3f54103ff0 2024-09-12T02:36:06.560 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:36:06.559+0000 7f3f4aa00640 1 -- 172.21.15.39:0/1607718752 <== mon.2 v2:172.21.15.44:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 28 v28) ==== 94+0+11975 (secure 0 0 0) 0x7f3f440a0410 con 0x7f3f54103ff0 2024-09-12T02:36:06.560 INFO:teuthology.orchestra.run.smithi039.stdout: 2024-09-12T02:36:06.561 INFO:teuthology.orchestra.run.smithi039.stdout:{"epoch":28,"btime":"2024-09-12T02:35:53:793149+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14451,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.39:6835/2325642381","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6834","nonce":2325642381},{"type":"v1","addr":"172.21.15.39:6835","nonce":2325642381}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14511,"name":"g","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.39:6839/936905514","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6838","nonce":936905514},{"type":"v1","addr":"172.21.15.39:6839","nonce":936905514}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":11}],"filesystems":[{"mdsmap":{"epoch":28,"flags":50,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-09-12T02:35:03.522182+0000","modified":"2024-09-12T02:35:53.762825+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":5,"in":[0,1,2,3,4],"up":{"mds_0":24515,"mds_1":24499,"mds_2":24484,"mds_3":24482,"mds_4":24472},"failed":[],"damaged":[],"stopped":[],"info":{"gid_14523":{"gid":14523,"name":"a","rank":4,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.39:6841/2829712180","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6840","nonce":2829712180},{"type":"v1","addr":"172.21.15.39:6841","nonce":2829712180}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24422":{"gid":24422,"name":"k","rank":3,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.44:6833/2359724364","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6832","nonce":2359724364},{"type":"v1","addr":"172.21.15.44:6833","nonce":2359724364}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24430":{"gid":24430,"name":"l","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.172:6833/3232434105","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6832","nonce":3232434105},{"type":"v1","addr":"172.21.15.172:6833","nonce":3232434105}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24446":{"gid":24446,"name":"d","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.39:6837/2743237008","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6836","nonce":2743237008},{"type":"v1","addr":"172.21.15.39:6837","nonce":2743237008}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24458":{"gid":24458,"name":"e","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.44:6835/4063842354","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6834","nonce":4063842354},{"type":"v1","addr":"172.21.15.44:6835","nonce":4063842354}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24472":{"gid":24472,"name":"f","rank":4,"incarnation":26,"state":"up:active","state_seq":21,"addr":"172.21.15.172:6835/3274676014","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6834","nonce":3274676014},{"type":"v1","addr":"172.21.15.172:6835","nonce":3274676014}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24482":{"gid":24482,"name":"h","rank":3,"incarnation":24,"state":"up:active","state_seq":19,"addr":"172.21.15.44:6837/1501493978","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6836","nonce":1501493978},{"type":"v1","addr":"172.21.15.44:6837","nonce":1501493978}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24484":{"gid":24484,"name":"c","rank":2,"incarnation":22,"state":"up:active","state_seq":20,"addr":"172.21.15.172:6837/493506747","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6836","nonce":493506747},{"type":"v1","addr":"172.21.15.172:6837","nonce":493506747}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24499":{"gid":24499,"name":"i","rank":1,"incarnation":20,"state":"up:active","state_seq":18,"addr":"172.21.15.172:6839/3742537097","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6838","nonce":3742537097},{"type":"v1","addr":"172.21.15.172:6839","nonce":3742537097}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24515":{"gid":24515,"name":"b","rank":0,"incarnation":14,"state":"up:active","state_seq":5,"addr":"172.21.15.44:6839/2556532723","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6838","nonce":2556532723},{"type":"v1","addr":"172.21.15.44:6839","nonce":2556532723}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":24515,"qdb_cluster":[24515,24499,24484,24482,24472]},"id":1}]} 2024-09-12T02:36:06.561 INFO:teuthology.orchestra.run.smithi039.stderr:dumped fsmap epoch 28 2024-09-12T02:36:06.563 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:36:06.562+0000 7f3f58e00640 1 -- 172.21.15.39:0/1607718752 >> [v2:172.21.15.39:6800/1725006999,v1:172.21.15.39:6801/1725006999] conn(0x7f3f380a2c10 msgr2=0x7f3f380a50d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:36:06.563 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:36:06.562+0000 7f3f58e00640 1 --2- 172.21.15.39:0/1607718752 >> [v2:172.21.15.39:6800/1725006999,v1:172.21.15.39:6801/1725006999] conn(0x7f3f380a2c10 0x7f3f380a50d0 secure :-1 s=READY pgs=171 cs=0 l=1 rev1=1 crypto rx=0x7f3f5410aa90 tx=0x7f3f3c005f90 comp rx=0 tx=0).stop 2024-09-12T02:36:06.563 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:36:06.562+0000 7f3f58e00640 1 -- 172.21.15.39:0/1607718752 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f3f54103ff0 msgr2=0x7f3f5419a590 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:36:06.563 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:36:06.562+0000 7f3f58e00640 1 --2- 172.21.15.39:0/1607718752 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f3f54103ff0 0x7f3f5419a590 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7f3f4400e9f0 tx=0x7f3f4400eeb0 comp rx=0 tx=0).stop 2024-09-12T02:36:06.563 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:36:06.562+0000 7f3f58e00640 1 -- 172.21.15.39:0/1607718752 shutdown_connections 2024-09-12T02:36:06.563 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:36:06.562+0000 7f3f58e00640 1 --2- 172.21.15.39:0/1607718752 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f3f54109120 0x7f3f5419ee60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:36:06.563 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:36:06.562+0000 7f3f58e00640 1 --2- 172.21.15.39:0/1607718752 >> [v2:172.21.15.39:6800/1725006999,v1:172.21.15.39:6801/1725006999] conn(0x7f3f380a2c10 0x7f3f380a50d0 unknown :-1 s=CLOSED pgs=171 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:36:06.563 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:36:06.562+0000 7f3f58e00640 1 --2- 172.21.15.39:0/1607718752 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f3f541049a0 0x7f3f5419aad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:36:06.563 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:36:06.562+0000 7f3f58e00640 1 --2- 172.21.15.39:0/1607718752 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f3f54103ff0 0x7f3f5419a590 unknown :-1 s=CLOSED pgs=85 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:36:06.563 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:36:06.562+0000 7f3f58e00640 1 -- 172.21.15.39:0/1607718752 >> 172.21.15.39:0/1607718752 conn(0x7f3f540ffa90 msgr2=0x7f3f54101ea0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:36:06.563 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:36:06.562+0000 7f3f58e00640 1 -- 172.21.15.39:0/1607718752 shutdown_connections 2024-09-12T02:36:06.564 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:36:06.562+0000 7f3f58e00640 1 -- 172.21.15.39:0/1607718752 wait complete. 2024-09-12T02:36:06.849 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 02:36:06 smithi039 ceph-mon[30515]: pgmap v333: 129 pgs: 129 active+clean; 628 KiB data, 347 MiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 8.4 KiB/s wr, 27 op/s 2024-09-12T02:36:06.850 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 02:36:06 smithi039 ceph-mon[30515]: from='client.? 172.21.15.39:0/1607718752' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-12T02:36:07.013 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 12 02:36:06 smithi172 ceph-mon[35609]: pgmap v333: 129 pgs: 129 active+clean; 628 KiB data, 347 MiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 8.4 KiB/s wr, 27 op/s 2024-09-12T02:36:07.014 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 12 02:36:06 smithi172 ceph-mon[35609]: from='client.? 172.21.15.39:0/1607718752' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-12T02:36:07.198 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 12 02:36:06 smithi044 ceph-mon[35411]: pgmap v333: 129 pgs: 129 active+clean; 628 KiB data, 347 MiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 8.4 KiB/s wr, 27 op/s 2024-09-12T02:36:07.198 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 12 02:36:06 smithi044 ceph-mon[35411]: from='client.? 172.21.15.39:0/1607718752' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-12T02:36:07.395 DEBUG:teuthology.orchestra.run.smithi039:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc shell --fsid 4954ed46-70ae-11ef-bcea-c7b262605968 -- ceph osd dump --format=json 2024-09-12T02:36:07.775 INFO:teuthology.orchestra.run.smithi039.stderr:Inferring config /var/lib/ceph/4954ed46-70ae-11ef-bcea-c7b262605968/mon.a/config 2024-09-12T02:36:08.358 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:36:08.357+0000 7fd15ec00640 1 -- 172.21.15.39:0/635054422 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fd158109120 msgr2=0x7fd158110ca0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:36:08.358 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:36:08.357+0000 7fd15ec00640 1 --2- 172.21.15.39:0/635054422 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fd158109120 0x7fd158110ca0 secure :-1 s=READY pgs=186 cs=0 l=1 rev1=1 crypto rx=0x7fd150009be0 tx=0x7fd15002a6c0 comp rx=0 tx=0).stop 2024-09-12T02:36:08.358 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:36:08.357+0000 7fd15ec00640 1 -- 172.21.15.39:0/635054422 shutdown_connections 2024-09-12T02:36:08.358 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:36:08.357+0000 7fd15ec00640 1 --2- 172.21.15.39:0/635054422 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fd158109120 0x7fd158110ca0 unknown :-1 s=CLOSED pgs=186 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:36:08.358 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:36:08.357+0000 7fd15ec00640 1 --2- 172.21.15.39:0/635054422 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fd1581049a0 0x7fd1581089f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:36:08.358 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:36:08.357+0000 7fd15ec00640 1 --2- 172.21.15.39:0/635054422 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fd158103ff0 0x7fd1581043d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:36:08.359 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:36:08.357+0000 7fd15ec00640 1 -- 172.21.15.39:0/635054422 >> 172.21.15.39:0/635054422 conn(0x7fd1580ffa90 msgr2=0x7fd158101eb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:36:08.359 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:36:08.357+0000 7fd15ec00640 1 -- 172.21.15.39:0/635054422 shutdown_connections 2024-09-12T02:36:08.359 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:36:08.357+0000 7fd15ec00640 1 -- 172.21.15.39:0/635054422 wait complete. 2024-09-12T02:36:08.360 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:36:08.358+0000 7fd15ec00640 1 Processor -- start 2024-09-12T02:36:08.360 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:36:08.358+0000 7fd15ec00640 1 -- start start 2024-09-12T02:36:08.360 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:36:08.358+0000 7fd15ec00640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fd158103ff0 0x7fd15819a590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:36:08.360 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:36:08.358+0000 7fd15ec00640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fd1581049a0 0x7fd15819aad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:36:08.360 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:36:08.359+0000 7fd15ec00640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fd158109120 0x7fd15819ee60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:36:08.361 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:36:08.359+0000 7fd15ec00640 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 -- 0x7fd158114130 con 0x7fd1581049a0 2024-09-12T02:36:08.361 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:36:08.359+0000 7fd15ec00640 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x7fd158113fb0 con 0x7fd158103ff0 2024-09-12T02:36:08.361 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:36:08.359+0000 7fd15ec00640 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7fd1581142b0 con 0x7fd158109120 2024-09-12T02:36:08.361 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:36:08.359+0000 7fd14fe00640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fd1581049a0 0x7fd15819aad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:36:08.361 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:36:08.359+0000 7fd157e00640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fd158103ff0 0x7fd15819a590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:36:08.361 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:36:08.359+0000 7fd14fe00640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fd1581049a0 0x7fd15819aad0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.39:3300/0 says I am v2:172.21.15.39:40356/0 (socket says 172.21.15.39:40356) 2024-09-12T02:36:08.362 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:36:08.359+0000 7fd157e00640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fd158103ff0 0x7fd15819a590 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.39:49756/0 (socket says 172.21.15.39:49756) 2024-09-12T02:36:08.362 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:36:08.359+0000 7fd14fe00640 1 -- 172.21.15.39:0/1793217682 learned_addr learned my addr 172.21.15.39:0/1793217682 (peer_addr_for_me v2:172.21.15.39:0/0) 2024-09-12T02:36:08.362 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:36:08.359+0000 7fd15cc00640 1 --2- 172.21.15.39:0/1793217682 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fd158109120 0x7fd15819ee60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:36:08.362 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:36:08.359+0000 7fd14fe00640 1 -- 172.21.15.39:0/1793217682 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fd158109120 msgr2=0x7fd15819ee60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:36:08.362 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:36:08.359+0000 7fd14fe00640 1 --2- 172.21.15.39:0/1793217682 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fd158109120 0x7fd15819ee60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:36:08.363 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:36:08.359+0000 7fd14fe00640 1 -- 172.21.15.39:0/1793217682 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fd158103ff0 msgr2=0x7fd15819a590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:36:08.363 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:36:08.359+0000 7fd14fe00640 1 --2- 172.21.15.39:0/1793217682 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fd158103ff0 0x7fd15819a590 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:36:08.363 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:36:08.359+0000 7fd14fe00640 1 -- 172.21.15.39:0/1793217682 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd15819f540 con 0x7fd1581049a0 2024-09-12T02:36:08.363 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:36:08.359+0000 7fd157e00640 1 --2- 172.21.15.39:0/1793217682 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fd158103ff0 0x7fd15819a590 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-12T02:36:08.363 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:36:08.360+0000 7fd14fe00640 1 --2- 172.21.15.39:0/1793217682 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fd1581049a0 0x7fd15819aad0 secure :-1 s=READY pgs=187 cs=0 l=1 rev1=1 crypto rx=0x7fd14000e9f0 tx=0x7fd14000eeb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:36:08.364 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:36:08.360+0000 7fd155600640 1 -- 172.21.15.39:0/1793217682 <== mon.0 v2:172.21.15.39:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd14000cd80 con 0x7fd1581049a0 2024-09-12T02:36:08.364 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:36:08.360+0000 7fd15ec00640 1 -- 172.21.15.39:0/1793217682 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd15819f830 con 0x7fd1581049a0 2024-09-12T02:36:08.364 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:36:08.360+0000 7fd155600640 1 -- 172.21.15.39:0/1793217682 <== mon.0 v2:172.21.15.39:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fd140010910 con 0x7fd1581049a0 2024-09-12T02:36:08.364 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:36:08.360+0000 7fd15ec00640 1 -- 172.21.15.39:0/1793217682 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd1581a7110 con 0x7fd1581049a0 2024-09-12T02:36:08.364 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:36:08.360+0000 7fd155600640 1 -- 172.21.15.39:0/1793217682 <== mon.0 v2:172.21.15.39:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd140018990 con 0x7fd1581049a0 2024-09-12T02:36:08.364 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:36:08.361+0000 7fd15ec00640 1 -- 172.21.15.39:0/1793217682 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fd134005290 con 0x7fd1581049a0 2024-09-12T02:36:08.364 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:36:08.363+0000 7fd155600640 1 -- 172.21.15.39:0/1793217682 <== mon.0 v2:172.21.15.39:3300/0 4 ==== mgrmap(e 17) ==== 137884+0+0 (secure 0 0 0) 0x7fd140018b30 con 0x7fd1581049a0 2024-09-12T02:36:08.366 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:36:08.365+0000 7fd155600640 1 --2- 172.21.15.39:0/1793217682 >> [v2:172.21.15.39:6800/1725006999,v1:172.21.15.39:6801/1725006999] conn(0x7fd13c0a2c10 0x7fd13c0a50d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:36:08.366 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:36:08.365+0000 7fd155600640 1 -- 172.21.15.39:0/1793217682 <== mon.0 v2:172.21.15.39:3300/0 5 ==== osd_map(93..93 src has 1..93) ==== 9092+0+0 (secure 0 0 0) 0x7fd1400cf6c0 con 0x7fd1581049a0 2024-09-12T02:36:08.366 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:36:08.365+0000 7fd157e00640 1 --2- 172.21.15.39:0/1793217682 >> [v2:172.21.15.39:6800/1725006999,v1:172.21.15.39:6801/1725006999] conn(0x7fd13c0a2c10 0x7fd13c0a50d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:36:08.366 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:36:08.366+0000 7fd157e00640 1 --2- 172.21.15.39:0/1793217682 >> [v2:172.21.15.39:6800/1725006999,v1:172.21.15.39:6801/1725006999] conn(0x7fd13c0a2c10 0x7fd13c0a50d0 secure :-1 s=READY pgs=172 cs=0 l=1 rev1=1 crypto rx=0x7fd1480096c0 tx=0x7fd148009260 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:36:08.369 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:36:08.368+0000 7fd155600640 1 -- 172.21.15.39:0/1793217682 <== mon.0 v2:172.21.15.39:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7fd14009bab0 con 0x7fd1581049a0 2024-09-12T02:36:08.559 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:36:08.559+0000 7fd15ec00640 1 -- 172.21.15.39:0/1793217682 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7fd134005850 con 0x7fd1581049a0 2024-09-12T02:36:08.561 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:36:08.561+0000 7fd155600640 1 -- 172.21.15.39:0/1793217682 <== mon.0 v2:172.21.15.39:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v93) ==== 74+0+24705 (secure 0 0 0) 0x7fd14009fdb0 con 0x7fd1581049a0 2024-09-12T02:36:08.562 INFO:teuthology.orchestra.run.smithi039.stdout: 2024-09-12T02:36:08.562 INFO:teuthology.orchestra.run.smithi039.stdout:{"epoch":93,"fsid":"4954ed46-70ae-11ef-bcea-c7b262605968","created":"2024-09-12T02:26:43.086467+0000","modified":"2024-09-12T02:35:46.720985+0000","last_up_change":"2024-09-12T02:34:08.626341+0000","last_in_change":"2024-09-12T02:33:45.553591+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":27,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":12,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-12T02:30:09.347905+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":12,"score_stable":12,"optimal_score":0.25,"raw_score_acting":3,"raw_score_stable":3,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-09-12T02:34:58.580872+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"84","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.8799999952316284,"score_stable":1.8799999952316284,"optimal_score":1,"raw_score_acting":1.8799999952316284,"raw_score_stable":1.8799999952316284,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-09-12T02:35:01.469805+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"84","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2024-09-12T02:35:11.088109+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"91","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"c967b48e-8a39-4797-871b-8b1b83d9472f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":87,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6802","nonce":2437586899},{"type":"v1","addr":"172.21.15.39:6803","nonce":2437586899}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6804","nonce":2437586899},{"type":"v1","addr":"172.21.15.39:6805","nonce":2437586899}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6808","nonce":2437586899},{"type":"v1","addr":"172.21.15.39:6809","nonce":2437586899}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6806","nonce":2437586899},{"type":"v1","addr":"172.21.15.39:6807","nonce":2437586899}]},"public_addr":"172.21.15.39:6803/2437586899","cluster_addr":"172.21.15.39:6805/2437586899","heartbeat_back_addr":"172.21.15.39:6809/2437586899","heartbeat_front_addr":"172.21.15.39:6807/2437586899","state":["exists","up"]},{"osd":1,"uuid":"30e1e4f4-1d50-4003-8978-cb183dca7fbb","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":87,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6800","nonce":2349287000},{"type":"v1","addr":"172.21.15.44:6801","nonce":2349287000}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6802","nonce":2349287000},{"type":"v1","addr":"172.21.15.44:6803","nonce":2349287000}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6806","nonce":2349287000},{"type":"v1","addr":"172.21.15.44:6807","nonce":2349287000}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6804","nonce":2349287000},{"type":"v1","addr":"172.21.15.44:6805","nonce":2349287000}]},"public_addr":"172.21.15.44:6801/2349287000","cluster_addr":"172.21.15.44:6803/2349287000","heartbeat_back_addr":"172.21.15.44:6807/2349287000","heartbeat_front_addr":"172.21.15.44:6805/2349287000","state":["exists","up"]},{"osd":2,"uuid":"a758803f-8668-4fc8-9417-b8d080cd9a7c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":18,"up_thru":87,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6800","nonce":1176898232},{"type":"v1","addr":"172.21.15.172:6801","nonce":1176898232}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6802","nonce":1176898232},{"type":"v1","addr":"172.21.15.172:6803","nonce":1176898232}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6806","nonce":1176898232},{"type":"v1","addr":"172.21.15.172:6807","nonce":1176898232}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6804","nonce":1176898232},{"type":"v1","addr":"172.21.15.172:6805","nonce":1176898232}]},"public_addr":"172.21.15.172:6801/1176898232","cluster_addr":"172.21.15.172:6803/1176898232","heartbeat_back_addr":"172.21.15.172:6807/1176898232","heartbeat_front_addr":"172.21.15.172:6805/1176898232","state":["exists","up"]},{"osd":3,"uuid":"8b256567-7efe-429c-bc4c-80e93228f139","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":26,"up_thru":87,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6810","nonce":2013565859},{"type":"v1","addr":"172.21.15.39:6811","nonce":2013565859}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6812","nonce":2013565859},{"type":"v1","addr":"172.21.15.39:6813","nonce":2013565859}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6816","nonce":2013565859},{"type":"v1","addr":"172.21.15.39:6817","nonce":2013565859}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6814","nonce":2013565859},{"type":"v1","addr":"172.21.15.39:6815","nonce":2013565859}]},"public_addr":"172.21.15.39:6811/2013565859","cluster_addr":"172.21.15.39:6813/2013565859","heartbeat_back_addr":"172.21.15.39:6817/2013565859","heartbeat_front_addr":"172.21.15.39:6815/2013565859","state":["exists","up"]},{"osd":4,"uuid":"e86b6756-e2b3-49fe-9b87-1a2b015bb17a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":33,"up_thru":87,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6808","nonce":3663639110},{"type":"v1","addr":"172.21.15.44:6809","nonce":3663639110}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6810","nonce":3663639110},{"type":"v1","addr":"172.21.15.44:6811","nonce":3663639110}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6814","nonce":3663639110},{"type":"v1","addr":"172.21.15.44:6815","nonce":3663639110}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6812","nonce":3663639110},{"type":"v1","addr":"172.21.15.44:6813","nonce":3663639110}]},"public_addr":"172.21.15.44:6809/3663639110","cluster_addr":"172.21.15.44:6811/3663639110","heartbeat_back_addr":"172.21.15.44:6815/3663639110","heartbeat_front_addr":"172.21.15.44:6813/3663639110","state":["exists","up"]},{"osd":5,"uuid":"9c907c92-b323-48e7-99ad-ec9756d26312","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":38,"up_thru":92,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6808","nonce":998885347},{"type":"v1","addr":"172.21.15.172:6809","nonce":998885347}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6810","nonce":998885347},{"type":"v1","addr":"172.21.15.172:6811","nonce":998885347}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6814","nonce":998885347},{"type":"v1","addr":"172.21.15.172:6815","nonce":998885347}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6812","nonce":998885347},{"type":"v1","addr":"172.21.15.172:6813","nonce":998885347}]},"public_addr":"172.21.15.172:6809/998885347","cluster_addr":"172.21.15.172:6811/998885347","heartbeat_back_addr":"172.21.15.172:6815/998885347","heartbeat_front_addr":"172.21.15.172:6813/998885347","state":["exists","up"]},{"osd":6,"uuid":"1fcb9bb2-6f4b-4d97-a401-aeb6a9706613","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":45,"up_thru":92,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6818","nonce":2569059542},{"type":"v1","addr":"172.21.15.39:6819","nonce":2569059542}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6820","nonce":2569059542},{"type":"v1","addr":"172.21.15.39:6821","nonce":2569059542}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6824","nonce":2569059542},{"type":"v1","addr":"172.21.15.39:6825","nonce":2569059542}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6822","nonce":2569059542},{"type":"v1","addr":"172.21.15.39:6823","nonce":2569059542}]},"public_addr":"172.21.15.39:6819/2569059542","cluster_addr":"172.21.15.39:6821/2569059542","heartbeat_back_addr":"172.21.15.39:6825/2569059542","heartbeat_front_addr":"172.21.15.39:6823/2569059542","state":["exists","up"]},{"osd":7,"uuid":"59e0caf9-8ce5-4161-8875-84862eba743e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":50,"up_thru":87,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6816","nonce":709635079},{"type":"v1","addr":"172.21.15.44:6817","nonce":709635079}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6818","nonce":709635079},{"type":"v1","addr":"172.21.15.44:6819","nonce":709635079}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6822","nonce":709635079},{"type":"v1","addr":"172.21.15.44:6823","nonce":709635079}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6820","nonce":709635079},{"type":"v1","addr":"172.21.15.44:6821","nonce":709635079}]},"public_addr":"172.21.15.44:6817/709635079","cluster_addr":"172.21.15.44:6819/709635079","heartbeat_back_addr":"172.21.15.44:6823/709635079","heartbeat_front_addr":"172.21.15.44:6821/709635079","state":["exists","up"]},{"osd":8,"uuid":"2f6fb5c7-86cc-43eb-bdfb-45a69316937e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":57,"up_thru":92,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6816","nonce":1162792895},{"type":"v1","addr":"172.21.15.172:6817","nonce":1162792895}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6818","nonce":1162792895},{"type":"v1","addr":"172.21.15.172:6819","nonce":1162792895}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6822","nonce":1162792895},{"type":"v1","addr":"172.21.15.172:6823","nonce":1162792895}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6820","nonce":1162792895},{"type":"v1","addr":"172.21.15.172:6821","nonce":1162792895}]},"public_addr":"172.21.15.172:6817/1162792895","cluster_addr":"172.21.15.172:6819/1162792895","heartbeat_back_addr":"172.21.15.172:6823/1162792895","heartbeat_front_addr":"172.21.15.172:6821/1162792895","state":["exists","up"]},{"osd":9,"uuid":"87e5dd9e-8191-4db6-83fa-cfff7c31e17e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":65,"up_thru":92,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6826","nonce":945860346},{"type":"v1","addr":"172.21.15.39:6827","nonce":945860346}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6828","nonce":945860346},{"type":"v1","addr":"172.21.15.39:6829","nonce":945860346}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6832","nonce":945860346},{"type":"v1","addr":"172.21.15.39:6833","nonce":945860346}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6830","nonce":945860346},{"type":"v1","addr":"172.21.15.39:6831","nonce":945860346}]},"public_addr":"172.21.15.39:6827/945860346","cluster_addr":"172.21.15.39:6829/945860346","heartbeat_back_addr":"172.21.15.39:6833/945860346","heartbeat_front_addr":"172.21.15.39:6831/945860346","state":["exists","up"]},{"osd":10,"uuid":"b55d8a00-850f-4910-a5bf-97d9ed545be7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":70,"up_thru":81,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6824","nonce":3899352344},{"type":"v1","addr":"172.21.15.44:6825","nonce":3899352344}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6826","nonce":3899352344},{"type":"v1","addr":"172.21.15.44:6827","nonce":3899352344}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6830","nonce":3899352344},{"type":"v1","addr":"172.21.15.44:6831","nonce":3899352344}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6828","nonce":3899352344},{"type":"v1","addr":"172.21.15.44:6829","nonce":3899352344}]},"public_addr":"172.21.15.44:6825/3899352344","cluster_addr":"172.21.15.44:6827/3899352344","heartbeat_back_addr":"172.21.15.44:6831/3899352344","heartbeat_front_addr":"172.21.15.44:6829/3899352344","state":["exists","up"]},{"osd":11,"uuid":"20cf5df1-5a80-4272-acc0-919c6a1da55a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":77,"up_thru":92,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6824","nonce":3627635035},{"type":"v1","addr":"172.21.15.172:6825","nonce":3627635035}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6826","nonce":3627635035},{"type":"v1","addr":"172.21.15.172:6827","nonce":3627635035}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6830","nonce":3627635035},{"type":"v1","addr":"172.21.15.172:6831","nonce":3627635035}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6828","nonce":3627635035},{"type":"v1","addr":"172.21.15.172:6829","nonce":3627635035}]},"public_addr":"172.21.15.172:6825/3627635035","cluster_addr":"172.21.15.172:6827/3627635035","heartbeat_back_addr":"172.21.15.172:6831/3627635035","heartbeat_front_addr":"172.21.15.172:6829/3627635035","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T02:29:15.367468+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T02:29:41.518207+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T02:30:06.004371+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T02:30:34.793371+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T02:31:00.878517+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T02:31:26.675956+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T02:31:55.950748+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T02:32:22.824017+0000","dead_epoch":0},{"osd":8,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T02:32:46.775880+0000","dead_epoch":0},{"osd":9,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T02:33:16.420347+0000","dead_epoch":0},{"osd":10,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T02:33:42.185837+0000","dead_epoch":0},{"osd":11,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T02:34:07.312555+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"2.0","mappings":[{"from":7,"to":11}]},{"pgid":"2.b","mappings":[{"from":2,"to":1}]},{"pgid":"2.10","mappings":[{"from":8,"to":11}]},{"pgid":"2.1b","mappings":[{"from":2,"to":4}]},{"pgid":"3.11","mappings":[{"from":4,"to":8}]},{"pgid":"3.24","mappings":[{"from":4,"to":9}]},{"pgid":"3.33","mappings":[{"from":5,"to":9}]},{"pgid":"3.34","mappings":[{"from":4,"to":9}]},{"pgid":"4.2","mappings":[{"from":9,"to":1}]},{"pgid":"4.6","mappings":[{"from":9,"to":11}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.39:6800/3152613618":"2024-09-13T02:27:44.717224+0000","172.21.15.39:0/2301206766":"2024-09-13T02:27:44.717224+0000","172.21.15.39:0/1941318538":"2024-09-13T02:27:44.717224+0000","172.21.15.39:0/1527429435":"2024-09-13T02:27:44.717224+0000","172.21.15.39:0/2913347539":"2024-09-13T02:27:16.531986+0000","172.21.15.39:0/2827440002":"2024-09-13T02:27:16.531986+0000","172.21.15.39:0/4075322467":"2024-09-13T02:27:16.531986+0000","172.21.15.39:6801/1074685700":"2024-09-13T02:27:16.531986+0000","172.21.15.39:6801/3152613618":"2024-09-13T02:27:44.717224+0000","172.21.15.39:6800/1074685700":"2024-09-13T02:27:16.531986+0000"},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-12T02:36:08.565 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:36:08.564+0000 7fd15ec00640 1 -- 172.21.15.39:0/1793217682 >> [v2:172.21.15.39:6800/1725006999,v1:172.21.15.39:6801/1725006999] conn(0x7fd13c0a2c10 msgr2=0x7fd13c0a50d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:36:08.566 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:36:08.564+0000 7fd15ec00640 1 --2- 172.21.15.39:0/1793217682 >> [v2:172.21.15.39:6800/1725006999,v1:172.21.15.39:6801/1725006999] conn(0x7fd13c0a2c10 0x7fd13c0a50d0 secure :-1 s=READY pgs=172 cs=0 l=1 rev1=1 crypto rx=0x7fd1480096c0 tx=0x7fd148009260 comp rx=0 tx=0).stop 2024-09-12T02:36:08.566 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:36:08.564+0000 7fd15ec00640 1 -- 172.21.15.39:0/1793217682 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fd1581049a0 msgr2=0x7fd15819aad0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:36:08.566 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:36:08.564+0000 7fd15ec00640 1 --2- 172.21.15.39:0/1793217682 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fd1581049a0 0x7fd15819aad0 secure :-1 s=READY pgs=187 cs=0 l=1 rev1=1 crypto rx=0x7fd14000e9f0 tx=0x7fd14000eeb0 comp rx=0 tx=0).stop 2024-09-12T02:36:08.566 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:36:08.564+0000 7fd15ec00640 1 -- 172.21.15.39:0/1793217682 shutdown_connections 2024-09-12T02:36:08.566 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:36:08.564+0000 7fd15ec00640 1 --2- 172.21.15.39:0/1793217682 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fd158109120 0x7fd15819ee60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:36:08.566 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:36:08.564+0000 7fd15ec00640 1 --2- 172.21.15.39:0/1793217682 >> [v2:172.21.15.39:6800/1725006999,v1:172.21.15.39:6801/1725006999] conn(0x7fd13c0a2c10 0x7fd13c0a50d0 unknown :-1 s=CLOSED pgs=172 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:36:08.566 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:36:08.564+0000 7fd15ec00640 1 --2- 172.21.15.39:0/1793217682 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fd1581049a0 0x7fd15819aad0 unknown :-1 s=CLOSED pgs=187 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:36:08.566 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:36:08.564+0000 7fd15ec00640 1 --2- 172.21.15.39:0/1793217682 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fd158103ff0 0x7fd15819a590 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:36:08.566 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:36:08.565+0000 7fd15ec00640 1 -- 172.21.15.39:0/1793217682 >> 172.21.15.39:0/1793217682 conn(0x7fd1580ffa90 msgr2=0x7fd158101ea0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:36:08.566 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:36:08.565+0000 7fd15ec00640 1 -- 172.21.15.39:0/1793217682 shutdown_connections 2024-09-12T02:36:08.566 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:36:08.565+0000 7fd15ec00640 1 -- 172.21.15.39:0/1793217682 wait complete. 2024-09-12T02:36:08.849 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 02:36:08 smithi039 ceph-mon[30515]: pgmap v334: 129 pgs: 129 active+clean; 628 KiB data, 347 MiB used, 1.0 TiB / 1.0 TiB avail; 7.9 KiB/s rd, 4.6 KiB/s wr, 12 op/s 2024-09-12T02:36:08.850 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 02:36:08 smithi039 ceph-mon[30515]: from='client.? 172.21.15.39:0/1793217682' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-09-12T02:36:09.013 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 12 02:36:08 smithi172 ceph-mon[35609]: pgmap v334: 129 pgs: 129 active+clean; 628 KiB data, 347 MiB used, 1.0 TiB / 1.0 TiB avail; 7.9 KiB/s rd, 4.6 KiB/s wr, 12 op/s 2024-09-12T02:36:09.014 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 12 02:36:08 smithi172 ceph-mon[35609]: from='client.? 172.21.15.39:0/1793217682' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-09-12T02:36:09.198 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 12 02:36:08 smithi044 ceph-mon[35411]: pgmap v334: 129 pgs: 129 active+clean; 628 KiB data, 347 MiB used, 1.0 TiB / 1.0 TiB avail; 7.9 KiB/s rd, 4.6 KiB/s wr, 12 op/s 2024-09-12T02:36:09.198 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 12 02:36:08 smithi044 ceph-mon[35411]: from='client.? 172.21.15.39:0/1793217682' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-09-12T02:36:09.362 INFO:tasks.cephadm.ceph_manager.ceph:waiting for clean 2024-09-12T02:36:09.362 DEBUG:teuthology.orchestra.run.smithi039:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc shell --fsid 4954ed46-70ae-11ef-bcea-c7b262605968 -- ceph pg dump --format=json 2024-09-12T02:36:09.739 INFO:teuthology.orchestra.run.smithi039.stderr:Inferring config /var/lib/ceph/4954ed46-70ae-11ef-bcea-c7b262605968/mon.a/config 2024-09-12T02:36:10.260 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:36:10.255+0000 7f722ea00640 1 -- 172.21.15.39:0/2056369557 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f7228101de0 msgr2=0x7f72281021c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:36:10.260 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:36:10.255+0000 7f722ea00640 1 --2- 172.21.15.39:0/2056369557 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f7228101de0 0x7f72281021c0 secure :-1 s=READY pgs=188 cs=0 l=1 rev1=1 crypto rx=0x7f7218009900 tx=0x7f721802a3f0 comp rx=0 tx=0).stop 2024-09-12T02:36:10.260 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:36:10.255+0000 7f722ea00640 1 -- 172.21.15.39:0/2056369557 shutdown_connections 2024-09-12T02:36:10.261 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:36:10.255+0000 7f722ea00640 1 --2- 172.21.15.39:0/2056369557 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f7228106f10 0x7f722810ea90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:36:10.261 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:36:10.255+0000 7f722ea00640 1 --2- 172.21.15.39:0/2056369557 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f7228102790 0x7f72281067e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:36:10.261 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:36:10.255+0000 7f722ea00640 1 --2- 172.21.15.39:0/2056369557 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f7228101de0 0x7f72281021c0 unknown :-1 s=CLOSED pgs=188 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:36:10.261 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:36:10.255+0000 7f722ea00640 1 -- 172.21.15.39:0/2056369557 >> 172.21.15.39:0/2056369557 conn(0x7f72280fd8c0 msgr2=0x7f72280ffce0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:36:10.261 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:36:10.255+0000 7f722ea00640 1 -- 172.21.15.39:0/2056369557 shutdown_connections 2024-09-12T02:36:10.261 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:36:10.255+0000 7f722ea00640 1 -- 172.21.15.39:0/2056369557 wait complete. 2024-09-12T02:36:10.261 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:36:10.256+0000 7f722ea00640 1 Processor -- start 2024-09-12T02:36:10.261 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:36:10.256+0000 7f722ea00640 1 -- start start 2024-09-12T02:36:10.261 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:36:10.256+0000 7f722ea00640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f7228101de0 0x7f722819a630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:36:10.261 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:36:10.256+0000 7f722ea00640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f7228102790 0x7f722819ab70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:36:10.261 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:36:10.256+0000 7f722ea00640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f7228106f10 0x7f722819ef00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:36:10.261 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:36:10.256+0000 7f722ea00640 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 -- 0x7f7228111fc0 con 0x7f7228106f10 2024-09-12T02:36:10.262 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:36:10.256+0000 7f722ea00640 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x7f7228111e40 con 0x7f7228101de0 2024-09-12T02:36:10.262 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:36:10.256+0000 7f722ea00640 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7f7228112140 con 0x7f7228102790 2024-09-12T02:36:10.262 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:36:10.257+0000 7f722ca00640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f7228106f10 0x7f722819ef00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:36:10.262 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:36:10.257+0000 7f722ca00640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f7228106f10 0x7f722819ef00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.39:3300/0 says I am v2:172.21.15.39:40382/0 (socket says 172.21.15.39:40382) 2024-09-12T02:36:10.262 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:36:10.257+0000 7f722ca00640 1 -- 172.21.15.39:0/2914960377 learned_addr learned my addr 172.21.15.39:0/2914960377 (peer_addr_for_me v2:172.21.15.39:0/0) 2024-09-12T02:36:10.262 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:36:10.257+0000 7f7227e00640 1 --2- 172.21.15.39:0/2914960377 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f7228101de0 0x7f722819a630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:36:10.262 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:36:10.257+0000 7f721fe00640 1 --2- 172.21.15.39:0/2914960377 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f7228102790 0x7f722819ab70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:36:10.262 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:36:10.257+0000 7f722ca00640 1 -- 172.21.15.39:0/2914960377 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f7228102790 msgr2=0x7f722819ab70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:36:10.262 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:36:10.257+0000 7f722ca00640 1 --2- 172.21.15.39:0/2914960377 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f7228102790 0x7f722819ab70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:36:10.262 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:36:10.257+0000 7f722ca00640 1 -- 172.21.15.39:0/2914960377 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f7228101de0 msgr2=0x7f722819a630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:36:10.262 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:36:10.257+0000 7f722ca00640 1 --2- 172.21.15.39:0/2914960377 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f7228101de0 0x7f722819a630 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:36:10.262 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:36:10.257+0000 7f722ca00640 1 -- 172.21.15.39:0/2914960377 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f722819f5e0 con 0x7f7228106f10 2024-09-12T02:36:10.262 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:36:10.258+0000 7f722ca00640 1 --2- 172.21.15.39:0/2914960377 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f7228106f10 0x7f722819ef00 secure :-1 s=READY pgs=189 cs=0 l=1 rev1=1 crypto rx=0x7f722000eb10 tx=0x7f722000c2d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:36:10.263 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:36:10.258+0000 7f7225600640 1 -- 172.21.15.39:0/2914960377 <== mon.0 v2:172.21.15.39:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7220004b20 con 0x7f7228106f10 2024-09-12T02:36:10.263 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:36:10.258+0000 7f7225600640 1 -- 172.21.15.39:0/2914960377 <== mon.0 v2:172.21.15.39:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f7220004cc0 con 0x7f7228106f10 2024-09-12T02:36:10.263 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:36:10.258+0000 7f7225600640 1 -- 172.21.15.39:0/2914960377 <== mon.0 v2:172.21.15.39:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7220010760 con 0x7f7228106f10 2024-09-12T02:36:10.263 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:36:10.258+0000 7f722ea00640 1 -- 172.21.15.39:0/2914960377 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f722819f8d0 con 0x7f7228106f10 2024-09-12T02:36:10.263 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:36:10.258+0000 7f722ea00640 1 -- 172.21.15.39:0/2914960377 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f72281a71b0 con 0x7f7228106f10 2024-09-12T02:36:10.263 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:36:10.259+0000 7f722ea00640 1 -- 172.21.15.39:0/2914960377 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f72281021c0 con 0x7f7228106f10 2024-09-12T02:36:10.264 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:36:10.261+0000 7f7225600640 1 -- 172.21.15.39:0/2914960377 <== mon.0 v2:172.21.15.39:3300/0 4 ==== mgrmap(e 17) ==== 137884+0+0 (secure 0 0 0) 0x7f7220005020 con 0x7f7228106f10 2024-09-12T02:36:10.264 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:36:10.262+0000 7f7225600640 1 --2- 172.21.15.39:0/2914960377 >> [v2:172.21.15.39:6800/1725006999,v1:172.21.15.39:6801/1725006999] conn(0x7f720c0a2c10 0x7f720c0a50d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:36:10.264 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:36:10.263+0000 7f7225600640 1 -- 172.21.15.39:0/2914960377 <== mon.0 v2:172.21.15.39:3300/0 5 ==== osd_map(93..93 src has 1..93) ==== 9092+0+0 (secure 0 0 0) 0x7f72200cfbf0 con 0x7f7228106f10 2024-09-12T02:36:10.264 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:36:10.263+0000 7f7227e00640 1 --2- 172.21.15.39:0/2914960377 >> [v2:172.21.15.39:6800/1725006999,v1:172.21.15.39:6801/1725006999] conn(0x7f720c0a2c10 0x7f720c0a50d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:36:10.264 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:36:10.264+0000 7f7227e00640 1 --2- 172.21.15.39:0/2914960377 >> [v2:172.21.15.39:6800/1725006999,v1:172.21.15.39:6801/1725006999] conn(0x7f720c0a2c10 0x7f720c0a50d0 secure :-1 s=READY pgs=173 cs=0 l=1 rev1=1 crypto rx=0x7f7218000c00 tx=0x7f7218005b50 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:36:10.267 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:36:10.266+0000 7f7225600640 1 -- 172.21.15.39:0/2914960377 <== mon.0 v2:172.21.15.39:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7f722009c630 con 0x7f7228106f10 2024-09-12T02:36:10.447 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:36:10.446+0000 7f722ea00640 1 -- 172.21.15.39:0/2914960377 --> [v2:172.21.15.39:6800/1725006999,v1:172.21.15.39:6801/1725006999] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7f72280febb0 con 0x7f720c0a2c10 2024-09-12T02:36:10.459 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:36:10.458+0000 7f7225600640 1 -- 172.21.15.39:0/2914960377 <== mgr.14150 v2:172.21.15.39:6800/1725006999 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+340392 (secure 0 0 0) 0x7f72280febb0 con 0x7f720c0a2c10 2024-09-12T02:36:10.464 INFO:teuthology.orchestra.run.smithi039.stdout: 2024-09-12T02:36:10.466 INFO:teuthology.orchestra.run.smithi039.stderr:dumped all 2024-09-12T02:36:10.469 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:36:10.463+0000 7f722ea00640 1 -- 172.21.15.39:0/2914960377 >> [v2:172.21.15.39:6800/1725006999,v1:172.21.15.39:6801/1725006999] conn(0x7f720c0a2c10 msgr2=0x7f720c0a50d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:36:10.469 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:36:10.463+0000 7f722ea00640 1 --2- 172.21.15.39:0/2914960377 >> [v2:172.21.15.39:6800/1725006999,v1:172.21.15.39:6801/1725006999] conn(0x7f720c0a2c10 0x7f720c0a50d0 secure :-1 s=READY pgs=173 cs=0 l=1 rev1=1 crypto rx=0x7f7218000c00 tx=0x7f7218005b50 comp rx=0 tx=0).stop 2024-09-12T02:36:10.469 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:36:10.463+0000 7f722ea00640 1 -- 172.21.15.39:0/2914960377 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f7228106f10 msgr2=0x7f722819ef00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:36:10.469 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:36:10.463+0000 7f722ea00640 1 --2- 172.21.15.39:0/2914960377 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f7228106f10 0x7f722819ef00 secure :-1 s=READY pgs=189 cs=0 l=1 rev1=1 crypto rx=0x7f722000eb10 tx=0x7f722000c2d0 comp rx=0 tx=0).stop 2024-09-12T02:36:10.469 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:36:10.464+0000 7f722ea00640 1 -- 172.21.15.39:0/2914960377 shutdown_connections 2024-09-12T02:36:10.469 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:36:10.464+0000 7f722ea00640 1 --2- 172.21.15.39:0/2914960377 >> [v2:172.21.15.39:6800/1725006999,v1:172.21.15.39:6801/1725006999] conn(0x7f720c0a2c10 0x7f720c0a50d0 unknown :-1 s=CLOSED pgs=173 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:36:10.469 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:36:10.464+0000 7f722ea00640 1 --2- 172.21.15.39:0/2914960377 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f7228106f10 0x7f722819ef00 unknown :-1 s=CLOSED pgs=189 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:36:10.469 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:36:10.464+0000 7f722ea00640 1 --2- 172.21.15.39:0/2914960377 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f7228102790 0x7f722819ab70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:36:10.469 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:36:10.464+0000 7f722ea00640 1 --2- 172.21.15.39:0/2914960377 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f7228101de0 0x7f722819a630 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:36:10.469 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:36:10.464+0000 7f722ea00640 1 -- 172.21.15.39:0/2914960377 >> 172.21.15.39:0/2914960377 conn(0x7f72280fd8c0 msgr2=0x7f72280ffc50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:36:10.469 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:36:10.464+0000 7f722ea00640 1 -- 172.21.15.39:0/2914960377 shutdown_connections 2024-09-12T02:36:10.469 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:36:10.464+0000 7f722ea00640 1 -- 172.21.15.39:0/2914960377 wait complete. 2024-09-12T02:36:11.013 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 12 02:36:10 smithi172 ceph-mon[35609]: pgmap v335: 129 pgs: 129 active+clean; 640 KiB data, 347 MiB used, 1.0 TiB / 1.0 TiB avail; 11 KiB/s rd, 5.7 KiB/s wr, 14 op/s 2024-09-12T02:36:11.099 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 02:36:10 smithi039 ceph-mon[30515]: pgmap v335: 129 pgs: 129 active+clean; 640 KiB data, 347 MiB used, 1.0 TiB / 1.0 TiB avail; 11 KiB/s rd, 5.7 KiB/s wr, 14 op/s 2024-09-12T02:36:11.198 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 12 02:36:10 smithi044 ceph-mon[35411]: pgmap v335: 129 pgs: 129 active+clean; 640 KiB data, 347 MiB used, 1.0 TiB / 1.0 TiB avail; 11 KiB/s rd, 5.7 KiB/s wr, 14 op/s 2024-09-12T02:36:11.345 INFO:teuthology.orchestra.run.smithi039.stdout:{"pg_ready":true,"pg_map":{"version":335,"stamp":"2024-09-12T02:36:08.825482+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":655461,"num_objects":102,"num_object_clones":0,"num_object_copies":308,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":102,"num_whiteouts":0,"num_read":338,"num_read_kb":292,"num_write":418,"num_write_kb":3073,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":9,"num_bytes_recovered":1180736,"num_keys_recovered":0,"num_objects_omap":66,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":345,"ondisk_log_size":345,"up":419,"acting":419,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":419,"num_osds":12,"num_per_pool_osds":12,"num_per_pool_omap_osds":12,"kb":1124941824,"kb_used":355528,"kb_used_data":14600,"kb_used_omap":18,"kb_used_meta":340717,"kb_avail":1124586296,"statfs":{"total":1151940427776,"available":1151576367104,"internally_reserved":0,"allocated":14950400,"data_stored":8250761,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":19143,"internal_metadata":348894521},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":54827,"num_objects":2,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":147,"num_read_kb":127,"num_write":28,"num_write_kb":68,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.002912"},"pg_stats":[{"pgid":"2.1f","version":"93'13","reported_seq":65,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-09-12T02:36:02.995087+0000","last_change":"2024-09-12T02:35:00.062996+0000","last_active":"2024-09-12T02:36:02.995087+0000","last_peered":"2024-09-12T02:36:02.995087+0000","last_clean":"2024-09-12T02:36:02.995087+0000","last_became_active":"2024-09-12T02:35:00.062670+0000","last_became_peered":"2024-09-12T02:35:00.062670+0000","last_unstale":"2024-09-12T02:36:02.995087+0000","last_undegraded":"2024-09-12T02:36:02.995087+0000","last_fullsized":"2024-09-12T02:36:02.995087+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:34:59.027857+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:34:59.027857+0000","last_clean_scrub_stamp":"2024-09-12T02:34:59.027857+0000","objects_scrubbed":0,"log_size":13,"log_dups_size":0,"ondisk_log_size":13,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:08:38.434465+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":672,"num_objects":6,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":14,"num_read_kb":14,"num_write":14,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,7,8],"acting":[9,7,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.1e","version":"0'0","reported_seq":34,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-09-12T02:35:46.726846+0000","last_change":"2024-09-12T02:35:02.518880+0000","last_active":"2024-09-12T02:35:46.726846+0000","last_peered":"2024-09-12T02:35:46.726846+0000","last_clean":"2024-09-12T02:35:46.726846+0000","last_became_active":"2024-09-12T02:35:02.516137+0000","last_became_peered":"2024-09-12T02:35:02.516137+0000","last_unstale":"2024-09-12T02:35:46.726846+0000","last_undegraded":"2024-09-12T02:35:46.726846+0000","last_fullsized":"2024-09-12T02:35:46.726846+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:35:01.470375+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:35:01.470375+0000","last_clean_scrub_stamp":"2024-09-12T02:35:01.470375+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T13:23:04.313584+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,5],"acting":[3,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.19","version":"0'0","reported_seq":24,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-09-12T02:35:46.731911+0000","last_change":"2024-09-12T02:35:12.591111+0000","last_active":"2024-09-12T02:35:46.731911+0000","last_peered":"2024-09-12T02:35:46.731911+0000","last_clean":"2024-09-12T02:35:46.731911+0000","last_became_active":"2024-09-12T02:35:12.590598+0000","last_became_peered":"2024-09-12T02:35:12.590598+0000","last_unstale":"2024-09-12T02:35:46.731911+0000","last_undegraded":"2024-09-12T02:35:46.731911+0000","last_fullsized":"2024-09-12T02:35:46.731911+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:35:11.552386+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:35:11.552386+0000","last_clean_scrub_stamp":"2024-09-12T02:35:11.552386+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:07:52.634283+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,9,0],"acting":[2,3,9,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1e","version":"93'2","reported_seq":40,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-09-12T02:35:46.727210+0000","last_change":"2024-09-12T02:35:00.068606+0000","last_active":"2024-09-12T02:35:46.727210+0000","last_peered":"2024-09-12T02:35:46.727210+0000","last_clean":"2024-09-12T02:35:46.727210+0000","last_became_active":"2024-09-12T02:35:00.068243+0000","last_became_peered":"2024-09-12T02:35:00.068243+0000","last_unstale":"2024-09-12T02:35:46.727210+0000","last_undegraded":"2024-09-12T02:35:46.727210+0000","last_fullsized":"2024-09-12T02:35:46.727210+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:34:59.027857+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:34:59.027857+0000","last_clean_scrub_stamp":"2024-09-12T02:34:59.027857+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:19:41.463728+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,5],"acting":[3,0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1f","version":"0'0","reported_seq":30,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-09-12T02:35:46.736697+0000","last_change":"2024-09-12T02:35:02.525485+0000","last_active":"2024-09-12T02:35:46.736697+0000","last_peered":"2024-09-12T02:35:46.736697+0000","last_clean":"2024-09-12T02:35:46.736697+0000","last_became_active":"2024-09-12T02:35:02.525111+0000","last_became_peered":"2024-09-12T02:35:02.525111+0000","last_unstale":"2024-09-12T02:35:46.736697+0000","last_undegraded":"2024-09-12T02:35:46.736697+0000","last_fullsized":"2024-09-12T02:35:46.736697+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:35:01.470375+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:35:01.470375+0000","last_clean_scrub_stamp":"2024-09-12T02:35:01.470375+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:37:25.329762+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,9],"acting":[0,1,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.18","version":"0'0","reported_seq":24,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-09-12T02:35:46.832568+0000","last_change":"2024-09-12T02:35:12.591057+0000","last_active":"2024-09-12T02:35:46.832568+0000","last_peered":"2024-09-12T02:35:46.832568+0000","last_clean":"2024-09-12T02:35:46.832568+0000","last_became_active":"2024-09-12T02:35:12.590606+0000","last_became_peered":"2024-09-12T02:35:12.590606+0000","last_unstale":"2024-09-12T02:35:46.832568+0000","last_undegraded":"2024-09-12T02:35:46.832568+0000","last_fullsized":"2024-09-12T02:35:46.832568+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:35:11.552386+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:35:11.552386+0000","last_clean_scrub_stamp":"2024-09-12T02:35:11.552386+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:44:06.007603+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6,9,3],"acting":[4,6,9,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1d","version":"93'12","reported_seq":49,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-09-12T02:35:51.975440+0000","last_change":"2024-09-12T02:35:00.064090+0000","last_active":"2024-09-12T02:35:51.975440+0000","last_peered":"2024-09-12T02:35:51.975440+0000","last_clean":"2024-09-12T02:35:51.975440+0000","last_became_active":"2024-09-12T02:35:00.063688+0000","last_became_peered":"2024-09-12T02:35:00.063688+0000","last_unstale":"2024-09-12T02:35:51.975440+0000","last_undegraded":"2024-09-12T02:35:51.975440+0000","last_fullsized":"2024-09-12T02:35:51.975440+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:34:59.027857+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:34:59.027857+0000","last_clean_scrub_stamp":"2024-09-12T02:34:59.027857+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:27:30.117990+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":7,"num_object_clones":0,"num_object_copies":21,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":16,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":7,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,2,7],"acting":[8,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.1c","version":"0'0","reported_seq":33,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-09-12T02:35:46.833790+0000","last_change":"2024-09-12T02:35:02.510882+0000","last_active":"2024-09-12T02:35:46.833790+0000","last_peered":"2024-09-12T02:35:46.833790+0000","last_clean":"2024-09-12T02:35:46.833790+0000","last_became_active":"2024-09-12T02:35:02.510513+0000","last_became_peered":"2024-09-12T02:35:02.510513+0000","last_unstale":"2024-09-12T02:35:46.833790+0000","last_undegraded":"2024-09-12T02:35:46.833790+0000","last_fullsized":"2024-09-12T02:35:46.833790+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:35:01.470375+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:35:01.470375+0000","last_clean_scrub_stamp":"2024-09-12T02:35:01.470375+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:21:40.527379+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,10,6],"acting":[1,10,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1b","version":"0'0","reported_seq":24,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-09-12T02:35:46.832859+0000","last_change":"2024-09-12T02:35:12.590704+0000","last_active":"2024-09-12T02:35:46.832859+0000","last_peered":"2024-09-12T02:35:46.832859+0000","last_clean":"2024-09-12T02:35:46.832859+0000","last_became_active":"2024-09-12T02:35:12.590217+0000","last_became_peered":"2024-09-12T02:35:12.590217+0000","last_unstale":"2024-09-12T02:35:46.832859+0000","last_undegraded":"2024-09-12T02:35:46.832859+0000","last_fullsized":"2024-09-12T02:35:46.832859+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:35:11.552386+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:35:11.552386+0000","last_clean_scrub_stamp":"2024-09-12T02:35:11.552386+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:21:47.370860+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,9,5],"acting":[4,3,9,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1c","version":"93'5","reported_seq":42,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-09-12T02:35:51.805060+0000","last_change":"2024-09-12T02:35:00.059679+0000","last_active":"2024-09-12T02:35:51.805060+0000","last_peered":"2024-09-12T02:35:51.805060+0000","last_clean":"2024-09-12T02:35:51.805060+0000","last_became_active":"2024-09-12T02:35:00.058599+0000","last_became_peered":"2024-09-12T02:35:00.058599+0000","last_unstale":"2024-09-12T02:35:51.805060+0000","last_undegraded":"2024-09-12T02:35:51.805060+0000","last_fullsized":"2024-09-12T02:35:51.805060+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:34:59.027857+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:34:59.027857+0000","last_clean_scrub_stamp":"2024-09-12T02:34:59.027857+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:24:39.878761+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":7,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,1,5],"acting":[8,1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.1d","version":"0'0","reported_seq":32,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-09-12T02:35:46.728725+0000","last_change":"2024-09-12T02:35:02.511371+0000","last_active":"2024-09-12T02:35:46.728725+0000","last_peered":"2024-09-12T02:35:46.728725+0000","last_clean":"2024-09-12T02:35:46.728725+0000","last_became_active":"2024-09-12T02:35:02.510941+0000","last_became_peered":"2024-09-12T02:35:02.510941+0000","last_unstale":"2024-09-12T02:35:46.728725+0000","last_undegraded":"2024-09-12T02:35:46.728725+0000","last_fullsized":"2024-09-12T02:35:46.728725+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:35:01.470375+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:35:01.470375+0000","last_clean_scrub_stamp":"2024-09-12T02:35:01.470375+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:30:50.106899+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,1],"acting":[5,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1a","version":"0'0","reported_seq":24,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-09-12T02:35:46.832391+0000","last_change":"2024-09-12T02:35:12.590925+0000","last_active":"2024-09-12T02:35:46.832391+0000","last_peered":"2024-09-12T02:35:46.832391+0000","last_clean":"2024-09-12T02:35:46.832391+0000","last_became_active":"2024-09-12T02:35:12.590286+0000","last_became_peered":"2024-09-12T02:35:12.590286+0000","last_unstale":"2024-09-12T02:35:46.832391+0000","last_undegraded":"2024-09-12T02:35:46.832391+0000","last_fullsized":"2024-09-12T02:35:46.832391+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:35:11.552386+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:35:11.552386+0000","last_clean_scrub_stamp":"2024-09-12T02:35:11.552386+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:31:48.835941+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6,5,3],"acting":[4,6,5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":33,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-09-12T02:35:46.730545+0000","last_change":"2024-09-12T02:35:02.524637+0000","last_active":"2024-09-12T02:35:46.730545+0000","last_peered":"2024-09-12T02:35:46.730545+0000","last_clean":"2024-09-12T02:35:46.730545+0000","last_became_active":"2024-09-12T02:35:02.524178+0000","last_became_peered":"2024-09-12T02:35:02.524178+0000","last_unstale":"2024-09-12T02:35:46.730545+0000","last_undegraded":"2024-09-12T02:35:46.730545+0000","last_fullsized":"2024-09-12T02:35:46.730545+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:35:01.470375+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:35:01.470375+0000","last_clean_scrub_stamp":"2024-09-12T02:35:01.470375+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:31:28.693302+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,6],"acting":[7,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.b","version":"93'4","reported_seq":51,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-09-12T02:35:48.760778+0000","last_change":"2024-09-12T02:35:46.837747+0000","last_active":"2024-09-12T02:35:48.760778+0000","last_peered":"2024-09-12T02:35:48.760778+0000","last_clean":"2024-09-12T02:35:48.760778+0000","last_became_active":"2024-09-12T02:35:46.834865+0000","last_became_peered":"2024-09-12T02:35:46.834865+0000","last_unstale":"2024-09-12T02:35:48.760778+0000","last_undegraded":"2024-09-12T02:35:48.760778+0000","last_fullsized":"2024-09-12T02:35:48.760778+0000","mapping_epoch":92,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":93,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:34:59.027857+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:34:59.027857+0000","last_clean_scrub_stamp":"2024-09-12T02:34:59.027857+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:04:51.092618+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,1,7],"acting":[8,1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"4.d","version":"0'0","reported_seq":24,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-09-12T02:35:46.832491+0000","last_change":"2024-09-12T02:35:12.590345+0000","last_active":"2024-09-12T02:35:46.832491+0000","last_peered":"2024-09-12T02:35:46.832491+0000","last_clean":"2024-09-12T02:35:46.832491+0000","last_became_active":"2024-09-12T02:35:12.589805+0000","last_became_peered":"2024-09-12T02:35:12.589805+0000","last_unstale":"2024-09-12T02:35:46.832491+0000","last_undegraded":"2024-09-12T02:35:46.832491+0000","last_fullsized":"2024-09-12T02:35:46.832491+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:35:11.552386+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:35:11.552386+0000","last_clean_scrub_stamp":"2024-09-12T02:35:11.552386+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:49:28.262371+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2,10,3],"acting":[4,2,10,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.b","version":"0'0","reported_seq":34,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-09-12T02:35:46.726646+0000","last_change":"2024-09-12T02:35:02.513424+0000","last_active":"2024-09-12T02:35:46.726646+0000","last_peered":"2024-09-12T02:35:46.726646+0000","last_clean":"2024-09-12T02:35:46.726646+0000","last_became_active":"2024-09-12T02:35:02.512180+0000","last_became_peered":"2024-09-12T02:35:02.512180+0000","last_unstale":"2024-09-12T02:35:46.726646+0000","last_undegraded":"2024-09-12T02:35:46.726646+0000","last_fullsized":"2024-09-12T02:35:46.726646+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:35:01.470375+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:35:01.470375+0000","last_clean_scrub_stamp":"2024-09-12T02:35:01.470375+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:22:40.102645+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,10],"acting":[3,0,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.a","version":"93'3","reported_seq":41,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-09-12T02:35:50.784413+0000","last_change":"2024-09-12T02:35:00.066012+0000","last_active":"2024-09-12T02:35:50.784413+0000","last_peered":"2024-09-12T02:35:50.784413+0000","last_clean":"2024-09-12T02:35:50.784413+0000","last_became_active":"2024-09-12T02:35:00.065642+0000","last_became_peered":"2024-09-12T02:35:00.065642+0000","last_unstale":"2024-09-12T02:35:50.784413+0000","last_undegraded":"2024-09-12T02:35:50.784413+0000","last_fullsized":"2024-09-12T02:35:50.784413+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:34:59.027857+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:34:59.027857+0000","last_clean_scrub_stamp":"2024-09-12T02:34:59.027857+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:16:27.609255+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,8],"acting":[2,3,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.c","version":"93'1","reported_seq":25,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-09-12T02:35:46.833465+0000","last_change":"2024-09-12T02:35:12.591850+0000","last_active":"2024-09-12T02:35:46.833465+0000","last_peered":"2024-09-12T02:35:46.833465+0000","last_clean":"2024-09-12T02:35:46.833465+0000","last_became_active":"2024-09-12T02:35:12.590807+0000","last_became_peered":"2024-09-12T02:35:12.590807+0000","last_unstale":"2024-09-12T02:35:46.833465+0000","last_undegraded":"2024-09-12T02:35:46.833465+0000","last_fullsized":"2024-09-12T02:35:46.833465+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:35:11.552386+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:35:11.552386+0000","last_clean_scrub_stamp":"2024-09-12T02:35:11.552386+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:09:16.082542+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":117,"num_objects":1,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,9,7,8],"acting":[4,9,7,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":31,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-09-12T02:35:46.731490+0000","last_change":"2024-09-12T02:35:02.510960+0000","last_active":"2024-09-12T02:35:46.731490+0000","last_peered":"2024-09-12T02:35:46.731490+0000","last_clean":"2024-09-12T02:35:46.731490+0000","last_became_active":"2024-09-12T02:35:02.510589+0000","last_became_peered":"2024-09-12T02:35:02.510589+0000","last_unstale":"2024-09-12T02:35:46.731490+0000","last_undegraded":"2024-09-12T02:35:46.731490+0000","last_fullsized":"2024-09-12T02:35:46.731490+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:35:01.470375+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:35:01.470375+0000","last_clean_scrub_stamp":"2024-09-12T02:35:01.470375+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:33:15.825208+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,0,2],"acting":[11,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"2.9","version":"93'7","reported_seq":45,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-09-12T02:35:51.806729+0000","last_change":"2024-09-12T02:35:00.061327+0000","last_active":"2024-09-12T02:35:51.806729+0000","last_peered":"2024-09-12T02:35:51.806729+0000","last_clean":"2024-09-12T02:35:51.806729+0000","last_became_active":"2024-09-12T02:35:00.061118+0000","last_became_peered":"2024-09-12T02:35:00.061118+0000","last_unstale":"2024-09-12T02:35:51.806729+0000","last_undegraded":"2024-09-12T02:35:51.806729+0000","last_fullsized":"2024-09-12T02:35:51.806729+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:34:59.027857+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:34:59.027857+0000","last_clean_scrub_stamp":"2024-09-12T02:34:59.027857+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T14:02:22.217428+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,9,10],"acting":[3,9,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.f","version":"0'0","reported_seq":24,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-09-12T02:35:46.725943+0000","last_change":"2024-09-12T02:35:12.581769+0000","last_active":"2024-09-12T02:35:46.725943+0000","last_peered":"2024-09-12T02:35:46.725943+0000","last_clean":"2024-09-12T02:35:46.725943+0000","last_became_active":"2024-09-12T02:35:12.580169+0000","last_became_peered":"2024-09-12T02:35:12.580169+0000","last_unstale":"2024-09-12T02:35:46.725943+0000","last_undegraded":"2024-09-12T02:35:46.725943+0000","last_fullsized":"2024-09-12T02:35:46.725943+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:35:11.552386+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:35:11.552386+0000","last_clean_scrub_stamp":"2024-09-12T02:35:11.552386+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:04:10.192058+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,3,2,5],"acting":[9,3,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":31,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-09-12T02:35:46.726693+0000","last_change":"2024-09-12T02:35:02.507893+0000","last_active":"2024-09-12T02:35:46.726693+0000","last_peered":"2024-09-12T02:35:46.726693+0000","last_clean":"2024-09-12T02:35:46.726693+0000","last_became_active":"2024-09-12T02:35:02.506357+0000","last_became_peered":"2024-09-12T02:35:02.506357+0000","last_unstale":"2024-09-12T02:35:46.726693+0000","last_undegraded":"2024-09-12T02:35:46.726693+0000","last_fullsized":"2024-09-12T02:35:46.726693+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:35:01.470375+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:35:01.470375+0000","last_clean_scrub_stamp":"2024-09-12T02:35:01.470375+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T14:03:36.148796+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,11,10],"acting":[8,11,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"2.8","version":"93'2","reported_seq":39,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-09-12T02:35:48.760963+0000","last_change":"2024-09-12T02:35:00.068759+0000","last_active":"2024-09-12T02:35:48.760963+0000","last_peered":"2024-09-12T02:35:48.760963+0000","last_clean":"2024-09-12T02:35:48.760963+0000","last_became_active":"2024-09-12T02:35:00.068464+0000","last_became_peered":"2024-09-12T02:35:00.068464+0000","last_unstale":"2024-09-12T02:35:48.760963+0000","last_undegraded":"2024-09-12T02:35:48.760963+0000","last_fullsized":"2024-09-12T02:35:48.760963+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:34:59.027857+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:34:59.027857+0000","last_clean_scrub_stamp":"2024-09-12T02:34:59.027857+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T14:17:20.863590+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,0],"acting":[1,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.e","version":"0'0","reported_seq":24,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-09-12T02:35:46.832775+0000","last_change":"2024-09-12T02:35:12.591707+0000","last_active":"2024-09-12T02:35:46.832775+0000","last_peered":"2024-09-12T02:35:46.832775+0000","last_clean":"2024-09-12T02:35:46.832775+0000","last_became_active":"2024-09-12T02:35:12.591302+0000","last_became_peered":"2024-09-12T02:35:12.591302+0000","last_unstale":"2024-09-12T02:35:46.832775+0000","last_undegraded":"2024-09-12T02:35:46.832775+0000","last_fullsized":"2024-09-12T02:35:46.832775+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:35:11.552386+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:35:11.552386+0000","last_clean_scrub_stamp":"2024-09-12T02:35:11.552386+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:56:14.526395+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5,10,9],"acting":[4,5,10,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":30,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-09-12T02:35:46.736523+0000","last_change":"2024-09-12T02:35:02.523175+0000","last_active":"2024-09-12T02:35:46.736523+0000","last_peered":"2024-09-12T02:35:46.736523+0000","last_clean":"2024-09-12T02:35:46.736523+0000","last_became_active":"2024-09-12T02:35:02.522846+0000","last_became_peered":"2024-09-12T02:35:02.522846+0000","last_unstale":"2024-09-12T02:35:46.736523+0000","last_undegraded":"2024-09-12T02:35:46.736523+0000","last_fullsized":"2024-09-12T02:35:46.736523+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:35:01.470375+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:35:01.470375+0000","last_clean_scrub_stamp":"2024-09-12T02:35:01.470375+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:16:18.488190+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,4],"acting":[0,3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.7","version":"93'7","reported_seq":45,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-09-12T02:35:51.805960+0000","last_change":"2024-09-12T02:35:00.314147+0000","last_active":"2024-09-12T02:35:51.805960+0000","last_peered":"2024-09-12T02:35:51.805960+0000","last_clean":"2024-09-12T02:35:51.805960+0000","last_became_active":"2024-09-12T02:35:00.313795+0000","last_became_peered":"2024-09-12T02:35:00.313795+0000","last_unstale":"2024-09-12T02:35:51.805960+0000","last_undegraded":"2024-09-12T02:35:51.805960+0000","last_fullsized":"2024-09-12T02:35:51.805960+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:34:59.027857+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:34:59.027857+0000","last_clean_scrub_stamp":"2024-09-12T02:34:59.027857+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:26:33.269006+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,11,6],"acting":[4,11,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.1","version":"0'0","reported_seq":24,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-09-12T02:35:46.732178+0000","last_change":"2024-09-12T02:35:12.578075+0000","last_active":"2024-09-12T02:35:46.732178+0000","last_peered":"2024-09-12T02:35:46.732178+0000","last_clean":"2024-09-12T02:35:46.732178+0000","last_became_active":"2024-09-12T02:35:12.577622+0000","last_became_peered":"2024-09-12T02:35:12.577622+0000","last_unstale":"2024-09-12T02:35:46.732178+0000","last_undegraded":"2024-09-12T02:35:46.732178+0000","last_fullsized":"2024-09-12T02:35:46.732178+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:35:11.552386+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:35:11.552386+0000","last_clean_scrub_stamp":"2024-09-12T02:35:11.552386+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:26:50.263757+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,4,7],"acting":[2,1,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.7","version":"0'0","reported_seq":34,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-09-12T02:35:46.727172+0000","last_change":"2024-09-12T02:35:02.514685+0000","last_active":"2024-09-12T02:35:46.727172+0000","last_peered":"2024-09-12T02:35:46.727172+0000","last_clean":"2024-09-12T02:35:46.727172+0000","last_became_active":"2024-09-12T02:35:02.511606+0000","last_became_peered":"2024-09-12T02:35:02.511606+0000","last_unstale":"2024-09-12T02:35:46.727172+0000","last_undegraded":"2024-09-12T02:35:46.727172+0000","last_fullsized":"2024-09-12T02:35:46.727172+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:35:01.470375+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:35:01.470375+0000","last_clean_scrub_stamp":"2024-09-12T02:35:01.470375+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:36:49.833272+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,11,7],"acting":[3,11,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.6","version":"93'10","reported_seq":48,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-09-12T02:35:58.515660+0000","last_change":"2024-09-12T02:35:00.059540+0000","last_active":"2024-09-12T02:35:58.515660+0000","last_peered":"2024-09-12T02:35:58.515660+0000","last_clean":"2024-09-12T02:35:58.515660+0000","last_became_active":"2024-09-12T02:35:00.059161+0000","last_became_peered":"2024-09-12T02:35:00.059161+0000","last_unstale":"2024-09-12T02:35:58.515660+0000","last_undegraded":"2024-09-12T02:35:58.515660+0000","last_fullsized":"2024-09-12T02:35:58.515660+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:34:59.027857+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:34:59.027857+0000","last_clean_scrub_stamp":"2024-09-12T02:34:59.027857+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:52:19.141087+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":16,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,8,3],"acting":[9,8,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"4.0","version":"0'0","reported_seq":24,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-09-12T02:35:46.725920+0000","last_change":"2024-09-12T02:35:12.584755+0000","last_active":"2024-09-12T02:35:46.725920+0000","last_peered":"2024-09-12T02:35:46.725920+0000","last_clean":"2024-09-12T02:35:46.725920+0000","last_became_active":"2024-09-12T02:35:12.584365+0000","last_became_peered":"2024-09-12T02:35:12.584365+0000","last_unstale":"2024-09-12T02:35:46.725920+0000","last_undegraded":"2024-09-12T02:35:46.725920+0000","last_fullsized":"2024-09-12T02:35:46.725920+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:35:11.552386+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:35:11.552386+0000","last_clean_scrub_stamp":"2024-09-12T02:35:11.552386+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:16:54.529244+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,10,0,7],"acting":[3,10,0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":31,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-09-12T02:35:46.732750+0000","last_change":"2024-09-12T02:35:02.507751+0000","last_active":"2024-09-12T02:35:46.732750+0000","last_peered":"2024-09-12T02:35:46.732750+0000","last_clean":"2024-09-12T02:35:46.732750+0000","last_became_active":"2024-09-12T02:35:02.507456+0000","last_became_peered":"2024-09-12T02:35:02.507456+0000","last_unstale":"2024-09-12T02:35:46.732750+0000","last_undegraded":"2024-09-12T02:35:46.732750+0000","last_fullsized":"2024-09-12T02:35:46.732750+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:35:01.470375+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:35:01.470375+0000","last_clean_scrub_stamp":"2024-09-12T02:35:01.470375+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:48:13.297422+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2,9],"acting":[6,2,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.5","version":"93'4","reported_seq":41,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-09-12T02:35:51.806203+0000","last_change":"2024-09-12T02:35:00.068895+0000","last_active":"2024-09-12T02:35:51.806203+0000","last_peered":"2024-09-12T02:35:51.806203+0000","last_clean":"2024-09-12T02:35:51.806203+0000","last_became_active":"2024-09-12T02:35:00.068547+0000","last_became_peered":"2024-09-12T02:35:00.068547+0000","last_unstale":"2024-09-12T02:35:51.806203+0000","last_undegraded":"2024-09-12T02:35:51.806203+0000","last_fullsized":"2024-09-12T02:35:51.806203+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:34:59.027857+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:34:59.027857+0000","last_clean_scrub_stamp":"2024-09-12T02:34:59.027857+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:31:14.305834+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":112,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":5,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,0,9],"acting":[8,0,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"4.3","version":"0'0","reported_seq":24,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-09-12T02:35:46.730216+0000","last_change":"2024-09-12T02:35:12.579890+0000","last_active":"2024-09-12T02:35:46.730216+0000","last_peered":"2024-09-12T02:35:46.730216+0000","last_clean":"2024-09-12T02:35:46.730216+0000","last_became_active":"2024-09-12T02:35:12.579399+0000","last_became_peered":"2024-09-12T02:35:12.579399+0000","last_unstale":"2024-09-12T02:35:46.730216+0000","last_undegraded":"2024-09-12T02:35:46.730216+0000","last_fullsized":"2024-09-12T02:35:46.730216+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:35:11.552386+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:35:11.552386+0000","last_clean_scrub_stamp":"2024-09-12T02:35:11.552386+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:48:31.564922+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,5,7,6],"acting":[11,5,7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":32,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-09-12T02:35:46.757621+0000","last_change":"2024-09-12T02:35:02.519590+0000","last_active":"2024-09-12T02:35:46.757621+0000","last_peered":"2024-09-12T02:35:46.757621+0000","last_clean":"2024-09-12T02:35:46.757621+0000","last_became_active":"2024-09-12T02:35:02.519244+0000","last_became_peered":"2024-09-12T02:35:02.519244+0000","last_unstale":"2024-09-12T02:35:46.757621+0000","last_undegraded":"2024-09-12T02:35:46.757621+0000","last_fullsized":"2024-09-12T02:35:46.757621+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:35:01.470375+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:35:01.470375+0000","last_clean_scrub_stamp":"2024-09-12T02:35:01.470375+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T13:52:18.415135+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,3,6],"acting":[10,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"2.4","version":"93'1","reported_seq":39,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-09-12T02:35:46.725433+0000","last_change":"2024-09-12T02:35:00.068931+0000","last_active":"2024-09-12T02:35:46.725433+0000","last_peered":"2024-09-12T02:35:46.725433+0000","last_clean":"2024-09-12T02:35:46.725433+0000","last_became_active":"2024-09-12T02:35:00.068217+0000","last_became_peered":"2024-09-12T02:35:00.068217+0000","last_unstale":"2024-09-12T02:35:46.725433+0000","last_undegraded":"2024-09-12T02:35:46.725433+0000","last_fullsized":"2024-09-12T02:35:46.725433+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:34:59.027857+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:34:59.027857+0000","last_clean_scrub_stamp":"2024-09-12T02:34:59.027857+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:56:25.407991+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,2,0],"acting":[9,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"4.2","version":"0'0","reported_seq":31,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-09-12T02:35:46.834010+0000","last_change":"2024-09-12T02:35:46.834010+0000","last_active":"2024-09-12T02:35:46.834010+0000","last_peered":"2024-09-12T02:35:46.834010+0000","last_clean":"2024-09-12T02:35:46.834010+0000","last_became_active":"2024-09-12T02:35:46.833523+0000","last_became_peered":"2024-09-12T02:35:46.833523+0000","last_unstale":"2024-09-12T02:35:46.834010+0000","last_undegraded":"2024-09-12T02:35:46.834010+0000","last_fullsized":"2024-09-12T02:35:46.834010+0000","mapping_epoch":92,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":93,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:35:11.552386+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:35:11.552386+0000","last_clean_scrub_stamp":"2024-09-12T02:35:11.552386+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:49:26.839307+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,10,11,1],"acting":[8,10,11,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":32,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-09-12T02:35:46.757793+0000","last_change":"2024-09-12T02:35:02.514146+0000","last_active":"2024-09-12T02:35:46.757793+0000","last_peered":"2024-09-12T02:35:46.757793+0000","last_clean":"2024-09-12T02:35:46.757793+0000","last_became_active":"2024-09-12T02:35:02.513777+0000","last_became_peered":"2024-09-12T02:35:02.513777+0000","last_unstale":"2024-09-12T02:35:46.757793+0000","last_undegraded":"2024-09-12T02:35:46.757793+0000","last_fullsized":"2024-09-12T02:35:46.757793+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:35:01.470375+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:35:01.470375+0000","last_clean_scrub_stamp":"2024-09-12T02:35:01.470375+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:33:57.554957+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,4,0],"acting":[10,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"2.2","version":"93'6","reported_seq":59,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-09-12T02:36:03.997048+0000","last_change":"2024-09-12T02:35:00.062893+0000","last_active":"2024-09-12T02:36:03.997048+0000","last_peered":"2024-09-12T02:36:03.997048+0000","last_clean":"2024-09-12T02:36:03.997048+0000","last_became_active":"2024-09-12T02:35:00.062547+0000","last_became_peered":"2024-09-12T02:35:00.062547+0000","last_unstale":"2024-09-12T02:36:03.997048+0000","last_undegraded":"2024-09-12T02:36:03.997048+0000","last_fullsized":"2024-09-12T02:36:03.997048+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:34:59.027857+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:34:59.027857+0000","last_clean_scrub_stamp":"2024-09-12T02:34:59.027857+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T13:40:15.098836+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":981,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":16,"num_read_kb":2,"num_write":5,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6,1],"acting":[7,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.4","version":"0'0","reported_seq":24,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-09-12T02:35:46.731789+0000","last_change":"2024-09-12T02:35:12.586490+0000","last_active":"2024-09-12T02:35:46.731789+0000","last_peered":"2024-09-12T02:35:46.731789+0000","last_clean":"2024-09-12T02:35:46.731789+0000","last_became_active":"2024-09-12T02:35:12.586102+0000","last_became_peered":"2024-09-12T02:35:12.586102+0000","last_unstale":"2024-09-12T02:35:46.731789+0000","last_undegraded":"2024-09-12T02:35:46.731789+0000","last_fullsized":"2024-09-12T02:35:46.731789+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:35:11.552386+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:35:11.552386+0000","last_clean_scrub_stamp":"2024-09-12T02:35:11.552386+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:43:45.543922+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0,1,8],"acting":[6,0,1,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":32,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-09-12T02:35:46.728073+0000","last_change":"2024-09-12T02:35:02.506726+0000","last_active":"2024-09-12T02:35:46.728073+0000","last_peered":"2024-09-12T02:35:46.728073+0000","last_clean":"2024-09-12T02:35:46.728073+0000","last_became_active":"2024-09-12T02:35:02.505693+0000","last_became_peered":"2024-09-12T02:35:02.505693+0000","last_unstale":"2024-09-12T02:35:46.728073+0000","last_undegraded":"2024-09-12T02:35:46.728073+0000","last_fullsized":"2024-09-12T02:35:46.728073+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:35:01.470375+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:35:01.470375+0000","last_clean_scrub_stamp":"2024-09-12T02:35:01.470375+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:54:51.507105+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2,4],"acting":[5,2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1","version":"93'5","reported_seq":59,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-09-12T02:36:07.000698+0000","last_change":"2024-09-12T02:35:00.069206+0000","last_active":"2024-09-12T02:36:07.000698+0000","last_peered":"2024-09-12T02:36:07.000698+0000","last_clean":"2024-09-12T02:36:07.000698+0000","last_became_active":"2024-09-12T02:35:00.068823+0000","last_became_peered":"2024-09-12T02:35:00.068823+0000","last_unstale":"2024-09-12T02:36:07.000698+0000","last_undegraded":"2024-09-12T02:36:07.000698+0000","last_fullsized":"2024-09-12T02:36:07.000698+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:34:59.027857+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:34:59.027857+0000","last_clean_scrub_stamp":"2024-09-12T02:34:59.027857+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:33:11.004561+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":112,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":18,"num_read_kb":18,"num_write":5,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,0],"acting":[6,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.7","version":"0'0","reported_seq":24,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-09-12T02:35:46.733237+0000","last_change":"2024-09-12T02:35:12.587431+0000","last_active":"2024-09-12T02:35:46.733237+0000","last_peered":"2024-09-12T02:35:46.733237+0000","last_clean":"2024-09-12T02:35:46.733237+0000","last_became_active":"2024-09-12T02:35:12.587059+0000","last_became_peered":"2024-09-12T02:35:12.587059+0000","last_unstale":"2024-09-12T02:35:46.733237+0000","last_undegraded":"2024-09-12T02:35:46.733237+0000","last_fullsized":"2024-09-12T02:35:46.733237+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:35:11.552386+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:35:11.552386+0000","last_clean_scrub_stamp":"2024-09-12T02:35:11.552386+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:51:53.335039+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5,10,0],"acting":[6,5,10,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":31,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-09-12T02:35:46.731728+0000","last_change":"2024-09-12T02:35:02.508475+0000","last_active":"2024-09-12T02:35:46.731728+0000","last_peered":"2024-09-12T02:35:46.731728+0000","last_clean":"2024-09-12T02:35:46.731728+0000","last_became_active":"2024-09-12T02:35:02.508183+0000","last_became_peered":"2024-09-12T02:35:02.508183+0000","last_unstale":"2024-09-12T02:35:46.731728+0000","last_undegraded":"2024-09-12T02:35:46.731728+0000","last_fullsized":"2024-09-12T02:35:46.731728+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:35:01.470375+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:35:01.470375+0000","last_clean_scrub_stamp":"2024-09-12T02:35:01.470375+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:49:09.545800+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,2],"acting":[6,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.0","version":"93'4","reported_seq":15,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-09-12T02:35:49.770625+0000","last_change":"2024-09-12T02:35:46.734658+0000","last_active":"2024-09-12T02:35:49.770625+0000","last_peered":"2024-09-12T02:35:49.770625+0000","last_clean":"2024-09-12T02:35:49.770625+0000","last_became_active":"2024-09-12T02:35:46.734239+0000","last_became_peered":"2024-09-12T02:35:46.734239+0000","last_unstale":"2024-09-12T02:35:49.770625+0000","last_undegraded":"2024-09-12T02:35:49.770625+0000","last_fullsized":"2024-09-12T02:35:49.770625+0000","mapping_epoch":92,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":93,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:34:59.027857+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:34:59.027857+0000","last_clean_scrub_stamp":"2024-09-12T02:34:59.027857+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:08:17.941344+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,5,8],"acting":[11,5,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"4.6","version":"0'0","reported_seq":31,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-09-12T02:35:46.758993+0000","last_change":"2024-09-12T02:35:46.758993+0000","last_active":"2024-09-12T02:35:46.758993+0000","last_peered":"2024-09-12T02:35:46.758993+0000","last_clean":"2024-09-12T02:35:46.758993+0000","last_became_active":"2024-09-12T02:35:46.758552+0000","last_became_peered":"2024-09-12T02:35:46.758552+0000","last_unstale":"2024-09-12T02:35:46.758993+0000","last_undegraded":"2024-09-12T02:35:46.758993+0000","last_fullsized":"2024-09-12T02:35:46.758993+0000","mapping_epoch":92,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":93,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:35:11.552386+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:35:11.552386+0000","last_clean_scrub_stamp":"2024-09-12T02:35:11.552386+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:32:10.618748+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,11,6,10],"acting":[5,11,6,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":34,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-09-12T02:35:46.726550+0000","last_change":"2024-09-12T02:35:02.515340+0000","last_active":"2024-09-12T02:35:46.726550+0000","last_peered":"2024-09-12T02:35:46.726550+0000","last_clean":"2024-09-12T02:35:46.726550+0000","last_became_active":"2024-09-12T02:35:02.514973+0000","last_became_peered":"2024-09-12T02:35:02.514973+0000","last_unstale":"2024-09-12T02:35:46.726550+0000","last_undegraded":"2024-09-12T02:35:46.726550+0000","last_fullsized":"2024-09-12T02:35:46.726550+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:35:01.470375+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:35:01.470375+0000","last_clean_scrub_stamp":"2024-09-12T02:35:01.470375+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:06:03.154300+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5,1],"acting":[3,5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.3","version":"93'6","reported_seq":46,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-09-12T02:35:51.975419+0000","last_change":"2024-09-12T02:35:00.066731+0000","last_active":"2024-09-12T02:35:51.975419+0000","last_peered":"2024-09-12T02:35:51.975419+0000","last_clean":"2024-09-12T02:35:51.975419+0000","last_became_active":"2024-09-12T02:35:00.066339+0000","last_became_peered":"2024-09-12T02:35:00.066339+0000","last_unstale":"2024-09-12T02:35:51.975419+0000","last_undegraded":"2024-09-12T02:35:51.975419+0000","last_fullsized":"2024-09-12T02:35:51.975419+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:34:59.027857+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:34:59.027857+0000","last_clean_scrub_stamp":"2024-09-12T02:34:59.027857+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:02:39.919349+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":68,"num_objects":5,"num_object_clones":0,"num_object_copies":15,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":4,"num_read_kb":4,"num_write":8,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,10,9],"acting":[4,10,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"1.0","version":"23'137","reported_seq":362,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-09-12T02:35:46.730329+0000","last_change":"2024-09-12T02:33:47.732241+0000","last_active":"2024-09-12T02:35:46.730329+0000","last_peered":"2024-09-12T02:35:46.730329+0000","last_clean":"2024-09-12T02:35:46.730329+0000","last_became_active":"2024-09-12T02:33:47.731872+0000","last_became_peered":"2024-09-12T02:33:47.731872+0000","last_unstale":"2024-09-12T02:35:46.730329+0000","last_undegraded":"2024-09-12T02:35:46.730329+0000","last_fullsized":"2024-09-12T02:35:46.730329+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:30:09.398092+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:30:09.398092+0000","last_clean_scrub_stamp":"2024-09-12T02:30:09.398092+0000","objects_scrubbed":0,"log_size":137,"log_dups_size":0,"ondisk_log_size":137,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:35:36.504372+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":136,"num_read_kb":119,"num_write":181,"num_write_kb":2938,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":1180736,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,10],"acting":[7,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.5","version":"93'1","reported_seq":25,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-09-12T02:35:46.730944+0000","last_change":"2024-09-12T02:35:12.578073+0000","last_active":"2024-09-12T02:35:46.730944+0000","last_peered":"2024-09-12T02:35:46.730944+0000","last_clean":"2024-09-12T02:35:46.730944+0000","last_became_active":"2024-09-12T02:35:12.577496+0000","last_became_peered":"2024-09-12T02:35:12.577496+0000","last_unstale":"2024-09-12T02:35:46.730944+0000","last_undegraded":"2024-09-12T02:35:46.730944+0000","last_fullsized":"2024-09-12T02:35:46.730944+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:35:11.552386+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:35:11.552386+0000","last_clean_scrub_stamp":"2024-09-12T02:35:11.552386+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:02:47.229873+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":117,"num_objects":1,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,11,9],"acting":[7,5,11,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.d","version":"0'0","reported_seq":33,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-09-12T02:35:46.731020+0000","last_change":"2024-09-12T02:35:02.510571+0000","last_active":"2024-09-12T02:35:46.731020+0000","last_peered":"2024-09-12T02:35:46.731020+0000","last_clean":"2024-09-12T02:35:46.731020+0000","last_became_active":"2024-09-12T02:35:02.509673+0000","last_became_peered":"2024-09-12T02:35:02.509673+0000","last_unstale":"2024-09-12T02:35:46.731020+0000","last_undegraded":"2024-09-12T02:35:46.731020+0000","last_fullsized":"2024-09-12T02:35:46.731020+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:35:01.470375+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:35:01.470375+0000","last_clean_scrub_stamp":"2024-09-12T02:35:01.470375+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:12:17.515300+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,11],"acting":[7,1,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.c","version":"93'6","reported_seq":64,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-09-12T02:36:07.001773+0000","last_change":"2024-09-12T02:35:00.314045+0000","last_active":"2024-09-12T02:36:07.001773+0000","last_peered":"2024-09-12T02:36:07.001773+0000","last_clean":"2024-09-12T02:36:07.001773+0000","last_became_active":"2024-09-12T02:35:00.313626+0000","last_became_peered":"2024-09-12T02:35:00.313626+0000","last_unstale":"2024-09-12T02:36:07.001773+0000","last_undegraded":"2024-09-12T02:36:07.001773+0000","last_fullsized":"2024-09-12T02:36:07.001773+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:34:59.027857+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:34:59.027857+0000","last_clean_scrub_stamp":"2024-09-12T02:34:59.027857+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:57:45.282128+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1563,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":20,"num_read_kb":3,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,11,0],"acting":[2,11,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.a","version":"0'0","reported_seq":24,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-09-12T02:35:46.832774+0000","last_change":"2024-09-12T02:35:12.582905+0000","last_active":"2024-09-12T02:35:46.832774+0000","last_peered":"2024-09-12T02:35:46.832774+0000","last_clean":"2024-09-12T02:35:46.832774+0000","last_became_active":"2024-09-12T02:35:12.582451+0000","last_became_peered":"2024-09-12T02:35:12.582451+0000","last_unstale":"2024-09-12T02:35:46.832774+0000","last_undegraded":"2024-09-12T02:35:46.832774+0000","last_fullsized":"2024-09-12T02:35:46.832774+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:35:11.552386+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:35:11.552386+0000","last_clean_scrub_stamp":"2024-09-12T02:35:11.552386+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:53:40.811531+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,6,7],"acting":[1,5,6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":33,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-09-12T02:35:46.730875+0000","last_change":"2024-09-12T02:35:02.516173+0000","last_active":"2024-09-12T02:35:46.730875+0000","last_peered":"2024-09-12T02:35:46.730875+0000","last_clean":"2024-09-12T02:35:46.730875+0000","last_became_active":"2024-09-12T02:35:02.515802+0000","last_became_peered":"2024-09-12T02:35:02.515802+0000","last_unstale":"2024-09-12T02:35:46.730875+0000","last_undegraded":"2024-09-12T02:35:46.730875+0000","last_fullsized":"2024-09-12T02:35:46.730875+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:35:01.470375+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:35:01.470375+0000","last_clean_scrub_stamp":"2024-09-12T02:35:01.470375+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:52:22.469433+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3,5],"acting":[7,3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.d","version":"93'3","reported_seq":41,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-09-12T02:35:51.807065+0000","last_change":"2024-09-12T02:35:00.058472+0000","last_active":"2024-09-12T02:35:51.807065+0000","last_peered":"2024-09-12T02:35:51.807065+0000","last_clean":"2024-09-12T02:35:51.807065+0000","last_became_active":"2024-09-12T02:35:00.058144+0000","last_became_peered":"2024-09-12T02:35:00.058144+0000","last_unstale":"2024-09-12T02:35:51.807065+0000","last_undegraded":"2024-09-12T02:35:51.807065+0000","last_fullsized":"2024-09-12T02:35:51.807065+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:34:59.027857+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:34:59.027857+0000","last_clean_scrub_stamp":"2024-09-12T02:34:59.027857+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:20:05.124583+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,10,3],"acting":[5,10,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.b","version":"0'0","reported_seq":22,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-09-12T02:35:46.736099+0000","last_change":"2024-09-12T02:35:12.592804+0000","last_active":"2024-09-12T02:35:46.736099+0000","last_peered":"2024-09-12T02:35:46.736099+0000","last_clean":"2024-09-12T02:35:46.736099+0000","last_became_active":"2024-09-12T02:35:12.592417+0000","last_became_peered":"2024-09-12T02:35:12.592417+0000","last_unstale":"2024-09-12T02:35:46.736099+0000","last_undegraded":"2024-09-12T02:35:46.736099+0000","last_fullsized":"2024-09-12T02:35:46.736099+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:35:11.552386+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:35:11.552386+0000","last_clean_scrub_stamp":"2024-09-12T02:35:11.552386+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:30:01.965989+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,9,1,4],"acting":[0,9,1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.f","version":"0'0","reported_seq":33,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-09-12T02:35:46.731110+0000","last_change":"2024-09-12T02:35:02.511051+0000","last_active":"2024-09-12T02:35:46.731110+0000","last_peered":"2024-09-12T02:35:46.731110+0000","last_clean":"2024-09-12T02:35:46.731110+0000","last_became_active":"2024-09-12T02:35:02.509959+0000","last_became_peered":"2024-09-12T02:35:02.509959+0000","last_unstale":"2024-09-12T02:35:46.731110+0000","last_undegraded":"2024-09-12T02:35:46.731110+0000","last_fullsized":"2024-09-12T02:35:46.731110+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:35:01.470375+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:35:01.470375+0000","last_clean_scrub_stamp":"2024-09-12T02:35:01.470375+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:03:53.757074+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,11,8],"acting":[7,11,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.e","version":"93'5","reported_seq":41,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-09-12T02:35:51.805312+0000","last_change":"2024-09-12T02:35:00.060428+0000","last_active":"2024-09-12T02:35:51.805312+0000","last_peered":"2024-09-12T02:35:51.805312+0000","last_clean":"2024-09-12T02:35:51.805312+0000","last_became_active":"2024-09-12T02:35:00.060026+0000","last_became_peered":"2024-09-12T02:35:00.060026+0000","last_unstale":"2024-09-12T02:35:51.805312+0000","last_undegraded":"2024-09-12T02:35:51.805312+0000","last_fullsized":"2024-09-12T02:35:51.805312+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:34:59.027857+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:34:59.027857+0000","last_clean_scrub_stamp":"2024-09-12T02:34:59.027857+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:07:25.226210+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,2],"acting":[6,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.8","version":"0'0","reported_seq":24,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-09-12T02:35:46.727750+0000","last_change":"2024-09-12T02:35:12.579879+0000","last_active":"2024-09-12T02:35:46.727750+0000","last_peered":"2024-09-12T02:35:46.727750+0000","last_clean":"2024-09-12T02:35:46.727750+0000","last_became_active":"2024-09-12T02:35:12.579449+0000","last_became_peered":"2024-09-12T02:35:12.579449+0000","last_unstale":"2024-09-12T02:35:46.727750+0000","last_undegraded":"2024-09-12T02:35:46.727750+0000","last_fullsized":"2024-09-12T02:35:46.727750+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:35:11.552386+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:35:11.552386+0000","last_clean_scrub_stamp":"2024-09-12T02:35:11.552386+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:55:37.280959+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2,7,1],"acting":[5,2,7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.e","version":"0'0","reported_seq":31,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-09-12T02:35:46.730606+0000","last_change":"2024-09-12T02:35:02.509442+0000","last_active":"2024-09-12T02:35:46.730606+0000","last_peered":"2024-09-12T02:35:46.730606+0000","last_clean":"2024-09-12T02:35:46.730606+0000","last_became_active":"2024-09-12T02:35:02.509072+0000","last_became_peered":"2024-09-12T02:35:02.509072+0000","last_unstale":"2024-09-12T02:35:46.730606+0000","last_undegraded":"2024-09-12T02:35:46.730606+0000","last_fullsized":"2024-09-12T02:35:46.730606+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:35:01.470375+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:35:01.470375+0000","last_clean_scrub_stamp":"2024-09-12T02:35:01.470375+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:39:51.913895+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,5,4],"acting":[11,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"2.f","version":"93'2","reported_seq":39,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-09-12T02:35:51.765764+0000","last_change":"2024-09-12T02:35:00.060908+0000","last_active":"2024-09-12T02:35:51.765764+0000","last_peered":"2024-09-12T02:35:51.765764+0000","last_clean":"2024-09-12T02:35:51.765764+0000","last_became_active":"2024-09-12T02:35:00.060539+0000","last_became_peered":"2024-09-12T02:35:00.060539+0000","last_unstale":"2024-09-12T02:35:51.765764+0000","last_undegraded":"2024-09-12T02:35:51.765764+0000","last_fullsized":"2024-09-12T02:35:51.765764+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:34:59.027857+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:34:59.027857+0000","last_clean_scrub_stamp":"2024-09-12T02:34:59.027857+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:10:18.241911+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":2,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,5,4],"acting":[8,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"4.9","version":"0'0","reported_seq":24,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-09-12T02:35:46.727753+0000","last_change":"2024-09-12T02:35:12.585841+0000","last_active":"2024-09-12T02:35:46.727753+0000","last_peered":"2024-09-12T02:35:46.727753+0000","last_clean":"2024-09-12T02:35:46.727753+0000","last_became_active":"2024-09-12T02:35:12.585535+0000","last_became_peered":"2024-09-12T02:35:12.585535+0000","last_unstale":"2024-09-12T02:35:46.727753+0000","last_undegraded":"2024-09-12T02:35:46.727753+0000","last_fullsized":"2024-09-12T02:35:46.727753+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:35:11.552386+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:35:11.552386+0000","last_clean_scrub_stamp":"2024-09-12T02:35:11.552386+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:55:32.595165+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0,3,1],"acting":[5,0,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":38,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-09-12T02:35:46.833349+0000","last_change":"2024-09-12T02:35:46.833349+0000","last_active":"2024-09-12T02:35:46.833349+0000","last_peered":"2024-09-12T02:35:46.833349+0000","last_clean":"2024-09-12T02:35:46.833349+0000","last_became_active":"2024-09-12T02:35:46.832980+0000","last_became_peered":"2024-09-12T02:35:46.832980+0000","last_unstale":"2024-09-12T02:35:46.833349+0000","last_undegraded":"2024-09-12T02:35:46.833349+0000","last_fullsized":"2024-09-12T02:35:46.833349+0000","mapping_epoch":92,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":93,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:35:01.470375+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:35:01.470375+0000","last_clean_scrub_stamp":"2024-09-12T02:35:01.470375+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:35:51.086023+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,8,1],"acting":[5,8,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.10","version":"93'17","reported_seq":31,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-09-12T02:35:51.804992+0000","last_change":"2024-09-12T02:35:46.743046+0000","last_active":"2024-09-12T02:35:51.804992+0000","last_peered":"2024-09-12T02:35:51.804992+0000","last_clean":"2024-09-12T02:35:51.804992+0000","last_became_active":"2024-09-12T02:35:46.736070+0000","last_became_peered":"2024-09-12T02:35:46.736070+0000","last_unstale":"2024-09-12T02:35:51.804992+0000","last_undegraded":"2024-09-12T02:35:51.804992+0000","last_fullsized":"2024-09-12T02:35:51.804992+0000","mapping_epoch":92,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":93,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:34:59.027857+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:34:59.027857+0000","last_clean_scrub_stamp":"2024-09-12T02:34:59.027857+0000","objects_scrubbed":0,"log_size":17,"log_dups_size":0,"ondisk_log_size":17,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:51:55.849111+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":112,"num_objects":8,"num_object_clones":0,"num_object_copies":24,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":20,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":6,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,0,2],"acting":[11,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"4.16","version":"0'0","reported_seq":24,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-09-12T02:35:46.731987+0000","last_change":"2024-09-12T02:35:12.583676+0000","last_active":"2024-09-12T02:35:46.731987+0000","last_peered":"2024-09-12T02:35:46.731987+0000","last_clean":"2024-09-12T02:35:46.731987+0000","last_became_active":"2024-09-12T02:35:12.583238+0000","last_became_peered":"2024-09-12T02:35:12.583238+0000","last_unstale":"2024-09-12T02:35:46.731987+0000","last_undegraded":"2024-09-12T02:35:46.731987+0000","last_fullsized":"2024-09-12T02:35:46.731987+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:35:11.552386+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:35:11.552386+0000","last_clean_scrub_stamp":"2024-09-12T02:35:11.552386+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:30:04.751525+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,9,11],"acting":[6,3,9,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.10","version":"0'0","reported_seq":33,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-09-12T02:35:46.730027+0000","last_change":"2024-09-12T02:35:02.519325+0000","last_active":"2024-09-12T02:35:46.730027+0000","last_peered":"2024-09-12T02:35:46.730027+0000","last_clean":"2024-09-12T02:35:46.730027+0000","last_became_active":"2024-09-12T02:35:02.518951+0000","last_became_peered":"2024-09-12T02:35:02.518951+0000","last_unstale":"2024-09-12T02:35:46.730027+0000","last_undegraded":"2024-09-12T02:35:46.730027+0000","last_fullsized":"2024-09-12T02:35:46.730027+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:35:01.470375+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:35:01.470375+0000","last_clean_scrub_stamp":"2024-09-12T02:35:01.470375+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:39:59.070416+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,10],"acting":[7,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.11","version":"93'6","reported_seq":63,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-09-12T02:36:07.001511+0000","last_change":"2024-09-12T02:35:00.061897+0000","last_active":"2024-09-12T02:36:07.001511+0000","last_peered":"2024-09-12T02:36:07.001511+0000","last_clean":"2024-09-12T02:36:07.001511+0000","last_became_active":"2024-09-12T02:35:00.060657+0000","last_became_peered":"2024-09-12T02:35:00.060657+0000","last_unstale":"2024-09-12T02:36:07.001511+0000","last_undegraded":"2024-09-12T02:36:07.001511+0000","last_fullsized":"2024-09-12T02:36:07.001511+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:34:59.027857+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:34:59.027857+0000","last_clean_scrub_stamp":"2024-09-12T02:34:59.027857+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:21:57.471691+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":981,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":21,"num_read_kb":4,"num_write":6,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7,10],"acting":[4,7,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.17","version":"0'0","reported_seq":24,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-09-12T02:35:46.726072+0000","last_change":"2024-09-12T02:35:12.590637+0000","last_active":"2024-09-12T02:35:46.726072+0000","last_peered":"2024-09-12T02:35:46.726072+0000","last_clean":"2024-09-12T02:35:46.726072+0000","last_became_active":"2024-09-12T02:35:12.590242+0000","last_became_peered":"2024-09-12T02:35:12.590242+0000","last_unstale":"2024-09-12T02:35:46.726072+0000","last_undegraded":"2024-09-12T02:35:46.726072+0000","last_fullsized":"2024-09-12T02:35:46.726072+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:35:11.552386+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:35:11.552386+0000","last_clean_scrub_stamp":"2024-09-12T02:35:11.552386+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:33:12.490203+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,7,0,3],"acting":[9,7,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.13","version":"0'0","reported_seq":33,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-09-12T02:35:46.730727+0000","last_change":"2024-09-12T02:35:02.510040+0000","last_active":"2024-09-12T02:35:46.730727+0000","last_peered":"2024-09-12T02:35:46.730727+0000","last_clean":"2024-09-12T02:35:46.730727+0000","last_became_active":"2024-09-12T02:35:02.509591+0000","last_became_peered":"2024-09-12T02:35:02.509591+0000","last_unstale":"2024-09-12T02:35:46.730727+0000","last_undegraded":"2024-09-12T02:35:46.730727+0000","last_fullsized":"2024-09-12T02:35:46.730727+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:35:01.470375+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:35:01.470375+0000","last_clean_scrub_stamp":"2024-09-12T02:35:01.470375+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:38:22.209174+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4,6],"acting":[7,4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.12","version":"93'5","reported_seq":43,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-09-12T02:35:51.806839+0000","last_change":"2024-09-12T02:35:00.060895+0000","last_active":"2024-09-12T02:35:51.806839+0000","last_peered":"2024-09-12T02:35:51.806839+0000","last_clean":"2024-09-12T02:35:51.806839+0000","last_became_active":"2024-09-12T02:35:00.060483+0000","last_became_peered":"2024-09-12T02:35:00.060483+0000","last_unstale":"2024-09-12T02:35:51.806839+0000","last_undegraded":"2024-09-12T02:35:51.806839+0000","last_fullsized":"2024-09-12T02:35:51.806839+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:34:59.027857+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:34:59.027857+0000","last_clean_scrub_stamp":"2024-09-12T02:34:59.027857+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T13:23:30.719311+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":5,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3,7],"acting":[5,3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.14","version":"0'0","reported_seq":24,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-09-12T02:35:46.729449+0000","last_change":"2024-09-12T02:35:12.579605+0000","last_active":"2024-09-12T02:35:46.729449+0000","last_peered":"2024-09-12T02:35:46.729449+0000","last_clean":"2024-09-12T02:35:46.729449+0000","last_became_active":"2024-09-12T02:35:12.579147+0000","last_became_peered":"2024-09-12T02:35:12.579147+0000","last_unstale":"2024-09-12T02:35:46.729449+0000","last_undegraded":"2024-09-12T02:35:46.729449+0000","last_fullsized":"2024-09-12T02:35:46.729449+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:35:11.552386+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:35:11.552386+0000","last_clean_scrub_stamp":"2024-09-12T02:35:11.552386+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:19:19.454816+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,9,7,6],"acting":[11,9,7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":31,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-09-12T02:35:46.732838+0000","last_change":"2024-09-12T02:35:02.520230+0000","last_active":"2024-09-12T02:35:46.732838+0000","last_peered":"2024-09-12T02:35:46.732838+0000","last_clean":"2024-09-12T02:35:46.732838+0000","last_became_active":"2024-09-12T02:35:02.519885+0000","last_became_peered":"2024-09-12T02:35:02.519885+0000","last_unstale":"2024-09-12T02:35:46.732838+0000","last_undegraded":"2024-09-12T02:35:46.732838+0000","last_fullsized":"2024-09-12T02:35:46.732838+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:35:01.470375+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:35:01.470375+0000","last_clean_scrub_stamp":"2024-09-12T02:35:01.470375+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:50:53.031073+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,3],"acting":[6,7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.13","version":"93'9","reported_seq":49,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-09-12T02:35:51.975605+0000","last_change":"2024-09-12T02:35:00.066323+0000","last_active":"2024-09-12T02:35:51.975605+0000","last_peered":"2024-09-12T02:35:51.975605+0000","last_clean":"2024-09-12T02:35:51.975605+0000","last_became_active":"2024-09-12T02:35:00.065961+0000","last_became_peered":"2024-09-12T02:35:00.065961+0000","last_unstale":"2024-09-12T02:35:51.975605+0000","last_undegraded":"2024-09-12T02:35:51.975605+0000","last_fullsized":"2024-09-12T02:35:51.975605+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:34:59.027857+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:34:59.027857+0000","last_clean_scrub_stamp":"2024-09-12T02:34:59.027857+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:07:35.660223+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":68,"num_objects":6,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":13,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,10,3],"acting":[2,10,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.15","version":"0'0","reported_seq":24,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-09-12T02:35:46.728615+0000","last_change":"2024-09-12T02:35:12.583133+0000","last_active":"2024-09-12T02:35:46.728615+0000","last_peered":"2024-09-12T02:35:46.728615+0000","last_clean":"2024-09-12T02:35:46.728615+0000","last_became_active":"2024-09-12T02:35:12.582716+0000","last_became_peered":"2024-09-12T02:35:12.582716+0000","last_unstale":"2024-09-12T02:35:46.728615+0000","last_undegraded":"2024-09-12T02:35:46.728615+0000","last_fullsized":"2024-09-12T02:35:46.728615+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:35:11.552386+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:35:11.552386+0000","last_clean_scrub_stamp":"2024-09-12T02:35:11.552386+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:06:51.301261+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,8,3,6],"acting":[5,8,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.15","version":"0'0","reported_seq":31,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-09-12T02:35:46.726982+0000","last_change":"2024-09-12T02:35:02.514078+0000","last_active":"2024-09-12T02:35:46.726982+0000","last_peered":"2024-09-12T02:35:46.726982+0000","last_clean":"2024-09-12T02:35:46.726982+0000","last_became_active":"2024-09-12T02:35:02.513692+0000","last_became_peered":"2024-09-12T02:35:02.513692+0000","last_unstale":"2024-09-12T02:35:46.726982+0000","last_undegraded":"2024-09-12T02:35:46.726982+0000","last_fullsized":"2024-09-12T02:35:46.726982+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:35:01.470375+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:35:01.470375+0000","last_clean_scrub_stamp":"2024-09-12T02:35:01.470375+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T13:16:32.968171+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,11,7],"acting":[8,11,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"2.14","version":"93'31","reported_seq":108,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-09-12T02:36:08.003132+0000","last_change":"2024-09-12T02:35:00.060326+0000","last_active":"2024-09-12T02:36:08.003132+0000","last_peered":"2024-09-12T02:36:08.003132+0000","last_clean":"2024-09-12T02:36:08.003132+0000","last_became_active":"2024-09-12T02:35:00.059723+0000","last_became_peered":"2024-09-12T02:35:00.059723+0000","last_unstale":"2024-09-12T02:36:08.003132+0000","last_undegraded":"2024-09-12T02:36:08.003132+0000","last_fullsized":"2024-09-12T02:36:08.003132+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:34:59.027857+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:34:59.027857+0000","last_clean_scrub_stamp":"2024-09-12T02:34:59.027857+0000","objects_scrubbed":0,"log_size":31,"log_dups_size":0,"ondisk_log_size":31,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:58:30.390130+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":57258,"num_objects":6,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":40,"num_read_kb":76,"num_write":33,"num_write_kb":68,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,1,2],"acting":[10,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"4.12","version":"0'0","reported_seq":24,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-09-12T02:35:46.724979+0000","last_change":"2024-09-12T02:35:12.574485+0000","last_active":"2024-09-12T02:35:46.724979+0000","last_peered":"2024-09-12T02:35:46.724979+0000","last_clean":"2024-09-12T02:35:46.724979+0000","last_became_active":"2024-09-12T02:35:12.573883+0000","last_became_peered":"2024-09-12T02:35:12.573883+0000","last_unstale":"2024-09-12T02:35:46.724979+0000","last_undegraded":"2024-09-12T02:35:46.724979+0000","last_fullsized":"2024-09-12T02:35:46.724979+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:35:11.552386+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:35:11.552386+0000","last_clean_scrub_stamp":"2024-09-12T02:35:11.552386+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:57:00.001595+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,8,11,5],"acting":[9,8,11,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.14","version":"0'0","reported_seq":33,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-09-12T02:35:46.833848+0000","last_change":"2024-09-12T02:35:02.505882+0000","last_active":"2024-09-12T02:35:46.833848+0000","last_peered":"2024-09-12T02:35:46.833848+0000","last_clean":"2024-09-12T02:35:46.833848+0000","last_became_active":"2024-09-12T02:35:02.504513+0000","last_became_peered":"2024-09-12T02:35:02.504513+0000","last_unstale":"2024-09-12T02:35:46.833848+0000","last_undegraded":"2024-09-12T02:35:46.833848+0000","last_fullsized":"2024-09-12T02:35:46.833848+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:35:01.470375+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:35:01.470375+0000","last_clean_scrub_stamp":"2024-09-12T02:35:01.470375+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:25:58.446843+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,8,4],"acting":[1,8,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.15","version":"93'5","reported_seq":43,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-09-12T02:35:50.785586+0000","last_change":"2024-09-12T02:35:00.068581+0000","last_active":"2024-09-12T02:35:50.785586+0000","last_peered":"2024-09-12T02:35:50.785586+0000","last_clean":"2024-09-12T02:35:50.785586+0000","last_became_active":"2024-09-12T02:35:00.068196+0000","last_became_peered":"2024-09-12T02:35:00.068196+0000","last_unstale":"2024-09-12T02:35:50.785586+0000","last_undegraded":"2024-09-12T02:35:50.785586+0000","last_fullsized":"2024-09-12T02:35:50.785586+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:34:59.027857+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:34:59.027857+0000","last_clean_scrub_stamp":"2024-09-12T02:34:59.027857+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:02:27.807799+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":672,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":7,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0,10],"acting":[5,0,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.13","version":"0'0","reported_seq":24,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-09-12T02:35:46.832968+0000","last_change":"2024-09-12T02:35:12.592600+0000","last_active":"2024-09-12T02:35:46.832968+0000","last_peered":"2024-09-12T02:35:46.832968+0000","last_clean":"2024-09-12T02:35:46.832968+0000","last_became_active":"2024-09-12T02:35:12.591976+0000","last_became_peered":"2024-09-12T02:35:12.591976+0000","last_unstale":"2024-09-12T02:35:46.832968+0000","last_undegraded":"2024-09-12T02:35:46.832968+0000","last_fullsized":"2024-09-12T02:35:46.832968+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:35:11.552386+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:35:11.552386+0000","last_clean_scrub_stamp":"2024-09-12T02:35:11.552386+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T14:23:23.077090+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1,2,9],"acting":[4,1,2,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":30,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-09-12T02:35:46.736730+0000","last_change":"2024-09-12T02:35:02.523261+0000","last_active":"2024-09-12T02:35:46.736730+0000","last_peered":"2024-09-12T02:35:46.736730+0000","last_clean":"2024-09-12T02:35:46.736730+0000","last_became_active":"2024-09-12T02:35:02.522919+0000","last_became_peered":"2024-09-12T02:35:02.522919+0000","last_unstale":"2024-09-12T02:35:46.736730+0000","last_undegraded":"2024-09-12T02:35:46.736730+0000","last_fullsized":"2024-09-12T02:35:46.736730+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:35:01.470375+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:35:01.470375+0000","last_clean_scrub_stamp":"2024-09-12T02:35:01.470375+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:51:54.774700+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4,5],"acting":[0,4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.16","version":"93'4","reported_seq":41,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-09-12T02:35:51.805238+0000","last_change":"2024-09-12T02:35:00.061316+0000","last_active":"2024-09-12T02:35:51.805238+0000","last_peered":"2024-09-12T02:35:51.805238+0000","last_clean":"2024-09-12T02:35:51.805238+0000","last_became_active":"2024-09-12T02:35:00.059753+0000","last_became_peered":"2024-09-12T02:35:00.059753+0000","last_unstale":"2024-09-12T02:35:51.805238+0000","last_undegraded":"2024-09-12T02:35:51.805238+0000","last_fullsized":"2024-09-12T02:35:51.805238+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:34:59.027857+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:34:59.027857+0000","last_clean_scrub_stamp":"2024-09-12T02:34:59.027857+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:43:15.836929+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,2],"acting":[7,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.10","version":"0'0","reported_seq":24,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-09-12T02:35:46.724693+0000","last_change":"2024-09-12T02:35:12.587080+0000","last_active":"2024-09-12T02:35:46.724693+0000","last_peered":"2024-09-12T02:35:46.724693+0000","last_clean":"2024-09-12T02:35:46.724693+0000","last_became_active":"2024-09-12T02:35:12.586322+0000","last_became_peered":"2024-09-12T02:35:12.586322+0000","last_unstale":"2024-09-12T02:35:46.724693+0000","last_undegraded":"2024-09-12T02:35:46.724693+0000","last_fullsized":"2024-09-12T02:35:46.724693+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:35:11.552386+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:35:11.552386+0000","last_clean_scrub_stamp":"2024-09-12T02:35:11.552386+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T13:37:00.736698+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,0,2,4],"acting":[9,0,2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":33,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-09-12T02:35:46.834343+0000","last_change":"2024-09-12T02:35:02.510240+0000","last_active":"2024-09-12T02:35:46.834343+0000","last_peered":"2024-09-12T02:35:46.834343+0000","last_clean":"2024-09-12T02:35:46.834343+0000","last_became_active":"2024-09-12T02:35:02.509909+0000","last_became_peered":"2024-09-12T02:35:02.509909+0000","last_unstale":"2024-09-12T02:35:46.834343+0000","last_undegraded":"2024-09-12T02:35:46.834343+0000","last_fullsized":"2024-09-12T02:35:46.834343+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:35:01.470375+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:35:01.470375+0000","last_clean_scrub_stamp":"2024-09-12T02:35:01.470375+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:27:09.070786+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,10,9],"acting":[1,10,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.17","version":"93'4","reported_seq":75,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-09-12T02:36:08.002557+0000","last_change":"2024-09-12T02:35:00.054193+0000","last_active":"2024-09-12T02:36:08.002557+0000","last_peered":"2024-09-12T02:36:08.002557+0000","last_clean":"2024-09-12T02:36:08.002557+0000","last_became_active":"2024-09-12T02:35:00.053811+0000","last_became_peered":"2024-09-12T02:35:00.053811+0000","last_unstale":"2024-09-12T02:36:08.002557+0000","last_undegraded":"2024-09-12T02:36:08.002557+0000","last_fullsized":"2024-09-12T02:36:08.002557+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:34:59.027857+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:34:59.027857+0000","last_clean_scrub_stamp":"2024-09-12T02:34:59.027857+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:49:30.618015+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":180,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":34,"num_read_kb":34,"num_write":5,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,5,9],"acting":[10,5,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"4.11","version":"0'0","reported_seq":24,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-09-12T02:35:46.726195+0000","last_change":"2024-09-12T02:35:12.579772+0000","last_active":"2024-09-12T02:35:46.726195+0000","last_peered":"2024-09-12T02:35:46.726195+0000","last_clean":"2024-09-12T02:35:46.726195+0000","last_became_active":"2024-09-12T02:35:12.579257+0000","last_became_peered":"2024-09-12T02:35:12.579257+0000","last_unstale":"2024-09-12T02:35:46.726195+0000","last_undegraded":"2024-09-12T02:35:46.726195+0000","last_fullsized":"2024-09-12T02:35:46.726195+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:35:11.552386+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:35:11.552386+0000","last_clean_scrub_stamp":"2024-09-12T02:35:11.552386+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:08:40.588248+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,1,5],"acting":[3,7,1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1e","version":"0'0","reported_seq":22,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-09-12T02:35:46.736311+0000","last_change":"2024-09-12T02:35:12.585212+0000","last_active":"2024-09-12T02:35:46.736311+0000","last_peered":"2024-09-12T02:35:46.736311+0000","last_clean":"2024-09-12T02:35:46.736311+0000","last_became_active":"2024-09-12T02:35:12.583272+0000","last_became_peered":"2024-09-12T02:35:12.583272+0000","last_unstale":"2024-09-12T02:35:46.736311+0000","last_undegraded":"2024-09-12T02:35:46.736311+0000","last_fullsized":"2024-09-12T02:35:46.736311+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:35:11.552386+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:35:11.552386+0000","last_clean_scrub_stamp":"2024-09-12T02:35:11.552386+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:03:28.264565+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7,6,1],"acting":[0,7,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":34,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-09-12T02:35:46.725787+0000","last_change":"2024-09-12T02:35:02.512310+0000","last_active":"2024-09-12T02:35:46.725787+0000","last_peered":"2024-09-12T02:35:46.725787+0000","last_clean":"2024-09-12T02:35:46.725787+0000","last_became_active":"2024-09-12T02:35:02.511969+0000","last_became_peered":"2024-09-12T02:35:02.511969+0000","last_unstale":"2024-09-12T02:35:46.725787+0000","last_undegraded":"2024-09-12T02:35:46.725787+0000","last_fullsized":"2024-09-12T02:35:46.725787+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:35:01.470375+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:35:01.470375+0000","last_clean_scrub_stamp":"2024-09-12T02:35:01.470375+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:57:13.437331+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,3,10],"acting":[9,3,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"2.18","version":"93'3","reported_seq":41,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-09-12T02:35:51.806726+0000","last_change":"2024-09-12T02:35:00.059989+0000","last_active":"2024-09-12T02:35:51.806726+0000","last_peered":"2024-09-12T02:35:51.806726+0000","last_clean":"2024-09-12T02:35:51.806726+0000","last_became_active":"2024-09-12T02:35:00.059659+0000","last_became_peered":"2024-09-12T02:35:00.059659+0000","last_unstale":"2024-09-12T02:35:51.806726+0000","last_undegraded":"2024-09-12T02:35:51.806726+0000","last_fullsized":"2024-09-12T02:35:51.806726+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:34:59.027857+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:34:59.027857+0000","last_clean_scrub_stamp":"2024-09-12T02:34:59.027857+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:19:37.650136+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1,7],"acting":[5,1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1f","version":"0'0","reported_seq":24,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-09-12T02:35:46.729815+0000","last_change":"2024-09-12T02:35:12.589003+0000","last_active":"2024-09-12T02:35:46.729815+0000","last_peered":"2024-09-12T02:35:46.729815+0000","last_clean":"2024-09-12T02:35:46.729815+0000","last_became_active":"2024-09-12T02:35:12.588526+0000","last_became_peered":"2024-09-12T02:35:12.588526+0000","last_unstale":"2024-09-12T02:35:46.729815+0000","last_undegraded":"2024-09-12T02:35:46.729815+0000","last_fullsized":"2024-09-12T02:35:46.729815+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:35:11.552386+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:35:11.552386+0000","last_clean_scrub_stamp":"2024-09-12T02:35:11.552386+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T13:33:04.109195+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,4,9,0],"acting":[11,4,9,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":34,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-09-12T02:35:46.726170+0000","last_change":"2024-09-12T02:35:02.509603+0000","last_active":"2024-09-12T02:35:46.726170+0000","last_peered":"2024-09-12T02:35:46.726170+0000","last_clean":"2024-09-12T02:35:46.726170+0000","last_became_active":"2024-09-12T02:35:02.507799+0000","last_became_peered":"2024-09-12T02:35:02.507799+0000","last_unstale":"2024-09-12T02:35:46.726170+0000","last_undegraded":"2024-09-12T02:35:46.726170+0000","last_fullsized":"2024-09-12T02:35:46.726170+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:35:01.470375+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:35:01.470375+0000","last_clean_scrub_stamp":"2024-09-12T02:35:01.470375+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:27:06.148877+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,11,6],"acting":[3,11,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.19","version":"93'3","reported_seq":39,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-09-12T02:35:49.772426+0000","last_change":"2024-09-12T02:35:00.065183+0000","last_active":"2024-09-12T02:35:49.772426+0000","last_peered":"2024-09-12T02:35:49.772426+0000","last_clean":"2024-09-12T02:35:49.772426+0000","last_became_active":"2024-09-12T02:35:00.064234+0000","last_became_peered":"2024-09-12T02:35:00.064234+0000","last_unstale":"2024-09-12T02:35:49.772426+0000","last_undegraded":"2024-09-12T02:35:49.772426+0000","last_fullsized":"2024-09-12T02:35:49.772426+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:34:59.027857+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:34:59.027857+0000","last_clean_scrub_stamp":"2024-09-12T02:34:59.027857+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:25:27.578117+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,9],"acting":[6,4,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.1a","version":"93'7","reported_seq":44,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-09-12T02:35:50.787038+0000","last_change":"2024-09-12T02:35:00.061590+0000","last_active":"2024-09-12T02:35:50.787038+0000","last_peered":"2024-09-12T02:35:50.787038+0000","last_clean":"2024-09-12T02:35:50.787038+0000","last_became_active":"2024-09-12T02:35:00.061266+0000","last_became_peered":"2024-09-12T02:35:00.061266+0000","last_unstale":"2024-09-12T02:35:50.787038+0000","last_undegraded":"2024-09-12T02:35:50.787038+0000","last_fullsized":"2024-09-12T02:35:50.787038+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:34:59.027857+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:34:59.027857+0000","last_clean_scrub_stamp":"2024-09-12T02:34:59.027857+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:46:39.137050+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":9,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,8,6],"acting":[10,8,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.1b","version":"0'0","reported_seq":32,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-09-12T02:35:46.727806+0000","last_change":"2024-09-12T02:35:02.508064+0000","last_active":"2024-09-12T02:35:46.727806+0000","last_peered":"2024-09-12T02:35:46.727806+0000","last_clean":"2024-09-12T02:35:46.727806+0000","last_became_active":"2024-09-12T02:35:02.507737+0000","last_became_peered":"2024-09-12T02:35:02.507737+0000","last_unstale":"2024-09-12T02:35:46.727806+0000","last_undegraded":"2024-09-12T02:35:46.727806+0000","last_fullsized":"2024-09-12T02:35:46.727806+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:35:01.470375+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:35:01.470375+0000","last_clean_scrub_stamp":"2024-09-12T02:35:01.470375+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:39:53.655575+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,3],"acting":[5,4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1c","version":"0'0","reported_seq":24,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-09-12T02:35:46.731182+0000","last_change":"2024-09-12T02:35:12.588770+0000","last_active":"2024-09-12T02:35:46.731182+0000","last_peered":"2024-09-12T02:35:46.731182+0000","last_clean":"2024-09-12T02:35:46.731182+0000","last_became_active":"2024-09-12T02:35:12.588104+0000","last_became_peered":"2024-09-12T02:35:12.588104+0000","last_unstale":"2024-09-12T02:35:46.731182+0000","last_undegraded":"2024-09-12T02:35:46.731182+0000","last_fullsized":"2024-09-12T02:35:46.731182+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:35:11.552386+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:35:11.552386+0000","last_clean_scrub_stamp":"2024-09-12T02:35:11.552386+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:31:05.068737+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6,9,5],"acting":[2,6,9,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1b","version":"93'5","reported_seq":67,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-09-12T02:36:07.001592+0000","last_change":"2024-09-12T02:35:46.834966+0000","last_active":"2024-09-12T02:36:07.001592+0000","last_peered":"2024-09-12T02:36:07.001592+0000","last_clean":"2024-09-12T02:36:07.001592+0000","last_became_active":"2024-09-12T02:35:46.834652+0000","last_became_peered":"2024-09-12T02:35:46.834652+0000","last_unstale":"2024-09-12T02:36:07.001592+0000","last_undegraded":"2024-09-12T02:36:07.001592+0000","last_fullsized":"2024-09-12T02:36:07.001592+0000","mapping_epoch":92,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":93,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:34:59.027857+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:34:59.027857+0000","last_clean_scrub_stamp":"2024-09-12T02:34:59.027857+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:10:48.506122+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":622,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":19,"num_read_kb":2,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,7],"acting":[5,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.1a","version":"0'0","reported_seq":31,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-09-12T02:35:46.727762+0000","last_change":"2024-09-12T02:35:02.507569+0000","last_active":"2024-09-12T02:35:46.727762+0000","last_peered":"2024-09-12T02:35:46.727762+0000","last_clean":"2024-09-12T02:35:46.727762+0000","last_became_active":"2024-09-12T02:35:02.507244+0000","last_became_peered":"2024-09-12T02:35:02.507244+0000","last_unstale":"2024-09-12T02:35:46.727762+0000","last_undegraded":"2024-09-12T02:35:46.727762+0000","last_fullsized":"2024-09-12T02:35:46.727762+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:35:01.470375+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:35:01.470375+0000","last_clean_scrub_stamp":"2024-09-12T02:35:01.470375+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:50:26.959314+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,9,5],"acting":[8,9,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"4.1d","version":"0'0","reported_seq":24,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-09-12T02:35:46.731353+0000","last_change":"2024-09-12T02:35:12.577997+0000","last_active":"2024-09-12T02:35:46.731353+0000","last_peered":"2024-09-12T02:35:46.731353+0000","last_clean":"2024-09-12T02:35:46.731353+0000","last_became_active":"2024-09-12T02:35:12.577577+0000","last_became_peered":"2024-09-12T02:35:12.577577+0000","last_unstale":"2024-09-12T02:35:46.731353+0000","last_undegraded":"2024-09-12T02:35:46.731353+0000","last_fullsized":"2024-09-12T02:35:46.731353+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:35:11.552386+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:35:11.552386+0000","last_clean_scrub_stamp":"2024-09-12T02:35:11.552386+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:33:51.562986+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5,7,11],"acting":[2,5,7,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.20","version":"0'0","reported_seq":31,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-09-12T02:35:46.731459+0000","last_change":"2024-09-12T02:35:02.509328+0000","last_active":"2024-09-12T02:35:46.731459+0000","last_peered":"2024-09-12T02:35:46.731459+0000","last_clean":"2024-09-12T02:35:46.731459+0000","last_became_active":"2024-09-12T02:35:02.509000+0000","last_became_peered":"2024-09-12T02:35:02.509000+0000","last_unstale":"2024-09-12T02:35:46.731459+0000","last_undegraded":"2024-09-12T02:35:46.731459+0000","last_fullsized":"2024-09-12T02:35:46.731459+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:35:01.470375+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:35:01.470375+0000","last_clean_scrub_stamp":"2024-09-12T02:35:01.470375+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:46:49.170900+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,2,5],"acting":[11,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.21","version":"0'0","reported_seq":34,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-09-12T02:35:46.732374+0000","last_change":"2024-09-12T02:35:02.515252+0000","last_active":"2024-09-12T02:35:46.732374+0000","last_peered":"2024-09-12T02:35:46.732374+0000","last_clean":"2024-09-12T02:35:46.732374+0000","last_became_active":"2024-09-12T02:35:02.514959+0000","last_became_peered":"2024-09-12T02:35:02.514959+0000","last_unstale":"2024-09-12T02:35:46.732374+0000","last_undegraded":"2024-09-12T02:35:46.732374+0000","last_fullsized":"2024-09-12T02:35:46.732374+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:35:01.470375+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:35:01.470375+0000","last_clean_scrub_stamp":"2024-09-12T02:35:01.470375+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:42:02.769604+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5,4],"acting":[2,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.22","version":"0'0","reported_seq":34,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-09-12T02:35:46.731219+0000","last_change":"2024-09-12T02:35:02.516334+0000","last_active":"2024-09-12T02:35:46.731219+0000","last_peered":"2024-09-12T02:35:46.731219+0000","last_clean":"2024-09-12T02:35:46.731219+0000","last_became_active":"2024-09-12T02:35:02.515949+0000","last_became_peered":"2024-09-12T02:35:02.515949+0000","last_unstale":"2024-09-12T02:35:46.731219+0000","last_undegraded":"2024-09-12T02:35:46.731219+0000","last_fullsized":"2024-09-12T02:35:46.731219+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:35:01.470375+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:35:01.470375+0000","last_clean_scrub_stamp":"2024-09-12T02:35:01.470375+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:41:00.677038+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0],"acting":[2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.23","version":"0'0","reported_seq":30,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-09-12T02:35:46.736152+0000","last_change":"2024-09-12T02:35:02.516701+0000","last_active":"2024-09-12T02:35:46.736152+0000","last_peered":"2024-09-12T02:35:46.736152+0000","last_clean":"2024-09-12T02:35:46.736152+0000","last_became_active":"2024-09-12T02:35:02.516384+0000","last_became_peered":"2024-09-12T02:35:02.516384+0000","last_unstale":"2024-09-12T02:35:46.736152+0000","last_undegraded":"2024-09-12T02:35:46.736152+0000","last_fullsized":"2024-09-12T02:35:46.736152+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:35:01.470375+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:35:01.470375+0000","last_clean_scrub_stamp":"2024-09-12T02:35:01.470375+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:11:43.591371+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6,4],"acting":[0,6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.24","version":"0'0","reported_seq":37,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-09-12T02:35:46.737445+0000","last_change":"2024-09-12T02:35:46.737445+0000","last_active":"2024-09-12T02:35:46.737445+0000","last_peered":"2024-09-12T02:35:46.737445+0000","last_clean":"2024-09-12T02:35:46.737445+0000","last_became_active":"2024-09-12T02:35:46.736786+0000","last_became_peered":"2024-09-12T02:35:46.736786+0000","last_unstale":"2024-09-12T02:35:46.737445+0000","last_undegraded":"2024-09-12T02:35:46.737445+0000","last_fullsized":"2024-09-12T02:35:46.737445+0000","mapping_epoch":92,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":93,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:35:01.470375+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:35:01.470375+0000","last_clean_scrub_stamp":"2024-09-12T02:35:01.470375+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:25:54.143479+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,9,0],"acting":[6,9,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.25","version":"0'0","reported_seq":31,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-09-12T02:35:46.730787+0000","last_change":"2024-09-12T02:35:02.508237+0000","last_active":"2024-09-12T02:35:46.730787+0000","last_peered":"2024-09-12T02:35:46.730787+0000","last_clean":"2024-09-12T02:35:46.730787+0000","last_became_active":"2024-09-12T02:35:02.507911+0000","last_became_peered":"2024-09-12T02:35:02.507911+0000","last_unstale":"2024-09-12T02:35:46.730787+0000","last_undegraded":"2024-09-12T02:35:46.730787+0000","last_fullsized":"2024-09-12T02:35:46.730787+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:35:01.470375+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:35:01.470375+0000","last_clean_scrub_stamp":"2024-09-12T02:35:01.470375+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T13:13:38.863684+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,8,5],"acting":[11,8,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.26","version":"0'0","reported_seq":34,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-09-12T02:35:46.731366+0000","last_change":"2024-09-12T02:35:02.511218+0000","last_active":"2024-09-12T02:35:46.731366+0000","last_peered":"2024-09-12T02:35:46.731366+0000","last_clean":"2024-09-12T02:35:46.731366+0000","last_became_active":"2024-09-12T02:35:02.510533+0000","last_became_peered":"2024-09-12T02:35:02.510533+0000","last_unstale":"2024-09-12T02:35:46.731366+0000","last_undegraded":"2024-09-12T02:35:46.731366+0000","last_fullsized":"2024-09-12T02:35:46.731366+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:35:01.470375+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:35:01.470375+0000","last_clean_scrub_stamp":"2024-09-12T02:35:01.470375+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:16:00.293407+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,8,1],"acting":[2,8,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.27","version":"0'0","reported_seq":34,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-09-12T02:35:46.727062+0000","last_change":"2024-09-12T02:35:02.512531+0000","last_active":"2024-09-12T02:35:46.727062+0000","last_peered":"2024-09-12T02:35:46.727062+0000","last_clean":"2024-09-12T02:35:46.727062+0000","last_became_active":"2024-09-12T02:35:02.509796+0000","last_became_peered":"2024-09-12T02:35:02.509796+0000","last_unstale":"2024-09-12T02:35:46.727062+0000","last_undegraded":"2024-09-12T02:35:46.727062+0000","last_fullsized":"2024-09-12T02:35:46.727062+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:35:01.470375+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:35:01.470375+0000","last_clean_scrub_stamp":"2024-09-12T02:35:01.470375+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:56:42.613776+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4,2],"acting":[3,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.28","version":"0'0","reported_seq":32,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-09-12T02:35:46.727945+0000","last_change":"2024-09-12T02:35:02.507891+0000","last_active":"2024-09-12T02:35:46.727945+0000","last_peered":"2024-09-12T02:35:46.727945+0000","last_clean":"2024-09-12T02:35:46.727945+0000","last_became_active":"2024-09-12T02:35:02.507548+0000","last_became_peered":"2024-09-12T02:35:02.507548+0000","last_unstale":"2024-09-12T02:35:46.727945+0000","last_undegraded":"2024-09-12T02:35:46.727945+0000","last_fullsized":"2024-09-12T02:35:46.727945+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:35:01.470375+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:35:01.470375+0000","last_clean_scrub_stamp":"2024-09-12T02:35:01.470375+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:35:12.386932+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,9,3],"acting":[5,9,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.29","version":"0'0","reported_seq":34,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-09-12T02:35:46.726346+0000","last_change":"2024-09-12T02:35:02.518093+0000","last_active":"2024-09-12T02:35:46.726346+0000","last_peered":"2024-09-12T02:35:46.726346+0000","last_clean":"2024-09-12T02:35:46.726346+0000","last_became_active":"2024-09-12T02:35:02.512045+0000","last_became_peered":"2024-09-12T02:35:02.512045+0000","last_unstale":"2024-09-12T02:35:46.726346+0000","last_undegraded":"2024-09-12T02:35:46.726346+0000","last_fullsized":"2024-09-12T02:35:46.726346+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:35:01.470375+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:35:01.470375+0000","last_clean_scrub_stamp":"2024-09-12T02:35:01.470375+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:06:35.765876+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,11],"acting":[3,2,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2a","version":"0'0","reported_seq":33,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-09-12T02:35:46.832970+0000","last_change":"2024-09-12T02:35:02.516522+0000","last_active":"2024-09-12T02:35:46.832970+0000","last_peered":"2024-09-12T02:35:46.832970+0000","last_clean":"2024-09-12T02:35:46.832970+0000","last_became_active":"2024-09-12T02:35:02.516178+0000","last_became_peered":"2024-09-12T02:35:02.516178+0000","last_unstale":"2024-09-12T02:35:46.832970+0000","last_undegraded":"2024-09-12T02:35:46.832970+0000","last_fullsized":"2024-09-12T02:35:46.832970+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:35:01.470375+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:35:01.470375+0000","last_clean_scrub_stamp":"2024-09-12T02:35:01.470375+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:00:01.397055+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7,3],"acting":[1,7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2b","version":"0'0","reported_seq":31,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-09-12T02:35:46.732205+0000","last_change":"2024-09-12T02:35:02.513095+0000","last_active":"2024-09-12T02:35:46.732205+0000","last_peered":"2024-09-12T02:35:46.732205+0000","last_clean":"2024-09-12T02:35:46.732205+0000","last_became_active":"2024-09-12T02:35:02.512782+0000","last_became_peered":"2024-09-12T02:35:02.512782+0000","last_unstale":"2024-09-12T02:35:46.732205+0000","last_undegraded":"2024-09-12T02:35:46.732205+0000","last_fullsized":"2024-09-12T02:35:46.732205+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:35:01.470375+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:35:01.470375+0000","last_clean_scrub_stamp":"2024-09-12T02:35:01.470375+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:19:05.954874+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,0],"acting":[6,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.2c","version":"0'0","reported_seq":31,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-09-12T02:35:46.729553+0000","last_change":"2024-09-12T02:35:02.503773+0000","last_active":"2024-09-12T02:35:46.729553+0000","last_peered":"2024-09-12T02:35:46.729553+0000","last_clean":"2024-09-12T02:35:46.729553+0000","last_became_active":"2024-09-12T02:35:02.503386+0000","last_became_peered":"2024-09-12T02:35:02.503386+0000","last_unstale":"2024-09-12T02:35:46.729553+0000","last_undegraded":"2024-09-12T02:35:46.729553+0000","last_fullsized":"2024-09-12T02:35:46.729553+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:35:01.470375+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:35:01.470375+0000","last_clean_scrub_stamp":"2024-09-12T02:35:01.470375+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:15:44.995245+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,4,8],"acting":[11,4,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.2d","version":"0'0","reported_seq":34,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-09-12T02:35:46.731578+0000","last_change":"2024-09-12T02:35:02.516429+0000","last_active":"2024-09-12T02:35:46.731578+0000","last_peered":"2024-09-12T02:35:46.731578+0000","last_clean":"2024-09-12T02:35:46.731578+0000","last_became_active":"2024-09-12T02:35:02.515907+0000","last_became_peered":"2024-09-12T02:35:02.515907+0000","last_unstale":"2024-09-12T02:35:46.731578+0000","last_undegraded":"2024-09-12T02:35:46.731578+0000","last_fullsized":"2024-09-12T02:35:46.731578+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:35:01.470375+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:35:01.470375+0000","last_clean_scrub_stamp":"2024-09-12T02:35:01.470375+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:30:04.631809+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,6],"acting":[2,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2e","version":"0'0","reported_seq":34,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-09-12T02:35:46.725991+0000","last_change":"2024-09-12T02:35:02.505181+0000","last_active":"2024-09-12T02:35:46.725991+0000","last_peered":"2024-09-12T02:35:46.725991+0000","last_clean":"2024-09-12T02:35:46.725991+0000","last_became_active":"2024-09-12T02:35:02.504824+0000","last_became_peered":"2024-09-12T02:35:02.504824+0000","last_unstale":"2024-09-12T02:35:46.725991+0000","last_undegraded":"2024-09-12T02:35:46.725991+0000","last_fullsized":"2024-09-12T02:35:46.725991+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:35:01.470375+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:35:01.470375+0000","last_clean_scrub_stamp":"2024-09-12T02:35:01.470375+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T14:00:57.800731+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,1,10],"acting":[9,1,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.2f","version":"0'0","reported_seq":31,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-09-12T02:35:46.730269+0000","last_change":"2024-09-12T02:35:02.520568+0000","last_active":"2024-09-12T02:35:46.730269+0000","last_peered":"2024-09-12T02:35:46.730269+0000","last_clean":"2024-09-12T02:35:46.730269+0000","last_became_active":"2024-09-12T02:35:02.520244+0000","last_became_peered":"2024-09-12T02:35:02.520244+0000","last_unstale":"2024-09-12T02:35:46.730269+0000","last_undegraded":"2024-09-12T02:35:46.730269+0000","last_fullsized":"2024-09-12T02:35:46.730269+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:35:01.470375+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:35:01.470375+0000","last_clean_scrub_stamp":"2024-09-12T02:35:01.470375+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:42:25.130404+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,1,0],"acting":[11,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.30","version":"0'0","reported_seq":33,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-09-12T02:35:46.832590+0000","last_change":"2024-09-12T02:35:02.514647+0000","last_active":"2024-09-12T02:35:46.832590+0000","last_peered":"2024-09-12T02:35:46.832590+0000","last_clean":"2024-09-12T02:35:46.832590+0000","last_became_active":"2024-09-12T02:35:02.513930+0000","last_became_peered":"2024-09-12T02:35:02.513930+0000","last_unstale":"2024-09-12T02:35:46.832590+0000","last_undegraded":"2024-09-12T02:35:46.832590+0000","last_fullsized":"2024-09-12T02:35:46.832590+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:35:01.470375+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:35:01.470375+0000","last_clean_scrub_stamp":"2024-09-12T02:35:01.470375+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:56:32.701937+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7,0],"acting":[1,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.31","version":"0'0","reported_seq":30,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-09-12T02:35:46.735655+0000","last_change":"2024-09-12T02:35:02.512230+0000","last_active":"2024-09-12T02:35:46.735655+0000","last_peered":"2024-09-12T02:35:46.735655+0000","last_clean":"2024-09-12T02:35:46.735655+0000","last_became_active":"2024-09-12T02:35:02.508114+0000","last_became_peered":"2024-09-12T02:35:02.508114+0000","last_unstale":"2024-09-12T02:35:46.735655+0000","last_undegraded":"2024-09-12T02:35:46.735655+0000","last_fullsized":"2024-09-12T02:35:46.735655+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:35:01.470375+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:35:01.470375+0000","last_clean_scrub_stamp":"2024-09-12T02:35:01.470375+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:37:53.225043+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4,2],"acting":[0,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.32","version":"0'0","reported_seq":30,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-09-12T02:35:46.735951+0000","last_change":"2024-09-12T02:35:02.519176+0000","last_active":"2024-09-12T02:35:46.735951+0000","last_peered":"2024-09-12T02:35:46.735951+0000","last_clean":"2024-09-12T02:35:46.735951+0000","last_became_active":"2024-09-12T02:35:02.518437+0000","last_became_peered":"2024-09-12T02:35:02.518437+0000","last_unstale":"2024-09-12T02:35:46.735951+0000","last_undegraded":"2024-09-12T02:35:46.735951+0000","last_fullsized":"2024-09-12T02:35:46.735951+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:35:01.470375+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:35:01.470375+0000","last_clean_scrub_stamp":"2024-09-12T02:35:01.470375+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:46:32.198479+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,8,10],"acting":[0,8,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.33","version":"0'0","reported_seq":37,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-09-12T02:35:46.759182+0000","last_change":"2024-09-12T02:35:46.759182+0000","last_active":"2024-09-12T02:35:46.759182+0000","last_peered":"2024-09-12T02:35:46.759182+0000","last_clean":"2024-09-12T02:35:46.759182+0000","last_became_active":"2024-09-12T02:35:46.758619+0000","last_became_peered":"2024-09-12T02:35:46.758619+0000","last_unstale":"2024-09-12T02:35:46.759182+0000","last_undegraded":"2024-09-12T02:35:46.759182+0000","last_fullsized":"2024-09-12T02:35:46.759182+0000","mapping_epoch":92,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":93,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:35:01.470375+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:35:01.470375+0000","last_clean_scrub_stamp":"2024-09-12T02:35:01.470375+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:35:55.039970+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,10,9],"acting":[6,10,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.34","version":"0'0","reported_seq":11,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-09-12T02:35:46.759745+0000","last_change":"2024-09-12T02:35:46.758945+0000","last_active":"2024-09-12T02:35:46.759745+0000","last_peered":"2024-09-12T02:35:46.759745+0000","last_clean":"2024-09-12T02:35:46.759745+0000","last_became_active":"2024-09-12T02:35:46.758522+0000","last_became_peered":"2024-09-12T02:35:46.758522+0000","last_unstale":"2024-09-12T02:35:46.759745+0000","last_undegraded":"2024-09-12T02:35:46.759745+0000","last_fullsized":"2024-09-12T02:35:46.759745+0000","mapping_epoch":92,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":93,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:35:01.470375+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:35:01.470375+0000","last_clean_scrub_stamp":"2024-09-12T02:35:01.470375+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:18:47.916784+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,10,8],"acting":[9,10,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.35","version":"0'0","reported_seq":33,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-09-12T02:35:46.731013+0000","last_change":"2024-09-12T02:35:02.511777+0000","last_active":"2024-09-12T02:35:46.731013+0000","last_peered":"2024-09-12T02:35:46.731013+0000","last_clean":"2024-09-12T02:35:46.731013+0000","last_became_active":"2024-09-12T02:35:02.511341+0000","last_became_peered":"2024-09-12T02:35:02.511341+0000","last_unstale":"2024-09-12T02:35:46.731013+0000","last_undegraded":"2024-09-12T02:35:46.731013+0000","last_fullsized":"2024-09-12T02:35:46.731013+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:35:01.470375+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:35:01.470375+0000","last_clean_scrub_stamp":"2024-09-12T02:35:01.470375+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:51:52.093252+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,8,1],"acting":[7,8,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.36","version":"0'0","reported_seq":32,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-09-12T02:35:46.758078+0000","last_change":"2024-09-12T02:35:02.510278+0000","last_active":"2024-09-12T02:35:46.758078+0000","last_peered":"2024-09-12T02:35:46.758078+0000","last_clean":"2024-09-12T02:35:46.758078+0000","last_became_active":"2024-09-12T02:35:02.509959+0000","last_became_peered":"2024-09-12T02:35:02.509959+0000","last_unstale":"2024-09-12T02:35:46.758078+0000","last_undegraded":"2024-09-12T02:35:46.758078+0000","last_fullsized":"2024-09-12T02:35:46.758078+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:35:01.470375+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:35:01.470375+0000","last_clean_scrub_stamp":"2024-09-12T02:35:01.470375+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:34:55.086493+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,2,4],"acting":[10,2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.37","version":"0'0","reported_seq":33,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-09-12T02:35:46.834443+0000","last_change":"2024-09-12T02:35:02.508143+0000","last_active":"2024-09-12T02:35:46.834443+0000","last_peered":"2024-09-12T02:35:46.834443+0000","last_clean":"2024-09-12T02:35:46.834443+0000","last_became_active":"2024-09-12T02:35:02.507096+0000","last_became_peered":"2024-09-12T02:35:02.507096+0000","last_unstale":"2024-09-12T02:35:46.834443+0000","last_undegraded":"2024-09-12T02:35:46.834443+0000","last_fullsized":"2024-09-12T02:35:46.834443+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:35:01.470375+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:35:01.470375+0000","last_clean_scrub_stamp":"2024-09-12T02:35:01.470375+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:04:15.687448+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,11],"acting":[1,5,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.38","version":"0'0","reported_seq":34,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-09-12T02:35:46.726064+0000","last_change":"2024-09-12T02:35:02.517013+0000","last_active":"2024-09-12T02:35:46.726064+0000","last_peered":"2024-09-12T02:35:46.726064+0000","last_clean":"2024-09-12T02:35:46.726064+0000","last_became_active":"2024-09-12T02:35:02.511344+0000","last_became_peered":"2024-09-12T02:35:02.511344+0000","last_unstale":"2024-09-12T02:35:46.726064+0000","last_undegraded":"2024-09-12T02:35:46.726064+0000","last_fullsized":"2024-09-12T02:35:46.726064+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:35:01.470375+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:35:01.470375+0000","last_clean_scrub_stamp":"2024-09-12T02:35:01.470375+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:35:56.829248+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5,10],"acting":[3,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.39","version":"0'0","reported_seq":33,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-09-12T02:35:46.730082+0000","last_change":"2024-09-12T02:35:02.515221+0000","last_active":"2024-09-12T02:35:46.730082+0000","last_peered":"2024-09-12T02:35:46.730082+0000","last_clean":"2024-09-12T02:35:46.730082+0000","last_became_active":"2024-09-12T02:35:02.514878+0000","last_became_peered":"2024-09-12T02:35:02.514878+0000","last_unstale":"2024-09-12T02:35:46.730082+0000","last_undegraded":"2024-09-12T02:35:46.730082+0000","last_fullsized":"2024-09-12T02:35:46.730082+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:35:01.470375+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:35:01.470375+0000","last_clean_scrub_stamp":"2024-09-12T02:35:01.470375+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:30:49.794740+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,9,5],"acting":[7,9,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3a","version":"0'0","reported_seq":32,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-09-12T02:35:46.757709+0000","last_change":"2024-09-12T02:35:02.506118+0000","last_active":"2024-09-12T02:35:46.757709+0000","last_peered":"2024-09-12T02:35:46.757709+0000","last_clean":"2024-09-12T02:35:46.757709+0000","last_became_active":"2024-09-12T02:35:02.505802+0000","last_became_peered":"2024-09-12T02:35:02.505802+0000","last_unstale":"2024-09-12T02:35:46.757709+0000","last_undegraded":"2024-09-12T02:35:46.757709+0000","last_fullsized":"2024-09-12T02:35:46.757709+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:35:01.470375+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:35:01.470375+0000","last_clean_scrub_stamp":"2024-09-12T02:35:01.470375+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:39:29.295096+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,9,4],"acting":[10,9,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.3b","version":"0'0","reported_seq":31,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-09-12T02:35:46.726785+0000","last_change":"2024-09-12T02:35:02.514743+0000","last_active":"2024-09-12T02:35:46.726785+0000","last_peered":"2024-09-12T02:35:46.726785+0000","last_clean":"2024-09-12T02:35:46.726785+0000","last_became_active":"2024-09-12T02:35:02.514299+0000","last_became_peered":"2024-09-12T02:35:02.514299+0000","last_unstale":"2024-09-12T02:35:46.726785+0000","last_undegraded":"2024-09-12T02:35:46.726785+0000","last_fullsized":"2024-09-12T02:35:46.726785+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:35:01.470375+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:35:01.470375+0000","last_clean_scrub_stamp":"2024-09-12T02:35:01.470375+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T13:31:30.632444+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,3,6],"acting":[8,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.3c","version":"0'0","reported_seq":32,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-09-12T02:35:46.833438+0000","last_change":"2024-09-12T02:35:02.504682+0000","last_active":"2024-09-12T02:35:46.833438+0000","last_peered":"2024-09-12T02:35:46.833438+0000","last_clean":"2024-09-12T02:35:46.833438+0000","last_became_active":"2024-09-12T02:35:02.504154+0000","last_became_peered":"2024-09-12T02:35:02.504154+0000","last_unstale":"2024-09-12T02:35:46.833438+0000","last_undegraded":"2024-09-12T02:35:46.833438+0000","last_fullsized":"2024-09-12T02:35:46.833438+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:35:01.470375+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:35:01.470375+0000","last_clean_scrub_stamp":"2024-09-12T02:35:01.470375+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:46:38.038655+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,8,2],"acting":[4,8,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.3d","version":"0'0","reported_seq":30,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-09-12T02:35:46.736081+0000","last_change":"2024-09-12T02:35:02.513117+0000","last_active":"2024-09-12T02:35:46.736081+0000","last_peered":"2024-09-12T02:35:46.736081+0000","last_clean":"2024-09-12T02:35:46.736081+0000","last_became_active":"2024-09-12T02:35:02.512824+0000","last_became_peered":"2024-09-12T02:35:02.512824+0000","last_unstale":"2024-09-12T02:35:46.736081+0000","last_undegraded":"2024-09-12T02:35:46.736081+0000","last_fullsized":"2024-09-12T02:35:46.736081+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:35:01.470375+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:35:01.470375+0000","last_clean_scrub_stamp":"2024-09-12T02:35:01.470375+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:18:22.413221+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,1],"acting":[0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3e","version":"0'0","reported_seq":30,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-09-12T02:35:46.736424+0000","last_change":"2024-09-12T02:35:02.517799+0000","last_active":"2024-09-12T02:35:46.736424+0000","last_peered":"2024-09-12T02:35:46.736424+0000","last_clean":"2024-09-12T02:35:46.736424+0000","last_became_active":"2024-09-12T02:35:02.513361+0000","last_became_peered":"2024-09-12T02:35:02.513361+0000","last_unstale":"2024-09-12T02:35:46.736424+0000","last_undegraded":"2024-09-12T02:35:46.736424+0000","last_fullsized":"2024-09-12T02:35:46.736424+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:35:01.470375+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:35:01.470375+0000","last_clean_scrub_stamp":"2024-09-12T02:35:01.470375+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T13:39:37.894677+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,11,10],"acting":[0,11,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3f","version":"0'0","reported_seq":31,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-09-12T02:35:46.730144+0000","last_change":"2024-09-12T02:35:02.520715+0000","last_active":"2024-09-12T02:35:46.730144+0000","last_peered":"2024-09-12T02:35:46.730144+0000","last_clean":"2024-09-12T02:35:46.730144+0000","last_became_active":"2024-09-12T02:35:02.520348+0000","last_became_peered":"2024-09-12T02:35:02.520348+0000","last_unstale":"2024-09-12T02:35:46.730144+0000","last_undegraded":"2024-09-12T02:35:46.730144+0000","last_fullsized":"2024-09-12T02:35:46.730144+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:35:01.470375+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:35:01.470375+0000","last_clean_scrub_stamp":"2024-09-12T02:35:01.470375+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:08:10.982486+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,1,0],"acting":[11,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]}],"pool_stats":[{"poolid":4,"num_pg":32,"stat_sum":{"num_bytes":234,"num_objects":2,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":32768,"data_stored":32768,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":2,"ondisk_log_size":2,"up":128,"acting":128,"num_store_stats":12},{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":192,"acting":192,"num_store_stats":12},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":64859,"num_objects":98,"num_object_clones":0,"num_object_copies":294,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":98,"num_whiteouts":0,"num_read":202,"num_read_kb":173,"num_write":235,"num_write_kb":133,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":5,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":66,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":552960,"data_stored":194577,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":206,"ondisk_log_size":206,"up":96,"acting":96,"num_store_stats":12},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":136,"num_read_kb":119,"num_write":181,"num_write_kb":2938,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":1180736,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":3563520,"data_stored":3542208,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":137,"ondisk_log_size":137,"up":3,"acting":3,"num_store_stats":8}],"osd_stats":[{"osd":11,"up_from":77,"seq":330712481817,"num_pgs":29,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":28072,"kb_used_data":1048,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717080,"statfs":{"total":95995035648,"available":95966289920,"internally_reserved":0,"allocated":1073152,"data_stored":526819,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1596,"internal_metadata":27654596},"hb_peers":[0,1,2,4,5,6,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":10,"up_from":70,"seq":300647710751,"num_pgs":32,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":28736,"kb_used_data":1712,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93716416,"statfs":{"total":95995035648,"available":95965609984,"internally_reserved":0,"allocated":1753088,"data_stored":1170781,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1600,"internal_metadata":27654592},"hb_peers":[0,1,2,3,4,5,6,8,9,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":9,"up_from":65,"seq":279172874275,"num_pgs":36,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":28092,"kb_used_data":1068,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717060,"statfs":{"total":95995035648,"available":95966269440,"internally_reserved":0,"allocated":1093632,"data_stored":530340,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1600,"internal_metadata":27654592},"hb_peers":[0,1,2,3,4,5,7,8,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":8,"up_from":57,"seq":244813135914,"num_pgs":29,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":28076,"kb_used_data":1052,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717076,"statfs":{"total":95995035648,"available":95966285824,"internally_reserved":0,"allocated":1077248,"data_stored":526510,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4,5,6,7,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":7,"up_from":50,"seq":214748364846,"num_pgs":36,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":28668,"kb_used_data":1644,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93716484,"statfs":{"total":95995035648,"available":95965679616,"internally_reserved":0,"allocated":1683456,"data_stored":1123514,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":27654602},"hb_peers":[1,2,3,4,5,6,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":6,"up_from":45,"seq":193273528372,"num_pgs":32,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":28064,"kb_used_data":1040,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717088,"statfs":{"total":95995035648,"available":95966298112,"internally_reserved":0,"allocated":1064960,"data_stored":522141,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,5,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":5,"up_from":38,"seq":163208757306,"num_pgs":45,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":28676,"kb_used_data":1652,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93716476,"statfs":{"total":95995035648,"available":95965671424,"internally_reserved":0,"allocated":1691648,"data_stored":1118310,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":4,"up_from":33,"seq":141733920832,"num_pgs":35,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":36400,"kb_used_data":1056,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":93708752,"statfs":{"total":95995035648,"available":95957762048,"internally_reserved":0,"allocated":1081344,"data_stored":526837,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":36174277},"hb_peers":[1,2,3,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":3,"up_from":26,"seq":111669149764,"num_pgs":40,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":32236,"kb_used_data":1052,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":93712916,"statfs":{"total":95995035648,"available":95962025984,"internally_reserved":0,"allocated":1077248,"data_stored":521456,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":31914439},"hb_peers":[0,1,2,4,5,6,7,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":18,"seq":77309411403,"num_pgs":35,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":28136,"kb_used_data":1112,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717016,"statfs":{"total":95995035648,"available":95966224384,"internally_reserved":0,"allocated":1138688,"data_stored":580027,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,3,4,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":13,"seq":55834574928,"num_pgs":35,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":28124,"kb_used_data":1100,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717028,"statfs":{"total":95995035648,"available":95966236672,"internally_reserved":0,"allocated":1126400,"data_stored":580429,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,2,3,4,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":8,"seq":34359738451,"num_pgs":35,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":32248,"kb_used_data":1064,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":93712904,"statfs":{"total":95995035648,"available":95962013696,"internally_reserved":0,"allocated":1089536,"data_stored":523597,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[1,2,3,4,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":40960,"data_stored":2571,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":77824,"data_stored":59403,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":90112,"data_stored":59001,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":28672,"data_stored":430,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":28672,"data_stored":1715,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":45056,"data_stored":2820,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":1115,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":32768,"data_stored":3928,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":24576,"data_stored":1388,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":9,"total":0,"available":0,"internally_reserved":0,"allocated":36864,"data_stored":1122,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":110592,"data_stored":59387,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":11,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":1697,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":9,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":11,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":4096,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":4096,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":8192,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":4096,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":9,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":8192,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":11,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":4096,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-12T02:36:11.351 DEBUG:teuthology.orchestra.run.smithi039:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc shell --fsid 4954ed46-70ae-11ef-bcea-c7b262605968 -- ceph pg dump --format=json 2024-09-12T02:36:11.731 INFO:teuthology.orchestra.run.smithi039.stderr:Inferring config /var/lib/ceph/4954ed46-70ae-11ef-bcea-c7b262605968/mon.a/config 2024-09-12T02:36:12.009 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 02:36:11 smithi039 ceph-mon[30515]: from='client.14739 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-09-12T02:36:12.013 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 12 02:36:11 smithi172 ceph-mon[35609]: from='client.14739 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-09-12T02:36:12.198 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 12 02:36:11 smithi044 ceph-mon[35411]: from='client.14739 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-09-12T02:36:12.278 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:36:12.264+0000 7f6f26600640 1 -- 172.21.15.39:0/3351425691 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f6f201049a0 msgr2=0x7f6f201089f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:36:12.278 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:36:12.264+0000 7f6f26600640 1 --2- 172.21.15.39:0/3351425691 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f6f201049a0 0x7f6f201089f0 secure :-1 s=READY pgs=190 cs=0 l=1 rev1=1 crypto rx=0x7f6f08009900 tx=0x7f6f0802a3f0 comp rx=0 tx=0).stop 2024-09-12T02:36:12.278 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:36:12.264+0000 7f6f26600640 1 -- 172.21.15.39:0/3351425691 shutdown_connections 2024-09-12T02:36:12.278 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:36:12.264+0000 7f6f26600640 1 --2- 172.21.15.39:0/3351425691 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f6f20109120 0x7f6f20110ca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:36:12.278 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:36:12.264+0000 7f6f26600640 1 --2- 172.21.15.39:0/3351425691 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f6f201049a0 0x7f6f201089f0 unknown :-1 s=CLOSED pgs=190 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:36:12.278 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:36:12.264+0000 7f6f26600640 1 --2- 172.21.15.39:0/3351425691 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f6f20103ff0 0x7f6f201043d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:36:12.278 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:36:12.264+0000 7f6f26600640 1 -- 172.21.15.39:0/3351425691 >> 172.21.15.39:0/3351425691 conn(0x7f6f200ffa90 msgr2=0x7f6f20101eb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:36:12.279 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:36:12.264+0000 7f6f26600640 1 -- 172.21.15.39:0/3351425691 shutdown_connections 2024-09-12T02:36:12.279 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:36:12.264+0000 7f6f26600640 1 -- 172.21.15.39:0/3351425691 wait complete. 2024-09-12T02:36:12.279 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:36:12.265+0000 7f6f26600640 1 Processor -- start 2024-09-12T02:36:12.279 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:36:12.265+0000 7f6f26600640 1 -- start start 2024-09-12T02:36:12.279 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:36:12.266+0000 7f6f26600640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f6f20103ff0 0x7f6f2019a650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:36:12.279 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:36:12.266+0000 7f6f26600640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f6f201049a0 0x7f6f2019ab90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:36:12.279 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:36:12.266+0000 7f6f26600640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f6f20109120 0x7f6f2019ef20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:36:12.279 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:36:12.266+0000 7f6f26600640 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 -- 0x7f6f20114170 con 0x7f6f20109120 2024-09-12T02:36:12.279 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:36:12.266+0000 7f6f26600640 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x7f6f20113ff0 con 0x7f6f20103ff0 2024-09-12T02:36:12.279 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:36:12.266+0000 7f6f26600640 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7f6f201142f0 con 0x7f6f201049a0 2024-09-12T02:36:12.279 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:36:12.266+0000 7f6f1fe00640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f6f20109120 0x7f6f2019ef20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:36:12.280 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:36:12.266+0000 7f6f1f400640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f6f20103ff0 0x7f6f2019a650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:36:12.280 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:36:12.266+0000 7f6f1fe00640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f6f20109120 0x7f6f2019ef20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.39:3300/0 says I am v2:172.21.15.39:40396/0 (socket says 172.21.15.39:40396) 2024-09-12T02:36:12.280 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:36:12.266+0000 7f6f17e00640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f6f201049a0 0x7f6f2019ab90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:36:12.280 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:36:12.266+0000 7f6f1fe00640 1 -- 172.21.15.39:0/34197160 learned_addr learned my addr 172.21.15.39:0/34197160 (peer_addr_for_me v2:172.21.15.39:0/0) 2024-09-12T02:36:12.280 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:36:12.267+0000 7f6f1f400640 1 -- 172.21.15.39:0/34197160 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f6f201049a0 msgr2=0x7f6f2019ab90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:36:12.280 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:36:12.267+0000 7f6f1f400640 1 --2- 172.21.15.39:0/34197160 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f6f201049a0 0x7f6f2019ab90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:36:12.280 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:36:12.267+0000 7f6f1f400640 1 -- 172.21.15.39:0/34197160 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f6f20109120 msgr2=0x7f6f2019ef20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:36:12.280 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:36:12.267+0000 7f6f1f400640 1 --2- 172.21.15.39:0/34197160 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f6f20109120 0x7f6f2019ef20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:36:12.280 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:36:12.267+0000 7f6f1f400640 1 -- 172.21.15.39:0/34197160 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6f2019f600 con 0x7f6f20103ff0 2024-09-12T02:36:12.280 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:36:12.267+0000 7f6f1fe00640 1 --2- 172.21.15.39:0/34197160 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f6f20109120 0x7f6f2019ef20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-12T02:36:12.281 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:36:12.267+0000 7f6f17e00640 1 --2- 172.21.15.39:0/34197160 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f6f201049a0 0x7f6f2019ab90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-12T02:36:12.281 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:36:12.267+0000 7f6f1f400640 1 --2- 172.21.15.39:0/34197160 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f6f20103ff0 0x7f6f2019a650 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7f6f1000e9f0 tx=0x7f6f1000eeb0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:36:12.281 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:36:12.267+0000 7f6f1cc00640 1 -- 172.21.15.39:0/34197160 <== mon.2 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6f1000ccc0 con 0x7f6f20103ff0 2024-09-12T02:36:12.281 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:36:12.267+0000 7f6f26600640 1 -- 172.21.15.39:0/34197160 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f6f2019f8f0 con 0x7f6f20103ff0 2024-09-12T02:36:12.281 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:36:12.267+0000 7f6f1cc00640 1 -- 172.21.15.39:0/34197160 <== mon.2 v2:172.21.15.44:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f6f10010910 con 0x7f6f20103ff0 2024-09-12T02:36:12.281 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:36:12.267+0000 7f6f1cc00640 1 -- 172.21.15.39:0/34197160 <== mon.2 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6f10018960 con 0x7f6f20103ff0 2024-09-12T02:36:12.281 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:36:12.267+0000 7f6f26600640 1 -- 172.21.15.39:0/34197160 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f6f201a71d0 con 0x7f6f20103ff0 2024-09-12T02:36:12.281 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:36:12.268+0000 7f6f26600640 1 -- 172.21.15.39:0/34197160 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f6f201043d0 con 0x7f6f20103ff0 2024-09-12T02:36:12.281 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:36:12.270+0000 7f6f1cc00640 1 -- 172.21.15.39:0/34197160 <== mon.2 v2:172.21.15.44:3300/0 4 ==== mgrmap(e 17) ==== 137884+0+0 (secure 0 0 0) 0x7f6f10010ac0 con 0x7f6f20103ff0 2024-09-12T02:36:12.281 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:36:12.272+0000 7f6f1cc00640 1 --2- 172.21.15.39:0/34197160 >> [v2:172.21.15.39:6800/1725006999,v1:172.21.15.39:6801/1725006999] conn(0x7f6f040a2c10 0x7f6f040a50d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:36:12.281 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:36:12.272+0000 7f6f1cc00640 1 -- 172.21.15.39:0/34197160 <== mon.2 v2:172.21.15.44:3300/0 5 ==== osd_map(93..93 src has 1..93) ==== 9092+0+0 (secure 0 0 0) 0x7f6f100cfd80 con 0x7f6f20103ff0 2024-09-12T02:36:12.282 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:36:12.272+0000 7f6f17e00640 1 --2- 172.21.15.39:0/34197160 >> [v2:172.21.15.39:6800/1725006999,v1:172.21.15.39:6801/1725006999] conn(0x7f6f040a2c10 0x7f6f040a50d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:36:12.282 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:36:12.273+0000 7f6f17e00640 1 --2- 172.21.15.39:0/34197160 >> [v2:172.21.15.39:6800/1725006999,v1:172.21.15.39:6801/1725006999] conn(0x7f6f040a2c10 0x7f6f040a50d0 secure :-1 s=READY pgs=174 cs=0 l=1 rev1=1 crypto rx=0x7f6f08000c00 tx=0x7f6f08031510 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:36:12.282 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:36:12.274+0000 7f6f1cc00640 1 -- 172.21.15.39:0/34197160 <== mon.2 v2:172.21.15.44:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7f6f1009c1d0 con 0x7f6f20103ff0 2024-09-12T02:36:12.458 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:36:12.457+0000 7f6f26600640 1 -- 172.21.15.39:0/34197160 --> [v2:172.21.15.39:6800/1725006999,v1:172.21.15.39:6801/1725006999] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7f6f2010c3c0 con 0x7f6f040a2c10 2024-09-12T02:36:12.466 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:36:12.466+0000 7f6f1cc00640 1 -- 172.21.15.39:0/34197160 <== mgr.14150 v2:172.21.15.39:6800/1725006999 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+340391 (secure 0 0 0) 0x7f6f2010c3c0 con 0x7f6f040a2c10 2024-09-12T02:36:12.470 INFO:teuthology.orchestra.run.smithi039.stdout: 2024-09-12T02:36:12.472 INFO:teuthology.orchestra.run.smithi039.stderr:dumped all 2024-09-12T02:36:12.474 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:36:12.471+0000 7f6f26600640 1 -- 172.21.15.39:0/34197160 >> [v2:172.21.15.39:6800/1725006999,v1:172.21.15.39:6801/1725006999] conn(0x7f6f040a2c10 msgr2=0x7f6f040a50d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:36:12.474 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:36:12.471+0000 7f6f26600640 1 --2- 172.21.15.39:0/34197160 >> [v2:172.21.15.39:6800/1725006999,v1:172.21.15.39:6801/1725006999] conn(0x7f6f040a2c10 0x7f6f040a50d0 secure :-1 s=READY pgs=174 cs=0 l=1 rev1=1 crypto rx=0x7f6f08000c00 tx=0x7f6f08031510 comp rx=0 tx=0).stop 2024-09-12T02:36:12.474 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:36:12.471+0000 7f6f26600640 1 -- 172.21.15.39:0/34197160 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f6f20103ff0 msgr2=0x7f6f2019a650 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:36:12.474 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:36:12.471+0000 7f6f26600640 1 --2- 172.21.15.39:0/34197160 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f6f20103ff0 0x7f6f2019a650 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7f6f1000e9f0 tx=0x7f6f1000eeb0 comp rx=0 tx=0).stop 2024-09-12T02:36:12.474 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:36:12.471+0000 7f6f26600640 1 -- 172.21.15.39:0/34197160 shutdown_connections 2024-09-12T02:36:12.474 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:36:12.471+0000 7f6f26600640 1 --2- 172.21.15.39:0/34197160 >> [v2:172.21.15.39:6800/1725006999,v1:172.21.15.39:6801/1725006999] conn(0x7f6f040a2c10 0x7f6f040a50d0 unknown :-1 s=CLOSED pgs=174 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:36:12.474 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:36:12.471+0000 7f6f26600640 1 --2- 172.21.15.39:0/34197160 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f6f20109120 0x7f6f2019ef20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:36:12.474 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:36:12.471+0000 7f6f26600640 1 --2- 172.21.15.39:0/34197160 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f6f201049a0 0x7f6f2019ab90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:36:12.474 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:36:12.471+0000 7f6f26600640 1 --2- 172.21.15.39:0/34197160 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f6f20103ff0 0x7f6f2019a650 unknown :-1 s=CLOSED pgs=86 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:36:12.474 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:36:12.471+0000 7f6f26600640 1 -- 172.21.15.39:0/34197160 >> 172.21.15.39:0/34197160 conn(0x7f6f200ffa90 msgr2=0x7f6f20100da0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:36:12.475 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:36:12.471+0000 7f6f26600640 1 -- 172.21.15.39:0/34197160 shutdown_connections 2024-09-12T02:36:12.475 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:36:12.471+0000 7f6f26600640 1 -- 172.21.15.39:0/34197160 wait complete. 2024-09-12T02:36:12.979 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 02:36:12 smithi039 ceph-mon[30515]: pgmap v336: 129 pgs: 129 active+clean; 640 KiB data, 347 MiB used, 1.0 TiB / 1.0 TiB avail; 7.4 KiB/s rd, 3.6 KiB/s wr, 11 op/s 2024-09-12T02:36:13.013 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 12 02:36:12 smithi172 ceph-mon[35609]: pgmap v336: 129 pgs: 129 active+clean; 640 KiB data, 347 MiB used, 1.0 TiB / 1.0 TiB avail; 7.4 KiB/s rd, 3.6 KiB/s wr, 11 op/s 2024-09-12T02:36:13.198 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 12 02:36:12 smithi044 ceph-mon[35411]: pgmap v336: 129 pgs: 129 active+clean; 640 KiB data, 347 MiB used, 1.0 TiB / 1.0 TiB avail; 7.4 KiB/s rd, 3.6 KiB/s wr, 11 op/s 2024-09-12T02:36:13.338 INFO:teuthology.orchestra.run.smithi039.stdout:{"pg_ready":true,"pg_map":{"version":336,"stamp":"2024-09-12T02:36:10.826112+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":655461,"num_objects":102,"num_object_clones":0,"num_object_copies":308,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":102,"num_whiteouts":0,"num_read":348,"num_read_kb":297,"num_write":426,"num_write_kb":3074,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":9,"num_bytes_recovered":1180736,"num_keys_recovered":0,"num_objects_omap":66,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":349,"ondisk_log_size":349,"up":419,"acting":419,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":419,"num_osds":12,"num_per_pool_osds":12,"num_per_pool_omap_osds":12,"kb":1124941824,"kb_used":355528,"kb_used_data":14600,"kb_used_omap":18,"kb_used_meta":340717,"kb_avail":1124586296,"statfs":{"total":1151940427776,"available":1151576367104,"internally_reserved":0,"allocated":14950400,"data_stored":8250761,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":19143,"internal_metadata":348894521},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":33305,"num_objects":2,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":113,"num_read_kb":89,"num_write":26,"num_write_kb":43,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.003058"},"pg_stats":[{"pgid":"2.1f","version":"93'13","reported_seq":70,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-09-12T02:36:08.001956+0000","last_change":"2024-09-12T02:35:00.062996+0000","last_active":"2024-09-12T02:36:08.001956+0000","last_peered":"2024-09-12T02:36:08.001956+0000","last_clean":"2024-09-12T02:36:08.001956+0000","last_became_active":"2024-09-12T02:35:00.062670+0000","last_became_peered":"2024-09-12T02:35:00.062670+0000","last_unstale":"2024-09-12T02:36:08.001956+0000","last_undegraded":"2024-09-12T02:36:08.001956+0000","last_fullsized":"2024-09-12T02:36:08.001956+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:34:59.027857+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:34:59.027857+0000","last_clean_scrub_stamp":"2024-09-12T02:34:59.027857+0000","objects_scrubbed":0,"log_size":13,"log_dups_size":0,"ondisk_log_size":13,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:08:38.434465+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":672,"num_objects":6,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":19,"num_read_kb":19,"num_write":14,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,7,8],"acting":[9,7,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.1e","version":"0'0","reported_seq":34,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-09-12T02:35:46.726846+0000","last_change":"2024-09-12T02:35:02.518880+0000","last_active":"2024-09-12T02:35:46.726846+0000","last_peered":"2024-09-12T02:35:46.726846+0000","last_clean":"2024-09-12T02:35:46.726846+0000","last_became_active":"2024-09-12T02:35:02.516137+0000","last_became_peered":"2024-09-12T02:35:02.516137+0000","last_unstale":"2024-09-12T02:35:46.726846+0000","last_undegraded":"2024-09-12T02:35:46.726846+0000","last_fullsized":"2024-09-12T02:35:46.726846+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:35:01.470375+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:35:01.470375+0000","last_clean_scrub_stamp":"2024-09-12T02:35:01.470375+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T13:23:04.313584+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,5],"acting":[3,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.19","version":"0'0","reported_seq":24,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-09-12T02:35:46.731911+0000","last_change":"2024-09-12T02:35:12.591111+0000","last_active":"2024-09-12T02:35:46.731911+0000","last_peered":"2024-09-12T02:35:46.731911+0000","last_clean":"2024-09-12T02:35:46.731911+0000","last_became_active":"2024-09-12T02:35:12.590598+0000","last_became_peered":"2024-09-12T02:35:12.590598+0000","last_unstale":"2024-09-12T02:35:46.731911+0000","last_undegraded":"2024-09-12T02:35:46.731911+0000","last_fullsized":"2024-09-12T02:35:46.731911+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:35:11.552386+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:35:11.552386+0000","last_clean_scrub_stamp":"2024-09-12T02:35:11.552386+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:07:52.634283+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,9,0],"acting":[2,3,9,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1e","version":"93'2","reported_seq":40,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-09-12T02:35:46.727210+0000","last_change":"2024-09-12T02:35:00.068606+0000","last_active":"2024-09-12T02:35:46.727210+0000","last_peered":"2024-09-12T02:35:46.727210+0000","last_clean":"2024-09-12T02:35:46.727210+0000","last_became_active":"2024-09-12T02:35:00.068243+0000","last_became_peered":"2024-09-12T02:35:00.068243+0000","last_unstale":"2024-09-12T02:35:46.727210+0000","last_undegraded":"2024-09-12T02:35:46.727210+0000","last_fullsized":"2024-09-12T02:35:46.727210+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:34:59.027857+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:34:59.027857+0000","last_clean_scrub_stamp":"2024-09-12T02:34:59.027857+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:19:41.463728+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,5],"acting":[3,0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1f","version":"0'0","reported_seq":30,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-09-12T02:35:46.736697+0000","last_change":"2024-09-12T02:35:02.525485+0000","last_active":"2024-09-12T02:35:46.736697+0000","last_peered":"2024-09-12T02:35:46.736697+0000","last_clean":"2024-09-12T02:35:46.736697+0000","last_became_active":"2024-09-12T02:35:02.525111+0000","last_became_peered":"2024-09-12T02:35:02.525111+0000","last_unstale":"2024-09-12T02:35:46.736697+0000","last_undegraded":"2024-09-12T02:35:46.736697+0000","last_fullsized":"2024-09-12T02:35:46.736697+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:35:01.470375+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:35:01.470375+0000","last_clean_scrub_stamp":"2024-09-12T02:35:01.470375+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:37:25.329762+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,9],"acting":[0,1,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.18","version":"0'0","reported_seq":24,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-09-12T02:35:46.832568+0000","last_change":"2024-09-12T02:35:12.591057+0000","last_active":"2024-09-12T02:35:46.832568+0000","last_peered":"2024-09-12T02:35:46.832568+0000","last_clean":"2024-09-12T02:35:46.832568+0000","last_became_active":"2024-09-12T02:35:12.590606+0000","last_became_peered":"2024-09-12T02:35:12.590606+0000","last_unstale":"2024-09-12T02:35:46.832568+0000","last_undegraded":"2024-09-12T02:35:46.832568+0000","last_fullsized":"2024-09-12T02:35:46.832568+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:35:11.552386+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:35:11.552386+0000","last_clean_scrub_stamp":"2024-09-12T02:35:11.552386+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:44:06.007603+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6,9,3],"acting":[4,6,9,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1d","version":"93'12","reported_seq":49,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-09-12T02:35:51.975440+0000","last_change":"2024-09-12T02:35:00.064090+0000","last_active":"2024-09-12T02:35:51.975440+0000","last_peered":"2024-09-12T02:35:51.975440+0000","last_clean":"2024-09-12T02:35:51.975440+0000","last_became_active":"2024-09-12T02:35:00.063688+0000","last_became_peered":"2024-09-12T02:35:00.063688+0000","last_unstale":"2024-09-12T02:35:51.975440+0000","last_undegraded":"2024-09-12T02:35:51.975440+0000","last_fullsized":"2024-09-12T02:35:51.975440+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:34:59.027857+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:34:59.027857+0000","last_clean_scrub_stamp":"2024-09-12T02:34:59.027857+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:27:30.117990+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":7,"num_object_clones":0,"num_object_copies":21,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":16,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":7,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,2,7],"acting":[8,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.1c","version":"0'0","reported_seq":33,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-09-12T02:35:46.833790+0000","last_change":"2024-09-12T02:35:02.510882+0000","last_active":"2024-09-12T02:35:46.833790+0000","last_peered":"2024-09-12T02:35:46.833790+0000","last_clean":"2024-09-12T02:35:46.833790+0000","last_became_active":"2024-09-12T02:35:02.510513+0000","last_became_peered":"2024-09-12T02:35:02.510513+0000","last_unstale":"2024-09-12T02:35:46.833790+0000","last_undegraded":"2024-09-12T02:35:46.833790+0000","last_fullsized":"2024-09-12T02:35:46.833790+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:35:01.470375+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:35:01.470375+0000","last_clean_scrub_stamp":"2024-09-12T02:35:01.470375+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:21:40.527379+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,10,6],"acting":[1,10,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1b","version":"0'0","reported_seq":24,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-09-12T02:35:46.832859+0000","last_change":"2024-09-12T02:35:12.590704+0000","last_active":"2024-09-12T02:35:46.832859+0000","last_peered":"2024-09-12T02:35:46.832859+0000","last_clean":"2024-09-12T02:35:46.832859+0000","last_became_active":"2024-09-12T02:35:12.590217+0000","last_became_peered":"2024-09-12T02:35:12.590217+0000","last_unstale":"2024-09-12T02:35:46.832859+0000","last_undegraded":"2024-09-12T02:35:46.832859+0000","last_fullsized":"2024-09-12T02:35:46.832859+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:35:11.552386+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:35:11.552386+0000","last_clean_scrub_stamp":"2024-09-12T02:35:11.552386+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:21:47.370860+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,9,5],"acting":[4,3,9,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1c","version":"93'5","reported_seq":42,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-09-12T02:35:51.805060+0000","last_change":"2024-09-12T02:35:00.059679+0000","last_active":"2024-09-12T02:35:51.805060+0000","last_peered":"2024-09-12T02:35:51.805060+0000","last_clean":"2024-09-12T02:35:51.805060+0000","last_became_active":"2024-09-12T02:35:00.058599+0000","last_became_peered":"2024-09-12T02:35:00.058599+0000","last_unstale":"2024-09-12T02:35:51.805060+0000","last_undegraded":"2024-09-12T02:35:51.805060+0000","last_fullsized":"2024-09-12T02:35:51.805060+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:34:59.027857+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:34:59.027857+0000","last_clean_scrub_stamp":"2024-09-12T02:34:59.027857+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:24:39.878761+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":7,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,1,5],"acting":[8,1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.1d","version":"0'0","reported_seq":32,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-09-12T02:35:46.728725+0000","last_change":"2024-09-12T02:35:02.511371+0000","last_active":"2024-09-12T02:35:46.728725+0000","last_peered":"2024-09-12T02:35:46.728725+0000","last_clean":"2024-09-12T02:35:46.728725+0000","last_became_active":"2024-09-12T02:35:02.510941+0000","last_became_peered":"2024-09-12T02:35:02.510941+0000","last_unstale":"2024-09-12T02:35:46.728725+0000","last_undegraded":"2024-09-12T02:35:46.728725+0000","last_fullsized":"2024-09-12T02:35:46.728725+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:35:01.470375+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:35:01.470375+0000","last_clean_scrub_stamp":"2024-09-12T02:35:01.470375+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:30:50.106899+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,1],"acting":[5,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1a","version":"0'0","reported_seq":24,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-09-12T02:35:46.832391+0000","last_change":"2024-09-12T02:35:12.590925+0000","last_active":"2024-09-12T02:35:46.832391+0000","last_peered":"2024-09-12T02:35:46.832391+0000","last_clean":"2024-09-12T02:35:46.832391+0000","last_became_active":"2024-09-12T02:35:12.590286+0000","last_became_peered":"2024-09-12T02:35:12.590286+0000","last_unstale":"2024-09-12T02:35:46.832391+0000","last_undegraded":"2024-09-12T02:35:46.832391+0000","last_fullsized":"2024-09-12T02:35:46.832391+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:35:11.552386+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:35:11.552386+0000","last_clean_scrub_stamp":"2024-09-12T02:35:11.552386+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:31:48.835941+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6,5,3],"acting":[4,6,5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":33,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-09-12T02:35:46.730545+0000","last_change":"2024-09-12T02:35:02.524637+0000","last_active":"2024-09-12T02:35:46.730545+0000","last_peered":"2024-09-12T02:35:46.730545+0000","last_clean":"2024-09-12T02:35:46.730545+0000","last_became_active":"2024-09-12T02:35:02.524178+0000","last_became_peered":"2024-09-12T02:35:02.524178+0000","last_unstale":"2024-09-12T02:35:46.730545+0000","last_undegraded":"2024-09-12T02:35:46.730545+0000","last_fullsized":"2024-09-12T02:35:46.730545+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:35:01.470375+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:35:01.470375+0000","last_clean_scrub_stamp":"2024-09-12T02:35:01.470375+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:31:28.693302+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,6],"acting":[7,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.b","version":"93'4","reported_seq":51,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-09-12T02:35:48.760778+0000","last_change":"2024-09-12T02:35:46.837747+0000","last_active":"2024-09-12T02:35:48.760778+0000","last_peered":"2024-09-12T02:35:48.760778+0000","last_clean":"2024-09-12T02:35:48.760778+0000","last_became_active":"2024-09-12T02:35:46.834865+0000","last_became_peered":"2024-09-12T02:35:46.834865+0000","last_unstale":"2024-09-12T02:35:48.760778+0000","last_undegraded":"2024-09-12T02:35:48.760778+0000","last_fullsized":"2024-09-12T02:35:48.760778+0000","mapping_epoch":92,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":93,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:34:59.027857+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:34:59.027857+0000","last_clean_scrub_stamp":"2024-09-12T02:34:59.027857+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:04:51.092618+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,1,7],"acting":[8,1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"4.d","version":"0'0","reported_seq":24,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-09-12T02:35:46.832491+0000","last_change":"2024-09-12T02:35:12.590345+0000","last_active":"2024-09-12T02:35:46.832491+0000","last_peered":"2024-09-12T02:35:46.832491+0000","last_clean":"2024-09-12T02:35:46.832491+0000","last_became_active":"2024-09-12T02:35:12.589805+0000","last_became_peered":"2024-09-12T02:35:12.589805+0000","last_unstale":"2024-09-12T02:35:46.832491+0000","last_undegraded":"2024-09-12T02:35:46.832491+0000","last_fullsized":"2024-09-12T02:35:46.832491+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:35:11.552386+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:35:11.552386+0000","last_clean_scrub_stamp":"2024-09-12T02:35:11.552386+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:49:28.262371+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2,10,3],"acting":[4,2,10,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.b","version":"0'0","reported_seq":34,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-09-12T02:35:46.726646+0000","last_change":"2024-09-12T02:35:02.513424+0000","last_active":"2024-09-12T02:35:46.726646+0000","last_peered":"2024-09-12T02:35:46.726646+0000","last_clean":"2024-09-12T02:35:46.726646+0000","last_became_active":"2024-09-12T02:35:02.512180+0000","last_became_peered":"2024-09-12T02:35:02.512180+0000","last_unstale":"2024-09-12T02:35:46.726646+0000","last_undegraded":"2024-09-12T02:35:46.726646+0000","last_fullsized":"2024-09-12T02:35:46.726646+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:35:01.470375+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:35:01.470375+0000","last_clean_scrub_stamp":"2024-09-12T02:35:01.470375+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:22:40.102645+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,10],"acting":[3,0,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.a","version":"93'3","reported_seq":41,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-09-12T02:35:50.784413+0000","last_change":"2024-09-12T02:35:00.066012+0000","last_active":"2024-09-12T02:35:50.784413+0000","last_peered":"2024-09-12T02:35:50.784413+0000","last_clean":"2024-09-12T02:35:50.784413+0000","last_became_active":"2024-09-12T02:35:00.065642+0000","last_became_peered":"2024-09-12T02:35:00.065642+0000","last_unstale":"2024-09-12T02:35:50.784413+0000","last_undegraded":"2024-09-12T02:35:50.784413+0000","last_fullsized":"2024-09-12T02:35:50.784413+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:34:59.027857+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:34:59.027857+0000","last_clean_scrub_stamp":"2024-09-12T02:34:59.027857+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:16:27.609255+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,8],"acting":[2,3,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.c","version":"93'1","reported_seq":25,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-09-12T02:35:46.833465+0000","last_change":"2024-09-12T02:35:12.591850+0000","last_active":"2024-09-12T02:35:46.833465+0000","last_peered":"2024-09-12T02:35:46.833465+0000","last_clean":"2024-09-12T02:35:46.833465+0000","last_became_active":"2024-09-12T02:35:12.590807+0000","last_became_peered":"2024-09-12T02:35:12.590807+0000","last_unstale":"2024-09-12T02:35:46.833465+0000","last_undegraded":"2024-09-12T02:35:46.833465+0000","last_fullsized":"2024-09-12T02:35:46.833465+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:35:11.552386+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:35:11.552386+0000","last_clean_scrub_stamp":"2024-09-12T02:35:11.552386+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:09:16.082542+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":117,"num_objects":1,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,9,7,8],"acting":[4,9,7,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":31,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-09-12T02:35:46.731490+0000","last_change":"2024-09-12T02:35:02.510960+0000","last_active":"2024-09-12T02:35:46.731490+0000","last_peered":"2024-09-12T02:35:46.731490+0000","last_clean":"2024-09-12T02:35:46.731490+0000","last_became_active":"2024-09-12T02:35:02.510589+0000","last_became_peered":"2024-09-12T02:35:02.510589+0000","last_unstale":"2024-09-12T02:35:46.731490+0000","last_undegraded":"2024-09-12T02:35:46.731490+0000","last_fullsized":"2024-09-12T02:35:46.731490+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:35:01.470375+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:35:01.470375+0000","last_clean_scrub_stamp":"2024-09-12T02:35:01.470375+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:33:15.825208+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,0,2],"acting":[11,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"2.9","version":"93'7","reported_seq":45,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-09-12T02:35:51.806729+0000","last_change":"2024-09-12T02:35:00.061327+0000","last_active":"2024-09-12T02:35:51.806729+0000","last_peered":"2024-09-12T02:35:51.806729+0000","last_clean":"2024-09-12T02:35:51.806729+0000","last_became_active":"2024-09-12T02:35:00.061118+0000","last_became_peered":"2024-09-12T02:35:00.061118+0000","last_unstale":"2024-09-12T02:35:51.806729+0000","last_undegraded":"2024-09-12T02:35:51.806729+0000","last_fullsized":"2024-09-12T02:35:51.806729+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:34:59.027857+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:34:59.027857+0000","last_clean_scrub_stamp":"2024-09-12T02:34:59.027857+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T14:02:22.217428+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,9,10],"acting":[3,9,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.f","version":"0'0","reported_seq":24,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-09-12T02:35:46.725943+0000","last_change":"2024-09-12T02:35:12.581769+0000","last_active":"2024-09-12T02:35:46.725943+0000","last_peered":"2024-09-12T02:35:46.725943+0000","last_clean":"2024-09-12T02:35:46.725943+0000","last_became_active":"2024-09-12T02:35:12.580169+0000","last_became_peered":"2024-09-12T02:35:12.580169+0000","last_unstale":"2024-09-12T02:35:46.725943+0000","last_undegraded":"2024-09-12T02:35:46.725943+0000","last_fullsized":"2024-09-12T02:35:46.725943+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:35:11.552386+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:35:11.552386+0000","last_clean_scrub_stamp":"2024-09-12T02:35:11.552386+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:04:10.192058+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,3,2,5],"acting":[9,3,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":31,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-09-12T02:35:46.726693+0000","last_change":"2024-09-12T02:35:02.507893+0000","last_active":"2024-09-12T02:35:46.726693+0000","last_peered":"2024-09-12T02:35:46.726693+0000","last_clean":"2024-09-12T02:35:46.726693+0000","last_became_active":"2024-09-12T02:35:02.506357+0000","last_became_peered":"2024-09-12T02:35:02.506357+0000","last_unstale":"2024-09-12T02:35:46.726693+0000","last_undegraded":"2024-09-12T02:35:46.726693+0000","last_fullsized":"2024-09-12T02:35:46.726693+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:35:01.470375+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:35:01.470375+0000","last_clean_scrub_stamp":"2024-09-12T02:35:01.470375+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T14:03:36.148796+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,11,10],"acting":[8,11,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"2.8","version":"93'2","reported_seq":39,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-09-12T02:35:48.760963+0000","last_change":"2024-09-12T02:35:00.068759+0000","last_active":"2024-09-12T02:35:48.760963+0000","last_peered":"2024-09-12T02:35:48.760963+0000","last_clean":"2024-09-12T02:35:48.760963+0000","last_became_active":"2024-09-12T02:35:00.068464+0000","last_became_peered":"2024-09-12T02:35:00.068464+0000","last_unstale":"2024-09-12T02:35:48.760963+0000","last_undegraded":"2024-09-12T02:35:48.760963+0000","last_fullsized":"2024-09-12T02:35:48.760963+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:34:59.027857+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:34:59.027857+0000","last_clean_scrub_stamp":"2024-09-12T02:34:59.027857+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T14:17:20.863590+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,0],"acting":[1,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.e","version":"0'0","reported_seq":24,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-09-12T02:35:46.832775+0000","last_change":"2024-09-12T02:35:12.591707+0000","last_active":"2024-09-12T02:35:46.832775+0000","last_peered":"2024-09-12T02:35:46.832775+0000","last_clean":"2024-09-12T02:35:46.832775+0000","last_became_active":"2024-09-12T02:35:12.591302+0000","last_became_peered":"2024-09-12T02:35:12.591302+0000","last_unstale":"2024-09-12T02:35:46.832775+0000","last_undegraded":"2024-09-12T02:35:46.832775+0000","last_fullsized":"2024-09-12T02:35:46.832775+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:35:11.552386+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:35:11.552386+0000","last_clean_scrub_stamp":"2024-09-12T02:35:11.552386+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:56:14.526395+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5,10,9],"acting":[4,5,10,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":30,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-09-12T02:35:46.736523+0000","last_change":"2024-09-12T02:35:02.523175+0000","last_active":"2024-09-12T02:35:46.736523+0000","last_peered":"2024-09-12T02:35:46.736523+0000","last_clean":"2024-09-12T02:35:46.736523+0000","last_became_active":"2024-09-12T02:35:02.522846+0000","last_became_peered":"2024-09-12T02:35:02.522846+0000","last_unstale":"2024-09-12T02:35:46.736523+0000","last_undegraded":"2024-09-12T02:35:46.736523+0000","last_fullsized":"2024-09-12T02:35:46.736523+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:35:01.470375+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:35:01.470375+0000","last_clean_scrub_stamp":"2024-09-12T02:35:01.470375+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:16:18.488190+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,4],"acting":[0,3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.7","version":"93'7","reported_seq":45,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-09-12T02:35:51.805960+0000","last_change":"2024-09-12T02:35:00.314147+0000","last_active":"2024-09-12T02:35:51.805960+0000","last_peered":"2024-09-12T02:35:51.805960+0000","last_clean":"2024-09-12T02:35:51.805960+0000","last_became_active":"2024-09-12T02:35:00.313795+0000","last_became_peered":"2024-09-12T02:35:00.313795+0000","last_unstale":"2024-09-12T02:35:51.805960+0000","last_undegraded":"2024-09-12T02:35:51.805960+0000","last_fullsized":"2024-09-12T02:35:51.805960+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:34:59.027857+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:34:59.027857+0000","last_clean_scrub_stamp":"2024-09-12T02:34:59.027857+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:26:33.269006+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,11,6],"acting":[4,11,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.1","version":"0'0","reported_seq":24,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-09-12T02:35:46.732178+0000","last_change":"2024-09-12T02:35:12.578075+0000","last_active":"2024-09-12T02:35:46.732178+0000","last_peered":"2024-09-12T02:35:46.732178+0000","last_clean":"2024-09-12T02:35:46.732178+0000","last_became_active":"2024-09-12T02:35:12.577622+0000","last_became_peered":"2024-09-12T02:35:12.577622+0000","last_unstale":"2024-09-12T02:35:46.732178+0000","last_undegraded":"2024-09-12T02:35:46.732178+0000","last_fullsized":"2024-09-12T02:35:46.732178+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:35:11.552386+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:35:11.552386+0000","last_clean_scrub_stamp":"2024-09-12T02:35:11.552386+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:26:50.263757+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,4,7],"acting":[2,1,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.7","version":"0'0","reported_seq":34,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-09-12T02:35:46.727172+0000","last_change":"2024-09-12T02:35:02.514685+0000","last_active":"2024-09-12T02:35:46.727172+0000","last_peered":"2024-09-12T02:35:46.727172+0000","last_clean":"2024-09-12T02:35:46.727172+0000","last_became_active":"2024-09-12T02:35:02.511606+0000","last_became_peered":"2024-09-12T02:35:02.511606+0000","last_unstale":"2024-09-12T02:35:46.727172+0000","last_undegraded":"2024-09-12T02:35:46.727172+0000","last_fullsized":"2024-09-12T02:35:46.727172+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:35:01.470375+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:35:01.470375+0000","last_clean_scrub_stamp":"2024-09-12T02:35:01.470375+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:36:49.833272+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,11,7],"acting":[3,11,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.6","version":"93'14","reported_seq":52,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-09-12T02:36:07.516833+0000","last_change":"2024-09-12T02:35:00.059540+0000","last_active":"2024-09-12T02:36:07.516833+0000","last_peered":"2024-09-12T02:36:07.516833+0000","last_clean":"2024-09-12T02:36:07.516833+0000","last_became_active":"2024-09-12T02:35:00.059161+0000","last_became_peered":"2024-09-12T02:35:00.059161+0000","last_unstale":"2024-09-12T02:36:07.516833+0000","last_undegraded":"2024-09-12T02:36:07.516833+0000","last_fullsized":"2024-09-12T02:36:07.516833+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:34:59.027857+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:34:59.027857+0000","last_clean_scrub_stamp":"2024-09-12T02:34:59.027857+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":0,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:52:19.141087+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":24,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,8,3],"acting":[9,8,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"4.0","version":"0'0","reported_seq":24,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-09-12T02:35:46.725920+0000","last_change":"2024-09-12T02:35:12.584755+0000","last_active":"2024-09-12T02:35:46.725920+0000","last_peered":"2024-09-12T02:35:46.725920+0000","last_clean":"2024-09-12T02:35:46.725920+0000","last_became_active":"2024-09-12T02:35:12.584365+0000","last_became_peered":"2024-09-12T02:35:12.584365+0000","last_unstale":"2024-09-12T02:35:46.725920+0000","last_undegraded":"2024-09-12T02:35:46.725920+0000","last_fullsized":"2024-09-12T02:35:46.725920+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:35:11.552386+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:35:11.552386+0000","last_clean_scrub_stamp":"2024-09-12T02:35:11.552386+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:16:54.529244+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,10,0,7],"acting":[3,10,0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":31,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-09-12T02:35:46.732750+0000","last_change":"2024-09-12T02:35:02.507751+0000","last_active":"2024-09-12T02:35:46.732750+0000","last_peered":"2024-09-12T02:35:46.732750+0000","last_clean":"2024-09-12T02:35:46.732750+0000","last_became_active":"2024-09-12T02:35:02.507456+0000","last_became_peered":"2024-09-12T02:35:02.507456+0000","last_unstale":"2024-09-12T02:35:46.732750+0000","last_undegraded":"2024-09-12T02:35:46.732750+0000","last_fullsized":"2024-09-12T02:35:46.732750+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:35:01.470375+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:35:01.470375+0000","last_clean_scrub_stamp":"2024-09-12T02:35:01.470375+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:48:13.297422+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2,9],"acting":[6,2,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.5","version":"93'4","reported_seq":41,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-09-12T02:35:51.806203+0000","last_change":"2024-09-12T02:35:00.068895+0000","last_active":"2024-09-12T02:35:51.806203+0000","last_peered":"2024-09-12T02:35:51.806203+0000","last_clean":"2024-09-12T02:35:51.806203+0000","last_became_active":"2024-09-12T02:35:00.068547+0000","last_became_peered":"2024-09-12T02:35:00.068547+0000","last_unstale":"2024-09-12T02:35:51.806203+0000","last_undegraded":"2024-09-12T02:35:51.806203+0000","last_fullsized":"2024-09-12T02:35:51.806203+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:34:59.027857+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:34:59.027857+0000","last_clean_scrub_stamp":"2024-09-12T02:34:59.027857+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:31:14.305834+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":112,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":5,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,0,9],"acting":[8,0,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"4.3","version":"0'0","reported_seq":24,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-09-12T02:35:46.730216+0000","last_change":"2024-09-12T02:35:12.579890+0000","last_active":"2024-09-12T02:35:46.730216+0000","last_peered":"2024-09-12T02:35:46.730216+0000","last_clean":"2024-09-12T02:35:46.730216+0000","last_became_active":"2024-09-12T02:35:12.579399+0000","last_became_peered":"2024-09-12T02:35:12.579399+0000","last_unstale":"2024-09-12T02:35:46.730216+0000","last_undegraded":"2024-09-12T02:35:46.730216+0000","last_fullsized":"2024-09-12T02:35:46.730216+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:35:11.552386+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:35:11.552386+0000","last_clean_scrub_stamp":"2024-09-12T02:35:11.552386+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:48:31.564922+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,5,7,6],"acting":[11,5,7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":32,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-09-12T02:35:46.757621+0000","last_change":"2024-09-12T02:35:02.519590+0000","last_active":"2024-09-12T02:35:46.757621+0000","last_peered":"2024-09-12T02:35:46.757621+0000","last_clean":"2024-09-12T02:35:46.757621+0000","last_became_active":"2024-09-12T02:35:02.519244+0000","last_became_peered":"2024-09-12T02:35:02.519244+0000","last_unstale":"2024-09-12T02:35:46.757621+0000","last_undegraded":"2024-09-12T02:35:46.757621+0000","last_fullsized":"2024-09-12T02:35:46.757621+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:35:01.470375+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:35:01.470375+0000","last_clean_scrub_stamp":"2024-09-12T02:35:01.470375+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T13:52:18.415135+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,3,6],"acting":[10,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"2.4","version":"93'1","reported_seq":39,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-09-12T02:35:46.725433+0000","last_change":"2024-09-12T02:35:00.068931+0000","last_active":"2024-09-12T02:35:46.725433+0000","last_peered":"2024-09-12T02:35:46.725433+0000","last_clean":"2024-09-12T02:35:46.725433+0000","last_became_active":"2024-09-12T02:35:00.068217+0000","last_became_peered":"2024-09-12T02:35:00.068217+0000","last_unstale":"2024-09-12T02:35:46.725433+0000","last_undegraded":"2024-09-12T02:35:46.725433+0000","last_fullsized":"2024-09-12T02:35:46.725433+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:34:59.027857+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:34:59.027857+0000","last_clean_scrub_stamp":"2024-09-12T02:34:59.027857+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:56:25.407991+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,2,0],"acting":[9,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"4.2","version":"0'0","reported_seq":31,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-09-12T02:35:46.834010+0000","last_change":"2024-09-12T02:35:46.834010+0000","last_active":"2024-09-12T02:35:46.834010+0000","last_peered":"2024-09-12T02:35:46.834010+0000","last_clean":"2024-09-12T02:35:46.834010+0000","last_became_active":"2024-09-12T02:35:46.833523+0000","last_became_peered":"2024-09-12T02:35:46.833523+0000","last_unstale":"2024-09-12T02:35:46.834010+0000","last_undegraded":"2024-09-12T02:35:46.834010+0000","last_fullsized":"2024-09-12T02:35:46.834010+0000","mapping_epoch":92,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":93,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:35:11.552386+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:35:11.552386+0000","last_clean_scrub_stamp":"2024-09-12T02:35:11.552386+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:49:26.839307+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,10,11,1],"acting":[8,10,11,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":32,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-09-12T02:35:46.757793+0000","last_change":"2024-09-12T02:35:02.514146+0000","last_active":"2024-09-12T02:35:46.757793+0000","last_peered":"2024-09-12T02:35:46.757793+0000","last_clean":"2024-09-12T02:35:46.757793+0000","last_became_active":"2024-09-12T02:35:02.513777+0000","last_became_peered":"2024-09-12T02:35:02.513777+0000","last_unstale":"2024-09-12T02:35:46.757793+0000","last_undegraded":"2024-09-12T02:35:46.757793+0000","last_fullsized":"2024-09-12T02:35:46.757793+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:35:01.470375+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:35:01.470375+0000","last_clean_scrub_stamp":"2024-09-12T02:35:01.470375+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:33:57.554957+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,4,0],"acting":[10,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"2.2","version":"93'6","reported_seq":64,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-09-12T02:36:09.003980+0000","last_change":"2024-09-12T02:35:00.062893+0000","last_active":"2024-09-12T02:36:09.003980+0000","last_peered":"2024-09-12T02:36:09.003980+0000","last_clean":"2024-09-12T02:36:09.003980+0000","last_became_active":"2024-09-12T02:35:00.062547+0000","last_became_peered":"2024-09-12T02:35:00.062547+0000","last_unstale":"2024-09-12T02:36:09.003980+0000","last_undegraded":"2024-09-12T02:36:09.003980+0000","last_fullsized":"2024-09-12T02:36:09.003980+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:34:59.027857+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:34:59.027857+0000","last_clean_scrub_stamp":"2024-09-12T02:34:59.027857+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T13:40:15.098836+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":981,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":21,"num_read_kb":2,"num_write":5,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6,1],"acting":[7,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.4","version":"0'0","reported_seq":24,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-09-12T02:35:46.731789+0000","last_change":"2024-09-12T02:35:12.586490+0000","last_active":"2024-09-12T02:35:46.731789+0000","last_peered":"2024-09-12T02:35:46.731789+0000","last_clean":"2024-09-12T02:35:46.731789+0000","last_became_active":"2024-09-12T02:35:12.586102+0000","last_became_peered":"2024-09-12T02:35:12.586102+0000","last_unstale":"2024-09-12T02:35:46.731789+0000","last_undegraded":"2024-09-12T02:35:46.731789+0000","last_fullsized":"2024-09-12T02:35:46.731789+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:35:11.552386+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:35:11.552386+0000","last_clean_scrub_stamp":"2024-09-12T02:35:11.552386+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:43:45.543922+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0,1,8],"acting":[6,0,1,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":32,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-09-12T02:35:46.728073+0000","last_change":"2024-09-12T02:35:02.506726+0000","last_active":"2024-09-12T02:35:46.728073+0000","last_peered":"2024-09-12T02:35:46.728073+0000","last_clean":"2024-09-12T02:35:46.728073+0000","last_became_active":"2024-09-12T02:35:02.505693+0000","last_became_peered":"2024-09-12T02:35:02.505693+0000","last_unstale":"2024-09-12T02:35:46.728073+0000","last_undegraded":"2024-09-12T02:35:46.728073+0000","last_fullsized":"2024-09-12T02:35:46.728073+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:35:01.470375+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:35:01.470375+0000","last_clean_scrub_stamp":"2024-09-12T02:35:01.470375+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:54:51.507105+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2,4],"acting":[5,2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1","version":"93'5","reported_seq":59,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-09-12T02:36:07.000698+0000","last_change":"2024-09-12T02:35:00.069206+0000","last_active":"2024-09-12T02:36:07.000698+0000","last_peered":"2024-09-12T02:36:07.000698+0000","last_clean":"2024-09-12T02:36:07.000698+0000","last_became_active":"2024-09-12T02:35:00.068823+0000","last_became_peered":"2024-09-12T02:35:00.068823+0000","last_unstale":"2024-09-12T02:36:07.000698+0000","last_undegraded":"2024-09-12T02:36:07.000698+0000","last_fullsized":"2024-09-12T02:36:07.000698+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:34:59.027857+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:34:59.027857+0000","last_clean_scrub_stamp":"2024-09-12T02:34:59.027857+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:33:11.004561+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":112,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":18,"num_read_kb":18,"num_write":5,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,0],"acting":[6,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.7","version":"0'0","reported_seq":24,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-09-12T02:35:46.733237+0000","last_change":"2024-09-12T02:35:12.587431+0000","last_active":"2024-09-12T02:35:46.733237+0000","last_peered":"2024-09-12T02:35:46.733237+0000","last_clean":"2024-09-12T02:35:46.733237+0000","last_became_active":"2024-09-12T02:35:12.587059+0000","last_became_peered":"2024-09-12T02:35:12.587059+0000","last_unstale":"2024-09-12T02:35:46.733237+0000","last_undegraded":"2024-09-12T02:35:46.733237+0000","last_fullsized":"2024-09-12T02:35:46.733237+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:35:11.552386+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:35:11.552386+0000","last_clean_scrub_stamp":"2024-09-12T02:35:11.552386+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:51:53.335039+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5,10,0],"acting":[6,5,10,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":31,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-09-12T02:35:46.731728+0000","last_change":"2024-09-12T02:35:02.508475+0000","last_active":"2024-09-12T02:35:46.731728+0000","last_peered":"2024-09-12T02:35:46.731728+0000","last_clean":"2024-09-12T02:35:46.731728+0000","last_became_active":"2024-09-12T02:35:02.508183+0000","last_became_peered":"2024-09-12T02:35:02.508183+0000","last_unstale":"2024-09-12T02:35:46.731728+0000","last_undegraded":"2024-09-12T02:35:46.731728+0000","last_fullsized":"2024-09-12T02:35:46.731728+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:35:01.470375+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:35:01.470375+0000","last_clean_scrub_stamp":"2024-09-12T02:35:01.470375+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:49:09.545800+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,2],"acting":[6,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.0","version":"93'4","reported_seq":15,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-09-12T02:35:49.770625+0000","last_change":"2024-09-12T02:35:46.734658+0000","last_active":"2024-09-12T02:35:49.770625+0000","last_peered":"2024-09-12T02:35:49.770625+0000","last_clean":"2024-09-12T02:35:49.770625+0000","last_became_active":"2024-09-12T02:35:46.734239+0000","last_became_peered":"2024-09-12T02:35:46.734239+0000","last_unstale":"2024-09-12T02:35:49.770625+0000","last_undegraded":"2024-09-12T02:35:49.770625+0000","last_fullsized":"2024-09-12T02:35:49.770625+0000","mapping_epoch":92,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":93,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:34:59.027857+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:34:59.027857+0000","last_clean_scrub_stamp":"2024-09-12T02:34:59.027857+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:08:17.941344+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,5,8],"acting":[11,5,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"4.6","version":"0'0","reported_seq":31,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-09-12T02:35:46.758993+0000","last_change":"2024-09-12T02:35:46.758993+0000","last_active":"2024-09-12T02:35:46.758993+0000","last_peered":"2024-09-12T02:35:46.758993+0000","last_clean":"2024-09-12T02:35:46.758993+0000","last_became_active":"2024-09-12T02:35:46.758552+0000","last_became_peered":"2024-09-12T02:35:46.758552+0000","last_unstale":"2024-09-12T02:35:46.758993+0000","last_undegraded":"2024-09-12T02:35:46.758993+0000","last_fullsized":"2024-09-12T02:35:46.758993+0000","mapping_epoch":92,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":93,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:35:11.552386+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:35:11.552386+0000","last_clean_scrub_stamp":"2024-09-12T02:35:11.552386+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:32:10.618748+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,11,6,10],"acting":[5,11,6,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":34,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-09-12T02:35:46.726550+0000","last_change":"2024-09-12T02:35:02.515340+0000","last_active":"2024-09-12T02:35:46.726550+0000","last_peered":"2024-09-12T02:35:46.726550+0000","last_clean":"2024-09-12T02:35:46.726550+0000","last_became_active":"2024-09-12T02:35:02.514973+0000","last_became_peered":"2024-09-12T02:35:02.514973+0000","last_unstale":"2024-09-12T02:35:46.726550+0000","last_undegraded":"2024-09-12T02:35:46.726550+0000","last_fullsized":"2024-09-12T02:35:46.726550+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:35:01.470375+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:35:01.470375+0000","last_clean_scrub_stamp":"2024-09-12T02:35:01.470375+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:06:03.154300+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5,1],"acting":[3,5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.3","version":"93'6","reported_seq":46,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-09-12T02:35:51.975419+0000","last_change":"2024-09-12T02:35:00.066731+0000","last_active":"2024-09-12T02:35:51.975419+0000","last_peered":"2024-09-12T02:35:51.975419+0000","last_clean":"2024-09-12T02:35:51.975419+0000","last_became_active":"2024-09-12T02:35:00.066339+0000","last_became_peered":"2024-09-12T02:35:00.066339+0000","last_unstale":"2024-09-12T02:35:51.975419+0000","last_undegraded":"2024-09-12T02:35:51.975419+0000","last_fullsized":"2024-09-12T02:35:51.975419+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:34:59.027857+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:34:59.027857+0000","last_clean_scrub_stamp":"2024-09-12T02:34:59.027857+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:02:39.919349+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":68,"num_objects":5,"num_object_clones":0,"num_object_copies":15,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":4,"num_read_kb":4,"num_write":8,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,10,9],"acting":[4,10,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"1.0","version":"23'137","reported_seq":362,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-09-12T02:35:46.730329+0000","last_change":"2024-09-12T02:33:47.732241+0000","last_active":"2024-09-12T02:35:46.730329+0000","last_peered":"2024-09-12T02:35:46.730329+0000","last_clean":"2024-09-12T02:35:46.730329+0000","last_became_active":"2024-09-12T02:33:47.731872+0000","last_became_peered":"2024-09-12T02:33:47.731872+0000","last_unstale":"2024-09-12T02:35:46.730329+0000","last_undegraded":"2024-09-12T02:35:46.730329+0000","last_fullsized":"2024-09-12T02:35:46.730329+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:30:09.398092+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:30:09.398092+0000","last_clean_scrub_stamp":"2024-09-12T02:30:09.398092+0000","objects_scrubbed":0,"log_size":137,"log_dups_size":0,"ondisk_log_size":137,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:35:36.504372+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":136,"num_read_kb":119,"num_write":181,"num_write_kb":2938,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":1180736,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,10],"acting":[7,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.5","version":"93'1","reported_seq":25,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-09-12T02:35:46.730944+0000","last_change":"2024-09-12T02:35:12.578073+0000","last_active":"2024-09-12T02:35:46.730944+0000","last_peered":"2024-09-12T02:35:46.730944+0000","last_clean":"2024-09-12T02:35:46.730944+0000","last_became_active":"2024-09-12T02:35:12.577496+0000","last_became_peered":"2024-09-12T02:35:12.577496+0000","last_unstale":"2024-09-12T02:35:46.730944+0000","last_undegraded":"2024-09-12T02:35:46.730944+0000","last_fullsized":"2024-09-12T02:35:46.730944+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:35:11.552386+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:35:11.552386+0000","last_clean_scrub_stamp":"2024-09-12T02:35:11.552386+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:02:47.229873+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":117,"num_objects":1,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,11,9],"acting":[7,5,11,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.d","version":"0'0","reported_seq":33,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-09-12T02:35:46.731020+0000","last_change":"2024-09-12T02:35:02.510571+0000","last_active":"2024-09-12T02:35:46.731020+0000","last_peered":"2024-09-12T02:35:46.731020+0000","last_clean":"2024-09-12T02:35:46.731020+0000","last_became_active":"2024-09-12T02:35:02.509673+0000","last_became_peered":"2024-09-12T02:35:02.509673+0000","last_unstale":"2024-09-12T02:35:46.731020+0000","last_undegraded":"2024-09-12T02:35:46.731020+0000","last_fullsized":"2024-09-12T02:35:46.731020+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:35:01.470375+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:35:01.470375+0000","last_clean_scrub_stamp":"2024-09-12T02:35:01.470375+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:12:17.515300+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,11],"acting":[7,1,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.c","version":"93'6","reported_seq":64,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-09-12T02:36:07.001773+0000","last_change":"2024-09-12T02:35:00.314045+0000","last_active":"2024-09-12T02:36:07.001773+0000","last_peered":"2024-09-12T02:36:07.001773+0000","last_clean":"2024-09-12T02:36:07.001773+0000","last_became_active":"2024-09-12T02:35:00.313626+0000","last_became_peered":"2024-09-12T02:35:00.313626+0000","last_unstale":"2024-09-12T02:36:07.001773+0000","last_undegraded":"2024-09-12T02:36:07.001773+0000","last_fullsized":"2024-09-12T02:36:07.001773+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:34:59.027857+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:34:59.027857+0000","last_clean_scrub_stamp":"2024-09-12T02:34:59.027857+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:57:45.282128+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1563,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":20,"num_read_kb":3,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,11,0],"acting":[2,11,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.a","version":"0'0","reported_seq":24,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-09-12T02:35:46.832774+0000","last_change":"2024-09-12T02:35:12.582905+0000","last_active":"2024-09-12T02:35:46.832774+0000","last_peered":"2024-09-12T02:35:46.832774+0000","last_clean":"2024-09-12T02:35:46.832774+0000","last_became_active":"2024-09-12T02:35:12.582451+0000","last_became_peered":"2024-09-12T02:35:12.582451+0000","last_unstale":"2024-09-12T02:35:46.832774+0000","last_undegraded":"2024-09-12T02:35:46.832774+0000","last_fullsized":"2024-09-12T02:35:46.832774+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:35:11.552386+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:35:11.552386+0000","last_clean_scrub_stamp":"2024-09-12T02:35:11.552386+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:53:40.811531+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,6,7],"acting":[1,5,6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":33,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-09-12T02:35:46.730875+0000","last_change":"2024-09-12T02:35:02.516173+0000","last_active":"2024-09-12T02:35:46.730875+0000","last_peered":"2024-09-12T02:35:46.730875+0000","last_clean":"2024-09-12T02:35:46.730875+0000","last_became_active":"2024-09-12T02:35:02.515802+0000","last_became_peered":"2024-09-12T02:35:02.515802+0000","last_unstale":"2024-09-12T02:35:46.730875+0000","last_undegraded":"2024-09-12T02:35:46.730875+0000","last_fullsized":"2024-09-12T02:35:46.730875+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:35:01.470375+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:35:01.470375+0000","last_clean_scrub_stamp":"2024-09-12T02:35:01.470375+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:52:22.469433+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3,5],"acting":[7,3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.d","version":"93'3","reported_seq":41,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-09-12T02:35:51.807065+0000","last_change":"2024-09-12T02:35:00.058472+0000","last_active":"2024-09-12T02:35:51.807065+0000","last_peered":"2024-09-12T02:35:51.807065+0000","last_clean":"2024-09-12T02:35:51.807065+0000","last_became_active":"2024-09-12T02:35:00.058144+0000","last_became_peered":"2024-09-12T02:35:00.058144+0000","last_unstale":"2024-09-12T02:35:51.807065+0000","last_undegraded":"2024-09-12T02:35:51.807065+0000","last_fullsized":"2024-09-12T02:35:51.807065+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:34:59.027857+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:34:59.027857+0000","last_clean_scrub_stamp":"2024-09-12T02:34:59.027857+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:20:05.124583+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,10,3],"acting":[5,10,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.b","version":"0'0","reported_seq":22,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-09-12T02:35:46.736099+0000","last_change":"2024-09-12T02:35:12.592804+0000","last_active":"2024-09-12T02:35:46.736099+0000","last_peered":"2024-09-12T02:35:46.736099+0000","last_clean":"2024-09-12T02:35:46.736099+0000","last_became_active":"2024-09-12T02:35:12.592417+0000","last_became_peered":"2024-09-12T02:35:12.592417+0000","last_unstale":"2024-09-12T02:35:46.736099+0000","last_undegraded":"2024-09-12T02:35:46.736099+0000","last_fullsized":"2024-09-12T02:35:46.736099+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:35:11.552386+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:35:11.552386+0000","last_clean_scrub_stamp":"2024-09-12T02:35:11.552386+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:30:01.965989+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,9,1,4],"acting":[0,9,1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.f","version":"0'0","reported_seq":33,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-09-12T02:35:46.731110+0000","last_change":"2024-09-12T02:35:02.511051+0000","last_active":"2024-09-12T02:35:46.731110+0000","last_peered":"2024-09-12T02:35:46.731110+0000","last_clean":"2024-09-12T02:35:46.731110+0000","last_became_active":"2024-09-12T02:35:02.509959+0000","last_became_peered":"2024-09-12T02:35:02.509959+0000","last_unstale":"2024-09-12T02:35:46.731110+0000","last_undegraded":"2024-09-12T02:35:46.731110+0000","last_fullsized":"2024-09-12T02:35:46.731110+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:35:01.470375+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:35:01.470375+0000","last_clean_scrub_stamp":"2024-09-12T02:35:01.470375+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:03:53.757074+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,11,8],"acting":[7,11,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.e","version":"93'5","reported_seq":41,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-09-12T02:35:51.805312+0000","last_change":"2024-09-12T02:35:00.060428+0000","last_active":"2024-09-12T02:35:51.805312+0000","last_peered":"2024-09-12T02:35:51.805312+0000","last_clean":"2024-09-12T02:35:51.805312+0000","last_became_active":"2024-09-12T02:35:00.060026+0000","last_became_peered":"2024-09-12T02:35:00.060026+0000","last_unstale":"2024-09-12T02:35:51.805312+0000","last_undegraded":"2024-09-12T02:35:51.805312+0000","last_fullsized":"2024-09-12T02:35:51.805312+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:34:59.027857+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:34:59.027857+0000","last_clean_scrub_stamp":"2024-09-12T02:34:59.027857+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:07:25.226210+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,2],"acting":[6,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.8","version":"0'0","reported_seq":24,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-09-12T02:35:46.727750+0000","last_change":"2024-09-12T02:35:12.579879+0000","last_active":"2024-09-12T02:35:46.727750+0000","last_peered":"2024-09-12T02:35:46.727750+0000","last_clean":"2024-09-12T02:35:46.727750+0000","last_became_active":"2024-09-12T02:35:12.579449+0000","last_became_peered":"2024-09-12T02:35:12.579449+0000","last_unstale":"2024-09-12T02:35:46.727750+0000","last_undegraded":"2024-09-12T02:35:46.727750+0000","last_fullsized":"2024-09-12T02:35:46.727750+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:35:11.552386+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:35:11.552386+0000","last_clean_scrub_stamp":"2024-09-12T02:35:11.552386+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:55:37.280959+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2,7,1],"acting":[5,2,7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.e","version":"0'0","reported_seq":31,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-09-12T02:35:46.730606+0000","last_change":"2024-09-12T02:35:02.509442+0000","last_active":"2024-09-12T02:35:46.730606+0000","last_peered":"2024-09-12T02:35:46.730606+0000","last_clean":"2024-09-12T02:35:46.730606+0000","last_became_active":"2024-09-12T02:35:02.509072+0000","last_became_peered":"2024-09-12T02:35:02.509072+0000","last_unstale":"2024-09-12T02:35:46.730606+0000","last_undegraded":"2024-09-12T02:35:46.730606+0000","last_fullsized":"2024-09-12T02:35:46.730606+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:35:01.470375+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:35:01.470375+0000","last_clean_scrub_stamp":"2024-09-12T02:35:01.470375+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:39:51.913895+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,5,4],"acting":[11,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"2.f","version":"93'2","reported_seq":39,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-09-12T02:35:51.765764+0000","last_change":"2024-09-12T02:35:00.060908+0000","last_active":"2024-09-12T02:35:51.765764+0000","last_peered":"2024-09-12T02:35:51.765764+0000","last_clean":"2024-09-12T02:35:51.765764+0000","last_became_active":"2024-09-12T02:35:00.060539+0000","last_became_peered":"2024-09-12T02:35:00.060539+0000","last_unstale":"2024-09-12T02:35:51.765764+0000","last_undegraded":"2024-09-12T02:35:51.765764+0000","last_fullsized":"2024-09-12T02:35:51.765764+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:34:59.027857+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:34:59.027857+0000","last_clean_scrub_stamp":"2024-09-12T02:34:59.027857+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:10:18.241911+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":2,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,5,4],"acting":[8,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"4.9","version":"0'0","reported_seq":24,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-09-12T02:35:46.727753+0000","last_change":"2024-09-12T02:35:12.585841+0000","last_active":"2024-09-12T02:35:46.727753+0000","last_peered":"2024-09-12T02:35:46.727753+0000","last_clean":"2024-09-12T02:35:46.727753+0000","last_became_active":"2024-09-12T02:35:12.585535+0000","last_became_peered":"2024-09-12T02:35:12.585535+0000","last_unstale":"2024-09-12T02:35:46.727753+0000","last_undegraded":"2024-09-12T02:35:46.727753+0000","last_fullsized":"2024-09-12T02:35:46.727753+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:35:11.552386+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:35:11.552386+0000","last_clean_scrub_stamp":"2024-09-12T02:35:11.552386+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:55:32.595165+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0,3,1],"acting":[5,0,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":38,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-09-12T02:35:46.833349+0000","last_change":"2024-09-12T02:35:46.833349+0000","last_active":"2024-09-12T02:35:46.833349+0000","last_peered":"2024-09-12T02:35:46.833349+0000","last_clean":"2024-09-12T02:35:46.833349+0000","last_became_active":"2024-09-12T02:35:46.832980+0000","last_became_peered":"2024-09-12T02:35:46.832980+0000","last_unstale":"2024-09-12T02:35:46.833349+0000","last_undegraded":"2024-09-12T02:35:46.833349+0000","last_fullsized":"2024-09-12T02:35:46.833349+0000","mapping_epoch":92,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":93,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:35:01.470375+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:35:01.470375+0000","last_clean_scrub_stamp":"2024-09-12T02:35:01.470375+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:35:51.086023+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,8,1],"acting":[5,8,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.10","version":"93'17","reported_seq":31,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-09-12T02:35:51.804992+0000","last_change":"2024-09-12T02:35:46.743046+0000","last_active":"2024-09-12T02:35:51.804992+0000","last_peered":"2024-09-12T02:35:51.804992+0000","last_clean":"2024-09-12T02:35:51.804992+0000","last_became_active":"2024-09-12T02:35:46.736070+0000","last_became_peered":"2024-09-12T02:35:46.736070+0000","last_unstale":"2024-09-12T02:35:51.804992+0000","last_undegraded":"2024-09-12T02:35:51.804992+0000","last_fullsized":"2024-09-12T02:35:51.804992+0000","mapping_epoch":92,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":93,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:34:59.027857+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:34:59.027857+0000","last_clean_scrub_stamp":"2024-09-12T02:34:59.027857+0000","objects_scrubbed":0,"log_size":17,"log_dups_size":0,"ondisk_log_size":17,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:51:55.849111+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":112,"num_objects":8,"num_object_clones":0,"num_object_copies":24,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":20,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":6,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,0,2],"acting":[11,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"4.16","version":"0'0","reported_seq":24,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-09-12T02:35:46.731987+0000","last_change":"2024-09-12T02:35:12.583676+0000","last_active":"2024-09-12T02:35:46.731987+0000","last_peered":"2024-09-12T02:35:46.731987+0000","last_clean":"2024-09-12T02:35:46.731987+0000","last_became_active":"2024-09-12T02:35:12.583238+0000","last_became_peered":"2024-09-12T02:35:12.583238+0000","last_unstale":"2024-09-12T02:35:46.731987+0000","last_undegraded":"2024-09-12T02:35:46.731987+0000","last_fullsized":"2024-09-12T02:35:46.731987+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:35:11.552386+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:35:11.552386+0000","last_clean_scrub_stamp":"2024-09-12T02:35:11.552386+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:30:04.751525+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,9,11],"acting":[6,3,9,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.10","version":"0'0","reported_seq":33,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-09-12T02:35:46.730027+0000","last_change":"2024-09-12T02:35:02.519325+0000","last_active":"2024-09-12T02:35:46.730027+0000","last_peered":"2024-09-12T02:35:46.730027+0000","last_clean":"2024-09-12T02:35:46.730027+0000","last_became_active":"2024-09-12T02:35:02.518951+0000","last_became_peered":"2024-09-12T02:35:02.518951+0000","last_unstale":"2024-09-12T02:35:46.730027+0000","last_undegraded":"2024-09-12T02:35:46.730027+0000","last_fullsized":"2024-09-12T02:35:46.730027+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:35:01.470375+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:35:01.470375+0000","last_clean_scrub_stamp":"2024-09-12T02:35:01.470375+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:39:59.070416+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,10],"acting":[7,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.11","version":"93'6","reported_seq":63,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-09-12T02:36:07.001511+0000","last_change":"2024-09-12T02:35:00.061897+0000","last_active":"2024-09-12T02:36:07.001511+0000","last_peered":"2024-09-12T02:36:07.001511+0000","last_clean":"2024-09-12T02:36:07.001511+0000","last_became_active":"2024-09-12T02:35:00.060657+0000","last_became_peered":"2024-09-12T02:35:00.060657+0000","last_unstale":"2024-09-12T02:36:07.001511+0000","last_undegraded":"2024-09-12T02:36:07.001511+0000","last_fullsized":"2024-09-12T02:36:07.001511+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:34:59.027857+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:34:59.027857+0000","last_clean_scrub_stamp":"2024-09-12T02:34:59.027857+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:21:57.471691+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":981,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":21,"num_read_kb":4,"num_write":6,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7,10],"acting":[4,7,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.17","version":"0'0","reported_seq":24,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-09-12T02:35:46.726072+0000","last_change":"2024-09-12T02:35:12.590637+0000","last_active":"2024-09-12T02:35:46.726072+0000","last_peered":"2024-09-12T02:35:46.726072+0000","last_clean":"2024-09-12T02:35:46.726072+0000","last_became_active":"2024-09-12T02:35:12.590242+0000","last_became_peered":"2024-09-12T02:35:12.590242+0000","last_unstale":"2024-09-12T02:35:46.726072+0000","last_undegraded":"2024-09-12T02:35:46.726072+0000","last_fullsized":"2024-09-12T02:35:46.726072+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:35:11.552386+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:35:11.552386+0000","last_clean_scrub_stamp":"2024-09-12T02:35:11.552386+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:33:12.490203+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,7,0,3],"acting":[9,7,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.13","version":"0'0","reported_seq":33,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-09-12T02:35:46.730727+0000","last_change":"2024-09-12T02:35:02.510040+0000","last_active":"2024-09-12T02:35:46.730727+0000","last_peered":"2024-09-12T02:35:46.730727+0000","last_clean":"2024-09-12T02:35:46.730727+0000","last_became_active":"2024-09-12T02:35:02.509591+0000","last_became_peered":"2024-09-12T02:35:02.509591+0000","last_unstale":"2024-09-12T02:35:46.730727+0000","last_undegraded":"2024-09-12T02:35:46.730727+0000","last_fullsized":"2024-09-12T02:35:46.730727+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:35:01.470375+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:35:01.470375+0000","last_clean_scrub_stamp":"2024-09-12T02:35:01.470375+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:38:22.209174+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4,6],"acting":[7,4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.12","version":"93'5","reported_seq":43,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-09-12T02:35:51.806839+0000","last_change":"2024-09-12T02:35:00.060895+0000","last_active":"2024-09-12T02:35:51.806839+0000","last_peered":"2024-09-12T02:35:51.806839+0000","last_clean":"2024-09-12T02:35:51.806839+0000","last_became_active":"2024-09-12T02:35:00.060483+0000","last_became_peered":"2024-09-12T02:35:00.060483+0000","last_unstale":"2024-09-12T02:35:51.806839+0000","last_undegraded":"2024-09-12T02:35:51.806839+0000","last_fullsized":"2024-09-12T02:35:51.806839+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:34:59.027857+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:34:59.027857+0000","last_clean_scrub_stamp":"2024-09-12T02:34:59.027857+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T13:23:30.719311+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":5,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3,7],"acting":[5,3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.14","version":"0'0","reported_seq":24,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-09-12T02:35:46.729449+0000","last_change":"2024-09-12T02:35:12.579605+0000","last_active":"2024-09-12T02:35:46.729449+0000","last_peered":"2024-09-12T02:35:46.729449+0000","last_clean":"2024-09-12T02:35:46.729449+0000","last_became_active":"2024-09-12T02:35:12.579147+0000","last_became_peered":"2024-09-12T02:35:12.579147+0000","last_unstale":"2024-09-12T02:35:46.729449+0000","last_undegraded":"2024-09-12T02:35:46.729449+0000","last_fullsized":"2024-09-12T02:35:46.729449+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:35:11.552386+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:35:11.552386+0000","last_clean_scrub_stamp":"2024-09-12T02:35:11.552386+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:19:19.454816+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,9,7,6],"acting":[11,9,7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":31,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-09-12T02:35:46.732838+0000","last_change":"2024-09-12T02:35:02.520230+0000","last_active":"2024-09-12T02:35:46.732838+0000","last_peered":"2024-09-12T02:35:46.732838+0000","last_clean":"2024-09-12T02:35:46.732838+0000","last_became_active":"2024-09-12T02:35:02.519885+0000","last_became_peered":"2024-09-12T02:35:02.519885+0000","last_unstale":"2024-09-12T02:35:46.732838+0000","last_undegraded":"2024-09-12T02:35:46.732838+0000","last_fullsized":"2024-09-12T02:35:46.732838+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:35:01.470375+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:35:01.470375+0000","last_clean_scrub_stamp":"2024-09-12T02:35:01.470375+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:50:53.031073+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,3],"acting":[6,7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.13","version":"93'9","reported_seq":49,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-09-12T02:35:51.975605+0000","last_change":"2024-09-12T02:35:00.066323+0000","last_active":"2024-09-12T02:35:51.975605+0000","last_peered":"2024-09-12T02:35:51.975605+0000","last_clean":"2024-09-12T02:35:51.975605+0000","last_became_active":"2024-09-12T02:35:00.065961+0000","last_became_peered":"2024-09-12T02:35:00.065961+0000","last_unstale":"2024-09-12T02:35:51.975605+0000","last_undegraded":"2024-09-12T02:35:51.975605+0000","last_fullsized":"2024-09-12T02:35:51.975605+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:34:59.027857+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:34:59.027857+0000","last_clean_scrub_stamp":"2024-09-12T02:34:59.027857+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:07:35.660223+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":68,"num_objects":6,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":13,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,10,3],"acting":[2,10,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.15","version":"0'0","reported_seq":24,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-09-12T02:35:46.728615+0000","last_change":"2024-09-12T02:35:12.583133+0000","last_active":"2024-09-12T02:35:46.728615+0000","last_peered":"2024-09-12T02:35:46.728615+0000","last_clean":"2024-09-12T02:35:46.728615+0000","last_became_active":"2024-09-12T02:35:12.582716+0000","last_became_peered":"2024-09-12T02:35:12.582716+0000","last_unstale":"2024-09-12T02:35:46.728615+0000","last_undegraded":"2024-09-12T02:35:46.728615+0000","last_fullsized":"2024-09-12T02:35:46.728615+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:35:11.552386+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:35:11.552386+0000","last_clean_scrub_stamp":"2024-09-12T02:35:11.552386+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:06:51.301261+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,8,3,6],"acting":[5,8,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.15","version":"0'0","reported_seq":31,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-09-12T02:35:46.726982+0000","last_change":"2024-09-12T02:35:02.514078+0000","last_active":"2024-09-12T02:35:46.726982+0000","last_peered":"2024-09-12T02:35:46.726982+0000","last_clean":"2024-09-12T02:35:46.726982+0000","last_became_active":"2024-09-12T02:35:02.513692+0000","last_became_peered":"2024-09-12T02:35:02.513692+0000","last_unstale":"2024-09-12T02:35:46.726982+0000","last_undegraded":"2024-09-12T02:35:46.726982+0000","last_fullsized":"2024-09-12T02:35:46.726982+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:35:01.470375+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:35:01.470375+0000","last_clean_scrub_stamp":"2024-09-12T02:35:01.470375+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T13:16:32.968171+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,11,7],"acting":[8,11,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"2.14","version":"93'31","reported_seq":108,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-09-12T02:36:08.003132+0000","last_change":"2024-09-12T02:35:00.060326+0000","last_active":"2024-09-12T02:36:08.003132+0000","last_peered":"2024-09-12T02:36:08.003132+0000","last_clean":"2024-09-12T02:36:08.003132+0000","last_became_active":"2024-09-12T02:35:00.059723+0000","last_became_peered":"2024-09-12T02:35:00.059723+0000","last_unstale":"2024-09-12T02:36:08.003132+0000","last_undegraded":"2024-09-12T02:36:08.003132+0000","last_fullsized":"2024-09-12T02:36:08.003132+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:34:59.027857+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:34:59.027857+0000","last_clean_scrub_stamp":"2024-09-12T02:34:59.027857+0000","objects_scrubbed":0,"log_size":31,"log_dups_size":0,"ondisk_log_size":31,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:58:30.390130+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":57258,"num_objects":6,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":40,"num_read_kb":76,"num_write":33,"num_write_kb":68,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,1,2],"acting":[10,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"4.12","version":"0'0","reported_seq":24,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-09-12T02:35:46.724979+0000","last_change":"2024-09-12T02:35:12.574485+0000","last_active":"2024-09-12T02:35:46.724979+0000","last_peered":"2024-09-12T02:35:46.724979+0000","last_clean":"2024-09-12T02:35:46.724979+0000","last_became_active":"2024-09-12T02:35:12.573883+0000","last_became_peered":"2024-09-12T02:35:12.573883+0000","last_unstale":"2024-09-12T02:35:46.724979+0000","last_undegraded":"2024-09-12T02:35:46.724979+0000","last_fullsized":"2024-09-12T02:35:46.724979+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:35:11.552386+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:35:11.552386+0000","last_clean_scrub_stamp":"2024-09-12T02:35:11.552386+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:57:00.001595+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,8,11,5],"acting":[9,8,11,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.14","version":"0'0","reported_seq":33,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-09-12T02:35:46.833848+0000","last_change":"2024-09-12T02:35:02.505882+0000","last_active":"2024-09-12T02:35:46.833848+0000","last_peered":"2024-09-12T02:35:46.833848+0000","last_clean":"2024-09-12T02:35:46.833848+0000","last_became_active":"2024-09-12T02:35:02.504513+0000","last_became_peered":"2024-09-12T02:35:02.504513+0000","last_unstale":"2024-09-12T02:35:46.833848+0000","last_undegraded":"2024-09-12T02:35:46.833848+0000","last_fullsized":"2024-09-12T02:35:46.833848+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:35:01.470375+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:35:01.470375+0000","last_clean_scrub_stamp":"2024-09-12T02:35:01.470375+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:25:58.446843+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,8,4],"acting":[1,8,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.15","version":"93'5","reported_seq":43,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-09-12T02:35:50.785586+0000","last_change":"2024-09-12T02:35:00.068581+0000","last_active":"2024-09-12T02:35:50.785586+0000","last_peered":"2024-09-12T02:35:50.785586+0000","last_clean":"2024-09-12T02:35:50.785586+0000","last_became_active":"2024-09-12T02:35:00.068196+0000","last_became_peered":"2024-09-12T02:35:00.068196+0000","last_unstale":"2024-09-12T02:35:50.785586+0000","last_undegraded":"2024-09-12T02:35:50.785586+0000","last_fullsized":"2024-09-12T02:35:50.785586+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:34:59.027857+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:34:59.027857+0000","last_clean_scrub_stamp":"2024-09-12T02:34:59.027857+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:02:27.807799+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":672,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":7,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0,10],"acting":[5,0,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.13","version":"0'0","reported_seq":24,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-09-12T02:35:46.832968+0000","last_change":"2024-09-12T02:35:12.592600+0000","last_active":"2024-09-12T02:35:46.832968+0000","last_peered":"2024-09-12T02:35:46.832968+0000","last_clean":"2024-09-12T02:35:46.832968+0000","last_became_active":"2024-09-12T02:35:12.591976+0000","last_became_peered":"2024-09-12T02:35:12.591976+0000","last_unstale":"2024-09-12T02:35:46.832968+0000","last_undegraded":"2024-09-12T02:35:46.832968+0000","last_fullsized":"2024-09-12T02:35:46.832968+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:35:11.552386+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:35:11.552386+0000","last_clean_scrub_stamp":"2024-09-12T02:35:11.552386+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T14:23:23.077090+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1,2,9],"acting":[4,1,2,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":30,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-09-12T02:35:46.736730+0000","last_change":"2024-09-12T02:35:02.523261+0000","last_active":"2024-09-12T02:35:46.736730+0000","last_peered":"2024-09-12T02:35:46.736730+0000","last_clean":"2024-09-12T02:35:46.736730+0000","last_became_active":"2024-09-12T02:35:02.522919+0000","last_became_peered":"2024-09-12T02:35:02.522919+0000","last_unstale":"2024-09-12T02:35:46.736730+0000","last_undegraded":"2024-09-12T02:35:46.736730+0000","last_fullsized":"2024-09-12T02:35:46.736730+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:35:01.470375+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:35:01.470375+0000","last_clean_scrub_stamp":"2024-09-12T02:35:01.470375+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:51:54.774700+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4,5],"acting":[0,4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.16","version":"93'4","reported_seq":41,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-09-12T02:35:51.805238+0000","last_change":"2024-09-12T02:35:00.061316+0000","last_active":"2024-09-12T02:35:51.805238+0000","last_peered":"2024-09-12T02:35:51.805238+0000","last_clean":"2024-09-12T02:35:51.805238+0000","last_became_active":"2024-09-12T02:35:00.059753+0000","last_became_peered":"2024-09-12T02:35:00.059753+0000","last_unstale":"2024-09-12T02:35:51.805238+0000","last_undegraded":"2024-09-12T02:35:51.805238+0000","last_fullsized":"2024-09-12T02:35:51.805238+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:34:59.027857+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:34:59.027857+0000","last_clean_scrub_stamp":"2024-09-12T02:34:59.027857+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:43:15.836929+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,2],"acting":[7,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.10","version":"0'0","reported_seq":24,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-09-12T02:35:46.724693+0000","last_change":"2024-09-12T02:35:12.587080+0000","last_active":"2024-09-12T02:35:46.724693+0000","last_peered":"2024-09-12T02:35:46.724693+0000","last_clean":"2024-09-12T02:35:46.724693+0000","last_became_active":"2024-09-12T02:35:12.586322+0000","last_became_peered":"2024-09-12T02:35:12.586322+0000","last_unstale":"2024-09-12T02:35:46.724693+0000","last_undegraded":"2024-09-12T02:35:46.724693+0000","last_fullsized":"2024-09-12T02:35:46.724693+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:35:11.552386+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:35:11.552386+0000","last_clean_scrub_stamp":"2024-09-12T02:35:11.552386+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T13:37:00.736698+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,0,2,4],"acting":[9,0,2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":33,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-09-12T02:35:46.834343+0000","last_change":"2024-09-12T02:35:02.510240+0000","last_active":"2024-09-12T02:35:46.834343+0000","last_peered":"2024-09-12T02:35:46.834343+0000","last_clean":"2024-09-12T02:35:46.834343+0000","last_became_active":"2024-09-12T02:35:02.509909+0000","last_became_peered":"2024-09-12T02:35:02.509909+0000","last_unstale":"2024-09-12T02:35:46.834343+0000","last_undegraded":"2024-09-12T02:35:46.834343+0000","last_fullsized":"2024-09-12T02:35:46.834343+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:35:01.470375+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:35:01.470375+0000","last_clean_scrub_stamp":"2024-09-12T02:35:01.470375+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:27:09.070786+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,10,9],"acting":[1,10,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.17","version":"93'4","reported_seq":75,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-09-12T02:36:08.002557+0000","last_change":"2024-09-12T02:35:00.054193+0000","last_active":"2024-09-12T02:36:08.002557+0000","last_peered":"2024-09-12T02:36:08.002557+0000","last_clean":"2024-09-12T02:36:08.002557+0000","last_became_active":"2024-09-12T02:35:00.053811+0000","last_became_peered":"2024-09-12T02:35:00.053811+0000","last_unstale":"2024-09-12T02:36:08.002557+0000","last_undegraded":"2024-09-12T02:36:08.002557+0000","last_fullsized":"2024-09-12T02:36:08.002557+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:34:59.027857+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:34:59.027857+0000","last_clean_scrub_stamp":"2024-09-12T02:34:59.027857+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:49:30.618015+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":180,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":34,"num_read_kb":34,"num_write":5,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,5,9],"acting":[10,5,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"4.11","version":"0'0","reported_seq":24,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-09-12T02:35:46.726195+0000","last_change":"2024-09-12T02:35:12.579772+0000","last_active":"2024-09-12T02:35:46.726195+0000","last_peered":"2024-09-12T02:35:46.726195+0000","last_clean":"2024-09-12T02:35:46.726195+0000","last_became_active":"2024-09-12T02:35:12.579257+0000","last_became_peered":"2024-09-12T02:35:12.579257+0000","last_unstale":"2024-09-12T02:35:46.726195+0000","last_undegraded":"2024-09-12T02:35:46.726195+0000","last_fullsized":"2024-09-12T02:35:46.726195+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:35:11.552386+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:35:11.552386+0000","last_clean_scrub_stamp":"2024-09-12T02:35:11.552386+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:08:40.588248+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,1,5],"acting":[3,7,1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1e","version":"0'0","reported_seq":22,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-09-12T02:35:46.736311+0000","last_change":"2024-09-12T02:35:12.585212+0000","last_active":"2024-09-12T02:35:46.736311+0000","last_peered":"2024-09-12T02:35:46.736311+0000","last_clean":"2024-09-12T02:35:46.736311+0000","last_became_active":"2024-09-12T02:35:12.583272+0000","last_became_peered":"2024-09-12T02:35:12.583272+0000","last_unstale":"2024-09-12T02:35:46.736311+0000","last_undegraded":"2024-09-12T02:35:46.736311+0000","last_fullsized":"2024-09-12T02:35:46.736311+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:35:11.552386+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:35:11.552386+0000","last_clean_scrub_stamp":"2024-09-12T02:35:11.552386+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:03:28.264565+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7,6,1],"acting":[0,7,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":34,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-09-12T02:35:46.725787+0000","last_change":"2024-09-12T02:35:02.512310+0000","last_active":"2024-09-12T02:35:46.725787+0000","last_peered":"2024-09-12T02:35:46.725787+0000","last_clean":"2024-09-12T02:35:46.725787+0000","last_became_active":"2024-09-12T02:35:02.511969+0000","last_became_peered":"2024-09-12T02:35:02.511969+0000","last_unstale":"2024-09-12T02:35:46.725787+0000","last_undegraded":"2024-09-12T02:35:46.725787+0000","last_fullsized":"2024-09-12T02:35:46.725787+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:35:01.470375+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:35:01.470375+0000","last_clean_scrub_stamp":"2024-09-12T02:35:01.470375+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:57:13.437331+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,3,10],"acting":[9,3,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"2.18","version":"93'3","reported_seq":41,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-09-12T02:35:51.806726+0000","last_change":"2024-09-12T02:35:00.059989+0000","last_active":"2024-09-12T02:35:51.806726+0000","last_peered":"2024-09-12T02:35:51.806726+0000","last_clean":"2024-09-12T02:35:51.806726+0000","last_became_active":"2024-09-12T02:35:00.059659+0000","last_became_peered":"2024-09-12T02:35:00.059659+0000","last_unstale":"2024-09-12T02:35:51.806726+0000","last_undegraded":"2024-09-12T02:35:51.806726+0000","last_fullsized":"2024-09-12T02:35:51.806726+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:34:59.027857+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:34:59.027857+0000","last_clean_scrub_stamp":"2024-09-12T02:34:59.027857+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:19:37.650136+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1,7],"acting":[5,1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1f","version":"0'0","reported_seq":24,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-09-12T02:35:46.729815+0000","last_change":"2024-09-12T02:35:12.589003+0000","last_active":"2024-09-12T02:35:46.729815+0000","last_peered":"2024-09-12T02:35:46.729815+0000","last_clean":"2024-09-12T02:35:46.729815+0000","last_became_active":"2024-09-12T02:35:12.588526+0000","last_became_peered":"2024-09-12T02:35:12.588526+0000","last_unstale":"2024-09-12T02:35:46.729815+0000","last_undegraded":"2024-09-12T02:35:46.729815+0000","last_fullsized":"2024-09-12T02:35:46.729815+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:35:11.552386+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:35:11.552386+0000","last_clean_scrub_stamp":"2024-09-12T02:35:11.552386+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T13:33:04.109195+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,4,9,0],"acting":[11,4,9,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":34,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-09-12T02:35:46.726170+0000","last_change":"2024-09-12T02:35:02.509603+0000","last_active":"2024-09-12T02:35:46.726170+0000","last_peered":"2024-09-12T02:35:46.726170+0000","last_clean":"2024-09-12T02:35:46.726170+0000","last_became_active":"2024-09-12T02:35:02.507799+0000","last_became_peered":"2024-09-12T02:35:02.507799+0000","last_unstale":"2024-09-12T02:35:46.726170+0000","last_undegraded":"2024-09-12T02:35:46.726170+0000","last_fullsized":"2024-09-12T02:35:46.726170+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:35:01.470375+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:35:01.470375+0000","last_clean_scrub_stamp":"2024-09-12T02:35:01.470375+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:27:06.148877+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,11,6],"acting":[3,11,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.19","version":"93'3","reported_seq":39,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-09-12T02:35:49.772426+0000","last_change":"2024-09-12T02:35:00.065183+0000","last_active":"2024-09-12T02:35:49.772426+0000","last_peered":"2024-09-12T02:35:49.772426+0000","last_clean":"2024-09-12T02:35:49.772426+0000","last_became_active":"2024-09-12T02:35:00.064234+0000","last_became_peered":"2024-09-12T02:35:00.064234+0000","last_unstale":"2024-09-12T02:35:49.772426+0000","last_undegraded":"2024-09-12T02:35:49.772426+0000","last_fullsized":"2024-09-12T02:35:49.772426+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:34:59.027857+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:34:59.027857+0000","last_clean_scrub_stamp":"2024-09-12T02:34:59.027857+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:25:27.578117+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,9],"acting":[6,4,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.1a","version":"93'7","reported_seq":44,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-09-12T02:35:50.787038+0000","last_change":"2024-09-12T02:35:00.061590+0000","last_active":"2024-09-12T02:35:50.787038+0000","last_peered":"2024-09-12T02:35:50.787038+0000","last_clean":"2024-09-12T02:35:50.787038+0000","last_became_active":"2024-09-12T02:35:00.061266+0000","last_became_peered":"2024-09-12T02:35:00.061266+0000","last_unstale":"2024-09-12T02:35:50.787038+0000","last_undegraded":"2024-09-12T02:35:50.787038+0000","last_fullsized":"2024-09-12T02:35:50.787038+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:34:59.027857+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:34:59.027857+0000","last_clean_scrub_stamp":"2024-09-12T02:34:59.027857+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:46:39.137050+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":9,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,8,6],"acting":[10,8,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.1b","version":"0'0","reported_seq":32,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-09-12T02:35:46.727806+0000","last_change":"2024-09-12T02:35:02.508064+0000","last_active":"2024-09-12T02:35:46.727806+0000","last_peered":"2024-09-12T02:35:46.727806+0000","last_clean":"2024-09-12T02:35:46.727806+0000","last_became_active":"2024-09-12T02:35:02.507737+0000","last_became_peered":"2024-09-12T02:35:02.507737+0000","last_unstale":"2024-09-12T02:35:46.727806+0000","last_undegraded":"2024-09-12T02:35:46.727806+0000","last_fullsized":"2024-09-12T02:35:46.727806+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:35:01.470375+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:35:01.470375+0000","last_clean_scrub_stamp":"2024-09-12T02:35:01.470375+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:39:53.655575+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,3],"acting":[5,4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1c","version":"0'0","reported_seq":24,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-09-12T02:35:46.731182+0000","last_change":"2024-09-12T02:35:12.588770+0000","last_active":"2024-09-12T02:35:46.731182+0000","last_peered":"2024-09-12T02:35:46.731182+0000","last_clean":"2024-09-12T02:35:46.731182+0000","last_became_active":"2024-09-12T02:35:12.588104+0000","last_became_peered":"2024-09-12T02:35:12.588104+0000","last_unstale":"2024-09-12T02:35:46.731182+0000","last_undegraded":"2024-09-12T02:35:46.731182+0000","last_fullsized":"2024-09-12T02:35:46.731182+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:35:11.552386+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:35:11.552386+0000","last_clean_scrub_stamp":"2024-09-12T02:35:11.552386+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:31:05.068737+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6,9,5],"acting":[2,6,9,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1b","version":"93'5","reported_seq":67,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-09-12T02:36:07.001592+0000","last_change":"2024-09-12T02:35:46.834966+0000","last_active":"2024-09-12T02:36:07.001592+0000","last_peered":"2024-09-12T02:36:07.001592+0000","last_clean":"2024-09-12T02:36:07.001592+0000","last_became_active":"2024-09-12T02:35:46.834652+0000","last_became_peered":"2024-09-12T02:35:46.834652+0000","last_unstale":"2024-09-12T02:36:07.001592+0000","last_undegraded":"2024-09-12T02:36:07.001592+0000","last_fullsized":"2024-09-12T02:36:07.001592+0000","mapping_epoch":92,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":93,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:34:59.027857+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:34:59.027857+0000","last_clean_scrub_stamp":"2024-09-12T02:34:59.027857+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:10:48.506122+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":622,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":19,"num_read_kb":2,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,7],"acting":[5,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.1a","version":"0'0","reported_seq":31,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-09-12T02:35:46.727762+0000","last_change":"2024-09-12T02:35:02.507569+0000","last_active":"2024-09-12T02:35:46.727762+0000","last_peered":"2024-09-12T02:35:46.727762+0000","last_clean":"2024-09-12T02:35:46.727762+0000","last_became_active":"2024-09-12T02:35:02.507244+0000","last_became_peered":"2024-09-12T02:35:02.507244+0000","last_unstale":"2024-09-12T02:35:46.727762+0000","last_undegraded":"2024-09-12T02:35:46.727762+0000","last_fullsized":"2024-09-12T02:35:46.727762+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:35:01.470375+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:35:01.470375+0000","last_clean_scrub_stamp":"2024-09-12T02:35:01.470375+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:50:26.959314+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,9,5],"acting":[8,9,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"4.1d","version":"0'0","reported_seq":24,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-09-12T02:35:46.731353+0000","last_change":"2024-09-12T02:35:12.577997+0000","last_active":"2024-09-12T02:35:46.731353+0000","last_peered":"2024-09-12T02:35:46.731353+0000","last_clean":"2024-09-12T02:35:46.731353+0000","last_became_active":"2024-09-12T02:35:12.577577+0000","last_became_peered":"2024-09-12T02:35:12.577577+0000","last_unstale":"2024-09-12T02:35:46.731353+0000","last_undegraded":"2024-09-12T02:35:46.731353+0000","last_fullsized":"2024-09-12T02:35:46.731353+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:35:11.552386+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:35:11.552386+0000","last_clean_scrub_stamp":"2024-09-12T02:35:11.552386+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:33:51.562986+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5,7,11],"acting":[2,5,7,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.20","version":"0'0","reported_seq":31,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-09-12T02:35:46.731459+0000","last_change":"2024-09-12T02:35:02.509328+0000","last_active":"2024-09-12T02:35:46.731459+0000","last_peered":"2024-09-12T02:35:46.731459+0000","last_clean":"2024-09-12T02:35:46.731459+0000","last_became_active":"2024-09-12T02:35:02.509000+0000","last_became_peered":"2024-09-12T02:35:02.509000+0000","last_unstale":"2024-09-12T02:35:46.731459+0000","last_undegraded":"2024-09-12T02:35:46.731459+0000","last_fullsized":"2024-09-12T02:35:46.731459+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:35:01.470375+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:35:01.470375+0000","last_clean_scrub_stamp":"2024-09-12T02:35:01.470375+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:46:49.170900+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,2,5],"acting":[11,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.21","version":"0'0","reported_seq":34,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-09-12T02:35:46.732374+0000","last_change":"2024-09-12T02:35:02.515252+0000","last_active":"2024-09-12T02:35:46.732374+0000","last_peered":"2024-09-12T02:35:46.732374+0000","last_clean":"2024-09-12T02:35:46.732374+0000","last_became_active":"2024-09-12T02:35:02.514959+0000","last_became_peered":"2024-09-12T02:35:02.514959+0000","last_unstale":"2024-09-12T02:35:46.732374+0000","last_undegraded":"2024-09-12T02:35:46.732374+0000","last_fullsized":"2024-09-12T02:35:46.732374+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:35:01.470375+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:35:01.470375+0000","last_clean_scrub_stamp":"2024-09-12T02:35:01.470375+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:42:02.769604+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5,4],"acting":[2,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.22","version":"0'0","reported_seq":34,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-09-12T02:35:46.731219+0000","last_change":"2024-09-12T02:35:02.516334+0000","last_active":"2024-09-12T02:35:46.731219+0000","last_peered":"2024-09-12T02:35:46.731219+0000","last_clean":"2024-09-12T02:35:46.731219+0000","last_became_active":"2024-09-12T02:35:02.515949+0000","last_became_peered":"2024-09-12T02:35:02.515949+0000","last_unstale":"2024-09-12T02:35:46.731219+0000","last_undegraded":"2024-09-12T02:35:46.731219+0000","last_fullsized":"2024-09-12T02:35:46.731219+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:35:01.470375+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:35:01.470375+0000","last_clean_scrub_stamp":"2024-09-12T02:35:01.470375+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:41:00.677038+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0],"acting":[2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.23","version":"0'0","reported_seq":30,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-09-12T02:35:46.736152+0000","last_change":"2024-09-12T02:35:02.516701+0000","last_active":"2024-09-12T02:35:46.736152+0000","last_peered":"2024-09-12T02:35:46.736152+0000","last_clean":"2024-09-12T02:35:46.736152+0000","last_became_active":"2024-09-12T02:35:02.516384+0000","last_became_peered":"2024-09-12T02:35:02.516384+0000","last_unstale":"2024-09-12T02:35:46.736152+0000","last_undegraded":"2024-09-12T02:35:46.736152+0000","last_fullsized":"2024-09-12T02:35:46.736152+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:35:01.470375+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:35:01.470375+0000","last_clean_scrub_stamp":"2024-09-12T02:35:01.470375+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:11:43.591371+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6,4],"acting":[0,6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.24","version":"0'0","reported_seq":37,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-09-12T02:35:46.737445+0000","last_change":"2024-09-12T02:35:46.737445+0000","last_active":"2024-09-12T02:35:46.737445+0000","last_peered":"2024-09-12T02:35:46.737445+0000","last_clean":"2024-09-12T02:35:46.737445+0000","last_became_active":"2024-09-12T02:35:46.736786+0000","last_became_peered":"2024-09-12T02:35:46.736786+0000","last_unstale":"2024-09-12T02:35:46.737445+0000","last_undegraded":"2024-09-12T02:35:46.737445+0000","last_fullsized":"2024-09-12T02:35:46.737445+0000","mapping_epoch":92,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":93,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:35:01.470375+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:35:01.470375+0000","last_clean_scrub_stamp":"2024-09-12T02:35:01.470375+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:25:54.143479+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,9,0],"acting":[6,9,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.25","version":"0'0","reported_seq":31,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-09-12T02:35:46.730787+0000","last_change":"2024-09-12T02:35:02.508237+0000","last_active":"2024-09-12T02:35:46.730787+0000","last_peered":"2024-09-12T02:35:46.730787+0000","last_clean":"2024-09-12T02:35:46.730787+0000","last_became_active":"2024-09-12T02:35:02.507911+0000","last_became_peered":"2024-09-12T02:35:02.507911+0000","last_unstale":"2024-09-12T02:35:46.730787+0000","last_undegraded":"2024-09-12T02:35:46.730787+0000","last_fullsized":"2024-09-12T02:35:46.730787+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:35:01.470375+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:35:01.470375+0000","last_clean_scrub_stamp":"2024-09-12T02:35:01.470375+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T13:13:38.863684+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,8,5],"acting":[11,8,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.26","version":"0'0","reported_seq":34,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-09-12T02:35:46.731366+0000","last_change":"2024-09-12T02:35:02.511218+0000","last_active":"2024-09-12T02:35:46.731366+0000","last_peered":"2024-09-12T02:35:46.731366+0000","last_clean":"2024-09-12T02:35:46.731366+0000","last_became_active":"2024-09-12T02:35:02.510533+0000","last_became_peered":"2024-09-12T02:35:02.510533+0000","last_unstale":"2024-09-12T02:35:46.731366+0000","last_undegraded":"2024-09-12T02:35:46.731366+0000","last_fullsized":"2024-09-12T02:35:46.731366+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:35:01.470375+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:35:01.470375+0000","last_clean_scrub_stamp":"2024-09-12T02:35:01.470375+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:16:00.293407+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,8,1],"acting":[2,8,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.27","version":"0'0","reported_seq":34,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-09-12T02:35:46.727062+0000","last_change":"2024-09-12T02:35:02.512531+0000","last_active":"2024-09-12T02:35:46.727062+0000","last_peered":"2024-09-12T02:35:46.727062+0000","last_clean":"2024-09-12T02:35:46.727062+0000","last_became_active":"2024-09-12T02:35:02.509796+0000","last_became_peered":"2024-09-12T02:35:02.509796+0000","last_unstale":"2024-09-12T02:35:46.727062+0000","last_undegraded":"2024-09-12T02:35:46.727062+0000","last_fullsized":"2024-09-12T02:35:46.727062+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:35:01.470375+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:35:01.470375+0000","last_clean_scrub_stamp":"2024-09-12T02:35:01.470375+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:56:42.613776+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4,2],"acting":[3,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.28","version":"0'0","reported_seq":32,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-09-12T02:35:46.727945+0000","last_change":"2024-09-12T02:35:02.507891+0000","last_active":"2024-09-12T02:35:46.727945+0000","last_peered":"2024-09-12T02:35:46.727945+0000","last_clean":"2024-09-12T02:35:46.727945+0000","last_became_active":"2024-09-12T02:35:02.507548+0000","last_became_peered":"2024-09-12T02:35:02.507548+0000","last_unstale":"2024-09-12T02:35:46.727945+0000","last_undegraded":"2024-09-12T02:35:46.727945+0000","last_fullsized":"2024-09-12T02:35:46.727945+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:35:01.470375+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:35:01.470375+0000","last_clean_scrub_stamp":"2024-09-12T02:35:01.470375+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:35:12.386932+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,9,3],"acting":[5,9,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.29","version":"0'0","reported_seq":34,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-09-12T02:35:46.726346+0000","last_change":"2024-09-12T02:35:02.518093+0000","last_active":"2024-09-12T02:35:46.726346+0000","last_peered":"2024-09-12T02:35:46.726346+0000","last_clean":"2024-09-12T02:35:46.726346+0000","last_became_active":"2024-09-12T02:35:02.512045+0000","last_became_peered":"2024-09-12T02:35:02.512045+0000","last_unstale":"2024-09-12T02:35:46.726346+0000","last_undegraded":"2024-09-12T02:35:46.726346+0000","last_fullsized":"2024-09-12T02:35:46.726346+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:35:01.470375+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:35:01.470375+0000","last_clean_scrub_stamp":"2024-09-12T02:35:01.470375+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:06:35.765876+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,11],"acting":[3,2,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2a","version":"0'0","reported_seq":33,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-09-12T02:35:46.832970+0000","last_change":"2024-09-12T02:35:02.516522+0000","last_active":"2024-09-12T02:35:46.832970+0000","last_peered":"2024-09-12T02:35:46.832970+0000","last_clean":"2024-09-12T02:35:46.832970+0000","last_became_active":"2024-09-12T02:35:02.516178+0000","last_became_peered":"2024-09-12T02:35:02.516178+0000","last_unstale":"2024-09-12T02:35:46.832970+0000","last_undegraded":"2024-09-12T02:35:46.832970+0000","last_fullsized":"2024-09-12T02:35:46.832970+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:35:01.470375+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:35:01.470375+0000","last_clean_scrub_stamp":"2024-09-12T02:35:01.470375+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:00:01.397055+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7,3],"acting":[1,7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2b","version":"0'0","reported_seq":31,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-09-12T02:35:46.732205+0000","last_change":"2024-09-12T02:35:02.513095+0000","last_active":"2024-09-12T02:35:46.732205+0000","last_peered":"2024-09-12T02:35:46.732205+0000","last_clean":"2024-09-12T02:35:46.732205+0000","last_became_active":"2024-09-12T02:35:02.512782+0000","last_became_peered":"2024-09-12T02:35:02.512782+0000","last_unstale":"2024-09-12T02:35:46.732205+0000","last_undegraded":"2024-09-12T02:35:46.732205+0000","last_fullsized":"2024-09-12T02:35:46.732205+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:35:01.470375+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:35:01.470375+0000","last_clean_scrub_stamp":"2024-09-12T02:35:01.470375+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:19:05.954874+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,0],"acting":[6,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.2c","version":"0'0","reported_seq":31,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-09-12T02:35:46.729553+0000","last_change":"2024-09-12T02:35:02.503773+0000","last_active":"2024-09-12T02:35:46.729553+0000","last_peered":"2024-09-12T02:35:46.729553+0000","last_clean":"2024-09-12T02:35:46.729553+0000","last_became_active":"2024-09-12T02:35:02.503386+0000","last_became_peered":"2024-09-12T02:35:02.503386+0000","last_unstale":"2024-09-12T02:35:46.729553+0000","last_undegraded":"2024-09-12T02:35:46.729553+0000","last_fullsized":"2024-09-12T02:35:46.729553+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:35:01.470375+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:35:01.470375+0000","last_clean_scrub_stamp":"2024-09-12T02:35:01.470375+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:15:44.995245+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,4,8],"acting":[11,4,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.2d","version":"0'0","reported_seq":34,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-09-12T02:35:46.731578+0000","last_change":"2024-09-12T02:35:02.516429+0000","last_active":"2024-09-12T02:35:46.731578+0000","last_peered":"2024-09-12T02:35:46.731578+0000","last_clean":"2024-09-12T02:35:46.731578+0000","last_became_active":"2024-09-12T02:35:02.515907+0000","last_became_peered":"2024-09-12T02:35:02.515907+0000","last_unstale":"2024-09-12T02:35:46.731578+0000","last_undegraded":"2024-09-12T02:35:46.731578+0000","last_fullsized":"2024-09-12T02:35:46.731578+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:35:01.470375+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:35:01.470375+0000","last_clean_scrub_stamp":"2024-09-12T02:35:01.470375+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:30:04.631809+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,6],"acting":[2,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2e","version":"0'0","reported_seq":34,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-09-12T02:35:46.725991+0000","last_change":"2024-09-12T02:35:02.505181+0000","last_active":"2024-09-12T02:35:46.725991+0000","last_peered":"2024-09-12T02:35:46.725991+0000","last_clean":"2024-09-12T02:35:46.725991+0000","last_became_active":"2024-09-12T02:35:02.504824+0000","last_became_peered":"2024-09-12T02:35:02.504824+0000","last_unstale":"2024-09-12T02:35:46.725991+0000","last_undegraded":"2024-09-12T02:35:46.725991+0000","last_fullsized":"2024-09-12T02:35:46.725991+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:35:01.470375+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:35:01.470375+0000","last_clean_scrub_stamp":"2024-09-12T02:35:01.470375+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T14:00:57.800731+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,1,10],"acting":[9,1,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.2f","version":"0'0","reported_seq":31,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-09-12T02:35:46.730269+0000","last_change":"2024-09-12T02:35:02.520568+0000","last_active":"2024-09-12T02:35:46.730269+0000","last_peered":"2024-09-12T02:35:46.730269+0000","last_clean":"2024-09-12T02:35:46.730269+0000","last_became_active":"2024-09-12T02:35:02.520244+0000","last_became_peered":"2024-09-12T02:35:02.520244+0000","last_unstale":"2024-09-12T02:35:46.730269+0000","last_undegraded":"2024-09-12T02:35:46.730269+0000","last_fullsized":"2024-09-12T02:35:46.730269+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:35:01.470375+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:35:01.470375+0000","last_clean_scrub_stamp":"2024-09-12T02:35:01.470375+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:42:25.130404+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,1,0],"acting":[11,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.30","version":"0'0","reported_seq":33,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-09-12T02:35:46.832590+0000","last_change":"2024-09-12T02:35:02.514647+0000","last_active":"2024-09-12T02:35:46.832590+0000","last_peered":"2024-09-12T02:35:46.832590+0000","last_clean":"2024-09-12T02:35:46.832590+0000","last_became_active":"2024-09-12T02:35:02.513930+0000","last_became_peered":"2024-09-12T02:35:02.513930+0000","last_unstale":"2024-09-12T02:35:46.832590+0000","last_undegraded":"2024-09-12T02:35:46.832590+0000","last_fullsized":"2024-09-12T02:35:46.832590+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:35:01.470375+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:35:01.470375+0000","last_clean_scrub_stamp":"2024-09-12T02:35:01.470375+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:56:32.701937+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7,0],"acting":[1,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.31","version":"0'0","reported_seq":30,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-09-12T02:35:46.735655+0000","last_change":"2024-09-12T02:35:02.512230+0000","last_active":"2024-09-12T02:35:46.735655+0000","last_peered":"2024-09-12T02:35:46.735655+0000","last_clean":"2024-09-12T02:35:46.735655+0000","last_became_active":"2024-09-12T02:35:02.508114+0000","last_became_peered":"2024-09-12T02:35:02.508114+0000","last_unstale":"2024-09-12T02:35:46.735655+0000","last_undegraded":"2024-09-12T02:35:46.735655+0000","last_fullsized":"2024-09-12T02:35:46.735655+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:35:01.470375+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:35:01.470375+0000","last_clean_scrub_stamp":"2024-09-12T02:35:01.470375+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:37:53.225043+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4,2],"acting":[0,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.32","version":"0'0","reported_seq":30,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-09-12T02:35:46.735951+0000","last_change":"2024-09-12T02:35:02.519176+0000","last_active":"2024-09-12T02:35:46.735951+0000","last_peered":"2024-09-12T02:35:46.735951+0000","last_clean":"2024-09-12T02:35:46.735951+0000","last_became_active":"2024-09-12T02:35:02.518437+0000","last_became_peered":"2024-09-12T02:35:02.518437+0000","last_unstale":"2024-09-12T02:35:46.735951+0000","last_undegraded":"2024-09-12T02:35:46.735951+0000","last_fullsized":"2024-09-12T02:35:46.735951+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:35:01.470375+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:35:01.470375+0000","last_clean_scrub_stamp":"2024-09-12T02:35:01.470375+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:46:32.198479+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,8,10],"acting":[0,8,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.33","version":"0'0","reported_seq":37,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-09-12T02:35:46.759182+0000","last_change":"2024-09-12T02:35:46.759182+0000","last_active":"2024-09-12T02:35:46.759182+0000","last_peered":"2024-09-12T02:35:46.759182+0000","last_clean":"2024-09-12T02:35:46.759182+0000","last_became_active":"2024-09-12T02:35:46.758619+0000","last_became_peered":"2024-09-12T02:35:46.758619+0000","last_unstale":"2024-09-12T02:35:46.759182+0000","last_undegraded":"2024-09-12T02:35:46.759182+0000","last_fullsized":"2024-09-12T02:35:46.759182+0000","mapping_epoch":92,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":93,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:35:01.470375+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:35:01.470375+0000","last_clean_scrub_stamp":"2024-09-12T02:35:01.470375+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:35:55.039970+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,10,9],"acting":[6,10,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.34","version":"0'0","reported_seq":11,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-09-12T02:35:46.759745+0000","last_change":"2024-09-12T02:35:46.758945+0000","last_active":"2024-09-12T02:35:46.759745+0000","last_peered":"2024-09-12T02:35:46.759745+0000","last_clean":"2024-09-12T02:35:46.759745+0000","last_became_active":"2024-09-12T02:35:46.758522+0000","last_became_peered":"2024-09-12T02:35:46.758522+0000","last_unstale":"2024-09-12T02:35:46.759745+0000","last_undegraded":"2024-09-12T02:35:46.759745+0000","last_fullsized":"2024-09-12T02:35:46.759745+0000","mapping_epoch":92,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":93,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:35:01.470375+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:35:01.470375+0000","last_clean_scrub_stamp":"2024-09-12T02:35:01.470375+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:18:47.916784+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,10,8],"acting":[9,10,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.35","version":"0'0","reported_seq":33,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-09-12T02:35:46.731013+0000","last_change":"2024-09-12T02:35:02.511777+0000","last_active":"2024-09-12T02:35:46.731013+0000","last_peered":"2024-09-12T02:35:46.731013+0000","last_clean":"2024-09-12T02:35:46.731013+0000","last_became_active":"2024-09-12T02:35:02.511341+0000","last_became_peered":"2024-09-12T02:35:02.511341+0000","last_unstale":"2024-09-12T02:35:46.731013+0000","last_undegraded":"2024-09-12T02:35:46.731013+0000","last_fullsized":"2024-09-12T02:35:46.731013+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:35:01.470375+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:35:01.470375+0000","last_clean_scrub_stamp":"2024-09-12T02:35:01.470375+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:51:52.093252+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,8,1],"acting":[7,8,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.36","version":"0'0","reported_seq":32,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-09-12T02:35:46.758078+0000","last_change":"2024-09-12T02:35:02.510278+0000","last_active":"2024-09-12T02:35:46.758078+0000","last_peered":"2024-09-12T02:35:46.758078+0000","last_clean":"2024-09-12T02:35:46.758078+0000","last_became_active":"2024-09-12T02:35:02.509959+0000","last_became_peered":"2024-09-12T02:35:02.509959+0000","last_unstale":"2024-09-12T02:35:46.758078+0000","last_undegraded":"2024-09-12T02:35:46.758078+0000","last_fullsized":"2024-09-12T02:35:46.758078+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:35:01.470375+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:35:01.470375+0000","last_clean_scrub_stamp":"2024-09-12T02:35:01.470375+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:34:55.086493+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,2,4],"acting":[10,2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.37","version":"0'0","reported_seq":33,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-09-12T02:35:46.834443+0000","last_change":"2024-09-12T02:35:02.508143+0000","last_active":"2024-09-12T02:35:46.834443+0000","last_peered":"2024-09-12T02:35:46.834443+0000","last_clean":"2024-09-12T02:35:46.834443+0000","last_became_active":"2024-09-12T02:35:02.507096+0000","last_became_peered":"2024-09-12T02:35:02.507096+0000","last_unstale":"2024-09-12T02:35:46.834443+0000","last_undegraded":"2024-09-12T02:35:46.834443+0000","last_fullsized":"2024-09-12T02:35:46.834443+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:35:01.470375+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:35:01.470375+0000","last_clean_scrub_stamp":"2024-09-12T02:35:01.470375+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:04:15.687448+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,11],"acting":[1,5,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.38","version":"0'0","reported_seq":34,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-09-12T02:35:46.726064+0000","last_change":"2024-09-12T02:35:02.517013+0000","last_active":"2024-09-12T02:35:46.726064+0000","last_peered":"2024-09-12T02:35:46.726064+0000","last_clean":"2024-09-12T02:35:46.726064+0000","last_became_active":"2024-09-12T02:35:02.511344+0000","last_became_peered":"2024-09-12T02:35:02.511344+0000","last_unstale":"2024-09-12T02:35:46.726064+0000","last_undegraded":"2024-09-12T02:35:46.726064+0000","last_fullsized":"2024-09-12T02:35:46.726064+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:35:01.470375+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:35:01.470375+0000","last_clean_scrub_stamp":"2024-09-12T02:35:01.470375+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:35:56.829248+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5,10],"acting":[3,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.39","version":"0'0","reported_seq":33,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-09-12T02:35:46.730082+0000","last_change":"2024-09-12T02:35:02.515221+0000","last_active":"2024-09-12T02:35:46.730082+0000","last_peered":"2024-09-12T02:35:46.730082+0000","last_clean":"2024-09-12T02:35:46.730082+0000","last_became_active":"2024-09-12T02:35:02.514878+0000","last_became_peered":"2024-09-12T02:35:02.514878+0000","last_unstale":"2024-09-12T02:35:46.730082+0000","last_undegraded":"2024-09-12T02:35:46.730082+0000","last_fullsized":"2024-09-12T02:35:46.730082+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:35:01.470375+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:35:01.470375+0000","last_clean_scrub_stamp":"2024-09-12T02:35:01.470375+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:30:49.794740+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,9,5],"acting":[7,9,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3a","version":"0'0","reported_seq":32,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-09-12T02:35:46.757709+0000","last_change":"2024-09-12T02:35:02.506118+0000","last_active":"2024-09-12T02:35:46.757709+0000","last_peered":"2024-09-12T02:35:46.757709+0000","last_clean":"2024-09-12T02:35:46.757709+0000","last_became_active":"2024-09-12T02:35:02.505802+0000","last_became_peered":"2024-09-12T02:35:02.505802+0000","last_unstale":"2024-09-12T02:35:46.757709+0000","last_undegraded":"2024-09-12T02:35:46.757709+0000","last_fullsized":"2024-09-12T02:35:46.757709+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:35:01.470375+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:35:01.470375+0000","last_clean_scrub_stamp":"2024-09-12T02:35:01.470375+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:39:29.295096+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,9,4],"acting":[10,9,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.3b","version":"0'0","reported_seq":31,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-09-12T02:35:46.726785+0000","last_change":"2024-09-12T02:35:02.514743+0000","last_active":"2024-09-12T02:35:46.726785+0000","last_peered":"2024-09-12T02:35:46.726785+0000","last_clean":"2024-09-12T02:35:46.726785+0000","last_became_active":"2024-09-12T02:35:02.514299+0000","last_became_peered":"2024-09-12T02:35:02.514299+0000","last_unstale":"2024-09-12T02:35:46.726785+0000","last_undegraded":"2024-09-12T02:35:46.726785+0000","last_fullsized":"2024-09-12T02:35:46.726785+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:35:01.470375+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:35:01.470375+0000","last_clean_scrub_stamp":"2024-09-12T02:35:01.470375+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T13:31:30.632444+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,3,6],"acting":[8,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.3c","version":"0'0","reported_seq":32,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-09-12T02:35:46.833438+0000","last_change":"2024-09-12T02:35:02.504682+0000","last_active":"2024-09-12T02:35:46.833438+0000","last_peered":"2024-09-12T02:35:46.833438+0000","last_clean":"2024-09-12T02:35:46.833438+0000","last_became_active":"2024-09-12T02:35:02.504154+0000","last_became_peered":"2024-09-12T02:35:02.504154+0000","last_unstale":"2024-09-12T02:35:46.833438+0000","last_undegraded":"2024-09-12T02:35:46.833438+0000","last_fullsized":"2024-09-12T02:35:46.833438+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:35:01.470375+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:35:01.470375+0000","last_clean_scrub_stamp":"2024-09-12T02:35:01.470375+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:46:38.038655+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,8,2],"acting":[4,8,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.3d","version":"0'0","reported_seq":30,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-09-12T02:35:46.736081+0000","last_change":"2024-09-12T02:35:02.513117+0000","last_active":"2024-09-12T02:35:46.736081+0000","last_peered":"2024-09-12T02:35:46.736081+0000","last_clean":"2024-09-12T02:35:46.736081+0000","last_became_active":"2024-09-12T02:35:02.512824+0000","last_became_peered":"2024-09-12T02:35:02.512824+0000","last_unstale":"2024-09-12T02:35:46.736081+0000","last_undegraded":"2024-09-12T02:35:46.736081+0000","last_fullsized":"2024-09-12T02:35:46.736081+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:35:01.470375+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:35:01.470375+0000","last_clean_scrub_stamp":"2024-09-12T02:35:01.470375+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:18:22.413221+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,1],"acting":[0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3e","version":"0'0","reported_seq":30,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-09-12T02:35:46.736424+0000","last_change":"2024-09-12T02:35:02.517799+0000","last_active":"2024-09-12T02:35:46.736424+0000","last_peered":"2024-09-12T02:35:46.736424+0000","last_clean":"2024-09-12T02:35:46.736424+0000","last_became_active":"2024-09-12T02:35:02.513361+0000","last_became_peered":"2024-09-12T02:35:02.513361+0000","last_unstale":"2024-09-12T02:35:46.736424+0000","last_undegraded":"2024-09-12T02:35:46.736424+0000","last_fullsized":"2024-09-12T02:35:46.736424+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:35:01.470375+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:35:01.470375+0000","last_clean_scrub_stamp":"2024-09-12T02:35:01.470375+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T13:39:37.894677+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,11,10],"acting":[0,11,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3f","version":"0'0","reported_seq":31,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-09-12T02:35:46.730144+0000","last_change":"2024-09-12T02:35:02.520715+0000","last_active":"2024-09-12T02:35:46.730144+0000","last_peered":"2024-09-12T02:35:46.730144+0000","last_clean":"2024-09-12T02:35:46.730144+0000","last_became_active":"2024-09-12T02:35:02.520348+0000","last_became_peered":"2024-09-12T02:35:02.520348+0000","last_unstale":"2024-09-12T02:35:46.730144+0000","last_undegraded":"2024-09-12T02:35:46.730144+0000","last_fullsized":"2024-09-12T02:35:46.730144+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:35:01.470375+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:35:01.470375+0000","last_clean_scrub_stamp":"2024-09-12T02:35:01.470375+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:08:10.982486+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,1,0],"acting":[11,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]}],"pool_stats":[{"poolid":4,"num_pg":32,"stat_sum":{"num_bytes":234,"num_objects":2,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":32768,"data_stored":32768,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":2,"ondisk_log_size":2,"up":128,"acting":128,"num_store_stats":12},{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":192,"acting":192,"num_store_stats":12},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":64859,"num_objects":98,"num_object_clones":0,"num_object_copies":294,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":98,"num_whiteouts":0,"num_read":212,"num_read_kb":178,"num_write":243,"num_write_kb":134,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":5,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":66,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":552960,"data_stored":194577,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":210,"ondisk_log_size":210,"up":96,"acting":96,"num_store_stats":12},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":136,"num_read_kb":119,"num_write":181,"num_write_kb":2938,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":1180736,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":3563520,"data_stored":3542208,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":137,"ondisk_log_size":137,"up":3,"acting":3,"num_store_stats":8}],"osd_stats":[{"osd":11,"up_from":77,"seq":330712481818,"num_pgs":29,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":28072,"kb_used_data":1048,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717080,"statfs":{"total":95995035648,"available":95966289920,"internally_reserved":0,"allocated":1073152,"data_stored":526819,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1596,"internal_metadata":27654596},"hb_peers":[0,1,2,4,5,6,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":10,"up_from":70,"seq":300647710751,"num_pgs":32,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":28736,"kb_used_data":1712,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93716416,"statfs":{"total":95995035648,"available":95965609984,"internally_reserved":0,"allocated":1753088,"data_stored":1170781,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1600,"internal_metadata":27654592},"hb_peers":[0,1,2,3,4,5,6,8,9,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":9,"up_from":65,"seq":279172874276,"num_pgs":36,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":28092,"kb_used_data":1068,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717060,"statfs":{"total":95995035648,"available":95966269440,"internally_reserved":0,"allocated":1093632,"data_stored":530340,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1600,"internal_metadata":27654592},"hb_peers":[0,1,2,3,4,5,7,8,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":8,"up_from":57,"seq":244813135914,"num_pgs":29,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":28076,"kb_used_data":1052,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717076,"statfs":{"total":95995035648,"available":95966285824,"internally_reserved":0,"allocated":1077248,"data_stored":526510,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4,5,6,7,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":7,"up_from":50,"seq":214748364847,"num_pgs":36,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":28668,"kb_used_data":1644,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93716484,"statfs":{"total":95995035648,"available":95965679616,"internally_reserved":0,"allocated":1683456,"data_stored":1123514,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":27654602},"hb_peers":[1,2,3,4,5,6,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":6,"up_from":45,"seq":193273528372,"num_pgs":32,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":28064,"kb_used_data":1040,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717088,"statfs":{"total":95995035648,"available":95966298112,"internally_reserved":0,"allocated":1064960,"data_stored":522141,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,5,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":5,"up_from":38,"seq":163208757306,"num_pgs":45,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":28676,"kb_used_data":1652,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93716476,"statfs":{"total":95995035648,"available":95965671424,"internally_reserved":0,"allocated":1691648,"data_stored":1118310,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":4,"up_from":33,"seq":141733920832,"num_pgs":35,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":36400,"kb_used_data":1056,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":93708752,"statfs":{"total":95995035648,"available":95957762048,"internally_reserved":0,"allocated":1081344,"data_stored":526837,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":36174277},"hb_peers":[1,2,3,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":3,"up_from":26,"seq":111669149764,"num_pgs":40,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":32236,"kb_used_data":1052,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":93712916,"statfs":{"total":95995035648,"available":95962025984,"internally_reserved":0,"allocated":1077248,"data_stored":521456,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":31914439},"hb_peers":[0,1,2,4,5,6,7,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":18,"seq":77309411403,"num_pgs":35,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":28136,"kb_used_data":1112,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717016,"statfs":{"total":95995035648,"available":95966224384,"internally_reserved":0,"allocated":1138688,"data_stored":580027,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,3,4,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":13,"seq":55834574928,"num_pgs":35,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":28124,"kb_used_data":1100,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717028,"statfs":{"total":95995035648,"available":95966236672,"internally_reserved":0,"allocated":1126400,"data_stored":580429,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,2,3,4,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":8,"seq":34359738451,"num_pgs":35,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":32248,"kb_used_data":1064,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":93712904,"statfs":{"total":95995035648,"available":95962013696,"internally_reserved":0,"allocated":1089536,"data_stored":523597,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[1,2,3,4,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":40960,"data_stored":2571,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":77824,"data_stored":59403,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":90112,"data_stored":59001,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":28672,"data_stored":430,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":28672,"data_stored":1715,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":45056,"data_stored":2820,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":1115,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":32768,"data_stored":3928,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":24576,"data_stored":1388,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":9,"total":0,"available":0,"internally_reserved":0,"allocated":36864,"data_stored":1122,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":110592,"data_stored":59387,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":11,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":1697,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":9,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":11,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":4096,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":4096,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":8192,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":4096,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":9,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":8192,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":11,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":4096,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-12T02:36:13.344 INFO:tasks.cephadm.ceph_manager.ceph:clean! 2024-09-12T02:36:13.344 INFO:tasks.cephadm:Setting up client nodes... 2024-09-12T02:36:13.345 DEBUG:teuthology.orchestra.run.smithi039:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 4954ed46-70ae-11ef-bcea-c7b262605968 -- ceph auth get-or-create client.0 mon 'allow *' osd 'allow *' mds 'allow *' mgr 'allow *' 2024-09-12T02:36:13.756 INFO:teuthology.orchestra.run.smithi039.stderr:Inferring config /var/lib/ceph/4954ed46-70ae-11ef-bcea-c7b262605968/mon.a/config 2024-09-12T02:36:14.013 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 12 02:36:13 smithi172 ceph-mon[35609]: from='client.24737 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-09-12T02:36:14.038 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 02:36:13 smithi039 ceph-mon[30515]: from='client.24737 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-09-12T02:36:14.198 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 12 02:36:13 smithi044 ceph-mon[35411]: from='client.24737 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-09-12T02:36:14.301 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:36:14.300+0000 7fec7f000640 1 -- 172.21.15.39:0/231825074 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fec78105920 msgr2=0x7fec7810c240 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:36:14.301 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:36:14.300+0000 7fec7f000640 1 --2- 172.21.15.39:0/231825074 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fec78105920 0x7fec7810c240 secure :-1 s=READY pgs=191 cs=0 l=1 rev1=1 crypto rx=0x7fec70009ca0 tx=0x7fec7002a8c0 comp rx=0 tx=0).stop 2024-09-12T02:36:14.302 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:36:14.300+0000 7fec7f000640 1 -- 172.21.15.39:0/231825074 shutdown_connections 2024-09-12T02:36:14.302 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:36:14.300+0000 7fec7f000640 1 --2- 172.21.15.39:0/231825074 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fec78105920 0x7fec7810c240 unknown :-1 s=CLOSED pgs=191 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:36:14.302 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:36:14.300+0000 7fec7f000640 1 --2- 172.21.15.39:0/231825074 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fec78104f60 0x7fec781053e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:36:14.302 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:36:14.300+0000 7fec7f000640 1 --2- 172.21.15.39:0/231825074 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fec78103e00 0x7fec78104200 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:36:14.302 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:36:14.300+0000 7fec7f000640 1 -- 172.21.15.39:0/231825074 >> 172.21.15.39:0/231825074 conn(0x7fec780ff5b0 msgr2=0x7fec781019d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:36:14.302 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:36:14.300+0000 7fec7f000640 1 -- 172.21.15.39:0/231825074 shutdown_connections 2024-09-12T02:36:14.302 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:36:14.300+0000 7fec7f000640 1 -- 172.21.15.39:0/231825074 wait complete. 2024-09-12T02:36:14.303 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:36:14.301+0000 7fec7f000640 1 Processor -- start 2024-09-12T02:36:14.303 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:36:14.301+0000 7fec7f000640 1 -- start start 2024-09-12T02:36:14.303 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:36:14.302+0000 7fec7f000640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fec78103e00 0x7fec7819a080 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:36:14.304 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:36:14.302+0000 7fec7f000640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fec78104f60 0x7fec7819a5c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:36:14.304 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:36:14.302+0000 7fec7f000640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fec78105920 0x7fec781a1640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:36:14.304 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:36:14.302+0000 7fec7f000640 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 -- 0x7fec7810fab0 con 0x7fec78105920 2024-09-12T02:36:14.304 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:36:14.302+0000 7fec7f000640 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x7fec7810f930 con 0x7fec78103e00 2024-09-12T02:36:14.304 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:36:14.302+0000 7fec7f000640 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7fec7810fc30 con 0x7fec78104f60 2024-09-12T02:36:14.304 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:36:14.302+0000 7fec7d000640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fec78105920 0x7fec781a1640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:36:14.304 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:36:14.302+0000 7fec7d000640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fec78105920 0x7fec781a1640 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.39:3300/0 says I am v2:172.21.15.39:40422/0 (socket says 172.21.15.39:40422) 2024-09-12T02:36:14.304 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:36:14.302+0000 7fec7d000640 1 -- 172.21.15.39:0/379254634 learned_addr learned my addr 172.21.15.39:0/379254634 (peer_addr_for_me v2:172.21.15.39:0/0) 2024-09-12T02:36:14.304 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:36:14.302+0000 7fec77e00640 1 --2- 172.21.15.39:0/379254634 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fec78103e00 0x7fec7819a080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:36:14.304 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:36:14.302+0000 7fec77400640 1 --2- 172.21.15.39:0/379254634 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fec78104f60 0x7fec7819a5c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:36:14.304 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:36:14.303+0000 7fec7d000640 1 -- 172.21.15.39:0/379254634 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fec78104f60 msgr2=0x7fec7819a5c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:36:14.304 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:36:14.303+0000 7fec7d000640 1 --2- 172.21.15.39:0/379254634 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fec78104f60 0x7fec7819a5c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:36:14.304 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:36:14.303+0000 7fec7d000640 1 -- 172.21.15.39:0/379254634 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fec78103e00 msgr2=0x7fec7819a080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:36:14.305 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:36:14.303+0000 7fec7d000640 1 --2- 172.21.15.39:0/379254634 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fec78103e00 0x7fec7819a080 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:36:14.305 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:36:14.303+0000 7fec7d000640 1 -- 172.21.15.39:0/379254634 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fec781a1cb0 con 0x7fec78105920 2024-09-12T02:36:14.305 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:36:14.303+0000 7fec7d000640 1 --2- 172.21.15.39:0/379254634 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fec78105920 0x7fec781a1640 secure :-1 s=READY pgs=192 cs=0 l=1 rev1=1 crypto rx=0x7fec70031ae0 tx=0x7fec70031ee0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:36:14.306 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:36:14.303+0000 7fec74c00640 1 -- 172.21.15.39:0/379254634 <== mon.0 v2:172.21.15.39:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fec70003b70 con 0x7fec78105920 2024-09-12T02:36:14.306 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:36:14.303+0000 7fec74c00640 1 -- 172.21.15.39:0/379254634 <== mon.0 v2:172.21.15.39:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fec70003d10 con 0x7fec78105920 2024-09-12T02:36:14.306 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:36:14.303+0000 7fec7f000640 1 -- 172.21.15.39:0/379254634 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fec781a1f40 con 0x7fec78105920 2024-09-12T02:36:14.306 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:36:14.303+0000 7fec74c00640 1 -- 172.21.15.39:0/379254634 <== mon.0 v2:172.21.15.39:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fec7002fc40 con 0x7fec78105920 2024-09-12T02:36:14.306 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:36:14.303+0000 7fec7f000640 1 -- 172.21.15.39:0/379254634 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fec781a23f0 con 0x7fec78105920 2024-09-12T02:36:14.306 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:36:14.304+0000 7fec7f000640 1 -- 172.21.15.39:0/379254634 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fec7810b120 con 0x7fec78105920 2024-09-12T02:36:14.307 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:36:14.306+0000 7fec74c00640 1 -- 172.21.15.39:0/379254634 <== mon.0 v2:172.21.15.39:3300/0 4 ==== mgrmap(e 17) ==== 137884+0+0 (secure 0 0 0) 0x7fec70004050 con 0x7fec78105920 2024-09-12T02:36:14.308 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:36:14.308+0000 7fec74c00640 1 --2- 172.21.15.39:0/379254634 >> [v2:172.21.15.39:6800/1725006999,v1:172.21.15.39:6801/1725006999] conn(0x7fec5c0a2c40 0x7fec5c0a5100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:36:14.308 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:36:14.308+0000 7fec74c00640 1 -- 172.21.15.39:0/379254634 <== mon.0 v2:172.21.15.39:3300/0 5 ==== osd_map(93..93 src has 1..93) ==== 9092+0+0 (secure 0 0 0) 0x7fec700f04b0 con 0x7fec78105920 2024-09-12T02:36:14.309 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:36:14.308+0000 7fec77e00640 1 --2- 172.21.15.39:0/379254634 >> [v2:172.21.15.39:6800/1725006999,v1:172.21.15.39:6801/1725006999] conn(0x7fec5c0a2c40 0x7fec5c0a5100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:36:14.309 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:36:14.309+0000 7fec77e00640 1 --2- 172.21.15.39:0/379254634 >> [v2:172.21.15.39:6800/1725006999,v1:172.21.15.39:6801/1725006999] conn(0x7fec5c0a2c40 0x7fec5c0a5100 secure :-1 s=READY pgs=175 cs=0 l=1 rev1=1 crypto rx=0x7fec68009bd0 tx=0x7fec68005f90 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:36:14.312 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:36:14.312+0000 7fec74c00640 1 -- 172.21.15.39:0/379254634 <== mon.0 v2:172.21.15.39:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7fec700bd120 con 0x7fec78105920 2024-09-12T02:36:14.571 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:36:14.570+0000 7fec7f000640 1 -- 172.21.15.39:0/379254634 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_command({"prefix": "auth get-or-create", "entity": "client.0", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]} v 0) -- 0x7fec7802da10 con 0x7fec78105920 2024-09-12T02:36:14.574 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:36:14.573+0000 7fec74c00640 1 -- 172.21.15.39:0/379254634 <== mon.0 v2:172.21.15.39:3300/0 7 ==== mon_command_ack([{"prefix": "auth get-or-create", "entity": "client.0", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]}]=0 v32) ==== 170+0+59 (secure 0 0 0) 0x7fec700bca20 con 0x7fec78105920 2024-09-12T02:36:14.574 INFO:teuthology.orchestra.run.smithi039.stdout:[client.0] 2024-09-12T02:36:14.574 INFO:teuthology.orchestra.run.smithi039.stdout: key = AQCeU+JmfdEUIhAAW+7TgESC4P0tGYCE4YcDBw== 2024-09-12T02:36:14.576 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:36:14.575+0000 7fec7f000640 1 -- 172.21.15.39:0/379254634 >> [v2:172.21.15.39:6800/1725006999,v1:172.21.15.39:6801/1725006999] conn(0x7fec5c0a2c40 msgr2=0x7fec5c0a5100 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:36:14.576 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:36:14.575+0000 7fec7f000640 1 --2- 172.21.15.39:0/379254634 >> [v2:172.21.15.39:6800/1725006999,v1:172.21.15.39:6801/1725006999] conn(0x7fec5c0a2c40 0x7fec5c0a5100 secure :-1 s=READY pgs=175 cs=0 l=1 rev1=1 crypto rx=0x7fec68009bd0 tx=0x7fec68005f90 comp rx=0 tx=0).stop 2024-09-12T02:36:14.576 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:36:14.575+0000 7fec7f000640 1 -- 172.21.15.39:0/379254634 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fec78105920 msgr2=0x7fec781a1640 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:36:14.576 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:36:14.575+0000 7fec7f000640 1 --2- 172.21.15.39:0/379254634 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fec78105920 0x7fec781a1640 secure :-1 s=READY pgs=192 cs=0 l=1 rev1=1 crypto rx=0x7fec70031ae0 tx=0x7fec70031ee0 comp rx=0 tx=0).stop 2024-09-12T02:36:14.577 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:36:14.575+0000 7fec7f000640 1 -- 172.21.15.39:0/379254634 shutdown_connections 2024-09-12T02:36:14.577 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:36:14.575+0000 7fec7f000640 1 --2- 172.21.15.39:0/379254634 >> [v2:172.21.15.39:6800/1725006999,v1:172.21.15.39:6801/1725006999] conn(0x7fec5c0a2c40 0x7fec5c0a5100 unknown :-1 s=CLOSED pgs=175 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:36:14.577 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:36:14.575+0000 7fec7f000640 1 --2- 172.21.15.39:0/379254634 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fec78105920 0x7fec781a1640 unknown :-1 s=CLOSED pgs=192 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:36:14.577 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:36:14.575+0000 7fec7f000640 1 --2- 172.21.15.39:0/379254634 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fec78104f60 0x7fec7819a5c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:36:14.577 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:36:14.575+0000 7fec7f000640 1 --2- 172.21.15.39:0/379254634 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fec78103e00 0x7fec7819a080 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:36:14.577 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:36:14.575+0000 7fec7f000640 1 -- 172.21.15.39:0/379254634 >> 172.21.15.39:0/379254634 conn(0x7fec780ff5b0 msgr2=0x7fec781082f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:36:14.577 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:36:14.576+0000 7fec7f000640 1 -- 172.21.15.39:0/379254634 shutdown_connections 2024-09-12T02:36:14.577 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:36:14.576+0000 7fec7f000640 1 -- 172.21.15.39:0/379254634 wait complete. 2024-09-12T02:36:14.850 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 02:36:14 smithi039 ceph-mon[30515]: pgmap v337: 129 pgs: 129 active+clean; 640 KiB data, 347 MiB used, 1.0 TiB / 1.0 TiB avail; 6.9 KiB/s rd, 3.2 KiB/s wr, 10 op/s 2024-09-12T02:36:14.850 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 02:36:14 smithi039 ceph-mon[30515]: from='client.? 172.21.15.39:0/379254634' entity='client.admin' cmd=[{"prefix": "auth get-or-create", "entity": "client.0", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]}]: dispatch 2024-09-12T02:36:14.850 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 02:36:14 smithi039 ceph-mon[30515]: from='client.? 172.21.15.39:0/379254634' entity='client.admin' cmd='[{"prefix": "auth get-or-create", "entity": "client.0", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]}]': finished 2024-09-12T02:36:15.013 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 12 02:36:14 smithi172 ceph-mon[35609]: pgmap v337: 129 pgs: 129 active+clean; 640 KiB data, 347 MiB used, 1.0 TiB / 1.0 TiB avail; 6.9 KiB/s rd, 3.2 KiB/s wr, 10 op/s 2024-09-12T02:36:15.013 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 12 02:36:14 smithi172 ceph-mon[35609]: from='client.? 172.21.15.39:0/379254634' entity='client.admin' cmd=[{"prefix": "auth get-or-create", "entity": "client.0", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]}]: dispatch 2024-09-12T02:36:15.013 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 12 02:36:14 smithi172 ceph-mon[35609]: from='client.? 172.21.15.39:0/379254634' entity='client.admin' cmd='[{"prefix": "auth get-or-create", "entity": "client.0", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]}]': finished 2024-09-12T02:36:15.199 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 12 02:36:14 smithi044 ceph-mon[35411]: pgmap v337: 129 pgs: 129 active+clean; 640 KiB data, 347 MiB used, 1.0 TiB / 1.0 TiB avail; 6.9 KiB/s rd, 3.2 KiB/s wr, 10 op/s 2024-09-12T02:36:15.199 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 12 02:36:14 smithi044 ceph-mon[35411]: from='client.? 172.21.15.39:0/379254634' entity='client.admin' cmd=[{"prefix": "auth get-or-create", "entity": "client.0", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]}]: dispatch 2024-09-12T02:36:15.199 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 12 02:36:14 smithi044 ceph-mon[35411]: from='client.? 172.21.15.39:0/379254634' entity='client.admin' cmd='[{"prefix": "auth get-or-create", "entity": "client.0", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]}]': finished 2024-09-12T02:36:15.320 DEBUG:teuthology.orchestra.run.smithi039:> set -ex 2024-09-12T02:36:15.320 DEBUG:teuthology.orchestra.run.smithi039:> sudo dd of=/etc/ceph/ceph.client.0.keyring 2024-09-12T02:36:15.320 DEBUG:teuthology.orchestra.run.smithi039:> sudo chmod 0644 /etc/ceph/ceph.client.0.keyring 2024-09-12T02:36:15.401 INFO:tasks.ceph:Waiting until ceph daemons up and pgs clean... 2024-09-12T02:36:15.401 INFO:tasks.cephadm.ceph_manager.ceph:waiting for mgr available 2024-09-12T02:36:15.401 DEBUG:teuthology.orchestra.run.smithi039:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc shell --fsid 4954ed46-70ae-11ef-bcea-c7b262605968 -- ceph mgr dump --format=json 2024-09-12T02:36:15.819 INFO:teuthology.orchestra.run.smithi039.stderr:Inferring config /var/lib/ceph/4954ed46-70ae-11ef-bcea-c7b262605968/mon.a/config 2024-09-12T02:36:16.352 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:36:16.347+0000 7f4011e00640 1 -- 172.21.15.39:0/515070861 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f400c103e30 msgr2=0x7f400c104210 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:36:16.352 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:36:16.347+0000 7f4011e00640 1 --2- 172.21.15.39:0/515070861 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f400c103e30 0x7f400c104210 secure :-1 s=READY pgs=193 cs=0 l=1 rev1=1 crypto rx=0x7f4000009900 tx=0x7f400002a3f0 comp rx=0 tx=0).stop 2024-09-12T02:36:16.352 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:36:16.347+0000 7f4011e00640 1 -- 172.21.15.39:0/515070861 shutdown_connections 2024-09-12T02:36:16.353 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:36:16.347+0000 7f4011e00640 1 --2- 172.21.15.39:0/515070861 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f400c108f60 0x7f400c110ae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:36:16.353 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:36:16.347+0000 7f4011e00640 1 --2- 172.21.15.39:0/515070861 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f400c1047e0 0x7f400c108830 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:36:16.353 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:36:16.347+0000 7f4011e00640 1 --2- 172.21.15.39:0/515070861 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f400c103e30 0x7f400c104210 unknown :-1 s=CLOSED pgs=193 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:36:16.353 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:36:16.347+0000 7f4011e00640 1 -- 172.21.15.39:0/515070861 >> 172.21.15.39:0/515070861 conn(0x7f400c0ff910 msgr2=0x7f400c101d30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:36:16.353 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:36:16.347+0000 7f4011e00640 1 -- 172.21.15.39:0/515070861 shutdown_connections 2024-09-12T02:36:16.353 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:36:16.347+0000 7f4011e00640 1 -- 172.21.15.39:0/515070861 wait complete. 2024-09-12T02:36:16.353 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:36:16.348+0000 7f4011e00640 1 Processor -- start 2024-09-12T02:36:16.353 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:36:16.348+0000 7f4011e00640 1 -- start start 2024-09-12T02:36:16.353 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:36:16.349+0000 7f4011e00640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f400c103e30 0x7f400c19a4b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:36:16.353 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:36:16.349+0000 7f4011e00640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f400c1047e0 0x7f400c19a9f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:36:16.353 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:36:16.349+0000 7f4011e00640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f400c108f60 0x7f400c19ed80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:36:16.353 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:36:16.349+0000 7f4011e00640 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 -- 0x7f400c113fd0 con 0x7f400c1047e0 2024-09-12T02:36:16.353 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:36:16.349+0000 7f4011e00640 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x7f400c113e50 con 0x7f400c108f60 2024-09-12T02:36:16.354 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:36:16.349+0000 7f4011e00640 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7f400c114150 con 0x7f400c103e30 2024-09-12T02:36:16.354 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:36:16.349+0000 7f400be00640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f400c1047e0 0x7f400c19a9f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:36:16.354 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:36:16.349+0000 7f4010a00640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f400c103e30 0x7f400c19a4b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:36:16.354 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:36:16.349+0000 7f4011400640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f400c108f60 0x7f400c19ed80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:36:16.354 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:36:16.349+0000 7f400be00640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f400c1047e0 0x7f400c19a9f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.39:3300/0 says I am v2:172.21.15.39:40440/0 (socket says 172.21.15.39:40440) 2024-09-12T02:36:16.354 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:36:16.349+0000 7f4010a00640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f400c103e30 0x7f400c19a4b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.172:3300/0 says I am v2:172.21.15.39:36330/0 (socket says 172.21.15.39:36330) 2024-09-12T02:36:16.354 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:36:16.349+0000 7f400be00640 1 -- 172.21.15.39:0/3414372130 learned_addr learned my addr 172.21.15.39:0/3414372130 (peer_addr_for_me v2:172.21.15.39:0/0) 2024-09-12T02:36:16.354 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:36:16.349+0000 7f4010a00640 1 -- 172.21.15.39:0/3414372130 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f400c108f60 msgr2=0x7f400c19ed80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:36:16.354 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:36:16.349+0000 7f4010a00640 1 --2- 172.21.15.39:0/3414372130 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f400c108f60 0x7f400c19ed80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:36:16.354 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:36:16.349+0000 7f4010a00640 1 -- 172.21.15.39:0/3414372130 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f400c1047e0 msgr2=0x7f400c19a9f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:36:16.354 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:36:16.349+0000 7f4010a00640 1 --2- 172.21.15.39:0/3414372130 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f400c1047e0 0x7f400c19a9f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:36:16.354 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:36:16.349+0000 7f4010a00640 1 -- 172.21.15.39:0/3414372130 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f400c19f460 con 0x7f400c103e30 2024-09-12T02:36:16.354 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:36:16.350+0000 7f4010a00640 1 --2- 172.21.15.39:0/3414372130 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f400c103e30 0x7f400c19a4b0 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7f400002a910 tx=0x7f4000003b20 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:36:16.355 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:36:16.350+0000 7f4009600640 1 -- 172.21.15.39:0/3414372130 <== mon.1 v2:172.21.15.172:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f400003f070 con 0x7f400c103e30 2024-09-12T02:36:16.355 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:36:16.350+0000 7f4011e00640 1 -- 172.21.15.39:0/3414372130 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f400c19f6f0 con 0x7f400c103e30 2024-09-12T02:36:16.355 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:36:16.350+0000 7f4009600640 1 -- 172.21.15.39:0/3414372130 <== mon.1 v2:172.21.15.172:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f4000031c90 con 0x7f400c103e30 2024-09-12T02:36:16.355 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:36:16.350+0000 7f4011e00640 1 -- 172.21.15.39:0/3414372130 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f400c1a7030 con 0x7f400c103e30 2024-09-12T02:36:16.355 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:36:16.350+0000 7f4009600640 1 -- 172.21.15.39:0/3414372130 <== mon.1 v2:172.21.15.172:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4000035030 con 0x7f400c103e30 2024-09-12T02:36:16.355 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:36:16.351+0000 7f4011e00640 1 -- 172.21.15.39:0/3414372130 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f400c105310 con 0x7f400c103e30 2024-09-12T02:36:16.356 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:36:16.353+0000 7f4009600640 1 -- 172.21.15.39:0/3414372130 <== mon.1 v2:172.21.15.172:3300/0 4 ==== mgrmap(e 17) ==== 137884+0+0 (secure 0 0 0) 0x7f4000042070 con 0x7f400c103e30 2024-09-12T02:36:16.356 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:36:16.355+0000 7f4009600640 1 --2- 172.21.15.39:0/3414372130 >> [v2:172.21.15.39:6800/1725006999,v1:172.21.15.39:6801/1725006999] conn(0x7f3ff40a2c90 0x7f3ff40a5150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:36:16.356 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:36:16.355+0000 7f4009600640 1 -- 172.21.15.39:0/3414372130 <== mon.1 v2:172.21.15.172:3300/0 5 ==== osd_map(93..93 src has 1..93) ==== 9092+0+0 (secure 0 0 0) 0x7f40000f00b0 con 0x7f400c103e30 2024-09-12T02:36:16.356 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:36:16.355+0000 7f400be00640 1 --2- 172.21.15.39:0/3414372130 >> [v2:172.21.15.39:6800/1725006999,v1:172.21.15.39:6801/1725006999] conn(0x7f3ff40a2c90 0x7f3ff40a5150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:36:16.356 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:36:16.356+0000 7f400be00640 1 --2- 172.21.15.39:0/3414372130 >> [v2:172.21.15.39:6800/1725006999,v1:172.21.15.39:6801/1725006999] conn(0x7f3ff40a2c90 0x7f3ff40a5150 secure :-1 s=READY pgs=176 cs=0 l=1 rev1=1 crypto rx=0x7f400c0ffd30 tx=0x7f3ff8005f90 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:36:16.358 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:36:16.357+0000 7f4009600640 1 -- 172.21.15.39:0/3414372130 <== mon.1 v2:172.21.15.172:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7f40000bcaf0 con 0x7f400c103e30 2024-09-12T02:36:16.596 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:36:16.595+0000 7f4011e00640 1 -- 172.21.15.39:0/3414372130 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_command({"prefix": "mgr dump", "format": "json"} v 0) -- 0x7f400c10c140 con 0x7f400c103e30 2024-09-12T02:36:16.601 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:36:16.600+0000 7f4009600640 1 -- 172.21.15.39:0/3414372130 <== mon.1 v2:172.21.15.172:3300/0 7 ==== mon_command_ack([{"prefix": "mgr dump", "format": "json"}]=0 v17) ==== 74+0+263200 (secure 0 0 0) 0x7f40000bc3f0 con 0x7f400c103e30 2024-09-12T02:36:16.605 INFO:teuthology.orchestra.run.smithi039.stdout: 2024-09-12T02:36:16.606 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:36:16.605+0000 7f4011e00640 1 -- 172.21.15.39:0/3414372130 >> [v2:172.21.15.39:6800/1725006999,v1:172.21.15.39:6801/1725006999] conn(0x7f3ff40a2c90 msgr2=0x7f3ff40a5150 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:36:16.606 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:36:16.605+0000 7f4011e00640 1 --2- 172.21.15.39:0/3414372130 >> [v2:172.21.15.39:6800/1725006999,v1:172.21.15.39:6801/1725006999] conn(0x7f3ff40a2c90 0x7f3ff40a5150 secure :-1 s=READY pgs=176 cs=0 l=1 rev1=1 crypto rx=0x7f400c0ffd30 tx=0x7f3ff8005f90 comp rx=0 tx=0).stop 2024-09-12T02:36:16.607 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:36:16.605+0000 7f4011e00640 1 -- 172.21.15.39:0/3414372130 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f400c103e30 msgr2=0x7f400c19a4b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:36:16.607 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:36:16.605+0000 7f4011e00640 1 --2- 172.21.15.39:0/3414372130 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f400c103e30 0x7f400c19a4b0 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7f400002a910 tx=0x7f4000003b20 comp rx=0 tx=0).stop 2024-09-12T02:36:16.607 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:36:16.605+0000 7f4011e00640 1 -- 172.21.15.39:0/3414372130 shutdown_connections 2024-09-12T02:36:16.607 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:36:16.605+0000 7f4011e00640 1 --2- 172.21.15.39:0/3414372130 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f400c108f60 0x7f400c19ed80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:36:16.607 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:36:16.605+0000 7f4011e00640 1 --2- 172.21.15.39:0/3414372130 >> [v2:172.21.15.39:6800/1725006999,v1:172.21.15.39:6801/1725006999] conn(0x7f3ff40a2c90 0x7f3ff40a5150 unknown :-1 s=CLOSED pgs=176 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:36:16.607 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:36:16.605+0000 7f4011e00640 1 --2- 172.21.15.39:0/3414372130 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f400c1047e0 0x7f400c19a9f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:36:16.607 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:36:16.605+0000 7f4011e00640 1 --2- 172.21.15.39:0/3414372130 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f400c103e30 0x7f400c19a4b0 unknown :-1 s=CLOSED pgs=85 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:36:16.607 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:36:16.605+0000 7f4011e00640 1 -- 172.21.15.39:0/3414372130 >> 172.21.15.39:0/3414372130 conn(0x7f400c0ff910 msgr2=0x7f400c100c60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:36:16.607 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:36:16.605+0000 7f4011e00640 1 -- 172.21.15.39:0/3414372130 shutdown_connections 2024-09-12T02:36:16.607 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:36:16.605+0000 7f4011e00640 1 -- 172.21.15.39:0/3414372130 wait complete. 2024-09-12T02:36:16.850 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 02:36:16 smithi039 ceph-mon[30515]: pgmap v338: 129 pgs: 129 active+clean; 645 KiB data, 347 MiB used, 1.0 TiB / 1.0 TiB avail; 9.5 KiB/s rd, 3.9 KiB/s wr, 14 op/s 2024-09-12T02:36:16.850 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 02:36:16 smithi039 ceph-mon[30515]: from='client.? 172.21.15.39:0/3414372130' entity='client.admin' cmd=[{"prefix": "mgr dump", "format": "json"}]: dispatch 2024-09-12T02:36:17.198 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 12 02:36:16 smithi044 ceph-mon[35411]: pgmap v338: 129 pgs: 129 active+clean; 645 KiB data, 347 MiB used, 1.0 TiB / 1.0 TiB avail; 9.5 KiB/s rd, 3.9 KiB/s wr, 14 op/s 2024-09-12T02:36:17.198 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 12 02:36:16 smithi044 ceph-mon[35411]: from='client.? 172.21.15.39:0/3414372130' entity='client.admin' cmd=[{"prefix": "mgr dump", "format": "json"}]: dispatch 2024-09-12T02:36:17.263 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 12 02:36:16 smithi172 ceph-mon[35609]: pgmap v338: 129 pgs: 129 active+clean; 645 KiB data, 347 MiB used, 1.0 TiB / 1.0 TiB avail; 9.5 KiB/s rd, 3.9 KiB/s wr, 14 op/s 2024-09-12T02:36:17.264 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 12 02:36:16 smithi172 ceph-mon[35609]: from='client.? 172.21.15.39:0/3414372130' entity='client.admin' cmd=[{"prefix": "mgr dump", "format": "json"}]: dispatch 2024-09-12T02:36:17.568 INFO:teuthology.orchestra.run.smithi039.stdout:{"epoch":17,"flags":0,"active_gid":14150,"active_name":"x","active_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6800","nonce":1725006999},{"type":"v1","addr":"172.21.15.39:6801","nonce":1725006999}]},"active_addr":"172.21.15.39:6801/1725006999","active_change":"2024-09-12T02:27:44.717333+0000","active_mgr_features":4540701547738038271,"available":true,"standbys":[{"gid":24109,"name":"z","mgr_features":4540701547738038271,"available_modules":[{"name":"alerts","can_run":true,"error_string":"","module_options":{"interval":{"name":"interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"How frequently to reexamine health status","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"smtp_destination":{"name":"smtp_destination","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Email address to send alerts to","long_desc":"","tags":[],"see_also":[]},"smtp_from_name":{"name":"smtp_from_name","type":"str","level":"advanced","flags":1,"default_value":"Ceph","min":"","max":"","enum_allowed":[],"desc":"Email From: name","long_desc":"","tags":[],"see_also":[]},"smtp_host":{"name":"smtp_host","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_password":{"name":"smtp_password","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Password to authenticate with","long_desc":"","tags":[],"see_also":[]},"smtp_port":{"name":"smtp_port","type":"int","level":"advanced","flags":1,"default_value":"465","min":"","max":"","enum_allowed":[],"desc":"SMTP port","long_desc":"","tags":[],"see_also":[]},"smtp_sender":{"name":"smtp_sender","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP envelope sender","long_desc":"","tags":[],"see_also":[]},"smtp_ssl":{"name":"smtp_ssl","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Use SSL to connect to SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_user":{"name":"smtp_user","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"User to authenticate as","long_desc":"","tags":[],"see_also":[]}}},{"name":"balancer","can_run":true,"error_string":"","module_options":{"active":{"name":"active","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"automatically balance PGs across cluster","long_desc":"","tags":[],"see_also":[]},"begin_time":{"name":"begin_time","type":"str","level":"advanced","flags":1,"default_value":"0000","min":"","max":"","enum_allowed":[],"desc":"beginning time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"begin_weekday":{"name":"begin_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to this day of the week or later","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"crush_compat_max_iterations":{"name":"crush_compat_max_iterations","type":"uint","level":"advanced","flags":1,"default_value":"25","min":"1","max":"250","enum_allowed":[],"desc":"maximum number of iterations to attempt optimization","long_desc":"","tags":[],"see_also":[]},"crush_compat_metrics":{"name":"crush_compat_metrics","type":"str","level":"advanced","flags":1,"default_value":"pgs,objects,bytes","min":"","max":"","enum_allowed":[],"desc":"metrics with which to calculate OSD utilization","long_desc":"Value is a list of one or more of \"pgs\", \"objects\", or \"bytes\", and indicates which metrics to use to balance utilization.","tags":[],"see_also":[]},"crush_compat_step":{"name":"crush_compat_step","type":"float","level":"advanced","flags":1,"default_value":"0.5","min":"0.001","max":"0.999","enum_allowed":[],"desc":"aggressiveness of optimization","long_desc":".99 is very aggressive, .01 is less aggressive","tags":[],"see_also":[]},"end_time":{"name":"end_time","type":"str","level":"advanced","flags":1,"default_value":"2359","min":"","max":"","enum_allowed":[],"desc":"ending time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"end_weekday":{"name":"end_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to days of the week earlier than this","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_score":{"name":"min_score","type":"float","level":"advanced","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"minimum score, below which no optimization is attempted","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":1,"default_value":"upmap","min":"","max":"","enum_allowed":["crush-compat","none","read","upmap","upmap-read"],"desc":"Balancer mode","long_desc":"","tags":[],"see_also":[]},"pool_ids":{"name":"pool_ids","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"pools which the automatic balancing will be limited to","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and attempt optimization","long_desc":"","tags":[],"see_also":[]},"upmap_max_deviation":{"name":"upmap_max_deviation","type":"int","level":"advanced","flags":1,"default_value":"5","min":"1","max":"","enum_allowed":[],"desc":"deviation below which no optimization is attempted","long_desc":"If the number of PGs are within this count then no optimization is attempted","tags":[],"see_also":[]},"upmap_max_optimizations":{"name":"upmap_max_optimizations","type":"uint","level":"advanced","flags":1,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"maximum upmap optimizations to make per attempt","long_desc":"","tags":[],"see_also":[]}}},{"name":"cephadm","can_run":true,"error_string":"","module_options":{"agent_down_multiplier":{"name":"agent_down_multiplier","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"","max":"","enum_allowed":[],"desc":"Multiplied by agent refresh rate to calculate how long agent must not report before being marked down","long_desc":"","tags":[],"see_also":[]},"agent_refresh_rate":{"name":"agent_refresh_rate","type":"secs","level":"advanced","flags":0,"default_value":"20","min":"","max":"","enum_allowed":[],"desc":"How often agent on each host will try to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"agent_starting_port":{"name":"agent_starting_port","type":"int","level":"advanced","flags":0,"default_value":"4721","min":"","max":"","enum_allowed":[],"desc":"First port agent will try to bind to (will also try up to next 1000 subsequent ports if blocked)","long_desc":"","tags":[],"see_also":[]},"allow_ptrace":{"name":"allow_ptrace","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow SYS_PTRACE capability on ceph containers","long_desc":"The SYS_PTRACE capability is needed to attach to a process with gdb or strace. Enabling this options can allow debugging daemons that encounter problems at runtime.","tags":[],"see_also":[]},"autotune_interval":{"name":"autotune_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to autotune daemon memory","long_desc":"","tags":[],"see_also":[]},"autotune_memory_target_ratio":{"name":"autotune_memory_target_ratio","type":"float","level":"advanced","flags":0,"default_value":"0.7","min":"","max":"","enum_allowed":[],"desc":"ratio of total system memory to divide amongst autotuned daemons","long_desc":"","tags":[],"see_also":[]},"cephadm_log_destination":{"name":"cephadm_log_destination","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":["file","file,syslog","syslog"],"desc":"Destination for cephadm command's persistent logging","long_desc":"","tags":[],"see_also":[]},"cgroups_split":{"name":"cgroups_split","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Pass --cgroups=split when cephadm creates containers (currently podman only)","long_desc":"","tags":[],"see_also":[]},"config_checks_enabled":{"name":"config_checks_enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable or disable the cephadm configuration analysis","long_desc":"","tags":[],"see_also":[]},"config_dashboard":{"name":"config_dashboard","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"manage configs like API endpoints in Dashboard.","long_desc":"","tags":[],"see_also":[]},"container_image_alertmanager":{"name":"container_image_alertmanager","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/alertmanager:v0.25.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_base":{"name":"container_image_base","type":"str","level":"advanced","flags":1,"default_value":"quay.io/ceph/ceph","min":"","max":"","enum_allowed":[],"desc":"Container image name, without the tag","long_desc":"","tags":[],"see_also":[]},"container_image_elasticsearch":{"name":"container_image_elasticsearch","type":"str","level":"advanced","flags":0,"default_value":"quay.io/omrizeneva/elasticsearch:6.8.23","min":"","max":"","enum_allowed":[],"desc":"elasticsearch container image","long_desc":"","tags":[],"see_also":[]},"container_image_grafana":{"name":"container_image_grafana","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/grafana:9.4.12","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_haproxy":{"name":"container_image_haproxy","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/haproxy:2.3","min":"","max":"","enum_allowed":[],"desc":"HAproxy container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_agent":{"name":"container_image_jaeger_agent","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-agent:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger agent container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_collector":{"name":"container_image_jaeger_collector","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-collector:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger collector container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_query":{"name":"container_image_jaeger_query","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-query:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger query container image","long_desc":"","tags":[],"see_also":[]},"container_image_keepalived":{"name":"container_image_keepalived","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/keepalived:2.2.4","min":"","max":"","enum_allowed":[],"desc":"Keepalived container image","long_desc":"","tags":[],"see_also":[]},"container_image_loki":{"name":"container_image_loki","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/loki:3.0.0","min":"","max":"","enum_allowed":[],"desc":"Loki container image","long_desc":"","tags":[],"see_also":[]},"container_image_node_exporter":{"name":"container_image_node_exporter","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/node-exporter:v1.5.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_nvmeof":{"name":"container_image_nvmeof","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/nvmeof:1.2.5","min":"","max":"","enum_allowed":[],"desc":"Nvme-of container image","long_desc":"","tags":[],"see_also":[]},"container_image_prometheus":{"name":"container_image_prometheus","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/prometheus:v2.43.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_promtail":{"name":"container_image_promtail","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/promtail:3.0.0","min":"","max":"","enum_allowed":[],"desc":"Promtail container image","long_desc":"","tags":[],"see_also":[]},"container_image_samba":{"name":"container_image_samba","type":"str","level":"advanced","flags":0,"default_value":"quay.io/samba.org/samba-server:devbuilds-centos-amd64","min":"","max":"","enum_allowed":[],"desc":"Samba/SMB container image","long_desc":"","tags":[],"see_also":[]},"container_image_snmp_gateway":{"name":"container_image_snmp_gateway","type":"str","level":"advanced","flags":0,"default_value":"docker.io/maxwo/snmp-notifier:v1.2.1","min":"","max":"","enum_allowed":[],"desc":"SNMP Gateway container image","long_desc":"","tags":[],"see_also":[]},"container_init":{"name":"container_init","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Run podman/docker with `--init`","long_desc":"","tags":[],"see_also":[]},"daemon_cache_timeout":{"name":"daemon_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"seconds to cache service (daemon) inventory","long_desc":"","tags":[],"see_also":[]},"default_cephadm_command_timeout":{"name":"default_cephadm_command_timeout","type":"int","level":"advanced","flags":0,"default_value":"900","min":"","max":"","enum_allowed":[],"desc":"Default timeout applied to cephadm commands run directly on the host (in seconds)","long_desc":"","tags":[],"see_also":[]},"default_registry":{"name":"default_registry","type":"str","level":"advanced","flags":0,"default_value":"docker.io","min":"","max":"","enum_allowed":[],"desc":"Search-registry to which we should normalize unqualified image names. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"device_cache_timeout":{"name":"device_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"1800","min":"","max":"","enum_allowed":[],"desc":"seconds to cache device inventory","long_desc":"","tags":[],"see_also":[]},"device_enhanced_scan":{"name":"device_enhanced_scan","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use libstoragemgmt during device scans","long_desc":"","tags":[],"see_also":[]},"facts_cache_timeout":{"name":"facts_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"seconds to cache host facts data","long_desc":"","tags":[],"see_also":[]},"grafana_dashboards_path":{"name":"grafana_dashboards_path","type":"str","level":"advanced","flags":0,"default_value":"/etc/grafana/dashboards/ceph-dashboard/","min":"","max":"","enum_allowed":[],"desc":"location of dashboards to include in grafana deployments","long_desc":"","tags":[],"see_also":[]},"host_check_interval":{"name":"host_check_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to perform a host check","long_desc":"","tags":[],"see_also":[]},"hw_monitoring":{"name":"hw_monitoring","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Deploy hw monitoring daemon on every host.","long_desc":"","tags":[],"see_also":[]},"inventory_list_all":{"name":"inventory_list_all","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Whether ceph-volume inventory should report more devices (mostly mappers (LVs / mpaths), partitions...)","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_refresh_metadata":{"name":"log_refresh_metadata","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Log all refresh metadata. Includes daemon, device, and host info collected regularly. Only has effect if logging at debug level","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"log to the \"cephadm\" cluster log channel\"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf":{"name":"manage_etc_ceph_ceph_conf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Manage and own /etc/ceph/ceph.conf on the hosts.","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf_hosts":{"name":"manage_etc_ceph_ceph_conf_hosts","type":"str","level":"advanced","flags":0,"default_value":"*","min":"","max":"","enum_allowed":[],"desc":"PlacementSpec describing on which hosts to manage /etc/ceph/ceph.conf","long_desc":"","tags":[],"see_also":[]},"max_count_per_host":{"name":"max_count_per_host","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of daemons per service per host","long_desc":"","tags":[],"see_also":[]},"max_osd_draining_count":{"name":"max_osd_draining_count","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of osds that will be drained simultaneously when osds are removed","long_desc":"","tags":[],"see_also":[]},"migration_current":{"name":"migration_current","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"internal - do not modify","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":0,"default_value":"root","min":"","max":"","enum_allowed":["cephadm-package","root"],"desc":"mode for remote execution of cephadm","long_desc":"","tags":[],"see_also":[]},"oob_default_addr":{"name":"oob_default_addr","type":"str","level":"advanced","flags":0,"default_value":"169.254.1.1","min":"","max":"","enum_allowed":[],"desc":"Default address for RedFish API (oob management).","long_desc":"","tags":[],"see_also":[]},"prometheus_alerts_path":{"name":"prometheus_alerts_path","type":"str","level":"advanced","flags":0,"default_value":"/etc/prometheus/ceph/ceph_default_alerts.yml","min":"","max":"","enum_allowed":[],"desc":"location of alerts to include in prometheus deployments","long_desc":"","tags":[],"see_also":[]},"registry_insecure":{"name":"registry_insecure","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Registry is to be considered insecure (no TLS available). Only for development purposes.","long_desc":"","tags":[],"see_also":[]},"registry_password":{"name":"registry_password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository password. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"registry_url":{"name":"registry_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Registry url for login purposes. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"registry_username":{"name":"registry_username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository username. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"secure_monitoring_stack":{"name":"secure_monitoring_stack","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable TLS security for all the monitoring stack daemons","long_desc":"","tags":[],"see_also":[]},"service_discovery_port":{"name":"service_discovery_port","type":"int","level":"advanced","flags":0,"default_value":"8765","min":"","max":"","enum_allowed":[],"desc":"cephadm service discovery port","long_desc":"","tags":[],"see_also":[]},"ssh_config_file":{"name":"ssh_config_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"customized SSH config file to connect to managed hosts","long_desc":"","tags":[],"see_also":[]},"use_agent":{"name":"use_agent","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use cephadm agent on each host to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"use_repo_digest":{"name":"use_repo_digest","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Automatically convert image tags to image digest. Make sure all daemons use the same image","long_desc":"","tags":[],"see_also":[]},"warn_on_failed_host_check":{"name":"warn_on_failed_host_check","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if the host check fails","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_daemons":{"name":"warn_on_stray_daemons","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected that are not managed by cephadm","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_hosts":{"name":"warn_on_stray_hosts","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected on a host that is not managed by cephadm","long_desc":"","tags":[],"see_also":[]}}},{"name":"crash","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"retain_interval":{"name":"retain_interval","type":"secs","level":"advanced","flags":1,"default_value":"31536000","min":"","max":"","enum_allowed":[],"desc":"how long to retain crashes before pruning them","long_desc":"","tags":[],"see_also":[]},"warn_recent_interval":{"name":"warn_recent_interval","type":"secs","level":"advanced","flags":1,"default_value":"1209600","min":"","max":"","enum_allowed":[],"desc":"time interval in which to warn about recent crashes","long_desc":"","tags":[],"see_also":[]}}},{"name":"dashboard","can_run":true,"error_string":"","module_options":{"ACCOUNT_LOCKOUT_ATTEMPTS":{"name":"ACCOUNT_LOCKOUT_ATTEMPTS","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_HOST":{"name":"ALERTMANAGER_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_SSL_VERIFY":{"name":"ALERTMANAGER_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_ENABLED":{"name":"AUDIT_API_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_LOG_PAYLOAD":{"name":"AUDIT_API_LOG_PAYLOAD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ENABLE_BROWSABLE_API":{"name":"ENABLE_BROWSABLE_API","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_CEPHFS":{"name":"FEATURE_TOGGLE_CEPHFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_DASHBOARD":{"name":"FEATURE_TOGGLE_DASHBOARD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_ISCSI":{"name":"FEATURE_TOGGLE_ISCSI","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_MIRRORING":{"name":"FEATURE_TOGGLE_MIRRORING","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_NFS":{"name":"FEATURE_TOGGLE_NFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RBD":{"name":"FEATURE_TOGGLE_RBD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RGW":{"name":"FEATURE_TOGGLE_RGW","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE":{"name":"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_PASSWORD":{"name":"GRAFANA_API_PASSWORD","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_SSL_VERIFY":{"name":"GRAFANA_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_URL":{"name":"GRAFANA_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_USERNAME":{"name":"GRAFANA_API_USERNAME","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_FRONTEND_API_URL":{"name":"GRAFANA_FRONTEND_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_UPDATE_DASHBOARDS":{"name":"GRAFANA_UPDATE_DASHBOARDS","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISCSI_API_SSL_VERIFICATION":{"name":"ISCSI_API_SSL_VERIFICATION","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISSUE_TRACKER_API_KEY":{"name":"ISSUE_TRACKER_API_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_HOST":{"name":"PROMETHEUS_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_SSL_VERIFY":{"name":"PROMETHEUS_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_COMPLEXITY_ENABLED":{"name":"PWD_POLICY_CHECK_COMPLEXITY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED":{"name":"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_LENGTH_ENABLED":{"name":"PWD_POLICY_CHECK_LENGTH_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_OLDPWD_ENABLED":{"name":"PWD_POLICY_CHECK_OLDPWD_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_USERNAME_ENABLED":{"name":"PWD_POLICY_CHECK_USERNAME_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_ENABLED":{"name":"PWD_POLICY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_EXCLUSION_LIST":{"name":"PWD_POLICY_EXCLUSION_LIST","type":"str","level":"advanced","flags":0,"default_value":"osd,host,dashboard,pool,block,nfs,ceph,monitors,gateway,logs,crush,maps","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_COMPLEXITY":{"name":"PWD_POLICY_MIN_COMPLEXITY","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_LENGTH":{"name":"PWD_POLICY_MIN_LENGTH","type":"int","level":"advanced","flags":0,"default_value":"8","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"REST_REQUESTS_TIMEOUT":{"name":"REST_REQUESTS_TIMEOUT","type":"int","level":"advanced","flags":0,"default_value":"45","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ACCESS_KEY":{"name":"RGW_API_ACCESS_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ADMIN_RESOURCE":{"name":"RGW_API_ADMIN_RESOURCE","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SECRET_KEY":{"name":"RGW_API_SECRET_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SSL_VERIFY":{"name":"RGW_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_SPAN":{"name":"USER_PWD_EXPIRATION_SPAN","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_1":{"name":"USER_PWD_EXPIRATION_WARNING_1","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_2":{"name":"USER_PWD_EXPIRATION_WARNING_2","type":"int","level":"advanced","flags":0,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"cross_origin_url":{"name":"cross_origin_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"crt_file":{"name":"crt_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"debug":{"name":"debug","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable/disable debug options","long_desc":"","tags":[],"see_also":[]},"jwt_token_ttl":{"name":"jwt_token_ttl","type":"int","level":"advanced","flags":0,"default_value":"28800","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"motd":{"name":"motd","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"The message of the day","long_desc":"","tags":[],"see_also":[]},"redirect_resolve_ip_addr":{"name":"redirect_resolve_ip_addr","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":0,"default_value":"8080","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl_server_port":{"name":"ssl_server_port","type":"int","level":"advanced","flags":0,"default_value":"8443","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":0,"default_value":"redirect","min":"","max":"","enum_allowed":["error","redirect"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":0,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url_prefix":{"name":"url_prefix","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"devicehealth","can_run":true,"error_string":"","module_options":{"enable_monitoring":{"name":"enable_monitoring","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"monitor device health metrics","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mark_out_threshold":{"name":"mark_out_threshold","type":"secs","level":"advanced","flags":1,"default_value":"2419200","min":"","max":"","enum_allowed":[],"desc":"automatically mark OSD if it may fail before this long","long_desc":"","tags":[],"see_also":[]},"pool_name":{"name":"pool_name","type":"str","level":"advanced","flags":1,"default_value":"device_health_metrics","min":"","max":"","enum_allowed":[],"desc":"name of pool in which to store device health metrics","long_desc":"","tags":[],"see_also":[]},"retention_period":{"name":"retention_period","type":"secs","level":"advanced","flags":1,"default_value":"15552000","min":"","max":"","enum_allowed":[],"desc":"how long to retain device health metrics","long_desc":"","tags":[],"see_also":[]},"scrape_frequency":{"name":"scrape_frequency","type":"secs","level":"advanced","flags":1,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"how frequently to scrape device health metrics","long_desc":"","tags":[],"see_also":[]},"self_heal":{"name":"self_heal","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"preemptively heal cluster around devices that may fail","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and check device health","long_desc":"","tags":[],"see_also":[]},"warn_threshold":{"name":"warn_threshold","type":"secs","level":"advanced","flags":1,"default_value":"7257600","min":"","max":"","enum_allowed":[],"desc":"raise health warning if OSD may fail before this long","long_desc":"","tags":[],"see_also":[]}}},{"name":"diskprediction_local","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predict_interval":{"name":"predict_interval","type":"str","level":"advanced","flags":0,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predictor_model":{"name":"predictor_model","type":"str","level":"advanced","flags":0,"default_value":"prophetstor","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"str","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"influx","can_run":false,"error_string":"influxdb python module not found","module_options":{"batch_size":{"name":"batch_size","type":"int","level":"advanced","flags":0,"default_value":"5000","min":"","max":"","enum_allowed":[],"desc":"How big batches of data points should be when sending to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"database":{"name":"database","type":"str","level":"advanced","flags":0,"default_value":"ceph","min":"","max":"","enum_allowed":[],"desc":"InfluxDB database name. You will need to create this database and grant write privileges to the configured username or the username must have admin privileges to create it.","long_desc":"","tags":[],"see_also":[]},"hostname":{"name":"hostname","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server hostname","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"30","min":"5","max":"","enum_allowed":[],"desc":"Time between reports to InfluxDB. Default 30 seconds.","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"password":{"name":"password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"password of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"port":{"name":"port","type":"int","level":"advanced","flags":0,"default_value":"8086","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server port","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"str","level":"advanced","flags":0,"default_value":"false","min":"","max":"","enum_allowed":[],"desc":"Use https connection for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]},"threads":{"name":"threads","type":"int","level":"advanced","flags":0,"default_value":"5","min":"1","max":"32","enum_allowed":[],"desc":"How many worker threads should be spawned for sending data to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"username":{"name":"username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"username of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"verify_ssl":{"name":"verify_ssl","type":"str","level":"advanced","flags":0,"default_value":"true","min":"","max":"","enum_allowed":[],"desc":"Verify https cert for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]}}},{"name":"insights","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"iostat","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"k8sevents","can_run":true,"error_string":"","module_options":{"ceph_event_retention_days":{"name":"ceph_event_retention_days","type":"int","level":"advanced","flags":0,"default_value":"7","min":"","max":"","enum_allowed":[],"desc":"Days to hold ceph event information within local cache","long_desc":"","tags":[],"see_also":[]},"config_check_secs":{"name":"config_check_secs","type":"int","level":"advanced","flags":0,"default_value":"10","min":"10","max":"","enum_allowed":[],"desc":"interval (secs) to check for cluster configuration changes","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"localpool","can_run":true,"error_string":"","module_options":{"failure_domain":{"name":"failure_domain","type":"str","level":"advanced","flags":1,"default_value":"host","min":"","max":"","enum_allowed":[],"desc":"failure domain for any created local pool","long_desc":"what failure domain we should separate data replicas across.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_size":{"name":"min_size","type":"int","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"default min_size for any created local pool","long_desc":"value to set min_size to (unchanged from Ceph's default if this option is not set)","tags":[],"see_also":[]},"num_rep":{"name":"num_rep","type":"int","level":"advanced","flags":1,"default_value":"3","min":"","max":"","enum_allowed":[],"desc":"default replica count for any created local pool","long_desc":"","tags":[],"see_also":[]},"pg_num":{"name":"pg_num","type":"int","level":"advanced","flags":1,"default_value":"128","min":"","max":"","enum_allowed":[],"desc":"default pg_num for any created local pool","long_desc":"","tags":[],"see_also":[]},"prefix":{"name":"prefix","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"name prefix for any created local pool","long_desc":"","tags":[],"see_also":[]},"subtree":{"name":"subtree","type":"str","level":"advanced","flags":1,"default_value":"rack","min":"","max":"","enum_allowed":[],"desc":"CRUSH level for which to create a local pool","long_desc":"which CRUSH subtree type the module should create a pool for.","tags":[],"see_also":[]}}},{"name":"mds_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"mirroring","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"nfs","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"orchestrator","can_run":true,"error_string":"","module_options":{"fail_fs":{"name":"fail_fs","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Fail filesystem for rapid multi-rank mds upgrade","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"orchestrator":{"name":"orchestrator","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["cephadm","rook","test_orchestrator"],"desc":"Orchestrator backend","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_perf_query","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"pg_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"threshold":{"name":"threshold","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"1.0","max":"","enum_allowed":[],"desc":"scaling threshold","long_desc":"The factor by which the `NEW PG_NUM` must vary from the current`PG_NUM` before being accepted. Cannot be less than 1.0","tags":[],"see_also":[]}}},{"name":"progress","can_run":true,"error_string":"","module_options":{"allow_pg_recovery_event":{"name":"allow_pg_recovery_event","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow the module to show pg recovery progress","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_completed_events":{"name":"max_completed_events","type":"int","level":"advanced","flags":1,"default_value":"50","min":"","max":"","enum_allowed":[],"desc":"number of past completed events to remember","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"how long the module is going to sleep","long_desc":"","tags":[],"see_also":[]}}},{"name":"prometheus","can_run":true,"error_string":"","module_options":{"cache":{"name":"cache","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"exclude_perf_counters":{"name":"exclude_perf_counters","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Do not include perf-counters in the metrics output","long_desc":"Gathering perf-counters from a single Prometheus exporter can degrade ceph-mgr performance, especially in large clusters. Instead, Ceph-exporter daemons are now used by default for perf-counter gathering. This should only be disabled when no ceph-exporters are deployed.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools":{"name":"rbd_stats_pools","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools_refresh_interval":{"name":"rbd_stats_pools_refresh_interval","type":"int","level":"advanced","flags":0,"default_value":"300","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"scrape_interval":{"name":"scrape_interval","type":"float","level":"advanced","flags":0,"default_value":"15.0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"the IPv4 or IPv6 address on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":1,"default_value":"9283","min":"","max":"","enum_allowed":[],"desc":"the port on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"stale_cache_strategy":{"name":"stale_cache_strategy","type":"str","level":"advanced","flags":0,"default_value":"log","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":1,"default_value":"default","min":"","max":"","enum_allowed":["default","error"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":1,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rbd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_snap_create":{"name":"max_concurrent_snap_create","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mirror_snapshot_schedule":{"name":"mirror_snapshot_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"trash_purge_schedule":{"name":"trash_purge_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"restful","can_run":true,"error_string":"","module_options":{"enable_auth":{"name":"enable_auth","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rgw","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rook","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"storage_class":{"name":"storage_class","type":"str","level":"advanced","flags":0,"default_value":"local","min":"","max":"","enum_allowed":[],"desc":"storage class name for LSO-discovered PVs","long_desc":"","tags":[],"see_also":[]}}},{"name":"selftest","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption1":{"name":"roption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption2":{"name":"roption2","type":"str","level":"advanced","flags":0,"default_value":"xyz","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption1":{"name":"rwoption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption2":{"name":"rwoption2","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption3":{"name":"rwoption3","type":"float","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption4":{"name":"rwoption4","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption5":{"name":"rwoption5","type":"bool","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption6":{"name":"rwoption6","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption7":{"name":"rwoption7","type":"int","level":"advanced","flags":0,"default_value":"","min":"1","max":"42","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testkey":{"name":"testkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testlkey":{"name":"testlkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testnewline":{"name":"testnewline","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"snap_schedule","can_run":true,"error_string":"","module_options":{"allow_m_granularity":{"name":"allow_m_granularity","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow minute scheduled snapshots","long_desc":"","tags":[],"see_also":[]},"dump_on_update":{"name":"dump_on_update","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"dump database to debug log on update","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"stats","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"status","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telegraf","can_run":true,"error_string":"","module_options":{"address":{"name":"address","type":"str","level":"advanced","flags":0,"default_value":"unixgram:///tmp/telegraf.sock","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"15","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telemetry","can_run":true,"error_string":"","module_options":{"channel_basic":{"name":"channel_basic","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share basic cluster information (size, version)","long_desc":"","tags":[],"see_also":[]},"channel_crash":{"name":"channel_crash","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share metadata about Ceph daemon crashes (version, stack straces, etc)","long_desc":"","tags":[],"see_also":[]},"channel_device":{"name":"channel_device","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share device health metrics (e.g., SMART data, minus potentially identifying info like serial numbers)","long_desc":"","tags":[],"see_also":[]},"channel_ident":{"name":"channel_ident","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share a user-provided description and/or contact email for the cluster","long_desc":"","tags":[],"see_also":[]},"channel_perf":{"name":"channel_perf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share various performance metrics of a cluster","long_desc":"","tags":[],"see_also":[]},"contact":{"name":"contact","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"description":{"name":"description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"device_url":{"name":"device_url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/device","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"int","level":"advanced","flags":0,"default_value":"24","min":"8","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"last_opt_revision":{"name":"last_opt_revision","type":"int","level":"advanced","flags":0,"default_value":"1","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard":{"name":"leaderboard","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard_description":{"name":"leaderboard_description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"organization":{"name":"organization","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"proxy":{"name":"proxy","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url":{"name":"url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/report","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"test_orchestrator","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"volumes","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_clones":{"name":"max_concurrent_clones","type":"int","level":"advanced","flags":0,"default_value":"4","min":"","max":"","enum_allowed":[],"desc":"Number of asynchronous cloner threads","long_desc":"","tags":[],"see_also":[]},"periodic_async_work":{"name":"periodic_async_work","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Periodically check for async work","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_delay":{"name":"snapshot_clone_delay","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"Delay clone begin operation by snapshot_clone_delay seconds","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_no_wait":{"name":"snapshot_clone_no_wait","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Reject subvolume clone request when cloner threads are busy","long_desc":"","tags":[],"see_also":[]}}},{"name":"zabbix","can_run":true,"error_string":"","module_options":{"discovery_interval":{"name":"discovery_interval","type":"uint","level":"advanced","flags":0,"default_value":"100","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"identifier":{"name":"identifier","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_host":{"name":"zabbix_host","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_port":{"name":"zabbix_port","type":"int","level":"advanced","flags":0,"default_value":"10051","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_sender":{"name":"zabbix_sender","type":"str","level":"advanced","flags":0,"default_value":"/usr/bin/zabbix_sender","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}}]},{"gid":24116,"name":"y","mgr_features":4540701547738038271,"available_modules":[{"name":"alerts","can_run":true,"error_string":"","module_options":{"interval":{"name":"interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"How frequently to reexamine health status","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"smtp_destination":{"name":"smtp_destination","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Email address to send alerts to","long_desc":"","tags":[],"see_also":[]},"smtp_from_name":{"name":"smtp_from_name","type":"str","level":"advanced","flags":1,"default_value":"Ceph","min":"","max":"","enum_allowed":[],"desc":"Email From: name","long_desc":"","tags":[],"see_also":[]},"smtp_host":{"name":"smtp_host","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_password":{"name":"smtp_password","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Password to authenticate with","long_desc":"","tags":[],"see_also":[]},"smtp_port":{"name":"smtp_port","type":"int","level":"advanced","flags":1,"default_value":"465","min":"","max":"","enum_allowed":[],"desc":"SMTP port","long_desc":"","tags":[],"see_also":[]},"smtp_sender":{"name":"smtp_sender","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP envelope sender","long_desc":"","tags":[],"see_also":[]},"smtp_ssl":{"name":"smtp_ssl","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Use SSL to connect to SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_user":{"name":"smtp_user","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"User to authenticate as","long_desc":"","tags":[],"see_also":[]}}},{"name":"balancer","can_run":true,"error_string":"","module_options":{"active":{"name":"active","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"automatically balance PGs across cluster","long_desc":"","tags":[],"see_also":[]},"begin_time":{"name":"begin_time","type":"str","level":"advanced","flags":1,"default_value":"0000","min":"","max":"","enum_allowed":[],"desc":"beginning time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"begin_weekday":{"name":"begin_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to this day of the week or later","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"crush_compat_max_iterations":{"name":"crush_compat_max_iterations","type":"uint","level":"advanced","flags":1,"default_value":"25","min":"1","max":"250","enum_allowed":[],"desc":"maximum number of iterations to attempt optimization","long_desc":"","tags":[],"see_also":[]},"crush_compat_metrics":{"name":"crush_compat_metrics","type":"str","level":"advanced","flags":1,"default_value":"pgs,objects,bytes","min":"","max":"","enum_allowed":[],"desc":"metrics with which to calculate OSD utilization","long_desc":"Value is a list of one or more of \"pgs\", \"objects\", or \"bytes\", and indicates which metrics to use to balance utilization.","tags":[],"see_also":[]},"crush_compat_step":{"name":"crush_compat_step","type":"float","level":"advanced","flags":1,"default_value":"0.5","min":"0.001","max":"0.999","enum_allowed":[],"desc":"aggressiveness of optimization","long_desc":".99 is very aggressive, .01 is less aggressive","tags":[],"see_also":[]},"end_time":{"name":"end_time","type":"str","level":"advanced","flags":1,"default_value":"2359","min":"","max":"","enum_allowed":[],"desc":"ending time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"end_weekday":{"name":"end_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to days of the week earlier than this","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_score":{"name":"min_score","type":"float","level":"advanced","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"minimum score, below which no optimization is attempted","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":1,"default_value":"upmap","min":"","max":"","enum_allowed":["crush-compat","none","read","upmap","upmap-read"],"desc":"Balancer mode","long_desc":"","tags":[],"see_also":[]},"pool_ids":{"name":"pool_ids","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"pools which the automatic balancing will be limited to","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and attempt optimization","long_desc":"","tags":[],"see_also":[]},"upmap_max_deviation":{"name":"upmap_max_deviation","type":"int","level":"advanced","flags":1,"default_value":"5","min":"1","max":"","enum_allowed":[],"desc":"deviation below which no optimization is attempted","long_desc":"If the number of PGs are within this count then no optimization is attempted","tags":[],"see_also":[]},"upmap_max_optimizations":{"name":"upmap_max_optimizations","type":"uint","level":"advanced","flags":1,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"maximum upmap optimizations to make per attempt","long_desc":"","tags":[],"see_also":[]}}},{"name":"cephadm","can_run":true,"error_string":"","module_options":{"agent_down_multiplier":{"name":"agent_down_multiplier","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"","max":"","enum_allowed":[],"desc":"Multiplied by agent refresh rate to calculate how long agent must not report before being marked down","long_desc":"","tags":[],"see_also":[]},"agent_refresh_rate":{"name":"agent_refresh_rate","type":"secs","level":"advanced","flags":0,"default_value":"20","min":"","max":"","enum_allowed":[],"desc":"How often agent on each host will try to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"agent_starting_port":{"name":"agent_starting_port","type":"int","level":"advanced","flags":0,"default_value":"4721","min":"","max":"","enum_allowed":[],"desc":"First port agent will try to bind to (will also try up to next 1000 subsequent ports if blocked)","long_desc":"","tags":[],"see_also":[]},"allow_ptrace":{"name":"allow_ptrace","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow SYS_PTRACE capability on ceph containers","long_desc":"The SYS_PTRACE capability is needed to attach to a process with gdb or strace. Enabling this options can allow debugging daemons that encounter problems at runtime.","tags":[],"see_also":[]},"autotune_interval":{"name":"autotune_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to autotune daemon memory","long_desc":"","tags":[],"see_also":[]},"autotune_memory_target_ratio":{"name":"autotune_memory_target_ratio","type":"float","level":"advanced","flags":0,"default_value":"0.7","min":"","max":"","enum_allowed":[],"desc":"ratio of total system memory to divide amongst autotuned daemons","long_desc":"","tags":[],"see_also":[]},"cephadm_log_destination":{"name":"cephadm_log_destination","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":["file","file,syslog","syslog"],"desc":"Destination for cephadm command's persistent logging","long_desc":"","tags":[],"see_also":[]},"cgroups_split":{"name":"cgroups_split","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Pass --cgroups=split when cephadm creates containers (currently podman only)","long_desc":"","tags":[],"see_also":[]},"config_checks_enabled":{"name":"config_checks_enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable or disable the cephadm configuration analysis","long_desc":"","tags":[],"see_also":[]},"config_dashboard":{"name":"config_dashboard","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"manage configs like API endpoints in Dashboard.","long_desc":"","tags":[],"see_also":[]},"container_image_alertmanager":{"name":"container_image_alertmanager","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/alertmanager:v0.25.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_base":{"name":"container_image_base","type":"str","level":"advanced","flags":1,"default_value":"quay.io/ceph/ceph","min":"","max":"","enum_allowed":[],"desc":"Container image name, without the tag","long_desc":"","tags":[],"see_also":[]},"container_image_elasticsearch":{"name":"container_image_elasticsearch","type":"str","level":"advanced","flags":0,"default_value":"quay.io/omrizeneva/elasticsearch:6.8.23","min":"","max":"","enum_allowed":[],"desc":"elasticsearch container image","long_desc":"","tags":[],"see_also":[]},"container_image_grafana":{"name":"container_image_grafana","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/grafana:9.4.12","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_haproxy":{"name":"container_image_haproxy","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/haproxy:2.3","min":"","max":"","enum_allowed":[],"desc":"HAproxy container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_agent":{"name":"container_image_jaeger_agent","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-agent:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger agent container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_collector":{"name":"container_image_jaeger_collector","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-collector:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger collector container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_query":{"name":"container_image_jaeger_query","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-query:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger query container image","long_desc":"","tags":[],"see_also":[]},"container_image_keepalived":{"name":"container_image_keepalived","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/keepalived:2.2.4","min":"","max":"","enum_allowed":[],"desc":"Keepalived container image","long_desc":"","tags":[],"see_also":[]},"container_image_loki":{"name":"container_image_loki","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/loki:3.0.0","min":"","max":"","enum_allowed":[],"desc":"Loki container image","long_desc":"","tags":[],"see_also":[]},"container_image_node_exporter":{"name":"container_image_node_exporter","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/node-exporter:v1.5.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_nvmeof":{"name":"container_image_nvmeof","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/nvmeof:1.2.5","min":"","max":"","enum_allowed":[],"desc":"Nvme-of container image","long_desc":"","tags":[],"see_also":[]},"container_image_prometheus":{"name":"container_image_prometheus","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/prometheus:v2.43.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_promtail":{"name":"container_image_promtail","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/promtail:3.0.0","min":"","max":"","enum_allowed":[],"desc":"Promtail container image","long_desc":"","tags":[],"see_also":[]},"container_image_samba":{"name":"container_image_samba","type":"str","level":"advanced","flags":0,"default_value":"quay.io/samba.org/samba-server:devbuilds-centos-amd64","min":"","max":"","enum_allowed":[],"desc":"Samba/SMB container image","long_desc":"","tags":[],"see_also":[]},"container_image_snmp_gateway":{"name":"container_image_snmp_gateway","type":"str","level":"advanced","flags":0,"default_value":"docker.io/maxwo/snmp-notifier:v1.2.1","min":"","max":"","enum_allowed":[],"desc":"SNMP Gateway container image","long_desc":"","tags":[],"see_also":[]},"container_init":{"name":"container_init","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Run podman/docker with `--init`","long_desc":"","tags":[],"see_also":[]},"daemon_cache_timeout":{"name":"daemon_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"seconds to cache service (daemon) inventory","long_desc":"","tags":[],"see_also":[]},"default_cephadm_command_timeout":{"name":"default_cephadm_command_timeout","type":"int","level":"advanced","flags":0,"default_value":"900","min":"","max":"","enum_allowed":[],"desc":"Default timeout applied to cephadm commands run directly on the host (in seconds)","long_desc":"","tags":[],"see_also":[]},"default_registry":{"name":"default_registry","type":"str","level":"advanced","flags":0,"default_value":"docker.io","min":"","max":"","enum_allowed":[],"desc":"Search-registry to which we should normalize unqualified image names. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"device_cache_timeout":{"name":"device_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"1800","min":"","max":"","enum_allowed":[],"desc":"seconds to cache device inventory","long_desc":"","tags":[],"see_also":[]},"device_enhanced_scan":{"name":"device_enhanced_scan","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use libstoragemgmt during device scans","long_desc":"","tags":[],"see_also":[]},"facts_cache_timeout":{"name":"facts_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"seconds to cache host facts data","long_desc":"","tags":[],"see_also":[]},"grafana_dashboards_path":{"name":"grafana_dashboards_path","type":"str","level":"advanced","flags":0,"default_value":"/etc/grafana/dashboards/ceph-dashboard/","min":"","max":"","enum_allowed":[],"desc":"location of dashboards to include in grafana deployments","long_desc":"","tags":[],"see_also":[]},"host_check_interval":{"name":"host_check_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to perform a host check","long_desc":"","tags":[],"see_also":[]},"hw_monitoring":{"name":"hw_monitoring","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Deploy hw monitoring daemon on every host.","long_desc":"","tags":[],"see_also":[]},"inventory_list_all":{"name":"inventory_list_all","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Whether ceph-volume inventory should report more devices (mostly mappers (LVs / mpaths), partitions...)","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_refresh_metadata":{"name":"log_refresh_metadata","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Log all refresh metadata. Includes daemon, device, and host info collected regularly. Only has effect if logging at debug level","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"log to the \"cephadm\" cluster log channel\"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf":{"name":"manage_etc_ceph_ceph_conf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Manage and own /etc/ceph/ceph.conf on the hosts.","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf_hosts":{"name":"manage_etc_ceph_ceph_conf_hosts","type":"str","level":"advanced","flags":0,"default_value":"*","min":"","max":"","enum_allowed":[],"desc":"PlacementSpec describing on which hosts to manage /etc/ceph/ceph.conf","long_desc":"","tags":[],"see_also":[]},"max_count_per_host":{"name":"max_count_per_host","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of daemons per service per host","long_desc":"","tags":[],"see_also":[]},"max_osd_draining_count":{"name":"max_osd_draining_count","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of osds that will be drained simultaneously when osds are removed","long_desc":"","tags":[],"see_also":[]},"migration_current":{"name":"migration_current","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"internal - do not modify","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":0,"default_value":"root","min":"","max":"","enum_allowed":["cephadm-package","root"],"desc":"mode for remote execution of cephadm","long_desc":"","tags":[],"see_also":[]},"oob_default_addr":{"name":"oob_default_addr","type":"str","level":"advanced","flags":0,"default_value":"169.254.1.1","min":"","max":"","enum_allowed":[],"desc":"Default address for RedFish API (oob management).","long_desc":"","tags":[],"see_also":[]},"prometheus_alerts_path":{"name":"prometheus_alerts_path","type":"str","level":"advanced","flags":0,"default_value":"/etc/prometheus/ceph/ceph_default_alerts.yml","min":"","max":"","enum_allowed":[],"desc":"location of alerts to include in prometheus deployments","long_desc":"","tags":[],"see_also":[]},"registry_insecure":{"name":"registry_insecure","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Registry is to be considered insecure (no TLS available). Only for development purposes.","long_desc":"","tags":[],"see_also":[]},"registry_password":{"name":"registry_password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository password. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"registry_url":{"name":"registry_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Registry url for login purposes. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"registry_username":{"name":"registry_username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository username. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"secure_monitoring_stack":{"name":"secure_monitoring_stack","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable TLS security for all the monitoring stack daemons","long_desc":"","tags":[],"see_also":[]},"service_discovery_port":{"name":"service_discovery_port","type":"int","level":"advanced","flags":0,"default_value":"8765","min":"","max":"","enum_allowed":[],"desc":"cephadm service discovery port","long_desc":"","tags":[],"see_also":[]},"ssh_config_file":{"name":"ssh_config_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"customized SSH config file to connect to managed hosts","long_desc":"","tags":[],"see_also":[]},"use_agent":{"name":"use_agent","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use cephadm agent on each host to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"use_repo_digest":{"name":"use_repo_digest","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Automatically convert image tags to image digest. Make sure all daemons use the same image","long_desc":"","tags":[],"see_also":[]},"warn_on_failed_host_check":{"name":"warn_on_failed_host_check","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if the host check fails","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_daemons":{"name":"warn_on_stray_daemons","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected that are not managed by cephadm","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_hosts":{"name":"warn_on_stray_hosts","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected on a host that is not managed by cephadm","long_desc":"","tags":[],"see_also":[]}}},{"name":"crash","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"retain_interval":{"name":"retain_interval","type":"secs","level":"advanced","flags":1,"default_value":"31536000","min":"","max":"","enum_allowed":[],"desc":"how long to retain crashes before pruning them","long_desc":"","tags":[],"see_also":[]},"warn_recent_interval":{"name":"warn_recent_interval","type":"secs","level":"advanced","flags":1,"default_value":"1209600","min":"","max":"","enum_allowed":[],"desc":"time interval in which to warn about recent crashes","long_desc":"","tags":[],"see_also":[]}}},{"name":"dashboard","can_run":true,"error_string":"","module_options":{"ACCOUNT_LOCKOUT_ATTEMPTS":{"name":"ACCOUNT_LOCKOUT_ATTEMPTS","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_HOST":{"name":"ALERTMANAGER_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_SSL_VERIFY":{"name":"ALERTMANAGER_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_ENABLED":{"name":"AUDIT_API_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_LOG_PAYLOAD":{"name":"AUDIT_API_LOG_PAYLOAD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ENABLE_BROWSABLE_API":{"name":"ENABLE_BROWSABLE_API","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_CEPHFS":{"name":"FEATURE_TOGGLE_CEPHFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_DASHBOARD":{"name":"FEATURE_TOGGLE_DASHBOARD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_ISCSI":{"name":"FEATURE_TOGGLE_ISCSI","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_MIRRORING":{"name":"FEATURE_TOGGLE_MIRRORING","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_NFS":{"name":"FEATURE_TOGGLE_NFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RBD":{"name":"FEATURE_TOGGLE_RBD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RGW":{"name":"FEATURE_TOGGLE_RGW","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE":{"name":"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_PASSWORD":{"name":"GRAFANA_API_PASSWORD","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_SSL_VERIFY":{"name":"GRAFANA_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_URL":{"name":"GRAFANA_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_USERNAME":{"name":"GRAFANA_API_USERNAME","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_FRONTEND_API_URL":{"name":"GRAFANA_FRONTEND_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_UPDATE_DASHBOARDS":{"name":"GRAFANA_UPDATE_DASHBOARDS","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISCSI_API_SSL_VERIFICATION":{"name":"ISCSI_API_SSL_VERIFICATION","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISSUE_TRACKER_API_KEY":{"name":"ISSUE_TRACKER_API_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_HOST":{"name":"PROMETHEUS_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_SSL_VERIFY":{"name":"PROMETHEUS_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_COMPLEXITY_ENABLED":{"name":"PWD_POLICY_CHECK_COMPLEXITY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED":{"name":"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_LENGTH_ENABLED":{"name":"PWD_POLICY_CHECK_LENGTH_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_OLDPWD_ENABLED":{"name":"PWD_POLICY_CHECK_OLDPWD_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_USERNAME_ENABLED":{"name":"PWD_POLICY_CHECK_USERNAME_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_ENABLED":{"name":"PWD_POLICY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_EXCLUSION_LIST":{"name":"PWD_POLICY_EXCLUSION_LIST","type":"str","level":"advanced","flags":0,"default_value":"osd,host,dashboard,pool,block,nfs,ceph,monitors,gateway,logs,crush,maps","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_COMPLEXITY":{"name":"PWD_POLICY_MIN_COMPLEXITY","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_LENGTH":{"name":"PWD_POLICY_MIN_LENGTH","type":"int","level":"advanced","flags":0,"default_value":"8","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"REST_REQUESTS_TIMEOUT":{"name":"REST_REQUESTS_TIMEOUT","type":"int","level":"advanced","flags":0,"default_value":"45","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ACCESS_KEY":{"name":"RGW_API_ACCESS_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ADMIN_RESOURCE":{"name":"RGW_API_ADMIN_RESOURCE","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SECRET_KEY":{"name":"RGW_API_SECRET_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SSL_VERIFY":{"name":"RGW_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_SPAN":{"name":"USER_PWD_EXPIRATION_SPAN","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_1":{"name":"USER_PWD_EXPIRATION_WARNING_1","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_2":{"name":"USER_PWD_EXPIRATION_WARNING_2","type":"int","level":"advanced","flags":0,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"cross_origin_url":{"name":"cross_origin_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"crt_file":{"name":"crt_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"debug":{"name":"debug","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable/disable debug options","long_desc":"","tags":[],"see_also":[]},"jwt_token_ttl":{"name":"jwt_token_ttl","type":"int","level":"advanced","flags":0,"default_value":"28800","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"motd":{"name":"motd","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"The message of the day","long_desc":"","tags":[],"see_also":[]},"redirect_resolve_ip_addr":{"name":"redirect_resolve_ip_addr","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":0,"default_value":"8080","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl_server_port":{"name":"ssl_server_port","type":"int","level":"advanced","flags":0,"default_value":"8443","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":0,"default_value":"redirect","min":"","max":"","enum_allowed":["error","redirect"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":0,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url_prefix":{"name":"url_prefix","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"devicehealth","can_run":true,"error_string":"","module_options":{"enable_monitoring":{"name":"enable_monitoring","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"monitor device health metrics","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mark_out_threshold":{"name":"mark_out_threshold","type":"secs","level":"advanced","flags":1,"default_value":"2419200","min":"","max":"","enum_allowed":[],"desc":"automatically mark OSD if it may fail before this long","long_desc":"","tags":[],"see_also":[]},"pool_name":{"name":"pool_name","type":"str","level":"advanced","flags":1,"default_value":"device_health_metrics","min":"","max":"","enum_allowed":[],"desc":"name of pool in which to store device health metrics","long_desc":"","tags":[],"see_also":[]},"retention_period":{"name":"retention_period","type":"secs","level":"advanced","flags":1,"default_value":"15552000","min":"","max":"","enum_allowed":[],"desc":"how long to retain device health metrics","long_desc":"","tags":[],"see_also":[]},"scrape_frequency":{"name":"scrape_frequency","type":"secs","level":"advanced","flags":1,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"how frequently to scrape device health metrics","long_desc":"","tags":[],"see_also":[]},"self_heal":{"name":"self_heal","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"preemptively heal cluster around devices that may fail","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and check device health","long_desc":"","tags":[],"see_also":[]},"warn_threshold":{"name":"warn_threshold","type":"secs","level":"advanced","flags":1,"default_value":"7257600","min":"","max":"","enum_allowed":[],"desc":"raise health warning if OSD may fail before this long","long_desc":"","tags":[],"see_also":[]}}},{"name":"diskprediction_local","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predict_interval":{"name":"predict_interval","type":"str","level":"advanced","flags":0,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predictor_model":{"name":"predictor_model","type":"str","level":"advanced","flags":0,"default_value":"prophetstor","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"str","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"influx","can_run":false,"error_string":"influxdb python module not found","module_options":{"batch_size":{"name":"batch_size","type":"int","level":"advanced","flags":0,"default_value":"5000","min":"","max":"","enum_allowed":[],"desc":"How big batches of data points should be when sending to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"database":{"name":"database","type":"str","level":"advanced","flags":0,"default_value":"ceph","min":"","max":"","enum_allowed":[],"desc":"InfluxDB database name. You will need to create this database and grant write privileges to the configured username or the username must have admin privileges to create it.","long_desc":"","tags":[],"see_also":[]},"hostname":{"name":"hostname","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server hostname","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"30","min":"5","max":"","enum_allowed":[],"desc":"Time between reports to InfluxDB. Default 30 seconds.","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"password":{"name":"password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"password of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"port":{"name":"port","type":"int","level":"advanced","flags":0,"default_value":"8086","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server port","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"str","level":"advanced","flags":0,"default_value":"false","min":"","max":"","enum_allowed":[],"desc":"Use https connection for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]},"threads":{"name":"threads","type":"int","level":"advanced","flags":0,"default_value":"5","min":"1","max":"32","enum_allowed":[],"desc":"How many worker threads should be spawned for sending data to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"username":{"name":"username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"username of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"verify_ssl":{"name":"verify_ssl","type":"str","level":"advanced","flags":0,"default_value":"true","min":"","max":"","enum_allowed":[],"desc":"Verify https cert for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]}}},{"name":"insights","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"iostat","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"k8sevents","can_run":true,"error_string":"","module_options":{"ceph_event_retention_days":{"name":"ceph_event_retention_days","type":"int","level":"advanced","flags":0,"default_value":"7","min":"","max":"","enum_allowed":[],"desc":"Days to hold ceph event information within local cache","long_desc":"","tags":[],"see_also":[]},"config_check_secs":{"name":"config_check_secs","type":"int","level":"advanced","flags":0,"default_value":"10","min":"10","max":"","enum_allowed":[],"desc":"interval (secs) to check for cluster configuration changes","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"localpool","can_run":true,"error_string":"","module_options":{"failure_domain":{"name":"failure_domain","type":"str","level":"advanced","flags":1,"default_value":"host","min":"","max":"","enum_allowed":[],"desc":"failure domain for any created local pool","long_desc":"what failure domain we should separate data replicas across.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_size":{"name":"min_size","type":"int","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"default min_size for any created local pool","long_desc":"value to set min_size to (unchanged from Ceph's default if this option is not set)","tags":[],"see_also":[]},"num_rep":{"name":"num_rep","type":"int","level":"advanced","flags":1,"default_value":"3","min":"","max":"","enum_allowed":[],"desc":"default replica count for any created local pool","long_desc":"","tags":[],"see_also":[]},"pg_num":{"name":"pg_num","type":"int","level":"advanced","flags":1,"default_value":"128","min":"","max":"","enum_allowed":[],"desc":"default pg_num for any created local pool","long_desc":"","tags":[],"see_also":[]},"prefix":{"name":"prefix","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"name prefix for any created local pool","long_desc":"","tags":[],"see_also":[]},"subtree":{"name":"subtree","type":"str","level":"advanced","flags":1,"default_value":"rack","min":"","max":"","enum_allowed":[],"desc":"CRUSH level for which to create a local pool","long_desc":"which CRUSH subtree type the module should create a pool for.","tags":[],"see_also":[]}}},{"name":"mds_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"mirroring","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"nfs","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"orchestrator","can_run":true,"error_string":"","module_options":{"fail_fs":{"name":"fail_fs","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Fail filesystem for rapid multi-rank mds upgrade","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"orchestrator":{"name":"orchestrator","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["cephadm","rook","test_orchestrator"],"desc":"Orchestrator backend","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_perf_query","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"pg_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"threshold":{"name":"threshold","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"1.0","max":"","enum_allowed":[],"desc":"scaling threshold","long_desc":"The factor by which the `NEW PG_NUM` must vary from the current`PG_NUM` before being accepted. Cannot be less than 1.0","tags":[],"see_also":[]}}},{"name":"progress","can_run":true,"error_string":"","module_options":{"allow_pg_recovery_event":{"name":"allow_pg_recovery_event","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow the module to show pg recovery progress","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_completed_events":{"name":"max_completed_events","type":"int","level":"advanced","flags":1,"default_value":"50","min":"","max":"","enum_allowed":[],"desc":"number of past completed events to remember","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"how long the module is going to sleep","long_desc":"","tags":[],"see_also":[]}}},{"name":"prometheus","can_run":true,"error_string":"","module_options":{"cache":{"name":"cache","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"exclude_perf_counters":{"name":"exclude_perf_counters","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Do not include perf-counters in the metrics output","long_desc":"Gathering perf-counters from a single Prometheus exporter can degrade ceph-mgr performance, especially in large clusters. Instead, Ceph-exporter daemons are now used by default for perf-counter gathering. This should only be disabled when no ceph-exporters are deployed.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools":{"name":"rbd_stats_pools","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools_refresh_interval":{"name":"rbd_stats_pools_refresh_interval","type":"int","level":"advanced","flags":0,"default_value":"300","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"scrape_interval":{"name":"scrape_interval","type":"float","level":"advanced","flags":0,"default_value":"15.0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"the IPv4 or IPv6 address on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":1,"default_value":"9283","min":"","max":"","enum_allowed":[],"desc":"the port on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"stale_cache_strategy":{"name":"stale_cache_strategy","type":"str","level":"advanced","flags":0,"default_value":"log","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":1,"default_value":"default","min":"","max":"","enum_allowed":["default","error"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":1,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rbd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_snap_create":{"name":"max_concurrent_snap_create","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mirror_snapshot_schedule":{"name":"mirror_snapshot_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"trash_purge_schedule":{"name":"trash_purge_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"restful","can_run":true,"error_string":"","module_options":{"enable_auth":{"name":"enable_auth","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rgw","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rook","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"storage_class":{"name":"storage_class","type":"str","level":"advanced","flags":0,"default_value":"local","min":"","max":"","enum_allowed":[],"desc":"storage class name for LSO-discovered PVs","long_desc":"","tags":[],"see_also":[]}}},{"name":"selftest","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption1":{"name":"roption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption2":{"name":"roption2","type":"str","level":"advanced","flags":0,"default_value":"xyz","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption1":{"name":"rwoption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption2":{"name":"rwoption2","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption3":{"name":"rwoption3","type":"float","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption4":{"name":"rwoption4","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption5":{"name":"rwoption5","type":"bool","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption6":{"name":"rwoption6","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption7":{"name":"rwoption7","type":"int","level":"advanced","flags":0,"default_value":"","min":"1","max":"42","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testkey":{"name":"testkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testlkey":{"name":"testlkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testnewline":{"name":"testnewline","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"snap_schedule","can_run":true,"error_string":"","module_options":{"allow_m_granularity":{"name":"allow_m_granularity","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow minute scheduled snapshots","long_desc":"","tags":[],"see_also":[]},"dump_on_update":{"name":"dump_on_update","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"dump database to debug log on update","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"stats","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"status","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telegraf","can_run":true,"error_string":"","module_options":{"address":{"name":"address","type":"str","level":"advanced","flags":0,"default_value":"unixgram:///tmp/telegraf.sock","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"15","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telemetry","can_run":true,"error_string":"","module_options":{"channel_basic":{"name":"channel_basic","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share basic cluster information (size, version)","long_desc":"","tags":[],"see_also":[]},"channel_crash":{"name":"channel_crash","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share metadata about Ceph daemon crashes (version, stack straces, etc)","long_desc":"","tags":[],"see_also":[]},"channel_device":{"name":"channel_device","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share device health metrics (e.g., SMART data, minus potentially identifying info like serial numbers)","long_desc":"","tags":[],"see_also":[]},"channel_ident":{"name":"channel_ident","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share a user-provided description and/or contact email for the cluster","long_desc":"","tags":[],"see_also":[]},"channel_perf":{"name":"channel_perf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share various performance metrics of a cluster","long_desc":"","tags":[],"see_also":[]},"contact":{"name":"contact","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"description":{"name":"description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"device_url":{"name":"device_url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/device","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"int","level":"advanced","flags":0,"default_value":"24","min":"8","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"last_opt_revision":{"name":"last_opt_revision","type":"int","level":"advanced","flags":0,"default_value":"1","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard":{"name":"leaderboard","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard_description":{"name":"leaderboard_description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"organization":{"name":"organization","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"proxy":{"name":"proxy","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url":{"name":"url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/report","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"test_orchestrator","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"volumes","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_clones":{"name":"max_concurrent_clones","type":"int","level":"advanced","flags":0,"default_value":"4","min":"","max":"","enum_allowed":[],"desc":"Number of asynchronous cloner threads","long_desc":"","tags":[],"see_also":[]},"periodic_async_work":{"name":"periodic_async_work","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Periodically check for async work","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_delay":{"name":"snapshot_clone_delay","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"Delay clone begin operation by snapshot_clone_delay seconds","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_no_wait":{"name":"snapshot_clone_no_wait","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Reject subvolume clone request when cloner threads are busy","long_desc":"","tags":[],"see_also":[]}}},{"name":"zabbix","can_run":true,"error_string":"","module_options":{"discovery_interval":{"name":"discovery_interval","type":"uint","level":"advanced","flags":0,"default_value":"100","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"identifier":{"name":"identifier","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_host":{"name":"zabbix_host","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_port":{"name":"zabbix_port","type":"int","level":"advanced","flags":0,"default_value":"10051","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_sender":{"name":"zabbix_sender","type":"str","level":"advanced","flags":0,"default_value":"/usr/bin/zabbix_sender","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}}]}],"modules":["cephadm","dashboard","iostat","nfs","restful"],"available_modules":[{"name":"alerts","can_run":true,"error_string":"","module_options":{"interval":{"name":"interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"How frequently to reexamine health status","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"smtp_destination":{"name":"smtp_destination","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Email address to send alerts to","long_desc":"","tags":[],"see_also":[]},"smtp_from_name":{"name":"smtp_from_name","type":"str","level":"advanced","flags":1,"default_value":"Ceph","min":"","max":"","enum_allowed":[],"desc":"Email From: name","long_desc":"","tags":[],"see_also":[]},"smtp_host":{"name":"smtp_host","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_password":{"name":"smtp_password","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Password to authenticate with","long_desc":"","tags":[],"see_also":[]},"smtp_port":{"name":"smtp_port","type":"int","level":"advanced","flags":1,"default_value":"465","min":"","max":"","enum_allowed":[],"desc":"SMTP port","long_desc":"","tags":[],"see_also":[]},"smtp_sender":{"name":"smtp_sender","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP envelope sender","long_desc":"","tags":[],"see_also":[]},"smtp_ssl":{"name":"smtp_ssl","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Use SSL to connect to SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_user":{"name":"smtp_user","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"User to authenticate as","long_desc":"","tags":[],"see_also":[]}}},{"name":"balancer","can_run":true,"error_string":"","module_options":{"active":{"name":"active","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"automatically balance PGs across cluster","long_desc":"","tags":[],"see_also":[]},"begin_time":{"name":"begin_time","type":"str","level":"advanced","flags":1,"default_value":"0000","min":"","max":"","enum_allowed":[],"desc":"beginning time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"begin_weekday":{"name":"begin_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to this day of the week or later","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"crush_compat_max_iterations":{"name":"crush_compat_max_iterations","type":"uint","level":"advanced","flags":1,"default_value":"25","min":"1","max":"250","enum_allowed":[],"desc":"maximum number of iterations to attempt optimization","long_desc":"","tags":[],"see_also":[]},"crush_compat_metrics":{"name":"crush_compat_metrics","type":"str","level":"advanced","flags":1,"default_value":"pgs,objects,bytes","min":"","max":"","enum_allowed":[],"desc":"metrics with which to calculate OSD utilization","long_desc":"Value is a list of one or more of \"pgs\", \"objects\", or \"bytes\", and indicates which metrics to use to balance utilization.","tags":[],"see_also":[]},"crush_compat_step":{"name":"crush_compat_step","type":"float","level":"advanced","flags":1,"default_value":"0.5","min":"0.001","max":"0.999","enum_allowed":[],"desc":"aggressiveness of optimization","long_desc":".99 is very aggressive, .01 is less aggressive","tags":[],"see_also":[]},"end_time":{"name":"end_time","type":"str","level":"advanced","flags":1,"default_value":"2359","min":"","max":"","enum_allowed":[],"desc":"ending time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"end_weekday":{"name":"end_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to days of the week earlier than this","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_score":{"name":"min_score","type":"float","level":"advanced","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"minimum score, below which no optimization is attempted","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":1,"default_value":"upmap","min":"","max":"","enum_allowed":["crush-compat","none","read","upmap","upmap-read"],"desc":"Balancer mode","long_desc":"","tags":[],"see_also":[]},"pool_ids":{"name":"pool_ids","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"pools which the automatic balancing will be limited to","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and attempt optimization","long_desc":"","tags":[],"see_also":[]},"upmap_max_deviation":{"name":"upmap_max_deviation","type":"int","level":"advanced","flags":1,"default_value":"5","min":"1","max":"","enum_allowed":[],"desc":"deviation below which no optimization is attempted","long_desc":"If the number of PGs are within this count then no optimization is attempted","tags":[],"see_also":[]},"upmap_max_optimizations":{"name":"upmap_max_optimizations","type":"uint","level":"advanced","flags":1,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"maximum upmap optimizations to make per attempt","long_desc":"","tags":[],"see_also":[]}}},{"name":"cephadm","can_run":true,"error_string":"","module_options":{"agent_down_multiplier":{"name":"agent_down_multiplier","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"","max":"","enum_allowed":[],"desc":"Multiplied by agent refresh rate to calculate how long agent must not report before being marked down","long_desc":"","tags":[],"see_also":[]},"agent_refresh_rate":{"name":"agent_refresh_rate","type":"secs","level":"advanced","flags":0,"default_value":"20","min":"","max":"","enum_allowed":[],"desc":"How often agent on each host will try to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"agent_starting_port":{"name":"agent_starting_port","type":"int","level":"advanced","flags":0,"default_value":"4721","min":"","max":"","enum_allowed":[],"desc":"First port agent will try to bind to (will also try up to next 1000 subsequent ports if blocked)","long_desc":"","tags":[],"see_also":[]},"allow_ptrace":{"name":"allow_ptrace","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow SYS_PTRACE capability on ceph containers","long_desc":"The SYS_PTRACE capability is needed to attach to a process with gdb or strace. Enabling this options can allow debugging daemons that encounter problems at runtime.","tags":[],"see_also":[]},"autotune_interval":{"name":"autotune_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to autotune daemon memory","long_desc":"","tags":[],"see_also":[]},"autotune_memory_target_ratio":{"name":"autotune_memory_target_ratio","type":"float","level":"advanced","flags":0,"default_value":"0.7","min":"","max":"","enum_allowed":[],"desc":"ratio of total system memory to divide amongst autotuned daemons","long_desc":"","tags":[],"see_also":[]},"cephadm_log_destination":{"name":"cephadm_log_destination","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":["file","file,syslog","syslog"],"desc":"Destination for cephadm command's persistent logging","long_desc":"","tags":[],"see_also":[]},"cgroups_split":{"name":"cgroups_split","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Pass --cgroups=split when cephadm creates containers (currently podman only)","long_desc":"","tags":[],"see_also":[]},"config_checks_enabled":{"name":"config_checks_enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable or disable the cephadm configuration analysis","long_desc":"","tags":[],"see_also":[]},"config_dashboard":{"name":"config_dashboard","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"manage configs like API endpoints in Dashboard.","long_desc":"","tags":[],"see_also":[]},"container_image_alertmanager":{"name":"container_image_alertmanager","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/alertmanager:v0.25.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_base":{"name":"container_image_base","type":"str","level":"advanced","flags":1,"default_value":"quay.io/ceph/ceph","min":"","max":"","enum_allowed":[],"desc":"Container image name, without the tag","long_desc":"","tags":[],"see_also":[]},"container_image_elasticsearch":{"name":"container_image_elasticsearch","type":"str","level":"advanced","flags":0,"default_value":"quay.io/omrizeneva/elasticsearch:6.8.23","min":"","max":"","enum_allowed":[],"desc":"elasticsearch container image","long_desc":"","tags":[],"see_also":[]},"container_image_grafana":{"name":"container_image_grafana","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/grafana:9.4.12","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_haproxy":{"name":"container_image_haproxy","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/haproxy:2.3","min":"","max":"","enum_allowed":[],"desc":"HAproxy container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_agent":{"name":"container_image_jaeger_agent","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-agent:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger agent container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_collector":{"name":"container_image_jaeger_collector","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-collector:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger collector container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_query":{"name":"container_image_jaeger_query","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-query:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger query container image","long_desc":"","tags":[],"see_also":[]},"container_image_keepalived":{"name":"container_image_keepalived","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/keepalived:2.2.4","min":"","max":"","enum_allowed":[],"desc":"Keepalived container image","long_desc":"","tags":[],"see_also":[]},"container_image_loki":{"name":"container_image_loki","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/loki:3.0.0","min":"","max":"","enum_allowed":[],"desc":"Loki container image","long_desc":"","tags":[],"see_also":[]},"container_image_node_exporter":{"name":"container_image_node_exporter","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/node-exporter:v1.5.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_nvmeof":{"name":"container_image_nvmeof","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/nvmeof:1.2.5","min":"","max":"","enum_allowed":[],"desc":"Nvme-of container image","long_desc":"","tags":[],"see_also":[]},"container_image_prometheus":{"name":"container_image_prometheus","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/prometheus:v2.43.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_promtail":{"name":"container_image_promtail","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/promtail:3.0.0","min":"","max":"","enum_allowed":[],"desc":"Promtail container image","long_desc":"","tags":[],"see_also":[]},"container_image_samba":{"name":"container_image_samba","type":"str","level":"advanced","flags":0,"default_value":"quay.io/samba.org/samba-server:devbuilds-centos-amd64","min":"","max":"","enum_allowed":[],"desc":"Samba/SMB container image","long_desc":"","tags":[],"see_also":[]},"container_image_snmp_gateway":{"name":"container_image_snmp_gateway","type":"str","level":"advanced","flags":0,"default_value":"docker.io/maxwo/snmp-notifier:v1.2.1","min":"","max":"","enum_allowed":[],"desc":"SNMP Gateway container image","long_desc":"","tags":[],"see_also":[]},"container_init":{"name":"container_init","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Run podman/docker with `--init`","long_desc":"","tags":[],"see_also":[]},"daemon_cache_timeout":{"name":"daemon_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"seconds to cache service (daemon) inventory","long_desc":"","tags":[],"see_also":[]},"default_cephadm_command_timeout":{"name":"default_cephadm_command_timeout","type":"int","level":"advanced","flags":0,"default_value":"900","min":"","max":"","enum_allowed":[],"desc":"Default timeout applied to cephadm commands run directly on the host (in seconds)","long_desc":"","tags":[],"see_also":[]},"default_registry":{"name":"default_registry","type":"str","level":"advanced","flags":0,"default_value":"docker.io","min":"","max":"","enum_allowed":[],"desc":"Search-registry to which we should normalize unqualified image names. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"device_cache_timeout":{"name":"device_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"1800","min":"","max":"","enum_allowed":[],"desc":"seconds to cache device inventory","long_desc":"","tags":[],"see_also":[]},"device_enhanced_scan":{"name":"device_enhanced_scan","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use libstoragemgmt during device scans","long_desc":"","tags":[],"see_also":[]},"facts_cache_timeout":{"name":"facts_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"seconds to cache host facts data","long_desc":"","tags":[],"see_also":[]},"grafana_dashboards_path":{"name":"grafana_dashboards_path","type":"str","level":"advanced","flags":0,"default_value":"/etc/grafana/dashboards/ceph-dashboard/","min":"","max":"","enum_allowed":[],"desc":"location of dashboards to include in grafana deployments","long_desc":"","tags":[],"see_also":[]},"host_check_interval":{"name":"host_check_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to perform a host check","long_desc":"","tags":[],"see_also":[]},"hw_monitoring":{"name":"hw_monitoring","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Deploy hw monitoring daemon on every host.","long_desc":"","tags":[],"see_also":[]},"inventory_list_all":{"name":"inventory_list_all","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Whether ceph-volume inventory should report more devices (mostly mappers (LVs / mpaths), partitions...)","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_refresh_metadata":{"name":"log_refresh_metadata","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Log all refresh metadata. Includes daemon, device, and host info collected regularly. Only has effect if logging at debug level","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"log to the \"cephadm\" cluster log channel\"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf":{"name":"manage_etc_ceph_ceph_conf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Manage and own /etc/ceph/ceph.conf on the hosts.","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf_hosts":{"name":"manage_etc_ceph_ceph_conf_hosts","type":"str","level":"advanced","flags":0,"default_value":"*","min":"","max":"","enum_allowed":[],"desc":"PlacementSpec describing on which hosts to manage /etc/ceph/ceph.conf","long_desc":"","tags":[],"see_also":[]},"max_count_per_host":{"name":"max_count_per_host","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of daemons per service per host","long_desc":"","tags":[],"see_also":[]},"max_osd_draining_count":{"name":"max_osd_draining_count","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of osds that will be drained simultaneously when osds are removed","long_desc":"","tags":[],"see_also":[]},"migration_current":{"name":"migration_current","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"internal - do not modify","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":0,"default_value":"root","min":"","max":"","enum_allowed":["cephadm-package","root"],"desc":"mode for remote execution of cephadm","long_desc":"","tags":[],"see_also":[]},"oob_default_addr":{"name":"oob_default_addr","type":"str","level":"advanced","flags":0,"default_value":"169.254.1.1","min":"","max":"","enum_allowed":[],"desc":"Default address for RedFish API (oob management).","long_desc":"","tags":[],"see_also":[]},"prometheus_alerts_path":{"name":"prometheus_alerts_path","type":"str","level":"advanced","flags":0,"default_value":"/etc/prometheus/ceph/ceph_default_alerts.yml","min":"","max":"","enum_allowed":[],"desc":"location of alerts to include in prometheus deployments","long_desc":"","tags":[],"see_also":[]},"registry_insecure":{"name":"registry_insecure","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Registry is to be considered insecure (no TLS available). Only for development purposes.","long_desc":"","tags":[],"see_also":[]},"registry_password":{"name":"registry_password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository password. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"registry_url":{"name":"registry_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Registry url for login purposes. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"registry_username":{"name":"registry_username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository username. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"secure_monitoring_stack":{"name":"secure_monitoring_stack","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable TLS security for all the monitoring stack daemons","long_desc":"","tags":[],"see_also":[]},"service_discovery_port":{"name":"service_discovery_port","type":"int","level":"advanced","flags":0,"default_value":"8765","min":"","max":"","enum_allowed":[],"desc":"cephadm service discovery port","long_desc":"","tags":[],"see_also":[]},"ssh_config_file":{"name":"ssh_config_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"customized SSH config file to connect to managed hosts","long_desc":"","tags":[],"see_also":[]},"use_agent":{"name":"use_agent","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use cephadm agent on each host to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"use_repo_digest":{"name":"use_repo_digest","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Automatically convert image tags to image digest. Make sure all daemons use the same image","long_desc":"","tags":[],"see_also":[]},"warn_on_failed_host_check":{"name":"warn_on_failed_host_check","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if the host check fails","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_daemons":{"name":"warn_on_stray_daemons","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected that are not managed by cephadm","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_hosts":{"name":"warn_on_stray_hosts","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected on a host that is not managed by cephadm","long_desc":"","tags":[],"see_also":[]}}},{"name":"crash","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"retain_interval":{"name":"retain_interval","type":"secs","level":"advanced","flags":1,"default_value":"31536000","min":"","max":"","enum_allowed":[],"desc":"how long to retain crashes before pruning them","long_desc":"","tags":[],"see_also":[]},"warn_recent_interval":{"name":"warn_recent_interval","type":"secs","level":"advanced","flags":1,"default_value":"1209600","min":"","max":"","enum_allowed":[],"desc":"time interval in which to warn about recent crashes","long_desc":"","tags":[],"see_also":[]}}},{"name":"dashboard","can_run":true,"error_string":"","module_options":{"ACCOUNT_LOCKOUT_ATTEMPTS":{"name":"ACCOUNT_LOCKOUT_ATTEMPTS","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_HOST":{"name":"ALERTMANAGER_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_SSL_VERIFY":{"name":"ALERTMANAGER_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_ENABLED":{"name":"AUDIT_API_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_LOG_PAYLOAD":{"name":"AUDIT_API_LOG_PAYLOAD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ENABLE_BROWSABLE_API":{"name":"ENABLE_BROWSABLE_API","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_CEPHFS":{"name":"FEATURE_TOGGLE_CEPHFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_DASHBOARD":{"name":"FEATURE_TOGGLE_DASHBOARD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_ISCSI":{"name":"FEATURE_TOGGLE_ISCSI","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_MIRRORING":{"name":"FEATURE_TOGGLE_MIRRORING","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_NFS":{"name":"FEATURE_TOGGLE_NFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RBD":{"name":"FEATURE_TOGGLE_RBD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RGW":{"name":"FEATURE_TOGGLE_RGW","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE":{"name":"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_PASSWORD":{"name":"GRAFANA_API_PASSWORD","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_SSL_VERIFY":{"name":"GRAFANA_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_URL":{"name":"GRAFANA_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_USERNAME":{"name":"GRAFANA_API_USERNAME","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_FRONTEND_API_URL":{"name":"GRAFANA_FRONTEND_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_UPDATE_DASHBOARDS":{"name":"GRAFANA_UPDATE_DASHBOARDS","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISCSI_API_SSL_VERIFICATION":{"name":"ISCSI_API_SSL_VERIFICATION","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISSUE_TRACKER_API_KEY":{"name":"ISSUE_TRACKER_API_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_HOST":{"name":"PROMETHEUS_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_SSL_VERIFY":{"name":"PROMETHEUS_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_COMPLEXITY_ENABLED":{"name":"PWD_POLICY_CHECK_COMPLEXITY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED":{"name":"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_LENGTH_ENABLED":{"name":"PWD_POLICY_CHECK_LENGTH_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_OLDPWD_ENABLED":{"name":"PWD_POLICY_CHECK_OLDPWD_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_USERNAME_ENABLED":{"name":"PWD_POLICY_CHECK_USERNAME_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_ENABLED":{"name":"PWD_POLICY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_EXCLUSION_LIST":{"name":"PWD_POLICY_EXCLUSION_LIST","type":"str","level":"advanced","flags":0,"default_value":"osd,host,dashboard,pool,block,nfs,ceph,monitors,gateway,logs,crush,maps","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_COMPLEXITY":{"name":"PWD_POLICY_MIN_COMPLEXITY","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_LENGTH":{"name":"PWD_POLICY_MIN_LENGTH","type":"int","level":"advanced","flags":0,"default_value":"8","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"REST_REQUESTS_TIMEOUT":{"name":"REST_REQUESTS_TIMEOUT","type":"int","level":"advanced","flags":0,"default_value":"45","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ACCESS_KEY":{"name":"RGW_API_ACCESS_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ADMIN_RESOURCE":{"name":"RGW_API_ADMIN_RESOURCE","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SECRET_KEY":{"name":"RGW_API_SECRET_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SSL_VERIFY":{"name":"RGW_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_SPAN":{"name":"USER_PWD_EXPIRATION_SPAN","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_1":{"name":"USER_PWD_EXPIRATION_WARNING_1","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_2":{"name":"USER_PWD_EXPIRATION_WARNING_2","type":"int","level":"advanced","flags":0,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"cross_origin_url":{"name":"cross_origin_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"crt_file":{"name":"crt_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"debug":{"name":"debug","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable/disable debug options","long_desc":"","tags":[],"see_also":[]},"jwt_token_ttl":{"name":"jwt_token_ttl","type":"int","level":"advanced","flags":0,"default_value":"28800","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"motd":{"name":"motd","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"The message of the day","long_desc":"","tags":[],"see_also":[]},"redirect_resolve_ip_addr":{"name":"redirect_resolve_ip_addr","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":0,"default_value":"8080","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl_server_port":{"name":"ssl_server_port","type":"int","level":"advanced","flags":0,"default_value":"8443","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":0,"default_value":"redirect","min":"","max":"","enum_allowed":["error","redirect"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":0,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url_prefix":{"name":"url_prefix","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"devicehealth","can_run":true,"error_string":"","module_options":{"enable_monitoring":{"name":"enable_monitoring","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"monitor device health metrics","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mark_out_threshold":{"name":"mark_out_threshold","type":"secs","level":"advanced","flags":1,"default_value":"2419200","min":"","max":"","enum_allowed":[],"desc":"automatically mark OSD if it may fail before this long","long_desc":"","tags":[],"see_also":[]},"pool_name":{"name":"pool_name","type":"str","level":"advanced","flags":1,"default_value":"device_health_metrics","min":"","max":"","enum_allowed":[],"desc":"name of pool in which to store device health metrics","long_desc":"","tags":[],"see_also":[]},"retention_period":{"name":"retention_period","type":"secs","level":"advanced","flags":1,"default_value":"15552000","min":"","max":"","enum_allowed":[],"desc":"how long to retain device health metrics","long_desc":"","tags":[],"see_also":[]},"scrape_frequency":{"name":"scrape_frequency","type":"secs","level":"advanced","flags":1,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"how frequently to scrape device health metrics","long_desc":"","tags":[],"see_also":[]},"self_heal":{"name":"self_heal","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"preemptively heal cluster around devices that may fail","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and check device health","long_desc":"","tags":[],"see_also":[]},"warn_threshold":{"name":"warn_threshold","type":"secs","level":"advanced","flags":1,"default_value":"7257600","min":"","max":"","enum_allowed":[],"desc":"raise health warning if OSD may fail before this long","long_desc":"","tags":[],"see_also":[]}}},{"name":"diskprediction_local","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predict_interval":{"name":"predict_interval","type":"str","level":"advanced","flags":0,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predictor_model":{"name":"predictor_model","type":"str","level":"advanced","flags":0,"default_value":"prophetstor","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"str","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"influx","can_run":false,"error_string":"influxdb python module not found","module_options":{"batch_size":{"name":"batch_size","type":"int","level":"advanced","flags":0,"default_value":"5000","min":"","max":"","enum_allowed":[],"desc":"How big batches of data points should be when sending to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"database":{"name":"database","type":"str","level":"advanced","flags":0,"default_value":"ceph","min":"","max":"","enum_allowed":[],"desc":"InfluxDB database name. You will need to create this database and grant write privileges to the configured username or the username must have admin privileges to create it.","long_desc":"","tags":[],"see_also":[]},"hostname":{"name":"hostname","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server hostname","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"30","min":"5","max":"","enum_allowed":[],"desc":"Time between reports to InfluxDB. Default 30 seconds.","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"password":{"name":"password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"password of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"port":{"name":"port","type":"int","level":"advanced","flags":0,"default_value":"8086","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server port","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"str","level":"advanced","flags":0,"default_value":"false","min":"","max":"","enum_allowed":[],"desc":"Use https connection for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]},"threads":{"name":"threads","type":"int","level":"advanced","flags":0,"default_value":"5","min":"1","max":"32","enum_allowed":[],"desc":"How many worker threads should be spawned for sending data to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"username":{"name":"username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"username of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"verify_ssl":{"name":"verify_ssl","type":"str","level":"advanced","flags":0,"default_value":"true","min":"","max":"","enum_allowed":[],"desc":"Verify https cert for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]}}},{"name":"insights","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"iostat","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"k8sevents","can_run":true,"error_string":"","module_options":{"ceph_event_retention_days":{"name":"ceph_event_retention_days","type":"int","level":"advanced","flags":0,"default_value":"7","min":"","max":"","enum_allowed":[],"desc":"Days to hold ceph event information within local cache","long_desc":"","tags":[],"see_also":[]},"config_check_secs":{"name":"config_check_secs","type":"int","level":"advanced","flags":0,"default_value":"10","min":"10","max":"","enum_allowed":[],"desc":"interval (secs) to check for cluster configuration changes","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"localpool","can_run":true,"error_string":"","module_options":{"failure_domain":{"name":"failure_domain","type":"str","level":"advanced","flags":1,"default_value":"host","min":"","max":"","enum_allowed":[],"desc":"failure domain for any created local pool","long_desc":"what failure domain we should separate data replicas across.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_size":{"name":"min_size","type":"int","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"default min_size for any created local pool","long_desc":"value to set min_size to (unchanged from Ceph's default if this option is not set)","tags":[],"see_also":[]},"num_rep":{"name":"num_rep","type":"int","level":"advanced","flags":1,"default_value":"3","min":"","max":"","enum_allowed":[],"desc":"default replica count for any created local pool","long_desc":"","tags":[],"see_also":[]},"pg_num":{"name":"pg_num","type":"int","level":"advanced","flags":1,"default_value":"128","min":"","max":"","enum_allowed":[],"desc":"default pg_num for any created local pool","long_desc":"","tags":[],"see_also":[]},"prefix":{"name":"prefix","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"name prefix for any created local pool","long_desc":"","tags":[],"see_also":[]},"subtree":{"name":"subtree","type":"str","level":"advanced","flags":1,"default_value":"rack","min":"","max":"","enum_allowed":[],"desc":"CRUSH level for which to create a local pool","long_desc":"which CRUSH subtree type the module should create a pool for.","tags":[],"see_also":[]}}},{"name":"mds_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"mirroring","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"nfs","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"orchestrator","can_run":true,"error_string":"","module_options":{"fail_fs":{"name":"fail_fs","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Fail filesystem for rapid multi-rank mds upgrade","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"orchestrator":{"name":"orchestrator","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["cephadm","rook","test_orchestrator"],"desc":"Orchestrator backend","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_perf_query","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"pg_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"threshold":{"name":"threshold","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"1.0","max":"","enum_allowed":[],"desc":"scaling threshold","long_desc":"The factor by which the `NEW PG_NUM` must vary from the current`PG_NUM` before being accepted. Cannot be less than 1.0","tags":[],"see_also":[]}}},{"name":"progress","can_run":true,"error_string":"","module_options":{"allow_pg_recovery_event":{"name":"allow_pg_recovery_event","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow the module to show pg recovery progress","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_completed_events":{"name":"max_completed_events","type":"int","level":"advanced","flags":1,"default_value":"50","min":"","max":"","enum_allowed":[],"desc":"number of past completed events to remember","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"how long the module is going to sleep","long_desc":"","tags":[],"see_also":[]}}},{"name":"prometheus","can_run":true,"error_string":"","module_options":{"cache":{"name":"cache","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"exclude_perf_counters":{"name":"exclude_perf_counters","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Do not include perf-counters in the metrics output","long_desc":"Gathering perf-counters from a single Prometheus exporter can degrade ceph-mgr performance, especially in large clusters. Instead, Ceph-exporter daemons are now used by default for perf-counter gathering. This should only be disabled when no ceph-exporters are deployed.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools":{"name":"rbd_stats_pools","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools_refresh_interval":{"name":"rbd_stats_pools_refresh_interval","type":"int","level":"advanced","flags":0,"default_value":"300","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"scrape_interval":{"name":"scrape_interval","type":"float","level":"advanced","flags":0,"default_value":"15.0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"the IPv4 or IPv6 address on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":1,"default_value":"9283","min":"","max":"","enum_allowed":[],"desc":"the port on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"stale_cache_strategy":{"name":"stale_cache_strategy","type":"str","level":"advanced","flags":0,"default_value":"log","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":1,"default_value":"default","min":"","max":"","enum_allowed":["default","error"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":1,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rbd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_snap_create":{"name":"max_concurrent_snap_create","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mirror_snapshot_schedule":{"name":"mirror_snapshot_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"trash_purge_schedule":{"name":"trash_purge_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"restful","can_run":true,"error_string":"","module_options":{"enable_auth":{"name":"enable_auth","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rgw","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rook","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"storage_class":{"name":"storage_class","type":"str","level":"advanced","flags":0,"default_value":"local","min":"","max":"","enum_allowed":[],"desc":"storage class name for LSO-discovered PVs","long_desc":"","tags":[],"see_also":[]}}},{"name":"selftest","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption1":{"name":"roption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption2":{"name":"roption2","type":"str","level":"advanced","flags":0,"default_value":"xyz","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption1":{"name":"rwoption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption2":{"name":"rwoption2","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption3":{"name":"rwoption3","type":"float","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption4":{"name":"rwoption4","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption5":{"name":"rwoption5","type":"bool","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption6":{"name":"rwoption6","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption7":{"name":"rwoption7","type":"int","level":"advanced","flags":0,"default_value":"","min":"1","max":"42","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testkey":{"name":"testkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testlkey":{"name":"testlkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testnewline":{"name":"testnewline","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"snap_schedule","can_run":true,"error_string":"","module_options":{"allow_m_granularity":{"name":"allow_m_granularity","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow minute scheduled snapshots","long_desc":"","tags":[],"see_also":[]},"dump_on_update":{"name":"dump_on_update","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"dump database to debug log on update","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"stats","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"status","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telegraf","can_run":true,"error_string":"","module_options":{"address":{"name":"address","type":"str","level":"advanced","flags":0,"default_value":"unixgram:///tmp/telegraf.sock","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"15","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telemetry","can_run":true,"error_string":"","module_options":{"channel_basic":{"name":"channel_basic","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share basic cluster information (size, version)","long_desc":"","tags":[],"see_also":[]},"channel_crash":{"name":"channel_crash","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share metadata about Ceph daemon crashes (version, stack straces, etc)","long_desc":"","tags":[],"see_also":[]},"channel_device":{"name":"channel_device","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share device health metrics (e.g., SMART data, minus potentially identifying info like serial numbers)","long_desc":"","tags":[],"see_also":[]},"channel_ident":{"name":"channel_ident","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share a user-provided description and/or contact email for the cluster","long_desc":"","tags":[],"see_also":[]},"channel_perf":{"name":"channel_perf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share various performance metrics of a cluster","long_desc":"","tags":[],"see_also":[]},"contact":{"name":"contact","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"description":{"name":"description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"device_url":{"name":"device_url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/device","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"int","level":"advanced","flags":0,"default_value":"24","min":"8","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"last_opt_revision":{"name":"last_opt_revision","type":"int","level":"advanced","flags":0,"default_value":"1","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard":{"name":"leaderboard","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard_description":{"name":"leaderboard_description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"organization":{"name":"organization","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"proxy":{"name":"proxy","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url":{"name":"url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/report","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"test_orchestrator","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"volumes","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_clones":{"name":"max_concurrent_clones","type":"int","level":"advanced","flags":0,"default_value":"4","min":"","max":"","enum_allowed":[],"desc":"Number of asynchronous cloner threads","long_desc":"","tags":[],"see_also":[]},"periodic_async_work":{"name":"periodic_async_work","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Periodically check for async work","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_delay":{"name":"snapshot_clone_delay","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"Delay clone begin operation by snapshot_clone_delay seconds","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_no_wait":{"name":"snapshot_clone_no_wait","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Reject subvolume clone request when cloner threads are busy","long_desc":"","tags":[],"see_also":[]}}},{"name":"zabbix","can_run":true,"error_string":"","module_options":{"discovery_interval":{"name":"discovery_interval","type":"uint","level":"advanced","flags":0,"default_value":"100","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"identifier":{"name":"identifier","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_host":{"name":"zabbix_host","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_port":{"name":"zabbix_port","type":"int","level":"advanced","flags":0,"default_value":"10051","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_sender":{"name":"zabbix_sender","type":"str","level":"advanced","flags":0,"default_value":"/usr/bin/zabbix_sender","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}}],"services":{"dashboard":"https://172.21.15.39:8443/"},"always_on_modules":{"octopus":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"pacific":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"quincy":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"reef":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"squid":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"]},"last_failure_osd_epoch":3,"active_clients":[{"name":"devicehealth","addrvec":[{"type":"v2","addr":"172.21.15.39:0","nonce":1147479345}]},{"name":"libcephsqlite","addrvec":[{"type":"v2","addr":"172.21.15.39:0","nonce":4167553412}]},{"name":"rbd_support","addrvec":[{"type":"v2","addr":"172.21.15.39:0","nonce":684883181}]},{"name":"volumes","addrvec":[{"type":"v2","addr":"172.21.15.39:0","nonce":4180631617}]},{"name":"volumes","addrvec":[{"type":"v2","addr":"172.21.15.39:0","nonce":1660909280}]}]} 2024-09-12T02:36:17.575 INFO:tasks.cephadm.ceph_manager.ceph:mgr available! 2024-09-12T02:36:17.575 INFO:tasks.cephadm.ceph_manager.ceph:waiting for all up 2024-09-12T02:36:17.575 DEBUG:teuthology.orchestra.run.smithi039:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc shell --fsid 4954ed46-70ae-11ef-bcea-c7b262605968 -- ceph osd dump --format=json 2024-09-12T02:36:17.956 INFO:teuthology.orchestra.run.smithi039.stderr:Inferring config /var/lib/ceph/4954ed46-70ae-11ef-bcea-c7b262605968/mon.a/config 2024-09-12T02:36:18.095 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 02:36:17 smithi039 ceph-mon[30515]: pgmap v339: 129 pgs: 129 active+clean; 645 KiB data, 347 MiB used, 1.0 TiB / 1.0 TiB avail; 5.7 KiB/s rd, 1.9 KiB/s wr, 10 op/s 2024-09-12T02:36:18.198 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 12 02:36:17 smithi044 ceph-mon[35411]: pgmap v339: 129 pgs: 129 active+clean; 645 KiB data, 347 MiB used, 1.0 TiB / 1.0 TiB avail; 5.7 KiB/s rd, 1.9 KiB/s wr, 10 op/s 2024-09-12T02:36:18.263 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 12 02:36:17 smithi172 ceph-mon[35609]: pgmap v339: 129 pgs: 129 active+clean; 645 KiB data, 347 MiB used, 1.0 TiB / 1.0 TiB avail; 5.7 KiB/s rd, 1.9 KiB/s wr, 10 op/s 2024-09-12T02:36:18.500 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:36:18.499+0000 7f1a73600640 1 -- 172.21.15.39:0/361386037 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f1a6c109120 msgr2=0x7f1a6c110ca0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:36:18.501 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:36:18.499+0000 7f1a73600640 1 --2- 172.21.15.39:0/361386037 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f1a6c109120 0x7f1a6c110ca0 secure :-1 s=READY pgs=194 cs=0 l=1 rev1=1 crypto rx=0x7f1a64009ca0 tx=0x7f1a6402a8b0 comp rx=0 tx=0).stop 2024-09-12T02:36:18.501 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:36:18.499+0000 7f1a73600640 1 -- 172.21.15.39:0/361386037 shutdown_connections 2024-09-12T02:36:18.501 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:36:18.499+0000 7f1a73600640 1 --2- 172.21.15.39:0/361386037 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f1a6c109120 0x7f1a6c110ca0 unknown :-1 s=CLOSED pgs=194 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:36:18.501 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:36:18.499+0000 7f1a73600640 1 --2- 172.21.15.39:0/361386037 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f1a6c1049a0 0x7f1a6c1089f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:36:18.501 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:36:18.499+0000 7f1a73600640 1 --2- 172.21.15.39:0/361386037 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f1a6c103ff0 0x7f1a6c1043d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:36:18.501 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:36:18.499+0000 7f1a73600640 1 -- 172.21.15.39:0/361386037 >> 172.21.15.39:0/361386037 conn(0x7f1a6c0ffa90 msgr2=0x7f1a6c101eb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:36:18.501 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:36:18.499+0000 7f1a73600640 1 -- 172.21.15.39:0/361386037 shutdown_connections 2024-09-12T02:36:18.501 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:36:18.499+0000 7f1a73600640 1 -- 172.21.15.39:0/361386037 wait complete. 2024-09-12T02:36:18.502 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:36:18.500+0000 7f1a73600640 1 Processor -- start 2024-09-12T02:36:18.502 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:36:18.500+0000 7f1a73600640 1 -- start start 2024-09-12T02:36:18.502 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:36:18.501+0000 7f1a73600640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f1a6c103ff0 0x7f1a6c19a610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:36:18.502 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:36:18.501+0000 7f1a73600640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f1a6c1049a0 0x7f1a6c19ab50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:36:18.503 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:36:18.501+0000 7f1a73600640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f1a6c109120 0x7f1a6c19eee0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:36:18.503 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:36:18.501+0000 7f1a73600640 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 -- 0x7f1a6c114130 con 0x7f1a6c109120 2024-09-12T02:36:18.503 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:36:18.501+0000 7f1a73600640 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x7f1a6c113fb0 con 0x7f1a6c1049a0 2024-09-12T02:36:18.503 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:36:18.501+0000 7f1a73600640 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7f1a6c1142b0 con 0x7f1a6c103ff0 2024-09-12T02:36:18.503 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:36:18.501+0000 7f1a71600640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f1a6c109120 0x7f1a6c19eee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:36:18.503 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:36:18.501+0000 7f1a6be00640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f1a6c1049a0 0x7f1a6c19ab50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:36:18.503 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:36:18.501+0000 7f1a71600640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f1a6c109120 0x7f1a6c19eee0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.39:3300/0 says I am v2:172.21.15.39:33990/0 (socket says 172.21.15.39:33990) 2024-09-12T02:36:18.503 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:36:18.501+0000 7f1a70c00640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f1a6c103ff0 0x7f1a6c19a610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:36:18.503 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:36:18.501+0000 7f1a71600640 1 -- 172.21.15.39:0/524307276 learned_addr learned my addr 172.21.15.39:0/524307276 (peer_addr_for_me v2:172.21.15.39:0/0) 2024-09-12T02:36:18.503 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:36:18.502+0000 7f1a6be00640 1 -- 172.21.15.39:0/524307276 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f1a6c103ff0 msgr2=0x7f1a6c19a610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:36:18.503 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:36:18.502+0000 7f1a6be00640 1 --2- 172.21.15.39:0/524307276 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f1a6c103ff0 0x7f1a6c19a610 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:36:18.503 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:36:18.502+0000 7f1a6be00640 1 -- 172.21.15.39:0/524307276 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f1a6c109120 msgr2=0x7f1a6c19eee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:36:18.503 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:36:18.502+0000 7f1a6be00640 1 --2- 172.21.15.39:0/524307276 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f1a6c109120 0x7f1a6c19eee0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:36:18.504 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:36:18.502+0000 7f1a6be00640 1 -- 172.21.15.39:0/524307276 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1a6c19f5c0 con 0x7f1a6c1049a0 2024-09-12T02:36:18.504 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:36:18.502+0000 7f1a6be00640 1 --2- 172.21.15.39:0/524307276 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f1a6c1049a0 0x7f1a6c19ab50 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7f1a5800e9f0 tx=0x7f1a5800eeb0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:36:18.504 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:36:18.502+0000 7f1a69600640 1 -- 172.21.15.39:0/524307276 <== mon.2 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1a5800ccc0 con 0x7f1a6c1049a0 2024-09-12T02:36:18.504 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:36:18.502+0000 7f1a69600640 1 -- 172.21.15.39:0/524307276 <== mon.2 v2:172.21.15.44:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f1a58010910 con 0x7f1a6c1049a0 2024-09-12T02:36:18.505 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:36:18.502+0000 7f1a73600640 1 -- 172.21.15.39:0/524307276 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f1a6c19f8b0 con 0x7f1a6c1049a0 2024-09-12T02:36:18.505 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:36:18.502+0000 7f1a69600640 1 -- 172.21.15.39:0/524307276 <== mon.2 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1a58018960 con 0x7f1a6c1049a0 2024-09-12T02:36:18.505 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:36:18.502+0000 7f1a73600640 1 -- 172.21.15.39:0/524307276 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f1a6c1a7190 con 0x7f1a6c1049a0 2024-09-12T02:36:18.505 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:36:18.503+0000 7f1a73600640 1 -- 172.21.15.39:0/524307276 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f1a6c1043d0 con 0x7f1a6c1049a0 2024-09-12T02:36:18.507 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:36:18.506+0000 7f1a69600640 1 -- 172.21.15.39:0/524307276 <== mon.2 v2:172.21.15.44:3300/0 4 ==== mgrmap(e 17) ==== 137884+0+0 (secure 0 0 0) 0x7f1a58010ac0 con 0x7f1a6c1049a0 2024-09-12T02:36:18.508 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:36:18.507+0000 7f1a69600640 1 --2- 172.21.15.39:0/524307276 >> [v2:172.21.15.39:6800/1725006999,v1:172.21.15.39:6801/1725006999] conn(0x7f1a540a2c10 0x7f1a540a50d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:36:18.508 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:36:18.508+0000 7f1a69600640 1 -- 172.21.15.39:0/524307276 <== mon.2 v2:172.21.15.44:3300/0 5 ==== osd_map(93..93 src has 1..93) ==== 9092+0+0 (secure 0 0 0) 0x7f1a580cfd40 con 0x7f1a6c1049a0 2024-09-12T02:36:18.509 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:36:18.508+0000 7f1a70c00640 1 --2- 172.21.15.39:0/524307276 >> [v2:172.21.15.39:6800/1725006999,v1:172.21.15.39:6801/1725006999] conn(0x7f1a540a2c10 0x7f1a540a50d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:36:18.509 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:36:18.508+0000 7f1a70c00640 1 --2- 172.21.15.39:0/524307276 >> [v2:172.21.15.39:6800/1725006999,v1:172.21.15.39:6801/1725006999] conn(0x7f1a540a2c10 0x7f1a540a50d0 secure :-1 s=READY pgs=177 cs=0 l=1 rev1=1 crypto rx=0x7f1a60009bb0 tx=0x7f1a60005f90 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:36:18.510 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:36:18.509+0000 7f1a69600640 1 -- 172.21.15.39:0/524307276 <== mon.2 v2:172.21.15.44:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7f1a5809c130 con 0x7f1a6c1049a0 2024-09-12T02:36:18.697 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:36:18.696+0000 7f1a73600640 1 -- 172.21.15.39:0/524307276 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f1a6c1a73f0 con 0x7f1a6c1049a0 2024-09-12T02:36:18.698 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:36:18.697+0000 7f1a69600640 1 -- 172.21.15.39:0/524307276 <== mon.2 v2:172.21.15.44:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v93) ==== 74+0+24705 (secure 0 0 0) 0x7f1a580a0430 con 0x7f1a6c1049a0 2024-09-12T02:36:18.699 INFO:teuthology.orchestra.run.smithi039.stdout: 2024-09-12T02:36:18.699 INFO:teuthology.orchestra.run.smithi039.stdout:{"epoch":93,"fsid":"4954ed46-70ae-11ef-bcea-c7b262605968","created":"2024-09-12T02:26:43.086467+0000","modified":"2024-09-12T02:35:46.720985+0000","last_up_change":"2024-09-12T02:34:08.626341+0000","last_in_change":"2024-09-12T02:33:45.553591+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":27,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":12,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-12T02:30:09.347905+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":12,"score_stable":12,"optimal_score":0.25,"raw_score_acting":3,"raw_score_stable":3,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-09-12T02:34:58.580872+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"84","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.8799999952316284,"score_stable":1.8799999952316284,"optimal_score":1,"raw_score_acting":1.8799999952316284,"raw_score_stable":1.8799999952316284,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-09-12T02:35:01.469805+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"84","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2024-09-12T02:35:11.088109+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"91","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"c967b48e-8a39-4797-871b-8b1b83d9472f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":87,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6802","nonce":2437586899},{"type":"v1","addr":"172.21.15.39:6803","nonce":2437586899}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6804","nonce":2437586899},{"type":"v1","addr":"172.21.15.39:6805","nonce":2437586899}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6808","nonce":2437586899},{"type":"v1","addr":"172.21.15.39:6809","nonce":2437586899}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6806","nonce":2437586899},{"type":"v1","addr":"172.21.15.39:6807","nonce":2437586899}]},"public_addr":"172.21.15.39:6803/2437586899","cluster_addr":"172.21.15.39:6805/2437586899","heartbeat_back_addr":"172.21.15.39:6809/2437586899","heartbeat_front_addr":"172.21.15.39:6807/2437586899","state":["exists","up"]},{"osd":1,"uuid":"30e1e4f4-1d50-4003-8978-cb183dca7fbb","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":87,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6800","nonce":2349287000},{"type":"v1","addr":"172.21.15.44:6801","nonce":2349287000}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6802","nonce":2349287000},{"type":"v1","addr":"172.21.15.44:6803","nonce":2349287000}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6806","nonce":2349287000},{"type":"v1","addr":"172.21.15.44:6807","nonce":2349287000}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6804","nonce":2349287000},{"type":"v1","addr":"172.21.15.44:6805","nonce":2349287000}]},"public_addr":"172.21.15.44:6801/2349287000","cluster_addr":"172.21.15.44:6803/2349287000","heartbeat_back_addr":"172.21.15.44:6807/2349287000","heartbeat_front_addr":"172.21.15.44:6805/2349287000","state":["exists","up"]},{"osd":2,"uuid":"a758803f-8668-4fc8-9417-b8d080cd9a7c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":18,"up_thru":87,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6800","nonce":1176898232},{"type":"v1","addr":"172.21.15.172:6801","nonce":1176898232}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6802","nonce":1176898232},{"type":"v1","addr":"172.21.15.172:6803","nonce":1176898232}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6806","nonce":1176898232},{"type":"v1","addr":"172.21.15.172:6807","nonce":1176898232}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6804","nonce":1176898232},{"type":"v1","addr":"172.21.15.172:6805","nonce":1176898232}]},"public_addr":"172.21.15.172:6801/1176898232","cluster_addr":"172.21.15.172:6803/1176898232","heartbeat_back_addr":"172.21.15.172:6807/1176898232","heartbeat_front_addr":"172.21.15.172:6805/1176898232","state":["exists","up"]},{"osd":3,"uuid":"8b256567-7efe-429c-bc4c-80e93228f139","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":26,"up_thru":87,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6810","nonce":2013565859},{"type":"v1","addr":"172.21.15.39:6811","nonce":2013565859}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6812","nonce":2013565859},{"type":"v1","addr":"172.21.15.39:6813","nonce":2013565859}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6816","nonce":2013565859},{"type":"v1","addr":"172.21.15.39:6817","nonce":2013565859}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6814","nonce":2013565859},{"type":"v1","addr":"172.21.15.39:6815","nonce":2013565859}]},"public_addr":"172.21.15.39:6811/2013565859","cluster_addr":"172.21.15.39:6813/2013565859","heartbeat_back_addr":"172.21.15.39:6817/2013565859","heartbeat_front_addr":"172.21.15.39:6815/2013565859","state":["exists","up"]},{"osd":4,"uuid":"e86b6756-e2b3-49fe-9b87-1a2b015bb17a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":33,"up_thru":87,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6808","nonce":3663639110},{"type":"v1","addr":"172.21.15.44:6809","nonce":3663639110}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6810","nonce":3663639110},{"type":"v1","addr":"172.21.15.44:6811","nonce":3663639110}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6814","nonce":3663639110},{"type":"v1","addr":"172.21.15.44:6815","nonce":3663639110}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6812","nonce":3663639110},{"type":"v1","addr":"172.21.15.44:6813","nonce":3663639110}]},"public_addr":"172.21.15.44:6809/3663639110","cluster_addr":"172.21.15.44:6811/3663639110","heartbeat_back_addr":"172.21.15.44:6815/3663639110","heartbeat_front_addr":"172.21.15.44:6813/3663639110","state":["exists","up"]},{"osd":5,"uuid":"9c907c92-b323-48e7-99ad-ec9756d26312","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":38,"up_thru":92,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6808","nonce":998885347},{"type":"v1","addr":"172.21.15.172:6809","nonce":998885347}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6810","nonce":998885347},{"type":"v1","addr":"172.21.15.172:6811","nonce":998885347}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6814","nonce":998885347},{"type":"v1","addr":"172.21.15.172:6815","nonce":998885347}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6812","nonce":998885347},{"type":"v1","addr":"172.21.15.172:6813","nonce":998885347}]},"public_addr":"172.21.15.172:6809/998885347","cluster_addr":"172.21.15.172:6811/998885347","heartbeat_back_addr":"172.21.15.172:6815/998885347","heartbeat_front_addr":"172.21.15.172:6813/998885347","state":["exists","up"]},{"osd":6,"uuid":"1fcb9bb2-6f4b-4d97-a401-aeb6a9706613","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":45,"up_thru":92,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6818","nonce":2569059542},{"type":"v1","addr":"172.21.15.39:6819","nonce":2569059542}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6820","nonce":2569059542},{"type":"v1","addr":"172.21.15.39:6821","nonce":2569059542}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6824","nonce":2569059542},{"type":"v1","addr":"172.21.15.39:6825","nonce":2569059542}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6822","nonce":2569059542},{"type":"v1","addr":"172.21.15.39:6823","nonce":2569059542}]},"public_addr":"172.21.15.39:6819/2569059542","cluster_addr":"172.21.15.39:6821/2569059542","heartbeat_back_addr":"172.21.15.39:6825/2569059542","heartbeat_front_addr":"172.21.15.39:6823/2569059542","state":["exists","up"]},{"osd":7,"uuid":"59e0caf9-8ce5-4161-8875-84862eba743e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":50,"up_thru":87,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6816","nonce":709635079},{"type":"v1","addr":"172.21.15.44:6817","nonce":709635079}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6818","nonce":709635079},{"type":"v1","addr":"172.21.15.44:6819","nonce":709635079}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6822","nonce":709635079},{"type":"v1","addr":"172.21.15.44:6823","nonce":709635079}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6820","nonce":709635079},{"type":"v1","addr":"172.21.15.44:6821","nonce":709635079}]},"public_addr":"172.21.15.44:6817/709635079","cluster_addr":"172.21.15.44:6819/709635079","heartbeat_back_addr":"172.21.15.44:6823/709635079","heartbeat_front_addr":"172.21.15.44:6821/709635079","state":["exists","up"]},{"osd":8,"uuid":"2f6fb5c7-86cc-43eb-bdfb-45a69316937e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":57,"up_thru":92,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6816","nonce":1162792895},{"type":"v1","addr":"172.21.15.172:6817","nonce":1162792895}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6818","nonce":1162792895},{"type":"v1","addr":"172.21.15.172:6819","nonce":1162792895}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6822","nonce":1162792895},{"type":"v1","addr":"172.21.15.172:6823","nonce":1162792895}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6820","nonce":1162792895},{"type":"v1","addr":"172.21.15.172:6821","nonce":1162792895}]},"public_addr":"172.21.15.172:6817/1162792895","cluster_addr":"172.21.15.172:6819/1162792895","heartbeat_back_addr":"172.21.15.172:6823/1162792895","heartbeat_front_addr":"172.21.15.172:6821/1162792895","state":["exists","up"]},{"osd":9,"uuid":"87e5dd9e-8191-4db6-83fa-cfff7c31e17e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":65,"up_thru":92,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6826","nonce":945860346},{"type":"v1","addr":"172.21.15.39:6827","nonce":945860346}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6828","nonce":945860346},{"type":"v1","addr":"172.21.15.39:6829","nonce":945860346}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6832","nonce":945860346},{"type":"v1","addr":"172.21.15.39:6833","nonce":945860346}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6830","nonce":945860346},{"type":"v1","addr":"172.21.15.39:6831","nonce":945860346}]},"public_addr":"172.21.15.39:6827/945860346","cluster_addr":"172.21.15.39:6829/945860346","heartbeat_back_addr":"172.21.15.39:6833/945860346","heartbeat_front_addr":"172.21.15.39:6831/945860346","state":["exists","up"]},{"osd":10,"uuid":"b55d8a00-850f-4910-a5bf-97d9ed545be7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":70,"up_thru":81,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6824","nonce":3899352344},{"type":"v1","addr":"172.21.15.44:6825","nonce":3899352344}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6826","nonce":3899352344},{"type":"v1","addr":"172.21.15.44:6827","nonce":3899352344}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6830","nonce":3899352344},{"type":"v1","addr":"172.21.15.44:6831","nonce":3899352344}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6828","nonce":3899352344},{"type":"v1","addr":"172.21.15.44:6829","nonce":3899352344}]},"public_addr":"172.21.15.44:6825/3899352344","cluster_addr":"172.21.15.44:6827/3899352344","heartbeat_back_addr":"172.21.15.44:6831/3899352344","heartbeat_front_addr":"172.21.15.44:6829/3899352344","state":["exists","up"]},{"osd":11,"uuid":"20cf5df1-5a80-4272-acc0-919c6a1da55a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":77,"up_thru":92,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6824","nonce":3627635035},{"type":"v1","addr":"172.21.15.172:6825","nonce":3627635035}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6826","nonce":3627635035},{"type":"v1","addr":"172.21.15.172:6827","nonce":3627635035}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6830","nonce":3627635035},{"type":"v1","addr":"172.21.15.172:6831","nonce":3627635035}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6828","nonce":3627635035},{"type":"v1","addr":"172.21.15.172:6829","nonce":3627635035}]},"public_addr":"172.21.15.172:6825/3627635035","cluster_addr":"172.21.15.172:6827/3627635035","heartbeat_back_addr":"172.21.15.172:6831/3627635035","heartbeat_front_addr":"172.21.15.172:6829/3627635035","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T02:29:15.367468+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T02:29:41.518207+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T02:30:06.004371+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T02:30:34.793371+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T02:31:00.878517+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T02:31:26.675956+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T02:31:55.950748+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T02:32:22.824017+0000","dead_epoch":0},{"osd":8,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T02:32:46.775880+0000","dead_epoch":0},{"osd":9,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T02:33:16.420347+0000","dead_epoch":0},{"osd":10,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T02:33:42.185837+0000","dead_epoch":0},{"osd":11,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T02:34:07.312555+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"2.0","mappings":[{"from":7,"to":11}]},{"pgid":"2.b","mappings":[{"from":2,"to":1}]},{"pgid":"2.10","mappings":[{"from":8,"to":11}]},{"pgid":"2.1b","mappings":[{"from":2,"to":4}]},{"pgid":"3.11","mappings":[{"from":4,"to":8}]},{"pgid":"3.24","mappings":[{"from":4,"to":9}]},{"pgid":"3.33","mappings":[{"from":5,"to":9}]},{"pgid":"3.34","mappings":[{"from":4,"to":9}]},{"pgid":"4.2","mappings":[{"from":9,"to":1}]},{"pgid":"4.6","mappings":[{"from":9,"to":11}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.39:6800/3152613618":"2024-09-13T02:27:44.717224+0000","172.21.15.39:0/2301206766":"2024-09-13T02:27:44.717224+0000","172.21.15.39:0/1941318538":"2024-09-13T02:27:44.717224+0000","172.21.15.39:0/1527429435":"2024-09-13T02:27:44.717224+0000","172.21.15.39:0/2913347539":"2024-09-13T02:27:16.531986+0000","172.21.15.39:0/2827440002":"2024-09-13T02:27:16.531986+0000","172.21.15.39:0/4075322467":"2024-09-13T02:27:16.531986+0000","172.21.15.39:6801/1074685700":"2024-09-13T02:27:16.531986+0000","172.21.15.39:6801/3152613618":"2024-09-13T02:27:44.717224+0000","172.21.15.39:6800/1074685700":"2024-09-13T02:27:16.531986+0000"},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-12T02:36:18.701 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:36:18.700+0000 7f1a73600640 1 -- 172.21.15.39:0/524307276 >> [v2:172.21.15.39:6800/1725006999,v1:172.21.15.39:6801/1725006999] conn(0x7f1a540a2c10 msgr2=0x7f1a540a50d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:36:18.701 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:36:18.700+0000 7f1a73600640 1 --2- 172.21.15.39:0/524307276 >> [v2:172.21.15.39:6800/1725006999,v1:172.21.15.39:6801/1725006999] conn(0x7f1a540a2c10 0x7f1a540a50d0 secure :-1 s=READY pgs=177 cs=0 l=1 rev1=1 crypto rx=0x7f1a60009bb0 tx=0x7f1a60005f90 comp rx=0 tx=0).stop 2024-09-12T02:36:18.701 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:36:18.700+0000 7f1a73600640 1 -- 172.21.15.39:0/524307276 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f1a6c1049a0 msgr2=0x7f1a6c19ab50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:36:18.701 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:36:18.700+0000 7f1a73600640 1 --2- 172.21.15.39:0/524307276 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f1a6c1049a0 0x7f1a6c19ab50 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7f1a5800e9f0 tx=0x7f1a5800eeb0 comp rx=0 tx=0).stop 2024-09-12T02:36:18.702 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:36:18.700+0000 7f1a73600640 1 -- 172.21.15.39:0/524307276 shutdown_connections 2024-09-12T02:36:18.702 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:36:18.700+0000 7f1a73600640 1 --2- 172.21.15.39:0/524307276 >> [v2:172.21.15.39:6800/1725006999,v1:172.21.15.39:6801/1725006999] conn(0x7f1a540a2c10 0x7f1a540a50d0 unknown :-1 s=CLOSED pgs=177 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:36:18.702 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:36:18.700+0000 7f1a73600640 1 --2- 172.21.15.39:0/524307276 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f1a6c109120 0x7f1a6c19eee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:36:18.702 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:36:18.700+0000 7f1a73600640 1 --2- 172.21.15.39:0/524307276 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f1a6c1049a0 0x7f1a6c19ab50 unknown :-1 s=CLOSED pgs=87 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:36:18.702 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:36:18.700+0000 7f1a73600640 1 --2- 172.21.15.39:0/524307276 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f1a6c103ff0 0x7f1a6c19a610 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:36:18.702 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:36:18.700+0000 7f1a73600640 1 -- 172.21.15.39:0/524307276 >> 172.21.15.39:0/524307276 conn(0x7f1a6c0ffa90 msgr2=0x7f1a6c1005b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:36:18.702 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:36:18.700+0000 7f1a73600640 1 -- 172.21.15.39:0/524307276 shutdown_connections 2024-09-12T02:36:18.702 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:36:18.701+0000 7f1a73600640 1 -- 172.21.15.39:0/524307276 wait complete. 2024-09-12T02:36:19.099 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 02:36:18 smithi039 ceph-mon[30515]: from='client.? 172.21.15.39:0/524307276' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-09-12T02:36:19.198 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 12 02:36:18 smithi044 ceph-mon[35411]: from='client.? 172.21.15.39:0/524307276' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-09-12T02:36:19.263 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 12 02:36:18 smithi172 ceph-mon[35609]: from='client.? 172.21.15.39:0/524307276' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-09-12T02:36:19.497 INFO:tasks.cephadm.ceph_manager.ceph:all up! 2024-09-12T02:36:19.497 DEBUG:teuthology.orchestra.run.smithi039:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc shell --fsid 4954ed46-70ae-11ef-bcea-c7b262605968 -- ceph osd dump --format=json 2024-09-12T02:36:19.878 INFO:teuthology.orchestra.run.smithi039.stderr:Inferring config /var/lib/ceph/4954ed46-70ae-11ef-bcea-c7b262605968/mon.a/config 2024-09-12T02:36:20.099 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 02:36:19 smithi039 ceph-mon[30515]: pgmap v340: 129 pgs: 129 active+clean; 645 KiB data, 347 MiB used, 1.0 TiB / 1.0 TiB avail; 7.4 KiB/s rd, 1.9 KiB/s wr, 13 op/s 2024-09-12T02:36:20.198 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 12 02:36:19 smithi044 ceph-mon[35411]: pgmap v340: 129 pgs: 129 active+clean; 645 KiB data, 347 MiB used, 1.0 TiB / 1.0 TiB avail; 7.4 KiB/s rd, 1.9 KiB/s wr, 13 op/s 2024-09-12T02:36:20.265 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 12 02:36:19 smithi172 ceph-mon[35609]: pgmap v340: 129 pgs: 129 active+clean; 645 KiB data, 347 MiB used, 1.0 TiB / 1.0 TiB avail; 7.4 KiB/s rd, 1.9 KiB/s wr, 13 op/s 2024-09-12T02:36:20.448 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:36:20.446+0000 7fde49400640 1 -- 172.21.15.39:0/2011470523 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fde44103ff0 msgr2=0x7fde441043d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:36:20.448 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:36:20.446+0000 7fde49400640 1 --2- 172.21.15.39:0/2011470523 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fde44103ff0 0x7fde441043d0 secure :-1 s=READY pgs=195 cs=0 l=1 rev1=1 crypto rx=0x7fde34009900 tx=0x7fde3402a400 comp rx=0 tx=0).stop 2024-09-12T02:36:20.448 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:36:20.447+0000 7fde49400640 1 -- 172.21.15.39:0/2011470523 shutdown_connections 2024-09-12T02:36:20.448 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:36:20.447+0000 7fde49400640 1 --2- 172.21.15.39:0/2011470523 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fde44109120 0x7fde44110ca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:36:20.448 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:36:20.447+0000 7fde49400640 1 --2- 172.21.15.39:0/2011470523 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fde441049a0 0x7fde441089f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:36:20.449 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:36:20.447+0000 7fde49400640 1 --2- 172.21.15.39:0/2011470523 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fde44103ff0 0x7fde441043d0 unknown :-1 s=CLOSED pgs=195 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:36:20.449 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:36:20.447+0000 7fde49400640 1 -- 172.21.15.39:0/2011470523 >> 172.21.15.39:0/2011470523 conn(0x7fde440ffa90 msgr2=0x7fde44101eb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:36:20.449 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:36:20.447+0000 7fde49400640 1 -- 172.21.15.39:0/2011470523 shutdown_connections 2024-09-12T02:36:20.449 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:36:20.447+0000 7fde49400640 1 -- 172.21.15.39:0/2011470523 wait complete. 2024-09-12T02:36:20.450 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:36:20.448+0000 7fde49400640 1 Processor -- start 2024-09-12T02:36:20.450 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:36:20.448+0000 7fde49400640 1 -- start start 2024-09-12T02:36:20.450 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:36:20.449+0000 7fde49400640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fde44103ff0 0x7fde4419a5b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:36:20.450 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:36:20.449+0000 7fde49400640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fde441049a0 0x7fde4419aaf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:36:20.450 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:36:20.449+0000 7fde49400640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fde44109120 0x7fde4419ee80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:36:20.450 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:36:20.449+0000 7fde49400640 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 -- 0x7fde44114170 con 0x7fde44103ff0 2024-09-12T02:36:20.450 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:36:20.449+0000 7fde49400640 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x7fde44113ff0 con 0x7fde441049a0 2024-09-12T02:36:20.450 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:36:20.449+0000 7fde49400640 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7fde441142f0 con 0x7fde44109120 2024-09-12T02:36:20.450 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:36:20.449+0000 7fde42800640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fde44103ff0 0x7fde4419a5b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:36:20.450 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:36:20.449+0000 7fde3be00640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fde441049a0 0x7fde4419aaf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:36:20.451 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:36:20.449+0000 7fde42800640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fde44103ff0 0x7fde4419a5b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.39:3300/0 says I am v2:172.21.15.39:34008/0 (socket says 172.21.15.39:34008) 2024-09-12T02:36:20.451 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:36:20.449+0000 7fde42800640 1 -- 172.21.15.39:0/2278853328 learned_addr learned my addr 172.21.15.39:0/2278853328 (peer_addr_for_me v2:172.21.15.39:0/0) 2024-09-12T02:36:20.451 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:36:20.449+0000 7fde43200640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fde44109120 0x7fde4419ee80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:36:20.451 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:36:20.449+0000 7fde3be00640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fde441049a0 0x7fde4419aaf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.39:38482/0 (socket says 172.21.15.39:38482) 2024-09-12T02:36:20.452 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:36:20.450+0000 7fde42800640 1 -- 172.21.15.39:0/2278853328 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fde44109120 msgr2=0x7fde4419ee80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:36:20.452 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:36:20.450+0000 7fde42800640 1 --2- 172.21.15.39:0/2278853328 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fde44109120 0x7fde4419ee80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:36:20.452 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:36:20.450+0000 7fde42800640 1 -- 172.21.15.39:0/2278853328 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fde441049a0 msgr2=0x7fde4419aaf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:36:20.452 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:36:20.450+0000 7fde42800640 1 --2- 172.21.15.39:0/2278853328 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fde441049a0 0x7fde4419aaf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:36:20.452 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:36:20.450+0000 7fde42800640 1 -- 172.21.15.39:0/2278853328 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fde4419f560 con 0x7fde44103ff0 2024-09-12T02:36:20.452 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:36:20.450+0000 7fde3be00640 1 --2- 172.21.15.39:0/2278853328 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fde441049a0 0x7fde4419aaf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-12T02:36:20.452 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:36:20.450+0000 7fde42800640 1 --2- 172.21.15.39:0/2278853328 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fde44103ff0 0x7fde4419a5b0 secure :-1 s=READY pgs=196 cs=0 l=1 rev1=1 crypto rx=0x7fde34004770 tx=0x7fde34003c10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:36:20.453 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:36:20.450+0000 7fde3b400640 1 -- 172.21.15.39:0/2278853328 <== mon.0 v2:172.21.15.39:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fde3403f070 con 0x7fde44103ff0 2024-09-12T02:36:20.453 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:36:20.450+0000 7fde3b400640 1 -- 172.21.15.39:0/2278853328 <== mon.0 v2:172.21.15.39:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fde34031ca0 con 0x7fde44103ff0 2024-09-12T02:36:20.453 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:36:20.450+0000 7fde3b400640 1 -- 172.21.15.39:0/2278853328 <== mon.0 v2:172.21.15.39:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fde34035030 con 0x7fde44103ff0 2024-09-12T02:36:20.453 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:36:20.450+0000 7fde49400640 1 -- 172.21.15.39:0/2278853328 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fde4419f7f0 con 0x7fde44103ff0 2024-09-12T02:36:20.453 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:36:20.451+0000 7fde49400640 1 -- 172.21.15.39:0/2278853328 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fde441a7130 con 0x7fde44103ff0 2024-09-12T02:36:20.453 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:36:20.452+0000 7fde49400640 1 -- 172.21.15.39:0/2278853328 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fde441054d0 con 0x7fde44103ff0 2024-09-12T02:36:20.454 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:36:20.454+0000 7fde3b400640 1 -- 172.21.15.39:0/2278853328 <== mon.0 v2:172.21.15.39:3300/0 4 ==== mgrmap(e 17) ==== 137884+0+0 (secure 0 0 0) 0x7fde34042070 con 0x7fde44103ff0 2024-09-12T02:36:20.456 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:36:20.455+0000 7fde3b400640 1 --2- 172.21.15.39:0/2278853328 >> [v2:172.21.15.39:6800/1725006999,v1:172.21.15.39:6801/1725006999] conn(0x7fde280a2c10 0x7fde280a50d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:36:20.456 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:36:20.455+0000 7fde3b400640 1 -- 172.21.15.39:0/2278853328 <== mon.0 v2:172.21.15.39:3300/0 5 ==== osd_map(93..93 src has 1..93) ==== 9092+0+0 (secure 0 0 0) 0x7fde340efd00 con 0x7fde44103ff0 2024-09-12T02:36:20.456 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:36:20.455+0000 7fde3be00640 1 --2- 172.21.15.39:0/2278853328 >> [v2:172.21.15.39:6800/1725006999,v1:172.21.15.39:6801/1725006999] conn(0x7fde280a2c10 0x7fde280a50d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:36:20.456 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:36:20.456+0000 7fde3be00640 1 --2- 172.21.15.39:0/2278853328 >> [v2:172.21.15.39:6800/1725006999,v1:172.21.15.39:6801/1725006999] conn(0x7fde280a2c10 0x7fde280a50d0 secure :-1 s=READY pgs=178 cs=0 l=1 rev1=1 crypto rx=0x7fde44100f50 tx=0x7fde2c00b410 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:36:20.460 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:36:20.459+0000 7fde3b400640 1 -- 172.21.15.39:0/2278853328 <== mon.0 v2:172.21.15.39:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7fde340bc0f0 con 0x7fde44103ff0 2024-09-12T02:36:20.647 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:36:20.646+0000 7fde49400640 1 -- 172.21.15.39:0/2278853328 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7fde441a7300 con 0x7fde44103ff0 2024-09-12T02:36:20.648 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:36:20.647+0000 7fde3b400640 1 -- 172.21.15.39:0/2278853328 <== mon.0 v2:172.21.15.39:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v93) ==== 74+0+24705 (secure 0 0 0) 0x7fde340c03f0 con 0x7fde44103ff0 2024-09-12T02:36:20.649 INFO:teuthology.orchestra.run.smithi039.stdout: 2024-09-12T02:36:20.649 INFO:teuthology.orchestra.run.smithi039.stdout:{"epoch":93,"fsid":"4954ed46-70ae-11ef-bcea-c7b262605968","created":"2024-09-12T02:26:43.086467+0000","modified":"2024-09-12T02:35:46.720985+0000","last_up_change":"2024-09-12T02:34:08.626341+0000","last_in_change":"2024-09-12T02:33:45.553591+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":27,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":12,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-12T02:30:09.347905+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":12,"score_stable":12,"optimal_score":0.25,"raw_score_acting":3,"raw_score_stable":3,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-09-12T02:34:58.580872+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"84","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.8799999952316284,"score_stable":1.8799999952316284,"optimal_score":1,"raw_score_acting":1.8799999952316284,"raw_score_stable":1.8799999952316284,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-09-12T02:35:01.469805+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"84","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2024-09-12T02:35:11.088109+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"91","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"c967b48e-8a39-4797-871b-8b1b83d9472f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":87,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6802","nonce":2437586899},{"type":"v1","addr":"172.21.15.39:6803","nonce":2437586899}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6804","nonce":2437586899},{"type":"v1","addr":"172.21.15.39:6805","nonce":2437586899}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6808","nonce":2437586899},{"type":"v1","addr":"172.21.15.39:6809","nonce":2437586899}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6806","nonce":2437586899},{"type":"v1","addr":"172.21.15.39:6807","nonce":2437586899}]},"public_addr":"172.21.15.39:6803/2437586899","cluster_addr":"172.21.15.39:6805/2437586899","heartbeat_back_addr":"172.21.15.39:6809/2437586899","heartbeat_front_addr":"172.21.15.39:6807/2437586899","state":["exists","up"]},{"osd":1,"uuid":"30e1e4f4-1d50-4003-8978-cb183dca7fbb","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":87,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6800","nonce":2349287000},{"type":"v1","addr":"172.21.15.44:6801","nonce":2349287000}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6802","nonce":2349287000},{"type":"v1","addr":"172.21.15.44:6803","nonce":2349287000}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6806","nonce":2349287000},{"type":"v1","addr":"172.21.15.44:6807","nonce":2349287000}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6804","nonce":2349287000},{"type":"v1","addr":"172.21.15.44:6805","nonce":2349287000}]},"public_addr":"172.21.15.44:6801/2349287000","cluster_addr":"172.21.15.44:6803/2349287000","heartbeat_back_addr":"172.21.15.44:6807/2349287000","heartbeat_front_addr":"172.21.15.44:6805/2349287000","state":["exists","up"]},{"osd":2,"uuid":"a758803f-8668-4fc8-9417-b8d080cd9a7c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":18,"up_thru":87,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6800","nonce":1176898232},{"type":"v1","addr":"172.21.15.172:6801","nonce":1176898232}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6802","nonce":1176898232},{"type":"v1","addr":"172.21.15.172:6803","nonce":1176898232}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6806","nonce":1176898232},{"type":"v1","addr":"172.21.15.172:6807","nonce":1176898232}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6804","nonce":1176898232},{"type":"v1","addr":"172.21.15.172:6805","nonce":1176898232}]},"public_addr":"172.21.15.172:6801/1176898232","cluster_addr":"172.21.15.172:6803/1176898232","heartbeat_back_addr":"172.21.15.172:6807/1176898232","heartbeat_front_addr":"172.21.15.172:6805/1176898232","state":["exists","up"]},{"osd":3,"uuid":"8b256567-7efe-429c-bc4c-80e93228f139","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":26,"up_thru":87,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6810","nonce":2013565859},{"type":"v1","addr":"172.21.15.39:6811","nonce":2013565859}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6812","nonce":2013565859},{"type":"v1","addr":"172.21.15.39:6813","nonce":2013565859}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6816","nonce":2013565859},{"type":"v1","addr":"172.21.15.39:6817","nonce":2013565859}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6814","nonce":2013565859},{"type":"v1","addr":"172.21.15.39:6815","nonce":2013565859}]},"public_addr":"172.21.15.39:6811/2013565859","cluster_addr":"172.21.15.39:6813/2013565859","heartbeat_back_addr":"172.21.15.39:6817/2013565859","heartbeat_front_addr":"172.21.15.39:6815/2013565859","state":["exists","up"]},{"osd":4,"uuid":"e86b6756-e2b3-49fe-9b87-1a2b015bb17a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":33,"up_thru":87,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6808","nonce":3663639110},{"type":"v1","addr":"172.21.15.44:6809","nonce":3663639110}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6810","nonce":3663639110},{"type":"v1","addr":"172.21.15.44:6811","nonce":3663639110}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6814","nonce":3663639110},{"type":"v1","addr":"172.21.15.44:6815","nonce":3663639110}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6812","nonce":3663639110},{"type":"v1","addr":"172.21.15.44:6813","nonce":3663639110}]},"public_addr":"172.21.15.44:6809/3663639110","cluster_addr":"172.21.15.44:6811/3663639110","heartbeat_back_addr":"172.21.15.44:6815/3663639110","heartbeat_front_addr":"172.21.15.44:6813/3663639110","state":["exists","up"]},{"osd":5,"uuid":"9c907c92-b323-48e7-99ad-ec9756d26312","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":38,"up_thru":92,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6808","nonce":998885347},{"type":"v1","addr":"172.21.15.172:6809","nonce":998885347}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6810","nonce":998885347},{"type":"v1","addr":"172.21.15.172:6811","nonce":998885347}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6814","nonce":998885347},{"type":"v1","addr":"172.21.15.172:6815","nonce":998885347}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6812","nonce":998885347},{"type":"v1","addr":"172.21.15.172:6813","nonce":998885347}]},"public_addr":"172.21.15.172:6809/998885347","cluster_addr":"172.21.15.172:6811/998885347","heartbeat_back_addr":"172.21.15.172:6815/998885347","heartbeat_front_addr":"172.21.15.172:6813/998885347","state":["exists","up"]},{"osd":6,"uuid":"1fcb9bb2-6f4b-4d97-a401-aeb6a9706613","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":45,"up_thru":92,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6818","nonce":2569059542},{"type":"v1","addr":"172.21.15.39:6819","nonce":2569059542}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6820","nonce":2569059542},{"type":"v1","addr":"172.21.15.39:6821","nonce":2569059542}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6824","nonce":2569059542},{"type":"v1","addr":"172.21.15.39:6825","nonce":2569059542}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6822","nonce":2569059542},{"type":"v1","addr":"172.21.15.39:6823","nonce":2569059542}]},"public_addr":"172.21.15.39:6819/2569059542","cluster_addr":"172.21.15.39:6821/2569059542","heartbeat_back_addr":"172.21.15.39:6825/2569059542","heartbeat_front_addr":"172.21.15.39:6823/2569059542","state":["exists","up"]},{"osd":7,"uuid":"59e0caf9-8ce5-4161-8875-84862eba743e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":50,"up_thru":87,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6816","nonce":709635079},{"type":"v1","addr":"172.21.15.44:6817","nonce":709635079}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6818","nonce":709635079},{"type":"v1","addr":"172.21.15.44:6819","nonce":709635079}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6822","nonce":709635079},{"type":"v1","addr":"172.21.15.44:6823","nonce":709635079}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6820","nonce":709635079},{"type":"v1","addr":"172.21.15.44:6821","nonce":709635079}]},"public_addr":"172.21.15.44:6817/709635079","cluster_addr":"172.21.15.44:6819/709635079","heartbeat_back_addr":"172.21.15.44:6823/709635079","heartbeat_front_addr":"172.21.15.44:6821/709635079","state":["exists","up"]},{"osd":8,"uuid":"2f6fb5c7-86cc-43eb-bdfb-45a69316937e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":57,"up_thru":92,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6816","nonce":1162792895},{"type":"v1","addr":"172.21.15.172:6817","nonce":1162792895}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6818","nonce":1162792895},{"type":"v1","addr":"172.21.15.172:6819","nonce":1162792895}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6822","nonce":1162792895},{"type":"v1","addr":"172.21.15.172:6823","nonce":1162792895}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6820","nonce":1162792895},{"type":"v1","addr":"172.21.15.172:6821","nonce":1162792895}]},"public_addr":"172.21.15.172:6817/1162792895","cluster_addr":"172.21.15.172:6819/1162792895","heartbeat_back_addr":"172.21.15.172:6823/1162792895","heartbeat_front_addr":"172.21.15.172:6821/1162792895","state":["exists","up"]},{"osd":9,"uuid":"87e5dd9e-8191-4db6-83fa-cfff7c31e17e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":65,"up_thru":92,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6826","nonce":945860346},{"type":"v1","addr":"172.21.15.39:6827","nonce":945860346}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6828","nonce":945860346},{"type":"v1","addr":"172.21.15.39:6829","nonce":945860346}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6832","nonce":945860346},{"type":"v1","addr":"172.21.15.39:6833","nonce":945860346}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6830","nonce":945860346},{"type":"v1","addr":"172.21.15.39:6831","nonce":945860346}]},"public_addr":"172.21.15.39:6827/945860346","cluster_addr":"172.21.15.39:6829/945860346","heartbeat_back_addr":"172.21.15.39:6833/945860346","heartbeat_front_addr":"172.21.15.39:6831/945860346","state":["exists","up"]},{"osd":10,"uuid":"b55d8a00-850f-4910-a5bf-97d9ed545be7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":70,"up_thru":81,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6824","nonce":3899352344},{"type":"v1","addr":"172.21.15.44:6825","nonce":3899352344}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6826","nonce":3899352344},{"type":"v1","addr":"172.21.15.44:6827","nonce":3899352344}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6830","nonce":3899352344},{"type":"v1","addr":"172.21.15.44:6831","nonce":3899352344}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6828","nonce":3899352344},{"type":"v1","addr":"172.21.15.44:6829","nonce":3899352344}]},"public_addr":"172.21.15.44:6825/3899352344","cluster_addr":"172.21.15.44:6827/3899352344","heartbeat_back_addr":"172.21.15.44:6831/3899352344","heartbeat_front_addr":"172.21.15.44:6829/3899352344","state":["exists","up"]},{"osd":11,"uuid":"20cf5df1-5a80-4272-acc0-919c6a1da55a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":77,"up_thru":92,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6824","nonce":3627635035},{"type":"v1","addr":"172.21.15.172:6825","nonce":3627635035}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6826","nonce":3627635035},{"type":"v1","addr":"172.21.15.172:6827","nonce":3627635035}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6830","nonce":3627635035},{"type":"v1","addr":"172.21.15.172:6831","nonce":3627635035}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6828","nonce":3627635035},{"type":"v1","addr":"172.21.15.172:6829","nonce":3627635035}]},"public_addr":"172.21.15.172:6825/3627635035","cluster_addr":"172.21.15.172:6827/3627635035","heartbeat_back_addr":"172.21.15.172:6831/3627635035","heartbeat_front_addr":"172.21.15.172:6829/3627635035","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T02:29:15.367468+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T02:29:41.518207+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T02:30:06.004371+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T02:30:34.793371+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T02:31:00.878517+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T02:31:26.675956+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T02:31:55.950748+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T02:32:22.824017+0000","dead_epoch":0},{"osd":8,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T02:32:46.775880+0000","dead_epoch":0},{"osd":9,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T02:33:16.420347+0000","dead_epoch":0},{"osd":10,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T02:33:42.185837+0000","dead_epoch":0},{"osd":11,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T02:34:07.312555+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"2.0","mappings":[{"from":7,"to":11}]},{"pgid":"2.b","mappings":[{"from":2,"to":1}]},{"pgid":"2.10","mappings":[{"from":8,"to":11}]},{"pgid":"2.1b","mappings":[{"from":2,"to":4}]},{"pgid":"3.11","mappings":[{"from":4,"to":8}]},{"pgid":"3.24","mappings":[{"from":4,"to":9}]},{"pgid":"3.33","mappings":[{"from":5,"to":9}]},{"pgid":"3.34","mappings":[{"from":4,"to":9}]},{"pgid":"4.2","mappings":[{"from":9,"to":1}]},{"pgid":"4.6","mappings":[{"from":9,"to":11}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.39:6800/3152613618":"2024-09-13T02:27:44.717224+0000","172.21.15.39:0/2301206766":"2024-09-13T02:27:44.717224+0000","172.21.15.39:0/1941318538":"2024-09-13T02:27:44.717224+0000","172.21.15.39:0/1527429435":"2024-09-13T02:27:44.717224+0000","172.21.15.39:0/2913347539":"2024-09-13T02:27:16.531986+0000","172.21.15.39:0/2827440002":"2024-09-13T02:27:16.531986+0000","172.21.15.39:0/4075322467":"2024-09-13T02:27:16.531986+0000","172.21.15.39:6801/1074685700":"2024-09-13T02:27:16.531986+0000","172.21.15.39:6801/3152613618":"2024-09-13T02:27:44.717224+0000","172.21.15.39:6800/1074685700":"2024-09-13T02:27:16.531986+0000"},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-12T02:36:20.651 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:36:20.650+0000 7fde49400640 1 -- 172.21.15.39:0/2278853328 >> [v2:172.21.15.39:6800/1725006999,v1:172.21.15.39:6801/1725006999] conn(0x7fde280a2c10 msgr2=0x7fde280a50d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:36:20.651 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:36:20.650+0000 7fde49400640 1 --2- 172.21.15.39:0/2278853328 >> [v2:172.21.15.39:6800/1725006999,v1:172.21.15.39:6801/1725006999] conn(0x7fde280a2c10 0x7fde280a50d0 secure :-1 s=READY pgs=178 cs=0 l=1 rev1=1 crypto rx=0x7fde44100f50 tx=0x7fde2c00b410 comp rx=0 tx=0).stop 2024-09-12T02:36:20.651 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:36:20.650+0000 7fde49400640 1 -- 172.21.15.39:0/2278853328 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fde44103ff0 msgr2=0x7fde4419a5b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:36:20.651 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:36:20.650+0000 7fde49400640 1 --2- 172.21.15.39:0/2278853328 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fde44103ff0 0x7fde4419a5b0 secure :-1 s=READY pgs=196 cs=0 l=1 rev1=1 crypto rx=0x7fde34004770 tx=0x7fde34003c10 comp rx=0 tx=0).stop 2024-09-12T02:36:20.651 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:36:20.650+0000 7fde49400640 1 -- 172.21.15.39:0/2278853328 shutdown_connections 2024-09-12T02:36:20.651 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:36:20.650+0000 7fde49400640 1 --2- 172.21.15.39:0/2278853328 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fde44109120 0x7fde4419ee80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:36:20.651 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:36:20.650+0000 7fde49400640 1 --2- 172.21.15.39:0/2278853328 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fde441049a0 0x7fde4419aaf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:36:20.651 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:36:20.650+0000 7fde49400640 1 --2- 172.21.15.39:0/2278853328 >> [v2:172.21.15.39:6800/1725006999,v1:172.21.15.39:6801/1725006999] conn(0x7fde280a2c10 0x7fde280a50d0 unknown :-1 s=CLOSED pgs=178 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:36:20.651 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:36:20.650+0000 7fde49400640 1 --2- 172.21.15.39:0/2278853328 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fde44103ff0 0x7fde4419a5b0 unknown :-1 s=CLOSED pgs=196 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:36:20.652 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:36:20.650+0000 7fde49400640 1 -- 172.21.15.39:0/2278853328 >> 172.21.15.39:0/2278853328 conn(0x7fde440ffa90 msgr2=0x7fde440fffb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:36:20.652 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:36:20.650+0000 7fde49400640 1 -- 172.21.15.39:0/2278853328 shutdown_connections 2024-09-12T02:36:20.652 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:36:20.650+0000 7fde49400640 1 -- 172.21.15.39:0/2278853328 wait complete. 2024-09-12T02:36:21.099 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 02:36:20 smithi039 ceph-mon[30515]: from='client.? 172.21.15.39:0/2278853328' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-09-12T02:36:21.198 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 12 02:36:20 smithi044 ceph-mon[35411]: from='client.? 172.21.15.39:0/2278853328' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-09-12T02:36:21.263 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 12 02:36:20 smithi172 ceph-mon[35609]: from='client.? 172.21.15.39:0/2278853328' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-09-12T02:36:21.467 DEBUG:teuthology.orchestra.run.smithi039:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc shell --fsid 4954ed46-70ae-11ef-bcea-c7b262605968 -- ceph tell osd.0 flush_pg_stats 2024-09-12T02:36:21.467 DEBUG:teuthology.orchestra.run.smithi039:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc shell --fsid 4954ed46-70ae-11ef-bcea-c7b262605968 -- ceph tell osd.1 flush_pg_stats 2024-09-12T02:36:21.468 DEBUG:teuthology.orchestra.run.smithi039:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc shell --fsid 4954ed46-70ae-11ef-bcea-c7b262605968 -- ceph tell osd.2 flush_pg_stats 2024-09-12T02:36:21.468 DEBUG:teuthology.orchestra.run.smithi039:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc shell --fsid 4954ed46-70ae-11ef-bcea-c7b262605968 -- ceph tell osd.3 flush_pg_stats 2024-09-12T02:36:21.469 DEBUG:teuthology.orchestra.run.smithi039:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc shell --fsid 4954ed46-70ae-11ef-bcea-c7b262605968 -- ceph tell osd.4 flush_pg_stats 2024-09-12T02:36:21.469 DEBUG:teuthology.orchestra.run.smithi039:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc shell --fsid 4954ed46-70ae-11ef-bcea-c7b262605968 -- ceph tell osd.5 flush_pg_stats 2024-09-12T02:36:21.469 DEBUG:teuthology.orchestra.run.smithi039:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc shell --fsid 4954ed46-70ae-11ef-bcea-c7b262605968 -- ceph tell osd.6 flush_pg_stats 2024-09-12T02:36:21.470 DEBUG:teuthology.orchestra.run.smithi039:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc shell --fsid 4954ed46-70ae-11ef-bcea-c7b262605968 -- ceph tell osd.7 flush_pg_stats 2024-09-12T02:36:21.470 DEBUG:teuthology.orchestra.run.smithi039:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc shell --fsid 4954ed46-70ae-11ef-bcea-c7b262605968 -- ceph tell osd.8 flush_pg_stats 2024-09-12T02:36:21.471 DEBUG:teuthology.orchestra.run.smithi039:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc shell --fsid 4954ed46-70ae-11ef-bcea-c7b262605968 -- ceph tell osd.9 flush_pg_stats 2024-09-12T02:36:21.471 DEBUG:teuthology.orchestra.run.smithi039:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc shell --fsid 4954ed46-70ae-11ef-bcea-c7b262605968 -- ceph tell osd.10 flush_pg_stats 2024-09-12T02:36:21.471 DEBUG:teuthology.orchestra.run.smithi039:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc shell --fsid 4954ed46-70ae-11ef-bcea-c7b262605968 -- ceph tell osd.11 flush_pg_stats 2024-09-12T02:36:22.099 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 02:36:21 smithi039 ceph-mon[30515]: pgmap v341: 129 pgs: 129 active+clean; 645 KiB data, 347 MiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 767 B/s wr, 10 op/s 2024-09-12T02:36:22.198 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 12 02:36:21 smithi044 ceph-mon[35411]: pgmap v341: 129 pgs: 129 active+clean; 645 KiB data, 347 MiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 767 B/s wr, 10 op/s 2024-09-12T02:36:22.263 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 12 02:36:21 smithi172 ceph-mon[35609]: pgmap v341: 129 pgs: 129 active+clean; 645 KiB data, 347 MiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 767 B/s wr, 10 op/s 2024-09-12T02:36:22.400 INFO:teuthology.orchestra.run.smithi039.stderr:Inferring config /var/lib/ceph/4954ed46-70ae-11ef-bcea-c7b262605968/mon.a/config 2024-09-12T02:36:22.501 INFO:teuthology.orchestra.run.smithi039.stderr:Inferring config /var/lib/ceph/4954ed46-70ae-11ef-bcea-c7b262605968/mon.a/config 2024-09-12T02:36:22.523 INFO:teuthology.orchestra.run.smithi039.stderr:Inferring config /var/lib/ceph/4954ed46-70ae-11ef-bcea-c7b262605968/mon.a/config 2024-09-12T02:36:22.524 INFO:teuthology.orchestra.run.smithi039.stderr:Inferring config /var/lib/ceph/4954ed46-70ae-11ef-bcea-c7b262605968/mon.a/config 2024-09-12T02:36:22.525 INFO:teuthology.orchestra.run.smithi039.stderr:Inferring config /var/lib/ceph/4954ed46-70ae-11ef-bcea-c7b262605968/mon.a/config 2024-09-12T02:36:22.526 INFO:teuthology.orchestra.run.smithi039.stderr:Inferring config /var/lib/ceph/4954ed46-70ae-11ef-bcea-c7b262605968/mon.a/config 2024-09-12T02:36:23.600 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:36:23.599+0000 7f4967400640 1 -- 172.21.15.39:0/3840396353 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f4960103ff0 msgr2=0x7f49601043d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:36:23.601 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:36:23.599+0000 7f4967400640 1 --2- 172.21.15.39:0/3840396353 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f4960103ff0 0x7f49601043d0 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7f4954009900 tx=0x7f495402a3f0 comp rx=0 tx=0).stop 2024-09-12T02:36:23.601 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:36:23.599+0000 7f4967400640 1 -- 172.21.15.39:0/3840396353 shutdown_connections 2024-09-12T02:36:23.601 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:36:23.599+0000 7f4967400640 1 --2- 172.21.15.39:0/3840396353 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f4960109120 0x7f4960110ca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:36:23.601 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:36:23.599+0000 7f4967400640 1 --2- 172.21.15.39:0/3840396353 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f49601049a0 0x7f49601089f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:36:23.601 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:36:23.599+0000 7f4967400640 1 --2- 172.21.15.39:0/3840396353 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f4960103ff0 0x7f49601043d0 unknown :-1 s=CLOSED pgs=86 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:36:23.601 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:36:23.599+0000 7f4967400640 1 -- 172.21.15.39:0/3840396353 >> 172.21.15.39:0/3840396353 conn(0x7f49600ffa90 msgr2=0x7f4960101eb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:36:23.601 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:36:23.599+0000 7f4967400640 1 -- 172.21.15.39:0/3840396353 shutdown_connections 2024-09-12T02:36:23.601 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:36:23.599+0000 7f4967400640 1 -- 172.21.15.39:0/3840396353 wait complete. 2024-09-12T02:36:23.603 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:36:23.600+0000 7f4967400640 1 Processor -- start 2024-09-12T02:36:23.603 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:36:23.600+0000 7f4967400640 1 -- start start 2024-09-12T02:36:23.603 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:36:23.601+0000 7f4967400640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f4960103ff0 0x7f496019a620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:36:23.603 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:36:23.601+0000 7f4967400640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f49601049a0 0x7f496019ab60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:36:23.603 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:36:23.601+0000 7f4967400640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f4960109120 0x7f496019eef0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:36:23.603 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:36:23.601+0000 7f4967400640 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 -- 0x7f49601141a0 con 0x7f4960103ff0 2024-09-12T02:36:23.603 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:36:23.601+0000 7f4967400640 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x7f4960114020 con 0x7f4960109120 2024-09-12T02:36:23.603 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:36:23.601+0000 7f4967400640 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7f4960114320 con 0x7f49601049a0 2024-09-12T02:36:23.603 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:36:23.601+0000 7f4964a00640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f4960103ff0 0x7f496019a620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:36:23.604 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:36:23.601+0000 7f4964a00640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f4960103ff0 0x7f496019a620 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.39:3300/0 says I am v2:172.21.15.39:34032/0 (socket says 172.21.15.39:34032) 2024-09-12T02:36:23.604 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:36:23.601+0000 7f4964a00640 1 -- 172.21.15.39:0/330680094 learned_addr learned my addr 172.21.15.39:0/330680094 (peer_addr_for_me v2:172.21.15.39:0/0) 2024-09-12T02:36:23.604 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:36:23.601+0000 7f4965400640 1 --2- 172.21.15.39:0/330680094 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f4960109120 0x7f496019eef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:36:23.604 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:36:23.601+0000 7f495fe00640 1 --2- 172.21.15.39:0/330680094 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f49601049a0 0x7f496019ab60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:36:23.604 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:36:23.601+0000 7f4965400640 1 -- 172.21.15.39:0/330680094 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f49601049a0 msgr2=0x7f496019ab60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:36:23.604 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:36:23.601+0000 7f4965400640 1 --2- 172.21.15.39:0/330680094 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f49601049a0 0x7f496019ab60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:36:23.604 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:36:23.602+0000 7f4965400640 1 -- 172.21.15.39:0/330680094 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f4960103ff0 msgr2=0x7f496019a620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:36:23.604 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:36:23.602+0000 7f4965400640 1 --2- 172.21.15.39:0/330680094 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f4960103ff0 0x7f496019a620 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:36:23.604 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:36:23.602+0000 7f4965400640 1 -- 172.21.15.39:0/330680094 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f496019f5d0 con 0x7f4960109120 2024-09-12T02:36:23.604 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:36:23.602+0000 7f4964a00640 1 --2- 172.21.15.39:0/330680094 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f4960103ff0 0x7f496019a620 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-12T02:36:23.604 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:36:23.602+0000 7f4965400640 1 --2- 172.21.15.39:0/330680094 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f4960109120 0x7f496019eef0 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7f4958009fd0 tx=0x7f495800ef10 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:36:23.604 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:36:23.602+0000 7f495d600640 1 -- 172.21.15.39:0/330680094 <== mon.2 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f495800ce20 con 0x7f4960109120 2024-09-12T02:36:23.604 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:36:23.602+0000 7f4967400640 1 -- 172.21.15.39:0/330680094 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f496019f8c0 con 0x7f4960109120 2024-09-12T02:36:23.605 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:36:23.602+0000 7f495d600640 1 -- 172.21.15.39:0/330680094 <== mon.2 v2:172.21.15.44:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f4958005020 con 0x7f4960109120 2024-09-12T02:36:23.605 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:36:23.602+0000 7f495d600640 1 -- 172.21.15.39:0/330680094 <== mon.2 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4958010720 con 0x7f4960109120 2024-09-12T02:36:23.605 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:36:23.602+0000 7f4967400640 1 -- 172.21.15.39:0/330680094 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f49601a71a0 con 0x7f4960109120 2024-09-12T02:36:23.605 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:36:23.603+0000 7f4967400640 1 -- 172.21.15.39:0/330680094 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7f4960062940 con 0x7f4960109120 2024-09-12T02:36:23.606 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:36:23.606+0000 7f495d600640 1 -- 172.21.15.39:0/330680094 <== mon.2 v2:172.21.15.44:3300/0 4 ==== mgrmap(e 17) ==== 137884+0+0 (secure 0 0 0) 0x7f4958005540 con 0x7f4960109120 2024-09-12T02:36:23.608 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:36:23.607+0000 7f495d600640 1 --2- 172.21.15.39:0/330680094 >> [v2:172.21.15.39:6800/1725006999,v1:172.21.15.39:6801/1725006999] conn(0x7f49480a2c10 0x7f49480a50d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:36:23.608 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:36:23.607+0000 7f495d600640 1 -- 172.21.15.39:0/330680094 <== mon.2 v2:172.21.15.44:3300/0 5 ==== osd_map(93..93 src has 1..93) ==== 9092+0+0 (secure 0 0 0) 0x7f49580cfdd0 con 0x7f4960109120 2024-09-12T02:36:23.608 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:36:23.607+0000 7f4964a00640 1 --2- 172.21.15.39:0/330680094 >> [v2:172.21.15.39:6800/1725006999,v1:172.21.15.39:6801/1725006999] conn(0x7f49480a2c10 0x7f49480a50d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:36:23.608 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:36:23.607+0000 7f495d600640 1 --2- 172.21.15.39:0/330680094 >> [v2:172.21.15.39:6802/2437586899,v1:172.21.15.39:6803/2437586899] conn(0x7f49480adde0 0x7f49480b0280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:36:23.608 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:36:23.607+0000 7f495d600640 1 -- 172.21.15.39:0/330680094 --> [v2:172.21.15.39:6802/2437586899,v1:172.21.15.39:6803/2437586899] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f495801ee50 con 0x7f49480adde0 2024-09-12T02:36:23.608 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:36:23.607+0000 7f495d600640 1 -- 172.21.15.39:0/330680094 <== mon.2 v2:172.21.15.44:3300/0 6 ==== mon_get_version_reply(handle=1 version=93) ==== 24+0+0 (secure 0 0 0) 0x7f49580d0180 con 0x7f4960109120 2024-09-12T02:36:23.609 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:36:23.608+0000 7f495fe00640 1 --2- 172.21.15.39:0/330680094 >> [v2:172.21.15.39:6802/2437586899,v1:172.21.15.39:6803/2437586899] conn(0x7f49480adde0 0x7f49480b0280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:36:23.609 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:36:23.608+0000 7f4964a00640 1 --2- 172.21.15.39:0/330680094 >> [v2:172.21.15.39:6800/1725006999,v1:172.21.15.39:6801/1725006999] conn(0x7f49480a2c10 0x7f49480a50d0 secure :-1 s=READY pgs=179 cs=0 l=1 rev1=1 crypto rx=0x7f49540096c0 tx=0x7f49540046c0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:36:23.609 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:36:23.608+0000 7f495fe00640 1 --2- 172.21.15.39:0/330680094 >> [v2:172.21.15.39:6802/2437586899,v1:172.21.15.39:6803/2437586899] conn(0x7f49480adde0 0x7f49480b0280 crc :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:36:23.610 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:36:23.609+0000 7f495d600640 1 -- 172.21.15.39:0/330680094 <== osd.0 v2:172.21.15.39:6802/2437586899 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7f495801ee50 con 0x7f49480adde0 2024-09-12T02:36:23.625 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:36:23.624+0000 7f4967400640 1 -- 172.21.15.39:0/330680094 --> [v2:172.21.15.39:6802/2437586899,v1:172.21.15.39:6803/2437586899] -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7f4960062d70 con 0x7f49480adde0 2024-09-12T02:36:23.625 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:36:23.624+0000 7f495d600640 1 -- 172.21.15.39:0/330680094 <== osd.0 v2:172.21.15.39:6802/2437586899 2 ==== command_reply(tid 2: 0 ) ==== 8+0+11 (crc 0 0 0) 0x7f4960062d70 con 0x7f49480adde0 2024-09-12T02:36:23.626 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:36:23.624+0000 7f4967400640 1 -- 172.21.15.39:0/330680094 >> [v2:172.21.15.39:6802/2437586899,v1:172.21.15.39:6803/2437586899] conn(0x7f49480adde0 msgr2=0x7f49480b0280 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:36:23.626 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:36:23.624+0000 7f4967400640 1 --2- 172.21.15.39:0/330680094 >> [v2:172.21.15.39:6802/2437586899,v1:172.21.15.39:6803/2437586899] conn(0x7f49480adde0 0x7f49480b0280 crc :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:36:23.626 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:36:23.625+0000 7f4967400640 1 -- 172.21.15.39:0/330680094 >> [v2:172.21.15.39:6800/1725006999,v1:172.21.15.39:6801/1725006999] conn(0x7f49480a2c10 msgr2=0x7f49480a50d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:36:23.626 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:36:23.625+0000 7f4967400640 1 --2- 172.21.15.39:0/330680094 >> [v2:172.21.15.39:6800/1725006999,v1:172.21.15.39:6801/1725006999] conn(0x7f49480a2c10 0x7f49480a50d0 secure :-1 s=READY pgs=179 cs=0 l=1 rev1=1 crypto rx=0x7f49540096c0 tx=0x7f49540046c0 comp rx=0 tx=0).stop 2024-09-12T02:36:23.626 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:36:23.625+0000 7f4967400640 1 -- 172.21.15.39:0/330680094 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f4960109120 msgr2=0x7f496019eef0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:36:23.626 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:36:23.625+0000 7f4967400640 1 --2- 172.21.15.39:0/330680094 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f4960109120 0x7f496019eef0 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7f4958009fd0 tx=0x7f495800ef10 comp rx=0 tx=0).stop 2024-09-12T02:36:23.626 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:36:23.625+0000 7f4965400640 1 -- 172.21.15.39:0/330680094 reap_dead start 2024-09-12T02:36:23.626 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:36:23.625+0000 7f4967400640 1 -- 172.21.15.39:0/330680094 shutdown_connections 2024-09-12T02:36:23.626 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:36:23.625+0000 7f4967400640 1 -- 172.21.15.39:0/330680094 >> 172.21.15.39:0/330680094 conn(0x7f49600ffa90 msgr2=0x7f4960100d20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:36:23.627 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:36:23.625+0000 7f4967400640 1 -- 172.21.15.39:0/330680094 shutdown_connections 2024-09-12T02:36:23.627 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:36:23.625+0000 7f4967400640 1 -- 172.21.15.39:0/330680094 wait complete. 2024-09-12T02:36:24.090 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 02:36:23 smithi039 ceph-mon[30515]: pgmap v342: 129 pgs: 129 active+clean; 645 KiB data, 347 MiB used, 1.0 TiB / 1.0 TiB avail; 4.7 KiB/s rd, 682 B/s wr, 8 op/s 2024-09-12T02:36:24.198 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 12 02:36:23 smithi044 ceph-mon[35411]: pgmap v342: 129 pgs: 129 active+clean; 645 KiB data, 347 MiB used, 1.0 TiB / 1.0 TiB avail; 4.7 KiB/s rd, 682 B/s wr, 8 op/s 2024-09-12T02:36:24.233 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:36:23.969+0000 7f74d9e00640 1 -- 172.21.15.39:0/2334968263 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f74d4104010 msgr2=0x7f74d41043f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:36:24.233 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:36:23.969+0000 7f74d9e00640 1 --2- 172.21.15.39:0/2334968263 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f74d4104010 0x7f74d41043f0 secure :-1 s=READY pgs=197 cs=0 l=1 rev1=1 crypto rx=0x7f74c4009900 tx=0x7f74c402a400 comp rx=0 tx=0).stop 2024-09-12T02:36:24.233 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:36:23.969+0000 7f74d9e00640 1 -- 172.21.15.39:0/2334968263 shutdown_connections 2024-09-12T02:36:24.233 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:36:23.969+0000 7f74d9e00640 1 --2- 172.21.15.39:0/2334968263 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f74d4109140 0x7f74d4110cc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:36:24.233 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:36:23.969+0000 7f74d9e00640 1 --2- 172.21.15.39:0/2334968263 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f74d41049c0 0x7f74d4108a10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:36:24.233 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:36:23.969+0000 7f74d9e00640 1 --2- 172.21.15.39:0/2334968263 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f74d4104010 0x7f74d41043f0 unknown :-1 s=CLOSED pgs=197 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:36:24.234 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:36:23.969+0000 7f74d9e00640 1 -- 172.21.15.39:0/2334968263 >> 172.21.15.39:0/2334968263 conn(0x7f74d40ffa50 msgr2=0x7f74d4101e70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:36:24.234 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:36:23.969+0000 7f74d9e00640 1 -- 172.21.15.39:0/2334968263 shutdown_connections 2024-09-12T02:36:24.234 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:36:23.969+0000 7f74d9e00640 1 -- 172.21.15.39:0/2334968263 wait complete. 2024-09-12T02:36:24.234 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:36:23.970+0000 7f74d9e00640 1 Processor -- start 2024-09-12T02:36:24.234 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:36:23.971+0000 7f74d9e00640 1 -- start start 2024-09-12T02:36:24.234 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:36:23.971+0000 7f74d9e00640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f74d4104010 0x7f74d419a600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:36:24.234 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:36:23.971+0000 7f74d9e00640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f74d41049c0 0x7f74d419ab40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:36:24.234 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:36:23.971+0000 7f74d9e00640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f74d4109140 0x7f74d419eed0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:36:24.234 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:36:23.971+0000 7f74d9e00640 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 -- 0x7f74d4114140 con 0x7f74d4109140 2024-09-12T02:36:24.234 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:36:23.971+0000 7f74d9e00640 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x7f74d4113fc0 con 0x7f74d41049c0 2024-09-12T02:36:24.234 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:36:23.971+0000 7f74d9e00640 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7f74d41142c0 con 0x7f74d4104010 2024-09-12T02:36:24.234 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:36:23.971+0000 7f74d3400640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f74d4109140 0x7f74d419eed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:36:24.234 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:36:23.971+0000 7f74d3400640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f74d4109140 0x7f74d419eed0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.39:3300/0 says I am v2:172.21.15.39:34046/0 (socket says 172.21.15.39:34046) 2024-09-12T02:36:24.235 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:36:23.971+0000 7f74d3400640 1 -- 172.21.15.39:0/2936970667 learned_addr learned my addr 172.21.15.39:0/2936970667 (peer_addr_for_me v2:172.21.15.39:0/0) 2024-09-12T02:36:24.235 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:36:23.971+0000 7f74d2a00640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f74d4104010 0x7f74d419a600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:36:24.235 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:36:23.971+0000 7f74ca000640 1 --2- 172.21.15.39:0/2936970667 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f74d41049c0 0x7f74d419ab40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:36:24.235 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:36:23.972+0000 7f74d3400640 1 -- 172.21.15.39:0/2936970667 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f74d4104010 msgr2=0x7f74d419a600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:36:24.235 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:36:23.972+0000 7f74d3400640 1 --2- 172.21.15.39:0/2936970667 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f74d4104010 0x7f74d419a600 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:36:24.235 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:36:23.972+0000 7f74d3400640 1 -- 172.21.15.39:0/2936970667 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f74d41049c0 msgr2=0x7f74d419ab40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:36:24.235 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:36:23.972+0000 7f74d3400640 1 --2- 172.21.15.39:0/2936970667 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f74d41049c0 0x7f74d419ab40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:36:24.235 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:36:23.972+0000 7f74d3400640 1 -- 172.21.15.39:0/2936970667 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f74d419f5b0 con 0x7f74d4109140 2024-09-12T02:36:24.235 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:36:23.972+0000 7f74d3400640 1 --2- 172.21.15.39:0/2936970667 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f74d4109140 0x7f74d419eed0 secure :-1 s=READY pgs=198 cs=0 l=1 rev1=1 crypto rx=0x7f74cc00eb10 tx=0x7f74cc00c2d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:36:24.235 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:36:23.972+0000 7f74d8a00640 1 -- 172.21.15.39:0/2936970667 <== mon.0 v2:172.21.15.39:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f74cc004b20 con 0x7f74d4109140 2024-09-12T02:36:24.235 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:36:23.972+0000 7f74d9e00640 1 -- 172.21.15.39:0/2936970667 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f74d419f8a0 con 0x7f74d4109140 2024-09-12T02:36:24.235 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:36:23.972+0000 7f74d8a00640 1 -- 172.21.15.39:0/2936970667 <== mon.0 v2:172.21.15.39:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f74cc004cc0 con 0x7f74d4109140 2024-09-12T02:36:24.235 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:36:23.972+0000 7f74d8a00640 1 -- 172.21.15.39:0/2936970667 <== mon.0 v2:172.21.15.39:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f74cc010760 con 0x7f74d4109140 2024-09-12T02:36:24.236 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:36:23.973+0000 7f74d9e00640 1 -- 172.21.15.39:0/2936970667 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f74d41a7180 con 0x7f74d4109140 2024-09-12T02:36:24.236 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:36:23.973+0000 7f74d9e00640 1 -- 172.21.15.39:0/2936970667 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7f74d4062980 con 0x7f74d4109140 2024-09-12T02:36:24.236 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:36:23.975+0000 7f74d8a00640 1 -- 172.21.15.39:0/2936970667 <== mon.0 v2:172.21.15.39:3300/0 4 ==== mgrmap(e 17) ==== 137884+0+0 (secure 0 0 0) 0x7f74cc005020 con 0x7f74d4109140 2024-09-12T02:36:24.236 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:36:23.977+0000 7f74d8a00640 1 --2- 172.21.15.39:0/2936970667 >> [v2:172.21.15.39:6800/1725006999,v1:172.21.15.39:6801/1725006999] conn(0x7f74b80a2c10 0x7f74b80a50d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:36:24.236 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:36:23.977+0000 7f74d8a00640 1 -- 172.21.15.39:0/2936970667 <== mon.0 v2:172.21.15.39:3300/0 5 ==== osd_map(93..93 src has 1..93) ==== 9092+0+0 (secure 0 0 0) 0x7f74cc0cfeb0 con 0x7f74d4109140 2024-09-12T02:36:24.236 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:36:23.977+0000 7f74d2a00640 1 --2- 172.21.15.39:0/2936970667 >> [v2:172.21.15.39:6800/1725006999,v1:172.21.15.39:6801/1725006999] conn(0x7f74b80a2c10 0x7f74b80a50d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:36:24.236 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:36:23.977+0000 7f74d8a00640 1 --2- 172.21.15.39:0/2936970667 >> [v2:172.21.15.44:6808/3663639110,v1:172.21.15.44:6809/3663639110] conn(0x7f74b80adde0 0x7f74b80b0280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:36:24.236 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:36:23.977+0000 7f74d8a00640 1 -- 172.21.15.39:0/2936970667 --> [v2:172.21.15.44:6808/3663639110,v1:172.21.15.44:6809/3663639110] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f74b80b0950 con 0x7f74b80adde0 2024-09-12T02:36:24.236 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:36:23.977+0000 7f74d8a00640 1 -- 172.21.15.39:0/2936970667 <== mon.0 v2:172.21.15.39:3300/0 6 ==== mon_get_version_reply(handle=1 version=93) ==== 24+0+0 (secure 0 0 0) 0x7f74cc0d0260 con 0x7f74d4109140 2024-09-12T02:36:24.236 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:36:23.978+0000 7f74ca000640 1 --2- 172.21.15.39:0/2936970667 >> [v2:172.21.15.44:6808/3663639110,v1:172.21.15.44:6809/3663639110] conn(0x7f74b80adde0 0x7f74b80b0280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:36:24.236 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:36:23.978+0000 7f74d2a00640 1 --2- 172.21.15.39:0/2936970667 >> [v2:172.21.15.39:6800/1725006999,v1:172.21.15.39:6801/1725006999] conn(0x7f74b80a2c10 0x7f74b80a50d0 secure :-1 s=READY pgs=180 cs=0 l=1 rev1=1 crypto rx=0x7f74c4009230 tx=0x7f74c40058d0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:36:24.236 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:36:23.978+0000 7f74ca000640 1 --2- 172.21.15.39:0/2936970667 >> [v2:172.21.15.44:6808/3663639110,v1:172.21.15.44:6809/3663639110] conn(0x7f74b80adde0 0x7f74b80b0280 crc :-1 s=READY pgs=17 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.4 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:36:24.237 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:36:23.979+0000 7f74d8a00640 1 -- 172.21.15.39:0/2936970667 <== osd.4 v2:172.21.15.44:6808/3663639110 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7f74b80b0950 con 0x7f74b80adde0 2024-09-12T02:36:24.237 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:36:23.995+0000 7f74d9e00640 1 -- 172.21.15.39:0/2936970667 --> [v2:172.21.15.44:6808/3663639110,v1:172.21.15.44:6809/3663639110] -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7f74d4062e00 con 0x7f74b80adde0 2024-09-12T02:36:24.237 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:36:23.996+0000 7f74d8a00640 1 -- 172.21.15.39:0/2936970667 <== osd.4 v2:172.21.15.44:6808/3663639110 2 ==== command_reply(tid 2: 0 ) ==== 8+0+12 (crc 0 0 0) 0x7f74d4062e00 con 0x7f74b80adde0 2024-09-12T02:36:24.237 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:36:23.996+0000 7f74d9e00640 1 -- 172.21.15.39:0/2936970667 >> [v2:172.21.15.44:6808/3663639110,v1:172.21.15.44:6809/3663639110] conn(0x7f74b80adde0 msgr2=0x7f74b80b0280 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:36:24.237 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:36:23.996+0000 7f74d9e00640 1 --2- 172.21.15.39:0/2936970667 >> [v2:172.21.15.44:6808/3663639110,v1:172.21.15.44:6809/3663639110] conn(0x7f74b80adde0 0x7f74b80b0280 crc :-1 s=READY pgs=17 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:36:24.237 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:36:23.996+0000 7f74d9e00640 1 -- 172.21.15.39:0/2936970667 >> [v2:172.21.15.39:6800/1725006999,v1:172.21.15.39:6801/1725006999] conn(0x7f74b80a2c10 msgr2=0x7f74b80a50d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:36:24.237 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:36:23.996+0000 7f74d9e00640 1 --2- 172.21.15.39:0/2936970667 >> [v2:172.21.15.39:6800/1725006999,v1:172.21.15.39:6801/1725006999] conn(0x7f74b80a2c10 0x7f74b80a50d0 secure :-1 s=READY pgs=180 cs=0 l=1 rev1=1 crypto rx=0x7f74c4009230 tx=0x7f74c40058d0 comp rx=0 tx=0).stop 2024-09-12T02:36:24.237 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:36:23.996+0000 7f74d9e00640 1 -- 172.21.15.39:0/2936970667 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f74d4109140 msgr2=0x7f74d419eed0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:36:24.237 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:36:23.996+0000 7f74d9e00640 1 --2- 172.21.15.39:0/2936970667 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f74d4109140 0x7f74d419eed0 secure :-1 s=READY pgs=198 cs=0 l=1 rev1=1 crypto rx=0x7f74cc00eb10 tx=0x7f74cc00c2d0 comp rx=0 tx=0).stop 2024-09-12T02:36:24.238 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:36:23.996+0000 7f74d3400640 1 -- 172.21.15.39:0/2936970667 reap_dead start 2024-09-12T02:36:24.238 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:36:23.996+0000 7f74d9e00640 1 -- 172.21.15.39:0/2936970667 shutdown_connections 2024-09-12T02:36:24.238 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:36:23.996+0000 7f74d9e00640 1 -- 172.21.15.39:0/2936970667 >> 172.21.15.39:0/2936970667 conn(0x7f74d40ffa50 msgr2=0x7f74d4100e10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:36:24.238 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:36:23.997+0000 7f74d9e00640 1 -- 172.21.15.39:0/2936970667 shutdown_connections 2024-09-12T02:36:24.238 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:36:23.997+0000 7f74d9e00640 1 -- 172.21.15.39:0/2936970667 wait complete. 2024-09-12T02:36:24.263 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 12 02:36:23 smithi172 ceph-mon[35609]: pgmap v342: 129 pgs: 129 active+clean; 645 KiB data, 347 MiB used, 1.0 TiB / 1.0 TiB avail; 4.7 KiB/s rd, 682 B/s wr, 8 op/s 2024-09-12T02:36:24.729 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:36:24.118+0000 7f3db7c00640 1 -- 172.21.15.39:0/1498284517 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f3db0077040 msgr2=0x7f3db01124f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:36:24.729 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:36:24.118+0000 7f3db7c00640 1 --2- 172.21.15.39:0/1498284517 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f3db0077040 0x7f3db01124f0 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7f3d9c009900 tx=0x7f3d9c02a3f0 comp rx=0 tx=0).stop 2024-09-12T02:36:24.729 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:36:24.118+0000 7f3db7c00640 1 -- 172.21.15.39:0/1498284517 shutdown_connections 2024-09-12T02:36:24.729 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:36:24.118+0000 7f3db7c00640 1 --2- 172.21.15.39:0/1498284517 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f3db0112a30 0x7f3db0114e20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:36:24.729 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:36:24.118+0000 7f3db7c00640 1 --2- 172.21.15.39:0/1498284517 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f3db0077040 0x7f3db01124f0 unknown :-1 s=CLOSED pgs=89 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:36:24.729 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:36:24.118+0000 7f3db7c00640 1 --2- 172.21.15.39:0/1498284517 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f3db0076720 0x7f3db0076b00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:36:24.729 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:36:24.118+0000 7f3db7c00640 1 -- 172.21.15.39:0/1498284517 >> 172.21.15.39:0/1498284517 conn(0x7f3db00ffa90 msgr2=0x7f3db0101eb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:36:24.729 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:36:24.118+0000 7f3db7c00640 1 -- 172.21.15.39:0/1498284517 shutdown_connections 2024-09-12T02:36:24.729 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:36:24.118+0000 7f3db7c00640 1 -- 172.21.15.39:0/1498284517 wait complete. 2024-09-12T02:36:24.729 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:36:24.119+0000 7f3db7c00640 1 Processor -- start 2024-09-12T02:36:24.730 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:36:24.119+0000 7f3db7c00640 1 -- start start 2024-09-12T02:36:24.730 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:36:24.120+0000 7f3db7c00640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f3db0076720 0x7f3db01a4700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:36:24.730 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:36:24.120+0000 7f3db7c00640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f3db0077040 0x7f3db01a4c40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:36:24.730 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:36:24.120+0000 7f3db7c00640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f3db0112a30 0x7f3db019e8c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:36:24.730 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:36:24.120+0000 7f3db7c00640 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 -- 0x7f3db01185f0 con 0x7f3db0077040 2024-09-12T02:36:24.730 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:36:24.120+0000 7f3db7c00640 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x7f3db0118470 con 0x7f3db0112a30 2024-09-12T02:36:24.730 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:36:24.120+0000 7f3db7c00640 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7f3db0118770 con 0x7f3db0076720 2024-09-12T02:36:24.730 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:36:24.120+0000 7f3dafe00640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f3db0077040 0x7f3db01a4c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:36:24.730 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:36:24.120+0000 7f3db5200640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f3db0076720 0x7f3db01a4700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:36:24.730 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:36:24.120+0000 7f3dafe00640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f3db0077040 0x7f3db01a4c40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.39:3300/0 says I am v2:172.21.15.39:34054/0 (socket says 172.21.15.39:34054) 2024-09-12T02:36:24.730 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:36:24.120+0000 7f3dafe00640 1 -- 172.21.15.39:0/255715227 learned_addr learned my addr 172.21.15.39:0/255715227 (peer_addr_for_me v2:172.21.15.39:0/0) 2024-09-12T02:36:24.730 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:36:24.120+0000 7f3db5c00640 1 --2- 172.21.15.39:0/255715227 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f3db0112a30 0x7f3db019e8c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:36:24.731 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:36:24.121+0000 7f3db5200640 1 -- 172.21.15.39:0/255715227 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f3db0112a30 msgr2=0x7f3db019e8c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:36:24.731 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:36:24.121+0000 7f3db5200640 1 --2- 172.21.15.39:0/255715227 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f3db0112a30 0x7f3db019e8c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:36:24.731 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:36:24.121+0000 7f3db5200640 1 -- 172.21.15.39:0/255715227 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f3db0077040 msgr2=0x7f3db01a4c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:36:24.731 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:36:24.121+0000 7f3db5200640 1 --2- 172.21.15.39:0/255715227 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f3db0077040 0x7f3db01a4c40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:36:24.731 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:36:24.121+0000 7f3db5200640 1 -- 172.21.15.39:0/255715227 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3db019eff0 con 0x7f3db0076720 2024-09-12T02:36:24.731 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:36:24.121+0000 7f3db5200640 1 --2- 172.21.15.39:0/255715227 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f3db0076720 0x7f3db01a4700 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7f3da400e9f0 tx=0x7f3da400eeb0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:36:24.731 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:36:24.121+0000 7f3dad600640 1 -- 172.21.15.39:0/255715227 <== mon.1 v2:172.21.15.172:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3da400ccc0 con 0x7f3db0076720 2024-09-12T02:36:24.731 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:36:24.121+0000 7f3dad600640 1 -- 172.21.15.39:0/255715227 <== mon.1 v2:172.21.15.172:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f3da4010910 con 0x7f3db0076720 2024-09-12T02:36:24.731 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:36:24.121+0000 7f3dad600640 1 -- 172.21.15.39:0/255715227 <== mon.1 v2:172.21.15.172:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3da4018960 con 0x7f3db0076720 2024-09-12T02:36:24.731 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:36:24.121+0000 7f3db7c00640 1 -- 172.21.15.39:0/255715227 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f3db019f2e0 con 0x7f3db0076720 2024-09-12T02:36:24.731 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:36:24.122+0000 7f3db7c00640 1 -- 172.21.15.39:0/255715227 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f3db01ab5d0 con 0x7f3db0076720 2024-09-12T02:36:24.731 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:36:24.122+0000 7f3db7c00640 1 -- 172.21.15.39:0/255715227 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7f3db0062980 con 0x7f3db0076720 2024-09-12T02:36:24.731 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:36:24.125+0000 7f3dad600640 1 -- 172.21.15.39:0/255715227 <== mon.1 v2:172.21.15.172:3300/0 4 ==== mgrmap(e 17) ==== 137884+0+0 (secure 0 0 0) 0x7f3da4010ac0 con 0x7f3db0076720 2024-09-12T02:36:24.732 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:36:24.126+0000 7f3dad600640 1 --2- 172.21.15.39:0/255715227 >> [v2:172.21.15.39:6800/1725006999,v1:172.21.15.39:6801/1725006999] conn(0x7f3d980a2c90 0x7f3d980a5150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:36:24.732 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:36:24.126+0000 7f3dad600640 1 -- 172.21.15.39:0/255715227 <== mon.1 v2:172.21.15.172:3300/0 5 ==== osd_map(93..93 src has 1..93) ==== 9092+0+0 (secure 0 0 0) 0x7f3da40d0080 con 0x7f3db0076720 2024-09-12T02:36:24.732 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:36:24.126+0000 7f3dafe00640 1 --2- 172.21.15.39:0/255715227 >> [v2:172.21.15.39:6800/1725006999,v1:172.21.15.39:6801/1725006999] conn(0x7f3d980a2c90 0x7f3d980a5150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:36:24.732 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:36:24.126+0000 7f3dad600640 1 --2- 172.21.15.39:0/255715227 >> [v2:172.21.15.44:6800/2349287000,v1:172.21.15.44:6801/2349287000] conn(0x7f3d980ade60 0x7f3d980b0300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:36:24.732 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:36:24.126+0000 7f3dad600640 1 -- 172.21.15.39:0/255715227 --> [v2:172.21.15.44:6800/2349287000,v1:172.21.15.44:6801/2349287000] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f3da4028ea0 con 0x7f3d980ade60 2024-09-12T02:36:24.732 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:36:24.126+0000 7f3dad600640 1 -- 172.21.15.39:0/255715227 <== mon.1 v2:172.21.15.172:3300/0 6 ==== mon_get_version_reply(handle=1 version=93) ==== 24+0+0 (secure 0 0 0) 0x7f3da40d0430 con 0x7f3db0076720 2024-09-12T02:36:24.732 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:36:24.127+0000 7f3db5c00640 1 --2- 172.21.15.39:0/255715227 >> [v2:172.21.15.44:6800/2349287000,v1:172.21.15.44:6801/2349287000] conn(0x7f3d980ade60 0x7f3d980b0300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:36:24.732 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:36:24.127+0000 7f3dafe00640 1 --2- 172.21.15.39:0/255715227 >> [v2:172.21.15.39:6800/1725006999,v1:172.21.15.39:6801/1725006999] conn(0x7f3d980a2c90 0x7f3d980a5150 secure :-1 s=READY pgs=181 cs=0 l=1 rev1=1 crypto rx=0x7f3db0079300 tx=0x7f3d9c0046c0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:36:24.732 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:36:24.127+0000 7f3db5c00640 1 --2- 172.21.15.39:0/255715227 >> [v2:172.21.15.44:6800/2349287000,v1:172.21.15.44:6801/2349287000] conn(0x7f3d980ade60 0x7f3d980b0300 crc :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:36:24.733 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:36:24.128+0000 7f3dad600640 1 -- 172.21.15.39:0/255715227 <== osd.1 v2:172.21.15.44:6800/2349287000 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7f3da4028ea0 con 0x7f3d980ade60 2024-09-12T02:36:24.733 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:36:24.157+0000 7f3db7c00640 1 -- 172.21.15.39:0/255715227 --> [v2:172.21.15.44:6800/2349287000,v1:172.21.15.44:6801/2349287000] -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7f3db0062d80 con 0x7f3d980ade60 2024-09-12T02:36:24.733 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:36:24.157+0000 7f3dad600640 1 -- 172.21.15.39:0/255715227 <== osd.1 v2:172.21.15.44:6800/2349287000 2 ==== command_reply(tid 2: 0 ) ==== 8+0+11 (crc 0 0 0) 0x7f3db0062d80 con 0x7f3d980ade60 2024-09-12T02:36:24.733 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:36:24.158+0000 7f3db7c00640 1 -- 172.21.15.39:0/255715227 >> [v2:172.21.15.44:6800/2349287000,v1:172.21.15.44:6801/2349287000] conn(0x7f3d980ade60 msgr2=0x7f3d980b0300 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:36:24.733 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:36:24.158+0000 7f3db7c00640 1 --2- 172.21.15.39:0/255715227 >> [v2:172.21.15.44:6800/2349287000,v1:172.21.15.44:6801/2349287000] conn(0x7f3d980ade60 0x7f3d980b0300 crc :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:36:24.733 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:36:24.158+0000 7f3db7c00640 1 -- 172.21.15.39:0/255715227 >> [v2:172.21.15.39:6800/1725006999,v1:172.21.15.39:6801/1725006999] conn(0x7f3d980a2c90 msgr2=0x7f3d980a5150 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:36:24.733 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:36:24.158+0000 7f3db7c00640 1 --2- 172.21.15.39:0/255715227 >> [v2:172.21.15.39:6800/1725006999,v1:172.21.15.39:6801/1725006999] conn(0x7f3d980a2c90 0x7f3d980a5150 secure :-1 s=READY pgs=181 cs=0 l=1 rev1=1 crypto rx=0x7f3db0079300 tx=0x7f3d9c0046c0 comp rx=0 tx=0).stop 2024-09-12T02:36:24.734 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:36:24.158+0000 7f3db7c00640 1 -- 172.21.15.39:0/255715227 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f3db0076720 msgr2=0x7f3db01a4700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:36:24.734 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:36:24.158+0000 7f3db7c00640 1 --2- 172.21.15.39:0/255715227 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f3db0076720 0x7f3db01a4700 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7f3da400e9f0 tx=0x7f3da400eeb0 comp rx=0 tx=0).stop 2024-09-12T02:36:24.734 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:36:24.158+0000 7f3db5c00640 1 -- 172.21.15.39:0/255715227 reap_dead start 2024-09-12T02:36:24.734 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:36:24.158+0000 7f3db7c00640 1 -- 172.21.15.39:0/255715227 shutdown_connections 2024-09-12T02:36:24.734 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:36:24.158+0000 7f3db7c00640 1 -- 172.21.15.39:0/255715227 >> 172.21.15.39:0/255715227 conn(0x7f3db00ffa90 msgr2=0x7f3db0101e80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:36:24.734 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:36:24.159+0000 7f3db7c00640 1 -- 172.21.15.39:0/255715227 shutdown_connections 2024-09-12T02:36:24.734 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:36:24.159+0000 7f3db7c00640 1 -- 172.21.15.39:0/255715227 wait complete. 2024-09-12T02:36:24.942 INFO:teuthology.orchestra.run.smithi039.stderr:Inferring config /var/lib/ceph/4954ed46-70ae-11ef-bcea-c7b262605968/mon.a/config 2024-09-12T02:36:24.942 INFO:teuthology.orchestra.run.smithi039.stderr:Inferring config /var/lib/ceph/4954ed46-70ae-11ef-bcea-c7b262605968/mon.a/config 2024-09-12T02:36:24.943 INFO:teuthology.orchestra.run.smithi039.stderr:Inferring config /var/lib/ceph/4954ed46-70ae-11ef-bcea-c7b262605968/mon.a/config 2024-09-12T02:36:25.163 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:36:25.162+0000 7ff39e200640 1 -- 172.21.15.39:0/4111496593 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7ff398103ff0 msgr2=0x7ff3981043d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:36:25.163 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:36:25.162+0000 7ff39e200640 1 --2- 172.21.15.39:0/4111496593 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7ff398103ff0 0x7ff3981043d0 secure :-1 s=READY pgs=199 cs=0 l=1 rev1=1 crypto rx=0x7ff388009900 tx=0x7ff38802a400 comp rx=0 tx=0).stop 2024-09-12T02:36:25.163 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:36:25.162+0000 7ff39e200640 1 -- 172.21.15.39:0/4111496593 shutdown_connections 2024-09-12T02:36:25.163 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:36:25.162+0000 7ff39e200640 1 --2- 172.21.15.39:0/4111496593 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7ff398109120 0x7ff398110ca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:36:25.163 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:36:25.162+0000 7ff39e200640 1 --2- 172.21.15.39:0/4111496593 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7ff3981049a0 0x7ff3981089f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:36:25.163 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:36:25.162+0000 7ff39e200640 1 --2- 172.21.15.39:0/4111496593 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7ff398103ff0 0x7ff3981043d0 unknown :-1 s=CLOSED pgs=199 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:36:25.164 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:36:25.162+0000 7ff39e200640 1 -- 172.21.15.39:0/4111496593 >> 172.21.15.39:0/4111496593 conn(0x7ff3980ffa90 msgr2=0x7ff398101eb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:36:25.164 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:36:25.162+0000 7ff39e200640 1 -- 172.21.15.39:0/4111496593 shutdown_connections 2024-09-12T02:36:25.164 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:36:25.163+0000 7ff39e200640 1 -- 172.21.15.39:0/4111496593 wait complete. 2024-09-12T02:36:25.165 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:36:25.165+0000 7ff39e200640 1 Processor -- start 2024-09-12T02:36:25.166 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:36:25.165+0000 7ff39e200640 1 -- start start 2024-09-12T02:36:25.166 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:36:25.166+0000 7ff39e200640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7ff398103ff0 0x7ff39819a630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:36:25.167 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:36:25.166+0000 7ff39e200640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7ff3981049a0 0x7ff39819ab70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:36:25.167 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:36:25.166+0000 7ff39e200640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7ff398109120 0x7ff39819ef00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:36:25.167 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:36:25.166+0000 7ff39e200640 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 -- 0x7ff398114170 con 0x7ff3981049a0 2024-09-12T02:36:25.167 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:36:25.166+0000 7ff39e200640 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x7ff398113ff0 con 0x7ff398109120 2024-09-12T02:36:25.167 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:36:25.166+0000 7ff39e200640 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7ff3981142f0 con 0x7ff398103ff0 2024-09-12T02:36:25.168 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:36:25.166+0000 7ff397400640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7ff398103ff0 0x7ff39819a630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:36:25.168 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:36:25.166+0000 7ff396a00640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7ff3981049a0 0x7ff39819ab70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:36:25.168 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:36:25.166+0000 7ff397400640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7ff398103ff0 0x7ff39819a630 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.172:3300/0 says I am v2:172.21.15.39:55186/0 (socket says 172.21.15.39:55186) 2024-09-12T02:36:25.168 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:36:25.166+0000 7ff397400640 1 -- 172.21.15.39:0/1648969471 learned_addr learned my addr 172.21.15.39:0/1648969471 (peer_addr_for_me v2:172.21.15.39:0/0) 2024-09-12T02:36:25.168 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:36:25.166+0000 7ff397e00640 1 --2- 172.21.15.39:0/1648969471 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7ff398109120 0x7ff39819ef00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:36:25.168 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:36:25.167+0000 7ff397400640 1 -- 172.21.15.39:0/1648969471 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7ff398109120 msgr2=0x7ff39819ef00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:36:25.168 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:36:25.167+0000 7ff397400640 1 --2- 172.21.15.39:0/1648969471 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7ff398109120 0x7ff39819ef00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:36:25.168 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:36:25.167+0000 7ff397400640 1 -- 172.21.15.39:0/1648969471 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7ff3981049a0 msgr2=0x7ff39819ab70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:36:25.168 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:36:25.167+0000 7ff397400640 1 --2- 172.21.15.39:0/1648969471 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7ff3981049a0 0x7ff39819ab70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:36:25.168 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:36:25.167+0000 7ff397400640 1 -- 172.21.15.39:0/1648969471 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff39819f5e0 con 0x7ff398103ff0 2024-09-12T02:36:25.169 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:36:25.167+0000 7ff397400640 1 --2- 172.21.15.39:0/1648969471 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7ff398103ff0 0x7ff39819a630 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7ff388004770 tx=0x7ff388003c10 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:36:25.169 INFO:teuthology.orchestra.run.smithi039.stderr:Inferring config /var/lib/ceph/4954ed46-70ae-11ef-bcea-c7b262605968/mon.a/config 2024-09-12T02:36:25.170 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:36:25.168+0000 7ff38fe00640 1 -- 172.21.15.39:0/1648969471 <== mon.1 v2:172.21.15.172:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff38803f070 con 0x7ff398103ff0 2024-09-12T02:36:25.170 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:36:25.168+0000 7ff38fe00640 1 -- 172.21.15.39:0/1648969471 <== mon.1 v2:172.21.15.172:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7ff388031ca0 con 0x7ff398103ff0 2024-09-12T02:36:25.170 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:36:25.168+0000 7ff39e200640 1 -- 172.21.15.39:0/1648969471 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff39819f870 con 0x7ff398103ff0 2024-09-12T02:36:25.170 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:36:25.168+0000 7ff38fe00640 1 -- 172.21.15.39:0/1648969471 <== mon.1 v2:172.21.15.172:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff388035030 con 0x7ff398103ff0 2024-09-12T02:36:25.170 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:36:25.168+0000 7ff39e200640 1 -- 172.21.15.39:0/1648969471 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff3981a71b0 con 0x7ff398103ff0 2024-09-12T02:36:25.170 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:36:25.170+0000 7ff39e200640 1 -- 172.21.15.39:0/1648969471 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7ff398062980 con 0x7ff398103ff0 2024-09-12T02:36:25.172 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:36:25.171+0000 7ff38fe00640 1 -- 172.21.15.39:0/1648969471 <== mon.1 v2:172.21.15.172:3300/0 4 ==== mgrmap(e 17) ==== 137884+0+0 (secure 0 0 0) 0x7ff388042070 con 0x7ff398103ff0 2024-09-12T02:36:25.173 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:36:25.172+0000 7ff38fe00640 1 --2- 172.21.15.39:0/1648969471 >> [v2:172.21.15.39:6800/1725006999,v1:172.21.15.39:6801/1725006999] conn(0x7ff37c0a2c90 0x7ff37c0a5150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:36:25.173 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:36:25.173+0000 7ff38fe00640 1 -- 172.21.15.39:0/1648969471 <== mon.1 v2:172.21.15.172:3300/0 5 ==== osd_map(93..93 src has 1..93) ==== 9092+0+0 (secure 0 0 0) 0x7ff3880efad0 con 0x7ff398103ff0 2024-09-12T02:36:25.174 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:36:25.173+0000 7ff396a00640 1 --2- 172.21.15.39:0/1648969471 >> [v2:172.21.15.39:6800/1725006999,v1:172.21.15.39:6801/1725006999] conn(0x7ff37c0a2c90 0x7ff37c0a5150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:36:25.174 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:36:25.173+0000 7ff38fe00640 1 --2- 172.21.15.39:0/1648969471 >> [v2:172.21.15.44:6824/3899352344,v1:172.21.15.44:6825/3899352344] conn(0x7ff37c0ade60 0x7ff37c0b0300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:36:25.174 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:36:25.173+0000 7ff38fe00640 1 -- 172.21.15.39:0/1648969471 --> [v2:172.21.15.44:6824/3899352344,v1:172.21.15.44:6825/3899352344] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7ff38802fec0 con 0x7ff37c0ade60 2024-09-12T02:36:25.174 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:36:25.173+0000 7ff38fe00640 1 -- 172.21.15.39:0/1648969471 <== mon.1 v2:172.21.15.172:3300/0 6 ==== mon_get_version_reply(handle=1 version=93) ==== 24+0+0 (secure 0 0 0) 0x7ff3880f42a0 con 0x7ff398103ff0 2024-09-12T02:36:25.175 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:36:25.174+0000 7ff397e00640 1 --2- 172.21.15.39:0/1648969471 >> [v2:172.21.15.44:6824/3899352344,v1:172.21.15.44:6825/3899352344] conn(0x7ff37c0ade60 0x7ff37c0b0300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:36:25.175 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:36:25.174+0000 7ff396a00640 1 --2- 172.21.15.39:0/1648969471 >> [v2:172.21.15.39:6800/1725006999,v1:172.21.15.39:6801/1725006999] conn(0x7ff37c0a2c90 0x7ff37c0a5150 secure :-1 s=READY pgs=182 cs=0 l=1 rev1=1 crypto rx=0x7ff3980fff90 tx=0x7ff384005f90 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:36:25.175 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:36:25.174+0000 7ff397e00640 1 --2- 172.21.15.39:0/1648969471 >> [v2:172.21.15.44:6824/3899352344,v1:172.21.15.44:6825/3899352344] conn(0x7ff37c0ade60 0x7ff37c0b0300 crc :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.10 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:36:25.176 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:36:25.175+0000 7ff38fe00640 1 -- 172.21.15.39:0/1648969471 <== osd.10 v2:172.21.15.44:6824/3899352344 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7ff38802fec0 con 0x7ff37c0ade60 2024-09-12T02:36:25.191 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:36:25.190+0000 7ff39e200640 1 -- 172.21.15.39:0/1648969471 --> [v2:172.21.15.44:6824/3899352344,v1:172.21.15.44:6825/3899352344] -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7ff398062e00 con 0x7ff37c0ade60 2024-09-12T02:36:25.191 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:36:25.191+0000 7ff38fe00640 1 -- 172.21.15.39:0/1648969471 <== osd.10 v2:172.21.15.44:6824/3899352344 2 ==== command_reply(tid 2: 0 ) ==== 8+0+12 (crc 0 0 0) 0x7ff398062e00 con 0x7ff37c0ade60 2024-09-12T02:36:25.192 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:36:25.191+0000 7ff39e200640 1 -- 172.21.15.39:0/1648969471 >> [v2:172.21.15.44:6824/3899352344,v1:172.21.15.44:6825/3899352344] conn(0x7ff37c0ade60 msgr2=0x7ff37c0b0300 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:36:25.192 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:36:25.191+0000 7ff39e200640 1 --2- 172.21.15.39:0/1648969471 >> [v2:172.21.15.44:6824/3899352344,v1:172.21.15.44:6825/3899352344] conn(0x7ff37c0ade60 0x7ff37c0b0300 crc :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:36:25.192 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:36:25.191+0000 7ff39e200640 1 -- 172.21.15.39:0/1648969471 >> [v2:172.21.15.39:6800/1725006999,v1:172.21.15.39:6801/1725006999] conn(0x7ff37c0a2c90 msgr2=0x7ff37c0a5150 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:36:25.193 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:36:25.191+0000 7ff39e200640 1 --2- 172.21.15.39:0/1648969471 >> [v2:172.21.15.39:6800/1725006999,v1:172.21.15.39:6801/1725006999] conn(0x7ff37c0a2c90 0x7ff37c0a5150 secure :-1 s=READY pgs=182 cs=0 l=1 rev1=1 crypto rx=0x7ff3980fff90 tx=0x7ff384005f90 comp rx=0 tx=0).stop 2024-09-12T02:36:25.193 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:36:25.191+0000 7ff39e200640 1 -- 172.21.15.39:0/1648969471 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7ff398103ff0 msgr2=0x7ff39819a630 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:36:25.193 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:36:25.191+0000 7ff39e200640 1 --2- 172.21.15.39:0/1648969471 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7ff398103ff0 0x7ff39819a630 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7ff388004770 tx=0x7ff388003c10 comp rx=0 tx=0).stop 2024-09-12T02:36:25.193 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:36:25.191+0000 7ff397e00640 1 -- 172.21.15.39:0/1648969471 reap_dead start 2024-09-12T02:36:25.193 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:36:25.191+0000 7ff39e200640 1 -- 172.21.15.39:0/1648969471 shutdown_connections 2024-09-12T02:36:25.193 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:36:25.191+0000 7ff39e200640 1 -- 172.21.15.39:0/1648969471 >> 172.21.15.39:0/1648969471 conn(0x7ff3980ffa90 msgr2=0x7ff398100d20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:36:25.193 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:36:25.192+0000 7ff39e200640 1 -- 172.21.15.39:0/1648969471 shutdown_connections 2024-09-12T02:36:25.193 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:36:25.192+0000 7ff39e200640 1 -- 172.21.15.39:0/1648969471 wait complete. 2024-09-12T02:36:25.940 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 02:36:25 smithi039 ceph-mon[30515]: pgmap v343: 129 pgs: 129 active+clean; 645 KiB data, 347 MiB used, 1.0 TiB / 1.0 TiB avail; 6.7 KiB/s rd, 682 B/s wr, 12 op/s 2024-09-12T02:36:26.198 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 12 02:36:25 smithi044 ceph-mon[35411]: pgmap v343: 129 pgs: 129 active+clean; 645 KiB data, 347 MiB used, 1.0 TiB / 1.0 TiB avail; 6.7 KiB/s rd, 682 B/s wr, 12 op/s 2024-09-12T02:36:26.263 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 12 02:36:25 smithi172 ceph-mon[35609]: pgmap v343: 129 pgs: 129 active+clean; 645 KiB data, 347 MiB used, 1.0 TiB / 1.0 TiB avail; 6.7 KiB/s rd, 682 B/s wr, 12 op/s 2024-09-12T02:36:26.402 INFO:teuthology.orchestra.run.smithi039.stdout:55834574932 2024-09-12T02:36:26.402 DEBUG:teuthology.orchestra.run.smithi039:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc shell --fsid 4954ed46-70ae-11ef-bcea-c7b262605968 -- ceph osd last-stat-seq osd.1 2024-09-12T02:36:26.862 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:36:26.860+0000 7f9403200640 1 -- 172.21.15.39:0/3684000328 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f94041079c0 msgr2=0x7f9404107da0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:36:26.862 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:36:26.860+0000 7f9403200640 1 --2- 172.21.15.39:0/3684000328 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f94041079c0 0x7f9404107da0 secure :-1 s=READY pgs=200 cs=0 l=1 rev1=1 crypto rx=0x7f93f4009930 tx=0x7f93f402a420 comp rx=0 tx=0).stop 2024-09-12T02:36:26.862 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:36:26.860+0000 7f9403200640 1 -- 172.21.15.39:0/3684000328 shutdown_connections 2024-09-12T02:36:26.862 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:36:26.860+0000 7f9403200640 1 --2- 172.21.15.39:0/3684000328 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f9404102360 0x7f940410e890 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:36:26.862 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:36:26.860+0000 7f9403200640 1 --2- 172.21.15.39:0/3684000328 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f94041019c0 0x7f9404101e20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:36:26.862 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:36:26.860+0000 7f9403200640 1 --2- 172.21.15.39:0/3684000328 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f94041079c0 0x7f9404107da0 unknown :-1 s=CLOSED pgs=200 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:36:26.863 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:36:26.860+0000 7f9403200640 1 -- 172.21.15.39:0/3684000328 >> 172.21.15.39:0/3684000328 conn(0x7f94040fd740 msgr2=0x7f94040ffb60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:36:26.863 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:36:26.860+0000 7f9403200640 1 -- 172.21.15.39:0/3684000328 shutdown_connections 2024-09-12T02:36:26.863 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:36:26.860+0000 7f9403200640 1 -- 172.21.15.39:0/3684000328 wait complete. 2024-09-12T02:36:26.863 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:36:26.861+0000 7f9403200640 1 Processor -- start 2024-09-12T02:36:26.863 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:36:26.861+0000 7f9403200640 1 -- start start 2024-09-12T02:36:26.864 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:36:26.862+0000 7f9403200640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f94041019c0 0x7f940419a4f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:36:26.864 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:36:26.862+0000 7f9403200640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f9404102360 0x7f940419aa30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:36:26.865 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:36:26.862+0000 7f9403200640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f94041079c0 0x7f940419edc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:36:26.865 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:36:26.862+0000 7f9403200640 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 -- 0x7f9404111e10 con 0x7f94041019c0 2024-09-12T02:36:26.865 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:36:26.862+0000 7f9403200640 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x7f9404111c90 con 0x7f9404102360 2024-09-12T02:36:26.865 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:36:26.862+0000 7f9403200640 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7f9404111f90 con 0x7f94041079c0 2024-09-12T02:36:26.865 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:36:26.862+0000 7f93fbe00640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f9404102360 0x7f940419aa30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:36:26.865 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:36:26.862+0000 7f9401e00640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f94041019c0 0x7f940419a4f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:36:26.865 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:36:26.862+0000 7f9402800640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f94041079c0 0x7f940419edc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:36:26.865 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:36:26.862+0000 7f9401e00640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f94041019c0 0x7f940419a4f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.39:3300/0 says I am v2:172.21.15.39:34088/0 (socket says 172.21.15.39:34088) 2024-09-12T02:36:26.865 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:36:26.862+0000 7f9401e00640 1 -- 172.21.15.39:0/2682196068 learned_addr learned my addr 172.21.15.39:0/2682196068 (peer_addr_for_me v2:172.21.15.39:0/0) 2024-09-12T02:36:26.865 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:36:26.863+0000 7f9402800640 1 -- 172.21.15.39:0/2682196068 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f9404102360 msgr2=0x7f940419aa30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:36:26.865 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:36:26.863+0000 7f9402800640 1 --2- 172.21.15.39:0/2682196068 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f9404102360 0x7f940419aa30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:36:26.865 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:36:26.863+0000 7f9402800640 1 -- 172.21.15.39:0/2682196068 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f94041019c0 msgr2=0x7f940419a4f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:36:26.865 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:36:26.863+0000 7f9402800640 1 --2- 172.21.15.39:0/2682196068 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f94041019c0 0x7f940419a4f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:36:26.866 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:36:26.863+0000 7f9402800640 1 -- 172.21.15.39:0/2682196068 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f940419f4a0 con 0x7f94041079c0 2024-09-12T02:36:26.866 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:36:26.863+0000 7f9401e00640 1 --2- 172.21.15.39:0/2682196068 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f94041019c0 0x7f940419a4f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-12T02:36:26.866 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:36:26.863+0000 7f93fbe00640 1 --2- 172.21.15.39:0/2682196068 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f9404102360 0x7f940419aa30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-12T02:36:26.866 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:36:26.863+0000 7f9402800640 1 --2- 172.21.15.39:0/2682196068 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f94041079c0 0x7f940419edc0 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7f93fc00da10 tx=0x7f93fc00ded0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:36:26.866 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:36:26.863+0000 7f93faa00640 1 -- 172.21.15.39:0/2682196068 <== mon.1 v2:172.21.15.172:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f93fc00bd70 con 0x7f94041079c0 2024-09-12T02:36:26.866 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:36:26.863+0000 7f9403200640 1 -- 172.21.15.39:0/2682196068 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f940419f790 con 0x7f94041079c0 2024-09-12T02:36:26.866 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:36:26.863+0000 7f93faa00640 1 -- 172.21.15.39:0/2682196068 <== mon.1 v2:172.21.15.172:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f93fc003e50 con 0x7f94041079c0 2024-09-12T02:36:26.866 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:36:26.863+0000 7f93faa00640 1 -- 172.21.15.39:0/2682196068 <== mon.1 v2:172.21.15.172:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f93fc0106a0 con 0x7f94041079c0 2024-09-12T02:36:26.866 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:36:26.863+0000 7f9403200640 1 -- 172.21.15.39:0/2682196068 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f94041a7070 con 0x7f94041079c0 2024-09-12T02:36:26.867 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:36:26.864+0000 7f9403200640 1 -- 172.21.15.39:0/2682196068 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7f94040ff840 con 0x7f94041079c0 2024-09-12T02:36:26.867 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:36:26.867+0000 7f93faa00640 1 -- 172.21.15.39:0/2682196068 <== mon.1 v2:172.21.15.172:3300/0 4 ==== mgrmap(e 17) ==== 137884+0+0 (secure 0 0 0) 0x7f93fc003970 con 0x7f94041079c0 2024-09-12T02:36:26.869 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:36:26.868+0000 7f93faa00640 1 --2- 172.21.15.39:0/2682196068 >> [v2:172.21.15.39:6800/1725006999,v1:172.21.15.39:6801/1725006999] conn(0x7f93e80a2c10 0x7f93e80a50d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:36:26.869 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:36:26.868+0000 7f93faa00640 1 -- 172.21.15.39:0/2682196068 <== mon.1 v2:172.21.15.172:3300/0 5 ==== osd_map(93..93 src has 1..93) ==== 9092+0+0 (secure 0 0 0) 0x7f93fc0cfff0 con 0x7f94041079c0 2024-09-12T02:36:26.870 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:36:26.869+0000 7f9401e00640 1 --2- 172.21.15.39:0/2682196068 >> [v2:172.21.15.39:6800/1725006999,v1:172.21.15.39:6801/1725006999] conn(0x7f93e80a2c10 0x7f93e80a50d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:36:26.870 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:36:26.869+0000 7f93faa00640 1 --2- 172.21.15.39:0/2682196068 >> [v2:172.21.15.172:6800/1176898232,v1:172.21.15.172:6801/1176898232] conn(0x7f93e80adde0 0x7f93e80b0280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:36:26.870 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:36:26.869+0000 7f93faa00640 1 -- 172.21.15.39:0/2682196068 --> [v2:172.21.15.172:6800/1176898232,v1:172.21.15.172:6801/1176898232] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f93fc022e70 con 0x7f93e80adde0 2024-09-12T02:36:26.870 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:36:26.869+0000 7f93faa00640 1 -- 172.21.15.39:0/2682196068 <== mon.1 v2:172.21.15.172:3300/0 6 ==== mon_get_version_reply(handle=1 version=93) ==== 24+0+0 (secure 0 0 0) 0x7f93fc0d0440 con 0x7f94041079c0 2024-09-12T02:36:26.870 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:36:26.869+0000 7f93fbe00640 1 --2- 172.21.15.39:0/2682196068 >> [v2:172.21.15.172:6800/1176898232,v1:172.21.15.172:6801/1176898232] conn(0x7f93e80adde0 0x7f93e80b0280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:36:26.870 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:36:26.869+0000 7f9401e00640 1 --2- 172.21.15.39:0/2682196068 >> [v2:172.21.15.39:6800/1725006999,v1:172.21.15.39:6801/1725006999] conn(0x7f93e80a2c10 0x7f93e80a50d0 secure :-1 s=READY pgs=183 cs=0 l=1 rev1=1 crypto rx=0x7f93f4000c00 tx=0x7f93f4031510 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:36:26.871 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:36:26.870+0000 7f93fbe00640 1 --2- 172.21.15.39:0/2682196068 >> [v2:172.21.15.172:6800/1176898232,v1:172.21.15.172:6801/1176898232] conn(0x7f93e80adde0 0x7f93e80b0280 crc :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:36:26.871 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:36:26.871+0000 7f93faa00640 1 -- 172.21.15.39:0/2682196068 <== osd.2 v2:172.21.15.172:6800/1176898232 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7f93fc022e70 con 0x7f93e80adde0 2024-09-12T02:36:26.886 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:36:26.885+0000 7f9403200640 1 -- 172.21.15.39:0/2682196068 --> [v2:172.21.15.172:6800/1176898232,v1:172.21.15.172:6801/1176898232] -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7f9404103100 con 0x7f93e80adde0 2024-09-12T02:36:26.887 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:36:26.886+0000 7f93faa00640 1 -- 172.21.15.39:0/2682196068 <== osd.2 v2:172.21.15.172:6800/1176898232 2 ==== command_reply(tid 2: 0 ) ==== 8+0+11 (crc 0 0 0) 0x7f9404103100 con 0x7f93e80adde0 2024-09-12T02:36:26.888 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:36:26.887+0000 7f9403200640 1 -- 172.21.15.39:0/2682196068 >> [v2:172.21.15.172:6800/1176898232,v1:172.21.15.172:6801/1176898232] conn(0x7f93e80adde0 msgr2=0x7f93e80b0280 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:36:26.888 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:36:26.887+0000 7f9403200640 1 --2- 172.21.15.39:0/2682196068 >> [v2:172.21.15.172:6800/1176898232,v1:172.21.15.172:6801/1176898232] conn(0x7f93e80adde0 0x7f93e80b0280 crc :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:36:26.888 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:36:26.887+0000 7f9403200640 1 -- 172.21.15.39:0/2682196068 >> [v2:172.21.15.39:6800/1725006999,v1:172.21.15.39:6801/1725006999] conn(0x7f93e80a2c10 msgr2=0x7f93e80a50d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:36:26.888 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:36:26.887+0000 7f9403200640 1 --2- 172.21.15.39:0/2682196068 >> [v2:172.21.15.39:6800/1725006999,v1:172.21.15.39:6801/1725006999] conn(0x7f93e80a2c10 0x7f93e80a50d0 secure :-1 s=READY pgs=183 cs=0 l=1 rev1=1 crypto rx=0x7f93f4000c00 tx=0x7f93f4031510 comp rx=0 tx=0).stop 2024-09-12T02:36:26.888 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:36:26.887+0000 7f9403200640 1 -- 172.21.15.39:0/2682196068 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f94041079c0 msgr2=0x7f940419edc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:36:26.888 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:36:26.887+0000 7f9403200640 1 --2- 172.21.15.39:0/2682196068 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f94041079c0 0x7f940419edc0 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7f93fc00da10 tx=0x7f93fc00ded0 comp rx=0 tx=0).stop 2024-09-12T02:36:26.888 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:36:26.887+0000 7f9402800640 1 -- 172.21.15.39:0/2682196068 reap_dead start 2024-09-12T02:36:26.888 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:36:26.887+0000 7f9403200640 1 -- 172.21.15.39:0/2682196068 shutdown_connections 2024-09-12T02:36:26.888 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:36:26.887+0000 7f9403200640 1 -- 172.21.15.39:0/2682196068 >> 172.21.15.39:0/2682196068 conn(0x7f94040fd740 msgr2=0x7f94040fede0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:36:26.888 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:36:26.887+0000 7f9403200640 1 -- 172.21.15.39:0/2682196068 shutdown_connections 2024-09-12T02:36:26.889 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:36:26.887+0000 7f9403200640 1 -- 172.21.15.39:0/2682196068 wait complete. 2024-09-12T02:36:27.852 INFO:teuthology.orchestra.run.smithi039.stdout:300647710755 2024-09-12T02:36:27.852 DEBUG:teuthology.orchestra.run.smithi039:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc shell --fsid 4954ed46-70ae-11ef-bcea-c7b262605968 -- ceph osd last-stat-seq osd.10 2024-09-12T02:36:27.924 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 02:36:27 smithi039 ceph-mon[30515]: pgmap v344: 129 pgs: 129 active+clean; 645 KiB data, 347 MiB used, 1.0 TiB / 1.0 TiB avail; 4.7 KiB/s rd, 9 op/s 2024-09-12T02:36:28.198 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 12 02:36:27 smithi044 ceph-mon[35411]: pgmap v344: 129 pgs: 129 active+clean; 645 KiB data, 347 MiB used, 1.0 TiB / 1.0 TiB avail; 4.7 KiB/s rd, 9 op/s 2024-09-12T02:36:28.263 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 12 02:36:27 smithi172 ceph-mon[35609]: pgmap v344: 129 pgs: 129 active+clean; 645 KiB data, 347 MiB used, 1.0 TiB / 1.0 TiB avail; 4.7 KiB/s rd, 9 op/s 2024-09-12T02:36:28.581 INFO:teuthology.orchestra.run.smithi039.stdout:34359738455 2024-09-12T02:36:28.582 DEBUG:teuthology.orchestra.run.smithi039:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc shell --fsid 4954ed46-70ae-11ef-bcea-c7b262605968 -- ceph osd last-stat-seq osd.0 2024-09-12T02:36:28.964 INFO:teuthology.orchestra.run.smithi039.stdout:77309411407 2024-09-12T02:36:28.965 DEBUG:teuthology.orchestra.run.smithi039:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc shell --fsid 4954ed46-70ae-11ef-bcea-c7b262605968 -- ceph osd last-stat-seq osd.2 2024-09-12T02:36:29.165 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:36:28.250+0000 7f5a87a00640 1 -- 172.21.15.39:0/1409892314 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f5a80109120 msgr2=0x7f5a80110ca0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:36:29.165 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:36:28.250+0000 7f5a87a00640 1 --2- 172.21.15.39:0/1409892314 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f5a80109120 0x7f5a80110ca0 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0x7f5a78009ca0 tx=0x7f5a7802a8c0 comp rx=0 tx=0).stop 2024-09-12T02:36:29.165 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:36:28.250+0000 7f5a87a00640 1 -- 172.21.15.39:0/1409892314 shutdown_connections 2024-09-12T02:36:29.165 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:36:28.250+0000 7f5a87a00640 1 --2- 172.21.15.39:0/1409892314 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f5a80109120 0x7f5a80110ca0 unknown :-1 s=CLOSED pgs=90 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:36:29.166 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:36:28.250+0000 7f5a87a00640 1 --2- 172.21.15.39:0/1409892314 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f5a801049a0 0x7f5a801089f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:36:29.166 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:36:28.250+0000 7f5a87a00640 1 --2- 172.21.15.39:0/1409892314 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f5a80103ff0 0x7f5a801043d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:36:29.166 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:36:28.250+0000 7f5a87a00640 1 -- 172.21.15.39:0/1409892314 >> 172.21.15.39:0/1409892314 conn(0x7f5a800ffa90 msgr2=0x7f5a80101eb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:36:29.166 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:36:28.250+0000 7f5a87a00640 1 -- 172.21.15.39:0/1409892314 shutdown_connections 2024-09-12T02:36:29.166 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:36:28.251+0000 7f5a87a00640 1 -- 172.21.15.39:0/1409892314 wait complete. 2024-09-12T02:36:29.166 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:36:28.252+0000 7f5a87a00640 1 Processor -- start 2024-09-12T02:36:29.166 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:36:28.252+0000 7f5a87a00640 1 -- start start 2024-09-12T02:36:29.166 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:36:28.252+0000 7f5a87a00640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f5a80103ff0 0x7f5a8019a5f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:36:29.166 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:36:28.252+0000 7f5a87a00640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f5a801049a0 0x7f5a8019ab30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:36:29.166 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:36:28.252+0000 7f5a87a00640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f5a80109120 0x7f5a8019eec0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:36:29.166 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:36:28.252+0000 7f5a87a00640 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 -- 0x7f5a80114150 con 0x7f5a801049a0 2024-09-12T02:36:29.166 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:36:28.252+0000 7f5a87a00640 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x7f5a80113fd0 con 0x7f5a80109120 2024-09-12T02:36:29.167 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:36:28.252+0000 7f5a87a00640 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7f5a801142d0 con 0x7f5a80103ff0 2024-09-12T02:36:29.167 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:36:28.252+0000 7f5a7fe00640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f5a801049a0 0x7f5a8019ab30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:36:29.167 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:36:28.252+0000 7f5a85000640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f5a80103ff0 0x7f5a8019a5f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:36:29.167 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:36:28.252+0000 7f5a85000640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f5a80103ff0 0x7f5a8019a5f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.172:3300/0 says I am v2:172.21.15.39:51120/0 (socket says 172.21.15.39:51120) 2024-09-12T02:36:29.167 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:36:28.252+0000 7f5a85000640 1 -- 172.21.15.39:0/1817181609 learned_addr learned my addr 172.21.15.39:0/1817181609 (peer_addr_for_me v2:172.21.15.39:0/0) 2024-09-12T02:36:29.167 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:36:28.253+0000 7f5a85a00640 1 --2- 172.21.15.39:0/1817181609 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f5a80109120 0x7f5a8019eec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:36:29.167 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:36:28.253+0000 7f5a7fe00640 1 -- 172.21.15.39:0/1817181609 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f5a80103ff0 msgr2=0x7f5a8019a5f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:36:29.167 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:36:28.253+0000 7f5a7fe00640 1 --2- 172.21.15.39:0/1817181609 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f5a80103ff0 0x7f5a8019a5f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:36:29.167 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:36:28.253+0000 7f5a7fe00640 1 -- 172.21.15.39:0/1817181609 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f5a80109120 msgr2=0x7f5a8019eec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:36:29.167 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:36:28.253+0000 7f5a7fe00640 1 --2- 172.21.15.39:0/1817181609 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f5a80109120 0x7f5a8019eec0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:36:29.167 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:36:28.253+0000 7f5a7fe00640 1 -- 172.21.15.39:0/1817181609 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5a8019f5a0 con 0x7f5a801049a0 2024-09-12T02:36:29.167 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:36:28.253+0000 7f5a7fe00640 1 --2- 172.21.15.39:0/1817181609 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f5a801049a0 0x7f5a8019ab30 secure :-1 s=READY pgs=201 cs=0 l=1 rev1=1 crypto rx=0x7f5a6c00e9f0 tx=0x7f5a6c00eeb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:36:29.168 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:36:28.253+0000 7f5a7d600640 1 -- 172.21.15.39:0/1817181609 <== mon.0 v2:172.21.15.39:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5a6c00cd80 con 0x7f5a801049a0 2024-09-12T02:36:29.168 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:36:28.253+0000 7f5a7d600640 1 -- 172.21.15.39:0/1817181609 <== mon.0 v2:172.21.15.39:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f5a6c0035f0 con 0x7f5a801049a0 2024-09-12T02:36:29.168 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:36:28.253+0000 7f5a87a00640 1 -- 172.21.15.39:0/1817181609 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f5a8019f890 con 0x7f5a801049a0 2024-09-12T02:36:29.168 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:36:28.253+0000 7f5a7d600640 1 -- 172.21.15.39:0/1817181609 <== mon.0 v2:172.21.15.39:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5a6c010690 con 0x7f5a801049a0 2024-09-12T02:36:29.168 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:36:28.254+0000 7f5a87a00640 1 -- 172.21.15.39:0/1817181609 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f5a801a7170 con 0x7f5a801049a0 2024-09-12T02:36:29.168 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:36:28.254+0000 7f5a87a00640 1 -- 172.21.15.39:0/1817181609 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7f5a80062940 con 0x7f5a801049a0 2024-09-12T02:36:29.168 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:36:28.257+0000 7f5a7d600640 1 -- 172.21.15.39:0/1817181609 <== mon.0 v2:172.21.15.39:3300/0 4 ==== mgrmap(e 17) ==== 137884+0+0 (secure 0 0 0) 0x7f5a6c003b30 con 0x7f5a801049a0 2024-09-12T02:36:29.168 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:36:28.258+0000 7f5a7d600640 1 --2- 172.21.15.39:0/1817181609 >> [v2:172.21.15.39:6800/1725006999,v1:172.21.15.39:6801/1725006999] conn(0x7f5a680a2c10 0x7f5a680a50d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:36:29.168 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:36:28.258+0000 7f5a7d600640 1 -- 172.21.15.39:0/1817181609 <== mon.0 v2:172.21.15.39:3300/0 5 ==== osd_map(93..93 src has 1..93) ==== 9092+0+0 (secure 0 0 0) 0x7f5a6c0cfa30 con 0x7f5a801049a0 2024-09-12T02:36:29.168 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:36:28.258+0000 7f5a85000640 1 --2- 172.21.15.39:0/1817181609 >> [v2:172.21.15.39:6800/1725006999,v1:172.21.15.39:6801/1725006999] conn(0x7f5a680a2c10 0x7f5a680a50d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:36:29.168 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:36:28.258+0000 7f5a7d600640 1 --2- 172.21.15.39:0/1817181609 >> [v2:172.21.15.172:6808/998885347,v1:172.21.15.172:6809/998885347] conn(0x7f5a680adde0 0x7f5a680b0280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:36:29.168 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:36:28.258+0000 7f5a7d600640 1 -- 172.21.15.39:0/1817181609 --> [v2:172.21.15.172:6808/998885347,v1:172.21.15.172:6809/998885347] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f5a680b0950 con 0x7f5a680adde0 2024-09-12T02:36:29.169 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:36:28.258+0000 7f5a7d600640 1 -- 172.21.15.39:0/1817181609 <== mon.0 v2:172.21.15.39:3300/0 6 ==== mon_get_version_reply(handle=1 version=93) ==== 24+0+0 (secure 0 0 0) 0x7f5a6c0cfde0 con 0x7f5a801049a0 2024-09-12T02:36:29.169 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:36:28.259+0000 7f5a85a00640 1 --2- 172.21.15.39:0/1817181609 >> [v2:172.21.15.172:6808/998885347,v1:172.21.15.172:6809/998885347] conn(0x7f5a680adde0 0x7f5a680b0280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:36:29.169 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:36:28.259+0000 7f5a85000640 1 --2- 172.21.15.39:0/1817181609 >> [v2:172.21.15.39:6800/1725006999,v1:172.21.15.39:6801/1725006999] conn(0x7f5a680a2c10 0x7f5a680a50d0 secure :-1 s=READY pgs=184 cs=0 l=1 rev1=1 crypto rx=0x7f5a74009cd0 tx=0x7f5a74005f90 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:36:29.169 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:36:28.259+0000 7f5a85a00640 1 --2- 172.21.15.39:0/1817181609 >> [v2:172.21.15.172:6808/998885347,v1:172.21.15.172:6809/998885347] conn(0x7f5a680adde0 0x7f5a680b0280 crc :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.5 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:36:29.169 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:36:28.260+0000 7f5a7d600640 1 -- 172.21.15.39:0/1817181609 <== osd.5 v2:172.21.15.172:6808/998885347 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7f5a680b0950 con 0x7f5a680adde0 2024-09-12T02:36:29.169 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:36:28.275+0000 7f5a87a00640 1 -- 172.21.15.39:0/1817181609 --> [v2:172.21.15.172:6808/998885347,v1:172.21.15.172:6809/998885347] -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7f5a80062dc0 con 0x7f5a680adde0 2024-09-12T02:36:29.169 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:36:28.276+0000 7f5a7d600640 1 -- 172.21.15.39:0/1817181609 <== osd.5 v2:172.21.15.172:6808/998885347 2 ==== command_reply(tid 2: 0 ) ==== 8+0+12 (crc 0 0 0) 0x7f5a80062dc0 con 0x7f5a680adde0 2024-09-12T02:36:29.169 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:36:28.276+0000 7f5a87a00640 1 -- 172.21.15.39:0/1817181609 >> [v2:172.21.15.172:6808/998885347,v1:172.21.15.172:6809/998885347] conn(0x7f5a680adde0 msgr2=0x7f5a680b0280 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:36:29.169 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:36:28.276+0000 7f5a87a00640 1 --2- 172.21.15.39:0/1817181609 >> [v2:172.21.15.172:6808/998885347,v1:172.21.15.172:6809/998885347] conn(0x7f5a680adde0 0x7f5a680b0280 crc :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:36:29.170 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:36:28.276+0000 7f5a87a00640 1 -- 172.21.15.39:0/1817181609 >> [v2:172.21.15.39:6800/1725006999,v1:172.21.15.39:6801/1725006999] conn(0x7f5a680a2c10 msgr2=0x7f5a680a50d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:36:29.170 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:36:28.276+0000 7f5a87a00640 1 --2- 172.21.15.39:0/1817181609 >> [v2:172.21.15.39:6800/1725006999,v1:172.21.15.39:6801/1725006999] conn(0x7f5a680a2c10 0x7f5a680a50d0 secure :-1 s=READY pgs=184 cs=0 l=1 rev1=1 crypto rx=0x7f5a74009cd0 tx=0x7f5a74005f90 comp rx=0 tx=0).stop 2024-09-12T02:36:29.170 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:36:28.277+0000 7f5a87a00640 1 -- 172.21.15.39:0/1817181609 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f5a801049a0 msgr2=0x7f5a8019ab30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:36:29.170 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:36:28.277+0000 7f5a87a00640 1 --2- 172.21.15.39:0/1817181609 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f5a801049a0 0x7f5a8019ab30 secure :-1 s=READY pgs=201 cs=0 l=1 rev1=1 crypto rx=0x7f5a6c00e9f0 tx=0x7f5a6c00eeb0 comp rx=0 tx=0).stop 2024-09-12T02:36:29.170 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:36:28.277+0000 7f5a85a00640 1 -- 172.21.15.39:0/1817181609 reap_dead start 2024-09-12T02:36:29.170 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:36:28.277+0000 7f5a87a00640 1 -- 172.21.15.39:0/1817181609 shutdown_connections 2024-09-12T02:36:29.170 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:36:28.277+0000 7f5a87a00640 1 -- 172.21.15.39:0/1817181609 >> 172.21.15.39:0/1817181609 conn(0x7f5a800ffa90 msgr2=0x7f5a80100d30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:36:29.170 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:36:28.277+0000 7f5a87a00640 1 -- 172.21.15.39:0/1817181609 shutdown_connections 2024-09-12T02:36:29.170 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:36:28.277+0000 7f5a87a00640 1 -- 172.21.15.39:0/1817181609 wait complete. 2024-09-12T02:36:29.761 INFO:teuthology.orchestra.run.smithi039.stderr:Inferring config /var/lib/ceph/4954ed46-70ae-11ef-bcea-c7b262605968/mon.a/config 2024-09-12T02:36:29.762 INFO:teuthology.orchestra.run.smithi039.stderr:Inferring config /var/lib/ceph/4954ed46-70ae-11ef-bcea-c7b262605968/mon.a/config 2024-09-12T02:36:30.136 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 02:36:29 smithi039 ceph-mon[30515]: pgmap v345: 129 pgs: 129 active+clean; 645 KiB data, 347 MiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 11 op/s 2024-09-12T02:36:30.168 INFO:teuthology.orchestra.run.smithi039.stdout:163208757310 2024-09-12T02:36:30.169 DEBUG:teuthology.orchestra.run.smithi039:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc shell --fsid 4954ed46-70ae-11ef-bcea-c7b262605968 -- ceph osd last-stat-seq osd.5 2024-09-12T02:36:30.198 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 12 02:36:29 smithi044 ceph-mon[35411]: pgmap v345: 129 pgs: 129 active+clean; 645 KiB data, 347 MiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 11 op/s 2024-09-12T02:36:30.263 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 12 02:36:29 smithi172 ceph-mon[35609]: pgmap v345: 129 pgs: 129 active+clean; 645 KiB data, 347 MiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 11 op/s 2024-09-12T02:36:30.500 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:36:30.357+0000 7fd8a2800640 1 -- 172.21.15.39:0/87695734 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fd89c1049c0 msgr2=0x7fd89c108a10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:36:30.500 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:36:30.357+0000 7fd8a2800640 1 --2- 172.21.15.39:0/87695734 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fd89c1049c0 0x7fd89c108a10 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0x7fd888009860 tx=0x7fd88802a340 comp rx=0 tx=0).stop 2024-09-12T02:36:30.500 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:36:30.358+0000 7fd8a2800640 1 -- 172.21.15.39:0/87695734 shutdown_connections 2024-09-12T02:36:30.500 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:36:30.358+0000 7fd8a2800640 1 --2- 172.21.15.39:0/87695734 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fd89c109140 0x7fd89c110cc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:36:30.501 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:36:30.358+0000 7fd8a2800640 1 --2- 172.21.15.39:0/87695734 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fd89c1049c0 0x7fd89c108a10 unknown :-1 s=CLOSED pgs=90 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:36:30.501 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:36:30.358+0000 7fd8a2800640 1 --2- 172.21.15.39:0/87695734 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fd89c104010 0x7fd89c1043f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:36:30.501 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:36:30.358+0000 7fd8a2800640 1 -- 172.21.15.39:0/87695734 >> 172.21.15.39:0/87695734 conn(0x7fd89c0ffa50 msgr2=0x7fd89c101e70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:36:30.501 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:36:30.358+0000 7fd8a2800640 1 -- 172.21.15.39:0/87695734 shutdown_connections 2024-09-12T02:36:30.501 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:36:30.358+0000 7fd8a2800640 1 -- 172.21.15.39:0/87695734 wait complete. 2024-09-12T02:36:30.501 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:36:30.359+0000 7fd8a2800640 1 Processor -- start 2024-09-12T02:36:30.501 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:36:30.359+0000 7fd8a2800640 1 -- start start 2024-09-12T02:36:30.501 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:36:30.359+0000 7fd8a2800640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fd89c104010 0x7fd89c19a650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:36:30.501 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:36:30.359+0000 7fd8a2800640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fd89c1049c0 0x7fd89c19ab90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:36:30.501 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:36:30.359+0000 7fd8a2800640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fd89c109140 0x7fd89c19ef20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:36:30.501 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:36:30.359+0000 7fd8a2800640 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 -- 0x7fd89c114140 con 0x7fd89c109140 2024-09-12T02:36:30.501 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:36:30.359+0000 7fd8a2800640 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x7fd89c113fc0 con 0x7fd89c1049c0 2024-09-12T02:36:30.502 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:36:30.359+0000 7fd8a2800640 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7fd89c1142c0 con 0x7fd89c104010 2024-09-12T02:36:30.502 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:36:30.360+0000 7fd89aa00640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fd89c1049c0 0x7fd89c19ab90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:36:30.502 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:36:30.360+0000 7fd89aa00640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fd89c1049c0 0x7fd89c19ab90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.39:40566/0 (socket says 172.21.15.39:40566) 2024-09-12T02:36:30.502 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:36:30.360+0000 7fd89b400640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fd89c104010 0x7fd89c19a650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:36:30.502 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:36:30.360+0000 7fd89aa00640 1 -- 172.21.15.39:0/3936314527 learned_addr learned my addr 172.21.15.39:0/3936314527 (peer_addr_for_me v2:172.21.15.39:0/0) 2024-09-12T02:36:30.502 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:36:30.360+0000 7fd89be00640 1 --2- 172.21.15.39:0/3936314527 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fd89c109140 0x7fd89c19ef20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:36:30.502 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:36:30.360+0000 7fd89aa00640 1 -- 172.21.15.39:0/3936314527 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fd89c104010 msgr2=0x7fd89c19a650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:36:30.503 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:36:30.360+0000 7fd89aa00640 1 --2- 172.21.15.39:0/3936314527 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fd89c104010 0x7fd89c19a650 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:36:30.503 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:36:30.360+0000 7fd89aa00640 1 -- 172.21.15.39:0/3936314527 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fd89c109140 msgr2=0x7fd89c19ef20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:36:30.503 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:36:30.360+0000 7fd89aa00640 1 --2- 172.21.15.39:0/3936314527 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fd89c109140 0x7fd89c19ef20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:36:30.503 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:36:30.360+0000 7fd89aa00640 1 -- 172.21.15.39:0/3936314527 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd89c19f600 con 0x7fd89c1049c0 2024-09-12T02:36:30.503 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:36:30.360+0000 7fd89aa00640 1 --2- 172.21.15.39:0/3936314527 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fd89c1049c0 0x7fd89c19ab90 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7fd888035040 tx=0x7fd888033d90 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:36:30.503 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:36:30.361+0000 7fd893e00640 1 -- 172.21.15.39:0/3936314527 <== mon.2 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd888037040 con 0x7fd89c1049c0 2024-09-12T02:36:30.503 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:36:30.361+0000 7fd8a2800640 1 -- 172.21.15.39:0/3936314527 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd89c19f890 con 0x7fd89c1049c0 2024-09-12T02:36:30.503 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:36:30.361+0000 7fd893e00640 1 -- 172.21.15.39:0/3936314527 <== mon.2 v2:172.21.15.44:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fd888040070 con 0x7fd89c1049c0 2024-09-12T02:36:30.503 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:36:30.361+0000 7fd893e00640 1 -- 172.21.15.39:0/3936314527 <== mon.2 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd8880039f0 con 0x7fd89c1049c0 2024-09-12T02:36:30.503 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:36:30.361+0000 7fd8a2800640 1 -- 172.21.15.39:0/3936314527 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd89c1a71d0 con 0x7fd89c1049c0 2024-09-12T02:36:30.503 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:36:30.362+0000 7fd8a2800640 1 -- 172.21.15.39:0/3936314527 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7fd89c062980 con 0x7fd89c1049c0 2024-09-12T02:36:30.503 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:36:30.364+0000 7fd893e00640 1 -- 172.21.15.39:0/3936314527 <== mon.2 v2:172.21.15.44:3300/0 4 ==== mgrmap(e 17) ==== 137884+0+0 (secure 0 0 0) 0x7fd888003b90 con 0x7fd89c1049c0 2024-09-12T02:36:30.503 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:36:30.365+0000 7fd893e00640 1 --2- 172.21.15.39:0/3936314527 >> [v2:172.21.15.39:6800/1725006999,v1:172.21.15.39:6801/1725006999] conn(0x7fd8800a2c90 0x7fd8800a5150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:36:30.504 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:36:30.365+0000 7fd893e00640 1 -- 172.21.15.39:0/3936314527 <== mon.2 v2:172.21.15.44:3300/0 5 ==== osd_map(93..93 src has 1..93) ==== 9092+0+0 (secure 0 0 0) 0x7fd8880efe60 con 0x7fd89c1049c0 2024-09-12T02:36:30.504 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:36:30.366+0000 7fd893e00640 1 --2- 172.21.15.39:0/3936314527 >> [v2:172.21.15.172:6816/1162792895,v1:172.21.15.172:6817/1162792895] conn(0x7fd8800ade60 0x7fd8800b0300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:36:30.504 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:36:30.366+0000 7fd893e00640 1 -- 172.21.15.39:0/3936314527 --> [v2:172.21.15.172:6816/1162792895,v1:172.21.15.172:6817/1162792895] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7fd88800b0b0 con 0x7fd8800ade60 2024-09-12T02:36:30.504 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:36:30.366+0000 7fd893e00640 1 -- 172.21.15.39:0/3936314527 <== mon.2 v2:172.21.15.44:3300/0 6 ==== mon_get_version_reply(handle=1 version=93) ==== 24+0+0 (secure 0 0 0) 0x7fd8880f0210 con 0x7fd89c1049c0 2024-09-12T02:36:30.504 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:36:30.366+0000 7fd89b400640 1 --2- 172.21.15.39:0/3936314527 >> [v2:172.21.15.39:6800/1725006999,v1:172.21.15.39:6801/1725006999] conn(0x7fd8800a2c90 0x7fd8800a5150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:36:30.504 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:36:30.366+0000 7fd89be00640 1 --2- 172.21.15.39:0/3936314527 >> [v2:172.21.15.172:6816/1162792895,v1:172.21.15.172:6817/1162792895] conn(0x7fd8800ade60 0x7fd8800b0300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:36:30.504 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:36:30.367+0000 7fd89b400640 1 --2- 172.21.15.39:0/3936314527 >> [v2:172.21.15.39:6800/1725006999,v1:172.21.15.39:6801/1725006999] conn(0x7fd8800a2c90 0x7fd8800a5150 secure :-1 s=READY pgs=186 cs=0 l=1 rev1=1 crypto rx=0x7fd88c005fd0 tx=0x7fd88c009260 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:36:30.504 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:36:30.367+0000 7fd89be00640 1 --2- 172.21.15.39:0/3936314527 >> [v2:172.21.15.172:6816/1162792895,v1:172.21.15.172:6817/1162792895] conn(0x7fd8800ade60 0x7fd8800b0300 crc :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.8 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:36:30.504 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:36:30.375+0000 7fd893e00640 1 -- 172.21.15.39:0/3936314527 <== osd.8 v2:172.21.15.172:6816/1162792895 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7fd88800b0b0 con 0x7fd8800ade60 2024-09-12T02:36:30.504 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:36:30.390+0000 7fd8a2800640 1 -- 172.21.15.39:0/3936314527 --> [v2:172.21.15.172:6816/1162792895,v1:172.21.15.172:6817/1162792895] -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7fd89c062d80 con 0x7fd8800ade60 2024-09-12T02:36:30.505 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:36:30.391+0000 7fd893e00640 1 -- 172.21.15.39:0/3936314527 <== osd.8 v2:172.21.15.172:6816/1162792895 2 ==== command_reply(tid 2: 0 ) ==== 8+0+12 (crc 0 0 0) 0x7fd89c062d80 con 0x7fd8800ade60 2024-09-12T02:36:30.505 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:36:30.391+0000 7fd8a2800640 1 -- 172.21.15.39:0/3936314527 >> [v2:172.21.15.172:6816/1162792895,v1:172.21.15.172:6817/1162792895] conn(0x7fd8800ade60 msgr2=0x7fd8800b0300 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:36:30.505 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:36:30.391+0000 7fd8a2800640 1 --2- 172.21.15.39:0/3936314527 >> [v2:172.21.15.172:6816/1162792895,v1:172.21.15.172:6817/1162792895] conn(0x7fd8800ade60 0x7fd8800b0300 crc :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:36:30.505 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:36:30.391+0000 7fd8a2800640 1 -- 172.21.15.39:0/3936314527 >> [v2:172.21.15.39:6800/1725006999,v1:172.21.15.39:6801/1725006999] conn(0x7fd8800a2c90 msgr2=0x7fd8800a5150 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:36:30.505 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:36:30.391+0000 7fd8a2800640 1 --2- 172.21.15.39:0/3936314527 >> [v2:172.21.15.39:6800/1725006999,v1:172.21.15.39:6801/1725006999] conn(0x7fd8800a2c90 0x7fd8800a5150 secure :-1 s=READY pgs=186 cs=0 l=1 rev1=1 crypto rx=0x7fd88c005fd0 tx=0x7fd88c009260 comp rx=0 tx=0).stop 2024-09-12T02:36:30.506 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:36:30.391+0000 7fd8a2800640 1 -- 172.21.15.39:0/3936314527 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fd89c1049c0 msgr2=0x7fd89c19ab90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:36:30.506 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:36:30.391+0000 7fd8a2800640 1 --2- 172.21.15.39:0/3936314527 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fd89c1049c0 0x7fd89c19ab90 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7fd888035040 tx=0x7fd888033d90 comp rx=0 tx=0).stop 2024-09-12T02:36:30.506 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:36:30.391+0000 7fd89be00640 1 -- 172.21.15.39:0/3936314527 reap_dead start 2024-09-12T02:36:30.506 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:36:30.392+0000 7fd8a2800640 1 -- 172.21.15.39:0/3936314527 shutdown_connections 2024-09-12T02:36:30.506 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:36:30.392+0000 7fd8a2800640 1 -- 172.21.15.39:0/3936314527 >> 172.21.15.39:0/3936314527 conn(0x7fd89c0ffa50 msgr2=0x7fd89c100e30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:36:30.506 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:36:30.392+0000 7fd8a2800640 1 -- 172.21.15.39:0/3936314527 shutdown_connections 2024-09-12T02:36:30.506 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:36:30.392+0000 7fd8a2800640 1 -- 172.21.15.39:0/3936314527 wait complete. 2024-09-12T02:36:31.284 INFO:teuthology.orchestra.run.smithi039.stdout:141733920836 2024-09-12T02:36:31.284 DEBUG:teuthology.orchestra.run.smithi039:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc shell --fsid 4954ed46-70ae-11ef-bcea-c7b262605968 -- ceph osd last-stat-seq osd.4 2024-09-12T02:36:31.732 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:36:29.174+0000 7fc48f400640 1 -- 172.21.15.39:0/43336001 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fc4881049c0 msgr2=0x7fc488108a10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:36:31.732 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:36:29.174+0000 7fc48f400640 1 --2- 172.21.15.39:0/43336001 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fc4881049c0 0x7fc488108a10 secure :-1 s=READY pgs=202 cs=0 l=1 rev1=1 crypto rx=0x7fc474009900 tx=0x7fc47402a3f0 comp rx=0 tx=0).stop 2024-09-12T02:36:31.732 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:36:29.174+0000 7fc48f400640 1 -- 172.21.15.39:0/43336001 shutdown_connections 2024-09-12T02:36:31.732 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:36:29.174+0000 7fc48f400640 1 --2- 172.21.15.39:0/43336001 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fc488109140 0x7fc488110cc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:36:31.732 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:36:29.174+0000 7fc48f400640 1 --2- 172.21.15.39:0/43336001 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fc4881049c0 0x7fc488108a10 unknown :-1 s=CLOSED pgs=202 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:36:31.733 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:36:29.174+0000 7fc48f400640 1 --2- 172.21.15.39:0/43336001 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fc488104010 0x7fc4881043f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:36:31.733 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:36:29.174+0000 7fc48f400640 1 -- 172.21.15.39:0/43336001 >> 172.21.15.39:0/43336001 conn(0x7fc4880ffa50 msgr2=0x7fc488101e70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:36:31.733 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:36:29.174+0000 7fc48f400640 1 -- 172.21.15.39:0/43336001 shutdown_connections 2024-09-12T02:36:31.733 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:36:29.174+0000 7fc48f400640 1 -- 172.21.15.39:0/43336001 wait complete. 2024-09-12T02:36:31.733 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:36:29.175+0000 7fc48f400640 1 Processor -- start 2024-09-12T02:36:31.733 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:36:29.176+0000 7fc48f400640 1 -- start start 2024-09-12T02:36:31.733 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:36:29.176+0000 7fc48f400640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fc488104010 0x7fc48819a6b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:36:31.733 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:36:29.176+0000 7fc48f400640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fc4881049c0 0x7fc48819abf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:36:31.733 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:36:29.176+0000 7fc48f400640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fc488109140 0x7fc48819ef80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:36:31.733 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:36:29.176+0000 7fc48f400640 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 -- 0x7fc4881141b0 con 0x7fc488104010 2024-09-12T02:36:31.733 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:36:29.176+0000 7fc48f400640 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x7fc488114030 con 0x7fc4881049c0 2024-09-12T02:36:31.733 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:36:29.176+0000 7fc48f400640 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7fc488114330 con 0x7fc488109140 2024-09-12T02:36:31.733 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:36:29.176+0000 7fc48ca00640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fc488104010 0x7fc48819a6b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:36:31.734 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:36:29.176+0000 7fc48ca00640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fc488104010 0x7fc48819a6b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.39:3300/0 says I am v2:172.21.15.39:39018/0 (socket says 172.21.15.39:39018) 2024-09-12T02:36:31.734 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:36:29.176+0000 7fc48ca00640 1 -- 172.21.15.39:0/3097092465 learned_addr learned my addr 172.21.15.39:0/3097092465 (peer_addr_for_me v2:172.21.15.39:0/0) 2024-09-12T02:36:31.734 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:36:29.176+0000 7fc487e00640 1 --2- 172.21.15.39:0/3097092465 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fc4881049c0 0x7fc48819abf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:36:31.734 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:36:29.176+0000 7fc48d400640 1 --2- 172.21.15.39:0/3097092465 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fc488109140 0x7fc48819ef80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:36:31.734 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:36:29.177+0000 7fc48ca00640 1 -- 172.21.15.39:0/3097092465 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fc488109140 msgr2=0x7fc48819ef80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:36:31.734 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:36:29.177+0000 7fc48ca00640 1 --2- 172.21.15.39:0/3097092465 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fc488109140 0x7fc48819ef80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:36:31.734 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:36:29.177+0000 7fc48ca00640 1 -- 172.21.15.39:0/3097092465 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fc4881049c0 msgr2=0x7fc48819abf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:36:31.734 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:36:29.177+0000 7fc48ca00640 1 --2- 172.21.15.39:0/3097092465 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fc4881049c0 0x7fc48819abf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:36:31.734 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:36:29.177+0000 7fc48ca00640 1 -- 172.21.15.39:0/3097092465 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc48819f660 con 0x7fc488104010 2024-09-12T02:36:31.734 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:36:29.177+0000 7fc48d400640 1 --2- 172.21.15.39:0/3097092465 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fc488109140 0x7fc48819ef80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-12T02:36:31.734 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:36:29.177+0000 7fc48ca00640 1 --2- 172.21.15.39:0/3097092465 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fc488104010 0x7fc48819a6b0 secure :-1 s=READY pgs=203 cs=0 l=1 rev1=1 crypto rx=0x7fc47c00ea60 tx=0x7fc47c00ef20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:36:31.734 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:36:29.177+0000 7fc485600640 1 -- 172.21.15.39:0/3097092465 <== mon.0 v2:172.21.15.39:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc47c00cde0 con 0x7fc488104010 2024-09-12T02:36:31.734 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:36:29.177+0000 7fc485600640 1 -- 172.21.15.39:0/3097092465 <== mon.0 v2:172.21.15.39:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fc47c0035f0 con 0x7fc488104010 2024-09-12T02:36:31.735 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:36:29.177+0000 7fc48f400640 1 -- 172.21.15.39:0/3097092465 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc48819f950 con 0x7fc488104010 2024-09-12T02:36:31.735 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:36:29.177+0000 7fc485600640 1 -- 172.21.15.39:0/3097092465 <== mon.0 v2:172.21.15.39:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc47c010670 con 0x7fc488104010 2024-09-12T02:36:31.735 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:36:29.178+0000 7fc48f400640 1 -- 172.21.15.39:0/3097092465 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc4881a7230 con 0x7fc488104010 2024-09-12T02:36:31.735 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:36:29.178+0000 7fc48f400640 1 -- 172.21.15.39:0/3097092465 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7fc4880628c0 con 0x7fc488104010 2024-09-12T02:36:31.735 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:36:29.182+0000 7fc485600640 1 -- 172.21.15.39:0/3097092465 <== mon.0 v2:172.21.15.39:3300/0 4 ==== mgrmap(e 17) ==== 137884+0+0 (secure 0 0 0) 0x7fc47c0037a0 con 0x7fc488104010 2024-09-12T02:36:31.735 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:36:29.183+0000 7fc485600640 1 --2- 172.21.15.39:0/3097092465 >> [v2:172.21.15.39:6800/1725006999,v1:172.21.15.39:6801/1725006999] conn(0x7fc4700a2c10 0x7fc4700a50d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:36:31.735 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:36:29.184+0000 7fc485600640 1 -- 172.21.15.39:0/3097092465 <== mon.0 v2:172.21.15.39:3300/0 5 ==== osd_map(93..93 src has 1..93) ==== 9092+0+0 (secure 0 0 0) 0x7fc47c0cfca0 con 0x7fc488104010 2024-09-12T02:36:31.735 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:36:29.184+0000 7fc487e00640 1 --2- 172.21.15.39:0/3097092465 >> [v2:172.21.15.39:6800/1725006999,v1:172.21.15.39:6801/1725006999] conn(0x7fc4700a2c10 0x7fc4700a50d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:36:31.735 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:36:29.184+0000 7fc485600640 1 --2- 172.21.15.39:0/3097092465 >> [v2:172.21.15.39:6810/2013565859,v1:172.21.15.39:6811/2013565859] conn(0x7fc4700adde0 0x7fc4700b0280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:36:31.735 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:36:29.184+0000 7fc485600640 1 -- 172.21.15.39:0/3097092465 --> [v2:172.21.15.39:6810/2013565859,v1:172.21.15.39:6811/2013565859] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7fc47c01aec0 con 0x7fc4700adde0 2024-09-12T02:36:31.735 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:36:29.184+0000 7fc485600640 1 -- 172.21.15.39:0/3097092465 <== mon.0 v2:172.21.15.39:3300/0 6 ==== mon_get_version_reply(handle=1 version=93) ==== 24+0+0 (secure 0 0 0) 0x7fc47c0d0050 con 0x7fc488104010 2024-09-12T02:36:31.735 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:36:29.184+0000 7fc48d400640 1 --2- 172.21.15.39:0/3097092465 >> [v2:172.21.15.39:6810/2013565859,v1:172.21.15.39:6811/2013565859] conn(0x7fc4700adde0 0x7fc4700b0280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:36:31.735 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:36:29.185+0000 7fc487e00640 1 --2- 172.21.15.39:0/3097092465 >> [v2:172.21.15.39:6800/1725006999,v1:172.21.15.39:6801/1725006999] conn(0x7fc4700a2c10 0x7fc4700a50d0 secure :-1 s=READY pgs=185 cs=0 l=1 rev1=1 crypto rx=0x7fc474000c00 tx=0x7fc474005a20 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:36:31.736 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:36:29.185+0000 7fc48d400640 1 --2- 172.21.15.39:0/3097092465 >> [v2:172.21.15.39:6810/2013565859,v1:172.21.15.39:6811/2013565859] conn(0x7fc4700adde0 0x7fc4700b0280 crc :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:36:31.736 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:36:29.186+0000 7fc485600640 1 -- 172.21.15.39:0/3097092465 <== osd.3 v2:172.21.15.39:6810/2013565859 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7fc47c01aec0 con 0x7fc4700adde0 2024-09-12T02:36:31.736 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:36:29.200+0000 7fc48f400640 1 -- 172.21.15.39:0/3097092465 --> [v2:172.21.15.39:6810/2013565859,v1:172.21.15.39:6811/2013565859] -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7fc488062d40 con 0x7fc4700adde0 2024-09-12T02:36:31.736 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:36:29.201+0000 7fc485600640 1 -- 172.21.15.39:0/3097092465 <== osd.3 v2:172.21.15.39:6810/2013565859 2 ==== command_reply(tid 2: 0 ) ==== 8+0+12 (crc 0 0 0) 0x7fc488062d40 con 0x7fc4700adde0 2024-09-12T02:36:31.736 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:36:29.201+0000 7fc48f400640 1 -- 172.21.15.39:0/3097092465 >> [v2:172.21.15.39:6810/2013565859,v1:172.21.15.39:6811/2013565859] conn(0x7fc4700adde0 msgr2=0x7fc4700b0280 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:36:31.736 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:36:29.201+0000 7fc48f400640 1 --2- 172.21.15.39:0/3097092465 >> [v2:172.21.15.39:6810/2013565859,v1:172.21.15.39:6811/2013565859] conn(0x7fc4700adde0 0x7fc4700b0280 crc :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:36:31.736 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:36:29.202+0000 7fc48f400640 1 -- 172.21.15.39:0/3097092465 >> [v2:172.21.15.39:6800/1725006999,v1:172.21.15.39:6801/1725006999] conn(0x7fc4700a2c10 msgr2=0x7fc4700a50d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:36:31.737 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:36:29.202+0000 7fc48f400640 1 --2- 172.21.15.39:0/3097092465 >> [v2:172.21.15.39:6800/1725006999,v1:172.21.15.39:6801/1725006999] conn(0x7fc4700a2c10 0x7fc4700a50d0 secure :-1 s=READY pgs=185 cs=0 l=1 rev1=1 crypto rx=0x7fc474000c00 tx=0x7fc474005a20 comp rx=0 tx=0).stop 2024-09-12T02:36:31.737 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:36:29.202+0000 7fc48f400640 1 -- 172.21.15.39:0/3097092465 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fc488104010 msgr2=0x7fc48819a6b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:36:31.737 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:36:29.202+0000 7fc48f400640 1 --2- 172.21.15.39:0/3097092465 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fc488104010 0x7fc48819a6b0 secure :-1 s=READY pgs=203 cs=0 l=1 rev1=1 crypto rx=0x7fc47c00ea60 tx=0x7fc47c00ef20 comp rx=0 tx=0).stop 2024-09-12T02:36:31.737 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:36:29.202+0000 7fc48d400640 1 -- 172.21.15.39:0/3097092465 reap_dead start 2024-09-12T02:36:31.737 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:36:29.202+0000 7fc48f400640 1 -- 172.21.15.39:0/3097092465 shutdown_connections 2024-09-12T02:36:31.737 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:36:29.202+0000 7fc48f400640 1 -- 172.21.15.39:0/3097092465 >> 172.21.15.39:0/3097092465 conn(0x7fc4880ffa50 msgr2=0x7fc488100d60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:36:31.737 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:36:29.202+0000 7fc48f400640 1 -- 172.21.15.39:0/3097092465 shutdown_connections 2024-09-12T02:36:31.737 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:36:29.202+0000 7fc48f400640 1 -- 172.21.15.39:0/3097092465 wait complete. 2024-09-12T02:36:32.198 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 12 02:36:31 smithi044 ceph-mon[35411]: pgmap v346: 129 pgs: 129 active+clean; 645 KiB data, 347 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2024-09-12T02:36:32.200 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 02:36:31 smithi039 ceph-mon[30515]: pgmap v346: 129 pgs: 129 active+clean; 645 KiB data, 347 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2024-09-12T02:36:32.264 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 12 02:36:31 smithi172 ceph-mon[35609]: pgmap v346: 129 pgs: 129 active+clean; 645 KiB data, 347 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2024-09-12T02:36:32.950 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:36:32.853+0000 7fbe93600640 1 -- 172.21.15.39:0/3633729726 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fbe8c1049c0 msgr2=0x7fbe8c108a10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:36:32.951 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:36:32.853+0000 7fbe93600640 1 --2- 172.21.15.39:0/3633729726 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fbe8c1049c0 0x7fbe8c108a10 secure :-1 s=READY pgs=204 cs=0 l=1 rev1=1 crypto rx=0x7fbe78009900 tx=0x7fbe7802a410 comp rx=0 tx=0).stop 2024-09-12T02:36:32.951 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:36:32.853+0000 7fbe93600640 1 -- 172.21.15.39:0/3633729726 shutdown_connections 2024-09-12T02:36:32.951 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:36:32.853+0000 7fbe93600640 1 --2- 172.21.15.39:0/3633729726 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fbe8c109140 0x7fbe8c110cc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:36:32.951 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:36:32.853+0000 7fbe93600640 1 --2- 172.21.15.39:0/3633729726 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fbe8c1049c0 0x7fbe8c108a10 unknown :-1 s=CLOSED pgs=204 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:36:32.951 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:36:32.853+0000 7fbe93600640 1 --2- 172.21.15.39:0/3633729726 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fbe8c104010 0x7fbe8c1043f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:36:32.952 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:36:32.853+0000 7fbe93600640 1 -- 172.21.15.39:0/3633729726 >> 172.21.15.39:0/3633729726 conn(0x7fbe8c0ffa50 msgr2=0x7fbe8c101e70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:36:32.952 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:36:32.853+0000 7fbe93600640 1 -- 172.21.15.39:0/3633729726 shutdown_connections 2024-09-12T02:36:32.952 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:36:32.853+0000 7fbe93600640 1 -- 172.21.15.39:0/3633729726 wait complete. 2024-09-12T02:36:32.952 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:36:32.854+0000 7fbe93600640 1 Processor -- start 2024-09-12T02:36:32.952 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:36:32.854+0000 7fbe93600640 1 -- start start 2024-09-12T02:36:32.953 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:36:32.854+0000 7fbe93600640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fbe8c104010 0x7fbe8c19a6b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:36:32.953 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:36:32.854+0000 7fbe93600640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fbe8c1049c0 0x7fbe8c19abf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:36:32.953 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:36:32.854+0000 7fbe93600640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fbe8c109140 0x7fbe8c19ef80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:36:32.953 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:36:32.854+0000 7fbe93600640 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 -- 0x7fbe8c1141b0 con 0x7fbe8c104010 2024-09-12T02:36:32.953 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:36:32.854+0000 7fbe93600640 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x7fbe8c114030 con 0x7fbe8c109140 2024-09-12T02:36:32.953 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:36:32.854+0000 7fbe93600640 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7fbe8c114330 con 0x7fbe8c1049c0 2024-09-12T02:36:32.953 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:36:32.855+0000 7fbe8be00640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fbe8c1049c0 0x7fbe8c19abf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:36:32.953 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:36:32.855+0000 7fbe90c00640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fbe8c104010 0x7fbe8c19a6b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:36:32.953 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:36:32.855+0000 7fbe90c00640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fbe8c104010 0x7fbe8c19a6b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.39:3300/0 says I am v2:172.21.15.39:39044/0 (socket says 172.21.15.39:39044) 2024-09-12T02:36:32.953 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:36:32.855+0000 7fbe90c00640 1 -- 172.21.15.39:0/2827454155 learned_addr learned my addr 172.21.15.39:0/2827454155 (peer_addr_for_me v2:172.21.15.39:0/0) 2024-09-12T02:36:32.953 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:36:32.855+0000 7fbe8be00640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fbe8c1049c0 0x7fbe8c19abf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.172:3300/0 says I am v2:172.21.15.39:51160/0 (socket says 172.21.15.39:51160) 2024-09-12T02:36:32.953 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:36:32.855+0000 7fbe91600640 1 --2- 172.21.15.39:0/2827454155 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fbe8c109140 0x7fbe8c19ef80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:36:32.954 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:36:32.855+0000 7fbe90c00640 1 -- 172.21.15.39:0/2827454155 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fbe8c1049c0 msgr2=0x7fbe8c19abf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:36:32.954 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:36:32.855+0000 7fbe90c00640 1 --2- 172.21.15.39:0/2827454155 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fbe8c1049c0 0x7fbe8c19abf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:36:32.954 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:36:32.855+0000 7fbe90c00640 1 -- 172.21.15.39:0/2827454155 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fbe8c109140 msgr2=0x7fbe8c19ef80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:36:32.954 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:36:32.855+0000 7fbe90c00640 1 --2- 172.21.15.39:0/2827454155 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fbe8c109140 0x7fbe8c19ef80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:36:32.954 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:36:32.855+0000 7fbe90c00640 1 -- 172.21.15.39:0/2827454155 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fbe8c19f660 con 0x7fbe8c104010 2024-09-12T02:36:32.954 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:36:32.855+0000 7fbe91600640 1 --2- 172.21.15.39:0/2827454155 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fbe8c109140 0x7fbe8c19ef80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-12T02:36:32.954 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:36:32.856+0000 7fbe90c00640 1 --2- 172.21.15.39:0/2827454155 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fbe8c104010 0x7fbe8c19a6b0 secure :-1 s=READY pgs=205 cs=0 l=1 rev1=1 crypto rx=0x7fbe8000e9f0 tx=0x7fbe8000eeb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:36:32.954 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:36:32.856+0000 7fbe89600640 1 -- 172.21.15.39:0/2827454155 <== mon.0 v2:172.21.15.39:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbe8000cd80 con 0x7fbe8c104010 2024-09-12T02:36:32.954 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:36:32.856+0000 7fbe89600640 1 -- 172.21.15.39:0/2827454155 <== mon.0 v2:172.21.15.39:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fbe80010910 con 0x7fbe8c104010 2024-09-12T02:36:32.954 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:36:32.856+0000 7fbe89600640 1 -- 172.21.15.39:0/2827454155 <== mon.0 v2:172.21.15.39:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbe80018990 con 0x7fbe8c104010 2024-09-12T02:36:32.954 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:36:32.856+0000 7fbe93600640 1 -- 172.21.15.39:0/2827454155 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fbe8c19f950 con 0x7fbe8c104010 2024-09-12T02:36:32.954 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:36:32.856+0000 7fbe93600640 1 -- 172.21.15.39:0/2827454155 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fbe8c1a7230 con 0x7fbe8c104010 2024-09-12T02:36:32.955 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:36:32.857+0000 7fbe93600640 1 -- 172.21.15.39:0/2827454155 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7fbe8c062900 con 0x7fbe8c104010 2024-09-12T02:36:32.955 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:36:32.859+0000 7fbe89600640 1 -- 172.21.15.39:0/2827454155 <== mon.0 v2:172.21.15.39:3300/0 4 ==== mgrmap(e 17) ==== 137884+0+0 (secure 0 0 0) 0x7fbe80010ac0 con 0x7fbe8c104010 2024-09-12T02:36:32.955 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:36:32.861+0000 7fbe89600640 1 --2- 172.21.15.39:0/2827454155 >> [v2:172.21.15.39:6800/1725006999,v1:172.21.15.39:6801/1725006999] conn(0x7fbe740a2c10 0x7fbe740a50d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:36:32.955 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:36:32.861+0000 7fbe89600640 1 -- 172.21.15.39:0/2827454155 <== mon.0 v2:172.21.15.39:3300/0 5 ==== osd_map(93..93 src has 1..93) ==== 9092+0+0 (secure 0 0 0) 0x7fbe800cff10 con 0x7fbe8c104010 2024-09-12T02:36:32.955 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:36:32.861+0000 7fbe8be00640 1 --2- 172.21.15.39:0/2827454155 >> [v2:172.21.15.39:6800/1725006999,v1:172.21.15.39:6801/1725006999] conn(0x7fbe740a2c10 0x7fbe740a50d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:36:32.955 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:36:32.861+0000 7fbe89600640 1 --2- 172.21.15.39:0/2827454155 >> [v2:172.21.15.44:6816/709635079,v1:172.21.15.44:6817/709635079] conn(0x7fbe740adde0 0x7fbe740b0280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:36:32.955 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:36:32.861+0000 7fbe89600640 1 -- 172.21.15.39:0/2827454155 --> [v2:172.21.15.44:6816/709635079,v1:172.21.15.44:6817/709635079] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7fbe80022e50 con 0x7fbe740adde0 2024-09-12T02:36:32.956 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:36:32.861+0000 7fbe89600640 1 -- 172.21.15.39:0/2827454155 <== mon.0 v2:172.21.15.39:3300/0 6 ==== mon_get_version_reply(handle=1 version=93) ==== 24+0+0 (secure 0 0 0) 0x7fbe800d02c0 con 0x7fbe8c104010 2024-09-12T02:36:32.956 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:36:32.862+0000 7fbe91600640 1 --2- 172.21.15.39:0/2827454155 >> [v2:172.21.15.44:6816/709635079,v1:172.21.15.44:6817/709635079] conn(0x7fbe740adde0 0x7fbe740b0280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:36:32.956 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:36:32.862+0000 7fbe8be00640 1 --2- 172.21.15.39:0/2827454155 >> [v2:172.21.15.39:6800/1725006999,v1:172.21.15.39:6801/1725006999] conn(0x7fbe740a2c10 0x7fbe740a50d0 secure :-1 s=READY pgs=187 cs=0 l=1 rev1=1 crypto rx=0x7fbe78000c00 tx=0x7fbe78005b50 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:36:32.956 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:36:32.862+0000 7fbe91600640 1 --2- 172.21.15.39:0/2827454155 >> [v2:172.21.15.44:6816/709635079,v1:172.21.15.44:6817/709635079] conn(0x7fbe740adde0 0x7fbe740b0280 crc :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.7 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:36:32.956 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:36:32.863+0000 7fbe89600640 1 -- 172.21.15.39:0/2827454155 <== osd.7 v2:172.21.15.44:6816/709635079 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7fbe80022e50 con 0x7fbe740adde0 2024-09-12T02:36:32.956 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:36:32.878+0000 7fbe93600640 1 -- 172.21.15.39:0/2827454155 --> [v2:172.21.15.44:6816/709635079,v1:172.21.15.44:6817/709635079] -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7fbe8c062d00 con 0x7fbe740adde0 2024-09-12T02:36:32.956 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:36:32.879+0000 7fbe89600640 1 -- 172.21.15.39:0/2827454155 <== osd.7 v2:172.21.15.44:6816/709635079 2 ==== command_reply(tid 2: 0 ) ==== 8+0+12 (crc 0 0 0) 0x7fbe8c062d00 con 0x7fbe740adde0 2024-09-12T02:36:32.956 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:36:32.879+0000 7fbe93600640 1 -- 172.21.15.39:0/2827454155 >> [v2:172.21.15.44:6816/709635079,v1:172.21.15.44:6817/709635079] conn(0x7fbe740adde0 msgr2=0x7fbe740b0280 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:36:32.956 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:36:32.879+0000 7fbe93600640 1 --2- 172.21.15.39:0/2827454155 >> [v2:172.21.15.44:6816/709635079,v1:172.21.15.44:6817/709635079] conn(0x7fbe740adde0 0x7fbe740b0280 crc :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:36:32.956 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:36:32.879+0000 7fbe93600640 1 -- 172.21.15.39:0/2827454155 >> [v2:172.21.15.39:6800/1725006999,v1:172.21.15.39:6801/1725006999] conn(0x7fbe740a2c10 msgr2=0x7fbe740a50d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:36:32.956 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:36:32.879+0000 7fbe93600640 1 --2- 172.21.15.39:0/2827454155 >> [v2:172.21.15.39:6800/1725006999,v1:172.21.15.39:6801/1725006999] conn(0x7fbe740a2c10 0x7fbe740a50d0 secure :-1 s=READY pgs=187 cs=0 l=1 rev1=1 crypto rx=0x7fbe78000c00 tx=0x7fbe78005b50 comp rx=0 tx=0).stop 2024-09-12T02:36:32.956 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:36:32.879+0000 7fbe93600640 1 -- 172.21.15.39:0/2827454155 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fbe8c104010 msgr2=0x7fbe8c19a6b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:36:32.957 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:36:32.879+0000 7fbe93600640 1 --2- 172.21.15.39:0/2827454155 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fbe8c104010 0x7fbe8c19a6b0 secure :-1 s=READY pgs=205 cs=0 l=1 rev1=1 crypto rx=0x7fbe8000e9f0 tx=0x7fbe8000eeb0 comp rx=0 tx=0).stop 2024-09-12T02:36:32.957 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:36:32.879+0000 7fbe91600640 1 -- 172.21.15.39:0/2827454155 reap_dead start 2024-09-12T02:36:32.957 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:36:32.879+0000 7fbe93600640 1 -- 172.21.15.39:0/2827454155 shutdown_connections 2024-09-12T02:36:32.957 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:36:32.879+0000 7fbe93600640 1 -- 172.21.15.39:0/2827454155 >> 172.21.15.39:0/2827454155 conn(0x7fbe8c0ffa50 msgr2=0x7fbe8c100d60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:36:32.957 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:36:32.880+0000 7fbe93600640 1 -- 172.21.15.39:0/2827454155 shutdown_connections 2024-09-12T02:36:32.957 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:36:32.880+0000 7fbe93600640 1 -- 172.21.15.39:0/2827454155 wait complete. 2024-09-12T02:36:33.410 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:36:32.979+0000 7f064e400640 1 -- 172.21.15.39:0/3859986167 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f064810e280 msgr2=0x7f0648110670 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:36:33.410 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:36:32.979+0000 7f064e400640 1 --2- 172.21.15.39:0/3859986167 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f064810e280 0x7f0648110670 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7f0640009be0 tx=0x7f064002a750 comp rx=0 tx=0).stop 2024-09-12T02:36:33.410 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:36:32.979+0000 7f064e400640 1 -- 172.21.15.39:0/3859986167 shutdown_connections 2024-09-12T02:36:33.410 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:36:32.979+0000 7f064e400640 1 --2- 172.21.15.39:0/3859986167 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f064810e280 0x7f0648110670 unknown :-1 s=CLOSED pgs=91 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:36:33.410 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:36:32.979+0000 7f064e400640 1 --2- 172.21.15.39:0/3859986167 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f0648074e30 0x7f064810dd40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:36:33.410 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:36:32.979+0000 7f064e400640 1 --2- 172.21.15.39:0/3859986167 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f0648074510 0x7f06480748f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:36:33.410 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:36:32.979+0000 7f064e400640 1 -- 172.21.15.39:0/3859986167 >> 172.21.15.39:0/3859986167 conn(0x7f06480fd740 msgr2=0x7f06480ffb60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:36:33.410 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:36:32.979+0000 7f064e400640 1 -- 172.21.15.39:0/3859986167 shutdown_connections 2024-09-12T02:36:33.410 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:36:32.979+0000 7f064e400640 1 -- 172.21.15.39:0/3859986167 wait complete. 2024-09-12T02:36:33.410 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:36:32.980+0000 7f064e400640 1 Processor -- start 2024-09-12T02:36:33.411 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:36:32.980+0000 7f064e400640 1 -- start start 2024-09-12T02:36:33.411 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:36:32.981+0000 7f064e400640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f0648074510 0x7f064819a4f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:36:33.411 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:36:32.981+0000 7f064e400640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f0648074e30 0x7f064819aa30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:36:33.411 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:36:32.981+0000 7f064e400640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f064810e280 0x7f064819edc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:36:33.411 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:36:32.981+0000 7f064e400640 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 -- 0x7f0648113f40 con 0x7f0648074e30 2024-09-12T02:36:33.411 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:36:32.981+0000 7f064e400640 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x7f0648113dc0 con 0x7f064810e280 2024-09-12T02:36:33.411 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:36:32.981+0000 7f064e400640 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7f06481140c0 con 0x7f0648074510 2024-09-12T02:36:33.411 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:36:32.981+0000 7f0647e00640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f0648074e30 0x7f064819aa30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:36:33.411 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:36:32.981+0000 7f064da00640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f064810e280 0x7f064819edc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:36:33.411 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:36:32.981+0000 7f064d000640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f0648074510 0x7f064819a4f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:36:33.411 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:36:32.981+0000 7f064da00640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f064810e280 0x7f064819edc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.39:40588/0 (socket says 172.21.15.39:40588) 2024-09-12T02:36:33.411 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:36:32.981+0000 7f064da00640 1 -- 172.21.15.39:0/1677911566 learned_addr learned my addr 172.21.15.39:0/1677911566 (peer_addr_for_me v2:172.21.15.39:0/0) 2024-09-12T02:36:33.411 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:36:32.981+0000 7f064d000640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f0648074510 0x7f064819a4f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.172:3300/0 says I am v2:172.21.15.39:51182/0 (socket says 172.21.15.39:51182) 2024-09-12T02:36:33.411 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:36:32.981+0000 7f064d000640 1 -- 172.21.15.39:0/1677911566 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f064810e280 msgr2=0x7f064819edc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:36:33.412 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:36:32.981+0000 7f064d000640 1 --2- 172.21.15.39:0/1677911566 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f064810e280 0x7f064819edc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:36:33.412 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:36:32.981+0000 7f064d000640 1 -- 172.21.15.39:0/1677911566 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f0648074e30 msgr2=0x7f064819aa30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:36:33.412 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:36:32.982+0000 7f064d000640 1 --2- 172.21.15.39:0/1677911566 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f0648074e30 0x7f064819aa30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:36:33.412 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:36:32.982+0000 7f064d000640 1 -- 172.21.15.39:0/1677911566 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f064819f4a0 con 0x7f0648074510 2024-09-12T02:36:33.412 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:36:32.982+0000 7f064da00640 1 --2- 172.21.15.39:0/1677911566 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f064810e280 0x7f064819edc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-12T02:36:33.412 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:36:32.982+0000 7f0647e00640 1 --2- 172.21.15.39:0/1677911566 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f0648074e30 0x7f064819aa30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-12T02:36:33.412 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:36:32.982+0000 7f064d000640 1 --2- 172.21.15.39:0/1677911566 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f0648074510 0x7f064819a4f0 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0x7f063c005fd0 tx=0x7f063c00ee50 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:36:33.412 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:36:32.982+0000 7f0645600640 1 -- 172.21.15.39:0/1677911566 <== mon.1 v2:172.21.15.172:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f063c00cd00 con 0x7f0648074510 2024-09-12T02:36:33.412 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:36:32.982+0000 7f0645600640 1 -- 172.21.15.39:0/1677911566 <== mon.1 v2:172.21.15.172:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f063c0035f0 con 0x7f0648074510 2024-09-12T02:36:33.412 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:36:32.982+0000 7f064e400640 1 -- 172.21.15.39:0/1677911566 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f064819f790 con 0x7f0648074510 2024-09-12T02:36:33.412 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:36:32.982+0000 7f0645600640 1 -- 172.21.15.39:0/1677911566 <== mon.1 v2:172.21.15.172:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f063c010690 con 0x7f0648074510 2024-09-12T02:36:33.413 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:36:32.982+0000 7f064e400640 1 -- 172.21.15.39:0/1677911566 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f06481a7070 con 0x7f0648074510 2024-09-12T02:36:33.413 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:36:32.983+0000 7f064e400640 1 -- 172.21.15.39:0/1677911566 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7f0648062900 con 0x7f0648074510 2024-09-12T02:36:33.413 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:36:32.985+0000 7f0645600640 1 -- 172.21.15.39:0/1677911566 <== mon.1 v2:172.21.15.172:3300/0 4 ==== mgrmap(e 17) ==== 137884+0+0 (secure 0 0 0) 0x7f063c0037a0 con 0x7f0648074510 2024-09-12T02:36:33.413 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:36:32.986+0000 7f0645600640 1 --2- 172.21.15.39:0/1677911566 >> [v2:172.21.15.39:6800/1725006999,v1:172.21.15.39:6801/1725006999] conn(0x7f06300a2c10 0x7f06300a50d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:36:33.413 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:36:32.987+0000 7f0645600640 1 -- 172.21.15.39:0/1677911566 <== mon.1 v2:172.21.15.172:3300/0 5 ==== osd_map(93..93 src has 1..93) ==== 9092+0+0 (secure 0 0 0) 0x7f063c0cfac0 con 0x7f0648074510 2024-09-12T02:36:33.413 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:36:32.987+0000 7f0647e00640 1 --2- 172.21.15.39:0/1677911566 >> [v2:172.21.15.39:6800/1725006999,v1:172.21.15.39:6801/1725006999] conn(0x7f06300a2c10 0x7f06300a50d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:36:33.413 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:36:32.987+0000 7f0645600640 1 --2- 172.21.15.39:0/1677911566 >> [v2:172.21.15.39:6826/945860346,v1:172.21.15.39:6827/945860346] conn(0x7f06300adde0 0x7f06300b0280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:36:33.413 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:36:32.987+0000 7f0645600640 1 -- 172.21.15.39:0/1677911566 --> [v2:172.21.15.39:6826/945860346,v1:172.21.15.39:6827/945860346] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f063c011e50 con 0x7f06300adde0 2024-09-12T02:36:33.414 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:36:32.987+0000 7f0645600640 1 -- 172.21.15.39:0/1677911566 <== mon.1 v2:172.21.15.172:3300/0 6 ==== mon_get_version_reply(handle=1 version=93) ==== 24+0+0 (secure 0 0 0) 0x7f063c0cfe70 con 0x7f0648074510 2024-09-12T02:36:33.414 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:36:32.987+0000 7f064da00640 1 --2- 172.21.15.39:0/1677911566 >> [v2:172.21.15.39:6826/945860346,v1:172.21.15.39:6827/945860346] conn(0x7f06300adde0 0x7f06300b0280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:36:33.414 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:36:32.987+0000 7f0647e00640 1 --2- 172.21.15.39:0/1677911566 >> [v2:172.21.15.39:6800/1725006999,v1:172.21.15.39:6801/1725006999] conn(0x7f06300a2c10 0x7f06300a50d0 secure :-1 s=READY pgs=188 cs=0 l=1 rev1=1 crypto rx=0x7f06480ffdd0 tx=0x7f0634005f90 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:36:33.414 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:36:32.988+0000 7f064da00640 1 --2- 172.21.15.39:0/1677911566 >> [v2:172.21.15.39:6826/945860346,v1:172.21.15.39:6827/945860346] conn(0x7f06300adde0 0x7f06300b0280 crc :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.9 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:36:33.414 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:36:32.989+0000 7f0645600640 1 -- 172.21.15.39:0/1677911566 <== osd.9 v2:172.21.15.39:6826/945860346 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7f063c011e50 con 0x7f06300adde0 2024-09-12T02:36:33.414 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:36:33.003+0000 7f064e400640 1 -- 172.21.15.39:0/1677911566 --> [v2:172.21.15.39:6826/945860346,v1:172.21.15.39:6827/945860346] -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7f0648062d00 con 0x7f06300adde0 2024-09-12T02:36:33.414 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:36:33.004+0000 7f0645600640 1 -- 172.21.15.39:0/1677911566 <== osd.9 v2:172.21.15.39:6826/945860346 2 ==== command_reply(tid 2: 0 ) ==== 8+0+12 (crc 0 0 0) 0x7f0648062d00 con 0x7f06300adde0 2024-09-12T02:36:33.414 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:36:33.004+0000 7f064e400640 1 -- 172.21.15.39:0/1677911566 >> [v2:172.21.15.39:6826/945860346,v1:172.21.15.39:6827/945860346] conn(0x7f06300adde0 msgr2=0x7f06300b0280 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:36:33.414 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:36:33.004+0000 7f064e400640 1 --2- 172.21.15.39:0/1677911566 >> [v2:172.21.15.39:6826/945860346,v1:172.21.15.39:6827/945860346] conn(0x7f06300adde0 0x7f06300b0280 crc :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:36:33.414 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:36:33.004+0000 7f064e400640 1 -- 172.21.15.39:0/1677911566 >> [v2:172.21.15.39:6800/1725006999,v1:172.21.15.39:6801/1725006999] conn(0x7f06300a2c10 msgr2=0x7f06300a50d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:36:33.414 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:36:33.004+0000 7f064e400640 1 --2- 172.21.15.39:0/1677911566 >> [v2:172.21.15.39:6800/1725006999,v1:172.21.15.39:6801/1725006999] conn(0x7f06300a2c10 0x7f06300a50d0 secure :-1 s=READY pgs=188 cs=0 l=1 rev1=1 crypto rx=0x7f06480ffdd0 tx=0x7f0634005f90 comp rx=0 tx=0).stop 2024-09-12T02:36:33.414 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:36:33.004+0000 7f064e400640 1 -- 172.21.15.39:0/1677911566 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f0648074510 msgr2=0x7f064819a4f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:36:33.415 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:36:33.004+0000 7f064e400640 1 --2- 172.21.15.39:0/1677911566 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f0648074510 0x7f064819a4f0 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0x7f063c005fd0 tx=0x7f063c00ee50 comp rx=0 tx=0).stop 2024-09-12T02:36:33.415 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:36:33.004+0000 7f064da00640 1 -- 172.21.15.39:0/1677911566 reap_dead start 2024-09-12T02:36:33.415 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:36:33.004+0000 7f064e400640 1 -- 172.21.15.39:0/1677911566 shutdown_connections 2024-09-12T02:36:33.415 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:36:33.004+0000 7f064e400640 1 -- 172.21.15.39:0/1677911566 >> 172.21.15.39:0/1677911566 conn(0x7f06480fd740 msgr2=0x7f06480fef70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:36:33.415 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:36:33.004+0000 7f064e400640 1 -- 172.21.15.39:0/1677911566 shutdown_connections 2024-09-12T02:36:33.415 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:36:33.004+0000 7f064e400640 1 -- 172.21.15.39:0/1677911566 wait complete. 2024-09-12T02:36:33.962 INFO:teuthology.orchestra.run.smithi039.stdout:111669149769 2024-09-12T02:36:33.962 DEBUG:teuthology.orchestra.run.smithi039:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc shell --fsid 4954ed46-70ae-11ef-bcea-c7b262605968 -- ceph osd last-stat-seq osd.3 2024-09-12T02:36:34.175 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 02:36:33 smithi039 ceph-mon[30515]: pgmap v347: 129 pgs: 129 active+clean; 645 KiB data, 347 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2024-09-12T02:36:34.198 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 12 02:36:33 smithi044 ceph-mon[35411]: pgmap v347: 129 pgs: 129 active+clean; 645 KiB data, 347 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2024-09-12T02:36:34.264 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 12 02:36:33 smithi172 ceph-mon[35609]: pgmap v347: 129 pgs: 129 active+clean; 645 KiB data, 347 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2024-09-12T02:36:34.391 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:36:34.293+0000 7f6903a00640 1 -- 172.21.15.39:0/76234361 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f68fc074620 msgr2=0x7f68fc074a00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:36:34.391 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:36:34.293+0000 7f6903a00640 1 --2- 172.21.15.39:0/76234361 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f68fc074620 0x7f68fc074a00 secure :-1 s=READY pgs=206 cs=0 l=1 rev1=1 crypto rx=0x7f68f0009900 tx=0x7f68f002a480 comp rx=0 tx=0).stop 2024-09-12T02:36:34.391 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:36:34.294+0000 7f6903a00640 1 -- 172.21.15.39:0/76234361 shutdown_connections 2024-09-12T02:36:34.391 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:36:34.294+0000 7f6903a00640 1 --2- 172.21.15.39:0/76234361 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f68fc10e3c0 0x7f68fc110810 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:36:34.391 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:36:34.294+0000 7f6903a00640 1 --2- 172.21.15.39:0/76234361 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f68fc074f40 0x7f68fc10de80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:36:34.392 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:36:34.294+0000 7f6903a00640 1 --2- 172.21.15.39:0/76234361 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f68fc074620 0x7f68fc074a00 unknown :-1 s=CLOSED pgs=206 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:36:34.392 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:36:34.294+0000 7f6903a00640 1 -- 172.21.15.39:0/76234361 >> 172.21.15.39:0/76234361 conn(0x7f68fc0fd8c0 msgr2=0x7f68fc0ffce0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:36:34.392 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:36:34.294+0000 7f6903a00640 1 -- 172.21.15.39:0/76234361 shutdown_connections 2024-09-12T02:36:34.392 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:36:34.294+0000 7f6903a00640 1 -- 172.21.15.39:0/76234361 wait complete. 2024-09-12T02:36:34.392 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:36:34.295+0000 7f6903a00640 1 Processor -- start 2024-09-12T02:36:34.392 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:36:34.295+0000 7f6903a00640 1 -- start start 2024-09-12T02:36:34.392 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:36:34.295+0000 7f6903a00640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f68fc074620 0x7f68fc19a730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:36:34.392 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:36:34.295+0000 7f6903a00640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f68fc074f40 0x7f68fc19ac70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:36:34.392 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:36:34.295+0000 7f6903a00640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f68fc10e3c0 0x7f68fc19f000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:36:34.392 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:36:34.295+0000 7f6903a00640 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 -- 0x7f68fc114170 con 0x7f68fc074f40 2024-09-12T02:36:34.392 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:36:34.295+0000 7f6903a00640 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x7f68fc113ff0 con 0x7f68fc10e3c0 2024-09-12T02:36:34.392 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:36:34.295+0000 7f6903a00640 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7f68fc1142f0 con 0x7f68fc074620 2024-09-12T02:36:34.393 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:36:34.295+0000 7f68fbe00640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f68fc074f40 0x7f68fc19ac70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:36:34.393 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:36:34.295+0000 7f68fbe00640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f68fc074f40 0x7f68fc19ac70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.39:3300/0 says I am v2:172.21.15.39:39094/0 (socket says 172.21.15.39:39094) 2024-09-12T02:36:34.393 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:36:34.295+0000 7f6901a00640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f68fc10e3c0 0x7f68fc19f000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:36:34.393 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:36:34.295+0000 7f68fbe00640 1 -- 172.21.15.39:0/2421740651 learned_addr learned my addr 172.21.15.39:0/2421740651 (peer_addr_for_me v2:172.21.15.39:0/0) 2024-09-12T02:36:34.393 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:36:34.295+0000 7f6901000640 1 --2- 172.21.15.39:0/2421740651 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f68fc074620 0x7f68fc19a730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:36:34.393 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:36:34.296+0000 7f68fbe00640 1 -- 172.21.15.39:0/2421740651 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f68fc074620 msgr2=0x7f68fc19a730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:36:34.393 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:36:34.296+0000 7f68fbe00640 1 --2- 172.21.15.39:0/2421740651 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f68fc074620 0x7f68fc19a730 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:36:34.393 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:36:34.296+0000 7f68fbe00640 1 -- 172.21.15.39:0/2421740651 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f68fc10e3c0 msgr2=0x7f68fc19f000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:36:34.393 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:36:34.296+0000 7f68fbe00640 1 --2- 172.21.15.39:0/2421740651 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f68fc10e3c0 0x7f68fc19f000 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:36:34.393 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:36:34.296+0000 7f68fbe00640 1 -- 172.21.15.39:0/2421740651 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f68fc19f6e0 con 0x7f68fc074f40 2024-09-12T02:36:34.393 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:36:34.296+0000 7f6901a00640 1 --2- 172.21.15.39:0/2421740651 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f68fc10e3c0 0x7f68fc19f000 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-12T02:36:34.393 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:36:34.296+0000 7f68fbe00640 1 --2- 172.21.15.39:0/2421740651 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f68fc074f40 0x7f68fc19ac70 secure :-1 s=READY pgs=207 cs=0 l=1 rev1=1 crypto rx=0x7f68e800e9f0 tx=0x7f68e800edf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:36:34.393 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:36:34.296+0000 7f68f9600640 1 -- 172.21.15.39:0/2421740651 <== mon.0 v2:172.21.15.39:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f68e800cd80 con 0x7f68fc074f40 2024-09-12T02:36:34.394 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:36:34.296+0000 7f68f9600640 1 -- 172.21.15.39:0/2421740651 <== mon.0 v2:172.21.15.39:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f68e8005500 con 0x7f68fc074f40 2024-09-12T02:36:34.394 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:36:34.296+0000 7f6903a00640 1 -- 172.21.15.39:0/2421740651 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f68fc19f9d0 con 0x7f68fc074f40 2024-09-12T02:36:34.394 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:36:34.296+0000 7f68f9600640 1 -- 172.21.15.39:0/2421740651 <== mon.0 v2:172.21.15.39:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f68e8010690 con 0x7f68fc074f40 2024-09-12T02:36:34.394 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:36:34.297+0000 7f6903a00640 1 -- 172.21.15.39:0/2421740651 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f68fc1a72b0 con 0x7f68fc074f40 2024-09-12T02:36:34.394 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:36:34.297+0000 7f6903a00640 1 -- 172.21.15.39:0/2421740651 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7f68fc062900 con 0x7f68fc074f40 2024-09-12T02:36:34.394 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:36:34.299+0000 7f68f9600640 1 -- 172.21.15.39:0/2421740651 <== mon.0 v2:172.21.15.39:3300/0 4 ==== mgrmap(e 17) ==== 137884+0+0 (secure 0 0 0) 0x7f68e80046c0 con 0x7f68fc074f40 2024-09-12T02:36:34.394 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:36:34.301+0000 7f68f9600640 1 --2- 172.21.15.39:0/2421740651 >> [v2:172.21.15.39:6800/1725006999,v1:172.21.15.39:6801/1725006999] conn(0x7f68e40a2c10 0x7f68e40a50d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:36:34.394 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:36:34.301+0000 7f68f9600640 1 -- 172.21.15.39:0/2421740651 <== mon.0 v2:172.21.15.39:3300/0 5 ==== osd_map(93..93 src has 1..93) ==== 9092+0+0 (secure 0 0 0) 0x7f68e80cfdd0 con 0x7f68fc074f40 2024-09-12T02:36:34.395 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:36:34.301+0000 7f6901000640 1 --2- 172.21.15.39:0/2421740651 >> [v2:172.21.15.39:6800/1725006999,v1:172.21.15.39:6801/1725006999] conn(0x7f68e40a2c10 0x7f68e40a50d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:36:34.395 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:36:34.301+0000 7f68f9600640 1 --2- 172.21.15.39:0/2421740651 >> [v2:172.21.15.39:6818/2569059542,v1:172.21.15.39:6819/2569059542] conn(0x7f68e40adde0 0x7f68e40b0280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:36:34.395 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:36:34.301+0000 7f68f9600640 1 -- 172.21.15.39:0/2421740651 --> [v2:172.21.15.39:6818/2569059542,v1:172.21.15.39:6819/2569059542] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f68e8005350 con 0x7f68e40adde0 2024-09-12T02:36:34.395 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:36:34.301+0000 7f68f9600640 1 -- 172.21.15.39:0/2421740651 <== mon.0 v2:172.21.15.39:3300/0 6 ==== mon_get_version_reply(handle=1 version=93) ==== 24+0+0 (secure 0 0 0) 0x7f68e80d0180 con 0x7f68fc074f40 2024-09-12T02:36:34.395 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:36:34.301+0000 7f6901a00640 1 --2- 172.21.15.39:0/2421740651 >> [v2:172.21.15.39:6818/2569059542,v1:172.21.15.39:6819/2569059542] conn(0x7f68e40adde0 0x7f68e40b0280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:36:34.395 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:36:34.302+0000 7f6901000640 1 --2- 172.21.15.39:0/2421740651 >> [v2:172.21.15.39:6800/1725006999,v1:172.21.15.39:6801/1725006999] conn(0x7f68e40a2c10 0x7f68e40a50d0 secure :-1 s=READY pgs=189 cs=0 l=1 rev1=1 crypto rx=0x7f68f0009230 tx=0x7f68f00058d0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:36:34.395 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:36:34.302+0000 7f6901a00640 1 --2- 172.21.15.39:0/2421740651 >> [v2:172.21.15.39:6818/2569059542,v1:172.21.15.39:6819/2569059542] conn(0x7f68e40adde0 0x7f68e40b0280 crc :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.6 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:36:34.395 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:36:34.303+0000 7f68f9600640 1 -- 172.21.15.39:0/2421740651 <== osd.6 v2:172.21.15.39:6818/2569059542 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7f68e8005350 con 0x7f68e40adde0 2024-09-12T02:36:34.395 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:36:34.317+0000 7f6903a00640 1 -- 172.21.15.39:0/2421740651 --> [v2:172.21.15.39:6818/2569059542,v1:172.21.15.39:6819/2569059542] -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7f68fc062d80 con 0x7f68e40adde0 2024-09-12T02:36:34.396 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:36:34.318+0000 7f68f9600640 1 -- 172.21.15.39:0/2421740651 <== osd.6 v2:172.21.15.39:6818/2569059542 2 ==== command_reply(tid 2: 0 ) ==== 8+0+12 (crc 0 0 0) 0x7f68fc062d80 con 0x7f68e40adde0 2024-09-12T02:36:34.396 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:36:34.318+0000 7f6903a00640 1 -- 172.21.15.39:0/2421740651 >> [v2:172.21.15.39:6818/2569059542,v1:172.21.15.39:6819/2569059542] conn(0x7f68e40adde0 msgr2=0x7f68e40b0280 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:36:34.396 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:36:34.318+0000 7f6903a00640 1 --2- 172.21.15.39:0/2421740651 >> [v2:172.21.15.39:6818/2569059542,v1:172.21.15.39:6819/2569059542] conn(0x7f68e40adde0 0x7f68e40b0280 crc :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:36:34.396 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:36:34.318+0000 7f6903a00640 1 -- 172.21.15.39:0/2421740651 >> [v2:172.21.15.39:6800/1725006999,v1:172.21.15.39:6801/1725006999] conn(0x7f68e40a2c10 msgr2=0x7f68e40a50d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:36:34.396 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:36:34.318+0000 7f6903a00640 1 --2- 172.21.15.39:0/2421740651 >> [v2:172.21.15.39:6800/1725006999,v1:172.21.15.39:6801/1725006999] conn(0x7f68e40a2c10 0x7f68e40a50d0 secure :-1 s=READY pgs=189 cs=0 l=1 rev1=1 crypto rx=0x7f68f0009230 tx=0x7f68f00058d0 comp rx=0 tx=0).stop 2024-09-12T02:36:34.396 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:36:34.318+0000 7f6903a00640 1 -- 172.21.15.39:0/2421740651 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f68fc074f40 msgr2=0x7f68fc19ac70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:36:34.396 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:36:34.318+0000 7f6903a00640 1 --2- 172.21.15.39:0/2421740651 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f68fc074f40 0x7f68fc19ac70 secure :-1 s=READY pgs=207 cs=0 l=1 rev1=1 crypto rx=0x7f68e800e9f0 tx=0x7f68e800edf0 comp rx=0 tx=0).stop 2024-09-12T02:36:34.396 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:36:34.318+0000 7f6901a00640 1 -- 172.21.15.39:0/2421740651 reap_dead start 2024-09-12T02:36:34.396 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:36:34.319+0000 7f6903a00640 1 -- 172.21.15.39:0/2421740651 shutdown_connections 2024-09-12T02:36:34.396 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:36:34.319+0000 7f6903a00640 1 -- 172.21.15.39:0/2421740651 >> 172.21.15.39:0/2421740651 conn(0x7f68fc0fd8c0 msgr2=0x7f68fc0fe620 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:36:34.396 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:36:34.319+0000 7f6903a00640 1 -- 172.21.15.39:0/2421740651 shutdown_connections 2024-09-12T02:36:34.396 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:36:34.319+0000 7f6903a00640 1 -- 172.21.15.39:0/2421740651 wait complete. 2024-09-12T02:36:35.285 INFO:teuthology.orchestra.run.smithi039.stdout:279172874281 2024-09-12T02:36:35.286 DEBUG:teuthology.orchestra.run.smithi039:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc shell --fsid 4954ed46-70ae-11ef-bcea-c7b262605968 -- ceph osd last-stat-seq osd.9 2024-09-12T02:36:35.989 INFO:teuthology.orchestra.run.smithi039.stdout:244813135919 2024-09-12T02:36:35.989 DEBUG:teuthology.orchestra.run.smithi039:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc shell --fsid 4954ed46-70ae-11ef-bcea-c7b262605968 -- ceph osd last-stat-seq osd.8 2024-09-12T02:36:36.168 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 02:36:35 smithi039 ceph-mon[30515]: pgmap v348: 129 pgs: 129 active+clean; 645 KiB data, 347 MiB used, 1.0 TiB / 1.0 TiB avail; 6.3 KiB/s rd, 12 op/s 2024-09-12T02:36:36.192 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:36:36.190+0000 7f0ede400640 1 -- 172.21.15.39:0/3432152190 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f0ed8101dd0 msgr2=0x7f0ed81021b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:36:36.192 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:36:36.190+0000 7f0ede400640 1 --2- 172.21.15.39:0/3432152190 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f0ed8101dd0 0x7f0ed81021b0 secure :-1 s=READY pgs=208 cs=0 l=1 rev1=1 crypto rx=0x7f0ec8009860 tx=0x7f0ec802a340 comp rx=0 tx=0).stop 2024-09-12T02:36:36.192 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:36:36.191+0000 7f0ede400640 1 -- 172.21.15.39:0/3432152190 shutdown_connections 2024-09-12T02:36:36.192 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:36:36.191+0000 7f0ede400640 1 --2- 172.21.15.39:0/3432152190 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f0ed8106f00 0x7f0ed810ea80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:36:36.192 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:36:36.191+0000 7f0ede400640 1 --2- 172.21.15.39:0/3432152190 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f0ed8102780 0x7f0ed81067d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:36:36.192 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:36:36.191+0000 7f0ede400640 1 --2- 172.21.15.39:0/3432152190 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f0ed8101dd0 0x7f0ed81021b0 unknown :-1 s=CLOSED pgs=208 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:36:36.192 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:36:36.191+0000 7f0ede400640 1 -- 172.21.15.39:0/3432152190 >> 172.21.15.39:0/3432152190 conn(0x7f0ed80fd8b0 msgr2=0x7f0ed80ffcd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:36:36.193 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:36:36.191+0000 7f0ede400640 1 -- 172.21.15.39:0/3432152190 shutdown_connections 2024-09-12T02:36:36.193 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:36:36.191+0000 7f0ede400640 1 -- 172.21.15.39:0/3432152190 wait complete. 2024-09-12T02:36:36.193 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:36:36.192+0000 7f0ede400640 1 Processor -- start 2024-09-12T02:36:36.193 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:36:36.192+0000 7f0ede400640 1 -- start start 2024-09-12T02:36:36.193 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:36:36.192+0000 7f0ede400640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f0ed8101dd0 0x7f0ed819f0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:36:36.193 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:36:36.192+0000 7f0ede400640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f0ed8102780 0x7f0ed819f5e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:36:36.194 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:36:36.192+0000 7f0ede400640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f0ed8106f00 0x7f0ed810dcb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:36:36.194 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:36:36.192+0000 7f0ede400640 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 -- 0x7f0ed8111f60 con 0x7f0ed8102780 2024-09-12T02:36:36.194 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:36:36.192+0000 7f0ede400640 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x7f0ed8111de0 con 0x7f0ed8106f00 2024-09-12T02:36:36.194 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:36:36.192+0000 7f0ede400640 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7f0ed81120e0 con 0x7f0ed8101dd0 2024-09-12T02:36:36.195 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:36:36.193+0000 7f0ed7e00640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f0ed8106f00 0x7f0ed810dcb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:36:36.195 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:36:36.193+0000 7f0ed7400640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f0ed8101dd0 0x7f0ed819f0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:36:36.195 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:36:36.193+0000 7f0ed7e00640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f0ed8106f00 0x7f0ed810dcb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.39:40618/0 (socket says 172.21.15.39:40618) 2024-09-12T02:36:36.195 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:36:36.193+0000 7f0ed7e00640 1 -- 172.21.15.39:0/99052278 learned_addr learned my addr 172.21.15.39:0/99052278 (peer_addr_for_me v2:172.21.15.39:0/0) 2024-09-12T02:36:36.195 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:36:36.193+0000 7f0ed6a00640 1 --2- 172.21.15.39:0/99052278 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f0ed8102780 0x7f0ed819f5e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:36:36.195 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:36:36.193+0000 7f0ed7400640 1 -- 172.21.15.39:0/99052278 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f0ed8106f00 msgr2=0x7f0ed810dcb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:36:36.195 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:36:36.193+0000 7f0ed7400640 1 --2- 172.21.15.39:0/99052278 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f0ed8106f00 0x7f0ed810dcb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:36:36.195 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:36:36.193+0000 7f0ed7400640 1 -- 172.21.15.39:0/99052278 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f0ed8102780 msgr2=0x7f0ed819f5e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:36:36.196 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:36:36.193+0000 7f0ed7400640 1 --2- 172.21.15.39:0/99052278 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f0ed8102780 0x7f0ed819f5e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:36:36.196 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:36:36.193+0000 7f0ed7400640 1 -- 172.21.15.39:0/99052278 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0ed810e570 con 0x7f0ed8101dd0 2024-09-12T02:36:36.196 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:36:36.194+0000 7f0ed7400640 1 --2- 172.21.15.39:0/99052278 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f0ed8101dd0 0x7f0ed819f0a0 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7f0ec802a860 tx=0x7f0ec8033b60 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:36:36.196 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:36:36.194+0000 7f0ecfe00640 1 -- 172.21.15.39:0/99052278 <== mon.1 v2:172.21.15.172:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0ec8037040 con 0x7f0ed8101dd0 2024-09-12T02:36:36.196 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:36:36.194+0000 7f0ede400640 1 -- 172.21.15.39:0/99052278 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f0ed810e800 con 0x7f0ed8101dd0 2024-09-12T02:36:36.196 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:36:36.194+0000 7f0ecfe00640 1 -- 172.21.15.39:0/99052278 <== mon.1 v2:172.21.15.172:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f0ec8033d50 con 0x7f0ed8101dd0 2024-09-12T02:36:36.196 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:36:36.194+0000 7f0ecfe00640 1 -- 172.21.15.39:0/99052278 <== mon.1 v2:172.21.15.172:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0ec8003960 con 0x7f0ed8101dd0 2024-09-12T02:36:36.196 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:36:36.194+0000 7f0ede400640 1 -- 172.21.15.39:0/99052278 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f0ed819ad20 con 0x7f0ed8101dd0 2024-09-12T02:36:36.197 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:36:36.195+0000 7f0ede400640 1 -- 172.21.15.39:0/99052278 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7f0ed819b2d0 con 0x7f0ed8101dd0 2024-09-12T02:36:36.198 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:36:36.197+0000 7f0ecfe00640 1 -- 172.21.15.39:0/99052278 <== mon.1 v2:172.21.15.172:3300/0 4 ==== mgrmap(e 17) ==== 137884+0+0 (secure 0 0 0) 0x7f0ec8042020 con 0x7f0ed8101dd0 2024-09-12T02:36:36.198 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 12 02:36:35 smithi044 ceph-mon[35411]: pgmap v348: 129 pgs: 129 active+clean; 645 KiB data, 347 MiB used, 1.0 TiB / 1.0 TiB avail; 6.3 KiB/s rd, 12 op/s 2024-09-12T02:36:36.199 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:36:36.199+0000 7f0ecfe00640 1 --2- 172.21.15.39:0/99052278 >> [v2:172.21.15.39:6800/1725006999,v1:172.21.15.39:6801/1725006999] conn(0x7f0ebc0a2c10 0x7f0ebc0a50d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:36:36.200 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:36:36.199+0000 7f0ecfe00640 1 -- 172.21.15.39:0/99052278 <== mon.1 v2:172.21.15.172:3300/0 5 ==== osd_map(93..93 src has 1..93) ==== 9092+0+0 (secure 0 0 0) 0x7f0ec80eee00 con 0x7f0ed8101dd0 2024-09-12T02:36:36.200 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:36:36.199+0000 7f0ed6a00640 1 --2- 172.21.15.39:0/99052278 >> [v2:172.21.15.39:6800/1725006999,v1:172.21.15.39:6801/1725006999] conn(0x7f0ebc0a2c10 0x7f0ebc0a50d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:36:36.200 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:36:36.199+0000 7f0ecfe00640 1 --2- 172.21.15.39:0/99052278 >> [v2:172.21.15.172:6824/3627635035,v1:172.21.15.172:6825/3627635035] conn(0x7f0ebc0addd0 0x7f0ebc0b0270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:36:36.200 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:36:36.199+0000 7f0ecfe00640 1 -- 172.21.15.39:0/99052278 --> [v2:172.21.15.172:6824/3627635035,v1:172.21.15.172:6825/3627635035] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f0ebc0b0940 con 0x7f0ebc0addd0 2024-09-12T02:36:36.201 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:36:36.199+0000 7f0ecfe00640 1 -- 172.21.15.39:0/99052278 <== mon.1 v2:172.21.15.172:3300/0 6 ==== mon_get_version_reply(handle=1 version=93) ==== 24+0+0 (secure 0 0 0) 0x7f0ec80ef1b0 con 0x7f0ed8101dd0 2024-09-12T02:36:36.201 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:36:36.200+0000 7f0ed7e00640 1 --2- 172.21.15.39:0/99052278 >> [v2:172.21.15.172:6824/3627635035,v1:172.21.15.172:6825/3627635035] conn(0x7f0ebc0addd0 0x7f0ebc0b0270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:36:36.201 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:36:36.200+0000 7f0ed6a00640 1 --2- 172.21.15.39:0/99052278 >> [v2:172.21.15.39:6800/1725006999,v1:172.21.15.39:6801/1725006999] conn(0x7f0ebc0a2c10 0x7f0ebc0a50d0 secure :-1 s=READY pgs=190 cs=0 l=1 rev1=1 crypto rx=0x7f0ed8197410 tx=0x7f0ec4009260 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:36:36.201 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:36:36.200+0000 7f0ed7e00640 1 --2- 172.21.15.39:0/99052278 >> [v2:172.21.15.172:6824/3627635035,v1:172.21.15.172:6825/3627635035] conn(0x7f0ebc0addd0 0x7f0ebc0b0270 crc :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.11 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:36:36.202 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:36:36.201+0000 7f0ecfe00640 1 -- 172.21.15.39:0/99052278 <== osd.11 v2:172.21.15.172:6824/3627635035 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7f0ebc0b0940 con 0x7f0ebc0addd0 2024-09-12T02:36:36.234 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:36:36.233+0000 7f0ede400640 1 -- 172.21.15.39:0/99052278 --> [v2:172.21.15.172:6824/3627635035,v1:172.21.15.172:6825/3627635035] -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7f0ed819b750 con 0x7f0ebc0addd0 2024-09-12T02:36:36.234 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:36:36.234+0000 7f0ecfe00640 1 -- 172.21.15.39:0/99052278 <== osd.11 v2:172.21.15.172:6824/3627635035 2 ==== command_reply(tid 2: 0 ) ==== 8+0+12 (crc 0 0 0) 0x7f0ed819b750 con 0x7f0ebc0addd0 2024-09-12T02:36:36.236 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:36:36.234+0000 7f0ede400640 1 -- 172.21.15.39:0/99052278 >> [v2:172.21.15.172:6824/3627635035,v1:172.21.15.172:6825/3627635035] conn(0x7f0ebc0addd0 msgr2=0x7f0ebc0b0270 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:36:36.236 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:36:36.234+0000 7f0ede400640 1 --2- 172.21.15.39:0/99052278 >> [v2:172.21.15.172:6824/3627635035,v1:172.21.15.172:6825/3627635035] conn(0x7f0ebc0addd0 0x7f0ebc0b0270 crc :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:36:36.236 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:36:36.234+0000 7f0ede400640 1 -- 172.21.15.39:0/99052278 >> [v2:172.21.15.39:6800/1725006999,v1:172.21.15.39:6801/1725006999] conn(0x7f0ebc0a2c10 msgr2=0x7f0ebc0a50d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:36:36.236 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:36:36.234+0000 7f0ede400640 1 --2- 172.21.15.39:0/99052278 >> [v2:172.21.15.39:6800/1725006999,v1:172.21.15.39:6801/1725006999] conn(0x7f0ebc0a2c10 0x7f0ebc0a50d0 secure :-1 s=READY pgs=190 cs=0 l=1 rev1=1 crypto rx=0x7f0ed8197410 tx=0x7f0ec4009260 comp rx=0 tx=0).stop 2024-09-12T02:36:36.236 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:36:36.234+0000 7f0ede400640 1 -- 172.21.15.39:0/99052278 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f0ed8101dd0 msgr2=0x7f0ed819f0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:36:36.236 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:36:36.234+0000 7f0ede400640 1 --2- 172.21.15.39:0/99052278 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f0ed8101dd0 0x7f0ed819f0a0 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7f0ec802a860 tx=0x7f0ec8033b60 comp rx=0 tx=0).stop 2024-09-12T02:36:36.236 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:36:36.235+0000 7f0ed7e00640 1 -- 172.21.15.39:0/99052278 reap_dead start 2024-09-12T02:36:36.236 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:36:36.235+0000 7f0ede400640 1 -- 172.21.15.39:0/99052278 shutdown_connections 2024-09-12T02:36:36.236 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:36:36.235+0000 7f0ede400640 1 -- 172.21.15.39:0/99052278 >> 172.21.15.39:0/99052278 conn(0x7f0ed80fd8b0 msgr2=0x7f0ed80febe0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:36:36.236 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:36:36.235+0000 7f0ede400640 1 -- 172.21.15.39:0/99052278 shutdown_connections 2024-09-12T02:36:36.237 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:36:36.235+0000 7f0ede400640 1 -- 172.21.15.39:0/99052278 wait complete. 2024-09-12T02:36:36.263 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 12 02:36:35 smithi172 ceph-mon[35609]: pgmap v348: 129 pgs: 129 active+clean; 645 KiB data, 347 MiB used, 1.0 TiB / 1.0 TiB avail; 6.3 KiB/s rd, 12 op/s 2024-09-12T02:36:36.680 INFO:teuthology.orchestra.run.smithi039.stdout:193273528378 2024-09-12T02:36:36.681 DEBUG:teuthology.orchestra.run.smithi039:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc shell --fsid 4954ed46-70ae-11ef-bcea-c7b262605968 -- ceph osd last-stat-seq osd.6 2024-09-12T02:36:37.099 INFO:teuthology.orchestra.run.smithi039.stdout:214748364852 2024-09-12T02:36:37.100 DEBUG:teuthology.orchestra.run.smithi039:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc shell --fsid 4954ed46-70ae-11ef-bcea-c7b262605968 -- ceph osd last-stat-seq osd.7 2024-09-12T02:36:37.304 INFO:teuthology.orchestra.run.smithi039.stderr:Inferring config /var/lib/ceph/4954ed46-70ae-11ef-bcea-c7b262605968/mon.a/config 2024-09-12T02:36:37.312 INFO:teuthology.orchestra.run.smithi039.stderr:Inferring config /var/lib/ceph/4954ed46-70ae-11ef-bcea-c7b262605968/mon.a/config 2024-09-12T02:36:37.964 INFO:teuthology.orchestra.run.smithi039.stderr:Inferring config /var/lib/ceph/4954ed46-70ae-11ef-bcea-c7b262605968/mon.a/config 2024-09-12T02:36:37.970 INFO:teuthology.orchestra.run.smithi039.stdout:330712481824 2024-09-12T02:36:37.970 DEBUG:teuthology.orchestra.run.smithi039:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc shell --fsid 4954ed46-70ae-11ef-bcea-c7b262605968 -- ceph osd last-stat-seq osd.11 2024-09-12T02:36:38.198 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 12 02:36:37 smithi044 ceph-mon[35411]: pgmap v349: 129 pgs: 129 active+clean; 645 KiB data, 347 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2024-09-12T02:36:38.263 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 12 02:36:37 smithi172 ceph-mon[35609]: pgmap v349: 129 pgs: 129 active+clean; 645 KiB data, 347 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2024-09-12T02:36:38.278 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 02:36:37 smithi039 ceph-mon[30515]: pgmap v349: 129 pgs: 129 active+clean; 645 KiB data, 347 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2024-09-12T02:36:38.776 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:36:38.775+0000 7f53a2000640 1 -- 172.21.15.39:0/1406587581 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f539c112b90 msgr2=0x7f539c114f80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:36:38.776 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:36:38.775+0000 7f53a2000640 1 --2- 172.21.15.39:0/1406587581 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f539c112b90 0x7f539c114f80 secure :-1 s=READY pgs=209 cs=0 l=1 rev1=1 crypto rx=0x7f5394009be0 tx=0x7f539402a750 comp rx=0 tx=0).stop 2024-09-12T02:36:38.776 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:36:38.775+0000 7f53a2000640 1 -- 172.21.15.39:0/1406587581 shutdown_connections 2024-09-12T02:36:38.777 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:36:38.775+0000 7f53a2000640 1 --2- 172.21.15.39:0/1406587581 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f539c112b90 0x7f539c114f80 unknown :-1 s=CLOSED pgs=209 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:36:38.777 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:36:38.775+0000 7f53a2000640 1 --2- 172.21.15.39:0/1406587581 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f539c074eb0 0x7f539c112650 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:36:38.777 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:36:38.775+0000 7f53a2000640 1 --2- 172.21.15.39:0/1406587581 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f539c074590 0x7f539c074970 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:36:38.777 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:36:38.775+0000 7f53a2000640 1 -- 172.21.15.39:0/1406587581 >> 172.21.15.39:0/1406587581 conn(0x7f539c0fd8c0 msgr2=0x7f539c0ffce0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:36:38.777 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:36:38.775+0000 7f53a2000640 1 -- 172.21.15.39:0/1406587581 shutdown_connections 2024-09-12T02:36:38.777 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:36:38.775+0000 7f53a2000640 1 -- 172.21.15.39:0/1406587581 wait complete. 2024-09-12T02:36:38.778 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:36:38.776+0000 7f53a2000640 1 Processor -- start 2024-09-12T02:36:38.778 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:36:38.776+0000 7f53a2000640 1 -- start start 2024-09-12T02:36:38.778 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:36:38.777+0000 7f53a2000640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f539c074590 0x7f539c1a46b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:36:38.778 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:36:38.777+0000 7f53a2000640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f539c074eb0 0x7f539c1a4bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:36:38.778 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:36:38.777+0000 7f53a2000640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f539c112b90 0x7f539c19e870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:36:38.778 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:36:38.777+0000 7f53a2000640 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 -- 0x7f539c118500 con 0x7f539c074eb0 2024-09-12T02:36:38.778 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:36:38.777+0000 7f53a2000640 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x7f539c118380 con 0x7f539c074590 2024-09-12T02:36:38.778 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:36:38.777+0000 7f53a2000640 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7f539c118680 con 0x7f539c112b90 2024-09-12T02:36:38.779 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:36:38.777+0000 7f5393e00640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f539c074eb0 0x7f539c1a4bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:36:38.779 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:36:38.777+0000 7f539b400640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f539c074590 0x7f539c1a46b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:36:38.779 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:36:38.777+0000 7f5393e00640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f539c074eb0 0x7f539c1a4bf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.39:3300/0 says I am v2:172.21.15.39:47100/0 (socket says 172.21.15.39:47100) 2024-09-12T02:36:38.779 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:36:38.777+0000 7f5393e00640 1 -- 172.21.15.39:0/3299800820 learned_addr learned my addr 172.21.15.39:0/3299800820 (peer_addr_for_me v2:172.21.15.39:0/0) 2024-09-12T02:36:38.779 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:36:38.777+0000 7f539b400640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f539c074590 0x7f539c1a46b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.39:50342/0 (socket says 172.21.15.39:50342) 2024-09-12T02:36:38.779 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:36:38.777+0000 7f539be00640 1 --2- 172.21.15.39:0/3299800820 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f539c112b90 0x7f539c19e870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:36:38.780 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:36:38.778+0000 7f539b400640 1 -- 172.21.15.39:0/3299800820 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f539c112b90 msgr2=0x7f539c19e870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:36:38.780 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:36:38.778+0000 7f539b400640 1 --2- 172.21.15.39:0/3299800820 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f539c112b90 0x7f539c19e870 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:36:38.780 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:36:38.778+0000 7f539b400640 1 -- 172.21.15.39:0/3299800820 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f539c074eb0 msgr2=0x7f539c1a4bf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:36:38.780 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:36:38.778+0000 7f539b400640 1 --2- 172.21.15.39:0/3299800820 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f539c074eb0 0x7f539c1a4bf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:36:38.780 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:36:38.778+0000 7f539b400640 1 -- 172.21.15.39:0/3299800820 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f539c19efa0 con 0x7f539c074590 2024-09-12T02:36:38.780 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:36:38.778+0000 7f5393e00640 1 --2- 172.21.15.39:0/3299800820 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f539c074eb0 0x7f539c1a4bf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-12T02:36:38.780 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:36:38.778+0000 7f539b400640 1 --2- 172.21.15.39:0/3299800820 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f539c074590 0x7f539c1a46b0 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0x7f538c00e9f0 tx=0x7f538c00eeb0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:36:38.780 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:36:38.778+0000 7f5398c00640 1 -- 172.21.15.39:0/3299800820 <== mon.2 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f538c00ccc0 con 0x7f539c074590 2024-09-12T02:36:38.780 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:36:38.778+0000 7f53a2000640 1 -- 172.21.15.39:0/3299800820 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f539c19f290 con 0x7f539c074590 2024-09-12T02:36:38.780 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:36:38.778+0000 7f5398c00640 1 -- 172.21.15.39:0/3299800820 <== mon.2 v2:172.21.15.44:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f538c010910 con 0x7f539c074590 2024-09-12T02:36:38.781 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:36:38.778+0000 7f5398c00640 1 -- 172.21.15.39:0/3299800820 <== mon.2 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f538c018960 con 0x7f539c074590 2024-09-12T02:36:38.781 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:36:38.778+0000 7f53a2000640 1 -- 172.21.15.39:0/3299800820 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f539c1ab580 con 0x7f539c074590 2024-09-12T02:36:38.781 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:36:38.780+0000 7f53a2000640 1 -- 172.21.15.39:0/3299800820 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f539c074970 con 0x7f539c074590 2024-09-12T02:36:38.782 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:36:38.782+0000 7f5398c00640 1 -- 172.21.15.39:0/3299800820 <== mon.2 v2:172.21.15.44:3300/0 4 ==== mgrmap(e 17) ==== 137884+0+0 (secure 0 0 0) 0x7f538c010ac0 con 0x7f539c074590 2024-09-12T02:36:38.784 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:36:38.783+0000 7f5398c00640 1 --2- 172.21.15.39:0/3299800820 >> [v2:172.21.15.39:6800/1725006999,v1:172.21.15.39:6801/1725006999] conn(0x7f53800a2c10 0x7f53800a50d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:36:38.784 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:36:38.783+0000 7f5398c00640 1 -- 172.21.15.39:0/3299800820 <== mon.2 v2:172.21.15.44:3300/0 5 ==== osd_map(93..93 src has 1..93) ==== 9092+0+0 (secure 0 0 0) 0x7f538c0cfd20 con 0x7f539c074590 2024-09-12T02:36:38.784 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:36:38.783+0000 7f5393e00640 1 --2- 172.21.15.39:0/3299800820 >> [v2:172.21.15.39:6800/1725006999,v1:172.21.15.39:6801/1725006999] conn(0x7f53800a2c10 0x7f53800a50d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:36:38.785 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:36:38.784+0000 7f5393e00640 1 --2- 172.21.15.39:0/3299800820 >> [v2:172.21.15.39:6800/1725006999,v1:172.21.15.39:6801/1725006999] conn(0x7f53800a2c10 0x7f53800a50d0 secure :-1 s=READY pgs=191 cs=0 l=1 rev1=1 crypto rx=0x7f53840096c0 tx=0x7f5384009260 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:36:38.786 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:36:38.785+0000 7f5398c00640 1 -- 172.21.15.39:0/3299800820 <== mon.2 v2:172.21.15.44:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7f538c09c760 con 0x7f539c074590 2024-09-12T02:36:38.976 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:36:38.975+0000 7f53a2000640 1 -- 172.21.15.39:0/3299800820 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) -- 0x7f539c1ab880 con 0x7f539c074590 2024-09-12T02:36:38.977 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:36:38.976+0000 7f5398c00640 1 -- 172.21.15.39:0/3299800820 <== mon.2 v2:172.21.15.44:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) ==== 74+0+12 (secure 0 0 0) 0x7f538c09c060 con 0x7f539c074590 2024-09-12T02:36:38.977 INFO:teuthology.orchestra.run.smithi039.stdout:55834574935 2024-09-12T02:36:38.980 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:36:38.979+0000 7f53a2000640 1 -- 172.21.15.39:0/3299800820 >> [v2:172.21.15.39:6800/1725006999,v1:172.21.15.39:6801/1725006999] conn(0x7f53800a2c10 msgr2=0x7f53800a50d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:36:38.980 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:36:38.979+0000 7f53a2000640 1 --2- 172.21.15.39:0/3299800820 >> [v2:172.21.15.39:6800/1725006999,v1:172.21.15.39:6801/1725006999] conn(0x7f53800a2c10 0x7f53800a50d0 secure :-1 s=READY pgs=191 cs=0 l=1 rev1=1 crypto rx=0x7f53840096c0 tx=0x7f5384009260 comp rx=0 tx=0).stop 2024-09-12T02:36:38.980 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:36:38.979+0000 7f53a2000640 1 -- 172.21.15.39:0/3299800820 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f539c074590 msgr2=0x7f539c1a46b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:36:38.980 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:36:38.979+0000 7f53a2000640 1 --2- 172.21.15.39:0/3299800820 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f539c074590 0x7f539c1a46b0 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0x7f538c00e9f0 tx=0x7f538c00eeb0 comp rx=0 tx=0).stop 2024-09-12T02:36:38.980 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:36:38.979+0000 7f53a2000640 1 -- 172.21.15.39:0/3299800820 shutdown_connections 2024-09-12T02:36:38.980 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:36:38.979+0000 7f53a2000640 1 --2- 172.21.15.39:0/3299800820 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f539c112b90 0x7f539c19e870 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:36:38.980 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:36:38.979+0000 7f53a2000640 1 --2- 172.21.15.39:0/3299800820 >> [v2:172.21.15.39:6800/1725006999,v1:172.21.15.39:6801/1725006999] conn(0x7f53800a2c10 0x7f53800a50d0 unknown :-1 s=CLOSED pgs=191 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:36:38.980 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:36:38.979+0000 7f53a2000640 1 --2- 172.21.15.39:0/3299800820 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f539c074eb0 0x7f539c1a4bf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:36:38.980 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:36:38.979+0000 7f53a2000640 1 --2- 172.21.15.39:0/3299800820 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f539c074590 0x7f539c1a46b0 unknown :-1 s=CLOSED pgs=92 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:36:38.981 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:36:38.979+0000 7f53a2000640 1 -- 172.21.15.39:0/3299800820 >> 172.21.15.39:0/3299800820 conn(0x7f539c0fd8c0 msgr2=0x7f539c0ff080 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:36:38.981 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:36:38.979+0000 7f53a2000640 1 -- 172.21.15.39:0/3299800820 shutdown_connections 2024-09-12T02:36:38.981 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:36:38.979+0000 7f53a2000640 1 -- 172.21.15.39:0/3299800820 wait complete. 2024-09-12T02:36:39.064 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:36:39.062+0000 7f6dfac00640 1 -- 172.21.15.39:0/2788529775 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f6df4103e30 msgr2=0x7f6df4104210 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:36:39.064 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:36:39.062+0000 7f6dfac00640 1 --2- 172.21.15.39:0/2788529775 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f6df4103e30 0x7f6df4104210 secure :-1 s=READY pgs=210 cs=0 l=1 rev1=1 crypto rx=0x7f6de8009900 tx=0x7f6de802a410 comp rx=0 tx=0).stop 2024-09-12T02:36:39.064 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:36:39.063+0000 7f6dfac00640 1 -- 172.21.15.39:0/2788529775 shutdown_connections 2024-09-12T02:36:39.064 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:36:39.063+0000 7f6dfac00640 1 --2- 172.21.15.39:0/2788529775 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f6df4108f60 0x7f6df4110ae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:36:39.064 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:36:39.063+0000 7f6dfac00640 1 --2- 172.21.15.39:0/2788529775 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f6df41047e0 0x7f6df4108830 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:36:39.064 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:36:39.063+0000 7f6dfac00640 1 --2- 172.21.15.39:0/2788529775 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f6df4103e30 0x7f6df4104210 unknown :-1 s=CLOSED pgs=210 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:36:39.065 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:36:39.063+0000 7f6dfac00640 1 -- 172.21.15.39:0/2788529775 >> 172.21.15.39:0/2788529775 conn(0x7f6df40ff8d0 msgr2=0x7f6df4101cf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:36:39.065 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:36:39.063+0000 7f6dfac00640 1 -- 172.21.15.39:0/2788529775 shutdown_connections 2024-09-12T02:36:39.065 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:36:39.063+0000 7f6dfac00640 1 -- 172.21.15.39:0/2788529775 wait complete. 2024-09-12T02:36:39.067 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:36:39.064+0000 7f6dfac00640 1 Processor -- start 2024-09-12T02:36:39.067 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:36:39.064+0000 7f6dfac00640 1 -- start start 2024-09-12T02:36:39.067 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:36:39.064+0000 7f6dfac00640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f6df4103e30 0x7f6df419a490 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:36:39.067 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:36:39.064+0000 7f6dfac00640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f6df41047e0 0x7f6df419a9d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:36:39.067 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:36:39.064+0000 7f6dfac00640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f6df4108f60 0x7f6df419ed60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:36:39.067 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:36:39.064+0000 7f6dfac00640 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 -- 0x7f6df4114010 con 0x7f6df4108f60 2024-09-12T02:36:39.067 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:36:39.064+0000 7f6dfac00640 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x7f6df4113e90 con 0x7f6df41047e0 2024-09-12T02:36:39.067 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:36:39.064+0000 7f6dfac00640 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7f6df4114190 con 0x7f6df4103e30 2024-09-12T02:36:39.067 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:36:39.065+0000 7f6dfa200640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f6df4108f60 0x7f6df419ed60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:36:39.067 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:36:39.065+0000 7f6df9800640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f6df4103e30 0x7f6df419a490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:36:39.067 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:36:39.065+0000 7f6dfa200640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f6df4108f60 0x7f6df419ed60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.39:3300/0 says I am v2:172.21.15.39:47128/0 (socket says 172.21.15.39:47128) 2024-09-12T02:36:39.068 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:36:39.065+0000 7f6dfa200640 1 -- 172.21.15.39:0/3913794422 learned_addr learned my addr 172.21.15.39:0/3913794422 (peer_addr_for_me v2:172.21.15.39:0/0) 2024-09-12T02:36:39.068 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:36:39.065+0000 7f6df9800640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f6df4103e30 0x7f6df419a490 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.172:3300/0 says I am v2:172.21.15.39:43866/0 (socket says 172.21.15.39:43866) 2024-09-12T02:36:39.068 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:36:39.065+0000 7f6df8e00640 1 --2- 172.21.15.39:0/3913794422 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f6df41047e0 0x7f6df419a9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:36:39.068 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:36:39.065+0000 7f6dfa200640 1 -- 172.21.15.39:0/3913794422 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f6df4103e30 msgr2=0x7f6df419a490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:36:39.068 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:36:39.065+0000 7f6dfa200640 1 --2- 172.21.15.39:0/3913794422 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f6df4103e30 0x7f6df419a490 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:36:39.068 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:36:39.065+0000 7f6dfa200640 1 -- 172.21.15.39:0/3913794422 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f6df41047e0 msgr2=0x7f6df419a9d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:36:39.068 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:36:39.065+0000 7f6dfa200640 1 --2- 172.21.15.39:0/3913794422 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f6df41047e0 0x7f6df419a9d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:36:39.068 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:36:39.065+0000 7f6dfa200640 1 -- 172.21.15.39:0/3913794422 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6df419f440 con 0x7f6df4108f60 2024-09-12T02:36:39.068 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:36:39.065+0000 7f6df9800640 1 --2- 172.21.15.39:0/3913794422 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f6df4103e30 0x7f6df419a490 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-12T02:36:39.068 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:36:39.065+0000 7f6dfa200640 1 --2- 172.21.15.39:0/3913794422 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f6df4108f60 0x7f6df419ed60 secure :-1 s=READY pgs=211 cs=0 l=1 rev1=1 crypto rx=0x7f6dec00eb10 tx=0x7f6dec00c2d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:36:39.068 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:36:39.066+0000 7f6df2000640 1 -- 172.21.15.39:0/3913794422 <== mon.0 v2:172.21.15.39:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6dec004b20 con 0x7f6df4108f60 2024-09-12T02:36:39.068 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:36:39.066+0000 7f6df2000640 1 -- 172.21.15.39:0/3913794422 <== mon.0 v2:172.21.15.39:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f6dec004cc0 con 0x7f6df4108f60 2024-09-12T02:36:39.068 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:36:39.066+0000 7f6df2000640 1 -- 172.21.15.39:0/3913794422 <== mon.0 v2:172.21.15.39:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6dec010760 con 0x7f6df4108f60 2024-09-12T02:36:39.069 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:36:39.066+0000 7f6dfac00640 1 -- 172.21.15.39:0/3913794422 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f6df419f730 con 0x7f6df4108f60 2024-09-12T02:36:39.069 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:36:39.066+0000 7f6dfac00640 1 -- 172.21.15.39:0/3913794422 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f6df41a7010 con 0x7f6df4108f60 2024-09-12T02:36:39.069 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:36:39.067+0000 7f6dfac00640 1 -- 172.21.15.39:0/3913794422 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f6df4104210 con 0x7f6df4108f60 2024-09-12T02:36:39.069 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:36:39.069+0000 7f6df2000640 1 -- 172.21.15.39:0/3913794422 <== mon.0 v2:172.21.15.39:3300/0 4 ==== mgrmap(e 17) ==== 137884+0+0 (secure 0 0 0) 0x7f6dec005020 con 0x7f6df4108f60 2024-09-12T02:36:39.071 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:36:39.070+0000 7f6df2000640 1 --2- 172.21.15.39:0/3913794422 >> [v2:172.21.15.39:6800/1725006999,v1:172.21.15.39:6801/1725006999] conn(0x7f6ddc0a2c90 0x7f6ddc0a5150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:36:39.071 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:36:39.070+0000 7f6df2000640 1 -- 172.21.15.39:0/3913794422 <== mon.0 v2:172.21.15.39:3300/0 5 ==== osd_map(93..93 src has 1..93) ==== 9092+0+0 (secure 0 0 0) 0x7f6dec0cfb40 con 0x7f6df4108f60 2024-09-12T02:36:39.071 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:36:39.071+0000 7f6df9800640 1 --2- 172.21.15.39:0/3913794422 >> [v2:172.21.15.39:6800/1725006999,v1:172.21.15.39:6801/1725006999] conn(0x7f6ddc0a2c90 0x7f6ddc0a5150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:36:39.072 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:36:39.071+0000 7f6df9800640 1 --2- 172.21.15.39:0/3913794422 >> [v2:172.21.15.39:6800/1725006999,v1:172.21.15.39:6801/1725006999] conn(0x7f6ddc0a2c90 0x7f6ddc0a5150 secure :-1 s=READY pgs=192 cs=0 l=1 rev1=1 crypto rx=0x7f6de8000c00 tx=0x7f6de8031510 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:36:39.075 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:36:39.075+0000 7f6df2000640 1 -- 172.21.15.39:0/3913794422 <== mon.0 v2:172.21.15.39:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7f6dec09c580 con 0x7f6df4108f60 2024-09-12T02:36:39.263 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:36:39.262+0000 7f6dfac00640 1 -- 172.21.15.39:0/3913794422 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 10} v 0) -- 0x7f6df410bbb0 con 0x7f6df4108f60 2024-09-12T02:36:39.263 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:36:39.262+0000 7f6df2000640 1 -- 172.21.15.39:0/3913794422 <== mon.0 v2:172.21.15.39:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 10}]=0 v0) ==== 75+0+13 (secure 0 0 0) 0x7f6dec09be80 con 0x7f6df4108f60 2024-09-12T02:36:39.263 INFO:teuthology.orchestra.run.smithi039.stdout:300647710758 2024-09-12T02:36:39.266 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:36:39.265+0000 7f6dfac00640 1 -- 172.21.15.39:0/3913794422 >> [v2:172.21.15.39:6800/1725006999,v1:172.21.15.39:6801/1725006999] conn(0x7f6ddc0a2c90 msgr2=0x7f6ddc0a5150 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:36:39.266 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:36:39.265+0000 7f6dfac00640 1 --2- 172.21.15.39:0/3913794422 >> [v2:172.21.15.39:6800/1725006999,v1:172.21.15.39:6801/1725006999] conn(0x7f6ddc0a2c90 0x7f6ddc0a5150 secure :-1 s=READY pgs=192 cs=0 l=1 rev1=1 crypto rx=0x7f6de8000c00 tx=0x7f6de8031510 comp rx=0 tx=0).stop 2024-09-12T02:36:39.266 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:36:39.265+0000 7f6dfac00640 1 -- 172.21.15.39:0/3913794422 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f6df4108f60 msgr2=0x7f6df419ed60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:36:39.266 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:36:39.265+0000 7f6dfac00640 1 --2- 172.21.15.39:0/3913794422 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f6df4108f60 0x7f6df419ed60 secure :-1 s=READY pgs=211 cs=0 l=1 rev1=1 crypto rx=0x7f6dec00eb10 tx=0x7f6dec00c2d0 comp rx=0 tx=0).stop 2024-09-12T02:36:39.266 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:36:39.265+0000 7f6dfac00640 1 -- 172.21.15.39:0/3913794422 shutdown_connections 2024-09-12T02:36:39.266 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:36:39.265+0000 7f6dfac00640 1 --2- 172.21.15.39:0/3913794422 >> [v2:172.21.15.39:6800/1725006999,v1:172.21.15.39:6801/1725006999] conn(0x7f6ddc0a2c90 0x7f6ddc0a5150 unknown :-1 s=CLOSED pgs=192 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:36:39.266 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:36:39.265+0000 7f6dfac00640 1 --2- 172.21.15.39:0/3913794422 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f6df4108f60 0x7f6df419ed60 unknown :-1 s=CLOSED pgs=211 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:36:39.266 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:36:39.265+0000 7f6dfac00640 1 --2- 172.21.15.39:0/3913794422 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f6df41047e0 0x7f6df419a9d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:36:39.266 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:36:39.265+0000 7f6dfac00640 1 --2- 172.21.15.39:0/3913794422 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f6df4103e30 0x7f6df419a490 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:36:39.267 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:36:39.265+0000 7f6dfac00640 1 -- 172.21.15.39:0/3913794422 >> 172.21.15.39:0/3913794422 conn(0x7f6df40ff8d0 msgr2=0x7f6df4100bf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:36:39.267 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:36:39.265+0000 7f6dfac00640 1 -- 172.21.15.39:0/3913794422 shutdown_connections 2024-09-12T02:36:39.267 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:36:39.265+0000 7f6dfac00640 1 -- 172.21.15.39:0/3913794422 wait complete. 2024-09-12T02:36:39.651 INFO:teuthology.orchestra.run.smithi039.stderr:Inferring config /var/lib/ceph/4954ed46-70ae-11ef-bcea-c7b262605968/mon.a/config 2024-09-12T02:36:39.652 INFO:teuthology.orchestra.run.smithi039.stderr:Inferring config /var/lib/ceph/4954ed46-70ae-11ef-bcea-c7b262605968/mon.a/config 2024-09-12T02:36:39.654 INFO:teuthology.orchestra.run.smithi039.stderr:Inferring config /var/lib/ceph/4954ed46-70ae-11ef-bcea-c7b262605968/mon.a/config 2024-09-12T02:36:40.169 INFO:tasks.cephadm.ceph_manager.ceph:need seq 300647710755 got 300647710758 for osd.10 2024-09-12T02:36:40.169 DEBUG:teuthology.parallel:result is None 2024-09-12T02:36:40.198 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 12 02:36:39 smithi044 ceph-mon[35411]: pgmap v350: 129 pgs: 129 active+clean; 645 KiB data, 347 MiB used, 1.0 TiB / 1.0 TiB avail; 5.3 KiB/s rd, 10 op/s 2024-09-12T02:36:40.198 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 12 02:36:39 smithi044 ceph-mon[35411]: from='client.? 172.21.15.39:0/3299800820' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 1}]: dispatch 2024-09-12T02:36:40.198 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 12 02:36:39 smithi044 ceph-mon[35411]: from='client.? 172.21.15.39:0/3913794422' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 10}]: dispatch 2024-09-12T02:36:40.238 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 02:36:39 smithi039 ceph-mon[30515]: pgmap v350: 129 pgs: 129 active+clean; 645 KiB data, 347 MiB used, 1.0 TiB / 1.0 TiB avail; 5.3 KiB/s rd, 10 op/s 2024-09-12T02:36:40.239 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 02:36:39 smithi039 ceph-mon[30515]: from='client.? 172.21.15.39:0/3299800820' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 1}]: dispatch 2024-09-12T02:36:40.239 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 02:36:39 smithi039 ceph-mon[30515]: from='client.? 172.21.15.39:0/3913794422' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 10}]: dispatch 2024-09-12T02:36:40.263 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 12 02:36:39 smithi172 ceph-mon[35609]: pgmap v350: 129 pgs: 129 active+clean; 645 KiB data, 347 MiB used, 1.0 TiB / 1.0 TiB avail; 5.3 KiB/s rd, 10 op/s 2024-09-12T02:36:40.263 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 12 02:36:39 smithi172 ceph-mon[35609]: from='client.? 172.21.15.39:0/3299800820' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 1}]: dispatch 2024-09-12T02:36:40.264 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 12 02:36:39 smithi172 ceph-mon[35609]: from='client.? 172.21.15.39:0/3913794422' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 10}]: dispatch 2024-09-12T02:36:40.872 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:36:40.872+0000 7f2af2400640 1 -- 172.21.15.39:0/1068177329 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f2aec1019c0 msgr2=0x7f2aec101e20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:36:40.873 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:36:40.872+0000 7f2af2400640 1 --2- 172.21.15.39:0/1068177329 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f2aec1019c0 0x7f2aec101e20 secure :-1 s=READY pgs=212 cs=0 l=1 rev1=1 crypto rx=0x7f2ad8009930 tx=0x7f2ad802a420 comp rx=0 tx=0).stop 2024-09-12T02:36:40.873 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:36:40.872+0000 7f2af2400640 1 -- 172.21.15.39:0/1068177329 shutdown_connections 2024-09-12T02:36:40.873 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:36:40.872+0000 7f2af2400640 1 --2- 172.21.15.39:0/1068177329 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f2aec102360 0x7f2aec10e890 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:36:40.873 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:36:40.872+0000 7f2af2400640 1 --2- 172.21.15.39:0/1068177329 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f2aec1019c0 0x7f2aec101e20 unknown :-1 s=CLOSED pgs=212 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:36:40.873 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:36:40.872+0000 7f2af2400640 1 --2- 172.21.15.39:0/1068177329 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f2aec1079c0 0x7f2aec107da0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:36:40.873 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:36:40.872+0000 7f2af2400640 1 -- 172.21.15.39:0/1068177329 >> 172.21.15.39:0/1068177329 conn(0x7f2aec0fd740 msgr2=0x7f2aec0ffb60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:36:40.873 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:36:40.873+0000 7f2af2400640 1 -- 172.21.15.39:0/1068177329 shutdown_connections 2024-09-12T02:36:40.873 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:36:40.873+0000 7f2af2400640 1 -- 172.21.15.39:0/1068177329 wait complete. 2024-09-12T02:36:40.874 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:36:40.874+0000 7f2af2400640 1 Processor -- start 2024-09-12T02:36:40.874 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:36:40.874+0000 7f2af2400640 1 -- start start 2024-09-12T02:36:40.875 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:36:40.875+0000 7f2af2400640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f2aec1019c0 0x7f2aec19a500 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:36:40.875 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:36:40.875+0000 7f2af2400640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f2aec102360 0x7f2aec19aa40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:36:40.875 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:36:40.875+0000 7f2af2400640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f2aec1079c0 0x7f2aec19edd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:36:40.875 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:36:40.875+0000 7f2af2400640 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 -- 0x7f2aec114060 con 0x7f2aec1079c0 2024-09-12T02:36:40.875 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:36:40.875+0000 7f2af2400640 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x7f2aec113ee0 con 0x7f2aec1019c0 2024-09-12T02:36:40.875 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:36:40.875+0000 7f2af2400640 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7f2aec1141e0 con 0x7f2aec102360 2024-09-12T02:36:40.875 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:36:40.875+0000 7f2af1000640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f2aec1019c0 0x7f2aec19a500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:36:40.875 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:36:40.875+0000 7f2af1000640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f2aec1019c0 0x7f2aec19a500 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.39:50378/0 (socket says 172.21.15.39:50378) 2024-09-12T02:36:40.875 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:36:40.875+0000 7f2af1000640 1 -- 172.21.15.39:0/610791139 learned_addr learned my addr 172.21.15.39:0/610791139 (peer_addr_for_me v2:172.21.15.39:0/0) 2024-09-12T02:36:40.875 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:36:40.875+0000 7f2aebe00640 1 --2- 172.21.15.39:0/610791139 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f2aec102360 0x7f2aec19aa40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:36:40.875 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:36:40.875+0000 7f2af1a00640 1 --2- 172.21.15.39:0/610791139 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f2aec1079c0 0x7f2aec19edd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:36:40.876 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:36:40.875+0000 7f2af1000640 1 -- 172.21.15.39:0/610791139 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f2aec102360 msgr2=0x7f2aec19aa40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:36:40.876 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:36:40.875+0000 7f2af1000640 1 --2- 172.21.15.39:0/610791139 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f2aec102360 0x7f2aec19aa40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:36:40.876 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:36:40.875+0000 7f2af1000640 1 -- 172.21.15.39:0/610791139 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f2aec1079c0 msgr2=0x7f2aec19edd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:36:40.876 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:36:40.875+0000 7f2af1000640 1 --2- 172.21.15.39:0/610791139 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f2aec1079c0 0x7f2aec19edd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:36:40.876 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:36:40.875+0000 7f2af1000640 1 -- 172.21.15.39:0/610791139 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2aec19f4b0 con 0x7f2aec1019c0 2024-09-12T02:36:40.876 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:36:40.876+0000 7f2af1000640 1 --2- 172.21.15.39:0/610791139 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f2aec1019c0 0x7f2aec19a500 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7f2ae000ea60 tx=0x7f2ae000ef20 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:36:40.879 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:36:40.876+0000 7f2ae9600640 1 -- 172.21.15.39:0/610791139 <== mon.2 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2ae000cde0 con 0x7f2aec1019c0 2024-09-12T02:36:40.879 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:36:40.876+0000 7f2af2400640 1 -- 172.21.15.39:0/610791139 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f2aec19f7a0 con 0x7f2aec1019c0 2024-09-12T02:36:40.880 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:36:40.876+0000 7f2ae9600640 1 -- 172.21.15.39:0/610791139 <== mon.2 v2:172.21.15.44:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f2ae00035f0 con 0x7f2aec1019c0 2024-09-12T02:36:40.880 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:36:40.876+0000 7f2ae9600640 1 -- 172.21.15.39:0/610791139 <== mon.2 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2ae0010670 con 0x7f2aec1019c0 2024-09-12T02:36:40.880 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:36:40.876+0000 7f2af2400640 1 -- 172.21.15.39:0/610791139 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f2aec10f0d0 con 0x7f2aec1019c0 2024-09-12T02:36:40.880 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:36:40.878+0000 7f2af2400640 1 -- 172.21.15.39:0/610791139 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f2aec101e20 con 0x7f2aec1019c0 2024-09-12T02:36:40.881 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:36:40.881+0000 7f2ae9600640 1 -- 172.21.15.39:0/610791139 <== mon.2 v2:172.21.15.44:3300/0 4 ==== mgrmap(e 17) ==== 137884+0+0 (secure 0 0 0) 0x7f2ae00037a0 con 0x7f2aec1019c0 2024-09-12T02:36:40.883 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:36:40.883+0000 7f2ae9600640 1 --2- 172.21.15.39:0/610791139 >> [v2:172.21.15.39:6800/1725006999,v1:172.21.15.39:6801/1725006999] conn(0x7f2ad40a2c90 0x7f2ad40a5150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:36:40.883 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:36:40.883+0000 7f2ae9600640 1 -- 172.21.15.39:0/610791139 <== mon.2 v2:172.21.15.44:3300/0 5 ==== osd_map(93..93 src has 1..93) ==== 9092+0+0 (secure 0 0 0) 0x7f2ae00cf7b0 con 0x7f2aec1019c0 2024-09-12T02:36:40.884 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:36:40.883+0000 7f2aebe00640 1 --2- 172.21.15.39:0/610791139 >> [v2:172.21.15.39:6800/1725006999,v1:172.21.15.39:6801/1725006999] conn(0x7f2ad40a2c90 0x7f2ad40a5150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:36:40.884 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:36:40.884+0000 7f2aebe00640 1 --2- 172.21.15.39:0/610791139 >> [v2:172.21.15.39:6800/1725006999,v1:172.21.15.39:6801/1725006999] conn(0x7f2ad40a2c90 0x7f2ad40a5150 secure :-1 s=READY pgs=193 cs=0 l=1 rev1=1 crypto rx=0x7f2ad8006010 tx=0x7f2ad8000bc0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:36:40.886 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:36:40.887+0000 7f2ae9600640 1 -- 172.21.15.39:0/610791139 <== mon.2 v2:172.21.15.44:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7f2ae009c250 con 0x7f2aec1019c0 2024-09-12T02:36:40.887 INFO:teuthology.orchestra.run.smithi039.stderr:Inferring config /var/lib/ceph/4954ed46-70ae-11ef-bcea-c7b262605968/mon.a/config 2024-09-12T02:36:40.888 INFO:teuthology.orchestra.run.smithi039.stderr:Inferring config /var/lib/ceph/4954ed46-70ae-11ef-bcea-c7b262605968/mon.a/config 2024-09-12T02:36:41.079 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:36:41.079+0000 7f2af2400640 1 -- 172.21.15.39:0/610791139 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 5} v 0) -- 0x7f2aec109f50 con 0x7f2aec1019c0 2024-09-12T02:36:41.080 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:36:41.079+0000 7f2ae9600640 1 -- 172.21.15.39:0/610791139 <== mon.2 v2:172.21.15.44:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 5}]=0 v0) ==== 74+0+13 (secure 0 0 0) 0x7f2ae009bb50 con 0x7f2aec1019c0 2024-09-12T02:36:41.080 INFO:teuthology.orchestra.run.smithi039.stdout:163208757313 2024-09-12T02:36:41.082 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:36:41.081+0000 7f2af2400640 1 -- 172.21.15.39:0/610791139 >> [v2:172.21.15.39:6800/1725006999,v1:172.21.15.39:6801/1725006999] conn(0x7f2ad40a2c90 msgr2=0x7f2ad40a5150 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:36:41.082 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:36:41.081+0000 7f2af2400640 1 --2- 172.21.15.39:0/610791139 >> [v2:172.21.15.39:6800/1725006999,v1:172.21.15.39:6801/1725006999] conn(0x7f2ad40a2c90 0x7f2ad40a5150 secure :-1 s=READY pgs=193 cs=0 l=1 rev1=1 crypto rx=0x7f2ad8006010 tx=0x7f2ad8000bc0 comp rx=0 tx=0).stop 2024-09-12T02:36:41.082 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:36:41.081+0000 7f2af2400640 1 -- 172.21.15.39:0/610791139 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f2aec1019c0 msgr2=0x7f2aec19a500 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:36:41.082 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:36:41.081+0000 7f2af2400640 1 --2- 172.21.15.39:0/610791139 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f2aec1019c0 0x7f2aec19a500 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7f2ae000ea60 tx=0x7f2ae000ef20 comp rx=0 tx=0).stop 2024-09-12T02:36:41.083 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:36:41.081+0000 7f2af2400640 1 -- 172.21.15.39:0/610791139 shutdown_connections 2024-09-12T02:36:41.083 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:36:41.081+0000 7f2af2400640 1 --2- 172.21.15.39:0/610791139 >> [v2:172.21.15.39:6800/1725006999,v1:172.21.15.39:6801/1725006999] conn(0x7f2ad40a2c90 0x7f2ad40a5150 unknown :-1 s=CLOSED pgs=193 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:36:41.083 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:36:41.081+0000 7f2af2400640 1 --2- 172.21.15.39:0/610791139 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f2aec1079c0 0x7f2aec19edd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:36:41.083 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:36:41.081+0000 7f2af2400640 1 --2- 172.21.15.39:0/610791139 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f2aec102360 0x7f2aec19aa40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:36:41.083 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:36:41.081+0000 7f2af2400640 1 --2- 172.21.15.39:0/610791139 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f2aec1019c0 0x7f2aec19a500 unknown :-1 s=CLOSED pgs=93 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:36:41.083 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:36:41.081+0000 7f2af2400640 1 -- 172.21.15.39:0/610791139 >> 172.21.15.39:0/610791139 conn(0x7f2aec0fd740 msgr2=0x7f2aec0fde90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:36:41.083 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:36:41.082+0000 7f2af2400640 1 -- 172.21.15.39:0/610791139 shutdown_connections 2024-09-12T02:36:41.083 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:36:41.082+0000 7f2af2400640 1 -- 172.21.15.39:0/610791139 wait complete. 2024-09-12T02:36:41.570 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:36:41.569+0000 7f7471e00640 1 -- 172.21.15.39:0/1994939034 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f746c1049c0 msgr2=0x7f746c108a10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:36:41.571 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:36:41.569+0000 7f7471e00640 1 --2- 172.21.15.39:0/1994939034 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f746c1049c0 0x7f746c108a10 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0x7f7454009860 tx=0x7f745402a360 comp rx=0 tx=0).stop 2024-09-12T02:36:41.571 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:36:41.570+0000 7f7471e00640 1 -- 172.21.15.39:0/1994939034 shutdown_connections 2024-09-12T02:36:41.572 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:36:41.570+0000 7f7471e00640 1 --2- 172.21.15.39:0/1994939034 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f746c109140 0x7f746c110cc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:36:41.572 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:36:41.570+0000 7f7471e00640 1 --2- 172.21.15.39:0/1994939034 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f746c1049c0 0x7f746c108a10 unknown :-1 s=CLOSED pgs=94 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:36:41.572 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:36:41.570+0000 7f7471e00640 1 --2- 172.21.15.39:0/1994939034 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f746c104010 0x7f746c1043f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:36:41.572 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:36:41.570+0000 7f7471e00640 1 -- 172.21.15.39:0/1994939034 >> 172.21.15.39:0/1994939034 conn(0x7f746c0ffa50 msgr2=0x7f746c101e70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:36:41.572 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:36:41.570+0000 7f7471e00640 1 -- 172.21.15.39:0/1994939034 shutdown_connections 2024-09-12T02:36:41.572 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:36:41.570+0000 7f7471e00640 1 -- 172.21.15.39:0/1994939034 wait complete. 2024-09-12T02:36:41.575 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:36:41.571+0000 7f7471e00640 1 Processor -- start 2024-09-12T02:36:41.575 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:36:41.572+0000 7f7471e00640 1 -- start start 2024-09-12T02:36:41.575 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:36:41.572+0000 7f7471e00640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f746c104010 0x7f746c19a700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:36:41.575 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:36:41.572+0000 7f7471e00640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f746c1049c0 0x7f746c19ac40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:36:41.576 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:36:41.572+0000 7f7471e00640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f746c109140 0x7f746c19efd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:36:41.576 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:36:41.572+0000 7f7471e00640 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 -- 0x7f746c1141e0 con 0x7f746c1049c0 2024-09-12T02:36:41.576 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:36:41.572+0000 7f7471e00640 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x7f746c114060 con 0x7f746c109140 2024-09-12T02:36:41.576 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:36:41.572+0000 7f7471e00640 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7f746c114360 con 0x7f746c104010 2024-09-12T02:36:41.576 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:36:41.572+0000 7f7462000640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f746c1049c0 0x7f746c19ac40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:36:41.576 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:36:41.572+0000 7f746aa00640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f746c104010 0x7f746c19a700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:36:41.576 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:36:41.572+0000 7f746aa00640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f746c104010 0x7f746c19a700 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.172:3300/0 says I am v2:172.21.15.39:43894/0 (socket says 172.21.15.39:43894) 2024-09-12T02:36:41.576 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:36:41.572+0000 7f746aa00640 1 -- 172.21.15.39:0/24452136 learned_addr learned my addr 172.21.15.39:0/24452136 (peer_addr_for_me v2:172.21.15.39:0/0) 2024-09-12T02:36:41.576 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:36:41.572+0000 7f7462000640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f746c1049c0 0x7f746c19ac40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.39:3300/0 says I am v2:172.21.15.39:47156/0 (socket says 172.21.15.39:47156) 2024-09-12T02:36:41.577 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:36:41.573+0000 7f746b400640 1 --2- 172.21.15.39:0/24452136 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f746c109140 0x7f746c19efd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:36:41.577 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:36:41.573+0000 7f746aa00640 1 -- 172.21.15.39:0/24452136 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f746c109140 msgr2=0x7f746c19efd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:36:41.577 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:36:41.573+0000 7f746aa00640 1 --2- 172.21.15.39:0/24452136 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f746c109140 0x7f746c19efd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:36:41.577 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:36:41.573+0000 7f746aa00640 1 -- 172.21.15.39:0/24452136 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f746c1049c0 msgr2=0x7f746c19ac40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:36:41.577 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:36:41.573+0000 7f746aa00640 1 --2- 172.21.15.39:0/24452136 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f746c1049c0 0x7f746c19ac40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:36:41.577 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:36:41.573+0000 7f746aa00640 1 -- 172.21.15.39:0/24452136 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f746c19f6b0 con 0x7f746c104010 2024-09-12T02:36:41.577 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:36:41.573+0000 7f7462000640 1 --2- 172.21.15.39:0/24452136 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f746c1049c0 0x7f746c19ac40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-12T02:36:41.577 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:36:41.573+0000 7f746aa00640 1 --2- 172.21.15.39:0/24452136 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f746c104010 0x7f746c19a700 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0x7f745c00e9c0 tx=0x7f745c00ee80 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:36:41.577 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:36:41.573+0000 7f7470a00640 1 -- 172.21.15.39:0/24452136 <== mon.1 v2:172.21.15.172:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f745c00cde0 con 0x7f746c104010 2024-09-12T02:36:41.577 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:36:41.573+0000 7f7470a00640 1 -- 172.21.15.39:0/24452136 <== mon.1 v2:172.21.15.172:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f745c0035f0 con 0x7f746c104010 2024-09-12T02:36:41.577 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:36:41.573+0000 7f7470a00640 1 -- 172.21.15.39:0/24452136 <== mon.1 v2:172.21.15.172:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f745c010690 con 0x7f746c104010 2024-09-12T02:36:41.577 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:36:41.573+0000 7f7471e00640 1 -- 172.21.15.39:0/24452136 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f746c19f9a0 con 0x7f746c104010 2024-09-12T02:36:41.578 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:36:41.574+0000 7f7471e00640 1 -- 172.21.15.39:0/24452136 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f746c1a7280 con 0x7f746c104010 2024-09-12T02:36:41.578 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:36:41.575+0000 7f7471e00640 1 -- 172.21.15.39:0/24452136 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f746c1043f0 con 0x7f746c104010 2024-09-12T02:36:41.578 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:36:41.577+0000 7f7470a00640 1 -- 172.21.15.39:0/24452136 <== mon.1 v2:172.21.15.172:3300/0 4 ==== mgrmap(e 17) ==== 137884+0+0 (secure 0 0 0) 0x7f745c0037a0 con 0x7f746c104010 2024-09-12T02:36:41.580 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:36:41.578+0000 7f7470a00640 1 --2- 172.21.15.39:0/24452136 >> [v2:172.21.15.39:6800/1725006999,v1:172.21.15.39:6801/1725006999] conn(0x7f744c0a2c90 0x7f744c0a5150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:36:41.580 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:36:41.579+0000 7f7470a00640 1 -- 172.21.15.39:0/24452136 <== mon.1 v2:172.21.15.172:3300/0 5 ==== osd_map(93..93 src has 1..93) ==== 9092+0+0 (secure 0 0 0) 0x7f745c0cf9b0 con 0x7f746c104010 2024-09-12T02:36:41.580 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:36:41.579+0000 7f7462000640 1 --2- 172.21.15.39:0/24452136 >> [v2:172.21.15.39:6800/1725006999,v1:172.21.15.39:6801/1725006999] conn(0x7f744c0a2c90 0x7f744c0a5150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:36:41.580 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:36:41.580+0000 7f7462000640 1 --2- 172.21.15.39:0/24452136 >> [v2:172.21.15.39:6800/1725006999,v1:172.21.15.39:6801/1725006999] conn(0x7f744c0a2c90 0x7f744c0a5150 secure :-1 s=READY pgs=194 cs=0 l=1 rev1=1 crypto rx=0x7f7454009830 tx=0x7f74540056d0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:36:41.581 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:36:41.580+0000 7f7470a00640 1 -- 172.21.15.39:0/24452136 <== mon.1 v2:172.21.15.172:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7f745c09c480 con 0x7f746c104010 2024-09-12T02:36:41.776 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:36:41.775+0000 7f7471e00640 1 -- 172.21.15.39:0/24452136 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) -- 0x7f746c19ba60 con 0x7f746c104010 2024-09-12T02:36:41.776 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:36:41.775+0000 7f7470a00640 1 -- 172.21.15.39:0/24452136 <== mon.1 v2:172.21.15.172:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) ==== 74+0+13 (secure 0 0 0) 0x7f745c09bd80 con 0x7f746c104010 2024-09-12T02:36:41.777 INFO:teuthology.orchestra.run.smithi039.stdout:111669149771 2024-09-12T02:36:41.779 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:36:41.778+0000 7f7471e00640 1 -- 172.21.15.39:0/24452136 >> [v2:172.21.15.39:6800/1725006999,v1:172.21.15.39:6801/1725006999] conn(0x7f744c0a2c90 msgr2=0x7f744c0a5150 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:36:41.779 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:36:41.778+0000 7f7471e00640 1 --2- 172.21.15.39:0/24452136 >> [v2:172.21.15.39:6800/1725006999,v1:172.21.15.39:6801/1725006999] conn(0x7f744c0a2c90 0x7f744c0a5150 secure :-1 s=READY pgs=194 cs=0 l=1 rev1=1 crypto rx=0x7f7454009830 tx=0x7f74540056d0 comp rx=0 tx=0).stop 2024-09-12T02:36:41.779 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:36:41.778+0000 7f7471e00640 1 -- 172.21.15.39:0/24452136 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f746c104010 msgr2=0x7f746c19a700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:36:41.779 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:36:41.778+0000 7f7471e00640 1 --2- 172.21.15.39:0/24452136 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f746c104010 0x7f746c19a700 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0x7f745c00e9c0 tx=0x7f745c00ee80 comp rx=0 tx=0).stop 2024-09-12T02:36:41.779 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:36:41.778+0000 7f7471e00640 1 -- 172.21.15.39:0/24452136 shutdown_connections 2024-09-12T02:36:41.779 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:36:41.778+0000 7f7471e00640 1 --2- 172.21.15.39:0/24452136 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f746c109140 0x7f746c19efd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:36:41.779 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:36:41.778+0000 7f7471e00640 1 --2- 172.21.15.39:0/24452136 >> [v2:172.21.15.39:6800/1725006999,v1:172.21.15.39:6801/1725006999] conn(0x7f744c0a2c90 0x7f744c0a5150 unknown :-1 s=CLOSED pgs=194 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:36:41.779 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:36:41.778+0000 7f7471e00640 1 --2- 172.21.15.39:0/24452136 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f746c1049c0 0x7f746c19ac40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:36:41.780 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:36:41.778+0000 7f7471e00640 1 --2- 172.21.15.39:0/24452136 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f746c104010 0x7f746c19a700 unknown :-1 s=CLOSED pgs=95 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:36:41.780 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:36:41.778+0000 7f7471e00640 1 -- 172.21.15.39:0/24452136 >> 172.21.15.39:0/24452136 conn(0x7f746c0ffa50 msgr2=0x7f746c100de0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:36:41.780 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:36:41.778+0000 7f7471e00640 1 -- 172.21.15.39:0/24452136 shutdown_connections 2024-09-12T02:36:41.780 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:36:41.778+0000 7f7471e00640 1 -- 172.21.15.39:0/24452136 wait complete. 2024-09-12T02:36:41.972 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 02:36:41 smithi039 ceph-mon[30515]: pgmap v351: 129 pgs: 129 active+clean; 645 KiB data, 347 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2024-09-12T02:36:41.973 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 02:36:41 smithi039 ceph-mon[30515]: from='client.? 172.21.15.39:0/610791139' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 5}]: dispatch 2024-09-12T02:36:41.973 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 02:36:41 smithi039 ceph-mon[30515]: from='client.? 172.21.15.39:0/24452136' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 3}]: dispatch 2024-09-12T02:36:42.198 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 12 02:36:41 smithi044 ceph-mon[35411]: pgmap v351: 129 pgs: 129 active+clean; 645 KiB data, 347 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2024-09-12T02:36:42.199 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 12 02:36:41 smithi044 ceph-mon[35411]: from='client.? 172.21.15.39:0/610791139' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 5}]: dispatch 2024-09-12T02:36:42.199 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 12 02:36:41 smithi044 ceph-mon[35411]: from='client.? 172.21.15.39:0/24452136' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 3}]: dispatch 2024-09-12T02:36:42.263 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 12 02:36:41 smithi172 ceph-mon[35609]: pgmap v351: 129 pgs: 129 active+clean; 645 KiB data, 347 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2024-09-12T02:36:42.264 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 12 02:36:41 smithi172 ceph-mon[35609]: from='client.? 172.21.15.39:0/610791139' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 5}]: dispatch 2024-09-12T02:36:42.264 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 12 02:36:41 smithi172 ceph-mon[35609]: from='client.? 172.21.15.39:0/24452136' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 3}]: dispatch 2024-09-12T02:36:42.657 INFO:teuthology.orchestra.run.smithi039.stderr:Inferring config /var/lib/ceph/4954ed46-70ae-11ef-bcea-c7b262605968/mon.a/config 2024-09-12T02:36:42.705 INFO:tasks.cephadm.ceph_manager.ceph:need seq 55834574932 got 55834574935 for osd.1 2024-09-12T02:36:42.705 DEBUG:teuthology.parallel:result is None 2024-09-12T02:36:43.292 INFO:tasks.cephadm.ceph_manager.ceph:need seq 111669149769 got 111669149771 for osd.3 2024-09-12T02:36:43.293 DEBUG:teuthology.parallel:result is None 2024-09-12T02:36:43.544 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:36:43.018+0000 7f1894a00640 1 -- 172.21.15.39:0/1109682210 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f1890104010 msgr2=0x7f18901043f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:36:43.544 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:36:43.018+0000 7f1894a00640 1 --2- 172.21.15.39:0/1109682210 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f1890104010 0x7f18901043f0 secure :-1 s=READY pgs=213 cs=0 l=1 rev1=1 crypto rx=0x7f1880009ca0 tx=0x7f188002a8c0 comp rx=0 tx=0).stop 2024-09-12T02:36:43.544 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:36:43.018+0000 7f1894a00640 1 -- 172.21.15.39:0/1109682210 shutdown_connections 2024-09-12T02:36:43.544 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:36:43.018+0000 7f1894a00640 1 --2- 172.21.15.39:0/1109682210 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f1890109140 0x7f1890110cc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:36:43.544 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:36:43.018+0000 7f1894a00640 1 --2- 172.21.15.39:0/1109682210 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f18901049c0 0x7f1890108a10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:36:43.545 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:36:43.018+0000 7f1894a00640 1 --2- 172.21.15.39:0/1109682210 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f1890104010 0x7f18901043f0 unknown :-1 s=CLOSED pgs=213 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:36:43.545 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:36:43.018+0000 7f1894a00640 1 -- 172.21.15.39:0/1109682210 >> 172.21.15.39:0/1109682210 conn(0x7f18900ffa50 msgr2=0x7f1890101e70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:36:43.545 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:36:43.018+0000 7f1894a00640 1 -- 172.21.15.39:0/1109682210 shutdown_connections 2024-09-12T02:36:43.545 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:36:43.018+0000 7f1894a00640 1 -- 172.21.15.39:0/1109682210 wait complete. 2024-09-12T02:36:43.545 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:36:43.019+0000 7f1894a00640 1 Processor -- start 2024-09-12T02:36:43.545 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:36:43.020+0000 7f1894a00640 1 -- start start 2024-09-12T02:36:43.545 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:36:43.020+0000 7f1894a00640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f1890104010 0x7f189019a600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:36:43.545 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:36:43.020+0000 7f1894a00640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f18901049c0 0x7f189019ab40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:36:43.545 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:36:43.020+0000 7f1894a00640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f1890109140 0x7f189019eed0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:36:43.545 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:36:43.020+0000 7f1894a00640 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 -- 0x7f1890114140 con 0x7f1890109140 2024-09-12T02:36:43.545 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:36:43.020+0000 7f1894a00640 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x7f1890113fc0 con 0x7f18901049c0 2024-09-12T02:36:43.545 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:36:43.020+0000 7f1894a00640 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7f18901142c0 con 0x7f1890104010 2024-09-12T02:36:43.545 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:36:43.021+0000 7f188e800640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f1890109140 0x7f189019eed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:36:43.546 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:36:43.021+0000 7f188de00640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f1890104010 0x7f189019a600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:36:43.546 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:36:43.021+0000 7f1885400640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f18901049c0 0x7f189019ab40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:36:43.546 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:36:43.021+0000 7f1885400640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f18901049c0 0x7f189019ab40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.39:50406/0 (socket says 172.21.15.39:50406) 2024-09-12T02:36:43.546 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:36:43.021+0000 7f188de00640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f1890104010 0x7f189019a600 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.172:3300/0 says I am v2:172.21.15.39:43918/0 (socket says 172.21.15.39:43918) 2024-09-12T02:36:43.546 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:36:43.021+0000 7f1885400640 1 -- 172.21.15.39:0/2516855175 learned_addr learned my addr 172.21.15.39:0/2516855175 (peer_addr_for_me v2:172.21.15.39:0/0) 2024-09-12T02:36:43.546 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:36:43.021+0000 7f188e800640 1 -- 172.21.15.39:0/2516855175 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f1890104010 msgr2=0x7f189019a600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:36:43.546 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:36:43.021+0000 7f188e800640 1 --2- 172.21.15.39:0/2516855175 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f1890104010 0x7f189019a600 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:36:43.546 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:36:43.021+0000 7f188e800640 1 -- 172.21.15.39:0/2516855175 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f18901049c0 msgr2=0x7f189019ab40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:36:43.546 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:36:43.021+0000 7f188e800640 1 --2- 172.21.15.39:0/2516855175 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f18901049c0 0x7f189019ab40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:36:43.547 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:36:43.021+0000 7f188e800640 1 -- 172.21.15.39:0/2516855175 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f189019f5b0 con 0x7f1890109140 2024-09-12T02:36:43.547 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:36:43.021+0000 7f1885400640 1 --2- 172.21.15.39:0/2516855175 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f18901049c0 0x7f189019ab40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-12T02:36:43.547 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:36:43.021+0000 7f188e800640 1 --2- 172.21.15.39:0/2516855175 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f1890109140 0x7f189019eed0 secure :-1 s=READY pgs=214 cs=0 l=1 rev1=1 crypto rx=0x7f188800d680 tx=0x7f188800db40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:36:43.547 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:36:43.022+0000 7f1887400640 1 -- 172.21.15.39:0/2516855175 <== mon.0 v2:172.21.15.39:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1888017070 con 0x7f1890109140 2024-09-12T02:36:43.547 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:36:43.022+0000 7f1887400640 1 -- 172.21.15.39:0/2516855175 <== mon.0 v2:172.21.15.39:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f1888009820 con 0x7f1890109140 2024-09-12T02:36:43.547 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:36:43.022+0000 7f1887400640 1 -- 172.21.15.39:0/2516855175 <== mon.0 v2:172.21.15.39:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1888004e00 con 0x7f1890109140 2024-09-12T02:36:43.547 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:36:43.022+0000 7f1894a00640 1 -- 172.21.15.39:0/2516855175 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f189019f8a0 con 0x7f1890109140 2024-09-12T02:36:43.547 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:36:43.022+0000 7f1894a00640 1 -- 172.21.15.39:0/2516855175 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f18901a7180 con 0x7f1890109140 2024-09-12T02:36:43.547 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:36:43.023+0000 7f1894a00640 1 -- 172.21.15.39:0/2516855175 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f18901043f0 con 0x7f1890109140 2024-09-12T02:36:43.547 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:36:43.025+0000 7f1887400640 1 -- 172.21.15.39:0/2516855175 <== mon.0 v2:172.21.15.39:3300/0 4 ==== mgrmap(e 17) ==== 137884+0+0 (secure 0 0 0) 0x7f18880099d0 con 0x7f1890109140 2024-09-12T02:36:43.547 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:36:43.026+0000 7f1887400640 1 --2- 172.21.15.39:0/2516855175 >> [v2:172.21.15.39:6800/1725006999,v1:172.21.15.39:6801/1725006999] conn(0x7f18740a2c10 0x7f18740a50d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:36:43.547 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:36:43.026+0000 7f1887400640 1 -- 172.21.15.39:0/2516855175 <== mon.0 v2:172.21.15.39:3300/0 5 ==== osd_map(93..93 src has 1..93) ==== 9092+0+0 (secure 0 0 0) 0x7f18880ced30 con 0x7f1890109140 2024-09-12T02:36:43.547 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:36:43.027+0000 7f188de00640 1 --2- 172.21.15.39:0/2516855175 >> [v2:172.21.15.39:6800/1725006999,v1:172.21.15.39:6801/1725006999] conn(0x7f18740a2c10 0x7f18740a50d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:36:43.548 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:36:43.027+0000 7f188de00640 1 --2- 172.21.15.39:0/2516855175 >> [v2:172.21.15.39:6800/1725006999,v1:172.21.15.39:6801/1725006999] conn(0x7f18740a2c10 0x7f18740a50d0 secure :-1 s=READY pgs=195 cs=0 l=1 rev1=1 crypto rx=0x7f1880006010 tx=0x7f1880009360 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:36:43.548 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:36:43.030+0000 7f1887400640 1 -- 172.21.15.39:0/2516855175 <== mon.0 v2:172.21.15.39:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7f188809b120 con 0x7f1890109140 2024-09-12T02:36:43.548 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:36:43.219+0000 7f1894a00640 1 -- 172.21.15.39:0/2516855175 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) -- 0x7f189010c380 con 0x7f1890109140 2024-09-12T02:36:43.548 INFO:teuthology.orchestra.run.smithi039.stdout:34359738458 2024-09-12T02:36:43.548 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:36:43.220+0000 7f1887400640 1 -- 172.21.15.39:0/2516855175 <== mon.0 v2:172.21.15.39:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) ==== 74+0+12 (secure 0 0 0) 0x7f188809f420 con 0x7f1890109140 2024-09-12T02:36:43.548 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:36:43.222+0000 7f1894a00640 1 -- 172.21.15.39:0/2516855175 >> [v2:172.21.15.39:6800/1725006999,v1:172.21.15.39:6801/1725006999] conn(0x7f18740a2c10 msgr2=0x7f18740a50d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:36:43.549 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:36:43.222+0000 7f1894a00640 1 --2- 172.21.15.39:0/2516855175 >> [v2:172.21.15.39:6800/1725006999,v1:172.21.15.39:6801/1725006999] conn(0x7f18740a2c10 0x7f18740a50d0 secure :-1 s=READY pgs=195 cs=0 l=1 rev1=1 crypto rx=0x7f1880006010 tx=0x7f1880009360 comp rx=0 tx=0).stop 2024-09-12T02:36:43.549 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:36:43.222+0000 7f1894a00640 1 -- 172.21.15.39:0/2516855175 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f1890109140 msgr2=0x7f189019eed0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:36:43.549 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:36:43.222+0000 7f1894a00640 1 --2- 172.21.15.39:0/2516855175 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f1890109140 0x7f189019eed0 secure :-1 s=READY pgs=214 cs=0 l=1 rev1=1 crypto rx=0x7f188800d680 tx=0x7f188800db40 comp rx=0 tx=0).stop 2024-09-12T02:36:43.549 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:36:43.222+0000 7f1894a00640 1 -- 172.21.15.39:0/2516855175 shutdown_connections 2024-09-12T02:36:43.549 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:36:43.222+0000 7f1894a00640 1 --2- 172.21.15.39:0/2516855175 >> [v2:172.21.15.39:6800/1725006999,v1:172.21.15.39:6801/1725006999] conn(0x7f18740a2c10 0x7f18740a50d0 unknown :-1 s=CLOSED pgs=195 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:36:43.549 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:36:43.222+0000 7f1894a00640 1 --2- 172.21.15.39:0/2516855175 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f1890109140 0x7f189019eed0 unknown :-1 s=CLOSED pgs=214 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:36:43.549 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:36:43.222+0000 7f1894a00640 1 --2- 172.21.15.39:0/2516855175 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f18901049c0 0x7f189019ab40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:36:43.549 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:36:43.222+0000 7f1894a00640 1 --2- 172.21.15.39:0/2516855175 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f1890104010 0x7f189019a600 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:36:43.549 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:36:43.222+0000 7f1894a00640 1 -- 172.21.15.39:0/2516855175 >> 172.21.15.39:0/2516855175 conn(0x7f18900ffa50 msgr2=0x7f1890100e10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:36:43.549 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:36:43.222+0000 7f1894a00640 1 -- 172.21.15.39:0/2516855175 shutdown_connections 2024-09-12T02:36:43.549 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:36:43.222+0000 7f1894a00640 1 -- 172.21.15.39:0/2516855175 wait complete. 2024-09-12T02:36:43.758 INFO:teuthology.orchestra.run.smithi039.stderr:Inferring config /var/lib/ceph/4954ed46-70ae-11ef-bcea-c7b262605968/mon.a/config 2024-09-12T02:36:44.147 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 02:36:43 smithi039 ceph-mon[30515]: pgmap v352: 129 pgs: 129 active+clean; 645 KiB data, 347 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2024-09-12T02:36:44.147 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 02:36:43 smithi039 ceph-mon[30515]: from='client.? 172.21.15.39:0/2516855175' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 0}]: dispatch 2024-09-12T02:36:44.147 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 02:36:43 smithi039 ceph-mon[30515]: from='client.? 172.21.15.39:0/1102274016' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 2}]: dispatch 2024-09-12T02:36:44.263 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 12 02:36:43 smithi172 ceph-mon[35609]: pgmap v352: 129 pgs: 129 active+clean; 645 KiB data, 347 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2024-09-12T02:36:44.264 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 12 02:36:43 smithi172 ceph-mon[35609]: from='client.? 172.21.15.39:0/2516855175' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 0}]: dispatch 2024-09-12T02:36:44.264 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 12 02:36:43 smithi172 ceph-mon[35609]: from='client.? 172.21.15.39:0/1102274016' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 2}]: dispatch 2024-09-12T02:36:44.385 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:36:43.553+0000 7f898e800640 1 -- 172.21.15.39:0/2364170129 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f8988103ff0 msgr2=0x7f89881043d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:36:44.385 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:36:43.553+0000 7f898e800640 1 --2- 172.21.15.39:0/2364170129 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f8988103ff0 0x7f89881043d0 secure :-1 s=READY pgs=215 cs=0 l=1 rev1=1 crypto rx=0x7f8978009900 tx=0x7f897802a410 comp rx=0 tx=0).stop 2024-09-12T02:36:44.385 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:36:43.553+0000 7f898e800640 1 -- 172.21.15.39:0/2364170129 shutdown_connections 2024-09-12T02:36:44.385 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:36:43.553+0000 7f898e800640 1 --2- 172.21.15.39:0/2364170129 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f8988109120 0x7f8988110ca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:36:44.385 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:36:43.553+0000 7f898e800640 1 --2- 172.21.15.39:0/2364170129 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f89881049a0 0x7f89881089f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:36:44.385 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:36:43.553+0000 7f898e800640 1 --2- 172.21.15.39:0/2364170129 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f8988103ff0 0x7f89881043d0 unknown :-1 s=CLOSED pgs=215 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:36:44.385 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:36:43.553+0000 7f898e800640 1 -- 172.21.15.39:0/2364170129 >> 172.21.15.39:0/2364170129 conn(0x7f89880ffa90 msgr2=0x7f8988101eb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:36:44.385 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:36:43.553+0000 7f898e800640 1 -- 172.21.15.39:0/2364170129 shutdown_connections 2024-09-12T02:36:44.385 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:36:43.554+0000 7f898e800640 1 -- 172.21.15.39:0/2364170129 wait complete. 2024-09-12T02:36:44.385 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:36:43.554+0000 7f898e800640 1 Processor -- start 2024-09-12T02:36:44.385 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:36:43.554+0000 7f898e800640 1 -- start start 2024-09-12T02:36:44.385 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:36:43.555+0000 7f898e800640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f8988103ff0 0x7f898819a620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:36:44.386 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:36:43.555+0000 7f898e800640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f89881049a0 0x7f898819ab60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:36:44.386 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:36:43.555+0000 7f898e800640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f8988109120 0x7f898819eef0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:36:44.386 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:36:43.555+0000 7f898e800640 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 -- 0x7f8988114140 con 0x7f8988103ff0 2024-09-12T02:36:44.386 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:36:43.555+0000 7f898e800640 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x7f8988113fc0 con 0x7f89881049a0 2024-09-12T02:36:44.386 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:36:43.555+0000 7f898e800640 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7f89881142c0 con 0x7f8988109120 2024-09-12T02:36:44.386 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:36:43.555+0000 7f8987400640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f8988103ff0 0x7f898819a620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:36:44.386 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:36:43.555+0000 7f8986a00640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f89881049a0 0x7f898819ab60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:36:44.386 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:36:43.555+0000 7f8987400640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f8988103ff0 0x7f898819a620 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.39:3300/0 says I am v2:172.21.15.39:47178/0 (socket says 172.21.15.39:47178) 2024-09-12T02:36:44.386 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:36:43.555+0000 7f8986a00640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f89881049a0 0x7f898819ab60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.39:50420/0 (socket says 172.21.15.39:50420) 2024-09-12T02:36:44.386 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:36:43.555+0000 7f8987400640 1 -- 172.21.15.39:0/1102274016 learned_addr learned my addr 172.21.15.39:0/1102274016 (peer_addr_for_me v2:172.21.15.39:0/0) 2024-09-12T02:36:44.386 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:36:43.555+0000 7f8987e00640 1 --2- 172.21.15.39:0/1102274016 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f8988109120 0x7f898819eef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:36:44.386 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:36:43.556+0000 7f8986a00640 1 -- 172.21.15.39:0/1102274016 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f8988109120 msgr2=0x7f898819eef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:36:44.386 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:36:43.556+0000 7f8986a00640 1 --2- 172.21.15.39:0/1102274016 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f8988109120 0x7f898819eef0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:36:44.387 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:36:43.556+0000 7f8986a00640 1 -- 172.21.15.39:0/1102274016 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f8988103ff0 msgr2=0x7f898819a620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:36:44.387 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:36:43.556+0000 7f8986a00640 1 --2- 172.21.15.39:0/1102274016 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f8988103ff0 0x7f898819a620 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:36:44.387 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:36:43.556+0000 7f8986a00640 1 -- 172.21.15.39:0/1102274016 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f898819f5d0 con 0x7f89881049a0 2024-09-12T02:36:44.387 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:36:43.556+0000 7f8986a00640 1 --2- 172.21.15.39:0/1102274016 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f89881049a0 0x7f898819ab60 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0x7f897400e9f0 tx=0x7f897400eeb0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:36:44.387 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:36:43.556+0000 7f897fe00640 1 -- 172.21.15.39:0/1102274016 <== mon.2 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f897400ccc0 con 0x7f89881049a0 2024-09-12T02:36:44.387 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:36:43.556+0000 7f897fe00640 1 -- 172.21.15.39:0/1102274016 <== mon.2 v2:172.21.15.44:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f8974005020 con 0x7f89881049a0 2024-09-12T02:36:44.387 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:36:43.556+0000 7f898e800640 1 -- 172.21.15.39:0/1102274016 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f898819f8c0 con 0x7f89881049a0 2024-09-12T02:36:44.387 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:36:43.556+0000 7f897fe00640 1 -- 172.21.15.39:0/1102274016 <== mon.2 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f89740049e0 con 0x7f89881049a0 2024-09-12T02:36:44.387 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:36:43.556+0000 7f898e800640 1 -- 172.21.15.39:0/1102274016 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f89881a71a0 con 0x7f89881049a0 2024-09-12T02:36:44.387 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:36:43.557+0000 7f898e800640 1 -- 172.21.15.39:0/1102274016 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f89881043d0 con 0x7f89881049a0 2024-09-12T02:36:44.387 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:36:43.559+0000 7f897fe00640 1 -- 172.21.15.39:0/1102274016 <== mon.2 v2:172.21.15.44:3300/0 4 ==== mgrmap(e 17) ==== 137884+0+0 (secure 0 0 0) 0x7f8974005560 con 0x7f89881049a0 2024-09-12T02:36:44.387 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:36:43.561+0000 7f897fe00640 1 --2- 172.21.15.39:0/1102274016 >> [v2:172.21.15.39:6800/1725006999,v1:172.21.15.39:6801/1725006999] conn(0x7f896c0a2c10 0x7f896c0a50d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:36:44.387 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:36:43.561+0000 7f897fe00640 1 -- 172.21.15.39:0/1102274016 <== mon.2 v2:172.21.15.44:3300/0 5 ==== osd_map(93..93 src has 1..93) ==== 9092+0+0 (secure 0 0 0) 0x7f89740cf5d0 con 0x7f89881049a0 2024-09-12T02:36:44.388 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:36:43.561+0000 7f8987400640 1 --2- 172.21.15.39:0/1102274016 >> [v2:172.21.15.39:6800/1725006999,v1:172.21.15.39:6801/1725006999] conn(0x7f896c0a2c10 0x7f896c0a50d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:36:44.388 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:36:43.562+0000 7f8987400640 1 --2- 172.21.15.39:0/1102274016 >> [v2:172.21.15.39:6800/1725006999,v1:172.21.15.39:6801/1725006999] conn(0x7f896c0a2c10 0x7f896c0a50d0 secure :-1 s=READY pgs=196 cs=0 l=1 rev1=1 crypto rx=0x7f89780096c0 tx=0x7f8978005a20 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:36:44.388 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:36:43.563+0000 7f897fe00640 1 -- 172.21.15.39:0/1102274016 <== mon.2 v2:172.21.15.44:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7f89740051d0 con 0x7f89881049a0 2024-09-12T02:36:44.388 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:36:43.751+0000 7f898e800640 1 -- 172.21.15.39:0/1102274016 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) -- 0x7f898819b980 con 0x7f89881049a0 2024-09-12T02:36:44.388 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:36:43.752+0000 7f897fe00640 1 -- 172.21.15.39:0/1102274016 <== mon.2 v2:172.21.15.44:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) ==== 74+0+12 (secure 0 0 0) 0x7f898819b980 con 0x7f89881049a0 2024-09-12T02:36:44.388 INFO:teuthology.orchestra.run.smithi039.stdout:77309411410 2024-09-12T02:36:44.389 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:36:43.754+0000 7f898e800640 1 -- 172.21.15.39:0/1102274016 >> [v2:172.21.15.39:6800/1725006999,v1:172.21.15.39:6801/1725006999] conn(0x7f896c0a2c10 msgr2=0x7f896c0a50d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:36:44.389 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:36:43.754+0000 7f898e800640 1 --2- 172.21.15.39:0/1102274016 >> [v2:172.21.15.39:6800/1725006999,v1:172.21.15.39:6801/1725006999] conn(0x7f896c0a2c10 0x7f896c0a50d0 secure :-1 s=READY pgs=196 cs=0 l=1 rev1=1 crypto rx=0x7f89780096c0 tx=0x7f8978005a20 comp rx=0 tx=0).stop 2024-09-12T02:36:44.389 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:36:43.754+0000 7f898e800640 1 -- 172.21.15.39:0/1102274016 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f89881049a0 msgr2=0x7f898819ab60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:36:44.389 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:36:43.754+0000 7f898e800640 1 --2- 172.21.15.39:0/1102274016 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f89881049a0 0x7f898819ab60 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0x7f897400e9f0 tx=0x7f897400eeb0 comp rx=0 tx=0).stop 2024-09-12T02:36:44.389 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:36:43.754+0000 7f898e800640 1 -- 172.21.15.39:0/1102274016 shutdown_connections 2024-09-12T02:36:44.389 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:36:43.754+0000 7f898e800640 1 --2- 172.21.15.39:0/1102274016 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f8988109120 0x7f898819eef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:36:44.389 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:36:43.754+0000 7f898e800640 1 --2- 172.21.15.39:0/1102274016 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f89881049a0 0x7f898819ab60 unknown :-1 s=CLOSED pgs=94 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:36:44.389 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:36:43.754+0000 7f898e800640 1 --2- 172.21.15.39:0/1102274016 >> [v2:172.21.15.39:6800/1725006999,v1:172.21.15.39:6801/1725006999] conn(0x7f896c0a2c10 0x7f896c0a50d0 unknown :-1 s=CLOSED pgs=196 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:36:44.389 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:36:43.754+0000 7f898e800640 1 --2- 172.21.15.39:0/1102274016 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f8988103ff0 0x7f898819a620 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:36:44.389 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:36:43.754+0000 7f898e800640 1 -- 172.21.15.39:0/1102274016 >> 172.21.15.39:0/1102274016 conn(0x7f89880ffa90 msgr2=0x7f8988100d90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:36:44.389 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:36:43.754+0000 7f898e800640 1 -- 172.21.15.39:0/1102274016 shutdown_connections 2024-09-12T02:36:44.389 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:36:43.754+0000 7f898e800640 1 -- 172.21.15.39:0/1102274016 wait complete. 2024-09-12T02:36:44.449 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 12 02:36:43 smithi044 ceph-mon[35411]: pgmap v352: 129 pgs: 129 active+clean; 645 KiB data, 347 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2024-09-12T02:36:44.449 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 12 02:36:43 smithi044 ceph-mon[35411]: from='client.? 172.21.15.39:0/2516855175' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 0}]: dispatch 2024-09-12T02:36:44.449 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 12 02:36:43 smithi044 ceph-mon[35411]: from='client.? 172.21.15.39:0/1102274016' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 2}]: dispatch 2024-09-12T02:36:45.194 INFO:tasks.cephadm.ceph_manager.ceph:need seq 34359738455 got 34359738458 for osd.0 2024-09-12T02:36:45.194 DEBUG:teuthology.parallel:result is None 2024-09-12T02:36:45.578 INFO:tasks.cephadm.ceph_manager.ceph:need seq 77309411407 got 77309411410 for osd.2 2024-09-12T02:36:45.578 DEBUG:teuthology.parallel:result is None 2024-09-12T02:36:46.086 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:36:45.868+0000 7fbb6b000640 1 -- 172.21.15.39:0/3316049621 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fbb64103ff0 msgr2=0x7fbb641043d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:36:46.087 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:36:45.868+0000 7fbb6b000640 1 --2- 172.21.15.39:0/3316049621 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fbb64103ff0 0x7fbb641043d0 secure :-1 s=READY pgs=216 cs=0 l=1 rev1=1 crypto rx=0x7fbb54009900 tx=0x7fbb5402a410 comp rx=0 tx=0).stop 2024-09-12T02:36:46.087 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:36:45.868+0000 7fbb6b000640 1 -- 172.21.15.39:0/3316049621 shutdown_connections 2024-09-12T02:36:46.087 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:36:45.868+0000 7fbb6b000640 1 --2- 172.21.15.39:0/3316049621 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fbb64109120 0x7fbb64110ca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:36:46.087 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:36:45.868+0000 7fbb6b000640 1 --2- 172.21.15.39:0/3316049621 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fbb641049a0 0x7fbb641089f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:36:46.087 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:36:45.868+0000 7fbb6b000640 1 --2- 172.21.15.39:0/3316049621 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fbb64103ff0 0x7fbb641043d0 unknown :-1 s=CLOSED pgs=216 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:36:46.087 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:36:45.868+0000 7fbb6b000640 1 -- 172.21.15.39:0/3316049621 >> 172.21.15.39:0/3316049621 conn(0x7fbb640ffa90 msgr2=0x7fbb64101eb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:36:46.087 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:36:45.868+0000 7fbb6b000640 1 -- 172.21.15.39:0/3316049621 shutdown_connections 2024-09-12T02:36:46.087 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:36:45.868+0000 7fbb6b000640 1 -- 172.21.15.39:0/3316049621 wait complete. 2024-09-12T02:36:46.087 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:36:45.869+0000 7fbb6b000640 1 Processor -- start 2024-09-12T02:36:46.087 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:36:45.869+0000 7fbb6b000640 1 -- start start 2024-09-12T02:36:46.088 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:36:45.869+0000 7fbb6b000640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fbb64103ff0 0x7fbb6419a600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:36:46.088 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:36:45.869+0000 7fbb6b000640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fbb641049a0 0x7fbb6419ab40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:36:46.088 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:36:45.869+0000 7fbb6b000640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fbb64109120 0x7fbb6419eed0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:36:46.088 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:36:45.869+0000 7fbb6b000640 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 -- 0x7fbb64114170 con 0x7fbb64109120 2024-09-12T02:36:46.088 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:36:45.869+0000 7fbb6b000640 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x7fbb64113ff0 con 0x7fbb641049a0 2024-09-12T02:36:46.088 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:36:45.869+0000 7fbb6b000640 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7fbb641142f0 con 0x7fbb64103ff0 2024-09-12T02:36:46.088 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:36:45.870+0000 7fbb63400640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fbb641049a0 0x7fbb6419ab40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:36:46.088 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:36:45.870+0000 7fbb69000640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fbb64109120 0x7fbb6419eed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:36:46.088 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:36:45.870+0000 7fbb63400640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fbb641049a0 0x7fbb6419ab40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.39:50432/0 (socket says 172.21.15.39:50432) 2024-09-12T02:36:46.088 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:36:45.870+0000 7fbb69000640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fbb64109120 0x7fbb6419eed0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.39:3300/0 says I am v2:172.21.15.39:47196/0 (socket says 172.21.15.39:47196) 2024-09-12T02:36:46.088 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:36:45.870+0000 7fbb63400640 1 -- 172.21.15.39:0/803520514 learned_addr learned my addr 172.21.15.39:0/803520514 (peer_addr_for_me v2:172.21.15.39:0/0) 2024-09-12T02:36:46.088 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:36:45.870+0000 7fbb63e00640 1 --2- 172.21.15.39:0/803520514 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fbb64103ff0 0x7fbb6419a600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:36:46.088 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:36:45.870+0000 7fbb63400640 1 -- 172.21.15.39:0/803520514 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fbb64103ff0 msgr2=0x7fbb6419a600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:36:46.089 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:36:45.870+0000 7fbb63400640 1 --2- 172.21.15.39:0/803520514 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fbb64103ff0 0x7fbb6419a600 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:36:46.089 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:36:45.870+0000 7fbb63400640 1 -- 172.21.15.39:0/803520514 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fbb64109120 msgr2=0x7fbb6419eed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:36:46.089 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:36:45.870+0000 7fbb63400640 1 --2- 172.21.15.39:0/803520514 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fbb64109120 0x7fbb6419eed0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:36:46.089 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:36:45.870+0000 7fbb63400640 1 -- 172.21.15.39:0/803520514 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fbb6419f5b0 con 0x7fbb641049a0 2024-09-12T02:36:46.089 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:36:45.870+0000 7fbb63400640 1 --2- 172.21.15.39:0/803520514 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fbb641049a0 0x7fbb6419ab40 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0x7fbb5000e9f0 tx=0x7fbb5000eeb0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:36:46.089 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:36:45.871+0000 7fbb60c00640 1 -- 172.21.15.39:0/803520514 <== mon.2 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbb5000cd80 con 0x7fbb641049a0 2024-09-12T02:36:46.089 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:36:45.871+0000 7fbb6b000640 1 -- 172.21.15.39:0/803520514 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fbb6419f8a0 con 0x7fbb641049a0 2024-09-12T02:36:46.089 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:36:45.871+0000 7fbb60c00640 1 -- 172.21.15.39:0/803520514 <== mon.2 v2:172.21.15.44:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fbb50010910 con 0x7fbb641049a0 2024-09-12T02:36:46.089 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:36:45.871+0000 7fbb60c00640 1 -- 172.21.15.39:0/803520514 <== mon.2 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbb500188f0 con 0x7fbb641049a0 2024-09-12T02:36:46.089 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:36:45.871+0000 7fbb6b000640 1 -- 172.21.15.39:0/803520514 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fbb641a7180 con 0x7fbb641049a0 2024-09-12T02:36:46.089 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:36:45.872+0000 7fbb6b000640 1 -- 172.21.15.39:0/803520514 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fbb641043d0 con 0x7fbb641049a0 2024-09-12T02:36:46.089 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:36:45.875+0000 7fbb60c00640 1 -- 172.21.15.39:0/803520514 <== mon.2 v2:172.21.15.44:3300/0 4 ==== mgrmap(e 17) ==== 137884+0+0 (secure 0 0 0) 0x7fbb50010ac0 con 0x7fbb641049a0 2024-09-12T02:36:46.089 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:36:45.876+0000 7fbb60c00640 1 --2- 172.21.15.39:0/803520514 >> [v2:172.21.15.39:6800/1725006999,v1:172.21.15.39:6801/1725006999] conn(0x7fbb480a2c10 0x7fbb480a50d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:36:46.090 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:36:45.876+0000 7fbb60c00640 1 -- 172.21.15.39:0/803520514 <== mon.2 v2:172.21.15.44:3300/0 5 ==== osd_map(93..93 src has 1..93) ==== 9092+0+0 (secure 0 0 0) 0x7fbb500cfd20 con 0x7fbb641049a0 2024-09-12T02:36:46.090 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:36:45.876+0000 7fbb63e00640 1 --2- 172.21.15.39:0/803520514 >> [v2:172.21.15.39:6800/1725006999,v1:172.21.15.39:6801/1725006999] conn(0x7fbb480a2c10 0x7fbb480a50d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:36:46.090 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:36:45.877+0000 7fbb63e00640 1 --2- 172.21.15.39:0/803520514 >> [v2:172.21.15.39:6800/1725006999,v1:172.21.15.39:6801/1725006999] conn(0x7fbb480a2c10 0x7fbb480a50d0 secure :-1 s=READY pgs=197 cs=0 l=1 rev1=1 crypto rx=0x7fbb54000c00 tx=0x7fbb54005b50 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:36:46.090 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:36:45.877+0000 7fbb60c00640 1 -- 172.21.15.39:0/803520514 <== mon.2 v2:172.21.15.44:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7fbb5009c110 con 0x7fbb641049a0 2024-09-12T02:36:46.090 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:36:46.081+0000 7fbb6b000640 1 -- 172.21.15.39:0/803520514 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 9} v 0) -- 0x7fbb6402d7c0 con 0x7fbb641049a0 2024-09-12T02:36:46.090 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:36:46.081+0000 7fbb60c00640 1 -- 172.21.15.39:0/803520514 <== mon.2 v2:172.21.15.44:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 9}]=0 v0) ==== 74+0+13 (secure 0 0 0) 0x7fbb500a0410 con 0x7fbb641049a0 2024-09-12T02:36:46.090 INFO:teuthology.orchestra.run.smithi039.stdout:279172874284 2024-09-12T02:36:46.090 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:36:46.084+0000 7fbb6b000640 1 -- 172.21.15.39:0/803520514 >> [v2:172.21.15.39:6800/1725006999,v1:172.21.15.39:6801/1725006999] conn(0x7fbb480a2c10 msgr2=0x7fbb480a50d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:36:46.091 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:36:46.084+0000 7fbb6b000640 1 --2- 172.21.15.39:0/803520514 >> [v2:172.21.15.39:6800/1725006999,v1:172.21.15.39:6801/1725006999] conn(0x7fbb480a2c10 0x7fbb480a50d0 secure :-1 s=READY pgs=197 cs=0 l=1 rev1=1 crypto rx=0x7fbb54000c00 tx=0x7fbb54005b50 comp rx=0 tx=0).stop 2024-09-12T02:36:46.091 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:36:46.084+0000 7fbb6b000640 1 -- 172.21.15.39:0/803520514 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fbb641049a0 msgr2=0x7fbb6419ab40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:36:46.091 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:36:46.084+0000 7fbb6b000640 1 --2- 172.21.15.39:0/803520514 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fbb641049a0 0x7fbb6419ab40 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0x7fbb5000e9f0 tx=0x7fbb5000eeb0 comp rx=0 tx=0).stop 2024-09-12T02:36:46.091 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:36:46.084+0000 7fbb6b000640 1 -- 172.21.15.39:0/803520514 shutdown_connections 2024-09-12T02:36:46.091 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:36:46.084+0000 7fbb6b000640 1 --2- 172.21.15.39:0/803520514 >> [v2:172.21.15.39:6800/1725006999,v1:172.21.15.39:6801/1725006999] conn(0x7fbb480a2c10 0x7fbb480a50d0 unknown :-1 s=CLOSED pgs=197 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:36:46.091 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:36:46.084+0000 7fbb6b000640 1 --2- 172.21.15.39:0/803520514 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fbb64109120 0x7fbb6419eed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:36:46.091 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:36:46.084+0000 7fbb6b000640 1 --2- 172.21.15.39:0/803520514 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fbb641049a0 0x7fbb6419ab40 unknown :-1 s=CLOSED pgs=95 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:36:46.091 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:36:46.084+0000 7fbb6b000640 1 --2- 172.21.15.39:0/803520514 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fbb64103ff0 0x7fbb6419a600 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:36:46.091 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:36:46.084+0000 7fbb6b000640 1 -- 172.21.15.39:0/803520514 >> 172.21.15.39:0/803520514 conn(0x7fbb640ffa90 msgr2=0x7fbb64100d20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:36:46.091 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:36:46.084+0000 7fbb6b000640 1 -- 172.21.15.39:0/803520514 shutdown_connections 2024-09-12T02:36:46.091 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:36:46.084+0000 7fbb6b000640 1 -- 172.21.15.39:0/803520514 wait complete. 2024-09-12T02:36:46.264 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 12 02:36:45 smithi172 ceph-mon[35609]: pgmap v353: 129 pgs: 129 active+clean; 645 KiB data, 347 MiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2024-09-12T02:36:46.264 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 12 02:36:45 smithi172 ceph-mon[35609]: from='mgr.14150 172.21.15.39:0/408627207' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.6", "id": [9, 11, 5, 8]}]: dispatch 2024-09-12T02:36:46.264 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 12 02:36:45 smithi172 ceph-mon[35609]: from='mgr.14150 172.21.15.39:0/408627207' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.19", "id": [9, 8]}]: dispatch 2024-09-12T02:36:46.349 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 02:36:45 smithi039 ceph-mon[30515]: pgmap v353: 129 pgs: 129 active+clean; 645 KiB data, 347 MiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2024-09-12T02:36:46.350 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 02:36:45 smithi039 ceph-mon[30515]: from='mgr.14150 172.21.15.39:0/408627207' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.6", "id": [9, 11, 5, 8]}]: dispatch 2024-09-12T02:36:46.350 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 02:36:45 smithi039 ceph-mon[30515]: from='mgr.14150 172.21.15.39:0/408627207' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.19", "id": [9, 8]}]: dispatch 2024-09-12T02:36:46.448 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 12 02:36:45 smithi044 ceph-mon[35411]: pgmap v353: 129 pgs: 129 active+clean; 645 KiB data, 347 MiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2024-09-12T02:36:46.449 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 12 02:36:45 smithi044 ceph-mon[35411]: from='mgr.14150 172.21.15.39:0/408627207' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.6", "id": [9, 11, 5, 8]}]: dispatch 2024-09-12T02:36:46.449 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 12 02:36:45 smithi044 ceph-mon[35411]: from='mgr.14150 172.21.15.39:0/408627207' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.19", "id": [9, 8]}]: dispatch 2024-09-12T02:36:46.692 INFO:teuthology.orchestra.run.smithi039.stderr:Inferring config /var/lib/ceph/4954ed46-70ae-11ef-bcea-c7b262605968/mon.a/config 2024-09-12T02:36:46.692 INFO:teuthology.orchestra.run.smithi039.stderr:Inferring config /var/lib/ceph/4954ed46-70ae-11ef-bcea-c7b262605968/mon.a/config 2024-09-12T02:36:46.720 INFO:tasks.cephadm.ceph_manager.ceph:need seq 163208757310 got 163208757313 for osd.5 2024-09-12T02:36:46.720 DEBUG:teuthology.parallel:result is None 2024-09-12T02:36:47.226 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 02:36:47 smithi039 ceph-mon[30515]: from='mgr.14150 172.21.15.39:0/408627207' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.6", "id": [9, 11, 5, 8]}]': finished 2024-09-12T02:36:47.226 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 02:36:47 smithi039 ceph-mon[30515]: from='mgr.14150 172.21.15.39:0/408627207' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.19", "id": [9, 8]}]': finished 2024-09-12T02:36:47.226 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 02:36:47 smithi039 ceph-mon[30515]: osdmap e94: 12 total, 12 up, 12 in 2024-09-12T02:36:47.226 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 02:36:47 smithi039 ceph-mon[30515]: from='client.? 172.21.15.39:0/803520514' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 9}]: dispatch 2024-09-12T02:36:47.263 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 12 02:36:47 smithi172 ceph-mon[35609]: from='mgr.14150 172.21.15.39:0/408627207' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.6", "id": [9, 11, 5, 8]}]': finished 2024-09-12T02:36:47.263 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 12 02:36:47 smithi172 ceph-mon[35609]: from='mgr.14150 172.21.15.39:0/408627207' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.19", "id": [9, 8]}]': finished 2024-09-12T02:36:47.263 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 12 02:36:47 smithi172 ceph-mon[35609]: osdmap e94: 12 total, 12 up, 12 in 2024-09-12T02:36:47.264 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 12 02:36:47 smithi172 ceph-mon[35609]: from='client.? 172.21.15.39:0/803520514' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 9}]: dispatch 2024-09-12T02:36:47.448 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 12 02:36:47 smithi044 ceph-mon[35411]: from='mgr.14150 172.21.15.39:0/408627207' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.6", "id": [9, 11, 5, 8]}]': finished 2024-09-12T02:36:47.448 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 12 02:36:47 smithi044 ceph-mon[35411]: from='mgr.14150 172.21.15.39:0/408627207' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.19", "id": [9, 8]}]': finished 2024-09-12T02:36:47.449 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 12 02:36:47 smithi044 ceph-mon[35411]: osdmap e94: 12 total, 12 up, 12 in 2024-09-12T02:36:47.449 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 12 02:36:47 smithi044 ceph-mon[35411]: from='client.? 172.21.15.39:0/803520514' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 9}]: dispatch 2024-09-12T02:36:47.591 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:36:47.344+0000 7f8cb9000640 1 -- 172.21.15.39:0/1951878713 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f8cb40745c0 msgr2=0x7f8cb40749a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:36:47.591 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:36:47.344+0000 7f8cb9000640 1 --2- 172.21.15.39:0/1951878713 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f8cb40745c0 0x7f8cb40749a0 secure :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0x7f8ca4009900 tx=0x7f8ca402a480 comp rx=0 tx=0).stop 2024-09-12T02:36:47.591 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:36:47.344+0000 7f8cb9000640 1 -- 172.21.15.39:0/1951878713 shutdown_connections 2024-09-12T02:36:47.591 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:36:47.344+0000 7f8cb9000640 1 --2- 172.21.15.39:0/1951878713 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f8cb410e260 0x7f8cb4110650 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:36:47.591 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:36:47.344+0000 7f8cb9000640 1 --2- 172.21.15.39:0/1951878713 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f8cb4074ee0 0x7f8cb410dd20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:36:47.592 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:36:47.344+0000 7f8cb9000640 1 --2- 172.21.15.39:0/1951878713 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f8cb40745c0 0x7f8cb40749a0 unknown :-1 s=CLOSED pgs=96 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:36:47.592 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:36:47.344+0000 7f8cb9000640 1 -- 172.21.15.39:0/1951878713 >> 172.21.15.39:0/1951878713 conn(0x7f8cb40fd740 msgr2=0x7f8cb40ffb60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:36:47.592 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:36:47.344+0000 7f8cb9000640 1 -- 172.21.15.39:0/1951878713 shutdown_connections 2024-09-12T02:36:47.592 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:36:47.344+0000 7f8cb9000640 1 -- 172.21.15.39:0/1951878713 wait complete. 2024-09-12T02:36:47.592 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:36:47.345+0000 7f8cb9000640 1 Processor -- start 2024-09-12T02:36:47.592 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:36:47.345+0000 7f8cb9000640 1 -- start start 2024-09-12T02:36:47.592 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:36:47.346+0000 7f8cb9000640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f8cb40745c0 0x7f8cb419a4d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:36:47.592 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:36:47.346+0000 7f8cb9000640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f8cb4074ee0 0x7f8cb419aa10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:36:47.592 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:36:47.346+0000 7f8cb9000640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f8cb410e260 0x7f8cb419eda0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:36:47.592 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:36:47.346+0000 7f8cb9000640 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 -- 0x7f8cb4114010 con 0x7f8cb4074ee0 2024-09-12T02:36:47.592 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:36:47.346+0000 7f8cb9000640 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x7f8cb4113e90 con 0x7f8cb410e260 2024-09-12T02:36:47.592 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:36:47.346+0000 7f8cb9000640 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7f8cb4114190 con 0x7f8cb40745c0 2024-09-12T02:36:47.593 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:36:47.346+0000 7f8cb2a00640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f8cb4074ee0 0x7f8cb419aa10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:36:47.593 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:36:47.346+0000 7f8cb2a00640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f8cb4074ee0 0x7f8cb419aa10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.39:3300/0 says I am v2:172.21.15.39:47228/0 (socket says 172.21.15.39:47228) 2024-09-12T02:36:47.593 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:36:47.346+0000 7f8cb2a00640 1 -- 172.21.15.39:0/3195266608 learned_addr learned my addr 172.21.15.39:0/3195266608 (peer_addr_for_me v2:172.21.15.39:0/0) 2024-09-12T02:36:47.593 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:36:47.346+0000 7f8cb3400640 1 --2- 172.21.15.39:0/3195266608 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f8cb40745c0 0x7f8cb419a4d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:36:47.593 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:36:47.346+0000 7f8cb2a00640 1 -- 172.21.15.39:0/3195266608 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f8cb40745c0 msgr2=0x7f8cb419a4d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:36:47.593 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:36:47.346+0000 7f8cb2a00640 1 --2- 172.21.15.39:0/3195266608 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f8cb40745c0 0x7f8cb419a4d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:36:47.593 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:36:47.347+0000 7f8cb3e00640 1 --2- 172.21.15.39:0/3195266608 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f8cb410e260 0x7f8cb419eda0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:36:47.593 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:36:47.347+0000 7f8cb2a00640 1 -- 172.21.15.39:0/3195266608 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f8cb410e260 msgr2=0x7f8cb419eda0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:36:47.593 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:36:47.347+0000 7f8cb2a00640 1 --2- 172.21.15.39:0/3195266608 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f8cb410e260 0x7f8cb419eda0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:36:47.593 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:36:47.347+0000 7f8cb2a00640 1 -- 172.21.15.39:0/3195266608 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8cb419f480 con 0x7f8cb4074ee0 2024-09-12T02:36:47.593 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:36:47.347+0000 7f8cb3e00640 1 --2- 172.21.15.39:0/3195266608 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f8cb410e260 0x7f8cb419eda0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-12T02:36:47.593 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:36:47.347+0000 7f8cb2a00640 1 --2- 172.21.15.39:0/3195266608 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f8cb4074ee0 0x7f8cb419aa10 secure :-1 s=READY pgs=219 cs=0 l=1 rev1=1 crypto rx=0x7f8ca000e9f0 tx=0x7f8ca000eeb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:36:47.593 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:36:47.347+0000 7f8cabe00640 1 -- 172.21.15.39:0/3195266608 <== mon.0 v2:172.21.15.39:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8ca000cd80 con 0x7f8cb4074ee0 2024-09-12T02:36:47.593 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:36:47.347+0000 7f8cb9000640 1 -- 172.21.15.39:0/3195266608 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f8cb419f770 con 0x7f8cb4074ee0 2024-09-12T02:36:47.594 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:36:47.347+0000 7f8cabe00640 1 -- 172.21.15.39:0/3195266608 <== mon.0 v2:172.21.15.39:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f8ca0010910 con 0x7f8cb4074ee0 2024-09-12T02:36:47.594 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:36:47.347+0000 7f8cabe00640 1 -- 172.21.15.39:0/3195266608 <== mon.0 v2:172.21.15.39:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8ca00188f0 con 0x7f8cb4074ee0 2024-09-12T02:36:47.594 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:36:47.347+0000 7f8cb9000640 1 -- 172.21.15.39:0/3195266608 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f8cb41a7050 con 0x7f8cb4074ee0 2024-09-12T02:36:47.594 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:36:47.349+0000 7f8cb9000640 1 -- 172.21.15.39:0/3195266608 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f8cb40749a0 con 0x7f8cb4074ee0 2024-09-12T02:36:47.594 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:36:47.352+0000 7f8cabe00640 1 -- 172.21.15.39:0/3195266608 <== mon.0 v2:172.21.15.39:3300/0 4 ==== mgrmap(e 17) ==== 137884+0+0 (secure 0 0 0) 0x7f8ca0010ac0 con 0x7f8cb4074ee0 2024-09-12T02:36:47.594 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:36:47.353+0000 7f8cabe00640 1 --2- 172.21.15.39:0/3195266608 >> [v2:172.21.15.39:6800/1725006999,v1:172.21.15.39:6801/1725006999] conn(0x7f8c980a2c10 0x7f8c980a50d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:36:47.594 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:36:47.354+0000 7f8cabe00640 1 -- 172.21.15.39:0/3195266608 <== mon.0 v2:172.21.15.39:3300/0 5 ==== osd_map(95..95 src has 1..95) ==== 9129+0+0 (secure 0 0 0) 0x7f8ca00cfaa0 con 0x7f8cb4074ee0 2024-09-12T02:36:47.594 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:36:47.354+0000 7f8cb3400640 1 --2- 172.21.15.39:0/3195266608 >> [v2:172.21.15.39:6800/1725006999,v1:172.21.15.39:6801/1725006999] conn(0x7f8c980a2c10 0x7f8c980a50d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:36:47.594 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:36:47.355+0000 7f8cb3400640 1 --2- 172.21.15.39:0/3195266608 >> [v2:172.21.15.39:6800/1725006999,v1:172.21.15.39:6801/1725006999] conn(0x7f8c980a2c10 0x7f8c980a50d0 secure :-1 s=READY pgs=199 cs=0 l=1 rev1=1 crypto rx=0x7f8ca4005ab0 tx=0x7f8ca4005a20 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:36:47.594 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:36:47.359+0000 7f8cabe00640 1 -- 172.21.15.39:0/3195266608 <== mon.0 v2:172.21.15.39:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7f8ca009c4c0 con 0x7f8cb4074ee0 2024-09-12T02:36:47.595 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:36:47.557+0000 7f8cb9000640 1 -- 172.21.15.39:0/3195266608 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 4} v 0) -- 0x7f8cb4108e50 con 0x7f8cb4074ee0 2024-09-12T02:36:47.595 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:36:47.557+0000 7f8cabe00640 1 -- 172.21.15.39:0/3195266608 <== mon.0 v2:172.21.15.39:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 4}]=0 v0) ==== 74+0+13 (secure 0 0 0) 0x7f8ca009bdc0 con 0x7f8cb4074ee0 2024-09-12T02:36:47.595 INFO:teuthology.orchestra.run.smithi039.stdout:141733920840 2024-09-12T02:36:47.595 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:36:47.559+0000 7f8cb9000640 1 -- 172.21.15.39:0/3195266608 >> [v2:172.21.15.39:6800/1725006999,v1:172.21.15.39:6801/1725006999] conn(0x7f8c980a2c10 msgr2=0x7f8c980a50d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:36:47.595 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:36:47.559+0000 7f8cb9000640 1 --2- 172.21.15.39:0/3195266608 >> [v2:172.21.15.39:6800/1725006999,v1:172.21.15.39:6801/1725006999] conn(0x7f8c980a2c10 0x7f8c980a50d0 secure :-1 s=READY pgs=199 cs=0 l=1 rev1=1 crypto rx=0x7f8ca4005ab0 tx=0x7f8ca4005a20 comp rx=0 tx=0).stop 2024-09-12T02:36:47.595 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:36:47.559+0000 7f8cb9000640 1 -- 172.21.15.39:0/3195266608 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f8cb4074ee0 msgr2=0x7f8cb419aa10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:36:47.596 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:36:47.560+0000 7f8cb9000640 1 --2- 172.21.15.39:0/3195266608 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f8cb4074ee0 0x7f8cb419aa10 secure :-1 s=READY pgs=219 cs=0 l=1 rev1=1 crypto rx=0x7f8ca000e9f0 tx=0x7f8ca000eeb0 comp rx=0 tx=0).stop 2024-09-12T02:36:47.596 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:36:47.560+0000 7f8cb9000640 1 -- 172.21.15.39:0/3195266608 shutdown_connections 2024-09-12T02:36:47.596 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:36:47.560+0000 7f8cb9000640 1 --2- 172.21.15.39:0/3195266608 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f8cb410e260 0x7f8cb419eda0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:36:47.596 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:36:47.560+0000 7f8cb9000640 1 --2- 172.21.15.39:0/3195266608 >> [v2:172.21.15.39:6800/1725006999,v1:172.21.15.39:6801/1725006999] conn(0x7f8c980a2c10 0x7f8c980a50d0 unknown :-1 s=CLOSED pgs=199 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:36:47.596 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:36:47.560+0000 7f8cb9000640 1 --2- 172.21.15.39:0/3195266608 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f8cb4074ee0 0x7f8cb419aa10 unknown :-1 s=CLOSED pgs=219 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:36:47.596 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:36:47.560+0000 7f8cb9000640 1 --2- 172.21.15.39:0/3195266608 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f8cb40745c0 0x7f8cb419a4d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:36:47.596 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:36:47.560+0000 7f8cb9000640 1 -- 172.21.15.39:0/3195266608 >> 172.21.15.39:0/3195266608 conn(0x7f8cb40fd740 msgr2=0x7f8cb40fe3a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:36:47.596 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:36:47.560+0000 7f8cb9000640 1 -- 172.21.15.39:0/3195266608 shutdown_connections 2024-09-12T02:36:47.596 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:36:47.560+0000 7f8cb9000640 1 -- 172.21.15.39:0/3195266608 wait complete. 2024-09-12T02:36:48.223 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 02:36:48 smithi039 ceph-mon[30515]: pgmap v355: 129 pgs: 129 active+clean; 645 KiB data, 347 MiB used, 1.0 TiB / 1.0 TiB avail; 4.9 KiB/s rd, 9 op/s 2024-09-12T02:36:48.223 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 02:36:48 smithi039 ceph-mon[30515]: osdmap e95: 12 total, 12 up, 12 in 2024-09-12T02:36:48.223 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 02:36:48 smithi039 ceph-mon[30515]: from='client.? 172.21.15.39:0/4032008529' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 6}]: dispatch 2024-09-12T02:36:48.224 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 02:36:48 smithi039 ceph-mon[30515]: from='client.? 172.21.15.39:0/3195266608' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 4}]: dispatch 2024-09-12T02:36:48.263 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 12 02:36:48 smithi172 ceph-mon[35609]: pgmap v355: 129 pgs: 129 active+clean; 645 KiB data, 347 MiB used, 1.0 TiB / 1.0 TiB avail; 4.9 KiB/s rd, 9 op/s 2024-09-12T02:36:48.263 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 12 02:36:48 smithi172 ceph-mon[35609]: osdmap e95: 12 total, 12 up, 12 in 2024-09-12T02:36:48.264 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 12 02:36:48 smithi172 ceph-mon[35609]: from='client.? 172.21.15.39:0/4032008529' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 6}]: dispatch 2024-09-12T02:36:48.264 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 12 02:36:48 smithi172 ceph-mon[35609]: from='client.? 172.21.15.39:0/3195266608' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 4}]: dispatch 2024-09-12T02:36:48.340 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:36:48.336+0000 7fa800800640 1 -- 172.21.15.39:0/3340717953 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fa7f81049c0 msgr2=0x7fa7f8108a10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:36:48.340 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:36:48.336+0000 7fa800800640 1 --2- 172.21.15.39:0/3340717953 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fa7f81049c0 0x7fa7f8108a10 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0x7fa7e8009900 tx=0x7fa7e802a410 comp rx=0 tx=0).stop 2024-09-12T02:36:48.341 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:36:48.336+0000 7fa800800640 1 -- 172.21.15.39:0/3340717953 shutdown_connections 2024-09-12T02:36:48.341 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:36:48.336+0000 7fa800800640 1 --2- 172.21.15.39:0/3340717953 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fa7f8109140 0x7fa7f8110cc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:36:48.341 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:36:48.336+0000 7fa800800640 1 --2- 172.21.15.39:0/3340717953 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fa7f81049c0 0x7fa7f8108a10 unknown :-1 s=CLOSED pgs=97 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:36:48.341 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:36:48.336+0000 7fa800800640 1 --2- 172.21.15.39:0/3340717953 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fa7f8104010 0x7fa7f81043f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:36:48.341 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:36:48.336+0000 7fa800800640 1 -- 172.21.15.39:0/3340717953 >> 172.21.15.39:0/3340717953 conn(0x7fa7f80ffa50 msgr2=0x7fa7f8101e70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:36:48.341 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:36:48.336+0000 7fa800800640 1 -- 172.21.15.39:0/3340717953 shutdown_connections 2024-09-12T02:36:48.341 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:36:48.336+0000 7fa800800640 1 -- 172.21.15.39:0/3340717953 wait complete. 2024-09-12T02:36:48.341 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:36:48.337+0000 7fa800800640 1 Processor -- start 2024-09-12T02:36:48.341 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:36:48.337+0000 7fa800800640 1 -- start start 2024-09-12T02:36:48.341 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:36:48.338+0000 7fa800800640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fa7f8104010 0x7fa7f819a680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:36:48.341 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:36:48.338+0000 7fa800800640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fa7f81049c0 0x7fa7f819abc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:36:48.341 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:36:48.338+0000 7fa800800640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fa7f8109140 0x7fa7f819ef50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:36:48.341 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:36:48.338+0000 7fa800800640 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 -- 0x7fa7f8114160 con 0x7fa7f8109140 2024-09-12T02:36:48.342 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:36:48.338+0000 7fa800800640 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x7fa7f8113fe0 con 0x7fa7f8104010 2024-09-12T02:36:48.342 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:36:48.338+0000 7fa800800640 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7fa7f81142e0 con 0x7fa7f81049c0 2024-09-12T02:36:48.342 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:36:48.338+0000 7fa7fde00640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fa7f8104010 0x7fa7f819a680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:36:48.342 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:36:48.338+0000 7fa7fe800640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fa7f8109140 0x7fa7f819ef50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:36:48.342 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:36:48.338+0000 7fa7fde00640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fa7f8104010 0x7fa7f819a680 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.39:47608/0 (socket says 172.21.15.39:47608) 2024-09-12T02:36:48.342 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:36:48.338+0000 7fa7fde00640 1 -- 172.21.15.39:0/2468772360 learned_addr learned my addr 172.21.15.39:0/2468772360 (peer_addr_for_me v2:172.21.15.39:0/0) 2024-09-12T02:36:48.342 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:36:48.338+0000 7fa7fd400640 1 --2- 172.21.15.39:0/2468772360 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fa7f81049c0 0x7fa7f819abc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:36:48.342 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:36:48.338+0000 7fa7fde00640 1 -- 172.21.15.39:0/2468772360 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fa7f81049c0 msgr2=0x7fa7f819abc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:36:48.342 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:36:48.339+0000 7fa7fde00640 1 --2- 172.21.15.39:0/2468772360 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fa7f81049c0 0x7fa7f819abc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:36:48.342 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:36:48.339+0000 7fa7fde00640 1 -- 172.21.15.39:0/2468772360 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fa7f8109140 msgr2=0x7fa7f819ef50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:36:48.342 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:36:48.339+0000 7fa7fde00640 1 --2- 172.21.15.39:0/2468772360 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fa7f8109140 0x7fa7f819ef50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:36:48.343 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:36:48.339+0000 7fa7fde00640 1 -- 172.21.15.39:0/2468772360 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa7f819f630 con 0x7fa7f8104010 2024-09-12T02:36:48.343 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:36:48.339+0000 7fa7fe800640 1 --2- 172.21.15.39:0/2468772360 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fa7f8109140 0x7fa7f819ef50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-12T02:36:48.343 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:36:48.339+0000 7fa7fd400640 1 --2- 172.21.15.39:0/2468772360 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fa7f81049c0 0x7fa7f819abc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-12T02:36:48.343 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:36:48.339+0000 7fa7fde00640 1 --2- 172.21.15.39:0/2468772360 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fa7f8104010 0x7fa7f819a680 secure :-1 s=READY pgs=98 cs=0 l=1 rev1=1 crypto rx=0x7fa7ec00e9f0 tx=0x7fa7ec00edf0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:36:48.343 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:36:48.339+0000 7fa7f2a00640 1 -- 172.21.15.39:0/2468772360 <== mon.2 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa7ec00cd80 con 0x7fa7f8104010 2024-09-12T02:36:48.343 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:36:48.339+0000 7fa800800640 1 -- 172.21.15.39:0/2468772360 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa7f819f920 con 0x7fa7f8104010 2024-09-12T02:36:48.343 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:36:48.339+0000 7fa7f2a00640 1 -- 172.21.15.39:0/2468772360 <== mon.2 v2:172.21.15.44:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fa7ec005500 con 0x7fa7f8104010 2024-09-12T02:36:48.343 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:36:48.339+0000 7fa7f2a00640 1 -- 172.21.15.39:0/2468772360 <== mon.2 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa7ec010690 con 0x7fa7f8104010 2024-09-12T02:36:48.343 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:36:48.339+0000 7fa800800640 1 -- 172.21.15.39:0/2468772360 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa7f81a7200 con 0x7fa7f8104010 2024-09-12T02:36:48.344 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:36:48.340+0000 7fa800800640 1 -- 172.21.15.39:0/2468772360 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fa7f81043f0 con 0x7fa7f8104010 2024-09-12T02:36:48.344 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:36:48.343+0000 7fa7f2a00640 1 -- 172.21.15.39:0/2468772360 <== mon.2 v2:172.21.15.44:3300/0 4 ==== mgrmap(e 17) ==== 137884+0+0 (secure 0 0 0) 0x7fa7ec0046c0 con 0x7fa7f8104010 2024-09-12T02:36:48.344 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:36:48.344+0000 7fa7f2a00640 1 --2- 172.21.15.39:0/2468772360 >> [v2:172.21.15.39:6800/1725006999,v1:172.21.15.39:6801/1725006999] conn(0x7fa7e00a2c90 0x7fa7e00a5150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:36:48.345 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:36:48.344+0000 7fa7f2a00640 1 -- 172.21.15.39:0/2468772360 <== mon.2 v2:172.21.15.44:3300/0 5 ==== osd_map(95..95 src has 1..95) ==== 9129+0+0 (secure 0 0 0) 0x7fa7ec0cfbc0 con 0x7fa7f8104010 2024-09-12T02:36:48.345 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:36:48.344+0000 7fa7fd400640 1 --2- 172.21.15.39:0/2468772360 >> [v2:172.21.15.39:6800/1725006999,v1:172.21.15.39:6801/1725006999] conn(0x7fa7e00a2c90 0x7fa7e00a5150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:36:48.345 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:36:48.345+0000 7fa7fd400640 1 --2- 172.21.15.39:0/2468772360 >> [v2:172.21.15.39:6800/1725006999,v1:172.21.15.39:6801/1725006999] conn(0x7fa7e00a2c90 0x7fa7e00a5150 secure :-1 s=READY pgs=200 cs=0 l=1 rev1=1 crypto rx=0x7fa7f810aad0 tx=0x7fa7e8005a20 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:36:48.347 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:36:48.346+0000 7fa7f2a00640 1 -- 172.21.15.39:0/2468772360 <== mon.2 v2:172.21.15.44:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7fa7ec0541b0 con 0x7fa7f8104010 2024-09-12T02:36:48.448 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 12 02:36:48 smithi044 ceph-mon[35411]: pgmap v355: 129 pgs: 129 active+clean; 645 KiB data, 347 MiB used, 1.0 TiB / 1.0 TiB avail; 4.9 KiB/s rd, 9 op/s 2024-09-12T02:36:48.448 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 12 02:36:48 smithi044 ceph-mon[35411]: osdmap e95: 12 total, 12 up, 12 in 2024-09-12T02:36:48.449 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 12 02:36:48 smithi044 ceph-mon[35411]: from='client.? 172.21.15.39:0/4032008529' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 6}]: dispatch 2024-09-12T02:36:48.449 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 12 02:36:48 smithi044 ceph-mon[35411]: from='client.? 172.21.15.39:0/3195266608' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 4}]: dispatch 2024-09-12T02:36:48.449 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:36:47.225+0000 7feb54800640 1 -- 172.21.15.39:0/3893818898 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7feb4c076720 msgr2=0x7feb4c076b00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:36:48.450 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:36:47.225+0000 7feb54800640 1 --2- 172.21.15.39:0/3893818898 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7feb4c076720 0x7feb4c076b00 secure :-1 s=READY pgs=217 cs=0 l=1 rev1=1 crypto rx=0x7feb40009900 tx=0x7feb4002a410 comp rx=0 tx=0).stop 2024-09-12T02:36:48.450 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:36:47.225+0000 7feb54800640 1 -- 172.21.15.39:0/3893818898 shutdown_connections 2024-09-12T02:36:48.450 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:36:47.225+0000 7feb54800640 1 --2- 172.21.15.39:0/3893818898 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7feb4c112a30 0x7feb4c114e20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:36:48.450 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:36:47.225+0000 7feb54800640 1 --2- 172.21.15.39:0/3893818898 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7feb4c077040 0x7feb4c1124f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:36:48.450 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:36:47.225+0000 7feb54800640 1 --2- 172.21.15.39:0/3893818898 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7feb4c076720 0x7feb4c076b00 unknown :-1 s=CLOSED pgs=217 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:36:48.450 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:36:47.225+0000 7feb54800640 1 -- 172.21.15.39:0/3893818898 >> 172.21.15.39:0/3893818898 conn(0x7feb4c0ffa90 msgr2=0x7feb4c101eb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:36:48.450 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:36:47.225+0000 7feb54800640 1 -- 172.21.15.39:0/3893818898 shutdown_connections 2024-09-12T02:36:48.450 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:36:47.225+0000 7feb54800640 1 -- 172.21.15.39:0/3893818898 wait complete. 2024-09-12T02:36:48.450 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:36:47.226+0000 7feb54800640 1 Processor -- start 2024-09-12T02:36:48.450 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:36:47.226+0000 7feb54800640 1 -- start start 2024-09-12T02:36:48.450 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:36:47.227+0000 7feb54800640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7feb4c076720 0x7feb4c1a46f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:36:48.450 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:36:47.227+0000 7feb54800640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7feb4c077040 0x7feb4c1a4c30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:36:48.450 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:36:47.227+0000 7feb54800640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7feb4c112a30 0x7feb4c19e8b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:36:48.451 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:36:47.227+0000 7feb54800640 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 -- 0x7feb4c1185c0 con 0x7feb4c076720 2024-09-12T02:36:48.451 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:36:47.227+0000 7feb54800640 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x7feb4c118440 con 0x7feb4c077040 2024-09-12T02:36:48.451 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:36:47.227+0000 7feb54800640 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7feb4c118740 con 0x7feb4c112a30 2024-09-12T02:36:48.451 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:36:47.227+0000 7feb51e00640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7feb4c076720 0x7feb4c1a46f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:36:48.451 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:36:47.227+0000 7feb51e00640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7feb4c076720 0x7feb4c1a46f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.39:3300/0 says I am v2:172.21.15.39:47212/0 (socket says 172.21.15.39:47212) 2024-09-12T02:36:48.451 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:36:47.227+0000 7feb51e00640 1 -- 172.21.15.39:0/4032008529 learned_addr learned my addr 172.21.15.39:0/4032008529 (peer_addr_for_me v2:172.21.15.39:0/0) 2024-09-12T02:36:48.451 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:36:47.227+0000 7feb52800640 1 --2- 172.21.15.39:0/4032008529 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7feb4c112a30 0x7feb4c19e8b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:36:48.451 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:36:47.227+0000 7feb51400640 1 --2- 172.21.15.39:0/4032008529 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7feb4c077040 0x7feb4c1a4c30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:36:48.451 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:36:47.228+0000 7feb51e00640 1 -- 172.21.15.39:0/4032008529 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7feb4c112a30 msgr2=0x7feb4c19e8b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:36:48.451 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:36:47.228+0000 7feb51e00640 1 --2- 172.21.15.39:0/4032008529 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7feb4c112a30 0x7feb4c19e8b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:36:48.451 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:36:47.228+0000 7feb51e00640 1 -- 172.21.15.39:0/4032008529 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7feb4c077040 msgr2=0x7feb4c1a4c30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:36:48.451 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:36:47.228+0000 7feb51e00640 1 --2- 172.21.15.39:0/4032008529 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7feb4c077040 0x7feb4c1a4c30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:36:48.451 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:36:47.228+0000 7feb51e00640 1 -- 172.21.15.39:0/4032008529 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7feb4c19efe0 con 0x7feb4c076720 2024-09-12T02:36:48.451 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:36:47.228+0000 7feb51e00640 1 --2- 172.21.15.39:0/4032008529 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7feb4c076720 0x7feb4c1a46f0 secure :-1 s=READY pgs=218 cs=0 l=1 rev1=1 crypto rx=0x7feb40006010 tx=0x7feb400042f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:36:48.452 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:36:47.228+0000 7feb46a00640 1 -- 172.21.15.39:0/4032008529 <== mon.0 v2:172.21.15.39:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7feb4003f030 con 0x7feb4c076720 2024-09-12T02:36:48.452 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:36:47.229+0000 7feb46a00640 1 -- 172.21.15.39:0/4032008529 <== mon.0 v2:172.21.15.39:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7feb40003ce0 con 0x7feb4c076720 2024-09-12T02:36:48.452 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:36:47.229+0000 7feb46a00640 1 -- 172.21.15.39:0/4032008529 <== mon.0 v2:172.21.15.39:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7feb40035070 con 0x7feb4c076720 2024-09-12T02:36:48.452 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:36:47.229+0000 7feb54800640 1 -- 172.21.15.39:0/4032008529 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7feb4c19f270 con 0x7feb4c076720 2024-09-12T02:36:48.452 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:36:47.229+0000 7feb54800640 1 -- 172.21.15.39:0/4032008529 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7feb4c1ab5c0 con 0x7feb4c076720 2024-09-12T02:36:48.452 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:36:47.230+0000 7feb54800640 1 -- 172.21.15.39:0/4032008529 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7feb4c076b00 con 0x7feb4c076720 2024-09-12T02:36:48.452 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:36:47.232+0000 7feb46a00640 1 -- 172.21.15.39:0/4032008529 <== mon.0 v2:172.21.15.39:3300/0 4 ==== mgrmap(e 17) ==== 137884+0+0 (secure 0 0 0) 0x7feb40042030 con 0x7feb4c076720 2024-09-12T02:36:48.452 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:36:47.233+0000 7feb46a00640 1 --2- 172.21.15.39:0/4032008529 >> [v2:172.21.15.39:6800/1725006999,v1:172.21.15.39:6801/1725006999] conn(0x7feb340a2c90 0x7feb340a5150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:36:48.452 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:36:47.234+0000 7feb46a00640 1 -- 172.21.15.39:0/4032008529 <== mon.0 v2:172.21.15.39:3300/0 5 ==== osd_map(95..95 src has 1..95) ==== 9129+0+0 (secure 0 0 0) 0x7feb400ef620 con 0x7feb4c076720 2024-09-12T02:36:48.452 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:36:47.234+0000 7feb51400640 1 --2- 172.21.15.39:0/4032008529 >> [v2:172.21.15.39:6800/1725006999,v1:172.21.15.39:6801/1725006999] conn(0x7feb340a2c90 0x7feb340a5150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:36:48.452 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:36:47.234+0000 7feb51400640 1 --2- 172.21.15.39:0/4032008529 >> [v2:172.21.15.39:6800/1725006999,v1:172.21.15.39:6801/1725006999] conn(0x7feb340a2c90 0x7feb340a5150 secure :-1 s=READY pgs=198 cs=0 l=1 rev1=1 crypto rx=0x7feb4c079300 tx=0x7feb3c005f90 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:36:48.452 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:36:47.238+0000 7feb46a00640 1 -- 172.21.15.39:0/4032008529 <== mon.0 v2:172.21.15.39:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7feb400bc100 con 0x7feb4c076720 2024-09-12T02:36:48.452 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:36:47.431+0000 7feb54800640 1 -- 172.21.15.39:0/4032008529 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 6} v 0) -- 0x7feb4c10dc20 con 0x7feb4c076720 2024-09-12T02:36:48.453 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:36:47.431+0000 7feb46a00640 1 -- 172.21.15.39:0/4032008529 <== mon.0 v2:172.21.15.39:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 6}]=0 v0) ==== 74+0+13 (secure 0 0 0) 0x7feb400bba00 con 0x7feb4c076720 2024-09-12T02:36:48.453 INFO:teuthology.orchestra.run.smithi039.stdout:193273528380 2024-09-12T02:36:48.453 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:36:47.433+0000 7feb54800640 1 -- 172.21.15.39:0/4032008529 >> [v2:172.21.15.39:6800/1725006999,v1:172.21.15.39:6801/1725006999] conn(0x7feb340a2c90 msgr2=0x7feb340a5150 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:36:48.454 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:36:47.433+0000 7feb54800640 1 --2- 172.21.15.39:0/4032008529 >> [v2:172.21.15.39:6800/1725006999,v1:172.21.15.39:6801/1725006999] conn(0x7feb340a2c90 0x7feb340a5150 secure :-1 s=READY pgs=198 cs=0 l=1 rev1=1 crypto rx=0x7feb4c079300 tx=0x7feb3c005f90 comp rx=0 tx=0).stop 2024-09-12T02:36:48.454 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:36:47.433+0000 7feb54800640 1 -- 172.21.15.39:0/4032008529 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7feb4c076720 msgr2=0x7feb4c1a46f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:36:48.454 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:36:47.433+0000 7feb54800640 1 --2- 172.21.15.39:0/4032008529 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7feb4c076720 0x7feb4c1a46f0 secure :-1 s=READY pgs=218 cs=0 l=1 rev1=1 crypto rx=0x7feb40006010 tx=0x7feb400042f0 comp rx=0 tx=0).stop 2024-09-12T02:36:48.454 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:36:47.434+0000 7feb54800640 1 -- 172.21.15.39:0/4032008529 shutdown_connections 2024-09-12T02:36:48.454 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:36:47.434+0000 7feb54800640 1 --2- 172.21.15.39:0/4032008529 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7feb4c112a30 0x7feb4c19e8b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:36:48.454 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:36:47.434+0000 7feb54800640 1 --2- 172.21.15.39:0/4032008529 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7feb4c077040 0x7feb4c1a4c30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:36:48.454 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:36:47.434+0000 7feb54800640 1 --2- 172.21.15.39:0/4032008529 >> [v2:172.21.15.39:6800/1725006999,v1:172.21.15.39:6801/1725006999] conn(0x7feb340a2c90 0x7feb340a5150 unknown :-1 s=CLOSED pgs=198 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:36:48.454 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:36:47.434+0000 7feb54800640 1 --2- 172.21.15.39:0/4032008529 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7feb4c076720 0x7feb4c1a46f0 unknown :-1 s=CLOSED pgs=218 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:36:48.454 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:36:47.434+0000 7feb54800640 1 -- 172.21.15.39:0/4032008529 >> 172.21.15.39:0/4032008529 conn(0x7feb4c0ffa90 msgr2=0x7feb4c101e80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:36:48.454 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:36:47.434+0000 7feb54800640 1 -- 172.21.15.39:0/4032008529 shutdown_connections 2024-09-12T02:36:48.454 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:36:47.434+0000 7feb54800640 1 -- 172.21.15.39:0/4032008529 wait complete. 2024-09-12T02:36:48.538 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:36:48.537+0000 7fa800800640 1 -- 172.21.15.39:0/2468772360 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 8} v 0) -- 0x7fa7f810c3e0 con 0x7fa7f8104010 2024-09-12T02:36:48.538 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:36:48.537+0000 7fa7f2a00640 1 -- 172.21.15.39:0/2468772360 <== mon.2 v2:172.21.15.44:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 8}]=0 v0) ==== 74+0+13 (secure 0 0 0) 0x7fa7ec09c5e0 con 0x7fa7f8104010 2024-09-12T02:36:48.538 INFO:teuthology.orchestra.run.smithi039.stdout:244813135922 2024-09-12T02:36:48.541 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:36:48.540+0000 7fa800800640 1 -- 172.21.15.39:0/2468772360 >> [v2:172.21.15.39:6800/1725006999,v1:172.21.15.39:6801/1725006999] conn(0x7fa7e00a2c90 msgr2=0x7fa7e00a5150 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:36:48.541 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:36:48.540+0000 7fa800800640 1 --2- 172.21.15.39:0/2468772360 >> [v2:172.21.15.39:6800/1725006999,v1:172.21.15.39:6801/1725006999] conn(0x7fa7e00a2c90 0x7fa7e00a5150 secure :-1 s=READY pgs=200 cs=0 l=1 rev1=1 crypto rx=0x7fa7f810aad0 tx=0x7fa7e8005a20 comp rx=0 tx=0).stop 2024-09-12T02:36:48.541 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:36:48.540+0000 7fa800800640 1 -- 172.21.15.39:0/2468772360 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fa7f8104010 msgr2=0x7fa7f819a680 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:36:48.541 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:36:48.540+0000 7fa800800640 1 --2- 172.21.15.39:0/2468772360 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fa7f8104010 0x7fa7f819a680 secure :-1 s=READY pgs=98 cs=0 l=1 rev1=1 crypto rx=0x7fa7ec00e9f0 tx=0x7fa7ec00edf0 comp rx=0 tx=0).stop 2024-09-12T02:36:48.541 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:36:48.540+0000 7fa800800640 1 -- 172.21.15.39:0/2468772360 shutdown_connections 2024-09-12T02:36:48.541 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:36:48.540+0000 7fa800800640 1 --2- 172.21.15.39:0/2468772360 >> [v2:172.21.15.39:6800/1725006999,v1:172.21.15.39:6801/1725006999] conn(0x7fa7e00a2c90 0x7fa7e00a5150 unknown :-1 s=CLOSED pgs=200 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:36:48.541 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:36:48.540+0000 7fa800800640 1 --2- 172.21.15.39:0/2468772360 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fa7f8109140 0x7fa7f819ef50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:36:48.542 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:36:48.540+0000 7fa800800640 1 --2- 172.21.15.39:0/2468772360 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fa7f81049c0 0x7fa7f819abc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:36:48.542 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:36:48.540+0000 7fa800800640 1 --2- 172.21.15.39:0/2468772360 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fa7f8104010 0x7fa7f819a680 unknown :-1 s=CLOSED pgs=98 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:36:48.542 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:36:48.540+0000 7fa800800640 1 -- 172.21.15.39:0/2468772360 >> 172.21.15.39:0/2468772360 conn(0x7fa7f80ffa50 msgr2=0x7fa7f8100e40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:36:48.542 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:36:48.540+0000 7fa800800640 1 -- 172.21.15.39:0/2468772360 shutdown_connections 2024-09-12T02:36:48.542 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:36:48.540+0000 7fa800800640 1 -- 172.21.15.39:0/2468772360 wait complete. 2024-09-12T02:36:49.097 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 02:36:49 smithi039 ceph-mon[30515]: from='client.? 172.21.15.39:0/2468772360' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 8}]: dispatch 2024-09-12T02:36:49.103 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:36:49.084+0000 7fe36f600640 1 -- 172.21.15.39:0/107421496 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fe368109140 msgr2=0x7fe368110cc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:36:49.103 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:36:49.084+0000 7fe36f600640 1 --2- 172.21.15.39:0/107421496 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fe368109140 0x7fe368110cc0 secure :-1 s=READY pgs=220 cs=0 l=1 rev1=1 crypto rx=0x7fe360009ca0 tx=0x7fe36002a8c0 comp rx=0 tx=0).stop 2024-09-12T02:36:49.103 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:36:49.084+0000 7fe36f600640 1 -- 172.21.15.39:0/107421496 shutdown_connections 2024-09-12T02:36:49.103 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:36:49.084+0000 7fe36f600640 1 --2- 172.21.15.39:0/107421496 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fe368109140 0x7fe368110cc0 unknown :-1 s=CLOSED pgs=220 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:36:49.103 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:36:49.084+0000 7fe36f600640 1 --2- 172.21.15.39:0/107421496 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fe3681049c0 0x7fe368108a10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:36:49.103 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:36:49.084+0000 7fe36f600640 1 --2- 172.21.15.39:0/107421496 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fe368104010 0x7fe3681043f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:36:49.103 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:36:49.084+0000 7fe36f600640 1 -- 172.21.15.39:0/107421496 >> 172.21.15.39:0/107421496 conn(0x7fe3680ffa50 msgr2=0x7fe368101e70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:36:49.103 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:36:49.084+0000 7fe36f600640 1 -- 172.21.15.39:0/107421496 shutdown_connections 2024-09-12T02:36:49.104 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:36:49.084+0000 7fe36f600640 1 -- 172.21.15.39:0/107421496 wait complete. 2024-09-12T02:36:49.104 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:36:49.085+0000 7fe36f600640 1 Processor -- start 2024-09-12T02:36:49.104 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:36:49.085+0000 7fe36f600640 1 -- start start 2024-09-12T02:36:49.104 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:36:49.086+0000 7fe36f600640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fe368104010 0x7fe36819a6c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:36:49.104 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:36:49.086+0000 7fe36f600640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fe3681049c0 0x7fe36819ac00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:36:49.104 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:36:49.086+0000 7fe36f600640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fe368109140 0x7fe36819ef90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:36:49.104 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:36:49.086+0000 7fe36f600640 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 -- 0x7fe3681141c0 con 0x7fe368109140 2024-09-12T02:36:49.104 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:36:49.086+0000 7fe36f600640 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x7fe368114040 con 0x7fe368104010 2024-09-12T02:36:49.104 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:36:49.086+0000 7fe36f600640 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7fe368114340 con 0x7fe3681049c0 2024-09-12T02:36:49.104 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:36:49.086+0000 7fe36d600640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fe368109140 0x7fe36819ef90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:36:49.104 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:36:49.086+0000 7fe36d600640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fe368109140 0x7fe36819ef90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.39:3300/0 says I am v2:172.21.15.39:52770/0 (socket says 172.21.15.39:52770) 2024-09-12T02:36:49.104 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:36:49.086+0000 7fe36cc00640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fe368104010 0x7fe36819a6c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:36:49.105 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:36:49.086+0000 7fe36d600640 1 -- 172.21.15.39:0/3402777667 learned_addr learned my addr 172.21.15.39:0/3402777667 (peer_addr_for_me v2:172.21.15.39:0/0) 2024-09-12T02:36:49.105 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:36:49.086+0000 7fe35fe00640 1 --2- 172.21.15.39:0/3402777667 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fe3681049c0 0x7fe36819ac00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:36:49.105 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:36:49.086+0000 7fe36cc00640 1 -- 172.21.15.39:0/3402777667 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fe3681049c0 msgr2=0x7fe36819ac00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:36:49.105 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:36:49.086+0000 7fe36cc00640 1 --2- 172.21.15.39:0/3402777667 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fe3681049c0 0x7fe36819ac00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:36:49.105 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:36:49.086+0000 7fe36cc00640 1 -- 172.21.15.39:0/3402777667 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fe368109140 msgr2=0x7fe36819ef90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:36:49.105 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:36:49.086+0000 7fe36cc00640 1 --2- 172.21.15.39:0/3402777667 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fe368109140 0x7fe36819ef90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:36:49.105 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:36:49.086+0000 7fe36cc00640 1 -- 172.21.15.39:0/3402777667 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe36819f670 con 0x7fe368104010 2024-09-12T02:36:49.105 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:36:49.086+0000 7fe36d600640 1 --2- 172.21.15.39:0/3402777667 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fe368109140 0x7fe36819ef90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-12T02:36:49.105 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:36:49.087+0000 7fe36cc00640 1 --2- 172.21.15.39:0/3402777667 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fe368104010 0x7fe36819a6c0 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0x7fe35800e9f0 tx=0x7fe35800eeb0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:36:49.105 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:36:49.087+0000 7fe366000640 1 -- 172.21.15.39:0/3402777667 <== mon.2 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe35800cd80 con 0x7fe368104010 2024-09-12T02:36:49.105 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:36:49.087+0000 7fe366000640 1 -- 172.21.15.39:0/3402777667 <== mon.2 v2:172.21.15.44:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fe3580035f0 con 0x7fe368104010 2024-09-12T02:36:49.105 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:36:49.087+0000 7fe36f600640 1 -- 172.21.15.39:0/3402777667 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe36819f960 con 0x7fe368104010 2024-09-12T02:36:49.105 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:36:49.087+0000 7fe366000640 1 -- 172.21.15.39:0/3402777667 <== mon.2 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe358010690 con 0x7fe368104010 2024-09-12T02:36:49.106 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:36:49.087+0000 7fe36f600640 1 -- 172.21.15.39:0/3402777667 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe3681a7240 con 0x7fe368104010 2024-09-12T02:36:49.106 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:36:49.088+0000 7fe36f600640 1 -- 172.21.15.39:0/3402777667 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fe3681043f0 con 0x7fe368104010 2024-09-12T02:36:49.106 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:36:49.090+0000 7fe366000640 1 -- 172.21.15.39:0/3402777667 <== mon.2 v2:172.21.15.44:3300/0 4 ==== mgrmap(e 17) ==== 137884+0+0 (secure 0 0 0) 0x7fe358003b30 con 0x7fe368104010 2024-09-12T02:36:49.106 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:36:49.091+0000 7fe366000640 1 --2- 172.21.15.39:0/3402777667 >> [v2:172.21.15.39:6800/1725006999,v1:172.21.15.39:6801/1725006999] conn(0x7fe34c0a2c10 0x7fe34c0a50d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:36:49.106 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:36:49.092+0000 7fe366000640 1 -- 172.21.15.39:0/3402777667 <== mon.2 v2:172.21.15.44:3300/0 5 ==== osd_map(95..95 src has 1..95) ==== 9129+0+0 (secure 0 0 0) 0x7fe3580cf890 con 0x7fe368104010 2024-09-12T02:36:49.106 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:36:49.092+0000 7fe35fe00640 1 --2- 172.21.15.39:0/3402777667 >> [v2:172.21.15.39:6800/1725006999,v1:172.21.15.39:6801/1725006999] conn(0x7fe34c0a2c10 0x7fe34c0a50d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:36:49.106 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:36:49.092+0000 7fe35fe00640 1 --2- 172.21.15.39:0/3402777667 >> [v2:172.21.15.39:6800/1725006999,v1:172.21.15.39:6801/1725006999] conn(0x7fe34c0a2c10 0x7fe34c0a50d0 secure :-1 s=READY pgs=201 cs=0 l=1 rev1=1 crypto rx=0x7fe36810ab10 tx=0x7fe350005f90 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:36:49.106 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:36:49.095+0000 7fe366000640 1 -- 172.21.15.39:0/3402777667 <== mon.2 v2:172.21.15.44:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7fe35809c2b0 con 0x7fe368104010 2024-09-12T02:36:49.263 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 12 02:36:49 smithi172 ceph-mon[35609]: from='client.? 172.21.15.39:0/2468772360' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 8}]: dispatch 2024-09-12T02:36:49.285 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:36:49.284+0000 7fe36f600640 1 -- 172.21.15.39:0/3402777667 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 11} v 0) -- 0x7fe36819ba20 con 0x7fe368104010 2024-09-12T02:36:49.286 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:36:49.285+0000 7fe366000640 1 -- 172.21.15.39:0/3402777667 <== mon.2 v2:172.21.15.44:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 11}]=0 v0) ==== 75+0+13 (secure 0 0 0) 0x7fe35809bbb0 con 0x7fe368104010 2024-09-12T02:36:49.286 INFO:teuthology.orchestra.run.smithi039.stdout:330712481826 2024-09-12T02:36:49.288 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:36:49.287+0000 7fe36f600640 1 -- 172.21.15.39:0/3402777667 >> [v2:172.21.15.39:6800/1725006999,v1:172.21.15.39:6801/1725006999] conn(0x7fe34c0a2c10 msgr2=0x7fe34c0a50d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:36:49.288 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:36:49.287+0000 7fe36f600640 1 --2- 172.21.15.39:0/3402777667 >> [v2:172.21.15.39:6800/1725006999,v1:172.21.15.39:6801/1725006999] conn(0x7fe34c0a2c10 0x7fe34c0a50d0 secure :-1 s=READY pgs=201 cs=0 l=1 rev1=1 crypto rx=0x7fe36810ab10 tx=0x7fe350005f90 comp rx=0 tx=0).stop 2024-09-12T02:36:49.288 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:36:49.287+0000 7fe36f600640 1 -- 172.21.15.39:0/3402777667 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fe368104010 msgr2=0x7fe36819a6c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:36:49.288 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:36:49.287+0000 7fe36f600640 1 --2- 172.21.15.39:0/3402777667 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fe368104010 0x7fe36819a6c0 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0x7fe35800e9f0 tx=0x7fe35800eeb0 comp rx=0 tx=0).stop 2024-09-12T02:36:49.289 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:36:49.287+0000 7fe36f600640 1 -- 172.21.15.39:0/3402777667 shutdown_connections 2024-09-12T02:36:49.289 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:36:49.287+0000 7fe36f600640 1 --2- 172.21.15.39:0/3402777667 >> [v2:172.21.15.39:6800/1725006999,v1:172.21.15.39:6801/1725006999] conn(0x7fe34c0a2c10 0x7fe34c0a50d0 unknown :-1 s=CLOSED pgs=201 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:36:49.289 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:36:49.287+0000 7fe36f600640 1 --2- 172.21.15.39:0/3402777667 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fe368109140 0x7fe36819ef90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:36:49.289 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:36:49.287+0000 7fe36f600640 1 --2- 172.21.15.39:0/3402777667 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fe3681049c0 0x7fe36819ac00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:36:49.289 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:36:49.287+0000 7fe36f600640 1 --2- 172.21.15.39:0/3402777667 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fe368104010 0x7fe36819a6c0 unknown :-1 s=CLOSED pgs=99 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:36:49.289 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:36:49.287+0000 7fe36f600640 1 -- 172.21.15.39:0/3402777667 >> 172.21.15.39:0/3402777667 conn(0x7fe3680ffa50 msgr2=0x7fe368100db0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:36:49.289 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:36:49.287+0000 7fe36f600640 1 -- 172.21.15.39:0/3402777667 shutdown_connections 2024-09-12T02:36:49.289 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:36:49.287+0000 7fe36f600640 1 -- 172.21.15.39:0/3402777667 wait complete. 2024-09-12T02:36:49.448 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 12 02:36:49 smithi044 ceph-mon[35411]: from='client.? 172.21.15.39:0/2468772360' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 8}]: dispatch 2024-09-12T02:36:49.769 INFO:tasks.cephadm.ceph_manager.ceph:need seq 193273528378 got 193273528380 for osd.6 2024-09-12T02:36:49.770 DEBUG:teuthology.parallel:result is None 2024-09-12T02:36:50.350 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 02:36:50 smithi039 ceph-mon[30515]: pgmap v357: 129 pgs: 129 active+clean; 645 KiB data, 348 MiB used, 1.0 TiB / 1.0 TiB avail; 5.6 KiB/s rd, 11 op/s 2024-09-12T02:36:50.350 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 02:36:50 smithi039 ceph-mon[30515]: from='client.? 172.21.15.39:0/3402777667' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 11}]: dispatch 2024-09-12T02:36:50.448 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 12 02:36:50 smithi044 ceph-mon[35411]: pgmap v357: 129 pgs: 129 active+clean; 645 KiB data, 348 MiB used, 1.0 TiB / 1.0 TiB avail; 5.6 KiB/s rd, 11 op/s 2024-09-12T02:36:50.449 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 12 02:36:50 smithi044 ceph-mon[35411]: from='client.? 172.21.15.39:0/3402777667' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 11}]: dispatch 2024-09-12T02:36:50.513 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 12 02:36:50 smithi172 ceph-mon[35609]: pgmap v357: 129 pgs: 129 active+clean; 645 KiB data, 348 MiB used, 1.0 TiB / 1.0 TiB avail; 5.6 KiB/s rd, 11 op/s 2024-09-12T02:36:50.513 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 12 02:36:50 smithi172 ceph-mon[35609]: from='client.? 172.21.15.39:0/3402777667' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 11}]: dispatch 2024-09-12T02:36:51.031 INFO:tasks.cephadm.ceph_manager.ceph:need seq 279172874281 got 279172874284 for osd.9 2024-09-12T02:36:51.031 DEBUG:teuthology.parallel:result is None 2024-09-12T02:36:51.291 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:36:51.286+0000 7faa87200640 1 -- 172.21.15.39:0/2942485099 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7faa881079d0 msgr2=0x7faa88107db0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:36:51.291 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:36:51.286+0000 7faa87200640 1 --2- 172.21.15.39:0/2942485099 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7faa881079d0 0x7faa88107db0 secure :-1 s=READY pgs=221 cs=0 l=1 rev1=1 crypto rx=0x7faa78009930 tx=0x7faa7802a420 comp rx=0 tx=0).stop 2024-09-12T02:36:51.291 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:36:51.286+0000 7faa87200640 1 -- 172.21.15.39:0/2942485099 shutdown_connections 2024-09-12T02:36:51.291 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:36:51.286+0000 7faa87200640 1 --2- 172.21.15.39:0/2942485099 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7faa88102370 0x7faa8810e8a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:36:51.291 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:36:51.286+0000 7faa87200640 1 --2- 172.21.15.39:0/2942485099 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7faa881019d0 0x7faa88101e30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:36:51.292 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:36:51.286+0000 7faa87200640 1 --2- 172.21.15.39:0/2942485099 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7faa881079d0 0x7faa88107db0 unknown :-1 s=CLOSED pgs=221 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:36:51.292 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:36:51.286+0000 7faa87200640 1 -- 172.21.15.39:0/2942485099 >> 172.21.15.39:0/2942485099 conn(0x7faa880fd710 msgr2=0x7faa880ffb30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:36:51.292 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:36:51.286+0000 7faa87200640 1 -- 172.21.15.39:0/2942485099 shutdown_connections 2024-09-12T02:36:51.292 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:36:51.286+0000 7faa87200640 1 -- 172.21.15.39:0/2942485099 wait complete. 2024-09-12T02:36:51.292 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:36:51.287+0000 7faa87200640 1 Processor -- start 2024-09-12T02:36:51.292 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:36:51.288+0000 7faa87200640 1 -- start start 2024-09-12T02:36:51.292 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:36:51.288+0000 7faa87200640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7faa881019d0 0x7faa8819a4a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:36:51.292 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:36:51.288+0000 7faa87200640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7faa88102370 0x7faa8819a9e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:36:51.292 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:36:51.288+0000 7faa87200640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7faa881079d0 0x7faa8819ed70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:36:51.292 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:36:51.288+0000 7faa87200640 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 -- 0x7faa88111e20 con 0x7faa88102370 2024-09-12T02:36:51.292 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:36:51.288+0000 7faa87200640 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x7faa88111ca0 con 0x7faa881079d0 2024-09-12T02:36:51.292 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:36:51.288+0000 7faa87200640 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7faa88111fa0 con 0x7faa881019d0 2024-09-12T02:36:51.293 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:36:51.288+0000 7faa85400640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7faa88102370 0x7faa8819a9e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:36:51.293 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:36:51.288+0000 7faa85e00640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7faa881019d0 0x7faa8819a4a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:36:51.293 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:36:51.288+0000 7faa85400640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7faa88102370 0x7faa8819a9e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.39:3300/0 says I am v2:172.21.15.39:52784/0 (socket says 172.21.15.39:52784) 2024-09-12T02:36:51.293 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:36:51.288+0000 7faa85400640 1 -- 172.21.15.39:0/4283675805 learned_addr learned my addr 172.21.15.39:0/4283675805 (peer_addr_for_me v2:172.21.15.39:0/0) 2024-09-12T02:36:51.293 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:36:51.288+0000 7faa86800640 1 --2- 172.21.15.39:0/4283675805 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7faa881079d0 0x7faa8819ed70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:36:51.293 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:36:51.289+0000 7faa85e00640 1 -- 172.21.15.39:0/4283675805 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7faa881079d0 msgr2=0x7faa8819ed70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:36:51.294 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:36:51.289+0000 7faa85e00640 1 --2- 172.21.15.39:0/4283675805 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7faa881079d0 0x7faa8819ed70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:36:51.294 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:36:51.289+0000 7faa85e00640 1 -- 172.21.15.39:0/4283675805 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7faa88102370 msgr2=0x7faa8819a9e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:36:51.294 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:36:51.289+0000 7faa85e00640 1 --2- 172.21.15.39:0/4283675805 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7faa88102370 0x7faa8819a9e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:36:51.294 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:36:51.289+0000 7faa85e00640 1 -- 172.21.15.39:0/4283675805 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7faa8819f450 con 0x7faa881019d0 2024-09-12T02:36:51.294 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:36:51.289+0000 7faa85400640 1 --2- 172.21.15.39:0/4283675805 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7faa88102370 0x7faa8819a9e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-12T02:36:51.294 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:36:51.289+0000 7faa86800640 1 --2- 172.21.15.39:0/4283675805 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7faa881079d0 0x7faa8819ed70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-12T02:36:51.294 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:36:51.289+0000 7faa85e00640 1 --2- 172.21.15.39:0/4283675805 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7faa881019d0 0x7faa8819a4a0 secure :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0x7faa7802a940 tx=0x7faa78003b20 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:36:51.295 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:36:51.290+0000 7faa7ea00640 1 -- 172.21.15.39:0/4283675805 <== mon.1 v2:172.21.15.172:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7faa7803f070 con 0x7faa881019d0 2024-09-12T02:36:51.295 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:36:51.290+0000 7faa87200640 1 -- 172.21.15.39:0/4283675805 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7faa8819f6e0 con 0x7faa881019d0 2024-09-12T02:36:51.295 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:36:51.290+0000 7faa7ea00640 1 -- 172.21.15.39:0/4283675805 <== mon.1 v2:172.21.15.172:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7faa78031c90 con 0x7faa881019d0 2024-09-12T02:36:51.295 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:36:51.290+0000 7faa7ea00640 1 -- 172.21.15.39:0/4283675805 <== mon.1 v2:172.21.15.172:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7faa78035030 con 0x7faa881019d0 2024-09-12T02:36:51.295 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:36:51.290+0000 7faa87200640 1 -- 172.21.15.39:0/4283675805 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7faa881a7020 con 0x7faa881019d0 2024-09-12T02:36:51.297 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:36:51.291+0000 7faa87200640 1 -- 172.21.15.39:0/4283675805 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7faa88101e30 con 0x7faa881019d0 2024-09-12T02:36:51.297 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:36:51.293+0000 7faa7ea00640 1 -- 172.21.15.39:0/4283675805 <== mon.1 v2:172.21.15.172:3300/0 4 ==== mgrmap(e 17) ==== 137884+0+0 (secure 0 0 0) 0x7faa78042070 con 0x7faa881019d0 2024-09-12T02:36:51.297 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:36:51.294+0000 7faa7ea00640 1 --2- 172.21.15.39:0/4283675805 >> [v2:172.21.15.39:6800/1725006999,v1:172.21.15.39:6801/1725006999] conn(0x7faa6c0a2c10 0x7faa6c0a50d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:36:51.297 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:36:51.294+0000 7faa7ea00640 1 -- 172.21.15.39:0/4283675805 <== mon.1 v2:172.21.15.172:3300/0 5 ==== osd_map(95..95 src has 1..95) ==== 9129+0+0 (secure 0 0 0) 0x7faa780f0420 con 0x7faa881019d0 2024-09-12T02:36:51.298 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:36:51.295+0000 7faa85400640 1 --2- 172.21.15.39:0/4283675805 >> [v2:172.21.15.39:6800/1725006999,v1:172.21.15.39:6801/1725006999] conn(0x7faa6c0a2c10 0x7faa6c0a50d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:36:51.298 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:36:51.295+0000 7faa85400640 1 --2- 172.21.15.39:0/4283675805 >> [v2:172.21.15.39:6800/1725006999,v1:172.21.15.39:6801/1725006999] conn(0x7faa6c0a2c10 0x7faa6c0a50d0 secure :-1 s=READY pgs=202 cs=0 l=1 rev1=1 crypto rx=0x7faa8810eca0 tx=0x7faa74005f90 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:36:51.298 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:36:51.296+0000 7faa7ea00640 1 -- 172.21.15.39:0/4283675805 <== mon.1 v2:172.21.15.172:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7faa780bc850 con 0x7faa881019d0 2024-09-12T02:36:51.484 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:36:51.482+0000 7faa87200640 1 -- 172.21.15.39:0/4283675805 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 7} v 0) -- 0x7faa881a71f0 con 0x7faa881019d0 2024-09-12T02:36:51.484 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:36:51.483+0000 7faa7ea00640 1 -- 172.21.15.39:0/4283675805 <== mon.1 v2:172.21.15.172:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 7}]=0 v0) ==== 74+0+13 (secure 0 0 0) 0x7faa780c0b50 con 0x7faa881019d0 2024-09-12T02:36:51.484 INFO:teuthology.orchestra.run.smithi039.stdout:214748364856 2024-09-12T02:36:51.487 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:36:51.485+0000 7faa87200640 1 -- 172.21.15.39:0/4283675805 >> [v2:172.21.15.39:6800/1725006999,v1:172.21.15.39:6801/1725006999] conn(0x7faa6c0a2c10 msgr2=0x7faa6c0a50d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:36:51.487 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:36:51.485+0000 7faa87200640 1 --2- 172.21.15.39:0/4283675805 >> [v2:172.21.15.39:6800/1725006999,v1:172.21.15.39:6801/1725006999] conn(0x7faa6c0a2c10 0x7faa6c0a50d0 secure :-1 s=READY pgs=202 cs=0 l=1 rev1=1 crypto rx=0x7faa8810eca0 tx=0x7faa74005f90 comp rx=0 tx=0).stop 2024-09-12T02:36:51.487 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:36:51.485+0000 7faa87200640 1 -- 172.21.15.39:0/4283675805 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7faa881019d0 msgr2=0x7faa8819a4a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:36:51.487 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:36:51.485+0000 7faa87200640 1 --2- 172.21.15.39:0/4283675805 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7faa881019d0 0x7faa8819a4a0 secure :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0x7faa7802a940 tx=0x7faa78003b20 comp rx=0 tx=0).stop 2024-09-12T02:36:51.487 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:36:51.485+0000 7faa87200640 1 -- 172.21.15.39:0/4283675805 shutdown_connections 2024-09-12T02:36:51.487 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:36:51.485+0000 7faa87200640 1 --2- 172.21.15.39:0/4283675805 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7faa881079d0 0x7faa8819ed70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:36:51.487 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:36:51.485+0000 7faa87200640 1 --2- 172.21.15.39:0/4283675805 >> [v2:172.21.15.39:6800/1725006999,v1:172.21.15.39:6801/1725006999] conn(0x7faa6c0a2c10 0x7faa6c0a50d0 unknown :-1 s=CLOSED pgs=202 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:36:51.487 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:36:51.485+0000 7faa87200640 1 --2- 172.21.15.39:0/4283675805 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7faa88102370 0x7faa8819a9e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:36:51.487 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:36:51.485+0000 7faa87200640 1 --2- 172.21.15.39:0/4283675805 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7faa881019d0 0x7faa8819a4a0 unknown :-1 s=CLOSED pgs=96 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:36:51.487 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:36:51.486+0000 7faa87200640 1 -- 172.21.15.39:0/4283675805 >> 172.21.15.39:0/4283675805 conn(0x7faa880fd710 msgr2=0x7faa880fed90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:36:51.487 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:36:51.486+0000 7faa87200640 1 -- 172.21.15.39:0/4283675805 shutdown_connections 2024-09-12T02:36:51.487 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:36:51.486+0000 7faa87200640 1 -- 172.21.15.39:0/4283675805 wait complete. 2024-09-12T02:36:51.780 INFO:tasks.cephadm.ceph_manager.ceph:need seq 330712481824 got 330712481826 for osd.11 2024-09-12T02:36:51.780 DEBUG:teuthology.parallel:result is None 2024-09-12T02:36:52.173 INFO:tasks.cephadm.ceph_manager.ceph:need seq 141733920836 got 141733920840 for osd.4 2024-09-12T02:36:52.173 DEBUG:teuthology.parallel:result is None 2024-09-12T02:36:52.310 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 02:36:52 smithi039 ceph-mon[30515]: pgmap v358: 129 pgs: 129 active+clean; 645 KiB data, 348 MiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2024-09-12T02:36:52.310 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 02:36:52 smithi039 ceph-mon[30515]: from='client.? 172.21.15.39:0/4283675805' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 7}]: dispatch 2024-09-12T02:36:52.448 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 12 02:36:52 smithi044 ceph-mon[35411]: pgmap v358: 129 pgs: 129 active+clean; 645 KiB data, 348 MiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2024-09-12T02:36:52.449 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 12 02:36:52 smithi044 ceph-mon[35411]: from='client.? 172.21.15.39:0/4283675805' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 7}]: dispatch 2024-09-12T02:36:52.513 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 12 02:36:52 smithi172 ceph-mon[35609]: pgmap v358: 129 pgs: 129 active+clean; 645 KiB data, 348 MiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2024-09-12T02:36:52.514 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 12 02:36:52 smithi172 ceph-mon[35609]: from='client.? 172.21.15.39:0/4283675805' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 7}]: dispatch 2024-09-12T02:36:53.005 INFO:tasks.cephadm.ceph_manager.ceph:need seq 244813135919 got 244813135922 for osd.8 2024-09-12T02:36:53.005 DEBUG:teuthology.parallel:result is None 2024-09-12T02:36:53.551 INFO:tasks.cephadm.ceph_manager.ceph:need seq 214748364852 got 214748364856 for osd.7 2024-09-12T02:36:53.552 DEBUG:teuthology.parallel:result is None 2024-09-12T02:36:53.552 INFO:tasks.cephadm.ceph_manager.ceph:waiting for clean 2024-09-12T02:36:53.552 DEBUG:teuthology.orchestra.run.smithi039:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc shell --fsid 4954ed46-70ae-11ef-bcea-c7b262605968 -- ceph pg dump --format=json 2024-09-12T02:36:53.930 INFO:teuthology.orchestra.run.smithi039.stderr:Inferring config /var/lib/ceph/4954ed46-70ae-11ef-bcea-c7b262605968/mon.a/config 2024-09-12T02:36:54.291 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 02:36:54 smithi039 ceph-mon[30515]: pgmap v359: 129 pgs: 129 active+clean; 645 KiB data, 348 MiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 6 op/s 2024-09-12T02:36:54.316 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 12 02:36:54 smithi172 ceph-mon[35609]: pgmap v359: 129 pgs: 129 active+clean; 645 KiB data, 348 MiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 6 op/s 2024-09-12T02:36:54.448 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 12 02:36:54 smithi044 ceph-mon[35411]: pgmap v359: 129 pgs: 129 active+clean; 645 KiB data, 348 MiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 6 op/s 2024-09-12T02:36:54.535 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:36:54.534+0000 7f93ad000640 1 -- 172.21.15.39:0/2023896365 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f93a81019a0 msgr2=0x7f93a8101e00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:36:54.535 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:36:54.534+0000 7f93ad000640 1 --2- 172.21.15.39:0/2023896365 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f93a81019a0 0x7f93a8101e00 secure :-1 s=READY pgs=222 cs=0 l=1 rev1=1 crypto rx=0x7f9390009930 tx=0x7f939002a440 comp rx=0 tx=0).stop 2024-09-12T02:36:54.535 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:36:54.534+0000 7f93ad000640 1 -- 172.21.15.39:0/2023896365 shutdown_connections 2024-09-12T02:36:54.536 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:36:54.534+0000 7f93ad000640 1 --2- 172.21.15.39:0/2023896365 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f93a8102340 0x7f93a810e870 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:36:54.536 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:36:54.534+0000 7f93ad000640 1 --2- 172.21.15.39:0/2023896365 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f93a81019a0 0x7f93a8101e00 unknown :-1 s=CLOSED pgs=222 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:36:54.536 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:36:54.534+0000 7f93ad000640 1 --2- 172.21.15.39:0/2023896365 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f93a81079a0 0x7f93a8107d80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:36:54.536 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:36:54.534+0000 7f93ad000640 1 -- 172.21.15.39:0/2023896365 >> 172.21.15.39:0/2023896365 conn(0x7f93a80fd680 msgr2=0x7f93a80ffaa0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:36:54.536 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:36:54.534+0000 7f93ad000640 1 -- 172.21.15.39:0/2023896365 shutdown_connections 2024-09-12T02:36:54.536 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:36:54.534+0000 7f93ad000640 1 -- 172.21.15.39:0/2023896365 wait complete. 2024-09-12T02:36:54.538 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:36:54.535+0000 7f93ad000640 1 Processor -- start 2024-09-12T02:36:54.538 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:36:54.535+0000 7f93ad000640 1 -- start start 2024-09-12T02:36:54.538 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:36:54.536+0000 7f93ad000640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f93a81019a0 0x7f93a819a500 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:36:54.538 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:36:54.536+0000 7f93ad000640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f93a8102340 0x7f93a819aa40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:36:54.538 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:36:54.536+0000 7f93ad000640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f93a81079a0 0x7f93a819edd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:36:54.538 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:36:54.536+0000 7f93ad000640 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 -- 0x7f93a8111df0 con 0x7f93a8102340 2024-09-12T02:36:54.538 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:36:54.536+0000 7f93ad000640 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x7f93a8111c70 con 0x7f93a81079a0 2024-09-12T02:36:54.538 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:36:54.536+0000 7f93ad000640 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7f93a8111f70 con 0x7f93a81019a0 2024-09-12T02:36:54.539 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:36:54.536+0000 7f939fe00640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f93a8102340 0x7f93a819aa40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:36:54.539 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:36:54.536+0000 7f93a7400640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f93a81019a0 0x7f93a819a500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:36:54.539 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:36:54.536+0000 7f939fe00640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f93a8102340 0x7f93a819aa40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.39:3300/0 says I am v2:172.21.15.39:52802/0 (socket says 172.21.15.39:52802) 2024-09-12T02:36:54.539 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:36:54.536+0000 7f939fe00640 1 -- 172.21.15.39:0/1355280666 learned_addr learned my addr 172.21.15.39:0/1355280666 (peer_addr_for_me v2:172.21.15.39:0/0) 2024-09-12T02:36:54.539 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:36:54.536+0000 7f93a7e00640 1 --2- 172.21.15.39:0/1355280666 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f93a81079a0 0x7f93a819edd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:36:54.539 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:36:54.536+0000 7f93a7400640 1 -- 172.21.15.39:0/1355280666 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f93a81079a0 msgr2=0x7f93a819edd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:36:54.539 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:36:54.536+0000 7f93a7400640 1 --2- 172.21.15.39:0/1355280666 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f93a81079a0 0x7f93a819edd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:36:54.539 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:36:54.536+0000 7f93a7400640 1 -- 172.21.15.39:0/1355280666 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f93a8102340 msgr2=0x7f93a819aa40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:36:54.539 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:36:54.536+0000 7f93a7400640 1 --2- 172.21.15.39:0/1355280666 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f93a8102340 0x7f93a819aa40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:36:54.539 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:36:54.537+0000 7f93a7400640 1 -- 172.21.15.39:0/1355280666 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f93a819f4b0 con 0x7f93a81019a0 2024-09-12T02:36:54.539 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:36:54.537+0000 7f939fe00640 1 --2- 172.21.15.39:0/1355280666 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f93a8102340 0x7f93a819aa40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-12T02:36:54.539 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:36:54.537+0000 7f93a7e00640 1 --2- 172.21.15.39:0/1355280666 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f93a81079a0 0x7f93a819edd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-12T02:36:54.539 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:36:54.537+0000 7f93a7400640 1 --2- 172.21.15.39:0/1355280666 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f93a81019a0 0x7f93a819a500 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0x7f939800e9f0 tx=0x7f939800eeb0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:36:54.540 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:36:54.537+0000 7f93a4c00640 1 -- 172.21.15.39:0/1355280666 <== mon.1 v2:172.21.15.172:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f939800ccc0 con 0x7f93a81019a0 2024-09-12T02:36:54.540 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:36:54.537+0000 7f93a4c00640 1 -- 172.21.15.39:0/1355280666 <== mon.1 v2:172.21.15.172:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f9398005020 con 0x7f93a81019a0 2024-09-12T02:36:54.540 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:36:54.537+0000 7f93ad000640 1 -- 172.21.15.39:0/1355280666 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f93a819f7a0 con 0x7f93a81019a0 2024-09-12T02:36:54.540 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:36:54.537+0000 7f93a4c00640 1 -- 172.21.15.39:0/1355280666 <== mon.1 v2:172.21.15.172:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f93980049e0 con 0x7f93a81019a0 2024-09-12T02:36:54.540 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:36:54.537+0000 7f93ad000640 1 -- 172.21.15.39:0/1355280666 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f93a81a7080 con 0x7f93a81019a0 2024-09-12T02:36:54.540 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:36:54.538+0000 7f93ad000640 1 -- 172.21.15.39:0/1355280666 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f93a81030e0 con 0x7f93a81019a0 2024-09-12T02:36:54.541 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:36:54.540+0000 7f93a4c00640 1 -- 172.21.15.39:0/1355280666 <== mon.1 v2:172.21.15.172:3300/0 4 ==== mgrmap(e 17) ==== 137884+0+0 (secure 0 0 0) 0x7f9398005560 con 0x7f93a81019a0 2024-09-12T02:36:54.542 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:36:54.542+0000 7f93a4c00640 1 --2- 172.21.15.39:0/1355280666 >> [v2:172.21.15.39:6800/1725006999,v1:172.21.15.39:6801/1725006999] conn(0x7f938c0a2c10 0x7f938c0a50d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:36:54.543 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:36:54.542+0000 7f93a4c00640 1 -- 172.21.15.39:0/1355280666 <== mon.1 v2:172.21.15.172:3300/0 5 ==== osd_map(95..95 src has 1..95) ==== 9129+0+0 (secure 0 0 0) 0x7f93980cf570 con 0x7f93a81019a0 2024-09-12T02:36:54.543 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:36:54.542+0000 7f939fe00640 1 --2- 172.21.15.39:0/1355280666 >> [v2:172.21.15.39:6800/1725006999,v1:172.21.15.39:6801/1725006999] conn(0x7f938c0a2c10 0x7f938c0a50d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:36:54.543 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:36:54.543+0000 7f939fe00640 1 --2- 172.21.15.39:0/1355280666 >> [v2:172.21.15.39:6800/1725006999,v1:172.21.15.39:6801/1725006999] conn(0x7f938c0a2c10 0x7f938c0a50d0 secure :-1 s=READY pgs=203 cs=0 l=1 rev1=1 crypto rx=0x7f93a810e6c0 tx=0x7f9390031510 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:36:54.544 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:36:54.544+0000 7f93a4c00640 1 -- 172.21.15.39:0/1355280666 <== mon.1 v2:172.21.15.172:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7f93980051d0 con 0x7f93a81019a0 2024-09-12T02:36:54.731 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:36:54.730+0000 7f93ad000640 1 -- 172.21.15.39:0/1355280666 --> [v2:172.21.15.39:6800/1725006999,v1:172.21.15.39:6801/1725006999] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7f93a810d340 con 0x7f938c0a2c10 2024-09-12T02:36:54.740 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:36:54.739+0000 7f93a4c00640 1 -- 172.21.15.39:0/1355280666 <== mgr.14150 v2:172.21.15.39:6800/1725006999 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+340418 (secure 0 0 0) 0x7f93a810d340 con 0x7f938c0a2c10 2024-09-12T02:36:54.745 INFO:teuthology.orchestra.run.smithi039.stdout: 2024-09-12T02:36:54.747 INFO:teuthology.orchestra.run.smithi039.stderr:dumped all 2024-09-12T02:36:54.749 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:36:54.743+0000 7f93ad000640 1 -- 172.21.15.39:0/1355280666 >> [v2:172.21.15.39:6800/1725006999,v1:172.21.15.39:6801/1725006999] conn(0x7f938c0a2c10 msgr2=0x7f938c0a50d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:36:54.750 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:36:54.743+0000 7f93ad000640 1 --2- 172.21.15.39:0/1355280666 >> [v2:172.21.15.39:6800/1725006999,v1:172.21.15.39:6801/1725006999] conn(0x7f938c0a2c10 0x7f938c0a50d0 secure :-1 s=READY pgs=203 cs=0 l=1 rev1=1 crypto rx=0x7f93a810e6c0 tx=0x7f9390031510 comp rx=0 tx=0).stop 2024-09-12T02:36:54.750 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:36:54.743+0000 7f93ad000640 1 -- 172.21.15.39:0/1355280666 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f93a81019a0 msgr2=0x7f93a819a500 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:36:54.750 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:36:54.743+0000 7f93ad000640 1 --2- 172.21.15.39:0/1355280666 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f93a81019a0 0x7f93a819a500 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0x7f939800e9f0 tx=0x7f939800eeb0 comp rx=0 tx=0).stop 2024-09-12T02:36:54.750 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:36:54.743+0000 7f93ad000640 1 -- 172.21.15.39:0/1355280666 shutdown_connections 2024-09-12T02:36:54.750 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:36:54.743+0000 7f93ad000640 1 --2- 172.21.15.39:0/1355280666 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f93a81079a0 0x7f93a819edd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:36:54.750 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:36:54.743+0000 7f93ad000640 1 --2- 172.21.15.39:0/1355280666 >> [v2:172.21.15.39:6800/1725006999,v1:172.21.15.39:6801/1725006999] conn(0x7f938c0a2c10 0x7f938c0a50d0 unknown :-1 s=CLOSED pgs=203 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:36:54.750 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:36:54.743+0000 7f93ad000640 1 --2- 172.21.15.39:0/1355280666 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f93a8102340 0x7f93a819aa40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:36:54.750 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:36:54.743+0000 7f93ad000640 1 --2- 172.21.15.39:0/1355280666 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f93a81019a0 0x7f93a819a500 unknown :-1 s=CLOSED pgs=97 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:36:54.750 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:36:54.743+0000 7f93ad000640 1 -- 172.21.15.39:0/1355280666 >> 172.21.15.39:0/1355280666 conn(0x7f93a80fd680 msgr2=0x7f93a810cc30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:36:54.750 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:36:54.744+0000 7f93ad000640 1 -- 172.21.15.39:0/1355280666 shutdown_connections 2024-09-12T02:36:54.751 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:36:54.744+0000 7f93ad000640 1 -- 172.21.15.39:0/1355280666 wait complete. 2024-09-12T02:36:55.252 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 02:36:55 smithi039 ceph-mon[30515]: from='client.24916 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-09-12T02:36:55.448 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 12 02:36:55 smithi044 ceph-mon[35411]: from='client.24916 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-09-12T02:36:55.513 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 12 02:36:55 smithi172 ceph-mon[35609]: from='client.24916 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-09-12T02:36:55.774 INFO:teuthology.orchestra.run.smithi039.stdout:{"pg_ready":true,"pg_map":{"version":359,"stamp":"2024-09-12T02:36:52.838607+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":660864,"num_objects":102,"num_object_clones":0,"num_object_copies":308,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":102,"num_whiteouts":0,"num_read":749,"num_read_kb":503,"num_write":431,"num_write_kb":3082,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":9,"num_bytes_recovered":1180736,"num_keys_recovered":0,"num_objects_omap":66,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":353,"ondisk_log_size":353,"up":419,"acting":419,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":419,"num_osds":12,"num_per_pool_osds":12,"num_per_pool_omap_osds":12,"kb":1124941824,"kb_used":355988,"kb_used_data":14992,"kb_used_omap":18,"kb_used_meta":340717,"kb_avail":1124585836,"statfs":{"total":1151940427776,"available":1151575896064,"internally_reserved":0,"allocated":15351808,"data_stored":8482505,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":19143,"internal_metadata":348894521},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":55,"num_read_kb":25,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"8.002230"},"pg_stats":[{"pgid":"2.1f","version":"93'13","reported_seq":114,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-12T02:36:48.065729+0000","last_change":"2024-09-12T02:35:00.062996+0000","last_active":"2024-09-12T02:36:48.065729+0000","last_peered":"2024-09-12T02:36:48.065729+0000","last_clean":"2024-09-12T02:36:48.065729+0000","last_became_active":"2024-09-12T02:35:00.062670+0000","last_became_peered":"2024-09-12T02:35:00.062670+0000","last_unstale":"2024-09-12T02:36:48.065729+0000","last_undegraded":"2024-09-12T02:36:48.065729+0000","last_fullsized":"2024-09-12T02:36:48.065729+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:34:59.027857+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:34:59.027857+0000","last_clean_scrub_stamp":"2024-09-12T02:34:59.027857+0000","objects_scrubbed":0,"log_size":13,"log_dups_size":0,"ondisk_log_size":13,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:08:38.434465+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":672,"num_objects":6,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":59,"num_read_kb":59,"num_write":14,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,7,8],"acting":[9,7,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.1e","version":"0'0","reported_seq":38,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-12T02:36:47.010296+0000","last_change":"2024-09-12T02:35:02.518880+0000","last_active":"2024-09-12T02:36:47.010296+0000","last_peered":"2024-09-12T02:36:47.010296+0000","last_clean":"2024-09-12T02:36:47.010296+0000","last_became_active":"2024-09-12T02:35:02.516137+0000","last_became_peered":"2024-09-12T02:35:02.516137+0000","last_unstale":"2024-09-12T02:36:47.010296+0000","last_undegraded":"2024-09-12T02:36:47.010296+0000","last_fullsized":"2024-09-12T02:36:47.010296+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:35:01.470375+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:35:01.470375+0000","last_clean_scrub_stamp":"2024-09-12T02:35:01.470375+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T13:23:04.313584+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,5],"acting":[3,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.19","version":"0'0","reported_seq":35,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-12T02:36:47.586823+0000","last_change":"2024-09-12T02:36:47.586823+0000","last_active":"2024-09-12T02:36:47.586823+0000","last_peered":"2024-09-12T02:36:47.586823+0000","last_clean":"2024-09-12T02:36:47.586823+0000","last_became_active":"2024-09-12T02:36:47.586394+0000","last_became_peered":"2024-09-12T02:36:47.586394+0000","last_unstale":"2024-09-12T02:36:47.586823+0000","last_undegraded":"2024-09-12T02:36:47.586823+0000","last_fullsized":"2024-09-12T02:36:47.586823+0000","mapping_epoch":94,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":95,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:35:11.552386+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:35:11.552386+0000","last_clean_scrub_stamp":"2024-09-12T02:35:11.552386+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:22:51.284546+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,8,0],"acting":[2,3,8,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1e","version":"93'2","reported_seq":44,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-12T02:36:47.010488+0000","last_change":"2024-09-12T02:35:00.068606+0000","last_active":"2024-09-12T02:36:47.010488+0000","last_peered":"2024-09-12T02:36:47.010488+0000","last_clean":"2024-09-12T02:36:47.010488+0000","last_became_active":"2024-09-12T02:35:00.068243+0000","last_became_peered":"2024-09-12T02:35:00.068243+0000","last_unstale":"2024-09-12T02:36:47.010488+0000","last_undegraded":"2024-09-12T02:36:47.010488+0000","last_fullsized":"2024-09-12T02:36:47.010488+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:34:59.027857+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:34:59.027857+0000","last_clean_scrub_stamp":"2024-09-12T02:34:59.027857+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:19:41.463728+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,5],"acting":[3,0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1f","version":"0'0","reported_seq":34,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-12T02:36:47.585723+0000","last_change":"2024-09-12T02:35:02.525485+0000","last_active":"2024-09-12T02:36:47.585723+0000","last_peered":"2024-09-12T02:36:47.585723+0000","last_clean":"2024-09-12T02:36:47.585723+0000","last_became_active":"2024-09-12T02:35:02.525111+0000","last_became_peered":"2024-09-12T02:35:02.525111+0000","last_unstale":"2024-09-12T02:36:47.585723+0000","last_undegraded":"2024-09-12T02:36:47.585723+0000","last_fullsized":"2024-09-12T02:36:47.585723+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:35:01.470375+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:35:01.470375+0000","last_clean_scrub_stamp":"2024-09-12T02:35:01.470375+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:37:25.329762+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,9],"acting":[0,1,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.18","version":"0'0","reported_seq":28,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-12T02:36:47.066540+0000","last_change":"2024-09-12T02:35:12.591057+0000","last_active":"2024-09-12T02:36:47.066540+0000","last_peered":"2024-09-12T02:36:47.066540+0000","last_clean":"2024-09-12T02:36:47.066540+0000","last_became_active":"2024-09-12T02:35:12.590606+0000","last_became_peered":"2024-09-12T02:35:12.590606+0000","last_unstale":"2024-09-12T02:36:47.066540+0000","last_undegraded":"2024-09-12T02:36:47.066540+0000","last_fullsized":"2024-09-12T02:36:47.066540+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:35:11.552386+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:35:11.552386+0000","last_clean_scrub_stamp":"2024-09-12T02:35:11.552386+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:44:06.007603+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6,9,3],"acting":[4,6,9,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1d","version":"93'12","reported_seq":53,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-12T02:36:47.011607+0000","last_change":"2024-09-12T02:35:00.064090+0000","last_active":"2024-09-12T02:36:47.011607+0000","last_peered":"2024-09-12T02:36:47.011607+0000","last_clean":"2024-09-12T02:36:47.011607+0000","last_became_active":"2024-09-12T02:35:00.063688+0000","last_became_peered":"2024-09-12T02:35:00.063688+0000","last_unstale":"2024-09-12T02:36:47.011607+0000","last_undegraded":"2024-09-12T02:36:47.011607+0000","last_fullsized":"2024-09-12T02:36:47.011607+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:34:59.027857+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:34:59.027857+0000","last_clean_scrub_stamp":"2024-09-12T02:34:59.027857+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:27:30.117990+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":7,"num_object_clones":0,"num_object_copies":21,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":16,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":7,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,2,7],"acting":[8,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.1c","version":"0'0","reported_seq":37,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-12T02:36:47.153737+0000","last_change":"2024-09-12T02:35:02.510882+0000","last_active":"2024-09-12T02:36:47.153737+0000","last_peered":"2024-09-12T02:36:47.153737+0000","last_clean":"2024-09-12T02:36:47.153737+0000","last_became_active":"2024-09-12T02:35:02.510513+0000","last_became_peered":"2024-09-12T02:35:02.510513+0000","last_unstale":"2024-09-12T02:36:47.153737+0000","last_undegraded":"2024-09-12T02:36:47.153737+0000","last_fullsized":"2024-09-12T02:36:47.153737+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:35:01.470375+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:35:01.470375+0000","last_clean_scrub_stamp":"2024-09-12T02:35:01.470375+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:21:40.527379+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,10,6],"acting":[1,10,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1b","version":"0'0","reported_seq":28,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-12T02:36:47.066838+0000","last_change":"2024-09-12T02:35:12.590704+0000","last_active":"2024-09-12T02:36:47.066838+0000","last_peered":"2024-09-12T02:36:47.066838+0000","last_clean":"2024-09-12T02:36:47.066838+0000","last_became_active":"2024-09-12T02:35:12.590217+0000","last_became_peered":"2024-09-12T02:35:12.590217+0000","last_unstale":"2024-09-12T02:36:47.066838+0000","last_undegraded":"2024-09-12T02:36:47.066838+0000","last_fullsized":"2024-09-12T02:36:47.066838+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:35:11.552386+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:35:11.552386+0000","last_clean_scrub_stamp":"2024-09-12T02:35:11.552386+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:21:47.370860+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,9,5],"acting":[4,3,9,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1c","version":"93'5","reported_seq":46,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-12T02:36:47.011722+0000","last_change":"2024-09-12T02:35:00.059679+0000","last_active":"2024-09-12T02:36:47.011722+0000","last_peered":"2024-09-12T02:36:47.011722+0000","last_clean":"2024-09-12T02:36:47.011722+0000","last_became_active":"2024-09-12T02:35:00.058599+0000","last_became_peered":"2024-09-12T02:35:00.058599+0000","last_unstale":"2024-09-12T02:36:47.011722+0000","last_undegraded":"2024-09-12T02:36:47.011722+0000","last_fullsized":"2024-09-12T02:36:47.011722+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:34:59.027857+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:34:59.027857+0000","last_clean_scrub_stamp":"2024-09-12T02:34:59.027857+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:24:39.878761+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":7,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,1,5],"acting":[8,1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.1d","version":"0'0","reported_seq":36,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-12T02:36:47.065676+0000","last_change":"2024-09-12T02:35:02.511371+0000","last_active":"2024-09-12T02:36:47.065676+0000","last_peered":"2024-09-12T02:36:47.065676+0000","last_clean":"2024-09-12T02:36:47.065676+0000","last_became_active":"2024-09-12T02:35:02.510941+0000","last_became_peered":"2024-09-12T02:35:02.510941+0000","last_unstale":"2024-09-12T02:36:47.065676+0000","last_undegraded":"2024-09-12T02:36:47.065676+0000","last_fullsized":"2024-09-12T02:36:47.065676+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:35:01.470375+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:35:01.470375+0000","last_clean_scrub_stamp":"2024-09-12T02:35:01.470375+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:30:50.106899+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,1],"acting":[5,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1a","version":"0'0","reported_seq":28,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-12T02:36:47.066647+0000","last_change":"2024-09-12T02:35:12.590925+0000","last_active":"2024-09-12T02:36:47.066647+0000","last_peered":"2024-09-12T02:36:47.066647+0000","last_clean":"2024-09-12T02:36:47.066647+0000","last_became_active":"2024-09-12T02:35:12.590286+0000","last_became_peered":"2024-09-12T02:35:12.590286+0000","last_unstale":"2024-09-12T02:36:47.066647+0000","last_undegraded":"2024-09-12T02:36:47.066647+0000","last_fullsized":"2024-09-12T02:36:47.066647+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:35:11.552386+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:35:11.552386+0000","last_clean_scrub_stamp":"2024-09-12T02:35:11.552386+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:31:48.835941+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6,5,3],"acting":[4,6,5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":37,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-12T02:36:47.064593+0000","last_change":"2024-09-12T02:35:02.524637+0000","last_active":"2024-09-12T02:36:47.064593+0000","last_peered":"2024-09-12T02:36:47.064593+0000","last_clean":"2024-09-12T02:36:47.064593+0000","last_became_active":"2024-09-12T02:35:02.524178+0000","last_became_peered":"2024-09-12T02:35:02.524178+0000","last_unstale":"2024-09-12T02:36:47.064593+0000","last_undegraded":"2024-09-12T02:36:47.064593+0000","last_fullsized":"2024-09-12T02:36:47.064593+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:35:01.470375+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:35:01.470375+0000","last_clean_scrub_stamp":"2024-09-12T02:35:01.470375+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:31:28.693302+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,6],"acting":[7,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.b","version":"93'4","reported_seq":55,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-12T02:36:47.011260+0000","last_change":"2024-09-12T02:35:46.837747+0000","last_active":"2024-09-12T02:36:47.011260+0000","last_peered":"2024-09-12T02:36:47.011260+0000","last_clean":"2024-09-12T02:36:47.011260+0000","last_became_active":"2024-09-12T02:35:46.834865+0000","last_became_peered":"2024-09-12T02:35:46.834865+0000","last_unstale":"2024-09-12T02:36:47.011260+0000","last_undegraded":"2024-09-12T02:36:47.011260+0000","last_fullsized":"2024-09-12T02:36:47.011260+0000","mapping_epoch":92,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":93,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:34:59.027857+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:34:59.027857+0000","last_clean_scrub_stamp":"2024-09-12T02:34:59.027857+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:04:51.092618+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,1,7],"acting":[8,1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"4.d","version":"0'0","reported_seq":28,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-12T02:36:47.066922+0000","last_change":"2024-09-12T02:35:12.590345+0000","last_active":"2024-09-12T02:36:47.066922+0000","last_peered":"2024-09-12T02:36:47.066922+0000","last_clean":"2024-09-12T02:36:47.066922+0000","last_became_active":"2024-09-12T02:35:12.589805+0000","last_became_peered":"2024-09-12T02:35:12.589805+0000","last_unstale":"2024-09-12T02:36:47.066922+0000","last_undegraded":"2024-09-12T02:36:47.066922+0000","last_fullsized":"2024-09-12T02:36:47.066922+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:35:11.552386+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:35:11.552386+0000","last_clean_scrub_stamp":"2024-09-12T02:35:11.552386+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:49:28.262371+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2,10,3],"acting":[4,2,10,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.b","version":"0'0","reported_seq":38,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-12T02:36:47.008947+0000","last_change":"2024-09-12T02:35:02.513424+0000","last_active":"2024-09-12T02:36:47.008947+0000","last_peered":"2024-09-12T02:36:47.008947+0000","last_clean":"2024-09-12T02:36:47.008947+0000","last_became_active":"2024-09-12T02:35:02.512180+0000","last_became_peered":"2024-09-12T02:35:02.512180+0000","last_unstale":"2024-09-12T02:36:47.008947+0000","last_undegraded":"2024-09-12T02:36:47.008947+0000","last_fullsized":"2024-09-12T02:36:47.008947+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:35:01.470375+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:35:01.470375+0000","last_clean_scrub_stamp":"2024-09-12T02:35:01.470375+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:22:40.102645+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,10],"acting":[3,0,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.a","version":"93'3","reported_seq":45,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-12T02:36:47.013189+0000","last_change":"2024-09-12T02:35:00.066012+0000","last_active":"2024-09-12T02:36:47.013189+0000","last_peered":"2024-09-12T02:36:47.013189+0000","last_clean":"2024-09-12T02:36:47.013189+0000","last_became_active":"2024-09-12T02:35:00.065642+0000","last_became_peered":"2024-09-12T02:35:00.065642+0000","last_unstale":"2024-09-12T02:36:47.013189+0000","last_undegraded":"2024-09-12T02:36:47.013189+0000","last_fullsized":"2024-09-12T02:36:47.013189+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:34:59.027857+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:34:59.027857+0000","last_clean_scrub_stamp":"2024-09-12T02:34:59.027857+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:16:27.609255+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,8],"acting":[2,3,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.c","version":"93'1","reported_seq":29,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-12T02:36:47.066831+0000","last_change":"2024-09-12T02:35:12.591850+0000","last_active":"2024-09-12T02:36:47.066831+0000","last_peered":"2024-09-12T02:36:47.066831+0000","last_clean":"2024-09-12T02:36:47.066831+0000","last_became_active":"2024-09-12T02:35:12.590807+0000","last_became_peered":"2024-09-12T02:35:12.590807+0000","last_unstale":"2024-09-12T02:36:47.066831+0000","last_undegraded":"2024-09-12T02:36:47.066831+0000","last_fullsized":"2024-09-12T02:36:47.066831+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:35:11.552386+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:35:11.552386+0000","last_clean_scrub_stamp":"2024-09-12T02:35:11.552386+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:09:16.082542+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":117,"num_objects":1,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,9,7,8],"acting":[4,9,7,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":35,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-12T02:36:47.154036+0000","last_change":"2024-09-12T02:35:02.510960+0000","last_active":"2024-09-12T02:36:47.154036+0000","last_peered":"2024-09-12T02:36:47.154036+0000","last_clean":"2024-09-12T02:36:47.154036+0000","last_became_active":"2024-09-12T02:35:02.510589+0000","last_became_peered":"2024-09-12T02:35:02.510589+0000","last_unstale":"2024-09-12T02:36:47.154036+0000","last_undegraded":"2024-09-12T02:36:47.154036+0000","last_fullsized":"2024-09-12T02:36:47.154036+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:35:01.470375+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:35:01.470375+0000","last_clean_scrub_stamp":"2024-09-12T02:35:01.470375+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:33:15.825208+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,0,2],"acting":[11,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"2.9","version":"93'7","reported_seq":49,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-12T02:36:47.009289+0000","last_change":"2024-09-12T02:35:00.061327+0000","last_active":"2024-09-12T02:36:47.009289+0000","last_peered":"2024-09-12T02:36:47.009289+0000","last_clean":"2024-09-12T02:36:47.009289+0000","last_became_active":"2024-09-12T02:35:00.061118+0000","last_became_peered":"2024-09-12T02:35:00.061118+0000","last_unstale":"2024-09-12T02:36:47.009289+0000","last_undegraded":"2024-09-12T02:36:47.009289+0000","last_fullsized":"2024-09-12T02:36:47.009289+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:34:59.027857+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:34:59.027857+0000","last_clean_scrub_stamp":"2024-09-12T02:34:59.027857+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T14:02:22.217428+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,9,10],"acting":[3,9,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.f","version":"0'0","reported_seq":28,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-12T02:36:47.009987+0000","last_change":"2024-09-12T02:35:12.581769+0000","last_active":"2024-09-12T02:36:47.009987+0000","last_peered":"2024-09-12T02:36:47.009987+0000","last_clean":"2024-09-12T02:36:47.009987+0000","last_became_active":"2024-09-12T02:35:12.580169+0000","last_became_peered":"2024-09-12T02:35:12.580169+0000","last_unstale":"2024-09-12T02:36:47.009987+0000","last_undegraded":"2024-09-12T02:36:47.009987+0000","last_fullsized":"2024-09-12T02:36:47.009987+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:35:11.552386+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:35:11.552386+0000","last_clean_scrub_stamp":"2024-09-12T02:35:11.552386+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:04:10.192058+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,3,2,5],"acting":[9,3,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":35,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-12T02:36:47.011088+0000","last_change":"2024-09-12T02:35:02.507893+0000","last_active":"2024-09-12T02:36:47.011088+0000","last_peered":"2024-09-12T02:36:47.011088+0000","last_clean":"2024-09-12T02:36:47.011088+0000","last_became_active":"2024-09-12T02:35:02.506357+0000","last_became_peered":"2024-09-12T02:35:02.506357+0000","last_unstale":"2024-09-12T02:36:47.011088+0000","last_undegraded":"2024-09-12T02:36:47.011088+0000","last_fullsized":"2024-09-12T02:36:47.011088+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:35:01.470375+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:35:01.470375+0000","last_clean_scrub_stamp":"2024-09-12T02:35:01.470375+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T14:03:36.148796+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,11,10],"acting":[8,11,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"2.8","version":"93'2","reported_seq":43,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-12T02:36:47.153507+0000","last_change":"2024-09-12T02:35:00.068759+0000","last_active":"2024-09-12T02:36:47.153507+0000","last_peered":"2024-09-12T02:36:47.153507+0000","last_clean":"2024-09-12T02:36:47.153507+0000","last_became_active":"2024-09-12T02:35:00.068464+0000","last_became_peered":"2024-09-12T02:35:00.068464+0000","last_unstale":"2024-09-12T02:36:47.153507+0000","last_undegraded":"2024-09-12T02:36:47.153507+0000","last_fullsized":"2024-09-12T02:36:47.153507+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:34:59.027857+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:34:59.027857+0000","last_clean_scrub_stamp":"2024-09-12T02:34:59.027857+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T14:17:20.863590+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,0],"acting":[1,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.e","version":"0'0","reported_seq":28,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-12T02:36:47.067079+0000","last_change":"2024-09-12T02:35:12.591707+0000","last_active":"2024-09-12T02:36:47.067079+0000","last_peered":"2024-09-12T02:36:47.067079+0000","last_clean":"2024-09-12T02:36:47.067079+0000","last_became_active":"2024-09-12T02:35:12.591302+0000","last_became_peered":"2024-09-12T02:35:12.591302+0000","last_unstale":"2024-09-12T02:36:47.067079+0000","last_undegraded":"2024-09-12T02:36:47.067079+0000","last_fullsized":"2024-09-12T02:36:47.067079+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:35:11.552386+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:35:11.552386+0000","last_clean_scrub_stamp":"2024-09-12T02:35:11.552386+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:56:14.526395+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5,10,9],"acting":[4,5,10,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":34,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-12T02:36:47.586036+0000","last_change":"2024-09-12T02:35:02.523175+0000","last_active":"2024-09-12T02:36:47.586036+0000","last_peered":"2024-09-12T02:36:47.586036+0000","last_clean":"2024-09-12T02:36:47.586036+0000","last_became_active":"2024-09-12T02:35:02.522846+0000","last_became_peered":"2024-09-12T02:35:02.522846+0000","last_unstale":"2024-09-12T02:36:47.586036+0000","last_undegraded":"2024-09-12T02:36:47.586036+0000","last_fullsized":"2024-09-12T02:36:47.586036+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:35:01.470375+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:35:01.470375+0000","last_clean_scrub_stamp":"2024-09-12T02:35:01.470375+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:16:18.488190+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,4],"acting":[0,3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.7","version":"93'7","reported_seq":49,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-12T02:36:47.067356+0000","last_change":"2024-09-12T02:35:00.314147+0000","last_active":"2024-09-12T02:36:47.067356+0000","last_peered":"2024-09-12T02:36:47.067356+0000","last_clean":"2024-09-12T02:36:47.067356+0000","last_became_active":"2024-09-12T02:35:00.313795+0000","last_became_peered":"2024-09-12T02:35:00.313795+0000","last_unstale":"2024-09-12T02:36:47.067356+0000","last_undegraded":"2024-09-12T02:36:47.067356+0000","last_fullsized":"2024-09-12T02:36:47.067356+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:34:59.027857+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:34:59.027857+0000","last_clean_scrub_stamp":"2024-09-12T02:34:59.027857+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:26:33.269006+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,11,6],"acting":[4,11,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.1","version":"0'0","reported_seq":28,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-12T02:36:47.013567+0000","last_change":"2024-09-12T02:35:12.578075+0000","last_active":"2024-09-12T02:36:47.013567+0000","last_peered":"2024-09-12T02:36:47.013567+0000","last_clean":"2024-09-12T02:36:47.013567+0000","last_became_active":"2024-09-12T02:35:12.577622+0000","last_became_peered":"2024-09-12T02:35:12.577622+0000","last_unstale":"2024-09-12T02:36:47.013567+0000","last_undegraded":"2024-09-12T02:36:47.013567+0000","last_fullsized":"2024-09-12T02:36:47.013567+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:35:11.552386+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:35:11.552386+0000","last_clean_scrub_stamp":"2024-09-12T02:35:11.552386+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:26:50.263757+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,4,7],"acting":[2,1,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.7","version":"0'0","reported_seq":38,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-12T02:36:47.010625+0000","last_change":"2024-09-12T02:35:02.514685+0000","last_active":"2024-09-12T02:36:47.010625+0000","last_peered":"2024-09-12T02:36:47.010625+0000","last_clean":"2024-09-12T02:36:47.010625+0000","last_became_active":"2024-09-12T02:35:02.511606+0000","last_became_peered":"2024-09-12T02:35:02.511606+0000","last_unstale":"2024-09-12T02:36:47.010625+0000","last_undegraded":"2024-09-12T02:36:47.010625+0000","last_fullsized":"2024-09-12T02:36:47.010625+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:35:01.470375+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:35:01.470375+0000","last_clean_scrub_stamp":"2024-09-12T02:35:01.470375+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:36:49.833272+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,11,7],"acting":[3,11,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.6","version":"93'15","reported_seq":57,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-12T02:36:47.009854+0000","last_change":"2024-09-12T02:35:00.059540+0000","last_active":"2024-09-12T02:36:47.009854+0000","last_peered":"2024-09-12T02:36:47.009854+0000","last_clean":"2024-09-12T02:36:47.009854+0000","last_became_active":"2024-09-12T02:35:00.059161+0000","last_became_peered":"2024-09-12T02:35:00.059161+0000","last_unstale":"2024-09-12T02:36:47.009854+0000","last_undegraded":"2024-09-12T02:36:47.009854+0000","last_fullsized":"2024-09-12T02:36:47.009854+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:34:59.027857+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:34:59.027857+0000","last_clean_scrub_stamp":"2024-09-12T02:34:59.027857+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:52:19.141087+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":26,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,8,3],"acting":[9,8,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"4.0","version":"0'0","reported_seq":28,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-12T02:36:47.009293+0000","last_change":"2024-09-12T02:35:12.584755+0000","last_active":"2024-09-12T02:36:47.009293+0000","last_peered":"2024-09-12T02:36:47.009293+0000","last_clean":"2024-09-12T02:36:47.009293+0000","last_became_active":"2024-09-12T02:35:12.584365+0000","last_became_peered":"2024-09-12T02:35:12.584365+0000","last_unstale":"2024-09-12T02:36:47.009293+0000","last_undegraded":"2024-09-12T02:36:47.009293+0000","last_fullsized":"2024-09-12T02:36:47.009293+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:35:11.552386+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:35:11.552386+0000","last_clean_scrub_stamp":"2024-09-12T02:35:11.552386+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:16:54.529244+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,10,0,7],"acting":[3,10,0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":35,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-12T02:36:47.064760+0000","last_change":"2024-09-12T02:35:02.507751+0000","last_active":"2024-09-12T02:36:47.064760+0000","last_peered":"2024-09-12T02:36:47.064760+0000","last_clean":"2024-09-12T02:36:47.064760+0000","last_became_active":"2024-09-12T02:35:02.507456+0000","last_became_peered":"2024-09-12T02:35:02.507456+0000","last_unstale":"2024-09-12T02:36:47.064760+0000","last_undegraded":"2024-09-12T02:36:47.064760+0000","last_fullsized":"2024-09-12T02:36:47.064760+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:35:01.470375+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:35:01.470375+0000","last_clean_scrub_stamp":"2024-09-12T02:35:01.470375+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:48:13.297422+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2,9],"acting":[6,2,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.5","version":"93'4","reported_seq":45,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-12T02:36:47.011648+0000","last_change":"2024-09-12T02:35:00.068895+0000","last_active":"2024-09-12T02:36:47.011648+0000","last_peered":"2024-09-12T02:36:47.011648+0000","last_clean":"2024-09-12T02:36:47.011648+0000","last_became_active":"2024-09-12T02:35:00.068547+0000","last_became_peered":"2024-09-12T02:35:00.068547+0000","last_unstale":"2024-09-12T02:36:47.011648+0000","last_undegraded":"2024-09-12T02:36:47.011648+0000","last_fullsized":"2024-09-12T02:36:47.011648+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:34:59.027857+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:34:59.027857+0000","last_clean_scrub_stamp":"2024-09-12T02:34:59.027857+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:31:14.305834+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":112,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":5,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,0,9],"acting":[8,0,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"4.3","version":"0'0","reported_seq":28,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-12T02:36:47.153747+0000","last_change":"2024-09-12T02:35:12.579890+0000","last_active":"2024-09-12T02:36:47.153747+0000","last_peered":"2024-09-12T02:36:47.153747+0000","last_clean":"2024-09-12T02:36:47.153747+0000","last_became_active":"2024-09-12T02:35:12.579399+0000","last_became_peered":"2024-09-12T02:35:12.579399+0000","last_unstale":"2024-09-12T02:36:47.153747+0000","last_undegraded":"2024-09-12T02:36:47.153747+0000","last_fullsized":"2024-09-12T02:36:47.153747+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:35:11.552386+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:35:11.552386+0000","last_clean_scrub_stamp":"2024-09-12T02:35:11.552386+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:48:31.564922+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,5,7,6],"acting":[11,5,7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":36,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-12T02:36:47.062753+0000","last_change":"2024-09-12T02:35:02.519590+0000","last_active":"2024-09-12T02:36:47.062753+0000","last_peered":"2024-09-12T02:36:47.062753+0000","last_clean":"2024-09-12T02:36:47.062753+0000","last_became_active":"2024-09-12T02:35:02.519244+0000","last_became_peered":"2024-09-12T02:35:02.519244+0000","last_unstale":"2024-09-12T02:36:47.062753+0000","last_undegraded":"2024-09-12T02:36:47.062753+0000","last_fullsized":"2024-09-12T02:36:47.062753+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:35:01.470375+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:35:01.470375+0000","last_clean_scrub_stamp":"2024-09-12T02:35:01.470375+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T13:52:18.415135+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,3,6],"acting":[10,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"2.4","version":"93'1","reported_seq":43,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-12T02:36:47.009801+0000","last_change":"2024-09-12T02:35:00.068931+0000","last_active":"2024-09-12T02:36:47.009801+0000","last_peered":"2024-09-12T02:36:47.009801+0000","last_clean":"2024-09-12T02:36:47.009801+0000","last_became_active":"2024-09-12T02:35:00.068217+0000","last_became_peered":"2024-09-12T02:35:00.068217+0000","last_unstale":"2024-09-12T02:36:47.009801+0000","last_undegraded":"2024-09-12T02:36:47.009801+0000","last_fullsized":"2024-09-12T02:36:47.009801+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:34:59.027857+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:34:59.027857+0000","last_clean_scrub_stamp":"2024-09-12T02:34:59.027857+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:56:25.407991+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,2,0],"acting":[9,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"4.2","version":"0'0","reported_seq":35,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-12T02:36:47.011093+0000","last_change":"2024-09-12T02:35:46.834010+0000","last_active":"2024-09-12T02:36:47.011093+0000","last_peered":"2024-09-12T02:36:47.011093+0000","last_clean":"2024-09-12T02:36:47.011093+0000","last_became_active":"2024-09-12T02:35:46.833523+0000","last_became_peered":"2024-09-12T02:35:46.833523+0000","last_unstale":"2024-09-12T02:36:47.011093+0000","last_undegraded":"2024-09-12T02:36:47.011093+0000","last_fullsized":"2024-09-12T02:36:47.011093+0000","mapping_epoch":92,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":93,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:35:11.552386+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:35:11.552386+0000","last_clean_scrub_stamp":"2024-09-12T02:35:11.552386+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:49:26.839307+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,10,11,1],"acting":[8,10,11,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":36,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-12T02:36:47.062738+0000","last_change":"2024-09-12T02:35:02.514146+0000","last_active":"2024-09-12T02:36:47.062738+0000","last_peered":"2024-09-12T02:36:47.062738+0000","last_clean":"2024-09-12T02:36:47.062738+0000","last_became_active":"2024-09-12T02:35:02.513777+0000","last_became_peered":"2024-09-12T02:35:02.513777+0000","last_unstale":"2024-09-12T02:36:47.062738+0000","last_undegraded":"2024-09-12T02:36:47.062738+0000","last_fullsized":"2024-09-12T02:36:47.062738+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:35:01.470375+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:35:01.470375+0000","last_clean_scrub_stamp":"2024-09-12T02:35:01.470375+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:33:57.554957+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,4,0],"acting":[10,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"2.2","version":"93'6","reported_seq":108,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-12T02:36:49.067654+0000","last_change":"2024-09-12T02:35:00.062893+0000","last_active":"2024-09-12T02:36:49.067654+0000","last_peered":"2024-09-12T02:36:49.067654+0000","last_clean":"2024-09-12T02:36:49.067654+0000","last_became_active":"2024-09-12T02:35:00.062547+0000","last_became_peered":"2024-09-12T02:35:00.062547+0000","last_unstale":"2024-09-12T02:36:49.067654+0000","last_undegraded":"2024-09-12T02:36:49.067654+0000","last_fullsized":"2024-09-12T02:36:49.067654+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:34:59.027857+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:34:59.027857+0000","last_clean_scrub_stamp":"2024-09-12T02:34:59.027857+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T13:40:15.098836+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":981,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":61,"num_read_kb":2,"num_write":5,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6,1],"acting":[7,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.4","version":"0'0","reported_seq":28,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-12T02:36:47.064649+0000","last_change":"2024-09-12T02:35:12.586490+0000","last_active":"2024-09-12T02:36:47.064649+0000","last_peered":"2024-09-12T02:36:47.064649+0000","last_clean":"2024-09-12T02:36:47.064649+0000","last_became_active":"2024-09-12T02:35:12.586102+0000","last_became_peered":"2024-09-12T02:35:12.586102+0000","last_unstale":"2024-09-12T02:36:47.064649+0000","last_undegraded":"2024-09-12T02:36:47.064649+0000","last_fullsized":"2024-09-12T02:36:47.064649+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:35:11.552386+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:35:11.552386+0000","last_clean_scrub_stamp":"2024-09-12T02:35:11.552386+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:43:45.543922+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0,1,8],"acting":[6,0,1,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":36,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-12T02:36:47.065329+0000","last_change":"2024-09-12T02:35:02.506726+0000","last_active":"2024-09-12T02:36:47.065329+0000","last_peered":"2024-09-12T02:36:47.065329+0000","last_clean":"2024-09-12T02:36:47.065329+0000","last_became_active":"2024-09-12T02:35:02.505693+0000","last_became_peered":"2024-09-12T02:35:02.505693+0000","last_unstale":"2024-09-12T02:36:47.065329+0000","last_undegraded":"2024-09-12T02:36:47.065329+0000","last_fullsized":"2024-09-12T02:36:47.065329+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:35:01.470375+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:35:01.470375+0000","last_clean_scrub_stamp":"2024-09-12T02:35:01.470375+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:54:51.507105+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2,4],"acting":[5,2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1","version":"93'5","reported_seq":103,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-12T02:36:47.064604+0000","last_change":"2024-09-12T02:35:00.069206+0000","last_active":"2024-09-12T02:36:47.064604+0000","last_peered":"2024-09-12T02:36:47.064604+0000","last_clean":"2024-09-12T02:36:47.064604+0000","last_became_active":"2024-09-12T02:35:00.068823+0000","last_became_peered":"2024-09-12T02:35:00.068823+0000","last_unstale":"2024-09-12T02:36:47.064604+0000","last_undegraded":"2024-09-12T02:36:47.064604+0000","last_fullsized":"2024-09-12T02:36:47.064604+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:34:59.027857+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:34:59.027857+0000","last_clean_scrub_stamp":"2024-09-12T02:34:59.027857+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:33:11.004561+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":112,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":58,"num_read_kb":58,"num_write":5,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,0],"acting":[6,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.7","version":"0'0","reported_seq":28,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-12T02:36:47.064797+0000","last_change":"2024-09-12T02:35:12.587431+0000","last_active":"2024-09-12T02:36:47.064797+0000","last_peered":"2024-09-12T02:36:47.064797+0000","last_clean":"2024-09-12T02:36:47.064797+0000","last_became_active":"2024-09-12T02:35:12.587059+0000","last_became_peered":"2024-09-12T02:35:12.587059+0000","last_unstale":"2024-09-12T02:36:47.064797+0000","last_undegraded":"2024-09-12T02:36:47.064797+0000","last_fullsized":"2024-09-12T02:36:47.064797+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:35:11.552386+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:35:11.552386+0000","last_clean_scrub_stamp":"2024-09-12T02:35:11.552386+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:51:53.335039+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5,10,0],"acting":[6,5,10,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":35,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-12T02:36:47.064206+0000","last_change":"2024-09-12T02:35:02.508475+0000","last_active":"2024-09-12T02:36:47.064206+0000","last_peered":"2024-09-12T02:36:47.064206+0000","last_clean":"2024-09-12T02:36:47.064206+0000","last_became_active":"2024-09-12T02:35:02.508183+0000","last_became_peered":"2024-09-12T02:35:02.508183+0000","last_unstale":"2024-09-12T02:36:47.064206+0000","last_undegraded":"2024-09-12T02:36:47.064206+0000","last_fullsized":"2024-09-12T02:36:47.064206+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:35:01.470375+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:35:01.470375+0000","last_clean_scrub_stamp":"2024-09-12T02:35:01.470375+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:49:09.545800+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,2],"acting":[6,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.0","version":"93'4","reported_seq":19,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-12T02:36:47.153623+0000","last_change":"2024-09-12T02:35:46.734658+0000","last_active":"2024-09-12T02:36:47.153623+0000","last_peered":"2024-09-12T02:36:47.153623+0000","last_clean":"2024-09-12T02:36:47.153623+0000","last_became_active":"2024-09-12T02:35:46.734239+0000","last_became_peered":"2024-09-12T02:35:46.734239+0000","last_unstale":"2024-09-12T02:36:47.153623+0000","last_undegraded":"2024-09-12T02:36:47.153623+0000","last_fullsized":"2024-09-12T02:36:47.153623+0000","mapping_epoch":92,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":93,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:34:59.027857+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:34:59.027857+0000","last_clean_scrub_stamp":"2024-09-12T02:34:59.027857+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:08:17.941344+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,5,8],"acting":[11,5,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"4.6","version":"0'0","reported_seq":12,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-12T02:36:47.155805+0000","last_change":"2024-09-12T02:36:47.155340+0000","last_active":"2024-09-12T02:36:47.155805+0000","last_peered":"2024-09-12T02:36:47.155805+0000","last_clean":"2024-09-12T02:36:47.155805+0000","last_became_active":"2024-09-12T02:36:47.154890+0000","last_became_peered":"2024-09-12T02:36:47.154890+0000","last_unstale":"2024-09-12T02:36:47.155805+0000","last_undegraded":"2024-09-12T02:36:47.155805+0000","last_fullsized":"2024-09-12T02:36:47.155805+0000","mapping_epoch":94,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":95,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:35:11.552386+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:35:11.552386+0000","last_clean_scrub_stamp":"2024-09-12T02:35:11.552386+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:34:06.673031+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,11,6,10],"acting":[8,11,6,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":38,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-12T02:36:47.009187+0000","last_change":"2024-09-12T02:35:02.515340+0000","last_active":"2024-09-12T02:36:47.009187+0000","last_peered":"2024-09-12T02:36:47.009187+0000","last_clean":"2024-09-12T02:36:47.009187+0000","last_became_active":"2024-09-12T02:35:02.514973+0000","last_became_peered":"2024-09-12T02:35:02.514973+0000","last_unstale":"2024-09-12T02:36:47.009187+0000","last_undegraded":"2024-09-12T02:36:47.009187+0000","last_fullsized":"2024-09-12T02:36:47.009187+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:35:01.470375+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:35:01.470375+0000","last_clean_scrub_stamp":"2024-09-12T02:35:01.470375+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:06:03.154300+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5,1],"acting":[3,5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.3","version":"93'6","reported_seq":50,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-12T02:36:47.067082+0000","last_change":"2024-09-12T02:35:00.066731+0000","last_active":"2024-09-12T02:36:47.067082+0000","last_peered":"2024-09-12T02:36:47.067082+0000","last_clean":"2024-09-12T02:36:47.067082+0000","last_became_active":"2024-09-12T02:35:00.066339+0000","last_became_peered":"2024-09-12T02:35:00.066339+0000","last_unstale":"2024-09-12T02:36:47.067082+0000","last_undegraded":"2024-09-12T02:36:47.067082+0000","last_fullsized":"2024-09-12T02:36:47.067082+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:34:59.027857+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:34:59.027857+0000","last_clean_scrub_stamp":"2024-09-12T02:34:59.027857+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:02:39.919349+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":68,"num_objects":5,"num_object_clones":0,"num_object_copies":15,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":4,"num_read_kb":4,"num_write":8,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,10,9],"acting":[4,10,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"1.0","version":"23'137","reported_seq":367,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-12T02:36:47.064547+0000","last_change":"2024-09-12T02:33:47.732241+0000","last_active":"2024-09-12T02:36:47.064547+0000","last_peered":"2024-09-12T02:36:47.064547+0000","last_clean":"2024-09-12T02:36:47.064547+0000","last_became_active":"2024-09-12T02:33:47.731872+0000","last_became_peered":"2024-09-12T02:33:47.731872+0000","last_unstale":"2024-09-12T02:36:47.064547+0000","last_undegraded":"2024-09-12T02:36:47.064547+0000","last_fullsized":"2024-09-12T02:36:47.064547+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:30:09.398092+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:30:09.398092+0000","last_clean_scrub_stamp":"2024-09-12T02:30:09.398092+0000","objects_scrubbed":0,"log_size":137,"log_dups_size":0,"ondisk_log_size":137,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:35:36.504372+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":136,"num_read_kb":119,"num_write":181,"num_write_kb":2938,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":1180736,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,10],"acting":[7,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.5","version":"93'1","reported_seq":29,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-12T02:36:47.064880+0000","last_change":"2024-09-12T02:35:12.578073+0000","last_active":"2024-09-12T02:36:47.064880+0000","last_peered":"2024-09-12T02:36:47.064880+0000","last_clean":"2024-09-12T02:36:47.064880+0000","last_became_active":"2024-09-12T02:35:12.577496+0000","last_became_peered":"2024-09-12T02:35:12.577496+0000","last_unstale":"2024-09-12T02:36:47.064880+0000","last_undegraded":"2024-09-12T02:36:47.064880+0000","last_fullsized":"2024-09-12T02:36:47.064880+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:35:11.552386+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:35:11.552386+0000","last_clean_scrub_stamp":"2024-09-12T02:35:11.552386+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:02:47.229873+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":117,"num_objects":1,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,11,9],"acting":[7,5,11,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.d","version":"0'0","reported_seq":37,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-12T02:36:47.064949+0000","last_change":"2024-09-12T02:35:02.510571+0000","last_active":"2024-09-12T02:36:47.064949+0000","last_peered":"2024-09-12T02:36:47.064949+0000","last_clean":"2024-09-12T02:36:47.064949+0000","last_became_active":"2024-09-12T02:35:02.509673+0000","last_became_peered":"2024-09-12T02:35:02.509673+0000","last_unstale":"2024-09-12T02:36:47.064949+0000","last_undegraded":"2024-09-12T02:36:47.064949+0000","last_fullsized":"2024-09-12T02:36:47.064949+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:35:01.470375+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:35:01.470375+0000","last_clean_scrub_stamp":"2024-09-12T02:35:01.470375+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:12:17.515300+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,11],"acting":[7,1,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.c","version":"93'6","reported_seq":108,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-12T02:36:47.063866+0000","last_change":"2024-09-12T02:35:00.314045+0000","last_active":"2024-09-12T02:36:47.063866+0000","last_peered":"2024-09-12T02:36:47.063866+0000","last_clean":"2024-09-12T02:36:47.063866+0000","last_became_active":"2024-09-12T02:35:00.313626+0000","last_became_peered":"2024-09-12T02:35:00.313626+0000","last_unstale":"2024-09-12T02:36:47.063866+0000","last_undegraded":"2024-09-12T02:36:47.063866+0000","last_fullsized":"2024-09-12T02:36:47.063866+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:34:59.027857+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:34:59.027857+0000","last_clean_scrub_stamp":"2024-09-12T02:34:59.027857+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:57:45.282128+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1563,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":60,"num_read_kb":3,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,11,0],"acting":[2,11,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.a","version":"0'0","reported_seq":28,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-12T02:36:47.153551+0000","last_change":"2024-09-12T02:35:12.582905+0000","last_active":"2024-09-12T02:36:47.153551+0000","last_peered":"2024-09-12T02:36:47.153551+0000","last_clean":"2024-09-12T02:36:47.153551+0000","last_became_active":"2024-09-12T02:35:12.582451+0000","last_became_peered":"2024-09-12T02:35:12.582451+0000","last_unstale":"2024-09-12T02:36:47.153551+0000","last_undegraded":"2024-09-12T02:36:47.153551+0000","last_fullsized":"2024-09-12T02:36:47.153551+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:35:11.552386+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:35:11.552386+0000","last_clean_scrub_stamp":"2024-09-12T02:35:11.552386+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:53:40.811531+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,6,7],"acting":[1,5,6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":37,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-12T02:36:47.064876+0000","last_change":"2024-09-12T02:35:02.516173+0000","last_active":"2024-09-12T02:36:47.064876+0000","last_peered":"2024-09-12T02:36:47.064876+0000","last_clean":"2024-09-12T02:36:47.064876+0000","last_became_active":"2024-09-12T02:35:02.515802+0000","last_became_peered":"2024-09-12T02:35:02.515802+0000","last_unstale":"2024-09-12T02:36:47.064876+0000","last_undegraded":"2024-09-12T02:36:47.064876+0000","last_fullsized":"2024-09-12T02:36:47.064876+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:35:01.470375+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:35:01.470375+0000","last_clean_scrub_stamp":"2024-09-12T02:35:01.470375+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:52:22.469433+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3,5],"acting":[7,3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.d","version":"93'3","reported_seq":45,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-12T02:36:47.065802+0000","last_change":"2024-09-12T02:35:00.058472+0000","last_active":"2024-09-12T02:36:47.065802+0000","last_peered":"2024-09-12T02:36:47.065802+0000","last_clean":"2024-09-12T02:36:47.065802+0000","last_became_active":"2024-09-12T02:35:00.058144+0000","last_became_peered":"2024-09-12T02:35:00.058144+0000","last_unstale":"2024-09-12T02:36:47.065802+0000","last_undegraded":"2024-09-12T02:36:47.065802+0000","last_fullsized":"2024-09-12T02:36:47.065802+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:34:59.027857+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:34:59.027857+0000","last_clean_scrub_stamp":"2024-09-12T02:34:59.027857+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:20:05.124583+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,10,3],"acting":[5,10,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.b","version":"0'0","reported_seq":26,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-12T02:36:47.585491+0000","last_change":"2024-09-12T02:35:12.592804+0000","last_active":"2024-09-12T02:36:47.585491+0000","last_peered":"2024-09-12T02:36:47.585491+0000","last_clean":"2024-09-12T02:36:47.585491+0000","last_became_active":"2024-09-12T02:35:12.592417+0000","last_became_peered":"2024-09-12T02:35:12.592417+0000","last_unstale":"2024-09-12T02:36:47.585491+0000","last_undegraded":"2024-09-12T02:36:47.585491+0000","last_fullsized":"2024-09-12T02:36:47.585491+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:35:11.552386+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:35:11.552386+0000","last_clean_scrub_stamp":"2024-09-12T02:35:11.552386+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:30:01.965989+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,9,1,4],"acting":[0,9,1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.f","version":"0'0","reported_seq":37,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-12T02:36:47.064792+0000","last_change":"2024-09-12T02:35:02.511051+0000","last_active":"2024-09-12T02:36:47.064792+0000","last_peered":"2024-09-12T02:36:47.064792+0000","last_clean":"2024-09-12T02:36:47.064792+0000","last_became_active":"2024-09-12T02:35:02.509959+0000","last_became_peered":"2024-09-12T02:35:02.509959+0000","last_unstale":"2024-09-12T02:36:47.064792+0000","last_undegraded":"2024-09-12T02:36:47.064792+0000","last_fullsized":"2024-09-12T02:36:47.064792+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:35:01.470375+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:35:01.470375+0000","last_clean_scrub_stamp":"2024-09-12T02:35:01.470375+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:03:53.757074+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,11,8],"acting":[7,11,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.e","version":"93'5","reported_seq":45,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-12T02:36:47.064778+0000","last_change":"2024-09-12T02:35:00.060428+0000","last_active":"2024-09-12T02:36:47.064778+0000","last_peered":"2024-09-12T02:36:47.064778+0000","last_clean":"2024-09-12T02:36:47.064778+0000","last_became_active":"2024-09-12T02:35:00.060026+0000","last_became_peered":"2024-09-12T02:35:00.060026+0000","last_unstale":"2024-09-12T02:36:47.064778+0000","last_undegraded":"2024-09-12T02:36:47.064778+0000","last_fullsized":"2024-09-12T02:36:47.064778+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:34:59.027857+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:34:59.027857+0000","last_clean_scrub_stamp":"2024-09-12T02:34:59.027857+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:07:25.226210+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,2],"acting":[6,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.8","version":"0'0","reported_seq":28,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-12T02:36:47.065088+0000","last_change":"2024-09-12T02:35:12.579879+0000","last_active":"2024-09-12T02:36:47.065088+0000","last_peered":"2024-09-12T02:36:47.065088+0000","last_clean":"2024-09-12T02:36:47.065088+0000","last_became_active":"2024-09-12T02:35:12.579449+0000","last_became_peered":"2024-09-12T02:35:12.579449+0000","last_unstale":"2024-09-12T02:36:47.065088+0000","last_undegraded":"2024-09-12T02:36:47.065088+0000","last_fullsized":"2024-09-12T02:36:47.065088+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:35:11.552386+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:35:11.552386+0000","last_clean_scrub_stamp":"2024-09-12T02:35:11.552386+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:55:37.280959+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2,7,1],"acting":[5,2,7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.e","version":"0'0","reported_seq":35,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-12T02:36:47.154320+0000","last_change":"2024-09-12T02:35:02.509442+0000","last_active":"2024-09-12T02:36:47.154320+0000","last_peered":"2024-09-12T02:36:47.154320+0000","last_clean":"2024-09-12T02:36:47.154320+0000","last_became_active":"2024-09-12T02:35:02.509072+0000","last_became_peered":"2024-09-12T02:35:02.509072+0000","last_unstale":"2024-09-12T02:36:47.154320+0000","last_undegraded":"2024-09-12T02:36:47.154320+0000","last_fullsized":"2024-09-12T02:36:47.154320+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:35:01.470375+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:35:01.470375+0000","last_clean_scrub_stamp":"2024-09-12T02:35:01.470375+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:39:51.913895+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,5,4],"acting":[11,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"2.f","version":"93'2","reported_seq":43,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-12T02:36:47.011563+0000","last_change":"2024-09-12T02:35:00.060908+0000","last_active":"2024-09-12T02:36:47.011563+0000","last_peered":"2024-09-12T02:36:47.011563+0000","last_clean":"2024-09-12T02:36:47.011563+0000","last_became_active":"2024-09-12T02:35:00.060539+0000","last_became_peered":"2024-09-12T02:35:00.060539+0000","last_unstale":"2024-09-12T02:36:47.011563+0000","last_undegraded":"2024-09-12T02:36:47.011563+0000","last_fullsized":"2024-09-12T02:36:47.011563+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:34:59.027857+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:34:59.027857+0000","last_clean_scrub_stamp":"2024-09-12T02:34:59.027857+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:10:18.241911+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":2,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,5,4],"acting":[8,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"4.9","version":"0'0","reported_seq":28,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-12T02:36:47.065106+0000","last_change":"2024-09-12T02:35:12.585841+0000","last_active":"2024-09-12T02:36:47.065106+0000","last_peered":"2024-09-12T02:36:47.065106+0000","last_clean":"2024-09-12T02:36:47.065106+0000","last_became_active":"2024-09-12T02:35:12.585535+0000","last_became_peered":"2024-09-12T02:35:12.585535+0000","last_unstale":"2024-09-12T02:36:47.065106+0000","last_undegraded":"2024-09-12T02:36:47.065106+0000","last_fullsized":"2024-09-12T02:36:47.065106+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:35:11.552386+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:35:11.552386+0000","last_clean_scrub_stamp":"2024-09-12T02:35:11.552386+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:55:32.595165+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0,3,1],"acting":[5,0,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":42,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-12T02:36:47.065392+0000","last_change":"2024-09-12T02:35:46.833349+0000","last_active":"2024-09-12T02:36:47.065392+0000","last_peered":"2024-09-12T02:36:47.065392+0000","last_clean":"2024-09-12T02:36:47.065392+0000","last_became_active":"2024-09-12T02:35:46.832980+0000","last_became_peered":"2024-09-12T02:35:46.832980+0000","last_unstale":"2024-09-12T02:36:47.065392+0000","last_undegraded":"2024-09-12T02:36:47.065392+0000","last_fullsized":"2024-09-12T02:36:47.065392+0000","mapping_epoch":92,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":93,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:35:01.470375+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:35:01.470375+0000","last_clean_scrub_stamp":"2024-09-12T02:35:01.470375+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:35:51.086023+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,8,1],"acting":[5,8,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.10","version":"93'17","reported_seq":35,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-12T02:36:47.153578+0000","last_change":"2024-09-12T02:35:46.743046+0000","last_active":"2024-09-12T02:36:47.153578+0000","last_peered":"2024-09-12T02:36:47.153578+0000","last_clean":"2024-09-12T02:36:47.153578+0000","last_became_active":"2024-09-12T02:35:46.736070+0000","last_became_peered":"2024-09-12T02:35:46.736070+0000","last_unstale":"2024-09-12T02:36:47.153578+0000","last_undegraded":"2024-09-12T02:36:47.153578+0000","last_fullsized":"2024-09-12T02:36:47.153578+0000","mapping_epoch":92,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":93,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:34:59.027857+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:34:59.027857+0000","last_clean_scrub_stamp":"2024-09-12T02:34:59.027857+0000","objects_scrubbed":0,"log_size":17,"log_dups_size":0,"ondisk_log_size":17,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:51:55.849111+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":112,"num_objects":8,"num_object_clones":0,"num_object_copies":24,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":20,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":6,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,0,2],"acting":[11,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"4.16","version":"0'0","reported_seq":28,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-12T02:36:47.064755+0000","last_change":"2024-09-12T02:35:12.583676+0000","last_active":"2024-09-12T02:36:47.064755+0000","last_peered":"2024-09-12T02:36:47.064755+0000","last_clean":"2024-09-12T02:36:47.064755+0000","last_became_active":"2024-09-12T02:35:12.583238+0000","last_became_peered":"2024-09-12T02:35:12.583238+0000","last_unstale":"2024-09-12T02:36:47.064755+0000","last_undegraded":"2024-09-12T02:36:47.064755+0000","last_fullsized":"2024-09-12T02:36:47.064755+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:35:11.552386+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:35:11.552386+0000","last_clean_scrub_stamp":"2024-09-12T02:35:11.552386+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:30:04.751525+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,9,11],"acting":[6,3,9,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.10","version":"0'0","reported_seq":37,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-12T02:36:47.064362+0000","last_change":"2024-09-12T02:35:02.519325+0000","last_active":"2024-09-12T02:36:47.064362+0000","last_peered":"2024-09-12T02:36:47.064362+0000","last_clean":"2024-09-12T02:36:47.064362+0000","last_became_active":"2024-09-12T02:35:02.518951+0000","last_became_peered":"2024-09-12T02:35:02.518951+0000","last_unstale":"2024-09-12T02:36:47.064362+0000","last_undegraded":"2024-09-12T02:36:47.064362+0000","last_fullsized":"2024-09-12T02:36:47.064362+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:35:01.470375+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:35:01.470375+0000","last_clean_scrub_stamp":"2024-09-12T02:35:01.470375+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:39:59.070416+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,10],"acting":[7,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.11","version":"93'6","reported_seq":107,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-12T02:36:47.067172+0000","last_change":"2024-09-12T02:35:00.061897+0000","last_active":"2024-09-12T02:36:47.067172+0000","last_peered":"2024-09-12T02:36:47.067172+0000","last_clean":"2024-09-12T02:36:47.067172+0000","last_became_active":"2024-09-12T02:35:00.060657+0000","last_became_peered":"2024-09-12T02:35:00.060657+0000","last_unstale":"2024-09-12T02:36:47.067172+0000","last_undegraded":"2024-09-12T02:36:47.067172+0000","last_fullsized":"2024-09-12T02:36:47.067172+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:34:59.027857+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:34:59.027857+0000","last_clean_scrub_stamp":"2024-09-12T02:34:59.027857+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:21:57.471691+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":981,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":61,"num_read_kb":4,"num_write":6,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7,10],"acting":[4,7,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.17","version":"0'0","reported_seq":28,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-12T02:36:47.010007+0000","last_change":"2024-09-12T02:35:12.590637+0000","last_active":"2024-09-12T02:36:47.010007+0000","last_peered":"2024-09-12T02:36:47.010007+0000","last_clean":"2024-09-12T02:36:47.010007+0000","last_became_active":"2024-09-12T02:35:12.590242+0000","last_became_peered":"2024-09-12T02:35:12.590242+0000","last_unstale":"2024-09-12T02:36:47.010007+0000","last_undegraded":"2024-09-12T02:36:47.010007+0000","last_fullsized":"2024-09-12T02:36:47.010007+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:35:11.552386+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:35:11.552386+0000","last_clean_scrub_stamp":"2024-09-12T02:35:11.552386+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:33:12.490203+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,7,0,3],"acting":[9,7,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.13","version":"0'0","reported_seq":37,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-12T02:36:47.064756+0000","last_change":"2024-09-12T02:35:02.510040+0000","last_active":"2024-09-12T02:36:47.064756+0000","last_peered":"2024-09-12T02:36:47.064756+0000","last_clean":"2024-09-12T02:36:47.064756+0000","last_became_active":"2024-09-12T02:35:02.509591+0000","last_became_peered":"2024-09-12T02:35:02.509591+0000","last_unstale":"2024-09-12T02:36:47.064756+0000","last_undegraded":"2024-09-12T02:36:47.064756+0000","last_fullsized":"2024-09-12T02:36:47.064756+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:35:01.470375+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:35:01.470375+0000","last_clean_scrub_stamp":"2024-09-12T02:35:01.470375+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:38:22.209174+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4,6],"acting":[7,4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.12","version":"93'5","reported_seq":47,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-12T02:36:47.065562+0000","last_change":"2024-09-12T02:35:00.060895+0000","last_active":"2024-09-12T02:36:47.065562+0000","last_peered":"2024-09-12T02:36:47.065562+0000","last_clean":"2024-09-12T02:36:47.065562+0000","last_became_active":"2024-09-12T02:35:00.060483+0000","last_became_peered":"2024-09-12T02:35:00.060483+0000","last_unstale":"2024-09-12T02:36:47.065562+0000","last_undegraded":"2024-09-12T02:36:47.065562+0000","last_fullsized":"2024-09-12T02:36:47.065562+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:34:59.027857+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:34:59.027857+0000","last_clean_scrub_stamp":"2024-09-12T02:34:59.027857+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T13:23:30.719311+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":5,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3,7],"acting":[5,3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.14","version":"0'0","reported_seq":28,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-12T02:36:47.153817+0000","last_change":"2024-09-12T02:35:12.579605+0000","last_active":"2024-09-12T02:36:47.153817+0000","last_peered":"2024-09-12T02:36:47.153817+0000","last_clean":"2024-09-12T02:36:47.153817+0000","last_became_active":"2024-09-12T02:35:12.579147+0000","last_became_peered":"2024-09-12T02:35:12.579147+0000","last_unstale":"2024-09-12T02:36:47.153817+0000","last_undegraded":"2024-09-12T02:36:47.153817+0000","last_fullsized":"2024-09-12T02:36:47.153817+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:35:11.552386+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:35:11.552386+0000","last_clean_scrub_stamp":"2024-09-12T02:35:11.552386+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:19:19.454816+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,9,7,6],"acting":[11,9,7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":35,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-12T02:36:47.064368+0000","last_change":"2024-09-12T02:35:02.520230+0000","last_active":"2024-09-12T02:36:47.064368+0000","last_peered":"2024-09-12T02:36:47.064368+0000","last_clean":"2024-09-12T02:36:47.064368+0000","last_became_active":"2024-09-12T02:35:02.519885+0000","last_became_peered":"2024-09-12T02:35:02.519885+0000","last_unstale":"2024-09-12T02:36:47.064368+0000","last_undegraded":"2024-09-12T02:36:47.064368+0000","last_fullsized":"2024-09-12T02:36:47.064368+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:35:01.470375+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:35:01.470375+0000","last_clean_scrub_stamp":"2024-09-12T02:35:01.470375+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:50:53.031073+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,3],"acting":[6,7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.13","version":"93'9","reported_seq":53,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-12T02:36:47.013122+0000","last_change":"2024-09-12T02:35:00.066323+0000","last_active":"2024-09-12T02:36:47.013122+0000","last_peered":"2024-09-12T02:36:47.013122+0000","last_clean":"2024-09-12T02:36:47.013122+0000","last_became_active":"2024-09-12T02:35:00.065961+0000","last_became_peered":"2024-09-12T02:35:00.065961+0000","last_unstale":"2024-09-12T02:36:47.013122+0000","last_undegraded":"2024-09-12T02:36:47.013122+0000","last_fullsized":"2024-09-12T02:36:47.013122+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:34:59.027857+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:34:59.027857+0000","last_clean_scrub_stamp":"2024-09-12T02:34:59.027857+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:07:35.660223+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":68,"num_objects":6,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":13,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,10,3],"acting":[2,10,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.15","version":"0'0","reported_seq":28,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-12T02:36:47.065537+0000","last_change":"2024-09-12T02:35:12.583133+0000","last_active":"2024-09-12T02:36:47.065537+0000","last_peered":"2024-09-12T02:36:47.065537+0000","last_clean":"2024-09-12T02:36:47.065537+0000","last_became_active":"2024-09-12T02:35:12.582716+0000","last_became_peered":"2024-09-12T02:35:12.582716+0000","last_unstale":"2024-09-12T02:36:47.065537+0000","last_undegraded":"2024-09-12T02:36:47.065537+0000","last_fullsized":"2024-09-12T02:36:47.065537+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:35:11.552386+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:35:11.552386+0000","last_clean_scrub_stamp":"2024-09-12T02:35:11.552386+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:06:51.301261+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,8,3,6],"acting":[5,8,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.15","version":"0'0","reported_seq":35,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-12T02:36:47.011448+0000","last_change":"2024-09-12T02:35:02.514078+0000","last_active":"2024-09-12T02:36:47.011448+0000","last_peered":"2024-09-12T02:36:47.011448+0000","last_clean":"2024-09-12T02:36:47.011448+0000","last_became_active":"2024-09-12T02:35:02.513692+0000","last_became_peered":"2024-09-12T02:35:02.513692+0000","last_unstale":"2024-09-12T02:36:47.011448+0000","last_undegraded":"2024-09-12T02:36:47.011448+0000","last_fullsized":"2024-09-12T02:36:47.011448+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:35:01.470375+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:35:01.470375+0000","last_clean_scrub_stamp":"2024-09-12T02:35:01.470375+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T13:16:32.968171+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,11,7],"acting":[8,11,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"2.14","version":"93'34","reported_seq":196,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-12T02:36:48.066731+0000","last_change":"2024-09-12T02:35:00.060326+0000","last_active":"2024-09-12T02:36:48.066731+0000","last_peered":"2024-09-12T02:36:48.066731+0000","last_clean":"2024-09-12T02:36:48.066731+0000","last_became_active":"2024-09-12T02:35:00.059723+0000","last_became_peered":"2024-09-12T02:35:00.059723+0000","last_unstale":"2024-09-12T02:36:48.066731+0000","last_undegraded":"2024-09-12T02:36:48.066731+0000","last_fullsized":"2024-09-12T02:36:48.066731+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:34:59.027857+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:34:59.027857+0000","last_clean_scrub_stamp":"2024-09-12T02:34:59.027857+0000","objects_scrubbed":0,"log_size":34,"log_dups_size":0,"ondisk_log_size":34,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:58:30.390130+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":62661,"num_objects":6,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":121,"num_read_kb":122,"num_write":36,"num_write_kb":76,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,1,2],"acting":[10,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"4.12","version":"0'0","reported_seq":28,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-12T02:36:47.009470+0000","last_change":"2024-09-12T02:35:12.574485+0000","last_active":"2024-09-12T02:36:47.009470+0000","last_peered":"2024-09-12T02:36:47.009470+0000","last_clean":"2024-09-12T02:36:47.009470+0000","last_became_active":"2024-09-12T02:35:12.573883+0000","last_became_peered":"2024-09-12T02:35:12.573883+0000","last_unstale":"2024-09-12T02:36:47.009470+0000","last_undegraded":"2024-09-12T02:36:47.009470+0000","last_fullsized":"2024-09-12T02:36:47.009470+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:35:11.552386+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:35:11.552386+0000","last_clean_scrub_stamp":"2024-09-12T02:35:11.552386+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:57:00.001595+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,8,11,5],"acting":[9,8,11,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.14","version":"0'0","reported_seq":37,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-12T02:36:47.153985+0000","last_change":"2024-09-12T02:35:02.505882+0000","last_active":"2024-09-12T02:36:47.153985+0000","last_peered":"2024-09-12T02:36:47.153985+0000","last_clean":"2024-09-12T02:36:47.153985+0000","last_became_active":"2024-09-12T02:35:02.504513+0000","last_became_peered":"2024-09-12T02:35:02.504513+0000","last_unstale":"2024-09-12T02:36:47.153985+0000","last_undegraded":"2024-09-12T02:36:47.153985+0000","last_fullsized":"2024-09-12T02:36:47.153985+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:35:01.470375+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:35:01.470375+0000","last_clean_scrub_stamp":"2024-09-12T02:35:01.470375+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:25:58.446843+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,8,4],"acting":[1,8,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.15","version":"93'5","reported_seq":47,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-12T02:36:47.065797+0000","last_change":"2024-09-12T02:35:00.068581+0000","last_active":"2024-09-12T02:36:47.065797+0000","last_peered":"2024-09-12T02:36:47.065797+0000","last_clean":"2024-09-12T02:36:47.065797+0000","last_became_active":"2024-09-12T02:35:00.068196+0000","last_became_peered":"2024-09-12T02:35:00.068196+0000","last_unstale":"2024-09-12T02:36:47.065797+0000","last_undegraded":"2024-09-12T02:36:47.065797+0000","last_fullsized":"2024-09-12T02:36:47.065797+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:34:59.027857+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:34:59.027857+0000","last_clean_scrub_stamp":"2024-09-12T02:34:59.027857+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:02:27.807799+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":672,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":7,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0,10],"acting":[5,0,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.13","version":"0'0","reported_seq":28,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-12T02:36:47.066933+0000","last_change":"2024-09-12T02:35:12.592600+0000","last_active":"2024-09-12T02:36:47.066933+0000","last_peered":"2024-09-12T02:36:47.066933+0000","last_clean":"2024-09-12T02:36:47.066933+0000","last_became_active":"2024-09-12T02:35:12.591976+0000","last_became_peered":"2024-09-12T02:35:12.591976+0000","last_unstale":"2024-09-12T02:36:47.066933+0000","last_undegraded":"2024-09-12T02:36:47.066933+0000","last_fullsized":"2024-09-12T02:36:47.066933+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:35:11.552386+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:35:11.552386+0000","last_clean_scrub_stamp":"2024-09-12T02:35:11.552386+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T14:23:23.077090+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1,2,9],"acting":[4,1,2,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":34,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-12T02:36:47.585853+0000","last_change":"2024-09-12T02:35:02.523261+0000","last_active":"2024-09-12T02:36:47.585853+0000","last_peered":"2024-09-12T02:36:47.585853+0000","last_clean":"2024-09-12T02:36:47.585853+0000","last_became_active":"2024-09-12T02:35:02.522919+0000","last_became_peered":"2024-09-12T02:35:02.522919+0000","last_unstale":"2024-09-12T02:36:47.585853+0000","last_undegraded":"2024-09-12T02:36:47.585853+0000","last_fullsized":"2024-09-12T02:36:47.585853+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:35:01.470375+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:35:01.470375+0000","last_clean_scrub_stamp":"2024-09-12T02:35:01.470375+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:51:54.774700+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4,5],"acting":[0,4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.16","version":"93'4","reported_seq":45,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-12T02:36:47.064954+0000","last_change":"2024-09-12T02:35:00.061316+0000","last_active":"2024-09-12T02:36:47.064954+0000","last_peered":"2024-09-12T02:36:47.064954+0000","last_clean":"2024-09-12T02:36:47.064954+0000","last_became_active":"2024-09-12T02:35:00.059753+0000","last_became_peered":"2024-09-12T02:35:00.059753+0000","last_unstale":"2024-09-12T02:36:47.064954+0000","last_undegraded":"2024-09-12T02:36:47.064954+0000","last_fullsized":"2024-09-12T02:36:47.064954+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:34:59.027857+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:34:59.027857+0000","last_clean_scrub_stamp":"2024-09-12T02:34:59.027857+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:43:15.836929+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,2],"acting":[7,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.10","version":"0'0","reported_seq":28,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-12T02:36:47.008562+0000","last_change":"2024-09-12T02:35:12.587080+0000","last_active":"2024-09-12T02:36:47.008562+0000","last_peered":"2024-09-12T02:36:47.008562+0000","last_clean":"2024-09-12T02:36:47.008562+0000","last_became_active":"2024-09-12T02:35:12.586322+0000","last_became_peered":"2024-09-12T02:35:12.586322+0000","last_unstale":"2024-09-12T02:36:47.008562+0000","last_undegraded":"2024-09-12T02:36:47.008562+0000","last_fullsized":"2024-09-12T02:36:47.008562+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:35:11.552386+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:35:11.552386+0000","last_clean_scrub_stamp":"2024-09-12T02:35:11.552386+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T13:37:00.736698+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,0,2,4],"acting":[9,0,2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":37,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-12T02:36:47.153997+0000","last_change":"2024-09-12T02:35:02.510240+0000","last_active":"2024-09-12T02:36:47.153997+0000","last_peered":"2024-09-12T02:36:47.153997+0000","last_clean":"2024-09-12T02:36:47.153997+0000","last_became_active":"2024-09-12T02:35:02.509909+0000","last_became_peered":"2024-09-12T02:35:02.509909+0000","last_unstale":"2024-09-12T02:36:47.153997+0000","last_undegraded":"2024-09-12T02:36:47.153997+0000","last_fullsized":"2024-09-12T02:36:47.153997+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:35:01.470375+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:35:01.470375+0000","last_clean_scrub_stamp":"2024-09-12T02:35:01.470375+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:27:09.070786+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,10,9],"acting":[1,10,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.17","version":"93'4","reported_seq":159,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-12T02:36:48.064840+0000","last_change":"2024-09-12T02:35:00.054193+0000","last_active":"2024-09-12T02:36:48.064840+0000","last_peered":"2024-09-12T02:36:48.064840+0000","last_clean":"2024-09-12T02:36:48.064840+0000","last_became_active":"2024-09-12T02:35:00.053811+0000","last_became_peered":"2024-09-12T02:35:00.053811+0000","last_unstale":"2024-09-12T02:36:48.064840+0000","last_undegraded":"2024-09-12T02:36:48.064840+0000","last_fullsized":"2024-09-12T02:36:48.064840+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:34:59.027857+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:34:59.027857+0000","last_clean_scrub_stamp":"2024-09-12T02:34:59.027857+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:49:30.618015+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":180,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":114,"num_read_kb":114,"num_write":5,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,5,9],"acting":[10,5,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"4.11","version":"0'0","reported_seq":28,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-12T02:36:47.008973+0000","last_change":"2024-09-12T02:35:12.579772+0000","last_active":"2024-09-12T02:36:47.008973+0000","last_peered":"2024-09-12T02:36:47.008973+0000","last_clean":"2024-09-12T02:36:47.008973+0000","last_became_active":"2024-09-12T02:35:12.579257+0000","last_became_peered":"2024-09-12T02:35:12.579257+0000","last_unstale":"2024-09-12T02:36:47.008973+0000","last_undegraded":"2024-09-12T02:36:47.008973+0000","last_fullsized":"2024-09-12T02:36:47.008973+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:35:11.552386+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:35:11.552386+0000","last_clean_scrub_stamp":"2024-09-12T02:35:11.552386+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:08:40.588248+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,1,5],"acting":[3,7,1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1e","version":"0'0","reported_seq":26,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-12T02:36:47.585875+0000","last_change":"2024-09-12T02:35:12.585212+0000","last_active":"2024-09-12T02:36:47.585875+0000","last_peered":"2024-09-12T02:36:47.585875+0000","last_clean":"2024-09-12T02:36:47.585875+0000","last_became_active":"2024-09-12T02:35:12.583272+0000","last_became_peered":"2024-09-12T02:35:12.583272+0000","last_unstale":"2024-09-12T02:36:47.585875+0000","last_undegraded":"2024-09-12T02:36:47.585875+0000","last_fullsized":"2024-09-12T02:36:47.585875+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:35:11.552386+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:35:11.552386+0000","last_clean_scrub_stamp":"2024-09-12T02:35:11.552386+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:03:28.264565+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7,6,1],"acting":[0,7,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":38,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-12T02:36:47.009066+0000","last_change":"2024-09-12T02:35:02.512310+0000","last_active":"2024-09-12T02:36:47.009066+0000","last_peered":"2024-09-12T02:36:47.009066+0000","last_clean":"2024-09-12T02:36:47.009066+0000","last_became_active":"2024-09-12T02:35:02.511969+0000","last_became_peered":"2024-09-12T02:35:02.511969+0000","last_unstale":"2024-09-12T02:36:47.009066+0000","last_undegraded":"2024-09-12T02:36:47.009066+0000","last_fullsized":"2024-09-12T02:36:47.009066+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:35:01.470375+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:35:01.470375+0000","last_clean_scrub_stamp":"2024-09-12T02:35:01.470375+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:57:13.437331+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,3,10],"acting":[9,3,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"2.18","version":"93'3","reported_seq":45,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-12T02:36:47.065505+0000","last_change":"2024-09-12T02:35:00.059989+0000","last_active":"2024-09-12T02:36:47.065505+0000","last_peered":"2024-09-12T02:36:47.065505+0000","last_clean":"2024-09-12T02:36:47.065505+0000","last_became_active":"2024-09-12T02:35:00.059659+0000","last_became_peered":"2024-09-12T02:35:00.059659+0000","last_unstale":"2024-09-12T02:36:47.065505+0000","last_undegraded":"2024-09-12T02:36:47.065505+0000","last_fullsized":"2024-09-12T02:36:47.065505+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:34:59.027857+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:34:59.027857+0000","last_clean_scrub_stamp":"2024-09-12T02:34:59.027857+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:19:37.650136+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1,7],"acting":[5,1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1f","version":"0'0","reported_seq":28,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-12T02:36:47.153982+0000","last_change":"2024-09-12T02:35:12.589003+0000","last_active":"2024-09-12T02:36:47.153982+0000","last_peered":"2024-09-12T02:36:47.153982+0000","last_clean":"2024-09-12T02:36:47.153982+0000","last_became_active":"2024-09-12T02:35:12.588526+0000","last_became_peered":"2024-09-12T02:35:12.588526+0000","last_unstale":"2024-09-12T02:36:47.153982+0000","last_undegraded":"2024-09-12T02:36:47.153982+0000","last_fullsized":"2024-09-12T02:36:47.153982+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:35:11.552386+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:35:11.552386+0000","last_clean_scrub_stamp":"2024-09-12T02:35:11.552386+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T13:33:04.109195+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,4,9,0],"acting":[11,4,9,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":38,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-12T02:36:47.009494+0000","last_change":"2024-09-12T02:35:02.509603+0000","last_active":"2024-09-12T02:36:47.009494+0000","last_peered":"2024-09-12T02:36:47.009494+0000","last_clean":"2024-09-12T02:36:47.009494+0000","last_became_active":"2024-09-12T02:35:02.507799+0000","last_became_peered":"2024-09-12T02:35:02.507799+0000","last_unstale":"2024-09-12T02:36:47.009494+0000","last_undegraded":"2024-09-12T02:36:47.009494+0000","last_fullsized":"2024-09-12T02:36:47.009494+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:35:01.470375+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:35:01.470375+0000","last_clean_scrub_stamp":"2024-09-12T02:35:01.470375+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:27:06.148877+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,11,6],"acting":[3,11,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.19","version":"93'3","reported_seq":43,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-12T02:36:47.064216+0000","last_change":"2024-09-12T02:35:00.065183+0000","last_active":"2024-09-12T02:36:47.064216+0000","last_peered":"2024-09-12T02:36:47.064216+0000","last_clean":"2024-09-12T02:36:47.064216+0000","last_became_active":"2024-09-12T02:35:00.064234+0000","last_became_peered":"2024-09-12T02:35:00.064234+0000","last_unstale":"2024-09-12T02:36:47.064216+0000","last_undegraded":"2024-09-12T02:36:47.064216+0000","last_fullsized":"2024-09-12T02:36:47.064216+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:34:59.027857+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:34:59.027857+0000","last_clean_scrub_stamp":"2024-09-12T02:34:59.027857+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:25:27.578117+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,9],"acting":[6,4,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.1a","version":"93'7","reported_seq":48,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-12T02:36:47.063009+0000","last_change":"2024-09-12T02:35:00.061590+0000","last_active":"2024-09-12T02:36:47.063009+0000","last_peered":"2024-09-12T02:36:47.063009+0000","last_clean":"2024-09-12T02:36:47.063009+0000","last_became_active":"2024-09-12T02:35:00.061266+0000","last_became_peered":"2024-09-12T02:35:00.061266+0000","last_unstale":"2024-09-12T02:36:47.063009+0000","last_undegraded":"2024-09-12T02:36:47.063009+0000","last_fullsized":"2024-09-12T02:36:47.063009+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:34:59.027857+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:34:59.027857+0000","last_clean_scrub_stamp":"2024-09-12T02:34:59.027857+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:46:39.137050+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":9,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,8,6],"acting":[10,8,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.1b","version":"0'0","reported_seq":36,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-12T02:36:47.065292+0000","last_change":"2024-09-12T02:35:02.508064+0000","last_active":"2024-09-12T02:36:47.065292+0000","last_peered":"2024-09-12T02:36:47.065292+0000","last_clean":"2024-09-12T02:36:47.065292+0000","last_became_active":"2024-09-12T02:35:02.507737+0000","last_became_peered":"2024-09-12T02:35:02.507737+0000","last_unstale":"2024-09-12T02:36:47.065292+0000","last_undegraded":"2024-09-12T02:36:47.065292+0000","last_fullsized":"2024-09-12T02:36:47.065292+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:35:01.470375+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:35:01.470375+0000","last_clean_scrub_stamp":"2024-09-12T02:35:01.470375+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:39:53.655575+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,3],"acting":[5,4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1c","version":"0'0","reported_seq":28,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-12T02:36:47.013134+0000","last_change":"2024-09-12T02:35:12.588770+0000","last_active":"2024-09-12T02:36:47.013134+0000","last_peered":"2024-09-12T02:36:47.013134+0000","last_clean":"2024-09-12T02:36:47.013134+0000","last_became_active":"2024-09-12T02:35:12.588104+0000","last_became_peered":"2024-09-12T02:35:12.588104+0000","last_unstale":"2024-09-12T02:36:47.013134+0000","last_undegraded":"2024-09-12T02:36:47.013134+0000","last_fullsized":"2024-09-12T02:36:47.013134+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:35:11.552386+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:35:11.552386+0000","last_clean_scrub_stamp":"2024-09-12T02:35:11.552386+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:31:05.068737+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6,9,5],"acting":[2,6,9,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1b","version":"93'5","reported_seq":111,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-12T02:36:47.066025+0000","last_change":"2024-09-12T02:35:46.834966+0000","last_active":"2024-09-12T02:36:47.066025+0000","last_peered":"2024-09-12T02:36:47.066025+0000","last_clean":"2024-09-12T02:36:47.066025+0000","last_became_active":"2024-09-12T02:35:46.834652+0000","last_became_peered":"2024-09-12T02:35:46.834652+0000","last_unstale":"2024-09-12T02:36:47.066025+0000","last_undegraded":"2024-09-12T02:36:47.066025+0000","last_fullsized":"2024-09-12T02:36:47.066025+0000","mapping_epoch":92,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":93,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:34:59.027857+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:34:59.027857+0000","last_clean_scrub_stamp":"2024-09-12T02:34:59.027857+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:10:48.506122+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":622,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":59,"num_read_kb":2,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,7],"acting":[5,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.1a","version":"0'0","reported_seq":35,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-12T02:36:47.011185+0000","last_change":"2024-09-12T02:35:02.507569+0000","last_active":"2024-09-12T02:36:47.011185+0000","last_peered":"2024-09-12T02:36:47.011185+0000","last_clean":"2024-09-12T02:36:47.011185+0000","last_became_active":"2024-09-12T02:35:02.507244+0000","last_became_peered":"2024-09-12T02:35:02.507244+0000","last_unstale":"2024-09-12T02:36:47.011185+0000","last_undegraded":"2024-09-12T02:36:47.011185+0000","last_fullsized":"2024-09-12T02:36:47.011185+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:35:01.470375+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:35:01.470375+0000","last_clean_scrub_stamp":"2024-09-12T02:35:01.470375+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:50:26.959314+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,9,5],"acting":[8,9,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"4.1d","version":"0'0","reported_seq":28,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-12T02:36:47.013418+0000","last_change":"2024-09-12T02:35:12.577997+0000","last_active":"2024-09-12T02:36:47.013418+0000","last_peered":"2024-09-12T02:36:47.013418+0000","last_clean":"2024-09-12T02:36:47.013418+0000","last_became_active":"2024-09-12T02:35:12.577577+0000","last_became_peered":"2024-09-12T02:35:12.577577+0000","last_unstale":"2024-09-12T02:36:47.013418+0000","last_undegraded":"2024-09-12T02:36:47.013418+0000","last_fullsized":"2024-09-12T02:36:47.013418+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:35:11.552386+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:35:11.552386+0000","last_clean_scrub_stamp":"2024-09-12T02:35:11.552386+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:33:51.562986+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5,7,11],"acting":[2,5,7,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.20","version":"0'0","reported_seq":35,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-12T02:36:47.153793+0000","last_change":"2024-09-12T02:35:02.509328+0000","last_active":"2024-09-12T02:36:47.153793+0000","last_peered":"2024-09-12T02:36:47.153793+0000","last_clean":"2024-09-12T02:36:47.153793+0000","last_became_active":"2024-09-12T02:35:02.509000+0000","last_became_peered":"2024-09-12T02:35:02.509000+0000","last_unstale":"2024-09-12T02:36:47.153793+0000","last_undegraded":"2024-09-12T02:36:47.153793+0000","last_fullsized":"2024-09-12T02:36:47.153793+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:35:01.470375+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:35:01.470375+0000","last_clean_scrub_stamp":"2024-09-12T02:35:01.470375+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:46:49.170900+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,2,5],"acting":[11,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.21","version":"0'0","reported_seq":38,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-12T02:36:47.013799+0000","last_change":"2024-09-12T02:35:02.515252+0000","last_active":"2024-09-12T02:36:47.013799+0000","last_peered":"2024-09-12T02:36:47.013799+0000","last_clean":"2024-09-12T02:36:47.013799+0000","last_became_active":"2024-09-12T02:35:02.514959+0000","last_became_peered":"2024-09-12T02:35:02.514959+0000","last_unstale":"2024-09-12T02:36:47.013799+0000","last_undegraded":"2024-09-12T02:36:47.013799+0000","last_fullsized":"2024-09-12T02:36:47.013799+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:35:01.470375+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:35:01.470375+0000","last_clean_scrub_stamp":"2024-09-12T02:35:01.470375+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:42:02.769604+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5,4],"acting":[2,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.22","version":"0'0","reported_seq":38,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-12T02:36:47.012980+0000","last_change":"2024-09-12T02:35:02.516334+0000","last_active":"2024-09-12T02:36:47.012980+0000","last_peered":"2024-09-12T02:36:47.012980+0000","last_clean":"2024-09-12T02:36:47.012980+0000","last_became_active":"2024-09-12T02:35:02.515949+0000","last_became_peered":"2024-09-12T02:35:02.515949+0000","last_unstale":"2024-09-12T02:36:47.012980+0000","last_undegraded":"2024-09-12T02:36:47.012980+0000","last_fullsized":"2024-09-12T02:36:47.012980+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:35:01.470375+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:35:01.470375+0000","last_clean_scrub_stamp":"2024-09-12T02:35:01.470375+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:41:00.677038+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0],"acting":[2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.23","version":"0'0","reported_seq":34,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-12T02:36:47.585549+0000","last_change":"2024-09-12T02:35:02.516701+0000","last_active":"2024-09-12T02:36:47.585549+0000","last_peered":"2024-09-12T02:36:47.585549+0000","last_clean":"2024-09-12T02:36:47.585549+0000","last_became_active":"2024-09-12T02:35:02.516384+0000","last_became_peered":"2024-09-12T02:35:02.516384+0000","last_unstale":"2024-09-12T02:36:47.585549+0000","last_undegraded":"2024-09-12T02:36:47.585549+0000","last_fullsized":"2024-09-12T02:36:47.585549+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:35:01.470375+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:35:01.470375+0000","last_clean_scrub_stamp":"2024-09-12T02:35:01.470375+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:11:43.591371+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6,4],"acting":[0,6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.24","version":"0'0","reported_seq":41,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-12T02:36:47.064713+0000","last_change":"2024-09-12T02:35:46.737445+0000","last_active":"2024-09-12T02:36:47.064713+0000","last_peered":"2024-09-12T02:36:47.064713+0000","last_clean":"2024-09-12T02:36:47.064713+0000","last_became_active":"2024-09-12T02:35:46.736786+0000","last_became_peered":"2024-09-12T02:35:46.736786+0000","last_unstale":"2024-09-12T02:36:47.064713+0000","last_undegraded":"2024-09-12T02:36:47.064713+0000","last_fullsized":"2024-09-12T02:36:47.064713+0000","mapping_epoch":92,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":93,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:35:01.470375+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:35:01.470375+0000","last_clean_scrub_stamp":"2024-09-12T02:35:01.470375+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:25:54.143479+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,9,0],"acting":[6,9,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.25","version":"0'0","reported_seq":35,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-12T02:36:47.154119+0000","last_change":"2024-09-12T02:35:02.508237+0000","last_active":"2024-09-12T02:36:47.154119+0000","last_peered":"2024-09-12T02:36:47.154119+0000","last_clean":"2024-09-12T02:36:47.154119+0000","last_became_active":"2024-09-12T02:35:02.507911+0000","last_became_peered":"2024-09-12T02:35:02.507911+0000","last_unstale":"2024-09-12T02:36:47.154119+0000","last_undegraded":"2024-09-12T02:36:47.154119+0000","last_fullsized":"2024-09-12T02:36:47.154119+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:35:01.470375+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:35:01.470375+0000","last_clean_scrub_stamp":"2024-09-12T02:35:01.470375+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T13:13:38.863684+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,8,5],"acting":[11,8,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.26","version":"0'0","reported_seq":38,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-12T02:36:47.013729+0000","last_change":"2024-09-12T02:35:02.511218+0000","last_active":"2024-09-12T02:36:47.013729+0000","last_peered":"2024-09-12T02:36:47.013729+0000","last_clean":"2024-09-12T02:36:47.013729+0000","last_became_active":"2024-09-12T02:35:02.510533+0000","last_became_peered":"2024-09-12T02:35:02.510533+0000","last_unstale":"2024-09-12T02:36:47.013729+0000","last_undegraded":"2024-09-12T02:36:47.013729+0000","last_fullsized":"2024-09-12T02:36:47.013729+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:35:01.470375+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:35:01.470375+0000","last_clean_scrub_stamp":"2024-09-12T02:35:01.470375+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:16:00.293407+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,8,1],"acting":[2,8,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.27","version":"0'0","reported_seq":38,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-12T02:36:47.010544+0000","last_change":"2024-09-12T02:35:02.512531+0000","last_active":"2024-09-12T02:36:47.010544+0000","last_peered":"2024-09-12T02:36:47.010544+0000","last_clean":"2024-09-12T02:36:47.010544+0000","last_became_active":"2024-09-12T02:35:02.509796+0000","last_became_peered":"2024-09-12T02:35:02.509796+0000","last_unstale":"2024-09-12T02:36:47.010544+0000","last_undegraded":"2024-09-12T02:36:47.010544+0000","last_fullsized":"2024-09-12T02:36:47.010544+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:35:01.470375+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:35:01.470375+0000","last_clean_scrub_stamp":"2024-09-12T02:35:01.470375+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:56:42.613776+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4,2],"acting":[3,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.28","version":"0'0","reported_seq":36,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-12T02:36:47.065172+0000","last_change":"2024-09-12T02:35:02.507891+0000","last_active":"2024-09-12T02:36:47.065172+0000","last_peered":"2024-09-12T02:36:47.065172+0000","last_clean":"2024-09-12T02:36:47.065172+0000","last_became_active":"2024-09-12T02:35:02.507548+0000","last_became_peered":"2024-09-12T02:35:02.507548+0000","last_unstale":"2024-09-12T02:36:47.065172+0000","last_undegraded":"2024-09-12T02:36:47.065172+0000","last_fullsized":"2024-09-12T02:36:47.065172+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:35:01.470375+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:35:01.470375+0000","last_clean_scrub_stamp":"2024-09-12T02:35:01.470375+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:35:12.386932+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,9,3],"acting":[5,9,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.29","version":"0'0","reported_seq":38,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-12T02:36:47.009141+0000","last_change":"2024-09-12T02:35:02.518093+0000","last_active":"2024-09-12T02:36:47.009141+0000","last_peered":"2024-09-12T02:36:47.009141+0000","last_clean":"2024-09-12T02:36:47.009141+0000","last_became_active":"2024-09-12T02:35:02.512045+0000","last_became_peered":"2024-09-12T02:35:02.512045+0000","last_unstale":"2024-09-12T02:36:47.009141+0000","last_undegraded":"2024-09-12T02:36:47.009141+0000","last_fullsized":"2024-09-12T02:36:47.009141+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:35:01.470375+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:35:01.470375+0000","last_clean_scrub_stamp":"2024-09-12T02:35:01.470375+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:06:35.765876+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,11],"acting":[3,2,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2a","version":"0'0","reported_seq":37,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-12T02:36:47.153863+0000","last_change":"2024-09-12T02:35:02.516522+0000","last_active":"2024-09-12T02:36:47.153863+0000","last_peered":"2024-09-12T02:36:47.153863+0000","last_clean":"2024-09-12T02:36:47.153863+0000","last_became_active":"2024-09-12T02:35:02.516178+0000","last_became_peered":"2024-09-12T02:35:02.516178+0000","last_unstale":"2024-09-12T02:36:47.153863+0000","last_undegraded":"2024-09-12T02:36:47.153863+0000","last_fullsized":"2024-09-12T02:36:47.153863+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:35:01.470375+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:35:01.470375+0000","last_clean_scrub_stamp":"2024-09-12T02:35:01.470375+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:00:01.397055+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7,3],"acting":[1,7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2b","version":"0'0","reported_seq":35,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-12T02:36:47.064588+0000","last_change":"2024-09-12T02:35:02.513095+0000","last_active":"2024-09-12T02:36:47.064588+0000","last_peered":"2024-09-12T02:36:47.064588+0000","last_clean":"2024-09-12T02:36:47.064588+0000","last_became_active":"2024-09-12T02:35:02.512782+0000","last_became_peered":"2024-09-12T02:35:02.512782+0000","last_unstale":"2024-09-12T02:36:47.064588+0000","last_undegraded":"2024-09-12T02:36:47.064588+0000","last_fullsized":"2024-09-12T02:36:47.064588+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:35:01.470375+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:35:01.470375+0000","last_clean_scrub_stamp":"2024-09-12T02:35:01.470375+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:19:05.954874+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,0],"acting":[6,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.2c","version":"0'0","reported_seq":35,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-12T02:36:47.153818+0000","last_change":"2024-09-12T02:35:02.503773+0000","last_active":"2024-09-12T02:36:47.153818+0000","last_peered":"2024-09-12T02:36:47.153818+0000","last_clean":"2024-09-12T02:36:47.153818+0000","last_became_active":"2024-09-12T02:35:02.503386+0000","last_became_peered":"2024-09-12T02:35:02.503386+0000","last_unstale":"2024-09-12T02:36:47.153818+0000","last_undegraded":"2024-09-12T02:36:47.153818+0000","last_fullsized":"2024-09-12T02:36:47.153818+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:35:01.470375+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:35:01.470375+0000","last_clean_scrub_stamp":"2024-09-12T02:35:01.470375+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:15:44.995245+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,4,8],"acting":[11,4,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.2d","version":"0'0","reported_seq":38,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-12T02:36:47.013711+0000","last_change":"2024-09-12T02:35:02.516429+0000","last_active":"2024-09-12T02:36:47.013711+0000","last_peered":"2024-09-12T02:36:47.013711+0000","last_clean":"2024-09-12T02:36:47.013711+0000","last_became_active":"2024-09-12T02:35:02.515907+0000","last_became_peered":"2024-09-12T02:35:02.515907+0000","last_unstale":"2024-09-12T02:36:47.013711+0000","last_undegraded":"2024-09-12T02:36:47.013711+0000","last_fullsized":"2024-09-12T02:36:47.013711+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:35:01.470375+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:35:01.470375+0000","last_clean_scrub_stamp":"2024-09-12T02:35:01.470375+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:30:04.631809+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,6],"acting":[2,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2e","version":"0'0","reported_seq":38,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-12T02:36:47.009837+0000","last_change":"2024-09-12T02:35:02.505181+0000","last_active":"2024-09-12T02:36:47.009837+0000","last_peered":"2024-09-12T02:36:47.009837+0000","last_clean":"2024-09-12T02:36:47.009837+0000","last_became_active":"2024-09-12T02:35:02.504824+0000","last_became_peered":"2024-09-12T02:35:02.504824+0000","last_unstale":"2024-09-12T02:36:47.009837+0000","last_undegraded":"2024-09-12T02:36:47.009837+0000","last_fullsized":"2024-09-12T02:36:47.009837+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:35:01.470375+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:35:01.470375+0000","last_clean_scrub_stamp":"2024-09-12T02:35:01.470375+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T14:00:57.800731+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,1,10],"acting":[9,1,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.2f","version":"0'0","reported_seq":35,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-12T02:36:47.154257+0000","last_change":"2024-09-12T02:35:02.520568+0000","last_active":"2024-09-12T02:36:47.154257+0000","last_peered":"2024-09-12T02:36:47.154257+0000","last_clean":"2024-09-12T02:36:47.154257+0000","last_became_active":"2024-09-12T02:35:02.520244+0000","last_became_peered":"2024-09-12T02:35:02.520244+0000","last_unstale":"2024-09-12T02:36:47.154257+0000","last_undegraded":"2024-09-12T02:36:47.154257+0000","last_fullsized":"2024-09-12T02:36:47.154257+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:35:01.470375+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:35:01.470375+0000","last_clean_scrub_stamp":"2024-09-12T02:35:01.470375+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:42:25.130404+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,1,0],"acting":[11,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.30","version":"0'0","reported_seq":37,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-12T02:36:47.153407+0000","last_change":"2024-09-12T02:35:02.514647+0000","last_active":"2024-09-12T02:36:47.153407+0000","last_peered":"2024-09-12T02:36:47.153407+0000","last_clean":"2024-09-12T02:36:47.153407+0000","last_became_active":"2024-09-12T02:35:02.513930+0000","last_became_peered":"2024-09-12T02:35:02.513930+0000","last_unstale":"2024-09-12T02:36:47.153407+0000","last_undegraded":"2024-09-12T02:36:47.153407+0000","last_fullsized":"2024-09-12T02:36:47.153407+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:35:01.470375+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:35:01.470375+0000","last_clean_scrub_stamp":"2024-09-12T02:35:01.470375+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:56:32.701937+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7,0],"acting":[1,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.31","version":"0'0","reported_seq":34,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-12T02:36:47.585502+0000","last_change":"2024-09-12T02:35:02.512230+0000","last_active":"2024-09-12T02:36:47.585502+0000","last_peered":"2024-09-12T02:36:47.585502+0000","last_clean":"2024-09-12T02:36:47.585502+0000","last_became_active":"2024-09-12T02:35:02.508114+0000","last_became_peered":"2024-09-12T02:35:02.508114+0000","last_unstale":"2024-09-12T02:36:47.585502+0000","last_undegraded":"2024-09-12T02:36:47.585502+0000","last_fullsized":"2024-09-12T02:36:47.585502+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:35:01.470375+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:35:01.470375+0000","last_clean_scrub_stamp":"2024-09-12T02:35:01.470375+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:37:53.225043+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4,2],"acting":[0,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.32","version":"0'0","reported_seq":34,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-12T02:36:47.585602+0000","last_change":"2024-09-12T02:35:02.519176+0000","last_active":"2024-09-12T02:36:47.585602+0000","last_peered":"2024-09-12T02:36:47.585602+0000","last_clean":"2024-09-12T02:36:47.585602+0000","last_became_active":"2024-09-12T02:35:02.518437+0000","last_became_peered":"2024-09-12T02:35:02.518437+0000","last_unstale":"2024-09-12T02:36:47.585602+0000","last_undegraded":"2024-09-12T02:36:47.585602+0000","last_fullsized":"2024-09-12T02:36:47.585602+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:35:01.470375+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:35:01.470375+0000","last_clean_scrub_stamp":"2024-09-12T02:35:01.470375+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:46:32.198479+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,8,10],"acting":[0,8,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.33","version":"0'0","reported_seq":41,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-12T02:36:47.064541+0000","last_change":"2024-09-12T02:35:46.759182+0000","last_active":"2024-09-12T02:36:47.064541+0000","last_peered":"2024-09-12T02:36:47.064541+0000","last_clean":"2024-09-12T02:36:47.064541+0000","last_became_active":"2024-09-12T02:35:46.758619+0000","last_became_peered":"2024-09-12T02:35:46.758619+0000","last_unstale":"2024-09-12T02:36:47.064541+0000","last_undegraded":"2024-09-12T02:36:47.064541+0000","last_fullsized":"2024-09-12T02:36:47.064541+0000","mapping_epoch":92,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":93,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:35:01.470375+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:35:01.470375+0000","last_clean_scrub_stamp":"2024-09-12T02:35:01.470375+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:35:55.039970+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,10,9],"acting":[6,10,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.34","version":"0'0","reported_seq":15,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-12T02:36:47.009570+0000","last_change":"2024-09-12T02:35:46.758945+0000","last_active":"2024-09-12T02:36:47.009570+0000","last_peered":"2024-09-12T02:36:47.009570+0000","last_clean":"2024-09-12T02:36:47.009570+0000","last_became_active":"2024-09-12T02:35:46.758522+0000","last_became_peered":"2024-09-12T02:35:46.758522+0000","last_unstale":"2024-09-12T02:36:47.009570+0000","last_undegraded":"2024-09-12T02:36:47.009570+0000","last_fullsized":"2024-09-12T02:36:47.009570+0000","mapping_epoch":92,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":93,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:35:01.470375+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:35:01.470375+0000","last_clean_scrub_stamp":"2024-09-12T02:35:01.470375+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:18:47.916784+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,10,8],"acting":[9,10,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.35","version":"0'0","reported_seq":37,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-12T02:36:47.064868+0000","last_change":"2024-09-12T02:35:02.511777+0000","last_active":"2024-09-12T02:36:47.064868+0000","last_peered":"2024-09-12T02:36:47.064868+0000","last_clean":"2024-09-12T02:36:47.064868+0000","last_became_active":"2024-09-12T02:35:02.511341+0000","last_became_peered":"2024-09-12T02:35:02.511341+0000","last_unstale":"2024-09-12T02:36:47.064868+0000","last_undegraded":"2024-09-12T02:36:47.064868+0000","last_fullsized":"2024-09-12T02:36:47.064868+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:35:01.470375+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:35:01.470375+0000","last_clean_scrub_stamp":"2024-09-12T02:35:01.470375+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:51:52.093252+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,8,1],"acting":[7,8,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.36","version":"0'0","reported_seq":36,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-12T02:36:47.063286+0000","last_change":"2024-09-12T02:35:02.510278+0000","last_active":"2024-09-12T02:36:47.063286+0000","last_peered":"2024-09-12T02:36:47.063286+0000","last_clean":"2024-09-12T02:36:47.063286+0000","last_became_active":"2024-09-12T02:35:02.509959+0000","last_became_peered":"2024-09-12T02:35:02.509959+0000","last_unstale":"2024-09-12T02:36:47.063286+0000","last_undegraded":"2024-09-12T02:36:47.063286+0000","last_fullsized":"2024-09-12T02:36:47.063286+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:35:01.470375+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:35:01.470375+0000","last_clean_scrub_stamp":"2024-09-12T02:35:01.470375+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:34:55.086493+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,2,4],"acting":[10,2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.37","version":"0'0","reported_seq":37,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-12T02:36:47.153929+0000","last_change":"2024-09-12T02:35:02.508143+0000","last_active":"2024-09-12T02:36:47.153929+0000","last_peered":"2024-09-12T02:36:47.153929+0000","last_clean":"2024-09-12T02:36:47.153929+0000","last_became_active":"2024-09-12T02:35:02.507096+0000","last_became_peered":"2024-09-12T02:35:02.507096+0000","last_unstale":"2024-09-12T02:36:47.153929+0000","last_undegraded":"2024-09-12T02:36:47.153929+0000","last_fullsized":"2024-09-12T02:36:47.153929+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:35:01.470375+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:35:01.470375+0000","last_clean_scrub_stamp":"2024-09-12T02:35:01.470375+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:04:15.687448+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,11],"acting":[1,5,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.38","version":"0'0","reported_seq":38,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-12T02:36:47.009441+0000","last_change":"2024-09-12T02:35:02.517013+0000","last_active":"2024-09-12T02:36:47.009441+0000","last_peered":"2024-09-12T02:36:47.009441+0000","last_clean":"2024-09-12T02:36:47.009441+0000","last_became_active":"2024-09-12T02:35:02.511344+0000","last_became_peered":"2024-09-12T02:35:02.511344+0000","last_unstale":"2024-09-12T02:36:47.009441+0000","last_undegraded":"2024-09-12T02:36:47.009441+0000","last_fullsized":"2024-09-12T02:36:47.009441+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:35:01.470375+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:35:01.470375+0000","last_clean_scrub_stamp":"2024-09-12T02:35:01.470375+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:35:56.829248+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5,10],"acting":[3,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.39","version":"0'0","reported_seq":37,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-12T02:36:47.064445+0000","last_change":"2024-09-12T02:35:02.515221+0000","last_active":"2024-09-12T02:36:47.064445+0000","last_peered":"2024-09-12T02:36:47.064445+0000","last_clean":"2024-09-12T02:36:47.064445+0000","last_became_active":"2024-09-12T02:35:02.514878+0000","last_became_peered":"2024-09-12T02:35:02.514878+0000","last_unstale":"2024-09-12T02:36:47.064445+0000","last_undegraded":"2024-09-12T02:36:47.064445+0000","last_fullsized":"2024-09-12T02:36:47.064445+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:35:01.470375+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:35:01.470375+0000","last_clean_scrub_stamp":"2024-09-12T02:35:01.470375+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:30:49.794740+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,9,5],"acting":[7,9,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3a","version":"0'0","reported_seq":36,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-12T02:36:47.062543+0000","last_change":"2024-09-12T02:35:02.506118+0000","last_active":"2024-09-12T02:36:47.062543+0000","last_peered":"2024-09-12T02:36:47.062543+0000","last_clean":"2024-09-12T02:36:47.062543+0000","last_became_active":"2024-09-12T02:35:02.505802+0000","last_became_peered":"2024-09-12T02:35:02.505802+0000","last_unstale":"2024-09-12T02:36:47.062543+0000","last_undegraded":"2024-09-12T02:36:47.062543+0000","last_fullsized":"2024-09-12T02:36:47.062543+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:35:01.470375+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:35:01.470375+0000","last_clean_scrub_stamp":"2024-09-12T02:35:01.470375+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:39:29.295096+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,9,4],"acting":[10,9,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.3b","version":"0'0","reported_seq":35,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-12T02:36:47.011164+0000","last_change":"2024-09-12T02:35:02.514743+0000","last_active":"2024-09-12T02:36:47.011164+0000","last_peered":"2024-09-12T02:36:47.011164+0000","last_clean":"2024-09-12T02:36:47.011164+0000","last_became_active":"2024-09-12T02:35:02.514299+0000","last_became_peered":"2024-09-12T02:35:02.514299+0000","last_unstale":"2024-09-12T02:36:47.011164+0000","last_undegraded":"2024-09-12T02:36:47.011164+0000","last_fullsized":"2024-09-12T02:36:47.011164+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:35:01.470375+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:35:01.470375+0000","last_clean_scrub_stamp":"2024-09-12T02:35:01.470375+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T13:31:30.632444+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,3,6],"acting":[8,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.3c","version":"0'0","reported_seq":36,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-12T02:36:47.066975+0000","last_change":"2024-09-12T02:35:02.504682+0000","last_active":"2024-09-12T02:36:47.066975+0000","last_peered":"2024-09-12T02:36:47.066975+0000","last_clean":"2024-09-12T02:36:47.066975+0000","last_became_active":"2024-09-12T02:35:02.504154+0000","last_became_peered":"2024-09-12T02:35:02.504154+0000","last_unstale":"2024-09-12T02:36:47.066975+0000","last_undegraded":"2024-09-12T02:36:47.066975+0000","last_fullsized":"2024-09-12T02:36:47.066975+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:35:01.470375+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:35:01.470375+0000","last_clean_scrub_stamp":"2024-09-12T02:35:01.470375+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:46:38.038655+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,8,2],"acting":[4,8,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.3d","version":"0'0","reported_seq":34,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-12T02:36:47.585827+0000","last_change":"2024-09-12T02:35:02.513117+0000","last_active":"2024-09-12T02:36:47.585827+0000","last_peered":"2024-09-12T02:36:47.585827+0000","last_clean":"2024-09-12T02:36:47.585827+0000","last_became_active":"2024-09-12T02:35:02.512824+0000","last_became_peered":"2024-09-12T02:35:02.512824+0000","last_unstale":"2024-09-12T02:36:47.585827+0000","last_undegraded":"2024-09-12T02:36:47.585827+0000","last_fullsized":"2024-09-12T02:36:47.585827+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:35:01.470375+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:35:01.470375+0000","last_clean_scrub_stamp":"2024-09-12T02:35:01.470375+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:18:22.413221+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,1],"acting":[0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3e","version":"0'0","reported_seq":34,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-12T02:36:47.586109+0000","last_change":"2024-09-12T02:35:02.517799+0000","last_active":"2024-09-12T02:36:47.586109+0000","last_peered":"2024-09-12T02:36:47.586109+0000","last_clean":"2024-09-12T02:36:47.586109+0000","last_became_active":"2024-09-12T02:35:02.513361+0000","last_became_peered":"2024-09-12T02:35:02.513361+0000","last_unstale":"2024-09-12T02:36:47.586109+0000","last_undegraded":"2024-09-12T02:36:47.586109+0000","last_fullsized":"2024-09-12T02:36:47.586109+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:35:01.470375+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:35:01.470375+0000","last_clean_scrub_stamp":"2024-09-12T02:35:01.470375+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T13:39:37.894677+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,11,10],"acting":[0,11,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3f","version":"0'0","reported_seq":35,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-12T02:36:47.154213+0000","last_change":"2024-09-12T02:35:02.520715+0000","last_active":"2024-09-12T02:36:47.154213+0000","last_peered":"2024-09-12T02:36:47.154213+0000","last_clean":"2024-09-12T02:36:47.154213+0000","last_became_active":"2024-09-12T02:35:02.520348+0000","last_became_peered":"2024-09-12T02:35:02.520348+0000","last_unstale":"2024-09-12T02:36:47.154213+0000","last_undegraded":"2024-09-12T02:36:47.154213+0000","last_fullsized":"2024-09-12T02:36:47.154213+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:35:01.470375+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:35:01.470375+0000","last_clean_scrub_stamp":"2024-09-12T02:35:01.470375+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:08:10.982486+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,1,0],"acting":[11,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]}],"pool_stats":[{"poolid":4,"num_pg":32,"stat_sum":{"num_bytes":234,"num_objects":2,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":32768,"data_stored":32768,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":2,"ondisk_log_size":2,"up":128,"acting":128,"num_store_stats":12},{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":192,"acting":192,"num_store_stats":12},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":70262,"num_objects":98,"num_object_clones":0,"num_object_copies":294,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":98,"num_whiteouts":0,"num_read":613,"num_read_kb":384,"num_write":248,"num_write_kb":142,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":5,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":66,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":577536,"data_stored":210786,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":214,"ondisk_log_size":214,"up":96,"acting":96,"num_store_stats":12},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":136,"num_read_kb":119,"num_write":181,"num_write_kb":2938,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":1180736,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":3563520,"data_stored":3542208,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":137,"ondisk_log_size":137,"up":3,"acting":3,"num_store_stats":8}],"osd_stats":[{"osd":11,"up_from":77,"seq":330712481827,"num_pgs":29,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":28112,"kb_used_data":1080,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717040,"statfs":{"total":95995035648,"available":95966248960,"internally_reserved":0,"allocated":1105920,"data_stored":545559,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1596,"internal_metadata":27654596},"hb_peers":[0,1,2,4,5,6,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":10,"up_from":70,"seq":300647710760,"num_pgs":32,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":28784,"kb_used_data":1752,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93716368,"statfs":{"total":95995035648,"available":95965560832,"internally_reserved":0,"allocated":1794048,"data_stored":1194924,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1600,"internal_metadata":27654592},"hb_peers":[0,1,2,3,4,5,6,8,9,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":9,"up_from":65,"seq":279172874285,"num_pgs":36,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":28132,"kb_used_data":1100,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717020,"statfs":{"total":95995035648,"available":95966228480,"internally_reserved":0,"allocated":1126400,"data_stored":549080,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1600,"internal_metadata":27654592},"hb_peers":[0,1,2,3,4,5,7,8,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":8,"up_from":57,"seq":244813135923,"num_pgs":30,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":28112,"kb_used_data":1084,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717040,"statfs":{"total":95995035648,"available":95966248960,"internally_reserved":0,"allocated":1110016,"data_stored":545250,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4,5,6,7,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":7,"up_from":50,"seq":214748364856,"num_pgs":36,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":28704,"kb_used_data":1676,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93716448,"statfs":{"total":95995035648,"available":95965642752,"internally_reserved":0,"allocated":1716224,"data_stored":1142254,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":27654602},"hb_peers":[1,2,3,4,5,6,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":6,"up_from":45,"seq":193273528381,"num_pgs":32,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":28100,"kb_used_data":1072,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717052,"statfs":{"total":95995035648,"available":95966261248,"internally_reserved":0,"allocated":1097728,"data_stored":540881,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,5,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":5,"up_from":38,"seq":163208757315,"num_pgs":44,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":28716,"kb_used_data":1684,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93716436,"statfs":{"total":95995035648,"available":95965630464,"internally_reserved":0,"allocated":1724416,"data_stored":1137050,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":4,"up_from":33,"seq":141733920841,"num_pgs":35,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":36440,"kb_used_data":1088,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":93708712,"statfs":{"total":95995035648,"available":95957721088,"internally_reserved":0,"allocated":1114112,"data_stored":545577,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":36174277},"hb_peers":[1,2,3,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":3,"up_from":26,"seq":111669149774,"num_pgs":40,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":32272,"kb_used_data":1084,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":93712880,"statfs":{"total":95995035648,"available":95961989120,"internally_reserved":0,"allocated":1110016,"data_stored":540196,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":31914439},"hb_peers":[0,1,2,4,5,6,7,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":18,"seq":77309411412,"num_pgs":35,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":28180,"kb_used_data":1152,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93716972,"statfs":{"total":95995035648,"available":95966179328,"internally_reserved":0,"allocated":1179648,"data_stored":604170,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,3,4,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":13,"seq":55834574937,"num_pgs":35,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":28168,"kb_used_data":1140,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93716984,"statfs":{"total":95995035648,"available":95966191616,"internally_reserved":0,"allocated":1167360,"data_stored":604572,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,2,3,4,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":8,"seq":34359738460,"num_pgs":35,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":32268,"kb_used_data":1080,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":93712884,"statfs":{"total":95995035648,"available":95961993216,"internally_reserved":0,"allocated":1105920,"data_stored":532992,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[1,2,3,4,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":40960,"data_stored":2571,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":86016,"data_stored":64806,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":98304,"data_stored":64404,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":28672,"data_stored":430,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":28672,"data_stored":1715,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":45056,"data_stored":2820,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":1115,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":32768,"data_stored":3928,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":24576,"data_stored":1388,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":9,"total":0,"available":0,"internally_reserved":0,"allocated":36864,"data_stored":1122,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":118784,"data_stored":64790,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":11,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":1697,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":9,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":11,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":4096,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":4096,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":8192,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":4096,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":9,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":8192,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":11,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":4096,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-12T02:36:55.780 DEBUG:teuthology.orchestra.run.smithi039:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc shell --fsid 4954ed46-70ae-11ef-bcea-c7b262605968 -- ceph pg dump --format=json 2024-09-12T02:36:56.160 INFO:teuthology.orchestra.run.smithi039.stderr:Inferring config /var/lib/ceph/4954ed46-70ae-11ef-bcea-c7b262605968/mon.a/config 2024-09-12T02:36:56.299 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 02:36:56 smithi039 ceph-mon[30515]: pgmap v360: 129 pgs: 129 active+clean; 645 KiB data, 348 MiB used, 1.0 TiB / 1.0 TiB avail; 5.7 KiB/s rd, 10 op/s 2024-09-12T02:36:56.448 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 12 02:36:56 smithi044 ceph-mon[35411]: pgmap v360: 129 pgs: 129 active+clean; 645 KiB data, 348 MiB used, 1.0 TiB / 1.0 TiB avail; 5.7 KiB/s rd, 10 op/s 2024-09-12T02:36:56.513 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 12 02:36:56 smithi172 ceph-mon[35609]: pgmap v360: 129 pgs: 129 active+clean; 645 KiB data, 348 MiB used, 1.0 TiB / 1.0 TiB avail; 5.7 KiB/s rd, 10 op/s 2024-09-12T02:36:56.766 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:36:56.765+0000 7f30a5a00640 1 -- 172.21.15.39:0/3933313215 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f30a0104010 msgr2=0x7f30a01043f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:36:56.767 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:36:56.765+0000 7f30a5a00640 1 --2- 172.21.15.39:0/3933313215 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f30a0104010 0x7f30a01043f0 secure :-1 s=READY pgs=223 cs=0 l=1 rev1=1 crypto rx=0x7f3090009900 tx=0x7f309002a3f0 comp rx=0 tx=0).stop 2024-09-12T02:36:56.767 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:36:56.765+0000 7f30a5a00640 1 -- 172.21.15.39:0/3933313215 shutdown_connections 2024-09-12T02:36:56.767 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:36:56.765+0000 7f30a5a00640 1 --2- 172.21.15.39:0/3933313215 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f30a0109140 0x7f30a0110cc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:36:56.767 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:36:56.765+0000 7f30a5a00640 1 --2- 172.21.15.39:0/3933313215 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f30a01049c0 0x7f30a0108a10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:36:56.767 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:36:56.765+0000 7f30a5a00640 1 --2- 172.21.15.39:0/3933313215 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f30a0104010 0x7f30a01043f0 unknown :-1 s=CLOSED pgs=223 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:36:56.767 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:36:56.765+0000 7f30a5a00640 1 -- 172.21.15.39:0/3933313215 >> 172.21.15.39:0/3933313215 conn(0x7f30a00ffa50 msgr2=0x7f30a0101e70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:36:56.767 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:36:56.765+0000 7f30a5a00640 1 -- 172.21.15.39:0/3933313215 shutdown_connections 2024-09-12T02:36:56.767 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:36:56.765+0000 7f30a5a00640 1 -- 172.21.15.39:0/3933313215 wait complete. 2024-09-12T02:36:56.768 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:36:56.766+0000 7f30a5a00640 1 Processor -- start 2024-09-12T02:36:56.769 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:36:56.766+0000 7f30a5a00640 1 -- start start 2024-09-12T02:36:56.769 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:36:56.767+0000 7f30a5a00640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f30a0104010 0x7f30a019a620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:36:56.769 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:36:56.767+0000 7f30a5a00640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f30a01049c0 0x7f30a019ab60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:36:56.769 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:36:56.767+0000 7f30a5a00640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f30a0109140 0x7f30a019eef0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:36:56.769 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:36:56.767+0000 7f30a5a00640 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 -- 0x7f30a0114160 con 0x7f30a01049c0 2024-09-12T02:36:56.769 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:36:56.767+0000 7f30a5a00640 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x7f30a0113fe0 con 0x7f30a0104010 2024-09-12T02:36:56.769 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:36:56.767+0000 7f30a5a00640 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7f30a01142e0 con 0x7f30a0109140 2024-09-12T02:36:56.769 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:36:56.767+0000 7f309e000640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f30a01049c0 0x7f30a019ab60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:36:56.769 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:36:56.767+0000 7f309ea00640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f30a0104010 0x7f30a019a620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:36:56.769 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:36:56.767+0000 7f309ea00640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f30a0104010 0x7f30a019a620 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.39:47692/0 (socket says 172.21.15.39:47692) 2024-09-12T02:36:56.769 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:36:56.767+0000 7f309ea00640 1 -- 172.21.15.39:0/1950026394 learned_addr learned my addr 172.21.15.39:0/1950026394 (peer_addr_for_me v2:172.21.15.39:0/0) 2024-09-12T02:36:56.769 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:36:56.767+0000 7f309f400640 1 --2- 172.21.15.39:0/1950026394 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f30a0109140 0x7f30a019eef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:36:56.770 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:36:56.768+0000 7f309ea00640 1 -- 172.21.15.39:0/1950026394 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f30a0109140 msgr2=0x7f30a019eef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:36:56.770 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:36:56.768+0000 7f309ea00640 1 --2- 172.21.15.39:0/1950026394 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f30a0109140 0x7f30a019eef0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:36:56.770 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:36:56.768+0000 7f309ea00640 1 -- 172.21.15.39:0/1950026394 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f30a01049c0 msgr2=0x7f30a019ab60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:36:56.770 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:36:56.768+0000 7f309ea00640 1 --2- 172.21.15.39:0/1950026394 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f30a01049c0 0x7f30a019ab60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:36:56.770 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:36:56.768+0000 7f309ea00640 1 -- 172.21.15.39:0/1950026394 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f30a019f5d0 con 0x7f30a0104010 2024-09-12T02:36:56.770 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:36:56.768+0000 7f309e000640 1 --2- 172.21.15.39:0/1950026394 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f30a01049c0 0x7f30a019ab60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-12T02:36:56.770 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:36:56.768+0000 7f309ea00640 1 --2- 172.21.15.39:0/1950026394 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f30a0104010 0x7f30a019a620 secure :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0x7f3090006010 tx=0x7f3090004040 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:36:56.771 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:36:56.768+0000 7f3097400640 1 -- 172.21.15.39:0/1950026394 <== mon.2 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f309003f030 con 0x7f30a0104010 2024-09-12T02:36:56.771 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:36:56.768+0000 7f30a5a00640 1 -- 172.21.15.39:0/1950026394 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f30a019f860 con 0x7f30a0104010 2024-09-12T02:36:56.771 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:36:56.768+0000 7f3097400640 1 -- 172.21.15.39:0/1950026394 <== mon.2 v2:172.21.15.44:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f3090004440 con 0x7f30a0104010 2024-09-12T02:36:56.771 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:36:56.768+0000 7f30a5a00640 1 -- 172.21.15.39:0/1950026394 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f30a01a71a0 con 0x7f30a0104010 2024-09-12T02:36:56.771 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:36:56.769+0000 7f3097400640 1 -- 172.21.15.39:0/1950026394 <== mon.2 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3090035070 con 0x7f30a0104010 2024-09-12T02:36:56.771 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:36:56.770+0000 7f30a5a00640 1 -- 172.21.15.39:0/1950026394 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f30a01043f0 con 0x7f30a0104010 2024-09-12T02:36:56.772 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:36:56.772+0000 7f3097400640 1 -- 172.21.15.39:0/1950026394 <== mon.2 v2:172.21.15.44:3300/0 4 ==== mgrmap(e 17) ==== 137884+0+0 (secure 0 0 0) 0x7f309004c060 con 0x7f30a0104010 2024-09-12T02:36:56.774 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:36:56.773+0000 7f3097400640 1 --2- 172.21.15.39:0/1950026394 >> [v2:172.21.15.39:6800/1725006999,v1:172.21.15.39:6801/1725006999] conn(0x7f30840a2c90 0x7f30840a5150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:36:56.774 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:36:56.773+0000 7f3097400640 1 -- 172.21.15.39:0/1950026394 <== mon.2 v2:172.21.15.44:3300/0 5 ==== osd_map(95..95 src has 1..95) ==== 9129+0+0 (secure 0 0 0) 0x7f309004a070 con 0x7f30a0104010 2024-09-12T02:36:56.774 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:36:56.773+0000 7f309e000640 1 --2- 172.21.15.39:0/1950026394 >> [v2:172.21.15.39:6800/1725006999,v1:172.21.15.39:6801/1725006999] conn(0x7f30840a2c90 0x7f30840a5150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:36:56.775 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:36:56.774+0000 7f309e000640 1 --2- 172.21.15.39:0/1950026394 >> [v2:172.21.15.39:6800/1725006999,v1:172.21.15.39:6801/1725006999] conn(0x7f30840a2c90 0x7f30840a5150 secure :-1 s=READY pgs=204 cs=0 l=1 rev1=1 crypto rx=0x7f30a00ffe70 tx=0x7f308c005f90 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:36:56.776 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:36:56.775+0000 7f3097400640 1 -- 172.21.15.39:0/1950026394 <== mon.2 v2:172.21.15.44:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7f30900bbe30 con 0x7f30a0104010 2024-09-12T02:36:56.956 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:36:56.955+0000 7f30a5a00640 1 -- 172.21.15.39:0/1950026394 --> [v2:172.21.15.39:6800/1725006999,v1:172.21.15.39:6801/1725006999] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7f30a0062630 con 0x7f30840a2c90 2024-09-12T02:36:56.965 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:36:56.964+0000 7f3097400640 1 -- 172.21.15.39:0/1950026394 <== mgr.14150 v2:172.21.15.39:6800/1725006999 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+340396 (secure 0 0 0) 0x7f30a0062630 con 0x7f30840a2c90 2024-09-12T02:36:56.969 INFO:teuthology.orchestra.run.smithi039.stdout: 2024-09-12T02:36:56.970 INFO:teuthology.orchestra.run.smithi039.stderr:dumped all 2024-09-12T02:36:56.972 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:36:56.969+0000 7f30a5a00640 1 -- 172.21.15.39:0/1950026394 >> [v2:172.21.15.39:6800/1725006999,v1:172.21.15.39:6801/1725006999] conn(0x7f30840a2c90 msgr2=0x7f30840a5150 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:36:56.972 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:36:56.969+0000 7f30a5a00640 1 --2- 172.21.15.39:0/1950026394 >> [v2:172.21.15.39:6800/1725006999,v1:172.21.15.39:6801/1725006999] conn(0x7f30840a2c90 0x7f30840a5150 secure :-1 s=READY pgs=204 cs=0 l=1 rev1=1 crypto rx=0x7f30a00ffe70 tx=0x7f308c005f90 comp rx=0 tx=0).stop 2024-09-12T02:36:56.973 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:36:56.969+0000 7f30a5a00640 1 -- 172.21.15.39:0/1950026394 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f30a0104010 msgr2=0x7f30a019a620 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:36:56.973 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:36:56.969+0000 7f30a5a00640 1 --2- 172.21.15.39:0/1950026394 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f30a0104010 0x7f30a019a620 secure :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0x7f3090006010 tx=0x7f3090004040 comp rx=0 tx=0).stop 2024-09-12T02:36:56.973 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:36:56.969+0000 7f30a5a00640 1 -- 172.21.15.39:0/1950026394 shutdown_connections 2024-09-12T02:36:56.973 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:36:56.969+0000 7f30a5a00640 1 --2- 172.21.15.39:0/1950026394 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f30a0109140 0x7f30a019eef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:36:56.973 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:36:56.969+0000 7f30a5a00640 1 --2- 172.21.15.39:0/1950026394 >> [v2:172.21.15.39:6800/1725006999,v1:172.21.15.39:6801/1725006999] conn(0x7f30840a2c90 0x7f30840a5150 unknown :-1 s=CLOSED pgs=204 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:36:56.973 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:36:56.969+0000 7f30a5a00640 1 --2- 172.21.15.39:0/1950026394 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f30a01049c0 0x7f30a019ab60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:36:56.973 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:36:56.969+0000 7f30a5a00640 1 --2- 172.21.15.39:0/1950026394 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f30a0104010 0x7f30a019a620 unknown :-1 s=CLOSED pgs=100 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:36:56.973 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:36:56.969+0000 7f30a5a00640 1 -- 172.21.15.39:0/1950026394 >> 172.21.15.39:0/1950026394 conn(0x7f30a00ffa50 msgr2=0x7f30a0100e10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:36:56.973 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:36:56.969+0000 7f30a5a00640 1 -- 172.21.15.39:0/1950026394 shutdown_connections 2024-09-12T02:36:56.973 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:36:56.969+0000 7f30a5a00640 1 -- 172.21.15.39:0/1950026394 wait complete. 2024-09-12T02:36:57.872 INFO:teuthology.orchestra.run.smithi039.stdout:{"pg_ready":true,"pg_map":{"version":361,"stamp":"2024-09-12T02:36:56.839813+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":660864,"num_objects":102,"num_object_clones":0,"num_object_copies":308,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":102,"num_whiteouts":0,"num_read":799,"num_read_kb":528,"num_write":431,"num_write_kb":3082,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":9,"num_bytes_recovered":1180736,"num_keys_recovered":0,"num_objects_omap":66,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":353,"ondisk_log_size":353,"up":419,"acting":419,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":419,"num_osds":12,"num_per_pool_osds":12,"num_per_pool_omap_osds":12,"kb":1124941824,"kb_used":356004,"kb_used_data":15008,"kb_used_omap":18,"kb_used_meta":340717,"kb_avail":1124585820,"statfs":{"total":1151940427776,"available":1151575879680,"internally_reserved":0,"allocated":15368192,"data_stored":8491850,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":19143,"internal_metadata":348894521},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":100,"num_read_kb":50,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"10.002597"},"pg_stats":[{"pgid":"2.1f","version":"93'13","reported_seq":119,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-12T02:36:53.072408+0000","last_change":"2024-09-12T02:35:00.062996+0000","last_active":"2024-09-12T02:36:53.072408+0000","last_peered":"2024-09-12T02:36:53.072408+0000","last_clean":"2024-09-12T02:36:53.072408+0000","last_became_active":"2024-09-12T02:35:00.062670+0000","last_became_peered":"2024-09-12T02:35:00.062670+0000","last_unstale":"2024-09-12T02:36:53.072408+0000","last_undegraded":"2024-09-12T02:36:53.072408+0000","last_fullsized":"2024-09-12T02:36:53.072408+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:34:59.027857+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:34:59.027857+0000","last_clean_scrub_stamp":"2024-09-12T02:34:59.027857+0000","objects_scrubbed":0,"log_size":13,"log_dups_size":0,"ondisk_log_size":13,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:08:38.434465+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":672,"num_objects":6,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":64,"num_read_kb":64,"num_write":14,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,7,8],"acting":[9,7,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.1e","version":"0'0","reported_seq":38,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-12T02:36:47.010296+0000","last_change":"2024-09-12T02:35:02.518880+0000","last_active":"2024-09-12T02:36:47.010296+0000","last_peered":"2024-09-12T02:36:47.010296+0000","last_clean":"2024-09-12T02:36:47.010296+0000","last_became_active":"2024-09-12T02:35:02.516137+0000","last_became_peered":"2024-09-12T02:35:02.516137+0000","last_unstale":"2024-09-12T02:36:47.010296+0000","last_undegraded":"2024-09-12T02:36:47.010296+0000","last_fullsized":"2024-09-12T02:36:47.010296+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:35:01.470375+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:35:01.470375+0000","last_clean_scrub_stamp":"2024-09-12T02:35:01.470375+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T13:23:04.313584+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,5],"acting":[3,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.19","version":"0'0","reported_seq":35,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-12T02:36:47.586823+0000","last_change":"2024-09-12T02:36:47.586823+0000","last_active":"2024-09-12T02:36:47.586823+0000","last_peered":"2024-09-12T02:36:47.586823+0000","last_clean":"2024-09-12T02:36:47.586823+0000","last_became_active":"2024-09-12T02:36:47.586394+0000","last_became_peered":"2024-09-12T02:36:47.586394+0000","last_unstale":"2024-09-12T02:36:47.586823+0000","last_undegraded":"2024-09-12T02:36:47.586823+0000","last_fullsized":"2024-09-12T02:36:47.586823+0000","mapping_epoch":94,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":95,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:35:11.552386+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:35:11.552386+0000","last_clean_scrub_stamp":"2024-09-12T02:35:11.552386+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:22:51.284546+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,8,0],"acting":[2,3,8,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1e","version":"93'2","reported_seq":44,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-12T02:36:47.010488+0000","last_change":"2024-09-12T02:35:00.068606+0000","last_active":"2024-09-12T02:36:47.010488+0000","last_peered":"2024-09-12T02:36:47.010488+0000","last_clean":"2024-09-12T02:36:47.010488+0000","last_became_active":"2024-09-12T02:35:00.068243+0000","last_became_peered":"2024-09-12T02:35:00.068243+0000","last_unstale":"2024-09-12T02:36:47.010488+0000","last_undegraded":"2024-09-12T02:36:47.010488+0000","last_fullsized":"2024-09-12T02:36:47.010488+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:34:59.027857+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:34:59.027857+0000","last_clean_scrub_stamp":"2024-09-12T02:34:59.027857+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:19:41.463728+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,5],"acting":[3,0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1f","version":"0'0","reported_seq":34,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-12T02:36:47.585723+0000","last_change":"2024-09-12T02:35:02.525485+0000","last_active":"2024-09-12T02:36:47.585723+0000","last_peered":"2024-09-12T02:36:47.585723+0000","last_clean":"2024-09-12T02:36:47.585723+0000","last_became_active":"2024-09-12T02:35:02.525111+0000","last_became_peered":"2024-09-12T02:35:02.525111+0000","last_unstale":"2024-09-12T02:36:47.585723+0000","last_undegraded":"2024-09-12T02:36:47.585723+0000","last_fullsized":"2024-09-12T02:36:47.585723+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:35:01.470375+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:35:01.470375+0000","last_clean_scrub_stamp":"2024-09-12T02:35:01.470375+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:37:25.329762+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,9],"acting":[0,1,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.18","version":"0'0","reported_seq":28,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-12T02:36:47.066540+0000","last_change":"2024-09-12T02:35:12.591057+0000","last_active":"2024-09-12T02:36:47.066540+0000","last_peered":"2024-09-12T02:36:47.066540+0000","last_clean":"2024-09-12T02:36:47.066540+0000","last_became_active":"2024-09-12T02:35:12.590606+0000","last_became_peered":"2024-09-12T02:35:12.590606+0000","last_unstale":"2024-09-12T02:36:47.066540+0000","last_undegraded":"2024-09-12T02:36:47.066540+0000","last_fullsized":"2024-09-12T02:36:47.066540+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:35:11.552386+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:35:11.552386+0000","last_clean_scrub_stamp":"2024-09-12T02:35:11.552386+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:44:06.007603+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6,9,3],"acting":[4,6,9,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1d","version":"93'12","reported_seq":53,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-12T02:36:47.011607+0000","last_change":"2024-09-12T02:35:00.064090+0000","last_active":"2024-09-12T02:36:47.011607+0000","last_peered":"2024-09-12T02:36:47.011607+0000","last_clean":"2024-09-12T02:36:47.011607+0000","last_became_active":"2024-09-12T02:35:00.063688+0000","last_became_peered":"2024-09-12T02:35:00.063688+0000","last_unstale":"2024-09-12T02:36:47.011607+0000","last_undegraded":"2024-09-12T02:36:47.011607+0000","last_fullsized":"2024-09-12T02:36:47.011607+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:34:59.027857+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:34:59.027857+0000","last_clean_scrub_stamp":"2024-09-12T02:34:59.027857+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:27:30.117990+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":7,"num_object_clones":0,"num_object_copies":21,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":16,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":7,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,2,7],"acting":[8,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.1c","version":"0'0","reported_seq":37,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-12T02:36:47.153737+0000","last_change":"2024-09-12T02:35:02.510882+0000","last_active":"2024-09-12T02:36:47.153737+0000","last_peered":"2024-09-12T02:36:47.153737+0000","last_clean":"2024-09-12T02:36:47.153737+0000","last_became_active":"2024-09-12T02:35:02.510513+0000","last_became_peered":"2024-09-12T02:35:02.510513+0000","last_unstale":"2024-09-12T02:36:47.153737+0000","last_undegraded":"2024-09-12T02:36:47.153737+0000","last_fullsized":"2024-09-12T02:36:47.153737+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:35:01.470375+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:35:01.470375+0000","last_clean_scrub_stamp":"2024-09-12T02:35:01.470375+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:21:40.527379+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,10,6],"acting":[1,10,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1b","version":"0'0","reported_seq":28,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-12T02:36:47.066838+0000","last_change":"2024-09-12T02:35:12.590704+0000","last_active":"2024-09-12T02:36:47.066838+0000","last_peered":"2024-09-12T02:36:47.066838+0000","last_clean":"2024-09-12T02:36:47.066838+0000","last_became_active":"2024-09-12T02:35:12.590217+0000","last_became_peered":"2024-09-12T02:35:12.590217+0000","last_unstale":"2024-09-12T02:36:47.066838+0000","last_undegraded":"2024-09-12T02:36:47.066838+0000","last_fullsized":"2024-09-12T02:36:47.066838+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:35:11.552386+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:35:11.552386+0000","last_clean_scrub_stamp":"2024-09-12T02:35:11.552386+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:21:47.370860+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,9,5],"acting":[4,3,9,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1c","version":"93'5","reported_seq":46,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-12T02:36:47.011722+0000","last_change":"2024-09-12T02:35:00.059679+0000","last_active":"2024-09-12T02:36:47.011722+0000","last_peered":"2024-09-12T02:36:47.011722+0000","last_clean":"2024-09-12T02:36:47.011722+0000","last_became_active":"2024-09-12T02:35:00.058599+0000","last_became_peered":"2024-09-12T02:35:00.058599+0000","last_unstale":"2024-09-12T02:36:47.011722+0000","last_undegraded":"2024-09-12T02:36:47.011722+0000","last_fullsized":"2024-09-12T02:36:47.011722+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:34:59.027857+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:34:59.027857+0000","last_clean_scrub_stamp":"2024-09-12T02:34:59.027857+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:24:39.878761+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":7,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,1,5],"acting":[8,1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.1d","version":"0'0","reported_seq":36,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-12T02:36:47.065676+0000","last_change":"2024-09-12T02:35:02.511371+0000","last_active":"2024-09-12T02:36:47.065676+0000","last_peered":"2024-09-12T02:36:47.065676+0000","last_clean":"2024-09-12T02:36:47.065676+0000","last_became_active":"2024-09-12T02:35:02.510941+0000","last_became_peered":"2024-09-12T02:35:02.510941+0000","last_unstale":"2024-09-12T02:36:47.065676+0000","last_undegraded":"2024-09-12T02:36:47.065676+0000","last_fullsized":"2024-09-12T02:36:47.065676+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:35:01.470375+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:35:01.470375+0000","last_clean_scrub_stamp":"2024-09-12T02:35:01.470375+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:30:50.106899+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,1],"acting":[5,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1a","version":"0'0","reported_seq":28,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-12T02:36:47.066647+0000","last_change":"2024-09-12T02:35:12.590925+0000","last_active":"2024-09-12T02:36:47.066647+0000","last_peered":"2024-09-12T02:36:47.066647+0000","last_clean":"2024-09-12T02:36:47.066647+0000","last_became_active":"2024-09-12T02:35:12.590286+0000","last_became_peered":"2024-09-12T02:35:12.590286+0000","last_unstale":"2024-09-12T02:36:47.066647+0000","last_undegraded":"2024-09-12T02:36:47.066647+0000","last_fullsized":"2024-09-12T02:36:47.066647+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:35:11.552386+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:35:11.552386+0000","last_clean_scrub_stamp":"2024-09-12T02:35:11.552386+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:31:48.835941+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6,5,3],"acting":[4,6,5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":37,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-12T02:36:47.064593+0000","last_change":"2024-09-12T02:35:02.524637+0000","last_active":"2024-09-12T02:36:47.064593+0000","last_peered":"2024-09-12T02:36:47.064593+0000","last_clean":"2024-09-12T02:36:47.064593+0000","last_became_active":"2024-09-12T02:35:02.524178+0000","last_became_peered":"2024-09-12T02:35:02.524178+0000","last_unstale":"2024-09-12T02:36:47.064593+0000","last_undegraded":"2024-09-12T02:36:47.064593+0000","last_fullsized":"2024-09-12T02:36:47.064593+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:35:01.470375+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:35:01.470375+0000","last_clean_scrub_stamp":"2024-09-12T02:35:01.470375+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:31:28.693302+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,6],"acting":[7,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.b","version":"93'4","reported_seq":55,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-12T02:36:47.011260+0000","last_change":"2024-09-12T02:35:46.837747+0000","last_active":"2024-09-12T02:36:47.011260+0000","last_peered":"2024-09-12T02:36:47.011260+0000","last_clean":"2024-09-12T02:36:47.011260+0000","last_became_active":"2024-09-12T02:35:46.834865+0000","last_became_peered":"2024-09-12T02:35:46.834865+0000","last_unstale":"2024-09-12T02:36:47.011260+0000","last_undegraded":"2024-09-12T02:36:47.011260+0000","last_fullsized":"2024-09-12T02:36:47.011260+0000","mapping_epoch":92,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":93,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:34:59.027857+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:34:59.027857+0000","last_clean_scrub_stamp":"2024-09-12T02:34:59.027857+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:04:51.092618+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,1,7],"acting":[8,1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"4.d","version":"0'0","reported_seq":28,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-12T02:36:47.066922+0000","last_change":"2024-09-12T02:35:12.590345+0000","last_active":"2024-09-12T02:36:47.066922+0000","last_peered":"2024-09-12T02:36:47.066922+0000","last_clean":"2024-09-12T02:36:47.066922+0000","last_became_active":"2024-09-12T02:35:12.589805+0000","last_became_peered":"2024-09-12T02:35:12.589805+0000","last_unstale":"2024-09-12T02:36:47.066922+0000","last_undegraded":"2024-09-12T02:36:47.066922+0000","last_fullsized":"2024-09-12T02:36:47.066922+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:35:11.552386+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:35:11.552386+0000","last_clean_scrub_stamp":"2024-09-12T02:35:11.552386+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:49:28.262371+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2,10,3],"acting":[4,2,10,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.b","version":"0'0","reported_seq":38,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-12T02:36:47.008947+0000","last_change":"2024-09-12T02:35:02.513424+0000","last_active":"2024-09-12T02:36:47.008947+0000","last_peered":"2024-09-12T02:36:47.008947+0000","last_clean":"2024-09-12T02:36:47.008947+0000","last_became_active":"2024-09-12T02:35:02.512180+0000","last_became_peered":"2024-09-12T02:35:02.512180+0000","last_unstale":"2024-09-12T02:36:47.008947+0000","last_undegraded":"2024-09-12T02:36:47.008947+0000","last_fullsized":"2024-09-12T02:36:47.008947+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:35:01.470375+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:35:01.470375+0000","last_clean_scrub_stamp":"2024-09-12T02:35:01.470375+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:22:40.102645+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,10],"acting":[3,0,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.a","version":"93'3","reported_seq":45,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-12T02:36:47.013189+0000","last_change":"2024-09-12T02:35:00.066012+0000","last_active":"2024-09-12T02:36:47.013189+0000","last_peered":"2024-09-12T02:36:47.013189+0000","last_clean":"2024-09-12T02:36:47.013189+0000","last_became_active":"2024-09-12T02:35:00.065642+0000","last_became_peered":"2024-09-12T02:35:00.065642+0000","last_unstale":"2024-09-12T02:36:47.013189+0000","last_undegraded":"2024-09-12T02:36:47.013189+0000","last_fullsized":"2024-09-12T02:36:47.013189+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:34:59.027857+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:34:59.027857+0000","last_clean_scrub_stamp":"2024-09-12T02:34:59.027857+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:16:27.609255+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,8],"acting":[2,3,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.c","version":"93'1","reported_seq":29,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-12T02:36:47.066831+0000","last_change":"2024-09-12T02:35:12.591850+0000","last_active":"2024-09-12T02:36:47.066831+0000","last_peered":"2024-09-12T02:36:47.066831+0000","last_clean":"2024-09-12T02:36:47.066831+0000","last_became_active":"2024-09-12T02:35:12.590807+0000","last_became_peered":"2024-09-12T02:35:12.590807+0000","last_unstale":"2024-09-12T02:36:47.066831+0000","last_undegraded":"2024-09-12T02:36:47.066831+0000","last_fullsized":"2024-09-12T02:36:47.066831+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:35:11.552386+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:35:11.552386+0000","last_clean_scrub_stamp":"2024-09-12T02:35:11.552386+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:09:16.082542+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":117,"num_objects":1,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,9,7,8],"acting":[4,9,7,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":35,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-12T02:36:47.154036+0000","last_change":"2024-09-12T02:35:02.510960+0000","last_active":"2024-09-12T02:36:47.154036+0000","last_peered":"2024-09-12T02:36:47.154036+0000","last_clean":"2024-09-12T02:36:47.154036+0000","last_became_active":"2024-09-12T02:35:02.510589+0000","last_became_peered":"2024-09-12T02:35:02.510589+0000","last_unstale":"2024-09-12T02:36:47.154036+0000","last_undegraded":"2024-09-12T02:36:47.154036+0000","last_fullsized":"2024-09-12T02:36:47.154036+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:35:01.470375+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:35:01.470375+0000","last_clean_scrub_stamp":"2024-09-12T02:35:01.470375+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:33:15.825208+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,0,2],"acting":[11,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"2.9","version":"93'7","reported_seq":49,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-12T02:36:47.009289+0000","last_change":"2024-09-12T02:35:00.061327+0000","last_active":"2024-09-12T02:36:47.009289+0000","last_peered":"2024-09-12T02:36:47.009289+0000","last_clean":"2024-09-12T02:36:47.009289+0000","last_became_active":"2024-09-12T02:35:00.061118+0000","last_became_peered":"2024-09-12T02:35:00.061118+0000","last_unstale":"2024-09-12T02:36:47.009289+0000","last_undegraded":"2024-09-12T02:36:47.009289+0000","last_fullsized":"2024-09-12T02:36:47.009289+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:34:59.027857+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:34:59.027857+0000","last_clean_scrub_stamp":"2024-09-12T02:34:59.027857+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T14:02:22.217428+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,9,10],"acting":[3,9,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.f","version":"0'0","reported_seq":28,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-12T02:36:47.009987+0000","last_change":"2024-09-12T02:35:12.581769+0000","last_active":"2024-09-12T02:36:47.009987+0000","last_peered":"2024-09-12T02:36:47.009987+0000","last_clean":"2024-09-12T02:36:47.009987+0000","last_became_active":"2024-09-12T02:35:12.580169+0000","last_became_peered":"2024-09-12T02:35:12.580169+0000","last_unstale":"2024-09-12T02:36:47.009987+0000","last_undegraded":"2024-09-12T02:36:47.009987+0000","last_fullsized":"2024-09-12T02:36:47.009987+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:35:11.552386+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:35:11.552386+0000","last_clean_scrub_stamp":"2024-09-12T02:35:11.552386+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:04:10.192058+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,3,2,5],"acting":[9,3,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":35,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-12T02:36:47.011088+0000","last_change":"2024-09-12T02:35:02.507893+0000","last_active":"2024-09-12T02:36:47.011088+0000","last_peered":"2024-09-12T02:36:47.011088+0000","last_clean":"2024-09-12T02:36:47.011088+0000","last_became_active":"2024-09-12T02:35:02.506357+0000","last_became_peered":"2024-09-12T02:35:02.506357+0000","last_unstale":"2024-09-12T02:36:47.011088+0000","last_undegraded":"2024-09-12T02:36:47.011088+0000","last_fullsized":"2024-09-12T02:36:47.011088+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:35:01.470375+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:35:01.470375+0000","last_clean_scrub_stamp":"2024-09-12T02:35:01.470375+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T14:03:36.148796+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,11,10],"acting":[8,11,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"2.8","version":"93'2","reported_seq":43,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-12T02:36:47.153507+0000","last_change":"2024-09-12T02:35:00.068759+0000","last_active":"2024-09-12T02:36:47.153507+0000","last_peered":"2024-09-12T02:36:47.153507+0000","last_clean":"2024-09-12T02:36:47.153507+0000","last_became_active":"2024-09-12T02:35:00.068464+0000","last_became_peered":"2024-09-12T02:35:00.068464+0000","last_unstale":"2024-09-12T02:36:47.153507+0000","last_undegraded":"2024-09-12T02:36:47.153507+0000","last_fullsized":"2024-09-12T02:36:47.153507+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:34:59.027857+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:34:59.027857+0000","last_clean_scrub_stamp":"2024-09-12T02:34:59.027857+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T14:17:20.863590+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,0],"acting":[1,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.e","version":"0'0","reported_seq":28,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-12T02:36:47.067079+0000","last_change":"2024-09-12T02:35:12.591707+0000","last_active":"2024-09-12T02:36:47.067079+0000","last_peered":"2024-09-12T02:36:47.067079+0000","last_clean":"2024-09-12T02:36:47.067079+0000","last_became_active":"2024-09-12T02:35:12.591302+0000","last_became_peered":"2024-09-12T02:35:12.591302+0000","last_unstale":"2024-09-12T02:36:47.067079+0000","last_undegraded":"2024-09-12T02:36:47.067079+0000","last_fullsized":"2024-09-12T02:36:47.067079+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:35:11.552386+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:35:11.552386+0000","last_clean_scrub_stamp":"2024-09-12T02:35:11.552386+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:56:14.526395+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5,10,9],"acting":[4,5,10,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":34,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-12T02:36:47.586036+0000","last_change":"2024-09-12T02:35:02.523175+0000","last_active":"2024-09-12T02:36:47.586036+0000","last_peered":"2024-09-12T02:36:47.586036+0000","last_clean":"2024-09-12T02:36:47.586036+0000","last_became_active":"2024-09-12T02:35:02.522846+0000","last_became_peered":"2024-09-12T02:35:02.522846+0000","last_unstale":"2024-09-12T02:36:47.586036+0000","last_undegraded":"2024-09-12T02:36:47.586036+0000","last_fullsized":"2024-09-12T02:36:47.586036+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:35:01.470375+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:35:01.470375+0000","last_clean_scrub_stamp":"2024-09-12T02:35:01.470375+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:16:18.488190+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,4],"acting":[0,3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.7","version":"93'7","reported_seq":49,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-12T02:36:47.067356+0000","last_change":"2024-09-12T02:35:00.314147+0000","last_active":"2024-09-12T02:36:47.067356+0000","last_peered":"2024-09-12T02:36:47.067356+0000","last_clean":"2024-09-12T02:36:47.067356+0000","last_became_active":"2024-09-12T02:35:00.313795+0000","last_became_peered":"2024-09-12T02:35:00.313795+0000","last_unstale":"2024-09-12T02:36:47.067356+0000","last_undegraded":"2024-09-12T02:36:47.067356+0000","last_fullsized":"2024-09-12T02:36:47.067356+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:34:59.027857+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:34:59.027857+0000","last_clean_scrub_stamp":"2024-09-12T02:34:59.027857+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:26:33.269006+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,11,6],"acting":[4,11,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.1","version":"0'0","reported_seq":28,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-12T02:36:47.013567+0000","last_change":"2024-09-12T02:35:12.578075+0000","last_active":"2024-09-12T02:36:47.013567+0000","last_peered":"2024-09-12T02:36:47.013567+0000","last_clean":"2024-09-12T02:36:47.013567+0000","last_became_active":"2024-09-12T02:35:12.577622+0000","last_became_peered":"2024-09-12T02:35:12.577622+0000","last_unstale":"2024-09-12T02:36:47.013567+0000","last_undegraded":"2024-09-12T02:36:47.013567+0000","last_fullsized":"2024-09-12T02:36:47.013567+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:35:11.552386+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:35:11.552386+0000","last_clean_scrub_stamp":"2024-09-12T02:35:11.552386+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:26:50.263757+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,4,7],"acting":[2,1,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.7","version":"0'0","reported_seq":38,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-12T02:36:47.010625+0000","last_change":"2024-09-12T02:35:02.514685+0000","last_active":"2024-09-12T02:36:47.010625+0000","last_peered":"2024-09-12T02:36:47.010625+0000","last_clean":"2024-09-12T02:36:47.010625+0000","last_became_active":"2024-09-12T02:35:02.511606+0000","last_became_peered":"2024-09-12T02:35:02.511606+0000","last_unstale":"2024-09-12T02:36:47.010625+0000","last_undegraded":"2024-09-12T02:36:47.010625+0000","last_fullsized":"2024-09-12T02:36:47.010625+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:35:01.470375+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:35:01.470375+0000","last_clean_scrub_stamp":"2024-09-12T02:35:01.470375+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:36:49.833272+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,11,7],"acting":[3,11,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.6","version":"93'15","reported_seq":57,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-12T02:36:47.009854+0000","last_change":"2024-09-12T02:35:00.059540+0000","last_active":"2024-09-12T02:36:47.009854+0000","last_peered":"2024-09-12T02:36:47.009854+0000","last_clean":"2024-09-12T02:36:47.009854+0000","last_became_active":"2024-09-12T02:35:00.059161+0000","last_became_peered":"2024-09-12T02:35:00.059161+0000","last_unstale":"2024-09-12T02:36:47.009854+0000","last_undegraded":"2024-09-12T02:36:47.009854+0000","last_fullsized":"2024-09-12T02:36:47.009854+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:34:59.027857+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:34:59.027857+0000","last_clean_scrub_stamp":"2024-09-12T02:34:59.027857+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:52:19.141087+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":26,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,8,3],"acting":[9,8,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"4.0","version":"0'0","reported_seq":28,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-12T02:36:47.009293+0000","last_change":"2024-09-12T02:35:12.584755+0000","last_active":"2024-09-12T02:36:47.009293+0000","last_peered":"2024-09-12T02:36:47.009293+0000","last_clean":"2024-09-12T02:36:47.009293+0000","last_became_active":"2024-09-12T02:35:12.584365+0000","last_became_peered":"2024-09-12T02:35:12.584365+0000","last_unstale":"2024-09-12T02:36:47.009293+0000","last_undegraded":"2024-09-12T02:36:47.009293+0000","last_fullsized":"2024-09-12T02:36:47.009293+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:35:11.552386+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:35:11.552386+0000","last_clean_scrub_stamp":"2024-09-12T02:35:11.552386+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:16:54.529244+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,10,0,7],"acting":[3,10,0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":35,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-12T02:36:47.064760+0000","last_change":"2024-09-12T02:35:02.507751+0000","last_active":"2024-09-12T02:36:47.064760+0000","last_peered":"2024-09-12T02:36:47.064760+0000","last_clean":"2024-09-12T02:36:47.064760+0000","last_became_active":"2024-09-12T02:35:02.507456+0000","last_became_peered":"2024-09-12T02:35:02.507456+0000","last_unstale":"2024-09-12T02:36:47.064760+0000","last_undegraded":"2024-09-12T02:36:47.064760+0000","last_fullsized":"2024-09-12T02:36:47.064760+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:35:01.470375+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:35:01.470375+0000","last_clean_scrub_stamp":"2024-09-12T02:35:01.470375+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:48:13.297422+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2,9],"acting":[6,2,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.5","version":"93'4","reported_seq":45,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-12T02:36:47.011648+0000","last_change":"2024-09-12T02:35:00.068895+0000","last_active":"2024-09-12T02:36:47.011648+0000","last_peered":"2024-09-12T02:36:47.011648+0000","last_clean":"2024-09-12T02:36:47.011648+0000","last_became_active":"2024-09-12T02:35:00.068547+0000","last_became_peered":"2024-09-12T02:35:00.068547+0000","last_unstale":"2024-09-12T02:36:47.011648+0000","last_undegraded":"2024-09-12T02:36:47.011648+0000","last_fullsized":"2024-09-12T02:36:47.011648+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:34:59.027857+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:34:59.027857+0000","last_clean_scrub_stamp":"2024-09-12T02:34:59.027857+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:31:14.305834+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":112,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":5,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,0,9],"acting":[8,0,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"4.3","version":"0'0","reported_seq":28,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-12T02:36:47.153747+0000","last_change":"2024-09-12T02:35:12.579890+0000","last_active":"2024-09-12T02:36:47.153747+0000","last_peered":"2024-09-12T02:36:47.153747+0000","last_clean":"2024-09-12T02:36:47.153747+0000","last_became_active":"2024-09-12T02:35:12.579399+0000","last_became_peered":"2024-09-12T02:35:12.579399+0000","last_unstale":"2024-09-12T02:36:47.153747+0000","last_undegraded":"2024-09-12T02:36:47.153747+0000","last_fullsized":"2024-09-12T02:36:47.153747+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:35:11.552386+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:35:11.552386+0000","last_clean_scrub_stamp":"2024-09-12T02:35:11.552386+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:48:31.564922+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,5,7,6],"acting":[11,5,7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":36,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-12T02:36:47.062753+0000","last_change":"2024-09-12T02:35:02.519590+0000","last_active":"2024-09-12T02:36:47.062753+0000","last_peered":"2024-09-12T02:36:47.062753+0000","last_clean":"2024-09-12T02:36:47.062753+0000","last_became_active":"2024-09-12T02:35:02.519244+0000","last_became_peered":"2024-09-12T02:35:02.519244+0000","last_unstale":"2024-09-12T02:36:47.062753+0000","last_undegraded":"2024-09-12T02:36:47.062753+0000","last_fullsized":"2024-09-12T02:36:47.062753+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:35:01.470375+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:35:01.470375+0000","last_clean_scrub_stamp":"2024-09-12T02:35:01.470375+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T13:52:18.415135+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,3,6],"acting":[10,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"2.4","version":"93'1","reported_seq":43,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-12T02:36:47.009801+0000","last_change":"2024-09-12T02:35:00.068931+0000","last_active":"2024-09-12T02:36:47.009801+0000","last_peered":"2024-09-12T02:36:47.009801+0000","last_clean":"2024-09-12T02:36:47.009801+0000","last_became_active":"2024-09-12T02:35:00.068217+0000","last_became_peered":"2024-09-12T02:35:00.068217+0000","last_unstale":"2024-09-12T02:36:47.009801+0000","last_undegraded":"2024-09-12T02:36:47.009801+0000","last_fullsized":"2024-09-12T02:36:47.009801+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:34:59.027857+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:34:59.027857+0000","last_clean_scrub_stamp":"2024-09-12T02:34:59.027857+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:56:25.407991+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,2,0],"acting":[9,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"4.2","version":"0'0","reported_seq":35,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-12T02:36:47.011093+0000","last_change":"2024-09-12T02:35:46.834010+0000","last_active":"2024-09-12T02:36:47.011093+0000","last_peered":"2024-09-12T02:36:47.011093+0000","last_clean":"2024-09-12T02:36:47.011093+0000","last_became_active":"2024-09-12T02:35:46.833523+0000","last_became_peered":"2024-09-12T02:35:46.833523+0000","last_unstale":"2024-09-12T02:36:47.011093+0000","last_undegraded":"2024-09-12T02:36:47.011093+0000","last_fullsized":"2024-09-12T02:36:47.011093+0000","mapping_epoch":92,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":93,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:35:11.552386+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:35:11.552386+0000","last_clean_scrub_stamp":"2024-09-12T02:35:11.552386+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:49:26.839307+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,10,11,1],"acting":[8,10,11,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":36,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-12T02:36:47.062738+0000","last_change":"2024-09-12T02:35:02.514146+0000","last_active":"2024-09-12T02:36:47.062738+0000","last_peered":"2024-09-12T02:36:47.062738+0000","last_clean":"2024-09-12T02:36:47.062738+0000","last_became_active":"2024-09-12T02:35:02.513777+0000","last_became_peered":"2024-09-12T02:35:02.513777+0000","last_unstale":"2024-09-12T02:36:47.062738+0000","last_undegraded":"2024-09-12T02:36:47.062738+0000","last_fullsized":"2024-09-12T02:36:47.062738+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:35:01.470375+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:35:01.470375+0000","last_clean_scrub_stamp":"2024-09-12T02:35:01.470375+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:33:57.554957+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,4,0],"acting":[10,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"2.2","version":"93'6","reported_seq":113,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-12T02:36:54.074424+0000","last_change":"2024-09-12T02:35:00.062893+0000","last_active":"2024-09-12T02:36:54.074424+0000","last_peered":"2024-09-12T02:36:54.074424+0000","last_clean":"2024-09-12T02:36:54.074424+0000","last_became_active":"2024-09-12T02:35:00.062547+0000","last_became_peered":"2024-09-12T02:35:00.062547+0000","last_unstale":"2024-09-12T02:36:54.074424+0000","last_undegraded":"2024-09-12T02:36:54.074424+0000","last_fullsized":"2024-09-12T02:36:54.074424+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:34:59.027857+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:34:59.027857+0000","last_clean_scrub_stamp":"2024-09-12T02:34:59.027857+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T13:40:15.098836+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":981,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":2,"num_write":5,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6,1],"acting":[7,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.4","version":"0'0","reported_seq":28,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-12T02:36:47.064649+0000","last_change":"2024-09-12T02:35:12.586490+0000","last_active":"2024-09-12T02:36:47.064649+0000","last_peered":"2024-09-12T02:36:47.064649+0000","last_clean":"2024-09-12T02:36:47.064649+0000","last_became_active":"2024-09-12T02:35:12.586102+0000","last_became_peered":"2024-09-12T02:35:12.586102+0000","last_unstale":"2024-09-12T02:36:47.064649+0000","last_undegraded":"2024-09-12T02:36:47.064649+0000","last_fullsized":"2024-09-12T02:36:47.064649+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:35:11.552386+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:35:11.552386+0000","last_clean_scrub_stamp":"2024-09-12T02:35:11.552386+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:43:45.543922+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0,1,8],"acting":[6,0,1,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":36,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-12T02:36:47.065329+0000","last_change":"2024-09-12T02:35:02.506726+0000","last_active":"2024-09-12T02:36:47.065329+0000","last_peered":"2024-09-12T02:36:47.065329+0000","last_clean":"2024-09-12T02:36:47.065329+0000","last_became_active":"2024-09-12T02:35:02.505693+0000","last_became_peered":"2024-09-12T02:35:02.505693+0000","last_unstale":"2024-09-12T02:36:47.065329+0000","last_undegraded":"2024-09-12T02:36:47.065329+0000","last_fullsized":"2024-09-12T02:36:47.065329+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:35:01.470375+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:35:01.470375+0000","last_clean_scrub_stamp":"2024-09-12T02:35:01.470375+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:54:51.507105+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2,4],"acting":[5,2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1","version":"93'5","reported_seq":108,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-12T02:36:52.073322+0000","last_change":"2024-09-12T02:35:00.069206+0000","last_active":"2024-09-12T02:36:52.073322+0000","last_peered":"2024-09-12T02:36:52.073322+0000","last_clean":"2024-09-12T02:36:52.073322+0000","last_became_active":"2024-09-12T02:35:00.068823+0000","last_became_peered":"2024-09-12T02:35:00.068823+0000","last_unstale":"2024-09-12T02:36:52.073322+0000","last_undegraded":"2024-09-12T02:36:52.073322+0000","last_fullsized":"2024-09-12T02:36:52.073322+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:34:59.027857+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:34:59.027857+0000","last_clean_scrub_stamp":"2024-09-12T02:34:59.027857+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:33:11.004561+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":112,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":63,"num_read_kb":63,"num_write":5,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,0],"acting":[6,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.7","version":"0'0","reported_seq":28,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-12T02:36:47.064797+0000","last_change":"2024-09-12T02:35:12.587431+0000","last_active":"2024-09-12T02:36:47.064797+0000","last_peered":"2024-09-12T02:36:47.064797+0000","last_clean":"2024-09-12T02:36:47.064797+0000","last_became_active":"2024-09-12T02:35:12.587059+0000","last_became_peered":"2024-09-12T02:35:12.587059+0000","last_unstale":"2024-09-12T02:36:47.064797+0000","last_undegraded":"2024-09-12T02:36:47.064797+0000","last_fullsized":"2024-09-12T02:36:47.064797+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:35:11.552386+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:35:11.552386+0000","last_clean_scrub_stamp":"2024-09-12T02:35:11.552386+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:51:53.335039+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5,10,0],"acting":[6,5,10,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":35,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-12T02:36:47.064206+0000","last_change":"2024-09-12T02:35:02.508475+0000","last_active":"2024-09-12T02:36:47.064206+0000","last_peered":"2024-09-12T02:36:47.064206+0000","last_clean":"2024-09-12T02:36:47.064206+0000","last_became_active":"2024-09-12T02:35:02.508183+0000","last_became_peered":"2024-09-12T02:35:02.508183+0000","last_unstale":"2024-09-12T02:36:47.064206+0000","last_undegraded":"2024-09-12T02:36:47.064206+0000","last_fullsized":"2024-09-12T02:36:47.064206+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:35:01.470375+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:35:01.470375+0000","last_clean_scrub_stamp":"2024-09-12T02:35:01.470375+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:49:09.545800+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,2],"acting":[6,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.0","version":"93'4","reported_seq":19,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-12T02:36:47.153623+0000","last_change":"2024-09-12T02:35:46.734658+0000","last_active":"2024-09-12T02:36:47.153623+0000","last_peered":"2024-09-12T02:36:47.153623+0000","last_clean":"2024-09-12T02:36:47.153623+0000","last_became_active":"2024-09-12T02:35:46.734239+0000","last_became_peered":"2024-09-12T02:35:46.734239+0000","last_unstale":"2024-09-12T02:36:47.153623+0000","last_undegraded":"2024-09-12T02:36:47.153623+0000","last_fullsized":"2024-09-12T02:36:47.153623+0000","mapping_epoch":92,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":93,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:34:59.027857+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:34:59.027857+0000","last_clean_scrub_stamp":"2024-09-12T02:34:59.027857+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:08:17.941344+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,5,8],"acting":[11,5,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"4.6","version":"0'0","reported_seq":12,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-12T02:36:47.155805+0000","last_change":"2024-09-12T02:36:47.155340+0000","last_active":"2024-09-12T02:36:47.155805+0000","last_peered":"2024-09-12T02:36:47.155805+0000","last_clean":"2024-09-12T02:36:47.155805+0000","last_became_active":"2024-09-12T02:36:47.154890+0000","last_became_peered":"2024-09-12T02:36:47.154890+0000","last_unstale":"2024-09-12T02:36:47.155805+0000","last_undegraded":"2024-09-12T02:36:47.155805+0000","last_fullsized":"2024-09-12T02:36:47.155805+0000","mapping_epoch":94,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":95,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:35:11.552386+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:35:11.552386+0000","last_clean_scrub_stamp":"2024-09-12T02:35:11.552386+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:34:06.673031+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,11,6,10],"acting":[8,11,6,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":38,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-12T02:36:47.009187+0000","last_change":"2024-09-12T02:35:02.515340+0000","last_active":"2024-09-12T02:36:47.009187+0000","last_peered":"2024-09-12T02:36:47.009187+0000","last_clean":"2024-09-12T02:36:47.009187+0000","last_became_active":"2024-09-12T02:35:02.514973+0000","last_became_peered":"2024-09-12T02:35:02.514973+0000","last_unstale":"2024-09-12T02:36:47.009187+0000","last_undegraded":"2024-09-12T02:36:47.009187+0000","last_fullsized":"2024-09-12T02:36:47.009187+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:35:01.470375+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:35:01.470375+0000","last_clean_scrub_stamp":"2024-09-12T02:35:01.470375+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:06:03.154300+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5,1],"acting":[3,5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.3","version":"93'6","reported_seq":50,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-12T02:36:47.067082+0000","last_change":"2024-09-12T02:35:00.066731+0000","last_active":"2024-09-12T02:36:47.067082+0000","last_peered":"2024-09-12T02:36:47.067082+0000","last_clean":"2024-09-12T02:36:47.067082+0000","last_became_active":"2024-09-12T02:35:00.066339+0000","last_became_peered":"2024-09-12T02:35:00.066339+0000","last_unstale":"2024-09-12T02:36:47.067082+0000","last_undegraded":"2024-09-12T02:36:47.067082+0000","last_fullsized":"2024-09-12T02:36:47.067082+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:34:59.027857+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:34:59.027857+0000","last_clean_scrub_stamp":"2024-09-12T02:34:59.027857+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:02:39.919349+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":68,"num_objects":5,"num_object_clones":0,"num_object_copies":15,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":4,"num_read_kb":4,"num_write":8,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,10,9],"acting":[4,10,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"1.0","version":"23'137","reported_seq":367,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-12T02:36:47.064547+0000","last_change":"2024-09-12T02:33:47.732241+0000","last_active":"2024-09-12T02:36:47.064547+0000","last_peered":"2024-09-12T02:36:47.064547+0000","last_clean":"2024-09-12T02:36:47.064547+0000","last_became_active":"2024-09-12T02:33:47.731872+0000","last_became_peered":"2024-09-12T02:33:47.731872+0000","last_unstale":"2024-09-12T02:36:47.064547+0000","last_undegraded":"2024-09-12T02:36:47.064547+0000","last_fullsized":"2024-09-12T02:36:47.064547+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:30:09.398092+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:30:09.398092+0000","last_clean_scrub_stamp":"2024-09-12T02:30:09.398092+0000","objects_scrubbed":0,"log_size":137,"log_dups_size":0,"ondisk_log_size":137,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:35:36.504372+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":136,"num_read_kb":119,"num_write":181,"num_write_kb":2938,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":1180736,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,10],"acting":[7,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.5","version":"93'1","reported_seq":29,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-12T02:36:47.064880+0000","last_change":"2024-09-12T02:35:12.578073+0000","last_active":"2024-09-12T02:36:47.064880+0000","last_peered":"2024-09-12T02:36:47.064880+0000","last_clean":"2024-09-12T02:36:47.064880+0000","last_became_active":"2024-09-12T02:35:12.577496+0000","last_became_peered":"2024-09-12T02:35:12.577496+0000","last_unstale":"2024-09-12T02:36:47.064880+0000","last_undegraded":"2024-09-12T02:36:47.064880+0000","last_fullsized":"2024-09-12T02:36:47.064880+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:35:11.552386+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:35:11.552386+0000","last_clean_scrub_stamp":"2024-09-12T02:35:11.552386+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:02:47.229873+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":117,"num_objects":1,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,11,9],"acting":[7,5,11,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.d","version":"0'0","reported_seq":37,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-12T02:36:47.064949+0000","last_change":"2024-09-12T02:35:02.510571+0000","last_active":"2024-09-12T02:36:47.064949+0000","last_peered":"2024-09-12T02:36:47.064949+0000","last_clean":"2024-09-12T02:36:47.064949+0000","last_became_active":"2024-09-12T02:35:02.509673+0000","last_became_peered":"2024-09-12T02:35:02.509673+0000","last_unstale":"2024-09-12T02:36:47.064949+0000","last_undegraded":"2024-09-12T02:36:47.064949+0000","last_fullsized":"2024-09-12T02:36:47.064949+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:35:01.470375+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:35:01.470375+0000","last_clean_scrub_stamp":"2024-09-12T02:35:01.470375+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:12:17.515300+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,11],"acting":[7,1,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.c","version":"93'6","reported_seq":113,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-12T02:36:52.071168+0000","last_change":"2024-09-12T02:35:00.314045+0000","last_active":"2024-09-12T02:36:52.071168+0000","last_peered":"2024-09-12T02:36:52.071168+0000","last_clean":"2024-09-12T02:36:52.071168+0000","last_became_active":"2024-09-12T02:35:00.313626+0000","last_became_peered":"2024-09-12T02:35:00.313626+0000","last_unstale":"2024-09-12T02:36:52.071168+0000","last_undegraded":"2024-09-12T02:36:52.071168+0000","last_fullsized":"2024-09-12T02:36:52.071168+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:34:59.027857+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:34:59.027857+0000","last_clean_scrub_stamp":"2024-09-12T02:34:59.027857+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:57:45.282128+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1563,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":65,"num_read_kb":3,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,11,0],"acting":[2,11,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.a","version":"0'0","reported_seq":28,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-12T02:36:47.153551+0000","last_change":"2024-09-12T02:35:12.582905+0000","last_active":"2024-09-12T02:36:47.153551+0000","last_peered":"2024-09-12T02:36:47.153551+0000","last_clean":"2024-09-12T02:36:47.153551+0000","last_became_active":"2024-09-12T02:35:12.582451+0000","last_became_peered":"2024-09-12T02:35:12.582451+0000","last_unstale":"2024-09-12T02:36:47.153551+0000","last_undegraded":"2024-09-12T02:36:47.153551+0000","last_fullsized":"2024-09-12T02:36:47.153551+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:35:11.552386+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:35:11.552386+0000","last_clean_scrub_stamp":"2024-09-12T02:35:11.552386+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:53:40.811531+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,6,7],"acting":[1,5,6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":37,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-12T02:36:47.064876+0000","last_change":"2024-09-12T02:35:02.516173+0000","last_active":"2024-09-12T02:36:47.064876+0000","last_peered":"2024-09-12T02:36:47.064876+0000","last_clean":"2024-09-12T02:36:47.064876+0000","last_became_active":"2024-09-12T02:35:02.515802+0000","last_became_peered":"2024-09-12T02:35:02.515802+0000","last_unstale":"2024-09-12T02:36:47.064876+0000","last_undegraded":"2024-09-12T02:36:47.064876+0000","last_fullsized":"2024-09-12T02:36:47.064876+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:35:01.470375+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:35:01.470375+0000","last_clean_scrub_stamp":"2024-09-12T02:35:01.470375+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:52:22.469433+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3,5],"acting":[7,3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.d","version":"93'3","reported_seq":45,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-12T02:36:47.065802+0000","last_change":"2024-09-12T02:35:00.058472+0000","last_active":"2024-09-12T02:36:47.065802+0000","last_peered":"2024-09-12T02:36:47.065802+0000","last_clean":"2024-09-12T02:36:47.065802+0000","last_became_active":"2024-09-12T02:35:00.058144+0000","last_became_peered":"2024-09-12T02:35:00.058144+0000","last_unstale":"2024-09-12T02:36:47.065802+0000","last_undegraded":"2024-09-12T02:36:47.065802+0000","last_fullsized":"2024-09-12T02:36:47.065802+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:34:59.027857+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:34:59.027857+0000","last_clean_scrub_stamp":"2024-09-12T02:34:59.027857+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:20:05.124583+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,10,3],"acting":[5,10,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.b","version":"0'0","reported_seq":26,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-12T02:36:47.585491+0000","last_change":"2024-09-12T02:35:12.592804+0000","last_active":"2024-09-12T02:36:47.585491+0000","last_peered":"2024-09-12T02:36:47.585491+0000","last_clean":"2024-09-12T02:36:47.585491+0000","last_became_active":"2024-09-12T02:35:12.592417+0000","last_became_peered":"2024-09-12T02:35:12.592417+0000","last_unstale":"2024-09-12T02:36:47.585491+0000","last_undegraded":"2024-09-12T02:36:47.585491+0000","last_fullsized":"2024-09-12T02:36:47.585491+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:35:11.552386+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:35:11.552386+0000","last_clean_scrub_stamp":"2024-09-12T02:35:11.552386+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:30:01.965989+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,9,1,4],"acting":[0,9,1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.f","version":"0'0","reported_seq":37,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-12T02:36:47.064792+0000","last_change":"2024-09-12T02:35:02.511051+0000","last_active":"2024-09-12T02:36:47.064792+0000","last_peered":"2024-09-12T02:36:47.064792+0000","last_clean":"2024-09-12T02:36:47.064792+0000","last_became_active":"2024-09-12T02:35:02.509959+0000","last_became_peered":"2024-09-12T02:35:02.509959+0000","last_unstale":"2024-09-12T02:36:47.064792+0000","last_undegraded":"2024-09-12T02:36:47.064792+0000","last_fullsized":"2024-09-12T02:36:47.064792+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:35:01.470375+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:35:01.470375+0000","last_clean_scrub_stamp":"2024-09-12T02:35:01.470375+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:03:53.757074+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,11,8],"acting":[7,11,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.e","version":"93'5","reported_seq":45,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-12T02:36:47.064778+0000","last_change":"2024-09-12T02:35:00.060428+0000","last_active":"2024-09-12T02:36:47.064778+0000","last_peered":"2024-09-12T02:36:47.064778+0000","last_clean":"2024-09-12T02:36:47.064778+0000","last_became_active":"2024-09-12T02:35:00.060026+0000","last_became_peered":"2024-09-12T02:35:00.060026+0000","last_unstale":"2024-09-12T02:36:47.064778+0000","last_undegraded":"2024-09-12T02:36:47.064778+0000","last_fullsized":"2024-09-12T02:36:47.064778+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:34:59.027857+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:34:59.027857+0000","last_clean_scrub_stamp":"2024-09-12T02:34:59.027857+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:07:25.226210+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,2],"acting":[6,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.8","version":"0'0","reported_seq":28,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-12T02:36:47.065088+0000","last_change":"2024-09-12T02:35:12.579879+0000","last_active":"2024-09-12T02:36:47.065088+0000","last_peered":"2024-09-12T02:36:47.065088+0000","last_clean":"2024-09-12T02:36:47.065088+0000","last_became_active":"2024-09-12T02:35:12.579449+0000","last_became_peered":"2024-09-12T02:35:12.579449+0000","last_unstale":"2024-09-12T02:36:47.065088+0000","last_undegraded":"2024-09-12T02:36:47.065088+0000","last_fullsized":"2024-09-12T02:36:47.065088+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:35:11.552386+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:35:11.552386+0000","last_clean_scrub_stamp":"2024-09-12T02:35:11.552386+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:55:37.280959+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2,7,1],"acting":[5,2,7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.e","version":"0'0","reported_seq":35,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-12T02:36:47.154320+0000","last_change":"2024-09-12T02:35:02.509442+0000","last_active":"2024-09-12T02:36:47.154320+0000","last_peered":"2024-09-12T02:36:47.154320+0000","last_clean":"2024-09-12T02:36:47.154320+0000","last_became_active":"2024-09-12T02:35:02.509072+0000","last_became_peered":"2024-09-12T02:35:02.509072+0000","last_unstale":"2024-09-12T02:36:47.154320+0000","last_undegraded":"2024-09-12T02:36:47.154320+0000","last_fullsized":"2024-09-12T02:36:47.154320+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:35:01.470375+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:35:01.470375+0000","last_clean_scrub_stamp":"2024-09-12T02:35:01.470375+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:39:51.913895+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,5,4],"acting":[11,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"2.f","version":"93'2","reported_seq":43,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-12T02:36:47.011563+0000","last_change":"2024-09-12T02:35:00.060908+0000","last_active":"2024-09-12T02:36:47.011563+0000","last_peered":"2024-09-12T02:36:47.011563+0000","last_clean":"2024-09-12T02:36:47.011563+0000","last_became_active":"2024-09-12T02:35:00.060539+0000","last_became_peered":"2024-09-12T02:35:00.060539+0000","last_unstale":"2024-09-12T02:36:47.011563+0000","last_undegraded":"2024-09-12T02:36:47.011563+0000","last_fullsized":"2024-09-12T02:36:47.011563+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:34:59.027857+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:34:59.027857+0000","last_clean_scrub_stamp":"2024-09-12T02:34:59.027857+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:10:18.241911+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":2,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,5,4],"acting":[8,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"4.9","version":"0'0","reported_seq":28,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-12T02:36:47.065106+0000","last_change":"2024-09-12T02:35:12.585841+0000","last_active":"2024-09-12T02:36:47.065106+0000","last_peered":"2024-09-12T02:36:47.065106+0000","last_clean":"2024-09-12T02:36:47.065106+0000","last_became_active":"2024-09-12T02:35:12.585535+0000","last_became_peered":"2024-09-12T02:35:12.585535+0000","last_unstale":"2024-09-12T02:36:47.065106+0000","last_undegraded":"2024-09-12T02:36:47.065106+0000","last_fullsized":"2024-09-12T02:36:47.065106+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:35:11.552386+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:35:11.552386+0000","last_clean_scrub_stamp":"2024-09-12T02:35:11.552386+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:55:32.595165+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0,3,1],"acting":[5,0,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":42,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-12T02:36:47.065392+0000","last_change":"2024-09-12T02:35:46.833349+0000","last_active":"2024-09-12T02:36:47.065392+0000","last_peered":"2024-09-12T02:36:47.065392+0000","last_clean":"2024-09-12T02:36:47.065392+0000","last_became_active":"2024-09-12T02:35:46.832980+0000","last_became_peered":"2024-09-12T02:35:46.832980+0000","last_unstale":"2024-09-12T02:36:47.065392+0000","last_undegraded":"2024-09-12T02:36:47.065392+0000","last_fullsized":"2024-09-12T02:36:47.065392+0000","mapping_epoch":92,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":93,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:35:01.470375+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:35:01.470375+0000","last_clean_scrub_stamp":"2024-09-12T02:35:01.470375+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:35:51.086023+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,8,1],"acting":[5,8,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.10","version":"93'17","reported_seq":35,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-12T02:36:47.153578+0000","last_change":"2024-09-12T02:35:46.743046+0000","last_active":"2024-09-12T02:36:47.153578+0000","last_peered":"2024-09-12T02:36:47.153578+0000","last_clean":"2024-09-12T02:36:47.153578+0000","last_became_active":"2024-09-12T02:35:46.736070+0000","last_became_peered":"2024-09-12T02:35:46.736070+0000","last_unstale":"2024-09-12T02:36:47.153578+0000","last_undegraded":"2024-09-12T02:36:47.153578+0000","last_fullsized":"2024-09-12T02:36:47.153578+0000","mapping_epoch":92,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":93,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:34:59.027857+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:34:59.027857+0000","last_clean_scrub_stamp":"2024-09-12T02:34:59.027857+0000","objects_scrubbed":0,"log_size":17,"log_dups_size":0,"ondisk_log_size":17,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:51:55.849111+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":112,"num_objects":8,"num_object_clones":0,"num_object_copies":24,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":20,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":6,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,0,2],"acting":[11,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"4.16","version":"0'0","reported_seq":28,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-12T02:36:47.064755+0000","last_change":"2024-09-12T02:35:12.583676+0000","last_active":"2024-09-12T02:36:47.064755+0000","last_peered":"2024-09-12T02:36:47.064755+0000","last_clean":"2024-09-12T02:36:47.064755+0000","last_became_active":"2024-09-12T02:35:12.583238+0000","last_became_peered":"2024-09-12T02:35:12.583238+0000","last_unstale":"2024-09-12T02:36:47.064755+0000","last_undegraded":"2024-09-12T02:36:47.064755+0000","last_fullsized":"2024-09-12T02:36:47.064755+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:35:11.552386+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:35:11.552386+0000","last_clean_scrub_stamp":"2024-09-12T02:35:11.552386+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:30:04.751525+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,9,11],"acting":[6,3,9,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.10","version":"0'0","reported_seq":37,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-12T02:36:47.064362+0000","last_change":"2024-09-12T02:35:02.519325+0000","last_active":"2024-09-12T02:36:47.064362+0000","last_peered":"2024-09-12T02:36:47.064362+0000","last_clean":"2024-09-12T02:36:47.064362+0000","last_became_active":"2024-09-12T02:35:02.518951+0000","last_became_peered":"2024-09-12T02:35:02.518951+0000","last_unstale":"2024-09-12T02:36:47.064362+0000","last_undegraded":"2024-09-12T02:36:47.064362+0000","last_fullsized":"2024-09-12T02:36:47.064362+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:35:01.470375+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:35:01.470375+0000","last_clean_scrub_stamp":"2024-09-12T02:35:01.470375+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:39:59.070416+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,10],"acting":[7,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.11","version":"93'6","reported_seq":112,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-12T02:36:52.073899+0000","last_change":"2024-09-12T02:35:00.061897+0000","last_active":"2024-09-12T02:36:52.073899+0000","last_peered":"2024-09-12T02:36:52.073899+0000","last_clean":"2024-09-12T02:36:52.073899+0000","last_became_active":"2024-09-12T02:35:00.060657+0000","last_became_peered":"2024-09-12T02:35:00.060657+0000","last_unstale":"2024-09-12T02:36:52.073899+0000","last_undegraded":"2024-09-12T02:36:52.073899+0000","last_fullsized":"2024-09-12T02:36:52.073899+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:34:59.027857+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:34:59.027857+0000","last_clean_scrub_stamp":"2024-09-12T02:34:59.027857+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:21:57.471691+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":981,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":66,"num_read_kb":4,"num_write":6,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7,10],"acting":[4,7,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.17","version":"0'0","reported_seq":28,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-12T02:36:47.010007+0000","last_change":"2024-09-12T02:35:12.590637+0000","last_active":"2024-09-12T02:36:47.010007+0000","last_peered":"2024-09-12T02:36:47.010007+0000","last_clean":"2024-09-12T02:36:47.010007+0000","last_became_active":"2024-09-12T02:35:12.590242+0000","last_became_peered":"2024-09-12T02:35:12.590242+0000","last_unstale":"2024-09-12T02:36:47.010007+0000","last_undegraded":"2024-09-12T02:36:47.010007+0000","last_fullsized":"2024-09-12T02:36:47.010007+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:35:11.552386+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:35:11.552386+0000","last_clean_scrub_stamp":"2024-09-12T02:35:11.552386+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:33:12.490203+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,7,0,3],"acting":[9,7,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.13","version":"0'0","reported_seq":37,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-12T02:36:47.064756+0000","last_change":"2024-09-12T02:35:02.510040+0000","last_active":"2024-09-12T02:36:47.064756+0000","last_peered":"2024-09-12T02:36:47.064756+0000","last_clean":"2024-09-12T02:36:47.064756+0000","last_became_active":"2024-09-12T02:35:02.509591+0000","last_became_peered":"2024-09-12T02:35:02.509591+0000","last_unstale":"2024-09-12T02:36:47.064756+0000","last_undegraded":"2024-09-12T02:36:47.064756+0000","last_fullsized":"2024-09-12T02:36:47.064756+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:35:01.470375+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:35:01.470375+0000","last_clean_scrub_stamp":"2024-09-12T02:35:01.470375+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:38:22.209174+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4,6],"acting":[7,4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.12","version":"93'5","reported_seq":47,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-12T02:36:47.065562+0000","last_change":"2024-09-12T02:35:00.060895+0000","last_active":"2024-09-12T02:36:47.065562+0000","last_peered":"2024-09-12T02:36:47.065562+0000","last_clean":"2024-09-12T02:36:47.065562+0000","last_became_active":"2024-09-12T02:35:00.060483+0000","last_became_peered":"2024-09-12T02:35:00.060483+0000","last_unstale":"2024-09-12T02:36:47.065562+0000","last_undegraded":"2024-09-12T02:36:47.065562+0000","last_fullsized":"2024-09-12T02:36:47.065562+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:34:59.027857+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:34:59.027857+0000","last_clean_scrub_stamp":"2024-09-12T02:34:59.027857+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T13:23:30.719311+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":5,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3,7],"acting":[5,3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.14","version":"0'0","reported_seq":28,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-12T02:36:47.153817+0000","last_change":"2024-09-12T02:35:12.579605+0000","last_active":"2024-09-12T02:36:47.153817+0000","last_peered":"2024-09-12T02:36:47.153817+0000","last_clean":"2024-09-12T02:36:47.153817+0000","last_became_active":"2024-09-12T02:35:12.579147+0000","last_became_peered":"2024-09-12T02:35:12.579147+0000","last_unstale":"2024-09-12T02:36:47.153817+0000","last_undegraded":"2024-09-12T02:36:47.153817+0000","last_fullsized":"2024-09-12T02:36:47.153817+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:35:11.552386+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:35:11.552386+0000","last_clean_scrub_stamp":"2024-09-12T02:35:11.552386+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:19:19.454816+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,9,7,6],"acting":[11,9,7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":35,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-12T02:36:47.064368+0000","last_change":"2024-09-12T02:35:02.520230+0000","last_active":"2024-09-12T02:36:47.064368+0000","last_peered":"2024-09-12T02:36:47.064368+0000","last_clean":"2024-09-12T02:36:47.064368+0000","last_became_active":"2024-09-12T02:35:02.519885+0000","last_became_peered":"2024-09-12T02:35:02.519885+0000","last_unstale":"2024-09-12T02:36:47.064368+0000","last_undegraded":"2024-09-12T02:36:47.064368+0000","last_fullsized":"2024-09-12T02:36:47.064368+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:35:01.470375+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:35:01.470375+0000","last_clean_scrub_stamp":"2024-09-12T02:35:01.470375+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:50:53.031073+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,3],"acting":[6,7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.13","version":"93'9","reported_seq":53,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-12T02:36:47.013122+0000","last_change":"2024-09-12T02:35:00.066323+0000","last_active":"2024-09-12T02:36:47.013122+0000","last_peered":"2024-09-12T02:36:47.013122+0000","last_clean":"2024-09-12T02:36:47.013122+0000","last_became_active":"2024-09-12T02:35:00.065961+0000","last_became_peered":"2024-09-12T02:35:00.065961+0000","last_unstale":"2024-09-12T02:36:47.013122+0000","last_undegraded":"2024-09-12T02:36:47.013122+0000","last_fullsized":"2024-09-12T02:36:47.013122+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:34:59.027857+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:34:59.027857+0000","last_clean_scrub_stamp":"2024-09-12T02:34:59.027857+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:07:35.660223+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":68,"num_objects":6,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":13,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,10,3],"acting":[2,10,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.15","version":"0'0","reported_seq":28,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-12T02:36:47.065537+0000","last_change":"2024-09-12T02:35:12.583133+0000","last_active":"2024-09-12T02:36:47.065537+0000","last_peered":"2024-09-12T02:36:47.065537+0000","last_clean":"2024-09-12T02:36:47.065537+0000","last_became_active":"2024-09-12T02:35:12.582716+0000","last_became_peered":"2024-09-12T02:35:12.582716+0000","last_unstale":"2024-09-12T02:36:47.065537+0000","last_undegraded":"2024-09-12T02:36:47.065537+0000","last_fullsized":"2024-09-12T02:36:47.065537+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:35:11.552386+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:35:11.552386+0000","last_clean_scrub_stamp":"2024-09-12T02:35:11.552386+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:06:51.301261+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,8,3,6],"acting":[5,8,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.15","version":"0'0","reported_seq":35,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-12T02:36:47.011448+0000","last_change":"2024-09-12T02:35:02.514078+0000","last_active":"2024-09-12T02:36:47.011448+0000","last_peered":"2024-09-12T02:36:47.011448+0000","last_clean":"2024-09-12T02:36:47.011448+0000","last_became_active":"2024-09-12T02:35:02.513692+0000","last_became_peered":"2024-09-12T02:35:02.513692+0000","last_unstale":"2024-09-12T02:36:47.011448+0000","last_undegraded":"2024-09-12T02:36:47.011448+0000","last_fullsized":"2024-09-12T02:36:47.011448+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:35:01.470375+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:35:01.470375+0000","last_clean_scrub_stamp":"2024-09-12T02:35:01.470375+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T13:16:32.968171+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,11,7],"acting":[8,11,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"2.14","version":"93'34","reported_seq":206,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-12T02:36:53.072419+0000","last_change":"2024-09-12T02:35:00.060326+0000","last_active":"2024-09-12T02:36:53.072419+0000","last_peered":"2024-09-12T02:36:53.072419+0000","last_clean":"2024-09-12T02:36:53.072419+0000","last_became_active":"2024-09-12T02:35:00.059723+0000","last_became_peered":"2024-09-12T02:35:00.059723+0000","last_unstale":"2024-09-12T02:36:53.072419+0000","last_undegraded":"2024-09-12T02:36:53.072419+0000","last_fullsized":"2024-09-12T02:36:53.072419+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:34:59.027857+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:34:59.027857+0000","last_clean_scrub_stamp":"2024-09-12T02:34:59.027857+0000","objects_scrubbed":0,"log_size":34,"log_dups_size":0,"ondisk_log_size":34,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:58:30.390130+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":62661,"num_objects":6,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":131,"num_read_kb":127,"num_write":36,"num_write_kb":76,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,1,2],"acting":[10,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"4.12","version":"0'0","reported_seq":28,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-12T02:36:47.009470+0000","last_change":"2024-09-12T02:35:12.574485+0000","last_active":"2024-09-12T02:36:47.009470+0000","last_peered":"2024-09-12T02:36:47.009470+0000","last_clean":"2024-09-12T02:36:47.009470+0000","last_became_active":"2024-09-12T02:35:12.573883+0000","last_became_peered":"2024-09-12T02:35:12.573883+0000","last_unstale":"2024-09-12T02:36:47.009470+0000","last_undegraded":"2024-09-12T02:36:47.009470+0000","last_fullsized":"2024-09-12T02:36:47.009470+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:35:11.552386+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:35:11.552386+0000","last_clean_scrub_stamp":"2024-09-12T02:35:11.552386+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:57:00.001595+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,8,11,5],"acting":[9,8,11,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.14","version":"0'0","reported_seq":37,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-12T02:36:47.153985+0000","last_change":"2024-09-12T02:35:02.505882+0000","last_active":"2024-09-12T02:36:47.153985+0000","last_peered":"2024-09-12T02:36:47.153985+0000","last_clean":"2024-09-12T02:36:47.153985+0000","last_became_active":"2024-09-12T02:35:02.504513+0000","last_became_peered":"2024-09-12T02:35:02.504513+0000","last_unstale":"2024-09-12T02:36:47.153985+0000","last_undegraded":"2024-09-12T02:36:47.153985+0000","last_fullsized":"2024-09-12T02:36:47.153985+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:35:01.470375+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:35:01.470375+0000","last_clean_scrub_stamp":"2024-09-12T02:35:01.470375+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:25:58.446843+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,8,4],"acting":[1,8,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.15","version":"93'5","reported_seq":47,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-12T02:36:47.065797+0000","last_change":"2024-09-12T02:35:00.068581+0000","last_active":"2024-09-12T02:36:47.065797+0000","last_peered":"2024-09-12T02:36:47.065797+0000","last_clean":"2024-09-12T02:36:47.065797+0000","last_became_active":"2024-09-12T02:35:00.068196+0000","last_became_peered":"2024-09-12T02:35:00.068196+0000","last_unstale":"2024-09-12T02:36:47.065797+0000","last_undegraded":"2024-09-12T02:36:47.065797+0000","last_fullsized":"2024-09-12T02:36:47.065797+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:34:59.027857+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:34:59.027857+0000","last_clean_scrub_stamp":"2024-09-12T02:34:59.027857+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:02:27.807799+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":672,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":7,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0,10],"acting":[5,0,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.13","version":"0'0","reported_seq":28,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-12T02:36:47.066933+0000","last_change":"2024-09-12T02:35:12.592600+0000","last_active":"2024-09-12T02:36:47.066933+0000","last_peered":"2024-09-12T02:36:47.066933+0000","last_clean":"2024-09-12T02:36:47.066933+0000","last_became_active":"2024-09-12T02:35:12.591976+0000","last_became_peered":"2024-09-12T02:35:12.591976+0000","last_unstale":"2024-09-12T02:36:47.066933+0000","last_undegraded":"2024-09-12T02:36:47.066933+0000","last_fullsized":"2024-09-12T02:36:47.066933+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:35:11.552386+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:35:11.552386+0000","last_clean_scrub_stamp":"2024-09-12T02:35:11.552386+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T14:23:23.077090+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1,2,9],"acting":[4,1,2,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":34,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-12T02:36:47.585853+0000","last_change":"2024-09-12T02:35:02.523261+0000","last_active":"2024-09-12T02:36:47.585853+0000","last_peered":"2024-09-12T02:36:47.585853+0000","last_clean":"2024-09-12T02:36:47.585853+0000","last_became_active":"2024-09-12T02:35:02.522919+0000","last_became_peered":"2024-09-12T02:35:02.522919+0000","last_unstale":"2024-09-12T02:36:47.585853+0000","last_undegraded":"2024-09-12T02:36:47.585853+0000","last_fullsized":"2024-09-12T02:36:47.585853+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:35:01.470375+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:35:01.470375+0000","last_clean_scrub_stamp":"2024-09-12T02:35:01.470375+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:51:54.774700+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4,5],"acting":[0,4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.16","version":"93'4","reported_seq":45,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-12T02:36:47.064954+0000","last_change":"2024-09-12T02:35:00.061316+0000","last_active":"2024-09-12T02:36:47.064954+0000","last_peered":"2024-09-12T02:36:47.064954+0000","last_clean":"2024-09-12T02:36:47.064954+0000","last_became_active":"2024-09-12T02:35:00.059753+0000","last_became_peered":"2024-09-12T02:35:00.059753+0000","last_unstale":"2024-09-12T02:36:47.064954+0000","last_undegraded":"2024-09-12T02:36:47.064954+0000","last_fullsized":"2024-09-12T02:36:47.064954+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:34:59.027857+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:34:59.027857+0000","last_clean_scrub_stamp":"2024-09-12T02:34:59.027857+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:43:15.836929+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,2],"acting":[7,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.10","version":"0'0","reported_seq":28,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-12T02:36:47.008562+0000","last_change":"2024-09-12T02:35:12.587080+0000","last_active":"2024-09-12T02:36:47.008562+0000","last_peered":"2024-09-12T02:36:47.008562+0000","last_clean":"2024-09-12T02:36:47.008562+0000","last_became_active":"2024-09-12T02:35:12.586322+0000","last_became_peered":"2024-09-12T02:35:12.586322+0000","last_unstale":"2024-09-12T02:36:47.008562+0000","last_undegraded":"2024-09-12T02:36:47.008562+0000","last_fullsized":"2024-09-12T02:36:47.008562+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:35:11.552386+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:35:11.552386+0000","last_clean_scrub_stamp":"2024-09-12T02:35:11.552386+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T13:37:00.736698+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,0,2,4],"acting":[9,0,2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":37,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-12T02:36:47.153997+0000","last_change":"2024-09-12T02:35:02.510240+0000","last_active":"2024-09-12T02:36:47.153997+0000","last_peered":"2024-09-12T02:36:47.153997+0000","last_clean":"2024-09-12T02:36:47.153997+0000","last_became_active":"2024-09-12T02:35:02.509909+0000","last_became_peered":"2024-09-12T02:35:02.509909+0000","last_unstale":"2024-09-12T02:36:47.153997+0000","last_undegraded":"2024-09-12T02:36:47.153997+0000","last_fullsized":"2024-09-12T02:36:47.153997+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:35:01.470375+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:35:01.470375+0000","last_clean_scrub_stamp":"2024-09-12T02:35:01.470375+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:27:09.070786+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,10,9],"acting":[1,10,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.17","version":"93'4","reported_seq":169,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-12T02:36:53.072203+0000","last_change":"2024-09-12T02:35:00.054193+0000","last_active":"2024-09-12T02:36:53.072203+0000","last_peered":"2024-09-12T02:36:53.072203+0000","last_clean":"2024-09-12T02:36:53.072203+0000","last_became_active":"2024-09-12T02:35:00.053811+0000","last_became_peered":"2024-09-12T02:35:00.053811+0000","last_unstale":"2024-09-12T02:36:53.072203+0000","last_undegraded":"2024-09-12T02:36:53.072203+0000","last_fullsized":"2024-09-12T02:36:53.072203+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:34:59.027857+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:34:59.027857+0000","last_clean_scrub_stamp":"2024-09-12T02:34:59.027857+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:49:30.618015+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":180,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":124,"num_read_kb":124,"num_write":5,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,5,9],"acting":[10,5,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"4.11","version":"0'0","reported_seq":28,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-12T02:36:47.008973+0000","last_change":"2024-09-12T02:35:12.579772+0000","last_active":"2024-09-12T02:36:47.008973+0000","last_peered":"2024-09-12T02:36:47.008973+0000","last_clean":"2024-09-12T02:36:47.008973+0000","last_became_active":"2024-09-12T02:35:12.579257+0000","last_became_peered":"2024-09-12T02:35:12.579257+0000","last_unstale":"2024-09-12T02:36:47.008973+0000","last_undegraded":"2024-09-12T02:36:47.008973+0000","last_fullsized":"2024-09-12T02:36:47.008973+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:35:11.552386+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:35:11.552386+0000","last_clean_scrub_stamp":"2024-09-12T02:35:11.552386+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:08:40.588248+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,1,5],"acting":[3,7,1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1e","version":"0'0","reported_seq":26,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-12T02:36:47.585875+0000","last_change":"2024-09-12T02:35:12.585212+0000","last_active":"2024-09-12T02:36:47.585875+0000","last_peered":"2024-09-12T02:36:47.585875+0000","last_clean":"2024-09-12T02:36:47.585875+0000","last_became_active":"2024-09-12T02:35:12.583272+0000","last_became_peered":"2024-09-12T02:35:12.583272+0000","last_unstale":"2024-09-12T02:36:47.585875+0000","last_undegraded":"2024-09-12T02:36:47.585875+0000","last_fullsized":"2024-09-12T02:36:47.585875+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:35:11.552386+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:35:11.552386+0000","last_clean_scrub_stamp":"2024-09-12T02:35:11.552386+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:03:28.264565+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7,6,1],"acting":[0,7,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":38,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-12T02:36:47.009066+0000","last_change":"2024-09-12T02:35:02.512310+0000","last_active":"2024-09-12T02:36:47.009066+0000","last_peered":"2024-09-12T02:36:47.009066+0000","last_clean":"2024-09-12T02:36:47.009066+0000","last_became_active":"2024-09-12T02:35:02.511969+0000","last_became_peered":"2024-09-12T02:35:02.511969+0000","last_unstale":"2024-09-12T02:36:47.009066+0000","last_undegraded":"2024-09-12T02:36:47.009066+0000","last_fullsized":"2024-09-12T02:36:47.009066+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:35:01.470375+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:35:01.470375+0000","last_clean_scrub_stamp":"2024-09-12T02:35:01.470375+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:57:13.437331+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,3,10],"acting":[9,3,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"2.18","version":"93'3","reported_seq":45,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-12T02:36:47.065505+0000","last_change":"2024-09-12T02:35:00.059989+0000","last_active":"2024-09-12T02:36:47.065505+0000","last_peered":"2024-09-12T02:36:47.065505+0000","last_clean":"2024-09-12T02:36:47.065505+0000","last_became_active":"2024-09-12T02:35:00.059659+0000","last_became_peered":"2024-09-12T02:35:00.059659+0000","last_unstale":"2024-09-12T02:36:47.065505+0000","last_undegraded":"2024-09-12T02:36:47.065505+0000","last_fullsized":"2024-09-12T02:36:47.065505+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:34:59.027857+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:34:59.027857+0000","last_clean_scrub_stamp":"2024-09-12T02:34:59.027857+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:19:37.650136+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1,7],"acting":[5,1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1f","version":"0'0","reported_seq":28,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-12T02:36:47.153982+0000","last_change":"2024-09-12T02:35:12.589003+0000","last_active":"2024-09-12T02:36:47.153982+0000","last_peered":"2024-09-12T02:36:47.153982+0000","last_clean":"2024-09-12T02:36:47.153982+0000","last_became_active":"2024-09-12T02:35:12.588526+0000","last_became_peered":"2024-09-12T02:35:12.588526+0000","last_unstale":"2024-09-12T02:36:47.153982+0000","last_undegraded":"2024-09-12T02:36:47.153982+0000","last_fullsized":"2024-09-12T02:36:47.153982+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:35:11.552386+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:35:11.552386+0000","last_clean_scrub_stamp":"2024-09-12T02:35:11.552386+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T13:33:04.109195+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,4,9,0],"acting":[11,4,9,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":38,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-12T02:36:47.009494+0000","last_change":"2024-09-12T02:35:02.509603+0000","last_active":"2024-09-12T02:36:47.009494+0000","last_peered":"2024-09-12T02:36:47.009494+0000","last_clean":"2024-09-12T02:36:47.009494+0000","last_became_active":"2024-09-12T02:35:02.507799+0000","last_became_peered":"2024-09-12T02:35:02.507799+0000","last_unstale":"2024-09-12T02:36:47.009494+0000","last_undegraded":"2024-09-12T02:36:47.009494+0000","last_fullsized":"2024-09-12T02:36:47.009494+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:35:01.470375+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:35:01.470375+0000","last_clean_scrub_stamp":"2024-09-12T02:35:01.470375+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:27:06.148877+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,11,6],"acting":[3,11,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.19","version":"93'3","reported_seq":43,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-12T02:36:47.064216+0000","last_change":"2024-09-12T02:35:00.065183+0000","last_active":"2024-09-12T02:36:47.064216+0000","last_peered":"2024-09-12T02:36:47.064216+0000","last_clean":"2024-09-12T02:36:47.064216+0000","last_became_active":"2024-09-12T02:35:00.064234+0000","last_became_peered":"2024-09-12T02:35:00.064234+0000","last_unstale":"2024-09-12T02:36:47.064216+0000","last_undegraded":"2024-09-12T02:36:47.064216+0000","last_fullsized":"2024-09-12T02:36:47.064216+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:34:59.027857+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:34:59.027857+0000","last_clean_scrub_stamp":"2024-09-12T02:34:59.027857+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:25:27.578117+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,9],"acting":[6,4,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.1a","version":"93'7","reported_seq":48,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-12T02:36:47.063009+0000","last_change":"2024-09-12T02:35:00.061590+0000","last_active":"2024-09-12T02:36:47.063009+0000","last_peered":"2024-09-12T02:36:47.063009+0000","last_clean":"2024-09-12T02:36:47.063009+0000","last_became_active":"2024-09-12T02:35:00.061266+0000","last_became_peered":"2024-09-12T02:35:00.061266+0000","last_unstale":"2024-09-12T02:36:47.063009+0000","last_undegraded":"2024-09-12T02:36:47.063009+0000","last_fullsized":"2024-09-12T02:36:47.063009+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:34:59.027857+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:34:59.027857+0000","last_clean_scrub_stamp":"2024-09-12T02:34:59.027857+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:46:39.137050+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":9,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,8,6],"acting":[10,8,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.1b","version":"0'0","reported_seq":36,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-12T02:36:47.065292+0000","last_change":"2024-09-12T02:35:02.508064+0000","last_active":"2024-09-12T02:36:47.065292+0000","last_peered":"2024-09-12T02:36:47.065292+0000","last_clean":"2024-09-12T02:36:47.065292+0000","last_became_active":"2024-09-12T02:35:02.507737+0000","last_became_peered":"2024-09-12T02:35:02.507737+0000","last_unstale":"2024-09-12T02:36:47.065292+0000","last_undegraded":"2024-09-12T02:36:47.065292+0000","last_fullsized":"2024-09-12T02:36:47.065292+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:35:01.470375+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:35:01.470375+0000","last_clean_scrub_stamp":"2024-09-12T02:35:01.470375+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:39:53.655575+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,3],"acting":[5,4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1c","version":"0'0","reported_seq":28,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-12T02:36:47.013134+0000","last_change":"2024-09-12T02:35:12.588770+0000","last_active":"2024-09-12T02:36:47.013134+0000","last_peered":"2024-09-12T02:36:47.013134+0000","last_clean":"2024-09-12T02:36:47.013134+0000","last_became_active":"2024-09-12T02:35:12.588104+0000","last_became_peered":"2024-09-12T02:35:12.588104+0000","last_unstale":"2024-09-12T02:36:47.013134+0000","last_undegraded":"2024-09-12T02:36:47.013134+0000","last_fullsized":"2024-09-12T02:36:47.013134+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:35:11.552386+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:35:11.552386+0000","last_clean_scrub_stamp":"2024-09-12T02:35:11.552386+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:31:05.068737+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6,9,5],"acting":[2,6,9,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1b","version":"93'5","reported_seq":116,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-12T02:36:52.072109+0000","last_change":"2024-09-12T02:35:46.834966+0000","last_active":"2024-09-12T02:36:52.072109+0000","last_peered":"2024-09-12T02:36:52.072109+0000","last_clean":"2024-09-12T02:36:52.072109+0000","last_became_active":"2024-09-12T02:35:46.834652+0000","last_became_peered":"2024-09-12T02:35:46.834652+0000","last_unstale":"2024-09-12T02:36:52.072109+0000","last_undegraded":"2024-09-12T02:36:52.072109+0000","last_fullsized":"2024-09-12T02:36:52.072109+0000","mapping_epoch":92,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":93,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:34:59.027857+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:34:59.027857+0000","last_clean_scrub_stamp":"2024-09-12T02:34:59.027857+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:10:48.506122+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":622,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":64,"num_read_kb":2,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,7],"acting":[5,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.1a","version":"0'0","reported_seq":35,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-12T02:36:47.011185+0000","last_change":"2024-09-12T02:35:02.507569+0000","last_active":"2024-09-12T02:36:47.011185+0000","last_peered":"2024-09-12T02:36:47.011185+0000","last_clean":"2024-09-12T02:36:47.011185+0000","last_became_active":"2024-09-12T02:35:02.507244+0000","last_became_peered":"2024-09-12T02:35:02.507244+0000","last_unstale":"2024-09-12T02:36:47.011185+0000","last_undegraded":"2024-09-12T02:36:47.011185+0000","last_fullsized":"2024-09-12T02:36:47.011185+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:35:01.470375+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:35:01.470375+0000","last_clean_scrub_stamp":"2024-09-12T02:35:01.470375+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:50:26.959314+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,9,5],"acting":[8,9,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"4.1d","version":"0'0","reported_seq":28,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-12T02:36:47.013418+0000","last_change":"2024-09-12T02:35:12.577997+0000","last_active":"2024-09-12T02:36:47.013418+0000","last_peered":"2024-09-12T02:36:47.013418+0000","last_clean":"2024-09-12T02:36:47.013418+0000","last_became_active":"2024-09-12T02:35:12.577577+0000","last_became_peered":"2024-09-12T02:35:12.577577+0000","last_unstale":"2024-09-12T02:36:47.013418+0000","last_undegraded":"2024-09-12T02:36:47.013418+0000","last_fullsized":"2024-09-12T02:36:47.013418+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:35:11.552386+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:35:11.552386+0000","last_clean_scrub_stamp":"2024-09-12T02:35:11.552386+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:33:51.562986+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5,7,11],"acting":[2,5,7,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.20","version":"0'0","reported_seq":35,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-12T02:36:47.153793+0000","last_change":"2024-09-12T02:35:02.509328+0000","last_active":"2024-09-12T02:36:47.153793+0000","last_peered":"2024-09-12T02:36:47.153793+0000","last_clean":"2024-09-12T02:36:47.153793+0000","last_became_active":"2024-09-12T02:35:02.509000+0000","last_became_peered":"2024-09-12T02:35:02.509000+0000","last_unstale":"2024-09-12T02:36:47.153793+0000","last_undegraded":"2024-09-12T02:36:47.153793+0000","last_fullsized":"2024-09-12T02:36:47.153793+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:35:01.470375+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:35:01.470375+0000","last_clean_scrub_stamp":"2024-09-12T02:35:01.470375+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:46:49.170900+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,2,5],"acting":[11,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.21","version":"0'0","reported_seq":38,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-12T02:36:47.013799+0000","last_change":"2024-09-12T02:35:02.515252+0000","last_active":"2024-09-12T02:36:47.013799+0000","last_peered":"2024-09-12T02:36:47.013799+0000","last_clean":"2024-09-12T02:36:47.013799+0000","last_became_active":"2024-09-12T02:35:02.514959+0000","last_became_peered":"2024-09-12T02:35:02.514959+0000","last_unstale":"2024-09-12T02:36:47.013799+0000","last_undegraded":"2024-09-12T02:36:47.013799+0000","last_fullsized":"2024-09-12T02:36:47.013799+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:35:01.470375+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:35:01.470375+0000","last_clean_scrub_stamp":"2024-09-12T02:35:01.470375+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:42:02.769604+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5,4],"acting":[2,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.22","version":"0'0","reported_seq":38,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-12T02:36:47.012980+0000","last_change":"2024-09-12T02:35:02.516334+0000","last_active":"2024-09-12T02:36:47.012980+0000","last_peered":"2024-09-12T02:36:47.012980+0000","last_clean":"2024-09-12T02:36:47.012980+0000","last_became_active":"2024-09-12T02:35:02.515949+0000","last_became_peered":"2024-09-12T02:35:02.515949+0000","last_unstale":"2024-09-12T02:36:47.012980+0000","last_undegraded":"2024-09-12T02:36:47.012980+0000","last_fullsized":"2024-09-12T02:36:47.012980+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:35:01.470375+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:35:01.470375+0000","last_clean_scrub_stamp":"2024-09-12T02:35:01.470375+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:41:00.677038+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0],"acting":[2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.23","version":"0'0","reported_seq":34,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-12T02:36:47.585549+0000","last_change":"2024-09-12T02:35:02.516701+0000","last_active":"2024-09-12T02:36:47.585549+0000","last_peered":"2024-09-12T02:36:47.585549+0000","last_clean":"2024-09-12T02:36:47.585549+0000","last_became_active":"2024-09-12T02:35:02.516384+0000","last_became_peered":"2024-09-12T02:35:02.516384+0000","last_unstale":"2024-09-12T02:36:47.585549+0000","last_undegraded":"2024-09-12T02:36:47.585549+0000","last_fullsized":"2024-09-12T02:36:47.585549+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:35:01.470375+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:35:01.470375+0000","last_clean_scrub_stamp":"2024-09-12T02:35:01.470375+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:11:43.591371+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6,4],"acting":[0,6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.24","version":"0'0","reported_seq":41,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-12T02:36:47.064713+0000","last_change":"2024-09-12T02:35:46.737445+0000","last_active":"2024-09-12T02:36:47.064713+0000","last_peered":"2024-09-12T02:36:47.064713+0000","last_clean":"2024-09-12T02:36:47.064713+0000","last_became_active":"2024-09-12T02:35:46.736786+0000","last_became_peered":"2024-09-12T02:35:46.736786+0000","last_unstale":"2024-09-12T02:36:47.064713+0000","last_undegraded":"2024-09-12T02:36:47.064713+0000","last_fullsized":"2024-09-12T02:36:47.064713+0000","mapping_epoch":92,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":93,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:35:01.470375+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:35:01.470375+0000","last_clean_scrub_stamp":"2024-09-12T02:35:01.470375+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:25:54.143479+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,9,0],"acting":[6,9,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.25","version":"0'0","reported_seq":35,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-12T02:36:47.154119+0000","last_change":"2024-09-12T02:35:02.508237+0000","last_active":"2024-09-12T02:36:47.154119+0000","last_peered":"2024-09-12T02:36:47.154119+0000","last_clean":"2024-09-12T02:36:47.154119+0000","last_became_active":"2024-09-12T02:35:02.507911+0000","last_became_peered":"2024-09-12T02:35:02.507911+0000","last_unstale":"2024-09-12T02:36:47.154119+0000","last_undegraded":"2024-09-12T02:36:47.154119+0000","last_fullsized":"2024-09-12T02:36:47.154119+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:35:01.470375+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:35:01.470375+0000","last_clean_scrub_stamp":"2024-09-12T02:35:01.470375+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T13:13:38.863684+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,8,5],"acting":[11,8,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.26","version":"0'0","reported_seq":38,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-12T02:36:47.013729+0000","last_change":"2024-09-12T02:35:02.511218+0000","last_active":"2024-09-12T02:36:47.013729+0000","last_peered":"2024-09-12T02:36:47.013729+0000","last_clean":"2024-09-12T02:36:47.013729+0000","last_became_active":"2024-09-12T02:35:02.510533+0000","last_became_peered":"2024-09-12T02:35:02.510533+0000","last_unstale":"2024-09-12T02:36:47.013729+0000","last_undegraded":"2024-09-12T02:36:47.013729+0000","last_fullsized":"2024-09-12T02:36:47.013729+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:35:01.470375+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:35:01.470375+0000","last_clean_scrub_stamp":"2024-09-12T02:35:01.470375+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:16:00.293407+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,8,1],"acting":[2,8,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.27","version":"0'0","reported_seq":38,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-12T02:36:47.010544+0000","last_change":"2024-09-12T02:35:02.512531+0000","last_active":"2024-09-12T02:36:47.010544+0000","last_peered":"2024-09-12T02:36:47.010544+0000","last_clean":"2024-09-12T02:36:47.010544+0000","last_became_active":"2024-09-12T02:35:02.509796+0000","last_became_peered":"2024-09-12T02:35:02.509796+0000","last_unstale":"2024-09-12T02:36:47.010544+0000","last_undegraded":"2024-09-12T02:36:47.010544+0000","last_fullsized":"2024-09-12T02:36:47.010544+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:35:01.470375+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:35:01.470375+0000","last_clean_scrub_stamp":"2024-09-12T02:35:01.470375+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:56:42.613776+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4,2],"acting":[3,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.28","version":"0'0","reported_seq":36,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-12T02:36:47.065172+0000","last_change":"2024-09-12T02:35:02.507891+0000","last_active":"2024-09-12T02:36:47.065172+0000","last_peered":"2024-09-12T02:36:47.065172+0000","last_clean":"2024-09-12T02:36:47.065172+0000","last_became_active":"2024-09-12T02:35:02.507548+0000","last_became_peered":"2024-09-12T02:35:02.507548+0000","last_unstale":"2024-09-12T02:36:47.065172+0000","last_undegraded":"2024-09-12T02:36:47.065172+0000","last_fullsized":"2024-09-12T02:36:47.065172+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:35:01.470375+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:35:01.470375+0000","last_clean_scrub_stamp":"2024-09-12T02:35:01.470375+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:35:12.386932+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,9,3],"acting":[5,9,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.29","version":"0'0","reported_seq":38,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-12T02:36:47.009141+0000","last_change":"2024-09-12T02:35:02.518093+0000","last_active":"2024-09-12T02:36:47.009141+0000","last_peered":"2024-09-12T02:36:47.009141+0000","last_clean":"2024-09-12T02:36:47.009141+0000","last_became_active":"2024-09-12T02:35:02.512045+0000","last_became_peered":"2024-09-12T02:35:02.512045+0000","last_unstale":"2024-09-12T02:36:47.009141+0000","last_undegraded":"2024-09-12T02:36:47.009141+0000","last_fullsized":"2024-09-12T02:36:47.009141+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:35:01.470375+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:35:01.470375+0000","last_clean_scrub_stamp":"2024-09-12T02:35:01.470375+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:06:35.765876+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,11],"acting":[3,2,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2a","version":"0'0","reported_seq":37,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-12T02:36:47.153863+0000","last_change":"2024-09-12T02:35:02.516522+0000","last_active":"2024-09-12T02:36:47.153863+0000","last_peered":"2024-09-12T02:36:47.153863+0000","last_clean":"2024-09-12T02:36:47.153863+0000","last_became_active":"2024-09-12T02:35:02.516178+0000","last_became_peered":"2024-09-12T02:35:02.516178+0000","last_unstale":"2024-09-12T02:36:47.153863+0000","last_undegraded":"2024-09-12T02:36:47.153863+0000","last_fullsized":"2024-09-12T02:36:47.153863+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:35:01.470375+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:35:01.470375+0000","last_clean_scrub_stamp":"2024-09-12T02:35:01.470375+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:00:01.397055+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7,3],"acting":[1,7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2b","version":"0'0","reported_seq":35,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-12T02:36:47.064588+0000","last_change":"2024-09-12T02:35:02.513095+0000","last_active":"2024-09-12T02:36:47.064588+0000","last_peered":"2024-09-12T02:36:47.064588+0000","last_clean":"2024-09-12T02:36:47.064588+0000","last_became_active":"2024-09-12T02:35:02.512782+0000","last_became_peered":"2024-09-12T02:35:02.512782+0000","last_unstale":"2024-09-12T02:36:47.064588+0000","last_undegraded":"2024-09-12T02:36:47.064588+0000","last_fullsized":"2024-09-12T02:36:47.064588+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:35:01.470375+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:35:01.470375+0000","last_clean_scrub_stamp":"2024-09-12T02:35:01.470375+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:19:05.954874+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,0],"acting":[6,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.2c","version":"0'0","reported_seq":35,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-12T02:36:47.153818+0000","last_change":"2024-09-12T02:35:02.503773+0000","last_active":"2024-09-12T02:36:47.153818+0000","last_peered":"2024-09-12T02:36:47.153818+0000","last_clean":"2024-09-12T02:36:47.153818+0000","last_became_active":"2024-09-12T02:35:02.503386+0000","last_became_peered":"2024-09-12T02:35:02.503386+0000","last_unstale":"2024-09-12T02:36:47.153818+0000","last_undegraded":"2024-09-12T02:36:47.153818+0000","last_fullsized":"2024-09-12T02:36:47.153818+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:35:01.470375+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:35:01.470375+0000","last_clean_scrub_stamp":"2024-09-12T02:35:01.470375+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:15:44.995245+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,4,8],"acting":[11,4,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.2d","version":"0'0","reported_seq":38,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-12T02:36:47.013711+0000","last_change":"2024-09-12T02:35:02.516429+0000","last_active":"2024-09-12T02:36:47.013711+0000","last_peered":"2024-09-12T02:36:47.013711+0000","last_clean":"2024-09-12T02:36:47.013711+0000","last_became_active":"2024-09-12T02:35:02.515907+0000","last_became_peered":"2024-09-12T02:35:02.515907+0000","last_unstale":"2024-09-12T02:36:47.013711+0000","last_undegraded":"2024-09-12T02:36:47.013711+0000","last_fullsized":"2024-09-12T02:36:47.013711+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:35:01.470375+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:35:01.470375+0000","last_clean_scrub_stamp":"2024-09-12T02:35:01.470375+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:30:04.631809+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,6],"acting":[2,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2e","version":"0'0","reported_seq":38,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-12T02:36:47.009837+0000","last_change":"2024-09-12T02:35:02.505181+0000","last_active":"2024-09-12T02:36:47.009837+0000","last_peered":"2024-09-12T02:36:47.009837+0000","last_clean":"2024-09-12T02:36:47.009837+0000","last_became_active":"2024-09-12T02:35:02.504824+0000","last_became_peered":"2024-09-12T02:35:02.504824+0000","last_unstale":"2024-09-12T02:36:47.009837+0000","last_undegraded":"2024-09-12T02:36:47.009837+0000","last_fullsized":"2024-09-12T02:36:47.009837+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:35:01.470375+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:35:01.470375+0000","last_clean_scrub_stamp":"2024-09-12T02:35:01.470375+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T14:00:57.800731+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,1,10],"acting":[9,1,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.2f","version":"0'0","reported_seq":35,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-12T02:36:47.154257+0000","last_change":"2024-09-12T02:35:02.520568+0000","last_active":"2024-09-12T02:36:47.154257+0000","last_peered":"2024-09-12T02:36:47.154257+0000","last_clean":"2024-09-12T02:36:47.154257+0000","last_became_active":"2024-09-12T02:35:02.520244+0000","last_became_peered":"2024-09-12T02:35:02.520244+0000","last_unstale":"2024-09-12T02:36:47.154257+0000","last_undegraded":"2024-09-12T02:36:47.154257+0000","last_fullsized":"2024-09-12T02:36:47.154257+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:35:01.470375+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:35:01.470375+0000","last_clean_scrub_stamp":"2024-09-12T02:35:01.470375+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:42:25.130404+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,1,0],"acting":[11,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.30","version":"0'0","reported_seq":37,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-12T02:36:47.153407+0000","last_change":"2024-09-12T02:35:02.514647+0000","last_active":"2024-09-12T02:36:47.153407+0000","last_peered":"2024-09-12T02:36:47.153407+0000","last_clean":"2024-09-12T02:36:47.153407+0000","last_became_active":"2024-09-12T02:35:02.513930+0000","last_became_peered":"2024-09-12T02:35:02.513930+0000","last_unstale":"2024-09-12T02:36:47.153407+0000","last_undegraded":"2024-09-12T02:36:47.153407+0000","last_fullsized":"2024-09-12T02:36:47.153407+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:35:01.470375+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:35:01.470375+0000","last_clean_scrub_stamp":"2024-09-12T02:35:01.470375+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:56:32.701937+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7,0],"acting":[1,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.31","version":"0'0","reported_seq":34,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-12T02:36:47.585502+0000","last_change":"2024-09-12T02:35:02.512230+0000","last_active":"2024-09-12T02:36:47.585502+0000","last_peered":"2024-09-12T02:36:47.585502+0000","last_clean":"2024-09-12T02:36:47.585502+0000","last_became_active":"2024-09-12T02:35:02.508114+0000","last_became_peered":"2024-09-12T02:35:02.508114+0000","last_unstale":"2024-09-12T02:36:47.585502+0000","last_undegraded":"2024-09-12T02:36:47.585502+0000","last_fullsized":"2024-09-12T02:36:47.585502+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:35:01.470375+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:35:01.470375+0000","last_clean_scrub_stamp":"2024-09-12T02:35:01.470375+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:37:53.225043+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4,2],"acting":[0,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.32","version":"0'0","reported_seq":34,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-12T02:36:47.585602+0000","last_change":"2024-09-12T02:35:02.519176+0000","last_active":"2024-09-12T02:36:47.585602+0000","last_peered":"2024-09-12T02:36:47.585602+0000","last_clean":"2024-09-12T02:36:47.585602+0000","last_became_active":"2024-09-12T02:35:02.518437+0000","last_became_peered":"2024-09-12T02:35:02.518437+0000","last_unstale":"2024-09-12T02:36:47.585602+0000","last_undegraded":"2024-09-12T02:36:47.585602+0000","last_fullsized":"2024-09-12T02:36:47.585602+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:35:01.470375+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:35:01.470375+0000","last_clean_scrub_stamp":"2024-09-12T02:35:01.470375+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:46:32.198479+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,8,10],"acting":[0,8,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.33","version":"0'0","reported_seq":41,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-12T02:36:47.064541+0000","last_change":"2024-09-12T02:35:46.759182+0000","last_active":"2024-09-12T02:36:47.064541+0000","last_peered":"2024-09-12T02:36:47.064541+0000","last_clean":"2024-09-12T02:36:47.064541+0000","last_became_active":"2024-09-12T02:35:46.758619+0000","last_became_peered":"2024-09-12T02:35:46.758619+0000","last_unstale":"2024-09-12T02:36:47.064541+0000","last_undegraded":"2024-09-12T02:36:47.064541+0000","last_fullsized":"2024-09-12T02:36:47.064541+0000","mapping_epoch":92,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":93,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:35:01.470375+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:35:01.470375+0000","last_clean_scrub_stamp":"2024-09-12T02:35:01.470375+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:35:55.039970+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,10,9],"acting":[6,10,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.34","version":"0'0","reported_seq":15,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-12T02:36:47.009570+0000","last_change":"2024-09-12T02:35:46.758945+0000","last_active":"2024-09-12T02:36:47.009570+0000","last_peered":"2024-09-12T02:36:47.009570+0000","last_clean":"2024-09-12T02:36:47.009570+0000","last_became_active":"2024-09-12T02:35:46.758522+0000","last_became_peered":"2024-09-12T02:35:46.758522+0000","last_unstale":"2024-09-12T02:36:47.009570+0000","last_undegraded":"2024-09-12T02:36:47.009570+0000","last_fullsized":"2024-09-12T02:36:47.009570+0000","mapping_epoch":92,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":93,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:35:01.470375+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:35:01.470375+0000","last_clean_scrub_stamp":"2024-09-12T02:35:01.470375+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:18:47.916784+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,10,8],"acting":[9,10,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.35","version":"0'0","reported_seq":37,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-12T02:36:47.064868+0000","last_change":"2024-09-12T02:35:02.511777+0000","last_active":"2024-09-12T02:36:47.064868+0000","last_peered":"2024-09-12T02:36:47.064868+0000","last_clean":"2024-09-12T02:36:47.064868+0000","last_became_active":"2024-09-12T02:35:02.511341+0000","last_became_peered":"2024-09-12T02:35:02.511341+0000","last_unstale":"2024-09-12T02:36:47.064868+0000","last_undegraded":"2024-09-12T02:36:47.064868+0000","last_fullsized":"2024-09-12T02:36:47.064868+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:35:01.470375+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:35:01.470375+0000","last_clean_scrub_stamp":"2024-09-12T02:35:01.470375+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:51:52.093252+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,8,1],"acting":[7,8,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.36","version":"0'0","reported_seq":36,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-12T02:36:47.063286+0000","last_change":"2024-09-12T02:35:02.510278+0000","last_active":"2024-09-12T02:36:47.063286+0000","last_peered":"2024-09-12T02:36:47.063286+0000","last_clean":"2024-09-12T02:36:47.063286+0000","last_became_active":"2024-09-12T02:35:02.509959+0000","last_became_peered":"2024-09-12T02:35:02.509959+0000","last_unstale":"2024-09-12T02:36:47.063286+0000","last_undegraded":"2024-09-12T02:36:47.063286+0000","last_fullsized":"2024-09-12T02:36:47.063286+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:35:01.470375+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:35:01.470375+0000","last_clean_scrub_stamp":"2024-09-12T02:35:01.470375+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:34:55.086493+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,2,4],"acting":[10,2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.37","version":"0'0","reported_seq":37,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-12T02:36:47.153929+0000","last_change":"2024-09-12T02:35:02.508143+0000","last_active":"2024-09-12T02:36:47.153929+0000","last_peered":"2024-09-12T02:36:47.153929+0000","last_clean":"2024-09-12T02:36:47.153929+0000","last_became_active":"2024-09-12T02:35:02.507096+0000","last_became_peered":"2024-09-12T02:35:02.507096+0000","last_unstale":"2024-09-12T02:36:47.153929+0000","last_undegraded":"2024-09-12T02:36:47.153929+0000","last_fullsized":"2024-09-12T02:36:47.153929+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:35:01.470375+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:35:01.470375+0000","last_clean_scrub_stamp":"2024-09-12T02:35:01.470375+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:04:15.687448+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,11],"acting":[1,5,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.38","version":"0'0","reported_seq":38,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-12T02:36:47.009441+0000","last_change":"2024-09-12T02:35:02.517013+0000","last_active":"2024-09-12T02:36:47.009441+0000","last_peered":"2024-09-12T02:36:47.009441+0000","last_clean":"2024-09-12T02:36:47.009441+0000","last_became_active":"2024-09-12T02:35:02.511344+0000","last_became_peered":"2024-09-12T02:35:02.511344+0000","last_unstale":"2024-09-12T02:36:47.009441+0000","last_undegraded":"2024-09-12T02:36:47.009441+0000","last_fullsized":"2024-09-12T02:36:47.009441+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:35:01.470375+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:35:01.470375+0000","last_clean_scrub_stamp":"2024-09-12T02:35:01.470375+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:35:56.829248+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5,10],"acting":[3,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.39","version":"0'0","reported_seq":37,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-12T02:36:47.064445+0000","last_change":"2024-09-12T02:35:02.515221+0000","last_active":"2024-09-12T02:36:47.064445+0000","last_peered":"2024-09-12T02:36:47.064445+0000","last_clean":"2024-09-12T02:36:47.064445+0000","last_became_active":"2024-09-12T02:35:02.514878+0000","last_became_peered":"2024-09-12T02:35:02.514878+0000","last_unstale":"2024-09-12T02:36:47.064445+0000","last_undegraded":"2024-09-12T02:36:47.064445+0000","last_fullsized":"2024-09-12T02:36:47.064445+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:35:01.470375+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:35:01.470375+0000","last_clean_scrub_stamp":"2024-09-12T02:35:01.470375+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:30:49.794740+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,9,5],"acting":[7,9,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3a","version":"0'0","reported_seq":36,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-12T02:36:47.062543+0000","last_change":"2024-09-12T02:35:02.506118+0000","last_active":"2024-09-12T02:36:47.062543+0000","last_peered":"2024-09-12T02:36:47.062543+0000","last_clean":"2024-09-12T02:36:47.062543+0000","last_became_active":"2024-09-12T02:35:02.505802+0000","last_became_peered":"2024-09-12T02:35:02.505802+0000","last_unstale":"2024-09-12T02:36:47.062543+0000","last_undegraded":"2024-09-12T02:36:47.062543+0000","last_fullsized":"2024-09-12T02:36:47.062543+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:35:01.470375+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:35:01.470375+0000","last_clean_scrub_stamp":"2024-09-12T02:35:01.470375+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:39:29.295096+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,9,4],"acting":[10,9,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.3b","version":"0'0","reported_seq":35,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-12T02:36:47.011164+0000","last_change":"2024-09-12T02:35:02.514743+0000","last_active":"2024-09-12T02:36:47.011164+0000","last_peered":"2024-09-12T02:36:47.011164+0000","last_clean":"2024-09-12T02:36:47.011164+0000","last_became_active":"2024-09-12T02:35:02.514299+0000","last_became_peered":"2024-09-12T02:35:02.514299+0000","last_unstale":"2024-09-12T02:36:47.011164+0000","last_undegraded":"2024-09-12T02:36:47.011164+0000","last_fullsized":"2024-09-12T02:36:47.011164+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:35:01.470375+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:35:01.470375+0000","last_clean_scrub_stamp":"2024-09-12T02:35:01.470375+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T13:31:30.632444+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,3,6],"acting":[8,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.3c","version":"0'0","reported_seq":36,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-12T02:36:47.066975+0000","last_change":"2024-09-12T02:35:02.504682+0000","last_active":"2024-09-12T02:36:47.066975+0000","last_peered":"2024-09-12T02:36:47.066975+0000","last_clean":"2024-09-12T02:36:47.066975+0000","last_became_active":"2024-09-12T02:35:02.504154+0000","last_became_peered":"2024-09-12T02:35:02.504154+0000","last_unstale":"2024-09-12T02:36:47.066975+0000","last_undegraded":"2024-09-12T02:36:47.066975+0000","last_fullsized":"2024-09-12T02:36:47.066975+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:35:01.470375+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:35:01.470375+0000","last_clean_scrub_stamp":"2024-09-12T02:35:01.470375+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:46:38.038655+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,8,2],"acting":[4,8,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.3d","version":"0'0","reported_seq":34,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-12T02:36:47.585827+0000","last_change":"2024-09-12T02:35:02.513117+0000","last_active":"2024-09-12T02:36:47.585827+0000","last_peered":"2024-09-12T02:36:47.585827+0000","last_clean":"2024-09-12T02:36:47.585827+0000","last_became_active":"2024-09-12T02:35:02.512824+0000","last_became_peered":"2024-09-12T02:35:02.512824+0000","last_unstale":"2024-09-12T02:36:47.585827+0000","last_undegraded":"2024-09-12T02:36:47.585827+0000","last_fullsized":"2024-09-12T02:36:47.585827+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:35:01.470375+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:35:01.470375+0000","last_clean_scrub_stamp":"2024-09-12T02:35:01.470375+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:18:22.413221+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,1],"acting":[0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3e","version":"0'0","reported_seq":34,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-12T02:36:47.586109+0000","last_change":"2024-09-12T02:35:02.517799+0000","last_active":"2024-09-12T02:36:47.586109+0000","last_peered":"2024-09-12T02:36:47.586109+0000","last_clean":"2024-09-12T02:36:47.586109+0000","last_became_active":"2024-09-12T02:35:02.513361+0000","last_became_peered":"2024-09-12T02:35:02.513361+0000","last_unstale":"2024-09-12T02:36:47.586109+0000","last_undegraded":"2024-09-12T02:36:47.586109+0000","last_fullsized":"2024-09-12T02:36:47.586109+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:35:01.470375+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:35:01.470375+0000","last_clean_scrub_stamp":"2024-09-12T02:35:01.470375+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T13:39:37.894677+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,11,10],"acting":[0,11,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3f","version":"0'0","reported_seq":35,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-12T02:36:47.154213+0000","last_change":"2024-09-12T02:35:02.520715+0000","last_active":"2024-09-12T02:36:47.154213+0000","last_peered":"2024-09-12T02:36:47.154213+0000","last_clean":"2024-09-12T02:36:47.154213+0000","last_became_active":"2024-09-12T02:35:02.520348+0000","last_became_peered":"2024-09-12T02:35:02.520348+0000","last_unstale":"2024-09-12T02:36:47.154213+0000","last_undegraded":"2024-09-12T02:36:47.154213+0000","last_fullsized":"2024-09-12T02:36:47.154213+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:35:01.470375+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:35:01.470375+0000","last_clean_scrub_stamp":"2024-09-12T02:35:01.470375+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:08:10.982486+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,1,0],"acting":[11,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]}],"pool_stats":[{"poolid":4,"num_pg":32,"stat_sum":{"num_bytes":234,"num_objects":2,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":32768,"data_stored":32768,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":2,"ondisk_log_size":2,"up":128,"acting":128,"num_store_stats":12},{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":192,"acting":192,"num_store_stats":12},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":70262,"num_objects":98,"num_object_clones":0,"num_object_copies":294,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":98,"num_whiteouts":0,"num_read":663,"num_read_kb":409,"num_write":248,"num_write_kb":142,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":5,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":66,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":577536,"data_stored":210786,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":214,"ondisk_log_size":214,"up":96,"acting":96,"num_store_stats":12},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":136,"num_read_kb":119,"num_write":181,"num_write_kb":2938,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":1180736,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":3563520,"data_stored":3542208,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":137,"ondisk_log_size":137,"up":3,"acting":3,"num_store_stats":8}],"osd_stats":[{"osd":11,"up_from":77,"seq":330712481828,"num_pgs":29,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":28112,"kb_used_data":1080,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717040,"statfs":{"total":95995035648,"available":95966248960,"internally_reserved":0,"allocated":1105920,"data_stored":545559,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1596,"internal_metadata":27654596},"hb_peers":[0,1,2,4,5,6,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":10,"up_from":70,"seq":300647710761,"num_pgs":32,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":28784,"kb_used_data":1752,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93716368,"statfs":{"total":95995035648,"available":95965560832,"internally_reserved":0,"allocated":1794048,"data_stored":1194924,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1600,"internal_metadata":27654592},"hb_peers":[0,1,2,3,4,5,6,8,9,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":9,"up_from":65,"seq":279172874286,"num_pgs":35,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":28132,"kb_used_data":1100,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717020,"statfs":{"total":95995035648,"available":95966228480,"internally_reserved":0,"allocated":1126400,"data_stored":549080,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1600,"internal_metadata":27654592},"hb_peers":[0,1,2,3,4,5,7,8,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":8,"up_from":57,"seq":244813135924,"num_pgs":31,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":28112,"kb_used_data":1084,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717040,"statfs":{"total":95995035648,"available":95966248960,"internally_reserved":0,"allocated":1110016,"data_stored":545250,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4,5,6,7,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":7,"up_from":50,"seq":214748364857,"num_pgs":36,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":28704,"kb_used_data":1676,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93716448,"statfs":{"total":95995035648,"available":95965642752,"internally_reserved":0,"allocated":1716224,"data_stored":1142254,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":27654602},"hb_peers":[1,2,3,4,5,6,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":6,"up_from":45,"seq":193273528382,"num_pgs":32,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":28100,"kb_used_data":1072,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717052,"statfs":{"total":95995035648,"available":95966261248,"internally_reserved":0,"allocated":1097728,"data_stored":540881,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,5,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":5,"up_from":38,"seq":163208757316,"num_pgs":44,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":28716,"kb_used_data":1684,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93716436,"statfs":{"total":95995035648,"available":95965630464,"internally_reserved":0,"allocated":1724416,"data_stored":1137050,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":4,"up_from":33,"seq":141733920842,"num_pgs":35,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":36440,"kb_used_data":1088,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":93708712,"statfs":{"total":95995035648,"available":95957721088,"internally_reserved":0,"allocated":1114112,"data_stored":545577,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":36174277},"hb_peers":[1,2,3,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":3,"up_from":26,"seq":111669149775,"num_pgs":40,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":32272,"kb_used_data":1084,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":93712880,"statfs":{"total":95995035648,"available":95961989120,"internally_reserved":0,"allocated":1110016,"data_stored":540196,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":31914439},"hb_peers":[0,1,2,4,5,6,7,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":18,"seq":77309411413,"num_pgs":35,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":28180,"kb_used_data":1152,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93716972,"statfs":{"total":95995035648,"available":95966179328,"internally_reserved":0,"allocated":1179648,"data_stored":604170,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,3,4,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":13,"seq":55834574938,"num_pgs":35,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":28168,"kb_used_data":1140,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93716984,"statfs":{"total":95995035648,"available":95966191616,"internally_reserved":0,"allocated":1167360,"data_stored":604572,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,2,3,4,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":8,"seq":34359738461,"num_pgs":35,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":32284,"kb_used_data":1096,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":93712868,"statfs":{"total":95995035648,"available":95961976832,"internally_reserved":0,"allocated":1122304,"data_stored":542337,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[1,2,3,4,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":40960,"data_stored":2571,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":86016,"data_stored":64806,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":98304,"data_stored":64404,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":28672,"data_stored":430,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":28672,"data_stored":1715,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":45056,"data_stored":2820,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":1115,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":32768,"data_stored":3928,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":24576,"data_stored":1388,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":9,"total":0,"available":0,"internally_reserved":0,"allocated":36864,"data_stored":1122,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":118784,"data_stored":64790,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":11,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":1697,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":9,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":11,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":4096,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":4096,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":8192,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":4096,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":9,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":8192,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":11,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":4096,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-12T02:36:57.877 INFO:tasks.cephadm.ceph_manager.ceph:clean! 2024-09-12T02:36:57.877 INFO:tasks.ceph:Waiting until ceph cluster ceph is healthy... 2024-09-12T02:36:57.877 INFO:tasks.cephadm.ceph_manager.ceph:wait_until_healthy 2024-09-12T02:36:57.878 DEBUG:teuthology.orchestra.run.smithi039:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc shell --fsid 4954ed46-70ae-11ef-bcea-c7b262605968 -- ceph health --format=json 2024-09-12T02:36:58.099 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 02:36:58 smithi039 ceph-mon[30515]: pgmap v361: 129 pgs: 129 active+clean; 645 KiB data, 348 MiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 9 op/s 2024-09-12T02:36:58.100 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 02:36:58 smithi039 ceph-mon[30515]: from='client.24911 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-09-12T02:36:58.258 INFO:teuthology.orchestra.run.smithi039.stderr:Inferring config /var/lib/ceph/4954ed46-70ae-11ef-bcea-c7b262605968/mon.a/config 2024-09-12T02:36:58.448 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 12 02:36:58 smithi044 ceph-mon[35411]: pgmap v361: 129 pgs: 129 active+clean; 645 KiB data, 348 MiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 9 op/s 2024-09-12T02:36:58.449 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 12 02:36:58 smithi044 ceph-mon[35411]: from='client.24911 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-09-12T02:36:58.513 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 12 02:36:58 smithi172 ceph-mon[35609]: pgmap v361: 129 pgs: 129 active+clean; 645 KiB data, 348 MiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 9 op/s 2024-09-12T02:36:58.514 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 12 02:36:58 smithi172 ceph-mon[35609]: from='client.24911 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-09-12T02:36:58.887 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:36:58.867+0000 7fc6ca200640 1 -- 172.21.15.39:0/3829098053 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fc6c4103e30 msgr2=0x7fc6c4104210 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:36:58.888 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:36:58.867+0000 7fc6ca200640 1 --2- 172.21.15.39:0/3829098053 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fc6c4103e30 0x7fc6c4104210 secure :-1 s=READY pgs=224 cs=0 l=1 rev1=1 crypto rx=0x7fc6b8009ca0 tx=0x7fc6b802a8c0 comp rx=0 tx=0).stop 2024-09-12T02:36:58.888 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:36:58.867+0000 7fc6ca200640 1 -- 172.21.15.39:0/3829098053 shutdown_connections 2024-09-12T02:36:58.888 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:36:58.867+0000 7fc6ca200640 1 --2- 172.21.15.39:0/3829098053 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fc6c4108f60 0x7fc6c4110ae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:36:58.888 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:36:58.867+0000 7fc6ca200640 1 --2- 172.21.15.39:0/3829098053 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fc6c41047e0 0x7fc6c4108830 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:36:58.888 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:36:58.867+0000 7fc6ca200640 1 --2- 172.21.15.39:0/3829098053 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fc6c4103e30 0x7fc6c4104210 unknown :-1 s=CLOSED pgs=224 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:36:58.888 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:36:58.867+0000 7fc6ca200640 1 -- 172.21.15.39:0/3829098053 >> 172.21.15.39:0/3829098053 conn(0x7fc6c40ff910 msgr2=0x7fc6c4101d30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:36:58.888 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:36:58.867+0000 7fc6ca200640 1 -- 172.21.15.39:0/3829098053 shutdown_connections 2024-09-12T02:36:58.888 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:36:58.867+0000 7fc6ca200640 1 -- 172.21.15.39:0/3829098053 wait complete. 2024-09-12T02:36:58.888 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:36:58.868+0000 7fc6ca200640 1 Processor -- start 2024-09-12T02:36:58.888 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:36:58.868+0000 7fc6ca200640 1 -- start start 2024-09-12T02:36:58.888 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:36:58.869+0000 7fc6ca200640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fc6c4103e30 0x7fc6c419a4a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:36:58.888 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:36:58.869+0000 7fc6ca200640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fc6c41047e0 0x7fc6c419a9e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:36:58.888 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:36:58.869+0000 7fc6ca200640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fc6c4108f60 0x7fc6c419ed70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:36:58.889 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:36:58.869+0000 7fc6ca200640 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 -- 0x7fc6c4113fc0 con 0x7fc6c4103e30 2024-09-12T02:36:58.889 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:36:58.869+0000 7fc6ca200640 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x7fc6c4113e40 con 0x7fc6c4108f60 2024-09-12T02:36:58.889 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:36:58.869+0000 7fc6ca200640 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7fc6c4114140 con 0x7fc6c41047e0 2024-09-12T02:36:58.889 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:36:58.869+0000 7fc6c8e00640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fc6c4103e30 0x7fc6c419a4a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:36:58.889 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:36:58.869+0000 7fc6c8e00640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fc6c4103e30 0x7fc6c419a4a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.39:3300/0 says I am v2:172.21.15.39:52870/0 (socket says 172.21.15.39:52870) 2024-09-12T02:36:58.889 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:36:58.869+0000 7fc6c8e00640 1 -- 172.21.15.39:0/3215612381 learned_addr learned my addr 172.21.15.39:0/3215612381 (peer_addr_for_me v2:172.21.15.39:0/0) 2024-09-12T02:36:58.889 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:36:58.869+0000 7fc6c3e00640 1 --2- 172.21.15.39:0/3215612381 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fc6c41047e0 0x7fc6c419a9e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:36:58.889 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:36:58.869+0000 7fc6c9800640 1 --2- 172.21.15.39:0/3215612381 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fc6c4108f60 0x7fc6c419ed70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:36:58.889 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:36:58.869+0000 7fc6c8e00640 1 -- 172.21.15.39:0/3215612381 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fc6c41047e0 msgr2=0x7fc6c419a9e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:36:58.889 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:36:58.869+0000 7fc6c8e00640 1 --2- 172.21.15.39:0/3215612381 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fc6c41047e0 0x7fc6c419a9e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:36:58.889 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:36:58.869+0000 7fc6c8e00640 1 -- 172.21.15.39:0/3215612381 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fc6c4108f60 msgr2=0x7fc6c419ed70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:36:58.889 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:36:58.869+0000 7fc6c8e00640 1 --2- 172.21.15.39:0/3215612381 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fc6c4108f60 0x7fc6c419ed70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:36:58.889 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:36:58.869+0000 7fc6c8e00640 1 -- 172.21.15.39:0/3215612381 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc6c419f450 con 0x7fc6c4103e30 2024-09-12T02:36:58.889 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:36:58.869+0000 7fc6c3e00640 1 --2- 172.21.15.39:0/3215612381 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fc6c41047e0 0x7fc6c419a9e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-12T02:36:58.890 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:36:58.869+0000 7fc6c9800640 1 --2- 172.21.15.39:0/3215612381 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fc6c4108f60 0x7fc6c419ed70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-12T02:36:58.890 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:36:58.870+0000 7fc6c8e00640 1 --2- 172.21.15.39:0/3215612381 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fc6c4103e30 0x7fc6c419a4a0 secure :-1 s=READY pgs=225 cs=0 l=1 rev1=1 crypto rx=0x7fc6b802ade0 tx=0x7fc6b80319f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:36:58.890 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:36:58.870+0000 7fc6c1600640 1 -- 172.21.15.39:0/3215612381 <== mon.0 v2:172.21.15.39:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc6b802fa20 con 0x7fc6c4103e30 2024-09-12T02:36:58.890 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:36:58.870+0000 7fc6ca200640 1 -- 172.21.15.39:0/3215612381 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc6c419f6e0 con 0x7fc6c4103e30 2024-09-12T02:36:58.890 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:36:58.870+0000 7fc6c1600640 1 -- 172.21.15.39:0/3215612381 <== mon.0 v2:172.21.15.39:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fc6b802fbc0 con 0x7fc6c4103e30 2024-09-12T02:36:58.890 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:36:58.870+0000 7fc6c1600640 1 -- 172.21.15.39:0/3215612381 <== mon.0 v2:172.21.15.39:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc6b80466e0 con 0x7fc6c4103e30 2024-09-12T02:36:58.890 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:36:58.870+0000 7fc6ca200640 1 -- 172.21.15.39:0/3215612381 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc6c41a7020 con 0x7fc6c4103e30 2024-09-12T02:36:58.890 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:36:58.871+0000 7fc6ca200640 1 -- 172.21.15.39:0/3215612381 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fc6c4105310 con 0x7fc6c4103e30 2024-09-12T02:36:58.890 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:36:58.873+0000 7fc6c1600640 1 -- 172.21.15.39:0/3215612381 <== mon.0 v2:172.21.15.39:3300/0 4 ==== mgrmap(e 17) ==== 137884+0+0 (secure 0 0 0) 0x7fc6b8046940 con 0x7fc6c4103e30 2024-09-12T02:36:58.890 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:36:58.875+0000 7fc6c1600640 1 --2- 172.21.15.39:0/3215612381 >> [v2:172.21.15.39:6800/1725006999,v1:172.21.15.39:6801/1725006999] conn(0x7fc6ac0a2c10 0x7fc6ac0a50d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:36:58.890 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:36:58.875+0000 7fc6c1600640 1 -- 172.21.15.39:0/3215612381 <== mon.0 v2:172.21.15.39:3300/0 5 ==== osd_map(95..95 src has 1..95) ==== 9129+0+0 (secure 0 0 0) 0x7fc6b80f0840 con 0x7fc6c4103e30 2024-09-12T02:36:58.890 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:36:58.875+0000 7fc6c3e00640 1 --2- 172.21.15.39:0/3215612381 >> [v2:172.21.15.39:6800/1725006999,v1:172.21.15.39:6801/1725006999] conn(0x7fc6ac0a2c10 0x7fc6ac0a50d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:36:58.890 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:36:58.876+0000 7fc6c3e00640 1 --2- 172.21.15.39:0/3215612381 >> [v2:172.21.15.39:6800/1725006999,v1:172.21.15.39:6801/1725006999] conn(0x7fc6ac0a2c10 0x7fc6ac0a50d0 secure :-1 s=READY pgs=205 cs=0 l=1 rev1=1 crypto rx=0x7fc6c4101e50 tx=0x7fc6b0005f90 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:36:58.890 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:36:58.880+0000 7fc6c1600640 1 -- 172.21.15.39:0/3215612381 <== mon.0 v2:172.21.15.39:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7fc6b80bd370 con 0x7fc6c4103e30 2024-09-12T02:36:59.111 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:36:59.109+0000 7fc6ca200640 1 -- 172.21.15.39:0/3215612381 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_command({"prefix": "health", "format": "json"} v 0) -- 0x7fc6c410c140 con 0x7fc6c4103e30 2024-09-12T02:36:59.111 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:36:59.110+0000 7fc6c1600640 1 -- 172.21.15.39:0/3215612381 <== mon.0 v2:172.21.15.39:3300/0 7 ==== mon_command_ack([{"prefix": "health", "format": "json"}]=0 v0) ==== 72+0+46 (secure 0 0 0) 0x7fc6b80bcc70 con 0x7fc6c4103e30 2024-09-12T02:36:59.111 INFO:teuthology.orchestra.run.smithi039.stdout: 2024-09-12T02:36:59.112 INFO:teuthology.orchestra.run.smithi039.stdout:{"status":"HEALTH_OK","checks":{},"mutes":[]} 2024-09-12T02:36:59.113 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:36:59.112+0000 7fc6ca200640 1 -- 172.21.15.39:0/3215612381 >> [v2:172.21.15.39:6800/1725006999,v1:172.21.15.39:6801/1725006999] conn(0x7fc6ac0a2c10 msgr2=0x7fc6ac0a50d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:36:59.113 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:36:59.112+0000 7fc6ca200640 1 --2- 172.21.15.39:0/3215612381 >> [v2:172.21.15.39:6800/1725006999,v1:172.21.15.39:6801/1725006999] conn(0x7fc6ac0a2c10 0x7fc6ac0a50d0 secure :-1 s=READY pgs=205 cs=0 l=1 rev1=1 crypto rx=0x7fc6c4101e50 tx=0x7fc6b0005f90 comp rx=0 tx=0).stop 2024-09-12T02:36:59.113 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:36:59.112+0000 7fc6ca200640 1 -- 172.21.15.39:0/3215612381 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fc6c4103e30 msgr2=0x7fc6c419a4a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:36:59.113 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:36:59.112+0000 7fc6ca200640 1 --2- 172.21.15.39:0/3215612381 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fc6c4103e30 0x7fc6c419a4a0 secure :-1 s=READY pgs=225 cs=0 l=1 rev1=1 crypto rx=0x7fc6b802ade0 tx=0x7fc6b80319f0 comp rx=0 tx=0).stop 2024-09-12T02:36:59.114 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:36:59.112+0000 7fc6ca200640 1 -- 172.21.15.39:0/3215612381 shutdown_connections 2024-09-12T02:36:59.114 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:36:59.112+0000 7fc6ca200640 1 --2- 172.21.15.39:0/3215612381 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fc6c4108f60 0x7fc6c419ed70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:36:59.114 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:36:59.112+0000 7fc6ca200640 1 --2- 172.21.15.39:0/3215612381 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fc6c41047e0 0x7fc6c419a9e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:36:59.114 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:36:59.112+0000 7fc6ca200640 1 --2- 172.21.15.39:0/3215612381 >> [v2:172.21.15.39:6800/1725006999,v1:172.21.15.39:6801/1725006999] conn(0x7fc6ac0a2c10 0x7fc6ac0a50d0 unknown :-1 s=CLOSED pgs=205 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:36:59.114 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:36:59.112+0000 7fc6ca200640 1 --2- 172.21.15.39:0/3215612381 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fc6c4103e30 0x7fc6c419a4a0 unknown :-1 s=CLOSED pgs=225 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:36:59.114 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:36:59.113+0000 7fc6ca200640 1 -- 172.21.15.39:0/3215612381 >> 172.21.15.39:0/3215612381 conn(0x7fc6c40ff910 msgr2=0x7fc6c4100d00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:36:59.114 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:36:59.113+0000 7fc6ca200640 1 -- 172.21.15.39:0/3215612381 shutdown_connections 2024-09-12T02:36:59.114 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:36:59.113+0000 7fc6ca200640 1 -- 172.21.15.39:0/3215612381 wait complete. 2024-09-12T02:36:59.935 INFO:tasks.cephadm.ceph_manager.ceph:wait_until_healthy done 2024-09-12T02:36:59.936 DEBUG:teuthology.orchestra.run.smithi039:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc shell --fsid 4954ed46-70ae-11ef-bcea-c7b262605968 -- ceph fs dump --format=json 2024-09-12T02:37:00.315 INFO:teuthology.orchestra.run.smithi039.stderr:Inferring config /var/lib/ceph/4954ed46-70ae-11ef-bcea-c7b262605968/mon.a/config 2024-09-12T02:37:00.349 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 02:37:00 smithi039 ceph-mon[30515]: pgmap v362: 129 pgs: 129 active+clean; 645 KiB data, 348 MiB used, 1.0 TiB / 1.0 TiB avail; 5.9 KiB/s rd, 11 op/s 2024-09-12T02:37:00.349 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 02:37:00 smithi039 ceph-mon[30515]: from='client.? 172.21.15.39:0/3215612381' entity='client.admin' cmd=[{"prefix": "health", "format": "json"}]: dispatch 2024-09-12T02:37:00.448 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 12 02:37:00 smithi044 ceph-mon[35411]: pgmap v362: 129 pgs: 129 active+clean; 645 KiB data, 348 MiB used, 1.0 TiB / 1.0 TiB avail; 5.9 KiB/s rd, 11 op/s 2024-09-12T02:37:00.448 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 12 02:37:00 smithi044 ceph-mon[35411]: from='client.? 172.21.15.39:0/3215612381' entity='client.admin' cmd=[{"prefix": "health", "format": "json"}]: dispatch 2024-09-12T02:37:00.513 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 12 02:37:00 smithi172 ceph-mon[35609]: pgmap v362: 129 pgs: 129 active+clean; 645 KiB data, 348 MiB used, 1.0 TiB / 1.0 TiB avail; 5.9 KiB/s rd, 11 op/s 2024-09-12T02:37:00.513 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 12 02:37:00 smithi172 ceph-mon[35609]: from='client.? 172.21.15.39:0/3215612381' entity='client.admin' cmd=[{"prefix": "health", "format": "json"}]: dispatch 2024-09-12T02:37:00.944 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:37:00.943+0000 7fc7c2600640 1 -- 172.21.15.39:0/3889437868 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fc7bc103e30 msgr2=0x7fc7bc104210 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:37:00.944 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:37:00.943+0000 7fc7c2600640 1 --2- 172.21.15.39:0/3889437868 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fc7bc103e30 0x7fc7bc104210 secure :-1 s=READY pgs=226 cs=0 l=1 rev1=1 crypto rx=0x7fc7ac009900 tx=0x7fc7ac02a410 comp rx=0 tx=0).stop 2024-09-12T02:37:00.945 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:37:00.943+0000 7fc7c2600640 1 -- 172.21.15.39:0/3889437868 shutdown_connections 2024-09-12T02:37:00.945 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:37:00.943+0000 7fc7c2600640 1 --2- 172.21.15.39:0/3889437868 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fc7bc108f60 0x7fc7bc110ae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:37:00.945 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:37:00.943+0000 7fc7c2600640 1 --2- 172.21.15.39:0/3889437868 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fc7bc1047e0 0x7fc7bc108830 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:37:00.945 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:37:00.943+0000 7fc7c2600640 1 --2- 172.21.15.39:0/3889437868 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fc7bc103e30 0x7fc7bc104210 unknown :-1 s=CLOSED pgs=226 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:37:00.945 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:37:00.943+0000 7fc7c2600640 1 -- 172.21.15.39:0/3889437868 >> 172.21.15.39:0/3889437868 conn(0x7fc7bc0ff8d0 msgr2=0x7fc7bc101cf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:37:00.945 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:37:00.943+0000 7fc7c2600640 1 -- 172.21.15.39:0/3889437868 shutdown_connections 2024-09-12T02:37:00.945 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:37:00.943+0000 7fc7c2600640 1 -- 172.21.15.39:0/3889437868 wait complete. 2024-09-12T02:37:00.946 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:37:00.944+0000 7fc7c2600640 1 Processor -- start 2024-09-12T02:37:00.946 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:37:00.944+0000 7fc7c2600640 1 -- start start 2024-09-12T02:37:00.946 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:37:00.945+0000 7fc7c2600640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fc7bc103e30 0x7fc7bc19a450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:37:00.946 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:37:00.945+0000 7fc7c2600640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fc7bc1047e0 0x7fc7bc19a990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:37:00.947 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:37:00.945+0000 7fc7c2600640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fc7bc108f60 0x7fc7bc19ed20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:37:00.947 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:37:00.945+0000 7fc7c2600640 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 -- 0x7fc7bc114010 con 0x7fc7bc103e30 2024-09-12T02:37:00.947 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:37:00.945+0000 7fc7c2600640 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x7fc7bc113e90 con 0x7fc7bc1047e0 2024-09-12T02:37:00.947 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:37:00.945+0000 7fc7c2600640 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7fc7bc114190 con 0x7fc7bc108f60 2024-09-12T02:37:00.947 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:37:00.945+0000 7fc7c1200640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fc7bc103e30 0x7fc7bc19a450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:37:00.947 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:37:00.945+0000 7fc7c1200640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fc7bc103e30 0x7fc7bc19a450 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.39:3300/0 says I am v2:172.21.15.39:52884/0 (socket says 172.21.15.39:52884) 2024-09-12T02:37:00.947 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:37:00.945+0000 7fc7c1200640 1 -- 172.21.15.39:0/206254152 learned_addr learned my addr 172.21.15.39:0/206254152 (peer_addr_for_me v2:172.21.15.39:0/0) 2024-09-12T02:37:00.947 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:37:00.945+0000 7fc7b3e00640 1 --2- 172.21.15.39:0/206254152 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fc7bc1047e0 0x7fc7bc19a990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:37:00.947 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:37:00.945+0000 7fc7c1c00640 1 --2- 172.21.15.39:0/206254152 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fc7bc108f60 0x7fc7bc19ed20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:37:00.947 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:37:00.946+0000 7fc7c1200640 1 -- 172.21.15.39:0/206254152 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fc7bc108f60 msgr2=0x7fc7bc19ed20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:37:00.947 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:37:00.946+0000 7fc7c1200640 1 --2- 172.21.15.39:0/206254152 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fc7bc108f60 0x7fc7bc19ed20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:37:00.947 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:37:00.946+0000 7fc7c1200640 1 -- 172.21.15.39:0/206254152 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fc7bc1047e0 msgr2=0x7fc7bc19a990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:37:00.947 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:37:00.946+0000 7fc7c1200640 1 --2- 172.21.15.39:0/206254152 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fc7bc1047e0 0x7fc7bc19a990 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:37:00.948 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:37:00.946+0000 7fc7c1200640 1 -- 172.21.15.39:0/206254152 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc7bc19f400 con 0x7fc7bc103e30 2024-09-12T02:37:00.948 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:37:00.946+0000 7fc7c1c00640 1 --2- 172.21.15.39:0/206254152 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fc7bc108f60 0x7fc7bc19ed20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-12T02:37:00.948 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:37:00.946+0000 7fc7b3e00640 1 --2- 172.21.15.39:0/206254152 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fc7bc1047e0 0x7fc7bc19a990 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-12T02:37:00.949 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:37:00.946+0000 7fc7c1200640 1 --2- 172.21.15.39:0/206254152 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fc7bc103e30 0x7fc7bc19a450 secure :-1 s=READY pgs=227 cs=0 l=1 rev1=1 crypto rx=0x7fc7ac004770 tx=0x7fc7ac003c10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:37:00.949 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:37:00.946+0000 7fc7ba000640 1 -- 172.21.15.39:0/206254152 <== mon.0 v2:172.21.15.39:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc7ac03f070 con 0x7fc7bc103e30 2024-09-12T02:37:00.949 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:37:00.946+0000 7fc7ba000640 1 -- 172.21.15.39:0/206254152 <== mon.0 v2:172.21.15.39:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fc7ac031ca0 con 0x7fc7bc103e30 2024-09-12T02:37:00.949 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:37:00.946+0000 7fc7c2600640 1 -- 172.21.15.39:0/206254152 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc7bc19f690 con 0x7fc7bc103e30 2024-09-12T02:37:00.949 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:37:00.947+0000 7fc7ba000640 1 -- 172.21.15.39:0/206254152 <== mon.0 v2:172.21.15.39:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc7ac035030 con 0x7fc7bc103e30 2024-09-12T02:37:00.949 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:37:00.947+0000 7fc7c2600640 1 -- 172.21.15.39:0/206254152 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc7bc1a6fd0 con 0x7fc7bc103e30 2024-09-12T02:37:00.949 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:37:00.948+0000 7fc7c2600640 1 -- 172.21.15.39:0/206254152 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fc7bc105310 con 0x7fc7bc103e30 2024-09-12T02:37:00.950 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:37:00.949+0000 7fc7ba000640 1 -- 172.21.15.39:0/206254152 <== mon.0 v2:172.21.15.39:3300/0 4 ==== mgrmap(e 17) ==== 137884+0+0 (secure 0 0 0) 0x7fc7ac042070 con 0x7fc7bc103e30 2024-09-12T02:37:00.951 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:37:00.951+0000 7fc7ba000640 1 --2- 172.21.15.39:0/206254152 >> [v2:172.21.15.39:6800/1725006999,v1:172.21.15.39:6801/1725006999] conn(0x7fc7a00a2c90 0x7fc7a00a5150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:37:00.952 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:37:00.951+0000 7fc7ba000640 1 -- 172.21.15.39:0/206254152 <== mon.0 v2:172.21.15.39:3300/0 5 ==== osd_map(95..95 src has 1..95) ==== 9129+0+0 (secure 0 0 0) 0x7fc7ac0efdc0 con 0x7fc7bc103e30 2024-09-12T02:37:00.952 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:37:00.951+0000 7fc7b3e00640 1 --2- 172.21.15.39:0/206254152 >> [v2:172.21.15.39:6800/1725006999,v1:172.21.15.39:6801/1725006999] conn(0x7fc7a00a2c90 0x7fc7a00a5150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:37:00.952 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:37:00.952+0000 7fc7b3e00640 1 --2- 172.21.15.39:0/206254152 >> [v2:172.21.15.39:6800/1725006999,v1:172.21.15.39:6801/1725006999] conn(0x7fc7a00a2c90 0x7fc7a00a5150 secure :-1 s=READY pgs=206 cs=0 l=1 rev1=1 crypto rx=0x7fc7a40095f0 tx=0x7fc7a4005f90 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:37:00.954 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:37:00.953+0000 7fc7ba000640 1 -- 172.21.15.39:0/206254152 <== mon.0 v2:172.21.15.39:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7fc7ac0bc250 con 0x7fc7bc103e30 2024-09-12T02:37:01.177 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:37:01.176+0000 7fc7c2600640 1 -- 172.21.15.39:0/206254152 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fc7bc104210 con 0x7fc7bc103e30 2024-09-12T02:37:01.177 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:37:01.177+0000 7fc7ba000640 1 -- 172.21.15.39:0/206254152 <== mon.0 v2:172.21.15.39:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 28 v28) ==== 94+0+11975 (secure 0 0 0) 0x7fc7ac0c0550 con 0x7fc7bc103e30 2024-09-12T02:37:01.178 INFO:teuthology.orchestra.run.smithi039.stdout: 2024-09-12T02:37:01.178 INFO:teuthology.orchestra.run.smithi039.stdout:{"epoch":28,"btime":"2024-09-12T02:35:53:793149+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14451,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.39:6835/2325642381","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6834","nonce":2325642381},{"type":"v1","addr":"172.21.15.39:6835","nonce":2325642381}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14511,"name":"g","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.39:6839/936905514","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6838","nonce":936905514},{"type":"v1","addr":"172.21.15.39:6839","nonce":936905514}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":11}],"filesystems":[{"mdsmap":{"epoch":28,"flags":50,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-09-12T02:35:03.522182+0000","modified":"2024-09-12T02:35:53.762825+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":5,"in":[0,1,2,3,4],"up":{"mds_0":24515,"mds_1":24499,"mds_2":24484,"mds_3":24482,"mds_4":24472},"failed":[],"damaged":[],"stopped":[],"info":{"gid_14523":{"gid":14523,"name":"a","rank":4,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.39:6841/2829712180","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6840","nonce":2829712180},{"type":"v1","addr":"172.21.15.39:6841","nonce":2829712180}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24422":{"gid":24422,"name":"k","rank":3,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.44:6833/2359724364","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6832","nonce":2359724364},{"type":"v1","addr":"172.21.15.44:6833","nonce":2359724364}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24430":{"gid":24430,"name":"l","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.172:6833/3232434105","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6832","nonce":3232434105},{"type":"v1","addr":"172.21.15.172:6833","nonce":3232434105}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24446":{"gid":24446,"name":"d","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.39:6837/2743237008","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6836","nonce":2743237008},{"type":"v1","addr":"172.21.15.39:6837","nonce":2743237008}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24458":{"gid":24458,"name":"e","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.44:6835/4063842354","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6834","nonce":4063842354},{"type":"v1","addr":"172.21.15.44:6835","nonce":4063842354}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24472":{"gid":24472,"name":"f","rank":4,"incarnation":26,"state":"up:active","state_seq":21,"addr":"172.21.15.172:6835/3274676014","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6834","nonce":3274676014},{"type":"v1","addr":"172.21.15.172:6835","nonce":3274676014}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24482":{"gid":24482,"name":"h","rank":3,"incarnation":24,"state":"up:active","state_seq":19,"addr":"172.21.15.44:6837/1501493978","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6836","nonce":1501493978},{"type":"v1","addr":"172.21.15.44:6837","nonce":1501493978}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24484":{"gid":24484,"name":"c","rank":2,"incarnation":22,"state":"up:active","state_seq":20,"addr":"172.21.15.172:6837/493506747","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6836","nonce":493506747},{"type":"v1","addr":"172.21.15.172:6837","nonce":493506747}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24499":{"gid":24499,"name":"i","rank":1,"incarnation":20,"state":"up:active","state_seq":18,"addr":"172.21.15.172:6839/3742537097","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6838","nonce":3742537097},{"type":"v1","addr":"172.21.15.172:6839","nonce":3742537097}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24515":{"gid":24515,"name":"b","rank":0,"incarnation":14,"state":"up:active","state_seq":5,"addr":"172.21.15.44:6839/2556532723","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6838","nonce":2556532723},{"type":"v1","addr":"172.21.15.44:6839","nonce":2556532723}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":24515,"qdb_cluster":[24515,24499,24484,24482,24472]},"id":1}]} 2024-09-12T02:37:01.178 INFO:teuthology.orchestra.run.smithi039.stderr:dumped fsmap epoch 28 2024-09-12T02:37:01.180 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:37:01.179+0000 7fc7c2600640 1 -- 172.21.15.39:0/206254152 >> [v2:172.21.15.39:6800/1725006999,v1:172.21.15.39:6801/1725006999] conn(0x7fc7a00a2c90 msgr2=0x7fc7a00a5150 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:37:01.180 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:37:01.179+0000 7fc7c2600640 1 --2- 172.21.15.39:0/206254152 >> [v2:172.21.15.39:6800/1725006999,v1:172.21.15.39:6801/1725006999] conn(0x7fc7a00a2c90 0x7fc7a00a5150 secure :-1 s=READY pgs=206 cs=0 l=1 rev1=1 crypto rx=0x7fc7a40095f0 tx=0x7fc7a4005f90 comp rx=0 tx=0).stop 2024-09-12T02:37:01.180 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:37:01.179+0000 7fc7c2600640 1 -- 172.21.15.39:0/206254152 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fc7bc103e30 msgr2=0x7fc7bc19a450 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:37:01.180 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:37:01.179+0000 7fc7c2600640 1 --2- 172.21.15.39:0/206254152 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fc7bc103e30 0x7fc7bc19a450 secure :-1 s=READY pgs=227 cs=0 l=1 rev1=1 crypto rx=0x7fc7ac004770 tx=0x7fc7ac003c10 comp rx=0 tx=0).stop 2024-09-12T02:37:01.180 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:37:01.179+0000 7fc7c2600640 1 -- 172.21.15.39:0/206254152 shutdown_connections 2024-09-12T02:37:01.180 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:37:01.179+0000 7fc7c2600640 1 --2- 172.21.15.39:0/206254152 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fc7bc108f60 0x7fc7bc19ed20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:37:01.180 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:37:01.179+0000 7fc7c2600640 1 --2- 172.21.15.39:0/206254152 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fc7bc1047e0 0x7fc7bc19a990 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:37:01.180 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:37:01.179+0000 7fc7c2600640 1 --2- 172.21.15.39:0/206254152 >> [v2:172.21.15.39:6800/1725006999,v1:172.21.15.39:6801/1725006999] conn(0x7fc7a00a2c90 0x7fc7a00a5150 unknown :-1 s=CLOSED pgs=206 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:37:01.181 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:37:01.179+0000 7fc7c2600640 1 --2- 172.21.15.39:0/206254152 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fc7bc103e30 0x7fc7bc19a450 unknown :-1 s=CLOSED pgs=227 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:37:01.181 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:37:01.179+0000 7fc7c2600640 1 -- 172.21.15.39:0/206254152 >> 172.21.15.39:0/206254152 conn(0x7fc7bc0ff8d0 msgr2=0x7fc7bc100bb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:37:01.181 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:37:01.179+0000 7fc7c2600640 1 -- 172.21.15.39:0/206254152 shutdown_connections 2024-09-12T02:37:01.181 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:37:01.179+0000 7fc7c2600640 1 -- 172.21.15.39:0/206254152 wait complete. 2024-09-12T02:37:01.915 DEBUG:teuthology.orchestra.run.smithi039:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc shell --fsid 4954ed46-70ae-11ef-bcea-c7b262605968 -- ceph fs dump --format=json 2024-09-12T02:37:02.295 INFO:teuthology.orchestra.run.smithi039.stderr:Inferring config /var/lib/ceph/4954ed46-70ae-11ef-bcea-c7b262605968/mon.a/config 2024-09-12T02:37:02.349 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 02:37:02 smithi039 ceph-mon[30515]: pgmap v363: 129 pgs: 129 active+clean; 645 KiB data, 348 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2024-09-12T02:37:02.350 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 02:37:02 smithi039 ceph-mon[30515]: from='client.? 172.21.15.39:0/206254152' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-12T02:37:02.448 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 12 02:37:02 smithi044 ceph-mon[35411]: pgmap v363: 129 pgs: 129 active+clean; 645 KiB data, 348 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2024-09-12T02:37:02.449 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 12 02:37:02 smithi044 ceph-mon[35411]: from='client.? 172.21.15.39:0/206254152' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-12T02:37:02.513 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 12 02:37:02 smithi172 ceph-mon[35609]: pgmap v363: 129 pgs: 129 active+clean; 645 KiB data, 348 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2024-09-12T02:37:02.513 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 12 02:37:02 smithi172 ceph-mon[35609]: from='client.? 172.21.15.39:0/206254152' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-12T02:37:02.877 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:37:02.876+0000 7f13d2800640 1 -- 172.21.15.39:0/2971864421 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f13cc1049a0 msgr2=0x7f13cc1089f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:37:02.878 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:37:02.876+0000 7f13d2800640 1 --2- 172.21.15.39:0/2971864421 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f13cc1049a0 0x7f13cc1089f0 secure :-1 s=READY pgs=228 cs=0 l=1 rev1=1 crypto rx=0x7f13b4009900 tx=0x7f13b402a3f0 comp rx=0 tx=0).stop 2024-09-12T02:37:02.878 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:37:02.876+0000 7f13d2800640 1 -- 172.21.15.39:0/2971864421 shutdown_connections 2024-09-12T02:37:02.878 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:37:02.876+0000 7f13d2800640 1 --2- 172.21.15.39:0/2971864421 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f13cc109120 0x7f13cc110ca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:37:02.878 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:37:02.876+0000 7f13d2800640 1 --2- 172.21.15.39:0/2971864421 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f13cc1049a0 0x7f13cc1089f0 unknown :-1 s=CLOSED pgs=228 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:37:02.878 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:37:02.876+0000 7f13d2800640 1 --2- 172.21.15.39:0/2971864421 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f13cc103ff0 0x7f13cc1043d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:37:02.878 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:37:02.876+0000 7f13d2800640 1 -- 172.21.15.39:0/2971864421 >> 172.21.15.39:0/2971864421 conn(0x7f13cc0ffa90 msgr2=0x7f13cc101eb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:37:02.878 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:37:02.876+0000 7f13d2800640 1 -- 172.21.15.39:0/2971864421 shutdown_connections 2024-09-12T02:37:02.878 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:37:02.876+0000 7f13d2800640 1 -- 172.21.15.39:0/2971864421 wait complete. 2024-09-12T02:37:02.879 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:37:02.877+0000 7f13d2800640 1 Processor -- start 2024-09-12T02:37:02.879 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:37:02.877+0000 7f13d2800640 1 -- start start 2024-09-12T02:37:02.879 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:37:02.878+0000 7f13d2800640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f13cc103ff0 0x7f13cc19a5f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:37:02.879 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:37:02.878+0000 7f13d2800640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f13cc1049a0 0x7f13cc19ab30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:37:02.879 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:37:02.878+0000 7f13d2800640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f13cc109120 0x7f13cc19eec0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:37:02.879 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:37:02.878+0000 7f13d2800640 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 -- 0x7f13cc114190 con 0x7f13cc109120 2024-09-12T02:37:02.879 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:37:02.878+0000 7f13d2800640 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x7f13cc114010 con 0x7f13cc103ff0 2024-09-12T02:37:02.879 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:37:02.878+0000 7f13d2800640 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7f13cc114310 con 0x7f13cc1049a0 2024-09-12T02:37:02.880 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:37:02.878+0000 7f13cbe00640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f13cc109120 0x7f13cc19eec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:37:02.880 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:37:02.878+0000 7f13c3e00640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f13cc1049a0 0x7f13cc19ab30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:37:02.880 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:37:02.878+0000 7f13c3e00640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f13cc1049a0 0x7f13cc19ab30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.172:3300/0 says I am v2:172.21.15.39:56194/0 (socket says 172.21.15.39:56194) 2024-09-12T02:37:02.880 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:37:02.878+0000 7f13c3e00640 1 -- 172.21.15.39:0/81609376 learned_addr learned my addr 172.21.15.39:0/81609376 (peer_addr_for_me v2:172.21.15.39:0/0) 2024-09-12T02:37:02.880 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:37:02.878+0000 7f13cb400640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f13cc103ff0 0x7f13cc19a5f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:37:02.881 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:37:02.879+0000 7f13cbe00640 1 -- 172.21.15.39:0/81609376 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f13cc1049a0 msgr2=0x7f13cc19ab30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:37:02.881 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:37:02.879+0000 7f13cbe00640 1 --2- 172.21.15.39:0/81609376 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f13cc1049a0 0x7f13cc19ab30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:37:02.881 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:37:02.879+0000 7f13cbe00640 1 -- 172.21.15.39:0/81609376 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f13cc103ff0 msgr2=0x7f13cc19a5f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:37:02.881 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:37:02.879+0000 7f13cbe00640 1 --2- 172.21.15.39:0/81609376 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f13cc103ff0 0x7f13cc19a5f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:37:02.881 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:37:02.879+0000 7f13cbe00640 1 -- 172.21.15.39:0/81609376 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f13cc19f5a0 con 0x7f13cc109120 2024-09-12T02:37:02.881 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:37:02.879+0000 7f13cbe00640 1 --2- 172.21.15.39:0/81609376 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f13cc109120 0x7f13cc19eec0 secure :-1 s=READY pgs=229 cs=0 l=1 rev1=1 crypto rx=0x7f13c4009fd0 tx=0x7f13c400ef10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:37:02.881 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:37:02.879+0000 7f13c8c00640 1 -- 172.21.15.39:0/81609376 <== mon.0 v2:172.21.15.39:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f13c400ce20 con 0x7f13cc109120 2024-09-12T02:37:02.881 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:37:02.879+0000 7f13c8c00640 1 -- 172.21.15.39:0/81609376 <== mon.0 v2:172.21.15.39:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f13c4005020 con 0x7f13cc109120 2024-09-12T02:37:02.882 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:37:02.879+0000 7f13c8c00640 1 -- 172.21.15.39:0/81609376 <== mon.0 v2:172.21.15.39:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f13c4010720 con 0x7f13cc109120 2024-09-12T02:37:02.882 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:37:02.879+0000 7f13d2800640 1 -- 172.21.15.39:0/81609376 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f13cc19f890 con 0x7f13cc109120 2024-09-12T02:37:02.882 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:37:02.880+0000 7f13d2800640 1 -- 172.21.15.39:0/81609376 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f13cc1a7170 con 0x7f13cc109120 2024-09-12T02:37:02.882 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:37:02.881+0000 7f13d2800640 1 -- 172.21.15.39:0/81609376 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f13cc1043d0 con 0x7f13cc109120 2024-09-12T02:37:02.883 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:37:02.883+0000 7f13c8c00640 1 -- 172.21.15.39:0/81609376 <== mon.0 v2:172.21.15.39:3300/0 4 ==== mgrmap(e 17) ==== 137884+0+0 (secure 0 0 0) 0x7f13c4005540 con 0x7f13cc109120 2024-09-12T02:37:02.885 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:37:02.884+0000 7f13c8c00640 1 --2- 172.21.15.39:0/81609376 >> [v2:172.21.15.39:6800/1725006999,v1:172.21.15.39:6801/1725006999] conn(0x7f13b00a2c10 0x7f13b00a50d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:37:02.885 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:37:02.884+0000 7f13c8c00640 1 -- 172.21.15.39:0/81609376 <== mon.0 v2:172.21.15.39:3300/0 5 ==== osd_map(95..95 src has 1..95) ==== 9129+0+0 (secure 0 0 0) 0x7f13c40cfb40 con 0x7f13cc109120 2024-09-12T02:37:02.885 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:37:02.884+0000 7f13cb400640 1 --2- 172.21.15.39:0/81609376 >> [v2:172.21.15.39:6800/1725006999,v1:172.21.15.39:6801/1725006999] conn(0x7f13b00a2c10 0x7f13b00a50d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:37:02.886 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:37:02.885+0000 7f13cb400640 1 --2- 172.21.15.39:0/81609376 >> [v2:172.21.15.39:6800/1725006999,v1:172.21.15.39:6801/1725006999] conn(0x7f13b00a2c10 0x7f13b00a50d0 secure :-1 s=READY pgs=207 cs=0 l=1 rev1=1 crypto rx=0x7f13bc00bbe0 tx=0x7f13bc00b390 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:37:02.889 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:37:02.888+0000 7f13c8c00640 1 -- 172.21.15.39:0/81609376 <== mon.0 v2:172.21.15.39:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7f13c409c560 con 0x7f13cc109120 2024-09-12T02:37:03.116 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:37:03.115+0000 7f13d2800640 1 -- 172.21.15.39:0/81609376 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f13cc1a7410 con 0x7f13cc109120 2024-09-12T02:37:03.117 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:37:03.116+0000 7f13c8c00640 1 -- 172.21.15.39:0/81609376 <== mon.0 v2:172.21.15.39:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 28 v28) ==== 94+0+11975 (secure 0 0 0) 0x7f13c409be60 con 0x7f13cc109120 2024-09-12T02:37:03.117 INFO:teuthology.orchestra.run.smithi039.stdout: 2024-09-12T02:37:03.118 INFO:teuthology.orchestra.run.smithi039.stdout:{"epoch":28,"btime":"2024-09-12T02:35:53:793149+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14451,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.39:6835/2325642381","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6834","nonce":2325642381},{"type":"v1","addr":"172.21.15.39:6835","nonce":2325642381}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14511,"name":"g","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.39:6839/936905514","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6838","nonce":936905514},{"type":"v1","addr":"172.21.15.39:6839","nonce":936905514}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":11}],"filesystems":[{"mdsmap":{"epoch":28,"flags":50,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-09-12T02:35:03.522182+0000","modified":"2024-09-12T02:35:53.762825+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":5,"in":[0,1,2,3,4],"up":{"mds_0":24515,"mds_1":24499,"mds_2":24484,"mds_3":24482,"mds_4":24472},"failed":[],"damaged":[],"stopped":[],"info":{"gid_14523":{"gid":14523,"name":"a","rank":4,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.39:6841/2829712180","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6840","nonce":2829712180},{"type":"v1","addr":"172.21.15.39:6841","nonce":2829712180}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24422":{"gid":24422,"name":"k","rank":3,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.44:6833/2359724364","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6832","nonce":2359724364},{"type":"v1","addr":"172.21.15.44:6833","nonce":2359724364}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24430":{"gid":24430,"name":"l","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.172:6833/3232434105","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6832","nonce":3232434105},{"type":"v1","addr":"172.21.15.172:6833","nonce":3232434105}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24446":{"gid":24446,"name":"d","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.39:6837/2743237008","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6836","nonce":2743237008},{"type":"v1","addr":"172.21.15.39:6837","nonce":2743237008}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24458":{"gid":24458,"name":"e","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.44:6835/4063842354","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6834","nonce":4063842354},{"type":"v1","addr":"172.21.15.44:6835","nonce":4063842354}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24472":{"gid":24472,"name":"f","rank":4,"incarnation":26,"state":"up:active","state_seq":21,"addr":"172.21.15.172:6835/3274676014","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6834","nonce":3274676014},{"type":"v1","addr":"172.21.15.172:6835","nonce":3274676014}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24482":{"gid":24482,"name":"h","rank":3,"incarnation":24,"state":"up:active","state_seq":19,"addr":"172.21.15.44:6837/1501493978","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6836","nonce":1501493978},{"type":"v1","addr":"172.21.15.44:6837","nonce":1501493978}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24484":{"gid":24484,"name":"c","rank":2,"incarnation":22,"state":"up:active","state_seq":20,"addr":"172.21.15.172:6837/493506747","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6836","nonce":493506747},{"type":"v1","addr":"172.21.15.172:6837","nonce":493506747}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24499":{"gid":24499,"name":"i","rank":1,"incarnation":20,"state":"up:active","state_seq":18,"addr":"172.21.15.172:6839/3742537097","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6838","nonce":3742537097},{"type":"v1","addr":"172.21.15.172:6839","nonce":3742537097}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24515":{"gid":24515,"name":"b","rank":0,"incarnation":14,"state":"up:active","state_seq":5,"addr":"172.21.15.44:6839/2556532723","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6838","nonce":2556532723},{"type":"v1","addr":"172.21.15.44:6839","nonce":2556532723}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":24515,"qdb_cluster":[24515,24499,24484,24482,24472]},"id":1}]} 2024-09-12T02:37:03.118 INFO:teuthology.orchestra.run.smithi039.stderr:dumped fsmap epoch 28 2024-09-12T02:37:03.119 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:37:03.118+0000 7f13d2800640 1 -- 172.21.15.39:0/81609376 >> [v2:172.21.15.39:6800/1725006999,v1:172.21.15.39:6801/1725006999] conn(0x7f13b00a2c10 msgr2=0x7f13b00a50d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:37:03.120 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:37:03.118+0000 7f13d2800640 1 --2- 172.21.15.39:0/81609376 >> [v2:172.21.15.39:6800/1725006999,v1:172.21.15.39:6801/1725006999] conn(0x7f13b00a2c10 0x7f13b00a50d0 secure :-1 s=READY pgs=207 cs=0 l=1 rev1=1 crypto rx=0x7f13bc00bbe0 tx=0x7f13bc00b390 comp rx=0 tx=0).stop 2024-09-12T02:37:03.120 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:37:03.119+0000 7f13d2800640 1 -- 172.21.15.39:0/81609376 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f13cc109120 msgr2=0x7f13cc19eec0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:37:03.120 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:37:03.119+0000 7f13d2800640 1 --2- 172.21.15.39:0/81609376 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f13cc109120 0x7f13cc19eec0 secure :-1 s=READY pgs=229 cs=0 l=1 rev1=1 crypto rx=0x7f13c4009fd0 tx=0x7f13c400ef10 comp rx=0 tx=0).stop 2024-09-12T02:37:03.120 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:37:03.119+0000 7f13d2800640 1 -- 172.21.15.39:0/81609376 shutdown_connections 2024-09-12T02:37:03.120 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:37:03.119+0000 7f13d2800640 1 --2- 172.21.15.39:0/81609376 >> [v2:172.21.15.39:6800/1725006999,v1:172.21.15.39:6801/1725006999] conn(0x7f13b00a2c10 0x7f13b00a50d0 unknown :-1 s=CLOSED pgs=207 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:37:03.120 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:37:03.119+0000 7f13d2800640 1 --2- 172.21.15.39:0/81609376 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f13cc109120 0x7f13cc19eec0 unknown :-1 s=CLOSED pgs=229 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:37:03.120 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:37:03.119+0000 7f13d2800640 1 --2- 172.21.15.39:0/81609376 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f13cc1049a0 0x7f13cc19ab30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:37:03.120 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:37:03.119+0000 7f13d2800640 1 --2- 172.21.15.39:0/81609376 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f13cc103ff0 0x7f13cc19a5f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:37:03.120 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:37:03.119+0000 7f13d2800640 1 -- 172.21.15.39:0/81609376 >> 172.21.15.39:0/81609376 conn(0x7f13cc0ffa90 msgr2=0x7f13cc101e80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:37:03.120 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:37:03.119+0000 7f13d2800640 1 -- 172.21.15.39:0/81609376 shutdown_connections 2024-09-12T02:37:03.120 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:37:03.119+0000 7f13d2800640 1 -- 172.21.15.39:0/81609376 wait complete. 2024-09-12T02:37:03.906 DEBUG:teuthology.orchestra.run.smithi039:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc shell --fsid 4954ed46-70ae-11ef-bcea-c7b262605968 -- ceph osd dump --format=json 2024-09-12T02:37:04.286 INFO:teuthology.orchestra.run.smithi039.stderr:Inferring config /var/lib/ceph/4954ed46-70ae-11ef-bcea-c7b262605968/mon.a/config 2024-09-12T02:37:04.349 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 02:37:04 smithi039 ceph-mon[30515]: pgmap v364: 129 pgs: 129 active+clean; 645 KiB data, 348 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2024-09-12T02:37:04.350 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 02:37:04 smithi039 ceph-mon[30515]: from='client.? 172.21.15.39:0/81609376' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-12T02:37:04.448 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 12 02:37:04 smithi044 ceph-mon[35411]: pgmap v364: 129 pgs: 129 active+clean; 645 KiB data, 348 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2024-09-12T02:37:04.449 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 12 02:37:04 smithi044 ceph-mon[35411]: from='client.? 172.21.15.39:0/81609376' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-12T02:37:04.513 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 12 02:37:04 smithi172 ceph-mon[35609]: pgmap v364: 129 pgs: 129 active+clean; 645 KiB data, 348 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2024-09-12T02:37:04.514 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 12 02:37:04 smithi172 ceph-mon[35609]: from='client.? 172.21.15.39:0/81609376' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-12T02:37:04.900 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:37:04.898+0000 7f2549e00640 1 -- 172.21.15.39:0/2627404705 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f2544074e30 msgr2=0x7f254410dd40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:37:04.900 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:37:04.898+0000 7f2549e00640 1 --2- 172.21.15.39:0/2627404705 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f2544074e30 0x7f254410dd40 secure :-1 s=READY pgs=98 cs=0 l=1 rev1=1 crypto rx=0x7f2530009900 tx=0x7f253002a490 comp rx=0 tx=0).stop 2024-09-12T02:37:04.900 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:37:04.898+0000 7f2549e00640 1 -- 172.21.15.39:0/2627404705 shutdown_connections 2024-09-12T02:37:04.900 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:37:04.898+0000 7f2549e00640 1 --2- 172.21.15.39:0/2627404705 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f254410e280 0x7f2544110670 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:37:04.900 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:37:04.898+0000 7f2549e00640 1 --2- 172.21.15.39:0/2627404705 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f2544074e30 0x7f254410dd40 unknown :-1 s=CLOSED pgs=98 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:37:04.900 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:37:04.898+0000 7f2549e00640 1 --2- 172.21.15.39:0/2627404705 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f2544074510 0x7f25440748f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:37:04.900 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:37:04.898+0000 7f2549e00640 1 -- 172.21.15.39:0/2627404705 >> 172.21.15.39:0/2627404705 conn(0x7f25440fd740 msgr2=0x7f25440ffb60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:37:04.900 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:37:04.898+0000 7f2549e00640 1 -- 172.21.15.39:0/2627404705 shutdown_connections 2024-09-12T02:37:04.901 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:37:04.898+0000 7f2549e00640 1 -- 172.21.15.39:0/2627404705 wait complete. 2024-09-12T02:37:04.902 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:37:04.900+0000 7f2549e00640 1 Processor -- start 2024-09-12T02:37:04.902 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:37:04.900+0000 7f2549e00640 1 -- start start 2024-09-12T02:37:04.902 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:37:04.900+0000 7f2549e00640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f2544074510 0x7f254419a480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:37:04.902 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:37:04.900+0000 7f2549e00640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f2544074e30 0x7f254419a9c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:37:04.902 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:37:04.900+0000 7f2549e00640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f254410e280 0x7f254419ed50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:37:04.902 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:37:04.900+0000 7f2549e00640 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 -- 0x7f2544114000 con 0x7f2544074e30 2024-09-12T02:37:04.902 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:37:04.900+0000 7f2549e00640 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x7f2544113e80 con 0x7f254410e280 2024-09-12T02:37:04.902 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:37:04.900+0000 7f2549e00640 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7f2544114180 con 0x7f2544074510 2024-09-12T02:37:04.902 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:37:04.901+0000 7f2548a00640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f2544074510 0x7f254419a480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:37:04.902 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:37:04.901+0000 7f2548a00640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f2544074510 0x7f254419a480 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.172:3300/0 says I am v2:172.21.15.39:56224/0 (socket says 172.21.15.39:56224) 2024-09-12T02:37:04.903 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:37:04.901+0000 7f2548a00640 1 -- 172.21.15.39:0/2843679371 learned_addr learned my addr 172.21.15.39:0/2843679371 (peer_addr_for_me v2:172.21.15.39:0/0) 2024-09-12T02:37:04.903 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:37:04.901+0000 7f2543e00640 1 --2- 172.21.15.39:0/2843679371 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f2544074e30 0x7f254419a9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:37:04.903 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:37:04.901+0000 7f2549400640 1 --2- 172.21.15.39:0/2843679371 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f254410e280 0x7f254419ed50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:37:04.903 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:37:04.901+0000 7f2548a00640 1 -- 172.21.15.39:0/2843679371 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f254410e280 msgr2=0x7f254419ed50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:37:04.903 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:37:04.901+0000 7f2548a00640 1 --2- 172.21.15.39:0/2843679371 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f254410e280 0x7f254419ed50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:37:04.903 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:37:04.901+0000 7f2548a00640 1 -- 172.21.15.39:0/2843679371 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f2544074e30 msgr2=0x7f254419a9c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:37:04.903 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:37:04.901+0000 7f2548a00640 1 --2- 172.21.15.39:0/2843679371 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f2544074e30 0x7f254419a9c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:37:04.903 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:37:04.901+0000 7f2548a00640 1 -- 172.21.15.39:0/2843679371 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f254419f430 con 0x7f2544074510 2024-09-12T02:37:04.904 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:37:04.902+0000 7f2548a00640 1 --2- 172.21.15.39:0/2843679371 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f2544074510 0x7f254419a480 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0x7f253800ea60 tx=0x7f253800ef20 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:37:04.904 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:37:04.902+0000 7f2541600640 1 -- 172.21.15.39:0/2843679371 <== mon.1 v2:172.21.15.172:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f253800cde0 con 0x7f2544074510 2024-09-12T02:37:04.904 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:37:04.902+0000 7f2541600640 1 -- 172.21.15.39:0/2843679371 <== mon.1 v2:172.21.15.172:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f25380035f0 con 0x7f2544074510 2024-09-12T02:37:04.904 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:37:04.902+0000 7f2549e00640 1 -- 172.21.15.39:0/2843679371 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f254419f720 con 0x7f2544074510 2024-09-12T02:37:04.904 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:37:04.902+0000 7f2541600640 1 -- 172.21.15.39:0/2843679371 <== mon.1 v2:172.21.15.172:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2538010670 con 0x7f2544074510 2024-09-12T02:37:04.904 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:37:04.902+0000 7f2549e00640 1 -- 172.21.15.39:0/2843679371 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f25441a7000 con 0x7f2544074510 2024-09-12T02:37:04.904 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:37:04.903+0000 7f2549e00640 1 -- 172.21.15.39:0/2843679371 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f25440748f0 con 0x7f2544074510 2024-09-12T02:37:04.905 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:37:04.905+0000 7f2541600640 1 -- 172.21.15.39:0/2843679371 <== mon.1 v2:172.21.15.172:3300/0 4 ==== mgrmap(e 17) ==== 137884+0+0 (secure 0 0 0) 0x7f25380037a0 con 0x7f2544074510 2024-09-12T02:37:04.907 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:37:04.907+0000 7f2541600640 1 --2- 172.21.15.39:0/2843679371 >> [v2:172.21.15.39:6800/1725006999,v1:172.21.15.39:6801/1725006999] conn(0x7f252c0a2c90 0x7f252c0a5150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:37:04.908 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:37:04.907+0000 7f2541600640 1 -- 172.21.15.39:0/2843679371 <== mon.1 v2:172.21.15.172:3300/0 5 ==== osd_map(95..95 src has 1..95) ==== 9129+0+0 (secure 0 0 0) 0x7f25380cf7f0 con 0x7f2544074510 2024-09-12T02:37:04.908 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:37:04.907+0000 7f2543e00640 1 --2- 172.21.15.39:0/2843679371 >> [v2:172.21.15.39:6800/1725006999,v1:172.21.15.39:6801/1725006999] conn(0x7f252c0a2c90 0x7f252c0a5150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:37:04.908 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:37:04.908+0000 7f2543e00640 1 --2- 172.21.15.39:0/2843679371 >> [v2:172.21.15.39:6800/1725006999,v1:172.21.15.39:6801/1725006999] conn(0x7f252c0a2c90 0x7f252c0a5150 secure :-1 s=READY pgs=208 cs=0 l=1 rev1=1 crypto rx=0x7f2530000c00 tx=0x7f2530005b50 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:37:04.911 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:37:04.911+0000 7f2541600640 1 -- 172.21.15.39:0/2843679371 <== mon.1 v2:172.21.15.172:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7f253809c210 con 0x7f2544074510 2024-09-12T02:37:05.136 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:37:05.136+0000 7f2549e00640 1 -- 172.21.15.39:0/2843679371 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f2544108e70 con 0x7f2544074510 2024-09-12T02:37:05.139 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:37:05.138+0000 7f2541600640 1 -- 172.21.15.39:0/2843679371 <== mon.1 v2:172.21.15.172:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v95) ==== 74+0+24770 (secure 0 0 0) 0x7f253809bb10 con 0x7f2544074510 2024-09-12T02:37:05.140 INFO:teuthology.orchestra.run.smithi039.stdout: 2024-09-12T02:37:05.140 INFO:teuthology.orchestra.run.smithi039.stdout:{"epoch":95,"fsid":"4954ed46-70ae-11ef-bcea-c7b262605968","created":"2024-09-12T02:26:43.086467+0000","modified":"2024-09-12T02:36:46.999173+0000","last_up_change":"2024-09-12T02:34:08.626341+0000","last_in_change":"2024-09-12T02:33:45.553591+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":27,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":12,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-12T02:30:09.347905+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":12,"score_stable":12,"optimal_score":0.25,"raw_score_acting":3,"raw_score_stable":3,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-09-12T02:34:58.580872+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"84","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.8799999952316284,"score_stable":1.8799999952316284,"optimal_score":1,"raw_score_acting":1.8799999952316284,"raw_score_stable":1.8799999952316284,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-09-12T02:35:01.469805+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"84","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2024-09-12T02:35:11.088109+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"91","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"c967b48e-8a39-4797-871b-8b1b83d9472f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":87,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6802","nonce":2437586899},{"type":"v1","addr":"172.21.15.39:6803","nonce":2437586899}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6804","nonce":2437586899},{"type":"v1","addr":"172.21.15.39:6805","nonce":2437586899}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6808","nonce":2437586899},{"type":"v1","addr":"172.21.15.39:6809","nonce":2437586899}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6806","nonce":2437586899},{"type":"v1","addr":"172.21.15.39:6807","nonce":2437586899}]},"public_addr":"172.21.15.39:6803/2437586899","cluster_addr":"172.21.15.39:6805/2437586899","heartbeat_back_addr":"172.21.15.39:6809/2437586899","heartbeat_front_addr":"172.21.15.39:6807/2437586899","state":["exists","up"]},{"osd":1,"uuid":"30e1e4f4-1d50-4003-8978-cb183dca7fbb","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":87,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6800","nonce":2349287000},{"type":"v1","addr":"172.21.15.44:6801","nonce":2349287000}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6802","nonce":2349287000},{"type":"v1","addr":"172.21.15.44:6803","nonce":2349287000}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6806","nonce":2349287000},{"type":"v1","addr":"172.21.15.44:6807","nonce":2349287000}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6804","nonce":2349287000},{"type":"v1","addr":"172.21.15.44:6805","nonce":2349287000}]},"public_addr":"172.21.15.44:6801/2349287000","cluster_addr":"172.21.15.44:6803/2349287000","heartbeat_back_addr":"172.21.15.44:6807/2349287000","heartbeat_front_addr":"172.21.15.44:6805/2349287000","state":["exists","up"]},{"osd":2,"uuid":"a758803f-8668-4fc8-9417-b8d080cd9a7c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":18,"up_thru":94,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6800","nonce":1176898232},{"type":"v1","addr":"172.21.15.172:6801","nonce":1176898232}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6802","nonce":1176898232},{"type":"v1","addr":"172.21.15.172:6803","nonce":1176898232}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6806","nonce":1176898232},{"type":"v1","addr":"172.21.15.172:6807","nonce":1176898232}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6804","nonce":1176898232},{"type":"v1","addr":"172.21.15.172:6805","nonce":1176898232}]},"public_addr":"172.21.15.172:6801/1176898232","cluster_addr":"172.21.15.172:6803/1176898232","heartbeat_back_addr":"172.21.15.172:6807/1176898232","heartbeat_front_addr":"172.21.15.172:6805/1176898232","state":["exists","up"]},{"osd":3,"uuid":"8b256567-7efe-429c-bc4c-80e93228f139","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":26,"up_thru":87,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6810","nonce":2013565859},{"type":"v1","addr":"172.21.15.39:6811","nonce":2013565859}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6812","nonce":2013565859},{"type":"v1","addr":"172.21.15.39:6813","nonce":2013565859}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6816","nonce":2013565859},{"type":"v1","addr":"172.21.15.39:6817","nonce":2013565859}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6814","nonce":2013565859},{"type":"v1","addr":"172.21.15.39:6815","nonce":2013565859}]},"public_addr":"172.21.15.39:6811/2013565859","cluster_addr":"172.21.15.39:6813/2013565859","heartbeat_back_addr":"172.21.15.39:6817/2013565859","heartbeat_front_addr":"172.21.15.39:6815/2013565859","state":["exists","up"]},{"osd":4,"uuid":"e86b6756-e2b3-49fe-9b87-1a2b015bb17a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":33,"up_thru":87,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6808","nonce":3663639110},{"type":"v1","addr":"172.21.15.44:6809","nonce":3663639110}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6810","nonce":3663639110},{"type":"v1","addr":"172.21.15.44:6811","nonce":3663639110}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6814","nonce":3663639110},{"type":"v1","addr":"172.21.15.44:6815","nonce":3663639110}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6812","nonce":3663639110},{"type":"v1","addr":"172.21.15.44:6813","nonce":3663639110}]},"public_addr":"172.21.15.44:6809/3663639110","cluster_addr":"172.21.15.44:6811/3663639110","heartbeat_back_addr":"172.21.15.44:6815/3663639110","heartbeat_front_addr":"172.21.15.44:6813/3663639110","state":["exists","up"]},{"osd":5,"uuid":"9c907c92-b323-48e7-99ad-ec9756d26312","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":38,"up_thru":92,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6808","nonce":998885347},{"type":"v1","addr":"172.21.15.172:6809","nonce":998885347}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6810","nonce":998885347},{"type":"v1","addr":"172.21.15.172:6811","nonce":998885347}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6814","nonce":998885347},{"type":"v1","addr":"172.21.15.172:6815","nonce":998885347}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6812","nonce":998885347},{"type":"v1","addr":"172.21.15.172:6813","nonce":998885347}]},"public_addr":"172.21.15.172:6809/998885347","cluster_addr":"172.21.15.172:6811/998885347","heartbeat_back_addr":"172.21.15.172:6815/998885347","heartbeat_front_addr":"172.21.15.172:6813/998885347","state":["exists","up"]},{"osd":6,"uuid":"1fcb9bb2-6f4b-4d97-a401-aeb6a9706613","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":45,"up_thru":92,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6818","nonce":2569059542},{"type":"v1","addr":"172.21.15.39:6819","nonce":2569059542}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6820","nonce":2569059542},{"type":"v1","addr":"172.21.15.39:6821","nonce":2569059542}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6824","nonce":2569059542},{"type":"v1","addr":"172.21.15.39:6825","nonce":2569059542}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6822","nonce":2569059542},{"type":"v1","addr":"172.21.15.39:6823","nonce":2569059542}]},"public_addr":"172.21.15.39:6819/2569059542","cluster_addr":"172.21.15.39:6821/2569059542","heartbeat_back_addr":"172.21.15.39:6825/2569059542","heartbeat_front_addr":"172.21.15.39:6823/2569059542","state":["exists","up"]},{"osd":7,"uuid":"59e0caf9-8ce5-4161-8875-84862eba743e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":50,"up_thru":87,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6816","nonce":709635079},{"type":"v1","addr":"172.21.15.44:6817","nonce":709635079}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6818","nonce":709635079},{"type":"v1","addr":"172.21.15.44:6819","nonce":709635079}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6822","nonce":709635079},{"type":"v1","addr":"172.21.15.44:6823","nonce":709635079}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6820","nonce":709635079},{"type":"v1","addr":"172.21.15.44:6821","nonce":709635079}]},"public_addr":"172.21.15.44:6817/709635079","cluster_addr":"172.21.15.44:6819/709635079","heartbeat_back_addr":"172.21.15.44:6823/709635079","heartbeat_front_addr":"172.21.15.44:6821/709635079","state":["exists","up"]},{"osd":8,"uuid":"2f6fb5c7-86cc-43eb-bdfb-45a69316937e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":57,"up_thru":94,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6816","nonce":1162792895},{"type":"v1","addr":"172.21.15.172:6817","nonce":1162792895}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6818","nonce":1162792895},{"type":"v1","addr":"172.21.15.172:6819","nonce":1162792895}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6822","nonce":1162792895},{"type":"v1","addr":"172.21.15.172:6823","nonce":1162792895}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6820","nonce":1162792895},{"type":"v1","addr":"172.21.15.172:6821","nonce":1162792895}]},"public_addr":"172.21.15.172:6817/1162792895","cluster_addr":"172.21.15.172:6819/1162792895","heartbeat_back_addr":"172.21.15.172:6823/1162792895","heartbeat_front_addr":"172.21.15.172:6821/1162792895","state":["exists","up"]},{"osd":9,"uuid":"87e5dd9e-8191-4db6-83fa-cfff7c31e17e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":65,"up_thru":92,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6826","nonce":945860346},{"type":"v1","addr":"172.21.15.39:6827","nonce":945860346}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6828","nonce":945860346},{"type":"v1","addr":"172.21.15.39:6829","nonce":945860346}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6832","nonce":945860346},{"type":"v1","addr":"172.21.15.39:6833","nonce":945860346}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6830","nonce":945860346},{"type":"v1","addr":"172.21.15.39:6831","nonce":945860346}]},"public_addr":"172.21.15.39:6827/945860346","cluster_addr":"172.21.15.39:6829/945860346","heartbeat_back_addr":"172.21.15.39:6833/945860346","heartbeat_front_addr":"172.21.15.39:6831/945860346","state":["exists","up"]},{"osd":10,"uuid":"b55d8a00-850f-4910-a5bf-97d9ed545be7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":70,"up_thru":81,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6824","nonce":3899352344},{"type":"v1","addr":"172.21.15.44:6825","nonce":3899352344}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6826","nonce":3899352344},{"type":"v1","addr":"172.21.15.44:6827","nonce":3899352344}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6830","nonce":3899352344},{"type":"v1","addr":"172.21.15.44:6831","nonce":3899352344}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6828","nonce":3899352344},{"type":"v1","addr":"172.21.15.44:6829","nonce":3899352344}]},"public_addr":"172.21.15.44:6825/3899352344","cluster_addr":"172.21.15.44:6827/3899352344","heartbeat_back_addr":"172.21.15.44:6831/3899352344","heartbeat_front_addr":"172.21.15.44:6829/3899352344","state":["exists","up"]},{"osd":11,"uuid":"20cf5df1-5a80-4272-acc0-919c6a1da55a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":77,"up_thru":92,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6824","nonce":3627635035},{"type":"v1","addr":"172.21.15.172:6825","nonce":3627635035}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6826","nonce":3627635035},{"type":"v1","addr":"172.21.15.172:6827","nonce":3627635035}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6830","nonce":3627635035},{"type":"v1","addr":"172.21.15.172:6831","nonce":3627635035}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6828","nonce":3627635035},{"type":"v1","addr":"172.21.15.172:6829","nonce":3627635035}]},"public_addr":"172.21.15.172:6825/3627635035","cluster_addr":"172.21.15.172:6827/3627635035","heartbeat_back_addr":"172.21.15.172:6831/3627635035","heartbeat_front_addr":"172.21.15.172:6829/3627635035","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T02:29:15.367468+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T02:29:41.518207+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T02:30:06.004371+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T02:30:34.793371+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T02:31:00.878517+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T02:31:26.675956+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T02:31:55.950748+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T02:32:22.824017+0000","dead_epoch":0},{"osd":8,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T02:32:46.775880+0000","dead_epoch":0},{"osd":9,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T02:33:16.420347+0000","dead_epoch":0},{"osd":10,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T02:33:42.185837+0000","dead_epoch":0},{"osd":11,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T02:34:07.312555+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"2.0","mappings":[{"from":7,"to":11}]},{"pgid":"2.b","mappings":[{"from":2,"to":1}]},{"pgid":"2.10","mappings":[{"from":8,"to":11}]},{"pgid":"2.1b","mappings":[{"from":2,"to":4}]},{"pgid":"3.11","mappings":[{"from":4,"to":8}]},{"pgid":"3.24","mappings":[{"from":4,"to":9}]},{"pgid":"3.33","mappings":[{"from":5,"to":9}]},{"pgid":"3.34","mappings":[{"from":4,"to":9}]},{"pgid":"4.2","mappings":[{"from":9,"to":1}]},{"pgid":"4.6","mappings":[{"from":9,"to":11},{"from":5,"to":8}]},{"pgid":"4.19","mappings":[{"from":9,"to":8}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.39:6800/3152613618":"2024-09-13T02:27:44.717224+0000","172.21.15.39:0/2301206766":"2024-09-13T02:27:44.717224+0000","172.21.15.39:0/1941318538":"2024-09-13T02:27:44.717224+0000","172.21.15.39:0/1527429435":"2024-09-13T02:27:44.717224+0000","172.21.15.39:0/2913347539":"2024-09-13T02:27:16.531986+0000","172.21.15.39:0/2827440002":"2024-09-13T02:27:16.531986+0000","172.21.15.39:0/4075322467":"2024-09-13T02:27:16.531986+0000","172.21.15.39:6801/1074685700":"2024-09-13T02:27:16.531986+0000","172.21.15.39:6801/3152613618":"2024-09-13T02:27:44.717224+0000","172.21.15.39:6800/1074685700":"2024-09-13T02:27:16.531986+0000"},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-12T02:37:05.142 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:37:05.141+0000 7f2549e00640 1 -- 172.21.15.39:0/2843679371 >> [v2:172.21.15.39:6800/1725006999,v1:172.21.15.39:6801/1725006999] conn(0x7f252c0a2c90 msgr2=0x7f252c0a5150 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:37:05.142 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:37:05.141+0000 7f2549e00640 1 --2- 172.21.15.39:0/2843679371 >> [v2:172.21.15.39:6800/1725006999,v1:172.21.15.39:6801/1725006999] conn(0x7f252c0a2c90 0x7f252c0a5150 secure :-1 s=READY pgs=208 cs=0 l=1 rev1=1 crypto rx=0x7f2530000c00 tx=0x7f2530005b50 comp rx=0 tx=0).stop 2024-09-12T02:37:05.142 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:37:05.141+0000 7f2549e00640 1 -- 172.21.15.39:0/2843679371 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f2544074510 msgr2=0x7f254419a480 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:37:05.142 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:37:05.141+0000 7f2549e00640 1 --2- 172.21.15.39:0/2843679371 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f2544074510 0x7f254419a480 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0x7f253800ea60 tx=0x7f253800ef20 comp rx=0 tx=0).stop 2024-09-12T02:37:05.142 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:37:05.141+0000 7f2549e00640 1 -- 172.21.15.39:0/2843679371 shutdown_connections 2024-09-12T02:37:05.142 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:37:05.141+0000 7f2549e00640 1 --2- 172.21.15.39:0/2843679371 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f254410e280 0x7f254419ed50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:37:05.142 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:37:05.141+0000 7f2549e00640 1 --2- 172.21.15.39:0/2843679371 >> [v2:172.21.15.39:6800/1725006999,v1:172.21.15.39:6801/1725006999] conn(0x7f252c0a2c90 0x7f252c0a5150 unknown :-1 s=CLOSED pgs=208 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:37:05.142 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:37:05.141+0000 7f2549e00640 1 --2- 172.21.15.39:0/2843679371 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f2544074e30 0x7f254419a9c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:37:05.142 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:37:05.141+0000 7f2549e00640 1 --2- 172.21.15.39:0/2843679371 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f2544074510 0x7f254419a480 unknown :-1 s=CLOSED pgs=99 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:37:05.142 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:37:05.141+0000 7f2549e00640 1 -- 172.21.15.39:0/2843679371 >> 172.21.15.39:0/2843679371 conn(0x7f25440fd740 msgr2=0x7f25440fe440 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:37:05.143 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 02:37:05 smithi039 ceph-mon[30515]: from='mgr.14150 172.21.15.39:0/408627207' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-12T02:37:05.143 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:37:05.142+0000 7f2549e00640 1 -- 172.21.15.39:0/2843679371 shutdown_connections 2024-09-12T02:37:05.143 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:37:05.142+0000 7f2549e00640 1 -- 172.21.15.39:0/2843679371 wait complete. 2024-09-12T02:37:05.342 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 12 02:37:05 smithi044 ceph-mon[35411]: from='mgr.14150 172.21.15.39:0/408627207' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-12T02:37:05.344 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 12 02:37:05 smithi172 ceph-mon[35609]: from='mgr.14150 172.21.15.39:0/408627207' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-12T02:37:05.944 DEBUG:teuthology.orchestra.run.smithi039:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc shell --fsid 4954ed46-70ae-11ef-bcea-c7b262605968 -- ceph fs dump --format=json 2024-09-12T02:37:06.100 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 02:37:06 smithi039 ceph-mon[30515]: pgmap v365: 129 pgs: 129 active+clean; 645 KiB data, 348 MiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2024-09-12T02:37:06.100 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 02:37:06 smithi039 ceph-mon[30515]: from='client.? 172.21.15.39:0/2843679371' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-09-12T02:37:06.100 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 02:37:06 smithi039 ceph-mon[30515]: from='mgr.14150 172.21.15.39:0/408627207' entity='mgr.x' 2024-09-12T02:37:06.100 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 02:37:06 smithi039 ceph-mon[30515]: from='mgr.14150 172.21.15.39:0/408627207' entity='mgr.x' 2024-09-12T02:37:06.100 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 02:37:06 smithi039 ceph-mon[30515]: from='mgr.14150 172.21.15.39:0/408627207' entity='mgr.x' 2024-09-12T02:37:06.100 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 02:37:06 smithi039 ceph-mon[30515]: from='mgr.14150 172.21.15.39:0/408627207' entity='mgr.x' 2024-09-12T02:37:06.448 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 12 02:37:06 smithi044 ceph-mon[35411]: pgmap v365: 129 pgs: 129 active+clean; 645 KiB data, 348 MiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2024-09-12T02:37:06.448 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 12 02:37:06 smithi044 ceph-mon[35411]: from='client.? 172.21.15.39:0/2843679371' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-09-12T02:37:06.448 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 12 02:37:06 smithi044 ceph-mon[35411]: from='mgr.14150 172.21.15.39:0/408627207' entity='mgr.x' 2024-09-12T02:37:06.449 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 12 02:37:06 smithi044 ceph-mon[35411]: from='mgr.14150 172.21.15.39:0/408627207' entity='mgr.x' 2024-09-12T02:37:06.449 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 12 02:37:06 smithi044 ceph-mon[35411]: from='mgr.14150 172.21.15.39:0/408627207' entity='mgr.x' 2024-09-12T02:37:06.449 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 12 02:37:06 smithi044 ceph-mon[35411]: from='mgr.14150 172.21.15.39:0/408627207' entity='mgr.x' 2024-09-12T02:37:06.513 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 12 02:37:06 smithi172 ceph-mon[35609]: pgmap v365: 129 pgs: 129 active+clean; 645 KiB data, 348 MiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2024-09-12T02:37:06.513 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 12 02:37:06 smithi172 ceph-mon[35609]: from='client.? 172.21.15.39:0/2843679371' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-09-12T02:37:06.513 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 12 02:37:06 smithi172 ceph-mon[35609]: from='mgr.14150 172.21.15.39:0/408627207' entity='mgr.x' 2024-09-12T02:37:06.514 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 12 02:37:06 smithi172 ceph-mon[35609]: from='mgr.14150 172.21.15.39:0/408627207' entity='mgr.x' 2024-09-12T02:37:06.514 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 12 02:37:06 smithi172 ceph-mon[35609]: from='mgr.14150 172.21.15.39:0/408627207' entity='mgr.x' 2024-09-12T02:37:06.514 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 12 02:37:06 smithi172 ceph-mon[35609]: from='mgr.14150 172.21.15.39:0/408627207' entity='mgr.x' 2024-09-12T02:37:06.719 INFO:teuthology.orchestra.run.smithi039.stderr:Inferring config /var/lib/ceph/4954ed46-70ae-11ef-bcea-c7b262605968/mon.a/config 2024-09-12T02:37:07.305 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:37:07.303+0000 7f5ae7e00640 1 -- 172.21.15.39:0/479307582 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f5ae010e420 msgr2=0x7f5ae0110810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:37:07.305 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:37:07.303+0000 7f5ae7e00640 1 --2- 172.21.15.39:0/479307582 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f5ae010e420 0x7f5ae0110810 secure :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0x7f5ad8009ca0 tx=0x7f5ad802a950 comp rx=0 tx=0).stop 2024-09-12T02:37:07.305 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:37:07.303+0000 7f5ae7e00640 1 -- 172.21.15.39:0/479307582 shutdown_connections 2024-09-12T02:37:07.305 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:37:07.303+0000 7f5ae7e00640 1 --2- 172.21.15.39:0/479307582 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f5ae010e420 0x7f5ae0110810 unknown :-1 s=CLOSED pgs=100 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:37:07.305 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:37:07.303+0000 7f5ae7e00640 1 --2- 172.21.15.39:0/479307582 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f5ae0074ee0 0x7f5ae010dee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:37:07.306 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:37:07.303+0000 7f5ae7e00640 1 --2- 172.21.15.39:0/479307582 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f5ae00745c0 0x7f5ae00749a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:37:07.306 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:37:07.303+0000 7f5ae7e00640 1 -- 172.21.15.39:0/479307582 >> 172.21.15.39:0/479307582 conn(0x7f5ae00fd8c0 msgr2=0x7f5ae00ffce0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:37:07.306 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:37:07.303+0000 7f5ae7e00640 1 -- 172.21.15.39:0/479307582 shutdown_connections 2024-09-12T02:37:07.306 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:37:07.303+0000 7f5ae7e00640 1 -- 172.21.15.39:0/479307582 wait complete. 2024-09-12T02:37:07.306 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:37:07.305+0000 7f5ae7e00640 1 Processor -- start 2024-09-12T02:37:07.308 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:37:07.305+0000 7f5ae7e00640 1 -- start start 2024-09-12T02:37:07.308 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:37:07.305+0000 7f5ae7e00640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f5ae00745c0 0x7f5ae019a640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:37:07.308 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:37:07.305+0000 7f5ae7e00640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f5ae0074ee0 0x7f5ae019ab80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:37:07.308 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:37:07.305+0000 7f5ae7e00640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f5ae010e420 0x7f5ae019ef10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:37:07.308 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:37:07.305+0000 7f5ae7e00640 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 -- 0x7f5ae0114160 con 0x7f5ae0074ee0 2024-09-12T02:37:07.308 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:37:07.305+0000 7f5ae7e00640 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x7f5ae0113fe0 con 0x7f5ae00745c0 2024-09-12T02:37:07.308 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:37:07.305+0000 7f5ae7e00640 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7f5ae01142e0 con 0x7f5ae010e420 2024-09-12T02:37:07.308 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:37:07.305+0000 7f5ae4a00640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f5ae0074ee0 0x7f5ae019ab80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:37:07.308 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:37:07.306+0000 7f5ae4a00640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f5ae0074ee0 0x7f5ae019ab80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.39:3300/0 says I am v2:172.21.15.39:52930/0 (socket says 172.21.15.39:52930) 2024-09-12T02:37:07.308 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:37:07.306+0000 7f5ae4a00640 1 -- 172.21.15.39:0/2993593025 learned_addr learned my addr 172.21.15.39:0/2993593025 (peer_addr_for_me v2:172.21.15.39:0/0) 2024-09-12T02:37:07.308 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:37:07.306+0000 7f5ae5400640 1 --2- 172.21.15.39:0/2993593025 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f5ae00745c0 0x7f5ae019a640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:37:07.309 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:37:07.306+0000 7f5ae5e00640 1 --2- 172.21.15.39:0/2993593025 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f5ae010e420 0x7f5ae019ef10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:37:07.309 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:37:07.306+0000 7f5ae4a00640 1 -- 172.21.15.39:0/2993593025 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f5ae010e420 msgr2=0x7f5ae019ef10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:37:07.309 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:37:07.306+0000 7f5ae4a00640 1 --2- 172.21.15.39:0/2993593025 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f5ae010e420 0x7f5ae019ef10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:37:07.309 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:37:07.306+0000 7f5ae4a00640 1 -- 172.21.15.39:0/2993593025 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f5ae00745c0 msgr2=0x7f5ae019a640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:37:07.309 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:37:07.306+0000 7f5ae4a00640 1 --2- 172.21.15.39:0/2993593025 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f5ae00745c0 0x7f5ae019a640 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:37:07.309 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:37:07.306+0000 7f5ae4a00640 1 -- 172.21.15.39:0/2993593025 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5ae019f5f0 con 0x7f5ae0074ee0 2024-09-12T02:37:07.309 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:37:07.306+0000 7f5ae5400640 1 --2- 172.21.15.39:0/2993593025 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f5ae00745c0 0x7f5ae019a640 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-12T02:37:07.309 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:37:07.307+0000 7f5ae4a00640 1 --2- 172.21.15.39:0/2993593025 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f5ae0074ee0 0x7f5ae019ab80 secure :-1 s=READY pgs=230 cs=0 l=1 rev1=1 crypto rx=0x7f5acc00ea60 tx=0x7f5acc00ef20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:37:07.309 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:37:07.307+0000 7f5ade000640 1 -- 172.21.15.39:0/2993593025 <== mon.0 v2:172.21.15.39:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5acc00cde0 con 0x7f5ae0074ee0 2024-09-12T02:37:07.309 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:37:07.307+0000 7f5ade000640 1 -- 172.21.15.39:0/2993593025 <== mon.0 v2:172.21.15.39:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f5acc0035f0 con 0x7f5ae0074ee0 2024-09-12T02:37:07.310 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:37:07.307+0000 7f5ade000640 1 -- 172.21.15.39:0/2993593025 <== mon.0 v2:172.21.15.39:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5acc010670 con 0x7f5ae0074ee0 2024-09-12T02:37:07.310 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:37:07.307+0000 7f5ae7e00640 1 -- 172.21.15.39:0/2993593025 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f5ae019f8e0 con 0x7f5ae0074ee0 2024-09-12T02:37:07.310 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:37:07.307+0000 7f5ae7e00640 1 -- 172.21.15.39:0/2993593025 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f5ae01a71c0 con 0x7f5ae0074ee0 2024-09-12T02:37:07.310 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:37:07.308+0000 7f5ae7e00640 1 -- 172.21.15.39:0/2993593025 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f5ae00749a0 con 0x7f5ae0074ee0 2024-09-12T02:37:07.311 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:37:07.310+0000 7f5ade000640 1 -- 172.21.15.39:0/2993593025 <== mon.0 v2:172.21.15.39:3300/0 4 ==== mgrmap(e 17) ==== 137884+0+0 (secure 0 0 0) 0x7f5acc0037a0 con 0x7f5ae0074ee0 2024-09-12T02:37:07.313 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:37:07.313+0000 7f5ade000640 1 --2- 172.21.15.39:0/2993593025 >> [v2:172.21.15.39:6800/1725006999,v1:172.21.15.39:6801/1725006999] conn(0x7f5ac80a2c90 0x7f5ac80a5150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:37:07.314 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:37:07.313+0000 7f5ade000640 1 -- 172.21.15.39:0/2993593025 <== mon.0 v2:172.21.15.39:3300/0 5 ==== osd_map(95..95 src has 1..95) ==== 9129+0+0 (secure 0 0 0) 0x7f5acc0cf850 con 0x7f5ae0074ee0 2024-09-12T02:37:07.314 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:37:07.313+0000 7f5ae5400640 1 --2- 172.21.15.39:0/2993593025 >> [v2:172.21.15.39:6800/1725006999,v1:172.21.15.39:6801/1725006999] conn(0x7f5ac80a2c90 0x7f5ac80a5150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:37:07.314 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:37:07.314+0000 7f5ae5400640 1 --2- 172.21.15.39:0/2993593025 >> [v2:172.21.15.39:6800/1725006999,v1:172.21.15.39:6801/1725006999] conn(0x7f5ac80a2c90 0x7f5ac80a5150 secure :-1 s=READY pgs=209 cs=0 l=1 rev1=1 crypto rx=0x7f5ad4009fc0 tx=0x7f5ad4005f90 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:37:07.316 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:37:07.315+0000 7f5ade000640 1 -- 172.21.15.39:0/2993593025 <== mon.0 v2:172.21.15.39:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7f5acc09c300 con 0x7f5ae0074ee0 2024-09-12T02:37:07.590 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:37:07.589+0000 7f5ae7e00640 1 -- 172.21.15.39:0/2993593025 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f5ae019b9a0 con 0x7f5ae0074ee0 2024-09-12T02:37:07.591 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:37:07.590+0000 7f5ade000640 1 -- 172.21.15.39:0/2993593025 <== mon.0 v2:172.21.15.39:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 28 v28) ==== 94+0+11975 (secure 0 0 0) 0x7f5ae019b9a0 con 0x7f5ae0074ee0 2024-09-12T02:37:07.591 INFO:teuthology.orchestra.run.smithi039.stdout: 2024-09-12T02:37:07.592 INFO:teuthology.orchestra.run.smithi039.stdout:{"epoch":28,"btime":"2024-09-12T02:35:53:793149+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14451,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.39:6835/2325642381","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6834","nonce":2325642381},{"type":"v1","addr":"172.21.15.39:6835","nonce":2325642381}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14511,"name":"g","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.39:6839/936905514","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6838","nonce":936905514},{"type":"v1","addr":"172.21.15.39:6839","nonce":936905514}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":11}],"filesystems":[{"mdsmap":{"epoch":28,"flags":50,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-09-12T02:35:03.522182+0000","modified":"2024-09-12T02:35:53.762825+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":5,"in":[0,1,2,3,4],"up":{"mds_0":24515,"mds_1":24499,"mds_2":24484,"mds_3":24482,"mds_4":24472},"failed":[],"damaged":[],"stopped":[],"info":{"gid_14523":{"gid":14523,"name":"a","rank":4,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.39:6841/2829712180","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6840","nonce":2829712180},{"type":"v1","addr":"172.21.15.39:6841","nonce":2829712180}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24422":{"gid":24422,"name":"k","rank":3,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.44:6833/2359724364","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6832","nonce":2359724364},{"type":"v1","addr":"172.21.15.44:6833","nonce":2359724364}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24430":{"gid":24430,"name":"l","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.172:6833/3232434105","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6832","nonce":3232434105},{"type":"v1","addr":"172.21.15.172:6833","nonce":3232434105}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24446":{"gid":24446,"name":"d","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.39:6837/2743237008","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6836","nonce":2743237008},{"type":"v1","addr":"172.21.15.39:6837","nonce":2743237008}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24458":{"gid":24458,"name":"e","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.44:6835/4063842354","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6834","nonce":4063842354},{"type":"v1","addr":"172.21.15.44:6835","nonce":4063842354}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24472":{"gid":24472,"name":"f","rank":4,"incarnation":26,"state":"up:active","state_seq":21,"addr":"172.21.15.172:6835/3274676014","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6834","nonce":3274676014},{"type":"v1","addr":"172.21.15.172:6835","nonce":3274676014}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24482":{"gid":24482,"name":"h","rank":3,"incarnation":24,"state":"up:active","state_seq":19,"addr":"172.21.15.44:6837/1501493978","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6836","nonce":1501493978},{"type":"v1","addr":"172.21.15.44:6837","nonce":1501493978}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24484":{"gid":24484,"name":"c","rank":2,"incarnation":22,"state":"up:active","state_seq":20,"addr":"172.21.15.172:6837/493506747","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6836","nonce":493506747},{"type":"v1","addr":"172.21.15.172:6837","nonce":493506747}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24499":{"gid":24499,"name":"i","rank":1,"incarnation":20,"state":"up:active","state_seq":18,"addr":"172.21.15.172:6839/3742537097","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6838","nonce":3742537097},{"type":"v1","addr":"172.21.15.172:6839","nonce":3742537097}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24515":{"gid":24515,"name":"b","rank":0,"incarnation":14,"state":"up:active","state_seq":5,"addr":"172.21.15.44:6839/2556532723","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6838","nonce":2556532723},{"type":"v1","addr":"172.21.15.44:6839","nonce":2556532723}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":24515,"qdb_cluster":[24515,24499,24484,24482,24472]},"id":1}]} 2024-09-12T02:37:07.592 INFO:teuthology.orchestra.run.smithi039.stderr:dumped fsmap epoch 28 2024-09-12T02:37:07.594 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:37:07.593+0000 7f5ae7e00640 1 -- 172.21.15.39:0/2993593025 >> [v2:172.21.15.39:6800/1725006999,v1:172.21.15.39:6801/1725006999] conn(0x7f5ac80a2c90 msgr2=0x7f5ac80a5150 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:37:07.594 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:37:07.593+0000 7f5ae7e00640 1 --2- 172.21.15.39:0/2993593025 >> [v2:172.21.15.39:6800/1725006999,v1:172.21.15.39:6801/1725006999] conn(0x7f5ac80a2c90 0x7f5ac80a5150 secure :-1 s=READY pgs=209 cs=0 l=1 rev1=1 crypto rx=0x7f5ad4009fc0 tx=0x7f5ad4005f90 comp rx=0 tx=0).stop 2024-09-12T02:37:07.594 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:37:07.593+0000 7f5ae7e00640 1 -- 172.21.15.39:0/2993593025 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f5ae0074ee0 msgr2=0x7f5ae019ab80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:37:07.595 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:37:07.593+0000 7f5ae7e00640 1 --2- 172.21.15.39:0/2993593025 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f5ae0074ee0 0x7f5ae019ab80 secure :-1 s=READY pgs=230 cs=0 l=1 rev1=1 crypto rx=0x7f5acc00ea60 tx=0x7f5acc00ef20 comp rx=0 tx=0).stop 2024-09-12T02:37:07.595 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:37:07.593+0000 7f5ae7e00640 1 -- 172.21.15.39:0/2993593025 shutdown_connections 2024-09-12T02:37:07.595 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:37:07.593+0000 7f5ae7e00640 1 --2- 172.21.15.39:0/2993593025 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f5ae010e420 0x7f5ae019ef10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:37:07.595 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:37:07.593+0000 7f5ae7e00640 1 --2- 172.21.15.39:0/2993593025 >> [v2:172.21.15.39:6800/1725006999,v1:172.21.15.39:6801/1725006999] conn(0x7f5ac80a2c90 0x7f5ac80a5150 unknown :-1 s=CLOSED pgs=209 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:37:07.595 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:37:07.593+0000 7f5ae7e00640 1 --2- 172.21.15.39:0/2993593025 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f5ae0074ee0 0x7f5ae019ab80 unknown :-1 s=CLOSED pgs=230 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:37:07.595 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:37:07.593+0000 7f5ae7e00640 1 --2- 172.21.15.39:0/2993593025 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f5ae00745c0 0x7f5ae019a640 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:37:07.595 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:37:07.593+0000 7f5ae7e00640 1 -- 172.21.15.39:0/2993593025 >> 172.21.15.39:0/2993593025 conn(0x7f5ae00fd8c0 msgr2=0x7f5ae00fefa0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:37:07.595 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:37:07.593+0000 7f5ae7e00640 1 -- 172.21.15.39:0/2993593025 shutdown_connections 2024-09-12T02:37:07.595 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:37:07.593+0000 7f5ae7e00640 1 -- 172.21.15.39:0/2993593025 wait complete. 2024-09-12T02:37:08.349 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 02:37:08 smithi039 ceph-mon[30515]: pgmap v366: 129 pgs: 129 active+clean; 645 KiB data, 348 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2024-09-12T02:37:08.350 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 02:37:08 smithi039 ceph-mon[30515]: from='client.? 172.21.15.39:0/2993593025' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-12T02:37:08.428 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 28, 'flags': 50, 'flags_state': {'joinable': True, 'allow_snaps': True, 'allow_multimds_snaps': True, 'allow_standby_replay': True, 'refuse_client_session': False, 'refuse_standby_for_another_fs': False, 'balance_automate': False}, 'ever_allowed_features': 32, 'explicitly_allowed_features': 32, 'created': '2024-09-12T02:35:03.522182+0000', 'modified': '2024-09-12T02:35:53.762825+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 300, 'session_autoclose': 300, 'required_client_features': {}, 'max_file_size': 1099511627776, 'max_xattr_size': 65536, 'last_failure': 0, 'last_failure_osd_epoch': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}, 'max_mds': 5, 'in': [0, 1, 2, 3, 4], 'up': {'mds_0': 24515, 'mds_1': 24499, 'mds_2': 24484, 'mds_3': 24482, 'mds_4': 24472}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_14523': {'gid': 14523, 'name': 'a', 'rank': 4, 'incarnation': 0, 'state': 'up:standby-replay', 'state_seq': 1, 'addr': '172.21.15.39:6841/2829712180', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.39:6840', 'nonce': 2829712180}, {'type': 'v1', 'addr': '172.21.15.39:6841', 'nonce': 2829712180}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540701547738038271, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}, 'gid_24422': {'gid': 24422, 'name': 'k', 'rank': 3, 'incarnation': 0, 'state': 'up:standby-replay', 'state_seq': 1, 'addr': '172.21.15.44:6833/2359724364', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.44:6832', 'nonce': 2359724364}, {'type': 'v1', 'addr': '172.21.15.44:6833', 'nonce': 2359724364}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540701547738038271, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}, 'gid_24430': {'gid': 24430, 'name': 'l', 'rank': 2, 'incarnation': 0, 'state': 'up:standby-replay', 'state_seq': 1, 'addr': '172.21.15.172:6833/3232434105', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.172:6832', 'nonce': 3232434105}, {'type': 'v1', 'addr': '172.21.15.172:6833', 'nonce': 3232434105}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540701547738038271, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}, 'gid_24446': {'gid': 24446, 'name': 'd', 'rank': 1, 'incarnation': 0, 'state': 'up:standby-replay', 'state_seq': 1, 'addr': '172.21.15.39:6837/2743237008', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.39:6836', 'nonce': 2743237008}, {'type': 'v1', 'addr': '172.21.15.39:6837', 'nonce': 2743237008}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540701547738038271, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}, 'gid_24458': {'gid': 24458, 'name': 'e', 'rank': 0, 'incarnation': 0, 'state': 'up:standby-replay', 'state_seq': 1, 'addr': '172.21.15.44:6835/4063842354', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.44:6834', 'nonce': 4063842354}, {'type': 'v1', 'addr': '172.21.15.44:6835', 'nonce': 4063842354}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540701547738038271, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}, 'gid_24472': {'gid': 24472, 'name': 'f', 'rank': 4, 'incarnation': 26, 'state': 'up:active', 'state_seq': 21, 'addr': '172.21.15.172:6835/3274676014', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.172:6834', 'nonce': 3274676014}, {'type': 'v1', 'addr': '172.21.15.172:6835', 'nonce': 3274676014}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540701547738038271, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}, 'gid_24482': {'gid': 24482, 'name': 'h', 'rank': 3, 'incarnation': 24, 'state': 'up:active', 'state_seq': 19, 'addr': '172.21.15.44:6837/1501493978', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.44:6836', 'nonce': 1501493978}, {'type': 'v1', 'addr': '172.21.15.44:6837', 'nonce': 1501493978}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540701547738038271, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}, 'gid_24484': {'gid': 24484, 'name': 'c', 'rank': 2, 'incarnation': 22, 'state': 'up:active', 'state_seq': 20, 'addr': '172.21.15.172:6837/493506747', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.172:6836', 'nonce': 493506747}, {'type': 'v1', 'addr': '172.21.15.172:6837', 'nonce': 493506747}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540701547738038271, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}, 'gid_24499': {'gid': 24499, 'name': 'i', 'rank': 1, 'incarnation': 20, 'state': 'up:active', 'state_seq': 18, 'addr': '172.21.15.172:6839/3742537097', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.172:6838', 'nonce': 3742537097}, {'type': 'v1', 'addr': '172.21.15.172:6839', 'nonce': 3742537097}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540701547738038271, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}, 'gid_24515': {'gid': 24515, 'name': 'b', 'rank': 0, 'incarnation': 14, 'state': 'up:active', 'state_seq': 5, 'addr': '172.21.15.44:6839/2556532723', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.44:6838', 'nonce': 2556532723}, {'type': 'v1', 'addr': '172.21.15.44:6839', 'nonce': 2556532723}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540701547738038271, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}}, 'data_pools': [3, 4], 'metadata_pool': 2, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'bal_rank_mask': '-1', 'standby_count_wanted': 0, 'qdb_leader': 24515, 'qdb_cluster': [24515, 24499, 24484, 24482, 24472]} 2024-09-12T02:37:08.428 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: 5/5 2024-09-12T02:37:08.428 DEBUG:teuthology.orchestra.run.smithi039:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc shell --fsid 4954ed46-70ae-11ef-bcea-c7b262605968 -- ceph tell mds.f status 2024-09-12T02:37:08.448 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 12 02:37:08 smithi044 ceph-mon[35411]: pgmap v366: 129 pgs: 129 active+clean; 645 KiB data, 348 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2024-09-12T02:37:08.448 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 12 02:37:08 smithi044 ceph-mon[35411]: from='client.? 172.21.15.39:0/2993593025' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-12T02:37:08.513 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 12 02:37:08 smithi172 ceph-mon[35609]: pgmap v366: 129 pgs: 129 active+clean; 645 KiB data, 348 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2024-09-12T02:37:08.514 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 12 02:37:08 smithi172 ceph-mon[35609]: from='client.? 172.21.15.39:0/2993593025' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-12T02:37:08.843 INFO:teuthology.orchestra.run.smithi039.stderr:Inferring config /var/lib/ceph/4954ed46-70ae-11ef-bcea-c7b262605968/mon.a/config 2024-09-12T02:37:09.430 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:37:09.429+0000 7f565f200640 1 -- 172.21.15.39:0/2123771754 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f56601047e0 msgr2=0x7f5660108830 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:37:09.430 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:37:09.429+0000 7f565f200640 1 --2- 172.21.15.39:0/2123771754 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f56601047e0 0x7f5660108830 secure :-1 s=READY pgs=231 cs=0 l=1 rev1=1 crypto rx=0x7f5648009900 tx=0x7f564802a3f0 comp rx=0 tx=0).stop 2024-09-12T02:37:09.430 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:37:09.429+0000 7f565f200640 1 -- 172.21.15.39:0/2123771754 shutdown_connections 2024-09-12T02:37:09.431 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:37:09.429+0000 7f565f200640 1 --2- 172.21.15.39:0/2123771754 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f5660108f60 0x7f5660110ae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:37:09.431 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:37:09.429+0000 7f565f200640 1 --2- 172.21.15.39:0/2123771754 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f56601047e0 0x7f5660108830 unknown :-1 s=CLOSED pgs=231 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:37:09.431 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:37:09.429+0000 7f565f200640 1 --2- 172.21.15.39:0/2123771754 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f5660103e30 0x7f5660104210 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:37:09.431 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:37:09.429+0000 7f565f200640 1 -- 172.21.15.39:0/2123771754 >> 172.21.15.39:0/2123771754 conn(0x7f56600ff8d0 msgr2=0x7f5660101cf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:37:09.431 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:37:09.429+0000 7f565f200640 1 -- 172.21.15.39:0/2123771754 shutdown_connections 2024-09-12T02:37:09.431 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:37:09.429+0000 7f565f200640 1 -- 172.21.15.39:0/2123771754 wait complete. 2024-09-12T02:37:09.432 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:37:09.430+0000 7f565f200640 1 Processor -- start 2024-09-12T02:37:09.432 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:37:09.430+0000 7f565f200640 1 -- start start 2024-09-12T02:37:09.432 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:37:09.431+0000 7f565f200640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f5660103e30 0x7f566019a490 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:37:09.432 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:37:09.431+0000 7f565f200640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f56601047e0 0x7f566019a9d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:37:09.432 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:37:09.431+0000 7f565f200640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f5660108f60 0x7f566019ed60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:37:09.432 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:37:09.431+0000 7f565f200640 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 -- 0x7f5660114010 con 0x7f5660103e30 2024-09-12T02:37:09.432 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:37:09.431+0000 7f565f200640 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x7f5660113e90 con 0x7f56601047e0 2024-09-12T02:37:09.432 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:37:09.431+0000 7f565f200640 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7f5660114190 con 0x7f5660108f60 2024-09-12T02:37:09.432 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:37:09.431+0000 7f5655400640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f56601047e0 0x7f566019a9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:37:09.432 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:37:09.431+0000 7f5655400640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f56601047e0 0x7f566019a9d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.39:56184/0 (socket says 172.21.15.39:56184) 2024-09-12T02:37:09.433 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:37:09.431+0000 7f5655400640 1 -- 172.21.15.39:0/2444313793 learned_addr learned my addr 172.21.15.39:0/2444313793 (peer_addr_for_me v2:172.21.15.39:0/0) 2024-09-12T02:37:09.433 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:37:09.431+0000 7f565e800640 1 --2- 172.21.15.39:0/2444313793 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f5660108f60 0x7f566019ed60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:37:09.433 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:37:09.431+0000 7f565de00640 1 --2- 172.21.15.39:0/2444313793 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f5660103e30 0x7f566019a490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:37:09.433 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:37:09.432+0000 7f5655400640 1 -- 172.21.15.39:0/2444313793 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f5660108f60 msgr2=0x7f566019ed60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:37:09.434 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:37:09.432+0000 7f5655400640 1 --2- 172.21.15.39:0/2444313793 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f5660108f60 0x7f566019ed60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:37:09.434 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:37:09.432+0000 7f5655400640 1 -- 172.21.15.39:0/2444313793 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f5660103e30 msgr2=0x7f566019a490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:37:09.434 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:37:09.432+0000 7f5655400640 1 --2- 172.21.15.39:0/2444313793 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f5660103e30 0x7f566019a490 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:37:09.434 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:37:09.432+0000 7f5655400640 1 -- 172.21.15.39:0/2444313793 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f566019f440 con 0x7f56601047e0 2024-09-12T02:37:09.434 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:37:09.432+0000 7f565e800640 1 --2- 172.21.15.39:0/2444313793 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f5660108f60 0x7f566019ed60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-12T02:37:09.434 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:37:09.432+0000 7f5655400640 1 --2- 172.21.15.39:0/2444313793 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f56601047e0 0x7f566019a9d0 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0x7f5648004770 tx=0x7f5648003c10 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:37:09.434 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:37:09.432+0000 7f5657400640 1 -- 172.21.15.39:0/2444313793 <== mon.2 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f564803f070 con 0x7f56601047e0 2024-09-12T02:37:09.434 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:37:09.433+0000 7f565f200640 1 -- 172.21.15.39:0/2444313793 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f566019f6d0 con 0x7f56601047e0 2024-09-12T02:37:09.434 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:37:09.433+0000 7f5657400640 1 -- 172.21.15.39:0/2444313793 <== mon.2 v2:172.21.15.44:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f5648031ca0 con 0x7f56601047e0 2024-09-12T02:37:09.434 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:37:09.433+0000 7f5657400640 1 -- 172.21.15.39:0/2444313793 <== mon.2 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5648035030 con 0x7f56601047e0 2024-09-12T02:37:09.434 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:37:09.433+0000 7f565f200640 1 -- 172.21.15.39:0/2444313793 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f56601a7010 con 0x7f56601047e0 2024-09-12T02:37:09.436 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:37:09.436+0000 7f5667a58740 1 Processor -- start 2024-09-12T02:37:09.436 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:37:09.436+0000 7f5667a58740 1 -- start start 2024-09-12T02:37:09.437 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:37:09.436+0000 7f5657400640 1 -- 172.21.15.39:0/2444313793 <== mon.2 v2:172.21.15.44:3300/0 4 ==== mgrmap(e 17) ==== 137884+0+0 (secure 0 0 0) 0x7f5648042070 con 0x7f56601047e0 2024-09-12T02:37:09.437 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:37:09.436+0000 7f5667a58740 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x555a98e454e0 0x555a98e458c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:37:09.437 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:37:09.436+0000 7f5667a58740 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x555a98e45e00 0x555a98e50180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:37:09.437 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:37:09.436+0000 7f5667a58740 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x555a98e506c0 0x555a98e52ab0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:37:09.437 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:37:09.436+0000 7f5667a58740 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 -- 0x555a98dab0b0 con 0x555a98e506c0 2024-09-12T02:37:09.438 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:37:09.436+0000 7f5667a58740 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x555a98d52ab0 con 0x555a98e45e00 2024-09-12T02:37:09.438 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:37:09.436+0000 7f5667a58740 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x555a98da7070 con 0x555a98e454e0 2024-09-12T02:37:09.438 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:37:09.436+0000 7f565de00640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x555a98e45e00 0x555a98e50180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:37:09.438 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:37:09.437+0000 7f5655400640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x555a98e506c0 0x555a98e52ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:37:09.438 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:37:09.437+0000 7f565de00640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x555a98e45e00 0x555a98e50180 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.39:56186/0 (socket says 172.21.15.39:56186) 2024-09-12T02:37:09.438 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:37:09.437+0000 7f565e800640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x555a98e454e0 0x555a98e458c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:37:09.438 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:37:09.437+0000 7f565de00640 1 -- 172.21.15.39:0/632959297 learned_addr learned my addr 172.21.15.39:0/632959297 (peer_addr_for_me v2:172.21.15.39:0/0) 2024-09-12T02:37:09.439 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:37:09.437+0000 7f565de00640 1 -- 172.21.15.39:0/632959297 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x555a98e454e0 msgr2=0x555a98e458c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:37:09.439 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:37:09.437+0000 7f565de00640 1 --2- 172.21.15.39:0/632959297 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x555a98e454e0 0x555a98e458c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:37:09.439 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:37:09.437+0000 7f565de00640 1 -- 172.21.15.39:0/632959297 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x555a98e506c0 msgr2=0x555a98e52ab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:37:09.439 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:37:09.437+0000 7f565de00640 1 --2- 172.21.15.39:0/632959297 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x555a98e506c0 0x555a98e52ab0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:37:09.439 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:37:09.437+0000 7f565de00640 1 -- 172.21.15.39:0/632959297 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x555a98d5f4a0 con 0x555a98e45e00 2024-09-12T02:37:09.439 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:37:09.437+0000 7f565de00640 1 --2- 172.21.15.39:0/632959297 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x555a98e45e00 0x555a98e50180 secure :-1 s=READY pgs=102 cs=0 l=1 rev1=1 crypto rx=0x7f56500039f0 tx=0x7f5650003eb0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=a8df9d5f3e2dd4df server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:37:09.439 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:37:09.438+0000 7f5657400640 1 --2- 172.21.15.39:0/2444313793 >> [v2:172.21.15.39:6800/1725006999,v1:172.21.15.39:6801/1725006999] conn(0x7f56440a2c90 0x7f56440a5150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:37:09.439 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:37:09.438+0000 7f5657400640 1 -- 172.21.15.39:0/2444313793 <== mon.2 v2:172.21.15.44:3300/0 5 ==== osd_map(95..95 src has 1..95) ==== 9129+0+0 (secure 0 0 0) 0x7f56480efb90 con 0x7f56601047e0 2024-09-12T02:37:09.439 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:37:09.438+0000 7f565e800640 1 --2- 172.21.15.39:0/2444313793 >> [v2:172.21.15.39:6800/1725006999,v1:172.21.15.39:6801/1725006999] conn(0x7f56440a2c90 0x7f56440a5150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:37:09.440 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:37:09.439+0000 7f565e800640 1 --2- 172.21.15.39:0/2444313793 >> [v2:172.21.15.39:6800/1725006999,v1:172.21.15.39:6801/1725006999] conn(0x7f56440a2c90 0x7f56440a5150 secure :-1 s=READY pgs=210 cs=0 l=1 rev1=1 crypto rx=0x7f5658012560 tx=0x7f5658005f90 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:37:09.441 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:37:09.441+0000 7f564f400640 1 -- 172.21.15.39:0/632959297 <== mon.2 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5650004b20 con 0x555a98e45e00 2024-09-12T02:37:09.442 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:37:09.441+0000 7f564f400640 1 -- 172.21.15.39:0/632959297 <== mon.2 v2:172.21.15.44:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f5650004cc0 con 0x555a98e45e00 2024-09-12T02:37:09.442 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:37:09.441+0000 7f564f400640 1 -- 172.21.15.39:0/632959297 <== mon.2 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5650012780 con 0x555a98e45e00 2024-09-12T02:37:09.442 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:37:09.442+0000 7f5667a58740 1 -- 172.21.15.39:0/632959297 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x555a98e45e00 msgr2=0x555a98e50180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:37:09.443 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:37:09.442+0000 7f5667a58740 1 --2- 172.21.15.39:0/632959297 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x555a98e45e00 0x555a98e50180 secure :-1 s=READY pgs=102 cs=0 l=1 rev1=1 crypto rx=0x7f56500039f0 tx=0x7f5650003eb0 comp rx=0 tx=0).stop 2024-09-12T02:37:09.443 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:37:09.442+0000 7f5667a58740 1 -- 172.21.15.39:0/632959297 shutdown_connections 2024-09-12T02:37:09.443 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:37:09.442+0000 7f5667a58740 1 --2- 172.21.15.39:0/632959297 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x555a98e506c0 0x555a98e52ab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:37:09.443 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:37:09.442+0000 7f5667a58740 1 --2- 172.21.15.39:0/632959297 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x555a98e45e00 0x555a98e50180 unknown :-1 s=CLOSED pgs=102 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:37:09.443 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:37:09.442+0000 7f5667a58740 1 --2- 172.21.15.39:0/632959297 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x555a98e454e0 0x555a98e458c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:37:09.443 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:37:09.442+0000 7f5667a58740 1 -- 172.21.15.39:0/632959297 >> 172.21.15.39:0/632959297 conn(0x555a98e41a70 msgr2=0x555a98e41e50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:37:09.443 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:37:09.442+0000 7f5667a58740 1 -- 172.21.15.39:0/632959297 shutdown_connections 2024-09-12T02:37:09.443 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:37:09.442+0000 7f5667a58740 1 -- 172.21.15.39:0/632959297 wait complete. 2024-09-12T02:37:09.444 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:37:09.442+0000 7f5667a58740 1 -- start start 2024-09-12T02:37:09.444 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:37:09.443+0000 7f5667a58740 1 Processor -- start 2024-09-12T02:37:09.444 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:37:09.443+0000 7f5667a58740 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x555a98e454e0 0x555a98e4d540 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:37:09.444 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:37:09.443+0000 7f5667a58740 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x555a98e45e00 0x555a98e4da80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:37:09.444 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:37:09.443+0000 7f5667a58740 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x555a98e506c0 0x555a98e4dfc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:37:09.444 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:37:09.443+0000 7f5667a58740 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 -- 0x555a98e53330 con 0x555a98e506c0 2024-09-12T02:37:09.444 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:37:09.443+0000 7f5667a58740 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x555a98d33920 con 0x555a98e454e0 2024-09-12T02:37:09.444 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:37:09.443+0000 7f5667a58740 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x555a98e534b0 con 0x555a98e45e00 2024-09-12T02:37:09.445 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:37:09.443+0000 7f5667a58740 10 client.0 _ll_register_callbacks cb 0x555a98d578a0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-12T02:37:09.445 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:37:09.443+0000 7f5655400640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x555a98e45e00 0x555a98e4da80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:37:09.446 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:37:09.443+0000 7f5655400640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x555a98e45e00 0x555a98e4da80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.172:3300/0 says I am v2:172.21.15.39:39238/0 (socket says 172.21.15.39:39238) 2024-09-12T02:37:09.446 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:37:09.443+0000 7f5655400640 1 -- 172.21.15.39:0/1601118353 learned_addr learned my addr 172.21.15.39:0/1601118353 (peer_addr_for_me v2:172.21.15.39:0/0) 2024-09-12T02:37:09.446 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:37:09.444+0000 7f565de00640 1 --2- 172.21.15.39:0/1601118353 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x555a98e454e0 0x555a98e4d540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:37:09.446 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:37:09.443+0000 7f565e800640 1 --2- 172.21.15.39:0/1601118353 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x555a98e506c0 0x555a98e4dfc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:37:09.446 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:37:09.444+0000 7f5655400640 1 -- 172.21.15.39:0/1601118353 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x555a98e454e0 msgr2=0x555a98e4d540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:37:09.446 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:37:09.444+0000 7f5655400640 1 --2- 172.21.15.39:0/1601118353 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x555a98e454e0 0x555a98e4d540 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:37:09.446 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:37:09.444+0000 7f5655400640 1 -- 172.21.15.39:0/1601118353 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x555a98e506c0 msgr2=0x555a98e4dfc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:37:09.446 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:37:09.444+0000 7f5655400640 1 --2- 172.21.15.39:0/1601118353 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x555a98e506c0 0x555a98e4dfc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:37:09.446 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:37:09.444+0000 7f5655400640 1 -- 172.21.15.39:0/1601118353 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({osdmap=0}) -- 0x555a98b1c2b0 con 0x555a98e45e00 2024-09-12T02:37:09.446 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:37:09.444+0000 7f565de00640 1 --2- 172.21.15.39:0/1601118353 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x555a98e454e0 0x555a98e4d540 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-12T02:37:09.446 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:37:09.444+0000 7f5655400640 1 --2- 172.21.15.39:0/1601118353 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x555a98e45e00 0x555a98e4da80 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0x7f56480c45f0 tx=0x7f56480b82c0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=2185d5f7ad2e25ba server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:37:09.446 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:37:09.444+0000 7f5643e00640 10 client.0 ms_handle_connect on v2:172.21.15.172:3300/0 2024-09-12T02:37:09.447 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:37:09.445+0000 7f5643e00640 1 -- 172.21.15.39:0/1601118353 <== mon.1 v2:172.21.15.172:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5648049070 con 0x555a98e45e00 2024-09-12T02:37:09.447 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:37:09.445+0000 7f5667a58740 1 -- 172.21.15.39:0/1601118353 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f5650004cc0 con 0x555a98e45e00 2024-09-12T02:37:09.447 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:37:09.445+0000 7f5643e00640 1 -- 172.21.15.39:0/1601118353 <== mon.1 v2:172.21.15.172:3300/0 2 ==== osd_map(95..95 src has 1..95) ==== 9129+0+0 (secure 0 0 0) 0x7f56480ed3b0 con 0x555a98e45e00 2024-09-12T02:37:09.447 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:37:09.446+0000 7f5643e00640 1 -- 172.21.15.39:0/1601118353 <== mon.1 v2:172.21.15.172:3300/0 3 ==== mon_get_version_reply(handle=1 version=28) ==== 24+0+0 (secure 0 0 0) 0x7f56480f4040 con 0x555a98e45e00 2024-09-12T02:37:09.447 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:37:09.446+0000 7f5667a58740 10 client.24964 fetch_fsmap learned FSMap version 28 2024-09-12T02:37:09.448 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:37:09.446+0000 7f5667a58740 1 -- 172.21.15.39:0/1601118353 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({config=0+,fsmap=28,monmap=4+}) -- 0x555a98e533e0 con 0x555a98e45e00 2024-09-12T02:37:09.448 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:37:09.447+0000 7f5643e00640 1 -- 172.21.15.39:0/1601118353 <== mon.1 v2:172.21.15.172:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f5650004cc0 con 0x555a98e45e00 2024-09-12T02:37:09.448 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:37:09.447+0000 7f5643e00640 1 -- 172.21.15.39:0/1601118353 <== mon.1 v2:172.21.15.172:3300/0 5 ==== fsmap(e 28) ==== 8370+0+0 (secure 0 0 0) 0x7f564803b4f0 con 0x555a98e45e00 2024-09-12T02:37:09.448 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:37:09.447+0000 7f5667a58740 10 client.24964 fetch_fsmap finished waiting for FSMap version 28 2024-09-12T02:37:09.448 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:37:09.447+0000 7f5667a58740 10 client.24964 resolve_mds: resolved name 'f' to daemon mds.f 2024-09-12T02:37:09.449 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:37:09.447+0000 7f5667a58740 20 client.24964 populate_metadata read hostname 'smithi039' 2024-09-12T02:37:09.449 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:37:09.447+0000 7f5667a58740 1 --2- 172.21.15.39:0/1601118353 >> [v2:172.21.15.172:6834/3274676014,v1:172.21.15.172:6835/3274676014] conn(0x555a98e61630 0x555a98e62aa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:37:09.449 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:37:09.447+0000 7f5667a58740 4 client.24964 mds_command: new command op to 24472 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-12T02:37:09.449 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:37:09.447+0000 7f5667a58740 1 -- 172.21.15.39:0/1601118353 --> [v2:172.21.15.172:6834/3274676014,v1:172.21.15.172:6835/3274676014] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x555a98db8620 con 0x555a98e61630 2024-09-12T02:37:09.449 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:37:09.447+0000 7f565de00640 1 --2- 172.21.15.39:0/1601118353 >> [v2:172.21.15.172:6834/3274676014,v1:172.21.15.172:6835/3274676014] conn(0x555a98e61630 0x555a98e62aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:37:09.449 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:37:09.448+0000 7f565de00640 1 --2- 172.21.15.39:0/1601118353 >> [v2:172.21.15.172:6834/3274676014,v1:172.21.15.172:6835/3274676014] conn(0x555a98e61630 0x555a98e62aa0 crc :-1 s=READY pgs=17 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.4 client_cookie=e89a0e3091ceac3f server_cookie=439911ffde763e4a in_seq=0 out_seq=0 2024-09-12T02:37:09.450 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:37:09.448+0000 7f5643e00640 10 client.24964 ms_handle_connect on v2:172.21.15.172:6834/3274676014 2024-09-12T02:37:09.450 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:37:09.449+0000 7f5643e00640 1 -- 172.21.15.39:0/1601118353 <== mds.4 v2:172.21.15.172:6834/3274676014 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x555a98db8620 con 0x555a98e61630 2024-09-12T02:37:09.450 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:37:09.449+0000 7f5643e00640 10 client.24964 handle_command_reply: tid=0 2024-09-12T02:37:09.450 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:37:09.449+0000 7f5667a58740 1 client.24964 shutdown 2024-09-12T02:37:09.451 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:37:09.449+0000 7f5667a58740 1 -- 172.21.15.39:0/1601118353 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x555a98e45e00 msgr2=0x555a98e4da80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:37:09.451 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:37:09.449+0000 7f5667a58740 1 --2- 172.21.15.39:0/1601118353 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x555a98e45e00 0x555a98e4da80 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0x7f56480c45f0 tx=0x7f56480b82c0 comp rx=0 tx=0).stop 2024-09-12T02:37:09.451 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:37:09.449+0000 7f5667a58740 1 -- 172.21.15.39:0/1601118353 shutdown_connections 2024-09-12T02:37:09.451 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:37:09.449+0000 7f5667a58740 1 --2- 172.21.15.39:0/1601118353 >> [v2:172.21.15.172:6834/3274676014,v1:172.21.15.172:6835/3274676014] conn(0x555a98e61630 0x555a98e62aa0 crc :-1 s=READY pgs=17 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:37:09.451 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:37:09.449+0000 7f5667a58740 1 --2- 172.21.15.39:0/1601118353 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x555a98e506c0 0x555a98e4dfc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:37:09.451 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:37:09.449+0000 7f5667a58740 1 --2- 172.21.15.39:0/1601118353 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x555a98e45e00 0x555a98e4da80 unknown :-1 s=CLOSED pgs=101 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:37:09.451 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:37:09.449+0000 7f5667a58740 1 --2- 172.21.15.39:0/1601118353 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x555a98e454e0 0x555a98e4d540 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:37:09.451 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:37:09.449+0000 7f5667a58740 1 -- 172.21.15.39:0/1601118353 >> 172.21.15.39:0/1601118353 conn(0x555a98e41a70 msgr2=0x555a98e47750 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:37:09.451 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:37:09.449+0000 7f5643e00640 0 client.24964 ms_handle_reset on v2:172.21.15.172:6834/3274676014 2024-09-12T02:37:09.451 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:37:09.450+0000 7f5667a58740 1 -- 172.21.15.39:0/1601118353 shutdown_connections 2024-09-12T02:37:09.451 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:37:09.450+0000 7f5667a58740 1 -- 172.21.15.39:0/1601118353 wait complete. 2024-09-12T02:37:09.451 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:37:09.450+0000 7f5667a58740 20 client.24964 trim_cache size 0 max 16384 2024-09-12T02:37:09.469 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:37:09.469+0000 7f5667a58740 1 Processor -- start 2024-09-12T02:37:09.469 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:37:09.469+0000 7f5667a58740 1 -- start start 2024-09-12T02:37:09.470 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:37:09.469+0000 7f5667a58740 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x555a98e454e0 0x555a98e623d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:37:09.471 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:37:09.469+0000 7f5667a58740 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x555a98e45e00 0x555a98e4be10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:37:09.471 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:37:09.469+0000 7f5667a58740 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x555a98e506c0 0x555a98e4c350 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:37:09.471 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:37:09.469+0000 7f5667a58740 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 -- 0x555a98e60de0 con 0x555a98e454e0 2024-09-12T02:37:09.471 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:37:09.469+0000 7f5667a58740 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x555a98e614b0 con 0x555a98e506c0 2024-09-12T02:37:09.471 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:37:09.469+0000 7f5667a58740 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x555a98e61b80 con 0x555a98e45e00 2024-09-12T02:37:09.471 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:37:09.469+0000 7f565de00640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x555a98e454e0 0x555a98e623d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:37:09.471 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:37:09.469+0000 7f565de00640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x555a98e454e0 0x555a98e623d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.39:3300/0 says I am v2:172.21.15.39:48726/0 (socket says 172.21.15.39:48726) 2024-09-12T02:37:09.471 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:37:09.469+0000 7f565de00640 1 -- 172.21.15.39:0/1458758593 learned_addr learned my addr 172.21.15.39:0/1458758593 (peer_addr_for_me v2:172.21.15.39:0/0) 2024-09-12T02:37:09.471 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:37:09.469+0000 7f565e800640 1 --2- 172.21.15.39:0/1458758593 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x555a98e506c0 0x555a98e4c350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:37:09.471 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:37:09.470+0000 7f5655400640 1 --2- 172.21.15.39:0/1458758593 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x555a98e45e00 0x555a98e4be10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:37:09.471 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:37:09.470+0000 7f565de00640 1 -- 172.21.15.39:0/1458758593 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x555a98e45e00 msgr2=0x555a98e4be10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:37:09.472 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:37:09.470+0000 7f565de00640 1 --2- 172.21.15.39:0/1458758593 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x555a98e45e00 0x555a98e4be10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:37:09.472 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:37:09.470+0000 7f565de00640 1 -- 172.21.15.39:0/1458758593 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x555a98e506c0 msgr2=0x555a98e4c350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:37:09.472 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:37:09.470+0000 7f565de00640 1 --2- 172.21.15.39:0/1458758593 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x555a98e506c0 0x555a98e4c350 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:37:09.472 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:37:09.470+0000 7f565de00640 1 -- 172.21.15.39:0/1458758593 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x555a98e4feb0 con 0x555a98e454e0 2024-09-12T02:37:09.472 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:37:09.470+0000 7f565de00640 1 --2- 172.21.15.39:0/1458758593 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x555a98e454e0 0x555a98e623d0 secure :-1 s=READY pgs=232 cs=0 l=1 rev1=1 crypto rx=0x7f56500039f0 tx=0x7f5650005fd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2b8fb6e622234077 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:37:09.474 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:37:09.470+0000 7f564ea00640 1 -- 172.21.15.39:0/1458758593 <== mon.0 v2:172.21.15.39:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5650009ca0 con 0x555a98e454e0 2024-09-12T02:37:09.474 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:37:09.470+0000 7f564ea00640 1 -- 172.21.15.39:0/1458758593 <== mon.0 v2:172.21.15.39:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f5650004840 con 0x555a98e454e0 2024-09-12T02:37:09.474 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:37:09.471+0000 7f564ea00640 1 -- 172.21.15.39:0/1458758593 <== mon.0 v2:172.21.15.39:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f56500284e0 con 0x555a98e454e0 2024-09-12T02:37:09.474 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:37:09.471+0000 7f5667a58740 1 -- 172.21.15.39:0/1458758593 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x555a98e454e0 msgr2=0x555a98e623d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:37:09.474 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:37:09.471+0000 7f5667a58740 1 --2- 172.21.15.39:0/1458758593 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x555a98e454e0 0x555a98e623d0 secure :-1 s=READY pgs=232 cs=0 l=1 rev1=1 crypto rx=0x7f56500039f0 tx=0x7f5650005fd0 comp rx=0 tx=0).stop 2024-09-12T02:37:09.474 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:37:09.471+0000 7f5667a58740 1 -- 172.21.15.39:0/1458758593 shutdown_connections 2024-09-12T02:37:09.474 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:37:09.471+0000 7f5667a58740 1 --2- 172.21.15.39:0/1458758593 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x555a98e506c0 0x555a98e4c350 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:37:09.474 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:37:09.471+0000 7f5667a58740 1 --2- 172.21.15.39:0/1458758593 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x555a98e45e00 0x555a98e4be10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:37:09.474 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:37:09.471+0000 7f5667a58740 1 --2- 172.21.15.39:0/1458758593 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x555a98e454e0 0x555a98e623d0 unknown :-1 s=CLOSED pgs=232 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:37:09.474 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:37:09.471+0000 7f5667a58740 1 -- 172.21.15.39:0/1458758593 >> 172.21.15.39:0/1458758593 conn(0x555a98e41a70 msgr2=0x555a98e3c7a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:37:09.474 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:37:09.471+0000 7f5667a58740 1 -- 172.21.15.39:0/1458758593 shutdown_connections 2024-09-12T02:37:09.474 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:37:09.471+0000 7f5667a58740 1 -- 172.21.15.39:0/1458758593 wait complete. 2024-09-12T02:37:09.475 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:37:09.472+0000 7f5667a58740 1 -- start start 2024-09-12T02:37:09.475 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:37:09.472+0000 7f5667a58740 1 Processor -- start 2024-09-12T02:37:09.475 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:37:09.472+0000 7f5667a58740 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x555a98e454e0 0x555a98e6b340 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:37:09.475 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:37:09.472+0000 7f5667a58740 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x555a98e45e00 0x555a98e680f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:37:09.475 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:37:09.472+0000 7f5667a58740 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x555a98e506c0 0x555a98e68630 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:37:09.475 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:37:09.472+0000 7f5667a58740 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 -- 0x555a98e62920 con 0x555a98e45e00 2024-09-12T02:37:09.475 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:37:09.472+0000 7f5667a58740 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x555a98e62250 con 0x555a98e454e0 2024-09-12T02:37:09.475 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:37:09.472+0000 7f5667a58740 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x555a98e62ff0 con 0x555a98e506c0 2024-09-12T02:37:09.475 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:37:09.472+0000 7f5667a58740 10 client.0 _ll_register_callbacks cb 0x7f5648031e50 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-12T02:37:09.475 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:37:09.473+0000 7f5655400640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x555a98e45e00 0x555a98e680f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:37:09.475 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:37:09.473+0000 7f565de00640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x555a98e454e0 0x555a98e6b340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:37:09.475 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:37:09.473+0000 7f565de00640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x555a98e454e0 0x555a98e6b340 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.39:56222/0 (socket says 172.21.15.39:56222) 2024-09-12T02:37:09.475 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:37:09.473+0000 7f565de00640 1 -- 172.21.15.39:0/3925506595 learned_addr learned my addr 172.21.15.39:0/3925506595 (peer_addr_for_me v2:172.21.15.39:0/0) 2024-09-12T02:37:09.476 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:37:09.473+0000 7f565e800640 1 --2- 172.21.15.39:0/3925506595 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x555a98e506c0 0x555a98e68630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:37:09.476 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:37:09.473+0000 7f565de00640 1 -- 172.21.15.39:0/3925506595 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x555a98e506c0 msgr2=0x555a98e68630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:37:09.476 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:37:09.473+0000 7f565de00640 1 --2- 172.21.15.39:0/3925506595 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x555a98e506c0 0x555a98e68630 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:37:09.476 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:37:09.473+0000 7f565de00640 1 -- 172.21.15.39:0/3925506595 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x555a98e45e00 msgr2=0x555a98e680f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:37:09.476 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:37:09.473+0000 7f565de00640 1 --2- 172.21.15.39:0/3925506595 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x555a98e45e00 0x555a98e680f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:37:09.476 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:37:09.473+0000 7f565de00640 1 -- 172.21.15.39:0/3925506595 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({osdmap=0}) -- 0x555a98e68c20 con 0x555a98e454e0 2024-09-12T02:37:09.478 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:37:09.474+0000 7f565de00640 1 --2- 172.21.15.39:0/3925506595 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x555a98e454e0 0x555a98e6b340 secure :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0x7f5650004550 tx=0x7f5650013f60 comp rx=0 tx=0).ready entity=mon.2 client_cookie=40fb5fa9ea9eacbf server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:37:09.478 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:37:09.474+0000 7f5643e00640 10 client.0 ms_handle_connect on v2:172.21.15.44:3300/0 2024-09-12T02:37:09.478 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:37:09.474+0000 7f5643e00640 1 -- 172.21.15.39:0/3925506595 <== mon.2 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5650012650 con 0x555a98e454e0 2024-09-12T02:37:09.478 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:37:09.474+0000 7f5667a58740 1 -- 172.21.15.39:0/3925506595 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f5650004840 con 0x555a98e454e0 2024-09-12T02:37:09.478 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:37:09.474+0000 7f5643e00640 1 -- 172.21.15.39:0/3925506595 <== mon.2 v2:172.21.15.44:3300/0 2 ==== osd_map(95..95 src has 1..95) ==== 9129+0+0 (secure 0 0 0) 0x7f56500127f0 con 0x555a98e454e0 2024-09-12T02:37:09.479 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:37:09.474+0000 7f5643e00640 1 -- 172.21.15.39:0/3925506595 <== mon.2 v2:172.21.15.44:3300/0 3 ==== mon_get_version_reply(handle=1 version=28) ==== 24+0+0 (secure 0 0 0) 0x7f56500129f0 con 0x555a98e454e0 2024-09-12T02:37:09.479 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:37:09.474+0000 7f5667a58740 10 client.24959 fetch_fsmap learned FSMap version 28 2024-09-12T02:37:09.479 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:37:09.474+0000 7f5667a58740 1 -- 172.21.15.39:0/3925506595 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,fsmap=28,monmap=4+}) -- 0x555a98ecbd40 con 0x555a98e454e0 2024-09-12T02:37:09.479 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:37:09.475+0000 7f5643e00640 1 -- 172.21.15.39:0/3925506595 <== mon.2 v2:172.21.15.44:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f5650004840 con 0x555a98e454e0 2024-09-12T02:37:09.479 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:37:09.475+0000 7f5643e00640 1 -- 172.21.15.39:0/3925506595 <== mon.2 v2:172.21.15.44:3300/0 5 ==== fsmap(e 28) ==== 8370+0+0 (secure 0 0 0) 0x7f565000f040 con 0x555a98e454e0 2024-09-12T02:37:09.479 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:37:09.475+0000 7f5667a58740 10 client.24959 fetch_fsmap finished waiting for FSMap version 28 2024-09-12T02:37:09.479 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:37:09.475+0000 7f5667a58740 10 client.24959 resolve_mds: resolved name 'f' to daemon mds.f 2024-09-12T02:37:09.479 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:37:09.475+0000 7f5667a58740 20 client.24959 populate_metadata read hostname 'smithi039' 2024-09-12T02:37:09.479 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:37:09.475+0000 7f5667a58740 1 --2- 172.21.15.39:0/3925506595 >> [v2:172.21.15.172:6834/3274676014,v1:172.21.15.172:6835/3274676014] conn(0x555a98ed0010 0x555a98eced20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:37:09.479 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:37:09.475+0000 7f5667a58740 4 client.24959 mds_command: new command op to 24472 tid=0 multi_id=0 [{"prefix": "status"}] 2024-09-12T02:37:09.479 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:37:09.475+0000 7f5667a58740 1 -- 172.21.15.39:0/3925506595 --> [v2:172.21.15.172:6834/3274676014,v1:172.21.15.172:6835/3274676014] -- command(tid 0: {"prefix": "status"}) -- 0x555a98db2b30 con 0x555a98ed0010 2024-09-12T02:37:09.479 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:37:09.475+0000 7f5655400640 1 --2- 172.21.15.39:0/3925506595 >> [v2:172.21.15.172:6834/3274676014,v1:172.21.15.172:6835/3274676014] conn(0x555a98ed0010 0x555a98eced20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:37:09.479 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:37:09.476+0000 7f5655400640 1 --2- 172.21.15.39:0/3925506595 >> [v2:172.21.15.172:6834/3274676014,v1:172.21.15.172:6835/3274676014] conn(0x555a98ed0010 0x555a98eced20 crc :-1 s=READY pgs=18 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.4 client_cookie=9f38be678fd8b0ee server_cookie=5759a2841e13e65a in_seq=0 out_seq=0 2024-09-12T02:37:09.480 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:37:09.476+0000 7f5643e00640 10 client.24959 ms_handle_connect on v2:172.21.15.172:6834/3274676014 2024-09-12T02:37:09.480 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:37:09.476+0000 7f5643e00640 1 -- 172.21.15.39:0/3925506595 <== mds.4 v2:172.21.15.172:6834/3274676014 1 ==== command_reply(tid 0: 0 ) ==== 8+0+332 (crc 0 0 0) 0x555a98db2b30 con 0x555a98ed0010 2024-09-12T02:37:09.480 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:37:09.476+0000 7f5643e00640 10 client.24959 handle_command_reply: tid=0 2024-09-12T02:37:09.480 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:37:09.476+0000 7f5667a58740 1 client.24959 shutdown 2024-09-12T02:37:09.480 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:37:09.476+0000 7f5667a58740 1 -- 172.21.15.39:0/3925506595 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x555a98e454e0 msgr2=0x555a98e6b340 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:37:09.480 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:37:09.476+0000 7f5667a58740 1 --2- 172.21.15.39:0/3925506595 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x555a98e454e0 0x555a98e6b340 secure :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0x7f5650004550 tx=0x7f5650013f60 comp rx=0 tx=0).stop 2024-09-12T02:37:09.480 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:37:09.476+0000 7f5667a58740 1 -- 172.21.15.39:0/3925506595 shutdown_connections 2024-09-12T02:37:09.480 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:37:09.476+0000 7f5667a58740 1 --2- 172.21.15.39:0/3925506595 >> [v2:172.21.15.172:6834/3274676014,v1:172.21.15.172:6835/3274676014] conn(0x555a98ed0010 0x555a98eced20 crc :-1 s=READY pgs=18 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:37:09.480 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:37:09.476+0000 7f5667a58740 1 --2- 172.21.15.39:0/3925506595 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x555a98e506c0 0x555a98e68630 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:37:09.480 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:37:09.476+0000 7f5667a58740 1 --2- 172.21.15.39:0/3925506595 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x555a98e45e00 0x555a98e680f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:37:09.480 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:37:09.476+0000 7f5667a58740 1 --2- 172.21.15.39:0/3925506595 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x555a98e454e0 0x555a98e6b340 unknown :-1 s=CLOSED pgs=103 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:37:09.480 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:37:09.476+0000 7f5667a58740 1 -- 172.21.15.39:0/3925506595 >> 172.21.15.39:0/3925506595 conn(0x555a98e41a70 msgr2=0x555a98e5b730 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:37:09.481 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:37:09.476+0000 7f5643e00640 0 client.24959 ms_handle_reset on v2:172.21.15.172:6834/3274676014 2024-09-12T02:37:09.481 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:37:09.477+0000 7f5667a58740 1 -- 172.21.15.39:0/3925506595 shutdown_connections 2024-09-12T02:37:09.481 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:37:09.477+0000 7f5667a58740 1 -- 172.21.15.39:0/3925506595 wait complete. 2024-09-12T02:37:09.481 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:37:09.477+0000 7f5667a58740 20 client.24959 trim_cache size 0 max 16384 2024-09-12T02:37:09.481 INFO:teuthology.orchestra.run.smithi039.stdout:{ 2024-09-12T02:37:09.481 INFO:teuthology.orchestra.run.smithi039.stdout: "cluster_fsid": "4954ed46-70ae-11ef-bcea-c7b262605968", 2024-09-12T02:37:09.481 INFO:teuthology.orchestra.run.smithi039.stdout: "whoami": 4, 2024-09-12T02:37:09.481 INFO:teuthology.orchestra.run.smithi039.stdout: "id": 24472, 2024-09-12T02:37:09.481 INFO:teuthology.orchestra.run.smithi039.stdout: "want_state": "up:active", 2024-09-12T02:37:09.481 INFO:teuthology.orchestra.run.smithi039.stdout: "state": "up:active", 2024-09-12T02:37:09.482 INFO:teuthology.orchestra.run.smithi039.stdout: "fs_name": "cephfs", 2024-09-12T02:37:09.482 INFO:teuthology.orchestra.run.smithi039.stdout: "rank_uptime": 77.680810854000001, 2024-09-12T02:37:09.482 INFO:teuthology.orchestra.run.smithi039.stdout: "mdsmap_epoch": 28, 2024-09-12T02:37:09.482 INFO:teuthology.orchestra.run.smithi039.stdout: "osdmap_epoch": 95, 2024-09-12T02:37:09.482 INFO:teuthology.orchestra.run.smithi039.stdout: "osdmap_epoch_barrier": 93, 2024-09-12T02:37:09.482 INFO:teuthology.orchestra.run.smithi039.stdout: "uptime": 155.58393308300001 2024-09-12T02:37:09.482 INFO:teuthology.orchestra.run.smithi039.stdout:} 2024-09-12T02:37:09.483 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:37:09.477+0000 7f565f200640 1 -- 172.21.15.39:0/2444313793 >> [v2:172.21.15.39:6800/1725006999,v1:172.21.15.39:6801/1725006999] conn(0x7f56440a2c90 msgr2=0x7f56440a5150 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:37:09.483 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:37:09.477+0000 7f565f200640 1 --2- 172.21.15.39:0/2444313793 >> [v2:172.21.15.39:6800/1725006999,v1:172.21.15.39:6801/1725006999] conn(0x7f56440a2c90 0x7f56440a5150 secure :-1 s=READY pgs=210 cs=0 l=1 rev1=1 crypto rx=0x7f5658012560 tx=0x7f5658005f90 comp rx=0 tx=0).stop 2024-09-12T02:37:09.483 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:37:09.477+0000 7f565f200640 1 -- 172.21.15.39:0/2444313793 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f56601047e0 msgr2=0x7f566019a9d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:37:09.483 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:37:09.477+0000 7f565f200640 1 --2- 172.21.15.39:0/2444313793 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f56601047e0 0x7f566019a9d0 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0x7f5648004770 tx=0x7f5648003c10 comp rx=0 tx=0).stop 2024-09-12T02:37:09.483 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:37:09.478+0000 7f565f200640 1 -- 172.21.15.39:0/2444313793 shutdown_connections 2024-09-12T02:37:09.483 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:37:09.478+0000 7f565f200640 1 --2- 172.21.15.39:0/2444313793 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f5660108f60 0x7f566019ed60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:37:09.483 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:37:09.478+0000 7f565f200640 1 --2- 172.21.15.39:0/2444313793 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f56601047e0 0x7f566019a9d0 unknown :-1 s=CLOSED pgs=101 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:37:09.483 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:37:09.478+0000 7f565f200640 1 --2- 172.21.15.39:0/2444313793 >> [v2:172.21.15.39:6800/1725006999,v1:172.21.15.39:6801/1725006999] conn(0x7f56440a2c90 0x7f56440a5150 unknown :-1 s=CLOSED pgs=210 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:37:09.483 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:37:09.478+0000 7f565f200640 1 --2- 172.21.15.39:0/2444313793 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f5660103e30 0x7f566019a490 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:37:09.483 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:37:09.478+0000 7f565f200640 1 -- 172.21.15.39:0/2444313793 >> 172.21.15.39:0/2444313793 conn(0x7f56600ff8d0 msgr2=0x7f5660100bf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:37:09.483 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:37:09.478+0000 7f565f200640 1 -- 172.21.15.39:0/2444313793 shutdown_connections 2024-09-12T02:37:09.483 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:37:09.478+0000 7f565f200640 1 -- 172.21.15.39:0/2444313793 wait complete. 2024-09-12T02:37:09.599 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 02:37:09 smithi039 ceph-mon[30515]: from='mgr.14150 172.21.15.39:0/408627207' entity='mgr.x' 2024-09-12T02:37:09.600 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 02:37:09 smithi039 ceph-mon[30515]: from='mgr.14150 172.21.15.39:0/408627207' entity='mgr.x' 2024-09-12T02:37:09.600 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 02:37:09 smithi039 ceph-mon[30515]: from='mgr.14150 172.21.15.39:0/408627207' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-12T02:37:09.600 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 02:37:09 smithi039 ceph-mon[30515]: from='mgr.14150 172.21.15.39:0/408627207' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-12T02:37:09.600 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 02:37:09 smithi039 ceph-mon[30515]: from='mgr.14150 172.21.15.39:0/408627207' entity='mgr.x' 2024-09-12T02:37:09.698 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 12 02:37:09 smithi044 ceph-mon[35411]: from='mgr.14150 172.21.15.39:0/408627207' entity='mgr.x' 2024-09-12T02:37:09.699 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 12 02:37:09 smithi044 ceph-mon[35411]: from='mgr.14150 172.21.15.39:0/408627207' entity='mgr.x' 2024-09-12T02:37:09.699 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 12 02:37:09 smithi044 ceph-mon[35411]: from='mgr.14150 172.21.15.39:0/408627207' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-12T02:37:09.699 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 12 02:37:09 smithi044 ceph-mon[35411]: from='mgr.14150 172.21.15.39:0/408627207' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-12T02:37:09.699 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 12 02:37:09 smithi044 ceph-mon[35411]: from='mgr.14150 172.21.15.39:0/408627207' entity='mgr.x' 2024-09-12T02:37:09.763 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 12 02:37:09 smithi172 ceph-mon[35609]: from='mgr.14150 172.21.15.39:0/408627207' entity='mgr.x' 2024-09-12T02:37:09.763 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 12 02:37:09 smithi172 ceph-mon[35609]: from='mgr.14150 172.21.15.39:0/408627207' entity='mgr.x' 2024-09-12T02:37:09.763 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 12 02:37:09 smithi172 ceph-mon[35609]: from='mgr.14150 172.21.15.39:0/408627207' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-12T02:37:09.764 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 12 02:37:09 smithi172 ceph-mon[35609]: from='mgr.14150 172.21.15.39:0/408627207' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-12T02:37:09.764 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 12 02:37:09 smithi172 ceph-mon[35609]: from='mgr.14150 172.21.15.39:0/408627207' entity='mgr.x' 2024-09-12T02:37:10.326 DEBUG:teuthology.orchestra.run.smithi039:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc shell --fsid 4954ed46-70ae-11ef-bcea-c7b262605968 -- ceph tell mds.h status 2024-09-12T02:37:10.599 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 02:37:10 smithi039 ceph-mon[30515]: pgmap v367: 129 pgs: 129 active+clean; 645 KiB data, 348 MiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 11 op/s 2024-09-12T02:37:10.707 INFO:teuthology.orchestra.run.smithi039.stderr:Inferring config /var/lib/ceph/4954ed46-70ae-11ef-bcea-c7b262605968/mon.a/config 2024-09-12T02:37:10.763 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 12 02:37:10 smithi172 ceph-mon[35609]: pgmap v367: 129 pgs: 129 active+clean; 645 KiB data, 348 MiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 11 op/s 2024-09-12T02:37:10.948 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 12 02:37:10 smithi044 ceph-mon[35411]: pgmap v367: 129 pgs: 129 active+clean; 645 KiB data, 348 MiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 11 op/s 2024-09-12T02:37:11.398 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:37:11.397+0000 7f2288000640 1 -- 172.21.15.39:0/1357075946 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f22801049c0 msgr2=0x7f2280108a10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:37:11.399 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:37:11.397+0000 7f2288000640 1 --2- 172.21.15.39:0/1357075946 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f22801049c0 0x7f2280108a10 secure :-1 s=READY pgs=233 cs=0 l=1 rev1=1 crypto rx=0x7f226c009900 tx=0x7f226c02a410 comp rx=0 tx=0).stop 2024-09-12T02:37:11.399 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:37:11.397+0000 7f2288000640 1 -- 172.21.15.39:0/1357075946 shutdown_connections 2024-09-12T02:37:11.399 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:37:11.397+0000 7f2288000640 1 --2- 172.21.15.39:0/1357075946 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f2280109140 0x7f2280110cc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:37:11.399 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:37:11.397+0000 7f2288000640 1 --2- 172.21.15.39:0/1357075946 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f22801049c0 0x7f2280108a10 unknown :-1 s=CLOSED pgs=233 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:37:11.399 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:37:11.397+0000 7f2288000640 1 --2- 172.21.15.39:0/1357075946 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f2280104010 0x7f22801043f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:37:11.399 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:37:11.397+0000 7f2288000640 1 -- 172.21.15.39:0/1357075946 >> 172.21.15.39:0/1357075946 conn(0x7f22800ffa50 msgr2=0x7f2280101e70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:37:11.399 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:37:11.397+0000 7f2288000640 1 -- 172.21.15.39:0/1357075946 shutdown_connections 2024-09-12T02:37:11.399 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:37:11.397+0000 7f2288000640 1 -- 172.21.15.39:0/1357075946 wait complete. 2024-09-12T02:37:11.399 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:37:11.398+0000 7f2288000640 1 Processor -- start 2024-09-12T02:37:11.399 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:37:11.398+0000 7f2288000640 1 -- start start 2024-09-12T02:37:11.400 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:37:11.398+0000 7f2288000640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f2280104010 0x7f228019a640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:37:11.401 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:37:11.398+0000 7f2288000640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f22801049c0 0x7f228019ab80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:37:11.401 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:37:11.398+0000 7f2288000640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f2280109140 0x7f228019ef10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:37:11.401 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:37:11.398+0000 7f2288000640 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 -- 0x7f2280114140 con 0x7f2280109140 2024-09-12T02:37:11.401 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:37:11.398+0000 7f2288000640 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x7f2280113fc0 con 0x7f22801049c0 2024-09-12T02:37:11.401 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:37:11.398+0000 7f2288000640 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7f22801142c0 con 0x7f2280104010 2024-09-12T02:37:11.401 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:37:11.398+0000 7f2286000640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f2280109140 0x7f228019ef10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:37:11.401 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:37:11.399+0000 7f2286000640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f2280109140 0x7f228019ef10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.39:3300/0 says I am v2:172.21.15.39:48752/0 (socket says 172.21.15.39:48752) 2024-09-12T02:37:11.401 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:37:11.399+0000 7f2286000640 1 -- 172.21.15.39:0/1952597079 learned_addr learned my addr 172.21.15.39:0/1952597079 (peer_addr_for_me v2:172.21.15.39:0/0) 2024-09-12T02:37:11.401 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:37:11.399+0000 7f2285600640 1 --2- 172.21.15.39:0/1952597079 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f2280104010 0x7f228019a640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:37:11.401 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:37:11.399+0000 7f2284c00640 1 --2- 172.21.15.39:0/1952597079 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f22801049c0 0x7f228019ab80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:37:11.401 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:37:11.399+0000 7f2286000640 1 -- 172.21.15.39:0/1952597079 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f2280104010 msgr2=0x7f228019a640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:37:11.401 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:37:11.399+0000 7f2286000640 1 --2- 172.21.15.39:0/1952597079 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f2280104010 0x7f228019a640 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:37:11.402 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:37:11.399+0000 7f2286000640 1 -- 172.21.15.39:0/1952597079 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f22801049c0 msgr2=0x7f228019ab80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:37:11.402 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:37:11.399+0000 7f2286000640 1 --2- 172.21.15.39:0/1952597079 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f22801049c0 0x7f228019ab80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:37:11.402 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:37:11.399+0000 7f2286000640 1 -- 172.21.15.39:0/1952597079 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f228019f5f0 con 0x7f2280109140 2024-09-12T02:37:11.402 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:37:11.399+0000 7f2285600640 1 --2- 172.21.15.39:0/1952597079 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f2280104010 0x7f228019a640 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-12T02:37:11.402 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:37:11.399+0000 7f2286000640 1 --2- 172.21.15.39:0/1952597079 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f2280109140 0x7f228019ef10 secure :-1 s=READY pgs=234 cs=0 l=1 rev1=1 crypto rx=0x7f227800eb10 tx=0x7f227800c2d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:37:11.402 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:37:11.400+0000 7f227e000640 1 -- 172.21.15.39:0/1952597079 <== mon.0 v2:172.21.15.39:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2278004b20 con 0x7f2280109140 2024-09-12T02:37:11.402 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:37:11.400+0000 7f2288000640 1 -- 172.21.15.39:0/1952597079 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f228019f8e0 con 0x7f2280109140 2024-09-12T02:37:11.402 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:37:11.400+0000 7f227e000640 1 -- 172.21.15.39:0/1952597079 <== mon.0 v2:172.21.15.39:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f2278004cc0 con 0x7f2280109140 2024-09-12T02:37:11.402 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:37:11.400+0000 7f227e000640 1 -- 172.21.15.39:0/1952597079 <== mon.0 v2:172.21.15.39:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2278010760 con 0x7f2280109140 2024-09-12T02:37:11.402 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:37:11.400+0000 7f2288000640 1 -- 172.21.15.39:0/1952597079 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f22801a71c0 con 0x7f2280109140 2024-09-12T02:37:11.403 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:37:11.403+0000 7f228abba740 1 Processor -- start 2024-09-12T02:37:11.403 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:37:11.403+0000 7f227e000640 1 -- 172.21.15.39:0/1952597079 <== mon.0 v2:172.21.15.39:3300/0 4 ==== mgrmap(e 17) ==== 137884+0+0 (secure 0 0 0) 0x7f2278005020 con 0x7f2280109140 2024-09-12T02:37:11.404 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:37:11.403+0000 7f228abba740 1 -- start start 2024-09-12T02:37:11.404 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:37:11.403+0000 7f228abba740 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55bf1b328330 0x55bf1b328710 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:37:11.404 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:37:11.403+0000 7f228abba740 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55bf1b328c50 0x55bf1b332fd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:37:11.405 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:37:11.403+0000 7f228abba740 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55bf1b333510 0x55bf1b335900 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:37:11.405 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:37:11.403+0000 7f228abba740 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 -- 0x55bf1b28e0b0 con 0x55bf1b333510 2024-09-12T02:37:11.405 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:37:11.403+0000 7f228abba740 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x55bf1b235ab0 con 0x55bf1b328c50 2024-09-12T02:37:11.405 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:37:11.403+0000 7f228abba740 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x55bf1b28a070 con 0x55bf1b328330 2024-09-12T02:37:11.405 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:37:11.404+0000 7f2285600640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55bf1b328c50 0x55bf1b332fd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:37:11.405 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:37:11.404+0000 7f2284c00640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55bf1b328330 0x55bf1b328710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:37:11.405 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:37:11.404+0000 7f2284c00640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55bf1b333510 0x55bf1b335900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:37:11.405 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:37:11.404+0000 7f2285600640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55bf1b328c50 0x55bf1b332fd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.39:56254/0 (socket says 172.21.15.39:56254) 2024-09-12T02:37:11.405 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:37:11.404+0000 7f2285600640 1 -- 172.21.15.39:0/1969508949 learned_addr learned my addr 172.21.15.39:0/1969508949 (peer_addr_for_me v2:172.21.15.39:0/0) 2024-09-12T02:37:11.407 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:37:11.404+0000 7f2285600640 1 -- 172.21.15.39:0/1969508949 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55bf1b328330 msgr2=0x55bf1b328710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:37:11.407 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:37:11.404+0000 7f2285600640 1 --2- 172.21.15.39:0/1969508949 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55bf1b328330 0x55bf1b328710 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:37:11.407 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:37:11.404+0000 7f2285600640 1 -- 172.21.15.39:0/1969508949 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55bf1b333510 msgr2=0x55bf1b335900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:37:11.407 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:37:11.404+0000 7f2285600640 1 --2- 172.21.15.39:0/1969508949 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55bf1b333510 0x55bf1b335900 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:37:11.407 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:37:11.404+0000 7f2285600640 1 -- 172.21.15.39:0/1969508949 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55bf1b2424a0 con 0x55bf1b328c50 2024-09-12T02:37:11.407 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:37:11.405+0000 7f2285600640 1 --2- 172.21.15.39:0/1969508949 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55bf1b328c50 0x55bf1b332fd0 secure :-1 s=READY pgs=104 cs=0 l=1 rev1=1 crypto rx=0x7f22740115f0 tx=0x7f2274011ab0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=3f9bfa1db4146b38 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:37:11.407 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:37:11.405+0000 7f227e000640 1 --2- 172.21.15.39:0/1952597079 >> [v2:172.21.15.39:6800/1725006999,v1:172.21.15.39:6801/1725006999] conn(0x7f22680a2c10 0x7f22680a50d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:37:11.407 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:37:11.405+0000 7f2272600640 1 -- 172.21.15.39:0/1969508949 <== mon.2 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f227401e070 con 0x55bf1b328c50 2024-09-12T02:37:11.408 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:37:11.405+0000 7f2272600640 1 -- 172.21.15.39:0/1969508949 <== mon.2 v2:172.21.15.44:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f227400fac0 con 0x55bf1b328c50 2024-09-12T02:37:11.408 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:37:11.405+0000 7f2272600640 1 -- 172.21.15.39:0/1969508949 <== mon.2 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2274019b60 con 0x55bf1b328c50 2024-09-12T02:37:11.408 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:37:11.405+0000 7f227e000640 1 -- 172.21.15.39:0/1952597079 <== mon.0 v2:172.21.15.39:3300/0 5 ==== osd_map(95..95 src has 1..95) ==== 9129+0+0 (secure 0 0 0) 0x7f22780cfaa0 con 0x7f2280109140 2024-09-12T02:37:11.408 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:37:11.405+0000 7f2284c00640 1 --2- 172.21.15.39:0/1952597079 >> [v2:172.21.15.39:6800/1725006999,v1:172.21.15.39:6801/1725006999] conn(0x7f22680a2c10 0x7f22680a50d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:37:11.408 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:37:11.406+0000 7f228abba740 1 -- 172.21.15.39:0/1969508949 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55bf1b328c50 msgr2=0x55bf1b332fd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:37:11.408 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:37:11.406+0000 7f228abba740 1 --2- 172.21.15.39:0/1969508949 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55bf1b328c50 0x55bf1b332fd0 secure :-1 s=READY pgs=104 cs=0 l=1 rev1=1 crypto rx=0x7f22740115f0 tx=0x7f2274011ab0 comp rx=0 tx=0).stop 2024-09-12T02:37:11.408 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:37:11.406+0000 7f228abba740 1 -- 172.21.15.39:0/1969508949 shutdown_connections 2024-09-12T02:37:11.408 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:37:11.406+0000 7f228abba740 1 --2- 172.21.15.39:0/1969508949 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55bf1b333510 0x55bf1b335900 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:37:11.408 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:37:11.406+0000 7f228abba740 1 --2- 172.21.15.39:0/1969508949 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55bf1b328c50 0x55bf1b332fd0 unknown :-1 s=CLOSED pgs=104 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:37:11.408 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:37:11.406+0000 7f228abba740 1 --2- 172.21.15.39:0/1969508949 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55bf1b328330 0x55bf1b328710 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:37:11.408 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:37:11.406+0000 7f228abba740 1 -- 172.21.15.39:0/1969508949 >> 172.21.15.39:0/1969508949 conn(0x55bf1b3248c0 msgr2=0x55bf1b324ca0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:37:11.409 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:37:11.406+0000 7f228abba740 1 -- 172.21.15.39:0/1969508949 shutdown_connections 2024-09-12T02:37:11.409 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:37:11.406+0000 7f2284c00640 1 --2- 172.21.15.39:0/1952597079 >> [v2:172.21.15.39:6800/1725006999,v1:172.21.15.39:6801/1725006999] conn(0x7f22680a2c10 0x7f22680a50d0 secure :-1 s=READY pgs=211 cs=0 l=1 rev1=1 crypto rx=0x7f226c009230 tx=0x7f226c041040 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:37:11.409 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:37:11.406+0000 7f228abba740 1 -- 172.21.15.39:0/1969508949 wait complete. 2024-09-12T02:37:11.411 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:37:11.406+0000 7f228abba740 1 -- start start 2024-09-12T02:37:11.411 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:37:11.407+0000 7f228abba740 1 Processor -- start 2024-09-12T02:37:11.411 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:37:11.407+0000 7f228abba740 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55bf1b328330 0x55bf1b3304f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:37:11.411 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:37:11.407+0000 7f228abba740 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55bf1b328c50 0x55bf1b330a30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:37:11.411 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:37:11.407+0000 7f228abba740 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55bf1b333510 0x55bf1b330f70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:37:11.411 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:37:11.407+0000 7f228abba740 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 -- 0x55bf1b336060 con 0x55bf1b333510 2024-09-12T02:37:11.411 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:37:11.407+0000 7f228abba740 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x55bf1b216920 con 0x55bf1b328c50 2024-09-12T02:37:11.412 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:37:11.407+0000 7f228abba740 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x55bf1b3361e0 con 0x55bf1b328330 2024-09-12T02:37:11.412 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:37:11.407+0000 7f228abba740 10 client.0 _ll_register_callbacks cb 0x55bf1b23a8a0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-12T02:37:11.412 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:37:11.407+0000 7f2286000640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55bf1b333510 0x55bf1b330f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:37:11.412 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:37:11.408+0000 7f2284c00640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55bf1b328c50 0x55bf1b330a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:37:11.412 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:37:11.408+0000 7f2286000640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55bf1b333510 0x55bf1b330f70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.39:3300/0 says I am v2:172.21.15.39:48780/0 (socket says 172.21.15.39:48780) 2024-09-12T02:37:11.412 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:37:11.408+0000 7f2286000640 1 -- 172.21.15.39:0/3047479109 learned_addr learned my addr 172.21.15.39:0/3047479109 (peer_addr_for_me v2:172.21.15.39:0/0) 2024-09-12T02:37:11.412 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:37:11.408+0000 7f2285600640 1 --2- 172.21.15.39:0/3047479109 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55bf1b328330 0x55bf1b3304f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:37:11.412 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:37:11.408+0000 7f2286000640 1 -- 172.21.15.39:0/3047479109 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55bf1b328330 msgr2=0x55bf1b3304f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:37:11.412 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:37:11.408+0000 7f2286000640 1 --2- 172.21.15.39:0/3047479109 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55bf1b328330 0x55bf1b3304f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:37:11.412 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:37:11.408+0000 7f2286000640 1 -- 172.21.15.39:0/3047479109 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55bf1b328c50 msgr2=0x55bf1b330a30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:37:11.412 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:37:11.408+0000 7f2286000640 1 --2- 172.21.15.39:0/3047479109 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55bf1b328c50 0x55bf1b330a30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:37:11.412 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:37:11.408+0000 7f2286000640 1 -- 172.21.15.39:0/3047479109 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55bf1afff2b0 con 0x55bf1b333510 2024-09-12T02:37:11.412 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:37:11.408+0000 7f2286000640 1 --2- 172.21.15.39:0/3047479109 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55bf1b333510 0x55bf1b330f70 secure :-1 s=READY pgs=235 cs=0 l=1 rev1=1 crypto rx=0x7f22780a4500 tx=0x7f227809b9c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4e9c861151db0ccb server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:37:11.413 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:37:11.408+0000 7f2266a00640 10 client.0 ms_handle_connect on v2:172.21.15.39:3300/0 2024-09-12T02:37:11.413 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:37:11.408+0000 7f2266a00640 1 -- 172.21.15.39:0/3047479109 <== mon.0 v2:172.21.15.39:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f22780a47a0 con 0x55bf1b333510 2024-09-12T02:37:11.413 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:37:11.408+0000 7f2266a00640 1 -- 172.21.15.39:0/3047479109 <== mon.0 v2:172.21.15.39:3300/0 2 ==== osd_map(95..95 src has 1..95) ==== 9129+0+0 (secure 0 0 0) 0x7f22780ba570 con 0x55bf1b333510 2024-09-12T02:37:11.413 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:37:11.409+0000 7f228abba740 1 -- 172.21.15.39:0/3047479109 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f227400fac0 con 0x55bf1b333510 2024-09-12T02:37:11.413 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:37:11.409+0000 7f2266a00640 1 -- 172.21.15.39:0/3047479109 <== mon.0 v2:172.21.15.39:3300/0 3 ==== mon_get_version_reply(handle=1 version=28) ==== 24+0+0 (secure 0 0 0) 0x7f22780a0170 con 0x55bf1b333510 2024-09-12T02:37:11.413 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:37:11.409+0000 7f228abba740 10 client.14985 fetch_fsmap learned FSMap version 28 2024-09-12T02:37:11.413 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:37:11.409+0000 7f228abba740 1 -- 172.21.15.39:0/3047479109 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({config=0+,fsmap=28,monmap=4+}) -- 0x55bf1b341e10 con 0x55bf1b333510 2024-09-12T02:37:11.413 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:37:11.409+0000 7f2266a00640 1 -- 172.21.15.39:0/3047479109 <== mon.0 v2:172.21.15.39:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f227400fac0 con 0x55bf1b333510 2024-09-12T02:37:11.413 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:37:11.409+0000 7f2266a00640 1 -- 172.21.15.39:0/3047479109 <== mon.0 v2:172.21.15.39:3300/0 5 ==== fsmap(e 28) ==== 8370+0+0 (secure 0 0 0) 0x7f2278005310 con 0x55bf1b333510 2024-09-12T02:37:11.413 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:37:11.409+0000 7f228abba740 10 client.14985 fetch_fsmap finished waiting for FSMap version 28 2024-09-12T02:37:11.413 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:37:11.409+0000 7f228abba740 10 client.14985 resolve_mds: resolved name 'h' to daemon mds.h 2024-09-12T02:37:11.413 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:37:11.409+0000 7f228abba740 20 client.14985 populate_metadata read hostname 'smithi039' 2024-09-12T02:37:11.413 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:37:11.409+0000 7f228abba740 1 --2- 172.21.15.39:0/3047479109 >> [v2:172.21.15.44:6836/1501493978,v1:172.21.15.44:6837/1501493978] conn(0x55bf1b344440 0x55bf1b3458b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:37:11.414 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:37:11.409+0000 7f228abba740 4 client.14985 mds_command: new command op to 24482 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-12T02:37:11.414 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:37:11.409+0000 7f228abba740 1 -- 172.21.15.39:0/3047479109 --> [v2:172.21.15.44:6836/1501493978,v1:172.21.15.44:6837/1501493978] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55bf1b29b620 con 0x55bf1b344440 2024-09-12T02:37:11.414 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:37:11.410+0000 7f2285600640 1 --2- 172.21.15.39:0/3047479109 >> [v2:172.21.15.44:6836/1501493978,v1:172.21.15.44:6837/1501493978] conn(0x55bf1b344440 0x55bf1b3458b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:37:11.414 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:37:11.410+0000 7f2285600640 1 --2- 172.21.15.39:0/3047479109 >> [v2:172.21.15.44:6836/1501493978,v1:172.21.15.44:6837/1501493978] conn(0x55bf1b344440 0x55bf1b3458b0 crc :-1 s=READY pgs=16 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.3 client_cookie=138154f6d1dd4a0f server_cookie=68cba33cff671a5f in_seq=0 out_seq=0 2024-09-12T02:37:11.414 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:37:11.410+0000 7f2266a00640 10 client.14985 ms_handle_connect on v2:172.21.15.44:6836/1501493978 2024-09-12T02:37:11.415 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:37:11.411+0000 7f2266a00640 1 -- 172.21.15.39:0/3047479109 <== mds.3 v2:172.21.15.44:6836/1501493978 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x55bf1b29b620 con 0x55bf1b344440 2024-09-12T02:37:11.415 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:37:11.411+0000 7f2266a00640 10 client.14985 handle_command_reply: tid=0 2024-09-12T02:37:11.415 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:37:11.411+0000 7f228abba740 1 client.14985 shutdown 2024-09-12T02:37:11.415 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:37:11.412+0000 7f228abba740 1 -- 172.21.15.39:0/3047479109 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55bf1b333510 msgr2=0x55bf1b330f70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:37:11.415 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:37:11.412+0000 7f228abba740 1 --2- 172.21.15.39:0/3047479109 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55bf1b333510 0x55bf1b330f70 secure :-1 s=READY pgs=235 cs=0 l=1 rev1=1 crypto rx=0x7f22780a4500 tx=0x7f227809b9c0 comp rx=0 tx=0).stop 2024-09-12T02:37:11.415 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:37:11.412+0000 7f228abba740 1 -- 172.21.15.39:0/3047479109 shutdown_connections 2024-09-12T02:37:11.415 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:37:11.412+0000 7f228abba740 1 --2- 172.21.15.39:0/3047479109 >> [v2:172.21.15.44:6836/1501493978,v1:172.21.15.44:6837/1501493978] conn(0x55bf1b344440 0x55bf1b3458b0 crc :-1 s=READY pgs=16 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:37:11.415 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:37:11.412+0000 7f228abba740 1 --2- 172.21.15.39:0/3047479109 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55bf1b333510 0x55bf1b330f70 unknown :-1 s=CLOSED pgs=235 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:37:11.415 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:37:11.412+0000 7f228abba740 1 --2- 172.21.15.39:0/3047479109 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55bf1b328c50 0x55bf1b330a30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:37:11.416 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:37:11.412+0000 7f228abba740 1 --2- 172.21.15.39:0/3047479109 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55bf1b328330 0x55bf1b3304f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:37:11.416 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:37:11.412+0000 7f228abba740 1 -- 172.21.15.39:0/3047479109 >> 172.21.15.39:0/3047479109 conn(0x55bf1b3248c0 msgr2=0x55bf1b32a5a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:37:11.416 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:37:11.412+0000 7f2266a00640 0 client.14985 ms_handle_reset on v2:172.21.15.44:6836/1501493978 2024-09-12T02:37:11.416 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:37:11.412+0000 7f228abba740 1 -- 172.21.15.39:0/3047479109 shutdown_connections 2024-09-12T02:37:11.416 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:37:11.412+0000 7f228abba740 1 -- 172.21.15.39:0/3047479109 wait complete. 2024-09-12T02:37:11.416 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:37:11.412+0000 7f228abba740 20 client.14985 trim_cache size 0 max 16384 2024-09-12T02:37:11.432 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:37:11.431+0000 7f228abba740 1 Processor -- start 2024-09-12T02:37:11.432 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:37:11.431+0000 7f228abba740 1 -- start start 2024-09-12T02:37:11.432 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:37:11.431+0000 7f228abba740 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55bf1b328330 0x55bf1b344440 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:37:11.432 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:37:11.431+0000 7f228abba740 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55bf1b328c50 0x55bf1b32ad90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:37:11.432 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:37:11.431+0000 7f228abba740 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55bf1b333510 0x55bf1b32fdb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:37:11.432 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:37:11.431+0000 7f228abba740 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 -- 0x55bf1b343bf0 con 0x55bf1b328330 2024-09-12T02:37:11.432 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:37:11.431+0000 7f228abba740 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x55bf1b3442c0 con 0x55bf1b328c50 2024-09-12T02:37:11.432 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:37:11.431+0000 7f228abba740 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x55bf1b344990 con 0x55bf1b333510 2024-09-12T02:37:11.433 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:37:11.431+0000 7f2285600640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55bf1b328330 0x55bf1b344440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:37:11.434 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:37:11.431+0000 7f2285600640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55bf1b328330 0x55bf1b344440 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.39:3300/0 says I am v2:172.21.15.39:48786/0 (socket says 172.21.15.39:48786) 2024-09-12T02:37:11.434 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:37:11.431+0000 7f2285600640 1 -- 172.21.15.39:0/523681635 learned_addr learned my addr 172.21.15.39:0/523681635 (peer_addr_for_me v2:172.21.15.39:0/0) 2024-09-12T02:37:11.434 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:37:11.431+0000 7f2284c00640 1 --2- 172.21.15.39:0/523681635 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55bf1b328c50 0x55bf1b32ad90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:37:11.434 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:37:11.432+0000 7f2286000640 1 --2- 172.21.15.39:0/523681635 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55bf1b333510 0x55bf1b32fdb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:37:11.434 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:37:11.432+0000 7f2285600640 1 -- 172.21.15.39:0/523681635 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55bf1b333510 msgr2=0x55bf1b32fdb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:37:11.434 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:37:11.432+0000 7f2285600640 1 --2- 172.21.15.39:0/523681635 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55bf1b333510 0x55bf1b32fdb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:37:11.434 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:37:11.432+0000 7f2285600640 1 -- 172.21.15.39:0/523681635 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55bf1b328c50 msgr2=0x55bf1b32ad90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:37:11.434 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:37:11.432+0000 7f2285600640 1 --2- 172.21.15.39:0/523681635 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55bf1b328c50 0x55bf1b32ad90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:37:11.434 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:37:11.432+0000 7f2285600640 1 -- 172.21.15.39:0/523681635 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55bf1b335c30 con 0x55bf1b328330 2024-09-12T02:37:11.434 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:37:11.432+0000 7f2285600640 1 --2- 172.21.15.39:0/523681635 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55bf1b328330 0x55bf1b344440 secure :-1 s=READY pgs=236 cs=0 l=1 rev1=1 crypto rx=0x7f22740115f0 tx=0x7f227400ff50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f3777a518424dbee server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:37:11.434 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:37:11.432+0000 7f2271c00640 1 -- 172.21.15.39:0/523681635 <== mon.0 v2:172.21.15.39:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2274028030 con 0x55bf1b328330 2024-09-12T02:37:11.434 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:37:11.432+0000 7f2271c00640 1 -- 172.21.15.39:0/523681635 <== mon.0 v2:172.21.15.39:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f227400fac0 con 0x55bf1b328330 2024-09-12T02:37:11.435 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:37:11.432+0000 7f2271c00640 1 -- 172.21.15.39:0/523681635 <== mon.0 v2:172.21.15.39:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f227401e040 con 0x55bf1b328330 2024-09-12T02:37:11.435 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:37:11.433+0000 7f228abba740 1 -- 172.21.15.39:0/523681635 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55bf1b328330 msgr2=0x55bf1b344440 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:37:11.435 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:37:11.433+0000 7f228abba740 1 --2- 172.21.15.39:0/523681635 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55bf1b328330 0x55bf1b344440 secure :-1 s=READY pgs=236 cs=0 l=1 rev1=1 crypto rx=0x7f22740115f0 tx=0x7f227400ff50 comp rx=0 tx=0).stop 2024-09-12T02:37:11.437 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:37:11.433+0000 7f228abba740 1 -- 172.21.15.39:0/523681635 shutdown_connections 2024-09-12T02:37:11.437 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:37:11.433+0000 7f228abba740 1 --2- 172.21.15.39:0/523681635 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55bf1b333510 0x55bf1b32fdb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:37:11.437 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:37:11.433+0000 7f228abba740 1 --2- 172.21.15.39:0/523681635 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55bf1b328c50 0x55bf1b32ad90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:37:11.437 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:37:11.433+0000 7f228abba740 1 --2- 172.21.15.39:0/523681635 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55bf1b328330 0x55bf1b344440 unknown :-1 s=CLOSED pgs=236 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:37:11.437 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:37:11.433+0000 7f228abba740 1 -- 172.21.15.39:0/523681635 >> 172.21.15.39:0/523681635 conn(0x55bf1b3248c0 msgr2=0x55bf1b32b790 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:37:11.437 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:37:11.433+0000 7f228abba740 1 -- 172.21.15.39:0/523681635 shutdown_connections 2024-09-12T02:37:11.437 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:37:11.433+0000 7f228abba740 1 -- 172.21.15.39:0/523681635 wait complete. 2024-09-12T02:37:11.437 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:37:11.434+0000 7f228abba740 1 -- start start 2024-09-12T02:37:11.437 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:37:11.434+0000 7f228abba740 1 Processor -- start 2024-09-12T02:37:11.438 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:37:11.434+0000 7f228abba740 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55bf1b328330 0x55bf1b34df40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:37:11.438 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:37:11.434+0000 7f228abba740 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55bf1b328c50 0x55bf1b34e480 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:37:11.438 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:37:11.434+0000 7f228abba740 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55bf1b333510 0x55bf1b347450 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:37:11.438 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:37:11.434+0000 7f228abba740 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 -- 0x55bf1b345730 con 0x55bf1b328c50 2024-09-12T02:37:11.438 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:37:11.434+0000 7f228abba740 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x55bf1b345060 con 0x55bf1b328330 2024-09-12T02:37:11.438 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:37:11.434+0000 7f228abba740 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x55bf1b345e00 con 0x55bf1b333510 2024-09-12T02:37:11.438 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:37:11.435+0000 7f228abba740 10 client.0 _ll_register_callbacks cb 0x7f2278098060 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-12T02:37:11.438 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:37:11.435+0000 7f2285600640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55bf1b328330 0x55bf1b34df40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:37:11.438 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:37:11.435+0000 7f2284c00640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55bf1b328c50 0x55bf1b34e480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:37:11.438 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:37:11.435+0000 7f2285600640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55bf1b328330 0x55bf1b34df40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.39:56290/0 (socket says 172.21.15.39:56290) 2024-09-12T02:37:11.438 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:37:11.435+0000 7f2285600640 1 -- 172.21.15.39:0/3739518268 learned_addr learned my addr 172.21.15.39:0/3739518268 (peer_addr_for_me v2:172.21.15.39:0/0) 2024-09-12T02:37:11.438 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:37:11.435+0000 7f2286000640 1 --2- 172.21.15.39:0/3739518268 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55bf1b333510 0x55bf1b347450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:37:11.438 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:37:11.435+0000 7f2285600640 1 -- 172.21.15.39:0/3739518268 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55bf1b333510 msgr2=0x55bf1b347450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:37:11.439 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:37:11.435+0000 7f2285600640 1 --2- 172.21.15.39:0/3739518268 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55bf1b333510 0x55bf1b347450 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:37:11.439 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:37:11.435+0000 7f2285600640 1 -- 172.21.15.39:0/3739518268 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55bf1b328c50 msgr2=0x55bf1b34e480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:37:11.439 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:37:11.435+0000 7f2285600640 1 --2- 172.21.15.39:0/3739518268 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55bf1b328c50 0x55bf1b34e480 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:37:11.439 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:37:11.435+0000 7f2285600640 1 -- 172.21.15.39:0/3739518268 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55bf1b347c80 con 0x55bf1b328330 2024-09-12T02:37:11.439 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:37:11.435+0000 7f2284c00640 1 --2- 172.21.15.39:0/3739518268 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55bf1b328c50 0x55bf1b34e480 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-12T02:37:11.439 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:37:11.436+0000 7f2285600640 1 --2- 172.21.15.39:0/3739518268 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55bf1b328330 0x55bf1b34df40 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0x7f2274000c00 tx=0x7f2274019410 comp rx=0 tx=0).ready entity=mon.2 client_cookie=4aded676ac29f526 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:37:11.439 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:37:11.436+0000 7f2266a00640 10 client.0 ms_handle_connect on v2:172.21.15.44:3300/0 2024-09-12T02:37:11.439 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:37:11.436+0000 7f2266a00640 1 -- 172.21.15.39:0/3739518268 <== mon.2 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2274031020 con 0x55bf1b328330 2024-09-12T02:37:11.439 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:37:11.436+0000 7f228abba740 1 -- 172.21.15.39:0/3739518268 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f227400fac0 con 0x55bf1b328330 2024-09-12T02:37:11.439 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:37:11.436+0000 7f2266a00640 1 -- 172.21.15.39:0/3739518268 <== mon.2 v2:172.21.15.44:3300/0 2 ==== osd_map(95..95 src has 1..95) ==== 9129+0+0 (secure 0 0 0) 0x7f2274016040 con 0x55bf1b328330 2024-09-12T02:37:11.439 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:37:11.436+0000 7f2266a00640 1 -- 172.21.15.39:0/3739518268 <== mon.2 v2:172.21.15.44:3300/0 3 ==== mon_get_version_reply(handle=1 version=28) ==== 24+0+0 (secure 0 0 0) 0x7f2274028030 con 0x55bf1b328330 2024-09-12T02:37:11.439 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:37:11.436+0000 7f228abba740 10 client.24977 fetch_fsmap learned FSMap version 28 2024-09-12T02:37:11.439 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:37:11.436+0000 7f228abba740 1 -- 172.21.15.39:0/3739518268 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,fsmap=28,monmap=4+}) -- 0x55bf1b34c6e0 con 0x55bf1b328330 2024-09-12T02:37:11.439 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:37:11.436+0000 7f2266a00640 1 -- 172.21.15.39:0/3739518268 <== mon.2 v2:172.21.15.44:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f227400fac0 con 0x55bf1b328330 2024-09-12T02:37:11.441 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:37:11.437+0000 7f2266a00640 1 -- 172.21.15.39:0/3739518268 <== mon.2 v2:172.21.15.44:3300/0 5 ==== fsmap(e 28) ==== 8370+0+0 (secure 0 0 0) 0x7f22740198d0 con 0x55bf1b328330 2024-09-12T02:37:11.441 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:37:11.437+0000 7f228abba740 10 client.24977 fetch_fsmap finished waiting for FSMap version 28 2024-09-12T02:37:11.441 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:37:11.437+0000 7f228abba740 10 client.24977 resolve_mds: resolved name 'h' to daemon mds.h 2024-09-12T02:37:11.441 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:37:11.437+0000 7f228abba740 20 client.24977 populate_metadata read hostname 'smithi039' 2024-09-12T02:37:11.441 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:37:11.437+0000 7f228abba740 1 --2- 172.21.15.39:0/3739518268 >> [v2:172.21.15.44:6836/1501493978,v1:172.21.15.44:6837/1501493978] conn(0x55bf1b3b2d30 0x55bf1b3b1a40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:37:11.442 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:37:11.437+0000 7f228abba740 4 client.24977 mds_command: new command op to 24482 tid=0 multi_id=0 [{"prefix": "status"}] 2024-09-12T02:37:11.442 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:37:11.437+0000 7f228abba740 1 -- 172.21.15.39:0/3739518268 --> [v2:172.21.15.44:6836/1501493978,v1:172.21.15.44:6837/1501493978] -- command(tid 0: {"prefix": "status"}) -- 0x55bf1b295b30 con 0x55bf1b3b2d30 2024-09-12T02:37:11.442 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:37:11.437+0000 7f2284c00640 1 --2- 172.21.15.39:0/3739518268 >> [v2:172.21.15.44:6836/1501493978,v1:172.21.15.44:6837/1501493978] conn(0x55bf1b3b2d30 0x55bf1b3b1a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:37:11.442 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:37:11.438+0000 7f2284c00640 1 --2- 172.21.15.39:0/3739518268 >> [v2:172.21.15.44:6836/1501493978,v1:172.21.15.44:6837/1501493978] conn(0x55bf1b3b2d30 0x55bf1b3b1a40 crc :-1 s=READY pgs=17 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.3 client_cookie=263f2f9fe3a30d22 server_cookie=37dfa5e9188cecf6 in_seq=0 out_seq=0 2024-09-12T02:37:11.442 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:37:11.438+0000 7f2266a00640 10 client.24977 ms_handle_connect on v2:172.21.15.44:6836/1501493978 2024-09-12T02:37:11.442 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:37:11.438+0000 7f2266a00640 1 -- 172.21.15.39:0/3739518268 <== mds.3 v2:172.21.15.44:6836/1501493978 1 ==== command_reply(tid 0: 0 ) ==== 8+0+332 (crc 0 0 0) 0x55bf1b295b30 con 0x55bf1b3b2d30 2024-09-12T02:37:11.442 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:37:11.438+0000 7f2266a00640 10 client.24977 handle_command_reply: tid=0 2024-09-12T02:37:11.442 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:37:11.438+0000 7f228abba740 1 client.24977 shutdown 2024-09-12T02:37:11.442 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:37:11.438+0000 7f228abba740 1 -- 172.21.15.39:0/3739518268 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55bf1b328330 msgr2=0x55bf1b34df40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:37:11.442 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:37:11.438+0000 7f228abba740 1 --2- 172.21.15.39:0/3739518268 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55bf1b328330 0x55bf1b34df40 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0x7f2274000c00 tx=0x7f2274019410 comp rx=0 tx=0).stop 2024-09-12T02:37:11.442 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:37:11.438+0000 7f228abba740 1 -- 172.21.15.39:0/3739518268 shutdown_connections 2024-09-12T02:37:11.442 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:37:11.438+0000 7f228abba740 1 --2- 172.21.15.39:0/3739518268 >> [v2:172.21.15.44:6836/1501493978,v1:172.21.15.44:6837/1501493978] conn(0x55bf1b3b2d30 0x55bf1b3b1a40 crc :-1 s=READY pgs=17 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:37:11.442 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:37:11.438+0000 7f228abba740 1 --2- 172.21.15.39:0/3739518268 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55bf1b333510 0x55bf1b347450 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:37:11.443 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:37:11.438+0000 7f228abba740 1 --2- 172.21.15.39:0/3739518268 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55bf1b328c50 0x55bf1b34e480 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:37:11.443 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:37:11.438+0000 7f2266a00640 0 client.24977 ms_handle_reset on v2:172.21.15.44:6836/1501493978 2024-09-12T02:37:11.443 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:37:11.438+0000 7f228abba740 1 --2- 172.21.15.39:0/3739518268 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55bf1b328330 0x55bf1b34df40 unknown :-1 s=CLOSED pgs=105 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:37:11.443 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:37:11.438+0000 7f228abba740 1 -- 172.21.15.39:0/3739518268 >> 172.21.15.39:0/3739518268 conn(0x55bf1b3248c0 msgr2=0x55bf1b32ec50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:37:11.443 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:37:11.438+0000 7f228abba740 1 -- 172.21.15.39:0/3739518268 shutdown_connections 2024-09-12T02:37:11.443 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:37:11.438+0000 7f228abba740 1 -- 172.21.15.39:0/3739518268 wait complete. 2024-09-12T02:37:11.443 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:37:11.439+0000 7f228abba740 20 client.24977 trim_cache size 0 max 16384 2024-09-12T02:37:11.443 INFO:teuthology.orchestra.run.smithi039.stdout:{ 2024-09-12T02:37:11.443 INFO:teuthology.orchestra.run.smithi039.stdout: "cluster_fsid": "4954ed46-70ae-11ef-bcea-c7b262605968", 2024-09-12T02:37:11.443 INFO:teuthology.orchestra.run.smithi039.stdout: "whoami": 3, 2024-09-12T02:37:11.444 INFO:teuthology.orchestra.run.smithi039.stdout: "id": 24482, 2024-09-12T02:37:11.444 INFO:teuthology.orchestra.run.smithi039.stdout: "want_state": "up:active", 2024-09-12T02:37:11.444 INFO:teuthology.orchestra.run.smithi039.stdout: "state": "up:active", 2024-09-12T02:37:11.444 INFO:teuthology.orchestra.run.smithi039.stdout: "fs_name": "cephfs", 2024-09-12T02:37:11.444 INFO:teuthology.orchestra.run.smithi039.stdout: "rank_uptime": 80.662974446000007, 2024-09-12T02:37:11.444 INFO:teuthology.orchestra.run.smithi039.stdout: "mdsmap_epoch": 28, 2024-09-12T02:37:11.444 INFO:teuthology.orchestra.run.smithi039.stdout: "osdmap_epoch": 95, 2024-09-12T02:37:11.444 INFO:teuthology.orchestra.run.smithi039.stdout: "osdmap_epoch_barrier": 93, 2024-09-12T02:37:11.444 INFO:teuthology.orchestra.run.smithi039.stdout: "uptime": 152.18728719500001 2024-09-12T02:37:11.444 INFO:teuthology.orchestra.run.smithi039.stdout:} 2024-09-12T02:37:11.445 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:37:11.439+0000 7f2288000640 1 -- 172.21.15.39:0/1952597079 >> [v2:172.21.15.39:6800/1725006999,v1:172.21.15.39:6801/1725006999] conn(0x7f22680a2c10 msgr2=0x7f22680a50d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:37:11.445 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:37:11.439+0000 7f2288000640 1 --2- 172.21.15.39:0/1952597079 >> [v2:172.21.15.39:6800/1725006999,v1:172.21.15.39:6801/1725006999] conn(0x7f22680a2c10 0x7f22680a50d0 secure :-1 s=READY pgs=211 cs=0 l=1 rev1=1 crypto rx=0x7f226c009230 tx=0x7f226c041040 comp rx=0 tx=0).stop 2024-09-12T02:37:11.445 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:37:11.439+0000 7f2288000640 1 -- 172.21.15.39:0/1952597079 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f2280109140 msgr2=0x7f228019ef10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:37:11.445 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:37:11.439+0000 7f2288000640 1 --2- 172.21.15.39:0/1952597079 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f2280109140 0x7f228019ef10 secure :-1 s=READY pgs=234 cs=0 l=1 rev1=1 crypto rx=0x7f227800eb10 tx=0x7f227800c2d0 comp rx=0 tx=0).stop 2024-09-12T02:37:11.445 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:37:11.439+0000 7f2288000640 1 -- 172.21.15.39:0/1952597079 shutdown_connections 2024-09-12T02:37:11.445 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:37:11.439+0000 7f2288000640 1 --2- 172.21.15.39:0/1952597079 >> [v2:172.21.15.39:6800/1725006999,v1:172.21.15.39:6801/1725006999] conn(0x7f22680a2c10 0x7f22680a50d0 unknown :-1 s=CLOSED pgs=211 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:37:11.445 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:37:11.439+0000 7f2288000640 1 --2- 172.21.15.39:0/1952597079 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f2280109140 0x7f228019ef10 unknown :-1 s=CLOSED pgs=234 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:37:11.445 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:37:11.439+0000 7f2288000640 1 --2- 172.21.15.39:0/1952597079 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f22801049c0 0x7f228019ab80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:37:11.445 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:37:11.439+0000 7f2288000640 1 --2- 172.21.15.39:0/1952597079 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f2280104010 0x7f228019a640 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:37:11.445 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:37:11.439+0000 7f2288000640 1 -- 172.21.15.39:0/1952597079 >> 172.21.15.39:0/1952597079 conn(0x7f22800ffa50 msgr2=0x7f2280100df0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:37:11.445 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:37:11.439+0000 7f2288000640 1 -- 172.21.15.39:0/1952597079 shutdown_connections 2024-09-12T02:37:11.446 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:37:11.440+0000 7f2288000640 1 -- 172.21.15.39:0/1952597079 wait complete. 2024-09-12T02:37:12.260 DEBUG:teuthology.orchestra.run.smithi039:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc shell --fsid 4954ed46-70ae-11ef-bcea-c7b262605968 -- ceph tell mds.c status 2024-09-12T02:37:12.599 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 02:37:12 smithi039 ceph-mon[30515]: pgmap v368: 129 pgs: 129 active+clean; 645 KiB data, 348 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2024-09-12T02:37:12.642 INFO:teuthology.orchestra.run.smithi039.stderr:Inferring config /var/lib/ceph/4954ed46-70ae-11ef-bcea-c7b262605968/mon.a/config 2024-09-12T02:37:12.763 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 12 02:37:12 smithi172 ceph-mon[35609]: pgmap v368: 129 pgs: 129 active+clean; 645 KiB data, 348 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2024-09-12T02:37:12.948 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 12 02:37:12 smithi044 ceph-mon[35411]: pgmap v368: 129 pgs: 129 active+clean; 645 KiB data, 348 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2024-09-12T02:37:13.224 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:37:13.223+0000 7f4dcec00640 1 -- 172.21.15.39:0/2696553902 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f4dc81049a0 msgr2=0x7f4dc81089f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:37:13.224 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:37:13.223+0000 7f4dcec00640 1 --2- 172.21.15.39:0/2696553902 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f4dc81049a0 0x7f4dc81089f0 secure :-1 s=READY pgs=237 cs=0 l=1 rev1=1 crypto rx=0x7f4db0009900 tx=0x7f4db002a410 comp rx=0 tx=0).stop 2024-09-12T02:37:13.225 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:37:13.223+0000 7f4dcec00640 1 -- 172.21.15.39:0/2696553902 shutdown_connections 2024-09-12T02:37:13.225 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:37:13.223+0000 7f4dcec00640 1 --2- 172.21.15.39:0/2696553902 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f4dc8109120 0x7f4dc8110ca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:37:13.225 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:37:13.223+0000 7f4dcec00640 1 --2- 172.21.15.39:0/2696553902 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f4dc81049a0 0x7f4dc81089f0 unknown :-1 s=CLOSED pgs=237 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:37:13.225 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:37:13.223+0000 7f4dcec00640 1 --2- 172.21.15.39:0/2696553902 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f4dc8103ff0 0x7f4dc81043d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:37:13.225 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:37:13.223+0000 7f4dcec00640 1 -- 172.21.15.39:0/2696553902 >> 172.21.15.39:0/2696553902 conn(0x7f4dc80ffa90 msgr2=0x7f4dc8101eb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:37:13.225 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:37:13.223+0000 7f4dcec00640 1 -- 172.21.15.39:0/2696553902 shutdown_connections 2024-09-12T02:37:13.225 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:37:13.223+0000 7f4dcec00640 1 -- 172.21.15.39:0/2696553902 wait complete. 2024-09-12T02:37:13.226 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:37:13.224+0000 7f4dcec00640 1 Processor -- start 2024-09-12T02:37:13.226 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:37:13.224+0000 7f4dcec00640 1 -- start start 2024-09-12T02:37:13.226 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:37:13.225+0000 7f4dcec00640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f4dc8103ff0 0x7f4dc819a620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:37:13.226 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:37:13.225+0000 7f4dcec00640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f4dc81049a0 0x7f4dc819ab60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:37:13.226 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:37:13.225+0000 7f4dcec00640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f4dc8109120 0x7f4dc819eef0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:37:13.226 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:37:13.225+0000 7f4dcec00640 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 -- 0x7f4dc8114140 con 0x7f4dc8103ff0 2024-09-12T02:37:13.226 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:37:13.225+0000 7f4dcec00640 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x7f4dc8113fc0 con 0x7f4dc8109120 2024-09-12T02:37:13.227 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:37:13.225+0000 7f4dcec00640 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7f4dc81142c0 con 0x7f4dc81049a0 2024-09-12T02:37:13.227 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:37:13.225+0000 7f4dc7e00640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f4dc8103ff0 0x7f4dc819a620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:37:13.227 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:37:13.225+0000 7f4dc7e00640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f4dc8103ff0 0x7f4dc819a620 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.39:3300/0 says I am v2:172.21.15.39:48824/0 (socket says 172.21.15.39:48824) 2024-09-12T02:37:13.227 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:37:13.225+0000 7f4dc7e00640 1 -- 172.21.15.39:0/1819560535 learned_addr learned my addr 172.21.15.39:0/1819560535 (peer_addr_for_me v2:172.21.15.39:0/0) 2024-09-12T02:37:13.227 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:37:13.225+0000 7f4dbf400640 1 --2- 172.21.15.39:0/1819560535 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f4dc81049a0 0x7f4dc819ab60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:37:13.227 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:37:13.225+0000 7f4dccc00640 1 --2- 172.21.15.39:0/1819560535 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f4dc8109120 0x7f4dc819eef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:37:13.228 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:37:13.226+0000 7f4dc7e00640 1 -- 172.21.15.39:0/1819560535 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f4dc81049a0 msgr2=0x7f4dc819ab60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:37:13.228 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:37:13.226+0000 7f4dc7e00640 1 --2- 172.21.15.39:0/1819560535 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f4dc81049a0 0x7f4dc819ab60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:37:13.228 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:37:13.226+0000 7f4dc7e00640 1 -- 172.21.15.39:0/1819560535 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f4dc8109120 msgr2=0x7f4dc819eef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:37:13.228 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:37:13.226+0000 7f4dc7e00640 1 --2- 172.21.15.39:0/1819560535 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f4dc8109120 0x7f4dc819eef0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:37:13.228 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:37:13.226+0000 7f4dc7e00640 1 -- 172.21.15.39:0/1819560535 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4dc819f5d0 con 0x7f4dc8103ff0 2024-09-12T02:37:13.228 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:37:13.226+0000 7f4dc7e00640 1 --2- 172.21.15.39:0/1819560535 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f4dc8103ff0 0x7f4dc819a620 secure :-1 s=READY pgs=238 cs=0 l=1 rev1=1 crypto rx=0x7f4db800eb90 tx=0x7f4db800c6a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:37:13.228 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:37:13.226+0000 7f4dc5600640 1 -- 172.21.15.39:0/1819560535 <== mon.0 v2:172.21.15.39:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4db8004d20 con 0x7f4dc8103ff0 2024-09-12T02:37:13.228 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:37:13.226+0000 7f4dc5600640 1 -- 172.21.15.39:0/1819560535 <== mon.0 v2:172.21.15.39:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f4db800ee90 con 0x7f4dc8103ff0 2024-09-12T02:37:13.228 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:37:13.226+0000 7f4dc5600640 1 -- 172.21.15.39:0/1819560535 <== mon.0 v2:172.21.15.39:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4db8010830 con 0x7f4dc8103ff0 2024-09-12T02:37:13.228 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:37:13.226+0000 7f4dcec00640 1 -- 172.21.15.39:0/1819560535 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f4dc819f8c0 con 0x7f4dc8103ff0 2024-09-12T02:37:13.228 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:37:13.227+0000 7f4dcec00640 1 -- 172.21.15.39:0/1819560535 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f4dc81a71a0 con 0x7f4dc8103ff0 2024-09-12T02:37:13.230 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:37:13.229+0000 7f4dc5600640 1 -- 172.21.15.39:0/1819560535 <== mon.0 v2:172.21.15.39:3300/0 4 ==== mgrmap(e 17) ==== 137884+0+0 (secure 0 0 0) 0x7f4db8005020 con 0x7f4dc8103ff0 2024-09-12T02:37:13.230 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:37:13.229+0000 7f4dd17d8740 1 Processor -- start 2024-09-12T02:37:13.230 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:37:13.230+0000 7f4dd17d8740 1 -- start start 2024-09-12T02:37:13.231 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:37:13.230+0000 7f4dd17d8740 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55d217dd1330 0x55d217dd1710 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:37:13.231 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:37:13.230+0000 7f4dd17d8740 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55d217dd1c50 0x55d217ddbfd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:37:13.231 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:37:13.230+0000 7f4dd17d8740 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55d217ddc510 0x55d217dde900 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:37:13.231 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:37:13.230+0000 7f4dd17d8740 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 -- 0x55d217d370b0 con 0x55d217ddc510 2024-09-12T02:37:13.231 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:37:13.230+0000 7f4dd17d8740 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x55d217cdeab0 con 0x55d217dd1c50 2024-09-12T02:37:13.232 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:37:13.230+0000 7f4dd17d8740 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x55d217d33070 con 0x55d217dd1330 2024-09-12T02:37:13.232 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:37:13.231+0000 7f4dc7e00640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55d217dd1c50 0x55d217ddbfd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:37:13.232 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:37:13.231+0000 7f4dccc00640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55d217dd1330 0x55d217dd1710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:37:13.232 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:37:13.231+0000 7f4dbf400640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55d217ddc510 0x55d217dde900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:37:13.232 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:37:13.231+0000 7f4dccc00640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55d217dd1330 0x55d217dd1710 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.172:3300/0 says I am v2:172.21.15.39:39346/0 (socket says 172.21.15.39:39346) 2024-09-12T02:37:13.232 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:37:13.231+0000 7f4dccc00640 1 -- 172.21.15.39:0/1888997137 learned_addr learned my addr 172.21.15.39:0/1888997137 (peer_addr_for_me v2:172.21.15.39:0/0) 2024-09-12T02:37:13.233 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:37:13.231+0000 7f4dc7e00640 1 -- 172.21.15.39:0/1888997137 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55d217dd1330 msgr2=0x55d217dd1710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:37:13.234 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:37:13.231+0000 7f4dc7e00640 1 --2- 172.21.15.39:0/1888997137 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55d217dd1330 0x55d217dd1710 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:37:13.234 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:37:13.231+0000 7f4dc7e00640 1 -- 172.21.15.39:0/1888997137 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55d217ddc510 msgr2=0x55d217dde900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:37:13.234 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:37:13.231+0000 7f4dc7e00640 1 --2- 172.21.15.39:0/1888997137 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55d217ddc510 0x55d217dde900 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:37:13.234 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:37:13.231+0000 7f4dc7e00640 1 -- 172.21.15.39:0/1888997137 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55d217ceb4a0 con 0x55d217dd1c50 2024-09-12T02:37:13.234 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:37:13.231+0000 7f4dc5600640 1 --2- 172.21.15.39:0/1819560535 >> [v2:172.21.15.39:6800/1725006999,v1:172.21.15.39:6801/1725006999] conn(0x7f4dac0a2c90 0x7f4dac0a5150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:37:13.234 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:37:13.231+0000 7f4dc7e00640 1 --2- 172.21.15.39:0/1888997137 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55d217dd1c50 0x55d217ddbfd0 secure :-1 s=READY pgs=106 cs=0 l=1 rev1=1 crypto rx=0x7f4db80cd0f0 tx=0x7f4db80d3bf0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=62f256849c547d8a server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:37:13.234 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:37:13.232+0000 7f4dccc00640 1 --2- 172.21.15.39:0/1819560535 >> [v2:172.21.15.39:6800/1725006999,v1:172.21.15.39:6801/1725006999] conn(0x7f4dac0a2c90 0x7f4dac0a5150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:37:13.234 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:37:13.232+0000 7f4dc5600640 1 -- 172.21.15.39:0/1819560535 <== mon.0 v2:172.21.15.39:3300/0 5 ==== osd_map(95..95 src has 1..95) ==== 9129+0+0 (secure 0 0 0) 0x7f4db80cfb50 con 0x7f4dc8103ff0 2024-09-12T02:37:13.234 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:37:13.232+0000 7f4dbd200640 1 -- 172.21.15.39:0/1888997137 <== mon.2 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4db8098110 con 0x55d217dd1c50 2024-09-12T02:37:13.234 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:37:13.232+0000 7f4dbd200640 1 -- 172.21.15.39:0/1888997137 <== mon.2 v2:172.21.15.44:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f4db80d3e40 con 0x55d217dd1c50 2024-09-12T02:37:13.234 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:37:13.232+0000 7f4dbd200640 1 -- 172.21.15.39:0/1888997137 <== mon.2 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4db809b7d0 con 0x55d217dd1c50 2024-09-12T02:37:13.234 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:37:13.233+0000 7f4dd17d8740 1 -- 172.21.15.39:0/1888997137 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55d217dd1c50 msgr2=0x55d217ddbfd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:37:13.234 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:37:13.233+0000 7f4dd17d8740 1 --2- 172.21.15.39:0/1888997137 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55d217dd1c50 0x55d217ddbfd0 secure :-1 s=READY pgs=106 cs=0 l=1 rev1=1 crypto rx=0x7f4db80cd0f0 tx=0x7f4db80d3bf0 comp rx=0 tx=0).stop 2024-09-12T02:37:13.234 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:37:13.233+0000 7f4dccc00640 1 --2- 172.21.15.39:0/1819560535 >> [v2:172.21.15.39:6800/1725006999,v1:172.21.15.39:6801/1725006999] conn(0x7f4dac0a2c90 0x7f4dac0a5150 secure :-1 s=READY pgs=212 cs=0 l=1 rev1=1 crypto rx=0x7f4dc0009e60 tx=0x7f4dc0005f90 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:37:13.235 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:37:13.233+0000 7f4dd17d8740 1 -- 172.21.15.39:0/1888997137 shutdown_connections 2024-09-12T02:37:13.235 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:37:13.233+0000 7f4dd17d8740 1 --2- 172.21.15.39:0/1888997137 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55d217ddc510 0x55d217dde900 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:37:13.235 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:37:13.233+0000 7f4dd17d8740 1 --2- 172.21.15.39:0/1888997137 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55d217dd1c50 0x55d217ddbfd0 unknown :-1 s=CLOSED pgs=106 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:37:13.235 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:37:13.233+0000 7f4dd17d8740 1 --2- 172.21.15.39:0/1888997137 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55d217dd1330 0x55d217dd1710 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:37:13.235 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:37:13.233+0000 7f4dd17d8740 1 -- 172.21.15.39:0/1888997137 >> 172.21.15.39:0/1888997137 conn(0x55d217dcd8c0 msgr2=0x55d217dcdca0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:37:13.235 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:37:13.233+0000 7f4dd17d8740 1 -- 172.21.15.39:0/1888997137 shutdown_connections 2024-09-12T02:37:13.235 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:37:13.233+0000 7f4dd17d8740 1 -- 172.21.15.39:0/1888997137 wait complete. 2024-09-12T02:37:13.237 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:37:13.233+0000 7f4dd17d8740 1 -- start start 2024-09-12T02:37:13.238 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:37:13.233+0000 7f4dd17d8740 1 Processor -- start 2024-09-12T02:37:13.238 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:37:13.234+0000 7f4dd17d8740 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55d217dd1330 0x55d217dd9600 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:37:13.238 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:37:13.234+0000 7f4dd17d8740 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55d217dd1c50 0x55d217dd9b40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:37:13.238 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:37:13.234+0000 7f4dd17d8740 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55d217ddc510 0x55d217dda080 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:37:13.238 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:37:13.234+0000 7f4dd17d8740 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 -- 0x55d217ddf060 con 0x55d217dd1330 2024-09-12T02:37:13.238 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:37:13.234+0000 7f4dd17d8740 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x55d217cbf920 con 0x55d217dd1c50 2024-09-12T02:37:13.238 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:37:13.234+0000 7f4dd17d8740 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x55d217ddf1e0 con 0x55d217ddc510 2024-09-12T02:37:13.238 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:37:13.234+0000 7f4dd17d8740 10 client.0 _ll_register_callbacks cb 0x55d217ce38a0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-12T02:37:13.238 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:37:13.234+0000 7f4dc7e00640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55d217dd1330 0x55d217dd9600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:37:13.238 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:37:13.234+0000 7f4dc7e00640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55d217dd1330 0x55d217dd9600 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.39:3300/0 says I am v2:172.21.15.39:48834/0 (socket says 172.21.15.39:48834) 2024-09-12T02:37:13.238 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:37:13.234+0000 7f4dbf400640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55d217dd1c50 0x55d217dd9b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:37:13.238 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:37:13.234+0000 7f4dc7e00640 1 -- 172.21.15.39:0/3806043467 learned_addr learned my addr 172.21.15.39:0/3806043467 (peer_addr_for_me v2:172.21.15.39:0/0) 2024-09-12T02:37:13.238 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:37:13.234+0000 7f4dccc00640 1 --2- 172.21.15.39:0/3806043467 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55d217ddc510 0x55d217dda080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:37:13.239 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:37:13.235+0000 7f4dbf400640 1 -- 172.21.15.39:0/3806043467 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55d217ddc510 msgr2=0x55d217dda080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:37:13.239 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:37:13.235+0000 7f4dbf400640 1 --2- 172.21.15.39:0/3806043467 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55d217ddc510 0x55d217dda080 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:37:13.239 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:37:13.235+0000 7f4dbf400640 1 -- 172.21.15.39:0/3806043467 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55d217dd1330 msgr2=0x55d217dd9600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:37:13.239 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:37:13.235+0000 7f4dbf400640 1 --2- 172.21.15.39:0/3806043467 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55d217dd1330 0x55d217dd9600 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:37:13.239 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:37:13.235+0000 7f4dbf400640 1 -- 172.21.15.39:0/3806043467 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55d217aa82b0 con 0x55d217dd1c50 2024-09-12T02:37:13.239 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:37:13.235+0000 7f4dbf400640 1 --2- 172.21.15.39:0/3806043467 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55d217dd1c50 0x55d217dd9b40 secure :-1 s=READY pgs=107 cs=0 l=1 rev1=1 crypto rx=0x7f4db0005940 tx=0x7f4db00317e0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=11ebc803d5823131 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:37:13.239 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:37:13.235+0000 7f4db5600640 10 client.0 ms_handle_connect on v2:172.21.15.44:3300/0 2024-09-12T02:37:13.239 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:37:13.235+0000 7f4db5600640 1 -- 172.21.15.39:0/3806043467 <== mon.2 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4db0035040 con 0x55d217dd1c50 2024-09-12T02:37:13.239 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:37:13.235+0000 7f4dd17d8740 1 -- 172.21.15.39:0/3806043467 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x55d217d44620 con 0x55d217dd1c50 2024-09-12T02:37:13.239 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:37:13.236+0000 7f4db5600640 1 -- 172.21.15.39:0/3806043467 <== mon.2 v2:172.21.15.44:3300/0 2 ==== osd_map(95..95 src has 1..95) ==== 9129+0+0 (secure 0 0 0) 0x7f4db0004240 con 0x55d217dd1c50 2024-09-12T02:37:13.239 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:37:13.236+0000 7f4db5600640 1 -- 172.21.15.39:0/3806043467 <== mon.2 v2:172.21.15.44:3300/0 3 ==== mon_get_version_reply(handle=1 version=28) ==== 24+0+0 (secure 0 0 0) 0x7f4db004f050 con 0x55d217dd1c50 2024-09-12T02:37:13.239 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:37:13.236+0000 7f4dd17d8740 10 client.24989 fetch_fsmap learned FSMap version 28 2024-09-12T02:37:13.239 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:37:13.236+0000 7f4dd17d8740 1 -- 172.21.15.39:0/3806043467 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,fsmap=28,monmap=4+}) -- 0x55d217deaef0 con 0x55d217dd1c50 2024-09-12T02:37:13.239 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:37:13.236+0000 7f4db5600640 1 -- 172.21.15.39:0/3806043467 <== mon.2 v2:172.21.15.44:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x55d217d44620 con 0x55d217dd1c50 2024-09-12T02:37:13.240 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:37:13.236+0000 7f4db5600640 1 -- 172.21.15.39:0/3806043467 <== mon.2 v2:172.21.15.44:3300/0 5 ==== fsmap(e 28) ==== 8370+0+0 (secure 0 0 0) 0x7f4db0004a10 con 0x55d217dd1c50 2024-09-12T02:37:13.240 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:37:13.236+0000 7f4dd17d8740 10 client.24989 fetch_fsmap finished waiting for FSMap version 28 2024-09-12T02:37:13.240 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:37:13.236+0000 7f4dd17d8740 10 client.24989 resolve_mds: resolved name 'c' to daemon mds.c 2024-09-12T02:37:13.240 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:37:13.236+0000 7f4dd17d8740 20 client.24989 populate_metadata read hostname 'smithi039' 2024-09-12T02:37:13.240 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:37:13.236+0000 7f4dd17d8740 1 --2- 172.21.15.39:0/3806043467 >> [v2:172.21.15.172:6836/493506747,v1:172.21.15.172:6837/493506747] conn(0x55d217ded490 0x55d217dee900 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:37:13.240 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:37:13.236+0000 7f4dd17d8740 4 client.24989 mds_command: new command op to 24484 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-12T02:37:13.240 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:37:13.236+0000 7f4dd17d8740 1 -- 172.21.15.39:0/3806043467 --> [v2:172.21.15.172:6836/493506747,v1:172.21.15.172:6837/493506747] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55d217d3eb30 con 0x55d217ded490 2024-09-12T02:37:13.240 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:37:13.237+0000 7f4dc7e00640 1 --2- 172.21.15.39:0/3806043467 >> [v2:172.21.15.172:6836/493506747,v1:172.21.15.172:6837/493506747] conn(0x55d217ded490 0x55d217dee900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:37:13.241 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:37:13.237+0000 7f4dc7e00640 1 --2- 172.21.15.39:0/3806043467 >> [v2:172.21.15.172:6836/493506747,v1:172.21.15.172:6837/493506747] conn(0x55d217ded490 0x55d217dee900 crc :-1 s=READY pgs=16 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.2 client_cookie=8bd6dedc60299c39 server_cookie=3a434807454f67bb in_seq=0 out_seq=0 2024-09-12T02:37:13.241 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:37:13.237+0000 7f4db5600640 10 client.24989 ms_handle_connect on v2:172.21.15.172:6836/493506747 2024-09-12T02:37:13.241 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:37:13.238+0000 7f4db5600640 1 -- 172.21.15.39:0/3806043467 <== mds.2 v2:172.21.15.172:6836/493506747 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x55d217d3eb30 con 0x55d217ded490 2024-09-12T02:37:13.241 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:37:13.238+0000 7f4db5600640 10 client.24989 handle_command_reply: tid=0 2024-09-12T02:37:13.241 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:37:13.238+0000 7f4dd17d8740 1 client.24989 shutdown 2024-09-12T02:37:13.241 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:37:13.238+0000 7f4dd17d8740 1 -- 172.21.15.39:0/3806043467 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55d217dd1c50 msgr2=0x55d217dd9b40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:37:13.242 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:37:13.238+0000 7f4dd17d8740 1 --2- 172.21.15.39:0/3806043467 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55d217dd1c50 0x55d217dd9b40 secure :-1 s=READY pgs=107 cs=0 l=1 rev1=1 crypto rx=0x7f4db0005940 tx=0x7f4db00317e0 comp rx=0 tx=0).stop 2024-09-12T02:37:13.242 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:37:13.239+0000 7f4dd17d8740 1 -- 172.21.15.39:0/3806043467 shutdown_connections 2024-09-12T02:37:13.242 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:37:13.239+0000 7f4dd17d8740 1 --2- 172.21.15.39:0/3806043467 >> [v2:172.21.15.172:6836/493506747,v1:172.21.15.172:6837/493506747] conn(0x55d217ded490 0x55d217dee900 crc :-1 s=READY pgs=16 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:37:13.242 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:37:13.239+0000 7f4dd17d8740 1 --2- 172.21.15.39:0/3806043467 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55d217ddc510 0x55d217dda080 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:37:13.242 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:37:13.239+0000 7f4dd17d8740 1 --2- 172.21.15.39:0/3806043467 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55d217dd1c50 0x55d217dd9b40 unknown :-1 s=CLOSED pgs=107 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:37:13.242 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:37:13.239+0000 7f4dd17d8740 1 --2- 172.21.15.39:0/3806043467 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55d217dd1330 0x55d217dd9600 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:37:13.242 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:37:13.239+0000 7f4dd17d8740 1 -- 172.21.15.39:0/3806043467 >> 172.21.15.39:0/3806043467 conn(0x55d217dcd8c0 msgr2=0x55d217dd35a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:37:13.242 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:37:13.239+0000 7f4db5600640 0 client.24989 ms_handle_reset on v2:172.21.15.172:6836/493506747 2024-09-12T02:37:13.242 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:37:13.239+0000 7f4dd17d8740 1 -- 172.21.15.39:0/3806043467 shutdown_connections 2024-09-12T02:37:13.242 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:37:13.239+0000 7f4dd17d8740 1 -- 172.21.15.39:0/3806043467 wait complete. 2024-09-12T02:37:13.242 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:37:13.239+0000 7f4dd17d8740 20 client.24989 trim_cache size 0 max 16384 2024-09-12T02:37:13.259 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:37:13.258+0000 7f4dd17d8740 1 Processor -- start 2024-09-12T02:37:13.259 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:37:13.258+0000 7f4dd17d8740 1 -- start start 2024-09-12T02:37:13.259 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:37:13.258+0000 7f4dd17d8740 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55d217dd1330 0x55d217dedb60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:37:13.259 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:37:13.258+0000 7f4dd17d8740 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55d217dd1c50 0x55d217dd9ed0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:37:13.259 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:37:13.258+0000 7f4dd17d8740 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55d217ddc510 0x55d217dd3d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:37:13.259 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:37:13.258+0000 7f4dd17d8740 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 -- 0x55d217decc40 con 0x55d217ddc510 2024-09-12T02:37:13.259 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:37:13.258+0000 7f4dd17d8740 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x55d217ded310 con 0x55d217dd1c50 2024-09-12T02:37:13.259 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:37:13.258+0000 7f4dd17d8740 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x55d217ded9e0 con 0x55d217dd1330 2024-09-12T02:37:13.260 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:37:13.259+0000 7f4dc7e00640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55d217dd1330 0x55d217dedb60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:37:13.260 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:37:13.259+0000 7f4dccc00640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55d217ddc510 0x55d217dd3d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:37:13.260 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:37:13.259+0000 7f4dc7e00640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55d217dd1330 0x55d217dedb60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.172:3300/0 says I am v2:172.21.15.39:39364/0 (socket says 172.21.15.39:39364) 2024-09-12T02:37:13.260 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:37:13.259+0000 7f4dc7e00640 1 -- 172.21.15.39:0/1687756654 learned_addr learned my addr 172.21.15.39:0/1687756654 (peer_addr_for_me v2:172.21.15.39:0/0) 2024-09-12T02:37:13.260 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:37:13.259+0000 7f4dbf400640 1 --2- 172.21.15.39:0/1687756654 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55d217dd1c50 0x55d217dd9ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:37:13.261 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:37:13.259+0000 7f4dc7e00640 1 -- 172.21.15.39:0/1687756654 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55d217dd1c50 msgr2=0x55d217dd9ed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:37:13.261 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:37:13.259+0000 7f4dc7e00640 1 --2- 172.21.15.39:0/1687756654 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55d217dd1c50 0x55d217dd9ed0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:37:13.261 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:37:13.259+0000 7f4dc7e00640 1 -- 172.21.15.39:0/1687756654 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55d217ddc510 msgr2=0x55d217dd3d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:37:13.261 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:37:13.259+0000 7f4dc7e00640 1 --2- 172.21.15.39:0/1687756654 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55d217ddc510 0x55d217dd3d90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:37:13.261 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:37:13.259+0000 7f4dc7e00640 1 -- 172.21.15.39:0/1687756654 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55d217deec30 con 0x55d217dd1330 2024-09-12T02:37:13.261 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:37:13.259+0000 7f4dc7e00640 1 --2- 172.21.15.39:0/1687756654 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55d217dd1330 0x55d217dedb60 secure :-1 s=READY pgs=102 cs=0 l=1 rev1=1 crypto rx=0x7f4db809bb70 tx=0x7f4db8009200 comp rx=0 tx=0).ready entity=mon.1 client_cookie=4a5599524a349a8c server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:37:13.261 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:37:13.259+0000 7f4db7e00640 1 -- 172.21.15.39:0/1687756654 <== mon.1 v2:172.21.15.172:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4db80b8020 con 0x55d217dd1330 2024-09-12T02:37:13.261 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:37:13.260+0000 7f4db7e00640 1 -- 172.21.15.39:0/1687756654 <== mon.1 v2:172.21.15.172:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f4db809c570 con 0x55d217dd1330 2024-09-12T02:37:13.261 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:37:13.260+0000 7f4db7e00640 1 -- 172.21.15.39:0/1687756654 <== mon.1 v2:172.21.15.172:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4db809b9b0 con 0x55d217dd1330 2024-09-12T02:37:13.263 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:37:13.260+0000 7f4dd17d8740 1 -- 172.21.15.39:0/1687756654 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55d217dd1330 msgr2=0x55d217dedb60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:37:13.263 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:37:13.260+0000 7f4dd17d8740 1 --2- 172.21.15.39:0/1687756654 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55d217dd1330 0x55d217dedb60 secure :-1 s=READY pgs=102 cs=0 l=1 rev1=1 crypto rx=0x7f4db809bb70 tx=0x7f4db8009200 comp rx=0 tx=0).stop 2024-09-12T02:37:13.263 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:37:13.260+0000 7f4dd17d8740 1 -- 172.21.15.39:0/1687756654 shutdown_connections 2024-09-12T02:37:13.263 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:37:13.260+0000 7f4dd17d8740 1 --2- 172.21.15.39:0/1687756654 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55d217ddc510 0x55d217dd3d90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:37:13.263 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:37:13.260+0000 7f4dd17d8740 1 --2- 172.21.15.39:0/1687756654 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55d217dd1c50 0x55d217dd9ed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:37:13.263 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:37:13.260+0000 7f4dd17d8740 1 --2- 172.21.15.39:0/1687756654 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55d217dd1330 0x55d217dedb60 unknown :-1 s=CLOSED pgs=102 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:37:13.263 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:37:13.260+0000 7f4dd17d8740 1 -- 172.21.15.39:0/1687756654 >> 172.21.15.39:0/1687756654 conn(0x55d217dcd8c0 msgr2=0x55d217ddae60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:37:13.263 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:37:13.260+0000 7f4dd17d8740 1 -- 172.21.15.39:0/1687756654 shutdown_connections 2024-09-12T02:37:13.263 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:37:13.261+0000 7f4dd17d8740 1 -- 172.21.15.39:0/1687756654 wait complete. 2024-09-12T02:37:13.264 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:37:13.261+0000 7f4dd17d8740 1 -- start start 2024-09-12T02:37:13.264 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:37:13.261+0000 7f4dd17d8740 1 Processor -- start 2024-09-12T02:37:13.264 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:37:13.262+0000 7f4dd17d8740 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55d217dd1330 0x55d217df6ed0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:37:13.264 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:37:13.262+0000 7f4dd17d8740 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55d217dd1c50 0x55d217df7410 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:37:13.264 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:37:13.262+0000 7f4dd17d8740 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55d217ddc510 0x55d217dd6000 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:37:13.264 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:37:13.262+0000 7f4dd17d8740 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 -- 0x55d217dee780 con 0x55d217dd1330 2024-09-12T02:37:13.264 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:37:13.262+0000 7f4dd17d8740 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x55d217dee0b0 con 0x55d217ddc510 2024-09-12T02:37:13.264 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:37:13.262+0000 7f4dd17d8740 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x55d217deee50 con 0x55d217dd1c50 2024-09-12T02:37:13.264 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:37:13.262+0000 7f4dd17d8740 10 client.0 _ll_register_callbacks cb 0x7f4db0005d50 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-12T02:37:13.264 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:37:13.262+0000 7f4dc7e00640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55d217dd1330 0x55d217df6ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:37:13.264 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:37:13.262+0000 7f4dc7e00640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55d217dd1330 0x55d217df6ed0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.39:3300/0 says I am v2:172.21.15.39:48852/0 (socket says 172.21.15.39:48852) 2024-09-12T02:37:13.264 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:37:13.262+0000 7f4dbf400640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55d217dd1c50 0x55d217df7410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:37:13.264 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:37:13.262+0000 7f4dc7e00640 1 -- 172.21.15.39:0/950946793 learned_addr learned my addr 172.21.15.39:0/950946793 (peer_addr_for_me v2:172.21.15.39:0/0) 2024-09-12T02:37:13.265 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:37:13.262+0000 7f4dccc00640 1 --2- 172.21.15.39:0/950946793 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55d217ddc510 0x55d217dd6000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:37:13.265 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:37:13.262+0000 7f4dbf400640 1 -- 172.21.15.39:0/950946793 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55d217ddc510 msgr2=0x55d217dd6000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:37:13.265 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:37:13.262+0000 7f4dbf400640 1 --2- 172.21.15.39:0/950946793 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55d217ddc510 0x55d217dd6000 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:37:13.265 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:37:13.262+0000 7f4dbf400640 1 -- 172.21.15.39:0/950946793 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55d217dd1330 msgr2=0x55d217df6ed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:37:13.265 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:37:13.262+0000 7f4dbf400640 1 --2- 172.21.15.39:0/950946793 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55d217dd1330 0x55d217df6ed0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:37:13.265 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:37:13.262+0000 7f4dbf400640 1 -- 172.21.15.39:0/950946793 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55d217dd6800 con 0x55d217dd1c50 2024-09-12T02:37:13.267 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:37:13.263+0000 7f4dbf400640 1 --2- 172.21.15.39:0/950946793 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55d217dd1c50 0x55d217df7410 secure :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0x7f4db002a930 tx=0x7f4db0003820 comp rx=0 tx=0).ready entity=mon.1 client_cookie=65e0234924da3ed8 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:37:13.267 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:37:13.263+0000 7f4db5600640 10 client.0 ms_handle_connect on v2:172.21.15.172:3300/0 2024-09-12T02:37:13.267 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:37:13.263+0000 7f4db5600640 1 -- 172.21.15.39:0/950946793 <== mon.1 v2:172.21.15.172:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4db0035050 con 0x55d217dd1c50 2024-09-12T02:37:13.267 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:37:13.263+0000 7f4dd17d8740 1 -- 172.21.15.39:0/950946793 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f4db809c570 con 0x55d217dd1c50 2024-09-12T02:37:13.268 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:37:13.263+0000 7f4db5600640 1 -- 172.21.15.39:0/950946793 <== mon.1 v2:172.21.15.172:3300/0 2 ==== osd_map(95..95 src has 1..95) ==== 9129+0+0 (secure 0 0 0) 0x7f4db0004910 con 0x55d217dd1c50 2024-09-12T02:37:13.268 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:37:13.263+0000 7f4db5600640 1 -- 172.21.15.39:0/950946793 <== mon.1 v2:172.21.15.172:3300/0 3 ==== mon_get_version_reply(handle=1 version=28) ==== 24+0+0 (secure 0 0 0) 0x7f4db0009520 con 0x55d217dd1c50 2024-09-12T02:37:13.268 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:37:13.263+0000 7f4dd17d8740 10 client.25006 fetch_fsmap learned FSMap version 28 2024-09-12T02:37:13.268 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:37:13.263+0000 7f4dd17d8740 1 -- 172.21.15.39:0/950946793 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({config=0+,fsmap=28,monmap=4+}) -- 0x55d217df67f0 con 0x55d217dd1c50 2024-09-12T02:37:13.268 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:37:13.263+0000 7f4db5600640 1 -- 172.21.15.39:0/950946793 <== mon.1 v2:172.21.15.172:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f4db809c570 con 0x55d217dd1c50 2024-09-12T02:37:13.268 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:37:13.264+0000 7f4db5600640 1 -- 172.21.15.39:0/950946793 <== mon.1 v2:172.21.15.172:3300/0 5 ==== fsmap(e 28) ==== 8370+0+0 (secure 0 0 0) 0x7f4db00465a0 con 0x55d217dd1c50 2024-09-12T02:37:13.268 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:37:13.264+0000 7f4dd17d8740 10 client.25006 fetch_fsmap finished waiting for FSMap version 28 2024-09-12T02:37:13.268 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:37:13.264+0000 7f4dd17d8740 10 client.25006 resolve_mds: resolved name 'c' to daemon mds.c 2024-09-12T02:37:13.268 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:37:13.264+0000 7f4dd17d8740 20 client.25006 populate_metadata read hostname 'smithi039' 2024-09-12T02:37:13.268 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:37:13.264+0000 7f4dd17d8740 1 --2- 172.21.15.39:0/950946793 >> [v2:172.21.15.172:6836/493506747,v1:172.21.15.172:6837/493506747] conn(0x55d217e5c2a0 0x55d217e5afb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:37:13.268 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:37:13.264+0000 7f4dd17d8740 4 client.25006 mds_command: new command op to 24484 tid=0 multi_id=0 [{"prefix": "status"}] 2024-09-12T02:37:13.268 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:37:13.264+0000 7f4dd17d8740 1 -- 172.21.15.39:0/950946793 --> [v2:172.21.15.172:6836/493506747,v1:172.21.15.172:6837/493506747] -- command(tid 0: {"prefix": "status"}) -- 0x55d217dce470 con 0x55d217e5c2a0 2024-09-12T02:37:13.268 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:37:13.264+0000 7f4dc7e00640 1 --2- 172.21.15.39:0/950946793 >> [v2:172.21.15.172:6836/493506747,v1:172.21.15.172:6837/493506747] conn(0x55d217e5c2a0 0x55d217e5afb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:37:13.269 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:37:13.264+0000 7f4dc7e00640 1 --2- 172.21.15.39:0/950946793 >> [v2:172.21.15.172:6836/493506747,v1:172.21.15.172:6837/493506747] conn(0x55d217e5c2a0 0x55d217e5afb0 crc :-1 s=READY pgs=17 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.2 client_cookie=fb0063b1c124fcc server_cookie=b1875614122de112 in_seq=0 out_seq=0 2024-09-12T02:37:13.269 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:37:13.264+0000 7f4db5600640 10 client.25006 ms_handle_connect on v2:172.21.15.172:6836/493506747 2024-09-12T02:37:13.269 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:37:13.265+0000 7f4db5600640 1 -- 172.21.15.39:0/950946793 <== mds.2 v2:172.21.15.172:6836/493506747 1 ==== command_reply(tid 0: 0 ) ==== 8+0+327 (crc 0 0 0) 0x55d217dce470 con 0x55d217e5c2a0 2024-09-12T02:37:13.269 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:37:13.265+0000 7f4db5600640 10 client.25006 handle_command_reply: tid=0 2024-09-12T02:37:13.269 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:37:13.265+0000 7f4dd17d8740 1 client.25006 shutdown 2024-09-12T02:37:13.269 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:37:13.265+0000 7f4dd17d8740 1 -- 172.21.15.39:0/950946793 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55d217dd1c50 msgr2=0x55d217df7410 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:37:13.269 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:37:13.265+0000 7f4dd17d8740 1 --2- 172.21.15.39:0/950946793 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55d217dd1c50 0x55d217df7410 secure :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0x7f4db002a930 tx=0x7f4db0003820 comp rx=0 tx=0).stop 2024-09-12T02:37:13.269 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:37:13.265+0000 7f4dd17d8740 1 -- 172.21.15.39:0/950946793 shutdown_connections 2024-09-12T02:37:13.269 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:37:13.265+0000 7f4dd17d8740 1 --2- 172.21.15.39:0/950946793 >> [v2:172.21.15.172:6836/493506747,v1:172.21.15.172:6837/493506747] conn(0x55d217e5c2a0 0x55d217e5afb0 crc :-1 s=READY pgs=17 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:37:13.269 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:37:13.265+0000 7f4dd17d8740 1 --2- 172.21.15.39:0/950946793 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55d217ddc510 0x55d217dd6000 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:37:13.269 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:37:13.265+0000 7f4dd17d8740 1 --2- 172.21.15.39:0/950946793 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55d217dd1c50 0x55d217df7410 unknown :-1 s=CLOSED pgs=103 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:37:13.269 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:37:13.265+0000 7f4dd17d8740 1 --2- 172.21.15.39:0/950946793 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55d217dd1330 0x55d217df6ed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:37:13.269 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:37:13.265+0000 7f4db5600640 0 client.25006 ms_handle_reset on v2:172.21.15.172:6836/493506747 2024-09-12T02:37:13.269 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:37:13.265+0000 7f4dd17d8740 1 -- 172.21.15.39:0/950946793 >> 172.21.15.39:0/950946793 conn(0x55d217dcd8c0 msgr2=0x55d217de7c50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:37:13.270 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:37:13.265+0000 7f4dd17d8740 1 -- 172.21.15.39:0/950946793 shutdown_connections 2024-09-12T02:37:13.270 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:37:13.265+0000 7f4dd17d8740 1 -- 172.21.15.39:0/950946793 wait complete. 2024-09-12T02:37:13.270 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:37:13.265+0000 7f4dd17d8740 20 client.25006 trim_cache size 0 max 16384 2024-09-12T02:37:13.270 INFO:teuthology.orchestra.run.smithi039.stdout:{ 2024-09-12T02:37:13.270 INFO:teuthology.orchestra.run.smithi039.stdout: "cluster_fsid": "4954ed46-70ae-11ef-bcea-c7b262605968", 2024-09-12T02:37:13.270 INFO:teuthology.orchestra.run.smithi039.stdout: "whoami": 2, 2024-09-12T02:37:13.270 INFO:teuthology.orchestra.run.smithi039.stdout: "id": 24484, 2024-09-12T02:37:13.270 INFO:teuthology.orchestra.run.smithi039.stdout: "want_state": "up:active", 2024-09-12T02:37:13.270 INFO:teuthology.orchestra.run.smithi039.stdout: "state": "up:active", 2024-09-12T02:37:13.270 INFO:teuthology.orchestra.run.smithi039.stdout: "fs_name": "cephfs", 2024-09-12T02:37:13.271 INFO:teuthology.orchestra.run.smithi039.stdout: "rank_uptime": 83.504858186000007, 2024-09-12T02:37:13.271 INFO:teuthology.orchestra.run.smithi039.stdout: "mdsmap_epoch": 28, 2024-09-12T02:37:13.271 INFO:teuthology.orchestra.run.smithi039.stdout: "osdmap_epoch": 95, 2024-09-12T02:37:13.271 INFO:teuthology.orchestra.run.smithi039.stdout: "osdmap_epoch_barrier": 93, 2024-09-12T02:37:13.271 INFO:teuthology.orchestra.run.smithi039.stdout: "uptime": 156.791313124 2024-09-12T02:37:13.271 INFO:teuthology.orchestra.run.smithi039.stdout:} 2024-09-12T02:37:13.272 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:37:13.266+0000 7f4dcec00640 1 -- 172.21.15.39:0/1819560535 >> [v2:172.21.15.39:6800/1725006999,v1:172.21.15.39:6801/1725006999] conn(0x7f4dac0a2c90 msgr2=0x7f4dac0a5150 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:37:13.272 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:37:13.266+0000 7f4dcec00640 1 --2- 172.21.15.39:0/1819560535 >> [v2:172.21.15.39:6800/1725006999,v1:172.21.15.39:6801/1725006999] conn(0x7f4dac0a2c90 0x7f4dac0a5150 secure :-1 s=READY pgs=212 cs=0 l=1 rev1=1 crypto rx=0x7f4dc0009e60 tx=0x7f4dc0005f90 comp rx=0 tx=0).stop 2024-09-12T02:37:13.272 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:37:13.266+0000 7f4dcec00640 1 -- 172.21.15.39:0/1819560535 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f4dc8103ff0 msgr2=0x7f4dc819a620 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:37:13.272 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:37:13.266+0000 7f4dcec00640 1 --2- 172.21.15.39:0/1819560535 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f4dc8103ff0 0x7f4dc819a620 secure :-1 s=READY pgs=238 cs=0 l=1 rev1=1 crypto rx=0x7f4db800eb90 tx=0x7f4db800c6a0 comp rx=0 tx=0).stop 2024-09-12T02:37:13.272 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:37:13.266+0000 7f4dcec00640 1 -- 172.21.15.39:0/1819560535 shutdown_connections 2024-09-12T02:37:13.272 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:37:13.266+0000 7f4dcec00640 1 --2- 172.21.15.39:0/1819560535 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f4dc8109120 0x7f4dc819eef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:37:13.272 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:37:13.266+0000 7f4dcec00640 1 --2- 172.21.15.39:0/1819560535 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f4dc81049a0 0x7f4dc819ab60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:37:13.272 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:37:13.266+0000 7f4dcec00640 1 --2- 172.21.15.39:0/1819560535 >> [v2:172.21.15.39:6800/1725006999,v1:172.21.15.39:6801/1725006999] conn(0x7f4dac0a2c90 0x7f4dac0a5150 unknown :-1 s=CLOSED pgs=212 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:37:13.272 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:37:13.266+0000 7f4dcec00640 1 --2- 172.21.15.39:0/1819560535 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f4dc8103ff0 0x7f4dc819a620 unknown :-1 s=CLOSED pgs=238 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:37:13.273 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:37:13.266+0000 7f4dcec00640 1 -- 172.21.15.39:0/1819560535 >> 172.21.15.39:0/1819560535 conn(0x7f4dc80ffa90 msgr2=0x7f4dc8100d50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:37:13.273 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:37:13.266+0000 7f4dcec00640 1 -- 172.21.15.39:0/1819560535 shutdown_connections 2024-09-12T02:37:13.273 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:37:13.266+0000 7f4dcec00640 1 -- 172.21.15.39:0/1819560535 wait complete. 2024-09-12T02:37:14.034 DEBUG:teuthology.orchestra.run.smithi039:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc shell --fsid 4954ed46-70ae-11ef-bcea-c7b262605968 -- ceph tell mds.i status 2024-09-12T02:37:14.411 INFO:teuthology.orchestra.run.smithi039.stderr:Inferring config /var/lib/ceph/4954ed46-70ae-11ef-bcea-c7b262605968/mon.a/config 2024-09-12T02:37:14.726 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 02:37:14 smithi039 ceph-mon[30515]: pgmap v369: 129 pgs: 129 active+clean; 645 KiB data, 348 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2024-09-12T02:37:14.763 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 12 02:37:14 smithi172 ceph-mon[35609]: pgmap v369: 129 pgs: 129 active+clean; 645 KiB data, 348 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2024-09-12T02:37:14.948 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 12 02:37:14 smithi044 ceph-mon[35411]: pgmap v369: 129 pgs: 129 active+clean; 645 KiB data, 348 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2024-09-12T02:37:14.984 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:37:14.983+0000 7f3ea8e00640 1 -- 172.21.15.39:0/633518105 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f3ea4103e30 msgr2=0x7f3ea4104210 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:37:14.984 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:37:14.983+0000 7f3ea8e00640 1 --2- 172.21.15.39:0/633518105 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f3ea4103e30 0x7f3ea4104210 secure :-1 s=READY pgs=239 cs=0 l=1 rev1=1 crypto rx=0x7f3e94009860 tx=0x7f3e9402a340 comp rx=0 tx=0).stop 2024-09-12T02:37:14.985 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:37:14.983+0000 7f3ea8e00640 1 -- 172.21.15.39:0/633518105 shutdown_connections 2024-09-12T02:37:14.985 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:37:14.983+0000 7f3ea8e00640 1 --2- 172.21.15.39:0/633518105 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f3ea4108f60 0x7f3ea4110ae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:37:14.985 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:37:14.983+0000 7f3ea8e00640 1 --2- 172.21.15.39:0/633518105 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f3ea41047e0 0x7f3ea4108830 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:37:14.985 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:37:14.983+0000 7f3ea8e00640 1 --2- 172.21.15.39:0/633518105 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f3ea4103e30 0x7f3ea4104210 unknown :-1 s=CLOSED pgs=239 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:37:14.985 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:37:14.983+0000 7f3ea8e00640 1 -- 172.21.15.39:0/633518105 >> 172.21.15.39:0/633518105 conn(0x7f3ea40ff8d0 msgr2=0x7f3ea4101cf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:37:14.985 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:37:14.983+0000 7f3ea8e00640 1 -- 172.21.15.39:0/633518105 shutdown_connections 2024-09-12T02:37:14.985 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:37:14.984+0000 7f3ea8e00640 1 -- 172.21.15.39:0/633518105 wait complete. 2024-09-12T02:37:14.986 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:37:14.984+0000 7f3ea8e00640 1 Processor -- start 2024-09-12T02:37:14.987 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:37:14.985+0000 7f3ea8e00640 1 -- start start 2024-09-12T02:37:14.987 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:37:14.985+0000 7f3ea8e00640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f3ea4103e30 0x7f3ea419a480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:37:14.987 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:37:14.985+0000 7f3ea8e00640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f3ea41047e0 0x7f3ea419a9c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:37:14.987 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:37:14.985+0000 7f3ea8e00640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f3ea4108f60 0x7f3ea419ed50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:37:14.987 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:37:14.985+0000 7f3ea8e00640 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 -- 0x7f3ea4113fc0 con 0x7f3ea4108f60 2024-09-12T02:37:14.987 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:37:14.985+0000 7f3ea8e00640 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x7f3ea4113e40 con 0x7f3ea4103e30 2024-09-12T02:37:14.987 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:37:14.985+0000 7f3ea8e00640 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7f3ea4114140 con 0x7f3ea41047e0 2024-09-12T02:37:14.987 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:37:14.985+0000 7f3ea3400640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f3ea4103e30 0x7f3ea419a480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:37:14.987 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:37:14.985+0000 7f3ea3400640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f3ea4103e30 0x7f3ea419a480 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.39:56380/0 (socket says 172.21.15.39:56380) 2024-09-12T02:37:14.987 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:37:14.985+0000 7f3ea3400640 1 -- 172.21.15.39:0/2864101623 learned_addr learned my addr 172.21.15.39:0/2864101623 (peer_addr_for_me v2:172.21.15.39:0/0) 2024-09-12T02:37:14.987 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:37:14.985+0000 7f3ea3e00640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f3ea4108f60 0x7f3ea419ed50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:37:14.987 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:37:14.986+0000 7f3ea2a00640 1 --2- 172.21.15.39:0/2864101623 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f3ea41047e0 0x7f3ea419a9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:37:14.987 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:37:14.986+0000 7f3ea3400640 1 -- 172.21.15.39:0/2864101623 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f3ea41047e0 msgr2=0x7f3ea419a9c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:37:14.988 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:37:14.986+0000 7f3ea3400640 1 --2- 172.21.15.39:0/2864101623 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f3ea41047e0 0x7f3ea419a9c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:37:14.988 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:37:14.986+0000 7f3ea3400640 1 -- 172.21.15.39:0/2864101623 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f3ea4108f60 msgr2=0x7f3ea419ed50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:37:14.988 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:37:14.986+0000 7f3ea3400640 1 --2- 172.21.15.39:0/2864101623 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f3ea4108f60 0x7f3ea419ed50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:37:14.988 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:37:14.986+0000 7f3ea3400640 1 -- 172.21.15.39:0/2864101623 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3ea419f430 con 0x7f3ea4103e30 2024-09-12T02:37:14.988 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:37:14.986+0000 7f3ea3400640 1 --2- 172.21.15.39:0/2864101623 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f3ea4103e30 0x7f3ea419a480 secure :-1 s=READY pgs=108 cs=0 l=1 rev1=1 crypto rx=0x7f3e94035040 tx=0x7f3e94033d90 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:37:14.988 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:37:14.986+0000 7f3e9be00640 1 -- 172.21.15.39:0/2864101623 <== mon.2 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3e94037040 con 0x7f3ea4103e30 2024-09-12T02:37:14.989 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:37:14.986+0000 7f3ea8e00640 1 -- 172.21.15.39:0/2864101623 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f3ea419f6c0 con 0x7f3ea4103e30 2024-09-12T02:37:14.989 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:37:14.986+0000 7f3e9be00640 1 -- 172.21.15.39:0/2864101623 <== mon.2 v2:172.21.15.44:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f3e94040070 con 0x7f3ea4103e30 2024-09-12T02:37:14.989 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:37:14.986+0000 7f3e9be00640 1 -- 172.21.15.39:0/2864101623 <== mon.2 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3e940039f0 con 0x7f3ea4103e30 2024-09-12T02:37:14.989 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:37:14.987+0000 7f3ea8e00640 1 -- 172.21.15.39:0/2864101623 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f3ea41a7000 con 0x7f3ea4103e30 2024-09-12T02:37:14.990 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:37:14.990+0000 7f3eacffb740 1 Processor -- start 2024-09-12T02:37:14.990 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:37:14.990+0000 7f3e9be00640 1 -- 172.21.15.39:0/2864101623 <== mon.2 v2:172.21.15.44:3300/0 4 ==== mgrmap(e 17) ==== 137884+0+0 (secure 0 0 0) 0x7f3e94003b90 con 0x7f3ea4103e30 2024-09-12T02:37:14.991 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:37:14.990+0000 7f3eacffb740 1 -- start start 2024-09-12T02:37:14.992 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:37:14.990+0000 7f3eacffb740 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55dfd84694e0 0x55dfd84698c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:37:14.992 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:37:14.990+0000 7f3eacffb740 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55dfd8469e00 0x55dfd8474180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:37:14.992 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:37:14.990+0000 7f3eacffb740 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55dfd84746c0 0x55dfd8476ab0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:37:14.992 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:37:14.990+0000 7f3eacffb740 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 -- 0x55dfd83cf0b0 con 0x55dfd84746c0 2024-09-12T02:37:14.992 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:37:14.990+0000 7f3eacffb740 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x55dfd8376ab0 con 0x55dfd8469e00 2024-09-12T02:37:14.992 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:37:14.990+0000 7f3eacffb740 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x55dfd83cb070 con 0x55dfd84694e0 2024-09-12T02:37:14.992 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:37:14.990+0000 7f3ea2a00640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55dfd84746c0 0x55dfd8476ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:37:14.992 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:37:14.990+0000 7f3ea2a00640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55dfd84746c0 0x55dfd8476ab0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.39:3300/0 says I am v2:172.21.15.39:48882/0 (socket says 172.21.15.39:48882) 2024-09-12T02:37:14.992 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:37:14.990+0000 7f3ea2a00640 1 -- 172.21.15.39:0/269102791 learned_addr learned my addr 172.21.15.39:0/269102791 (peer_addr_for_me v2:172.21.15.39:0/0) 2024-09-12T02:37:14.992 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:37:14.990+0000 7f3ea3e00640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55dfd84694e0 0x55dfd84698c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:37:14.992 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:37:14.991+0000 7f3ea3400640 1 --2- 172.21.15.39:0/269102791 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55dfd8469e00 0x55dfd8474180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:37:14.992 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:37:14.991+0000 7f3ea3e00640 1 -- 172.21.15.39:0/269102791 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55dfd8469e00 msgr2=0x55dfd8474180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:37:14.993 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:37:14.991+0000 7f3ea3e00640 1 --2- 172.21.15.39:0/269102791 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55dfd8469e00 0x55dfd8474180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:37:14.993 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:37:14.991+0000 7f3ea3e00640 1 -- 172.21.15.39:0/269102791 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55dfd84746c0 msgr2=0x55dfd8476ab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:37:14.993 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:37:14.991+0000 7f3ea3e00640 1 --2- 172.21.15.39:0/269102791 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55dfd84746c0 0x55dfd8476ab0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:37:14.993 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:37:14.991+0000 7f3ea3e00640 1 -- 172.21.15.39:0/269102791 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55dfd83834a0 con 0x55dfd84694e0 2024-09-12T02:37:14.994 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:37:14.992+0000 7f3ea3e00640 1 --2- 172.21.15.39:0/269102791 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55dfd84694e0 0x55dfd84698c0 secure :-1 s=READY pgs=104 cs=0 l=1 rev1=1 crypto rx=0x7f3e9c009eb0 tx=0x7f3e9c0107a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=565eff1013fc49d1 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:37:14.994 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:37:14.992+0000 7f3e9be00640 1 --2- 172.21.15.39:0/2864101623 >> [v2:172.21.15.39:6800/1725006999,v1:172.21.15.39:6801/1725006999] conn(0x7f3e880a2c10 0x7f3e880a50d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:37:14.994 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:37:14.992+0000 7f3e9be00640 1 -- 172.21.15.39:0/2864101623 <== mon.2 v2:172.21.15.44:3300/0 5 ==== osd_map(95..95 src has 1..95) ==== 9129+0+0 (secure 0 0 0) 0x7f3e940ef480 con 0x7f3ea4103e30 2024-09-12T02:37:14.994 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:37:14.992+0000 7f3e98c00640 1 -- 172.21.15.39:0/269102791 <== mon.1 v2:172.21.15.172:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3e9c003b70 con 0x55dfd84694e0 2024-09-12T02:37:14.994 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:37:14.992+0000 7f3ea3400640 1 --2- 172.21.15.39:0/2864101623 >> [v2:172.21.15.39:6800/1725006999,v1:172.21.15.39:6801/1725006999] conn(0x7f3e880a2c10 0x7f3e880a50d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:37:14.994 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:37:14.992+0000 7f3e98c00640 1 -- 172.21.15.39:0/269102791 <== mon.1 v2:172.21.15.172:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f3e9c015070 con 0x55dfd84694e0 2024-09-12T02:37:14.994 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:37:14.992+0000 7f3e98c00640 1 -- 172.21.15.39:0/269102791 <== mon.1 v2:172.21.15.172:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3e9c01a830 con 0x55dfd84694e0 2024-09-12T02:37:14.994 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:37:14.993+0000 7f3eacffb740 1 -- 172.21.15.39:0/269102791 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55dfd84694e0 msgr2=0x55dfd84698c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:37:14.995 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:37:14.993+0000 7f3ea3400640 1 --2- 172.21.15.39:0/2864101623 >> [v2:172.21.15.39:6800/1725006999,v1:172.21.15.39:6801/1725006999] conn(0x7f3e880a2c10 0x7f3e880a50d0 secure :-1 s=READY pgs=213 cs=0 l=1 rev1=1 crypto rx=0x55dfd84668d0 tx=0x7f3e9402a340 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:37:14.995 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:37:14.993+0000 7f3eacffb740 1 --2- 172.21.15.39:0/269102791 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55dfd84694e0 0x55dfd84698c0 secure :-1 s=READY pgs=104 cs=0 l=1 rev1=1 crypto rx=0x7f3e9c009eb0 tx=0x7f3e9c0107a0 comp rx=0 tx=0).stop 2024-09-12T02:37:14.995 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:37:14.993+0000 7f3eacffb740 1 -- 172.21.15.39:0/269102791 shutdown_connections 2024-09-12T02:37:14.995 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:37:14.993+0000 7f3eacffb740 1 --2- 172.21.15.39:0/269102791 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55dfd84746c0 0x55dfd8476ab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:37:14.995 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:37:14.993+0000 7f3eacffb740 1 --2- 172.21.15.39:0/269102791 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55dfd8469e00 0x55dfd8474180 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:37:14.995 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:37:14.993+0000 7f3eacffb740 1 --2- 172.21.15.39:0/269102791 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55dfd84694e0 0x55dfd84698c0 unknown :-1 s=CLOSED pgs=104 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:37:14.995 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:37:14.993+0000 7f3eacffb740 1 -- 172.21.15.39:0/269102791 >> 172.21.15.39:0/269102791 conn(0x55dfd8465a70 msgr2=0x55dfd8465e50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:37:14.995 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:37:14.993+0000 7f3eacffb740 1 -- 172.21.15.39:0/269102791 shutdown_connections 2024-09-12T02:37:14.995 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:37:14.993+0000 7f3eacffb740 1 -- 172.21.15.39:0/269102791 wait complete. 2024-09-12T02:37:14.995 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:37:14.993+0000 7f3eacffb740 1 -- start start 2024-09-12T02:37:14.995 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:37:14.994+0000 7f3eacffb740 1 Processor -- start 2024-09-12T02:37:14.997 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:37:14.994+0000 7f3eacffb740 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55dfd84694e0 0x55dfd8471600 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:37:14.997 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:37:14.994+0000 7f3eacffb740 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55dfd8469e00 0x55dfd8471b40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:37:14.998 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:37:14.994+0000 7f3eacffb740 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55dfd84746c0 0x55dfd8472080 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:37:14.998 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:37:14.994+0000 7f3eacffb740 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 -- 0x55dfd8477330 con 0x55dfd84746c0 2024-09-12T02:37:14.998 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:37:14.994+0000 7f3eacffb740 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x55dfd8357920 con 0x55dfd84694e0 2024-09-12T02:37:14.998 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:37:14.994+0000 7f3eacffb740 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x55dfd84774b0 con 0x55dfd8469e00 2024-09-12T02:37:14.998 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:37:14.994+0000 7f3eacffb740 10 client.0 _ll_register_callbacks cb 0x55dfd837b8a0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-12T02:37:14.998 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:37:14.994+0000 7f3ea3e00640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55dfd84694e0 0x55dfd8471600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:37:14.998 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:37:14.994+0000 7f3ea3e00640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55dfd84694e0 0x55dfd8471600 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.39:56394/0 (socket says 172.21.15.39:56394) 2024-09-12T02:37:14.998 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:37:14.994+0000 7f3ea3e00640 1 -- 172.21.15.39:0/1258268758 learned_addr learned my addr 172.21.15.39:0/1258268758 (peer_addr_for_me v2:172.21.15.39:0/0) 2024-09-12T02:37:14.998 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:37:14.994+0000 7f3ea3e00640 1 --2- 172.21.15.39:0/1258268758 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55dfd84746c0 0x55dfd8472080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:37:14.998 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:37:14.994+0000 7f3ea2a00640 1 --2- 172.21.15.39:0/1258268758 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55dfd8469e00 0x55dfd8471b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:37:14.998 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:37:14.995+0000 7f3ea3e00640 1 -- 172.21.15.39:0/1258268758 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55dfd8469e00 msgr2=0x55dfd8471b40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:37:14.998 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:37:14.995+0000 7f3ea3e00640 1 --2- 172.21.15.39:0/1258268758 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55dfd8469e00 0x55dfd8471b40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:37:14.999 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:37:14.995+0000 7f3ea3e00640 1 -- 172.21.15.39:0/1258268758 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55dfd84746c0 msgr2=0x55dfd8472080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:37:14.999 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:37:14.995+0000 7f3ea3e00640 1 --2- 172.21.15.39:0/1258268758 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55dfd84746c0 0x55dfd8472080 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:37:14.999 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:37:14.995+0000 7f3ea3e00640 1 -- 172.21.15.39:0/1258268758 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55dfd81402b0 con 0x55dfd84694e0 2024-09-12T02:37:14.999 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:37:14.995+0000 7f3ea3e00640 1 --2- 172.21.15.39:0/1258268758 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55dfd84694e0 0x55dfd8471600 secure :-1 s=READY pgs=109 cs=0 l=1 rev1=1 crypto rx=0x7f3e9c004860 tx=0x7f3e9c004960 comp rx=0 tx=0).ready entity=mon.2 client_cookie=4f323a9a18831659 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:37:14.999 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:37:14.995+0000 7f3e8d600640 10 client.0 ms_handle_connect on v2:172.21.15.44:3300/0 2024-09-12T02:37:14.999 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:37:14.995+0000 7f3e8d600640 1 -- 172.21.15.39:0/1258268758 <== mon.2 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3e9c023040 con 0x55dfd84694e0 2024-09-12T02:37:14.999 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:37:14.996+0000 7f3eacffb740 1 -- 172.21.15.39:0/1258268758 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f3e9c015070 con 0x55dfd84694e0 2024-09-12T02:37:14.999 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:37:14.996+0000 7f3e8d600640 1 -- 172.21.15.39:0/1258268758 <== mon.2 v2:172.21.15.44:3300/0 2 ==== osd_map(95..95 src has 1..95) ==== 9129+0+0 (secure 0 0 0) 0x7f3e9c004c40 con 0x55dfd84694e0 2024-09-12T02:37:14.999 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:37:14.996+0000 7f3e8d600640 1 -- 172.21.15.39:0/1258268758 <== mon.2 v2:172.21.15.44:3300/0 3 ==== mon_get_version_reply(handle=1 version=28) ==== 24+0+0 (secure 0 0 0) 0x7f3e9c031050 con 0x55dfd84694e0 2024-09-12T02:37:14.999 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:37:14.996+0000 7f3eacffb740 10 client.25007 fetch_fsmap learned FSMap version 28 2024-09-12T02:37:14.999 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:37:14.996+0000 7f3eacffb740 1 -- 172.21.15.39:0/1258268758 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,fsmap=28,monmap=4+}) -- 0x55dfd8483030 con 0x55dfd84694e0 2024-09-12T02:37:14.999 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:37:14.996+0000 7f3e8d600640 1 -- 172.21.15.39:0/1258268758 <== mon.2 v2:172.21.15.44:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f3e9c015070 con 0x55dfd84694e0 2024-09-12T02:37:14.999 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:37:14.996+0000 7f3e8d600640 1 -- 172.21.15.39:0/1258268758 <== mon.2 v2:172.21.15.44:3300/0 5 ==== fsmap(e 28) ==== 8370+0+0 (secure 0 0 0) 0x7f3e9c011440 con 0x55dfd84694e0 2024-09-12T02:37:14.999 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:37:14.996+0000 7f3eacffb740 10 client.25007 fetch_fsmap finished waiting for FSMap version 28 2024-09-12T02:37:15.000 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:37:14.997+0000 7f3eacffb740 10 client.25007 resolve_mds: resolved name 'i' to daemon mds.i 2024-09-12T02:37:15.000 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:37:14.997+0000 7f3eacffb740 20 client.25007 populate_metadata read hostname 'smithi039' 2024-09-12T02:37:15.000 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:37:14.997+0000 7f3eacffb740 1 --2- 172.21.15.39:0/1258268758 >> [v2:172.21.15.172:6838/3742537097,v1:172.21.15.172:6839/3742537097] conn(0x55dfd84853f0 0x55dfd8486860 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:37:15.000 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:37:14.997+0000 7f3eacffb740 4 client.25007 mds_command: new command op to 24499 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-12T02:37:15.000 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:37:14.997+0000 7f3eacffb740 1 -- 172.21.15.39:0/1258268758 --> [v2:172.21.15.172:6838/3742537097,v1:172.21.15.172:6839/3742537097] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55dfd83dc620 con 0x55dfd84853f0 2024-09-12T02:37:15.000 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:37:14.997+0000 7f3ea2a00640 1 --2- 172.21.15.39:0/1258268758 >> [v2:172.21.15.172:6838/3742537097,v1:172.21.15.172:6839/3742537097] conn(0x55dfd84853f0 0x55dfd8486860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:37:15.001 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:37:14.998+0000 7f3ea2a00640 1 --2- 172.21.15.39:0/1258268758 >> [v2:172.21.15.172:6838/3742537097,v1:172.21.15.172:6839/3742537097] conn(0x55dfd84853f0 0x55dfd8486860 crc :-1 s=READY pgs=16 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=d97e2b896ec361d4 server_cookie=9410284c114ced63 in_seq=0 out_seq=0 2024-09-12T02:37:15.001 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:37:14.998+0000 7f3e8d600640 10 client.25007 ms_handle_connect on v2:172.21.15.172:6838/3742537097 2024-09-12T02:37:15.001 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:37:14.999+0000 7f3e8d600640 1 -- 172.21.15.39:0/1258268758 <== mds.1 v2:172.21.15.172:6838/3742537097 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x55dfd83dc620 con 0x55dfd84853f0 2024-09-12T02:37:15.001 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:37:14.999+0000 7f3e8d600640 10 client.25007 handle_command_reply: tid=0 2024-09-12T02:37:15.001 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:37:14.999+0000 7f3eacffb740 1 client.25007 shutdown 2024-09-12T02:37:15.001 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:37:14.999+0000 7f3eacffb740 1 -- 172.21.15.39:0/1258268758 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55dfd84694e0 msgr2=0x55dfd8471600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:37:15.002 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:37:14.999+0000 7f3eacffb740 1 --2- 172.21.15.39:0/1258268758 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55dfd84694e0 0x55dfd8471600 secure :-1 s=READY pgs=109 cs=0 l=1 rev1=1 crypto rx=0x7f3e9c004860 tx=0x7f3e9c004960 comp rx=0 tx=0).stop 2024-09-12T02:37:15.002 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:37:14.999+0000 7f3eacffb740 1 -- 172.21.15.39:0/1258268758 shutdown_connections 2024-09-12T02:37:15.002 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:37:14.999+0000 7f3eacffb740 1 --2- 172.21.15.39:0/1258268758 >> [v2:172.21.15.172:6838/3742537097,v1:172.21.15.172:6839/3742537097] conn(0x55dfd84853f0 0x55dfd8486860 crc :-1 s=READY pgs=16 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:37:15.002 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:37:14.999+0000 7f3eacffb740 1 --2- 172.21.15.39:0/1258268758 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55dfd84746c0 0x55dfd8472080 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:37:15.002 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:37:14.999+0000 7f3eacffb740 1 --2- 172.21.15.39:0/1258268758 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55dfd8469e00 0x55dfd8471b40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:37:15.002 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:37:14.999+0000 7f3e8d600640 0 client.25007 ms_handle_reset on v2:172.21.15.172:6838/3742537097 2024-09-12T02:37:15.002 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:37:14.999+0000 7f3eacffb740 1 --2- 172.21.15.39:0/1258268758 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55dfd84694e0 0x55dfd8471600 unknown :-1 s=CLOSED pgs=109 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:37:15.002 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:37:14.999+0000 7f3eacffb740 1 -- 172.21.15.39:0/1258268758 >> 172.21.15.39:0/1258268758 conn(0x55dfd8465a70 msgr2=0x55dfd846b750 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:37:15.002 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:37:14.999+0000 7f3eacffb740 1 -- 172.21.15.39:0/1258268758 shutdown_connections 2024-09-12T02:37:15.002 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:37:14.999+0000 7f3eacffb740 1 -- 172.21.15.39:0/1258268758 wait complete. 2024-09-12T02:37:15.002 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:37:14.999+0000 7f3eacffb740 20 client.25007 trim_cache size 0 max 16384 2024-09-12T02:37:15.019 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:37:15.018+0000 7f3eacffb740 1 Processor -- start 2024-09-12T02:37:15.019 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:37:15.018+0000 7f3eacffb740 1 -- start start 2024-09-12T02:37:15.019 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:37:15.019+0000 7f3eacffb740 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55dfd84694e0 0x55dfd846e860 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:37:15.020 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:37:15.019+0000 7f3eacffb740 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55dfd8469e00 0x55dfd846eda0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:37:15.020 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:37:15.019+0000 7f3eacffb740 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55dfd84746c0 0x55dfd8472e60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:37:15.020 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:37:15.019+0000 7f3eacffb740 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 -- 0x55dfd8484ba0 con 0x55dfd84694e0 2024-09-12T02:37:15.020 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:37:15.019+0000 7f3eacffb740 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x55dfd8485270 con 0x55dfd8469e00 2024-09-12T02:37:15.020 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:37:15.019+0000 7f3eacffb740 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x55dfd8485940 con 0x55dfd84746c0 2024-09-12T02:37:15.021 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:37:15.019+0000 7f3ea3e00640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55dfd84694e0 0x55dfd846e860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:37:15.022 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:37:15.019+0000 7f3ea3e00640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55dfd84694e0 0x55dfd846e860 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.39:3300/0 says I am v2:172.21.15.39:48896/0 (socket says 172.21.15.39:48896) 2024-09-12T02:37:15.022 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:37:15.019+0000 7f3ea3e00640 1 -- 172.21.15.39:0/3689505302 learned_addr learned my addr 172.21.15.39:0/3689505302 (peer_addr_for_me v2:172.21.15.39:0/0) 2024-09-12T02:37:15.022 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:37:15.019+0000 7f3ea2a00640 1 --2- 172.21.15.39:0/3689505302 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55dfd8469e00 0x55dfd846eda0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:37:15.022 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:37:15.019+0000 7f3ea3e00640 1 --2- 172.21.15.39:0/3689505302 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55dfd84746c0 0x55dfd8472e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:37:15.022 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:37:15.019+0000 7f3ea3e00640 1 -- 172.21.15.39:0/3689505302 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55dfd84746c0 msgr2=0x55dfd8472e60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:37:15.022 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:37:15.019+0000 7f3ea3e00640 1 --2- 172.21.15.39:0/3689505302 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55dfd84746c0 0x55dfd8472e60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:37:15.022 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:37:15.019+0000 7f3ea3e00640 1 -- 172.21.15.39:0/3689505302 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55dfd8469e00 msgr2=0x55dfd846eda0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:37:15.022 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:37:15.020+0000 7f3ea3e00640 1 --2- 172.21.15.39:0/3689505302 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55dfd8469e00 0x55dfd846eda0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:37:15.022 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:37:15.020+0000 7f3ea3e00640 1 -- 172.21.15.39:0/3689505302 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55dfd84658a0 con 0x55dfd84694e0 2024-09-12T02:37:15.022 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:37:15.020+0000 7f3ea2a00640 1 --2- 172.21.15.39:0/3689505302 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55dfd8469e00 0x55dfd846eda0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-12T02:37:15.022 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:37:15.020+0000 7f3ea3e00640 1 --2- 172.21.15.39:0/3689505302 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55dfd84694e0 0x55dfd846e860 secure :-1 s=READY pgs=240 cs=0 l=1 rev1=1 crypto rx=0x7f3e9c004890 tx=0x7f3e9c0021f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f4fc3e6664dc4a8f server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:37:15.022 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:37:15.020+0000 7f3e8fe00640 1 -- 172.21.15.39:0/3689505302 <== mon.0 v2:172.21.15.39:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3e9c011b80 con 0x55dfd84694e0 2024-09-12T02:37:15.023 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:37:15.020+0000 7f3e8fe00640 1 -- 172.21.15.39:0/3689505302 <== mon.0 v2:172.21.15.39:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f3e9c015040 con 0x55dfd84694e0 2024-09-12T02:37:15.023 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:37:15.020+0000 7f3e8fe00640 1 -- 172.21.15.39:0/3689505302 <== mon.0 v2:172.21.15.39:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3e9c004c30 con 0x55dfd84694e0 2024-09-12T02:37:15.023 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:37:15.021+0000 7f3eacffb740 1 -- 172.21.15.39:0/3689505302 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55dfd84694e0 msgr2=0x55dfd846e860 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:37:15.023 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:37:15.021+0000 7f3eacffb740 1 --2- 172.21.15.39:0/3689505302 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55dfd84694e0 0x55dfd846e860 secure :-1 s=READY pgs=240 cs=0 l=1 rev1=1 crypto rx=0x7f3e9c004890 tx=0x7f3e9c0021f0 comp rx=0 tx=0).stop 2024-09-12T02:37:15.023 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:37:15.021+0000 7f3eacffb740 1 -- 172.21.15.39:0/3689505302 shutdown_connections 2024-09-12T02:37:15.023 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:37:15.021+0000 7f3eacffb740 1 --2- 172.21.15.39:0/3689505302 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55dfd84746c0 0x55dfd8472e60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:37:15.023 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:37:15.021+0000 7f3eacffb740 1 --2- 172.21.15.39:0/3689505302 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55dfd8469e00 0x55dfd846eda0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:37:15.023 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:37:15.021+0000 7f3eacffb740 1 --2- 172.21.15.39:0/3689505302 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55dfd84694e0 0x55dfd846e860 unknown :-1 s=CLOSED pgs=240 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:37:15.023 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:37:15.021+0000 7f3eacffb740 1 -- 172.21.15.39:0/3689505302 >> 172.21.15.39:0/3689505302 conn(0x55dfd8465a70 msgr2=0x55dfd84607a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:37:15.023 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:37:15.021+0000 7f3eacffb740 1 -- 172.21.15.39:0/3689505302 shutdown_connections 2024-09-12T02:37:15.023 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:37:15.021+0000 7f3eacffb740 1 -- 172.21.15.39:0/3689505302 wait complete. 2024-09-12T02:37:15.026 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:37:15.021+0000 7f3eacffb740 1 -- start start 2024-09-12T02:37:15.026 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:37:15.022+0000 7f3eacffb740 1 Processor -- start 2024-09-12T02:37:15.026 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:37:15.022+0000 7f3eacffb740 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55dfd84694e0 0x55dfd8488f60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:37:15.026 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:37:15.022+0000 7f3eacffb740 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55dfd8469e00 0x55dfd84894a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:37:15.026 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:37:15.022+0000 7f3eacffb740 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55dfd84746c0 0x55dfd848d570 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:37:15.026 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:37:15.022+0000 7f3eacffb740 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 -- 0x55dfd84866e0 con 0x55dfd8469e00 2024-09-12T02:37:15.026 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:37:15.022+0000 7f3eacffb740 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x55dfd8486010 con 0x55dfd84694e0 2024-09-12T02:37:15.026 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:37:15.022+0000 7f3eacffb740 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x55dfd8486db0 con 0x55dfd84746c0 2024-09-12T02:37:15.026 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:37:15.022+0000 7f3eacffb740 10 client.0 _ll_register_callbacks cb 0x7f3e9c01a860 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-12T02:37:15.026 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:37:15.022+0000 7f3ea2a00640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55dfd8469e00 0x55dfd84894a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:37:15.026 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:37:15.023+0000 7f3ea2a00640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55dfd8469e00 0x55dfd84894a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.39:3300/0 says I am v2:172.21.15.39:48900/0 (socket says 172.21.15.39:48900) 2024-09-12T02:37:15.027 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:37:15.023+0000 7f3ea2a00640 1 -- 172.21.15.39:0/790935873 learned_addr learned my addr 172.21.15.39:0/790935873 (peer_addr_for_me v2:172.21.15.39:0/0) 2024-09-12T02:37:15.027 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:37:15.023+0000 7f3ea3e00640 1 --2- 172.21.15.39:0/790935873 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55dfd84746c0 0x55dfd848d570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:37:15.027 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:37:15.023+0000 7f3ea3e00640 1 --2- 172.21.15.39:0/790935873 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55dfd84694e0 0x55dfd8488f60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:37:15.027 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:37:15.023+0000 7f3ea2a00640 1 -- 172.21.15.39:0/790935873 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55dfd84746c0 msgr2=0x55dfd848d570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:37:15.027 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:37:15.023+0000 7f3ea2a00640 1 --2- 172.21.15.39:0/790935873 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55dfd84746c0 0x55dfd848d570 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:37:15.027 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:37:15.023+0000 7f3ea2a00640 1 -- 172.21.15.39:0/790935873 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55dfd84694e0 msgr2=0x55dfd8488f60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:37:15.027 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:37:15.023+0000 7f3ea2a00640 1 --2- 172.21.15.39:0/790935873 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55dfd84694e0 0x55dfd8488f60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:37:15.027 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:37:15.023+0000 7f3ea2a00640 1 -- 172.21.15.39:0/790935873 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55dfd848dae0 con 0x55dfd8469e00 2024-09-12T02:37:15.027 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:37:15.023+0000 7f3ea2a00640 1 --2- 172.21.15.39:0/790935873 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55dfd8469e00 0x55dfd84894a0 secure :-1 s=READY pgs=241 cs=0 l=1 rev1=1 crypto rx=0x7f3e90009d30 tx=0x7f3e900039c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a1060ae02352771c server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:37:15.027 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:37:15.023+0000 7f3e8d600640 10 client.0 ms_handle_connect on v2:172.21.15.39:3300/0 2024-09-12T02:37:15.027 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:37:15.024+0000 7f3e8d600640 1 -- 172.21.15.39:0/790935873 <== mon.0 v2:172.21.15.39:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3e90005220 con 0x55dfd8469e00 2024-09-12T02:37:15.027 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:37:15.024+0000 7f3e8d600640 1 -- 172.21.15.39:0/790935873 <== mon.0 v2:172.21.15.39:3300/0 2 ==== osd_map(95..95 src has 1..95) ==== 9129+0+0 (secure 0 0 0) 0x7f3e900053c0 con 0x55dfd8469e00 2024-09-12T02:37:15.027 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:37:15.024+0000 7f3eacffb740 1 -- 172.21.15.39:0/790935873 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f3e9c015040 con 0x55dfd8469e00 2024-09-12T02:37:15.028 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:37:15.024+0000 7f3e8d600640 1 -- 172.21.15.39:0/790935873 <== mon.0 v2:172.21.15.39:3300/0 3 ==== mon_get_version_reply(handle=1 version=28) ==== 24+0+0 (secure 0 0 0) 0x7f3e9002d050 con 0x55dfd8469e00 2024-09-12T02:37:15.028 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:37:15.024+0000 7f3eacffb740 10 client.15027 fetch_fsmap learned FSMap version 28 2024-09-12T02:37:15.028 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:37:15.024+0000 7f3eacffb740 1 -- 172.21.15.39:0/790935873 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({config=0+,fsmap=28,monmap=4+}) -- 0x55dfd84f03f0 con 0x55dfd8469e00 2024-09-12T02:37:15.028 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:37:15.024+0000 7f3e8d600640 1 -- 172.21.15.39:0/790935873 <== mon.0 v2:172.21.15.39:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f3e9c015040 con 0x55dfd8469e00 2024-09-12T02:37:15.028 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:37:15.024+0000 7f3e8d600640 1 -- 172.21.15.39:0/790935873 <== mon.0 v2:172.21.15.39:3300/0 5 ==== fsmap(e 28) ==== 8370+0+0 (secure 0 0 0) 0x7f3e900107e0 con 0x55dfd8469e00 2024-09-12T02:37:15.028 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:37:15.024+0000 7f3eacffb740 10 client.15027 fetch_fsmap finished waiting for FSMap version 28 2024-09-12T02:37:15.028 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:37:15.024+0000 7f3eacffb740 10 client.15027 resolve_mds: resolved name 'i' to daemon mds.i 2024-09-12T02:37:15.028 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:37:15.025+0000 7f3eacffb740 20 client.15027 populate_metadata read hostname 'smithi039' 2024-09-12T02:37:15.028 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:37:15.025+0000 7f3eacffb740 1 --2- 172.21.15.39:0/790935873 >> [v2:172.21.15.172:6838/3742537097,v1:172.21.15.172:6839/3742537097] conn(0x55dfd84f4ff0 0x55dfd84f3d00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:37:15.028 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:37:15.025+0000 7f3eacffb740 4 client.15027 mds_command: new command op to 24499 tid=0 multi_id=0 [{"prefix": "status"}] 2024-09-12T02:37:15.028 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:37:15.025+0000 7f3eacffb740 1 -- 172.21.15.39:0/790935873 --> [v2:172.21.15.172:6838/3742537097,v1:172.21.15.172:6839/3742537097] -- command(tid 0: {"prefix": "status"}) -- 0x55dfd83d6b30 con 0x55dfd84f4ff0 2024-09-12T02:37:15.028 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:37:15.025+0000 7f3ea3e00640 1 --2- 172.21.15.39:0/790935873 >> [v2:172.21.15.172:6838/3742537097,v1:172.21.15.172:6839/3742537097] conn(0x55dfd84f4ff0 0x55dfd84f3d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:37:15.029 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:37:15.025+0000 7f3ea3e00640 1 --2- 172.21.15.39:0/790935873 >> [v2:172.21.15.172:6838/3742537097,v1:172.21.15.172:6839/3742537097] conn(0x55dfd84f4ff0 0x55dfd84f3d00 crc :-1 s=READY pgs=17 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=7c1233ce2dc76cb4 server_cookie=2d7caaa8f15e81cf in_seq=0 out_seq=0 2024-09-12T02:37:15.029 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:37:15.026+0000 7f3e8d600640 10 client.15027 ms_handle_connect on v2:172.21.15.172:6838/3742537097 2024-09-12T02:37:15.030 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:37:15.026+0000 7f3e8d600640 1 -- 172.21.15.39:0/790935873 <== mds.1 v2:172.21.15.172:6838/3742537097 1 ==== command_reply(tid 0: 0 ) ==== 8+0+332 (crc 0 0 0) 0x55dfd83d6b30 con 0x55dfd84f4ff0 2024-09-12T02:37:15.030 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:37:15.026+0000 7f3e8d600640 10 client.15027 handle_command_reply: tid=0 2024-09-12T02:37:15.030 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:37:15.026+0000 7f3eacffb740 1 client.15027 shutdown 2024-09-12T02:37:15.030 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:37:15.026+0000 7f3eacffb740 1 -- 172.21.15.39:0/790935873 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55dfd8469e00 msgr2=0x55dfd84894a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:37:15.030 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:37:15.026+0000 7f3eacffb740 1 --2- 172.21.15.39:0/790935873 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55dfd8469e00 0x55dfd84894a0 secure :-1 s=READY pgs=241 cs=0 l=1 rev1=1 crypto rx=0x7f3e90009d30 tx=0x7f3e900039c0 comp rx=0 tx=0).stop 2024-09-12T02:37:15.030 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:37:15.026+0000 7f3eacffb740 1 -- 172.21.15.39:0/790935873 shutdown_connections 2024-09-12T02:37:15.030 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:37:15.026+0000 7f3eacffb740 1 --2- 172.21.15.39:0/790935873 >> [v2:172.21.15.172:6838/3742537097,v1:172.21.15.172:6839/3742537097] conn(0x55dfd84f4ff0 0x55dfd84f3d00 crc :-1 s=READY pgs=17 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:37:15.030 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:37:15.026+0000 7f3eacffb740 1 --2- 172.21.15.39:0/790935873 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55dfd84746c0 0x55dfd848d570 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:37:15.030 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:37:15.026+0000 7f3eacffb740 1 --2- 172.21.15.39:0/790935873 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55dfd8469e00 0x55dfd84894a0 unknown :-1 s=CLOSED pgs=241 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:37:15.030 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:37:15.026+0000 7f3eacffb740 1 --2- 172.21.15.39:0/790935873 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55dfd84694e0 0x55dfd8488f60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:37:15.030 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:37:15.026+0000 7f3eacffb740 1 -- 172.21.15.39:0/790935873 >> 172.21.15.39:0/790935873 conn(0x55dfd8465a70 msgr2=0x55dfd8472e60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:37:15.030 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:37:15.026+0000 7f3e8d600640 0 client.15027 ms_handle_reset on v2:172.21.15.172:6838/3742537097 2024-09-12T02:37:15.030 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:37:15.026+0000 7f3eacffb740 1 -- 172.21.15.39:0/790935873 shutdown_connections 2024-09-12T02:37:15.030 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:37:15.026+0000 7f3eacffb740 1 -- 172.21.15.39:0/790935873 wait complete. 2024-09-12T02:37:15.031 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:37:15.026+0000 7f3eacffb740 20 client.15027 trim_cache size 0 max 16384 2024-09-12T02:37:15.031 INFO:teuthology.orchestra.run.smithi039.stdout:{ 2024-09-12T02:37:15.031 INFO:teuthology.orchestra.run.smithi039.stdout: "cluster_fsid": "4954ed46-70ae-11ef-bcea-c7b262605968", 2024-09-12T02:37:15.031 INFO:teuthology.orchestra.run.smithi039.stdout: "whoami": 1, 2024-09-12T02:37:15.031 INFO:teuthology.orchestra.run.smithi039.stdout: "id": 24499, 2024-09-12T02:37:15.031 INFO:teuthology.orchestra.run.smithi039.stdout: "want_state": "up:active", 2024-09-12T02:37:15.031 INFO:teuthology.orchestra.run.smithi039.stdout: "state": "up:active", 2024-09-12T02:37:15.031 INFO:teuthology.orchestra.run.smithi039.stdout: "fs_name": "cephfs", 2024-09-12T02:37:15.032 INFO:teuthology.orchestra.run.smithi039.stdout: "rank_uptime": 86.275728459999996, 2024-09-12T02:37:15.032 INFO:teuthology.orchestra.run.smithi039.stdout: "mdsmap_epoch": 28, 2024-09-12T02:37:15.032 INFO:teuthology.orchestra.run.smithi039.stdout: "osdmap_epoch": 95, 2024-09-12T02:37:15.032 INFO:teuthology.orchestra.run.smithi039.stdout: "osdmap_epoch_barrier": 93, 2024-09-12T02:37:15.032 INFO:teuthology.orchestra.run.smithi039.stdout: "uptime": 153.18732889200001 2024-09-12T02:37:15.032 INFO:teuthology.orchestra.run.smithi039.stdout:} 2024-09-12T02:37:15.032 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:37:15.027+0000 7f3ea8e00640 1 -- 172.21.15.39:0/2864101623 >> [v2:172.21.15.39:6800/1725006999,v1:172.21.15.39:6801/1725006999] conn(0x7f3e880a2c10 msgr2=0x7f3e880a50d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:37:15.033 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:37:15.027+0000 7f3ea8e00640 1 --2- 172.21.15.39:0/2864101623 >> [v2:172.21.15.39:6800/1725006999,v1:172.21.15.39:6801/1725006999] conn(0x7f3e880a2c10 0x7f3e880a50d0 secure :-1 s=READY pgs=213 cs=0 l=1 rev1=1 crypto rx=0x55dfd84668d0 tx=0x7f3e9402a340 comp rx=0 tx=0).stop 2024-09-12T02:37:15.033 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:37:15.027+0000 7f3ea8e00640 1 -- 172.21.15.39:0/2864101623 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f3ea4103e30 msgr2=0x7f3ea419a480 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:37:15.033 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:37:15.027+0000 7f3ea8e00640 1 --2- 172.21.15.39:0/2864101623 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f3ea4103e30 0x7f3ea419a480 secure :-1 s=READY pgs=108 cs=0 l=1 rev1=1 crypto rx=0x7f3e94035040 tx=0x7f3e94033d90 comp rx=0 tx=0).stop 2024-09-12T02:37:15.033 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:37:15.027+0000 7f3ea8e00640 1 -- 172.21.15.39:0/2864101623 shutdown_connections 2024-09-12T02:37:15.033 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:37:15.027+0000 7f3ea8e00640 1 --2- 172.21.15.39:0/2864101623 >> [v2:172.21.15.39:6800/1725006999,v1:172.21.15.39:6801/1725006999] conn(0x7f3e880a2c10 0x7f3e880a50d0 unknown :-1 s=CLOSED pgs=213 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:37:15.033 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:37:15.027+0000 7f3ea8e00640 1 --2- 172.21.15.39:0/2864101623 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f3ea4108f60 0x7f3ea419ed50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:37:15.033 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:37:15.027+0000 7f3ea8e00640 1 --2- 172.21.15.39:0/2864101623 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f3ea41047e0 0x7f3ea419a9c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:37:15.033 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:37:15.027+0000 7f3ea8e00640 1 --2- 172.21.15.39:0/2864101623 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f3ea4103e30 0x7f3ea419a480 unknown :-1 s=CLOSED pgs=108 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:37:15.033 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:37:15.027+0000 7f3ea8e00640 1 -- 172.21.15.39:0/2864101623 >> 172.21.15.39:0/2864101623 conn(0x7f3ea40ff8d0 msgr2=0x7f3ea4100c50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:37:15.033 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:37:15.027+0000 7f3ea8e00640 1 -- 172.21.15.39:0/2864101623 shutdown_connections 2024-09-12T02:37:15.033 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:37:15.027+0000 7f3ea8e00640 1 -- 172.21.15.39:0/2864101623 wait complete. 2024-09-12T02:37:15.979 DEBUG:teuthology.orchestra.run.smithi039:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc shell --fsid 4954ed46-70ae-11ef-bcea-c7b262605968 -- ceph tell mds.b status 2024-09-12T02:37:16.361 INFO:teuthology.orchestra.run.smithi039.stderr:Inferring config /var/lib/ceph/4954ed46-70ae-11ef-bcea-c7b262605968/mon.a/config 2024-09-12T02:37:16.763 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 12 02:37:16 smithi172 ceph-mon[35609]: pgmap v370: 129 pgs: 129 active+clean; 645 KiB data, 348 MiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2024-09-12T02:37:16.763 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 12 02:37:16 smithi172 ceph-mon[35609]: mgrmap e18: x(active, since 9m), standbys: z, y 2024-09-12T02:37:16.850 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 02:37:16 smithi039 ceph-mon[30515]: pgmap v370: 129 pgs: 129 active+clean; 645 KiB data, 348 MiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2024-09-12T02:37:16.850 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 02:37:16 smithi039 ceph-mon[30515]: mgrmap e18: x(active, since 9m), standbys: z, y 2024-09-12T02:37:16.948 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 12 02:37:16 smithi044 ceph-mon[35411]: pgmap v370: 129 pgs: 129 active+clean; 645 KiB data, 348 MiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2024-09-12T02:37:16.948 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 12 02:37:16 smithi044 ceph-mon[35411]: mgrmap e18: x(active, since 9m), standbys: z, y 2024-09-12T02:37:17.027 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:37:17.025+0000 7f21db000640 1 -- 172.21.15.39:0/2415182812 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f21d4103ff0 msgr2=0x7f21d41043d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:37:17.027 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:37:17.025+0000 7f21db000640 1 --2- 172.21.15.39:0/2415182812 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f21d4103ff0 0x7f21d41043d0 secure :-1 s=READY pgs=242 cs=0 l=1 rev1=1 crypto rx=0x7f21c4009900 tx=0x7f21c402a3f0 comp rx=0 tx=0).stop 2024-09-12T02:37:17.027 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:37:17.025+0000 7f21db000640 1 -- 172.21.15.39:0/2415182812 shutdown_connections 2024-09-12T02:37:17.027 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:37:17.025+0000 7f21db000640 1 --2- 172.21.15.39:0/2415182812 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f21d4109120 0x7f21d4110ca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:37:17.028 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:37:17.025+0000 7f21db000640 1 --2- 172.21.15.39:0/2415182812 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f21d41049a0 0x7f21d41089f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:37:17.028 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:37:17.025+0000 7f21db000640 1 --2- 172.21.15.39:0/2415182812 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f21d4103ff0 0x7f21d41043d0 unknown :-1 s=CLOSED pgs=242 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:37:17.028 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:37:17.025+0000 7f21db000640 1 -- 172.21.15.39:0/2415182812 >> 172.21.15.39:0/2415182812 conn(0x7f21d40ffa90 msgr2=0x7f21d4101eb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:37:17.028 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:37:17.025+0000 7f21db000640 1 -- 172.21.15.39:0/2415182812 shutdown_connections 2024-09-12T02:37:17.028 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:37:17.025+0000 7f21db000640 1 -- 172.21.15.39:0/2415182812 wait complete. 2024-09-12T02:37:17.028 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:37:17.026+0000 7f21db000640 1 Processor -- start 2024-09-12T02:37:17.028 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:37:17.026+0000 7f21db000640 1 -- start start 2024-09-12T02:37:17.030 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:37:17.027+0000 7f21db000640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f21d4103ff0 0x7f21d419a620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:37:17.030 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:37:17.027+0000 7f21db000640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f21d41049a0 0x7f21d419ab60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:37:17.030 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:37:17.027+0000 7f21db000640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f21d4109120 0x7f21d419eef0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:37:17.030 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:37:17.027+0000 7f21db000640 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 -- 0x7f21d4114120 con 0x7f21d41049a0 2024-09-12T02:37:17.030 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:37:17.027+0000 7f21db000640 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x7f21d4113fa0 con 0x7f21d4109120 2024-09-12T02:37:17.030 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:37:17.027+0000 7f21db000640 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7f21d41142a0 con 0x7f21d4103ff0 2024-09-12T02:37:17.030 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:37:17.027+0000 7f21cb400640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f21d41049a0 0x7f21d419ab60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:37:17.030 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:37:17.027+0000 7f21d9000640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f21d4109120 0x7f21d419eef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:37:17.030 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:37:17.027+0000 7f21d3e00640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f21d4103ff0 0x7f21d419a620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:37:17.030 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:37:17.027+0000 7f21d9000640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f21d4109120 0x7f21d419eef0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.39:56438/0 (socket says 172.21.15.39:56438) 2024-09-12T02:37:17.030 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:37:17.027+0000 7f21cb400640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f21d41049a0 0x7f21d419ab60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.39:3300/0 says I am v2:172.21.15.39:48918/0 (socket says 172.21.15.39:48918) 2024-09-12T02:37:17.031 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:37:17.027+0000 7f21d3e00640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f21d4103ff0 0x7f21d419a620 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.172:3300/0 says I am v2:172.21.15.39:39456/0 (socket says 172.21.15.39:39456) 2024-09-12T02:37:17.031 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:37:17.027+0000 7f21d9000640 1 -- 172.21.15.39:0/2668660436 learned_addr learned my addr 172.21.15.39:0/2668660436 (peer_addr_for_me v2:172.21.15.39:0/0) 2024-09-12T02:37:17.031 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:37:17.028+0000 7f21d9000640 1 -- 172.21.15.39:0/2668660436 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f21d4103ff0 msgr2=0x7f21d419a620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:37:17.031 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:37:17.028+0000 7f21d9000640 1 --2- 172.21.15.39:0/2668660436 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f21d4103ff0 0x7f21d419a620 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:37:17.031 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:37:17.028+0000 7f21d9000640 1 -- 172.21.15.39:0/2668660436 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f21d41049a0 msgr2=0x7f21d419ab60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:37:17.031 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:37:17.028+0000 7f21d9000640 1 --2- 172.21.15.39:0/2668660436 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f21d41049a0 0x7f21d419ab60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:37:17.031 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:37:17.028+0000 7f21d9000640 1 -- 172.21.15.39:0/2668660436 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f21d419f5d0 con 0x7f21d4109120 2024-09-12T02:37:17.031 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:37:17.028+0000 7f21d9000640 1 --2- 172.21.15.39:0/2668660436 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f21d4109120 0x7f21d419eef0 secure :-1 s=READY pgs=110 cs=0 l=1 rev1=1 crypto rx=0x7f21cc00eaa0 tx=0x7f21cc00ef60 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:37:17.031 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:37:17.028+0000 7f21d1600640 1 -- 172.21.15.39:0/2668660436 <== mon.2 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f21cc00cdb0 con 0x7f21d4109120 2024-09-12T02:37:17.031 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:37:17.028+0000 7f21db000640 1 -- 172.21.15.39:0/2668660436 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f21d419f8c0 con 0x7f21d4109120 2024-09-12T02:37:17.032 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:37:17.028+0000 7f21d1600640 1 -- 172.21.15.39:0/2668660436 <== mon.2 v2:172.21.15.44:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f21cc005020 con 0x7f21d4109120 2024-09-12T02:37:17.032 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:37:17.028+0000 7f21d1600640 1 -- 172.21.15.39:0/2668660436 <== mon.2 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f21cc0116b0 con 0x7f21d4109120 2024-09-12T02:37:17.032 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:37:17.029+0000 7f21db000640 1 -- 172.21.15.39:0/2668660436 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f21d41a71a0 con 0x7f21d4109120 2024-09-12T02:37:17.032 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:37:17.032+0000 7f21dda8a740 1 Processor -- start 2024-09-12T02:37:17.032 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:37:17.032+0000 7f21d1600640 1 -- 172.21.15.39:0/2668660436 <== mon.2 v2:172.21.15.44:3300/0 4 ==== mgrmap(e 18) ==== 137833+0+0 (secure 0 0 0) 0x7f21cc005560 con 0x7f21d4109120 2024-09-12T02:37:17.033 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:37:17.032+0000 7f21dda8a740 1 -- start start 2024-09-12T02:37:17.033 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:37:17.032+0000 7f21dda8a740 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5568031ee330 0x5568031ee710 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:37:17.033 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:37:17.032+0000 7f21dda8a740 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x5568031eec50 0x5568031f8fd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:37:17.034 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:37:17.032+0000 7f21dda8a740 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x5568031f9510 0x5568031fb900 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:37:17.034 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:37:17.032+0000 7f21dda8a740 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 -- 0x5568031540b0 con 0x5568031f9510 2024-09-12T02:37:17.034 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:37:17.032+0000 7f21dda8a740 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x5568030fbab0 con 0x5568031ee330 2024-09-12T02:37:17.034 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:37:17.032+0000 7f21dda8a740 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x556803150070 con 0x5568031eec50 2024-09-12T02:37:17.034 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:37:17.033+0000 7f21cb400640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5568031ee330 0x5568031ee710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:37:17.034 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:37:17.033+0000 7f21cb400640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5568031ee330 0x5568031ee710 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.39:56446/0 (socket says 172.21.15.39:56446) 2024-09-12T02:37:17.034 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:37:17.033+0000 7f21cb400640 1 -- 172.21.15.39:0/331399541 learned_addr learned my addr 172.21.15.39:0/331399541 (peer_addr_for_me v2:172.21.15.39:0/0) 2024-09-12T02:37:17.034 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:37:17.033+0000 7f21cb400640 1 --2- 172.21.15.39:0/331399541 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x5568031f9510 0x5568031fb900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:37:17.034 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:37:17.033+0000 7f21d3e00640 1 --2- 172.21.15.39:0/331399541 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x5568031eec50 0x5568031f8fd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:37:17.036 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:37:17.033+0000 7f21cb400640 1 -- 172.21.15.39:0/331399541 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x5568031eec50 msgr2=0x5568031f8fd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:37:17.036 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:37:17.033+0000 7f21cb400640 1 --2- 172.21.15.39:0/331399541 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x5568031eec50 0x5568031f8fd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:37:17.036 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:37:17.033+0000 7f21cb400640 1 -- 172.21.15.39:0/331399541 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x5568031f9510 msgr2=0x5568031fb900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:37:17.036 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:37:17.033+0000 7f21cb400640 1 --2- 172.21.15.39:0/331399541 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x5568031f9510 0x5568031fb900 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:37:17.036 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:37:17.033+0000 7f21cb400640 1 -- 172.21.15.39:0/331399541 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5568031084a0 con 0x5568031ee330 2024-09-12T02:37:17.036 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:37:17.033+0000 7f21cb400640 1 --2- 172.21.15.39:0/331399541 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5568031ee330 0x5568031ee710 secure :-1 s=READY pgs=111 cs=0 l=1 rev1=1 crypto rx=0x7f21bc012790 tx=0x7f21bc00b7c0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=8a55ac3853e6c9a0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:37:17.036 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:37:17.034+0000 7f21d1600640 1 --2- 172.21.15.39:0/2668660436 >> [v2:172.21.15.39:6800/1725006999,v1:172.21.15.39:6801/1725006999] conn(0x7f21b80a2b80 0x7f21b80a5040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:37:17.037 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:37:17.034+0000 7f21c9600640 1 -- 172.21.15.39:0/331399541 <== mon.2 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f21bc012dd0 con 0x5568031ee330 2024-09-12T02:37:17.037 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:37:17.034+0000 7f21c9600640 1 -- 172.21.15.39:0/331399541 <== mon.2 v2:172.21.15.44:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f21bc010c50 con 0x5568031ee330 2024-09-12T02:37:17.037 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:37:17.034+0000 7f21c9600640 1 -- 172.21.15.39:0/331399541 <== mon.2 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f21bc01ec30 con 0x5568031ee330 2024-09-12T02:37:17.037 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:37:17.034+0000 7f21d1600640 1 -- 172.21.15.39:0/2668660436 <== mon.2 v2:172.21.15.44:3300/0 5 ==== osd_map(95..95 src has 1..95) ==== 9129+0+0 (secure 0 0 0) 0x7f21cc0cf560 con 0x7f21d4109120 2024-09-12T02:37:17.037 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:37:17.034+0000 7f21d3e00640 1 --2- 172.21.15.39:0/2668660436 >> [v2:172.21.15.39:6800/1725006999,v1:172.21.15.39:6801/1725006999] conn(0x7f21b80a2b80 0x7f21b80a5040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:37:17.037 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:37:17.035+0000 7f21dda8a740 1 -- 172.21.15.39:0/331399541 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5568031ee330 msgr2=0x5568031ee710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:37:17.037 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:37:17.035+0000 7f21dda8a740 1 --2- 172.21.15.39:0/331399541 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5568031ee330 0x5568031ee710 secure :-1 s=READY pgs=111 cs=0 l=1 rev1=1 crypto rx=0x7f21bc012790 tx=0x7f21bc00b7c0 comp rx=0 tx=0).stop 2024-09-12T02:37:17.037 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:37:17.035+0000 7f21d3e00640 1 --2- 172.21.15.39:0/2668660436 >> [v2:172.21.15.39:6800/1725006999,v1:172.21.15.39:6801/1725006999] conn(0x7f21b80a2b80 0x7f21b80a5040 secure :-1 s=READY pgs=214 cs=0 l=1 rev1=1 crypto rx=0x7f21c4009230 tx=0x7f21c40058d0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:37:17.037 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:37:17.035+0000 7f21dda8a740 1 -- 172.21.15.39:0/331399541 shutdown_connections 2024-09-12T02:37:17.037 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:37:17.035+0000 7f21dda8a740 1 --2- 172.21.15.39:0/331399541 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x5568031f9510 0x5568031fb900 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:37:17.037 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:37:17.035+0000 7f21dda8a740 1 --2- 172.21.15.39:0/331399541 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x5568031eec50 0x5568031f8fd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:37:17.037 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:37:17.035+0000 7f21dda8a740 1 --2- 172.21.15.39:0/331399541 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5568031ee330 0x5568031ee710 unknown :-1 s=CLOSED pgs=111 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:37:17.037 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:37:17.035+0000 7f21dda8a740 1 -- 172.21.15.39:0/331399541 >> 172.21.15.39:0/331399541 conn(0x5568031ea8c0 msgr2=0x5568031eaca0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:37:17.038 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:37:17.035+0000 7f21dda8a740 1 -- 172.21.15.39:0/331399541 shutdown_connections 2024-09-12T02:37:17.038 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:37:17.035+0000 7f21dda8a740 1 -- 172.21.15.39:0/331399541 wait complete. 2024-09-12T02:37:17.040 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:37:17.036+0000 7f21dda8a740 1 -- start start 2024-09-12T02:37:17.041 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:37:17.036+0000 7f21dda8a740 1 Processor -- start 2024-09-12T02:37:17.041 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:37:17.036+0000 7f21dda8a740 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5568031ee330 0x5568031f6590 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:37:17.041 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:37:17.036+0000 7f21dda8a740 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x5568031eec50 0x5568031f6ad0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:37:17.041 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:37:17.036+0000 7f21dda8a740 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x5568031f9510 0x5568031f7010 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:37:17.041 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:37:17.037+0000 7f21dda8a740 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 -- 0x5568031fc060 con 0x5568031eec50 2024-09-12T02:37:17.041 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:37:17.037+0000 7f21dda8a740 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x5568030dc920 con 0x5568031ee330 2024-09-12T02:37:17.041 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:37:17.037+0000 7f21dda8a740 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x5568031fc1e0 con 0x5568031f9510 2024-09-12T02:37:17.041 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:37:17.037+0000 7f21dda8a740 10 client.0 _ll_register_callbacks cb 0x5568031008a0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-12T02:37:17.041 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:37:17.037+0000 7f21cb400640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x5568031eec50 0x5568031f6ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:37:17.041 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:37:17.037+0000 7f21d9000640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x5568031f9510 0x5568031f7010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:37:17.041 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:37:17.037+0000 7f21cb400640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x5568031eec50 0x5568031f6ad0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.39:3300/0 says I am v2:172.21.15.39:48926/0 (socket says 172.21.15.39:48926) 2024-09-12T02:37:17.041 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:37:17.037+0000 7f21cb400640 1 -- 172.21.15.39:0/3095341015 learned_addr learned my addr 172.21.15.39:0/3095341015 (peer_addr_for_me v2:172.21.15.39:0/0) 2024-09-12T02:37:17.042 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:37:17.037+0000 7f21d3e00640 1 --2- 172.21.15.39:0/3095341015 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5568031ee330 0x5568031f6590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:37:17.042 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:37:17.037+0000 7f21cb400640 1 -- 172.21.15.39:0/3095341015 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x5568031f9510 msgr2=0x5568031f7010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:37:17.042 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:37:17.037+0000 7f21cb400640 1 --2- 172.21.15.39:0/3095341015 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x5568031f9510 0x5568031f7010 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:37:17.042 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:37:17.037+0000 7f21cb400640 1 -- 172.21.15.39:0/3095341015 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5568031ee330 msgr2=0x5568031f6590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:37:17.042 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:37:17.037+0000 7f21cb400640 1 --2- 172.21.15.39:0/3095341015 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5568031ee330 0x5568031f6590 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:37:17.042 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:37:17.037+0000 7f21cb400640 1 -- 172.21.15.39:0/3095341015 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({osdmap=0}) -- 0x556802ec52b0 con 0x5568031eec50 2024-09-12T02:37:17.042 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:37:17.038+0000 7f21cb400640 1 --2- 172.21.15.39:0/3095341015 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x5568031eec50 0x5568031f6ad0 secure :-1 s=READY pgs=243 cs=0 l=1 rev1=1 crypto rx=0x7f21bc01e870 tx=0x7f21bc00b9d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=31485f9dc7da3386 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:37:17.042 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:37:17.038+0000 7f21c2000640 10 client.0 ms_handle_connect on v2:172.21.15.39:3300/0 2024-09-12T02:37:17.042 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:37:17.038+0000 7f21c2000640 1 -- 172.21.15.39:0/3095341015 <== mon.0 v2:172.21.15.39:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f21bc025070 con 0x5568031eec50 2024-09-12T02:37:17.042 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:37:17.038+0000 7f21dda8a740 1 -- 172.21.15.39:0/3095341015 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f21bc010c50 con 0x5568031eec50 2024-09-12T02:37:17.042 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:37:17.038+0000 7f21c2000640 1 -- 172.21.15.39:0/3095341015 <== mon.0 v2:172.21.15.39:3300/0 2 ==== osd_map(95..95 src has 1..95) ==== 9129+0+0 (secure 0 0 0) 0x7f21bc004040 con 0x5568031eec50 2024-09-12T02:37:17.042 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:37:17.038+0000 7f21c2000640 1 -- 172.21.15.39:0/3095341015 <== mon.0 v2:172.21.15.39:3300/0 3 ==== mon_get_version_reply(handle=1 version=28) ==== 24+0+0 (secure 0 0 0) 0x7f21bc033050 con 0x5568031eec50 2024-09-12T02:37:17.042 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:37:17.038+0000 7f21dda8a740 10 client.15039 fetch_fsmap learned FSMap version 28 2024-09-12T02:37:17.043 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:37:17.038+0000 7f21dda8a740 1 -- 172.21.15.39:0/3095341015 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({config=0+,fsmap=28,monmap=4+}) -- 0x556803207e10 con 0x5568031eec50 2024-09-12T02:37:17.043 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:37:17.039+0000 7f21c2000640 1 -- 172.21.15.39:0/3095341015 <== mon.0 v2:172.21.15.39:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f21bc010c50 con 0x5568031eec50 2024-09-12T02:37:17.043 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:37:17.039+0000 7f21c2000640 1 -- 172.21.15.39:0/3095341015 <== mon.0 v2:172.21.15.39:3300/0 5 ==== fsmap(e 28) ==== 8370+0+0 (secure 0 0 0) 0x7f21bc0035f0 con 0x5568031eec50 2024-09-12T02:37:17.043 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:37:17.039+0000 7f21dda8a740 10 client.15039 fetch_fsmap finished waiting for FSMap version 28 2024-09-12T02:37:17.043 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:37:17.039+0000 7f21dda8a740 10 client.15039 resolve_mds: resolved name 'b' to daemon mds.b 2024-09-12T02:37:17.043 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:37:17.039+0000 7f21dda8a740 20 client.15039 populate_metadata read hostname 'smithi039' 2024-09-12T02:37:17.043 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:37:17.039+0000 7f21dda8a740 1 --2- 172.21.15.39:0/3095341015 >> [v2:172.21.15.44:6838/2556532723,v1:172.21.15.44:6839/2556532723] conn(0x55680320a1c0 0x55680320b630 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:37:17.043 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:37:17.039+0000 7f21dda8a740 4 client.15039 mds_command: new command op to 24515 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-12T02:37:17.043 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:37:17.039+0000 7f21dda8a740 1 -- 172.21.15.39:0/3095341015 --> [v2:172.21.15.44:6838/2556532723,v1:172.21.15.44:6839/2556532723] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x556803161620 con 0x55680320a1c0 2024-09-12T02:37:17.043 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:37:17.039+0000 7f21d3e00640 1 --2- 172.21.15.39:0/3095341015 >> [v2:172.21.15.44:6838/2556532723,v1:172.21.15.44:6839/2556532723] conn(0x55680320a1c0 0x55680320b630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:37:17.043 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:37:17.040+0000 7f21d3e00640 1 --2- 172.21.15.39:0/3095341015 >> [v2:172.21.15.44:6838/2556532723,v1:172.21.15.44:6839/2556532723] conn(0x55680320a1c0 0x55680320b630 crc :-1 s=READY pgs=28 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=cf004cd0fd6992e server_cookie=84571ce654fa5fc6 in_seq=0 out_seq=0 2024-09-12T02:37:17.043 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:37:17.040+0000 7f21c2000640 10 client.15039 ms_handle_connect on v2:172.21.15.44:6838/2556532723 2024-09-12T02:37:17.045 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:37:17.041+0000 7f21c2000640 1 -- 172.21.15.39:0/3095341015 <== mds.0 v2:172.21.15.44:6838/2556532723 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x556803161620 con 0x55680320a1c0 2024-09-12T02:37:17.045 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:37:17.041+0000 7f21c2000640 10 client.15039 handle_command_reply: tid=0 2024-09-12T02:37:17.045 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:37:17.041+0000 7f21dda8a740 1 client.15039 shutdown 2024-09-12T02:37:17.045 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:37:17.041+0000 7f21dda8a740 1 -- 172.21.15.39:0/3095341015 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x5568031eec50 msgr2=0x5568031f6ad0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:37:17.045 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:37:17.041+0000 7f21dda8a740 1 --2- 172.21.15.39:0/3095341015 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x5568031eec50 0x5568031f6ad0 secure :-1 s=READY pgs=243 cs=0 l=1 rev1=1 crypto rx=0x7f21bc01e870 tx=0x7f21bc00b9d0 comp rx=0 tx=0).stop 2024-09-12T02:37:17.045 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:37:17.041+0000 7f21dda8a740 1 -- 172.21.15.39:0/3095341015 shutdown_connections 2024-09-12T02:37:17.045 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:37:17.041+0000 7f21dda8a740 1 --2- 172.21.15.39:0/3095341015 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x5568031f9510 0x5568031f7010 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:37:17.045 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:37:17.041+0000 7f21dda8a740 1 --2- 172.21.15.39:0/3095341015 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x5568031eec50 0x5568031f6ad0 unknown :-1 s=CLOSED pgs=243 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:37:17.045 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:37:17.041+0000 7f21dda8a740 1 --2- 172.21.15.39:0/3095341015 >> [v2:172.21.15.44:6838/2556532723,v1:172.21.15.44:6839/2556532723] conn(0x55680320a1c0 0x55680320b630 crc :-1 s=READY pgs=28 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:37:17.046 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:37:17.041+0000 7f21dda8a740 1 --2- 172.21.15.39:0/3095341015 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5568031ee330 0x5568031f6590 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:37:17.046 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:37:17.041+0000 7f21dda8a740 1 -- 172.21.15.39:0/3095341015 >> 172.21.15.39:0/3095341015 conn(0x5568031ea8c0 msgr2=0x5568031f05a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:37:17.046 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:37:17.041+0000 7f21c2000640 0 client.15039 ms_handle_reset on v2:172.21.15.44:6838/2556532723 2024-09-12T02:37:17.046 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:37:17.041+0000 7f21dda8a740 1 -- 172.21.15.39:0/3095341015 shutdown_connections 2024-09-12T02:37:17.046 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:37:17.041+0000 7f21dda8a740 1 -- 172.21.15.39:0/3095341015 wait complete. 2024-09-12T02:37:17.046 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:37:17.042+0000 7f21dda8a740 20 client.15039 trim_cache size 0 max 16384 2024-09-12T02:37:17.068 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:37:17.067+0000 7f21dda8a740 1 Processor -- start 2024-09-12T02:37:17.068 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:37:17.067+0000 7f21dda8a740 1 -- start start 2024-09-12T02:37:17.068 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:37:17.067+0000 7f21dda8a740 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x5568031ee330 0x5568031ea210 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:37:17.068 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:37:17.067+0000 7f21dda8a740 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5568031eec50 0x5568031f8500 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:37:17.068 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:37:17.067+0000 7f21dda8a740 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x5568031f9510 0x5568031f6e60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:37:17.069 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:37:17.067+0000 7f21dda8a740 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 -- 0x556803209970 con 0x5568031f9510 2024-09-12T02:37:17.069 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:37:17.067+0000 7f21dda8a740 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x55680320a040 con 0x5568031eec50 2024-09-12T02:37:17.069 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:37:17.067+0000 7f21dda8a740 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x55680320a710 con 0x5568031ee330 2024-09-12T02:37:17.071 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:37:17.068+0000 7f21d9000640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x5568031f9510 0x5568031f6e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:37:17.071 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:37:17.068+0000 7f21cb400640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5568031eec50 0x5568031f8500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:37:17.071 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:37:17.068+0000 7f21cb400640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5568031eec50 0x5568031f8500 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.39:56472/0 (socket says 172.21.15.39:56472) 2024-09-12T02:37:17.071 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:37:17.068+0000 7f21cb400640 1 -- 172.21.15.39:0/878201088 learned_addr learned my addr 172.21.15.39:0/878201088 (peer_addr_for_me v2:172.21.15.39:0/0) 2024-09-12T02:37:17.071 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:37:17.068+0000 7f21d3e00640 1 --2- 172.21.15.39:0/878201088 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x5568031ee330 0x5568031ea210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:37:17.071 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:37:17.068+0000 7f21cb400640 1 -- 172.21.15.39:0/878201088 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x5568031ee330 msgr2=0x5568031ea210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:37:17.071 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:37:17.068+0000 7f21cb400640 1 --2- 172.21.15.39:0/878201088 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x5568031ee330 0x5568031ea210 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:37:17.071 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:37:17.068+0000 7f21cb400640 1 -- 172.21.15.39:0/878201088 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x5568031f9510 msgr2=0x5568031f6e60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:37:17.072 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:37:17.068+0000 7f21cb400640 1 --2- 172.21.15.39:0/878201088 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x5568031f9510 0x5568031f6e60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:37:17.072 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:37:17.068+0000 7f21cb400640 1 -- 172.21.15.39:0/878201088 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5568031f5580 con 0x5568031eec50 2024-09-12T02:37:17.072 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:37:17.068+0000 7f21cb400640 1 --2- 172.21.15.39:0/878201088 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5568031eec50 0x5568031f8500 secure :-1 s=READY pgs=112 cs=0 l=1 rev1=1 crypto rx=0x7f21bc011010 tx=0x7f21bc0124f0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=ce7c92bcef1c85ed server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:37:17.072 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:37:17.069+0000 7f21c8c00640 1 -- 172.21.15.39:0/878201088 <== mon.2 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f21bc00b7c0 con 0x5568031eec50 2024-09-12T02:37:17.072 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:37:17.069+0000 7f21c8c00640 1 -- 172.21.15.39:0/878201088 <== mon.2 v2:172.21.15.44:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f21bc016040 con 0x5568031eec50 2024-09-12T02:37:17.072 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:37:17.069+0000 7f21c8c00640 1 -- 172.21.15.39:0/878201088 <== mon.2 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f21bc010950 con 0x5568031eec50 2024-09-12T02:37:17.072 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:37:17.070+0000 7f21dda8a740 1 -- 172.21.15.39:0/878201088 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5568031eec50 msgr2=0x5568031f8500 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:37:17.072 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:37:17.070+0000 7f21dda8a740 1 --2- 172.21.15.39:0/878201088 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5568031eec50 0x5568031f8500 secure :-1 s=READY pgs=112 cs=0 l=1 rev1=1 crypto rx=0x7f21bc011010 tx=0x7f21bc0124f0 comp rx=0 tx=0).stop 2024-09-12T02:37:17.072 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:37:17.070+0000 7f21dda8a740 1 -- 172.21.15.39:0/878201088 shutdown_connections 2024-09-12T02:37:17.072 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:37:17.070+0000 7f21dda8a740 1 --2- 172.21.15.39:0/878201088 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x5568031f9510 0x5568031f6e60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:37:17.072 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:37:17.070+0000 7f21dda8a740 1 --2- 172.21.15.39:0/878201088 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5568031eec50 0x5568031f8500 unknown :-1 s=CLOSED pgs=112 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:37:17.072 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:37:17.070+0000 7f21dda8a740 1 --2- 172.21.15.39:0/878201088 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x5568031ee330 0x5568031ea210 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:37:17.072 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:37:17.070+0000 7f21dda8a740 1 -- 172.21.15.39:0/878201088 >> 172.21.15.39:0/878201088 conn(0x5568031ea8c0 msgr2=0x5568031f7df0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:37:17.072 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:37:17.070+0000 7f21dda8a740 1 -- 172.21.15.39:0/878201088 shutdown_connections 2024-09-12T02:37:17.073 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:37:17.070+0000 7f21dda8a740 1 -- 172.21.15.39:0/878201088 wait complete. 2024-09-12T02:37:17.073 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:37:17.070+0000 7f21dda8a740 1 -- start start 2024-09-12T02:37:17.073 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:37:17.070+0000 7f21dda8a740 1 Processor -- start 2024-09-12T02:37:17.076 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:37:17.071+0000 7f21dda8a740 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x5568031ee330 0x5568031f35c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:37:17.076 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:37:17.071+0000 7f21dda8a740 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x5568031eec50 0x5568031f3b00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:37:17.076 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:37:17.071+0000 7f21dda8a740 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5568031f9510 0x5568031f4040 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:37:17.076 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:37:17.071+0000 7f21dda8a740 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 -- 0x55680320b4b0 con 0x5568031ee330 2024-09-12T02:37:17.076 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:37:17.071+0000 7f21dda8a740 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x55680320ade0 con 0x5568031f9510 2024-09-12T02:37:17.077 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:37:17.071+0000 7f21dda8a740 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x55680320bb80 con 0x5568031eec50 2024-09-12T02:37:17.077 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:37:17.071+0000 7f21dda8a740 10 client.0 _ll_register_callbacks cb 0x7f21bc012690 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-12T02:37:17.077 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:37:17.071+0000 7f21d3e00640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x5568031ee330 0x5568031f35c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:37:17.077 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:37:17.071+0000 7f21d3e00640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x5568031ee330 0x5568031f35c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.39:3300/0 says I am v2:172.21.15.39:48946/0 (socket says 172.21.15.39:48946) 2024-09-12T02:37:17.077 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:37:17.071+0000 7f21d3e00640 1 -- 172.21.15.39:0/3733636950 learned_addr learned my addr 172.21.15.39:0/3733636950 (peer_addr_for_me v2:172.21.15.39:0/0) 2024-09-12T02:37:17.077 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:37:17.071+0000 7f21cb400640 1 --2- 172.21.15.39:0/3733636950 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x5568031eec50 0x5568031f3b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:37:17.077 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:37:17.071+0000 7f21d9000640 1 --2- 172.21.15.39:0/3733636950 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5568031f9510 0x5568031f4040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:37:17.077 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:37:17.072+0000 7f21d3e00640 1 -- 172.21.15.39:0/3733636950 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x5568031eec50 msgr2=0x5568031f3b00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:37:17.077 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:37:17.072+0000 7f21d3e00640 1 --2- 172.21.15.39:0/3733636950 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x5568031eec50 0x5568031f3b00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:37:17.077 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:37:17.072+0000 7f21d3e00640 1 -- 172.21.15.39:0/3733636950 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5568031f9510 msgr2=0x5568031f4040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:37:17.077 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:37:17.072+0000 7f21d3e00640 1 --2- 172.21.15.39:0/3733636950 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5568031f9510 0x5568031f4040 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:37:17.077 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:37:17.072+0000 7f21d3e00640 1 -- 172.21.15.39:0/3733636950 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({osdmap=0}) -- 0x556803211dd0 con 0x5568031ee330 2024-09-12T02:37:17.077 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:37:17.072+0000 7f21d3e00640 1 --2- 172.21.15.39:0/3733636950 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x5568031ee330 0x5568031f35c0 secure :-1 s=READY pgs=244 cs=0 l=1 rev1=1 crypto rx=0x7f21c4009900 tx=0x7f21c402a3f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=948d53edc2cf70b8 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:37:17.077 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:37:17.072+0000 7f21c2000640 10 client.0 ms_handle_connect on v2:172.21.15.39:3300/0 2024-09-12T02:37:17.078 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:37:17.072+0000 7f21c2000640 1 -- 172.21.15.39:0/3733636950 <== mon.0 v2:172.21.15.39:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f21c4035040 con 0x5568031ee330 2024-09-12T02:37:17.078 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:37:17.072+0000 7f21c2000640 1 -- 172.21.15.39:0/3733636950 <== mon.0 v2:172.21.15.39:3300/0 2 ==== osd_map(95..95 src has 1..95) ==== 9129+0+0 (secure 0 0 0) 0x7f21c4003b80 con 0x5568031ee330 2024-09-12T02:37:17.078 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:37:17.072+0000 7f21dda8a740 1 -- 172.21.15.39:0/3733636950 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f21bc016040 con 0x5568031ee330 2024-09-12T02:37:17.078 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:37:17.073+0000 7f21c2000640 1 -- 172.21.15.39:0/3733636950 <== mon.0 v2:172.21.15.39:3300/0 3 ==== mon_get_version_reply(handle=1 version=28) ==== 24+0+0 (secure 0 0 0) 0x7f21c4003d80 con 0x5568031ee330 2024-09-12T02:37:17.078 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:37:17.073+0000 7f21dda8a740 10 client.15045 fetch_fsmap learned FSMap version 28 2024-09-12T02:37:17.078 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:37:17.073+0000 7f21dda8a740 1 -- 172.21.15.39:0/3733636950 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({config=0+,fsmap=28,monmap=4+}) -- 0x556803274be0 con 0x5568031ee330 2024-09-12T02:37:17.078 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:37:17.073+0000 7f21c2000640 1 -- 172.21.15.39:0/3733636950 <== mon.0 v2:172.21.15.39:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f21bc016040 con 0x5568031ee330 2024-09-12T02:37:17.078 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:37:17.073+0000 7f21c2000640 1 -- 172.21.15.39:0/3733636950 <== mon.0 v2:172.21.15.39:3300/0 5 ==== fsmap(e 28) ==== 8370+0+0 (secure 0 0 0) 0x7f21c405b070 con 0x5568031ee330 2024-09-12T02:37:17.078 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:37:17.073+0000 7f21dda8a740 10 client.15045 fetch_fsmap finished waiting for FSMap version 28 2024-09-12T02:37:17.078 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:37:17.073+0000 7f21dda8a740 10 client.15045 resolve_mds: resolved name 'b' to daemon mds.b 2024-09-12T02:37:17.078 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:37:17.073+0000 7f21dda8a740 20 client.15045 populate_metadata read hostname 'smithi039' 2024-09-12T02:37:17.078 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:37:17.073+0000 7f21dda8a740 1 --2- 172.21.15.39:0/3733636950 >> [v2:172.21.15.44:6838/2556532723,v1:172.21.15.44:6839/2556532723] conn(0x5568032797c0 0x5568032784d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:37:17.078 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:37:17.073+0000 7f21dda8a740 4 client.15045 mds_command: new command op to 24515 tid=0 multi_id=0 [{"prefix": "status"}] 2024-09-12T02:37:17.079 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:37:17.073+0000 7f21dda8a740 1 -- 172.21.15.39:0/3733636950 --> [v2:172.21.15.44:6838/2556532723,v1:172.21.15.44:6839/2556532723] -- command(tid 0: {"prefix": "status"}) -- 0x55680315bb30 con 0x5568032797c0 2024-09-12T02:37:17.079 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:37:17.074+0000 7f21cb400640 1 --2- 172.21.15.39:0/3733636950 >> [v2:172.21.15.44:6838/2556532723,v1:172.21.15.44:6839/2556532723] conn(0x5568032797c0 0x5568032784d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:37:17.079 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:37:17.074+0000 7f21cb400640 1 --2- 172.21.15.39:0/3733636950 >> [v2:172.21.15.44:6838/2556532723,v1:172.21.15.44:6839/2556532723] conn(0x5568032797c0 0x5568032784d0 crc :-1 s=READY pgs=29 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=799c145e059beb server_cookie=d42e20d770272eed in_seq=0 out_seq=0 2024-09-12T02:37:17.079 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:37:17.074+0000 7f21c2000640 10 client.15045 ms_handle_connect on v2:172.21.15.44:6838/2556532723 2024-09-12T02:37:17.079 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:37:17.075+0000 7f21c2000640 1 -- 172.21.15.39:0/3733636950 <== mds.0 v2:172.21.15.44:6838/2556532723 1 ==== command_reply(tid 0: 0 ) ==== 8+0+332 (crc 0 0 0) 0x55680315bb30 con 0x5568032797c0 2024-09-12T02:37:17.079 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:37:17.075+0000 7f21c2000640 10 client.15045 handle_command_reply: tid=0 2024-09-12T02:37:17.079 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:37:17.075+0000 7f21dda8a740 1 client.15045 shutdown 2024-09-12T02:37:17.079 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:37:17.075+0000 7f21dda8a740 1 -- 172.21.15.39:0/3733636950 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x5568031ee330 msgr2=0x5568031f35c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:37:17.079 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:37:17.075+0000 7f21dda8a740 1 --2- 172.21.15.39:0/3733636950 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x5568031ee330 0x5568031f35c0 secure :-1 s=READY pgs=244 cs=0 l=1 rev1=1 crypto rx=0x7f21c4009900 tx=0x7f21c402a3f0 comp rx=0 tx=0).stop 2024-09-12T02:37:17.079 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:37:17.075+0000 7f21dda8a740 1 -- 172.21.15.39:0/3733636950 shutdown_connections 2024-09-12T02:37:17.079 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:37:17.075+0000 7f21dda8a740 1 --2- 172.21.15.39:0/3733636950 >> [v2:172.21.15.44:6838/2556532723,v1:172.21.15.44:6839/2556532723] conn(0x5568032797c0 0x5568032784d0 crc :-1 s=READY pgs=29 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:37:17.079 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:37:17.075+0000 7f21dda8a740 1 --2- 172.21.15.39:0/3733636950 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5568031f9510 0x5568031f4040 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:37:17.080 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:37:17.075+0000 7f21dda8a740 1 --2- 172.21.15.39:0/3733636950 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x5568031eec50 0x5568031f3b00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:37:17.080 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:37:17.075+0000 7f21dda8a740 1 --2- 172.21.15.39:0/3733636950 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x5568031ee330 0x5568031f35c0 unknown :-1 s=CLOSED pgs=244 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:37:17.080 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:37:17.075+0000 7f21dda8a740 1 -- 172.21.15.39:0/3733636950 >> 172.21.15.39:0/3733636950 conn(0x5568031ea8c0 msgr2=0x5568031f05a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:37:17.080 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:37:17.075+0000 7f21c2000640 0 client.15045 ms_handle_reset on v2:172.21.15.44:6838/2556532723 2024-09-12T02:37:17.080 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:37:17.075+0000 7f21dda8a740 1 -- 172.21.15.39:0/3733636950 shutdown_connections 2024-09-12T02:37:17.080 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:37:17.075+0000 7f21dda8a740 1 -- 172.21.15.39:0/3733636950 wait complete. 2024-09-12T02:37:17.080 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:37:17.075+0000 7f21dda8a740 20 client.15045 trim_cache size 0 max 16384 2024-09-12T02:37:17.080 INFO:teuthology.orchestra.run.smithi039.stdout:{ 2024-09-12T02:37:17.080 INFO:teuthology.orchestra.run.smithi039.stdout: "cluster_fsid": "4954ed46-70ae-11ef-bcea-c7b262605968", 2024-09-12T02:37:17.081 INFO:teuthology.orchestra.run.smithi039.stdout: "whoami": 0, 2024-09-12T02:37:17.081 INFO:teuthology.orchestra.run.smithi039.stdout: "id": 24515, 2024-09-12T02:37:17.081 INFO:teuthology.orchestra.run.smithi039.stdout: "want_state": "up:active", 2024-09-12T02:37:17.081 INFO:teuthology.orchestra.run.smithi039.stdout: "state": "up:active", 2024-09-12T02:37:17.081 INFO:teuthology.orchestra.run.smithi039.stdout: "fs_name": "cephfs", 2024-09-12T02:37:17.081 INFO:teuthology.orchestra.run.smithi039.stdout: "rank_uptime": 132.57319430300001, 2024-09-12T02:37:17.081 INFO:teuthology.orchestra.run.smithi039.stdout: "mdsmap_epoch": 28, 2024-09-12T02:37:17.081 INFO:teuthology.orchestra.run.smithi039.stdout: "osdmap_epoch": 95, 2024-09-12T02:37:17.081 INFO:teuthology.orchestra.run.smithi039.stdout: "osdmap_epoch_barrier": 93, 2024-09-12T02:37:17.081 INFO:teuthology.orchestra.run.smithi039.stdout: "uptime": 144.87668882099999 2024-09-12T02:37:17.081 INFO:teuthology.orchestra.run.smithi039.stdout:} 2024-09-12T02:37:17.082 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:37:17.076+0000 7f21db000640 1 -- 172.21.15.39:0/2668660436 >> [v2:172.21.15.39:6800/1725006999,v1:172.21.15.39:6801/1725006999] conn(0x7f21b80a2b80 msgr2=0x7f21b80a5040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:37:17.082 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:37:17.076+0000 7f21db000640 1 --2- 172.21.15.39:0/2668660436 >> [v2:172.21.15.39:6800/1725006999,v1:172.21.15.39:6801/1725006999] conn(0x7f21b80a2b80 0x7f21b80a5040 secure :-1 s=READY pgs=214 cs=0 l=1 rev1=1 crypto rx=0x7f21c4009230 tx=0x7f21c40058d0 comp rx=0 tx=0).stop 2024-09-12T02:37:17.082 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:37:17.076+0000 7f21db000640 1 -- 172.21.15.39:0/2668660436 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f21d4109120 msgr2=0x7f21d419eef0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:37:17.082 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:37:17.076+0000 7f21db000640 1 --2- 172.21.15.39:0/2668660436 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f21d4109120 0x7f21d419eef0 secure :-1 s=READY pgs=110 cs=0 l=1 rev1=1 crypto rx=0x7f21cc00eaa0 tx=0x7f21cc00ef60 comp rx=0 tx=0).stop 2024-09-12T02:37:17.082 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:37:17.076+0000 7f21db000640 1 -- 172.21.15.39:0/2668660436 shutdown_connections 2024-09-12T02:37:17.083 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:37:17.076+0000 7f21db000640 1 --2- 172.21.15.39:0/2668660436 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f21d4109120 0x7f21d419eef0 unknown :-1 s=CLOSED pgs=110 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:37:17.083 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:37:17.076+0000 7f21db000640 1 --2- 172.21.15.39:0/2668660436 >> [v2:172.21.15.39:6800/1725006999,v1:172.21.15.39:6801/1725006999] conn(0x7f21b80a2b80 0x7f21b80a5040 unknown :-1 s=CLOSED pgs=214 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:37:17.083 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:37:17.076+0000 7f21db000640 1 --2- 172.21.15.39:0/2668660436 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f21d41049a0 0x7f21d419ab60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:37:17.083 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:37:17.076+0000 7f21db000640 1 --2- 172.21.15.39:0/2668660436 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f21d4103ff0 0x7f21d419a620 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:37:17.083 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:37:17.076+0000 7f21db000640 1 -- 172.21.15.39:0/2668660436 >> 172.21.15.39:0/2668660436 conn(0x7f21d40ffa90 msgr2=0x7f21d4100db0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:37:17.083 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:37:17.076+0000 7f21db000640 1 -- 172.21.15.39:0/2668660436 shutdown_connections 2024-09-12T02:37:17.083 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:37:17.076+0000 7f21db000640 1 -- 172.21.15.39:0/2668660436 wait complete. 2024-09-12T02:37:17.869 INFO:tasks.cephadm:Setup complete, yielding 2024-09-12T02:37:17.870 INFO:teuthology.run_tasks:Running task cephadm.shell... 2024-09-12T02:37:17.882 INFO:tasks.cephadm:Running commands on role mon.a host ubuntu@smithi039.front.sepia.ceph.com 2024-09-12T02:37:17.882 DEBUG:teuthology.orchestra.run.smithi039:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 4954ed46-70ae-11ef-bcea-c7b262605968 -- bash -c 'ceph orch status' 2024-09-12T02:37:18.260 INFO:teuthology.orchestra.run.smithi039.stderr:Inferring config /var/lib/ceph/4954ed46-70ae-11ef-bcea-c7b262605968/mon.a/config 2024-09-12T02:37:18.764 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 12 02:37:18 smithi172 ceph-mon[35609]: pgmap v371: 129 pgs: 129 active+clean; 646 KiB data, 348 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 85 B/s wr, 8 op/s 2024-09-12T02:37:18.779 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 02:37:18 smithi039 ceph-mon[30515]: pgmap v371: 129 pgs: 129 active+clean; 646 KiB data, 348 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 85 B/s wr, 8 op/s 2024-09-12T02:37:18.896 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:37:18.894+0000 7f8573a00640 1 -- 172.21.15.39:0/1879473043 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f856c101c00 msgr2=0x7f856c102000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:37:18.896 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:37:18.894+0000 7f8573a00640 1 --2- 172.21.15.39:0/1879473043 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f856c101c00 0x7f856c102000 secure :-1 s=READY pgs=245 cs=0 l=1 rev1=1 crypto rx=0x7f8560009900 tx=0x7f856002a410 comp rx=0 tx=0).stop 2024-09-12T02:37:18.896 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:37:18.895+0000 7f8573a00640 1 -- 172.21.15.39:0/1879473043 shutdown_connections 2024-09-12T02:37:18.896 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:37:18.895+0000 7f8573a00640 1 --2- 172.21.15.39:0/1879473043 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f856c1037c0 0x7f856c10a050 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:37:18.896 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:37:18.895+0000 7f8573a00640 1 --2- 172.21.15.39:0/1879473043 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f856c102e00 0x7f856c103280 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:37:18.896 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:37:18.895+0000 7f8573a00640 1 --2- 172.21.15.39:0/1879473043 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f856c101c00 0x7f856c102000 unknown :-1 s=CLOSED pgs=245 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:37:18.896 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:37:18.895+0000 7f8573a00640 1 -- 172.21.15.39:0/1879473043 >> 172.21.15.39:0/1879473043 conn(0x7f856c0fd390 msgr2=0x7f856c0ff7d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:37:18.896 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:37:18.895+0000 7f8573a00640 1 -- 172.21.15.39:0/1879473043 shutdown_connections 2024-09-12T02:37:18.897 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:37:18.895+0000 7f8573a00640 1 -- 172.21.15.39:0/1879473043 wait complete. 2024-09-12T02:37:18.898 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:37:18.896+0000 7f8573a00640 1 Processor -- start 2024-09-12T02:37:18.898 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:37:18.896+0000 7f8573a00640 1 -- start start 2024-09-12T02:37:18.898 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:37:18.896+0000 7f8573a00640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f856c101c00 0x7f856c197ee0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:37:18.898 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:37:18.896+0000 7f8573a00640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f856c102e00 0x7f856c198420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:37:18.899 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:37:18.896+0000 7f8573a00640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f856c1037c0 0x7f856c19f4a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:37:18.899 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:37:18.896+0000 7f8573a00640 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 -- 0x7f856c10d880 con 0x7f856c101c00 2024-09-12T02:37:18.899 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:37:18.896+0000 7f8573a00640 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x7f856c10d700 con 0x7f856c1037c0 2024-09-12T02:37:18.899 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:37:18.896+0000 7f8573a00640 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7f856c10da00 con 0x7f856c102e00 2024-09-12T02:37:18.899 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:37:18.896+0000 7f8571000640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f856c101c00 0x7f856c197ee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:37:18.899 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:37:18.896+0000 7f8571000640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f856c101c00 0x7f856c197ee0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.39:3300/0 says I am v2:172.21.15.39:37168/0 (socket says 172.21.15.39:37168) 2024-09-12T02:37:18.899 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:37:18.896+0000 7f8571000640 1 -- 172.21.15.39:0/1410555988 learned_addr learned my addr 172.21.15.39:0/1410555988 (peer_addr_for_me v2:172.21.15.39:0/0) 2024-09-12T02:37:18.899 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:37:18.897+0000 7f856be00640 1 --2- 172.21.15.39:0/1410555988 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f856c102e00 0x7f856c198420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:37:18.899 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:37:18.897+0000 7f8571a00640 1 --2- 172.21.15.39:0/1410555988 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f856c1037c0 0x7f856c19f4a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:37:18.899 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:37:18.897+0000 7f8571000640 1 -- 172.21.15.39:0/1410555988 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f856c102e00 msgr2=0x7f856c198420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:37:18.899 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:37:18.897+0000 7f8571000640 1 --2- 172.21.15.39:0/1410555988 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f856c102e00 0x7f856c198420 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:37:18.899 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:37:18.897+0000 7f8571000640 1 -- 172.21.15.39:0/1410555988 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f856c1037c0 msgr2=0x7f856c19f4a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:37:18.899 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:37:18.897+0000 7f8571000640 1 --2- 172.21.15.39:0/1410555988 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f856c1037c0 0x7f856c19f4a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:37:18.900 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:37:18.897+0000 7f8571000640 1 -- 172.21.15.39:0/1410555988 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f856c19fb10 con 0x7f856c101c00 2024-09-12T02:37:18.900 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:37:18.897+0000 7f8571000640 1 --2- 172.21.15.39:0/1410555988 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f856c101c00 0x7f856c197ee0 secure :-1 s=READY pgs=246 cs=0 l=1 rev1=1 crypto rx=0x7f8560031610 tx=0x7f8560004270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:37:18.900 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:37:18.898+0000 7f8569600640 1 -- 172.21.15.39:0/1410555988 <== mon.0 v2:172.21.15.39:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f856003f030 con 0x7f856c101c00 2024-09-12T02:37:18.900 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:37:18.898+0000 7f8569600640 1 -- 172.21.15.39:0/1410555988 <== mon.0 v2:172.21.15.39:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f8560003ad0 con 0x7f856c101c00 2024-09-12T02:37:18.900 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:37:18.898+0000 7f8569600640 1 -- 172.21.15.39:0/1410555988 <== mon.0 v2:172.21.15.39:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8560035070 con 0x7f856c101c00 2024-09-12T02:37:18.900 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:37:18.898+0000 7f8573a00640 1 -- 172.21.15.39:0/1410555988 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f856c19fda0 con 0x7f856c101c00 2024-09-12T02:37:18.900 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:37:18.898+0000 7f8573a00640 1 -- 172.21.15.39:0/1410555988 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f856c1a01c0 con 0x7f856c101c00 2024-09-12T02:37:18.900 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:37:18.899+0000 7f8573a00640 1 -- 172.21.15.39:0/1410555988 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f856c1090a0 con 0x7f856c101c00 2024-09-12T02:37:18.901 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:37:18.901+0000 7f8569600640 1 -- 172.21.15.39:0/1410555988 <== mon.0 v2:172.21.15.39:3300/0 4 ==== mgrmap(e 18) ==== 137833+0+0 (secure 0 0 0) 0x7f8560042030 con 0x7f856c101c00 2024-09-12T02:37:18.903 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:37:18.902+0000 7f8569600640 1 --2- 172.21.15.39:0/1410555988 >> [v2:172.21.15.39:6800/1725006999,v1:172.21.15.39:6801/1725006999] conn(0x7f85540a2bb0 0x7f85540a5070 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:37:18.903 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:37:18.902+0000 7f8569600640 1 -- 172.21.15.39:0/1410555988 <== mon.0 v2:172.21.15.39:3300/0 5 ==== osd_map(95..95 src has 1..95) ==== 9129+0+0 (secure 0 0 0) 0x7f85600efbf0 con 0x7f856c101c00 2024-09-12T02:37:18.903 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:37:18.902+0000 7f856be00640 1 --2- 172.21.15.39:0/1410555988 >> [v2:172.21.15.39:6800/1725006999,v1:172.21.15.39:6801/1725006999] conn(0x7f85540a2bb0 0x7f85540a5070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:37:18.904 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:37:18.903+0000 7f856be00640 1 --2- 172.21.15.39:0/1410555988 >> [v2:172.21.15.39:6800/1725006999,v1:172.21.15.39:6801/1725006999] conn(0x7f85540a2bb0 0x7f85540a5070 secure :-1 s=READY pgs=215 cs=0 l=1 rev1=1 crypto rx=0x7f856c199400 tx=0x7f8558005f90 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:37:18.905 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:37:18.905+0000 7f8569600640 1 -- 172.21.15.39:0/1410555988 <== mon.0 v2:172.21.15.39:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7f85600bc120 con 0x7f856c101c00 2024-09-12T02:37:18.948 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 12 02:37:18 smithi044 ceph-mon[35411]: pgmap v371: 129 pgs: 129 active+clean; 646 KiB data, 348 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 85 B/s wr, 8 op/s 2024-09-12T02:37:19.106 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:37:19.105+0000 7f8573a00640 1 -- 172.21.15.39:0/1410555988 --> [v2:172.21.15.39:6800/1725006999,v1:172.21.15.39:6801/1725006999] -- mgr_command(tid 0: {"prefix": "orch status", "target": ["mon-mgr", ""]}) -- 0x7f856c062630 con 0x7f85540a2bb0 2024-09-12T02:37:19.107 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:37:19.106+0000 7f8569600640 1 -- 172.21.15.39:0/1410555988 <== mgr.14150 v2:172.21.15.39:6800/1725006999 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+43 (secure 0 0 0) 0x7f856c062630 con 0x7f85540a2bb0 2024-09-12T02:37:19.107 INFO:teuthology.orchestra.run.smithi039.stdout:Backend: cephadm 2024-09-12T02:37:19.107 INFO:teuthology.orchestra.run.smithi039.stdout:Available: Yes 2024-09-12T02:37:19.107 INFO:teuthology.orchestra.run.smithi039.stdout:Paused: No 2024-09-12T02:37:19.109 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:37:19.108+0000 7f8573a00640 1 -- 172.21.15.39:0/1410555988 >> [v2:172.21.15.39:6800/1725006999,v1:172.21.15.39:6801/1725006999] conn(0x7f85540a2bb0 msgr2=0x7f85540a5070 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:37:19.109 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:37:19.108+0000 7f8573a00640 1 --2- 172.21.15.39:0/1410555988 >> [v2:172.21.15.39:6800/1725006999,v1:172.21.15.39:6801/1725006999] conn(0x7f85540a2bb0 0x7f85540a5070 secure :-1 s=READY pgs=215 cs=0 l=1 rev1=1 crypto rx=0x7f856c199400 tx=0x7f8558005f90 comp rx=0 tx=0).stop 2024-09-12T02:37:19.109 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:37:19.108+0000 7f8573a00640 1 -- 172.21.15.39:0/1410555988 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f856c101c00 msgr2=0x7f856c197ee0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:37:19.110 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:37:19.108+0000 7f8573a00640 1 --2- 172.21.15.39:0/1410555988 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f856c101c00 0x7f856c197ee0 secure :-1 s=READY pgs=246 cs=0 l=1 rev1=1 crypto rx=0x7f8560031610 tx=0x7f8560004270 comp rx=0 tx=0).stop 2024-09-12T02:37:19.110 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:37:19.109+0000 7f8573a00640 1 -- 172.21.15.39:0/1410555988 shutdown_connections 2024-09-12T02:37:19.110 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:37:19.109+0000 7f8573a00640 1 --2- 172.21.15.39:0/1410555988 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f856c1037c0 0x7f856c19f4a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:37:19.110 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:37:19.109+0000 7f8573a00640 1 --2- 172.21.15.39:0/1410555988 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f856c102e00 0x7f856c198420 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:37:19.110 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:37:19.109+0000 7f8573a00640 1 --2- 172.21.15.39:0/1410555988 >> [v2:172.21.15.39:6800/1725006999,v1:172.21.15.39:6801/1725006999] conn(0x7f85540a2bb0 0x7f85540a5070 unknown :-1 s=CLOSED pgs=215 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:37:19.110 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:37:19.109+0000 7f8573a00640 1 --2- 172.21.15.39:0/1410555988 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f856c101c00 0x7f856c197ee0 unknown :-1 s=CLOSED pgs=246 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:37:19.110 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:37:19.109+0000 7f8573a00640 1 -- 172.21.15.39:0/1410555988 >> 172.21.15.39:0/1410555988 conn(0x7f856c0fd390 msgr2=0x7f856c106270 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:37:19.110 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:37:19.109+0000 7f8573a00640 1 -- 172.21.15.39:0/1410555988 shutdown_connections 2024-09-12T02:37:19.110 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:37:19.109+0000 7f8573a00640 1 -- 172.21.15.39:0/1410555988 wait complete. 2024-09-12T02:37:19.870 DEBUG:teuthology.orchestra.run.smithi039:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 4954ed46-70ae-11ef-bcea-c7b262605968 -- bash -c 'ceph orch ps' 2024-09-12T02:37:20.248 INFO:teuthology.orchestra.run.smithi039.stderr:Inferring config /var/lib/ceph/4954ed46-70ae-11ef-bcea-c7b262605968/mon.a/config 2024-09-12T02:37:20.719 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 02:37:20 smithi039 ceph-mon[30515]: pgmap v372: 129 pgs: 129 active+clean; 646 KiB data, 348 MiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 682 B/s wr, 12 op/s 2024-09-12T02:37:20.719 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 02:37:20 smithi039 ceph-mon[30515]: from='client.15051 -' entity='client.admin' cmd=[{"prefix": "orch status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-12T02:37:20.763 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 12 02:37:20 smithi172 ceph-mon[35609]: pgmap v372: 129 pgs: 129 active+clean; 646 KiB data, 348 MiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 682 B/s wr, 12 op/s 2024-09-12T02:37:20.763 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 12 02:37:20 smithi172 ceph-mon[35609]: from='client.15051 -' entity='client.admin' cmd=[{"prefix": "orch status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-12T02:37:20.876 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:37:20.834+0000 7f478be00640 1 -- 172.21.15.39:0/623154825 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f478c105810 msgr2=0x7f478c10c0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:37:20.876 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:37:20.834+0000 7f478be00640 1 --2- 172.21.15.39:0/623154825 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f478c105810 0x7f478c10c0a0 secure :-1 s=READY pgs=247 cs=0 l=1 rev1=1 crypto rx=0x7f4784009ca0 tx=0x7f478402a8c0 comp rx=0 tx=0).stop 2024-09-12T02:37:20.876 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:37:20.834+0000 7f478be00640 1 -- 172.21.15.39:0/623154825 shutdown_connections 2024-09-12T02:37:20.876 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:37:20.834+0000 7f478be00640 1 --2- 172.21.15.39:0/623154825 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f478c105810 0x7f478c10c0a0 unknown :-1 s=CLOSED pgs=247 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:37:20.876 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:37:20.834+0000 7f478be00640 1 --2- 172.21.15.39:0/623154825 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f478c104e50 0x7f478c1052d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:37:20.876 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:37:20.834+0000 7f478be00640 1 --2- 172.21.15.39:0/623154825 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f478c103c50 0x7f478c104050 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:37:20.876 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:37:20.834+0000 7f478be00640 1 -- 172.21.15.39:0/623154825 >> 172.21.15.39:0/623154825 conn(0x7f478c0ff3e0 msgr2=0x7f478c101820 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:37:20.877 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:37:20.834+0000 7f478be00640 1 -- 172.21.15.39:0/623154825 shutdown_connections 2024-09-12T02:37:20.877 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:37:20.834+0000 7f478be00640 1 -- 172.21.15.39:0/623154825 wait complete. 2024-09-12T02:37:20.877 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:37:20.835+0000 7f478be00640 1 Processor -- start 2024-09-12T02:37:20.877 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:37:20.835+0000 7f478be00640 1 -- start start 2024-09-12T02:37:20.877 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:37:20.835+0000 7f478be00640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f478c103c50 0x7f478c199ec0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:37:20.877 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:37:20.835+0000 7f478be00640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f478c104e50 0x7f478c19a400 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:37:20.877 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:37:20.835+0000 7f478be00640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f478c105810 0x7f478c1a1480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:37:20.877 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:37:20.835+0000 7f478be00640 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 -- 0x7f478c10f8d0 con 0x7f478c103c50 2024-09-12T02:37:20.877 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:37:20.835+0000 7f478be00640 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x7f478c10f750 con 0x7f478c105810 2024-09-12T02:37:20.877 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:37:20.835+0000 7f478be00640 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7f478c10fa50 con 0x7f478c104e50 2024-09-12T02:37:20.877 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:37:20.836+0000 7f478aa00640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f478c103c50 0x7f478c199ec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:37:20.877 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:37:20.836+0000 7f478b400640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f478c105810 0x7f478c1a1480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:37:20.878 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:37:20.836+0000 7f478a000640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f478c104e50 0x7f478c19a400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:37:20.878 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:37:20.836+0000 7f478aa00640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f478c103c50 0x7f478c199ec0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.39:3300/0 says I am v2:172.21.15.39:37192/0 (socket says 172.21.15.39:37192) 2024-09-12T02:37:20.878 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:37:20.836+0000 7f478b400640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f478c105810 0x7f478c1a1480 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.39:37054/0 (socket says 172.21.15.39:37054) 2024-09-12T02:37:20.878 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:37:20.836+0000 7f478aa00640 1 -- 172.21.15.39:0/1070832762 learned_addr learned my addr 172.21.15.39:0/1070832762 (peer_addr_for_me v2:172.21.15.39:0/0) 2024-09-12T02:37:20.878 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:37:20.836+0000 7f478aa00640 1 -- 172.21.15.39:0/1070832762 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f478c104e50 msgr2=0x7f478c19a400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:37:20.878 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:37:20.836+0000 7f478aa00640 1 --2- 172.21.15.39:0/1070832762 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f478c104e50 0x7f478c19a400 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:37:20.878 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:37:20.836+0000 7f478aa00640 1 -- 172.21.15.39:0/1070832762 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f478c105810 msgr2=0x7f478c1a1480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:37:20.878 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:37:20.836+0000 7f478aa00640 1 --2- 172.21.15.39:0/1070832762 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f478c105810 0x7f478c1a1480 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:37:20.878 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:37:20.836+0000 7f478aa00640 1 -- 172.21.15.39:0/1070832762 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f478c1a1af0 con 0x7f478c103c50 2024-09-12T02:37:20.878 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:37:20.836+0000 7f478aa00640 1 --2- 172.21.15.39:0/1070832762 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f478c103c50 0x7f478c199ec0 secure :-1 s=READY pgs=248 cs=0 l=1 rev1=1 crypto rx=0x7f477c00e9c0 tx=0x7f477c00ee80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:37:20.878 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:37:20.837+0000 7f4783400640 1 -- 172.21.15.39:0/1070832762 <== mon.0 v2:172.21.15.39:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f477c00cd80 con 0x7f478c103c50 2024-09-12T02:37:20.878 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:37:20.837+0000 7f4783400640 1 -- 172.21.15.39:0/1070832762 <== mon.0 v2:172.21.15.39:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f477c0035f0 con 0x7f478c103c50 2024-09-12T02:37:20.878 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:37:20.837+0000 7f4783400640 1 -- 172.21.15.39:0/1070832762 <== mon.0 v2:172.21.15.39:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f477c010690 con 0x7f478c103c50 2024-09-12T02:37:20.878 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:37:20.837+0000 7f478be00640 1 -- 172.21.15.39:0/1070832762 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f478c1a1de0 con 0x7f478c103c50 2024-09-12T02:37:20.879 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:37:20.837+0000 7f478be00640 1 -- 172.21.15.39:0/1070832762 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f478c1a2230 con 0x7f478c103c50 2024-09-12T02:37:20.879 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:37:20.838+0000 7f478be00640 1 -- 172.21.15.39:0/1070832762 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f478c10af80 con 0x7f478c103c50 2024-09-12T02:37:20.879 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:37:20.840+0000 7f4783400640 1 -- 172.21.15.39:0/1070832762 <== mon.0 v2:172.21.15.39:3300/0 4 ==== mgrmap(e 18) ==== 137833+0+0 (secure 0 0 0) 0x7f477c0037a0 con 0x7f478c103c50 2024-09-12T02:37:20.879 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:37:20.841+0000 7f4783400640 1 --2- 172.21.15.39:0/1070832762 >> [v2:172.21.15.39:6800/1725006999,v1:172.21.15.39:6801/1725006999] conn(0x7f47700a2c30 0x7f47700a50f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:37:20.879 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:37:20.841+0000 7f4783400640 1 -- 172.21.15.39:0/1070832762 <== mon.0 v2:172.21.15.39:3300/0 5 ==== osd_map(95..95 src has 1..95) ==== 9129+0+0 (secure 0 0 0) 0x7f477c0cf700 con 0x7f478c103c50 2024-09-12T02:37:20.879 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:37:20.842+0000 7f478a000640 1 --2- 172.21.15.39:0/1070832762 >> [v2:172.21.15.39:6800/1725006999,v1:172.21.15.39:6801/1725006999] conn(0x7f47700a2c30 0x7f47700a50f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:37:20.879 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:37:20.842+0000 7f478a000640 1 --2- 172.21.15.39:0/1070832762 >> [v2:172.21.15.39:6800/1725006999,v1:172.21.15.39:6801/1725006999] conn(0x7f47700a2c30 0x7f47700a50f0 secure :-1 s=READY pgs=216 cs=0 l=1 rev1=1 crypto rx=0x7f478c19b3e0 tx=0x7f4778005f90 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:37:20.879 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:37:20.843+0000 7f4783400640 1 -- 172.21.15.39:0/1070832762 <== mon.0 v2:172.21.15.39:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7f477c09c280 con 0x7f478c103c50 2024-09-12T02:37:20.948 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 12 02:37:20 smithi044 ceph-mon[35411]: pgmap v372: 129 pgs: 129 active+clean; 646 KiB data, 348 MiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 682 B/s wr, 12 op/s 2024-09-12T02:37:20.948 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 12 02:37:20 smithi044 ceph-mon[35411]: from='client.15051 -' entity='client.admin' cmd=[{"prefix": "orch status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-12T02:37:21.037 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:37:21.036+0000 7f478be00640 1 -- 172.21.15.39:0/1070832762 --> [v2:172.21.15.39:6800/1725006999,v1:172.21.15.39:6801/1725006999] -- mgr_command(tid 0: {"prefix": "orch ps", "target": ["mon-mgr", ""]}) -- 0x7f478c062630 con 0x7f47700a2c30 2024-09-12T02:37:21.052 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:37:21.051+0000 7f4783400640 1 -- 172.21.15.39:0/1070832762 <== mgr.14150 v2:172.21.15.39:6800/1725006999 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+4092 (secure 0 0 0) 0x7f478c062630 con 0x7f47700a2c30 2024-09-12T02:37:21.052 INFO:teuthology.orchestra.run.smithi039.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2024-09-12T02:37:21.052 INFO:teuthology.orchestra.run.smithi039.stdout:mds.a smithi039 running (2m) 12s ago 2m 16.6M - 19.1.1-298-gb53b6d3e 54467abc55f8 47f9ba6d6ffa 2024-09-12T02:37:21.052 INFO:teuthology.orchestra.run.smithi039.stdout:mds.b smithi044 running (2m) 15s ago 2m 26.5M - 19.1.1-298-gb53b6d3e 54467abc55f8 77d1fe5b803d 2024-09-12T02:37:21.052 INFO:teuthology.orchestra.run.smithi039.stdout:mds.c smithi172 running (2m) 15s ago 2m 19.3M - 19.1.1-298-gb53b6d3e 54467abc55f8 ff35a3c0915d 2024-09-12T02:37:21.052 INFO:teuthology.orchestra.run.smithi039.stdout:mds.d smithi039 running (2m) 12s ago 2m 16.8M - 19.1.1-298-gb53b6d3e 54467abc55f8 f31fd87cec94 2024-09-12T02:37:21.053 INFO:teuthology.orchestra.run.smithi039.stdout:mds.e smithi044 running (2m) 15s ago 2m 21.7M - 19.1.1-298-gb53b6d3e 54467abc55f8 12f1740ebc2c 2024-09-12T02:37:21.053 INFO:teuthology.orchestra.run.smithi039.stdout:mds.f smithi172 running (2m) 15s ago 2m 18.4M - 19.1.1-298-gb53b6d3e 54467abc55f8 054236d1dd92 2024-09-12T02:37:21.053 INFO:teuthology.orchestra.run.smithi039.stdout:mds.g smithi039 running (2m) 12s ago 2m 13.0M - 19.1.1-298-gb53b6d3e 54467abc55f8 13f74e89fc49 2024-09-12T02:37:21.053 INFO:teuthology.orchestra.run.smithi039.stdout:mds.h smithi044 running (2m) 15s ago 2m 20.6M - 19.1.1-298-gb53b6d3e 54467abc55f8 6a8800c1dc39 2024-09-12T02:37:21.053 INFO:teuthology.orchestra.run.smithi039.stdout:mds.i smithi172 running (2m) 15s ago 2m 18.3M - 19.1.1-298-gb53b6d3e 54467abc55f8 54587d5ab57b 2024-09-12T02:37:21.054 INFO:teuthology.orchestra.run.smithi039.stdout:mds.j smithi039 running (2m) 12s ago 2m 13.2M - 19.1.1-298-gb53b6d3e 54467abc55f8 80f513251c79 2024-09-12T02:37:21.054 INFO:teuthology.orchestra.run.smithi039.stdout:mds.k smithi044 running (3m) 15s ago 3m 18.6M - 19.1.1-298-gb53b6d3e 54467abc55f8 d6812fe96b08 2024-09-12T02:37:21.054 INFO:teuthology.orchestra.run.smithi039.stdout:mds.l smithi172 running (3m) 15s ago 3m 20.6M - 19.1.1-298-gb53b6d3e 54467abc55f8 0d261ee5edd6 2024-09-12T02:37:21.054 INFO:teuthology.orchestra.run.smithi039.stdout:mgr.x smithi039 *:9283,8765 running (10m) 12s ago 10m 512M - 19.1.1-298-gb53b6d3e 54467abc55f8 3e91a1d13a6a 2024-09-12T02:37:21.054 INFO:teuthology.orchestra.run.smithi039.stdout:mgr.y smithi044 *:8443,8765 running (8m) 15s ago 8m 444M - 19.1.1-298-gb53b6d3e 54467abc55f8 3fe9c80a9d1e 2024-09-12T02:37:21.054 INFO:teuthology.orchestra.run.smithi039.stdout:mgr.z smithi172 *:8443,8765 running (8m) 15s ago 8m 442M - 19.1.1-298-gb53b6d3e 54467abc55f8 650e5692e1e1 2024-09-12T02:37:21.054 INFO:teuthology.orchestra.run.smithi039.stdout:mon.a smithi039 running (10m) 12s ago 10m 50.5M 2048M 19.1.1-298-gb53b6d3e 54467abc55f8 aa6e01b76020 2024-09-12T02:37:21.054 INFO:teuthology.orchestra.run.smithi039.stdout:mon.b smithi044 running (8m) 15s ago 8m 40.8M 2048M 19.1.1-298-gb53b6d3e 54467abc55f8 41838f02b634 2024-09-12T02:37:21.054 INFO:teuthology.orchestra.run.smithi039.stdout:mon.c smithi172 running (8m) 15s ago 8m 44.2M 2048M 19.1.1-298-gb53b6d3e 54467abc55f8 d652d920a681 2024-09-12T02:37:21.054 INFO:teuthology.orchestra.run.smithi039.stdout:osd.0 smithi039 running (8m) 12s ago 8m 54.0M 4272M 19.1.1-298-gb53b6d3e 54467abc55f8 b108ae4a0fad 2024-09-12T02:37:21.055 INFO:teuthology.orchestra.run.smithi039.stdout:osd.1 smithi044 running (7m) 15s ago 7m 48.7M 4273M 19.1.1-298-gb53b6d3e 54467abc55f8 d4a646ebe6d2 2024-09-12T02:37:21.055 INFO:teuthology.orchestra.run.smithi039.stdout:osd.2 smithi172 running (7m) 15s ago 7m 48.0M 4272M 19.1.1-298-gb53b6d3e 54467abc55f8 3a7c026a60e6 2024-09-12T02:37:21.055 INFO:teuthology.orchestra.run.smithi039.stdout:osd.3 smithi039 running (6m) 12s ago 6m 51.7M 4272M 19.1.1-298-gb53b6d3e 54467abc55f8 37956a8e817d 2024-09-12T02:37:21.055 INFO:teuthology.orchestra.run.smithi039.stdout:osd.4 smithi044 running (6m) 15s ago 6m 52.0M 4273M 19.1.1-298-gb53b6d3e 54467abc55f8 170c6c067d69 2024-09-12T02:37:21.055 INFO:teuthology.orchestra.run.smithi039.stdout:osd.5 smithi172 running (6m) 15s ago 6m 46.4M 4272M 19.1.1-298-gb53b6d3e 54467abc55f8 8834aaa6db4c 2024-09-12T02:37:21.055 INFO:teuthology.orchestra.run.smithi039.stdout:osd.6 smithi039 running (5m) 12s ago 5m 41.9M 4272M 19.1.1-298-gb53b6d3e 54467abc55f8 70820e943ccf 2024-09-12T02:37:21.055 INFO:teuthology.orchestra.run.smithi039.stdout:osd.7 smithi044 running (5m) 15s ago 5m 50.0M 4273M 19.1.1-298-gb53b6d3e 54467abc55f8 1d0e8149735b 2024-09-12T02:37:21.055 INFO:teuthology.orchestra.run.smithi039.stdout:osd.8 smithi172 running (4m) 15s ago 4m 43.8M 4272M 19.1.1-298-gb53b6d3e 54467abc55f8 df0d5430fa53 2024-09-12T02:37:21.055 INFO:teuthology.orchestra.run.smithi039.stdout:osd.9 smithi039 running (4m) 12s ago 4m 41.8M 4272M 19.1.1-298-gb53b6d3e 54467abc55f8 420838e298d7 2024-09-12T02:37:21.055 INFO:teuthology.orchestra.run.smithi039.stdout:osd.10 smithi044 running (3m) 15s ago 3m 47.4M 4273M 19.1.1-298-gb53b6d3e 54467abc55f8 bb8ceaa43dd4 2024-09-12T02:37:21.055 INFO:teuthology.orchestra.run.smithi039.stdout:osd.11 smithi172 running (3m) 15s ago 3m 42.8M 4272M 19.1.1-298-gb53b6d3e 54467abc55f8 4b56ef31936e 2024-09-12T02:37:21.056 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:37:21.053+0000 7f478be00640 1 -- 172.21.15.39:0/1070832762 >> [v2:172.21.15.39:6800/1725006999,v1:172.21.15.39:6801/1725006999] conn(0x7f47700a2c30 msgr2=0x7f47700a50f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:37:21.056 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:37:21.053+0000 7f478be00640 1 --2- 172.21.15.39:0/1070832762 >> [v2:172.21.15.39:6800/1725006999,v1:172.21.15.39:6801/1725006999] conn(0x7f47700a2c30 0x7f47700a50f0 secure :-1 s=READY pgs=216 cs=0 l=1 rev1=1 crypto rx=0x7f478c19b3e0 tx=0x7f4778005f90 comp rx=0 tx=0).stop 2024-09-12T02:37:21.056 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:37:21.053+0000 7f478be00640 1 -- 172.21.15.39:0/1070832762 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f478c103c50 msgr2=0x7f478c199ec0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:37:21.056 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:37:21.053+0000 7f478be00640 1 --2- 172.21.15.39:0/1070832762 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f478c103c50 0x7f478c199ec0 secure :-1 s=READY pgs=248 cs=0 l=1 rev1=1 crypto rx=0x7f477c00e9c0 tx=0x7f477c00ee80 comp rx=0 tx=0).stop 2024-09-12T02:37:21.056 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:37:21.053+0000 7f478be00640 1 -- 172.21.15.39:0/1070832762 shutdown_connections 2024-09-12T02:37:21.056 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:37:21.053+0000 7f478be00640 1 --2- 172.21.15.39:0/1070832762 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f478c105810 0x7f478c1a1480 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:37:21.057 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:37:21.053+0000 7f478be00640 1 --2- 172.21.15.39:0/1070832762 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f478c104e50 0x7f478c19a400 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:37:21.057 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:37:21.053+0000 7f478be00640 1 --2- 172.21.15.39:0/1070832762 >> [v2:172.21.15.39:6800/1725006999,v1:172.21.15.39:6801/1725006999] conn(0x7f47700a2c30 0x7f47700a50f0 unknown :-1 s=CLOSED pgs=216 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:37:21.057 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:37:21.053+0000 7f478be00640 1 --2- 172.21.15.39:0/1070832762 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f478c103c50 0x7f478c199ec0 unknown :-1 s=CLOSED pgs=248 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:37:21.057 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:37:21.053+0000 7f478be00640 1 -- 172.21.15.39:0/1070832762 >> 172.21.15.39:0/1070832762 conn(0x7f478c0ff3e0 msgr2=0x7f478c108150 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:37:21.057 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:37:21.054+0000 7f478be00640 1 -- 172.21.15.39:0/1070832762 shutdown_connections 2024-09-12T02:37:21.057 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:37:21.054+0000 7f478be00640 1 -- 172.21.15.39:0/1070832762 wait complete. 2024-09-12T02:37:21.803 DEBUG:teuthology.orchestra.run.smithi039:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 4954ed46-70ae-11ef-bcea-c7b262605968 -- bash -c 'ceph orch ls' 2024-09-12T02:37:22.180 INFO:teuthology.orchestra.run.smithi039.stderr:Inferring config /var/lib/ceph/4954ed46-70ae-11ef-bcea-c7b262605968/mon.a/config 2024-09-12T02:37:22.592 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 02:37:22 smithi039 ceph-mon[30515]: pgmap v373: 129 pgs: 129 active+clean; 646 KiB data, 348 MiB used, 1.0 TiB / 1.0 TiB avail; 4.9 KiB/s rd, 767 B/s wr, 10 op/s 2024-09-12T02:37:22.592 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 02:37:22 smithi039 ceph-mon[30515]: from='client.15057 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-09-12T02:37:22.763 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 12 02:37:22 smithi172 ceph-mon[35609]: pgmap v373: 129 pgs: 129 active+clean; 646 KiB data, 348 MiB used, 1.0 TiB / 1.0 TiB avail; 4.9 KiB/s rd, 767 B/s wr, 10 op/s 2024-09-12T02:37:22.763 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 12 02:37:22 smithi172 ceph-mon[35609]: from='client.15057 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-09-12T02:37:22.867 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:37:22.866+0000 7f3548a00640 1 -- 172.21.15.39:0/2835356063 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f3544101a40 msgr2=0x7f3544101e40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:37:22.868 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:37:22.866+0000 7f3548a00640 1 --2- 172.21.15.39:0/2835356063 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f3544101a40 0x7f3544101e40 secure :-1 s=READY pgs=249 cs=0 l=1 rev1=1 crypto rx=0x7f3534009900 tx=0x7f353402a410 comp rx=0 tx=0).stop 2024-09-12T02:37:22.868 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:37:22.866+0000 7f3548a00640 1 -- 172.21.15.39:0/2835356063 shutdown_connections 2024-09-12T02:37:22.868 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:37:22.866+0000 7f3548a00640 1 --2- 172.21.15.39:0/2835356063 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f3544103600 0x7f3544109e90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:37:22.868 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:37:22.866+0000 7f3548a00640 1 --2- 172.21.15.39:0/2835356063 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f3544102c40 0x7f35441030c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:37:22.868 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:37:22.866+0000 7f3548a00640 1 --2- 172.21.15.39:0/2835356063 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f3544101a40 0x7f3544101e40 unknown :-1 s=CLOSED pgs=249 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:37:22.868 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:37:22.866+0000 7f3548a00640 1 -- 172.21.15.39:0/2835356063 >> 172.21.15.39:0/2835356063 conn(0x7f35440fd1f0 msgr2=0x7f35440ff610 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:37:22.868 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:37:22.866+0000 7f3548a00640 1 -- 172.21.15.39:0/2835356063 shutdown_connections 2024-09-12T02:37:22.868 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:37:22.866+0000 7f3548a00640 1 -- 172.21.15.39:0/2835356063 wait complete. 2024-09-12T02:37:22.869 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:37:22.867+0000 7f3548a00640 1 Processor -- start 2024-09-12T02:37:22.869 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:37:22.868+0000 7f3548a00640 1 -- start start 2024-09-12T02:37:22.869 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:37:22.868+0000 7f3548a00640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f3544101a40 0x7f3544197d40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:37:22.870 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:37:22.868+0000 7f3548a00640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f3544102c40 0x7f3544198280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:37:22.870 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:37:22.868+0000 7f3548a00640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f3544103600 0x7f354419f2c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:37:22.870 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:37:22.868+0000 7f3548a00640 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 -- 0x7f354410d6a0 con 0x7f3544102c40 2024-09-12T02:37:22.870 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:37:22.868+0000 7f3548a00640 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x7f354410d520 con 0x7f3544103600 2024-09-12T02:37:22.870 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:37:22.868+0000 7f3548a00640 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7f354410d820 con 0x7f3544101a40 2024-09-12T02:37:22.870 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:37:22.868+0000 7f3542a00640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f3544102c40 0x7f3544198280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:37:22.870 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:37:22.868+0000 7f3543e00640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f3544103600 0x7f354419f2c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:37:22.870 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:37:22.868+0000 7f3543e00640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f3544103600 0x7f354419f2c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.39:37078/0 (socket says 172.21.15.39:37078) 2024-09-12T02:37:22.870 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:37:22.868+0000 7f3543e00640 1 -- 172.21.15.39:0/1346628767 learned_addr learned my addr 172.21.15.39:0/1346628767 (peer_addr_for_me v2:172.21.15.39:0/0) 2024-09-12T02:37:22.870 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:37:22.868+0000 7f3543400640 1 --2- 172.21.15.39:0/1346628767 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f3544101a40 0x7f3544197d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:37:22.870 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:37:22.869+0000 7f3542a00640 1 -- 172.21.15.39:0/1346628767 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f3544101a40 msgr2=0x7f3544197d40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:37:22.870 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:37:22.869+0000 7f3542a00640 1 --2- 172.21.15.39:0/1346628767 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f3544101a40 0x7f3544197d40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:37:22.870 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:37:22.869+0000 7f3542a00640 1 -- 172.21.15.39:0/1346628767 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f3544103600 msgr2=0x7f354419f2c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:37:22.870 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:37:22.869+0000 7f3542a00640 1 --2- 172.21.15.39:0/1346628767 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f3544103600 0x7f354419f2c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:37:22.871 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:37:22.869+0000 7f3542a00640 1 -- 172.21.15.39:0/1346628767 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f354419f960 con 0x7f3544102c40 2024-09-12T02:37:22.871 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:37:22.869+0000 7f3543e00640 1 --2- 172.21.15.39:0/1346628767 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f3544103600 0x7f354419f2c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-12T02:37:22.871 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:37:22.869+0000 7f3542a00640 1 --2- 172.21.15.39:0/1346628767 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f3544102c40 0x7f3544198280 secure :-1 s=READY pgs=250 cs=0 l=1 rev1=1 crypto rx=0x7f353000e9f0 tx=0x7f353000eeb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:37:22.872 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:37:22.869+0000 7f353be00640 1 -- 172.21.15.39:0/1346628767 <== mon.0 v2:172.21.15.39:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f353000ccc0 con 0x7f3544102c40 2024-09-12T02:37:22.872 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:37:22.869+0000 7f353be00640 1 -- 172.21.15.39:0/1346628767 <== mon.0 v2:172.21.15.39:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f3530010910 con 0x7f3544102c40 2024-09-12T02:37:22.872 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:37:22.869+0000 7f3548a00640 1 -- 172.21.15.39:0/1346628767 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f354419fc50 con 0x7f3544102c40 2024-09-12T02:37:22.872 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:37:22.869+0000 7f353be00640 1 -- 172.21.15.39:0/1346628767 <== mon.0 v2:172.21.15.39:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3530018960 con 0x7f3544102c40 2024-09-12T02:37:22.872 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:37:22.869+0000 7f3548a00640 1 -- 172.21.15.39:0/1346628767 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f35441a01b0 con 0x7f3544102c40 2024-09-12T02:37:22.872 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:37:22.870+0000 7f3548a00640 1 -- 172.21.15.39:0/1346628767 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f3544108e40 con 0x7f3544102c40 2024-09-12T02:37:22.874 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:37:22.873+0000 7f353be00640 1 -- 172.21.15.39:0/1346628767 <== mon.0 v2:172.21.15.39:3300/0 4 ==== mgrmap(e 18) ==== 137833+0+0 (secure 0 0 0) 0x7f3530010ac0 con 0x7f3544102c40 2024-09-12T02:37:22.875 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:37:22.874+0000 7f353be00640 1 --2- 172.21.15.39:0/1346628767 >> [v2:172.21.15.39:6800/1725006999,v1:172.21.15.39:6801/1725006999] conn(0x7f35280a2c00 0x7f35280a50c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:37:22.875 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:37:22.875+0000 7f353be00640 1 -- 172.21.15.39:0/1346628767 <== mon.0 v2:172.21.15.39:3300/0 5 ==== osd_map(95..95 src has 1..95) ==== 9129+0+0 (secure 0 0 0) 0x7f35300cfbc0 con 0x7f3544102c40 2024-09-12T02:37:22.875 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:37:22.875+0000 7f3543400640 1 --2- 172.21.15.39:0/1346628767 >> [v2:172.21.15.39:6800/1725006999,v1:172.21.15.39:6801/1725006999] conn(0x7f35280a2c00 0x7f35280a50c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:37:22.876 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:37:22.875+0000 7f3543400640 1 --2- 172.21.15.39:0/1346628767 >> [v2:172.21.15.39:6800/1725006999,v1:172.21.15.39:6801/1725006999] conn(0x7f35280a2c00 0x7f35280a50c0 secure :-1 s=READY pgs=217 cs=0 l=1 rev1=1 crypto rx=0x7f3534005ab0 tx=0x7f3534000bc0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:37:22.877 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:37:22.876+0000 7f353be00640 1 -- 172.21.15.39:0/1346628767 <== mon.0 v2:172.21.15.39:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7f353009c0f0 con 0x7f3544102c40 2024-09-12T02:37:22.948 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 12 02:37:22 smithi044 ceph-mon[35411]: pgmap v373: 129 pgs: 129 active+clean; 646 KiB data, 348 MiB used, 1.0 TiB / 1.0 TiB avail; 4.9 KiB/s rd, 767 B/s wr, 10 op/s 2024-09-12T02:37:22.948 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 12 02:37:22 smithi044 ceph-mon[35411]: from='client.15057 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-09-12T02:37:23.071 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:37:23.070+0000 7f3548a00640 1 -- 172.21.15.39:0/1346628767 --> [v2:172.21.15.39:6800/1725006999,v1:172.21.15.39:6801/1725006999] -- mgr_command(tid 0: {"prefix": "orch ls", "target": ["mon-mgr", ""]}) -- 0x7f3544062630 con 0x7f35280a2c00 2024-09-12T02:37:23.077 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:37:23.076+0000 7f353be00640 1 -- 172.21.15.39:0/1346628767 <== mgr.14150 v2:172.21.15.39:6800/1725006999 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+980 (secure 0 0 0) 0x7f3544062630 con 0x7f35280a2c00 2024-09-12T02:37:23.077 INFO:teuthology.orchestra.run.smithi039.stdout:NAME PORTS RUNNING REFRESHED AGE PLACEMENT 2024-09-12T02:37:23.077 INFO:teuthology.orchestra.run.smithi039.stdout:mds.all 12/12 17s ago 3m smithi039=a;smithi039=d;smithi039=g;smithi039=j;smithi044=b;smithi044=e;smithi044=h;smithi044=k;smithi172=c;smithi172=f;smithi172=i;smithi172=l;count:12 2024-09-12T02:37:23.077 INFO:teuthology.orchestra.run.smithi039.stdout:mgr 3/3 17s ago 8m smithi039=x;smithi044=y;smithi172=z;count:3 2024-09-12T02:37:23.077 INFO:teuthology.orchestra.run.smithi039.stdout:mon 3/3 17s ago 9m smithi039:172.21.15.39=a;smithi044:172.21.15.44=b;smithi172:172.21.15.172=c;count:3 2024-09-12T02:37:23.077 INFO:teuthology.orchestra.run.smithi039.stdout:osd 12 17s ago - 2024-09-12T02:37:23.079 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:37:23.078+0000 7f3548a00640 1 -- 172.21.15.39:0/1346628767 >> [v2:172.21.15.39:6800/1725006999,v1:172.21.15.39:6801/1725006999] conn(0x7f35280a2c00 msgr2=0x7f35280a50c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:37:23.079 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:37:23.078+0000 7f3548a00640 1 --2- 172.21.15.39:0/1346628767 >> [v2:172.21.15.39:6800/1725006999,v1:172.21.15.39:6801/1725006999] conn(0x7f35280a2c00 0x7f35280a50c0 secure :-1 s=READY pgs=217 cs=0 l=1 rev1=1 crypto rx=0x7f3534005ab0 tx=0x7f3534000bc0 comp rx=0 tx=0).stop 2024-09-12T02:37:23.079 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:37:23.078+0000 7f3548a00640 1 -- 172.21.15.39:0/1346628767 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f3544102c40 msgr2=0x7f3544198280 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:37:23.079 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:37:23.078+0000 7f3548a00640 1 --2- 172.21.15.39:0/1346628767 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f3544102c40 0x7f3544198280 secure :-1 s=READY pgs=250 cs=0 l=1 rev1=1 crypto rx=0x7f353000e9f0 tx=0x7f353000eeb0 comp rx=0 tx=0).stop 2024-09-12T02:37:23.080 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:37:23.078+0000 7f3548a00640 1 -- 172.21.15.39:0/1346628767 shutdown_connections 2024-09-12T02:37:23.080 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:37:23.078+0000 7f3548a00640 1 --2- 172.21.15.39:0/1346628767 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f3544103600 0x7f354419f2c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:37:23.080 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:37:23.078+0000 7f3548a00640 1 --2- 172.21.15.39:0/1346628767 >> [v2:172.21.15.39:6800/1725006999,v1:172.21.15.39:6801/1725006999] conn(0x7f35280a2c00 0x7f35280a50c0 unknown :-1 s=CLOSED pgs=217 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:37:23.080 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:37:23.078+0000 7f3548a00640 1 --2- 172.21.15.39:0/1346628767 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f3544102c40 0x7f3544198280 unknown :-1 s=CLOSED pgs=250 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:37:23.080 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:37:23.078+0000 7f3548a00640 1 --2- 172.21.15.39:0/1346628767 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f3544101a40 0x7f3544197d40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:37:23.080 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:37:23.078+0000 7f3548a00640 1 -- 172.21.15.39:0/1346628767 >> 172.21.15.39:0/1346628767 conn(0x7f35440fd1f0 msgr2=0x7f3544106010 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:37:23.080 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:37:23.078+0000 7f3548a00640 1 -- 172.21.15.39:0/1346628767 shutdown_connections 2024-09-12T02:37:23.080 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:37:23.078+0000 7f3548a00640 1 -- 172.21.15.39:0/1346628767 wait complete. 2024-09-12T02:37:23.852 DEBUG:teuthology.orchestra.run.smithi039:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 4954ed46-70ae-11ef-bcea-c7b262605968 -- bash -c 'ceph orch host ls' 2024-09-12T02:37:24.233 INFO:teuthology.orchestra.run.smithi039.stderr:Inferring config /var/lib/ceph/4954ed46-70ae-11ef-bcea-c7b262605968/mon.a/config 2024-09-12T02:37:24.710 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 02:37:24 smithi039 ceph-mon[30515]: pgmap v374: 129 pgs: 129 active+clean; 646 KiB data, 348 MiB used, 1.0 TiB / 1.0 TiB avail; 4.5 KiB/s rd, 767 B/s wr, 9 op/s 2024-09-12T02:37:24.710 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 02:37:24 smithi039 ceph-mon[30515]: from='client.15063 -' entity='client.admin' cmd=[{"prefix": "orch ls", "target": ["mon-mgr", ""]}]: dispatch 2024-09-12T02:37:24.763 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 12 02:37:24 smithi172 ceph-mon[35609]: pgmap v374: 129 pgs: 129 active+clean; 646 KiB data, 348 MiB used, 1.0 TiB / 1.0 TiB avail; 4.5 KiB/s rd, 767 B/s wr, 9 op/s 2024-09-12T02:37:24.763 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 12 02:37:24 smithi172 ceph-mon[35609]: from='client.15063 -' entity='client.admin' cmd=[{"prefix": "orch ls", "target": ["mon-mgr", ""]}]: dispatch 2024-09-12T02:37:24.826 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:37:24.824+0000 7f34b9400640 1 -- 172.21.15.39:0/2846822405 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f34b4076220 msgr2=0x7f34b4074680 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:37:24.826 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:37:24.824+0000 7f34b9400640 1 --2- 172.21.15.39:0/2846822405 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f34b4076220 0x7f34b4074680 secure :-1 s=READY pgs=251 cs=0 l=1 rev1=1 crypto rx=0x7f34a4009900 tx=0x7f34a402a3f0 comp rx=0 tx=0).stop 2024-09-12T02:37:24.826 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:37:24.824+0000 7f34b9400640 1 -- 172.21.15.39:0/2846822405 shutdown_connections 2024-09-12T02:37:24.826 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:37:24.824+0000 7f34b9400640 1 --2- 172.21.15.39:0/2846822405 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f34b410e1e0 0x7f34b41105d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:37:24.826 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:37:24.824+0000 7f34b9400640 1 --2- 172.21.15.39:0/2846822405 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f34b4074c50 0x7f34b40750b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:37:24.826 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:37:24.824+0000 7f34b9400640 1 --2- 172.21.15.39:0/2846822405 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f34b4076220 0x7f34b4074680 unknown :-1 s=CLOSED pgs=251 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:37:24.826 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:37:24.824+0000 7f34b9400640 1 -- 172.21.15.39:0/2846822405 >> 172.21.15.39:0/2846822405 conn(0x7f34b40fd390 msgr2=0x7f34b40ff7d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:37:24.826 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:37:24.825+0000 7f34b9400640 1 -- 172.21.15.39:0/2846822405 shutdown_connections 2024-09-12T02:37:24.826 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:37:24.825+0000 7f34b9400640 1 -- 172.21.15.39:0/2846822405 wait complete. 2024-09-12T02:37:24.828 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:37:24.825+0000 7f34b9400640 1 Processor -- start 2024-09-12T02:37:24.828 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:37:24.826+0000 7f34b9400640 1 -- start start 2024-09-12T02:37:24.828 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:37:24.826+0000 7f34b9400640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f34b4074c50 0x7f34b419e550 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:37:24.828 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:37:24.826+0000 7f34b9400640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f34b4076220 0x7f34b419ea90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:37:24.828 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:37:24.826+0000 7f34b9400640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f34b410e1e0 0x7f34b41a5b10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:37:24.828 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:37:24.826+0000 7f34b9400640 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 -- 0x7f34b4113ef0 con 0x7f34b410e1e0 2024-09-12T02:37:24.829 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:37:24.826+0000 7f34b9400640 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x7f34b4113d70 con 0x7f34b4074c50 2024-09-12T02:37:24.829 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:37:24.826+0000 7f34b9400640 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7f34b4114070 con 0x7f34b4076220 2024-09-12T02:37:24.829 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:37:24.826+0000 7f34abe00640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f34b4076220 0x7f34b419ea90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:37:24.829 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:37:24.826+0000 7f34abe00640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f34b4076220 0x7f34b419ea90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.172:3300/0 says I am v2:172.21.15.39:60066/0 (socket says 172.21.15.39:60066) 2024-09-12T02:37:24.829 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:37:24.826+0000 7f34abe00640 1 -- 172.21.15.39:0/489593069 learned_addr learned my addr 172.21.15.39:0/489593069 (peer_addr_for_me v2:172.21.15.39:0/0) 2024-09-12T02:37:24.829 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:37:24.826+0000 7f34b3200640 1 --2- 172.21.15.39:0/489593069 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f34b410e1e0 0x7f34b41a5b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:37:24.829 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:37:24.826+0000 7f34b2800640 1 --2- 172.21.15.39:0/489593069 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f34b4074c50 0x7f34b419e550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:37:24.829 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:37:24.827+0000 7f34abe00640 1 -- 172.21.15.39:0/489593069 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f34b4074c50 msgr2=0x7f34b419e550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:37:24.829 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:37:24.827+0000 7f34abe00640 1 --2- 172.21.15.39:0/489593069 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f34b4074c50 0x7f34b419e550 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:37:24.829 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:37:24.827+0000 7f34abe00640 1 -- 172.21.15.39:0/489593069 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f34b410e1e0 msgr2=0x7f34b41a5b10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:37:24.829 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:37:24.827+0000 7f34abe00640 1 --2- 172.21.15.39:0/489593069 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f34b410e1e0 0x7f34b41a5b10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:37:24.829 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:37:24.827+0000 7f34abe00640 1 -- 172.21.15.39:0/489593069 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f34b41a6180 con 0x7f34b4076220 2024-09-12T02:37:24.830 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:37:24.827+0000 7f34abe00640 1 --2- 172.21.15.39:0/489593069 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f34b4076220 0x7f34b419ea90 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0x7f349c00e9f0 tx=0x7f349c00edf0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:37:24.830 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:37:24.827+0000 7f34ab400640 1 -- 172.21.15.39:0/489593069 <== mon.1 v2:172.21.15.172:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f349c00cd80 con 0x7f34b4076220 2024-09-12T02:37:24.830 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:37:24.827+0000 7f34ab400640 1 -- 172.21.15.39:0/489593069 <== mon.1 v2:172.21.15.172:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f349c005500 con 0x7f34b4076220 2024-09-12T02:37:24.830 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:37:24.827+0000 7f34b9400640 1 -- 172.21.15.39:0/489593069 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f34b41a6470 con 0x7f34b4076220 2024-09-12T02:37:24.830 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:37:24.827+0000 7f34ab400640 1 -- 172.21.15.39:0/489593069 <== mon.1 v2:172.21.15.172:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f349c010690 con 0x7f34b4076220 2024-09-12T02:37:24.830 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:37:24.827+0000 7f34b9400640 1 -- 172.21.15.39:0/489593069 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f34b41a6960 con 0x7f34b4076220 2024-09-12T02:37:24.830 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:37:24.828+0000 7f34b9400640 1 -- 172.21.15.39:0/489593069 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f34b4104290 con 0x7f34b4076220 2024-09-12T02:37:24.832 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:37:24.831+0000 7f34ab400640 1 -- 172.21.15.39:0/489593069 <== mon.1 v2:172.21.15.172:3300/0 4 ==== mgrmap(e 18) ==== 137833+0+0 (secure 0 0 0) 0x7f349c0046c0 con 0x7f34b4076220 2024-09-12T02:37:24.833 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:37:24.832+0000 7f34ab400640 1 --2- 172.21.15.39:0/489593069 >> [v2:172.21.15.39:6800/1725006999,v1:172.21.15.39:6801/1725006999] conn(0x7f34980a2bb0 0x7f34980a5070 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:37:24.833 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:37:24.833+0000 7f34ab400640 1 -- 172.21.15.39:0/489593069 <== mon.1 v2:172.21.15.172:3300/0 5 ==== osd_map(95..95 src has 1..95) ==== 9129+0+0 (secure 0 0 0) 0x7f349c0cfa20 con 0x7f34b4076220 2024-09-12T02:37:24.833 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:37:24.833+0000 7f34b2800640 1 --2- 172.21.15.39:0/489593069 >> [v2:172.21.15.39:6800/1725006999,v1:172.21.15.39:6801/1725006999] conn(0x7f34980a2bb0 0x7f34980a5070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:37:24.834 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:37:24.833+0000 7f34b2800640 1 --2- 172.21.15.39:0/489593069 >> [v2:172.21.15.39:6800/1725006999,v1:172.21.15.39:6801/1725006999] conn(0x7f34980a2bb0 0x7f34980a5070 secure :-1 s=READY pgs=218 cs=0 l=1 rev1=1 crypto rx=0x7f34a402a9e0 tx=0x7f34a40315b0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:37:24.834 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:37:24.834+0000 7f34ab400640 1 -- 172.21.15.39:0/489593069 <== mon.1 v2:172.21.15.172:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7f349c0541b0 con 0x7f34b4076220 2024-09-12T02:37:24.948 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 12 02:37:24 smithi044 ceph-mon[35411]: pgmap v374: 129 pgs: 129 active+clean; 646 KiB data, 348 MiB used, 1.0 TiB / 1.0 TiB avail; 4.5 KiB/s rd, 767 B/s wr, 9 op/s 2024-09-12T02:37:24.948 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 12 02:37:24 smithi044 ceph-mon[35411]: from='client.15063 -' entity='client.admin' cmd=[{"prefix": "orch ls", "target": ["mon-mgr", ""]}]: dispatch 2024-09-12T02:37:25.024 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:37:25.023+0000 7f34b9400640 1 -- 172.21.15.39:0/489593069 --> [v2:172.21.15.39:6800/1725006999,v1:172.21.15.39:6801/1725006999] -- mgr_command(tid 0: {"prefix": "orch host ls", "target": ["mon-mgr", ""]}) -- 0x7f34b4062630 con 0x7f34980a2bb0 2024-09-12T02:37:25.026 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:37:25.025+0000 7f34ab400640 1 -- 172.21.15.39:0/489593069 <== mgr.14150 v2:172.21.15.39:6800/1725006999 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+191 (secure 0 0 0) 0x7f34b4062630 con 0x7f34980a2bb0 2024-09-12T02:37:25.026 INFO:teuthology.orchestra.run.smithi039.stdout:HOST ADDR LABELS STATUS 2024-09-12T02:37:25.026 INFO:teuthology.orchestra.run.smithi039.stdout:smithi039 172.21.15.39 2024-09-12T02:37:25.026 INFO:teuthology.orchestra.run.smithi039.stdout:smithi044 172.21.15.44 2024-09-12T02:37:25.026 INFO:teuthology.orchestra.run.smithi039.stdout:smithi172 172.21.15.172 2024-09-12T02:37:25.026 INFO:teuthology.orchestra.run.smithi039.stdout:3 hosts in cluster 2024-09-12T02:37:25.029 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:37:25.028+0000 7f34b9400640 1 -- 172.21.15.39:0/489593069 >> [v2:172.21.15.39:6800/1725006999,v1:172.21.15.39:6801/1725006999] conn(0x7f34980a2bb0 msgr2=0x7f34980a5070 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:37:25.029 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:37:25.028+0000 7f34b9400640 1 --2- 172.21.15.39:0/489593069 >> [v2:172.21.15.39:6800/1725006999,v1:172.21.15.39:6801/1725006999] conn(0x7f34980a2bb0 0x7f34980a5070 secure :-1 s=READY pgs=218 cs=0 l=1 rev1=1 crypto rx=0x7f34a402a9e0 tx=0x7f34a40315b0 comp rx=0 tx=0).stop 2024-09-12T02:37:25.029 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:37:25.028+0000 7f34b9400640 1 -- 172.21.15.39:0/489593069 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f34b4076220 msgr2=0x7f34b419ea90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:37:25.029 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:37:25.028+0000 7f34b9400640 1 --2- 172.21.15.39:0/489593069 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f34b4076220 0x7f34b419ea90 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0x7f349c00e9f0 tx=0x7f349c00edf0 comp rx=0 tx=0).stop 2024-09-12T02:37:25.029 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:37:25.028+0000 7f34b9400640 1 -- 172.21.15.39:0/489593069 shutdown_connections 2024-09-12T02:37:25.029 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:37:25.028+0000 7f34b9400640 1 --2- 172.21.15.39:0/489593069 >> [v2:172.21.15.39:6800/1725006999,v1:172.21.15.39:6801/1725006999] conn(0x7f34980a2bb0 0x7f34980a5070 unknown :-1 s=CLOSED pgs=218 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:37:25.029 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:37:25.028+0000 7f34b9400640 1 --2- 172.21.15.39:0/489593069 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f34b410e1e0 0x7f34b41a5b10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:37:25.029 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:37:25.028+0000 7f34b9400640 1 --2- 172.21.15.39:0/489593069 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f34b4076220 0x7f34b419ea90 unknown :-1 s=CLOSED pgs=105 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:37:25.029 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:37:25.028+0000 7f34b9400640 1 --2- 172.21.15.39:0/489593069 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f34b4074c50 0x7f34b419e550 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:37:25.029 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:37:25.028+0000 7f34b9400640 1 -- 172.21.15.39:0/489593069 >> 172.21.15.39:0/489593069 conn(0x7f34b40fd390 msgr2=0x7f34b4101460 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:37:25.029 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:37:25.028+0000 7f34b9400640 1 -- 172.21.15.39:0/489593069 shutdown_connections 2024-09-12T02:37:25.029 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:37:25.028+0000 7f34b9400640 1 -- 172.21.15.39:0/489593069 wait complete. 2024-09-12T02:37:25.811 DEBUG:teuthology.orchestra.run.smithi039:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 4954ed46-70ae-11ef-bcea-c7b262605968 -- bash -c 'ceph orch device ls' 2024-09-12T02:37:26.189 INFO:teuthology.orchestra.run.smithi039.stderr:Inferring config /var/lib/ceph/4954ed46-70ae-11ef-bcea-c7b262605968/mon.a/config 2024-09-12T02:37:26.581 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 02:37:26 smithi039 ceph-mon[30515]: pgmap v375: 129 pgs: 129 active+clean; 646 KiB data, 348 MiB used, 1.0 TiB / 1.0 TiB avail; 6.6 KiB/s rd, 767 B/s wr, 13 op/s 2024-09-12T02:37:26.581 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 02:37:26 smithi039 ceph-mon[30515]: from='client.25066 -' entity='client.admin' cmd=[{"prefix": "orch host ls", "target": ["mon-mgr", ""]}]: dispatch 2024-09-12T02:37:26.764 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 12 02:37:26 smithi172 ceph-mon[35609]: pgmap v375: 129 pgs: 129 active+clean; 646 KiB data, 348 MiB used, 1.0 TiB / 1.0 TiB avail; 6.6 KiB/s rd, 767 B/s wr, 13 op/s 2024-09-12T02:37:26.764 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 12 02:37:26 smithi172 ceph-mon[35609]: from='client.25066 -' entity='client.admin' cmd=[{"prefix": "orch host ls", "target": ["mon-mgr", ""]}]: dispatch 2024-09-12T02:37:26.808 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:37:26.807+0000 7f69ce400640 1 -- 172.21.15.39:0/309470929 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f69c8105810 msgr2=0x7f69c810c0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:37:26.808 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:37:26.807+0000 7f69ce400640 1 --2- 172.21.15.39:0/309470929 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f69c8105810 0x7f69c810c0a0 secure :-1 s=READY pgs=252 cs=0 l=1 rev1=1 crypto rx=0x7f69c0009ca0 tx=0x7f69c002a8c0 comp rx=0 tx=0).stop 2024-09-12T02:37:26.808 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:37:26.807+0000 7f69ce400640 1 -- 172.21.15.39:0/309470929 shutdown_connections 2024-09-12T02:37:26.808 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:37:26.807+0000 7f69ce400640 1 --2- 172.21.15.39:0/309470929 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f69c8105810 0x7f69c810c0a0 unknown :-1 s=CLOSED pgs=252 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:37:26.809 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:37:26.807+0000 7f69ce400640 1 --2- 172.21.15.39:0/309470929 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f69c8104e50 0x7f69c81052d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:37:26.809 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:37:26.807+0000 7f69ce400640 1 --2- 172.21.15.39:0/309470929 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f69c8103c50 0x7f69c8104050 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:37:26.809 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:37:26.807+0000 7f69ce400640 1 -- 172.21.15.39:0/309470929 >> 172.21.15.39:0/309470929 conn(0x7f69c80ff3e0 msgr2=0x7f69c8101820 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:37:26.809 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:37:26.807+0000 7f69ce400640 1 -- 172.21.15.39:0/309470929 shutdown_connections 2024-09-12T02:37:26.809 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:37:26.807+0000 7f69ce400640 1 -- 172.21.15.39:0/309470929 wait complete. 2024-09-12T02:37:26.810 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:37:26.808+0000 7f69ce400640 1 Processor -- start 2024-09-12T02:37:26.810 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:37:26.808+0000 7f69ce400640 1 -- start start 2024-09-12T02:37:26.810 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:37:26.809+0000 7f69ce400640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f69c8103c50 0x7f69c8199ec0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:37:26.810 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:37:26.809+0000 7f69ce400640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f69c8104e50 0x7f69c819a400 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:37:26.810 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:37:26.809+0000 7f69ce400640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f69c8105810 0x7f69c81a1480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:37:26.810 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:37:26.809+0000 7f69ce400640 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 -- 0x7f69c810f920 con 0x7f69c8104e50 2024-09-12T02:37:26.810 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:37:26.809+0000 7f69ce400640 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x7f69c810f7a0 con 0x7f69c8103c50 2024-09-12T02:37:26.810 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:37:26.809+0000 7f69ce400640 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7f69c810faa0 con 0x7f69c8105810 2024-09-12T02:37:26.810 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:37:26.809+0000 7f69c7e00640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f69c8104e50 0x7f69c819a400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:37:26.810 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:37:26.809+0000 7f69c7e00640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f69c8104e50 0x7f69c819a400 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.39:3300/0 says I am v2:172.21.15.39:37246/0 (socket says 172.21.15.39:37246) 2024-09-12T02:37:26.811 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:37:26.809+0000 7f69c7e00640 1 -- 172.21.15.39:0/2660763691 learned_addr learned my addr 172.21.15.39:0/2660763691 (peer_addr_for_me v2:172.21.15.39:0/0) 2024-09-12T02:37:26.811 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:37:26.809+0000 7f69cda00640 1 --2- 172.21.15.39:0/2660763691 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f69c8105810 0x7f69c81a1480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:37:26.811 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:37:26.809+0000 7f69cd000640 1 --2- 172.21.15.39:0/2660763691 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f69c8103c50 0x7f69c8199ec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:37:26.812 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:37:26.810+0000 7f69c7e00640 1 -- 172.21.15.39:0/2660763691 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f69c8105810 msgr2=0x7f69c81a1480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:37:26.812 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:37:26.810+0000 7f69c7e00640 1 --2- 172.21.15.39:0/2660763691 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f69c8105810 0x7f69c81a1480 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:37:26.812 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:37:26.810+0000 7f69c7e00640 1 -- 172.21.15.39:0/2660763691 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f69c8103c50 msgr2=0x7f69c8199ec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:37:26.812 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:37:26.810+0000 7f69c7e00640 1 --2- 172.21.15.39:0/2660763691 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f69c8103c50 0x7f69c8199ec0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:37:26.812 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:37:26.810+0000 7f69c7e00640 1 -- 172.21.15.39:0/2660763691 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f69c81a1af0 con 0x7f69c8104e50 2024-09-12T02:37:26.812 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:37:26.810+0000 7f69c7e00640 1 --2- 172.21.15.39:0/2660763691 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f69c8104e50 0x7f69c819a400 secure :-1 s=READY pgs=253 cs=0 l=1 rev1=1 crypto rx=0x7f69b400e9f0 tx=0x7f69b400edf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:37:26.812 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:37:26.810+0000 7f69c5600640 1 -- 172.21.15.39:0/2660763691 <== mon.0 v2:172.21.15.39:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f69b400cd80 con 0x7f69c8104e50 2024-09-12T02:37:26.812 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:37:26.810+0000 7f69c5600640 1 -- 172.21.15.39:0/2660763691 <== mon.0 v2:172.21.15.39:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f69b4005500 con 0x7f69c8104e50 2024-09-12T02:37:26.812 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:37:26.810+0000 7f69ce400640 1 -- 172.21.15.39:0/2660763691 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f69c81a1de0 con 0x7f69c8104e50 2024-09-12T02:37:26.812 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:37:26.810+0000 7f69c5600640 1 -- 172.21.15.39:0/2660763691 <== mon.0 v2:172.21.15.39:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f69b4010690 con 0x7f69c8104e50 2024-09-12T02:37:26.812 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:37:26.811+0000 7f69ce400640 1 -- 172.21.15.39:0/2660763691 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f69c81a2240 con 0x7f69c8104e50 2024-09-12T02:37:26.813 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:37:26.812+0000 7f69ce400640 1 -- 172.21.15.39:0/2660763691 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f69c810af80 con 0x7f69c8104e50 2024-09-12T02:37:26.814 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:37:26.814+0000 7f69c5600640 1 -- 172.21.15.39:0/2660763691 <== mon.0 v2:172.21.15.39:3300/0 4 ==== mgrmap(e 18) ==== 137833+0+0 (secure 0 0 0) 0x7f69b40046c0 con 0x7f69c8104e50 2024-09-12T02:37:26.816 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:37:26.815+0000 7f69c5600640 1 --2- 172.21.15.39:0/2660763691 >> [v2:172.21.15.39:6800/1725006999,v1:172.21.15.39:6801/1725006999] conn(0x7f69b00a2bb0 0x7f69b00a5070 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:37:26.816 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:37:26.815+0000 7f69c5600640 1 -- 172.21.15.39:0/2660763691 <== mon.0 v2:172.21.15.39:3300/0 5 ==== osd_map(95..95 src has 1..95) ==== 9129+0+0 (secure 0 0 0) 0x7f69b40cf740 con 0x7f69c8104e50 2024-09-12T02:37:26.816 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:37:26.815+0000 7f69cd000640 1 --2- 172.21.15.39:0/2660763691 >> [v2:172.21.15.39:6800/1725006999,v1:172.21.15.39:6801/1725006999] conn(0x7f69b00a2bb0 0x7f69b00a5070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:37:26.816 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:37:26.816+0000 7f69cd000640 1 --2- 172.21.15.39:0/2660763691 >> [v2:172.21.15.39:6800/1725006999,v1:172.21.15.39:6801/1725006999] conn(0x7f69b00a2bb0 0x7f69b00a5070 secure :-1 s=READY pgs=219 cs=0 l=1 rev1=1 crypto rx=0x7f69bc005fd0 tx=0x7f69bc00b410 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:37:26.819 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:37:26.819+0000 7f69c5600640 1 -- 172.21.15.39:0/2660763691 <== mon.0 v2:172.21.15.39:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7f69b409c2c0 con 0x7f69c8104e50 2024-09-12T02:37:26.948 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 12 02:37:26 smithi044 ceph-mon[35411]: pgmap v375: 129 pgs: 129 active+clean; 646 KiB data, 348 MiB used, 1.0 TiB / 1.0 TiB avail; 6.6 KiB/s rd, 767 B/s wr, 13 op/s 2024-09-12T02:37:26.948 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 12 02:37:26 smithi044 ceph-mon[35411]: from='client.25066 -' entity='client.admin' cmd=[{"prefix": "orch host ls", "target": ["mon-mgr", ""]}]: dispatch 2024-09-12T02:37:27.014 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:37:27.014+0000 7f69ce400640 1 -- 172.21.15.39:0/2660763691 --> [v2:172.21.15.39:6800/1725006999,v1:172.21.15.39:6801/1725006999] -- mgr_command(tid 0: {"prefix": "orch device ls", "target": ["mon-mgr", ""]}) -- 0x7f69c8062630 con 0x7f69b00a2bb0 2024-09-12T02:37:27.016 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:37:27.015+0000 7f69c5600640 1 -- 172.21.15.39:0/2660763691 <== mgr.14150 v2:172.21.15.39:6800/1725006999 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+532 (secure 0 0 0) 0x7f69c8062630 con 0x7f69b00a2bb0 2024-09-12T02:37:27.016 INFO:teuthology.orchestra.run.smithi039.stdout:HOST PATH TYPE DEVICE ID SIZE AVAILABLE REFRESHED REJECT REASONS 2024-09-12T02:37:27.016 INFO:teuthology.orchestra.run.smithi039.stdout:smithi039 /dev/nvme0n1 ssd INTEL_SSDPEDKE040T7_BTLE736102QX4P0KGN 3726G No 4m ago Has a FileSystem, LVM detected 2024-09-12T02:37:27.017 INFO:teuthology.orchestra.run.smithi039.stdout:smithi044 /dev/nvme0n1 ssd INTEL_SSDPEDMD400G4_CVFT5331001K400BGN 372G No 3m ago Has a FileSystem, LVM detected 2024-09-12T02:37:27.017 INFO:teuthology.orchestra.run.smithi039.stdout:smithi172 /dev/nvme0n1 ssd INTEL_SSDPEDMD400G4_CVFT6233005M400BGN 372G No 3m ago Has a FileSystem, LVM detected 2024-09-12T02:37:27.019 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:37:27.018+0000 7f69ce400640 1 -- 172.21.15.39:0/2660763691 >> [v2:172.21.15.39:6800/1725006999,v1:172.21.15.39:6801/1725006999] conn(0x7f69b00a2bb0 msgr2=0x7f69b00a5070 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:37:27.019 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:37:27.018+0000 7f69ce400640 1 --2- 172.21.15.39:0/2660763691 >> [v2:172.21.15.39:6800/1725006999,v1:172.21.15.39:6801/1725006999] conn(0x7f69b00a2bb0 0x7f69b00a5070 secure :-1 s=READY pgs=219 cs=0 l=1 rev1=1 crypto rx=0x7f69bc005fd0 tx=0x7f69bc00b410 comp rx=0 tx=0).stop 2024-09-12T02:37:27.019 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:37:27.018+0000 7f69ce400640 1 -- 172.21.15.39:0/2660763691 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f69c8104e50 msgr2=0x7f69c819a400 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:37:27.019 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:37:27.018+0000 7f69ce400640 1 --2- 172.21.15.39:0/2660763691 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f69c8104e50 0x7f69c819a400 secure :-1 s=READY pgs=253 cs=0 l=1 rev1=1 crypto rx=0x7f69b400e9f0 tx=0x7f69b400edf0 comp rx=0 tx=0).stop 2024-09-12T02:37:27.019 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:37:27.018+0000 7f69ce400640 1 -- 172.21.15.39:0/2660763691 shutdown_connections 2024-09-12T02:37:27.020 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:37:27.018+0000 7f69ce400640 1 --2- 172.21.15.39:0/2660763691 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f69c8105810 0x7f69c81a1480 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:37:27.020 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:37:27.018+0000 7f69ce400640 1 --2- 172.21.15.39:0/2660763691 >> [v2:172.21.15.39:6800/1725006999,v1:172.21.15.39:6801/1725006999] conn(0x7f69b00a2bb0 0x7f69b00a5070 unknown :-1 s=CLOSED pgs=219 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:37:27.020 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:37:27.018+0000 7f69ce400640 1 --2- 172.21.15.39:0/2660763691 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f69c8104e50 0x7f69c819a400 unknown :-1 s=CLOSED pgs=253 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:37:27.020 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:37:27.018+0000 7f69ce400640 1 --2- 172.21.15.39:0/2660763691 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f69c8103c50 0x7f69c8199ec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:37:27.020 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:37:27.018+0000 7f69ce400640 1 -- 172.21.15.39:0/2660763691 >> 172.21.15.39:0/2660763691 conn(0x7f69c80ff3e0 msgr2=0x7f69c8108150 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:37:27.020 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:37:27.019+0000 7f69ce400640 1 -- 172.21.15.39:0/2660763691 shutdown_connections 2024-09-12T02:37:27.020 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:37:27.019+0000 7f69ce400640 1 -- 172.21.15.39:0/2660763691 wait complete. 2024-09-12T02:37:27.968 INFO:teuthology.run_tasks:Running task cephadm.shell... 2024-09-12T02:37:27.978 INFO:tasks.cephadm:Running commands on role mon.a host ubuntu@smithi039.front.sepia.ceph.com 2024-09-12T02:37:27.978 DEBUG:teuthology.orchestra.run.smithi039:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 4954ed46-70ae-11ef-bcea-c7b262605968 -- bash -c 'ceph fs dump' 2024-09-12T02:37:28.357 INFO:teuthology.orchestra.run.smithi039.stderr:Inferring config /var/lib/ceph/4954ed46-70ae-11ef-bcea-c7b262605968/mon.a/config 2024-09-12T02:37:28.760 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 02:37:28 smithi039 ceph-mon[30515]: pgmap v376: 129 pgs: 129 active+clean; 646 KiB data, 348 MiB used, 1.0 TiB / 1.0 TiB avail; 4.5 KiB/s rd, 767 B/s wr, 9 op/s 2024-09-12T02:37:28.760 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 02:37:28 smithi039 ceph-mon[30515]: from='client.15075 -' entity='client.admin' cmd=[{"prefix": "orch device ls", "target": ["mon-mgr", ""]}]: dispatch 2024-09-12T02:37:28.763 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 12 02:37:28 smithi172 ceph-mon[35609]: pgmap v376: 129 pgs: 129 active+clean; 646 KiB data, 348 MiB used, 1.0 TiB / 1.0 TiB avail; 4.5 KiB/s rd, 767 B/s wr, 9 op/s 2024-09-12T02:37:28.763 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 12 02:37:28 smithi172 ceph-mon[35609]: from='client.15075 -' entity='client.admin' cmd=[{"prefix": "orch device ls", "target": ["mon-mgr", ""]}]: dispatch 2024-09-12T02:37:28.949 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 12 02:37:28 smithi044 ceph-mon[35411]: pgmap v376: 129 pgs: 129 active+clean; 646 KiB data, 348 MiB used, 1.0 TiB / 1.0 TiB avail; 4.5 KiB/s rd, 767 B/s wr, 9 op/s 2024-09-12T02:37:28.949 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 12 02:37:28 smithi044 ceph-mon[35411]: from='client.15075 -' entity='client.admin' cmd=[{"prefix": "orch device ls", "target": ["mon-mgr", ""]}]: dispatch 2024-09-12T02:37:29.023 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:37:29.022+0000 7f1c79c00640 1 -- 172.21.15.39:0/2695468819 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f1c74103e00 msgr2=0x7f1c74104200 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:37:29.023 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:37:29.022+0000 7f1c79c00640 1 --2- 172.21.15.39:0/2695468819 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f1c74103e00 0x7f1c74104200 secure :-1 s=READY pgs=254 cs=0 l=1 rev1=1 crypto rx=0x7f1c64009900 tx=0x7f1c6402a3f0 comp rx=0 tx=0).stop 2024-09-12T02:37:29.023 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:37:29.022+0000 7f1c79c00640 1 -- 172.21.15.39:0/2695468819 shutdown_connections 2024-09-12T02:37:29.023 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:37:29.022+0000 7f1c79c00640 1 --2- 172.21.15.39:0/2695468819 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f1c74105920 0x7f1c7410c240 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:37:29.023 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:37:29.022+0000 7f1c79c00640 1 --2- 172.21.15.39:0/2695468819 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f1c74104f60 0x7f1c741053e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:37:29.023 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:37:29.022+0000 7f1c79c00640 1 --2- 172.21.15.39:0/2695468819 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f1c74103e00 0x7f1c74104200 unknown :-1 s=CLOSED pgs=254 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:37:29.023 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:37:29.022+0000 7f1c79c00640 1 -- 172.21.15.39:0/2695468819 >> 172.21.15.39:0/2695468819 conn(0x7f1c740ff5b0 msgr2=0x7f1c741019d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:37:29.023 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:37:29.022+0000 7f1c79c00640 1 -- 172.21.15.39:0/2695468819 shutdown_connections 2024-09-12T02:37:29.023 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:37:29.022+0000 7f1c79c00640 1 -- 172.21.15.39:0/2695468819 wait complete. 2024-09-12T02:37:29.024 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:37:29.023+0000 7f1c79c00640 1 Processor -- start 2024-09-12T02:37:29.024 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:37:29.023+0000 7f1c79c00640 1 -- start start 2024-09-12T02:37:29.024 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:37:29.023+0000 7f1c79c00640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f1c74103e00 0x7f1c7419a0b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:37:29.024 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:37:29.023+0000 7f1c79c00640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f1c74104f60 0x7f1c7419a5f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:37:29.024 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:37:29.023+0000 7f1c79c00640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f1c74105920 0x7f1c741a1670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:37:29.025 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:37:29.023+0000 7f1c79c00640 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 -- 0x7f1c7410fa90 con 0x7f1c74105920 2024-09-12T02:37:29.025 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:37:29.023+0000 7f1c79c00640 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x7f1c7410f910 con 0x7f1c74104f60 2024-09-12T02:37:29.025 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:37:29.023+0000 7f1c79c00640 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7f1c7410fc10 con 0x7f1c74103e00 2024-09-12T02:37:29.025 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:37:29.024+0000 7f1c73400640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f1c74105920 0x7f1c741a1670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:37:29.025 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:37:29.024+0000 7f1c72a00640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f1c74103e00 0x7f1c7419a0b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:37:29.025 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:37:29.024+0000 7f1c6a000640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f1c74104f60 0x7f1c7419a5f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:37:29.025 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:37:29.024+0000 7f1c73400640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f1c74105920 0x7f1c741a1670 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.39:3300/0 says I am v2:172.21.15.39:35442/0 (socket says 172.21.15.39:35442) 2024-09-12T02:37:29.025 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:37:29.024+0000 7f1c6a000640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f1c74104f60 0x7f1c7419a5f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.39:55708/0 (socket says 172.21.15.39:55708) 2024-09-12T02:37:29.025 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:37:29.024+0000 7f1c73400640 1 -- 172.21.15.39:0/2009937447 learned_addr learned my addr 172.21.15.39:0/2009937447 (peer_addr_for_me v2:172.21.15.39:0/0) 2024-09-12T02:37:29.026 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:37:29.024+0000 7f1c6a000640 1 -- 172.21.15.39:0/2009937447 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f1c74103e00 msgr2=0x7f1c7419a0b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:37:29.026 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:37:29.024+0000 7f1c6a000640 1 --2- 172.21.15.39:0/2009937447 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f1c74103e00 0x7f1c7419a0b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:37:29.026 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:37:29.024+0000 7f1c6a000640 1 -- 172.21.15.39:0/2009937447 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f1c74105920 msgr2=0x7f1c741a1670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:37:29.026 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:37:29.024+0000 7f1c6a000640 1 --2- 172.21.15.39:0/2009937447 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f1c74105920 0x7f1c741a1670 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:37:29.026 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:37:29.024+0000 7f1c6a000640 1 -- 172.21.15.39:0/2009937447 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1c741a1ce0 con 0x7f1c74104f60 2024-09-12T02:37:29.026 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:37:29.024+0000 7f1c73400640 1 --2- 172.21.15.39:0/2009937447 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f1c74105920 0x7f1c741a1670 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-12T02:37:29.026 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:37:29.024+0000 7f1c6a000640 1 --2- 172.21.15.39:0/2009937447 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f1c74104f60 0x7f1c7419a5f0 secure :-1 s=READY pgs=113 cs=0 l=1 rev1=1 crypto rx=0x7f1c5c00e9c0 tx=0x7f1c5c00ee80 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:37:29.026 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:37:29.025+0000 7f1c6be00640 1 -- 172.21.15.39:0/2009937447 <== mon.2 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1c5c00ccc0 con 0x7f1c74104f60 2024-09-12T02:37:29.026 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:37:29.025+0000 7f1c79c00640 1 -- 172.21.15.39:0/2009937447 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f1c741a1fd0 con 0x7f1c74104f60 2024-09-12T02:37:29.026 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:37:29.025+0000 7f1c6be00640 1 -- 172.21.15.39:0/2009937447 <== mon.2 v2:172.21.15.44:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f1c5c0035f0 con 0x7f1c74104f60 2024-09-12T02:37:29.027 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:37:29.025+0000 7f1c6be00640 1 -- 172.21.15.39:0/2009937447 <== mon.2 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1c5c00ce60 con 0x7f1c74104f60 2024-09-12T02:37:29.027 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:37:29.025+0000 7f1c79c00640 1 -- 172.21.15.39:0/2009937447 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f1c741a2480 con 0x7f1c74104f60 2024-09-12T02:37:29.027 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:37:29.026+0000 7f1c79c00640 1 -- 172.21.15.39:0/2009937447 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f1c7410b1c0 con 0x7f1c74104f60 2024-09-12T02:37:29.028 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:37:29.028+0000 7f1c6be00640 1 -- 172.21.15.39:0/2009937447 <== mon.2 v2:172.21.15.44:3300/0 4 ==== mgrmap(e 18) ==== 137833+0+0 (secure 0 0 0) 0x7f1c5c0037a0 con 0x7f1c74104f60 2024-09-12T02:37:29.030 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:37:29.029+0000 7f1c6be00640 1 --2- 172.21.15.39:0/2009937447 >> [v2:172.21.15.39:6800/1725006999,v1:172.21.15.39:6801/1725006999] conn(0x7f1c580a2bb0 0x7f1c580a5070 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:37:29.030 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:37:29.029+0000 7f1c6be00640 1 -- 172.21.15.39:0/2009937447 <== mon.2 v2:172.21.15.44:3300/0 5 ==== osd_map(95..95 src has 1..95) ==== 9129+0+0 (secure 0 0 0) 0x7f1c5c0cf810 con 0x7f1c74104f60 2024-09-12T02:37:29.030 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:37:29.029+0000 7f1c72a00640 1 --2- 172.21.15.39:0/2009937447 >> [v2:172.21.15.39:6800/1725006999,v1:172.21.15.39:6801/1725006999] conn(0x7f1c580a2bb0 0x7f1c580a5070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:37:29.031 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:37:29.030+0000 7f1c72a00640 1 --2- 172.21.15.39:0/2009937447 >> [v2:172.21.15.39:6800/1725006999,v1:172.21.15.39:6801/1725006999] conn(0x7f1c580a2bb0 0x7f1c580a5070 secure :-1 s=READY pgs=220 cs=0 l=1 rev1=1 crypto rx=0x7f1c640314e0 tx=0x7f1c64000bc0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:37:29.034 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:37:29.033+0000 7f1c6be00640 1 -- 172.21.15.39:0/2009937447 <== mon.2 v2:172.21.15.44:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7f1c5c09c390 con 0x7f1c74104f60 2024-09-12T02:37:29.258 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:37:29.257+0000 7f1c79c00640 1 -- 172.21.15.39:0/2009937447 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_command({"prefix": "fs dump"} v 0) -- 0x7f1c74062e90 con 0x7f1c74104f60 2024-09-12T02:37:29.258 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:37:29.257+0000 7f1c6be00640 1 -- 172.21.15.39:0/2009937447 <== mon.2 v2:172.21.15.44:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump"}]=0 dumped fsmap epoch 28 v28) ==== 76+0+3130 (secure 0 0 0) 0x7f1c5c09bc90 con 0x7f1c74104f60 2024-09-12T02:37:29.258 INFO:teuthology.orchestra.run.smithi039.stdout:e28 2024-09-12T02:37:29.259 INFO:teuthology.orchestra.run.smithi039.stdout:btime 2024-09-12T02:35:53:793149+0000 2024-09-12T02:37:29.259 INFO:teuthology.orchestra.run.smithi039.stdout:enable_multiple, ever_enabled_multiple: 1,1 2024-09-12T02:37:29.259 INFO:teuthology.orchestra.run.smithi039.stdout:default compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2,11=minor log segments,12=quiesce subvolumes} 2024-09-12T02:37:29.259 INFO:teuthology.orchestra.run.smithi039.stdout:legacy client fscid: 1 2024-09-12T02:37:29.259 INFO:teuthology.orchestra.run.smithi039.stdout: 2024-09-12T02:37:29.259 INFO:teuthology.orchestra.run.smithi039.stdout:Filesystem 'cephfs' (1) 2024-09-12T02:37:29.259 INFO:teuthology.orchestra.run.smithi039.stdout:fs_name cephfs 2024-09-12T02:37:29.259 INFO:teuthology.orchestra.run.smithi039.stdout:epoch 28 2024-09-12T02:37:29.259 INFO:teuthology.orchestra.run.smithi039.stdout:flags 32 joinable allow_snaps allow_multimds_snaps allow_standby_replay 2024-09-12T02:37:29.259 INFO:teuthology.orchestra.run.smithi039.stdout:created 2024-09-12T02:35:03.522182+0000 2024-09-12T02:37:29.259 INFO:teuthology.orchestra.run.smithi039.stdout:modified 2024-09-12T02:35:53.762825+0000 2024-09-12T02:37:29.259 INFO:teuthology.orchestra.run.smithi039.stdout:tableserver 0 2024-09-12T02:37:29.259 INFO:teuthology.orchestra.run.smithi039.stdout:root 0 2024-09-12T02:37:29.260 INFO:teuthology.orchestra.run.smithi039.stdout:session_timeout 300 2024-09-12T02:37:29.260 INFO:teuthology.orchestra.run.smithi039.stdout:session_autoclose 300 2024-09-12T02:37:29.260 INFO:teuthology.orchestra.run.smithi039.stdout:max_file_size 1099511627776 2024-09-12T02:37:29.260 INFO:teuthology.orchestra.run.smithi039.stdout:max_xattr_size 65536 2024-09-12T02:37:29.260 INFO:teuthology.orchestra.run.smithi039.stdout:required_client_features {} 2024-09-12T02:37:29.260 INFO:teuthology.orchestra.run.smithi039.stdout:last_failure 0 2024-09-12T02:37:29.260 INFO:teuthology.orchestra.run.smithi039.stdout:last_failure_osd_epoch 0 2024-09-12T02:37:29.260 INFO:teuthology.orchestra.run.smithi039.stdout:compat compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,7=mds uses inline data,8=no anchor table,9=file layout v2,10=snaprealm v2,11=minor log segments,12=quiesce subvolumes} 2024-09-12T02:37:29.260 INFO:teuthology.orchestra.run.smithi039.stdout:max_mds 5 2024-09-12T02:37:29.260 INFO:teuthology.orchestra.run.smithi039.stdout:in 0,1,2,3,4 2024-09-12T02:37:29.260 INFO:teuthology.orchestra.run.smithi039.stdout:up {0=24515,1=24499,2=24484,3=24482,4=24472} 2024-09-12T02:37:29.260 INFO:teuthology.orchestra.run.smithi039.stdout:failed 2024-09-12T02:37:29.260 INFO:teuthology.orchestra.run.smithi039.stdout:damaged 2024-09-12T02:37:29.260 INFO:teuthology.orchestra.run.smithi039.stdout:stopped 2024-09-12T02:37:29.260 INFO:teuthology.orchestra.run.smithi039.stdout:data_pools [3,4] 2024-09-12T02:37:29.261 INFO:teuthology.orchestra.run.smithi039.stdout:metadata_pool 2 2024-09-12T02:37:29.261 INFO:teuthology.orchestra.run.smithi039.stdout:inline_data disabled 2024-09-12T02:37:29.261 INFO:teuthology.orchestra.run.smithi039.stdout:balancer 2024-09-12T02:37:29.261 INFO:teuthology.orchestra.run.smithi039.stdout:bal_rank_mask -1 2024-09-12T02:37:29.261 INFO:teuthology.orchestra.run.smithi039.stdout:standby_count_wanted 0 2024-09-12T02:37:29.261 INFO:teuthology.orchestra.run.smithi039.stdout:qdb_cluster leader: 24515 members: 24515,24499,24484,24482,24472 2024-09-12T02:37:29.261 INFO:teuthology.orchestra.run.smithi039.stdout:[mds.b{0:24515} state up:active seq 5 addr [v2:172.21.15.44:6838/2556532723,v1:172.21.15.44:6839/2556532723] compat {c=[1],r=[1],i=[1fff]}] 2024-09-12T02:37:29.261 INFO:teuthology.orchestra.run.smithi039.stdout:[mds.e{0:24458} state up:standby-replay seq 1 addr [v2:172.21.15.44:6834/4063842354,v1:172.21.15.44:6835/4063842354] compat {c=[1],r=[1],i=[1fff]}] 2024-09-12T02:37:29.261 INFO:teuthology.orchestra.run.smithi039.stdout:[mds.i{1:24499} state up:active seq 18 addr [v2:172.21.15.172:6838/3742537097,v1:172.21.15.172:6839/3742537097] compat {c=[1],r=[1],i=[1fff]}] 2024-09-12T02:37:29.261 INFO:teuthology.orchestra.run.smithi039.stdout:[mds.d{1:24446} state up:standby-replay seq 1 addr [v2:172.21.15.39:6836/2743237008,v1:172.21.15.39:6837/2743237008] compat {c=[1],r=[1],i=[1fff]}] 2024-09-12T02:37:29.261 INFO:teuthology.orchestra.run.smithi039.stdout:[mds.c{2:24484} state up:active seq 20 addr [v2:172.21.15.172:6836/493506747,v1:172.21.15.172:6837/493506747] compat {c=[1],r=[1],i=[1fff]}] 2024-09-12T02:37:29.261 INFO:teuthology.orchestra.run.smithi039.stdout:[mds.l{2:24430} state up:standby-replay seq 1 addr [v2:172.21.15.172:6832/3232434105,v1:172.21.15.172:6833/3232434105] compat {c=[1],r=[1],i=[1fff]}] 2024-09-12T02:37:29.261 INFO:teuthology.orchestra.run.smithi039.stdout:[mds.h{3:24482} state up:active seq 19 addr [v2:172.21.15.44:6836/1501493978,v1:172.21.15.44:6837/1501493978] compat {c=[1],r=[1],i=[1fff]}] 2024-09-12T02:37:29.261 INFO:teuthology.orchestra.run.smithi039.stdout:[mds.k{3:24422} state up:standby-replay seq 1 addr [v2:172.21.15.44:6832/2359724364,v1:172.21.15.44:6833/2359724364] compat {c=[1],r=[1],i=[1fff]}] 2024-09-12T02:37:29.262 INFO:teuthology.orchestra.run.smithi039.stdout:[mds.f{4:24472} state up:active seq 21 addr [v2:172.21.15.172:6834/3274676014,v1:172.21.15.172:6835/3274676014] compat {c=[1],r=[1],i=[1fff]}] 2024-09-12T02:37:29.262 INFO:teuthology.orchestra.run.smithi039.stdout:[mds.a{4:14523} state up:standby-replay seq 1 addr [v2:172.21.15.39:6840/2829712180,v1:172.21.15.39:6841/2829712180] compat {c=[1],r=[1],i=[1fff]}] 2024-09-12T02:37:29.262 INFO:teuthology.orchestra.run.smithi039.stdout: 2024-09-12T02:37:29.262 INFO:teuthology.orchestra.run.smithi039.stdout: 2024-09-12T02:37:29.262 INFO:teuthology.orchestra.run.smithi039.stdout:Standby daemons: 2024-09-12T02:37:29.262 INFO:teuthology.orchestra.run.smithi039.stdout: 2024-09-12T02:37:29.262 INFO:teuthology.orchestra.run.smithi039.stdout:[mds.j{-1:14451} state up:standby seq 1 addr [v2:172.21.15.39:6834/2325642381,v1:172.21.15.39:6835/2325642381] compat {c=[1],r=[1],i=[1fff]}] 2024-09-12T02:37:29.262 INFO:teuthology.orchestra.run.smithi039.stdout:[mds.g{-1:14511} state up:standby seq 1 addr [v2:172.21.15.39:6838/936905514,v1:172.21.15.39:6839/936905514] compat {c=[1],r=[1],i=[1fff]}] 2024-09-12T02:37:29.263 INFO:teuthology.orchestra.run.smithi039.stderr:dumped fsmap epoch 28 2024-09-12T02:37:29.263 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:37:29.260+0000 7f1c79c00640 1 -- 172.21.15.39:0/2009937447 >> [v2:172.21.15.39:6800/1725006999,v1:172.21.15.39:6801/1725006999] conn(0x7f1c580a2bb0 msgr2=0x7f1c580a5070 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:37:29.263 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:37:29.260+0000 7f1c79c00640 1 --2- 172.21.15.39:0/2009937447 >> [v2:172.21.15.39:6800/1725006999,v1:172.21.15.39:6801/1725006999] conn(0x7f1c580a2bb0 0x7f1c580a5070 secure :-1 s=READY pgs=220 cs=0 l=1 rev1=1 crypto rx=0x7f1c640314e0 tx=0x7f1c64000bc0 comp rx=0 tx=0).stop 2024-09-12T02:37:29.263 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:37:29.260+0000 7f1c79c00640 1 -- 172.21.15.39:0/2009937447 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f1c74104f60 msgr2=0x7f1c7419a5f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:37:29.263 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:37:29.260+0000 7f1c79c00640 1 --2- 172.21.15.39:0/2009937447 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f1c74104f60 0x7f1c7419a5f0 secure :-1 s=READY pgs=113 cs=0 l=1 rev1=1 crypto rx=0x7f1c5c00e9c0 tx=0x7f1c5c00ee80 comp rx=0 tx=0).stop 2024-09-12T02:37:29.263 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:37:29.260+0000 7f1c79c00640 1 -- 172.21.15.39:0/2009937447 shutdown_connections 2024-09-12T02:37:29.263 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:37:29.260+0000 7f1c79c00640 1 --2- 172.21.15.39:0/2009937447 >> [v2:172.21.15.39:6800/1725006999,v1:172.21.15.39:6801/1725006999] conn(0x7f1c580a2bb0 0x7f1c580a5070 unknown :-1 s=CLOSED pgs=220 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:37:29.263 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:37:29.260+0000 7f1c79c00640 1 --2- 172.21.15.39:0/2009937447 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f1c74105920 0x7f1c741a1670 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:37:29.263 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:37:29.260+0000 7f1c79c00640 1 --2- 172.21.15.39:0/2009937447 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f1c74104f60 0x7f1c7419a5f0 unknown :-1 s=CLOSED pgs=113 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:37:29.263 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:37:29.260+0000 7f1c79c00640 1 --2- 172.21.15.39:0/2009937447 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f1c74103e00 0x7f1c7419a0b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:37:29.264 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:37:29.260+0000 7f1c79c00640 1 -- 172.21.15.39:0/2009937447 >> 172.21.15.39:0/2009937447 conn(0x7f1c740ff5b0 msgr2=0x7f1c74108390 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:37:29.264 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:37:29.260+0000 7f1c79c00640 1 -- 172.21.15.39:0/2009937447 shutdown_connections 2024-09-12T02:37:29.264 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:37:29.260+0000 7f1c79c00640 1 -- 172.21.15.39:0/2009937447 wait complete. 2024-09-12T02:37:29.600 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 02:37:29 smithi039 ceph-mon[30515]: from='client.? 172.21.15.39:0/2009937447' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2024-09-12T02:37:29.948 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 12 02:37:29 smithi044 ceph-mon[35411]: from='client.? 172.21.15.39:0/2009937447' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2024-09-12T02:37:30.013 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 12 02:37:29 smithi172 ceph-mon[35609]: from='client.? 172.21.15.39:0/2009937447' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2024-09-12T02:37:30.033 DEBUG:teuthology.orchestra.run.smithi039:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 4954ed46-70ae-11ef-bcea-c7b262605968 -- bash -c 'ceph osd dump' 2024-09-12T02:37:30.410 INFO:teuthology.orchestra.run.smithi039.stderr:Inferring config /var/lib/ceph/4954ed46-70ae-11ef-bcea-c7b262605968/mon.a/config 2024-09-12T02:37:30.849 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 12 02:37:30 smithi044 ceph-mon[35411]: pgmap v377: 129 pgs: 129 active+clean; 646 KiB data, 348 MiB used, 1.0 TiB / 1.0 TiB avail; 6.1 KiB/s rd, 682 B/s wr, 12 op/s 2024-09-12T02:37:30.850 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 02:37:30 smithi039 ceph-mon[30515]: pgmap v377: 129 pgs: 129 active+clean; 646 KiB data, 348 MiB used, 1.0 TiB / 1.0 TiB avail; 6.1 KiB/s rd, 682 B/s wr, 12 op/s 2024-09-12T02:37:31.011 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:37:31.011+0000 7f6400e00640 1 -- 172.21.15.39:0/892563913 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f63fc104f60 msgr2=0x7f63fc1053e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:37:31.011 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:37:31.011+0000 7f6400e00640 1 --2- 172.21.15.39:0/892563913 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f63fc104f60 0x7f63fc1053e0 secure :-1 s=READY pgs=255 cs=0 l=1 rev1=1 crypto rx=0x7f63e8009860 tx=0x7f63e802a340 comp rx=0 tx=0).stop 2024-09-12T02:37:31.011 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:37:31.011+0000 7f6400e00640 1 -- 172.21.15.39:0/892563913 shutdown_connections 2024-09-12T02:37:31.011 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:37:31.011+0000 7f6400e00640 1 --2- 172.21.15.39:0/892563913 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f63fc105920 0x7f63fc10c240 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:37:31.011 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:37:31.011+0000 7f6400e00640 1 --2- 172.21.15.39:0/892563913 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f63fc104f60 0x7f63fc1053e0 unknown :-1 s=CLOSED pgs=255 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:37:31.011 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:37:31.011+0000 7f6400e00640 1 --2- 172.21.15.39:0/892563913 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f63fc103e00 0x7f63fc104200 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:37:31.011 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:37:31.011+0000 7f6400e00640 1 -- 172.21.15.39:0/892563913 >> 172.21.15.39:0/892563913 conn(0x7f63fc0ff5b0 msgr2=0x7f63fc1019d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:37:31.011 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:37:31.011+0000 7f6400e00640 1 -- 172.21.15.39:0/892563913 shutdown_connections 2024-09-12T02:37:31.011 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:37:31.011+0000 7f6400e00640 1 -- 172.21.15.39:0/892563913 wait complete. 2024-09-12T02:37:31.012 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:37:31.012+0000 7f6400e00640 1 Processor -- start 2024-09-12T02:37:31.012 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:37:31.012+0000 7f6400e00640 1 -- start start 2024-09-12T02:37:31.013 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:37:31.012+0000 7f6400e00640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f63fc103e00 0x7f63fc19a0e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:37:31.013 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:37:31.012+0000 7f6400e00640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f63fc104f60 0x7f63fc19a620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:37:31.013 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:37:31.012+0000 7f6400e00640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f63fc105920 0x7f63fc1a16a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:37:31.013 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:37:31.012+0000 7f6400e00640 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 -- 0x7f63fc10fab0 con 0x7f63fc104f60 2024-09-12T02:37:31.013 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:37:31.012+0000 7f6400e00640 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x7f63fc10f930 con 0x7f63fc103e00 2024-09-12T02:37:31.013 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:37:31.013+0000 7f6400e00640 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7f63fc10fc30 con 0x7f63fc105920 2024-09-12T02:37:31.013 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:37:31.013+0000 7f63f9e00640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f63fc103e00 0x7f63fc19a0e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:37:31.013 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:37:31.013+0000 7f63fa800640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f63fc105920 0x7f63fc1a16a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:37:31.013 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:37:31.013+0000 7f63f9e00640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f63fc103e00 0x7f63fc19a0e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.39:55728/0 (socket says 172.21.15.39:55728) 2024-09-12T02:37:31.013 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:37:31.013+0000 7f63f9e00640 1 -- 172.21.15.39:0/3282198279 learned_addr learned my addr 172.21.15.39:0/3282198279 (peer_addr_for_me v2:172.21.15.39:0/0) 2024-09-12T02:37:31.013 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:37:31.013+0000 7f63fa800640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f63fc105920 0x7f63fc1a16a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.172:3300/0 says I am v2:172.21.15.39:53578/0 (socket says 172.21.15.39:53578) 2024-09-12T02:37:31.013 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:37:31.013+0000 7f63f9400640 1 --2- 172.21.15.39:0/3282198279 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f63fc104f60 0x7f63fc19a620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:37:31.014 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 12 02:37:30 smithi172 ceph-mon[35609]: pgmap v377: 129 pgs: 129 active+clean; 646 KiB data, 348 MiB used, 1.0 TiB / 1.0 TiB avail; 6.1 KiB/s rd, 682 B/s wr, 12 op/s 2024-09-12T02:37:31.015 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:37:31.013+0000 7f63f9e00640 1 -- 172.21.15.39:0/3282198279 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f63fc105920 msgr2=0x7f63fc1a16a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:37:31.015 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:37:31.013+0000 7f63f9e00640 1 --2- 172.21.15.39:0/3282198279 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f63fc105920 0x7f63fc1a16a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:37:31.015 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:37:31.013+0000 7f63f9e00640 1 -- 172.21.15.39:0/3282198279 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f63fc104f60 msgr2=0x7f63fc19a620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:37:31.015 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:37:31.013+0000 7f63f9e00640 1 --2- 172.21.15.39:0/3282198279 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f63fc104f60 0x7f63fc19a620 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:37:31.015 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:37:31.013+0000 7f63f9e00640 1 -- 172.21.15.39:0/3282198279 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f63fc1a1d10 con 0x7f63fc103e00 2024-09-12T02:37:31.015 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:37:31.014+0000 7f63f9e00640 1 --2- 172.21.15.39:0/3282198279 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f63fc103e00 0x7f63fc19a0e0 secure :-1 s=READY pgs=114 cs=0 l=1 rev1=1 crypto rx=0x7f63ec00e9c0 tx=0x7f63ec00ee80 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:37:31.015 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:37:31.014+0000 7f63f2a00640 1 -- 172.21.15.39:0/3282198279 <== mon.2 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f63ec00ccc0 con 0x7f63fc103e00 2024-09-12T02:37:31.015 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:37:31.014+0000 7f63f2a00640 1 -- 172.21.15.39:0/3282198279 <== mon.2 v2:172.21.15.44:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f63ec005500 con 0x7f63fc103e00 2024-09-12T02:37:31.015 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:37:31.014+0000 7f6400e00640 1 -- 172.21.15.39:0/3282198279 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f63fc1a1fa0 con 0x7f63fc103e00 2024-09-12T02:37:31.015 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:37:31.014+0000 7f63f2a00640 1 -- 172.21.15.39:0/3282198279 <== mon.2 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f63ec010430 con 0x7f63fc103e00 2024-09-12T02:37:31.015 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:37:31.014+0000 7f6400e00640 1 -- 172.21.15.39:0/3282198279 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f63fc1a24a0 con 0x7f63fc103e00 2024-09-12T02:37:31.017 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:37:31.015+0000 7f6400e00640 1 -- 172.21.15.39:0/3282198279 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f63fc10b1f0 con 0x7f63fc103e00 2024-09-12T02:37:31.017 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:37:31.017+0000 7f63f2a00640 1 -- 172.21.15.39:0/3282198279 <== mon.2 v2:172.21.15.44:3300/0 4 ==== mgrmap(e 18) ==== 137833+0+0 (secure 0 0 0) 0x7f63ec0046c0 con 0x7f63fc103e00 2024-09-12T02:37:31.018 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:37:31.018+0000 7f63f2a00640 1 --2- 172.21.15.39:0/3282198279 >> [v2:172.21.15.39:6800/1725006999,v1:172.21.15.39:6801/1725006999] conn(0x7f63e00a2c30 0x7f63e00a50f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:37:31.018 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:37:31.018+0000 7f63f2a00640 1 -- 172.21.15.39:0/3282198279 <== mon.2 v2:172.21.15.44:3300/0 5 ==== osd_map(95..95 src has 1..95) ==== 9129+0+0 (secure 0 0 0) 0x7f63ec0cf650 con 0x7f63fc103e00 2024-09-12T02:37:31.018 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:37:31.019+0000 7f63f9400640 1 --2- 172.21.15.39:0/3282198279 >> [v2:172.21.15.39:6800/1725006999,v1:172.21.15.39:6801/1725006999] conn(0x7f63e00a2c30 0x7f63e00a50f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:37:31.019 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:37:31.019+0000 7f63f9400640 1 --2- 172.21.15.39:0/3282198279 >> [v2:172.21.15.39:6800/1725006999,v1:172.21.15.39:6801/1725006999] conn(0x7f63e00a2c30 0x7f63e00a50f0 secure :-1 s=READY pgs=221 cs=0 l=1 rev1=1 crypto rx=0x7f63e8030410 tx=0x7f63e8030550 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:37:31.022 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:37:31.022+0000 7f63f2a00640 1 -- 172.21.15.39:0/3282198279 <== mon.2 v2:172.21.15.44:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7f63ec09c1d0 con 0x7f63fc103e00 2024-09-12T02:37:31.210 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:37:31.210+0000 7f6400e00640 1 -- 172.21.15.39:0/3282198279 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_command({"prefix": "osd dump"} v 0) -- 0x7f63fc062e20 con 0x7f63fc103e00 2024-09-12T02:37:31.210 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:37:31.211+0000 7f63f2a00640 1 -- 172.21.15.39:0/3282198279 <== mon.2 v2:172.21.15.44:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump"}]=0 v95) ==== 56+0+5618 (secure 0 0 0) 0x7f63ec09bad0 con 0x7f63fc103e00 2024-09-12T02:37:31.211 INFO:teuthology.orchestra.run.smithi039.stdout:epoch 95 2024-09-12T02:37:31.212 INFO:teuthology.orchestra.run.smithi039.stdout:fsid 4954ed46-70ae-11ef-bcea-c7b262605968 2024-09-12T02:37:31.212 INFO:teuthology.orchestra.run.smithi039.stdout:created 2024-09-12T02:26:43.086467+0000 2024-09-12T02:37:31.212 INFO:teuthology.orchestra.run.smithi039.stdout:modified 2024-09-12T02:36:46.999173+0000 2024-09-12T02:37:31.212 INFO:teuthology.orchestra.run.smithi039.stdout:flags sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit 2024-09-12T02:37:31.212 INFO:teuthology.orchestra.run.smithi039.stdout:crush_version 27 2024-09-12T02:37:31.212 INFO:teuthology.orchestra.run.smithi039.stdout:full_ratio 0.95 2024-09-12T02:37:31.212 INFO:teuthology.orchestra.run.smithi039.stdout:backfillfull_ratio 0.9 2024-09-12T02:37:31.212 INFO:teuthology.orchestra.run.smithi039.stdout:nearfull_ratio 0.85 2024-09-12T02:37:31.212 INFO:teuthology.orchestra.run.smithi039.stdout:require_min_compat_client luminous 2024-09-12T02:37:31.212 INFO:teuthology.orchestra.run.smithi039.stdout:min_compat_client luminous 2024-09-12T02:37:31.212 INFO:teuthology.orchestra.run.smithi039.stdout:require_osd_release squid 2024-09-12T02:37:31.212 INFO:teuthology.orchestra.run.smithi039.stdout:stretch_mode_enabled false 2024-09-12T02:37:31.213 INFO:teuthology.orchestra.run.smithi039.stdout:pool 1 '.mgr' replicated size 3 min_size 2 crush_rule 0 object_hash rjenkins pg_num 1 pgp_num 1 autoscale_mode off last_change 22 flags hashpspool stripe_width 0 pg_num_max 32 pg_num_min 1 application mgr read_balance_score 12.00 2024-09-12T02:37:31.213 INFO:teuthology.orchestra.run.smithi039.stdout:pool 2 'cephfs_metadata' replicated size 3 min_size 2 crush_rule 0 object_hash rjenkins pg_num 32 pgp_num 32 autoscale_mode off last_change 84 flags hashpspool stripe_width 0 pg_autoscale_bias 4 pg_num_min 16 recovery_priority 5 application cephfs read_balance_score 1.88 2024-09-12T02:37:31.213 INFO:teuthology.orchestra.run.smithi039.stdout:pool 3 'cephfs_data' replicated size 3 min_size 2 crush_rule 0 object_hash rjenkins pg_num 64 pgp_num 64 autoscale_mode off last_change 84 flags hashpspool stripe_width 0 pg_num_min 64 target_size_ratio 0.05 application cephfs read_balance_score 1.50 2024-09-12T02:37:31.213 INFO:teuthology.orchestra.run.smithi039.stdout:pool 4 'cephfs_data_ec' erasure profile cephfs_data_ec size 4 min_size 3 crush_rule 1 object_hash rjenkins pg_num 32 pgp_num 32 autoscale_mode off last_change 91 flags hashpspool,ec_overwrites stripe_width 8192 pg_num_min 64 target_size_ratio 0.9 application cephfs 2024-09-12T02:37:31.213 INFO:teuthology.orchestra.run.smithi039.stdout:max_osd 12 2024-09-12T02:37:31.213 INFO:teuthology.orchestra.run.smithi039.stdout:osd.0 up in weight 1 up_from 8 up_thru 87 down_at 0 last_clean_interval [0,0) [v2:172.21.15.39:6802/2437586899,v1:172.21.15.39:6803/2437586899] [v2:172.21.15.39:6804/2437586899,v1:172.21.15.39:6805/2437586899] exists,up c967b48e-8a39-4797-871b-8b1b83d9472f 2024-09-12T02:37:31.213 INFO:teuthology.orchestra.run.smithi039.stdout:osd.1 up in weight 1 up_from 13 up_thru 87 down_at 0 last_clean_interval [0,0) [v2:172.21.15.44:6800/2349287000,v1:172.21.15.44:6801/2349287000] [v2:172.21.15.44:6802/2349287000,v1:172.21.15.44:6803/2349287000] exists,up 30e1e4f4-1d50-4003-8978-cb183dca7fbb 2024-09-12T02:37:31.213 INFO:teuthology.orchestra.run.smithi039.stdout:osd.2 up in weight 1 up_from 18 up_thru 94 down_at 0 last_clean_interval [0,0) [v2:172.21.15.172:6800/1176898232,v1:172.21.15.172:6801/1176898232] [v2:172.21.15.172:6802/1176898232,v1:172.21.15.172:6803/1176898232] exists,up a758803f-8668-4fc8-9417-b8d080cd9a7c 2024-09-12T02:37:31.213 INFO:teuthology.orchestra.run.smithi039.stdout:osd.3 up in weight 1 up_from 26 up_thru 87 down_at 0 last_clean_interval [0,0) [v2:172.21.15.39:6810/2013565859,v1:172.21.15.39:6811/2013565859] [v2:172.21.15.39:6812/2013565859,v1:172.21.15.39:6813/2013565859] exists,up 8b256567-7efe-429c-bc4c-80e93228f139 2024-09-12T02:37:31.213 INFO:teuthology.orchestra.run.smithi039.stdout:osd.4 up in weight 1 up_from 33 up_thru 87 down_at 0 last_clean_interval [0,0) [v2:172.21.15.44:6808/3663639110,v1:172.21.15.44:6809/3663639110] [v2:172.21.15.44:6810/3663639110,v1:172.21.15.44:6811/3663639110] exists,up e86b6756-e2b3-49fe-9b87-1a2b015bb17a 2024-09-12T02:37:31.213 INFO:teuthology.orchestra.run.smithi039.stdout:osd.5 up in weight 1 up_from 38 up_thru 92 down_at 0 last_clean_interval [0,0) [v2:172.21.15.172:6808/998885347,v1:172.21.15.172:6809/998885347] [v2:172.21.15.172:6810/998885347,v1:172.21.15.172:6811/998885347] exists,up 9c907c92-b323-48e7-99ad-ec9756d26312 2024-09-12T02:37:31.213 INFO:teuthology.orchestra.run.smithi039.stdout:osd.6 up in weight 1 up_from 45 up_thru 92 down_at 0 last_clean_interval [0,0) [v2:172.21.15.39:6818/2569059542,v1:172.21.15.39:6819/2569059542] [v2:172.21.15.39:6820/2569059542,v1:172.21.15.39:6821/2569059542] exists,up 1fcb9bb2-6f4b-4d97-a401-aeb6a9706613 2024-09-12T02:37:31.214 INFO:teuthology.orchestra.run.smithi039.stdout:osd.7 up in weight 1 up_from 50 up_thru 87 down_at 0 last_clean_interval [0,0) [v2:172.21.15.44:6816/709635079,v1:172.21.15.44:6817/709635079] [v2:172.21.15.44:6818/709635079,v1:172.21.15.44:6819/709635079] exists,up 59e0caf9-8ce5-4161-8875-84862eba743e 2024-09-12T02:37:31.214 INFO:teuthology.orchestra.run.smithi039.stdout:osd.8 up in weight 1 up_from 57 up_thru 94 down_at 0 last_clean_interval [0,0) [v2:172.21.15.172:6816/1162792895,v1:172.21.15.172:6817/1162792895] [v2:172.21.15.172:6818/1162792895,v1:172.21.15.172:6819/1162792895] exists,up 2f6fb5c7-86cc-43eb-bdfb-45a69316937e 2024-09-12T02:37:31.214 INFO:teuthology.orchestra.run.smithi039.stdout:osd.9 up in weight 1 up_from 65 up_thru 92 down_at 0 last_clean_interval [0,0) [v2:172.21.15.39:6826/945860346,v1:172.21.15.39:6827/945860346] [v2:172.21.15.39:6828/945860346,v1:172.21.15.39:6829/945860346] exists,up 87e5dd9e-8191-4db6-83fa-cfff7c31e17e 2024-09-12T02:37:31.214 INFO:teuthology.orchestra.run.smithi039.stdout:osd.10 up in weight 1 up_from 70 up_thru 81 down_at 0 last_clean_interval [0,0) [v2:172.21.15.44:6824/3899352344,v1:172.21.15.44:6825/3899352344] [v2:172.21.15.44:6826/3899352344,v1:172.21.15.44:6827/3899352344] exists,up b55d8a00-850f-4910-a5bf-97d9ed545be7 2024-09-12T02:37:31.214 INFO:teuthology.orchestra.run.smithi039.stdout:osd.11 up in weight 1 up_from 77 up_thru 92 down_at 0 last_clean_interval [0,0) [v2:172.21.15.172:6824/3627635035,v1:172.21.15.172:6825/3627635035] [v2:172.21.15.172:6826/3627635035,v1:172.21.15.172:6827/3627635035] exists,up 20cf5df1-5a80-4272-acc0-919c6a1da55a 2024-09-12T02:37:31.214 INFO:teuthology.orchestra.run.smithi039.stdout:pg_upmap_items 2.0 [7,11] 2024-09-12T02:37:31.214 INFO:teuthology.orchestra.run.smithi039.stdout:pg_upmap_items 2.b [2,1] 2024-09-12T02:37:31.214 INFO:teuthology.orchestra.run.smithi039.stdout:pg_upmap_items 2.10 [8,11] 2024-09-12T02:37:31.214 INFO:teuthology.orchestra.run.smithi039.stdout:pg_upmap_items 2.1b [2,4] 2024-09-12T02:37:31.214 INFO:teuthology.orchestra.run.smithi039.stdout:pg_upmap_items 3.11 [4,8] 2024-09-12T02:37:31.214 INFO:teuthology.orchestra.run.smithi039.stdout:pg_upmap_items 3.24 [4,9] 2024-09-12T02:37:31.214 INFO:teuthology.orchestra.run.smithi039.stdout:pg_upmap_items 3.33 [5,9] 2024-09-12T02:37:31.214 INFO:teuthology.orchestra.run.smithi039.stdout:pg_upmap_items 3.34 [4,9] 2024-09-12T02:37:31.214 INFO:teuthology.orchestra.run.smithi039.stdout:pg_upmap_items 4.2 [9,1] 2024-09-12T02:37:31.215 INFO:teuthology.orchestra.run.smithi039.stdout:pg_upmap_items 4.6 [9,11,5,8] 2024-09-12T02:37:31.215 INFO:teuthology.orchestra.run.smithi039.stdout:pg_upmap_items 4.19 [9,8] 2024-09-12T02:37:31.215 INFO:teuthology.orchestra.run.smithi039.stdout:blocklist 172.21.15.39:6800/3152613618 expires 2024-09-13T02:27:44.717224+0000 2024-09-12T02:37:31.215 INFO:teuthology.orchestra.run.smithi039.stdout:blocklist 172.21.15.39:0/2301206766 expires 2024-09-13T02:27:44.717224+0000 2024-09-12T02:37:31.215 INFO:teuthology.orchestra.run.smithi039.stdout:blocklist 172.21.15.39:0/1941318538 expires 2024-09-13T02:27:44.717224+0000 2024-09-12T02:37:31.215 INFO:teuthology.orchestra.run.smithi039.stdout:blocklist 172.21.15.39:0/1527429435 expires 2024-09-13T02:27:44.717224+0000 2024-09-12T02:37:31.215 INFO:teuthology.orchestra.run.smithi039.stdout:blocklist 172.21.15.39:0/2913347539 expires 2024-09-13T02:27:16.531986+0000 2024-09-12T02:37:31.215 INFO:teuthology.orchestra.run.smithi039.stdout:blocklist 172.21.15.39:0/2827440002 expires 2024-09-13T02:27:16.531986+0000 2024-09-12T02:37:31.215 INFO:teuthology.orchestra.run.smithi039.stdout:blocklist 172.21.15.39:0/4075322467 expires 2024-09-13T02:27:16.531986+0000 2024-09-12T02:37:31.215 INFO:teuthology.orchestra.run.smithi039.stdout:blocklist 172.21.15.39:6801/1074685700 expires 2024-09-13T02:27:16.531986+0000 2024-09-12T02:37:31.215 INFO:teuthology.orchestra.run.smithi039.stdout:blocklist 172.21.15.39:6801/3152613618 expires 2024-09-13T02:27:44.717224+0000 2024-09-12T02:37:31.215 INFO:teuthology.orchestra.run.smithi039.stdout:blocklist 172.21.15.39:6800/1074685700 expires 2024-09-13T02:27:16.531986+0000 2024-09-12T02:37:31.216 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:37:31.213+0000 7f6400e00640 1 -- 172.21.15.39:0/3282198279 >> [v2:172.21.15.39:6800/1725006999,v1:172.21.15.39:6801/1725006999] conn(0x7f63e00a2c30 msgr2=0x7f63e00a50f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:37:31.216 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:37:31.213+0000 7f6400e00640 1 --2- 172.21.15.39:0/3282198279 >> [v2:172.21.15.39:6800/1725006999,v1:172.21.15.39:6801/1725006999] conn(0x7f63e00a2c30 0x7f63e00a50f0 secure :-1 s=READY pgs=221 cs=0 l=1 rev1=1 crypto rx=0x7f63e8030410 tx=0x7f63e8030550 comp rx=0 tx=0).stop 2024-09-12T02:37:31.216 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:37:31.213+0000 7f6400e00640 1 -- 172.21.15.39:0/3282198279 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f63fc103e00 msgr2=0x7f63fc19a0e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:37:31.216 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:37:31.213+0000 7f6400e00640 1 --2- 172.21.15.39:0/3282198279 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f63fc103e00 0x7f63fc19a0e0 secure :-1 s=READY pgs=114 cs=0 l=1 rev1=1 crypto rx=0x7f63ec00e9c0 tx=0x7f63ec00ee80 comp rx=0 tx=0).stop 2024-09-12T02:37:31.217 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:37:31.214+0000 7f6400e00640 1 -- 172.21.15.39:0/3282198279 shutdown_connections 2024-09-12T02:37:31.217 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:37:31.214+0000 7f6400e00640 1 --2- 172.21.15.39:0/3282198279 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f63fc105920 0x7f63fc1a16a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:37:31.217 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:37:31.214+0000 7f6400e00640 1 --2- 172.21.15.39:0/3282198279 >> [v2:172.21.15.39:6800/1725006999,v1:172.21.15.39:6801/1725006999] conn(0x7f63e00a2c30 0x7f63e00a50f0 unknown :-1 s=CLOSED pgs=221 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:37:31.217 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:37:31.214+0000 7f6400e00640 1 --2- 172.21.15.39:0/3282198279 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f63fc104f60 0x7f63fc19a620 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:37:31.217 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:37:31.214+0000 7f6400e00640 1 --2- 172.21.15.39:0/3282198279 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f63fc103e00 0x7f63fc19a0e0 unknown :-1 s=CLOSED pgs=114 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:37:31.217 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:37:31.214+0000 7f6400e00640 1 -- 172.21.15.39:0/3282198279 >> 172.21.15.39:0/3282198279 conn(0x7f63fc0ff5b0 msgr2=0x7f63fc1083c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:37:31.217 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:37:31.214+0000 7f6400e00640 1 -- 172.21.15.39:0/3282198279 shutdown_connections 2024-09-12T02:37:31.217 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:37:31.214+0000 7f6400e00640 1 -- 172.21.15.39:0/3282198279 wait complete. 2024-09-12T02:37:31.849 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 02:37:31 smithi039 ceph-mon[30515]: from='client.? 172.21.15.39:0/3282198279' entity='client.admin' cmd=[{"prefix": "osd dump"}]: dispatch 2024-09-12T02:37:31.948 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 12 02:37:31 smithi044 ceph-mon[35411]: from='client.? 172.21.15.39:0/3282198279' entity='client.admin' cmd=[{"prefix": "osd dump"}]: dispatch 2024-09-12T02:37:32.013 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 12 02:37:31 smithi172 ceph-mon[35609]: from='client.? 172.21.15.39:0/3282198279' entity='client.admin' cmd=[{"prefix": "osd dump"}]: dispatch 2024-09-12T02:37:32.050 INFO:teuthology.run_tasks:Running task fs.ready... 2024-09-12T02:37:32.062 DEBUG:teuthology.orchestra.run.smithi039:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc shell --fsid 4954ed46-70ae-11ef-bcea-c7b262605968 -- ceph fs dump --format=json 2024-09-12T02:37:32.440 INFO:teuthology.orchestra.run.smithi039.stderr:Inferring config /var/lib/ceph/4954ed46-70ae-11ef-bcea-c7b262605968/mon.a/config 2024-09-12T02:37:32.828 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 02:37:32 smithi039 ceph-mon[30515]: pgmap v378: 129 pgs: 129 active+clean; 646 KiB data, 348 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 85 B/s wr, 9 op/s 2024-09-12T02:37:32.948 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 12 02:37:32 smithi044 ceph-mon[35411]: pgmap v378: 129 pgs: 129 active+clean; 646 KiB data, 348 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 85 B/s wr, 9 op/s 2024-09-12T02:37:33.013 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 12 02:37:32 smithi172 ceph-mon[35609]: pgmap v378: 129 pgs: 129 active+clean; 646 KiB data, 348 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 85 B/s wr, 9 op/s 2024-09-12T02:37:33.131 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:37:33.101+0000 7ffabac00640 1 -- 172.21.15.39:0/3501301455 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7ffab4106f10 msgr2=0x7ffab410ea90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:37:33.131 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:37:33.101+0000 7ffabac00640 1 --2- 172.21.15.39:0/3501301455 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7ffab4106f10 0x7ffab410ea90 secure :-1 s=READY pgs=256 cs=0 l=1 rev1=1 crypto rx=0x7ffaac009ca0 tx=0x7ffaac02a8c0 comp rx=0 tx=0).stop 2024-09-12T02:37:33.132 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:37:33.101+0000 7ffabac00640 1 -- 172.21.15.39:0/3501301455 shutdown_connections 2024-09-12T02:37:33.132 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:37:33.101+0000 7ffabac00640 1 --2- 172.21.15.39:0/3501301455 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7ffab4106f10 0x7ffab410ea90 unknown :-1 s=CLOSED pgs=256 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:37:33.132 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:37:33.101+0000 7ffabac00640 1 --2- 172.21.15.39:0/3501301455 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7ffab4102790 0x7ffab41067e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:37:33.132 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:37:33.101+0000 7ffabac00640 1 --2- 172.21.15.39:0/3501301455 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7ffab4101de0 0x7ffab41021c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:37:33.132 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:37:33.101+0000 7ffabac00640 1 -- 172.21.15.39:0/3501301455 >> 172.21.15.39:0/3501301455 conn(0x7ffab40fd8c0 msgr2=0x7ffab40ffce0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:37:33.132 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:37:33.101+0000 7ffabac00640 1 -- 172.21.15.39:0/3501301455 shutdown_connections 2024-09-12T02:37:33.132 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:37:33.101+0000 7ffabac00640 1 -- 172.21.15.39:0/3501301455 wait complete. 2024-09-12T02:37:33.132 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:37:33.102+0000 7ffabac00640 1 Processor -- start 2024-09-12T02:37:33.132 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:37:33.102+0000 7ffabac00640 1 -- start start 2024-09-12T02:37:33.132 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:37:33.102+0000 7ffabac00640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7ffab4101de0 0x7ffab40744f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:37:33.132 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:37:33.103+0000 7ffabac00640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7ffab4102790 0x7ffab4074a30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:37:33.132 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:37:33.103+0000 7ffabac00640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7ffab4106f10 0x7ffab4074f70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:37:33.132 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:37:33.103+0000 7ffabac00640 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 -- 0x7ffab4111fc0 con 0x7ffab4102790 2024-09-12T02:37:33.133 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:37:33.103+0000 7ffabac00640 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x7ffab4111e40 con 0x7ffab4101de0 2024-09-12T02:37:33.133 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:37:33.103+0000 7ffabac00640 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7ffab4112140 con 0x7ffab4106f10 2024-09-12T02:37:33.133 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:37:33.103+0000 7ffaab400640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7ffab4102790 0x7ffab4074a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:37:33.133 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:37:33.103+0000 7ffab3e00640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7ffab4101de0 0x7ffab40744f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:37:33.133 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:37:33.103+0000 7ffaab400640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7ffab4102790 0x7ffab4074a30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.39:3300/0 says I am v2:172.21.15.39:35476/0 (socket says 172.21.15.39:35476) 2024-09-12T02:37:33.133 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:37:33.103+0000 7ffaab400640 1 -- 172.21.15.39:0/4262309116 learned_addr learned my addr 172.21.15.39:0/4262309116 (peer_addr_for_me v2:172.21.15.39:0/0) 2024-09-12T02:37:33.133 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:37:33.103+0000 7ffaab400640 1 -- 172.21.15.39:0/4262309116 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7ffab4106f10 msgr2=0x7ffab4074f70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:37:33.133 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:37:33.103+0000 7ffaab400640 1 --2- 172.21.15.39:0/4262309116 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7ffab4106f10 0x7ffab4074f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:37:33.133 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:37:33.103+0000 7ffaab400640 1 -- 172.21.15.39:0/4262309116 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7ffab4101de0 msgr2=0x7ffab40744f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:37:33.133 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:37:33.103+0000 7ffaab400640 1 --2- 172.21.15.39:0/4262309116 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7ffab4101de0 0x7ffab40744f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:37:33.133 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:37:33.103+0000 7ffaab400640 1 -- 172.21.15.39:0/4262309116 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ffab41a68a0 con 0x7ffab4102790 2024-09-12T02:37:33.133 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:37:33.104+0000 7ffaab400640 1 --2- 172.21.15.39:0/4262309116 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7ffab4102790 0x7ffab4074a30 secure :-1 s=READY pgs=257 cs=0 l=1 rev1=1 crypto rx=0x7ffa9c00e9f0 tx=0x7ffa9c00edf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:37:33.133 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:37:33.104+0000 7ffab1600640 1 -- 172.21.15.39:0/4262309116 <== mon.0 v2:172.21.15.39:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ffa9c00cd80 con 0x7ffab4102790 2024-09-12T02:37:33.134 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:37:33.104+0000 7ffab1600640 1 -- 172.21.15.39:0/4262309116 <== mon.0 v2:172.21.15.39:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7ffa9c005500 con 0x7ffab4102790 2024-09-12T02:37:33.134 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:37:33.104+0000 7ffabac00640 1 -- 172.21.15.39:0/4262309116 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ffab41a6b90 con 0x7ffab4102790 2024-09-12T02:37:33.134 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:37:33.104+0000 7ffab1600640 1 -- 172.21.15.39:0/4262309116 <== mon.0 v2:172.21.15.39:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ffa9c010690 con 0x7ffab4102790 2024-09-12T02:37:33.134 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:37:33.104+0000 7ffabac00640 1 -- 172.21.15.39:0/4262309116 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ffab41a70d0 con 0x7ffab4102790 2024-09-12T02:37:33.134 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:37:33.105+0000 7ffabac00640 1 -- 172.21.15.39:0/4262309116 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ffab41021c0 con 0x7ffab4102790 2024-09-12T02:37:33.134 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:37:33.107+0000 7ffab1600640 1 -- 172.21.15.39:0/4262309116 <== mon.0 v2:172.21.15.39:3300/0 4 ==== mgrmap(e 18) ==== 137833+0+0 (secure 0 0 0) 0x7ffa9c0046c0 con 0x7ffab4102790 2024-09-12T02:37:33.134 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:37:33.108+0000 7ffab1600640 1 --2- 172.21.15.39:0/4262309116 >> [v2:172.21.15.39:6800/1725006999,v1:172.21.15.39:6801/1725006999] conn(0x7ffa980a2c00 0x7ffa980a50c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:37:33.134 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:37:33.108+0000 7ffab1600640 1 -- 172.21.15.39:0/4262309116 <== mon.0 v2:172.21.15.39:3300/0 5 ==== osd_map(95..95 src has 1..95) ==== 9129+0+0 (secure 0 0 0) 0x7ffa9c0cf7c0 con 0x7ffab4102790 2024-09-12T02:37:33.134 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:37:33.109+0000 7ffab3e00640 1 --2- 172.21.15.39:0/4262309116 >> [v2:172.21.15.39:6800/1725006999,v1:172.21.15.39:6801/1725006999] conn(0x7ffa980a2c00 0x7ffa980a50c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:37:33.134 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:37:33.109+0000 7ffab3e00640 1 --2- 172.21.15.39:0/4262309116 >> [v2:172.21.15.39:6800/1725006999,v1:172.21.15.39:6801/1725006999] conn(0x7ffa980a2c00 0x7ffa980a50c0 secure :-1 s=READY pgs=222 cs=0 l=1 rev1=1 crypto rx=0x7ffaa40095f0 tx=0x7ffaa4005f90 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:37:33.134 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:37:33.112+0000 7ffab1600640 1 -- 172.21.15.39:0/4262309116 <== mon.0 v2:172.21.15.39:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7ffa9c09c340 con 0x7ffab4102790 2024-09-12T02:37:33.336 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:37:33.335+0000 7ffabac00640 1 -- 172.21.15.39:0/4262309116 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7ffab4109b60 con 0x7ffab4102790 2024-09-12T02:37:33.337 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:37:33.336+0000 7ffab1600640 1 -- 172.21.15.39:0/4262309116 <== mon.0 v2:172.21.15.39:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 28 v28) ==== 94+0+11975 (secure 0 0 0) 0x7ffa9c09bc40 con 0x7ffab4102790 2024-09-12T02:37:33.337 INFO:teuthology.orchestra.run.smithi039.stdout: 2024-09-12T02:37:33.337 INFO:teuthology.orchestra.run.smithi039.stdout:{"epoch":28,"btime":"2024-09-12T02:35:53:793149+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14451,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.39:6835/2325642381","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6834","nonce":2325642381},{"type":"v1","addr":"172.21.15.39:6835","nonce":2325642381}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14511,"name":"g","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.39:6839/936905514","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6838","nonce":936905514},{"type":"v1","addr":"172.21.15.39:6839","nonce":936905514}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":11}],"filesystems":[{"mdsmap":{"epoch":28,"flags":50,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-09-12T02:35:03.522182+0000","modified":"2024-09-12T02:35:53.762825+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":5,"in":[0,1,2,3,4],"up":{"mds_0":24515,"mds_1":24499,"mds_2":24484,"mds_3":24482,"mds_4":24472},"failed":[],"damaged":[],"stopped":[],"info":{"gid_14523":{"gid":14523,"name":"a","rank":4,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.39:6841/2829712180","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6840","nonce":2829712180},{"type":"v1","addr":"172.21.15.39:6841","nonce":2829712180}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24422":{"gid":24422,"name":"k","rank":3,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.44:6833/2359724364","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6832","nonce":2359724364},{"type":"v1","addr":"172.21.15.44:6833","nonce":2359724364}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24430":{"gid":24430,"name":"l","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.172:6833/3232434105","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6832","nonce":3232434105},{"type":"v1","addr":"172.21.15.172:6833","nonce":3232434105}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24446":{"gid":24446,"name":"d","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.39:6837/2743237008","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6836","nonce":2743237008},{"type":"v1","addr":"172.21.15.39:6837","nonce":2743237008}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24458":{"gid":24458,"name":"e","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.44:6835/4063842354","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6834","nonce":4063842354},{"type":"v1","addr":"172.21.15.44:6835","nonce":4063842354}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24472":{"gid":24472,"name":"f","rank":4,"incarnation":26,"state":"up:active","state_seq":21,"addr":"172.21.15.172:6835/3274676014","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6834","nonce":3274676014},{"type":"v1","addr":"172.21.15.172:6835","nonce":3274676014}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24482":{"gid":24482,"name":"h","rank":3,"incarnation":24,"state":"up:active","state_seq":19,"addr":"172.21.15.44:6837/1501493978","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6836","nonce":1501493978},{"type":"v1","addr":"172.21.15.44:6837","nonce":1501493978}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24484":{"gid":24484,"name":"c","rank":2,"incarnation":22,"state":"up:active","state_seq":20,"addr":"172.21.15.172:6837/493506747","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6836","nonce":493506747},{"type":"v1","addr":"172.21.15.172:6837","nonce":493506747}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24499":{"gid":24499,"name":"i","rank":1,"incarnation":20,"state":"up:active","state_seq":18,"addr":"172.21.15.172:6839/3742537097","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6838","nonce":3742537097},{"type":"v1","addr":"172.21.15.172:6839","nonce":3742537097}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24515":{"gid":24515,"name":"b","rank":0,"incarnation":14,"state":"up:active","state_seq":5,"addr":"172.21.15.44:6839/2556532723","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6838","nonce":2556532723},{"type":"v1","addr":"172.21.15.44:6839","nonce":2556532723}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":24515,"qdb_cluster":[24515,24499,24484,24482,24472]},"id":1}]} 2024-09-12T02:37:33.338 INFO:teuthology.orchestra.run.smithi039.stderr:dumped fsmap epoch 28 2024-09-12T02:37:33.340 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:37:33.338+0000 7ffabac00640 1 -- 172.21.15.39:0/4262309116 >> [v2:172.21.15.39:6800/1725006999,v1:172.21.15.39:6801/1725006999] conn(0x7ffa980a2c00 msgr2=0x7ffa980a50c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:37:33.340 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:37:33.338+0000 7ffabac00640 1 --2- 172.21.15.39:0/4262309116 >> [v2:172.21.15.39:6800/1725006999,v1:172.21.15.39:6801/1725006999] conn(0x7ffa980a2c00 0x7ffa980a50c0 secure :-1 s=READY pgs=222 cs=0 l=1 rev1=1 crypto rx=0x7ffaa40095f0 tx=0x7ffaa4005f90 comp rx=0 tx=0).stop 2024-09-12T02:37:33.340 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:37:33.338+0000 7ffabac00640 1 -- 172.21.15.39:0/4262309116 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7ffab4102790 msgr2=0x7ffab4074a30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:37:33.340 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:37:33.338+0000 7ffabac00640 1 --2- 172.21.15.39:0/4262309116 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7ffab4102790 0x7ffab4074a30 secure :-1 s=READY pgs=257 cs=0 l=1 rev1=1 crypto rx=0x7ffa9c00e9f0 tx=0x7ffa9c00edf0 comp rx=0 tx=0).stop 2024-09-12T02:37:33.340 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:37:33.339+0000 7ffabac00640 1 -- 172.21.15.39:0/4262309116 shutdown_connections 2024-09-12T02:37:33.340 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:37:33.339+0000 7ffabac00640 1 --2- 172.21.15.39:0/4262309116 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7ffab4106f10 0x7ffab4074f70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:37:33.340 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:37:33.339+0000 7ffabac00640 1 --2- 172.21.15.39:0/4262309116 >> [v2:172.21.15.39:6800/1725006999,v1:172.21.15.39:6801/1725006999] conn(0x7ffa980a2c00 0x7ffa980a50c0 unknown :-1 s=CLOSED pgs=222 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:37:33.340 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:37:33.339+0000 7ffabac00640 1 --2- 172.21.15.39:0/4262309116 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7ffab4102790 0x7ffab4074a30 unknown :-1 s=CLOSED pgs=257 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:37:33.340 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:37:33.339+0000 7ffabac00640 1 --2- 172.21.15.39:0/4262309116 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7ffab4101de0 0x7ffab40744f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:37:33.340 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:37:33.339+0000 7ffabac00640 1 -- 172.21.15.39:0/4262309116 >> 172.21.15.39:0/4262309116 conn(0x7ffab40fd8c0 msgr2=0x7ffab40feb40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:37:33.340 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:37:33.339+0000 7ffabac00640 1 -- 172.21.15.39:0/4262309116 shutdown_connections 2024-09-12T02:37:33.341 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:37:33.339+0000 7ffabac00640 1 -- 172.21.15.39:0/4262309116 wait complete. 2024-09-12T02:37:33.733 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 02:37:33 smithi039 ceph-mon[30515]: from='client.? 172.21.15.39:0/4262309116' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-12T02:37:33.948 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 12 02:37:33 smithi044 ceph-mon[35411]: from='client.? 172.21.15.39:0/4262309116' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-12T02:37:34.013 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 12 02:37:33 smithi172 ceph-mon[35609]: from='client.? 172.21.15.39:0/4262309116' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-12T02:37:34.107 DEBUG:teuthology.orchestra.run.smithi039:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc shell --fsid 4954ed46-70ae-11ef-bcea-c7b262605968 -- ceph fs dump --format=json 2024-09-12T02:37:34.485 INFO:teuthology.orchestra.run.smithi039.stderr:Inferring config /var/lib/ceph/4954ed46-70ae-11ef-bcea-c7b262605968/mon.a/config 2024-09-12T02:37:34.810 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 02:37:34 smithi039 ceph-mon[30515]: pgmap v379: 129 pgs: 129 active+clean; 646 KiB data, 348 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2024-09-12T02:37:34.948 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 12 02:37:34 smithi044 ceph-mon[35411]: pgmap v379: 129 pgs: 129 active+clean; 646 KiB data, 348 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2024-09-12T02:37:35.013 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 12 02:37:34 smithi172 ceph-mon[35609]: pgmap v379: 129 pgs: 129 active+clean; 646 KiB data, 348 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2024-09-12T02:37:35.051 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:37:35.050+0000 7fbfe8400640 1 -- 172.21.15.39:0/1676328560 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fbfe01049a0 msgr2=0x7fbfe01089f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:37:35.051 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:37:35.050+0000 7fbfe8400640 1 --2- 172.21.15.39:0/1676328560 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fbfe01049a0 0x7fbfe01089f0 secure :-1 s=READY pgs=258 cs=0 l=1 rev1=1 crypto rx=0x7fbfcc009900 tx=0x7fbfcc02a410 comp rx=0 tx=0).stop 2024-09-12T02:37:35.051 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:37:35.050+0000 7fbfe8400640 1 -- 172.21.15.39:0/1676328560 shutdown_connections 2024-09-12T02:37:35.052 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:37:35.050+0000 7fbfe8400640 1 --2- 172.21.15.39:0/1676328560 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fbfe0109120 0x7fbfe0110ca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:37:35.052 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:37:35.050+0000 7fbfe8400640 1 --2- 172.21.15.39:0/1676328560 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fbfe01049a0 0x7fbfe01089f0 unknown :-1 s=CLOSED pgs=258 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:37:35.052 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:37:35.050+0000 7fbfe8400640 1 --2- 172.21.15.39:0/1676328560 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fbfe0103ff0 0x7fbfe01043d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:37:35.052 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:37:35.050+0000 7fbfe8400640 1 -- 172.21.15.39:0/1676328560 >> 172.21.15.39:0/1676328560 conn(0x7fbfe00ffa90 msgr2=0x7fbfe0101eb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:37:35.052 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:37:35.050+0000 7fbfe8400640 1 -- 172.21.15.39:0/1676328560 shutdown_connections 2024-09-12T02:37:35.052 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:37:35.050+0000 7fbfe8400640 1 -- 172.21.15.39:0/1676328560 wait complete. 2024-09-12T02:37:35.053 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:37:35.051+0000 7fbfe8400640 1 Processor -- start 2024-09-12T02:37:35.053 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:37:35.051+0000 7fbfe8400640 1 -- start start 2024-09-12T02:37:35.054 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:37:35.052+0000 7fbfe8400640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fbfe0103ff0 0x7fbfe019a6a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:37:35.054 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:37:35.052+0000 7fbfe8400640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fbfe01049a0 0x7fbfe019abe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:37:35.054 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:37:35.052+0000 7fbfe8400640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fbfe0109120 0x7fbfe019ef70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:37:35.054 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:37:35.052+0000 7fbfe8400640 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 -- 0x7fbfe0114120 con 0x7fbfe0103ff0 2024-09-12T02:37:35.054 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:37:35.052+0000 7fbfe8400640 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x7fbfe0113fa0 con 0x7fbfe01049a0 2024-09-12T02:37:35.054 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:37:35.052+0000 7fbfe8400640 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7fbfe01142a0 con 0x7fbfe0109120 2024-09-12T02:37:35.054 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:37:35.052+0000 7fbfe5a00640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fbfe0103ff0 0x7fbfe019a6a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:37:35.054 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:37:35.052+0000 7fbfe5a00640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fbfe0103ff0 0x7fbfe019a6a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.39:3300/0 says I am v2:172.21.15.39:35490/0 (socket says 172.21.15.39:35490) 2024-09-12T02:37:35.054 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:37:35.052+0000 7fbfe5a00640 1 -- 172.21.15.39:0/225618022 learned_addr learned my addr 172.21.15.39:0/225618022 (peer_addr_for_me v2:172.21.15.39:0/0) 2024-09-12T02:37:35.054 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:37:35.052+0000 7fbfe5000640 1 --2- 172.21.15.39:0/225618022 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fbfe01049a0 0x7fbfe019abe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:37:35.055 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:37:35.052+0000 7fbfe6400640 1 --2- 172.21.15.39:0/225618022 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fbfe0109120 0x7fbfe019ef70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:37:35.055 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:37:35.053+0000 7fbfe5a00640 1 -- 172.21.15.39:0/225618022 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fbfe0109120 msgr2=0x7fbfe019ef70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:37:35.055 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:37:35.053+0000 7fbfe5a00640 1 --2- 172.21.15.39:0/225618022 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fbfe0109120 0x7fbfe019ef70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:37:35.055 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:37:35.053+0000 7fbfe5a00640 1 -- 172.21.15.39:0/225618022 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fbfe01049a0 msgr2=0x7fbfe019abe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:37:35.055 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:37:35.053+0000 7fbfe5a00640 1 --2- 172.21.15.39:0/225618022 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fbfe01049a0 0x7fbfe019abe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:37:35.055 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:37:35.053+0000 7fbfe5a00640 1 -- 172.21.15.39:0/225618022 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fbfe019f650 con 0x7fbfe0103ff0 2024-09-12T02:37:35.055 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:37:35.053+0000 7fbfe6400640 1 --2- 172.21.15.39:0/225618022 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fbfe0109120 0x7fbfe019ef70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-12T02:37:35.055 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:37:35.053+0000 7fbfe5a00640 1 --2- 172.21.15.39:0/225618022 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fbfe0103ff0 0x7fbfe019a6a0 secure :-1 s=READY pgs=259 cs=0 l=1 rev1=1 crypto rx=0x7fbfd400e9f0 tx=0x7fbfd400eeb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:37:35.056 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:37:35.053+0000 7fbfde000640 1 -- 172.21.15.39:0/225618022 <== mon.0 v2:172.21.15.39:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbfd400cd80 con 0x7fbfe0103ff0 2024-09-12T02:37:35.056 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:37:35.053+0000 7fbfde000640 1 -- 172.21.15.39:0/225618022 <== mon.0 v2:172.21.15.39:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fbfd4010910 con 0x7fbfe0103ff0 2024-09-12T02:37:35.056 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:37:35.053+0000 7fbfde000640 1 -- 172.21.15.39:0/225618022 <== mon.0 v2:172.21.15.39:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbfd4018990 con 0x7fbfe0103ff0 2024-09-12T02:37:35.056 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:37:35.053+0000 7fbfe8400640 1 -- 172.21.15.39:0/225618022 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fbfe019f940 con 0x7fbfe0103ff0 2024-09-12T02:37:35.056 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:37:35.053+0000 7fbfe8400640 1 -- 172.21.15.39:0/225618022 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fbfe01a7220 con 0x7fbfe0103ff0 2024-09-12T02:37:35.056 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:37:35.054+0000 7fbfe8400640 1 -- 172.21.15.39:0/225618022 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fbfe01043d0 con 0x7fbfe0103ff0 2024-09-12T02:37:35.057 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:37:35.056+0000 7fbfde000640 1 -- 172.21.15.39:0/225618022 <== mon.0 v2:172.21.15.39:3300/0 4 ==== mgrmap(e 18) ==== 137833+0+0 (secure 0 0 0) 0x7fbfd4010ac0 con 0x7fbfe0103ff0 2024-09-12T02:37:35.058 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:37:35.057+0000 7fbfde000640 1 --2- 172.21.15.39:0/225618022 >> [v2:172.21.15.39:6800/1725006999,v1:172.21.15.39:6801/1725006999] conn(0x7fbfc80a2b80 0x7fbfc80a5040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:37:35.059 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:37:35.058+0000 7fbfde000640 1 -- 172.21.15.39:0/225618022 <== mon.0 v2:172.21.15.39:3300/0 5 ==== osd_map(95..95 src has 1..95) ==== 9129+0+0 (secure 0 0 0) 0x7fbfd40cf7e0 con 0x7fbfe0103ff0 2024-09-12T02:37:35.059 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:37:35.058+0000 7fbfe5000640 1 --2- 172.21.15.39:0/225618022 >> [v2:172.21.15.39:6800/1725006999,v1:172.21.15.39:6801/1725006999] conn(0x7fbfc80a2b80 0x7fbfc80a5040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:37:35.059 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:37:35.059+0000 7fbfe5000640 1 --2- 172.21.15.39:0/225618022 >> [v2:172.21.15.39:6800/1725006999,v1:172.21.15.39:6801/1725006999] conn(0x7fbfc80a2b80 0x7fbfc80a5040 secure :-1 s=READY pgs=223 cs=0 l=1 rev1=1 crypto rx=0x7fbfcc009230 tx=0x7fbfcc0058d0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:37:35.062 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:37:35.061+0000 7fbfde000640 1 -- 172.21.15.39:0/225618022 <== mon.0 v2:172.21.15.39:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7fbfd409c360 con 0x7fbfe0103ff0 2024-09-12T02:37:35.281 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:37:35.280+0000 7fbfe8400640 1 -- 172.21.15.39:0/225618022 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fbfe002d7c0 con 0x7fbfe0103ff0 2024-09-12T02:37:35.282 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:37:35.281+0000 7fbfde000640 1 -- 172.21.15.39:0/225618022 <== mon.0 v2:172.21.15.39:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 28 v28) ==== 94+0+11975 (secure 0 0 0) 0x7fbfd409bc60 con 0x7fbfe0103ff0 2024-09-12T02:37:35.282 INFO:teuthology.orchestra.run.smithi039.stdout: 2024-09-12T02:37:35.282 INFO:teuthology.orchestra.run.smithi039.stdout:{"epoch":28,"btime":"2024-09-12T02:35:53:793149+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14451,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.39:6835/2325642381","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6834","nonce":2325642381},{"type":"v1","addr":"172.21.15.39:6835","nonce":2325642381}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14511,"name":"g","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.39:6839/936905514","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6838","nonce":936905514},{"type":"v1","addr":"172.21.15.39:6839","nonce":936905514}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":11}],"filesystems":[{"mdsmap":{"epoch":28,"flags":50,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-09-12T02:35:03.522182+0000","modified":"2024-09-12T02:35:53.762825+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":5,"in":[0,1,2,3,4],"up":{"mds_0":24515,"mds_1":24499,"mds_2":24484,"mds_3":24482,"mds_4":24472},"failed":[],"damaged":[],"stopped":[],"info":{"gid_14523":{"gid":14523,"name":"a","rank":4,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.39:6841/2829712180","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6840","nonce":2829712180},{"type":"v1","addr":"172.21.15.39:6841","nonce":2829712180}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24422":{"gid":24422,"name":"k","rank":3,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.44:6833/2359724364","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6832","nonce":2359724364},{"type":"v1","addr":"172.21.15.44:6833","nonce":2359724364}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24430":{"gid":24430,"name":"l","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.172:6833/3232434105","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6832","nonce":3232434105},{"type":"v1","addr":"172.21.15.172:6833","nonce":3232434105}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24446":{"gid":24446,"name":"d","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.39:6837/2743237008","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6836","nonce":2743237008},{"type":"v1","addr":"172.21.15.39:6837","nonce":2743237008}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24458":{"gid":24458,"name":"e","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.44:6835/4063842354","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6834","nonce":4063842354},{"type":"v1","addr":"172.21.15.44:6835","nonce":4063842354}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24472":{"gid":24472,"name":"f","rank":4,"incarnation":26,"state":"up:active","state_seq":21,"addr":"172.21.15.172:6835/3274676014","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6834","nonce":3274676014},{"type":"v1","addr":"172.21.15.172:6835","nonce":3274676014}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24482":{"gid":24482,"name":"h","rank":3,"incarnation":24,"state":"up:active","state_seq":19,"addr":"172.21.15.44:6837/1501493978","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6836","nonce":1501493978},{"type":"v1","addr":"172.21.15.44:6837","nonce":1501493978}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24484":{"gid":24484,"name":"c","rank":2,"incarnation":22,"state":"up:active","state_seq":20,"addr":"172.21.15.172:6837/493506747","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6836","nonce":493506747},{"type":"v1","addr":"172.21.15.172:6837","nonce":493506747}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24499":{"gid":24499,"name":"i","rank":1,"incarnation":20,"state":"up:active","state_seq":18,"addr":"172.21.15.172:6839/3742537097","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6838","nonce":3742537097},{"type":"v1","addr":"172.21.15.172:6839","nonce":3742537097}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24515":{"gid":24515,"name":"b","rank":0,"incarnation":14,"state":"up:active","state_seq":5,"addr":"172.21.15.44:6839/2556532723","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6838","nonce":2556532723},{"type":"v1","addr":"172.21.15.44:6839","nonce":2556532723}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":24515,"qdb_cluster":[24515,24499,24484,24482,24472]},"id":1}]} 2024-09-12T02:37:35.282 INFO:teuthology.orchestra.run.smithi039.stderr:dumped fsmap epoch 28 2024-09-12T02:37:35.284 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:37:35.283+0000 7fbfe8400640 1 -- 172.21.15.39:0/225618022 >> [v2:172.21.15.39:6800/1725006999,v1:172.21.15.39:6801/1725006999] conn(0x7fbfc80a2b80 msgr2=0x7fbfc80a5040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:37:35.284 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:37:35.283+0000 7fbfe8400640 1 --2- 172.21.15.39:0/225618022 >> [v2:172.21.15.39:6800/1725006999,v1:172.21.15.39:6801/1725006999] conn(0x7fbfc80a2b80 0x7fbfc80a5040 secure :-1 s=READY pgs=223 cs=0 l=1 rev1=1 crypto rx=0x7fbfcc009230 tx=0x7fbfcc0058d0 comp rx=0 tx=0).stop 2024-09-12T02:37:35.284 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:37:35.283+0000 7fbfe8400640 1 -- 172.21.15.39:0/225618022 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fbfe0103ff0 msgr2=0x7fbfe019a6a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:37:35.285 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:37:35.283+0000 7fbfe8400640 1 --2- 172.21.15.39:0/225618022 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fbfe0103ff0 0x7fbfe019a6a0 secure :-1 s=READY pgs=259 cs=0 l=1 rev1=1 crypto rx=0x7fbfd400e9f0 tx=0x7fbfd400eeb0 comp rx=0 tx=0).stop 2024-09-12T02:37:35.285 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:37:35.283+0000 7fbfe8400640 1 -- 172.21.15.39:0/225618022 shutdown_connections 2024-09-12T02:37:35.285 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:37:35.283+0000 7fbfe8400640 1 --2- 172.21.15.39:0/225618022 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fbfe0109120 0x7fbfe019ef70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:37:35.285 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:37:35.283+0000 7fbfe8400640 1 --2- 172.21.15.39:0/225618022 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fbfe01049a0 0x7fbfe019abe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:37:35.285 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:37:35.283+0000 7fbfe8400640 1 --2- 172.21.15.39:0/225618022 >> [v2:172.21.15.39:6800/1725006999,v1:172.21.15.39:6801/1725006999] conn(0x7fbfc80a2b80 0x7fbfc80a5040 unknown :-1 s=CLOSED pgs=223 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:37:35.285 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:37:35.283+0000 7fbfe8400640 1 --2- 172.21.15.39:0/225618022 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fbfe0103ff0 0x7fbfe019a6a0 unknown :-1 s=CLOSED pgs=259 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:37:35.285 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:37:35.283+0000 7fbfe8400640 1 -- 172.21.15.39:0/225618022 >> 172.21.15.39:0/225618022 conn(0x7fbfe00ffa90 msgr2=0x7fbfe0100d70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:37:35.285 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:37:35.284+0000 7fbfe8400640 1 -- 172.21.15.39:0/225618022 shutdown_connections 2024-09-12T02:37:35.285 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:37:35.284+0000 7fbfe8400640 1 -- 172.21.15.39:0/225618022 wait complete. 2024-09-12T02:37:35.599 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 02:37:35 smithi039 ceph-mon[30515]: from='client.? 172.21.15.39:0/225618022' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-12T02:37:35.859 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 12 02:37:35 smithi172 ceph-mon[35609]: from='client.? 172.21.15.39:0/225618022' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-12T02:37:35.948 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 12 02:37:35 smithi044 ceph-mon[35411]: from='client.? 172.21.15.39:0/225618022' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-12T02:37:36.083 DEBUG:teuthology.orchestra.run.smithi039:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc shell --fsid 4954ed46-70ae-11ef-bcea-c7b262605968 -- ceph osd dump --format=json 2024-09-12T02:37:36.474 INFO:teuthology.orchestra.run.smithi039.stderr:Inferring config /var/lib/ceph/4954ed46-70ae-11ef-bcea-c7b262605968/mon.a/config 2024-09-12T02:37:36.824 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 02:37:36 smithi039 ceph-mon[30515]: pgmap v380: 129 pgs: 129 active+clean; 646 KiB data, 348 MiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2024-09-12T02:37:36.948 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 12 02:37:36 smithi044 ceph-mon[35411]: pgmap v380: 129 pgs: 129 active+clean; 646 KiB data, 348 MiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2024-09-12T02:37:37.013 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 12 02:37:36 smithi172 ceph-mon[35609]: pgmap v380: 129 pgs: 129 active+clean; 646 KiB data, 348 MiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2024-09-12T02:37:37.078 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:37:37.077+0000 7f6248400640 1 -- 172.21.15.39:0/2904014485 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f6240074ee0 msgr2=0x7f624010dee0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:37:37.079 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:37:37.077+0000 7f6248400640 1 --2- 172.21.15.39:0/2904014485 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f6240074ee0 0x7f624010dee0 secure :-1 s=READY pgs=260 cs=0 l=1 rev1=1 crypto rx=0x7f622c009900 tx=0x7f622c02a480 comp rx=0 tx=0).stop 2024-09-12T02:37:37.079 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:37:37.077+0000 7f6248400640 1 -- 172.21.15.39:0/2904014485 shutdown_connections 2024-09-12T02:37:37.079 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:37:37.077+0000 7f6248400640 1 --2- 172.21.15.39:0/2904014485 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f624010e420 0x7f6240110810 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:37:37.079 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:37:37.077+0000 7f6248400640 1 --2- 172.21.15.39:0/2904014485 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f6240074ee0 0x7f624010dee0 unknown :-1 s=CLOSED pgs=260 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:37:37.079 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:37:37.077+0000 7f6248400640 1 --2- 172.21.15.39:0/2904014485 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f62400745c0 0x7f62400749a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:37:37.079 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:37:37.077+0000 7f6248400640 1 -- 172.21.15.39:0/2904014485 >> 172.21.15.39:0/2904014485 conn(0x7f62400fd8c0 msgr2=0x7f62400ffce0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:37:37.079 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:37:37.077+0000 7f6248400640 1 -- 172.21.15.39:0/2904014485 shutdown_connections 2024-09-12T02:37:37.079 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:37:37.077+0000 7f6248400640 1 -- 172.21.15.39:0/2904014485 wait complete. 2024-09-12T02:37:37.080 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:37:37.078+0000 7f6248400640 1 Processor -- start 2024-09-12T02:37:37.081 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:37:37.078+0000 7f6248400640 1 -- start start 2024-09-12T02:37:37.081 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:37:37.079+0000 7f6248400640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f62400745c0 0x7f624019a650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:37:37.081 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:37:37.079+0000 7f6248400640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f6240074ee0 0x7f624019ab90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:37:37.081 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:37:37.079+0000 7f6248400640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f624010e420 0x7f624019ef20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:37:37.081 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:37:37.079+0000 7f6248400640 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 -- 0x7f6240114170 con 0x7f62400745c0 2024-09-12T02:37:37.081 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:37:37.079+0000 7f6248400640 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x7f6240113ff0 con 0x7f624010e420 2024-09-12T02:37:37.081 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:37:37.079+0000 7f6248400640 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7f62401142f0 con 0x7f6240074ee0 2024-09-12T02:37:37.081 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:37:37.079+0000 7f6245a00640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f62400745c0 0x7f624019a650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:37:37.081 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:37:37.079+0000 7f6245a00640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f62400745c0 0x7f624019a650 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.39:3300/0 says I am v2:172.21.15.39:35506/0 (socket says 172.21.15.39:35506) 2024-09-12T02:37:37.081 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:37:37.079+0000 7f6246400640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f624010e420 0x7f624019ef20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:37:37.081 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:37:37.079+0000 7f6245a00640 1 -- 172.21.15.39:0/2188272914 learned_addr learned my addr 172.21.15.39:0/2188272914 (peer_addr_for_me v2:172.21.15.39:0/0) 2024-09-12T02:37:37.081 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:37:37.080+0000 7f6245000640 1 --2- 172.21.15.39:0/2188272914 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f6240074ee0 0x7f624019ab90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:37:37.081 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:37:37.080+0000 7f6245a00640 1 -- 172.21.15.39:0/2188272914 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f6240074ee0 msgr2=0x7f624019ab90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:37:37.082 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:37:37.080+0000 7f6245a00640 1 --2- 172.21.15.39:0/2188272914 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f6240074ee0 0x7f624019ab90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:37:37.082 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:37:37.080+0000 7f6245a00640 1 -- 172.21.15.39:0/2188272914 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f624010e420 msgr2=0x7f624019ef20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:37:37.082 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:37:37.080+0000 7f6245a00640 1 --2- 172.21.15.39:0/2188272914 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f624010e420 0x7f624019ef20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:37:37.082 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:37:37.080+0000 7f6245a00640 1 -- 172.21.15.39:0/2188272914 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f624019f600 con 0x7f62400745c0 2024-09-12T02:37:37.082 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:37:37.080+0000 7f6245000640 1 --2- 172.21.15.39:0/2188272914 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f6240074ee0 0x7f624019ab90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-12T02:37:37.082 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:37:37.080+0000 7f6246400640 1 --2- 172.21.15.39:0/2188272914 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f624010e420 0x7f624019ef20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-12T02:37:37.083 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:37:37.080+0000 7f6245a00640 1 --2- 172.21.15.39:0/2188272914 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f62400745c0 0x7f624019a650 secure :-1 s=READY pgs=261 cs=0 l=1 rev1=1 crypto rx=0x7f623400e9f0 tx=0x7f623400eeb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:37:37.083 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:37:37.080+0000 7f623e000640 1 -- 172.21.15.39:0/2188272914 <== mon.0 v2:172.21.15.39:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f623400cd80 con 0x7f62400745c0 2024-09-12T02:37:37.083 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:37:37.081+0000 7f6248400640 1 -- 172.21.15.39:0/2188272914 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f624019f8f0 con 0x7f62400745c0 2024-09-12T02:37:37.083 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:37:37.081+0000 7f623e000640 1 -- 172.21.15.39:0/2188272914 <== mon.0 v2:172.21.15.39:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f6234010910 con 0x7f62400745c0 2024-09-12T02:37:37.083 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:37:37.081+0000 7f623e000640 1 -- 172.21.15.39:0/2188272914 <== mon.0 v2:172.21.15.39:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6234018990 con 0x7f62400745c0 2024-09-12T02:37:37.083 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:37:37.081+0000 7f6248400640 1 -- 172.21.15.39:0/2188272914 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f62401a71d0 con 0x7f62400745c0 2024-09-12T02:37:37.083 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:37:37.082+0000 7f6248400640 1 -- 172.21.15.39:0/2188272914 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f62400749a0 con 0x7f62400745c0 2024-09-12T02:37:37.085 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:37:37.084+0000 7f623e000640 1 -- 172.21.15.39:0/2188272914 <== mon.0 v2:172.21.15.39:3300/0 4 ==== mgrmap(e 18) ==== 137833+0+0 (secure 0 0 0) 0x7f6234010ac0 con 0x7f62400745c0 2024-09-12T02:37:37.086 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:37:37.085+0000 7f623e000640 1 --2- 172.21.15.39:0/2188272914 >> [v2:172.21.15.39:6800/1725006999,v1:172.21.15.39:6801/1725006999] conn(0x7f62280a2c00 0x7f62280a50c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:37:37.086 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:37:37.086+0000 7f623e000640 1 -- 172.21.15.39:0/2188272914 <== mon.0 v2:172.21.15.39:3300/0 5 ==== osd_map(95..95 src has 1..95) ==== 9129+0+0 (secure 0 0 0) 0x7f62340cfb20 con 0x7f62400745c0 2024-09-12T02:37:37.086 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:37:37.086+0000 7f6245000640 1 --2- 172.21.15.39:0/2188272914 >> [v2:172.21.15.39:6800/1725006999,v1:172.21.15.39:6801/1725006999] conn(0x7f62280a2c00 0x7f62280a50c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:37:37.087 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:37:37.086+0000 7f6245000640 1 --2- 172.21.15.39:0/2188272914 >> [v2:172.21.15.39:6800/1725006999,v1:172.21.15.39:6801/1725006999] conn(0x7f62280a2c00 0x7f62280a50c0 secure :-1 s=READY pgs=224 cs=0 l=1 rev1=1 crypto rx=0x7f622c000c00 tx=0x7f622c032c70 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:37:37.088 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:37:37.088+0000 7f623e000640 1 -- 172.21.15.39:0/2188272914 <== mon.0 v2:172.21.15.39:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7f623409c700 con 0x7f62400745c0 2024-09-12T02:37:37.287 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:37:37.286+0000 7f6248400640 1 -- 172.21.15.39:0/2188272914 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f6240109600 con 0x7f62400745c0 2024-09-12T02:37:37.289 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:37:37.288+0000 7f623e000640 1 -- 172.21.15.39:0/2188272914 <== mon.0 v2:172.21.15.39:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v95) ==== 74+0+24770 (secure 0 0 0) 0x7f62340bc0c0 con 0x7f62400745c0 2024-09-12T02:37:37.289 INFO:teuthology.orchestra.run.smithi039.stdout: 2024-09-12T02:37:37.290 INFO:teuthology.orchestra.run.smithi039.stdout:{"epoch":95,"fsid":"4954ed46-70ae-11ef-bcea-c7b262605968","created":"2024-09-12T02:26:43.086467+0000","modified":"2024-09-12T02:36:46.999173+0000","last_up_change":"2024-09-12T02:34:08.626341+0000","last_in_change":"2024-09-12T02:33:45.553591+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":27,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":12,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-12T02:30:09.347905+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":12,"score_stable":12,"optimal_score":0.25,"raw_score_acting":3,"raw_score_stable":3,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-09-12T02:34:58.580872+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"84","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.8799999952316284,"score_stable":1.8799999952316284,"optimal_score":1,"raw_score_acting":1.8799999952316284,"raw_score_stable":1.8799999952316284,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-09-12T02:35:01.469805+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"84","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2024-09-12T02:35:11.088109+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"91","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"c967b48e-8a39-4797-871b-8b1b83d9472f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":87,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6802","nonce":2437586899},{"type":"v1","addr":"172.21.15.39:6803","nonce":2437586899}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6804","nonce":2437586899},{"type":"v1","addr":"172.21.15.39:6805","nonce":2437586899}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6808","nonce":2437586899},{"type":"v1","addr":"172.21.15.39:6809","nonce":2437586899}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6806","nonce":2437586899},{"type":"v1","addr":"172.21.15.39:6807","nonce":2437586899}]},"public_addr":"172.21.15.39:6803/2437586899","cluster_addr":"172.21.15.39:6805/2437586899","heartbeat_back_addr":"172.21.15.39:6809/2437586899","heartbeat_front_addr":"172.21.15.39:6807/2437586899","state":["exists","up"]},{"osd":1,"uuid":"30e1e4f4-1d50-4003-8978-cb183dca7fbb","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":87,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6800","nonce":2349287000},{"type":"v1","addr":"172.21.15.44:6801","nonce":2349287000}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6802","nonce":2349287000},{"type":"v1","addr":"172.21.15.44:6803","nonce":2349287000}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6806","nonce":2349287000},{"type":"v1","addr":"172.21.15.44:6807","nonce":2349287000}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6804","nonce":2349287000},{"type":"v1","addr":"172.21.15.44:6805","nonce":2349287000}]},"public_addr":"172.21.15.44:6801/2349287000","cluster_addr":"172.21.15.44:6803/2349287000","heartbeat_back_addr":"172.21.15.44:6807/2349287000","heartbeat_front_addr":"172.21.15.44:6805/2349287000","state":["exists","up"]},{"osd":2,"uuid":"a758803f-8668-4fc8-9417-b8d080cd9a7c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":18,"up_thru":94,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6800","nonce":1176898232},{"type":"v1","addr":"172.21.15.172:6801","nonce":1176898232}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6802","nonce":1176898232},{"type":"v1","addr":"172.21.15.172:6803","nonce":1176898232}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6806","nonce":1176898232},{"type":"v1","addr":"172.21.15.172:6807","nonce":1176898232}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6804","nonce":1176898232},{"type":"v1","addr":"172.21.15.172:6805","nonce":1176898232}]},"public_addr":"172.21.15.172:6801/1176898232","cluster_addr":"172.21.15.172:6803/1176898232","heartbeat_back_addr":"172.21.15.172:6807/1176898232","heartbeat_front_addr":"172.21.15.172:6805/1176898232","state":["exists","up"]},{"osd":3,"uuid":"8b256567-7efe-429c-bc4c-80e93228f139","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":26,"up_thru":87,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6810","nonce":2013565859},{"type":"v1","addr":"172.21.15.39:6811","nonce":2013565859}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6812","nonce":2013565859},{"type":"v1","addr":"172.21.15.39:6813","nonce":2013565859}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6816","nonce":2013565859},{"type":"v1","addr":"172.21.15.39:6817","nonce":2013565859}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6814","nonce":2013565859},{"type":"v1","addr":"172.21.15.39:6815","nonce":2013565859}]},"public_addr":"172.21.15.39:6811/2013565859","cluster_addr":"172.21.15.39:6813/2013565859","heartbeat_back_addr":"172.21.15.39:6817/2013565859","heartbeat_front_addr":"172.21.15.39:6815/2013565859","state":["exists","up"]},{"osd":4,"uuid":"e86b6756-e2b3-49fe-9b87-1a2b015bb17a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":33,"up_thru":87,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6808","nonce":3663639110},{"type":"v1","addr":"172.21.15.44:6809","nonce":3663639110}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6810","nonce":3663639110},{"type":"v1","addr":"172.21.15.44:6811","nonce":3663639110}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6814","nonce":3663639110},{"type":"v1","addr":"172.21.15.44:6815","nonce":3663639110}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6812","nonce":3663639110},{"type":"v1","addr":"172.21.15.44:6813","nonce":3663639110}]},"public_addr":"172.21.15.44:6809/3663639110","cluster_addr":"172.21.15.44:6811/3663639110","heartbeat_back_addr":"172.21.15.44:6815/3663639110","heartbeat_front_addr":"172.21.15.44:6813/3663639110","state":["exists","up"]},{"osd":5,"uuid":"9c907c92-b323-48e7-99ad-ec9756d26312","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":38,"up_thru":92,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6808","nonce":998885347},{"type":"v1","addr":"172.21.15.172:6809","nonce":998885347}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6810","nonce":998885347},{"type":"v1","addr":"172.21.15.172:6811","nonce":998885347}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6814","nonce":998885347},{"type":"v1","addr":"172.21.15.172:6815","nonce":998885347}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6812","nonce":998885347},{"type":"v1","addr":"172.21.15.172:6813","nonce":998885347}]},"public_addr":"172.21.15.172:6809/998885347","cluster_addr":"172.21.15.172:6811/998885347","heartbeat_back_addr":"172.21.15.172:6815/998885347","heartbeat_front_addr":"172.21.15.172:6813/998885347","state":["exists","up"]},{"osd":6,"uuid":"1fcb9bb2-6f4b-4d97-a401-aeb6a9706613","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":45,"up_thru":92,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6818","nonce":2569059542},{"type":"v1","addr":"172.21.15.39:6819","nonce":2569059542}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6820","nonce":2569059542},{"type":"v1","addr":"172.21.15.39:6821","nonce":2569059542}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6824","nonce":2569059542},{"type":"v1","addr":"172.21.15.39:6825","nonce":2569059542}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6822","nonce":2569059542},{"type":"v1","addr":"172.21.15.39:6823","nonce":2569059542}]},"public_addr":"172.21.15.39:6819/2569059542","cluster_addr":"172.21.15.39:6821/2569059542","heartbeat_back_addr":"172.21.15.39:6825/2569059542","heartbeat_front_addr":"172.21.15.39:6823/2569059542","state":["exists","up"]},{"osd":7,"uuid":"59e0caf9-8ce5-4161-8875-84862eba743e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":50,"up_thru":87,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6816","nonce":709635079},{"type":"v1","addr":"172.21.15.44:6817","nonce":709635079}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6818","nonce":709635079},{"type":"v1","addr":"172.21.15.44:6819","nonce":709635079}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6822","nonce":709635079},{"type":"v1","addr":"172.21.15.44:6823","nonce":709635079}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6820","nonce":709635079},{"type":"v1","addr":"172.21.15.44:6821","nonce":709635079}]},"public_addr":"172.21.15.44:6817/709635079","cluster_addr":"172.21.15.44:6819/709635079","heartbeat_back_addr":"172.21.15.44:6823/709635079","heartbeat_front_addr":"172.21.15.44:6821/709635079","state":["exists","up"]},{"osd":8,"uuid":"2f6fb5c7-86cc-43eb-bdfb-45a69316937e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":57,"up_thru":94,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6816","nonce":1162792895},{"type":"v1","addr":"172.21.15.172:6817","nonce":1162792895}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6818","nonce":1162792895},{"type":"v1","addr":"172.21.15.172:6819","nonce":1162792895}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6822","nonce":1162792895},{"type":"v1","addr":"172.21.15.172:6823","nonce":1162792895}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6820","nonce":1162792895},{"type":"v1","addr":"172.21.15.172:6821","nonce":1162792895}]},"public_addr":"172.21.15.172:6817/1162792895","cluster_addr":"172.21.15.172:6819/1162792895","heartbeat_back_addr":"172.21.15.172:6823/1162792895","heartbeat_front_addr":"172.21.15.172:6821/1162792895","state":["exists","up"]},{"osd":9,"uuid":"87e5dd9e-8191-4db6-83fa-cfff7c31e17e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":65,"up_thru":92,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6826","nonce":945860346},{"type":"v1","addr":"172.21.15.39:6827","nonce":945860346}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6828","nonce":945860346},{"type":"v1","addr":"172.21.15.39:6829","nonce":945860346}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6832","nonce":945860346},{"type":"v1","addr":"172.21.15.39:6833","nonce":945860346}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6830","nonce":945860346},{"type":"v1","addr":"172.21.15.39:6831","nonce":945860346}]},"public_addr":"172.21.15.39:6827/945860346","cluster_addr":"172.21.15.39:6829/945860346","heartbeat_back_addr":"172.21.15.39:6833/945860346","heartbeat_front_addr":"172.21.15.39:6831/945860346","state":["exists","up"]},{"osd":10,"uuid":"b55d8a00-850f-4910-a5bf-97d9ed545be7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":70,"up_thru":81,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6824","nonce":3899352344},{"type":"v1","addr":"172.21.15.44:6825","nonce":3899352344}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6826","nonce":3899352344},{"type":"v1","addr":"172.21.15.44:6827","nonce":3899352344}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6830","nonce":3899352344},{"type":"v1","addr":"172.21.15.44:6831","nonce":3899352344}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6828","nonce":3899352344},{"type":"v1","addr":"172.21.15.44:6829","nonce":3899352344}]},"public_addr":"172.21.15.44:6825/3899352344","cluster_addr":"172.21.15.44:6827/3899352344","heartbeat_back_addr":"172.21.15.44:6831/3899352344","heartbeat_front_addr":"172.21.15.44:6829/3899352344","state":["exists","up"]},{"osd":11,"uuid":"20cf5df1-5a80-4272-acc0-919c6a1da55a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":77,"up_thru":92,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6824","nonce":3627635035},{"type":"v1","addr":"172.21.15.172:6825","nonce":3627635035}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6826","nonce":3627635035},{"type":"v1","addr":"172.21.15.172:6827","nonce":3627635035}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6830","nonce":3627635035},{"type":"v1","addr":"172.21.15.172:6831","nonce":3627635035}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6828","nonce":3627635035},{"type":"v1","addr":"172.21.15.172:6829","nonce":3627635035}]},"public_addr":"172.21.15.172:6825/3627635035","cluster_addr":"172.21.15.172:6827/3627635035","heartbeat_back_addr":"172.21.15.172:6831/3627635035","heartbeat_front_addr":"172.21.15.172:6829/3627635035","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T02:29:15.367468+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T02:29:41.518207+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T02:30:06.004371+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T02:30:34.793371+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T02:31:00.878517+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T02:31:26.675956+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T02:31:55.950748+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T02:32:22.824017+0000","dead_epoch":0},{"osd":8,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T02:32:46.775880+0000","dead_epoch":0},{"osd":9,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T02:33:16.420347+0000","dead_epoch":0},{"osd":10,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T02:33:42.185837+0000","dead_epoch":0},{"osd":11,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T02:34:07.312555+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"2.0","mappings":[{"from":7,"to":11}]},{"pgid":"2.b","mappings":[{"from":2,"to":1}]},{"pgid":"2.10","mappings":[{"from":8,"to":11}]},{"pgid":"2.1b","mappings":[{"from":2,"to":4}]},{"pgid":"3.11","mappings":[{"from":4,"to":8}]},{"pgid":"3.24","mappings":[{"from":4,"to":9}]},{"pgid":"3.33","mappings":[{"from":5,"to":9}]},{"pgid":"3.34","mappings":[{"from":4,"to":9}]},{"pgid":"4.2","mappings":[{"from":9,"to":1}]},{"pgid":"4.6","mappings":[{"from":9,"to":11},{"from":5,"to":8}]},{"pgid":"4.19","mappings":[{"from":9,"to":8}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.39:6800/3152613618":"2024-09-13T02:27:44.717224+0000","172.21.15.39:0/2301206766":"2024-09-13T02:27:44.717224+0000","172.21.15.39:0/1941318538":"2024-09-13T02:27:44.717224+0000","172.21.15.39:0/1527429435":"2024-09-13T02:27:44.717224+0000","172.21.15.39:0/2913347539":"2024-09-13T02:27:16.531986+0000","172.21.15.39:0/2827440002":"2024-09-13T02:27:16.531986+0000","172.21.15.39:0/4075322467":"2024-09-13T02:27:16.531986+0000","172.21.15.39:6801/1074685700":"2024-09-13T02:27:16.531986+0000","172.21.15.39:6801/3152613618":"2024-09-13T02:27:44.717224+0000","172.21.15.39:6800/1074685700":"2024-09-13T02:27:16.531986+0000"},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-12T02:37:37.291 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:37:37.290+0000 7f6248400640 1 -- 172.21.15.39:0/2188272914 >> [v2:172.21.15.39:6800/1725006999,v1:172.21.15.39:6801/1725006999] conn(0x7f62280a2c00 msgr2=0x7f62280a50c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:37:37.291 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:37:37.290+0000 7f6248400640 1 --2- 172.21.15.39:0/2188272914 >> [v2:172.21.15.39:6800/1725006999,v1:172.21.15.39:6801/1725006999] conn(0x7f62280a2c00 0x7f62280a50c0 secure :-1 s=READY pgs=224 cs=0 l=1 rev1=1 crypto rx=0x7f622c000c00 tx=0x7f622c032c70 comp rx=0 tx=0).stop 2024-09-12T02:37:37.291 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:37:37.290+0000 7f6248400640 1 -- 172.21.15.39:0/2188272914 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f62400745c0 msgr2=0x7f624019a650 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:37:37.291 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:37:37.290+0000 7f6248400640 1 --2- 172.21.15.39:0/2188272914 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f62400745c0 0x7f624019a650 secure :-1 s=READY pgs=261 cs=0 l=1 rev1=1 crypto rx=0x7f623400e9f0 tx=0x7f623400eeb0 comp rx=0 tx=0).stop 2024-09-12T02:37:37.291 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:37:37.290+0000 7f6248400640 1 -- 172.21.15.39:0/2188272914 shutdown_connections 2024-09-12T02:37:37.292 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:37:37.290+0000 7f6248400640 1 --2- 172.21.15.39:0/2188272914 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f624010e420 0x7f624019ef20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:37:37.292 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:37:37.290+0000 7f6248400640 1 --2- 172.21.15.39:0/2188272914 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f6240074ee0 0x7f624019ab90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:37:37.292 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:37:37.290+0000 7f6248400640 1 --2- 172.21.15.39:0/2188272914 >> [v2:172.21.15.39:6800/1725006999,v1:172.21.15.39:6801/1725006999] conn(0x7f62280a2c00 0x7f62280a50c0 unknown :-1 s=CLOSED pgs=224 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:37:37.292 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:37:37.290+0000 7f6248400640 1 --2- 172.21.15.39:0/2188272914 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f62400745c0 0x7f624019a650 unknown :-1 s=CLOSED pgs=261 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:37:37.292 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:37:37.290+0000 7f6248400640 1 -- 172.21.15.39:0/2188272914 >> 172.21.15.39:0/2188272914 conn(0x7f62400fd8c0 msgr2=0x7f62400fe560 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:37:37.292 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:37:37.291+0000 7f6248400640 1 -- 172.21.15.39:0/2188272914 shutdown_connections 2024-09-12T02:37:37.292 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:37:37.291+0000 7f6248400640 1 -- 172.21.15.39:0/2188272914 wait complete. 2024-09-12T02:37:37.756 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 02:37:37 smithi039 ceph-mon[30515]: from='client.? 172.21.15.39:0/2188272914' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-09-12T02:37:37.948 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 12 02:37:37 smithi044 ceph-mon[35411]: from='client.? 172.21.15.39:0/2188272914' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-09-12T02:37:38.013 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 12 02:37:37 smithi172 ceph-mon[35609]: from='client.? 172.21.15.39:0/2188272914' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-09-12T02:37:38.194 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 28, 'flags': 50, 'flags_state': {'joinable': True, 'allow_snaps': True, 'allow_multimds_snaps': True, 'allow_standby_replay': True, 'refuse_client_session': False, 'refuse_standby_for_another_fs': False, 'balance_automate': False}, 'ever_allowed_features': 32, 'explicitly_allowed_features': 32, 'created': '2024-09-12T02:35:03.522182+0000', 'modified': '2024-09-12T02:35:53.762825+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 300, 'session_autoclose': 300, 'required_client_features': {}, 'max_file_size': 1099511627776, 'max_xattr_size': 65536, 'last_failure': 0, 'last_failure_osd_epoch': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}, 'max_mds': 5, 'in': [0, 1, 2, 3, 4], 'up': {'mds_0': 24515, 'mds_1': 24499, 'mds_2': 24484, 'mds_3': 24482, 'mds_4': 24472}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_14523': {'gid': 14523, 'name': 'a', 'rank': 4, 'incarnation': 0, 'state': 'up:standby-replay', 'state_seq': 1, 'addr': '172.21.15.39:6841/2829712180', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.39:6840', 'nonce': 2829712180}, {'type': 'v1', 'addr': '172.21.15.39:6841', 'nonce': 2829712180}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540701547738038271, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}, 'gid_24422': {'gid': 24422, 'name': 'k', 'rank': 3, 'incarnation': 0, 'state': 'up:standby-replay', 'state_seq': 1, 'addr': '172.21.15.44:6833/2359724364', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.44:6832', 'nonce': 2359724364}, {'type': 'v1', 'addr': '172.21.15.44:6833', 'nonce': 2359724364}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540701547738038271, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}, 'gid_24430': {'gid': 24430, 'name': 'l', 'rank': 2, 'incarnation': 0, 'state': 'up:standby-replay', 'state_seq': 1, 'addr': '172.21.15.172:6833/3232434105', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.172:6832', 'nonce': 3232434105}, {'type': 'v1', 'addr': '172.21.15.172:6833', 'nonce': 3232434105}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540701547738038271, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}, 'gid_24446': {'gid': 24446, 'name': 'd', 'rank': 1, 'incarnation': 0, 'state': 'up:standby-replay', 'state_seq': 1, 'addr': '172.21.15.39:6837/2743237008', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.39:6836', 'nonce': 2743237008}, {'type': 'v1', 'addr': '172.21.15.39:6837', 'nonce': 2743237008}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540701547738038271, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}, 'gid_24458': {'gid': 24458, 'name': 'e', 'rank': 0, 'incarnation': 0, 'state': 'up:standby-replay', 'state_seq': 1, 'addr': '172.21.15.44:6835/4063842354', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.44:6834', 'nonce': 4063842354}, {'type': 'v1', 'addr': '172.21.15.44:6835', 'nonce': 4063842354}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540701547738038271, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}, 'gid_24472': {'gid': 24472, 'name': 'f', 'rank': 4, 'incarnation': 26, 'state': 'up:active', 'state_seq': 21, 'addr': '172.21.15.172:6835/3274676014', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.172:6834', 'nonce': 3274676014}, {'type': 'v1', 'addr': '172.21.15.172:6835', 'nonce': 3274676014}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540701547738038271, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}, 'gid_24482': {'gid': 24482, 'name': 'h', 'rank': 3, 'incarnation': 24, 'state': 'up:active', 'state_seq': 19, 'addr': '172.21.15.44:6837/1501493978', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.44:6836', 'nonce': 1501493978}, {'type': 'v1', 'addr': '172.21.15.44:6837', 'nonce': 1501493978}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540701547738038271, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}, 'gid_24484': {'gid': 24484, 'name': 'c', 'rank': 2, 'incarnation': 22, 'state': 'up:active', 'state_seq': 20, 'addr': '172.21.15.172:6837/493506747', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.172:6836', 'nonce': 493506747}, {'type': 'v1', 'addr': '172.21.15.172:6837', 'nonce': 493506747}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540701547738038271, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}, 'gid_24499': {'gid': 24499, 'name': 'i', 'rank': 1, 'incarnation': 20, 'state': 'up:active', 'state_seq': 18, 'addr': '172.21.15.172:6839/3742537097', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.172:6838', 'nonce': 3742537097}, {'type': 'v1', 'addr': '172.21.15.172:6839', 'nonce': 3742537097}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540701547738038271, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}, 'gid_24515': {'gid': 24515, 'name': 'b', 'rank': 0, 'incarnation': 14, 'state': 'up:active', 'state_seq': 5, 'addr': '172.21.15.44:6839/2556532723', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.44:6838', 'nonce': 2556532723}, {'type': 'v1', 'addr': '172.21.15.44:6839', 'nonce': 2556532723}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540701547738038271, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}}, 'data_pools': [3, 4], 'metadata_pool': 2, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'bal_rank_mask': '-1', 'standby_count_wanted': 0, 'qdb_leader': 24515, 'qdb_cluster': [24515, 24499, 24484, 24482, 24472]} 2024-09-12T02:37:38.194 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: 5/5 2024-09-12T02:37:38.194 DEBUG:teuthology.orchestra.run.smithi039:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc shell --fsid 4954ed46-70ae-11ef-bcea-c7b262605968 -- ceph tell mds.f status 2024-09-12T02:37:38.574 INFO:teuthology.orchestra.run.smithi039.stderr:Inferring config /var/lib/ceph/4954ed46-70ae-11ef-bcea-c7b262605968/mon.a/config 2024-09-12T02:37:38.849 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 02:37:38 smithi039 ceph-mon[30515]: pgmap v381: 129 pgs: 129 active+clean; 646 KiB data, 348 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2024-09-12T02:37:38.948 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 12 02:37:38 smithi044 ceph-mon[35411]: pgmap v381: 129 pgs: 129 active+clean; 646 KiB data, 348 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2024-09-12T02:37:39.013 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 12 02:37:38 smithi172 ceph-mon[35609]: pgmap v381: 129 pgs: 129 active+clean; 646 KiB data, 348 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2024-09-12T02:37:39.193 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:37:39.192+0000 7fc633e00640 1 -- 172.21.15.39:0/1648101340 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fc634102360 msgr2=0x7fc63410e890 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:37:39.194 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:37:39.192+0000 7fc633e00640 1 --2- 172.21.15.39:0/1648101340 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fc634102360 0x7fc63410e890 secure :-1 s=READY pgs=262 cs=0 l=1 rev1=1 crypto rx=0x7fc62c009cd0 tx=0x7fc62c02a8e0 comp rx=0 tx=0).stop 2024-09-12T02:37:39.194 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:37:39.192+0000 7fc633e00640 1 -- 172.21.15.39:0/1648101340 shutdown_connections 2024-09-12T02:37:39.194 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:37:39.192+0000 7fc633e00640 1 --2- 172.21.15.39:0/1648101340 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fc634102360 0x7fc63410e890 unknown :-1 s=CLOSED pgs=262 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:37:39.194 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:37:39.192+0000 7fc633e00640 1 --2- 172.21.15.39:0/1648101340 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fc6341019c0 0x7fc634101e20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:37:39.194 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:37:39.192+0000 7fc633e00640 1 --2- 172.21.15.39:0/1648101340 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fc6341079c0 0x7fc634107da0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:37:39.194 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:37:39.192+0000 7fc633e00640 1 -- 172.21.15.39:0/1648101340 >> 172.21.15.39:0/1648101340 conn(0x7fc6340fd6e0 msgr2=0x7fc6340ffb00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:37:39.194 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:37:39.192+0000 7fc633e00640 1 -- 172.21.15.39:0/1648101340 shutdown_connections 2024-09-12T02:37:39.194 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:37:39.192+0000 7fc633e00640 1 -- 172.21.15.39:0/1648101340 wait complete. 2024-09-12T02:37:39.195 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:37:39.193+0000 7fc633e00640 1 Processor -- start 2024-09-12T02:37:39.195 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:37:39.193+0000 7fc633e00640 1 -- start start 2024-09-12T02:37:39.195 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:37:39.194+0000 7fc633e00640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fc6341019c0 0x7fc634198250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:37:39.195 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:37:39.194+0000 7fc633e00640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fc634102360 0x7fc634198790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:37:39.195 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:37:39.194+0000 7fc633e00640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fc6341079c0 0x7fc63419cb20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:37:39.195 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:37:39.194+0000 7fc633e00640 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 -- 0x7fc634111e10 con 0x7fc6341019c0 2024-09-12T02:37:39.196 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:37:39.194+0000 7fc633e00640 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x7fc634111c90 con 0x7fc634102360 2024-09-12T02:37:39.196 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:37:39.194+0000 7fc633e00640 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7fc634111f90 con 0x7fc6341079c0 2024-09-12T02:37:39.196 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:37:39.194+0000 7fc632a00640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fc6341019c0 0x7fc634198250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:37:39.196 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:37:39.194+0000 7fc632a00640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fc6341019c0 0x7fc634198250 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.39:3300/0 says I am v2:172.21.15.39:55750/0 (socket says 172.21.15.39:55750) 2024-09-12T02:37:39.196 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:37:39.194+0000 7fc632a00640 1 -- 172.21.15.39:0/3097297401 learned_addr learned my addr 172.21.15.39:0/3097297401 (peer_addr_for_me v2:172.21.15.39:0/0) 2024-09-12T02:37:39.196 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:37:39.194+0000 7fc633400640 1 --2- 172.21.15.39:0/3097297401 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fc6341079c0 0x7fc63419cb20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:37:39.196 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:37:39.194+0000 7fc62be00640 1 --2- 172.21.15.39:0/3097297401 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fc634102360 0x7fc634198790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:37:39.197 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:37:39.195+0000 7fc632a00640 1 -- 172.21.15.39:0/3097297401 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fc6341079c0 msgr2=0x7fc63419cb20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:37:39.197 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:37:39.195+0000 7fc632a00640 1 --2- 172.21.15.39:0/3097297401 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fc6341079c0 0x7fc63419cb20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:37:39.197 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:37:39.195+0000 7fc632a00640 1 -- 172.21.15.39:0/3097297401 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fc634102360 msgr2=0x7fc634198790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:37:39.197 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:37:39.195+0000 7fc632a00640 1 --2- 172.21.15.39:0/3097297401 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fc634102360 0x7fc634198790 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:37:39.197 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:37:39.195+0000 7fc632a00640 1 -- 172.21.15.39:0/3097297401 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc63419d200 con 0x7fc6341019c0 2024-09-12T02:37:39.197 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:37:39.195+0000 7fc632a00640 1 --2- 172.21.15.39:0/3097297401 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fc6341019c0 0x7fc634198250 secure :-1 s=READY pgs=263 cs=0 l=1 rev1=1 crypto rx=0x7fc62400e9f0 tx=0x7fc62400edf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:37:39.197 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:37:39.195+0000 7fc62b400640 1 -- 172.21.15.39:0/3097297401 <== mon.0 v2:172.21.15.39:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc62400cd80 con 0x7fc6341019c0 2024-09-12T02:37:39.197 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:37:39.196+0000 7fc62b400640 1 -- 172.21.15.39:0/3097297401 <== mon.0 v2:172.21.15.39:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fc624005500 con 0x7fc6341019c0 2024-09-12T02:37:39.198 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:37:39.196+0000 7fc633e00640 1 -- 172.21.15.39:0/3097297401 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc63419d4f0 con 0x7fc6341019c0 2024-09-12T02:37:39.198 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:37:39.196+0000 7fc62b400640 1 -- 172.21.15.39:0/3097297401 <== mon.0 v2:172.21.15.39:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc624010690 con 0x7fc6341019c0 2024-09-12T02:37:39.198 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:37:39.196+0000 7fc633e00640 1 -- 172.21.15.39:0/3097297401 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc6341a4dd0 con 0x7fc6341019c0 2024-09-12T02:37:39.200 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:37:39.199+0000 7fc63c26c740 1 Processor -- start 2024-09-12T02:37:39.200 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:37:39.199+0000 7fc62b400640 1 -- 172.21.15.39:0/3097297401 <== mon.0 v2:172.21.15.39:3300/0 4 ==== mgrmap(e 18) ==== 137833+0+0 (secure 0 0 0) 0x7fc6240046c0 con 0x7fc6341019c0 2024-09-12T02:37:39.200 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:37:39.199+0000 7fc63c26c740 1 -- start start 2024-09-12T02:37:39.200 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:37:39.199+0000 7fc63c26c740 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55e87146d4e0 0x55e87146d8c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:37:39.200 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:37:39.199+0000 7fc63c26c740 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55e87146de00 0x55e871478180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:37:39.200 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:37:39.199+0000 7fc63c26c740 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55e8714786c0 0x55e87147aab0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:37:39.200 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:37:39.199+0000 7fc63c26c740 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 -- 0x55e8713d30b0 con 0x55e8714786c0 2024-09-12T02:37:39.200 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:37:39.199+0000 7fc63c26c740 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x55e87137aab0 con 0x55e87146d4e0 2024-09-12T02:37:39.201 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:37:39.199+0000 7fc63c26c740 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x55e8713cf070 con 0x55e87146de00 2024-09-12T02:37:39.202 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:37:39.200+0000 7fc62be00640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55e8714786c0 0x55e87147aab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:37:39.202 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:37:39.200+0000 7fc633400640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55e87146d4e0 0x55e87146d8c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:37:39.202 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:37:39.200+0000 7fc62be00640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55e8714786c0 0x55e87147aab0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.39:3300/0 says I am v2:172.21.15.39:55756/0 (socket says 172.21.15.39:55756) 2024-09-12T02:37:39.202 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:37:39.200+0000 7fc62be00640 1 -- 172.21.15.39:0/2367329580 learned_addr learned my addr 172.21.15.39:0/2367329580 (peer_addr_for_me v2:172.21.15.39:0/0) 2024-09-12T02:37:39.203 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:37:39.200+0000 7fc632a00640 1 --2- 172.21.15.39:0/2367329580 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55e87146de00 0x55e871478180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:37:39.203 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:37:39.200+0000 7fc633400640 1 -- 172.21.15.39:0/2367329580 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55e87146de00 msgr2=0x55e871478180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:37:39.203 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:37:39.200+0000 7fc633400640 1 --2- 172.21.15.39:0/2367329580 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55e87146de00 0x55e871478180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:37:39.203 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:37:39.200+0000 7fc633400640 1 -- 172.21.15.39:0/2367329580 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55e8714786c0 msgr2=0x55e87147aab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:37:39.203 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:37:39.200+0000 7fc633400640 1 --2- 172.21.15.39:0/2367329580 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55e8714786c0 0x55e87147aab0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:37:39.203 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:37:39.200+0000 7fc633400640 1 -- 172.21.15.39:0/2367329580 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55e8713874a0 con 0x55e87146d4e0 2024-09-12T02:37:39.203 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:37:39.200+0000 7fc62be00640 1 --2- 172.21.15.39:0/2367329580 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55e8714786c0 0x55e87147aab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-12T02:37:39.203 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:37:39.200+0000 7fc633400640 1 --2- 172.21.15.39:0/2367329580 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55e87146d4e0 0x55e87146d8c0 secure :-1 s=READY pgs=115 cs=0 l=1 rev1=1 crypto rx=0x7fc62c009ca0 tx=0x7fc62c009a20 comp rx=0 tx=0).ready entity=mon.2 client_cookie=c096d37e59d5f275 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:37:39.203 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:37:39.201+0000 7fc623400640 1 -- 172.21.15.39:0/2367329580 <== mon.2 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc62c049070 con 0x55e87146d4e0 2024-09-12T02:37:39.203 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:37:39.201+0000 7fc623400640 1 -- 172.21.15.39:0/2367329580 <== mon.2 v2:172.21.15.44:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fc62c036040 con 0x55e87146d4e0 2024-09-12T02:37:39.203 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:37:39.201+0000 7fc623400640 1 -- 172.21.15.39:0/2367329580 <== mon.2 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc62c004040 con 0x55e87146d4e0 2024-09-12T02:37:39.203 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:37:39.201+0000 7fc62b400640 1 --2- 172.21.15.39:0/3097297401 >> [v2:172.21.15.39:6800/1725006999,v1:172.21.15.39:6801/1725006999] conn(0x7fc6180a2b80 0x7fc6180a5040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:37:39.203 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:37:39.201+0000 7fc62b400640 1 -- 172.21.15.39:0/3097297401 <== mon.0 v2:172.21.15.39:3300/0 5 ==== osd_map(95..95 src has 1..95) ==== 9129+0+0 (secure 0 0 0) 0x7fc6240cf760 con 0x7fc6341019c0 2024-09-12T02:37:39.203 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:37:39.201+0000 7fc632a00640 1 --2- 172.21.15.39:0/3097297401 >> [v2:172.21.15.39:6800/1725006999,v1:172.21.15.39:6801/1725006999] conn(0x7fc6180a2b80 0x7fc6180a5040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:37:39.204 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:37:39.202+0000 7fc63c26c740 1 -- 172.21.15.39:0/2367329580 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55e87146d4e0 msgr2=0x55e87146d8c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:37:39.204 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:37:39.202+0000 7fc63c26c740 1 --2- 172.21.15.39:0/2367329580 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55e87146d4e0 0x55e87146d8c0 secure :-1 s=READY pgs=115 cs=0 l=1 rev1=1 crypto rx=0x7fc62c009ca0 tx=0x7fc62c009a20 comp rx=0 tx=0).stop 2024-09-12T02:37:39.204 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:37:39.202+0000 7fc63c26c740 1 -- 172.21.15.39:0/2367329580 shutdown_connections 2024-09-12T02:37:39.204 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:37:39.202+0000 7fc63c26c740 1 --2- 172.21.15.39:0/2367329580 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55e8714786c0 0x55e87147aab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:37:39.204 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:37:39.202+0000 7fc63c26c740 1 --2- 172.21.15.39:0/2367329580 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55e87146de00 0x55e871478180 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:37:39.204 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:37:39.202+0000 7fc63c26c740 1 --2- 172.21.15.39:0/2367329580 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55e87146d4e0 0x55e87146d8c0 unknown :-1 s=CLOSED pgs=115 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:37:39.204 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:37:39.202+0000 7fc63c26c740 1 -- 172.21.15.39:0/2367329580 >> 172.21.15.39:0/2367329580 conn(0x55e871469a70 msgr2=0x55e871469e50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:37:39.207 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:37:39.202+0000 7fc63c26c740 1 -- 172.21.15.39:0/2367329580 shutdown_connections 2024-09-12T02:37:39.207 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:37:39.202+0000 7fc63c26c740 1 -- 172.21.15.39:0/2367329580 wait complete. 2024-09-12T02:37:39.207 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:37:39.202+0000 7fc632a00640 1 --2- 172.21.15.39:0/3097297401 >> [v2:172.21.15.39:6800/1725006999,v1:172.21.15.39:6801/1725006999] conn(0x7fc6180a2b80 0x7fc6180a5040 secure :-1 s=READY pgs=225 cs=0 l=1 rev1=1 crypto rx=0x7fc6240cd250 tx=0x7fc6240d5550 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:37:39.207 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:37:39.202+0000 7fc63c26c740 1 -- start start 2024-09-12T02:37:39.207 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:37:39.203+0000 7fc63c26c740 1 Processor -- start 2024-09-12T02:37:39.207 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:37:39.203+0000 7fc63c26c740 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55e87146d4e0 0x55e871475640 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:37:39.207 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:37:39.203+0000 7fc63c26c740 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55e87146de00 0x55e871475b80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:37:39.207 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:37:39.203+0000 7fc63c26c740 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55e8714786c0 0x55e8714760c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:37:39.207 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:37:39.203+0000 7fc63c26c740 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 -- 0x55e87147b330 con 0x55e8714786c0 2024-09-12T02:37:39.207 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:37:39.203+0000 7fc63c26c740 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x55e87135b920 con 0x55e87146de00 2024-09-12T02:37:39.208 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:37:39.203+0000 7fc63c26c740 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x55e87147b4b0 con 0x55e87146d4e0 2024-09-12T02:37:39.208 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:37:39.203+0000 7fc63c26c740 10 client.0 _ll_register_callbacks cb 0x55e87137f8a0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-12T02:37:39.208 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:37:39.204+0000 7fc633400640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55e8714786c0 0x55e8714760c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:37:39.208 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:37:39.204+0000 7fc633400640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55e8714786c0 0x55e8714760c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.39:3300/0 says I am v2:172.21.15.39:55772/0 (socket says 172.21.15.39:55772) 2024-09-12T02:37:39.208 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:37:39.204+0000 7fc633400640 1 -- 172.21.15.39:0/3181882426 learned_addr learned my addr 172.21.15.39:0/3181882426 (peer_addr_for_me v2:172.21.15.39:0/0) 2024-09-12T02:37:39.208 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:37:39.204+0000 7fc62be00640 1 --2- 172.21.15.39:0/3181882426 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55e87146de00 0x55e871475b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:37:39.208 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:37:39.204+0000 7fc633400640 1 --2- 172.21.15.39:0/3181882426 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55e87146d4e0 0x55e871475640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:37:39.208 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:37:39.204+0000 7fc62be00640 1 -- 172.21.15.39:0/3181882426 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55e87146d4e0 msgr2=0x55e871475640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:37:39.208 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:37:39.204+0000 7fc62be00640 1 --2- 172.21.15.39:0/3181882426 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55e87146d4e0 0x55e871475640 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:37:39.208 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:37:39.204+0000 7fc62be00640 1 -- 172.21.15.39:0/3181882426 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55e8714786c0 msgr2=0x55e8714760c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:37:39.208 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:37:39.204+0000 7fc62be00640 1 --2- 172.21.15.39:0/3181882426 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55e8714786c0 0x55e8714760c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:37:39.208 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:37:39.204+0000 7fc62be00640 1 -- 172.21.15.39:0/3181882426 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55e8711442b0 con 0x55e87146de00 2024-09-12T02:37:39.209 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:37:39.204+0000 7fc62be00640 1 --2- 172.21.15.39:0/3181882426 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55e87146de00 0x55e871475b80 secure :-1 s=READY pgs=116 cs=0 l=1 rev1=1 crypto rx=0x7fc61c009560 tx=0x7fc61c012b60 comp rx=0 tx=0).ready entity=mon.2 client_cookie=2f1508af5f8704d3 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:37:39.209 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:37:39.204+0000 7fc617e00640 10 client.0 ms_handle_connect on v2:172.21.15.44:3300/0 2024-09-12T02:37:39.209 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:37:39.205+0000 7fc617e00640 1 -- 172.21.15.39:0/3181882426 <== mon.2 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc61c004050 con 0x55e87146de00 2024-09-12T02:37:39.209 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:37:39.205+0000 7fc63c26c740 1 -- 172.21.15.39:0/3181882426 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fc62c036040 con 0x55e87146de00 2024-09-12T02:37:39.209 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:37:39.205+0000 7fc617e00640 1 -- 172.21.15.39:0/3181882426 <== mon.2 v2:172.21.15.44:3300/0 2 ==== osd_map(95..95 src has 1..95) ==== 9129+0+0 (secure 0 0 0) 0x7fc61c0041f0 con 0x55e87146de00 2024-09-12T02:37:39.209 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:37:39.205+0000 7fc617e00640 1 -- 172.21.15.39:0/3181882426 <== mon.2 v2:172.21.15.44:3300/0 3 ==== mon_get_version_reply(handle=1 version=28) ==== 24+0+0 (secure 0 0 0) 0x7fc61c0043f0 con 0x55e87146de00 2024-09-12T02:37:39.209 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:37:39.205+0000 7fc63c26c740 10 client.25103 fetch_fsmap learned FSMap version 28 2024-09-12T02:37:39.209 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:37:39.205+0000 7fc63c26c740 1 -- 172.21.15.39:0/3181882426 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,fsmap=28,monmap=4+}) -- 0x55e871487110 con 0x55e87146de00 2024-09-12T02:37:39.209 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:37:39.205+0000 7fc617e00640 1 -- 172.21.15.39:0/3181882426 <== mon.2 v2:172.21.15.44:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fc62c036040 con 0x55e87146de00 2024-09-12T02:37:39.209 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:37:39.206+0000 7fc617e00640 1 -- 172.21.15.39:0/3181882426 <== mon.2 v2:172.21.15.44:3300/0 5 ==== fsmap(e 28) ==== 8370+0+0 (secure 0 0 0) 0x7fc61c003c70 con 0x55e87146de00 2024-09-12T02:37:39.209 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:37:39.206+0000 7fc63c26c740 10 client.25103 fetch_fsmap finished waiting for FSMap version 28 2024-09-12T02:37:39.209 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:37:39.206+0000 7fc63c26c740 10 client.25103 resolve_mds: resolved name 'f' to daemon mds.f 2024-09-12T02:37:39.209 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:37:39.206+0000 7fc63c26c740 20 client.25103 populate_metadata read hostname 'smithi039' 2024-09-12T02:37:39.209 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:37:39.206+0000 7fc63c26c740 1 --2- 172.21.15.39:0/3181882426 >> [v2:172.21.15.172:6834/3274676014,v1:172.21.15.172:6835/3274676014] conn(0x55e8714896c0 0x55e87148ab30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:37:39.209 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:37:39.206+0000 7fc63c26c740 4 client.25103 mds_command: new command op to 24472 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-12T02:37:39.210 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:37:39.206+0000 7fc63c26c740 1 -- 172.21.15.39:0/3181882426 --> [v2:172.21.15.172:6834/3274676014,v1:172.21.15.172:6835/3274676014] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55e8713e0620 con 0x55e8714896c0 2024-09-12T02:37:39.210 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:37:39.206+0000 7fc633400640 1 --2- 172.21.15.39:0/3181882426 >> [v2:172.21.15.172:6834/3274676014,v1:172.21.15.172:6835/3274676014] conn(0x55e8714896c0 0x55e87148ab30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:37:39.211 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:37:39.207+0000 7fc633400640 1 --2- 172.21.15.39:0/3181882426 >> [v2:172.21.15.172:6834/3274676014,v1:172.21.15.172:6835/3274676014] conn(0x55e8714896c0 0x55e87148ab30 crc :-1 s=READY pgs=19 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.4 client_cookie=a27aa3d2b94ac633 server_cookie=e51765e9b1edaf1f in_seq=0 out_seq=0 2024-09-12T02:37:39.211 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:37:39.207+0000 7fc617e00640 10 client.25103 ms_handle_connect on v2:172.21.15.172:6834/3274676014 2024-09-12T02:37:39.211 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:37:39.208+0000 7fc617e00640 1 -- 172.21.15.39:0/3181882426 <== mds.4 v2:172.21.15.172:6834/3274676014 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x55e8713e0620 con 0x55e8714896c0 2024-09-12T02:37:39.211 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:37:39.208+0000 7fc617e00640 10 client.25103 handle_command_reply: tid=0 2024-09-12T02:37:39.211 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:37:39.208+0000 7fc63c26c740 1 client.25103 shutdown 2024-09-12T02:37:39.211 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:37:39.208+0000 7fc63c26c740 1 -- 172.21.15.39:0/3181882426 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55e87146de00 msgr2=0x55e871475b80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:37:39.211 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:37:39.208+0000 7fc63c26c740 1 --2- 172.21.15.39:0/3181882426 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55e87146de00 0x55e871475b80 secure :-1 s=READY pgs=116 cs=0 l=1 rev1=1 crypto rx=0x7fc61c009560 tx=0x7fc61c012b60 comp rx=0 tx=0).stop 2024-09-12T02:37:39.211 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:37:39.208+0000 7fc63c26c740 1 -- 172.21.15.39:0/3181882426 shutdown_connections 2024-09-12T02:37:39.211 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:37:39.208+0000 7fc63c26c740 1 --2- 172.21.15.39:0/3181882426 >> [v2:172.21.15.172:6834/3274676014,v1:172.21.15.172:6835/3274676014] conn(0x55e8714896c0 0x55e87148ab30 crc :-1 s=READY pgs=19 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:37:39.211 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:37:39.208+0000 7fc63c26c740 1 --2- 172.21.15.39:0/3181882426 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55e8714786c0 0x55e8714760c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:37:39.211 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:37:39.208+0000 7fc63c26c740 1 --2- 172.21.15.39:0/3181882426 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55e87146de00 0x55e871475b80 unknown :-1 s=CLOSED pgs=116 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:37:39.211 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:37:39.208+0000 7fc63c26c740 1 --2- 172.21.15.39:0/3181882426 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55e87146d4e0 0x55e871475640 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:37:39.211 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:37:39.208+0000 7fc617e00640 0 client.25103 ms_handle_reset on v2:172.21.15.172:6834/3274676014 2024-09-12T02:37:39.212 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:37:39.208+0000 7fc63c26c740 1 -- 172.21.15.39:0/3181882426 >> 172.21.15.39:0/3181882426 conn(0x55e871469a70 msgr2=0x55e87146f750 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:37:39.212 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:37:39.208+0000 7fc63c26c740 1 -- 172.21.15.39:0/3181882426 shutdown_connections 2024-09-12T02:37:39.212 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:37:39.208+0000 7fc63c26c740 1 -- 172.21.15.39:0/3181882426 wait complete. 2024-09-12T02:37:39.212 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:37:39.208+0000 7fc63c26c740 20 client.25103 trim_cache size 0 max 16384 2024-09-12T02:37:39.228 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:37:39.227+0000 7fc63c26c740 1 Processor -- start 2024-09-12T02:37:39.228 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:37:39.227+0000 7fc63c26c740 1 -- start start 2024-09-12T02:37:39.229 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:37:39.227+0000 7fc63c26c740 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55e87146d4e0 0x55e871469e50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:37:39.229 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:37:39.227+0000 7fc63c26c740 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55e87146de00 0x55e8714728a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:37:39.229 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:37:39.227+0000 7fc63c26c740 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55e8714786c0 0x55e871472de0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:37:39.229 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:37:39.227+0000 7fc63c26c740 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 -- 0x55e871488e70 con 0x55e87146d4e0 2024-09-12T02:37:39.230 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:37:39.227+0000 7fc63c26c740 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x55e871489540 con 0x55e8714786c0 2024-09-12T02:37:39.230 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:37:39.227+0000 7fc63c26c740 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x55e871489c10 con 0x55e87146de00 2024-09-12T02:37:39.230 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:37:39.228+0000 7fc633400640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55e87146d4e0 0x55e871469e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:37:39.230 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:37:39.228+0000 7fc633400640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55e87146d4e0 0x55e871469e50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.39:3300/0 says I am v2:172.21.15.39:55784/0 (socket says 172.21.15.39:55784) 2024-09-12T02:37:39.230 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:37:39.228+0000 7fc633400640 1 -- 172.21.15.39:0/3044332965 learned_addr learned my addr 172.21.15.39:0/3044332965 (peer_addr_for_me v2:172.21.15.39:0/0) 2024-09-12T02:37:39.230 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:37:39.228+0000 7fc62be00640 1 --2- 172.21.15.39:0/3044332965 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55e87146de00 0x55e8714728a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:37:39.230 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:37:39.228+0000 7fc633400640 1 --2- 172.21.15.39:0/3044332965 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55e8714786c0 0x55e871472de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:37:39.230 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:37:39.228+0000 7fc633400640 1 -- 172.21.15.39:0/3044332965 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55e87146de00 msgr2=0x55e8714728a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:37:39.230 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:37:39.228+0000 7fc633400640 1 --2- 172.21.15.39:0/3044332965 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55e87146de00 0x55e8714728a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:37:39.230 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:37:39.228+0000 7fc633400640 1 -- 172.21.15.39:0/3044332965 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55e8714786c0 msgr2=0x55e871472de0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:37:39.230 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:37:39.228+0000 7fc633400640 1 --2- 172.21.15.39:0/3044332965 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55e8714786c0 0x55e871472de0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:37:39.230 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:37:39.228+0000 7fc633400640 1 -- 172.21.15.39:0/3044332965 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55e87146e370 con 0x55e87146d4e0 2024-09-12T02:37:39.230 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:37:39.228+0000 7fc633400640 1 --2- 172.21.15.39:0/3044332965 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55e87146d4e0 0x55e871469e50 secure :-1 s=READY pgs=264 cs=0 l=1 rev1=1 crypto rx=0x7fc62c005e10 tx=0x7fc62c003c40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8fef2fdd00a44c11 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:37:39.231 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:37:39.229+0000 7fc622a00640 1 -- 172.21.15.39:0/3044332965 <== mon.0 v2:172.21.15.39:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc62c049040 con 0x55e87146d4e0 2024-09-12T02:37:39.231 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:37:39.229+0000 7fc622a00640 1 -- 172.21.15.39:0/3044332965 <== mon.0 v2:172.21.15.39:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fc62c036050 con 0x55e87146d4e0 2024-09-12T02:37:39.231 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:37:39.229+0000 7fc622a00640 1 -- 172.21.15.39:0/3044332965 <== mon.0 v2:172.21.15.39:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc62c0047a0 con 0x55e87146d4e0 2024-09-12T02:37:39.233 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:37:39.229+0000 7fc63c26c740 1 -- 172.21.15.39:0/3044332965 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55e87146d4e0 msgr2=0x55e871469e50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:37:39.234 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:37:39.229+0000 7fc63c26c740 1 --2- 172.21.15.39:0/3044332965 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55e87146d4e0 0x55e871469e50 secure :-1 s=READY pgs=264 cs=0 l=1 rev1=1 crypto rx=0x7fc62c005e10 tx=0x7fc62c003c40 comp rx=0 tx=0).stop 2024-09-12T02:37:39.234 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:37:39.229+0000 7fc63c26c740 1 -- 172.21.15.39:0/3044332965 shutdown_connections 2024-09-12T02:37:39.234 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:37:39.229+0000 7fc63c26c740 1 --2- 172.21.15.39:0/3044332965 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55e8714786c0 0x55e871472de0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:37:39.234 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:37:39.229+0000 7fc63c26c740 1 --2- 172.21.15.39:0/3044332965 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55e87146de00 0x55e8714728a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:37:39.234 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:37:39.230+0000 7fc63c26c740 1 --2- 172.21.15.39:0/3044332965 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55e87146d4e0 0x55e871469e50 unknown :-1 s=CLOSED pgs=264 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:37:39.234 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:37:39.230+0000 7fc63c26c740 1 -- 172.21.15.39:0/3044332965 >> 172.21.15.39:0/3044332965 conn(0x55e871469a70 msgr2=0x55e871473f10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:37:39.234 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:37:39.230+0000 7fc63c26c740 1 -- 172.21.15.39:0/3044332965 shutdown_connections 2024-09-12T02:37:39.234 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:37:39.230+0000 7fc63c26c740 1 -- 172.21.15.39:0/3044332965 wait complete. 2024-09-12T02:37:39.234 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:37:39.230+0000 7fc63c26c740 1 -- start start 2024-09-12T02:37:39.234 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:37:39.230+0000 7fc63c26c740 1 Processor -- start 2024-09-12T02:37:39.234 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:37:39.231+0000 7fc63c26c740 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55e87146d4e0 0x55e87148cac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:37:39.234 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:37:39.231+0000 7fc63c26c740 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55e87146de00 0x55e87148d000 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:37:39.234 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:37:39.231+0000 7fc63c26c740 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55e8714786c0 0x55e87148d540 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:37:39.235 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:37:39.231+0000 7fc63c26c740 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 -- 0x55e87148a9b0 con 0x55e87146d4e0 2024-09-12T02:37:39.235 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:37:39.231+0000 7fc63c26c740 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x55e87148a2e0 con 0x55e8714786c0 2024-09-12T02:37:39.235 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:37:39.231+0000 7fc63c26c740 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x55e87148b080 con 0x55e87146de00 2024-09-12T02:37:39.235 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:37:39.231+0000 7fc63c26c740 10 client.0 _ll_register_callbacks cb 0x7fc61c009ec0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-12T02:37:39.235 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:37:39.231+0000 7fc633400640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55e87146d4e0 0x55e87148cac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:37:39.235 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:37:39.231+0000 7fc62be00640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55e87146de00 0x55e87148d000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:37:39.235 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:37:39.231+0000 7fc633400640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55e87146d4e0 0x55e87148cac0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.39:3300/0 says I am v2:172.21.15.39:55800/0 (socket says 172.21.15.39:55800) 2024-09-12T02:37:39.235 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:37:39.231+0000 7fc633400640 1 -- 172.21.15.39:0/712390323 learned_addr learned my addr 172.21.15.39:0/712390323 (peer_addr_for_me v2:172.21.15.39:0/0) 2024-09-12T02:37:39.235 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:37:39.231+0000 7fc633400640 1 --2- 172.21.15.39:0/712390323 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55e8714786c0 0x55e87148d540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:37:39.235 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:37:39.232+0000 7fc62be00640 1 -- 172.21.15.39:0/712390323 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55e8714786c0 msgr2=0x55e87148d540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:37:39.235 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:37:39.232+0000 7fc62be00640 1 --2- 172.21.15.39:0/712390323 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55e8714786c0 0x55e87148d540 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:37:39.235 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:37:39.232+0000 7fc62be00640 1 -- 172.21.15.39:0/712390323 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55e87146d4e0 msgr2=0x55e87148cac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:37:39.235 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:37:39.232+0000 7fc62be00640 1 --2- 172.21.15.39:0/712390323 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55e87146d4e0 0x55e87148cac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:37:39.235 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:37:39.232+0000 7fc62be00640 1 -- 172.21.15.39:0/712390323 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55e8714912b0 con 0x55e87146de00 2024-09-12T02:37:39.236 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:37:39.232+0000 7fc633400640 1 --2- 172.21.15.39:0/712390323 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55e87146d4e0 0x55e87148cac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-12T02:37:39.236 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:37:39.232+0000 7fc62be00640 1 --2- 172.21.15.39:0/712390323 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55e87146de00 0x55e87148d000 secure :-1 s=READY pgs=106 cs=0 l=1 rev1=1 crypto rx=0x7fc61c0106f0 tx=0x7fc61c0109a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=999ec2d42599780c server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:37:39.236 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:37:39.232+0000 7fc617e00640 10 client.0 ms_handle_connect on v2:172.21.15.172:3300/0 2024-09-12T02:37:39.236 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:37:39.232+0000 7fc617e00640 1 -- 172.21.15.39:0/712390323 <== mon.1 v2:172.21.15.172:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc61c00fe60 con 0x55e87146de00 2024-09-12T02:37:39.236 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:37:39.232+0000 7fc63c26c740 1 -- 172.21.15.39:0/712390323 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fc62c036050 con 0x55e87146de00 2024-09-12T02:37:39.236 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:37:39.232+0000 7fc617e00640 1 -- 172.21.15.39:0/712390323 <== mon.1 v2:172.21.15.172:3300/0 2 ==== osd_map(95..95 src has 1..95) ==== 9129+0+0 (secure 0 0 0) 0x7fc61c010d20 con 0x55e87146de00 2024-09-12T02:37:39.236 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:37:39.233+0000 7fc617e00640 1 -- 172.21.15.39:0/712390323 <== mon.1 v2:172.21.15.172:3300/0 3 ==== mon_get_version_reply(handle=1 version=28) ==== 24+0+0 (secure 0 0 0) 0x7fc61c005030 con 0x55e87146de00 2024-09-12T02:37:39.236 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:37:39.233+0000 7fc63c26c740 10 client.25114 fetch_fsmap learned FSMap version 28 2024-09-12T02:37:39.236 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:37:39.233+0000 7fc63c26c740 1 -- 172.21.15.39:0/712390323 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({config=0+,fsmap=28,monmap=4+}) -- 0x55e8714f4070 con 0x55e87146de00 2024-09-12T02:37:39.236 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:37:39.233+0000 7fc617e00640 1 -- 172.21.15.39:0/712390323 <== mon.1 v2:172.21.15.172:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fc62c036050 con 0x55e87146de00 2024-09-12T02:37:39.238 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:37:39.233+0000 7fc617e00640 1 -- 172.21.15.39:0/712390323 <== mon.1 v2:172.21.15.172:3300/0 5 ==== fsmap(e 28) ==== 8370+0+0 (secure 0 0 0) 0x7fc61c0047f0 con 0x55e87146de00 2024-09-12T02:37:39.238 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:37:39.233+0000 7fc63c26c740 10 client.25114 fetch_fsmap finished waiting for FSMap version 28 2024-09-12T02:37:39.238 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:37:39.233+0000 7fc63c26c740 10 client.25114 resolve_mds: resolved name 'f' to daemon mds.f 2024-09-12T02:37:39.238 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:37:39.233+0000 7fc63c26c740 20 client.25114 populate_metadata read hostname 'smithi039' 2024-09-12T02:37:39.238 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:37:39.233+0000 7fc63c26c740 1 --2- 172.21.15.39:0/712390323 >> [v2:172.21.15.172:6834/3274676014,v1:172.21.15.172:6835/3274676014] conn(0x55e8714f8c80 0x55e8714f7990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:37:39.238 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:37:39.233+0000 7fc63c26c740 4 client.25114 mds_command: new command op to 24472 tid=0 multi_id=0 [{"prefix": "status"}] 2024-09-12T02:37:39.238 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:37:39.234+0000 7fc63c26c740 1 -- 172.21.15.39:0/712390323 --> [v2:172.21.15.172:6834/3274676014,v1:172.21.15.172:6835/3274676014] -- command(tid 0: {"prefix": "status"}) -- 0x55e8713dab30 con 0x55e8714f8c80 2024-09-12T02:37:39.238 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:37:39.234+0000 7fc633400640 1 --2- 172.21.15.39:0/712390323 >> [v2:172.21.15.172:6834/3274676014,v1:172.21.15.172:6835/3274676014] conn(0x55e8714f8c80 0x55e8714f7990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:37:39.239 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:37:39.234+0000 7fc633400640 1 --2- 172.21.15.39:0/712390323 >> [v2:172.21.15.172:6834/3274676014,v1:172.21.15.172:6835/3274676014] conn(0x55e8714f8c80 0x55e8714f7990 crc :-1 s=READY pgs=20 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.4 client_cookie=544368a45a09ca15 server_cookie=488c05e89f80ffb8 in_seq=0 out_seq=0 2024-09-12T02:37:39.239 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:37:39.234+0000 7fc617e00640 10 client.25114 ms_handle_connect on v2:172.21.15.172:6834/3274676014 2024-09-12T02:37:39.239 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:37:39.235+0000 7fc617e00640 1 -- 172.21.15.39:0/712390323 <== mds.4 v2:172.21.15.172:6834/3274676014 1 ==== command_reply(tid 0: 0 ) ==== 8+0+326 (crc 0 0 0) 0x55e8713dab30 con 0x55e8714f8c80 2024-09-12T02:37:39.239 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:37:39.235+0000 7fc617e00640 10 client.25114 handle_command_reply: tid=0 2024-09-12T02:37:39.239 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:37:39.235+0000 7fc63c26c740 1 client.25114 shutdown 2024-09-12T02:37:39.239 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:37:39.235+0000 7fc63c26c740 1 -- 172.21.15.39:0/712390323 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55e87146de00 msgr2=0x55e87148d000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:37:39.239 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:37:39.235+0000 7fc63c26c740 1 --2- 172.21.15.39:0/712390323 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55e87146de00 0x55e87148d000 secure :-1 s=READY pgs=106 cs=0 l=1 rev1=1 crypto rx=0x7fc61c0106f0 tx=0x7fc61c0109a0 comp rx=0 tx=0).stop 2024-09-12T02:37:39.239 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:37:39.235+0000 7fc63c26c740 1 -- 172.21.15.39:0/712390323 shutdown_connections 2024-09-12T02:37:39.239 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:37:39.235+0000 7fc63c26c740 1 --2- 172.21.15.39:0/712390323 >> [v2:172.21.15.172:6834/3274676014,v1:172.21.15.172:6835/3274676014] conn(0x55e8714f8c80 0x55e8714f7990 crc :-1 s=READY pgs=20 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:37:39.239 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:37:39.235+0000 7fc63c26c740 1 --2- 172.21.15.39:0/712390323 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55e8714786c0 0x55e87148d540 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:37:39.240 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:37:39.235+0000 7fc63c26c740 1 --2- 172.21.15.39:0/712390323 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55e87146de00 0x55e87148d000 unknown :-1 s=CLOSED pgs=106 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:37:39.240 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:37:39.235+0000 7fc63c26c740 1 --2- 172.21.15.39:0/712390323 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55e87146d4e0 0x55e87148cac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:37:39.240 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:37:39.235+0000 7fc617e00640 0 client.25114 ms_handle_reset on v2:172.21.15.172:6834/3274676014 2024-09-12T02:37:39.240 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:37:39.235+0000 7fc63c26c740 1 -- 172.21.15.39:0/712390323 >> 172.21.15.39:0/712390323 conn(0x55e871469a70 msgr2=0x55e87146ef30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:37:39.240 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:37:39.235+0000 7fc63c26c740 1 -- 172.21.15.39:0/712390323 shutdown_connections 2024-09-12T02:37:39.240 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:37:39.235+0000 7fc63c26c740 1 -- 172.21.15.39:0/712390323 wait complete. 2024-09-12T02:37:39.240 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:37:39.235+0000 7fc63c26c740 20 client.25114 trim_cache size 0 max 16384 2024-09-12T02:37:39.240 INFO:teuthology.orchestra.run.smithi039.stdout:{ 2024-09-12T02:37:39.240 INFO:teuthology.orchestra.run.smithi039.stdout: "cluster_fsid": "4954ed46-70ae-11ef-bcea-c7b262605968", 2024-09-12T02:37:39.240 INFO:teuthology.orchestra.run.smithi039.stdout: "whoami": 4, 2024-09-12T02:37:39.241 INFO:teuthology.orchestra.run.smithi039.stdout: "id": 24472, 2024-09-12T02:37:39.241 INFO:teuthology.orchestra.run.smithi039.stdout: "want_state": "up:active", 2024-09-12T02:37:39.241 INFO:teuthology.orchestra.run.smithi039.stdout: "state": "up:active", 2024-09-12T02:37:39.241 INFO:teuthology.orchestra.run.smithi039.stdout: "fs_name": "cephfs", 2024-09-12T02:37:39.241 INFO:teuthology.orchestra.run.smithi039.stdout: "rank_uptime": 107.43938403, 2024-09-12T02:37:39.241 INFO:teuthology.orchestra.run.smithi039.stdout: "mdsmap_epoch": 28, 2024-09-12T02:37:39.241 INFO:teuthology.orchestra.run.smithi039.stdout: "osdmap_epoch": 95, 2024-09-12T02:37:39.241 INFO:teuthology.orchestra.run.smithi039.stdout: "osdmap_epoch_barrier": 93, 2024-09-12T02:37:39.241 INFO:teuthology.orchestra.run.smithi039.stdout: "uptime": 185.34250436599999 2024-09-12T02:37:39.241 INFO:teuthology.orchestra.run.smithi039.stdout:} 2024-09-12T02:37:39.242 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:37:39.236+0000 7fc633e00640 1 -- 172.21.15.39:0/3097297401 >> [v2:172.21.15.39:6800/1725006999,v1:172.21.15.39:6801/1725006999] conn(0x7fc6180a2b80 msgr2=0x7fc6180a5040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:37:39.242 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:37:39.236+0000 7fc633e00640 1 --2- 172.21.15.39:0/3097297401 >> [v2:172.21.15.39:6800/1725006999,v1:172.21.15.39:6801/1725006999] conn(0x7fc6180a2b80 0x7fc6180a5040 secure :-1 s=READY pgs=225 cs=0 l=1 rev1=1 crypto rx=0x7fc6240cd250 tx=0x7fc6240d5550 comp rx=0 tx=0).stop 2024-09-12T02:37:39.242 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:37:39.236+0000 7fc633e00640 1 -- 172.21.15.39:0/3097297401 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fc6341019c0 msgr2=0x7fc634198250 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:37:39.242 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:37:39.236+0000 7fc633e00640 1 --2- 172.21.15.39:0/3097297401 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fc6341019c0 0x7fc634198250 secure :-1 s=READY pgs=263 cs=0 l=1 rev1=1 crypto rx=0x7fc62400e9f0 tx=0x7fc62400edf0 comp rx=0 tx=0).stop 2024-09-12T02:37:39.242 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:37:39.236+0000 7fc633e00640 1 -- 172.21.15.39:0/3097297401 shutdown_connections 2024-09-12T02:37:39.242 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:37:39.236+0000 7fc633e00640 1 --2- 172.21.15.39:0/3097297401 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fc6341079c0 0x7fc63419cb20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:37:39.242 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:37:39.236+0000 7fc633e00640 1 --2- 172.21.15.39:0/3097297401 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fc634102360 0x7fc634198790 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:37:39.242 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:37:39.236+0000 7fc633e00640 1 --2- 172.21.15.39:0/3097297401 >> [v2:172.21.15.39:6800/1725006999,v1:172.21.15.39:6801/1725006999] conn(0x7fc6180a2b80 0x7fc6180a5040 unknown :-1 s=CLOSED pgs=225 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:37:39.243 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:37:39.236+0000 7fc633e00640 1 --2- 172.21.15.39:0/3097297401 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fc6341019c0 0x7fc634198250 unknown :-1 s=CLOSED pgs=263 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:37:39.243 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:37:39.236+0000 7fc633e00640 1 -- 172.21.15.39:0/3097297401 >> 172.21.15.39:0/3097297401 conn(0x7fc6340fd6e0 msgr2=0x7fc6340fddc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:37:39.243 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:37:39.236+0000 7fc633e00640 1 -- 172.21.15.39:0/3097297401 shutdown_connections 2024-09-12T02:37:39.243 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:37:39.236+0000 7fc633e00640 1 -- 172.21.15.39:0/3097297401 wait complete. 2024-09-12T02:37:40.089 DEBUG:teuthology.orchestra.run.smithi039:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc shell --fsid 4954ed46-70ae-11ef-bcea-c7b262605968 -- ceph tell mds.h status 2024-09-12T02:37:40.469 INFO:teuthology.orchestra.run.smithi039.stderr:Inferring config /var/lib/ceph/4954ed46-70ae-11ef-bcea-c7b262605968/mon.a/config 2024-09-12T02:37:40.825 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 02:37:40 smithi039 ceph-mon[30515]: pgmap v382: 129 pgs: 129 active+clean; 646 KiB data, 348 MiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 11 op/s 2024-09-12T02:37:40.948 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 12 02:37:40 smithi044 ceph-mon[35411]: pgmap v382: 129 pgs: 129 active+clean; 646 KiB data, 348 MiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 11 op/s 2024-09-12T02:37:41.013 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 12 02:37:40 smithi172 ceph-mon[35609]: pgmap v382: 129 pgs: 129 active+clean; 646 KiB data, 348 MiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 11 op/s 2024-09-12T02:37:41.060 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:37:41.058+0000 7f1185e00640 1 -- 172.21.15.39:0/214574455 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f11801047e0 msgr2=0x7f1180108830 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:37:41.060 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:37:41.058+0000 7f1185e00640 1 --2- 172.21.15.39:0/214574455 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f11801047e0 0x7f1180108830 secure :-1 s=READY pgs=265 cs=0 l=1 rev1=1 crypto rx=0x7f116c009900 tx=0x7f116c02a3f0 comp rx=0 tx=0).stop 2024-09-12T02:37:41.060 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:37:41.059+0000 7f1185e00640 1 -- 172.21.15.39:0/214574455 shutdown_connections 2024-09-12T02:37:41.060 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:37:41.059+0000 7f1185e00640 1 --2- 172.21.15.39:0/214574455 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f1180108f60 0x7f1180110ae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:37:41.060 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:37:41.059+0000 7f1185e00640 1 --2- 172.21.15.39:0/214574455 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f11801047e0 0x7f1180108830 unknown :-1 s=CLOSED pgs=265 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:37:41.060 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:37:41.059+0000 7f1185e00640 1 --2- 172.21.15.39:0/214574455 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f1180103e30 0x7f1180104210 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:37:41.060 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:37:41.059+0000 7f1185e00640 1 -- 172.21.15.39:0/214574455 >> 172.21.15.39:0/214574455 conn(0x7f11800ff8d0 msgr2=0x7f1180101cf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:37:41.060 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:37:41.059+0000 7f1185e00640 1 -- 172.21.15.39:0/214574455 shutdown_connections 2024-09-12T02:37:41.060 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:37:41.059+0000 7f1185e00640 1 -- 172.21.15.39:0/214574455 wait complete. 2024-09-12T02:37:41.061 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:37:41.060+0000 7f1185e00640 1 Processor -- start 2024-09-12T02:37:41.061 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:37:41.060+0000 7f1185e00640 1 -- start start 2024-09-12T02:37:41.061 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:37:41.060+0000 7f1185e00640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f1180103e30 0x7f118019a490 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:37:41.061 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:37:41.061+0000 7f1185e00640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f11801047e0 0x7f118019a9d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:37:41.062 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:37:41.061+0000 7f1185e00640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f1180108f60 0x7f118019ed60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:37:41.062 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:37:41.061+0000 7f1185e00640 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 -- 0x7f1180114010 con 0x7f1180108f60 2024-09-12T02:37:41.062 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:37:41.061+0000 7f1185e00640 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x7f1180113e90 con 0x7f1180103e30 2024-09-12T02:37:41.062 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:37:41.061+0000 7f1185e00640 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7f1180114190 con 0x7f11801047e0 2024-09-12T02:37:41.063 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:37:41.061+0000 7f1184a00640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f1180103e30 0x7f118019a490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:37:41.063 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:37:41.061+0000 7f117fe00640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f11801047e0 0x7f118019a9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:37:41.063 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:37:41.061+0000 7f1185400640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f1180108f60 0x7f118019ed60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:37:41.063 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:37:41.061+0000 7f117fe00640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f11801047e0 0x7f118019a9d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.172:3300/0 says I am v2:172.21.15.39:56426/0 (socket says 172.21.15.39:56426) 2024-09-12T02:37:41.063 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:37:41.061+0000 7f117fe00640 1 -- 172.21.15.39:0/1345665119 learned_addr learned my addr 172.21.15.39:0/1345665119 (peer_addr_for_me v2:172.21.15.39:0/0) 2024-09-12T02:37:41.064 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:37:41.061+0000 7f1184a00640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f1180103e30 0x7f118019a490 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.39:44180/0 (socket says 172.21.15.39:44180) 2024-09-12T02:37:41.064 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:37:41.061+0000 7f117fe00640 1 -- 172.21.15.39:0/1345665119 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f1180103e30 msgr2=0x7f118019a490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:37:41.064 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:37:41.061+0000 7f117fe00640 1 --2- 172.21.15.39:0/1345665119 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f1180103e30 0x7f118019a490 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:37:41.064 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:37:41.061+0000 7f117fe00640 1 -- 172.21.15.39:0/1345665119 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f1180108f60 msgr2=0x7f118019ed60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:37:41.064 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:37:41.061+0000 7f117fe00640 1 --2- 172.21.15.39:0/1345665119 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f1180108f60 0x7f118019ed60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:37:41.064 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:37:41.061+0000 7f117fe00640 1 -- 172.21.15.39:0/1345665119 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f118019f440 con 0x7f11801047e0 2024-09-12T02:37:41.064 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:37:41.061+0000 7f1185400640 1 --2- 172.21.15.39:0/1345665119 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f1180108f60 0x7f118019ed60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-12T02:37:41.064 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:37:41.062+0000 7f117fe00640 1 --2- 172.21.15.39:0/1345665119 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f11801047e0 0x7f118019a9d0 secure :-1 s=READY pgs=107 cs=0 l=1 rev1=1 crypto rx=0x7f116c004770 tx=0x7f116c003c10 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:37:41.064 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:37:41.062+0000 7f117d600640 1 -- 172.21.15.39:0/1345665119 <== mon.1 v2:172.21.15.172:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f116c03f070 con 0x7f11801047e0 2024-09-12T02:37:41.064 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:37:41.062+0000 7f117d600640 1 -- 172.21.15.39:0/1345665119 <== mon.1 v2:172.21.15.172:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f116c031ca0 con 0x7f11801047e0 2024-09-12T02:37:41.064 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:37:41.062+0000 7f1185e00640 1 -- 172.21.15.39:0/1345665119 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f118019f6d0 con 0x7f11801047e0 2024-09-12T02:37:41.064 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:37:41.062+0000 7f117d600640 1 -- 172.21.15.39:0/1345665119 <== mon.1 v2:172.21.15.172:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f116c035030 con 0x7f11801047e0 2024-09-12T02:37:41.064 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:37:41.062+0000 7f1185e00640 1 -- 172.21.15.39:0/1345665119 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f11801a7010 con 0x7f11801047e0 2024-09-12T02:37:41.066 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:37:41.065+0000 7f1189fea740 1 Processor -- start 2024-09-12T02:37:41.066 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:37:41.065+0000 7f117d600640 1 -- 172.21.15.39:0/1345665119 <== mon.1 v2:172.21.15.172:3300/0 4 ==== mgrmap(e 18) ==== 137833+0+0 (secure 0 0 0) 0x7f116c042070 con 0x7f11801047e0 2024-09-12T02:37:41.066 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:37:41.065+0000 7f1189fea740 1 -- start start 2024-09-12T02:37:41.067 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:37:41.066+0000 7f1189fea740 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55c8357534e0 0x55c8357538c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:37:41.067 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:37:41.066+0000 7f1189fea740 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55c835753e00 0x55c83575e180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:37:41.067 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:37:41.066+0000 7f1189fea740 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55c83575e6c0 0x55c835760ab0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:37:41.067 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:37:41.066+0000 7f1189fea740 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 -- 0x55c8356b90b0 con 0x55c83575e6c0 2024-09-12T02:37:41.067 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:37:41.066+0000 7f1189fea740 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x55c835660ab0 con 0x55c835753e00 2024-09-12T02:37:41.067 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:37:41.066+0000 7f1189fea740 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x55c8356b5070 con 0x55c8357534e0 2024-09-12T02:37:41.067 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:37:41.066+0000 7f1184a00640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55c835753e00 0x55c83575e180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:37:41.067 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:37:41.066+0000 7f117fe00640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55c83575e6c0 0x55c835760ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:37:41.067 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:37:41.066+0000 7f1184a00640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55c835753e00 0x55c83575e180 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.39:44192/0 (socket says 172.21.15.39:44192) 2024-09-12T02:37:41.068 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:37:41.066+0000 7f1184a00640 1 -- 172.21.15.39:0/1572264431 learned_addr learned my addr 172.21.15.39:0/1572264431 (peer_addr_for_me v2:172.21.15.39:0/0) 2024-09-12T02:37:41.068 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:37:41.066+0000 7f1185400640 1 --2- 172.21.15.39:0/1572264431 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55c8357534e0 0x55c8357538c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:37:41.069 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:37:41.067+0000 7f1184a00640 1 -- 172.21.15.39:0/1572264431 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55c8357534e0 msgr2=0x55c8357538c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:37:41.070 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:37:41.067+0000 7f1184a00640 1 --2- 172.21.15.39:0/1572264431 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55c8357534e0 0x55c8357538c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:37:41.070 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:37:41.067+0000 7f1184a00640 1 -- 172.21.15.39:0/1572264431 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55c83575e6c0 msgr2=0x55c835760ab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:37:41.070 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:37:41.067+0000 7f1184a00640 1 --2- 172.21.15.39:0/1572264431 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55c83575e6c0 0x55c835760ab0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:37:41.070 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:37:41.067+0000 7f1184a00640 1 -- 172.21.15.39:0/1572264431 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55c83566d4a0 con 0x55c835753e00 2024-09-12T02:37:41.070 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:37:41.067+0000 7f1184a00640 1 --2- 172.21.15.39:0/1572264431 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55c835753e00 0x55c83575e180 secure :-1 s=READY pgs=117 cs=0 l=1 rev1=1 crypto rx=0x7f1174009cf0 tx=0x7f1174011810 comp rx=0 tx=0).ready entity=mon.2 client_cookie=952b6113d139b056 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:37:41.070 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:37:41.067+0000 7f117d600640 1 --2- 172.21.15.39:0/1345665119 >> [v2:172.21.15.39:6800/1725006999,v1:172.21.15.39:6801/1725006999] conn(0x7f11680a2c00 0x7f11680a50c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:37:41.070 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:37:41.067+0000 7f117d600640 1 -- 172.21.15.39:0/1345665119 <== mon.1 v2:172.21.15.172:3300/0 5 ==== osd_map(95..95 src has 1..95) ==== 9129+0+0 (secure 0 0 0) 0x7f116c0ef930 con 0x7f11801047e0 2024-09-12T02:37:41.070 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:37:41.067+0000 7f1171c00640 1 -- 172.21.15.39:0/1572264431 <== mon.2 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1174004230 con 0x55c835753e00 2024-09-12T02:37:41.070 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:37:41.067+0000 7f1171c00640 1 -- 172.21.15.39:0/1572264431 <== mon.2 v2:172.21.15.44:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f11740043d0 con 0x55c835753e00 2024-09-12T02:37:41.070 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:37:41.067+0000 7f1185400640 1 --2- 172.21.15.39:0/1345665119 >> [v2:172.21.15.39:6800/1725006999,v1:172.21.15.39:6801/1725006999] conn(0x7f11680a2c00 0x7f11680a50c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:37:41.070 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:37:41.067+0000 7f1171c00640 1 -- 172.21.15.39:0/1572264431 <== mon.2 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f11740198c0 con 0x55c835753e00 2024-09-12T02:37:41.070 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:37:41.068+0000 7f1189fea740 1 -- 172.21.15.39:0/1572264431 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55c835753e00 msgr2=0x55c83575e180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:37:41.070 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:37:41.068+0000 7f1189fea740 1 --2- 172.21.15.39:0/1572264431 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55c835753e00 0x55c83575e180 secure :-1 s=READY pgs=117 cs=0 l=1 rev1=1 crypto rx=0x7f1174009cf0 tx=0x7f1174011810 comp rx=0 tx=0).stop 2024-09-12T02:37:41.071 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:37:41.068+0000 7f1185400640 1 --2- 172.21.15.39:0/1345665119 >> [v2:172.21.15.39:6800/1725006999,v1:172.21.15.39:6801/1725006999] conn(0x7f11680a2c00 0x7f11680a50c0 secure :-1 s=READY pgs=226 cs=0 l=1 rev1=1 crypto rx=0x7f1178009fd0 tx=0x7f1178009500 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:37:41.071 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:37:41.068+0000 7f1189fea740 1 -- 172.21.15.39:0/1572264431 shutdown_connections 2024-09-12T02:37:41.071 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:37:41.068+0000 7f1189fea740 1 --2- 172.21.15.39:0/1572264431 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55c83575e6c0 0x55c835760ab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:37:41.071 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:37:41.068+0000 7f1189fea740 1 --2- 172.21.15.39:0/1572264431 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55c835753e00 0x55c83575e180 unknown :-1 s=CLOSED pgs=117 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:37:41.071 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:37:41.068+0000 7f1189fea740 1 --2- 172.21.15.39:0/1572264431 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55c8357534e0 0x55c8357538c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:37:41.071 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:37:41.068+0000 7f1189fea740 1 -- 172.21.15.39:0/1572264431 >> 172.21.15.39:0/1572264431 conn(0x55c83574fa70 msgr2=0x55c83574fe50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:37:41.071 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:37:41.068+0000 7f1189fea740 1 -- 172.21.15.39:0/1572264431 shutdown_connections 2024-09-12T02:37:41.071 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:37:41.068+0000 7f1189fea740 1 -- 172.21.15.39:0/1572264431 wait complete. 2024-09-12T02:37:41.071 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:37:41.069+0000 7f1189fea740 1 -- start start 2024-09-12T02:37:41.071 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:37:41.069+0000 7f1189fea740 1 Processor -- start 2024-09-12T02:37:41.073 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:37:41.069+0000 7f1189fea740 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55c8357534e0 0x55c83575b560 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:37:41.073 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:37:41.069+0000 7f1189fea740 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55c835753e00 0x55c83575baa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:37:41.074 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:37:41.069+0000 7f1189fea740 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55c83575e6c0 0x55c83575bfe0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:37:41.074 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:37:41.069+0000 7f1189fea740 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 -- 0x55c835761330 con 0x55c83575e6c0 2024-09-12T02:37:41.074 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:37:41.069+0000 7f1189fea740 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x55c835641920 con 0x55c835753e00 2024-09-12T02:37:41.074 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:37:41.069+0000 7f1189fea740 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x55c8357614b0 con 0x55c8357534e0 2024-09-12T02:37:41.074 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:37:41.069+0000 7f1189fea740 10 client.0 _ll_register_callbacks cb 0x55c8356658a0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-12T02:37:41.074 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:37:41.070+0000 7f117fe00640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55c835753e00 0x55c83575baa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:37:41.074 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:37:41.070+0000 7f1185400640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55c83575e6c0 0x55c83575bfe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:37:41.074 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:37:41.070+0000 7f117fe00640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55c835753e00 0x55c83575baa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.39:44206/0 (socket says 172.21.15.39:44206) 2024-09-12T02:37:41.074 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:37:41.070+0000 7f117fe00640 1 -- 172.21.15.39:0/822638888 learned_addr learned my addr 172.21.15.39:0/822638888 (peer_addr_for_me v2:172.21.15.39:0/0) 2024-09-12T02:37:41.074 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:37:41.070+0000 7f117fe00640 1 -- 172.21.15.39:0/822638888 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55c8357534e0 msgr2=0x55c83575b560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:37:41.074 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:37:41.070+0000 7f117fe00640 1 --2- 172.21.15.39:0/822638888 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55c8357534e0 0x55c83575b560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:37:41.074 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:37:41.070+0000 7f117fe00640 1 -- 172.21.15.39:0/822638888 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55c83575e6c0 msgr2=0x55c83575bfe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:37:41.074 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:37:41.070+0000 7f117fe00640 1 --2- 172.21.15.39:0/822638888 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55c83575e6c0 0x55c83575bfe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:37:41.074 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:37:41.070+0000 7f117fe00640 1 -- 172.21.15.39:0/822638888 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55c83542a2b0 con 0x55c835753e00 2024-09-12T02:37:41.075 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:37:41.070+0000 7f117fe00640 1 --2- 172.21.15.39:0/822638888 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55c835753e00 0x55c83575baa0 secure :-1 s=READY pgs=118 cs=0 l=1 rev1=1 crypto rx=0x7f116c0bbeb0 tx=0x7f116c031f00 comp rx=0 tx=0).ready entity=mon.2 client_cookie=89586fae74b8ec5e server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:37:41.075 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:37:41.071+0000 7f1166000640 10 client.0 ms_handle_connect on v2:172.21.15.44:3300/0 2024-09-12T02:37:41.075 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:37:41.071+0000 7f1166000640 1 -- 172.21.15.39:0/822638888 <== mon.2 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f116c049030 con 0x55c835753e00 2024-09-12T02:37:41.075 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:37:41.071+0000 7f1189fea740 1 -- 172.21.15.39:0/822638888 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f11740043d0 con 0x55c835753e00 2024-09-12T02:37:41.075 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:37:41.071+0000 7f1166000640 1 -- 172.21.15.39:0/822638888 <== mon.2 v2:172.21.15.44:3300/0 2 ==== osd_map(95..95 src has 1..95) ==== 9129+0+0 (secure 0 0 0) 0x7f116c0b8590 con 0x55c835753e00 2024-09-12T02:37:41.075 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:37:41.071+0000 7f1166000640 1 -- 172.21.15.39:0/822638888 <== mon.2 v2:172.21.15.44:3300/0 3 ==== mon_get_version_reply(handle=1 version=28) ==== 24+0+0 (secure 0 0 0) 0x7f116c0bb880 con 0x55c835753e00 2024-09-12T02:37:41.075 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:37:41.071+0000 7f1189fea740 10 client.25118 fetch_fsmap learned FSMap version 28 2024-09-12T02:37:41.075 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:37:41.071+0000 7f1189fea740 1 -- 172.21.15.39:0/822638888 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,fsmap=28,monmap=4+}) -- 0x55c83576cf90 con 0x55c835753e00 2024-09-12T02:37:41.075 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:37:41.071+0000 7f1166000640 1 -- 172.21.15.39:0/822638888 <== mon.2 v2:172.21.15.44:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f11740043d0 con 0x55c835753e00 2024-09-12T02:37:41.075 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:37:41.071+0000 7f1166000640 1 -- 172.21.15.39:0/822638888 <== mon.2 v2:172.21.15.44:3300/0 5 ==== fsmap(e 28) ==== 8370+0+0 (secure 0 0 0) 0x7f116c0c4650 con 0x55c835753e00 2024-09-12T02:37:41.075 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:37:41.072+0000 7f1189fea740 10 client.25118 fetch_fsmap finished waiting for FSMap version 28 2024-09-12T02:37:41.075 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:37:41.072+0000 7f1189fea740 10 client.25118 resolve_mds: resolved name 'h' to daemon mds.h 2024-09-12T02:37:41.075 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:37:41.072+0000 7f1189fea740 20 client.25118 populate_metadata read hostname 'smithi039' 2024-09-12T02:37:41.075 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:37:41.072+0000 7f1189fea740 1 --2- 172.21.15.39:0/822638888 >> [v2:172.21.15.44:6836/1501493978,v1:172.21.15.44:6837/1501493978] conn(0x55c83576f670 0x55c835770ae0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:37:41.076 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:37:41.072+0000 7f1189fea740 4 client.25118 mds_command: new command op to 24482 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-12T02:37:41.076 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:37:41.072+0000 7f1189fea740 1 -- 172.21.15.39:0/822638888 --> [v2:172.21.15.44:6836/1501493978,v1:172.21.15.44:6837/1501493978] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55c8356c6620 con 0x55c83576f670 2024-09-12T02:37:41.076 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:37:41.072+0000 7f1184a00640 1 --2- 172.21.15.39:0/822638888 >> [v2:172.21.15.44:6836/1501493978,v1:172.21.15.44:6837/1501493978] conn(0x55c83576f670 0x55c835770ae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:37:41.076 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:37:41.073+0000 7f1184a00640 1 --2- 172.21.15.39:0/822638888 >> [v2:172.21.15.44:6836/1501493978,v1:172.21.15.44:6837/1501493978] conn(0x55c83576f670 0x55c835770ae0 crc :-1 s=READY pgs=18 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.3 client_cookie=f4d0c64a19d4fca5 server_cookie=8d14f8f38376ed25 in_seq=0 out_seq=0 2024-09-12T02:37:41.076 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:37:41.073+0000 7f1166000640 10 client.25118 ms_handle_connect on v2:172.21.15.44:6836/1501493978 2024-09-12T02:37:41.077 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:37:41.073+0000 7f1166000640 1 -- 172.21.15.39:0/822638888 <== mds.3 v2:172.21.15.44:6836/1501493978 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x55c8356c6620 con 0x55c83576f670 2024-09-12T02:37:41.077 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:37:41.073+0000 7f1166000640 10 client.25118 handle_command_reply: tid=0 2024-09-12T02:37:41.077 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:37:41.073+0000 7f1189fea740 1 client.25118 shutdown 2024-09-12T02:37:41.077 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:37:41.074+0000 7f1189fea740 1 -- 172.21.15.39:0/822638888 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55c835753e00 msgr2=0x55c83575baa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:37:41.077 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:37:41.074+0000 7f1189fea740 1 --2- 172.21.15.39:0/822638888 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55c835753e00 0x55c83575baa0 secure :-1 s=READY pgs=118 cs=0 l=1 rev1=1 crypto rx=0x7f116c0bbeb0 tx=0x7f116c031f00 comp rx=0 tx=0).stop 2024-09-12T02:37:41.077 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:37:41.074+0000 7f1189fea740 1 -- 172.21.15.39:0/822638888 shutdown_connections 2024-09-12T02:37:41.077 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:37:41.074+0000 7f1189fea740 1 --2- 172.21.15.39:0/822638888 >> [v2:172.21.15.44:6836/1501493978,v1:172.21.15.44:6837/1501493978] conn(0x55c83576f670 0x55c835770ae0 crc :-1 s=READY pgs=18 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:37:41.077 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:37:41.074+0000 7f1189fea740 1 --2- 172.21.15.39:0/822638888 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55c83575e6c0 0x55c83575bfe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:37:41.077 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:37:41.074+0000 7f1189fea740 1 --2- 172.21.15.39:0/822638888 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55c835753e00 0x55c83575baa0 unknown :-1 s=CLOSED pgs=118 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:37:41.077 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:37:41.074+0000 7f1189fea740 1 --2- 172.21.15.39:0/822638888 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55c8357534e0 0x55c83575b560 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:37:41.078 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:37:41.074+0000 7f1189fea740 1 -- 172.21.15.39:0/822638888 >> 172.21.15.39:0/822638888 conn(0x55c83574fa70 msgr2=0x55c835755750 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:37:41.078 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:37:41.074+0000 7f1166000640 0 client.25118 ms_handle_reset on v2:172.21.15.44:6836/1501493978 2024-09-12T02:37:41.078 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:37:41.074+0000 7f1189fea740 1 -- 172.21.15.39:0/822638888 shutdown_connections 2024-09-12T02:37:41.078 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:37:41.074+0000 7f1189fea740 1 -- 172.21.15.39:0/822638888 wait complete. 2024-09-12T02:37:41.078 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:37:41.074+0000 7f1189fea740 20 client.25118 trim_cache size 0 max 16384 2024-09-12T02:37:41.094 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:37:41.093+0000 7f1189fea740 1 Processor -- start 2024-09-12T02:37:41.094 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:37:41.093+0000 7f1189fea740 1 -- start start 2024-09-12T02:37:41.094 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:37:41.093+0000 7f1189fea740 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55c8357534e0 0x55c835770ae0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:37:41.094 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:37:41.093+0000 7f1189fea740 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55c835753e00 0x55c835759e50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:37:41.094 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:37:41.093+0000 7f1189fea740 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55c83575e6c0 0x55c83575a390 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:37:41.094 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:37:41.093+0000 7f1189fea740 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 -- 0x55c83576ee20 con 0x55c8357534e0 2024-09-12T02:37:41.094 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:37:41.093+0000 7f1189fea740 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x55c83576f4f0 con 0x55c83575e6c0 2024-09-12T02:37:41.094 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:37:41.093+0000 7f1189fea740 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x55c83576fbc0 con 0x55c835753e00 2024-09-12T02:37:41.095 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:37:41.093+0000 7f1184a00640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55c8357534e0 0x55c835770ae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:37:41.095 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:37:41.093+0000 7f1184a00640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55c8357534e0 0x55c835770ae0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.39:3300/0 says I am v2:172.21.15.39:55818/0 (socket says 172.21.15.39:55818) 2024-09-12T02:37:41.095 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:37:41.093+0000 7f1184a00640 1 -- 172.21.15.39:0/942593591 learned_addr learned my addr 172.21.15.39:0/942593591 (peer_addr_for_me v2:172.21.15.39:0/0) 2024-09-12T02:37:41.095 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:37:41.094+0000 7f1185400640 1 --2- 172.21.15.39:0/942593591 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55c83575e6c0 0x55c83575a390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:37:41.095 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:37:41.094+0000 7f117fe00640 1 --2- 172.21.15.39:0/942593591 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55c835753e00 0x55c835759e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:37:41.096 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:37:41.094+0000 7f1184a00640 1 -- 172.21.15.39:0/942593591 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55c835753e00 msgr2=0x55c835759e50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:37:41.096 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:37:41.094+0000 7f1184a00640 1 --2- 172.21.15.39:0/942593591 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55c835753e00 0x55c835759e50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:37:41.096 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:37:41.094+0000 7f1184a00640 1 -- 172.21.15.39:0/942593591 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55c83575e6c0 msgr2=0x55c83575a390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:37:41.096 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:37:41.094+0000 7f1184a00640 1 --2- 172.21.15.39:0/942593591 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55c83575e6c0 0x55c83575a390 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:37:41.096 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:37:41.094+0000 7f1184a00640 1 -- 172.21.15.39:0/942593591 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55c83574f510 con 0x55c8357534e0 2024-09-12T02:37:41.096 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:37:41.094+0000 7f1184a00640 1 --2- 172.21.15.39:0/942593591 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55c8357534e0 0x55c835770ae0 secure :-1 s=READY pgs=266 cs=0 l=1 rev1=1 crypto rx=0x7f117401b040 tx=0x7f1174019420 comp rx=0 tx=0).ready entity=mon.0 client_cookie=997268b466a90a9e server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:37:41.096 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:37:41.095+0000 7f1171200640 1 -- 172.21.15.39:0/942593591 <== mon.0 v2:172.21.15.39:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f11740037f0 con 0x55c8357534e0 2024-09-12T02:37:41.096 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:37:41.095+0000 7f1171200640 1 -- 172.21.15.39:0/942593591 <== mon.0 v2:172.21.15.39:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f11740054e0 con 0x55c8357534e0 2024-09-12T02:37:41.096 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:37:41.095+0000 7f1171200640 1 -- 172.21.15.39:0/942593591 <== mon.0 v2:172.21.15.39:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f11740197b0 con 0x55c8357534e0 2024-09-12T02:37:41.097 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:37:41.095+0000 7f1189fea740 1 -- 172.21.15.39:0/942593591 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55c8357534e0 msgr2=0x55c835770ae0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:37:41.097 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:37:41.095+0000 7f1189fea740 1 --2- 172.21.15.39:0/942593591 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55c8357534e0 0x55c835770ae0 secure :-1 s=READY pgs=266 cs=0 l=1 rev1=1 crypto rx=0x7f117401b040 tx=0x7f1174019420 comp rx=0 tx=0).stop 2024-09-12T02:37:41.098 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:37:41.095+0000 7f1189fea740 1 -- 172.21.15.39:0/942593591 shutdown_connections 2024-09-12T02:37:41.098 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:37:41.095+0000 7f1189fea740 1 --2- 172.21.15.39:0/942593591 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55c83575e6c0 0x55c83575a390 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:37:41.098 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:37:41.095+0000 7f1189fea740 1 --2- 172.21.15.39:0/942593591 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55c835753e00 0x55c835759e50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:37:41.098 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:37:41.095+0000 7f1189fea740 1 --2- 172.21.15.39:0/942593591 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55c8357534e0 0x55c835770ae0 unknown :-1 s=CLOSED pgs=266 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:37:41.098 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:37:41.095+0000 7f1189fea740 1 -- 172.21.15.39:0/942593591 >> 172.21.15.39:0/942593591 conn(0x55c83574fa70 msgr2=0x55c83576e2e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:37:41.098 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:37:41.095+0000 7f1189fea740 1 -- 172.21.15.39:0/942593591 shutdown_connections 2024-09-12T02:37:41.098 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:37:41.095+0000 7f1189fea740 1 -- 172.21.15.39:0/942593591 wait complete. 2024-09-12T02:37:41.098 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:37:41.096+0000 7f1189fea740 1 -- start start 2024-09-12T02:37:41.098 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:37:41.096+0000 7f1189fea740 1 Processor -- start 2024-09-12T02:37:41.098 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:37:41.096+0000 7f1189fea740 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55c8357534e0 0x55c835779420 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:37:41.098 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:37:41.096+0000 7f1189fea740 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55c835753e00 0x55c835758270 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:37:41.098 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:37:41.097+0000 7f1189fea740 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55c83575e6c0 0x55c8357587b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:37:41.098 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:37:41.097+0000 7f1189fea740 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 -- 0x55c835770960 con 0x55c8357534e0 2024-09-12T02:37:41.098 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:37:41.097+0000 7f1189fea740 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x55c835770290 con 0x55c83575e6c0 2024-09-12T02:37:41.099 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:37:41.097+0000 7f1189fea740 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x55c835771030 con 0x55c835753e00 2024-09-12T02:37:41.099 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:37:41.097+0000 7f1189fea740 10 client.0 _ll_register_callbacks cb 0x7f116c0b81c0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-12T02:37:41.099 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:37:41.097+0000 7f1184a00640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55c8357534e0 0x55c835779420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:37:41.099 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:37:41.097+0000 7f117fe00640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55c835753e00 0x55c835758270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:37:41.099 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:37:41.097+0000 7f117fe00640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55c835753e00 0x55c835758270 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.172:3300/0 says I am v2:172.21.15.39:56454/0 (socket says 172.21.15.39:56454) 2024-09-12T02:37:41.099 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:37:41.097+0000 7f117fe00640 1 -- 172.21.15.39:0/1058487057 learned_addr learned my addr 172.21.15.39:0/1058487057 (peer_addr_for_me v2:172.21.15.39:0/0) 2024-09-12T02:37:41.099 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:37:41.097+0000 7f1184a00640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55c8357534e0 0x55c835779420 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.39:3300/0 says I am v2:172.21.15.39:55824/0 (socket says 172.21.15.39:55824) 2024-09-12T02:37:41.099 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:37:41.097+0000 7f1185400640 1 --2- 172.21.15.39:0/1058487057 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55c83575e6c0 0x55c8357587b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:37:41.101 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:37:41.097+0000 7f1185400640 1 -- 172.21.15.39:0/1058487057 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55c835753e00 msgr2=0x55c835758270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:37:41.101 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:37:41.097+0000 7f1185400640 1 --2- 172.21.15.39:0/1058487057 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55c835753e00 0x55c835758270 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:37:41.102 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:37:41.097+0000 7f1185400640 1 -- 172.21.15.39:0/1058487057 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55c8357534e0 msgr2=0x55c835779420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:37:41.102 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:37:41.097+0000 7f1185400640 1 --2- 172.21.15.39:0/1058487057 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55c8357534e0 0x55c835779420 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:37:41.102 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:37:41.097+0000 7f1185400640 1 -- 172.21.15.39:0/1058487057 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55c835758ef0 con 0x55c83575e6c0 2024-09-12T02:37:41.102 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:37:41.097+0000 7f117fe00640 1 --2- 172.21.15.39:0/1058487057 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55c835753e00 0x55c835758270 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-12T02:37:41.102 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:37:41.097+0000 7f1184a00640 1 --2- 172.21.15.39:0/1058487057 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55c8357534e0 0x55c835779420 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-12T02:37:41.102 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:37:41.098+0000 7f1185400640 1 --2- 172.21.15.39:0/1058487057 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55c83575e6c0 0x55c8357587b0 secure :-1 s=READY pgs=119 cs=0 l=1 rev1=1 crypto rx=0x55c8357714f0 tx=0x7f1178004a40 comp rx=0 tx=0).ready entity=mon.2 client_cookie=8ccd41803bdbcaf8 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:37:41.102 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:37:41.098+0000 7f1166000640 10 client.0 ms_handle_connect on v2:172.21.15.44:3300/0 2024-09-12T02:37:41.102 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:37:41.098+0000 7f1166000640 1 -- 172.21.15.39:0/1058487057 <== mon.2 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1178012020 con 0x55c83575e6c0 2024-09-12T02:37:41.102 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:37:41.098+0000 7f1166000640 1 -- 172.21.15.39:0/1058487057 <== mon.2 v2:172.21.15.44:3300/0 2 ==== osd_map(95..95 src has 1..95) ==== 9129+0+0 (secure 0 0 0) 0x7f11780121c0 con 0x55c83575e6c0 2024-09-12T02:37:41.102 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:37:41.098+0000 7f1189fea740 1 -- 172.21.15.39:0/1058487057 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f11740054e0 con 0x55c83575e6c0 2024-09-12T02:37:41.102 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:37:41.098+0000 7f1166000640 1 -- 172.21.15.39:0/1058487057 <== mon.2 v2:172.21.15.44:3300/0 3 ==== mon_get_version_reply(handle=1 version=28) ==== 24+0+0 (secure 0 0 0) 0x7f1178004b20 con 0x55c83575e6c0 2024-09-12T02:37:41.102 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:37:41.098+0000 7f1189fea740 10 client.25124 fetch_fsmap learned FSMap version 28 2024-09-12T02:37:41.103 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:37:41.098+0000 7f1189fea740 1 -- 172.21.15.39:0/1058487057 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,fsmap=28,monmap=4+}) -- 0x55c8357d9d80 con 0x55c83575e6c0 2024-09-12T02:37:41.103 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:37:41.099+0000 7f1166000640 1 -- 172.21.15.39:0/1058487057 <== mon.2 v2:172.21.15.44:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f11740054e0 con 0x55c83575e6c0 2024-09-12T02:37:41.103 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:37:41.099+0000 7f1166000640 1 -- 172.21.15.39:0/1058487057 <== mon.2 v2:172.21.15.44:3300/0 5 ==== fsmap(e 28) ==== 8370+0+0 (secure 0 0 0) 0x7f117801f430 con 0x55c83575e6c0 2024-09-12T02:37:41.103 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:37:41.099+0000 7f1189fea740 10 client.25124 fetch_fsmap finished waiting for FSMap version 28 2024-09-12T02:37:41.103 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:37:41.099+0000 7f1189fea740 10 client.25124 resolve_mds: resolved name 'h' to daemon mds.h 2024-09-12T02:37:41.103 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:37:41.099+0000 7f1189fea740 20 client.25124 populate_metadata read hostname 'smithi039' 2024-09-12T02:37:41.103 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:37:41.099+0000 7f1189fea740 1 --2- 172.21.15.39:0/1058487057 >> [v2:172.21.15.44:6836/1501493978,v1:172.21.15.44:6837/1501493978] conn(0x55c8357de9b0 0x55c8357dd6c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:37:41.103 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:37:41.099+0000 7f1189fea740 4 client.25124 mds_command: new command op to 24482 tid=0 multi_id=0 [{"prefix": "status"}] 2024-09-12T02:37:41.103 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:37:41.099+0000 7f1189fea740 1 -- 172.21.15.39:0/1058487057 --> [v2:172.21.15.44:6836/1501493978,v1:172.21.15.44:6837/1501493978] -- command(tid 0: {"prefix": "status"}) -- 0x55c8356c0b30 con 0x55c8357de9b0 2024-09-12T02:37:41.103 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:37:41.099+0000 7f1184a00640 1 --2- 172.21.15.39:0/1058487057 >> [v2:172.21.15.44:6836/1501493978,v1:172.21.15.44:6837/1501493978] conn(0x55c8357de9b0 0x55c8357dd6c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:37:41.103 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:37:41.100+0000 7f1184a00640 1 --2- 172.21.15.39:0/1058487057 >> [v2:172.21.15.44:6836/1501493978,v1:172.21.15.44:6837/1501493978] conn(0x55c8357de9b0 0x55c8357dd6c0 crc :-1 s=READY pgs=19 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.3 client_cookie=69f5cf92ea47ee6d server_cookie=f1382a90f8084a7b in_seq=0 out_seq=0 2024-09-12T02:37:41.103 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:37:41.100+0000 7f1166000640 10 client.25124 ms_handle_connect on v2:172.21.15.44:6836/1501493978 2024-09-12T02:37:41.103 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:37:41.100+0000 7f1166000640 1 -- 172.21.15.39:0/1058487057 <== mds.3 v2:172.21.15.44:6836/1501493978 1 ==== command_reply(tid 0: 0 ) ==== 8+0+327 (crc 0 0 0) 0x55c8356c0b30 con 0x55c8357de9b0 2024-09-12T02:37:41.104 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:37:41.100+0000 7f1166000640 10 client.25124 handle_command_reply: tid=0 2024-09-12T02:37:41.104 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:37:41.100+0000 7f1189fea740 1 client.25124 shutdown 2024-09-12T02:37:41.104 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:37:41.100+0000 7f1189fea740 1 -- 172.21.15.39:0/1058487057 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55c83575e6c0 msgr2=0x55c8357587b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:37:41.104 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:37:41.100+0000 7f1189fea740 1 --2- 172.21.15.39:0/1058487057 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55c83575e6c0 0x55c8357587b0 secure :-1 s=READY pgs=119 cs=0 l=1 rev1=1 crypto rx=0x55c8357714f0 tx=0x7f1178004a40 comp rx=0 tx=0).stop 2024-09-12T02:37:41.104 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:37:41.100+0000 7f1189fea740 1 -- 172.21.15.39:0/1058487057 shutdown_connections 2024-09-12T02:37:41.104 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:37:41.100+0000 7f1189fea740 1 --2- 172.21.15.39:0/1058487057 >> [v2:172.21.15.44:6836/1501493978,v1:172.21.15.44:6837/1501493978] conn(0x55c8357de9b0 0x55c8357dd6c0 crc :-1 s=READY pgs=19 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:37:41.104 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:37:41.100+0000 7f1189fea740 1 --2- 172.21.15.39:0/1058487057 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55c83575e6c0 0x55c8357587b0 unknown :-1 s=CLOSED pgs=119 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:37:41.104 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:37:41.100+0000 7f1189fea740 1 --2- 172.21.15.39:0/1058487057 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55c835753e00 0x55c835758270 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:37:41.104 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:37:41.100+0000 7f1189fea740 1 --2- 172.21.15.39:0/1058487057 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55c8357534e0 0x55c835779420 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:37:41.104 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:37:41.100+0000 7f1166000640 0 client.25124 ms_handle_reset on v2:172.21.15.44:6836/1501493978 2024-09-12T02:37:41.104 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:37:41.100+0000 7f1189fea740 1 -- 172.21.15.39:0/1058487057 >> 172.21.15.39:0/1058487057 conn(0x55c83574fa70 msgr2=0x55c83574e3b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:37:41.104 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:37:41.100+0000 7f1189fea740 1 -- 172.21.15.39:0/1058487057 shutdown_connections 2024-09-12T02:37:41.104 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:37:41.100+0000 7f1189fea740 1 -- 172.21.15.39:0/1058487057 wait complete. 2024-09-12T02:37:41.104 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:37:41.101+0000 7f1189fea740 20 client.25124 trim_cache size 0 max 16384 2024-09-12T02:37:41.105 INFO:teuthology.orchestra.run.smithi039.stdout:{ 2024-09-12T02:37:41.105 INFO:teuthology.orchestra.run.smithi039.stdout: "cluster_fsid": "4954ed46-70ae-11ef-bcea-c7b262605968", 2024-09-12T02:37:41.105 INFO:teuthology.orchestra.run.smithi039.stdout: "whoami": 3, 2024-09-12T02:37:41.105 INFO:teuthology.orchestra.run.smithi039.stdout: "id": 24482, 2024-09-12T02:37:41.105 INFO:teuthology.orchestra.run.smithi039.stdout: "want_state": "up:active", 2024-09-12T02:37:41.105 INFO:teuthology.orchestra.run.smithi039.stdout: "state": "up:active", 2024-09-12T02:37:41.105 INFO:teuthology.orchestra.run.smithi039.stdout: "fs_name": "cephfs", 2024-09-12T02:37:41.105 INFO:teuthology.orchestra.run.smithi039.stdout: "rank_uptime": 110.324967839, 2024-09-12T02:37:41.105 INFO:teuthology.orchestra.run.smithi039.stdout: "mdsmap_epoch": 28, 2024-09-12T02:37:41.105 INFO:teuthology.orchestra.run.smithi039.stdout: "osdmap_epoch": 95, 2024-09-12T02:37:41.105 INFO:teuthology.orchestra.run.smithi039.stdout: "osdmap_epoch_barrier": 93, 2024-09-12T02:37:41.105 INFO:teuthology.orchestra.run.smithi039.stdout: "uptime": 181.84928091500001 2024-09-12T02:37:41.106 INFO:teuthology.orchestra.run.smithi039.stdout:} 2024-09-12T02:37:41.106 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:37:41.101+0000 7f1185e00640 1 -- 172.21.15.39:0/1345665119 >> [v2:172.21.15.39:6800/1725006999,v1:172.21.15.39:6801/1725006999] conn(0x7f11680a2c00 msgr2=0x7f11680a50c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:37:41.106 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:37:41.101+0000 7f1185e00640 1 --2- 172.21.15.39:0/1345665119 >> [v2:172.21.15.39:6800/1725006999,v1:172.21.15.39:6801/1725006999] conn(0x7f11680a2c00 0x7f11680a50c0 secure :-1 s=READY pgs=226 cs=0 l=1 rev1=1 crypto rx=0x7f1178009fd0 tx=0x7f1178009500 comp rx=0 tx=0).stop 2024-09-12T02:37:41.106 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:37:41.101+0000 7f1185e00640 1 -- 172.21.15.39:0/1345665119 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f11801047e0 msgr2=0x7f118019a9d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:37:41.106 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:37:41.101+0000 7f1185e00640 1 --2- 172.21.15.39:0/1345665119 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f11801047e0 0x7f118019a9d0 secure :-1 s=READY pgs=107 cs=0 l=1 rev1=1 crypto rx=0x7f116c004770 tx=0x7f116c003c10 comp rx=0 tx=0).stop 2024-09-12T02:37:41.106 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:37:41.101+0000 7f1185e00640 1 -- 172.21.15.39:0/1345665119 shutdown_connections 2024-09-12T02:37:41.107 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:37:41.101+0000 7f1185e00640 1 --2- 172.21.15.39:0/1345665119 >> [v2:172.21.15.39:6800/1725006999,v1:172.21.15.39:6801/1725006999] conn(0x7f11680a2c00 0x7f11680a50c0 unknown :-1 s=CLOSED pgs=226 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:37:41.107 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:37:41.101+0000 7f1185e00640 1 --2- 172.21.15.39:0/1345665119 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f1180108f60 0x7f118019ed60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:37:41.107 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:37:41.101+0000 7f1185e00640 1 --2- 172.21.15.39:0/1345665119 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f11801047e0 0x7f118019a9d0 unknown :-1 s=CLOSED pgs=107 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:37:41.107 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:37:41.101+0000 7f1185e00640 1 --2- 172.21.15.39:0/1345665119 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f1180103e30 0x7f118019a490 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:37:41.107 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:37:41.101+0000 7f1185e00640 1 -- 172.21.15.39:0/1345665119 >> 172.21.15.39:0/1345665119 conn(0x7f11800ff8d0 msgr2=0x7f1180100c00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:37:41.107 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:37:41.102+0000 7f1185e00640 1 -- 172.21.15.39:0/1345665119 shutdown_connections 2024-09-12T02:37:41.107 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:37:41.102+0000 7f1185e00640 1 -- 172.21.15.39:0/1345665119 wait complete. 2024-09-12T02:37:42.140 DEBUG:teuthology.orchestra.run.smithi039:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc shell --fsid 4954ed46-70ae-11ef-bcea-c7b262605968 -- ceph tell mds.c status 2024-09-12T02:37:42.522 INFO:teuthology.orchestra.run.smithi039.stderr:Inferring config /var/lib/ceph/4954ed46-70ae-11ef-bcea-c7b262605968/mon.a/config 2024-09-12T02:37:42.850 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 02:37:42 smithi039 ceph-mon[30515]: pgmap v383: 129 pgs: 129 active+clean; 646 KiB data, 348 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2024-09-12T02:37:42.948 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 12 02:37:42 smithi044 ceph-mon[35411]: pgmap v383: 129 pgs: 129 active+clean; 646 KiB data, 348 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2024-09-12T02:37:43.013 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 12 02:37:42 smithi172 ceph-mon[35609]: pgmap v383: 129 pgs: 129 active+clean; 646 KiB data, 348 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2024-09-12T02:37:43.216 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:37:43.215+0000 7f0c28600640 1 -- 172.21.15.39:0/1076023337 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f0c201049a0 msgr2=0x7f0c201089f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:37:43.217 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:37:43.215+0000 7f0c28600640 1 --2- 172.21.15.39:0/1076023337 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f0c201049a0 0x7f0c201089f0 secure :-1 s=READY pgs=267 cs=0 l=1 rev1=1 crypto rx=0x7f0c0c009900 tx=0x7f0c0c02a410 comp rx=0 tx=0).stop 2024-09-12T02:37:43.217 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:37:43.215+0000 7f0c28600640 1 -- 172.21.15.39:0/1076023337 shutdown_connections 2024-09-12T02:37:43.217 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:37:43.215+0000 7f0c28600640 1 --2- 172.21.15.39:0/1076023337 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f0c20109120 0x7f0c20110ca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:37:43.217 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:37:43.215+0000 7f0c28600640 1 --2- 172.21.15.39:0/1076023337 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f0c201049a0 0x7f0c201089f0 unknown :-1 s=CLOSED pgs=267 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:37:43.217 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:37:43.215+0000 7f0c28600640 1 --2- 172.21.15.39:0/1076023337 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f0c20103ff0 0x7f0c201043d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:37:43.217 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:37:43.215+0000 7f0c28600640 1 -- 172.21.15.39:0/1076023337 >> 172.21.15.39:0/1076023337 conn(0x7f0c200ffa90 msgr2=0x7f0c20101eb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:37:43.217 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:37:43.215+0000 7f0c28600640 1 -- 172.21.15.39:0/1076023337 shutdown_connections 2024-09-12T02:37:43.217 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:37:43.215+0000 7f0c28600640 1 -- 172.21.15.39:0/1076023337 wait complete. 2024-09-12T02:37:43.219 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:37:43.216+0000 7f0c28600640 1 Processor -- start 2024-09-12T02:37:43.219 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:37:43.216+0000 7f0c28600640 1 -- start start 2024-09-12T02:37:43.219 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:37:43.217+0000 7f0c28600640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f0c20103ff0 0x7f0c2019a670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:37:43.219 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:37:43.217+0000 7f0c28600640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f0c201049a0 0x7f0c2019abb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:37:43.219 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:37:43.217+0000 7f0c28600640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f0c20109120 0x7f0c2019ef40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:37:43.220 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:37:43.217+0000 7f0c28600640 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 -- 0x7f0c20114190 con 0x7f0c201049a0 2024-09-12T02:37:43.220 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:37:43.217+0000 7f0c28600640 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x7f0c20114010 con 0x7f0c20109120 2024-09-12T02:37:43.220 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:37:43.217+0000 7f0c28600640 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7f0c20114310 con 0x7f0c20103ff0 2024-09-12T02:37:43.220 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:37:43.217+0000 7f0c25200640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f0c201049a0 0x7f0c2019abb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:37:43.220 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:37:43.217+0000 7f0c25200640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f0c201049a0 0x7f0c2019abb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.39:3300/0 says I am v2:172.21.15.39:55834/0 (socket says 172.21.15.39:55834) 2024-09-12T02:37:43.220 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:37:43.217+0000 7f0c25c00640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f0c20103ff0 0x7f0c2019a670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:37:43.220 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:37:43.217+0000 7f0c25200640 1 -- 172.21.15.39:0/4253472291 learned_addr learned my addr 172.21.15.39:0/4253472291 (peer_addr_for_me v2:172.21.15.39:0/0) 2024-09-12T02:37:43.220 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:37:43.217+0000 7f0c26600640 1 --2- 172.21.15.39:0/4253472291 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f0c20109120 0x7f0c2019ef40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:37:43.220 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:37:43.218+0000 7f0c25c00640 1 -- 172.21.15.39:0/4253472291 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f0c20109120 msgr2=0x7f0c2019ef40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:37:43.220 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:37:43.218+0000 7f0c25c00640 1 --2- 172.21.15.39:0/4253472291 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f0c20109120 0x7f0c2019ef40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:37:43.220 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:37:43.218+0000 7f0c25c00640 1 -- 172.21.15.39:0/4253472291 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f0c201049a0 msgr2=0x7f0c2019abb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:37:43.220 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:37:43.218+0000 7f0c25c00640 1 --2- 172.21.15.39:0/4253472291 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f0c201049a0 0x7f0c2019abb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:37:43.221 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:37:43.218+0000 7f0c25c00640 1 -- 172.21.15.39:0/4253472291 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0c2019f620 con 0x7f0c20103ff0 2024-09-12T02:37:43.221 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:37:43.218+0000 7f0c25c00640 1 --2- 172.21.15.39:0/4253472291 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f0c20103ff0 0x7f0c2019a670 secure :-1 s=READY pgs=108 cs=0 l=1 rev1=1 crypto rx=0x7f0c1400e9f0 tx=0x7f0c1400eeb0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:37:43.221 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:37:43.218+0000 7f0c1e000640 1 -- 172.21.15.39:0/4253472291 <== mon.1 v2:172.21.15.172:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0c1400ccc0 con 0x7f0c20103ff0 2024-09-12T02:37:43.221 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:37:43.218+0000 7f0c28600640 1 -- 172.21.15.39:0/4253472291 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f0c2019f910 con 0x7f0c20103ff0 2024-09-12T02:37:43.221 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:37:43.218+0000 7f0c1e000640 1 -- 172.21.15.39:0/4253472291 <== mon.1 v2:172.21.15.172:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f0c14010910 con 0x7f0c20103ff0 2024-09-12T02:37:43.221 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:37:43.218+0000 7f0c1e000640 1 -- 172.21.15.39:0/4253472291 <== mon.1 v2:172.21.15.172:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0c14018960 con 0x7f0c20103ff0 2024-09-12T02:37:43.221 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:37:43.218+0000 7f0c28600640 1 -- 172.21.15.39:0/4253472291 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f0c201a71f0 con 0x7f0c20103ff0 2024-09-12T02:37:43.222 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:37:43.221+0000 7f0c2b267740 1 Processor -- start 2024-09-12T02:37:43.222 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:37:43.221+0000 7f0c2b267740 1 -- start start 2024-09-12T02:37:43.222 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:37:43.222+0000 7f0c1e000640 1 -- 172.21.15.39:0/4253472291 <== mon.1 v2:172.21.15.172:3300/0 4 ==== mgrmap(e 18) ==== 137833+0+0 (secure 0 0 0) 0x7f0c14010ac0 con 0x7f0c20103ff0 2024-09-12T02:37:43.224 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:37:43.222+0000 7f0c2b267740 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x56507540a330 0x56507540a710 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:37:43.224 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:37:43.222+0000 7f0c2b267740 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x56507540ac50 0x565075414fd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:37:43.224 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:37:43.222+0000 7f0c2b267740 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x565075415510 0x565075417900 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:37:43.224 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:37:43.222+0000 7f0c2b267740 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 -- 0x5650753700b0 con 0x565075415510 2024-09-12T02:37:43.224 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:37:43.222+0000 7f0c2b267740 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x565075317ab0 con 0x56507540ac50 2024-09-12T02:37:43.224 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:37:43.222+0000 7f0c2b267740 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x56507536c070 con 0x56507540a330 2024-09-12T02:37:43.224 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:37:43.222+0000 7f0c25c00640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x56507540ac50 0x565075414fd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:37:43.224 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:37:43.222+0000 7f0c25c00640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x56507540ac50 0x565075414fd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.39:44250/0 (socket says 172.21.15.39:44250) 2024-09-12T02:37:43.225 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:37:43.222+0000 7f0c25c00640 1 -- 172.21.15.39:0/3548870437 learned_addr learned my addr 172.21.15.39:0/3548870437 (peer_addr_for_me v2:172.21.15.39:0/0) 2024-09-12T02:37:43.225 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:37:43.222+0000 7f0c25200640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x565075415510 0x565075417900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:37:43.225 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:37:43.222+0000 7f0c26600640 1 --2- 172.21.15.39:0/3548870437 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x56507540a330 0x56507540a710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:37:43.225 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:37:43.223+0000 7f0c25c00640 1 -- 172.21.15.39:0/3548870437 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x56507540a330 msgr2=0x56507540a710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:37:43.225 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:37:43.223+0000 7f0c25c00640 1 --2- 172.21.15.39:0/3548870437 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x56507540a330 0x56507540a710 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:37:43.225 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:37:43.223+0000 7f0c25c00640 1 -- 172.21.15.39:0/3548870437 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x565075415510 msgr2=0x565075417900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:37:43.225 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:37:43.223+0000 7f0c25c00640 1 --2- 172.21.15.39:0/3548870437 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x565075415510 0x565075417900 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:37:43.225 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:37:43.223+0000 7f0c25c00640 1 -- 172.21.15.39:0/3548870437 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5650753244a0 con 0x56507540ac50 2024-09-12T02:37:43.225 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:37:43.223+0000 7f0c25c00640 1 --2- 172.21.15.39:0/3548870437 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x56507540ac50 0x565075414fd0 secure :-1 s=READY pgs=120 cs=0 l=1 rev1=1 crypto rx=0x7f0c140d5c20 tx=0x7f0c140d7670 comp rx=0 tx=0).ready entity=mon.2 client_cookie=b4c52f37282b9183 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:37:43.228 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:37:43.223+0000 7f0c12a00640 1 -- 172.21.15.39:0/3548870437 <== mon.2 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0c140de070 con 0x56507540ac50 2024-09-12T02:37:43.229 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:37:43.224+0000 7f0c12a00640 1 -- 172.21.15.39:0/3548870437 <== mon.2 v2:172.21.15.44:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f0c140cfda0 con 0x56507540ac50 2024-09-12T02:37:43.229 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:37:43.224+0000 7f0c12a00640 1 -- 172.21.15.39:0/3548870437 <== mon.2 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0c140da820 con 0x56507540ac50 2024-09-12T02:37:43.229 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:37:43.224+0000 7f0c1e000640 1 --2- 172.21.15.39:0/4253472291 >> [v2:172.21.15.39:6800/1725006999,v1:172.21.15.39:6801/1725006999] conn(0x7f0c080a2b80 0x7f0c080a5040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:37:43.229 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:37:43.224+0000 7f0c1e000640 1 -- 172.21.15.39:0/4253472291 <== mon.1 v2:172.21.15.172:3300/0 5 ==== osd_map(95..95 src has 1..95) ==== 9129+0+0 (secure 0 0 0) 0x7f0c140cf7b0 con 0x7f0c20103ff0 2024-09-12T02:37:43.229 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:37:43.224+0000 7f0c26600640 1 --2- 172.21.15.39:0/4253472291 >> [v2:172.21.15.39:6800/1725006999,v1:172.21.15.39:6801/1725006999] conn(0x7f0c080a2b80 0x7f0c080a5040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:37:43.229 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:37:43.224+0000 7f0c2b267740 1 -- 172.21.15.39:0/3548870437 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x56507540ac50 msgr2=0x565075414fd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:37:43.229 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:37:43.224+0000 7f0c2b267740 1 --2- 172.21.15.39:0/3548870437 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x56507540ac50 0x565075414fd0 secure :-1 s=READY pgs=120 cs=0 l=1 rev1=1 crypto rx=0x7f0c140d5c20 tx=0x7f0c140d7670 comp rx=0 tx=0).stop 2024-09-12T02:37:43.229 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:37:43.224+0000 7f0c2b267740 1 -- 172.21.15.39:0/3548870437 shutdown_connections 2024-09-12T02:37:43.229 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:37:43.224+0000 7f0c2b267740 1 --2- 172.21.15.39:0/3548870437 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x565075415510 0x565075417900 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:37:43.229 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:37:43.224+0000 7f0c2b267740 1 --2- 172.21.15.39:0/3548870437 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x56507540ac50 0x565075414fd0 unknown :-1 s=CLOSED pgs=120 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:37:43.229 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:37:43.224+0000 7f0c2b267740 1 --2- 172.21.15.39:0/3548870437 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x56507540a330 0x56507540a710 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:37:43.229 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:37:43.224+0000 7f0c2b267740 1 -- 172.21.15.39:0/3548870437 >> 172.21.15.39:0/3548870437 conn(0x5650754068c0 msgr2=0x565075406ca0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:37:43.230 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:37:43.225+0000 7f0c2b267740 1 -- 172.21.15.39:0/3548870437 shutdown_connections 2024-09-12T02:37:43.230 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:37:43.225+0000 7f0c2b267740 1 -- 172.21.15.39:0/3548870437 wait complete. 2024-09-12T02:37:43.230 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:37:43.225+0000 7f0c26600640 1 --2- 172.21.15.39:0/4253472291 >> [v2:172.21.15.39:6800/1725006999,v1:172.21.15.39:6801/1725006999] conn(0x7f0c080a2b80 0x7f0c080a5040 secure :-1 s=READY pgs=227 cs=0 l=1 rev1=1 crypto rx=0x7f0c18005fd0 tx=0x7f0c18009500 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:37:43.230 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:37:43.225+0000 7f0c2b267740 1 -- start start 2024-09-12T02:37:43.230 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:37:43.225+0000 7f0c2b267740 1 Processor -- start 2024-09-12T02:37:43.230 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:37:43.226+0000 7f0c2b267740 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x56507540a330 0x5650754125e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:37:43.230 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:37:43.226+0000 7f0c2b267740 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x56507540ac50 0x565075412b20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:37:43.230 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:37:43.226+0000 7f0c2b267740 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x565075415510 0x565075413060 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:37:43.230 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:37:43.226+0000 7f0c2b267740 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 -- 0x565075418060 con 0x56507540a330 2024-09-12T02:37:43.230 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:37:43.226+0000 7f0c2b267740 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x5650752f8920 con 0x565075415510 2024-09-12T02:37:43.230 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:37:43.226+0000 7f0c2b267740 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x5650754181e0 con 0x56507540ac50 2024-09-12T02:37:43.230 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:37:43.226+0000 7f0c2b267740 10 client.0 _ll_register_callbacks cb 0x56507531c8a0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-12T02:37:43.230 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:37:43.226+0000 7f0c25c00640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x56507540a330 0x5650754125e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:37:43.231 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:37:43.226+0000 7f0c25200640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x56507540ac50 0x565075412b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:37:43.231 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:37:43.226+0000 7f0c25200640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x56507540ac50 0x565075412b20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.172:3300/0 says I am v2:172.21.15.39:56472/0 (socket says 172.21.15.39:56472) 2024-09-12T02:37:43.231 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:37:43.226+0000 7f0c25200640 1 -- 172.21.15.39:0/1423135637 learned_addr learned my addr 172.21.15.39:0/1423135637 (peer_addr_for_me v2:172.21.15.39:0/0) 2024-09-12T02:37:43.231 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:37:43.226+0000 7f0c25c00640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x56507540a330 0x5650754125e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.39:3300/0 says I am v2:172.21.15.39:55842/0 (socket says 172.21.15.39:55842) 2024-09-12T02:37:43.231 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:37:43.226+0000 7f0c26600640 1 --2- 172.21.15.39:0/1423135637 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x565075415510 0x565075413060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:37:43.231 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:37:43.227+0000 7f0c25200640 1 -- 172.21.15.39:0/1423135637 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x565075415510 msgr2=0x565075413060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:37:43.231 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:37:43.227+0000 7f0c25200640 1 --2- 172.21.15.39:0/1423135637 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x565075415510 0x565075413060 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:37:43.231 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:37:43.227+0000 7f0c25200640 1 -- 172.21.15.39:0/1423135637 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x56507540a330 msgr2=0x5650754125e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:37:43.231 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:37:43.227+0000 7f0c25200640 1 --2- 172.21.15.39:0/1423135637 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x56507540a330 0x5650754125e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:37:43.231 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:37:43.227+0000 7f0c25200640 1 -- 172.21.15.39:0/1423135637 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5650750e12b0 con 0x56507540ac50 2024-09-12T02:37:43.231 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:37:43.227+0000 7f0c25200640 1 --2- 172.21.15.39:0/1423135637 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x56507540ac50 0x565075412b20 secure :-1 s=READY pgs=109 cs=0 l=1 rev1=1 crypto rx=0x7f0c0c02aa00 tx=0x7f0c0c0042e0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=916dc12ab394f680 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:37:43.231 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:37:43.227+0000 7f0c07400640 10 client.0 ms_handle_connect on v2:172.21.15.172:3300/0 2024-09-12T02:37:43.232 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:37:43.227+0000 7f0c07400640 1 -- 172.21.15.39:0/1423135637 <== mon.1 v2:172.21.15.172:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0c0c035040 con 0x56507540ac50 2024-09-12T02:37:43.232 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:37:43.227+0000 7f0c2b267740 1 -- 172.21.15.39:0/1423135637 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f0c140cfda0 con 0x56507540ac50 2024-09-12T02:37:43.232 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:37:43.227+0000 7f0c07400640 1 -- 172.21.15.39:0/1423135637 <== mon.1 v2:172.21.15.172:3300/0 2 ==== osd_map(95..95 src has 1..95) ==== 9129+0+0 (secure 0 0 0) 0x7f0c0c005220 con 0x56507540ac50 2024-09-12T02:37:43.232 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:37:43.227+0000 7f0c07400640 1 -- 172.21.15.39:0/1423135637 <== mon.1 v2:172.21.15.172:3300/0 3 ==== mon_get_version_reply(handle=1 version=28) ==== 24+0+0 (secure 0 0 0) 0x7f0c0c04e050 con 0x56507540ac50 2024-09-12T02:37:43.232 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:37:43.227+0000 7f0c2b267740 10 client.25141 fetch_fsmap learned FSMap version 28 2024-09-12T02:37:43.232 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:37:43.228+0000 7f0c2b267740 1 -- 172.21.15.39:0/1423135637 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({config=0+,fsmap=28,monmap=4+}) -- 0x565075423ed0 con 0x56507540ac50 2024-09-12T02:37:43.232 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:37:43.228+0000 7f0c07400640 1 -- 172.21.15.39:0/1423135637 <== mon.1 v2:172.21.15.172:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f0c140cfda0 con 0x56507540ac50 2024-09-12T02:37:43.233 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:37:43.228+0000 7f0c07400640 1 -- 172.21.15.39:0/1423135637 <== mon.1 v2:172.21.15.172:3300/0 5 ==== fsmap(e 28) ==== 8370+0+0 (secure 0 0 0) 0x7f0c0c003780 con 0x56507540ac50 2024-09-12T02:37:43.234 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:37:43.228+0000 7f0c2b267740 10 client.25141 fetch_fsmap finished waiting for FSMap version 28 2024-09-12T02:37:43.234 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:37:43.228+0000 7f0c2b267740 10 client.25141 resolve_mds: resolved name 'c' to daemon mds.c 2024-09-12T02:37:43.234 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:37:43.228+0000 7f0c2b267740 20 client.25141 populate_metadata read hostname 'smithi039' 2024-09-12T02:37:43.234 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:37:43.228+0000 7f0c2b267740 1 --2- 172.21.15.39:0/1423135637 >> [v2:172.21.15.172:6836/493506747,v1:172.21.15.172:6837/493506747] conn(0x565075426510 0x565075427980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:37:43.234 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:37:43.228+0000 7f0c2b267740 4 client.25141 mds_command: new command op to 24484 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-12T02:37:43.234 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:37:43.228+0000 7f0c2b267740 1 -- 172.21.15.39:0/1423135637 --> [v2:172.21.15.172:6836/493506747,v1:172.21.15.172:6837/493506747] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x56507537d620 con 0x565075426510 2024-09-12T02:37:43.234 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:37:43.229+0000 7f0c25c00640 1 --2- 172.21.15.39:0/1423135637 >> [v2:172.21.15.172:6836/493506747,v1:172.21.15.172:6837/493506747] conn(0x565075426510 0x565075427980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:37:43.234 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:37:43.229+0000 7f0c25c00640 1 --2- 172.21.15.39:0/1423135637 >> [v2:172.21.15.172:6836/493506747,v1:172.21.15.172:6837/493506747] conn(0x565075426510 0x565075427980 crc :-1 s=READY pgs=18 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.2 client_cookie=5b3bf4a30d85844c server_cookie=4206d813168d78d1 in_seq=0 out_seq=0 2024-09-12T02:37:43.234 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:37:43.229+0000 7f0c07400640 10 client.25141 ms_handle_connect on v2:172.21.15.172:6836/493506747 2024-09-12T02:37:43.234 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:37:43.230+0000 7f0c07400640 1 -- 172.21.15.39:0/1423135637 <== mds.2 v2:172.21.15.172:6836/493506747 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x56507537d620 con 0x565075426510 2024-09-12T02:37:43.234 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:37:43.230+0000 7f0c07400640 10 client.25141 handle_command_reply: tid=0 2024-09-12T02:37:43.234 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:37:43.230+0000 7f0c2b267740 1 client.25141 shutdown 2024-09-12T02:37:43.234 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:37:43.230+0000 7f0c2b267740 1 -- 172.21.15.39:0/1423135637 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x56507540ac50 msgr2=0x565075412b20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:37:43.235 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:37:43.230+0000 7f0c2b267740 1 --2- 172.21.15.39:0/1423135637 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x56507540ac50 0x565075412b20 secure :-1 s=READY pgs=109 cs=0 l=1 rev1=1 crypto rx=0x7f0c0c02aa00 tx=0x7f0c0c0042e0 comp rx=0 tx=0).stop 2024-09-12T02:37:43.235 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:37:43.230+0000 7f0c2b267740 1 -- 172.21.15.39:0/1423135637 shutdown_connections 2024-09-12T02:37:43.235 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:37:43.230+0000 7f0c2b267740 1 --2- 172.21.15.39:0/1423135637 >> [v2:172.21.15.172:6836/493506747,v1:172.21.15.172:6837/493506747] conn(0x565075426510 0x565075427980 crc :-1 s=READY pgs=18 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:37:43.235 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:37:43.230+0000 7f0c2b267740 1 --2- 172.21.15.39:0/1423135637 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x565075415510 0x565075413060 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:37:43.235 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:37:43.230+0000 7f0c2b267740 1 --2- 172.21.15.39:0/1423135637 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x56507540ac50 0x565075412b20 unknown :-1 s=CLOSED pgs=109 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:37:43.235 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:37:43.230+0000 7f0c2b267740 1 --2- 172.21.15.39:0/1423135637 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x56507540a330 0x5650754125e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:37:43.235 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:37:43.230+0000 7f0c07400640 0 client.25141 ms_handle_reset on v2:172.21.15.172:6836/493506747 2024-09-12T02:37:43.235 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:37:43.230+0000 7f0c2b267740 1 -- 172.21.15.39:0/1423135637 >> 172.21.15.39:0/1423135637 conn(0x5650754068c0 msgr2=0x56507540c5a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:37:43.235 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:37:43.231+0000 7f0c2b267740 1 -- 172.21.15.39:0/1423135637 shutdown_connections 2024-09-12T02:37:43.235 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:37:43.231+0000 7f0c2b267740 1 -- 172.21.15.39:0/1423135637 wait complete. 2024-09-12T02:37:43.235 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:37:43.231+0000 7f0c2b267740 20 client.25141 trim_cache size 0 max 16384 2024-09-12T02:37:43.251 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:37:43.249+0000 7f0c2b267740 1 Processor -- start 2024-09-12T02:37:43.251 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:37:43.249+0000 7f0c2b267740 1 -- start start 2024-09-12T02:37:43.251 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:37:43.250+0000 7f0c2b267740 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x56507540a330 0x56507540cd90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:37:43.251 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:37:43.250+0000 7f0c2b267740 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x56507540ac50 0x56507540f860 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:37:43.251 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:37:43.250+0000 7f0c2b267740 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x565075415510 0x56507540fda0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:37:43.251 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:37:43.250+0000 7f0c2b267740 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 -- 0x565075425cc0 con 0x56507540ac50 2024-09-12T02:37:43.251 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:37:43.250+0000 7f0c2b267740 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x565075426390 con 0x565075415510 2024-09-12T02:37:43.251 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:37:43.250+0000 7f0c2b267740 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x565075426a60 con 0x56507540a330 2024-09-12T02:37:43.251 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:37:43.250+0000 7f0c25200640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x56507540ac50 0x56507540f860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:37:43.252 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:37:43.250+0000 7f0c25200640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x56507540ac50 0x56507540f860 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.39:3300/0 says I am v2:172.21.15.39:55858/0 (socket says 172.21.15.39:55858) 2024-09-12T02:37:43.252 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:37:43.250+0000 7f0c25200640 1 -- 172.21.15.39:0/501183172 learned_addr learned my addr 172.21.15.39:0/501183172 (peer_addr_for_me v2:172.21.15.39:0/0) 2024-09-12T02:37:43.252 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:37:43.250+0000 7f0c25c00640 1 --2- 172.21.15.39:0/501183172 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x56507540a330 0x56507540cd90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:37:43.252 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:37:43.250+0000 7f0c26600640 1 --2- 172.21.15.39:0/501183172 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x565075415510 0x56507540fda0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:37:43.255 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:37:43.250+0000 7f0c25200640 1 -- 172.21.15.39:0/501183172 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x56507540a330 msgr2=0x56507540cd90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:37:43.255 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:37:43.250+0000 7f0c25200640 1 --2- 172.21.15.39:0/501183172 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x56507540a330 0x56507540cd90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:37:43.255 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:37:43.250+0000 7f0c25200640 1 -- 172.21.15.39:0/501183172 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x565075415510 msgr2=0x56507540fda0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:37:43.255 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:37:43.250+0000 7f0c25200640 1 --2- 172.21.15.39:0/501183172 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x565075415510 0x56507540fda0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:37:43.255 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:37:43.251+0000 7f0c25200640 1 -- 172.21.15.39:0/501183172 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x565075427cb0 con 0x56507540ac50 2024-09-12T02:37:43.255 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:37:43.251+0000 7f0c26600640 1 --2- 172.21.15.39:0/501183172 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x565075415510 0x56507540fda0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-12T02:37:43.255 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:37:43.251+0000 7f0c25200640 1 --2- 172.21.15.39:0/501183172 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x56507540ac50 0x56507540f860 secure :-1 s=READY pgs=268 cs=0 l=1 rev1=1 crypto rx=0x7f0c0c003cf0 tx=0x7f0c0c003f40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e06e35eb45768f46 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:37:43.256 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:37:43.251+0000 7f0c12000640 1 -- 172.21.15.39:0/501183172 <== mon.0 v2:172.21.15.39:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0c0c057070 con 0x56507540ac50 2024-09-12T02:37:43.256 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:37:43.251+0000 7f0c12000640 1 -- 172.21.15.39:0/501183172 <== mon.0 v2:172.21.15.39:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f0c0c005030 con 0x56507540ac50 2024-09-12T02:37:43.256 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:37:43.251+0000 7f0c12000640 1 -- 172.21.15.39:0/501183172 <== mon.0 v2:172.21.15.39:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0c0c035030 con 0x56507540ac50 2024-09-12T02:37:43.256 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:37:43.252+0000 7f0c2b267740 1 -- 172.21.15.39:0/501183172 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x56507540ac50 msgr2=0x56507540f860 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:37:43.256 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:37:43.252+0000 7f0c2b267740 1 --2- 172.21.15.39:0/501183172 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x56507540ac50 0x56507540f860 secure :-1 s=READY pgs=268 cs=0 l=1 rev1=1 crypto rx=0x7f0c0c003cf0 tx=0x7f0c0c003f40 comp rx=0 tx=0).stop 2024-09-12T02:37:43.256 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:37:43.252+0000 7f0c2b267740 1 -- 172.21.15.39:0/501183172 shutdown_connections 2024-09-12T02:37:43.256 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:37:43.252+0000 7f0c2b267740 1 --2- 172.21.15.39:0/501183172 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x565075415510 0x56507540fda0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:37:43.256 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:37:43.252+0000 7f0c2b267740 1 --2- 172.21.15.39:0/501183172 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x56507540ac50 0x56507540f860 unknown :-1 s=CLOSED pgs=268 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:37:43.256 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:37:43.252+0000 7f0c2b267740 1 --2- 172.21.15.39:0/501183172 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x56507540a330 0x56507540cd90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:37:43.256 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:37:43.252+0000 7f0c2b267740 1 -- 172.21.15.39:0/501183172 >> 172.21.15.39:0/501183172 conn(0x5650754068c0 msgr2=0x56507540d9d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:37:43.256 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:37:43.252+0000 7f0c2b267740 1 -- 172.21.15.39:0/501183172 shutdown_connections 2024-09-12T02:37:43.256 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:37:43.252+0000 7f0c2b267740 1 -- 172.21.15.39:0/501183172 wait complete. 2024-09-12T02:37:43.257 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:37:43.252+0000 7f0c2b267740 1 -- start start 2024-09-12T02:37:43.257 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:37:43.252+0000 7f0c2b267740 1 Processor -- start 2024-09-12T02:37:43.257 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:37:43.253+0000 7f0c2b267740 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x56507540a330 0x565075430470 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:37:43.257 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:37:43.253+0000 7f0c2b267740 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x56507540ac50 0x56507540f470 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:37:43.257 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:37:43.253+0000 7f0c2b267740 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x565075415510 0x56507540fa60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:37:43.257 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:37:43.253+0000 7f0c2b267740 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 -- 0x565075427800 con 0x56507540a330 2024-09-12T02:37:43.257 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:37:43.253+0000 7f0c2b267740 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x565075427130 con 0x56507540ac50 2024-09-12T02:37:43.257 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:37:43.253+0000 7f0c2b267740 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x565075427ed0 con 0x565075415510 2024-09-12T02:37:43.257 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:37:43.253+0000 7f0c2b267740 10 client.0 _ll_register_callbacks cb 0x7f0c0c005dc0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-12T02:37:43.257 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:37:43.253+0000 7f0c25c00640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x56507540a330 0x565075430470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:37:43.257 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:37:43.253+0000 7f0c25c00640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x56507540a330 0x565075430470 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.39:3300/0 says I am v2:172.21.15.39:55870/0 (socket says 172.21.15.39:55870) 2024-09-12T02:37:43.258 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:37:43.253+0000 7f0c25c00640 1 -- 172.21.15.39:0/3391551529 learned_addr learned my addr 172.21.15.39:0/3391551529 (peer_addr_for_me v2:172.21.15.39:0/0) 2024-09-12T02:37:43.258 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:37:43.253+0000 7f0c25200640 1 --2- 172.21.15.39:0/3391551529 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x56507540ac50 0x56507540f470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:37:43.258 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:37:43.253+0000 7f0c26600640 1 --2- 172.21.15.39:0/3391551529 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x565075415510 0x56507540fa60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:37:43.258 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:37:43.254+0000 7f0c25c00640 1 -- 172.21.15.39:0/3391551529 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x565075415510 msgr2=0x56507540fa60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:37:43.258 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:37:43.254+0000 7f0c25c00640 1 --2- 172.21.15.39:0/3391551529 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x565075415510 0x56507540fa60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:37:43.258 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:37:43.254+0000 7f0c25c00640 1 -- 172.21.15.39:0/3391551529 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x56507540ac50 msgr2=0x56507540f470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:37:43.258 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:37:43.254+0000 7f0c25c00640 1 --2- 172.21.15.39:0/3391551529 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x56507540ac50 0x56507540f470 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:37:43.258 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:37:43.254+0000 7f0c25c00640 1 -- 172.21.15.39:0/3391551529 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({osdmap=0}) -- 0x565075410260 con 0x56507540a330 2024-09-12T02:37:43.258 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:37:43.254+0000 7f0c25c00640 1 --2- 172.21.15.39:0/3391551529 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x56507540a330 0x565075430470 secure :-1 s=READY pgs=269 cs=0 l=1 rev1=1 crypto rx=0x7f0c1409b9e0 tx=0x7f0c140d1a50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8733f00c28dbddb2 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:37:43.258 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:37:43.254+0000 7f0c07400640 10 client.0 ms_handle_connect on v2:172.21.15.39:3300/0 2024-09-12T02:37:43.258 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:37:43.254+0000 7f0c07400640 1 -- 172.21.15.39:0/3391551529 <== mon.0 v2:172.21.15.39:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0c140de040 con 0x56507540a330 2024-09-12T02:37:43.258 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:37:43.254+0000 7f0c07400640 1 -- 172.21.15.39:0/3391551529 <== mon.0 v2:172.21.15.39:3300/0 2 ==== osd_map(95..95 src has 1..95) ==== 9129+0+0 (secure 0 0 0) 0x7f0c14099fe0 con 0x56507540a330 2024-09-12T02:37:43.259 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:37:43.254+0000 7f0c2b267740 1 -- 172.21.15.39:0/3391551529 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f0c0c005030 con 0x56507540a330 2024-09-12T02:37:43.260 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:37:43.255+0000 7f0c07400640 1 -- 172.21.15.39:0/3391551529 <== mon.0 v2:172.21.15.39:3300/0 3 ==== mon_get_version_reply(handle=1 version=28) ==== 24+0+0 (secure 0 0 0) 0x7f0c14097f80 con 0x56507540a330 2024-09-12T02:37:43.260 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:37:43.255+0000 7f0c2b267740 10 client.15159 fetch_fsmap learned FSMap version 28 2024-09-12T02:37:43.260 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:37:43.255+0000 7f0c2b267740 1 -- 172.21.15.39:0/3391551529 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({config=0+,fsmap=28,monmap=4+}) -- 0x565075490ce0 con 0x56507540a330 2024-09-12T02:37:43.260 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:37:43.255+0000 7f0c07400640 1 -- 172.21.15.39:0/3391551529 <== mon.0 v2:172.21.15.39:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f0c0c005030 con 0x56507540a330 2024-09-12T02:37:43.261 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:37:43.255+0000 7f0c07400640 1 -- 172.21.15.39:0/3391551529 <== mon.0 v2:172.21.15.39:3300/0 5 ==== fsmap(e 28) ==== 8370+0+0 (secure 0 0 0) 0x7f0c140ccf50 con 0x56507540a330 2024-09-12T02:37:43.261 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:37:43.255+0000 7f0c2b267740 10 client.15159 fetch_fsmap finished waiting for FSMap version 28 2024-09-12T02:37:43.261 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:37:43.255+0000 7f0c2b267740 10 client.15159 resolve_mds: resolved name 'c' to daemon mds.c 2024-09-12T02:37:43.261 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:37:43.255+0000 7f0c2b267740 20 client.15159 populate_metadata read hostname 'smithi039' 2024-09-12T02:37:43.261 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:37:43.255+0000 7f0c2b267740 1 --2- 172.21.15.39:0/3391551529 >> [v2:172.21.15.172:6836/493506747,v1:172.21.15.172:6837/493506747] conn(0x565075495370 0x565075494080 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:37:43.261 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:37:43.255+0000 7f0c2b267740 4 client.15159 mds_command: new command op to 24484 tid=0 multi_id=0 [{"prefix": "status"}] 2024-09-12T02:37:43.261 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:37:43.255+0000 7f0c2b267740 1 -- 172.21.15.39:0/3391551529 --> [v2:172.21.15.172:6836/493506747,v1:172.21.15.172:6837/493506747] -- command(tid 0: {"prefix": "status"}) -- 0x565075377b30 con 0x565075495370 2024-09-12T02:37:43.261 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:37:43.256+0000 7f0c25200640 1 --2- 172.21.15.39:0/3391551529 >> [v2:172.21.15.172:6836/493506747,v1:172.21.15.172:6837/493506747] conn(0x565075495370 0x565075494080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:37:43.261 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:37:43.256+0000 7f0c25200640 1 --2- 172.21.15.39:0/3391551529 >> [v2:172.21.15.172:6836/493506747,v1:172.21.15.172:6837/493506747] conn(0x565075495370 0x565075494080 crc :-1 s=READY pgs=19 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.2 client_cookie=6556063a500f2af4 server_cookie=d9e226c8353b3f71 in_seq=0 out_seq=0 2024-09-12T02:37:43.261 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:37:43.256+0000 7f0c07400640 10 client.15159 ms_handle_connect on v2:172.21.15.172:6836/493506747 2024-09-12T02:37:43.261 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:37:43.256+0000 7f0c07400640 1 -- 172.21.15.39:0/3391551529 <== mds.2 v2:172.21.15.172:6836/493506747 1 ==== command_reply(tid 0: 0 ) ==== 8+0+327 (crc 0 0 0) 0x565075377b30 con 0x565075495370 2024-09-12T02:37:43.261 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:37:43.256+0000 7f0c07400640 10 client.15159 handle_command_reply: tid=0 2024-09-12T02:37:43.261 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:37:43.256+0000 7f0c2b267740 1 client.15159 shutdown 2024-09-12T02:37:43.261 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:37:43.257+0000 7f0c2b267740 1 -- 172.21.15.39:0/3391551529 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x56507540a330 msgr2=0x565075430470 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:37:43.262 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:37:43.257+0000 7f0c2b267740 1 --2- 172.21.15.39:0/3391551529 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x56507540a330 0x565075430470 secure :-1 s=READY pgs=269 cs=0 l=1 rev1=1 crypto rx=0x7f0c1409b9e0 tx=0x7f0c140d1a50 comp rx=0 tx=0).stop 2024-09-12T02:37:43.262 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:37:43.257+0000 7f0c2b267740 1 -- 172.21.15.39:0/3391551529 shutdown_connections 2024-09-12T02:37:43.262 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:37:43.257+0000 7f0c2b267740 1 --2- 172.21.15.39:0/3391551529 >> [v2:172.21.15.172:6836/493506747,v1:172.21.15.172:6837/493506747] conn(0x565075495370 0x565075494080 crc :-1 s=READY pgs=19 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:37:43.262 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:37:43.257+0000 7f0c2b267740 1 --2- 172.21.15.39:0/3391551529 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x565075415510 0x56507540fa60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:37:43.262 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:37:43.257+0000 7f0c2b267740 1 --2- 172.21.15.39:0/3391551529 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x56507540ac50 0x56507540f470 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:37:43.262 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:37:43.257+0000 7f0c2b267740 1 --2- 172.21.15.39:0/3391551529 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x56507540a330 0x565075430470 unknown :-1 s=CLOSED pgs=269 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:37:43.262 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:37:43.257+0000 7f0c2b267740 1 -- 172.21.15.39:0/3391551529 >> 172.21.15.39:0/3391551529 conn(0x5650754068c0 msgr2=0x565075410eb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:37:43.262 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:37:43.257+0000 7f0c07400640 0 client.15159 ms_handle_reset on v2:172.21.15.172:6836/493506747 2024-09-12T02:37:43.262 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:37:43.257+0000 7f0c2b267740 1 -- 172.21.15.39:0/3391551529 shutdown_connections 2024-09-12T02:37:43.262 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:37:43.257+0000 7f0c2b267740 1 -- 172.21.15.39:0/3391551529 wait complete. 2024-09-12T02:37:43.262 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:37:43.257+0000 7f0c2b267740 20 client.15159 trim_cache size 0 max 16384 2024-09-12T02:37:43.263 INFO:teuthology.orchestra.run.smithi039.stdout:{ 2024-09-12T02:37:43.263 INFO:teuthology.orchestra.run.smithi039.stdout: "cluster_fsid": "4954ed46-70ae-11ef-bcea-c7b262605968", 2024-09-12T02:37:43.263 INFO:teuthology.orchestra.run.smithi039.stdout: "whoami": 2, 2024-09-12T02:37:43.263 INFO:teuthology.orchestra.run.smithi039.stdout: "id": 24484, 2024-09-12T02:37:43.263 INFO:teuthology.orchestra.run.smithi039.stdout: "want_state": "up:active", 2024-09-12T02:37:43.263 INFO:teuthology.orchestra.run.smithi039.stdout: "state": "up:active", 2024-09-12T02:37:43.263 INFO:teuthology.orchestra.run.smithi039.stdout: "fs_name": "cephfs", 2024-09-12T02:37:43.263 INFO:teuthology.orchestra.run.smithi039.stdout: "rank_uptime": 113.49647662700001, 2024-09-12T02:37:43.263 INFO:teuthology.orchestra.run.smithi039.stdout: "mdsmap_epoch": 28, 2024-09-12T02:37:43.263 INFO:teuthology.orchestra.run.smithi039.stdout: "osdmap_epoch": 95, 2024-09-12T02:37:43.263 INFO:teuthology.orchestra.run.smithi039.stdout: "osdmap_epoch_barrier": 93, 2024-09-12T02:37:43.263 INFO:teuthology.orchestra.run.smithi039.stdout: "uptime": 186.782924165 2024-09-12T02:37:43.263 INFO:teuthology.orchestra.run.smithi039.stdout:} 2024-09-12T02:37:43.264 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:37:43.258+0000 7f0c28600640 1 -- 172.21.15.39:0/4253472291 >> [v2:172.21.15.39:6800/1725006999,v1:172.21.15.39:6801/1725006999] conn(0x7f0c080a2b80 msgr2=0x7f0c080a5040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:37:43.264 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:37:43.258+0000 7f0c28600640 1 --2- 172.21.15.39:0/4253472291 >> [v2:172.21.15.39:6800/1725006999,v1:172.21.15.39:6801/1725006999] conn(0x7f0c080a2b80 0x7f0c080a5040 secure :-1 s=READY pgs=227 cs=0 l=1 rev1=1 crypto rx=0x7f0c18005fd0 tx=0x7f0c18009500 comp rx=0 tx=0).stop 2024-09-12T02:37:43.264 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:37:43.258+0000 7f0c28600640 1 -- 172.21.15.39:0/4253472291 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f0c20103ff0 msgr2=0x7f0c2019a670 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:37:43.264 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:37:43.258+0000 7f0c28600640 1 --2- 172.21.15.39:0/4253472291 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f0c20103ff0 0x7f0c2019a670 secure :-1 s=READY pgs=108 cs=0 l=1 rev1=1 crypto rx=0x7f0c1400e9f0 tx=0x7f0c1400eeb0 comp rx=0 tx=0).stop 2024-09-12T02:37:43.264 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:37:43.258+0000 7f0c28600640 1 -- 172.21.15.39:0/4253472291 shutdown_connections 2024-09-12T02:37:43.264 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:37:43.258+0000 7f0c28600640 1 --2- 172.21.15.39:0/4253472291 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f0c20109120 0x7f0c2019ef40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:37:43.264 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:37:43.258+0000 7f0c28600640 1 --2- 172.21.15.39:0/4253472291 >> [v2:172.21.15.39:6800/1725006999,v1:172.21.15.39:6801/1725006999] conn(0x7f0c080a2b80 0x7f0c080a5040 unknown :-1 s=CLOSED pgs=227 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:37:43.265 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:37:43.258+0000 7f0c28600640 1 --2- 172.21.15.39:0/4253472291 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f0c201049a0 0x7f0c2019abb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:37:43.265 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:37:43.258+0000 7f0c28600640 1 --2- 172.21.15.39:0/4253472291 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f0c20103ff0 0x7f0c2019a670 unknown :-1 s=CLOSED pgs=108 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:37:43.265 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:37:43.258+0000 7f0c28600640 1 -- 172.21.15.39:0/4253472291 >> 172.21.15.39:0/4253472291 conn(0x7f0c200ffa90 msgr2=0x7f0c20100d20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:37:43.265 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:37:43.258+0000 7f0c28600640 1 -- 172.21.15.39:0/4253472291 shutdown_connections 2024-09-12T02:37:43.265 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:37:43.258+0000 7f0c28600640 1 -- 172.21.15.39:0/4253472291 wait complete. 2024-09-12T02:37:44.219 DEBUG:teuthology.orchestra.run.smithi039:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc shell --fsid 4954ed46-70ae-11ef-bcea-c7b262605968 -- ceph tell mds.i status 2024-09-12T02:37:44.588 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 02:37:44 smithi039 ceph-mon[30515]: pgmap v384: 129 pgs: 129 active+clean; 646 KiB data, 348 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2024-09-12T02:37:44.599 INFO:teuthology.orchestra.run.smithi039.stderr:Inferring config /var/lib/ceph/4954ed46-70ae-11ef-bcea-c7b262605968/mon.a/config 2024-09-12T02:37:44.948 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 12 02:37:44 smithi044 ceph-mon[35411]: pgmap v384: 129 pgs: 129 active+clean; 646 KiB data, 348 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2024-09-12T02:37:45.013 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 12 02:37:44 smithi172 ceph-mon[35609]: pgmap v384: 129 pgs: 129 active+clean; 646 KiB data, 348 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2024-09-12T02:37:45.237 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:37:45.207+0000 7f550ac00640 1 -- 172.21.15.39:0/4259047993 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f5504112b90 msgr2=0x7f5504114f80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:37:45.237 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:37:45.207+0000 7f550ac00640 1 --2- 172.21.15.39:0/4259047993 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f5504112b90 0x7f5504114f80 secure :-1 s=READY pgs=270 cs=0 l=1 rev1=1 crypto rx=0x7f54fc009ca0 tx=0x7f54fc02a950 comp rx=0 tx=0).stop 2024-09-12T02:37:45.238 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:37:45.208+0000 7f550ac00640 1 -- 172.21.15.39:0/4259047993 shutdown_connections 2024-09-12T02:37:45.238 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:37:45.208+0000 7f550ac00640 1 --2- 172.21.15.39:0/4259047993 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f5504112b90 0x7f5504114f80 unknown :-1 s=CLOSED pgs=270 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:37:45.238 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:37:45.208+0000 7f550ac00640 1 --2- 172.21.15.39:0/4259047993 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f5504074eb0 0x7f5504112650 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:37:45.238 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:37:45.208+0000 7f550ac00640 1 --2- 172.21.15.39:0/4259047993 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f5504074590 0x7f5504074970 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:37:45.238 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:37:45.208+0000 7f550ac00640 1 -- 172.21.15.39:0/4259047993 >> 172.21.15.39:0/4259047993 conn(0x7f55040fd8c0 msgr2=0x7f55040ffce0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:37:45.238 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:37:45.208+0000 7f550ac00640 1 -- 172.21.15.39:0/4259047993 shutdown_connections 2024-09-12T02:37:45.238 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:37:45.208+0000 7f550ac00640 1 -- 172.21.15.39:0/4259047993 wait complete. 2024-09-12T02:37:45.238 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:37:45.209+0000 7f550ac00640 1 Processor -- start 2024-09-12T02:37:45.238 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:37:45.209+0000 7f550ac00640 1 -- start start 2024-09-12T02:37:45.238 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:37:45.209+0000 7f550ac00640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f5504074590 0x7f55041a46f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:37:45.238 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:37:45.209+0000 7f550ac00640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f5504074eb0 0x7f55041a4c30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:37:45.238 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:37:45.209+0000 7f550ac00640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f5504112b90 0x7f550419e8b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:37:45.238 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:37:45.209+0000 7f550ac00640 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 -- 0x7f55041185c0 con 0x7f5504074eb0 2024-09-12T02:37:45.239 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:37:45.209+0000 7f550ac00640 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x7f5504118440 con 0x7f5504112b90 2024-09-12T02:37:45.239 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:37:45.209+0000 7f550ac00640 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7f5504118740 con 0x7f5504074590 2024-09-12T02:37:45.239 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:37:45.209+0000 7f5503400640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f5504074eb0 0x7f55041a4c30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:37:45.239 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:37:45.209+0000 7f5503400640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f5504074eb0 0x7f55041a4c30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.39:3300/0 says I am v2:172.21.15.39:55884/0 (socket says 172.21.15.39:55884) 2024-09-12T02:37:45.239 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:37:45.209+0000 7f5503400640 1 -- 172.21.15.39:0/4187661928 learned_addr learned my addr 172.21.15.39:0/4187661928 (peer_addr_for_me v2:172.21.15.39:0/0) 2024-09-12T02:37:45.239 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:37:45.209+0000 7f5503e00640 1 --2- 172.21.15.39:0/4187661928 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f5504074590 0x7f55041a46f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:37:45.239 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:37:45.210+0000 7f5508c00640 1 --2- 172.21.15.39:0/4187661928 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f5504112b90 0x7f550419e8b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:37:45.239 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:37:45.210+0000 7f5503400640 1 -- 172.21.15.39:0/4187661928 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f5504074590 msgr2=0x7f55041a46f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:37:45.239 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:37:45.210+0000 7f5503400640 1 --2- 172.21.15.39:0/4187661928 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f5504074590 0x7f55041a46f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:37:45.239 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:37:45.210+0000 7f5503400640 1 -- 172.21.15.39:0/4187661928 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f5504112b90 msgr2=0x7f550419e8b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:37:45.239 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:37:45.210+0000 7f5503400640 1 --2- 172.21.15.39:0/4187661928 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f5504112b90 0x7f550419e8b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:37:45.239 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:37:45.210+0000 7f5503400640 1 -- 172.21.15.39:0/4187661928 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f550419efe0 con 0x7f5504074eb0 2024-09-12T02:37:45.239 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:37:45.210+0000 7f5503400640 1 --2- 172.21.15.39:0/4187661928 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f5504074eb0 0x7f55041a4c30 secure :-1 s=READY pgs=271 cs=0 l=1 rev1=1 crypto rx=0x7f54f000e9f0 tx=0x7f54f000edf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:37:45.240 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:37:45.210+0000 7f5500c00640 1 -- 172.21.15.39:0/4187661928 <== mon.0 v2:172.21.15.39:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f54f000cd80 con 0x7f5504074eb0 2024-09-12T02:37:45.240 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:37:45.210+0000 7f5500c00640 1 -- 172.21.15.39:0/4187661928 <== mon.0 v2:172.21.15.39:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f54f0005500 con 0x7f5504074eb0 2024-09-12T02:37:45.240 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:37:45.210+0000 7f550ac00640 1 -- 172.21.15.39:0/4187661928 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f550419f2d0 con 0x7f5504074eb0 2024-09-12T02:37:45.240 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:37:45.211+0000 7f5500c00640 1 -- 172.21.15.39:0/4187661928 <== mon.0 v2:172.21.15.39:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f54f0010690 con 0x7f5504074eb0 2024-09-12T02:37:45.240 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:37:45.211+0000 7f550ac00640 1 -- 172.21.15.39:0/4187661928 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f55041ab5c0 con 0x7f5504074eb0 2024-09-12T02:37:45.240 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:37:45.214+0000 7f550d66c740 1 Processor -- start 2024-09-12T02:37:45.240 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:37:45.214+0000 7f5500c00640 1 -- 172.21.15.39:0/4187661928 <== mon.0 v2:172.21.15.39:3300/0 4 ==== mgrmap(e 18) ==== 137833+0+0 (secure 0 0 0) 0x7f54f00046c0 con 0x7f5504074eb0 2024-09-12T02:37:45.240 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:37:45.214+0000 7f550d66c740 1 -- start start 2024-09-12T02:37:45.240 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:37:45.214+0000 7f550d66c740 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55e1c4898330 0x55e1c4898710 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:37:45.240 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:37:45.214+0000 7f550d66c740 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55e1c4898c50 0x55e1c48a2fd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:37:45.240 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:37:45.214+0000 7f550d66c740 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55e1c48a3510 0x55e1c48a5900 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:37:45.241 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:37:45.214+0000 7f550d66c740 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 -- 0x55e1c47fe0b0 con 0x55e1c48a3510 2024-09-12T02:37:45.241 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:37:45.214+0000 7f550d66c740 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x55e1c47a5ab0 con 0x55e1c4898330 2024-09-12T02:37:45.241 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:37:45.214+0000 7f550d66c740 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x55e1c47fa070 con 0x55e1c4898c50 2024-09-12T02:37:45.241 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:37:45.214+0000 7f5503400640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55e1c48a3510 0x55e1c48a5900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:37:45.241 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:37:45.215+0000 7f5503400640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55e1c48a3510 0x55e1c48a5900 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.39:3300/0 says I am v2:172.21.15.39:55896/0 (socket says 172.21.15.39:55896) 2024-09-12T02:37:45.241 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:37:45.215+0000 7f5503e00640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55e1c4898c50 0x55e1c48a2fd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:37:45.241 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:37:45.215+0000 7f5503400640 1 -- 172.21.15.39:0/4155329716 learned_addr learned my addr 172.21.15.39:0/4155329716 (peer_addr_for_me v2:172.21.15.39:0/0) 2024-09-12T02:37:45.241 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:37:45.215+0000 7f5508c00640 1 --2- 172.21.15.39:0/4155329716 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55e1c4898330 0x55e1c4898710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:37:45.241 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:37:45.215+0000 7f5508c00640 1 -- 172.21.15.39:0/4155329716 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55e1c4898c50 msgr2=0x55e1c48a2fd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:37:45.241 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:37:45.215+0000 7f5508c00640 1 --2- 172.21.15.39:0/4155329716 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55e1c4898c50 0x55e1c48a2fd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:37:45.241 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:37:45.215+0000 7f5508c00640 1 -- 172.21.15.39:0/4155329716 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55e1c48a3510 msgr2=0x55e1c48a5900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:37:45.241 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:37:45.215+0000 7f5508c00640 1 --2- 172.21.15.39:0/4155329716 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55e1c48a3510 0x55e1c48a5900 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:37:45.241 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:37:45.215+0000 7f5508c00640 1 -- 172.21.15.39:0/4155329716 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55e1c47b24a0 con 0x55e1c4898330 2024-09-12T02:37:45.242 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:37:45.215+0000 7f5503e00640 1 --2- 172.21.15.39:0/4155329716 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55e1c4898c50 0x55e1c48a2fd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-12T02:37:45.242 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:37:45.215+0000 7f5503400640 1 --2- 172.21.15.39:0/4155329716 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55e1c48a3510 0x55e1c48a5900 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-12T02:37:45.242 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:37:45.215+0000 7f5508c00640 1 --2- 172.21.15.39:0/4155329716 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55e1c4898330 0x55e1c4898710 secure :-1 s=READY pgs=121 cs=0 l=1 rev1=1 crypto rx=0x7f54fc02af40 tx=0x7f54fc02f3a0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=97bbdce0fe576339 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:37:45.242 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:37:45.215+0000 7f5500c00640 1 --2- 172.21.15.39:0/4187661928 >> [v2:172.21.15.39:6800/1725006999,v1:172.21.15.39:6801/1725006999] conn(0x7f54e80a2c00 0x7f54e80a50c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:37:45.242 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:37:45.216+0000 7f5500c00640 1 -- 172.21.15.39:0/4187661928 <== mon.0 v2:172.21.15.39:3300/0 5 ==== osd_map(95..95 src has 1..95) ==== 9129+0+0 (secure 0 0 0) 0x7f54f00cf710 con 0x7f5504074eb0 2024-09-12T02:37:45.242 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:37:45.216+0000 7f5503e00640 1 --2- 172.21.15.39:0/4187661928 >> [v2:172.21.15.39:6800/1725006999,v1:172.21.15.39:6801/1725006999] conn(0x7f54e80a2c00 0x7f54e80a50c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:37:45.242 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:37:45.216+0000 7f54f9200640 1 -- 172.21.15.39:0/4155329716 <== mon.2 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f54fc048070 con 0x55e1c4898330 2024-09-12T02:37:45.242 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:37:45.216+0000 7f54f9200640 1 -- 172.21.15.39:0/4155329716 <== mon.2 v2:172.21.15.44:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f54fc003e50 con 0x55e1c4898330 2024-09-12T02:37:45.242 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:37:45.216+0000 7f54f9200640 1 -- 172.21.15.39:0/4155329716 <== mon.2 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f54fc034040 con 0x55e1c4898330 2024-09-12T02:37:45.242 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:37:45.217+0000 7f550d66c740 1 -- 172.21.15.39:0/4155329716 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55e1c4898330 msgr2=0x55e1c4898710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:37:45.242 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:37:45.217+0000 7f5503e00640 1 --2- 172.21.15.39:0/4187661928 >> [v2:172.21.15.39:6800/1725006999,v1:172.21.15.39:6801/1725006999] conn(0x7f54e80a2c00 0x7f54e80a50c0 secure :-1 s=READY pgs=228 cs=0 l=1 rev1=1 crypto rx=0x55e1c4895720 tx=0x7f54f400b410 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:37:45.242 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:37:45.217+0000 7f550d66c740 1 --2- 172.21.15.39:0/4155329716 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55e1c4898330 0x55e1c4898710 secure :-1 s=READY pgs=121 cs=0 l=1 rev1=1 crypto rx=0x7f54fc02af40 tx=0x7f54fc02f3a0 comp rx=0 tx=0).stop 2024-09-12T02:37:45.242 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:37:45.217+0000 7f550d66c740 1 -- 172.21.15.39:0/4155329716 shutdown_connections 2024-09-12T02:37:45.243 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:37:45.217+0000 7f550d66c740 1 --2- 172.21.15.39:0/4155329716 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55e1c48a3510 0x55e1c48a5900 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:37:45.243 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:37:45.217+0000 7f550d66c740 1 --2- 172.21.15.39:0/4155329716 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55e1c4898c50 0x55e1c48a2fd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:37:45.243 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:37:45.217+0000 7f550d66c740 1 --2- 172.21.15.39:0/4155329716 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55e1c4898330 0x55e1c4898710 unknown :-1 s=CLOSED pgs=121 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:37:45.243 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:37:45.217+0000 7f550d66c740 1 -- 172.21.15.39:0/4155329716 >> 172.21.15.39:0/4155329716 conn(0x55e1c48948c0 msgr2=0x55e1c4894ca0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:37:45.243 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:37:45.217+0000 7f550d66c740 1 -- 172.21.15.39:0/4155329716 shutdown_connections 2024-09-12T02:37:45.243 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:37:45.217+0000 7f550d66c740 1 -- 172.21.15.39:0/4155329716 wait complete. 2024-09-12T02:37:45.243 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:37:45.218+0000 7f550d66c740 1 -- start start 2024-09-12T02:37:45.243 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:37:45.218+0000 7f550d66c740 1 Processor -- start 2024-09-12T02:37:45.243 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:37:45.218+0000 7f550d66c740 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55e1c4898330 0x55e1c48a0630 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:37:45.243 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:37:45.218+0000 7f550d66c740 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55e1c4898c50 0x55e1c48a0b70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:37:45.243 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:37:45.218+0000 7f550d66c740 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55e1c48a3510 0x55e1c48a10b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:37:45.243 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:37:45.218+0000 7f550d66c740 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 -- 0x55e1c48a5fc0 con 0x55e1c48a3510 2024-09-12T02:37:45.243 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:37:45.218+0000 7f550d66c740 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x55e1c4786920 con 0x55e1c4898330 2024-09-12T02:37:45.243 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:37:45.218+0000 7f550d66c740 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x55e1c48a6140 con 0x55e1c4898c50 2024-09-12T02:37:45.244 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:37:45.218+0000 7f550d66c740 10 client.0 _ll_register_callbacks cb 0x55e1c47aa8a0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-12T02:37:45.244 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:37:45.219+0000 7f5508c00640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55e1c48a3510 0x55e1c48a10b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:37:45.244 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:37:45.219+0000 7f5503e00640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55e1c4898330 0x55e1c48a0630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:37:45.244 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:37:45.219+0000 7f5508c00640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55e1c48a3510 0x55e1c48a10b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.39:3300/0 says I am v2:172.21.15.39:55912/0 (socket says 172.21.15.39:55912) 2024-09-12T02:37:45.244 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:37:45.219+0000 7f5508c00640 1 -- 172.21.15.39:0/726934265 learned_addr learned my addr 172.21.15.39:0/726934265 (peer_addr_for_me v2:172.21.15.39:0/0) 2024-09-12T02:37:45.244 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:37:45.219+0000 7f5503400640 1 --2- 172.21.15.39:0/726934265 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55e1c4898c50 0x55e1c48a0b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:37:45.244 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:37:45.219+0000 7f5508c00640 1 -- 172.21.15.39:0/726934265 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55e1c4898c50 msgr2=0x55e1c48a0b70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:37:45.244 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:37:45.219+0000 7f5508c00640 1 --2- 172.21.15.39:0/726934265 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55e1c4898c50 0x55e1c48a0b70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:37:45.244 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:37:45.219+0000 7f5508c00640 1 -- 172.21.15.39:0/726934265 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55e1c4898330 msgr2=0x55e1c48a0630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:37:45.244 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:37:45.219+0000 7f5508c00640 1 --2- 172.21.15.39:0/726934265 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55e1c4898330 0x55e1c48a0630 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:37:45.244 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:37:45.219+0000 7f5508c00640 1 -- 172.21.15.39:0/726934265 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55e1c456f2b0 con 0x55e1c48a3510 2024-09-12T02:37:45.244 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:37:45.219+0000 7f5503400640 1 --2- 172.21.15.39:0/726934265 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55e1c4898c50 0x55e1c48a0b70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-12T02:37:45.244 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:37:45.219+0000 7f5503e00640 1 --2- 172.21.15.39:0/726934265 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55e1c4898330 0x55e1c48a0630 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-12T02:37:45.245 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:37:45.219+0000 7f5508c00640 1 --2- 172.21.15.39:0/726934265 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55e1c48a3510 0x55e1c48a10b0 secure :-1 s=READY pgs=272 cs=0 l=1 rev1=1 crypto rx=0x7f54fc02fb00 tx=0x7f54fc02f7c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=91735ff9157889b7 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:37:45.245 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:37:45.219+0000 7f54ed600640 10 client.0 ms_handle_connect on v2:172.21.15.39:3300/0 2024-09-12T02:37:45.245 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:37:45.220+0000 7f54ed600640 1 -- 172.21.15.39:0/726934265 <== mon.0 v2:172.21.15.39:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f54fc050060 con 0x55e1c48a3510 2024-09-12T02:37:45.245 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:37:45.220+0000 7f550d66c740 1 -- 172.21.15.39:0/726934265 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f54fc003e50 con 0x55e1c48a3510 2024-09-12T02:37:45.245 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:37:45.220+0000 7f54ed600640 1 -- 172.21.15.39:0/726934265 <== mon.0 v2:172.21.15.39:3300/0 2 ==== osd_map(95..95 src has 1..95) ==== 9129+0+0 (secure 0 0 0) 0x7f54fc003b80 con 0x55e1c48a3510 2024-09-12T02:37:45.245 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:37:45.220+0000 7f54ed600640 1 -- 172.21.15.39:0/726934265 <== mon.0 v2:172.21.15.39:3300/0 3 ==== mon_get_version_reply(handle=1 version=28) ==== 24+0+0 (secure 0 0 0) 0x7f54fc048070 con 0x55e1c48a3510 2024-09-12T02:37:45.245 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:37:45.220+0000 7f550d66c740 10 client.15171 fetch_fsmap learned FSMap version 28 2024-09-12T02:37:45.245 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:37:45.220+0000 7f550d66c740 1 -- 172.21.15.39:0/726934265 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({config=0+,fsmap=28,monmap=4+}) -- 0x55e1c48b1e30 con 0x55e1c48a3510 2024-09-12T02:37:45.245 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:37:45.220+0000 7f54ed600640 1 -- 172.21.15.39:0/726934265 <== mon.0 v2:172.21.15.39:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f54fc003e50 con 0x55e1c48a3510 2024-09-12T02:37:45.245 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:37:45.220+0000 7f54ed600640 1 -- 172.21.15.39:0/726934265 <== mon.0 v2:172.21.15.39:3300/0 5 ==== fsmap(e 28) ==== 8370+0+0 (secure 0 0 0) 0x7f54fc030600 con 0x55e1c48a3510 2024-09-12T02:37:45.245 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:37:45.220+0000 7f550d66c740 10 client.15171 fetch_fsmap finished waiting for FSMap version 28 2024-09-12T02:37:45.245 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:37:45.221+0000 7f550d66c740 10 client.15171 resolve_mds: resolved name 'i' to daemon mds.i 2024-09-12T02:37:45.245 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:37:45.221+0000 7f550d66c740 20 client.15171 populate_metadata read hostname 'smithi039' 2024-09-12T02:37:45.245 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:37:45.221+0000 7f550d66c740 1 --2- 172.21.15.39:0/726934265 >> [v2:172.21.15.172:6838/3742537097,v1:172.21.15.172:6839/3742537097] conn(0x55e1c48b3fb0 0x55e1c48b5420 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:37:45.246 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:37:45.221+0000 7f550d66c740 4 client.15171 mds_command: new command op to 24499 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-12T02:37:45.246 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:37:45.221+0000 7f550d66c740 1 -- 172.21.15.39:0/726934265 --> [v2:172.21.15.172:6838/3742537097,v1:172.21.15.172:6839/3742537097] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55e1c480b620 con 0x55e1c48b3fb0 2024-09-12T02:37:45.246 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:37:45.221+0000 7f5503e00640 1 --2- 172.21.15.39:0/726934265 >> [v2:172.21.15.172:6838/3742537097,v1:172.21.15.172:6839/3742537097] conn(0x55e1c48b3fb0 0x55e1c48b5420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:37:45.246 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:37:45.221+0000 7f5503e00640 1 --2- 172.21.15.39:0/726934265 >> [v2:172.21.15.172:6838/3742537097,v1:172.21.15.172:6839/3742537097] conn(0x55e1c48b3fb0 0x55e1c48b5420 crc :-1 s=READY pgs=18 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=2f74cd3e7ccb454 server_cookie=b33ba7bcd616f8ac in_seq=0 out_seq=0 2024-09-12T02:37:45.246 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:37:45.221+0000 7f54ed600640 10 client.15171 ms_handle_connect on v2:172.21.15.172:6838/3742537097 2024-09-12T02:37:45.246 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:37:45.222+0000 7f54ed600640 1 -- 172.21.15.39:0/726934265 <== mds.1 v2:172.21.15.172:6838/3742537097 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x55e1c480b620 con 0x55e1c48b3fb0 2024-09-12T02:37:45.246 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:37:45.222+0000 7f54ed600640 10 client.15171 handle_command_reply: tid=0 2024-09-12T02:37:45.246 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:37:45.222+0000 7f550d66c740 1 client.15171 shutdown 2024-09-12T02:37:45.246 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:37:45.223+0000 7f550d66c740 1 -- 172.21.15.39:0/726934265 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55e1c48a3510 msgr2=0x55e1c48a10b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:37:45.246 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:37:45.223+0000 7f550d66c740 1 --2- 172.21.15.39:0/726934265 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55e1c48a3510 0x55e1c48a10b0 secure :-1 s=READY pgs=272 cs=0 l=1 rev1=1 crypto rx=0x7f54fc02fb00 tx=0x7f54fc02f7c0 comp rx=0 tx=0).stop 2024-09-12T02:37:45.246 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:37:45.223+0000 7f550d66c740 1 -- 172.21.15.39:0/726934265 shutdown_connections 2024-09-12T02:37:45.246 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:37:45.223+0000 7f550d66c740 1 --2- 172.21.15.39:0/726934265 >> [v2:172.21.15.172:6838/3742537097,v1:172.21.15.172:6839/3742537097] conn(0x55e1c48b3fb0 0x55e1c48b5420 crc :-1 s=READY pgs=18 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:37:45.246 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:37:45.223+0000 7f550d66c740 1 --2- 172.21.15.39:0/726934265 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55e1c48a3510 0x55e1c48a10b0 unknown :-1 s=CLOSED pgs=272 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:37:45.246 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:37:45.223+0000 7f550d66c740 1 --2- 172.21.15.39:0/726934265 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55e1c4898c50 0x55e1c48a0b70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:37:45.247 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:37:45.223+0000 7f550d66c740 1 --2- 172.21.15.39:0/726934265 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55e1c4898330 0x55e1c48a0630 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:37:45.247 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:37:45.223+0000 7f550d66c740 1 -- 172.21.15.39:0/726934265 >> 172.21.15.39:0/726934265 conn(0x55e1c48948c0 msgr2=0x55e1c489a5a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:37:45.247 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:37:45.223+0000 7f54ed600640 0 client.15171 ms_handle_reset on v2:172.21.15.172:6838/3742537097 2024-09-12T02:37:45.247 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:37:45.223+0000 7f550d66c740 1 -- 172.21.15.39:0/726934265 shutdown_connections 2024-09-12T02:37:45.247 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:37:45.223+0000 7f550d66c740 1 -- 172.21.15.39:0/726934265 wait complete. 2024-09-12T02:37:45.247 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:37:45.223+0000 7f550d66c740 20 client.15171 trim_cache size 0 max 16384 2024-09-12T02:37:45.251 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:37:45.242+0000 7f550d66c740 1 Processor -- start 2024-09-12T02:37:45.251 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:37:45.242+0000 7f550d66c740 1 -- start start 2024-09-12T02:37:45.251 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:37:45.242+0000 7f550d66c740 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55e1c4898330 0x55e1c48b5420 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:37:45.251 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:37:45.242+0000 7f550d66c740 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55e1c4898c50 0x55e1c48a0f00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:37:45.251 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:37:45.242+0000 7f550d66c740 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55e1c48a3510 0x55e1c489ef20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:37:45.251 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:37:45.242+0000 7f550d66c740 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 -- 0x55e1c48b3760 con 0x55e1c4898330 2024-09-12T02:37:45.251 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:37:45.242+0000 7f550d66c740 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x55e1c48b3e30 con 0x55e1c4898c50 2024-09-12T02:37:45.252 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:37:45.242+0000 7f550d66c740 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x55e1c48b4500 con 0x55e1c48a3510 2024-09-12T02:37:45.252 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:37:45.242+0000 7f5503e00640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55e1c4898330 0x55e1c48b5420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:37:45.252 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:37:45.243+0000 7f5503e00640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55e1c4898330 0x55e1c48b5420 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.39:3300/0 says I am v2:172.21.15.39:55918/0 (socket says 172.21.15.39:55918) 2024-09-12T02:37:45.252 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:37:45.243+0000 7f5503e00640 1 -- 172.21.15.39:0/4217403288 learned_addr learned my addr 172.21.15.39:0/4217403288 (peer_addr_for_me v2:172.21.15.39:0/0) 2024-09-12T02:37:45.252 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:37:45.243+0000 7f5508c00640 1 --2- 172.21.15.39:0/4217403288 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55e1c48a3510 0x55e1c489ef20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:37:45.252 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:37:45.243+0000 7f5503400640 1 --2- 172.21.15.39:0/4217403288 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55e1c4898c50 0x55e1c48a0f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:37:45.252 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:37:45.243+0000 7f5503e00640 1 -- 172.21.15.39:0/4217403288 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55e1c48a3510 msgr2=0x55e1c489ef20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:37:45.252 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:37:45.243+0000 7f5503e00640 1 --2- 172.21.15.39:0/4217403288 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55e1c48a3510 0x55e1c489ef20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:37:45.252 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:37:45.243+0000 7f5503e00640 1 -- 172.21.15.39:0/4217403288 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55e1c4898c50 msgr2=0x55e1c48a0f00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:37:45.252 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:37:45.243+0000 7f5503e00640 1 --2- 172.21.15.39:0/4217403288 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55e1c4898c50 0x55e1c48a0f00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:37:45.252 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:37:45.243+0000 7f5503e00640 1 -- 172.21.15.39:0/4217403288 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55e1c489c230 con 0x55e1c4898330 2024-09-12T02:37:45.252 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:37:45.243+0000 7f5503e00640 1 --2- 172.21.15.39:0/4217403288 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55e1c4898330 0x55e1c48b5420 secure :-1 s=READY pgs=273 cs=0 l=1 rev1=1 crypto rx=0x7f54f4005d00 tx=0x7f54f4019000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=663ecf14b2210a8c server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:37:45.252 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:37:45.244+0000 7f54efe00640 1 -- 172.21.15.39:0/4217403288 <== mon.0 v2:172.21.15.39:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f54f401ed70 con 0x55e1c4898330 2024-09-12T02:37:45.253 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:37:45.244+0000 7f54efe00640 1 -- 172.21.15.39:0/4217403288 <== mon.0 v2:172.21.15.39:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f54f4005500 con 0x55e1c4898330 2024-09-12T02:37:45.253 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:37:45.244+0000 7f54efe00640 1 -- 172.21.15.39:0/4217403288 <== mon.0 v2:172.21.15.39:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f54f402a680 con 0x55e1c4898330 2024-09-12T02:37:45.253 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:37:45.244+0000 7f550d66c740 1 -- 172.21.15.39:0/4217403288 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55e1c4898330 msgr2=0x55e1c48b5420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:37:45.253 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:37:45.244+0000 7f550d66c740 1 --2- 172.21.15.39:0/4217403288 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55e1c4898330 0x55e1c48b5420 secure :-1 s=READY pgs=273 cs=0 l=1 rev1=1 crypto rx=0x7f54f4005d00 tx=0x7f54f4019000 comp rx=0 tx=0).stop 2024-09-12T02:37:45.253 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:37:45.244+0000 7f550d66c740 1 -- 172.21.15.39:0/4217403288 shutdown_connections 2024-09-12T02:37:45.253 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:37:45.244+0000 7f550d66c740 1 --2- 172.21.15.39:0/4217403288 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55e1c48a3510 0x55e1c489ef20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:37:45.253 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:37:45.244+0000 7f550d66c740 1 --2- 172.21.15.39:0/4217403288 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55e1c4898c50 0x55e1c48a0f00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:37:45.253 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:37:45.244+0000 7f550d66c740 1 --2- 172.21.15.39:0/4217403288 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55e1c4898330 0x55e1c48b5420 unknown :-1 s=CLOSED pgs=273 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:37:45.253 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:37:45.244+0000 7f550d66c740 1 -- 172.21.15.39:0/4217403288 >> 172.21.15.39:0/4217403288 conn(0x55e1c48948c0 msgr2=0x55e1c489aec0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:37:45.253 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:37:45.245+0000 7f550d66c740 1 -- 172.21.15.39:0/4217403288 shutdown_connections 2024-09-12T02:37:45.253 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:37:45.245+0000 7f550d66c740 1 -- 172.21.15.39:0/4217403288 wait complete. 2024-09-12T02:37:45.253 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:37:45.245+0000 7f550d66c740 1 -- start start 2024-09-12T02:37:45.253 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:37:45.245+0000 7f550d66c740 1 Processor -- start 2024-09-12T02:37:45.254 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:37:45.246+0000 7f550d66c740 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55e1c4898330 0x55e1c48bd990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:37:45.254 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:37:45.246+0000 7f550d66c740 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55e1c4898c50 0x55e1c48bded0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:37:45.254 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:37:45.246+0000 7f550d66c740 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55e1c48a3510 0x55e1c489d050 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:37:45.254 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:37:45.246+0000 7f550d66c740 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 -- 0x55e1c48b52a0 con 0x55e1c4898c50 2024-09-12T02:37:45.254 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:37:45.246+0000 7f550d66c740 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x55e1c48b4bd0 con 0x55e1c48a3510 2024-09-12T02:37:45.254 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:37:45.246+0000 7f550d66c740 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x55e1c48b5970 con 0x55e1c4898330 2024-09-12T02:37:45.254 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:37:45.246+0000 7f550d66c740 10 client.0 _ll_register_callbacks cb 0x7f54f400b810 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-12T02:37:45.254 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:37:45.246+0000 7f5503400640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55e1c4898c50 0x55e1c48bded0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:37:45.254 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:37:45.246+0000 7f5503400640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55e1c4898c50 0x55e1c48bded0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.39:3300/0 says I am v2:172.21.15.39:55930/0 (socket says 172.21.15.39:55930) 2024-09-12T02:37:45.254 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:37:45.246+0000 7f5503400640 1 -- 172.21.15.39:0/4270951010 learned_addr learned my addr 172.21.15.39:0/4270951010 (peer_addr_for_me v2:172.21.15.39:0/0) 2024-09-12T02:37:45.254 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:37:45.246+0000 7f5503e00640 1 --2- 172.21.15.39:0/4270951010 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55e1c4898330 0x55e1c48bd990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:37:45.254 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:37:45.246+0000 7f5508c00640 1 --2- 172.21.15.39:0/4270951010 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55e1c48a3510 0x55e1c489d050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:37:45.254 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:37:45.247+0000 7f5503400640 1 -- 172.21.15.39:0/4270951010 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55e1c4898330 msgr2=0x55e1c48bd990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:37:45.254 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:37:45.247+0000 7f5503400640 1 --2- 172.21.15.39:0/4270951010 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55e1c4898330 0x55e1c48bd990 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:37:45.255 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:37:45.247+0000 7f5503400640 1 -- 172.21.15.39:0/4270951010 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55e1c48a3510 msgr2=0x55e1c489d050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:37:45.255 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:37:45.247+0000 7f5503400640 1 --2- 172.21.15.39:0/4270951010 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55e1c48a3510 0x55e1c489d050 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:37:45.255 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:37:45.247+0000 7f5503400640 1 -- 172.21.15.39:0/4270951010 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55e1c489d880 con 0x55e1c4898c50 2024-09-12T02:37:45.255 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:37:45.247+0000 7f5503400640 1 --2- 172.21.15.39:0/4270951010 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55e1c4898c50 0x55e1c48bded0 secure :-1 s=READY pgs=274 cs=0 l=1 rev1=1 crypto rx=0x7f54f00985c0 tx=0x7f54f0097f50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6191317600495a6f server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:37:45.255 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:37:45.247+0000 7f54ed600640 10 client.0 ms_handle_connect on v2:172.21.15.39:3300/0 2024-09-12T02:37:45.255 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:37:45.247+0000 7f54ed600640 1 -- 172.21.15.39:0/4270951010 <== mon.0 v2:172.21.15.39:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f54f00b2070 con 0x55e1c4898c50 2024-09-12T02:37:45.255 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:37:45.247+0000 7f54ed600640 1 -- 172.21.15.39:0/4270951010 <== mon.0 v2:172.21.15.39:3300/0 2 ==== osd_map(95..95 src has 1..95) ==== 9129+0+0 (secure 0 0 0) 0x7f54f00a45d0 con 0x55e1c4898c50 2024-09-12T02:37:45.255 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:37:45.247+0000 7f550d66c740 1 -- 172.21.15.39:0/4270951010 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f54f4005500 con 0x55e1c4898c50 2024-09-12T02:37:45.255 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:37:45.247+0000 7f54ed600640 1 -- 172.21.15.39:0/4270951010 <== mon.0 v2:172.21.15.39:3300/0 3 ==== mon_get_version_reply(handle=1 version=28) ==== 24+0+0 (secure 0 0 0) 0x7f54f009b550 con 0x55e1c4898c50 2024-09-12T02:37:45.255 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:37:45.247+0000 7f550d66c740 10 client.15177 fetch_fsmap learned FSMap version 28 2024-09-12T02:37:45.255 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:37:45.247+0000 7f550d66c740 1 -- 172.21.15.39:0/4270951010 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({config=0+,fsmap=28,monmap=4+}) -- 0x55e1c48bc130 con 0x55e1c4898c50 2024-09-12T02:37:45.255 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:37:45.248+0000 7f54ed600640 1 -- 172.21.15.39:0/4270951010 <== mon.0 v2:172.21.15.39:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f54f4005500 con 0x55e1c4898c50 2024-09-12T02:37:45.255 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:37:45.248+0000 7f54ed600640 1 -- 172.21.15.39:0/4270951010 <== mon.0 v2:172.21.15.39:3300/0 5 ==== fsmap(e 28) ==== 8370+0+0 (secure 0 0 0) 0x7f54f00cfc50 con 0x55e1c4898c50 2024-09-12T02:37:45.256 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:37:45.248+0000 7f550d66c740 10 client.15177 fetch_fsmap finished waiting for FSMap version 28 2024-09-12T02:37:45.256 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:37:45.248+0000 7f550d66c740 10 client.15177 resolve_mds: resolved name 'i' to daemon mds.i 2024-09-12T02:37:45.256 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:37:45.248+0000 7f550d66c740 20 client.15177 populate_metadata read hostname 'smithi039' 2024-09-12T02:37:45.256 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:37:45.248+0000 7f550d66c740 1 --2- 172.21.15.39:0/4270951010 >> [v2:172.21.15.172:6838/3742537097,v1:172.21.15.172:6839/3742537097] conn(0x55e1c4922e60 0x55e1c4921b70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:37:45.256 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:37:45.248+0000 7f550d66c740 4 client.15177 mds_command: new command op to 24499 tid=0 multi_id=0 [{"prefix": "status"}] 2024-09-12T02:37:45.256 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:37:45.248+0000 7f550d66c740 1 -- 172.21.15.39:0/4270951010 --> [v2:172.21.15.172:6838/3742537097,v1:172.21.15.172:6839/3742537097] -- command(tid 0: {"prefix": "status"}) -- 0x55e1c4805b30 con 0x55e1c4922e60 2024-09-12T02:37:45.256 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:37:45.248+0000 7f5503e00640 1 --2- 172.21.15.39:0/4270951010 >> [v2:172.21.15.172:6838/3742537097,v1:172.21.15.172:6839/3742537097] conn(0x55e1c4922e60 0x55e1c4921b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:37:45.256 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:37:45.249+0000 7f5503e00640 1 --2- 172.21.15.39:0/4270951010 >> [v2:172.21.15.172:6838/3742537097,v1:172.21.15.172:6839/3742537097] conn(0x55e1c4922e60 0x55e1c4921b70 crc :-1 s=READY pgs=19 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=125896f922dd6372 server_cookie=94abcdb7e3f1033b in_seq=0 out_seq=0 2024-09-12T02:37:45.256 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:37:45.249+0000 7f54ed600640 10 client.15177 ms_handle_connect on v2:172.21.15.172:6838/3742537097 2024-09-12T02:37:45.256 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:37:45.250+0000 7f54ed600640 1 -- 172.21.15.39:0/4270951010 <== mds.1 v2:172.21.15.172:6838/3742537097 1 ==== command_reply(tid 0: 0 ) ==== 8+0+327 (crc 0 0 0) 0x55e1c4805b30 con 0x55e1c4922e60 2024-09-12T02:37:45.256 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:37:45.250+0000 7f54ed600640 10 client.15177 handle_command_reply: tid=0 2024-09-12T02:37:45.256 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:37:45.250+0000 7f550d66c740 1 client.15177 shutdown 2024-09-12T02:37:45.256 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:37:45.250+0000 7f550d66c740 1 -- 172.21.15.39:0/4270951010 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55e1c4898c50 msgr2=0x55e1c48bded0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:37:45.257 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:37:45.250+0000 7f550d66c740 1 --2- 172.21.15.39:0/4270951010 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55e1c4898c50 0x55e1c48bded0 secure :-1 s=READY pgs=274 cs=0 l=1 rev1=1 crypto rx=0x7f54f00985c0 tx=0x7f54f0097f50 comp rx=0 tx=0).stop 2024-09-12T02:37:45.257 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:37:45.250+0000 7f550d66c740 1 -- 172.21.15.39:0/4270951010 shutdown_connections 2024-09-12T02:37:45.257 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:37:45.250+0000 7f550d66c740 1 --2- 172.21.15.39:0/4270951010 >> [v2:172.21.15.172:6838/3742537097,v1:172.21.15.172:6839/3742537097] conn(0x55e1c4922e60 0x55e1c4921b70 crc :-1 s=READY pgs=19 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:37:45.257 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:37:45.250+0000 7f550d66c740 1 --2- 172.21.15.39:0/4270951010 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55e1c48a3510 0x55e1c489d050 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:37:45.257 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:37:45.250+0000 7f550d66c740 1 --2- 172.21.15.39:0/4270951010 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55e1c4898c50 0x55e1c48bded0 unknown :-1 s=CLOSED pgs=274 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:37:45.257 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:37:45.250+0000 7f550d66c740 1 --2- 172.21.15.39:0/4270951010 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55e1c4898330 0x55e1c48bd990 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:37:45.257 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:37:45.250+0000 7f550d66c740 1 -- 172.21.15.39:0/4270951010 >> 172.21.15.39:0/4270951010 conn(0x55e1c48948c0 msgr2=0x55e1c489edb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:37:45.257 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:37:45.250+0000 7f54ed600640 0 client.15177 ms_handle_reset on v2:172.21.15.172:6838/3742537097 2024-09-12T02:37:45.257 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:37:45.250+0000 7f550d66c740 1 -- 172.21.15.39:0/4270951010 shutdown_connections 2024-09-12T02:37:45.257 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:37:45.251+0000 7f550d66c740 1 -- 172.21.15.39:0/4270951010 wait complete. 2024-09-12T02:37:45.257 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:37:45.251+0000 7f550d66c740 20 client.15177 trim_cache size 0 max 16384 2024-09-12T02:37:45.258 INFO:teuthology.orchestra.run.smithi039.stdout:{ 2024-09-12T02:37:45.258 INFO:teuthology.orchestra.run.smithi039.stdout: "cluster_fsid": "4954ed46-70ae-11ef-bcea-c7b262605968", 2024-09-12T02:37:45.258 INFO:teuthology.orchestra.run.smithi039.stdout: "whoami": 1, 2024-09-12T02:37:45.258 INFO:teuthology.orchestra.run.smithi039.stdout: "id": 24499, 2024-09-12T02:37:45.259 INFO:teuthology.orchestra.run.smithi039.stdout: "want_state": "up:active", 2024-09-12T02:37:45.259 INFO:teuthology.orchestra.run.smithi039.stdout: "state": "up:active", 2024-09-12T02:37:45.259 INFO:teuthology.orchestra.run.smithi039.stdout: "fs_name": "cephfs", 2024-09-12T02:37:45.259 INFO:teuthology.orchestra.run.smithi039.stdout: "rank_uptime": 116.499917809, 2024-09-12T02:37:45.259 INFO:teuthology.orchestra.run.smithi039.stdout: "mdsmap_epoch": 28, 2024-09-12T02:37:45.259 INFO:teuthology.orchestra.run.smithi039.stdout: "osdmap_epoch": 95, 2024-09-12T02:37:45.259 INFO:teuthology.orchestra.run.smithi039.stdout: "osdmap_epoch_barrier": 93, 2024-09-12T02:37:45.259 INFO:teuthology.orchestra.run.smithi039.stdout: "uptime": 183.41152895499999 2024-09-12T02:37:45.259 INFO:teuthology.orchestra.run.smithi039.stdout:} 2024-09-12T02:37:45.260 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:37:45.251+0000 7f550ac00640 1 -- 172.21.15.39:0/4187661928 >> [v2:172.21.15.39:6800/1725006999,v1:172.21.15.39:6801/1725006999] conn(0x7f54e80a2c00 msgr2=0x7f54e80a50c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:37:45.260 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:37:45.251+0000 7f550ac00640 1 --2- 172.21.15.39:0/4187661928 >> [v2:172.21.15.39:6800/1725006999,v1:172.21.15.39:6801/1725006999] conn(0x7f54e80a2c00 0x7f54e80a50c0 secure :-1 s=READY pgs=228 cs=0 l=1 rev1=1 crypto rx=0x55e1c4895720 tx=0x7f54f400b410 comp rx=0 tx=0).stop 2024-09-12T02:37:45.260 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:37:45.251+0000 7f550ac00640 1 -- 172.21.15.39:0/4187661928 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f5504074eb0 msgr2=0x7f55041a4c30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:37:45.260 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:37:45.251+0000 7f550ac00640 1 --2- 172.21.15.39:0/4187661928 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f5504074eb0 0x7f55041a4c30 secure :-1 s=READY pgs=271 cs=0 l=1 rev1=1 crypto rx=0x7f54f000e9f0 tx=0x7f54f000edf0 comp rx=0 tx=0).stop 2024-09-12T02:37:45.260 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:37:45.251+0000 7f550ac00640 1 -- 172.21.15.39:0/4187661928 shutdown_connections 2024-09-12T02:37:45.260 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:37:45.251+0000 7f550ac00640 1 --2- 172.21.15.39:0/4187661928 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f5504112b90 0x7f550419e8b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:37:45.260 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:37:45.251+0000 7f550ac00640 1 --2- 172.21.15.39:0/4187661928 >> [v2:172.21.15.39:6800/1725006999,v1:172.21.15.39:6801/1725006999] conn(0x7f54e80a2c00 0x7f54e80a50c0 unknown :-1 s=CLOSED pgs=228 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:37:45.260 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:37:45.251+0000 7f550ac00640 1 --2- 172.21.15.39:0/4187661928 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f5504074eb0 0x7f55041a4c30 unknown :-1 s=CLOSED pgs=271 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:37:45.261 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:37:45.251+0000 7f550ac00640 1 --2- 172.21.15.39:0/4187661928 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f5504074590 0x7f55041a46f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:37:45.261 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:37:45.251+0000 7f550ac00640 1 -- 172.21.15.39:0/4187661928 >> 172.21.15.39:0/4187661928 conn(0x7f55040fd8c0 msgr2=0x7f55040fef70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:37:45.261 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:37:45.252+0000 7f550ac00640 1 -- 172.21.15.39:0/4187661928 shutdown_connections 2024-09-12T02:37:45.261 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:37:45.252+0000 7f550ac00640 1 -- 172.21.15.39:0/4187661928 wait complete. 2024-09-12T02:37:46.152 DEBUG:teuthology.orchestra.run.smithi039:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc shell --fsid 4954ed46-70ae-11ef-bcea-c7b262605968 -- ceph tell mds.b status 2024-09-12T02:37:46.529 INFO:teuthology.orchestra.run.smithi039.stderr:Inferring config /var/lib/ceph/4954ed46-70ae-11ef-bcea-c7b262605968/mon.a/config 2024-09-12T02:37:46.849 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 02:37:46 smithi039 ceph-mon[30515]: pgmap v385: 129 pgs: 129 active+clean; 646 KiB data, 348 MiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2024-09-12T02:37:46.948 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 12 02:37:46 smithi044 ceph-mon[35411]: pgmap v385: 129 pgs: 129 active+clean; 646 KiB data, 348 MiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2024-09-12T02:37:47.013 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 12 02:37:46 smithi172 ceph-mon[35609]: pgmap v385: 129 pgs: 129 active+clean; 646 KiB data, 348 MiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2024-09-12T02:37:47.093 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:37:47.091+0000 7f97c7e00640 1 -- 172.21.15.39:0/3693345569 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f97c0102790 msgr2=0x7f97c01067e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:37:47.093 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:37:47.091+0000 7f97c7e00640 1 --2- 172.21.15.39:0/3693345569 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f97c0102790 0x7f97c01067e0 secure :-1 s=READY pgs=122 cs=0 l=1 rev1=1 crypto rx=0x7f97ac009900 tx=0x7f97ac02a3f0 comp rx=0 tx=0).stop 2024-09-12T02:37:47.093 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:37:47.091+0000 7f97c7e00640 1 -- 172.21.15.39:0/3693345569 shutdown_connections 2024-09-12T02:37:47.093 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:37:47.091+0000 7f97c7e00640 1 --2- 172.21.15.39:0/3693345569 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f97c0106f10 0x7f97c010ea90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:37:47.093 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:37:47.091+0000 7f97c7e00640 1 --2- 172.21.15.39:0/3693345569 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f97c0102790 0x7f97c01067e0 unknown :-1 s=CLOSED pgs=122 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:37:47.093 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:37:47.091+0000 7f97c7e00640 1 --2- 172.21.15.39:0/3693345569 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f97c0101de0 0x7f97c01021c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:37:47.094 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:37:47.091+0000 7f97c7e00640 1 -- 172.21.15.39:0/3693345569 >> 172.21.15.39:0/3693345569 conn(0x7f97c00fd8c0 msgr2=0x7f97c00ffce0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:37:47.094 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:37:47.091+0000 7f97c7e00640 1 -- 172.21.15.39:0/3693345569 shutdown_connections 2024-09-12T02:37:47.094 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:37:47.091+0000 7f97c7e00640 1 -- 172.21.15.39:0/3693345569 wait complete. 2024-09-12T02:37:47.094 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:37:47.092+0000 7f97c7e00640 1 Processor -- start 2024-09-12T02:37:47.094 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:37:47.093+0000 7f97c7e00640 1 -- start start 2024-09-12T02:37:47.095 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:37:47.093+0000 7f97c7e00640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f97c0101de0 0x7f97c0198430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:37:47.096 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:37:47.093+0000 7f97c7e00640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f97c0102790 0x7f97c0198970 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:37:47.096 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:37:47.093+0000 7f97c7e00640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f97c0106f10 0x7f97c019cd00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:37:47.096 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:37:47.093+0000 7f97c7e00640 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 -- 0x7f97c0111f70 con 0x7f97c0101de0 2024-09-12T02:37:47.096 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:37:47.093+0000 7f97c7e00640 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x7f97c0111df0 con 0x7f97c0102790 2024-09-12T02:37:47.096 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:37:47.093+0000 7f97c7e00640 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7f97c01120f0 con 0x7f97c0106f10 2024-09-12T02:37:47.096 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:37:47.093+0000 7f97c5400640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f97c0101de0 0x7f97c0198430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:37:47.096 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:37:47.093+0000 7f97c5400640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f97c0101de0 0x7f97c0198430 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.39:3300/0 says I am v2:172.21.15.39:55952/0 (socket says 172.21.15.39:55952) 2024-09-12T02:37:47.096 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:37:47.093+0000 7f97c5400640 1 -- 172.21.15.39:0/3381383646 learned_addr learned my addr 172.21.15.39:0/3381383646 (peer_addr_for_me v2:172.21.15.39:0/0) 2024-09-12T02:37:47.096 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:37:47.093+0000 7f97c5e00640 1 --2- 172.21.15.39:0/3381383646 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f97c0106f10 0x7f97c019cd00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:37:47.096 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:37:47.093+0000 7f97c4a00640 1 --2- 172.21.15.39:0/3381383646 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f97c0102790 0x7f97c0198970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:37:47.096 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:37:47.094+0000 7f97c5400640 1 -- 172.21.15.39:0/3381383646 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f97c0106f10 msgr2=0x7f97c019cd00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:37:47.096 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:37:47.094+0000 7f97c5400640 1 --2- 172.21.15.39:0/3381383646 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f97c0106f10 0x7f97c019cd00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:37:47.097 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:37:47.094+0000 7f97c5400640 1 -- 172.21.15.39:0/3381383646 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f97c0102790 msgr2=0x7f97c0198970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:37:47.097 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:37:47.094+0000 7f97c5400640 1 --2- 172.21.15.39:0/3381383646 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f97c0102790 0x7f97c0198970 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:37:47.097 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:37:47.094+0000 7f97c5400640 1 -- 172.21.15.39:0/3381383646 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f97c019d3e0 con 0x7f97c0101de0 2024-09-12T02:37:47.097 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:37:47.094+0000 7f97c5e00640 1 --2- 172.21.15.39:0/3381383646 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f97c0106f10 0x7f97c019cd00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-12T02:37:47.097 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:37:47.094+0000 7f97c5400640 1 --2- 172.21.15.39:0/3381383646 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f97c0101de0 0x7f97c0198430 secure :-1 s=READY pgs=275 cs=0 l=1 rev1=1 crypto rx=0x7f97b400ea60 tx=0x7f97b400ef20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:37:47.097 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:37:47.094+0000 7f97be000640 1 -- 172.21.15.39:0/3381383646 <== mon.0 v2:172.21.15.39:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f97b400cde0 con 0x7f97c0101de0 2024-09-12T02:37:47.097 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:37:47.094+0000 7f97c7e00640 1 -- 172.21.15.39:0/3381383646 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f97c019d6d0 con 0x7f97c0101de0 2024-09-12T02:37:47.097 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:37:47.095+0000 7f97be000640 1 -- 172.21.15.39:0/3381383646 <== mon.0 v2:172.21.15.39:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f97b40035f0 con 0x7f97c0101de0 2024-09-12T02:37:47.097 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:37:47.095+0000 7f97be000640 1 -- 172.21.15.39:0/3381383646 <== mon.0 v2:172.21.15.39:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f97b4005220 con 0x7f97c0101de0 2024-09-12T02:37:47.097 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:37:47.095+0000 7f97c7e00640 1 -- 172.21.15.39:0/3381383646 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f97c01a4fb0 con 0x7f97c0101de0 2024-09-12T02:37:47.098 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:37:47.098+0000 7f97ca9fa740 1 Processor -- start 2024-09-12T02:37:47.099 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:37:47.098+0000 7f97be000640 1 -- 172.21.15.39:0/3381383646 <== mon.0 v2:172.21.15.39:3300/0 4 ==== mgrmap(e 18) ==== 137833+0+0 (secure 0 0 0) 0x7f97b40037a0 con 0x7f97c0101de0 2024-09-12T02:37:47.099 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:37:47.098+0000 7f97ca9fa740 1 -- start start 2024-09-12T02:37:47.099 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:37:47.098+0000 7f97ca9fa740 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x56009eece330 0x56009eece710 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:37:47.099 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:37:47.098+0000 7f97ca9fa740 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x56009eecec50 0x56009eed8fd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:37:47.100 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:37:47.098+0000 7f97ca9fa740 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x56009eed9510 0x56009eedb900 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:37:47.100 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:37:47.098+0000 7f97ca9fa740 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 -- 0x56009ee340b0 con 0x56009eece330 2024-09-12T02:37:47.100 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:37:47.098+0000 7f97ca9fa740 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x56009eddbab0 con 0x56009eecec50 2024-09-12T02:37:47.100 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:37:47.098+0000 7f97ca9fa740 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x56009ee30070 con 0x56009eed9510 2024-09-12T02:37:47.100 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:37:47.099+0000 7f97c5e00640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x56009eece330 0x56009eece710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:37:47.100 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:37:47.099+0000 7f97c5e00640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x56009eece330 0x56009eece710 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.39:3300/0 says I am v2:172.21.15.39:55958/0 (socket says 172.21.15.39:55958) 2024-09-12T02:37:47.100 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:37:47.099+0000 7f97c5e00640 1 -- 172.21.15.39:0/889795422 learned_addr learned my addr 172.21.15.39:0/889795422 (peer_addr_for_me v2:172.21.15.39:0/0) 2024-09-12T02:37:47.100 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:37:47.099+0000 7f97c5400640 1 --2- 172.21.15.39:0/889795422 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x56009eecec50 0x56009eed8fd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:37:47.101 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:37:47.099+0000 7f97c4a00640 1 --2- 172.21.15.39:0/889795422 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x56009eed9510 0x56009eedb900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:37:47.101 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:37:47.099+0000 7f97c5e00640 1 -- 172.21.15.39:0/889795422 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x56009eed9510 msgr2=0x56009eedb900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:37:47.101 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:37:47.099+0000 7f97c5e00640 1 --2- 172.21.15.39:0/889795422 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x56009eed9510 0x56009eedb900 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:37:47.101 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:37:47.099+0000 7f97c5e00640 1 -- 172.21.15.39:0/889795422 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x56009eecec50 msgr2=0x56009eed8fd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:37:47.101 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:37:47.099+0000 7f97c5e00640 1 --2- 172.21.15.39:0/889795422 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x56009eecec50 0x56009eed8fd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:37:47.101 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:37:47.099+0000 7f97c5e00640 1 -- 172.21.15.39:0/889795422 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x56009ede84a0 con 0x56009eece330 2024-09-12T02:37:47.102 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:37:47.099+0000 7f97c5400640 1 --2- 172.21.15.39:0/889795422 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x56009eecec50 0x56009eed8fd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-12T02:37:47.102 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:37:47.100+0000 7f97be000640 1 --2- 172.21.15.39:0/3381383646 >> [v2:172.21.15.39:6800/1725006999,v1:172.21.15.39:6801/1725006999] conn(0x7f97a80a2b80 0x7f97a80a5040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:37:47.102 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:37:47.100+0000 7f97c5e00640 1 --2- 172.21.15.39:0/889795422 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x56009eece330 0x56009eece710 secure :-1 s=READY pgs=276 cs=0 l=1 rev1=1 crypto rx=0x7f97b8011790 tx=0x7f97b8011c50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=215cee0cb2addaa2 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:37:47.102 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:37:47.100+0000 7f97be000640 1 -- 172.21.15.39:0/3381383646 <== mon.0 v2:172.21.15.39:3300/0 5 ==== osd_map(95..95 src has 1..95) ==== 9129+0+0 (secure 0 0 0) 0x7f97b40cf610 con 0x7f97c0101de0 2024-09-12T02:37:47.102 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:37:47.100+0000 7f97c5400640 1 --2- 172.21.15.39:0/3381383646 >> [v2:172.21.15.39:6800/1725006999,v1:172.21.15.39:6801/1725006999] conn(0x7f97a80a2b80 0x7f97a80a5040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:37:47.102 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:37:47.100+0000 7f97b2600640 1 -- 172.21.15.39:0/889795422 <== mon.0 v2:172.21.15.39:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f97b8003c30 con 0x56009eece330 2024-09-12T02:37:47.102 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:37:47.100+0000 7f97b2600640 1 -- 172.21.15.39:0/889795422 <== mon.0 v2:172.21.15.39:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f97b800fe80 con 0x56009eece330 2024-09-12T02:37:47.102 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:37:47.100+0000 7f97b2600640 1 -- 172.21.15.39:0/889795422 <== mon.0 v2:172.21.15.39:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f97b80193e0 con 0x56009eece330 2024-09-12T02:37:47.104 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:37:47.101+0000 7f97ca9fa740 1 -- 172.21.15.39:0/889795422 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x56009eece330 msgr2=0x56009eece710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:37:47.104 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:37:47.101+0000 7f97c5400640 1 --2- 172.21.15.39:0/3381383646 >> [v2:172.21.15.39:6800/1725006999,v1:172.21.15.39:6801/1725006999] conn(0x7f97a80a2b80 0x7f97a80a5040 secure :-1 s=READY pgs=229 cs=0 l=1 rev1=1 crypto rx=0x7f97b4098460 tx=0x7f97b40d50e0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:37:47.104 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:37:47.101+0000 7f97ca9fa740 1 --2- 172.21.15.39:0/889795422 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x56009eece330 0x56009eece710 secure :-1 s=READY pgs=276 cs=0 l=1 rev1=1 crypto rx=0x7f97b8011790 tx=0x7f97b8011c50 comp rx=0 tx=0).stop 2024-09-12T02:37:47.104 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:37:47.101+0000 7f97ca9fa740 1 -- 172.21.15.39:0/889795422 shutdown_connections 2024-09-12T02:37:47.104 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:37:47.101+0000 7f97ca9fa740 1 --2- 172.21.15.39:0/889795422 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x56009eed9510 0x56009eedb900 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:37:47.104 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:37:47.101+0000 7f97ca9fa740 1 --2- 172.21.15.39:0/889795422 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x56009eecec50 0x56009eed8fd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:37:47.104 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:37:47.101+0000 7f97ca9fa740 1 --2- 172.21.15.39:0/889795422 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x56009eece330 0x56009eece710 unknown :-1 s=CLOSED pgs=276 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:37:47.104 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:37:47.101+0000 7f97ca9fa740 1 -- 172.21.15.39:0/889795422 >> 172.21.15.39:0/889795422 conn(0x56009eeca8c0 msgr2=0x56009eecaca0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:37:47.105 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:37:47.101+0000 7f97ca9fa740 1 -- 172.21.15.39:0/889795422 shutdown_connections 2024-09-12T02:37:47.105 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:37:47.101+0000 7f97ca9fa740 1 -- 172.21.15.39:0/889795422 wait complete. 2024-09-12T02:37:47.105 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:37:47.102+0000 7f97ca9fa740 1 -- start start 2024-09-12T02:37:47.105 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:37:47.102+0000 7f97ca9fa740 1 Processor -- start 2024-09-12T02:37:47.105 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:37:47.103+0000 7f97ca9fa740 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x56009eece330 0x56009eedda70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:37:47.105 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:37:47.103+0000 7f97ca9fa740 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x56009eecec50 0x56009eeddfb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:37:47.105 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:37:47.103+0000 7f97ca9fa740 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x56009eed9510 0x56009eee2120 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:37:47.105 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:37:47.103+0000 7f97ca9fa740 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 -- 0x56009eedc060 con 0x56009eecec50 2024-09-12T02:37:47.105 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:37:47.103+0000 7f97ca9fa740 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x56009edbc920 con 0x56009eece330 2024-09-12T02:37:47.106 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:37:47.103+0000 7f97ca9fa740 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x56009eedc1e0 con 0x56009eed9510 2024-09-12T02:37:47.106 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:37:47.103+0000 7f97ca9fa740 10 client.0 _ll_register_callbacks cb 0x56009ede08a0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-12T02:37:47.106 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:37:47.103+0000 7f97c4a00640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x56009eecec50 0x56009eeddfb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:37:47.106 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:37:47.103+0000 7f97c5e00640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x56009eece330 0x56009eedda70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:37:47.106 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:37:47.103+0000 7f97c4a00640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x56009eecec50 0x56009eeddfb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.39:3300/0 says I am v2:172.21.15.39:55974/0 (socket says 172.21.15.39:55974) 2024-09-12T02:37:47.106 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:37:47.103+0000 7f97c4a00640 1 -- 172.21.15.39:0/2135336682 learned_addr learned my addr 172.21.15.39:0/2135336682 (peer_addr_for_me v2:172.21.15.39:0/0) 2024-09-12T02:37:47.106 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:37:47.103+0000 7f97c5e00640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x56009eece330 0x56009eedda70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.39:44336/0 (socket says 172.21.15.39:44336) 2024-09-12T02:37:47.106 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:37:47.103+0000 7f97c5e00640 1 --2- 172.21.15.39:0/2135336682 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x56009eed9510 0x56009eee2120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:37:47.108 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:37:47.103+0000 7f97c4a00640 1 -- 172.21.15.39:0/2135336682 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x56009eed9510 msgr2=0x56009eee2120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:37:47.108 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:37:47.103+0000 7f97c4a00640 1 --2- 172.21.15.39:0/2135336682 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x56009eed9510 0x56009eee2120 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:37:47.108 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:37:47.104+0000 7f97c4a00640 1 -- 172.21.15.39:0/2135336682 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x56009eece330 msgr2=0x56009eedda70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:37:47.108 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:37:47.104+0000 7f97c4a00640 1 --2- 172.21.15.39:0/2135336682 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x56009eece330 0x56009eedda70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:37:47.108 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:37:47.104+0000 7f97c4a00640 1 -- 172.21.15.39:0/2135336682 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({osdmap=0}) -- 0x56009eba52b0 con 0x56009eecec50 2024-09-12T02:37:47.108 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:37:47.104+0000 7f97c5e00640 1 --2- 172.21.15.39:0/2135336682 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x56009eed9510 0x56009eee2120 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-12T02:37:47.108 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:37:47.104+0000 7f97c4a00640 1 --2- 172.21.15.39:0/2135336682 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x56009eecec50 0x56009eeddfb0 secure :-1 s=READY pgs=277 cs=0 l=1 rev1=1 crypto rx=0x7f97ac02a910 tx=0x7f97ac0317e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9bacbecb6593b48d server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:37:47.109 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:37:47.104+0000 7f97a6a00640 10 client.0 ms_handle_connect on v2:172.21.15.39:3300/0 2024-09-12T02:37:47.109 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:37:47.104+0000 7f97a6a00640 1 -- 172.21.15.39:0/2135336682 <== mon.0 v2:172.21.15.39:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f97ac035040 con 0x56009eecec50 2024-09-12T02:37:47.109 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:37:47.104+0000 7f97ca9fa740 1 -- 172.21.15.39:0/2135336682 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x56009ee41620 con 0x56009eecec50 2024-09-12T02:37:47.109 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:37:47.104+0000 7f97a6a00640 1 -- 172.21.15.39:0/2135336682 <== mon.0 v2:172.21.15.39:3300/0 2 ==== osd_map(95..95 src has 1..95) ==== 9129+0+0 (secure 0 0 0) 0x7f97ac004240 con 0x56009eecec50 2024-09-12T02:37:47.109 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:37:47.105+0000 7f97a6a00640 1 -- 172.21.15.39:0/2135336682 <== mon.0 v2:172.21.15.39:3300/0 3 ==== mon_get_version_reply(handle=1 version=28) ==== 24+0+0 (secure 0 0 0) 0x7f97ac004440 con 0x56009eecec50 2024-09-12T02:37:47.109 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:37:47.105+0000 7f97ca9fa740 10 client.15189 fetch_fsmap learned FSMap version 28 2024-09-12T02:37:47.109 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:37:47.105+0000 7f97ca9fa740 1 -- 172.21.15.39:0/2135336682 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({config=0+,fsmap=28,monmap=4+}) -- 0x56009eeec270 con 0x56009eecec50 2024-09-12T02:37:47.109 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:37:47.105+0000 7f97a6a00640 1 -- 172.21.15.39:0/2135336682 <== mon.0 v2:172.21.15.39:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x56009ee41620 con 0x56009eecec50 2024-09-12T02:37:47.109 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:37:47.105+0000 7f97a6a00640 1 -- 172.21.15.39:0/2135336682 <== mon.0 v2:172.21.15.39:3300/0 5 ==== fsmap(e 28) ==== 8370+0+0 (secure 0 0 0) 0x7f97ac004b80 con 0x56009eecec50 2024-09-12T02:37:47.109 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:37:47.105+0000 7f97ca9fa740 10 client.15189 fetch_fsmap finished waiting for FSMap version 28 2024-09-12T02:37:47.109 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:37:47.105+0000 7f97ca9fa740 10 client.15189 resolve_mds: resolved name 'b' to daemon mds.b 2024-09-12T02:37:47.109 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:37:47.105+0000 7f97ca9fa740 20 client.15189 populate_metadata read hostname 'smithi039' 2024-09-12T02:37:47.109 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:37:47.105+0000 7f97ca9fa740 1 --2- 172.21.15.39:0/2135336682 >> [v2:172.21.15.44:6838/2556532723,v1:172.21.15.44:6839/2556532723] conn(0x56009eeee820 0x56009eeefc90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:37:47.110 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:37:47.105+0000 7f97ca9fa740 4 client.15189 mds_command: new command op to 24515 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-12T02:37:47.110 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:37:47.105+0000 7f97ca9fa740 1 -- 172.21.15.39:0/2135336682 --> [v2:172.21.15.44:6838/2556532723,v1:172.21.15.44:6839/2556532723] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x56009ee3bb30 con 0x56009eeee820 2024-09-12T02:37:47.110 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:37:47.106+0000 7f97c5e00640 1 --2- 172.21.15.39:0/2135336682 >> [v2:172.21.15.44:6838/2556532723,v1:172.21.15.44:6839/2556532723] conn(0x56009eeee820 0x56009eeefc90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:37:47.110 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:37:47.106+0000 7f97c5e00640 1 --2- 172.21.15.39:0/2135336682 >> [v2:172.21.15.44:6838/2556532723,v1:172.21.15.44:6839/2556532723] conn(0x56009eeee820 0x56009eeefc90 crc :-1 s=READY pgs=30 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=48f096fe32d0f0d6 server_cookie=672092047a2434d4 in_seq=0 out_seq=0 2024-09-12T02:37:47.110 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:37:47.106+0000 7f97a6a00640 10 client.15189 ms_handle_connect on v2:172.21.15.44:6838/2556532723 2024-09-12T02:37:47.110 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:37:47.107+0000 7f97a6a00640 1 -- 172.21.15.39:0/2135336682 <== mds.0 v2:172.21.15.44:6838/2556532723 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x56009ee3bb30 con 0x56009eeee820 2024-09-12T02:37:47.110 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:37:47.107+0000 7f97a6a00640 10 client.15189 handle_command_reply: tid=0 2024-09-12T02:37:47.110 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:37:47.107+0000 7f97ca9fa740 1 client.15189 shutdown 2024-09-12T02:37:47.110 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:37:47.107+0000 7f97ca9fa740 1 -- 172.21.15.39:0/2135336682 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x56009eecec50 msgr2=0x56009eeddfb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:37:47.110 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:37:47.107+0000 7f97ca9fa740 1 --2- 172.21.15.39:0/2135336682 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x56009eecec50 0x56009eeddfb0 secure :-1 s=READY pgs=277 cs=0 l=1 rev1=1 crypto rx=0x7f97ac02a910 tx=0x7f97ac0317e0 comp rx=0 tx=0).stop 2024-09-12T02:37:47.111 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:37:47.107+0000 7f97ca9fa740 1 -- 172.21.15.39:0/2135336682 shutdown_connections 2024-09-12T02:37:47.111 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:37:47.107+0000 7f97ca9fa740 1 --2- 172.21.15.39:0/2135336682 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x56009eed9510 0x56009eee2120 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:37:47.111 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:37:47.107+0000 7f97ca9fa740 1 --2- 172.21.15.39:0/2135336682 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x56009eecec50 0x56009eeddfb0 unknown :-1 s=CLOSED pgs=277 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:37:47.111 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:37:47.107+0000 7f97ca9fa740 1 --2- 172.21.15.39:0/2135336682 >> [v2:172.21.15.44:6838/2556532723,v1:172.21.15.44:6839/2556532723] conn(0x56009eeee820 0x56009eeefc90 crc :-1 s=READY pgs=30 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:37:47.111 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:37:47.107+0000 7f97ca9fa740 1 --2- 172.21.15.39:0/2135336682 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x56009eece330 0x56009eedda70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:37:47.111 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:37:47.107+0000 7f97ca9fa740 1 -- 172.21.15.39:0/2135336682 >> 172.21.15.39:0/2135336682 conn(0x56009eeca8c0 msgr2=0x56009eed05f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:37:47.111 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:37:47.107+0000 7f97a6a00640 0 client.15189 ms_handle_reset on v2:172.21.15.44:6838/2556532723 2024-09-12T02:37:47.111 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:37:47.108+0000 7f97ca9fa740 1 -- 172.21.15.39:0/2135336682 shutdown_connections 2024-09-12T02:37:47.112 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:37:47.108+0000 7f97ca9fa740 1 -- 172.21.15.39:0/2135336682 wait complete. 2024-09-12T02:37:47.112 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:37:47.108+0000 7f97ca9fa740 20 client.15189 trim_cache size 0 max 16384 2024-09-12T02:37:47.128 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:37:47.127+0000 7f97ca9fa740 1 Processor -- start 2024-09-12T02:37:47.128 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:37:47.127+0000 7f97ca9fa740 1 -- start start 2024-09-12T02:37:47.128 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:37:47.127+0000 7f97ca9fa740 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x56009eece330 0x56009eee2110 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:37:47.128 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:37:47.127+0000 7f97ca9fa740 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x56009eecec50 0x56009eedc060 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:37:47.128 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:37:47.127+0000 7f97ca9fa740 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x56009eed9510 0x56009eedc5a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:37:47.128 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:37:47.127+0000 7f97ca9fa740 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 -- 0x56009eeedfd0 con 0x56009eecec50 2024-09-12T02:37:47.128 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:37:47.127+0000 7f97ca9fa740 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x56009eeee6a0 con 0x56009eed9510 2024-09-12T02:37:47.128 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:37:47.127+0000 7f97ca9fa740 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x56009eeeed70 con 0x56009eece330 2024-09-12T02:37:47.129 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:37:47.128+0000 7f97c4a00640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x56009eecec50 0x56009eedc060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:37:47.130 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:37:47.128+0000 7f97c4a00640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x56009eecec50 0x56009eedc060 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.39:3300/0 says I am v2:172.21.15.39:55984/0 (socket says 172.21.15.39:55984) 2024-09-12T02:37:47.130 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:37:47.128+0000 7f97c4a00640 1 -- 172.21.15.39:0/2761287442 learned_addr learned my addr 172.21.15.39:0/2761287442 (peer_addr_for_me v2:172.21.15.39:0/0) 2024-09-12T02:37:47.130 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:37:47.128+0000 7f97c5e00640 1 --2- 172.21.15.39:0/2761287442 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x56009eed9510 0x56009eedc5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:37:47.130 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:37:47.128+0000 7f97c5e00640 1 --2- 172.21.15.39:0/2761287442 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x56009eece330 0x56009eee2110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:37:47.130 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:37:47.128+0000 7f97c4a00640 1 -- 172.21.15.39:0/2761287442 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x56009eece330 msgr2=0x56009eee2110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:37:47.130 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:37:47.128+0000 7f97c4a00640 1 --2- 172.21.15.39:0/2761287442 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x56009eece330 0x56009eee2110 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:37:47.130 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:37:47.128+0000 7f97c4a00640 1 -- 172.21.15.39:0/2761287442 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x56009eed9510 msgr2=0x56009eedc5a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:37:47.130 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:37:47.128+0000 7f97c4a00640 1 --2- 172.21.15.39:0/2761287442 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x56009eed9510 0x56009eedc5a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:37:47.130 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:37:47.128+0000 7f97c4a00640 1 -- 172.21.15.39:0/2761287442 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x56009eed8fb0 con 0x56009eecec50 2024-09-12T02:37:47.130 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:37:47.128+0000 7f97c5e00640 1 --2- 172.21.15.39:0/2761287442 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x56009eed9510 0x56009eedc5a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-12T02:37:47.130 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:37:47.128+0000 7f97c4a00640 1 --2- 172.21.15.39:0/2761287442 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x56009eecec50 0x56009eedc060 secure :-1 s=READY pgs=278 cs=0 l=1 rev1=1 crypto rx=0x7f97ac0096c0 tx=0x7f97ac02a3f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=83409d700142737 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:37:47.130 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:37:47.129+0000 7f97b1c00640 1 -- 172.21.15.39:0/2761287442 <== mon.0 v2:172.21.15.39:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f97ac035030 con 0x56009eecec50 2024-09-12T02:37:47.130 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:37:47.129+0000 7f97b1c00640 1 -- 172.21.15.39:0/2761287442 <== mon.0 v2:172.21.15.39:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f97ac003930 con 0x56009eecec50 2024-09-12T02:37:47.131 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:37:47.129+0000 7f97b1c00640 1 -- 172.21.15.39:0/2761287442 <== mon.0 v2:172.21.15.39:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f97ac000e60 con 0x56009eecec50 2024-09-12T02:37:47.133 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:37:47.129+0000 7f97ca9fa740 1 -- 172.21.15.39:0/2761287442 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x56009eecec50 msgr2=0x56009eedc060 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:37:47.133 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:37:47.129+0000 7f97ca9fa740 1 --2- 172.21.15.39:0/2761287442 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x56009eecec50 0x56009eedc060 secure :-1 s=READY pgs=278 cs=0 l=1 rev1=1 crypto rx=0x7f97ac0096c0 tx=0x7f97ac02a3f0 comp rx=0 tx=0).stop 2024-09-12T02:37:47.133 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:37:47.129+0000 7f97ca9fa740 1 -- 172.21.15.39:0/2761287442 shutdown_connections 2024-09-12T02:37:47.133 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:37:47.129+0000 7f97ca9fa740 1 --2- 172.21.15.39:0/2761287442 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x56009eed9510 0x56009eedc5a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:37:47.133 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:37:47.129+0000 7f97ca9fa740 1 --2- 172.21.15.39:0/2761287442 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x56009eecec50 0x56009eedc060 unknown :-1 s=CLOSED pgs=278 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:37:47.133 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:37:47.129+0000 7f97ca9fa740 1 --2- 172.21.15.39:0/2761287442 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x56009eece330 0x56009eee2110 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:37:47.134 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:37:47.129+0000 7f97ca9fa740 1 -- 172.21.15.39:0/2761287442 >> 172.21.15.39:0/2761287442 conn(0x56009eeca8c0 msgr2=0x56009eedda70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:37:47.134 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:37:47.130+0000 7f97ca9fa740 1 -- 172.21.15.39:0/2761287442 shutdown_connections 2024-09-12T02:37:47.134 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:37:47.130+0000 7f97ca9fa740 1 -- 172.21.15.39:0/2761287442 wait complete. 2024-09-12T02:37:47.134 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:37:47.130+0000 7f97ca9fa740 1 -- start start 2024-09-12T02:37:47.134 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:37:47.130+0000 7f97ca9fa740 1 Processor -- start 2024-09-12T02:37:47.134 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:37:47.131+0000 7f97ca9fa740 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x56009eece330 0x56009eed7420 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:37:47.134 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:37:47.131+0000 7f97ca9fa740 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x56009eecec50 0x56009eed7960 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:37:47.134 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:37:47.131+0000 7f97ca9fa740 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x56009eed9510 0x56009eed7ea0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:37:47.134 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:37:47.131+0000 7f97ca9fa740 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 -- 0x56009eeefb10 con 0x56009eece330 2024-09-12T02:37:47.134 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:37:47.131+0000 7f97ca9fa740 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x56009eeef440 con 0x56009eecec50 2024-09-12T02:37:47.134 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:37:47.131+0000 7f97ca9fa740 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x56009eef01e0 con 0x56009eed9510 2024-09-12T02:37:47.134 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:37:47.131+0000 7f97ca9fa740 10 client.0 _ll_register_callbacks cb 0x7f97ac005d50 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-12T02:37:47.134 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:37:47.131+0000 7f97c5e00640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x56009eece330 0x56009eed7420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:37:47.135 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:37:47.131+0000 7f97c5e00640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x56009eece330 0x56009eed7420 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.39:3300/0 says I am v2:172.21.15.39:55998/0 (socket says 172.21.15.39:55998) 2024-09-12T02:37:47.135 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:37:47.131+0000 7f97c5e00640 1 -- 172.21.15.39:0/40143253 learned_addr learned my addr 172.21.15.39:0/40143253 (peer_addr_for_me v2:172.21.15.39:0/0) 2024-09-12T02:37:47.135 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:37:47.131+0000 7f97c4a00640 1 --2- 172.21.15.39:0/40143253 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x56009eecec50 0x56009eed7960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:37:47.135 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:37:47.131+0000 7f97c5e00640 1 --2- 172.21.15.39:0/40143253 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x56009eed9510 0x56009eed7ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:37:47.135 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:37:47.131+0000 7f97c4a00640 1 -- 172.21.15.39:0/40143253 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x56009eed9510 msgr2=0x56009eed7ea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:37:47.135 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:37:47.131+0000 7f97c4a00640 1 --2- 172.21.15.39:0/40143253 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x56009eed9510 0x56009eed7ea0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:37:47.135 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:37:47.131+0000 7f97c4a00640 1 -- 172.21.15.39:0/40143253 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x56009eece330 msgr2=0x56009eed7420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:37:47.135 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:37:47.131+0000 7f97c4a00640 1 --2- 172.21.15.39:0/40143253 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x56009eece330 0x56009eed7420 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:37:47.135 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:37:47.132+0000 7f97c4a00640 1 -- 172.21.15.39:0/40143253 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({osdmap=0}) -- 0x56009eee7e50 con 0x56009eecec50 2024-09-12T02:37:47.135 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:37:47.132+0000 7f97c5e00640 1 --2- 172.21.15.39:0/40143253 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x56009eece330 0x56009eed7420 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-12T02:37:47.135 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:37:47.132+0000 7f97c4a00640 1 --2- 172.21.15.39:0/40143253 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x56009eecec50 0x56009eed7960 secure :-1 s=READY pgs=123 cs=0 l=1 rev1=1 crypto rx=0x56009eef0650 tx=0x7f97ac005270 comp rx=0 tx=0).ready entity=mon.2 client_cookie=30517baa29d67200 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:37:47.135 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:37:47.132+0000 7f97a6a00640 10 client.0 ms_handle_connect on v2:172.21.15.44:3300/0 2024-09-12T02:37:47.135 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:37:47.132+0000 7f97a6a00640 1 -- 172.21.15.39:0/40143253 <== mon.2 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f97ac035040 con 0x56009eecec50 2024-09-12T02:37:47.136 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:37:47.132+0000 7f97ca9fa740 1 -- 172.21.15.39:0/40143253 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f97ac003930 con 0x56009eecec50 2024-09-12T02:37:47.136 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:37:47.132+0000 7f97a6a00640 1 -- 172.21.15.39:0/40143253 <== mon.2 v2:172.21.15.44:3300/0 2 ==== osd_map(95..95 src has 1..95) ==== 9129+0+0 (secure 0 0 0) 0x7f97ac0055f0 con 0x56009eecec50 2024-09-12T02:37:47.136 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:37:47.132+0000 7f97a6a00640 1 -- 172.21.15.39:0/40143253 <== mon.2 v2:172.21.15.44:3300/0 3 ==== mon_get_version_reply(handle=1 version=28) ==== 24+0+0 (secure 0 0 0) 0x7f97ac068050 con 0x56009eecec50 2024-09-12T02:37:47.136 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:37:47.132+0000 7f97ca9fa740 10 client.25178 fetch_fsmap learned FSMap version 28 2024-09-12T02:37:47.136 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:37:47.132+0000 7f97ca9fa740 1 -- 172.21.15.39:0/40143253 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,fsmap=28,monmap=4+}) -- 0x56009ef59150 con 0x56009eecec50 2024-09-12T02:37:47.136 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:37:47.133+0000 7f97a6a00640 1 -- 172.21.15.39:0/40143253 <== mon.2 v2:172.21.15.44:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f97ac003930 con 0x56009eecec50 2024-09-12T02:37:47.137 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:37:47.133+0000 7f97a6a00640 1 -- 172.21.15.39:0/40143253 <== mon.2 v2:172.21.15.44:3300/0 5 ==== fsmap(e 28) ==== 8370+0+0 (secure 0 0 0) 0x7f97ac003ed0 con 0x56009eecec50 2024-09-12T02:37:47.137 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:37:47.133+0000 7f97ca9fa740 10 client.25178 fetch_fsmap finished waiting for FSMap version 28 2024-09-12T02:37:47.138 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:37:47.133+0000 7f97ca9fa740 10 client.25178 resolve_mds: resolved name 'b' to daemon mds.b 2024-09-12T02:37:47.138 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:37:47.133+0000 7f97ca9fa740 20 client.25178 populate_metadata read hostname 'smithi039' 2024-09-12T02:37:47.138 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:37:47.133+0000 7f97ca9fa740 1 --2- 172.21.15.39:0/40143253 >> [v2:172.21.15.44:6838/2556532723,v1:172.21.15.44:6839/2556532723] conn(0x56009ef5d8d0 0x56009ef5c5e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:37:47.138 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:37:47.133+0000 7f97ca9fa740 4 client.25178 mds_command: new command op to 24515 tid=0 multi_id=0 [{"prefix": "status"}] 2024-09-12T02:37:47.138 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:37:47.133+0000 7f97ca9fa740 1 -- 172.21.15.39:0/40143253 --> [v2:172.21.15.44:6838/2556532723,v1:172.21.15.44:6839/2556532723] -- command(tid 0: {"prefix": "status"}) -- 0x56009edb7f80 con 0x56009ef5d8d0 2024-09-12T02:37:47.138 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:37:47.133+0000 7f97c5e00640 1 --2- 172.21.15.39:0/40143253 >> [v2:172.21.15.44:6838/2556532723,v1:172.21.15.44:6839/2556532723] conn(0x56009ef5d8d0 0x56009ef5c5e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:37:47.138 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:37:47.134+0000 7f97c5e00640 1 --2- 172.21.15.39:0/40143253 >> [v2:172.21.15.44:6838/2556532723,v1:172.21.15.44:6839/2556532723] conn(0x56009ef5d8d0 0x56009ef5c5e0 crc :-1 s=READY pgs=31 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=768480f7904dafdb server_cookie=1da5e54776483d3b in_seq=0 out_seq=0 2024-09-12T02:37:47.138 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:37:47.134+0000 7f97a6a00640 10 client.25178 ms_handle_connect on v2:172.21.15.44:6838/2556532723 2024-09-12T02:37:47.138 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:37:47.134+0000 7f97a6a00640 1 -- 172.21.15.39:0/40143253 <== mds.0 v2:172.21.15.44:6838/2556532723 1 ==== command_reply(tid 0: 0 ) ==== 8+0+332 (crc 0 0 0) 0x56009edb7f80 con 0x56009ef5d8d0 2024-09-12T02:37:47.138 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:37:47.134+0000 7f97a6a00640 10 client.25178 handle_command_reply: tid=0 2024-09-12T02:37:47.138 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:37:47.134+0000 7f97ca9fa740 1 client.25178 shutdown 2024-09-12T02:37:47.138 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:37:47.134+0000 7f97ca9fa740 1 -- 172.21.15.39:0/40143253 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x56009eecec50 msgr2=0x56009eed7960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:37:47.138 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:37:47.134+0000 7f97ca9fa740 1 --2- 172.21.15.39:0/40143253 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x56009eecec50 0x56009eed7960 secure :-1 s=READY pgs=123 cs=0 l=1 rev1=1 crypto rx=0x56009eef0650 tx=0x7f97ac005270 comp rx=0 tx=0).stop 2024-09-12T02:37:47.139 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:37:47.134+0000 7f97ca9fa740 1 -- 172.21.15.39:0/40143253 shutdown_connections 2024-09-12T02:37:47.139 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:37:47.134+0000 7f97ca9fa740 1 --2- 172.21.15.39:0/40143253 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x56009eed9510 0x56009eed7ea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:37:47.139 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:37:47.134+0000 7f97ca9fa740 1 --2- 172.21.15.39:0/40143253 >> [v2:172.21.15.44:6838/2556532723,v1:172.21.15.44:6839/2556532723] conn(0x56009ef5d8d0 0x56009ef5c5e0 crc :-1 s=READY pgs=31 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:37:47.139 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:37:47.134+0000 7f97ca9fa740 1 --2- 172.21.15.39:0/40143253 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x56009eecec50 0x56009eed7960 unknown :-1 s=CLOSED pgs=123 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:37:47.139 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:37:47.134+0000 7f97ca9fa740 1 --2- 172.21.15.39:0/40143253 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x56009eece330 0x56009eed7420 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:37:47.139 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:37:47.134+0000 7f97a6a00640 0 client.25178 ms_handle_reset on v2:172.21.15.44:6838/2556532723 2024-09-12T02:37:47.139 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:37:47.134+0000 7f97ca9fa740 1 -- 172.21.15.39:0/40143253 >> 172.21.15.39:0/40143253 conn(0x56009eeca8c0 msgr2=0x56009eedc060 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:37:47.139 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:37:47.135+0000 7f97ca9fa740 1 -- 172.21.15.39:0/40143253 shutdown_connections 2024-09-12T02:37:47.139 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:37:47.135+0000 7f97ca9fa740 1 -- 172.21.15.39:0/40143253 wait complete. 2024-09-12T02:37:47.139 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:37:47.135+0000 7f97ca9fa740 20 client.25178 trim_cache size 0 max 16384 2024-09-12T02:37:47.139 INFO:teuthology.orchestra.run.smithi039.stdout:{ 2024-09-12T02:37:47.139 INFO:teuthology.orchestra.run.smithi039.stdout: "cluster_fsid": "4954ed46-70ae-11ef-bcea-c7b262605968", 2024-09-12T02:37:47.140 INFO:teuthology.orchestra.run.smithi039.stdout: "whoami": 0, 2024-09-12T02:37:47.140 INFO:teuthology.orchestra.run.smithi039.stdout: "id": 24515, 2024-09-12T02:37:47.140 INFO:teuthology.orchestra.run.smithi039.stdout: "want_state": "up:active", 2024-09-12T02:37:47.140 INFO:teuthology.orchestra.run.smithi039.stdout: "state": "up:active", 2024-09-12T02:37:47.140 INFO:teuthology.orchestra.run.smithi039.stdout: "fs_name": "cephfs", 2024-09-12T02:37:47.140 INFO:teuthology.orchestra.run.smithi039.stdout: "rank_uptime": 162.63277695900001, 2024-09-12T02:37:47.140 INFO:teuthology.orchestra.run.smithi039.stdout: "mdsmap_epoch": 28, 2024-09-12T02:37:47.140 INFO:teuthology.orchestra.run.smithi039.stdout: "osdmap_epoch": 95, 2024-09-12T02:37:47.140 INFO:teuthology.orchestra.run.smithi039.stdout: "osdmap_epoch_barrier": 93, 2024-09-12T02:37:47.140 INFO:teuthology.orchestra.run.smithi039.stdout: "uptime": 174.93627138400001 2024-09-12T02:37:47.140 INFO:teuthology.orchestra.run.smithi039.stdout:} 2024-09-12T02:37:47.141 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:37:47.135+0000 7f97c7e00640 1 -- 172.21.15.39:0/3381383646 >> [v2:172.21.15.39:6800/1725006999,v1:172.21.15.39:6801/1725006999] conn(0x7f97a80a2b80 msgr2=0x7f97a80a5040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:37:47.141 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:37:47.135+0000 7f97c7e00640 1 --2- 172.21.15.39:0/3381383646 >> [v2:172.21.15.39:6800/1725006999,v1:172.21.15.39:6801/1725006999] conn(0x7f97a80a2b80 0x7f97a80a5040 secure :-1 s=READY pgs=229 cs=0 l=1 rev1=1 crypto rx=0x7f97b4098460 tx=0x7f97b40d50e0 comp rx=0 tx=0).stop 2024-09-12T02:37:47.141 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:37:47.136+0000 7f97c7e00640 1 -- 172.21.15.39:0/3381383646 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f97c0101de0 msgr2=0x7f97c0198430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:37:47.141 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:37:47.136+0000 7f97c7e00640 1 --2- 172.21.15.39:0/3381383646 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f97c0101de0 0x7f97c0198430 secure :-1 s=READY pgs=275 cs=0 l=1 rev1=1 crypto rx=0x7f97b400ea60 tx=0x7f97b400ef20 comp rx=0 tx=0).stop 2024-09-12T02:37:47.141 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:37:47.136+0000 7f97c7e00640 1 -- 172.21.15.39:0/3381383646 shutdown_connections 2024-09-12T02:37:47.141 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:37:47.136+0000 7f97c7e00640 1 --2- 172.21.15.39:0/3381383646 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f97c0106f10 0x7f97c019cd00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:37:47.141 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:37:47.136+0000 7f97c7e00640 1 --2- 172.21.15.39:0/3381383646 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f97c0102790 0x7f97c0198970 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:37:47.141 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:37:47.136+0000 7f97c7e00640 1 --2- 172.21.15.39:0/3381383646 >> [v2:172.21.15.39:6800/1725006999,v1:172.21.15.39:6801/1725006999] conn(0x7f97a80a2b80 0x7f97a80a5040 unknown :-1 s=CLOSED pgs=229 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:37:47.142 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:37:47.136+0000 7f97c7e00640 1 --2- 172.21.15.39:0/3381383646 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f97c0101de0 0x7f97c0198430 unknown :-1 s=CLOSED pgs=275 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:37:47.142 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:37:47.136+0000 7f97c7e00640 1 -- 172.21.15.39:0/3381383646 >> 172.21.15.39:0/3381383646 conn(0x7f97c00fd8c0 msgr2=0x7f97c00fec30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:37:47.142 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:37:47.136+0000 7f97c7e00640 1 -- 172.21.15.39:0/3381383646 shutdown_connections 2024-09-12T02:37:47.142 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:37:47.136+0000 7f97c7e00640 1 -- 172.21.15.39:0/3381383646 wait complete. 2024-09-12T02:37:48.186 INFO:teuthology.run_tasks:Running task sequential... 2024-09-12T02:37:48.201 INFO:teuthology.task.sequential:In sequential, running task sequential... 2024-09-12T02:37:48.201 INFO:teuthology.task.sequential:In sequential, running task print... 2024-09-12T02:37:48.201 INFO:teuthology.task.print:Enabling mgr modules 2024-09-12T02:37:48.202 INFO:teuthology.task.sequential:In sequential, running task exec... 2024-09-12T02:37:48.202 INFO:teuthology.task.exec:Executing custom commands... 2024-09-12T02:37:48.203 INFO:teuthology.task.exec:Running commands on role mon.a host ubuntu@smithi039.front.sepia.ceph.com 2024-09-12T02:37:48.203 DEBUG:teuthology.orchestra.run.smithi039:> sudo TESTDIR=/home/ubuntu/cephtest bash -c 'ceph mgr module enable snap_schedule' 2024-09-12T02:37:48.359 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:37:48.358+0000 7f61eac00640 1 -- 172.21.15.39:0/1947131057 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f61e4104cf0 msgr2=0x7f61e41070e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:37:48.359 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:37:48.358+0000 7f61eac00640 1 --2- 172.21.15.39:0/1947131057 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f61e4104cf0 0x7f61e41070e0 secure :-1 s=READY pgs=279 cs=0 l=1 rev1=1 crypto rx=0x7f61d0009900 tx=0x7f61d002a410 comp rx=0 tx=0).stop 2024-09-12T02:37:48.359 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:37:48.358+0000 7f61eac00640 1 -- 172.21.15.39:0/1947131057 shutdown_connections 2024-09-12T02:37:48.360 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:37:48.358+0000 7f61eac00640 1 --2- 172.21.15.39:0/1947131057 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f61e4107620 0x7f61e4109a90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:37:48.360 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:37:48.358+0000 7f61eac00640 1 --2- 172.21.15.39:0/1947131057 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f61e4104cf0 0x7f61e41070e0 unknown :-1 s=CLOSED pgs=279 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:37:48.360 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:37:48.358+0000 7f61eac00640 1 --2- 172.21.15.39:0/1947131057 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f61e41023c0 0x7f61e41047b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:37:48.360 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:37:48.358+0000 7f61eac00640 1 -- 172.21.15.39:0/1947131057 >> 172.21.15.39:0/1947131057 conn(0x7f61e40fbfa0 msgr2=0x7f61e40fe3e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:37:48.360 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:37:48.358+0000 7f61eac00640 1 -- 172.21.15.39:0/1947131057 shutdown_connections 2024-09-12T02:37:48.360 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:37:48.358+0000 7f61eac00640 1 -- 172.21.15.39:0/1947131057 wait complete. 2024-09-12T02:37:48.362 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:37:48.359+0000 7f61eac00640 1 Processor -- start 2024-09-12T02:37:48.362 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:37:48.359+0000 7f61eac00640 1 -- start start 2024-09-12T02:37:48.362 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:37:48.360+0000 7f61eac00640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f61e41023c0 0x7f61e4199f40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:37:48.362 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:37:48.360+0000 7f61eac00640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f61e4104cf0 0x7f61e419a480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:37:48.362 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:37:48.360+0000 7f61eac00640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f61e4107620 0x7f61e41a14f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:37:48.363 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:37:48.360+0000 7f61eac00640 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 -- 0x7f61e410d600 con 0x7f61e4104cf0 2024-09-12T02:37:48.363 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:37:48.360+0000 7f61eac00640 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x7f61e410d480 con 0x7f61e41023c0 2024-09-12T02:37:48.363 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:37:48.360+0000 7f61eac00640 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7f61e410d780 con 0x7f61e4107620 2024-09-12T02:37:48.363 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:37:48.360+0000 7f61e8e00640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f61e4104cf0 0x7f61e419a480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:37:48.363 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:37:48.360+0000 7f61e8e00640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f61e4104cf0 0x7f61e419a480 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.39:3300/0 says I am v2:172.21.15.39:50236/0 (socket says 172.21.15.39:50236) 2024-09-12T02:37:48.363 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:37:48.360+0000 7f61e8e00640 1 -- 172.21.15.39:0/516863180 learned_addr learned my addr 172.21.15.39:0/516863180 (peer_addr_for_me v2:172.21.15.39:0/0) 2024-09-12T02:37:48.363 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:37:48.360+0000 7f61ea200640 1 --2- 172.21.15.39:0/516863180 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f61e4107620 0x7f61e41a14f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:37:48.363 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:37:48.360+0000 7f61e9800640 1 --2- 172.21.15.39:0/516863180 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f61e41023c0 0x7f61e4199f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:37:48.363 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:37:48.361+0000 7f61e8e00640 1 -- 172.21.15.39:0/516863180 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f61e4107620 msgr2=0x7f61e41a14f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:37:48.363 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:37:48.361+0000 7f61e8e00640 1 --2- 172.21.15.39:0/516863180 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f61e4107620 0x7f61e41a14f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:37:48.363 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:37:48.361+0000 7f61e8e00640 1 -- 172.21.15.39:0/516863180 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f61e41023c0 msgr2=0x7f61e4199f40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:37:48.363 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:37:48.361+0000 7f61e8e00640 1 --2- 172.21.15.39:0/516863180 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f61e41023c0 0x7f61e4199f40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:37:48.363 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:37:48.361+0000 7f61e8e00640 1 -- 172.21.15.39:0/516863180 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f61e41a1b60 con 0x7f61e4104cf0 2024-09-12T02:37:48.364 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:37:48.361+0000 7f61e8e00640 1 --2- 172.21.15.39:0/516863180 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f61e4104cf0 0x7f61e419a480 secure :-1 s=READY pgs=280 cs=0 l=1 rev1=1 crypto rx=0x7f61d0031610 tx=0x7f61d0004270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:37:48.364 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:37:48.361+0000 7f61e2000640 1 -- 172.21.15.39:0/516863180 <== mon.0 v2:172.21.15.39:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f61d003f030 con 0x7f61e4104cf0 2024-09-12T02:37:48.364 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:37:48.361+0000 7f61eac00640 1 -- 172.21.15.39:0/516863180 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f61e41a1df0 con 0x7f61e4104cf0 2024-09-12T02:37:48.364 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:37:48.361+0000 7f61e2000640 1 -- 172.21.15.39:0/516863180 <== mon.0 v2:172.21.15.39:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f61d0003ad0 con 0x7f61e4104cf0 2024-09-12T02:37:48.364 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:37:48.361+0000 7f61e2000640 1 -- 172.21.15.39:0/516863180 <== mon.0 v2:172.21.15.39:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f61d0035070 con 0x7f61e4104cf0 2024-09-12T02:37:48.364 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:37:48.361+0000 7f61eac00640 1 -- 172.21.15.39:0/516863180 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f61e41a2260 con 0x7f61e4104cf0 2024-09-12T02:37:48.364 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:37:48.362+0000 7f61eac00640 1 -- 172.21.15.39:0/516863180 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f61e4109190 con 0x7f61e4104cf0 2024-09-12T02:37:48.365 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:37:48.364+0000 7f61e2000640 1 -- 172.21.15.39:0/516863180 <== mon.0 v2:172.21.15.39:3300/0 4 ==== mgrmap(e 18) ==== 137833+0+0 (secure 0 0 0) 0x7f61d0042030 con 0x7f61e4104cf0 2024-09-12T02:37:48.366 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:37:48.365+0000 7f61e2000640 1 --2- 172.21.15.39:0/516863180 >> [v2:172.21.15.39:6800/1725006999,v1:172.21.15.39:6801/1725006999] conn(0x7f61cc0a2c00 0x7f61cc0a50c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:37:48.366 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:37:48.365+0000 7f61e2000640 1 -- 172.21.15.39:0/516863180 <== mon.0 v2:172.21.15.39:3300/0 5 ==== osd_map(95..95 src has 1..95) ==== 9129+0+0 (secure 0 0 0) 0x7f61d00ef930 con 0x7f61e4104cf0 2024-09-12T02:37:48.366 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:37:48.366+0000 7f61e9800640 1 --2- 172.21.15.39:0/516863180 >> [v2:172.21.15.39:6800/1725006999,v1:172.21.15.39:6801/1725006999] conn(0x7f61cc0a2c00 0x7f61cc0a50c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:37:48.367 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:37:48.366+0000 7f61e9800640 1 --2- 172.21.15.39:0/516863180 >> [v2:172.21.15.39:6800/1725006999,v1:172.21.15.39:6801/1725006999] conn(0x7f61cc0a2c00 0x7f61cc0a50c0 secure :-1 s=READY pgs=230 cs=0 l=1 rev1=1 crypto rx=0x7f61d8005fd0 tx=0x7f61d8009500 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:37:48.370 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:37:48.369+0000 7f61e2000640 1 -- 172.21.15.39:0/516863180 <== mon.0 v2:172.21.15.39:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7f61d00bbe60 con 0x7f61e4104cf0 2024-09-12T02:37:48.603 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:37:48.603+0000 7f61eac00640 1 -- 172.21.15.39:0/516863180 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_command({"prefix": "mgr module enable", "module": "snap_schedule"} v 0) -- 0x7f61e4062e90 con 0x7f61e4104cf0 2024-09-12T02:37:48.948 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 12 02:37:48 smithi044 ceph-mon[35411]: pgmap v386: 129 pgs: 129 active+clean; 646 KiB data, 348 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2024-09-12T02:37:49.013 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 12 02:37:48 smithi172 ceph-mon[35609]: pgmap v386: 129 pgs: 129 active+clean; 646 KiB data, 348 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2024-09-12T02:37:49.099 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 02:37:48 smithi039 ceph-mon[30515]: pgmap v386: 129 pgs: 129 active+clean; 646 KiB data, 348 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2024-09-12T02:37:49.617 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:37:49.616+0000 7f61e2000640 1 -- 172.21.15.39:0/516863180 <== mon.0 v2:172.21.15.39:3300/0 7 ==== mon_command_ack([{"prefix": "mgr module enable", "module": "snap_schedule"}]=0 v19) ==== 92+0+0 (secure 0 0 0) 0x7f61d00c0160 con 0x7f61e4104cf0 2024-09-12T02:37:49.620 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:37:49.619+0000 7f61eac00640 1 -- 172.21.15.39:0/516863180 >> [v2:172.21.15.39:6800/1725006999,v1:172.21.15.39:6801/1725006999] conn(0x7f61cc0a2c00 msgr2=0x7f61cc0a50c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:37:49.620 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:37:49.619+0000 7f61eac00640 1 --2- 172.21.15.39:0/516863180 >> [v2:172.21.15.39:6800/1725006999,v1:172.21.15.39:6801/1725006999] conn(0x7f61cc0a2c00 0x7f61cc0a50c0 secure :-1 s=READY pgs=230 cs=0 l=1 rev1=1 crypto rx=0x7f61d8005fd0 tx=0x7f61d8009500 comp rx=0 tx=0).stop 2024-09-12T02:37:49.620 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:37:49.619+0000 7f61eac00640 1 -- 172.21.15.39:0/516863180 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f61e4104cf0 msgr2=0x7f61e419a480 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:37:49.620 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:37:49.619+0000 7f61eac00640 1 --2- 172.21.15.39:0/516863180 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f61e4104cf0 0x7f61e419a480 secure :-1 s=READY pgs=280 cs=0 l=1 rev1=1 crypto rx=0x7f61d0031610 tx=0x7f61d0004270 comp rx=0 tx=0).stop 2024-09-12T02:37:49.620 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:37:49.619+0000 7f61eac00640 1 -- 172.21.15.39:0/516863180 shutdown_connections 2024-09-12T02:37:49.620 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:37:49.619+0000 7f61eac00640 1 --2- 172.21.15.39:0/516863180 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f61e4107620 0x7f61e41a14f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:37:49.621 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:37:49.619+0000 7f61eac00640 1 --2- 172.21.15.39:0/516863180 >> [v2:172.21.15.39:6800/1725006999,v1:172.21.15.39:6801/1725006999] conn(0x7f61cc0a2c00 0x7f61cc0a50c0 unknown :-1 s=CLOSED pgs=230 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:37:49.621 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:37:49.619+0000 7f61eac00640 1 --2- 172.21.15.39:0/516863180 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f61e4104cf0 0x7f61e419a480 unknown :-1 s=CLOSED pgs=280 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:37:49.621 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:37:49.619+0000 7f61eac00640 1 --2- 172.21.15.39:0/516863180 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f61e41023c0 0x7f61e4199f40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:37:49.621 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:37:49.619+0000 7f61eac00640 1 -- 172.21.15.39:0/516863180 >> 172.21.15.39:0/516863180 conn(0x7f61e40fbfa0 msgr2=0x7f61e4101b40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:37:49.621 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:37:49.619+0000 7f61eac00640 1 -- 172.21.15.39:0/516863180 shutdown_connections 2024-09-12T02:37:49.621 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:37:49.619+0000 7f61eac00640 1 -- 172.21.15.39:0/516863180 wait complete. 2024-09-12T02:37:49.645 INFO:teuthology.run_tasks:Running task kclient... 2024-09-12T02:37:49.660 INFO:tasks.kclient:Mounting kernel clients... 2024-09-12T02:37:49.660 INFO:tasks.kclient:config is {'client.0': {}} 2024-09-12T02:37:49.660 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-12T02:37:49.660 DEBUG:teuthology.orchestra.run.smithi039:> ip netns list 2024-09-12T02:37:49.697 INFO:teuthology.orchestra.run.smithi039.stdout:ceph-ns--home-ubuntu-cephtest-mnt.admin (id: 0) 2024-09-12T02:37:49.699 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-12T02:37:49.699 DEBUG:teuthology.orchestra.run.smithi039:> sudo ip netns delete ceph-ns--home-ubuntu-cephtest-mnt.admin 2024-09-12T02:37:49.802 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-12T02:37:49.802 DEBUG:teuthology.orchestra.run.smithi039:> sudo ip link delete ceph-brx 2024-09-12T02:37:49.882 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 02:37:49 smithi039 ceph-mon[30515]: from='client.? 172.21.15.39:0/516863180' entity='client.admin' cmd=[{"prefix": "mgr module enable", "module": "snap_schedule"}]: dispatch 2024-09-12T02:37:49.882 INFO:journalctl@ceph.mgr.x.smithi039.stdout:Sep 12 02:37:49 smithi039 ceph-4954ed46-70ae-11ef-bcea-c7b262605968-mgr-x[30736]: ignoring --setuser ceph since I am not root 2024-09-12T02:37:49.882 INFO:journalctl@ceph.mgr.x.smithi039.stdout:Sep 12 02:37:49 smithi039 ceph-4954ed46-70ae-11ef-bcea-c7b262605968-mgr-x[30736]: ignoring --setgroup ceph since I am not root 2024-09-12T02:37:49.882 INFO:journalctl@ceph.mgr.x.smithi039.stdout:Sep 12 02:37:49 smithi039 ceph-4954ed46-70ae-11ef-bcea-c7b262605968-mgr-x[30736]: 2024-09-12T02:37:49.880+0000 7fbaf0e1a040 -1 mgr[py] Module osd_perf_query has missing NOTIFY_TYPES member 2024-09-12T02:37:49.948 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 12 02:37:49 smithi044 ceph-mon[35411]: from='client.? 172.21.15.39:0/516863180' entity='client.admin' cmd=[{"prefix": "mgr module enable", "module": "snap_schedule"}]: dispatch 2024-09-12T02:37:49.948 INFO:journalctl@ceph.mgr.y.smithi044.stdout:Sep 12 02:37:49 smithi044 ceph-4954ed46-70ae-11ef-bcea-c7b262605968-mgr-y[36777]: ignoring --setuser ceph since I am not root 2024-09-12T02:37:49.949 INFO:journalctl@ceph.mgr.y.smithi044.stdout:Sep 12 02:37:49 smithi044 ceph-4954ed46-70ae-11ef-bcea-c7b262605968-mgr-y[36777]: ignoring --setgroup ceph since I am not root 2024-09-12T02:37:49.949 INFO:journalctl@ceph.mgr.y.smithi044.stdout:Sep 12 02:37:49 smithi044 ceph-mgr[36781]: -- 172.21.15.44:0/4257941498 <== mon.2 v2:172.21.15.44:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 194+0+0 (secure 0 0 0) 0x55ada67370e0 con 0x55ada6715400 2024-09-12T02:37:49.949 INFO:journalctl@ceph.mgr.y.smithi044.stdout:Sep 12 02:37:49 smithi044 ceph-4954ed46-70ae-11ef-bcea-c7b262605968-mgr-y[36777]: 2024-09-12T02:37:49.776+0000 7feac5ec0040 -1 mgr[py] Module osd_perf_query has missing NOTIFY_TYPES member 2024-09-12T02:37:49.949 INFO:journalctl@ceph.mgr.y.smithi044.stdout:Sep 12 02:37:49 smithi044 ceph-4954ed46-70ae-11ef-bcea-c7b262605968-mgr-y[36777]: 2024-09-12T02:37:49.836+0000 7feac5ec0040 -1 mgr[py] Module osd_support has missing NOTIFY_TYPES member 2024-09-12T02:37:49.975 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 12 02:37:49 smithi172 ceph-mon[35609]: from='client.? 172.21.15.39:0/516863180' entity='client.admin' cmd=[{"prefix": "mgr module enable", "module": "snap_schedule"}]: dispatch 2024-09-12T02:37:49.975 INFO:journalctl@ceph.mgr.z.smithi172.stdout:Sep 12 02:37:49 smithi172 ceph-4954ed46-70ae-11ef-bcea-c7b262605968-mgr-z[37423]: ignoring --setuser ceph since I am not root 2024-09-12T02:37:49.976 INFO:journalctl@ceph.mgr.z.smithi172.stdout:Sep 12 02:37:49 smithi172 ceph-4954ed46-70ae-11ef-bcea-c7b262605968-mgr-z[37423]: ignoring --setgroup ceph since I am not root 2024-09-12T02:37:49.976 INFO:journalctl@ceph.mgr.z.smithi172.stdout:Sep 12 02:37:49 smithi172 ceph-mgr[37427]: -- 172.21.15.172:0/793142486 <== mon.1 v2:172.21.15.172:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 194+0+0 (secure 0 0 0) 0x5567fff690e0 con 0x5567fff47000 2024-09-12T02:37:49.976 INFO:journalctl@ceph.mgr.z.smithi172.stdout:Sep 12 02:37:49 smithi172 ceph-4954ed46-70ae-11ef-bcea-c7b262605968-mgr-z[37423]: 2024-09-12T02:37:49.769+0000 7f7deec28040 -1 mgr[py] Module osd_perf_query has missing NOTIFY_TYPES member 2024-09-12T02:37:49.976 INFO:journalctl@ceph.mgr.z.smithi172.stdout:Sep 12 02:37:49 smithi172 ceph-4954ed46-70ae-11ef-bcea-c7b262605968-mgr-z[37423]: 2024-09-12T02:37:49.828+0000 7f7deec28040 -1 mgr[py] Module osd_support has missing NOTIFY_TYPES member 2024-09-12T02:37:49.976 INFO:journalctl@ceph.mgr.z.smithi172.stdout:Sep 12 02:37:49 smithi172 ceph-4954ed46-70ae-11ef-bcea-c7b262605968-mgr-z[37423]: 2024-09-12T02:37:49.974+0000 7f7deec28040 -1 mgr[py] Module diskprediction_local has missing NOTIFY_TYPES member 2024-09-12T02:37:50.141 INFO:journalctl@ceph.mgr.x.smithi039.stdout:Sep 12 02:37:49 smithi039 ceph-4954ed46-70ae-11ef-bcea-c7b262605968-mgr-x[30736]: 2024-09-12T02:37:49.954+0000 7fbaf0e1a040 -1 mgr[py] Module osd_support has missing NOTIFY_TYPES member 2024-09-12T02:37:50.157 INFO:tasks.kclient:client.0 config is {'mntopts': ['ms_mode=legacy', 'nowsync'], 'syntax': 'v2', 'mount_subvol_num': 1} 2024-09-12T02:37:50.158 INFO:tasks.cephfs.mount:cephfs_mntpt = None 2024-09-12T02:37:50.158 INFO:tasks.cephfs.mount:hostfs_mntpt = /home/ubuntu/cephtest/mnt.0 2024-09-12T02:37:50.158 DEBUG:teuthology.orchestra.run.smithi039:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc shell --fsid 4954ed46-70ae-11ef-bcea-c7b262605968 -- ceph fs ls 2024-09-12T02:37:50.263 INFO:journalctl@ceph.mgr.z.smithi172.stdout:Sep 12 02:37:50 smithi172 ceph-4954ed46-70ae-11ef-bcea-c7b262605968-mgr-z[37423]: 2024-09-12T02:37:50.041+0000 7f7deec28040 -1 mgr[py] Module crash has missing NOTIFY_TYPES member 2024-09-12T02:37:50.263 INFO:journalctl@ceph.mgr.z.smithi172.stdout:Sep 12 02:37:50 smithi172 ceph-4954ed46-70ae-11ef-bcea-c7b262605968-mgr-z[37423]: 2024-09-12T02:37:50.189+0000 7f7deec28040 -1 mgr[py] Module test_orchestrator has missing NOTIFY_TYPES member 2024-09-12T02:37:50.360 INFO:journalctl@ceph.mgr.y.smithi044.stdout:Sep 12 02:37:49 smithi044 ceph-4954ed46-70ae-11ef-bcea-c7b262605968-mgr-y[36777]: 2024-09-12T02:37:49.990+0000 7feac5ec0040 -1 mgr[py] Module diskprediction_local has missing NOTIFY_TYPES member 2024-09-12T02:37:50.360 INFO:journalctl@ceph.mgr.y.smithi044.stdout:Sep 12 02:37:50 smithi044 ceph-4954ed46-70ae-11ef-bcea-c7b262605968-mgr-y[36777]: 2024-09-12T02:37:50.059+0000 7feac5ec0040 -1 mgr[py] Module crash has missing NOTIFY_TYPES member 2024-09-12T02:37:50.360 INFO:journalctl@ceph.mgr.y.smithi044.stdout:Sep 12 02:37:50 smithi044 ceph-4954ed46-70ae-11ef-bcea-c7b262605968-mgr-y[36777]: 2024-09-12T02:37:50.212+0000 7feac5ec0040 -1 mgr[py] Module test_orchestrator has missing NOTIFY_TYPES member 2024-09-12T02:37:50.360 INFO:journalctl@ceph.mgr.y.smithi044.stdout:Sep 12 02:37:50 smithi044 ceph-4954ed46-70ae-11ef-bcea-c7b262605968-mgr-y[36777]: 2024-09-12T02:37:50.359+0000 7feac5ec0040 -1 mgr[py] Module snap_schedule has missing NOTIFY_TYPES member 2024-09-12T02:37:50.421 INFO:journalctl@ceph.mgr.x.smithi039.stdout:Sep 12 02:37:50 smithi039 ceph-4954ed46-70ae-11ef-bcea-c7b262605968-mgr-x[30736]: 2024-09-12T02:37:50.152+0000 7fbaf0e1a040 -1 mgr[py] Module diskprediction_local has missing NOTIFY_TYPES member 2024-09-12T02:37:50.421 INFO:journalctl@ceph.mgr.x.smithi039.stdout:Sep 12 02:37:50 smithi039 ceph-4954ed46-70ae-11ef-bcea-c7b262605968-mgr-x[30736]: 2024-09-12T02:37:50.238+0000 7fbaf0e1a040 -1 mgr[py] Module crash has missing NOTIFY_TYPES member 2024-09-12T02:37:50.554 INFO:teuthology.orchestra.run.smithi039.stderr:Inferring config /var/lib/ceph/4954ed46-70ae-11ef-bcea-c7b262605968/mon.a/config 2024-09-12T02:37:50.622 INFO:journalctl@ceph.mgr.z.smithi172.stdout:Sep 12 02:37:50 smithi172 ceph-4954ed46-70ae-11ef-bcea-c7b262605968-mgr-z[37423]: 2024-09-12T02:37:50.330+0000 7f7deec28040 -1 mgr[py] Module snap_schedule has missing NOTIFY_TYPES member 2024-09-12T02:37:50.701 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 02:37:50 smithi039 ceph-mon[30515]: from='client.? 172.21.15.39:0/516863180' entity='client.admin' cmd='[{"prefix": "mgr module enable", "module": "snap_schedule"}]': finished 2024-09-12T02:37:50.702 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 02:37:50 smithi039 ceph-mon[30515]: mgrmap e19: x(active, since 10m), standbys: z, y 2024-09-12T02:37:50.702 INFO:journalctl@ceph.mgr.x.smithi039.stdout:Sep 12 02:37:50 smithi039 ceph-4954ed46-70ae-11ef-bcea-c7b262605968-mgr-x[30736]: 2024-09-12T02:37:50.419+0000 7fbaf0e1a040 -1 mgr[py] Module test_orchestrator has missing NOTIFY_TYPES member 2024-09-12T02:37:50.702 INFO:journalctl@ceph.mgr.x.smithi039.stdout:Sep 12 02:37:50 smithi039 ceph-4954ed46-70ae-11ef-bcea-c7b262605968-mgr-x[30736]: 2024-09-12T02:37:50.615+0000 7fbaf0e1a040 -1 mgr[py] Module snap_schedule has missing NOTIFY_TYPES member 2024-09-12T02:37:50.894 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 12 02:37:50 smithi172 ceph-mon[35609]: from='client.? 172.21.15.39:0/516863180' entity='client.admin' cmd='[{"prefix": "mgr module enable", "module": "snap_schedule"}]': finished 2024-09-12T02:37:50.894 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 12 02:37:50 smithi172 ceph-mon[35609]: mgrmap e19: x(active, since 10m), standbys: z, y 2024-09-12T02:37:50.894 INFO:journalctl@ceph.mgr.z.smithi172.stdout:Sep 12 02:37:50 smithi172 ceph-4954ed46-70ae-11ef-bcea-c7b262605968-mgr-z[37423]: 2024-09-12T02:37:50.645+0000 7f7deec28040 -1 mgr[py] Module prometheus has missing NOTIFY_TYPES member 2024-09-12T02:37:50.894 INFO:journalctl@ceph.mgr.z.smithi172.stdout:Sep 12 02:37:50 smithi172 ceph-4954ed46-70ae-11ef-bcea-c7b262605968-mgr-z[37423]: 2024-09-12T02:37:50.707+0000 7f7deec28040 -1 mgr[py] Module selftest has missing NOTIFY_TYPES member 2024-09-12T02:37:50.894 INFO:journalctl@ceph.mgr.z.smithi172.stdout:Sep 12 02:37:50 smithi172 ceph-4954ed46-70ae-11ef-bcea-c7b262605968-mgr-z[37423]: 2024-09-12T02:37:50.893+0000 7f7deec28040 -1 mgr[py] Module volumes has missing NOTIFY_TYPES member 2024-09-12T02:37:50.944 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 12 02:37:50 smithi044 ceph-mon[35411]: from='client.? 172.21.15.39:0/516863180' entity='client.admin' cmd='[{"prefix": "mgr module enable", "module": "snap_schedule"}]': finished 2024-09-12T02:37:50.944 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 12 02:37:50 smithi044 ceph-mon[35411]: mgrmap e19: x(active, since 10m), standbys: z, y 2024-09-12T02:37:50.944 INFO:journalctl@ceph.mgr.y.smithi044.stdout:Sep 12 02:37:50 smithi044 ceph-4954ed46-70ae-11ef-bcea-c7b262605968-mgr-y[36777]: 2024-09-12T02:37:50.687+0000 7feac5ec0040 -1 mgr[py] Module prometheus has missing NOTIFY_TYPES member 2024-09-12T02:37:50.944 INFO:journalctl@ceph.mgr.y.smithi044.stdout:Sep 12 02:37:50 smithi044 ceph-4954ed46-70ae-11ef-bcea-c7b262605968-mgr-y[36777]: 2024-09-12T02:37:50.750+0000 7feac5ec0040 -1 mgr[py] Module selftest has missing NOTIFY_TYPES member 2024-09-12T02:37:50.944 INFO:journalctl@ceph.mgr.y.smithi044.stdout:Sep 12 02:37:50 smithi044 ceph-4954ed46-70ae-11ef-bcea-c7b262605968-mgr-y[36777]: 2024-09-12T02:37:50.943+0000 7feac5ec0040 -1 mgr[py] Module volumes has missing NOTIFY_TYPES member 2024-09-12T02:37:51.161 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:37:51.159+0000 7fa8e8200640 1 -- 172.21.15.39:0/2440280733 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fa8e0077040 msgr2=0x7fa8e0112510 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:37:51.161 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:37:51.159+0000 7fa8e8200640 1 --2- 172.21.15.39:0/2440280733 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fa8e0077040 0x7fa8e0112510 secure :-1 s=READY pgs=127 cs=0 l=1 rev1=1 crypto rx=0x7fa8cc009900 tx=0x7fa8cc02a3f0 comp rx=0 tx=0).stop 2024-09-12T02:37:51.161 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:37:51.159+0000 7fa8e8200640 1 -- 172.21.15.39:0/2440280733 shutdown_connections 2024-09-12T02:37:51.161 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:37:51.159+0000 7fa8e8200640 1 --2- 172.21.15.39:0/2440280733 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fa8e0112a50 0x7fa8e0114e40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:37:51.161 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:37:51.159+0000 7fa8e8200640 1 --2- 172.21.15.39:0/2440280733 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fa8e0077040 0x7fa8e0112510 unknown :-1 s=CLOSED pgs=127 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:37:51.161 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:37:51.159+0000 7fa8e8200640 1 --2- 172.21.15.39:0/2440280733 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fa8e0076720 0x7fa8e0076b00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:37:51.162 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:37:51.159+0000 7fa8e8200640 1 -- 172.21.15.39:0/2440280733 >> 172.21.15.39:0/2440280733 conn(0x7fa8e00ffa50 msgr2=0x7fa8e0101e70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:37:51.162 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:37:51.159+0000 7fa8e8200640 1 -- 172.21.15.39:0/2440280733 shutdown_connections 2024-09-12T02:37:51.162 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:37:51.159+0000 7fa8e8200640 1 -- 172.21.15.39:0/2440280733 wait complete. 2024-09-12T02:37:51.162 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:37:51.160+0000 7fa8e8200640 1 Processor -- start 2024-09-12T02:37:51.162 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:37:51.160+0000 7fa8e8200640 1 -- start start 2024-09-12T02:37:51.163 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:37:51.161+0000 7fa8e8200640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fa8e0076720 0x7fa8e01a4790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:37:51.163 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:37:51.161+0000 7fa8e8200640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fa8e0077040 0x7fa8e01a4cd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:37:51.163 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:37:51.161+0000 7fa8e8200640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fa8e0112a50 0x7fa8e019e950 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:37:51.163 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:37:51.161+0000 7fa8e8200640 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 -- 0x7fa8e0118630 con 0x7fa8e0076720 2024-09-12T02:37:51.163 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:37:51.161+0000 7fa8e8200640 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x7fa8e01184b0 con 0x7fa8e0077040 2024-09-12T02:37:51.163 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:37:51.161+0000 7fa8e8200640 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7fa8e01187b0 con 0x7fa8e0112a50 2024-09-12T02:37:51.163 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:37:51.161+0000 7fa8e4e00640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fa8e0077040 0x7fa8e01a4cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:37:51.163 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:37:51.161+0000 7fa8e4e00640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fa8e0077040 0x7fa8e01a4cd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.39:52010/0 (socket says 172.21.15.39:52010) 2024-09-12T02:37:51.163 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:37:51.161+0000 7fa8e4e00640 1 -- 172.21.15.39:0/3519821842 learned_addr learned my addr 172.21.15.39:0/3519821842 (peer_addr_for_me v2:172.21.15.39:0/0) 2024-09-12T02:37:51.164 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:37:51.161+0000 7fa8e5800640 1 --2- 172.21.15.39:0/3519821842 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fa8e0076720 0x7fa8e01a4790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:37:51.164 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:37:51.161+0000 7fa8e6200640 1 --2- 172.21.15.39:0/3519821842 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fa8e0112a50 0x7fa8e019e950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:37:51.164 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:37:51.162+0000 7fa8e4e00640 1 -- 172.21.15.39:0/3519821842 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fa8e0112a50 msgr2=0x7fa8e019e950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:37:51.164 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:37:51.162+0000 7fa8e4e00640 1 --2- 172.21.15.39:0/3519821842 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fa8e0112a50 0x7fa8e019e950 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:37:51.164 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:37:51.162+0000 7fa8e4e00640 1 -- 172.21.15.39:0/3519821842 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fa8e0076720 msgr2=0x7fa8e01a4790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:37:51.164 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:37:51.162+0000 7fa8e4e00640 1 --2- 172.21.15.39:0/3519821842 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fa8e0076720 0x7fa8e01a4790 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:37:51.164 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:37:51.162+0000 7fa8e4e00640 1 -- 172.21.15.39:0/3519821842 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa8e019f080 con 0x7fa8e0077040 2024-09-12T02:37:51.164 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:37:51.162+0000 7fa8e6200640 1 --2- 172.21.15.39:0/3519821842 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fa8e0112a50 0x7fa8e019e950 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-12T02:37:51.164 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:37:51.162+0000 7fa8e4e00640 1 --2- 172.21.15.39:0/3519821842 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fa8e0077040 0x7fa8e01a4cd0 secure :-1 s=READY pgs=128 cs=0 l=1 rev1=1 crypto rx=0x7fa8cc006010 tx=0x7fa8cc0042f0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:37:51.164 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:37:51.162+0000 7fa8de000640 1 -- 172.21.15.39:0/3519821842 <== mon.2 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa8cc03f030 con 0x7fa8e0077040 2024-09-12T02:37:51.164 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:37:51.162+0000 7fa8e8200640 1 -- 172.21.15.39:0/3519821842 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa8e019f310 con 0x7fa8e0077040 2024-09-12T02:37:51.164 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:37:51.162+0000 7fa8de000640 1 -- 172.21.15.39:0/3519821842 <== mon.2 v2:172.21.15.44:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fa8cc003ce0 con 0x7fa8e0077040 2024-09-12T02:37:51.164 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:37:51.162+0000 7fa8de000640 1 -- 172.21.15.39:0/3519821842 <== mon.2 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa8cc035070 con 0x7fa8e0077040 2024-09-12T02:37:51.165 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:37:51.163+0000 7fa8e8200640 1 -- 172.21.15.39:0/3519821842 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa8e01ab660 con 0x7fa8e0077040 2024-09-12T02:37:51.165 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:37:51.164+0000 7fa8e8200640 1 -- 172.21.15.39:0/3519821842 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fa8e0076b00 con 0x7fa8e0077040 2024-09-12T02:37:51.166 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:37:51.165+0000 7fa8de000640 1 -- 172.21.15.39:0/3519821842 <== mon.2 v2:172.21.15.44:3300/0 4 ==== mgrmap(e 19) ==== 137850+0+0 (secure 0 0 0) 0x7fa8cc042030 con 0x7fa8e0077040 2024-09-12T02:37:51.168 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:37:51.167+0000 7fa8de000640 1 --2- 172.21.15.39:0/3519821842 >> [v2:172.21.15.39:6800/1725006999,v1:172.21.15.39:6801/1725006999] conn(0x7fa8c80a2bd0 0x7fa8c80a5090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:37:51.168 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:37:51.167+0000 7fa8e5800640 1 -- 172.21.15.39:0/3519821842 >> [v2:172.21.15.39:6800/1725006999,v1:172.21.15.39:6801/1725006999] conn(0x7fa8c80a2bd0 msgr2=0x7fa8c80a5090 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.39:6800/1725006999 2024-09-12T02:37:51.168 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:37:51.167+0000 7fa8de000640 1 -- 172.21.15.39:0/3519821842 <== mon.2 v2:172.21.15.44:3300/0 5 ==== osd_map(95..95 src has 1..95) ==== 9129+0+0 (secure 0 0 0) 0x7fa8cc0ef7f0 con 0x7fa8e0077040 2024-09-12T02:37:51.168 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:37:51.167+0000 7fa8e5800640 1 --2- 172.21.15.39:0/3519821842 >> [v2:172.21.15.39:6800/1725006999,v1:172.21.15.39:6801/1725006999] conn(0x7fa8c80a2bd0 0x7fa8c80a5090 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-09-12T02:37:51.171 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:37:51.170+0000 7fa8de000640 1 -- 172.21.15.39:0/3519821842 <== mon.2 v2:172.21.15.44:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7fa8cc0bc370 con 0x7fa8e0077040 2024-09-12T02:37:51.315 INFO:journalctl@ceph.mgr.x.smithi039.stdout:Sep 12 02:37:51 smithi039 ceph-4954ed46-70ae-11ef-bcea-c7b262605968-mgr-x[30736]: 2024-09-12T02:37:51.009+0000 7fbaf0e1a040 -1 mgr[py] Module prometheus has missing NOTIFY_TYPES member 2024-09-12T02:37:51.315 INFO:journalctl@ceph.mgr.x.smithi039.stdout:Sep 12 02:37:51 smithi039 ceph-4954ed46-70ae-11ef-bcea-c7b262605968-mgr-x[30736]: 2024-09-12T02:37:51.088+0000 7fbaf0e1a040 -1 mgr[py] Module selftest has missing NOTIFY_TYPES member 2024-09-12T02:37:51.315 INFO:journalctl@ceph.mgr.x.smithi039.stdout:Sep 12 02:37:51 smithi039 ceph-4954ed46-70ae-11ef-bcea-c7b262605968-mgr-x[30736]: 2024-09-12T02:37:51.313+0000 7fbaf0e1a040 -1 mgr[py] Module volumes has missing NOTIFY_TYPES member 2024-09-12T02:37:51.369 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:37:51.368+0000 7fa8e5800640 1 -- 172.21.15.39:0/3519821842 >> [v2:172.21.15.39:6800/1725006999,v1:172.21.15.39:6801/1725006999] conn(0x7fa8c80a2bd0 msgr2=0x7fa8c80a5090 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.39:6800/1725006999 2024-09-12T02:37:51.369 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:37:51.368+0000 7fa8e5800640 1 --2- 172.21.15.39:0/3519821842 >> [v2:172.21.15.39:6800/1725006999,v1:172.21.15.39:6801/1725006999] conn(0x7fa8c80a2bd0 0x7fa8c80a5090 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2024-09-12T02:37:51.396 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:37:51.395+0000 7fa8e8200640 1 -- 172.21.15.39:0/3519821842 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_command({"prefix": "fs ls"} v 0) -- 0x7fa8e019fe80 con 0x7fa8e0077040 2024-09-12T02:37:51.396 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:37:51.396+0000 7fa8de000640 1 -- 172.21.15.39:0/3519821842 <== mon.2 v2:172.21.15.44:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v28) ==== 53+0+88 (secure 0 0 0) 0x7fa8e019fe80 con 0x7fa8e0077040 2024-09-12T02:37:51.397 INFO:teuthology.orchestra.run.smithi039.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data cephfs_data_ec ] 2024-09-12T02:37:51.399 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:37:51.398+0000 7fa8e8200640 1 -- 172.21.15.39:0/3519821842 >> [v2:172.21.15.39:6800/1725006999,v1:172.21.15.39:6801/1725006999] conn(0x7fa8c80a2bd0 msgr2=0x7fa8c80a5090 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-09-12T02:37:51.399 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:37:51.398+0000 7fa8e8200640 1 --2- 172.21.15.39:0/3519821842 >> [v2:172.21.15.39:6800/1725006999,v1:172.21.15.39:6801/1725006999] conn(0x7fa8c80a2bd0 0x7fa8c80a5090 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:37:51.399 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:37:51.398+0000 7fa8e8200640 1 -- 172.21.15.39:0/3519821842 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fa8e0077040 msgr2=0x7fa8e01a4cd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:37:51.399 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:37:51.398+0000 7fa8e8200640 1 --2- 172.21.15.39:0/3519821842 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fa8e0077040 0x7fa8e01a4cd0 secure :-1 s=READY pgs=128 cs=0 l=1 rev1=1 crypto rx=0x7fa8cc006010 tx=0x7fa8cc0042f0 comp rx=0 tx=0).stop 2024-09-12T02:37:51.399 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:37:51.398+0000 7fa8e8200640 1 -- 172.21.15.39:0/3519821842 shutdown_connections 2024-09-12T02:37:51.399 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:37:51.398+0000 7fa8e8200640 1 --2- 172.21.15.39:0/3519821842 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fa8e0112a50 0x7fa8e019e950 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:37:51.400 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:37:51.398+0000 7fa8e8200640 1 --2- 172.21.15.39:0/3519821842 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fa8e0077040 0x7fa8e01a4cd0 unknown :-1 s=CLOSED pgs=128 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:37:51.400 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:37:51.398+0000 7fa8e8200640 1 --2- 172.21.15.39:0/3519821842 >> [v2:172.21.15.39:6800/1725006999,v1:172.21.15.39:6801/1725006999] conn(0x7fa8c80a2bd0 0x7fa8c80a5090 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:37:51.400 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:37:51.398+0000 7fa8e8200640 1 --2- 172.21.15.39:0/3519821842 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fa8e0076720 0x7fa8e01a4790 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:37:51.400 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:37:51.398+0000 7fa8e8200640 1 -- 172.21.15.39:0/3519821842 >> 172.21.15.39:0/3519821842 conn(0x7fa8e00ffa50 msgr2=0x7fa8e0101e40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:37:51.400 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:37:51.398+0000 7fa8e8200640 1 -- 172.21.15.39:0/3519821842 shutdown_connections 2024-09-12T02:37:51.400 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:37:51.398+0000 7fa8e8200640 1 -- 172.21.15.39:0/3519821842 wait complete. 2024-09-12T02:37:51.931 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 12 02:37:51 smithi044 ceph-mon[35411]: from='client.? 172.21.15.39:0/3519821842' entity='client.admin' cmd=[{"prefix": "fs ls"}]: dispatch 2024-09-12T02:37:51.931 INFO:journalctl@ceph.mgr.y.smithi044.stdout:Sep 12 02:37:51 smithi044 ceph-4954ed46-70ae-11ef-bcea-c7b262605968-mgr-y[36777]: 2024-09-12T02:37:51.860+0000 7feac5ec0040 -1 mgr[py] Module telemetry has missing NOTIFY_TYPES member 2024-09-12T02:37:52.013 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 12 02:37:51 smithi172 ceph-mon[35609]: from='client.? 172.21.15.39:0/3519821842' entity='client.admin' cmd=[{"prefix": "fs ls"}]: dispatch 2024-09-12T02:37:52.014 INFO:journalctl@ceph.mgr.z.smithi172.stdout:Sep 12 02:37:51 smithi172 ceph-4954ed46-70ae-11ef-bcea-c7b262605968-mgr-z[37423]: 2024-09-12T02:37:51.774+0000 7f7deec28040 -1 mgr[py] Module telemetry has missing NOTIFY_TYPES member 2024-09-12T02:37:52.014 INFO:journalctl@ceph.mgr.z.smithi172.stdout:Sep 12 02:37:51 smithi172 ceph-4954ed46-70ae-11ef-bcea-c7b262605968-mgr-z[37423]: 2024-09-12T02:37:51.842+0000 7f7deec28040 -1 mgr[py] Module balancer has missing NOTIFY_TYPES member 2024-09-12T02:37:52.099 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 02:37:51 smithi039 ceph-mon[30515]: from='client.? 172.21.15.39:0/3519821842' entity='client.admin' cmd=[{"prefix": "fs ls"}]: dispatch 2024-09-12T02:37:52.198 INFO:journalctl@ceph.mgr.y.smithi044.stdout:Sep 12 02:37:51 smithi044 ceph-4954ed46-70ae-11ef-bcea-c7b262605968-mgr-y[36777]: 2024-09-12T02:37:51.930+0000 7feac5ec0040 -1 mgr[py] Module balancer has missing NOTIFY_TYPES member 2024-09-12T02:37:52.329 INFO:tasks.cephfs.mount:Mounting default Ceph FS; just confirmed its presence on cluster 2024-09-12T02:37:52.329 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2024-09-12T02:37:52.329 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi039.front.sepia.ceph.com 2024-09-12T02:37:52.330 INFO:tasks.cephfs.mount:self.client.name = client.0 2024-09-12T02:37:52.330 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.0 2024-09-12T02:37:52.330 INFO:tasks.cephfs.mount:self.cephfs_name = None 2024-09-12T02:37:52.330 INFO:tasks.cephfs.mount:self.cephfs_mntpt = None 2024-09-12T02:37:52.330 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2024-09-12T02:37:52.330 INFO:tasks.cephfs.mount:Setting the 'None' netns for '/home/ubuntu/cephtest/mnt.0' 2024-09-12T02:37:52.330 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-12T02:37:52.330 DEBUG:teuthology.orchestra.run.smithi039:> ip addr 2024-09-12T02:37:52.367 INFO:teuthology.orchestra.run.smithi039.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2024-09-12T02:37:52.368 INFO:teuthology.orchestra.run.smithi039.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2024-09-12T02:37:52.368 INFO:teuthology.orchestra.run.smithi039.stdout: inet 127.0.0.1/8 scope host lo 2024-09-12T02:37:52.368 INFO:teuthology.orchestra.run.smithi039.stdout: valid_lft forever preferred_lft forever 2024-09-12T02:37:52.368 INFO:teuthology.orchestra.run.smithi039.stdout: inet6 ::1/128 scope host 2024-09-12T02:37:52.368 INFO:teuthology.orchestra.run.smithi039.stdout: valid_lft forever preferred_lft forever 2024-09-12T02:37:52.368 INFO:teuthology.orchestra.run.smithi039.stdout:2: eno1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-09-12T02:37:52.368 INFO:teuthology.orchestra.run.smithi039.stdout: link/ether 0c:c4:7a:6b:fe:c6 brd ff:ff:ff:ff:ff:ff 2024-09-12T02:37:52.368 INFO:teuthology.orchestra.run.smithi039.stdout: altname enp7s0f0 2024-09-12T02:37:52.368 INFO:teuthology.orchestra.run.smithi039.stdout:3: eno2: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-09-12T02:37:52.368 INFO:teuthology.orchestra.run.smithi039.stdout: link/ether 0c:c4:7a:6b:fe:c7 brd ff:ff:ff:ff:ff:ff 2024-09-12T02:37:52.368 INFO:teuthology.orchestra.run.smithi039.stdout: altname enp7s0f1 2024-09-12T02:37:52.368 INFO:teuthology.orchestra.run.smithi039.stdout:4: ens1f0: mtu 1500 qdisc mq state UP group default qlen 1000 2024-09-12T02:37:52.368 INFO:teuthology.orchestra.run.smithi039.stdout: link/ether 0c:c4:7a:bd:13:70 brd ff:ff:ff:ff:ff:ff 2024-09-12T02:37:52.368 INFO:teuthology.orchestra.run.smithi039.stdout: altname enp1s0f0 2024-09-12T02:37:52.369 INFO:teuthology.orchestra.run.smithi039.stdout: inet 172.21.15.39/20 brd 172.21.15.255 scope global dynamic noprefixroute ens1f0 2024-09-12T02:37:52.369 INFO:teuthology.orchestra.run.smithi039.stdout: valid_lft 42013sec preferred_lft 42013sec 2024-09-12T02:37:52.369 INFO:teuthology.orchestra.run.smithi039.stdout: inet6 fe80::ec4:7aff:febd:1370/64 scope link 2024-09-12T02:37:52.369 INFO:teuthology.orchestra.run.smithi039.stdout: valid_lft forever preferred_lft forever 2024-09-12T02:37:52.369 INFO:teuthology.orchestra.run.smithi039.stdout:5: ens1f1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-09-12T02:37:52.369 INFO:teuthology.orchestra.run.smithi039.stdout: link/ether 0c:c4:7a:bd:13:71 brd ff:ff:ff:ff:ff:ff 2024-09-12T02:37:52.369 INFO:teuthology.orchestra.run.smithi039.stdout: altname enp1s0f1 2024-09-12T02:37:52.369 INFO:tasks.cephfs.mount:Setuping the 'ceph-brx' with 192.168.255.254/16 2024-09-12T02:37:52.369 DEBUG:teuthology.orchestra.run.smithi039:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-09-12T02:37:52.370 DEBUG:teuthology.orchestra.run.smithi039:> set -e 2024-09-12T02:37:52.370 DEBUG:teuthology.orchestra.run.smithi039:> sudo ip link add name ceph-brx type bridge 2024-09-12T02:37:52.370 DEBUG:teuthology.orchestra.run.smithi039:> sudo ip addr flush dev ceph-brx 2024-09-12T02:37:52.370 DEBUG:teuthology.orchestra.run.smithi039:> sudo ip link set ceph-brx up 2024-09-12T02:37:52.370 DEBUG:teuthology.orchestra.run.smithi039:> sudo ip addr add 192.168.255.254/16 brd 192.168.255.255 dev ceph-brx 2024-09-12T02:37:52.370 DEBUG:teuthology.orchestra.run.smithi039:> ') 2024-09-12T02:37:52.488 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:37:52 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-09-12T02:37:52.540 INFO:journalctl@ceph.mgr.x.smithi039.stdout:Sep 12 02:37:52 smithi039 ceph-4954ed46-70ae-11ef-bcea-c7b262605968-mgr-x[30736]: 2024-09-12T02:37:52.474+0000 7fbaf0e1a040 -1 mgr[py] Module telemetry has missing NOTIFY_TYPES member 2024-09-12T02:37:52.596 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:37:52 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-12T02:37:52.605 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-12T02:37:52.605 DEBUG:teuthology.orchestra.run.smithi039:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2024-09-12T02:37:52.661 INFO:teuthology.orchestra.run.smithi039.stdout:1 2024-09-12T02:37:52.664 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-12T02:37:52.664 DEBUG:teuthology.orchestra.run.smithi039:> route 2024-09-12T02:37:52.701 INFO:teuthology.orchestra.run.smithi039.stdout:Kernel IP routing table 2024-09-12T02:37:52.701 INFO:teuthology.orchestra.run.smithi039.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2024-09-12T02:37:52.702 INFO:teuthology.orchestra.run.smithi039.stdout:default _gateway 0.0.0.0 UG 100 0 0 ens1f0 2024-09-12T02:37:52.702 INFO:teuthology.orchestra.run.smithi039.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 100 0 0 ens1f0 2024-09-12T02:37:52.702 INFO:teuthology.orchestra.run.smithi039.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2024-09-12T02:37:52.702 DEBUG:teuthology.orchestra.run.smithi039:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-09-12T02:37:52.702 DEBUG:teuthology.orchestra.run.smithi039:> set -e 2024-09-12T02:37:52.702 DEBUG:teuthology.orchestra.run.smithi039:> sudo iptables -A FORWARD -o ens1f0 -i ceph-brx -j ACCEPT 2024-09-12T02:37:52.702 DEBUG:teuthology.orchestra.run.smithi039:> sudo iptables -A FORWARD -i ens1f0 -o ceph-brx -j ACCEPT 2024-09-12T02:37:52.703 DEBUG:teuthology.orchestra.run.smithi039:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o ens1f0 -j MASQUERADE 2024-09-12T02:37:52.703 DEBUG:teuthology.orchestra.run.smithi039:> ') 2024-09-12T02:37:52.812 INFO:journalctl@ceph.mgr.z.smithi172.stdout:Sep 12 02:37:52 smithi172 ceph-4954ed46-70ae-11ef-bcea-c7b262605968-mgr-z[37423]: 2024-09-12T02:37:52.547+0000 7f7deec28040 -1 mgr[py] Module rook has missing NOTIFY_TYPES member 2024-09-12T02:37:52.812 INFO:journalctl@ceph.mgr.z.smithi172.stdout:Sep 12 02:37:52 smithi172 ceph-4954ed46-70ae-11ef-bcea-c7b262605968-mgr-z[37423]: 2024-09-12T02:37:52.664+0000 7f7deec28040 -1 mgr[py] Module iostat has missing NOTIFY_TYPES member 2024-09-12T02:37:52.821 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:37:52 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-09-12T02:37:52.838 INFO:journalctl@ceph.mgr.x.smithi039.stdout:Sep 12 02:37:52 smithi039 ceph-4954ed46-70ae-11ef-bcea-c7b262605968-mgr-x[30736]: 2024-09-12T02:37:52.562+0000 7fbaf0e1a040 -1 mgr[py] Module balancer has missing NOTIFY_TYPES member 2024-09-12T02:37:52.895 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:37:52 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-12T02:37:52.903 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-12T02:37:52.903 DEBUG:teuthology.orchestra.run.smithi039:> ip netns list 2024-09-12T02:37:52.939 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-12T02:37:52.940 DEBUG:teuthology.orchestra.run.smithi039:> ip netns list-id 2024-09-12T02:37:52.945 INFO:journalctl@ceph.mgr.y.smithi044.stdout:Sep 12 02:37:52 smithi044 ceph-4954ed46-70ae-11ef-bcea-c7b262605968-mgr-y[36777]: 2024-09-12T02:37:52.675+0000 7feac5ec0040 -1 mgr[py] Module rook has missing NOTIFY_TYPES member 2024-09-12T02:37:52.945 INFO:journalctl@ceph.mgr.y.smithi044.stdout:Sep 12 02:37:52 smithi044 ceph-4954ed46-70ae-11ef-bcea-c7b262605968-mgr-y[36777]: 2024-09-12T02:37:52.796+0000 7feac5ec0040 -1 mgr[py] Module iostat has missing NOTIFY_TYPES member 2024-09-12T02:37:53.015 DEBUG:teuthology.orchestra.run.smithi039:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-09-12T02:37:53.016 DEBUG:teuthology.orchestra.run.smithi039:> set -e 2024-09-12T02:37:53.016 DEBUG:teuthology.orchestra.run.smithi039:> sudo ip netns add ceph-ns--home-ubuntu-cephtest-mnt.0 2024-09-12T02:37:53.016 DEBUG:teuthology.orchestra.run.smithi039:> sudo ip netns set ceph-ns--home-ubuntu-cephtest-mnt.0 0 2024-09-12T02:37:53.016 DEBUG:teuthology.orchestra.run.smithi039:> ') 2024-09-12T02:37:53.086 INFO:journalctl@ceph.mgr.z.smithi172.stdout:Sep 12 02:37:52 smithi172 ceph-4954ed46-70ae-11ef-bcea-c7b262605968-mgr-z[37423]: 2024-09-12T02:37:52.809+0000 7f7deec28040 -1 mgr[py] Module orchestrator has missing NOTIFY_TYPES member 2024-09-12T02:37:53.087 INFO:journalctl@ceph.mgr.z.smithi172.stdout:Sep 12 02:37:52 smithi172 ceph-4954ed46-70ae-11ef-bcea-c7b262605968-mgr-z[37423]: 2024-09-12T02:37:52.871+0000 7f7deec28040 -1 mgr[py] Module devicehealth has missing NOTIFY_TYPES member 2024-09-12T02:37:53.087 INFO:journalctl@ceph.mgr.z.smithi172.stdout:Sep 12 02:37:53 smithi172 ceph-4954ed46-70ae-11ef-bcea-c7b262605968-mgr-z[37423]: 2024-09-12T02:37:53.018+0000 7f7deec28040 -1 mgr[py] Module rgw has missing NOTIFY_TYPES member 2024-09-12T02:37:53.087 INFO:journalctl@ceph.mgr.z.smithi172.stdout:Sep 12 02:37:53 smithi172 ceph-4954ed46-70ae-11ef-bcea-c7b262605968-mgr-z[37423]: 2024-09-12T02:37:53.086+0000 7f7deec28040 -1 mgr[py] Module alerts has missing NOTIFY_TYPES member 2024-09-12T02:37:53.136 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:37:53 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-09-12T02:37:53.188 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:37:53 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-12T02:37:53.197 INFO:tasks.cephfs.mount:Setuping the netns 'ceph-ns--home-ubuntu-cephtest-mnt.0' with 192.168.0.1/16 2024-09-12T02:37:53.197 DEBUG:teuthology.orchestra.run.smithi039:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-09-12T02:37:53.197 DEBUG:teuthology.orchestra.run.smithi039:> set -e 2024-09-12T02:37:53.197 DEBUG:teuthology.orchestra.run.smithi039:> sudo ip link add veth0 netns ceph-ns--home-ubuntu-cephtest-mnt.0 type veth peer name brx.0 2024-09-12T02:37:53.197 DEBUG:teuthology.orchestra.run.smithi039:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip addr add 192.168.0.1/16 brd 192.168.255.255 dev veth0 2024-09-12T02:37:53.197 DEBUG:teuthology.orchestra.run.smithi039:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip link set veth0 up 2024-09-12T02:37:53.197 DEBUG:teuthology.orchestra.run.smithi039:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip link set lo up 2024-09-12T02:37:53.197 DEBUG:teuthology.orchestra.run.smithi039:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip route add default via 192.168.255.254 2024-09-12T02:37:53.197 DEBUG:teuthology.orchestra.run.smithi039:> ') 2024-09-12T02:37:53.198 INFO:journalctl@ceph.mgr.y.smithi044.stdout:Sep 12 02:37:52 smithi044 ceph-4954ed46-70ae-11ef-bcea-c7b262605968-mgr-y[36777]: 2024-09-12T02:37:52.944+0000 7feac5ec0040 -1 mgr[py] Module orchestrator has missing NOTIFY_TYPES member 2024-09-12T02:37:53.198 INFO:journalctl@ceph.mgr.y.smithi044.stdout:Sep 12 02:37:53 smithi044 ceph-4954ed46-70ae-11ef-bcea-c7b262605968-mgr-y[36777]: 2024-09-12T02:37:53.008+0000 7feac5ec0040 -1 mgr[py] Module devicehealth has missing NOTIFY_TYPES member 2024-09-12T02:37:53.198 INFO:journalctl@ceph.mgr.y.smithi044.stdout:Sep 12 02:37:53 smithi044 ceph-4954ed46-70ae-11ef-bcea-c7b262605968-mgr-y[36777]: 2024-09-12T02:37:53.164+0000 7feac5ec0040 -1 mgr[py] Module rgw has missing NOTIFY_TYPES member 2024-09-12T02:37:53.277 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:37:53 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-09-12T02:37:53.368 INFO:journalctl@ceph.mgr.z.smithi172.stdout:Sep 12 02:37:53 smithi172 ceph-4954ed46-70ae-11ef-bcea-c7b262605968-mgr-z[37423]: 2024-09-12T02:37:53.145+0000 7f7deec28040 -1 mgr[py] Module progress has missing NOTIFY_TYPES member 2024-09-12T02:37:53.368 INFO:journalctl@ceph.mgr.z.smithi172.stdout:Sep 12 02:37:53 smithi172 ceph-4954ed46-70ae-11ef-bcea-c7b262605968-mgr-z[37423]: 2024-09-12T02:37:53.303+0000 7f7deec28040 -1 mgr[py] Module nfs has missing NOTIFY_TYPES member 2024-09-12T02:37:53.369 INFO:journalctl@ceph.mgr.z.smithi172.stdout:Sep 12 02:37:53 smithi172 ceph-4954ed46-70ae-11ef-bcea-c7b262605968-mgr-z[37423]: 2024-09-12T02:37:53.367+0000 7f7deec28040 -1 mgr[py] Module status has missing NOTIFY_TYPES member 2024-09-12T02:37:53.442 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:37:53 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-12T02:37:53.451 DEBUG:teuthology.orchestra.run.smithi039:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-09-12T02:37:53.451 DEBUG:teuthology.orchestra.run.smithi039:> set -e 2024-09-12T02:37:53.451 DEBUG:teuthology.orchestra.run.smithi039:> sudo ip link set brx.0 up 2024-09-12T02:37:53.451 DEBUG:teuthology.orchestra.run.smithi039:> sudo ip link set dev brx.0 master ceph-brx 2024-09-12T02:37:53.451 DEBUG:teuthology.orchestra.run.smithi039:> ') 2024-09-12T02:37:53.531 INFO:journalctl@ceph.mgr.y.smithi044.stdout:Sep 12 02:37:53 smithi044 ceph-4954ed46-70ae-11ef-bcea-c7b262605968-mgr-y[36777]: 2024-09-12T02:37:53.235+0000 7feac5ec0040 -1 mgr[py] Module alerts has missing NOTIFY_TYPES member 2024-09-12T02:37:53.531 INFO:journalctl@ceph.mgr.y.smithi044.stdout:Sep 12 02:37:53 smithi044 ceph-4954ed46-70ae-11ef-bcea-c7b262605968-mgr-y[36777]: 2024-09-12T02:37:53.298+0000 7feac5ec0040 -1 mgr[py] Module progress has missing NOTIFY_TYPES member 2024-09-12T02:37:53.531 INFO:journalctl@ceph.mgr.y.smithi044.stdout:Sep 12 02:37:53 smithi044 ceph-4954ed46-70ae-11ef-bcea-c7b262605968-mgr-y[36777]: 2024-09-12T02:37:53.462+0000 7feac5ec0040 -1 mgr[py] Module nfs has missing NOTIFY_TYPES member 2024-09-12T02:37:53.531 INFO:journalctl@ceph.mgr.y.smithi044.stdout:Sep 12 02:37:53 smithi044 ceph-4954ed46-70ae-11ef-bcea-c7b262605968-mgr-y[36777]: 2024-09-12T02:37:53.530+0000 7feac5ec0040 -1 mgr[py] Module status has missing NOTIFY_TYPES member 2024-09-12T02:37:53.531 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:37:53 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-09-12T02:37:53.615 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:37:53 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-12T02:37:53.623 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-09-12T02:37:53.623 DEBUG:teuthology.orchestra.run.smithi039:> mkdir -p -v /home/ubuntu/cephtest/mnt.0 2024-09-12T02:37:53.632 INFO:journalctl@ceph.mgr.z.smithi172.stdout:Sep 12 02:37:53 smithi172 ceph-4954ed46-70ae-11ef-bcea-c7b262605968-mgr-z[37423]: 2024-09-12T02:37:53.433+0000 7f7deec28040 -1 mgr[py] Module pg_autoscaler has missing NOTIFY_TYPES member 2024-09-12T02:37:53.632 INFO:journalctl@ceph.mgr.z.smithi172.stdout:Sep 12 02:37:53 smithi172 ceph-4954ed46-70ae-11ef-bcea-c7b262605968-mgr-z[37423]: 2024-09-12T02:37:53.514+0000 7f7deec28040 -1 mgr[py] Module rbd_support has missing NOTIFY_TYPES member 2024-09-12T02:37:53.633 INFO:journalctl@ceph.mgr.z.smithi172.stdout:Sep 12 02:37:53 smithi172 ceph-4954ed46-70ae-11ef-bcea-c7b262605968-mgr-z[37423]: 2024-09-12T02:37:53.573+0000 7f7deec28040 -1 mgr[py] Module influx has missing NOTIFY_TYPES member 2024-09-12T02:37:53.633 INFO:journalctl@ceph.mgr.z.smithi172.stdout:Sep 12 02:37:53 smithi172 ceph-4954ed46-70ae-11ef-bcea-c7b262605968-mgr-z[37423]: 2024-09-12T02:37:53.632+0000 7f7deec28040 -1 mgr[py] Module zabbix has missing NOTIFY_TYPES member 2024-09-12T02:37:53.662 INFO:teuthology.orchestra.run.smithi039.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.0' 2024-09-12T02:37:53.662 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-09-12T02:37:53.662 DEBUG:teuthology.orchestra.run.smithi039:> chmod 0000 /home/ubuntu/cephtest/mnt.0 2024-09-12T02:37:53.722 INFO:journalctl@ceph.mgr.x.smithi039.stdout:Sep 12 02:37:53 smithi039 ceph-4954ed46-70ae-11ef-bcea-c7b262605968-mgr-x[30736]: 2024-09-12T02:37:53.572+0000 7fbaf0e1a040 -1 mgr[py] Module rook has missing NOTIFY_TYPES member 2024-09-12T02:37:53.723 INFO:journalctl@ceph.mgr.x.smithi039.stdout:Sep 12 02:37:53 smithi039 ceph-4954ed46-70ae-11ef-bcea-c7b262605968-mgr-x[30736]: 2024-09-12T02:37:53.721+0000 7fbaf0e1a040 -1 mgr[py] Module iostat has missing NOTIFY_TYPES member 2024-09-12T02:37:53.739 WARNING:tasks.cephfs.mount:You cannot specify both: cephfs_mntpt and mount_subvol_num 2024-09-12T02:37:53.739 INFO:tasks.cephfs.mount:Mounting subvol 1 for now 2024-09-12T02:37:53.739 INFO:tasks.cephfs.kernel_mount:mounting using device: 0@.cephfs=/volumes/qa/sv_1/c0d2c7d5-847b-407e-9538-c804b4cffaac 2024-09-12T02:37:53.739 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-12T02:37:53.739 DEBUG:teuthology.orchestra.run.smithi039:> sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage /bin/mount -t ceph 0@.cephfs=/volumes/qa/sv_1/c0d2c7d5-847b-407e-9538-c804b4cffaac /home/ubuntu/cephtest/mnt.0 -v -o norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,ms_mode=legacy,nowsync,nofallback 2024-09-12T02:37:53.809 INFO:journalctl@ceph.mgr.y.smithi044.stdout:Sep 12 02:37:53 smithi044 ceph-4954ed46-70ae-11ef-bcea-c7b262605968-mgr-y[36777]: 2024-09-12T02:37:53.599+0000 7feac5ec0040 -1 mgr[py] Module pg_autoscaler has missing NOTIFY_TYPES member 2024-09-12T02:37:53.809 INFO:journalctl@ceph.mgr.y.smithi044.stdout:Sep 12 02:37:53 smithi044 ceph-4954ed46-70ae-11ef-bcea-c7b262605968-mgr-y[36777]: 2024-09-12T02:37:53.685+0000 7feac5ec0040 -1 mgr[py] Module rbd_support has missing NOTIFY_TYPES member 2024-09-12T02:37:53.809 INFO:journalctl@ceph.mgr.y.smithi044.stdout:Sep 12 02:37:53 smithi044 ceph-4954ed46-70ae-11ef-bcea-c7b262605968-mgr-y[36777]: 2024-09-12T02:37:53.747+0000 7feac5ec0040 -1 mgr[py] Module influx has missing NOTIFY_TYPES member 2024-09-12T02:37:53.809 INFO:journalctl@ceph.mgr.y.smithi044.stdout:Sep 12 02:37:53 smithi044 ceph-4954ed46-70ae-11ef-bcea-c7b262605968-mgr-y[36777]: 2024-09-12T02:37:53.808+0000 7feac5ec0040 -1 mgr[py] Module zabbix has missing NOTIFY_TYPES member 2024-09-12T02:37:53.870 INFO:teuthology.orchestra.run.smithi039.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,ms_mode=legacy,nowsync,nofallback 2024-09-12T02:37:53.870 INFO:teuthology.orchestra.run.smithi039.stdout:mount.ceph: options "norequire_active_mds,norbytes,ms_mode=legacy,nowsync". 2024-09-12T02:37:53.975 INFO:journalctl@ceph.mgr.x.smithi039.stdout:Sep 12 02:37:53 smithi039 ceph-4954ed46-70ae-11ef-bcea-c7b262605968-mgr-x[30736]: 2024-09-12T02:37:53.897+0000 7fbaf0e1a040 -1 mgr[py] Module orchestrator has missing NOTIFY_TYPES member 2024-09-12T02:37:54.233 INFO:journalctl@ceph.mgr.x.smithi039.stdout:Sep 12 02:37:53 smithi039 ceph-4954ed46-70ae-11ef-bcea-c7b262605968-mgr-x[30736]: 2024-09-12T02:37:53.974+0000 7fbaf0e1a040 -1 mgr[py] Module devicehealth has missing NOTIFY_TYPES member 2024-09-12T02:37:54.233 INFO:journalctl@ceph.mgr.x.smithi039.stdout:Sep 12 02:37:54 smithi039 ceph-4954ed46-70ae-11ef-bcea-c7b262605968-mgr-x[30736]: 2024-09-12T02:37:54.158+0000 7fbaf0e1a040 -1 mgr[py] Module rgw has missing NOTIFY_TYPES member 2024-09-12T02:37:54.515 INFO:journalctl@ceph.mgr.x.smithi039.stdout:Sep 12 02:37:54 smithi039 ceph-4954ed46-70ae-11ef-bcea-c7b262605968-mgr-x[30736]: 2024-09-12T02:37:54.246+0000 7fbaf0e1a040 -1 mgr[py] Module alerts has missing NOTIFY_TYPES member 2024-09-12T02:37:54.515 INFO:journalctl@ceph.mgr.x.smithi039.stdout:Sep 12 02:37:54 smithi039 ceph-4954ed46-70ae-11ef-bcea-c7b262605968-mgr-x[30736]: 2024-09-12T02:37:54.321+0000 7fbaf0e1a040 -1 mgr[py] Module progress has missing NOTIFY_TYPES member 2024-09-12T02:37:54.515 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 02:37:54 smithi039 ceph-mon[30515]: Standby manager daemon z restarted 2024-09-12T02:37:54.515 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 02:37:54 smithi039 ceph-mon[30515]: Standby manager daemon z started 2024-09-12T02:37:54.515 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 02:37:54 smithi039 ceph-mon[30515]: from='mgr.? 172.21.15.172:0/1841962104' entity='mgr.z' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/z/crt"}]: dispatch 2024-09-12T02:37:54.516 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 02:37:54 smithi039 ceph-mon[30515]: from='mgr.? 172.21.15.172:0/1841962104' entity='mgr.z' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/crt"}]: dispatch 2024-09-12T02:37:54.516 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 02:37:54 smithi039 ceph-mon[30515]: from='mgr.? 172.21.15.172:0/1841962104' entity='mgr.z' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/z/key"}]: dispatch 2024-09-12T02:37:54.516 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 02:37:54 smithi039 ceph-mon[30515]: from='mgr.? 172.21.15.172:0/1841962104' entity='mgr.z' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/key"}]: dispatch 2024-09-12T02:37:54.532 INFO:teuthology.orchestra.run.smithi039.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,ms_mode=legacy,nowsync,nofallback 2024-09-12T02:37:54.532 INFO:teuthology.orchestra.run.smithi039.stdout:mount.ceph: options "norequire_active_mds,norbytes,ms_mode=legacy,nowsync". 2024-09-12T02:37:54.532 INFO:teuthology.orchestra.run.smithi039.stdout:mount.ceph: resolved to: "172.21.15.39:6789,172.21.15.44:6789,172.21.15.172:6789" 2024-09-12T02:37:54.532 INFO:teuthology.orchestra.run.smithi039.stdout:mount.ceph: trying mount with new device syntax: 0@4954ed46-70ae-11ef-bcea-c7b262605968.cephfs=/volumes/qa/sv_1/c0d2c7d5-847b-407e-9538-c804b4cffaac 2024-09-12T02:37:54.532 INFO:teuthology.orchestra.run.smithi039.stdout:mount.ceph: options "norequire_active_mds,norbytes,ms_mode=legacy,nowsync,name=0,key=0,mon_addr=172.21.15.39:6789/172.21.15.44:6789/172.21.15.172:6789" will pass to kernel 2024-09-12T02:37:54.535 INFO:teuthology.orchestra.run.smithi039.stdout:mount: /home/ubuntu/cephtest/mnt.0 does not contain SELinux labels. 2024-09-12T02:37:54.536 INFO:teuthology.orchestra.run.smithi039.stdout: You just mounted a file system that supports labels which does not 2024-09-12T02:37:54.536 INFO:teuthology.orchestra.run.smithi039.stdout: contain labels, onto an SELinux box. It is likely that confined 2024-09-12T02:37:54.536 INFO:teuthology.orchestra.run.smithi039.stdout: applications will generate AVC messages and not be allowed access to 2024-09-12T02:37:54.536 INFO:teuthology.orchestra.run.smithi039.stdout: this file system. For more details see restorecon(8) and mount(8). 2024-09-12T02:37:54.537 INFO:tasks.cephfs.kernel_mount:mount command passed 2024-09-12T02:37:54.537 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-12T02:37:54.537 DEBUG:teuthology.orchestra.run.smithi039:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.0 2024-09-12T02:37:54.597 DEBUG:teuthology.orchestra.run.smithi039:> (cd /home/ubuntu/cephtest/mnt.0 && exec stdin-killer --timeout=900 -- bash -c 'getfattr --only-values -n ceph.client_id .') 2024-09-12T02:37:54.679 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:37:54 stdin-killer INFO: expiration expected; waiting 900 seconds for command to complete 2024-09-12T02:37:54.683 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:37:54 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-12T02:37:54.691 INFO:teuthology.orchestra.run.smithi039.stdout:client15228 2024-09-12T02:37:54.692 DEBUG:teuthology.orchestra.run.smithi039:> set -ex 2024-09-12T02:37:54.692 DEBUG:teuthology.orchestra.run.smithi039:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-12T02:37:54.729 DEBUG:teuthology.orchestra.run.smithi039:> (cd /home/ubuntu/cephtest/mnt.0 && exec stdin-killer --timeout=900 -- bash -c 'getfattr --only-values -n ceph.client_id .') 2024-09-12T02:37:54.764 INFO:journalctl@ceph.mgr.z.smithi172.stdout:Sep 12 02:37:54 smithi172 ceph-4954ed46-70ae-11ef-bcea-c7b262605968-mgr-z[37423]: 2024-09-12T02:37:54.419+0000 7f7deec28040 -1 mgr[py] Module telegraf has missing NOTIFY_TYPES member 2024-09-12T02:37:54.764 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 12 02:37:54 smithi172 ceph-mon[35609]: Standby manager daemon z restarted 2024-09-12T02:37:54.764 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 12 02:37:54 smithi172 ceph-mon[35609]: Standby manager daemon z started 2024-09-12T02:37:54.764 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 12 02:37:54 smithi172 ceph-mon[35609]: from='mgr.? 172.21.15.172:0/1841962104' entity='mgr.z' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/z/crt"}]: dispatch 2024-09-12T02:37:54.764 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 12 02:37:54 smithi172 ceph-mon[35609]: from='mgr.? 172.21.15.172:0/1841962104' entity='mgr.z' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/crt"}]: dispatch 2024-09-12T02:37:54.764 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 12 02:37:54 smithi172 ceph-mon[35609]: from='mgr.? 172.21.15.172:0/1841962104' entity='mgr.z' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/z/key"}]: dispatch 2024-09-12T02:37:54.764 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 12 02:37:54 smithi172 ceph-mon[35609]: from='mgr.? 172.21.15.172:0/1841962104' entity='mgr.z' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/key"}]: dispatch 2024-09-12T02:37:54.796 INFO:journalctl@ceph.mgr.x.smithi039.stdout:Sep 12 02:37:54 smithi039 ceph-4954ed46-70ae-11ef-bcea-c7b262605968-mgr-x[30736]: 2024-09-12T02:37:54.519+0000 7fbaf0e1a040 -1 mgr[py] Module nfs has missing NOTIFY_TYPES member 2024-09-12T02:37:54.796 INFO:journalctl@ceph.mgr.x.smithi039.stdout:Sep 12 02:37:54 smithi039 ceph-4954ed46-70ae-11ef-bcea-c7b262605968-mgr-x[30736]: 2024-09-12T02:37:54.605+0000 7fbaf0e1a040 -1 mgr[py] Module status has missing NOTIFY_TYPES member 2024-09-12T02:37:54.796 INFO:journalctl@ceph.mgr.x.smithi039.stdout:Sep 12 02:37:54 smithi039 ceph-4954ed46-70ae-11ef-bcea-c7b262605968-mgr-x[30736]: 2024-09-12T02:37:54.691+0000 7fbaf0e1a040 -1 mgr[py] Module pg_autoscaler has missing NOTIFY_TYPES member 2024-09-12T02:37:54.797 INFO:journalctl@ceph.mgr.x.smithi039.stdout:Sep 12 02:37:54 smithi039 ceph-4954ed46-70ae-11ef-bcea-c7b262605968-mgr-x[30736]: 2024-09-12T02:37:54.795+0000 7fbaf0e1a040 -1 mgr[py] Module rbd_support has missing NOTIFY_TYPES member 2024-09-12T02:37:54.850 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:37:54 stdin-killer INFO: expiration expected; waiting 900 seconds for command to complete 2024-09-12T02:37:54.853 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:37:54 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-12T02:37:54.862 INFO:teuthology.orchestra.run.smithi039.stdout:client15228 2024-09-12T02:37:54.862 DEBUG:teuthology.orchestra.run.smithi039:> (cd /home/ubuntu/cephtest/mnt.0 && exec stdin-killer --timeout=900 -- bash -c 'getfattr --only-values -n ceph.client_id .') 2024-09-12T02:37:54.948 INFO:journalctl@ceph.mgr.y.smithi044.stdout:Sep 12 02:37:54 smithi044 ceph-4954ed46-70ae-11ef-bcea-c7b262605968-mgr-y[36777]: 2024-09-12T02:37:54.637+0000 7feac5ec0040 -1 mgr[py] Module telegraf has missing NOTIFY_TYPES member 2024-09-12T02:37:54.949 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 12 02:37:54 smithi044 ceph-mon[35411]: Standby manager daemon z restarted 2024-09-12T02:37:54.949 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 12 02:37:54 smithi044 ceph-mon[35411]: Standby manager daemon z started 2024-09-12T02:37:54.949 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 12 02:37:54 smithi044 ceph-mon[35411]: from='mgr.? 172.21.15.172:0/1841962104' entity='mgr.z' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/z/crt"}]: dispatch 2024-09-12T02:37:54.949 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 12 02:37:54 smithi044 ceph-mon[35411]: from='mgr.? 172.21.15.172:0/1841962104' entity='mgr.z' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/crt"}]: dispatch 2024-09-12T02:37:54.949 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 12 02:37:54 smithi044 ceph-mon[35411]: from='mgr.? 172.21.15.172:0/1841962104' entity='mgr.z' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/z/key"}]: dispatch 2024-09-12T02:37:54.949 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 12 02:37:54 smithi044 ceph-mon[35411]: from='mgr.? 172.21.15.172:0/1841962104' entity='mgr.z' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/key"}]: dispatch 2024-09-12T02:37:54.982 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:37:54 stdin-killer INFO: expiration expected; waiting 900 seconds for command to complete 2024-09-12T02:37:54.986 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:37:54 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-12T02:37:54.994 INFO:teuthology.orchestra.run.smithi039.stdout:client15228 2024-09-12T02:37:54.994 DEBUG:teuthology.orchestra.run.smithi039:> (cd /home/ubuntu/cephtest/mnt.0 && exec stdin-killer --timeout=300 -- bash -c 'sudo dd if=/sys/kernel/debug/ceph/4954ed46-70ae-11ef-bcea-c7b262605968.client15228/status') 2024-09-12T02:37:55.074 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:37:55 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-09-12T02:37:55.091 INFO:journalctl@ceph.mgr.x.smithi039.stdout:Sep 12 02:37:54 smithi039 ceph-4954ed46-70ae-11ef-bcea-c7b262605968-mgr-x[30736]: 2024-09-12T02:37:54.871+0000 7fbaf0e1a040 -1 mgr[py] Module influx has missing NOTIFY_TYPES member 2024-09-12T02:37:55.091 INFO:journalctl@ceph.mgr.x.smithi039.stdout:Sep 12 02:37:54 smithi039 ceph-4954ed46-70ae-11ef-bcea-c7b262605968-mgr-x[30736]: 2024-09-12T02:37:54.946+0000 7fbaf0e1a040 -1 mgr[py] Module zabbix has missing NOTIFY_TYPES member 2024-09-12T02:37:55.097 INFO:teuthology.orchestra.run.smithi039.stdout:instance: client.15228 (3)192.168.0.1:0/2711407657 2024-09-12T02:37:55.097 INFO:teuthology.orchestra.run.smithi039.stdout:blocklisted: false 2024-09-12T02:37:55.097 INFO:teuthology.orchestra.run.smithi039.stderr:0+1 records in 2024-09-12T02:37:55.097 INFO:teuthology.orchestra.run.smithi039.stderr:0+1 records out 2024-09-12T02:37:55.097 INFO:teuthology.orchestra.run.smithi039.stderr:70 bytes copied, 5.9727e-05 s, 1.2 MB/s 2024-09-12T02:37:55.100 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:37:55 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-12T02:37:55.109 INFO:teuthology.run_tasks:Running task exec... 2024-09-12T02:37:55.121 INFO:teuthology.task.exec:Executing custom commands... 2024-09-12T02:37:55.122 INFO:teuthology.task.exec:Running commands on role mon.a host ubuntu@smithi039.front.sepia.ceph.com 2024-09-12T02:37:55.122 DEBUG:teuthology.orchestra.run.smithi039:> sudo TESTDIR=/home/ubuntu/cephtest bash -c 'ceph fs set cephfs balance_automate false' 2024-09-12T02:37:55.281 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:37:55.280+0000 7f71f9600640 1 -- 172.21.15.39:0/1271147866 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f71f4101b60 msgr2=0x7f71f4101f60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:37:55.281 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:37:55.280+0000 7f71f9600640 1 --2- 172.21.15.39:0/1271147866 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f71f4101b60 0x7f71f4101f60 secure :-1 s=READY pgs=283 cs=0 l=1 rev1=1 crypto rx=0x7f71e4009900 tx=0x7f71e402a410 comp rx=0 tx=0).stop 2024-09-12T02:37:55.281 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:37:55.280+0000 7f71f9600640 1 -- 172.21.15.39:0/1271147866 shutdown_connections 2024-09-12T02:37:55.281 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:37:55.280+0000 7f71f9600640 1 --2- 172.21.15.39:0/1271147866 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f71f4103710 0x7f71f4109fa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:37:55.281 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:37:55.280+0000 7f71f9600640 1 --2- 172.21.15.39:0/1271147866 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f71f4102d50 0x7f71f41031d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:37:55.281 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:37:55.280+0000 7f71f9600640 1 --2- 172.21.15.39:0/1271147866 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f71f4101b60 0x7f71f4101f60 unknown :-1 s=CLOSED pgs=283 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:37:55.281 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:37:55.280+0000 7f71f9600640 1 -- 172.21.15.39:0/1271147866 >> 172.21.15.39:0/1271147866 conn(0x7f71f40fd2e0 msgr2=0x7f71f40ff700 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:37:55.282 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:37:55.280+0000 7f71f9600640 1 -- 172.21.15.39:0/1271147866 shutdown_connections 2024-09-12T02:37:55.282 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:37:55.280+0000 7f71f9600640 1 -- 172.21.15.39:0/1271147866 wait complete. 2024-09-12T02:37:55.284 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:37:55.281+0000 7f71f9600640 1 Processor -- start 2024-09-12T02:37:55.284 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:37:55.281+0000 7f71f9600640 1 -- start start 2024-09-12T02:37:55.284 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:37:55.281+0000 7f71f9600640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f71f4101b60 0x7f71f4199ff0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:37:55.284 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:37:55.281+0000 7f71f9600640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f71f4102d50 0x7f71f419a530 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:37:55.284 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:37:55.281+0000 7f71f9600640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f71f4103710 0x7f71f41a15a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:37:55.284 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:37:55.281+0000 7f71f9600640 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 -- 0x7f71f410d810 con 0x7f71f4103710 2024-09-12T02:37:55.285 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:37:55.281+0000 7f71f9600640 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x7f71f410d690 con 0x7f71f4101b60 2024-09-12T02:37:55.285 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:37:55.281+0000 7f71f9600640 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7f71f410d990 con 0x7f71f4102d50 2024-09-12T02:37:55.285 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:37:55.282+0000 7f71f3400640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f71f4103710 0x7f71f41a15a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:37:55.285 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:37:55.282+0000 7f71f2a00640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f71f4101b60 0x7f71f4199ff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:37:55.285 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:37:55.282+0000 7f71f2a00640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f71f4101b60 0x7f71f4199ff0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.39:52030/0 (socket says 172.21.15.39:52030) 2024-09-12T02:37:55.285 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:37:55.282+0000 7f71f2a00640 1 -- 172.21.15.39:0/108994807 learned_addr learned my addr 172.21.15.39:0/108994807 (peer_addr_for_me v2:172.21.15.39:0/0) 2024-09-12T02:37:55.285 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:37:55.282+0000 7f71f2000640 1 --2- 172.21.15.39:0/108994807 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f71f4102d50 0x7f71f419a530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:37:55.285 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:37:55.282+0000 7f71f2a00640 1 -- 172.21.15.39:0/108994807 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f71f4102d50 msgr2=0x7f71f419a530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:37:55.285 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:37:55.282+0000 7f71f2a00640 1 --2- 172.21.15.39:0/108994807 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f71f4102d50 0x7f71f419a530 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:37:55.285 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:37:55.282+0000 7f71f2a00640 1 -- 172.21.15.39:0/108994807 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f71f4103710 msgr2=0x7f71f41a15a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:37:55.285 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:37:55.282+0000 7f71f2a00640 1 --2- 172.21.15.39:0/108994807 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f71f4103710 0x7f71f41a15a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:37:55.285 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:37:55.282+0000 7f71f2a00640 1 -- 172.21.15.39:0/108994807 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f71f41a1c10 con 0x7f71f4101b60 2024-09-12T02:37:55.286 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:37:55.282+0000 7f71f2000640 1 --2- 172.21.15.39:0/108994807 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f71f4102d50 0x7f71f419a530 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-12T02:37:55.286 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:37:55.282+0000 7f71f2a00640 1 --2- 172.21.15.39:0/108994807 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f71f4101b60 0x7f71f4199ff0 secure :-1 s=READY pgs=129 cs=0 l=1 rev1=1 crypto rx=0x7f71e4031440 tx=0x7f71e4032ce0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:37:55.286 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:37:55.283+0000 7f71eb400640 1 -- 172.21.15.39:0/108994807 <== mon.2 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f71e403f030 con 0x7f71f4101b60 2024-09-12T02:37:55.286 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:37:55.283+0000 7f71eb400640 1 -- 172.21.15.39:0/108994807 <== mon.2 v2:172.21.15.44:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f71e4003ce0 con 0x7f71f4101b60 2024-09-12T02:37:55.286 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:37:55.283+0000 7f71eb400640 1 -- 172.21.15.39:0/108994807 <== mon.2 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f71e4035070 con 0x7f71f4101b60 2024-09-12T02:37:55.286 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:37:55.283+0000 7f71f9600640 1 -- 172.21.15.39:0/108994807 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f71f41a1ea0 con 0x7f71f4101b60 2024-09-12T02:37:55.286 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:37:55.283+0000 7f71f9600640 1 -- 172.21.15.39:0/108994807 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f71f41a2300 con 0x7f71f4101b60 2024-09-12T02:37:55.287 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:37:55.284+0000 7f71f9600640 1 -- 172.21.15.39:0/108994807 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f71f41a2530 con 0x7f71f4101b60 2024-09-12T02:37:55.287 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:37:55.286+0000 7f71eb400640 1 -- 172.21.15.39:0/108994807 <== mon.2 v2:172.21.15.44:3300/0 4 ==== mgrmap(e 20) ==== 137850+0+0 (secure 0 0 0) 0x7f71e4042030 con 0x7f71f4101b60 2024-09-12T02:37:55.288 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:37:55.287+0000 7f71eb400640 1 --2- 172.21.15.39:0/108994807 >> [v2:172.21.15.39:6800/1725006999,v1:172.21.15.39:6801/1725006999] conn(0x7f71d80a2d00 0x7f71d80a51c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:37:55.288 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:37:55.287+0000 7f71f2000640 1 -- 172.21.15.39:0/108994807 >> [v2:172.21.15.39:6800/1725006999,v1:172.21.15.39:6801/1725006999] conn(0x7f71d80a2d00 msgr2=0x7f71d80a51c0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.39:6800/1725006999 2024-09-12T02:37:55.288 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:37:55.287+0000 7f71eb400640 1 -- 172.21.15.39:0/108994807 <== mon.2 v2:172.21.15.44:3300/0 5 ==== osd_map(95..95 src has 1..95) ==== 9129+0+0 (secure 0 0 0) 0x7f71e40efd30 con 0x7f71f4101b60 2024-09-12T02:37:55.288 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:37:55.287+0000 7f71f2000640 1 --2- 172.21.15.39:0/108994807 >> [v2:172.21.15.39:6800/1725006999,v1:172.21.15.39:6801/1725006999] conn(0x7f71d80a2d00 0x7f71d80a51c0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-09-12T02:37:55.290 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:37:55.289+0000 7f71eb400640 1 -- 172.21.15.39:0/108994807 <== mon.2 v2:172.21.15.44:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7f71e40bc8b0 con 0x7f71f4101b60 2024-09-12T02:37:55.489 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:37:55.488+0000 7f71f2000640 1 -- 172.21.15.39:0/108994807 >> [v2:172.21.15.39:6800/1725006999,v1:172.21.15.39:6801/1725006999] conn(0x7f71d80a2d00 msgr2=0x7f71d80a51c0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.39:6800/1725006999 2024-09-12T02:37:55.489 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:37:55.488+0000 7f71f2000640 1 --2- 172.21.15.39:0/108994807 >> [v2:172.21.15.39:6800/1725006999,v1:172.21.15.39:6801/1725006999] conn(0x7f71d80a2d00 0x7f71d80a51c0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2024-09-12T02:37:55.514 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:37:55.514+0000 7f71eb400640 1 -- 172.21.15.39:0/108994807 <== mon.2 v2:172.21.15.44:3300/0 7 ==== mgrmap(e 21) ==== 137850+0+0 (secure 0 0 0) 0x7f71e40b8820 con 0x7f71f4101b60 2024-09-12T02:37:55.518 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:37:55.518+0000 7f71f9600640 1 -- 172.21.15.39:0/108994807 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "balance_automate", "val": "false"} v 0) -- 0x7f71f41a27a0 con 0x7f71f4101b60 2024-09-12T02:37:55.764 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 12 02:37:55 smithi172 ceph-mon[35609]: mgrmap e20: x(active, since 10m), standbys: y, z 2024-09-12T02:37:55.764 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 12 02:37:55 smithi172 ceph-mon[35609]: Standby manager daemon y restarted 2024-09-12T02:37:55.764 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 12 02:37:55 smithi172 ceph-mon[35609]: Standby manager daemon y started 2024-09-12T02:37:55.764 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 12 02:37:55 smithi172 ceph-mon[35609]: from='mgr.? 172.21.15.44:0/418018800' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/y/crt"}]: dispatch 2024-09-12T02:37:55.764 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 12 02:37:55 smithi172 ceph-mon[35609]: from='mgr.? 172.21.15.44:0/418018800' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/crt"}]: dispatch 2024-09-12T02:37:55.764 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 12 02:37:55 smithi172 ceph-mon[35609]: from='mgr.? 172.21.15.44:0/418018800' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/y/key"}]: dispatch 2024-09-12T02:37:55.764 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 12 02:37:55 smithi172 ceph-mon[35609]: from='mgr.? 172.21.15.44:0/418018800' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/key"}]: dispatch 2024-09-12T02:37:55.850 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 02:37:55 smithi039 ceph-mon[30515]: mgrmap e20: x(active, since 10m), standbys: y, z 2024-09-12T02:37:55.850 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 02:37:55 smithi039 ceph-mon[30515]: Standby manager daemon y restarted 2024-09-12T02:37:55.850 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 02:37:55 smithi039 ceph-mon[30515]: Standby manager daemon y started 2024-09-12T02:37:55.850 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 02:37:55 smithi039 ceph-mon[30515]: from='mgr.? 172.21.15.44:0/418018800' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/y/crt"}]: dispatch 2024-09-12T02:37:55.850 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 02:37:55 smithi039 ceph-mon[30515]: from='mgr.? 172.21.15.44:0/418018800' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/crt"}]: dispatch 2024-09-12T02:37:55.850 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 02:37:55 smithi039 ceph-mon[30515]: from='mgr.? 172.21.15.44:0/418018800' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/y/key"}]: dispatch 2024-09-12T02:37:55.850 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 02:37:55 smithi039 ceph-mon[30515]: from='mgr.? 172.21.15.44:0/418018800' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/key"}]: dispatch 2024-09-12T02:37:55.889 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:37:55.889+0000 7f71f2000640 1 -- 172.21.15.39:0/108994807 >> [v2:172.21.15.39:6800/1725006999,v1:172.21.15.39:6801/1725006999] conn(0x7f71d80a2d00 msgr2=0x7f71d80a51c0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.39:6800/1725006999 2024-09-12T02:37:55.889 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:37:55.889+0000 7f71f2000640 1 --2- 172.21.15.39:0/108994807 >> [v2:172.21.15.39:6800/1725006999,v1:172.21.15.39:6801/1725006999] conn(0x7f71d80a2d00 0x7f71d80a51c0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2024-09-12T02:37:55.947 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:37:55.946+0000 7f71eb400640 1 -- 172.21.15.39:0/108994807 <== mon.2 v2:172.21.15.44:3300/0 8 ==== mgrmap(e 22) ==== 137518+0+0 (secure 0 0 0) 0x7f71e40ed4d0 con 0x7f71f4101b60 2024-09-12T02:37:55.947 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:37:55.947+0000 7f71eb400640 1 -- 172.21.15.39:0/108994807 >> [v2:172.21.15.39:6800/1725006999,v1:172.21.15.39:6801/1725006999] conn(0x7f71d80a2d00 msgr2=0x7f71d80a51c0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-09-12T02:37:55.947 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:37:55.947+0000 7f71eb400640 1 --2- 172.21.15.39:0/108994807 >> [v2:172.21.15.39:6800/1725006999,v1:172.21.15.39:6801/1725006999] conn(0x7f71d80a2d00 0x7f71d80a51c0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:37:55.948 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 12 02:37:55 smithi044 ceph-mon[35411]: mgrmap e20: x(active, since 10m), standbys: y, z 2024-09-12T02:37:55.948 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 12 02:37:55 smithi044 ceph-mon[35411]: Standby manager daemon y restarted 2024-09-12T02:37:55.948 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 12 02:37:55 smithi044 ceph-mon[35411]: Standby manager daemon y started 2024-09-12T02:37:55.948 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 12 02:37:55 smithi044 ceph-mon[35411]: from='mgr.? 172.21.15.44:0/418018800' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/y/crt"}]: dispatch 2024-09-12T02:37:55.948 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 12 02:37:55 smithi044 ceph-mon[35411]: from='mgr.? 172.21.15.44:0/418018800' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/crt"}]: dispatch 2024-09-12T02:37:55.948 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 12 02:37:55 smithi044 ceph-mon[35411]: from='mgr.? 172.21.15.44:0/418018800' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/y/key"}]: dispatch 2024-09-12T02:37:55.949 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 12 02:37:55 smithi044 ceph-mon[35411]: from='mgr.? 172.21.15.44:0/418018800' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/key"}]: dispatch 2024-09-12T02:37:56.235 INFO:journalctl@ceph.mgr.x.smithi039.stdout:Sep 12 02:37:55 smithi039 ceph-4954ed46-70ae-11ef-bcea-c7b262605968-mgr-x[30736]: 2024-09-12T02:37:55.924+0000 7fbaf0e1a040 -1 mgr[py] Module telegraf has missing NOTIFY_TYPES member 2024-09-12T02:37:56.511 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:37:56.510+0000 7f71eb400640 1 -- 172.21.15.39:0/108994807 <== mon.2 v2:172.21.15.44:3300/0 9 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "balance_automate", "val": "false"}]=0 v29) ==== 118+0+0 (secure 0 0 0) 0x7f71e40e9260 con 0x7f71f4101b60 2024-09-12T02:37:56.513 INFO:journalctl@ceph.mgr.x.smithi039.stdout:Sep 12 02:37:56 smithi039 ceph-4954ed46-70ae-11ef-bcea-c7b262605968-mgr-x[30736]: 2024-09-12T02:37:56.233+0000 7fba48600640 -1 client.0 error registering admin socket command: (17) File exists 2024-09-12T02:37:56.514 INFO:journalctl@ceph.mgr.x.smithi039.stdout:Sep 12 02:37:56 smithi039 ceph-4954ed46-70ae-11ef-bcea-c7b262605968-mgr-x[30736]: 2024-09-12T02:37:56.233+0000 7fba48600640 -1 client.0 error registering admin socket command: (17) File exists 2024-09-12T02:37:56.514 INFO:journalctl@ceph.mgr.x.smithi039.stdout:Sep 12 02:37:56 smithi039 ceph-4954ed46-70ae-11ef-bcea-c7b262605968-mgr-x[30736]: 2024-09-12T02:37:56.233+0000 7fba48600640 -1 client.0 error registering admin socket command: (17) File exists 2024-09-12T02:37:56.514 INFO:journalctl@ceph.mgr.x.smithi039.stdout:Sep 12 02:37:56 smithi039 ceph-4954ed46-70ae-11ef-bcea-c7b262605968-mgr-x[30736]: 2024-09-12T02:37:56.233+0000 7fba48600640 -1 client.0 error registering admin socket command: (17) File exists 2024-09-12T02:37:56.514 INFO:journalctl@ceph.mgr.x.smithi039.stdout:Sep 12 02:37:56 smithi039 ceph-4954ed46-70ae-11ef-bcea-c7b262605968-mgr-x[30736]: 2024-09-12T02:37:56.233+0000 7fba48600640 -1 client.0 error registering admin socket command: (17) File exists 2024-09-12T02:37:56.514 INFO:journalctl@ceph.mgr.x.smithi039.stdout:Sep 12 02:37:56 smithi039 ceph-4954ed46-70ae-11ef-bcea-c7b262605968-mgr-x[30736]: 2024-09-12T02:37:56.235+0000 7fba4e000640 -1 client.0 error registering admin socket command: (17) File exists 2024-09-12T02:37:56.514 INFO:journalctl@ceph.mgr.x.smithi039.stdout:Sep 12 02:37:56 smithi039 ceph-4954ed46-70ae-11ef-bcea-c7b262605968-mgr-x[30736]: 2024-09-12T02:37:56.235+0000 7fba4e000640 -1 client.0 error registering admin socket command: (17) File exists 2024-09-12T02:37:56.514 INFO:journalctl@ceph.mgr.x.smithi039.stdout:Sep 12 02:37:56 smithi039 ceph-4954ed46-70ae-11ef-bcea-c7b262605968-mgr-x[30736]: 2024-09-12T02:37:56.235+0000 7fba4e000640 -1 client.0 error registering admin socket command: (17) File exists 2024-09-12T02:37:56.514 INFO:journalctl@ceph.mgr.x.smithi039.stdout:Sep 12 02:37:56 smithi039 ceph-4954ed46-70ae-11ef-bcea-c7b262605968-mgr-x[30736]: 2024-09-12T02:37:56.235+0000 7fba4e000640 -1 client.0 error registering admin socket command: (17) File exists 2024-09-12T02:37:56.514 INFO:journalctl@ceph.mgr.x.smithi039.stdout:Sep 12 02:37:56 smithi039 ceph-4954ed46-70ae-11ef-bcea-c7b262605968-mgr-x[30736]: 2024-09-12T02:37:56.235+0000 7fba4e000640 -1 client.0 error registering admin socket command: (17) File exists 2024-09-12T02:37:56.515 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:37:56.514+0000 7f71f9600640 1 -- 172.21.15.39:0/108994807 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f71f4101b60 msgr2=0x7f71f4199ff0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:37:56.515 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:37:56.514+0000 7f71f9600640 1 --2- 172.21.15.39:0/108994807 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f71f4101b60 0x7f71f4199ff0 secure :-1 s=READY pgs=129 cs=0 l=1 rev1=1 crypto rx=0x7f71e4031440 tx=0x7f71e4032ce0 comp rx=0 tx=0).stop 2024-09-12T02:37:56.515 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:37:56.514+0000 7f71f9600640 1 -- 172.21.15.39:0/108994807 shutdown_connections 2024-09-12T02:37:56.515 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:37:56.514+0000 7f71f9600640 1 --2- 172.21.15.39:0/108994807 >> [v2:172.21.15.39:6800/1725006999,v1:172.21.15.39:6801/1725006999] conn(0x7f71d80a2d00 0x7f71d80a51c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:37:56.515 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:37:56.514+0000 7f71f9600640 1 --2- 172.21.15.39:0/108994807 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f71f4103710 0x7f71f41a15a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:37:56.515 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:37:56.514+0000 7f71f9600640 1 --2- 172.21.15.39:0/108994807 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f71f4102d50 0x7f71f419a530 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:37:56.515 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:37:56.514+0000 7f71f9600640 1 --2- 172.21.15.39:0/108994807 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f71f4101b60 0x7f71f4199ff0 unknown :-1 s=CLOSED pgs=129 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:37:56.516 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:37:56.514+0000 7f71f9600640 1 -- 172.21.15.39:0/108994807 >> 172.21.15.39:0/108994807 conn(0x7f71f40fd2e0 msgr2=0x7f71f4074420 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:37:56.516 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:37:56.514+0000 7f71f9600640 1 -- 172.21.15.39:0/108994807 shutdown_connections 2024-09-12T02:37:56.516 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:37:56.514+0000 7f71f9600640 1 -- 172.21.15.39:0/108994807 wait complete. 2024-09-12T02:37:56.533 DEBUG:teuthology.orchestra.run.smithi039:> sudo TESTDIR=/home/ubuntu/cephtest bash -c 'ceph fs subvolumegroup pin cephfs qa random 0.10' 2024-09-12T02:37:56.632 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 12 02:37:56 smithi044 ceph-mon[35411]: mgrmap e21: x(active, since 10m), standbys: y, z 2024-09-12T02:37:56.633 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 12 02:37:56 smithi044 ceph-mon[35411]: from='client.? 172.21.15.39:0/108994807' entity='client.admin' cmd=[{"prefix": "fs set", "fs_name": "cephfs", "var": "balance_automate", "val": "false"}]: dispatch 2024-09-12T02:37:56.633 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 12 02:37:56 smithi044 ceph-mon[35411]: from='client.? ' entity='client.admin' cmd=[{"prefix": "fs set", "fs_name": "cephfs", "var": "balance_automate", "val": "false"}]: dispatch 2024-09-12T02:37:56.633 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 12 02:37:56 smithi044 ceph-mon[35411]: Active manager daemon x restarted 2024-09-12T02:37:56.633 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 12 02:37:56 smithi044 ceph-mon[35411]: Activating manager daemon x 2024-09-12T02:37:56.633 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 12 02:37:56 smithi044 ceph-mon[35411]: osdmap e96: 12 total, 12 up, 12 in 2024-09-12T02:37:56.633 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 12 02:37:56 smithi044 ceph-mon[35411]: mgrmap e22: x(active, starting, since 0.0194209s), standbys: y, z 2024-09-12T02:37:56.633 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 12 02:37:56 smithi044 ceph-mon[35411]: from='mgr.25199 172.21.15.39:0/1270637502' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2024-09-12T02:37:56.633 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 12 02:37:56 smithi044 ceph-mon[35411]: from='mgr.25199 172.21.15.39:0/1270637502' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-09-12T02:37:56.633 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 12 02:37:56 smithi044 ceph-mon[35411]: from='mgr.25199 172.21.15.39:0/1270637502' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-09-12T02:37:56.633 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 12 02:37:56 smithi044 ceph-mon[35411]: from='mgr.25199 172.21.15.39:0/1270637502' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "j"}]: dispatch 2024-09-12T02:37:56.634 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 12 02:37:56 smithi044 ceph-mon[35411]: from='mgr.25199 172.21.15.39:0/1270637502' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "g"}]: dispatch 2024-09-12T02:37:56.634 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 12 02:37:56 smithi044 ceph-mon[35411]: from='mgr.25199 172.21.15.39:0/1270637502' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "a"}]: dispatch 2024-09-12T02:37:56.634 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 12 02:37:56 smithi044 ceph-mon[35411]: from='mgr.25199 172.21.15.39:0/1270637502' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "k"}]: dispatch 2024-09-12T02:37:56.634 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 12 02:37:56 smithi044 ceph-mon[35411]: from='mgr.25199 172.21.15.39:0/1270637502' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "l"}]: dispatch 2024-09-12T02:37:56.634 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 12 02:37:56 smithi044 ceph-mon[35411]: from='mgr.25199 172.21.15.39:0/1270637502' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "d"}]: dispatch 2024-09-12T02:37:56.634 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 12 02:37:56 smithi044 ceph-mon[35411]: from='mgr.25199 172.21.15.39:0/1270637502' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "e"}]: dispatch 2024-09-12T02:37:56.634 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 12 02:37:56 smithi044 ceph-mon[35411]: from='mgr.25199 172.21.15.39:0/1270637502' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "f"}]: dispatch 2024-09-12T02:37:56.634 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 12 02:37:56 smithi044 ceph-mon[35411]: from='mgr.25199 172.21.15.39:0/1270637502' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "h"}]: dispatch 2024-09-12T02:37:56.634 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 12 02:37:56 smithi044 ceph-mon[35411]: from='mgr.25199 172.21.15.39:0/1270637502' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "c"}]: dispatch 2024-09-12T02:37:56.635 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 12 02:37:56 smithi044 ceph-mon[35411]: from='mgr.25199 172.21.15.39:0/1270637502' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "i"}]: dispatch 2024-09-12T02:37:56.635 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 12 02:37:56 smithi044 ceph-mon[35411]: from='mgr.25199 172.21.15.39:0/1270637502' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "b"}]: dispatch 2024-09-12T02:37:56.635 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 12 02:37:56 smithi044 ceph-mon[35411]: from='mgr.25199 172.21.15.39:0/1270637502' entity='mgr.x' cmd=[{"prefix": "mgr metadata", "who": "x", "id": "x"}]: dispatch 2024-09-12T02:37:56.635 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 12 02:37:56 smithi044 ceph-mon[35411]: from='mgr.25199 172.21.15.39:0/1270637502' entity='mgr.x' cmd=[{"prefix": "mgr metadata", "who": "y", "id": "y"}]: dispatch 2024-09-12T02:37:56.635 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 12 02:37:56 smithi044 ceph-mon[35411]: from='mgr.25199 172.21.15.39:0/1270637502' entity='mgr.x' cmd=[{"prefix": "mgr metadata", "who": "z", "id": "z"}]: dispatch 2024-09-12T02:37:56.635 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 12 02:37:56 smithi044 ceph-mon[35411]: from='mgr.25199 172.21.15.39:0/1270637502' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-09-12T02:37:56.635 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 12 02:37:56 smithi044 ceph-mon[35411]: from='mgr.25199 172.21.15.39:0/1270637502' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-09-12T02:37:56.635 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 12 02:37:56 smithi044 ceph-mon[35411]: from='mgr.25199 172.21.15.39:0/1270637502' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-09-12T02:37:56.635 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 12 02:37:56 smithi044 ceph-mon[35411]: from='mgr.25199 172.21.15.39:0/1270637502' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-09-12T02:37:56.635 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 12 02:37:56 smithi044 ceph-mon[35411]: from='mgr.25199 172.21.15.39:0/1270637502' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-09-12T02:37:56.635 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 12 02:37:56 smithi044 ceph-mon[35411]: from='mgr.25199 172.21.15.39:0/1270637502' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-09-12T02:37:56.635 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 12 02:37:56 smithi044 ceph-mon[35411]: from='mgr.25199 172.21.15.39:0/1270637502' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2024-09-12T02:37:56.635 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 12 02:37:56 smithi044 ceph-mon[35411]: from='mgr.25199 172.21.15.39:0/1270637502' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 7}]: dispatch 2024-09-12T02:37:56.635 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 12 02:37:56 smithi044 ceph-mon[35411]: from='mgr.25199 172.21.15.39:0/1270637502' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 8}]: dispatch 2024-09-12T02:37:56.636 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 12 02:37:56 smithi044 ceph-mon[35411]: from='mgr.25199 172.21.15.39:0/1270637502' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 9}]: dispatch 2024-09-12T02:37:56.636 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 12 02:37:56 smithi044 ceph-mon[35411]: from='mgr.25199 172.21.15.39:0/1270637502' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 10}]: dispatch 2024-09-12T02:37:56.636 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 12 02:37:56 smithi044 ceph-mon[35411]: from='mgr.25199 172.21.15.39:0/1270637502' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 11}]: dispatch 2024-09-12T02:37:56.636 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 12 02:37:56 smithi044 ceph-mon[35411]: from='mgr.25199 172.21.15.39:0/1270637502' entity='mgr.x' cmd=[{"prefix": "mds metadata"}]: dispatch 2024-09-12T02:37:56.636 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 12 02:37:56 smithi044 ceph-mon[35411]: from='mgr.25199 172.21.15.39:0/1270637502' entity='mgr.x' cmd=[{"prefix": "osd metadata"}]: dispatch 2024-09-12T02:37:56.636 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 12 02:37:56 smithi044 ceph-mon[35411]: from='mgr.25199 172.21.15.39:0/1270637502' entity='mgr.x' cmd=[{"prefix": "mon metadata"}]: dispatch 2024-09-12T02:37:56.636 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 12 02:37:56 smithi044 ceph-mon[35411]: Manager daemon x is now available 2024-09-12T02:37:56.636 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 12 02:37:56 smithi044 ceph-mon[35411]: from='mgr.25199 172.21.15.39:0/1270637502' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-12T02:37:56.636 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 12 02:37:56 smithi044 ceph-mon[35411]: from='mgr.25199 172.21.15.39:0/1270637502' entity='mgr.x' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/x/mirror_snapshot_schedule"}]: dispatch 2024-09-12T02:37:56.636 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 12 02:37:56 smithi044 ceph-mon[35411]: from='mgr.25199 172.21.15.39:0/1270637502' entity='mgr.x' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/x/trash_purge_schedule"}]: dispatch 2024-09-12T02:37:56.699 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:37:56.698+0000 7f649be00640 1 -- 172.21.15.39:0/1239615771 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f6494078790 msgr2=0x7f6494079030 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:37:56.699 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:37:56.698+0000 7f649be00640 1 --2- 172.21.15.39:0/1239615771 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f6494078790 0x7f6494079030 secure :-1 s=READY pgs=288 cs=0 l=1 rev1=1 crypto rx=0x7f648c009ca0 tx=0x7f648c02a8c0 comp rx=0 tx=0).stop 2024-09-12T02:37:56.699 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:37:56.698+0000 7f649be00640 1 -- 172.21.15.39:0/1239615771 shutdown_connections 2024-09-12T02:37:56.700 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:37:56.698+0000 7f649be00640 1 --2- 172.21.15.39:0/1239615771 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f6494078790 0x7f6494079030 unknown :-1 s=CLOSED pgs=288 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:37:56.700 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:37:56.698+0000 7f649be00640 1 --2- 172.21.15.39:0/1239615771 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f6494077df0 0x7f6494078250 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:37:56.700 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:37:56.698+0000 7f649be00640 1 --2- 172.21.15.39:0/1239615771 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f6494076bb0 0x7f6494076fb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:37:56.700 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:37:56.698+0000 7f649be00640 1 -- 172.21.15.39:0/1239615771 >> 172.21.15.39:0/1239615771 conn(0x7f64940ff4e0 msgr2=0x7f6494101900 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:37:56.700 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:37:56.698+0000 7f649be00640 1 -- 172.21.15.39:0/1239615771 shutdown_connections 2024-09-12T02:37:56.700 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:37:56.698+0000 7f649be00640 1 -- 172.21.15.39:0/1239615771 wait complete. 2024-09-12T02:37:56.702 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:37:56.699+0000 7f649be00640 1 Processor -- start 2024-09-12T02:37:56.702 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:37:56.700+0000 7f649be00640 1 -- start start 2024-09-12T02:37:56.702 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:37:56.700+0000 7f649be00640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f6494076bb0 0x7f649419e320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:37:56.702 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:37:56.700+0000 7f649be00640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f6494077df0 0x7f649419e860 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:37:56.702 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:37:56.700+0000 7f649be00640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f6494078790 0x7f64941a58d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:37:56.702 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:37:56.700+0000 7f649be00640 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 -- 0x7f6494113e40 con 0x7f6494077df0 2024-09-12T02:37:56.702 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:37:56.700+0000 7f649be00640 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x7f6494113cc0 con 0x7f6494078790 2024-09-12T02:37:56.703 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:37:56.700+0000 7f649be00640 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7f6494113fc0 con 0x7f6494076bb0 2024-09-12T02:37:56.703 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:37:56.700+0000 7f6499400640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f6494076bb0 0x7f649419e320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:37:56.703 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:37:56.700+0000 7f6498a00640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f6494077df0 0x7f649419e860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:37:56.703 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:37:56.700+0000 7f6499400640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f6494076bb0 0x7f649419e320 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.172:3300/0 says I am v2:172.21.15.39:43032/0 (socket says 172.21.15.39:43032) 2024-09-12T02:37:56.703 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:37:56.700+0000 7f6499400640 1 -- 172.21.15.39:0/3769397038 learned_addr learned my addr 172.21.15.39:0/3769397038 (peer_addr_for_me v2:172.21.15.39:0/0) 2024-09-12T02:37:56.703 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:37:56.700+0000 7f6499e00640 1 --2- 172.21.15.39:0/3769397038 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f6494078790 0x7f64941a58d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:37:56.703 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:37:56.701+0000 7f6499400640 1 -- 172.21.15.39:0/3769397038 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f6494078790 msgr2=0x7f64941a58d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:37:56.703 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:37:56.701+0000 7f6499400640 1 --2- 172.21.15.39:0/3769397038 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f6494078790 0x7f64941a58d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:37:56.703 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:37:56.701+0000 7f6499400640 1 -- 172.21.15.39:0/3769397038 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f6494077df0 msgr2=0x7f649419e860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:37:56.703 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:37:56.701+0000 7f6499400640 1 --2- 172.21.15.39:0/3769397038 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f6494077df0 0x7f649419e860 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:37:56.703 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:37:56.701+0000 7f6499400640 1 -- 172.21.15.39:0/3769397038 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f64941a5f40 con 0x7f6494076bb0 2024-09-12T02:37:56.703 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:37:56.701+0000 7f6499400640 1 --2- 172.21.15.39:0/3769397038 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f6494076bb0 0x7f649419e320 secure :-1 s=READY pgs=117 cs=0 l=1 rev1=1 crypto rx=0x7f648800e9f0 tx=0x7f648800eeb0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:37:56.703 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:37:56.701+0000 7f6492000640 1 -- 172.21.15.39:0/3769397038 <== mon.1 v2:172.21.15.172:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f648800cd80 con 0x7f6494076bb0 2024-09-12T02:37:56.703 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:37:56.701+0000 7f6492000640 1 -- 172.21.15.39:0/3769397038 <== mon.1 v2:172.21.15.172:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f6488010910 con 0x7f6494076bb0 2024-09-12T02:37:56.704 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:37:56.701+0000 7f6492000640 1 -- 172.21.15.39:0/3769397038 <== mon.1 v2:172.21.15.172:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6488018990 con 0x7f6494076bb0 2024-09-12T02:37:56.704 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:37:56.701+0000 7f649be00640 1 -- 172.21.15.39:0/3769397038 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f64941a6230 con 0x7f6494076bb0 2024-09-12T02:37:56.704 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:37:56.701+0000 7f649be00640 1 -- 172.21.15.39:0/3769397038 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f64941a6730 con 0x7f6494076bb0 2024-09-12T02:37:56.704 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:37:56.703+0000 7f649be00640 1 -- 172.21.15.39:0/3769397038 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f64941106d0 con 0x7f6494076bb0 2024-09-12T02:37:56.705 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:37:56.704+0000 7f6492000640 1 -- 172.21.15.39:0/3769397038 <== mon.1 v2:172.21.15.172:3300/0 4 ==== mgrmap(e 22) ==== 137518+0+0 (secure 0 0 0) 0x7f6488010ac0 con 0x7f6494076bb0 2024-09-12T02:37:56.707 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:37:56.707+0000 7f6492000640 1 -- 172.21.15.39:0/3769397038 <== mon.1 v2:172.21.15.172:3300/0 5 ==== osd_map(96..96 src has 1..96) ==== 9387+0+0 (secure 0 0 0) 0x7f64880cf210 con 0x7f6494076bb0 2024-09-12T02:37:56.710 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:37:56.709+0000 7f6492000640 1 -- 172.21.15.39:0/3769397038 <== mon.1 v2:172.21.15.172:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7f648809ba40 con 0x7f6494076bb0 2024-09-12T02:37:56.764 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 12 02:37:56 smithi172 ceph-mon[35609]: mgrmap e21: x(active, since 10m), standbys: y, z 2024-09-12T02:37:56.764 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 12 02:37:56 smithi172 ceph-mon[35609]: from='client.? 172.21.15.39:0/108994807' entity='client.admin' cmd=[{"prefix": "fs set", "fs_name": "cephfs", "var": "balance_automate", "val": "false"}]: dispatch 2024-09-12T02:37:56.764 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 12 02:37:56 smithi172 ceph-mon[35609]: from='client.? ' entity='client.admin' cmd=[{"prefix": "fs set", "fs_name": "cephfs", "var": "balance_automate", "val": "false"}]: dispatch 2024-09-12T02:37:56.764 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 12 02:37:56 smithi172 ceph-mon[35609]: Active manager daemon x restarted 2024-09-12T02:37:56.764 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 12 02:37:56 smithi172 ceph-mon[35609]: Activating manager daemon x 2024-09-12T02:37:56.764 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 12 02:37:56 smithi172 ceph-mon[35609]: osdmap e96: 12 total, 12 up, 12 in 2024-09-12T02:37:56.764 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 12 02:37:56 smithi172 ceph-mon[35609]: mgrmap e22: x(active, starting, since 0.0194209s), standbys: y, z 2024-09-12T02:37:56.765 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 12 02:37:56 smithi172 ceph-mon[35609]: from='mgr.25199 172.21.15.39:0/1270637502' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2024-09-12T02:37:56.765 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 12 02:37:56 smithi172 ceph-mon[35609]: from='mgr.25199 172.21.15.39:0/1270637502' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-09-12T02:37:56.765 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 12 02:37:56 smithi172 ceph-mon[35609]: from='mgr.25199 172.21.15.39:0/1270637502' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-09-12T02:37:56.765 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 12 02:37:56 smithi172 ceph-mon[35609]: from='mgr.25199 172.21.15.39:0/1270637502' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "j"}]: dispatch 2024-09-12T02:37:56.765 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 12 02:37:56 smithi172 ceph-mon[35609]: from='mgr.25199 172.21.15.39:0/1270637502' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "g"}]: dispatch 2024-09-12T02:37:56.765 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 12 02:37:56 smithi172 ceph-mon[35609]: from='mgr.25199 172.21.15.39:0/1270637502' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "a"}]: dispatch 2024-09-12T02:37:56.765 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 12 02:37:56 smithi172 ceph-mon[35609]: from='mgr.25199 172.21.15.39:0/1270637502' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "k"}]: dispatch 2024-09-12T02:37:56.765 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 12 02:37:56 smithi172 ceph-mon[35609]: from='mgr.25199 172.21.15.39:0/1270637502' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "l"}]: dispatch 2024-09-12T02:37:56.765 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 12 02:37:56 smithi172 ceph-mon[35609]: from='mgr.25199 172.21.15.39:0/1270637502' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "d"}]: dispatch 2024-09-12T02:37:56.766 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 12 02:37:56 smithi172 ceph-mon[35609]: from='mgr.25199 172.21.15.39:0/1270637502' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "e"}]: dispatch 2024-09-12T02:37:56.766 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 12 02:37:56 smithi172 ceph-mon[35609]: from='mgr.25199 172.21.15.39:0/1270637502' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "f"}]: dispatch 2024-09-12T02:37:56.766 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 12 02:37:56 smithi172 ceph-mon[35609]: from='mgr.25199 172.21.15.39:0/1270637502' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "h"}]: dispatch 2024-09-12T02:37:56.766 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 12 02:37:56 smithi172 ceph-mon[35609]: from='mgr.25199 172.21.15.39:0/1270637502' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "c"}]: dispatch 2024-09-12T02:37:56.766 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 12 02:37:56 smithi172 ceph-mon[35609]: from='mgr.25199 172.21.15.39:0/1270637502' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "i"}]: dispatch 2024-09-12T02:37:56.766 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 12 02:37:56 smithi172 ceph-mon[35609]: from='mgr.25199 172.21.15.39:0/1270637502' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "b"}]: dispatch 2024-09-12T02:37:56.766 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 12 02:37:56 smithi172 ceph-mon[35609]: from='mgr.25199 172.21.15.39:0/1270637502' entity='mgr.x' cmd=[{"prefix": "mgr metadata", "who": "x", "id": "x"}]: dispatch 2024-09-12T02:37:56.766 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 12 02:37:56 smithi172 ceph-mon[35609]: from='mgr.25199 172.21.15.39:0/1270637502' entity='mgr.x' cmd=[{"prefix": "mgr metadata", "who": "y", "id": "y"}]: dispatch 2024-09-12T02:37:56.766 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 12 02:37:56 smithi172 ceph-mon[35609]: from='mgr.25199 172.21.15.39:0/1270637502' entity='mgr.x' cmd=[{"prefix": "mgr metadata", "who": "z", "id": "z"}]: dispatch 2024-09-12T02:37:56.766 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 12 02:37:56 smithi172 ceph-mon[35609]: from='mgr.25199 172.21.15.39:0/1270637502' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-09-12T02:37:56.766 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 12 02:37:56 smithi172 ceph-mon[35609]: from='mgr.25199 172.21.15.39:0/1270637502' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-09-12T02:37:56.766 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 12 02:37:56 smithi172 ceph-mon[35609]: from='mgr.25199 172.21.15.39:0/1270637502' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-09-12T02:37:56.766 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 12 02:37:56 smithi172 ceph-mon[35609]: from='mgr.25199 172.21.15.39:0/1270637502' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-09-12T02:37:56.766 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 12 02:37:56 smithi172 ceph-mon[35609]: from='mgr.25199 172.21.15.39:0/1270637502' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-09-12T02:37:56.767 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 12 02:37:56 smithi172 ceph-mon[35609]: from='mgr.25199 172.21.15.39:0/1270637502' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-09-12T02:37:56.767 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 12 02:37:56 smithi172 ceph-mon[35609]: from='mgr.25199 172.21.15.39:0/1270637502' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2024-09-12T02:37:56.767 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 12 02:37:56 smithi172 ceph-mon[35609]: from='mgr.25199 172.21.15.39:0/1270637502' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 7}]: dispatch 2024-09-12T02:37:56.767 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 12 02:37:56 smithi172 ceph-mon[35609]: from='mgr.25199 172.21.15.39:0/1270637502' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 8}]: dispatch 2024-09-12T02:37:56.767 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 12 02:37:56 smithi172 ceph-mon[35609]: from='mgr.25199 172.21.15.39:0/1270637502' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 9}]: dispatch 2024-09-12T02:37:56.767 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 12 02:37:56 smithi172 ceph-mon[35609]: from='mgr.25199 172.21.15.39:0/1270637502' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 10}]: dispatch 2024-09-12T02:37:56.767 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 12 02:37:56 smithi172 ceph-mon[35609]: from='mgr.25199 172.21.15.39:0/1270637502' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 11}]: dispatch 2024-09-12T02:37:56.767 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 12 02:37:56 smithi172 ceph-mon[35609]: from='mgr.25199 172.21.15.39:0/1270637502' entity='mgr.x' cmd=[{"prefix": "mds metadata"}]: dispatch 2024-09-12T02:37:56.767 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 12 02:37:56 smithi172 ceph-mon[35609]: from='mgr.25199 172.21.15.39:0/1270637502' entity='mgr.x' cmd=[{"prefix": "osd metadata"}]: dispatch 2024-09-12T02:37:56.767 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 12 02:37:56 smithi172 ceph-mon[35609]: from='mgr.25199 172.21.15.39:0/1270637502' entity='mgr.x' cmd=[{"prefix": "mon metadata"}]: dispatch 2024-09-12T02:37:56.767 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 12 02:37:56 smithi172 ceph-mon[35609]: Manager daemon x is now available 2024-09-12T02:37:56.767 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 12 02:37:56 smithi172 ceph-mon[35609]: from='mgr.25199 172.21.15.39:0/1270637502' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-12T02:37:56.767 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 12 02:37:56 smithi172 ceph-mon[35609]: from='mgr.25199 172.21.15.39:0/1270637502' entity='mgr.x' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/x/mirror_snapshot_schedule"}]: dispatch 2024-09-12T02:37:56.768 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 12 02:37:56 smithi172 ceph-mon[35609]: from='mgr.25199 172.21.15.39:0/1270637502' entity='mgr.x' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/x/trash_purge_schedule"}]: dispatch 2024-09-12T02:37:56.850 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 02:37:56 smithi039 ceph-mon[30515]: mgrmap e21: x(active, since 10m), standbys: y, z 2024-09-12T02:37:56.850 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 02:37:56 smithi039 ceph-mon[30515]: from='client.? 172.21.15.39:0/108994807' entity='client.admin' cmd=[{"prefix": "fs set", "fs_name": "cephfs", "var": "balance_automate", "val": "false"}]: dispatch 2024-09-12T02:37:56.850 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 02:37:56 smithi039 ceph-mon[30515]: from='client.? ' entity='client.admin' cmd=[{"prefix": "fs set", "fs_name": "cephfs", "var": "balance_automate", "val": "false"}]: dispatch 2024-09-12T02:37:56.850 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 02:37:56 smithi039 ceph-mon[30515]: Active manager daemon x restarted 2024-09-12T02:37:56.851 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 02:37:56 smithi039 ceph-mon[30515]: Activating manager daemon x 2024-09-12T02:37:56.851 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 02:37:56 smithi039 ceph-mon[30515]: osdmap e96: 12 total, 12 up, 12 in 2024-09-12T02:37:56.851 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 02:37:56 smithi039 ceph-mon[30515]: mgrmap e22: x(active, starting, since 0.0194209s), standbys: y, z 2024-09-12T02:37:56.851 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 02:37:56 smithi039 ceph-mon[30515]: from='mgr.25199 172.21.15.39:0/1270637502' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2024-09-12T02:37:56.851 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 02:37:56 smithi039 ceph-mon[30515]: from='mgr.25199 172.21.15.39:0/1270637502' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-09-12T02:37:56.851 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 02:37:56 smithi039 ceph-mon[30515]: from='mgr.25199 172.21.15.39:0/1270637502' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-09-12T02:37:56.851 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 02:37:56 smithi039 ceph-mon[30515]: from='mgr.25199 172.21.15.39:0/1270637502' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "j"}]: dispatch 2024-09-12T02:37:56.851 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 02:37:56 smithi039 ceph-mon[30515]: from='mgr.25199 172.21.15.39:0/1270637502' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "g"}]: dispatch 2024-09-12T02:37:56.851 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 02:37:56 smithi039 ceph-mon[30515]: from='mgr.25199 172.21.15.39:0/1270637502' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "a"}]: dispatch 2024-09-12T02:37:56.851 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 02:37:56 smithi039 ceph-mon[30515]: from='mgr.25199 172.21.15.39:0/1270637502' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "k"}]: dispatch 2024-09-12T02:37:56.851 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 02:37:56 smithi039 ceph-mon[30515]: from='mgr.25199 172.21.15.39:0/1270637502' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "l"}]: dispatch 2024-09-12T02:37:56.851 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 02:37:56 smithi039 ceph-mon[30515]: from='mgr.25199 172.21.15.39:0/1270637502' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "d"}]: dispatch 2024-09-12T02:37:56.851 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 02:37:56 smithi039 ceph-mon[30515]: from='mgr.25199 172.21.15.39:0/1270637502' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "e"}]: dispatch 2024-09-12T02:37:56.852 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 02:37:56 smithi039 ceph-mon[30515]: from='mgr.25199 172.21.15.39:0/1270637502' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "f"}]: dispatch 2024-09-12T02:37:56.852 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 02:37:56 smithi039 ceph-mon[30515]: from='mgr.25199 172.21.15.39:0/1270637502' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "h"}]: dispatch 2024-09-12T02:37:56.852 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 02:37:56 smithi039 ceph-mon[30515]: from='mgr.25199 172.21.15.39:0/1270637502' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "c"}]: dispatch 2024-09-12T02:37:56.852 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 02:37:56 smithi039 ceph-mon[30515]: from='mgr.25199 172.21.15.39:0/1270637502' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "i"}]: dispatch 2024-09-12T02:37:56.852 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 02:37:56 smithi039 ceph-mon[30515]: from='mgr.25199 172.21.15.39:0/1270637502' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "b"}]: dispatch 2024-09-12T02:37:56.852 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 02:37:56 smithi039 ceph-mon[30515]: from='mgr.25199 172.21.15.39:0/1270637502' entity='mgr.x' cmd=[{"prefix": "mgr metadata", "who": "x", "id": "x"}]: dispatch 2024-09-12T02:37:56.852 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 02:37:56 smithi039 ceph-mon[30515]: from='mgr.25199 172.21.15.39:0/1270637502' entity='mgr.x' cmd=[{"prefix": "mgr metadata", "who": "y", "id": "y"}]: dispatch 2024-09-12T02:37:56.852 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 02:37:56 smithi039 ceph-mon[30515]: from='mgr.25199 172.21.15.39:0/1270637502' entity='mgr.x' cmd=[{"prefix": "mgr metadata", "who": "z", "id": "z"}]: dispatch 2024-09-12T02:37:56.852 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 02:37:56 smithi039 ceph-mon[30515]: from='mgr.25199 172.21.15.39:0/1270637502' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-09-12T02:37:56.852 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 02:37:56 smithi039 ceph-mon[30515]: from='mgr.25199 172.21.15.39:0/1270637502' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-09-12T02:37:56.852 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 02:37:56 smithi039 ceph-mon[30515]: from='mgr.25199 172.21.15.39:0/1270637502' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-09-12T02:37:56.852 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 02:37:56 smithi039 ceph-mon[30515]: from='mgr.25199 172.21.15.39:0/1270637502' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-09-12T02:37:56.853 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 02:37:56 smithi039 ceph-mon[30515]: from='mgr.25199 172.21.15.39:0/1270637502' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-09-12T02:37:56.853 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 02:37:56 smithi039 ceph-mon[30515]: from='mgr.25199 172.21.15.39:0/1270637502' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-09-12T02:37:56.853 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 02:37:56 smithi039 ceph-mon[30515]: from='mgr.25199 172.21.15.39:0/1270637502' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2024-09-12T02:37:56.853 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 02:37:56 smithi039 ceph-mon[30515]: from='mgr.25199 172.21.15.39:0/1270637502' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 7}]: dispatch 2024-09-12T02:37:56.853 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 02:37:56 smithi039 ceph-mon[30515]: from='mgr.25199 172.21.15.39:0/1270637502' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 8}]: dispatch 2024-09-12T02:37:56.853 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 02:37:56 smithi039 ceph-mon[30515]: from='mgr.25199 172.21.15.39:0/1270637502' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 9}]: dispatch 2024-09-12T02:37:56.853 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 02:37:56 smithi039 ceph-mon[30515]: from='mgr.25199 172.21.15.39:0/1270637502' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 10}]: dispatch 2024-09-12T02:37:56.853 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 02:37:56 smithi039 ceph-mon[30515]: from='mgr.25199 172.21.15.39:0/1270637502' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 11}]: dispatch 2024-09-12T02:37:56.853 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 02:37:56 smithi039 ceph-mon[30515]: from='mgr.25199 172.21.15.39:0/1270637502' entity='mgr.x' cmd=[{"prefix": "mds metadata"}]: dispatch 2024-09-12T02:37:56.853 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 02:37:56 smithi039 ceph-mon[30515]: from='mgr.25199 172.21.15.39:0/1270637502' entity='mgr.x' cmd=[{"prefix": "osd metadata"}]: dispatch 2024-09-12T02:37:56.853 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 02:37:56 smithi039 ceph-mon[30515]: from='mgr.25199 172.21.15.39:0/1270637502' entity='mgr.x' cmd=[{"prefix": "mon metadata"}]: dispatch 2024-09-12T02:37:56.853 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 02:37:56 smithi039 ceph-mon[30515]: Manager daemon x is now available 2024-09-12T02:37:56.853 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 02:37:56 smithi039 ceph-mon[30515]: from='mgr.25199 172.21.15.39:0/1270637502' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-12T02:37:56.853 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 02:37:56 smithi039 ceph-mon[30515]: from='mgr.25199 172.21.15.39:0/1270637502' entity='mgr.x' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/x/mirror_snapshot_schedule"}]: dispatch 2024-09-12T02:37:56.854 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 02:37:56 smithi039 ceph-mon[30515]: from='mgr.25199 172.21.15.39:0/1270637502' entity='mgr.x' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/x/trash_purge_schedule"}]: dispatch 2024-09-12T02:37:56.955 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:37:56.953+0000 7f6492000640 1 -- 172.21.15.39:0/3769397038 <== mon.1 v2:172.21.15.172:3300/0 7 ==== mgrmap(e 23) ==== 137645+0+0 (secure 0 0 0) 0x7f6488097790 con 0x7f6494076bb0 2024-09-12T02:37:56.955 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:37:56.954+0000 7f6492000640 1 --2- 172.21.15.39:0/3769397038 >> [v2:172.21.15.39:6800/2187509357,v1:172.21.15.39:6801/2187509357] conn(0x7f647c0ab050 0x7f647c0ad440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:37:56.955 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:37:56.954+0000 7f6492000640 1 -- 172.21.15.39:0/3769397038 --> [v2:172.21.15.39:6800/2187509357,v1:172.21.15.39:6801/2187509357] -- mgr_command(tid 0: {"prefix": "fs subvolumegroup pin", "vol_name": "cephfs", "group_name": "qa", "pin_type": "random", "pin_setting": "0.10", "target": ["mon-mgr", ""]}) -- 0x7f647c0ad980 con 0x7f647c0ab050 2024-09-12T02:37:56.957 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:37:56.957+0000 7f6498a00640 1 --2- 172.21.15.39:0/3769397038 >> [v2:172.21.15.39:6800/2187509357,v1:172.21.15.39:6801/2187509357] conn(0x7f647c0ab050 0x7f647c0ad440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:37:56.962 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:37:56.962+0000 7f6498a00640 1 --2- 172.21.15.39:0/3769397038 >> [v2:172.21.15.39:6800/2187509357,v1:172.21.15.39:6801/2187509357] conn(0x7f647c0ab050 0x7f647c0ad440 secure :-1 s=READY pgs=31 cs=0 l=1 rev1=1 crypto rx=0x7f649419f830 tx=0x7f6480005f90 comp rx=0 tx=0).ready entity=mgr.25199 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:37:56.987 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:37:56.987+0000 7f6492000640 1 -- 172.21.15.39:0/3769397038 <== mgr.25199 v2:172.21.15.39:6800/2187509357 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+3 (secure 0 0 0) 0x7f647c0ad980 con 0x7f647c0ab050 2024-09-12T02:37:56.988 INFO:teuthology.orchestra.run.smithi039.stdout:{} 2024-09-12T02:37:56.990 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:37:56.989+0000 7f649be00640 1 -- 172.21.15.39:0/3769397038 >> [v2:172.21.15.39:6800/2187509357,v1:172.21.15.39:6801/2187509357] conn(0x7f647c0ab050 msgr2=0x7f647c0ad440 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:37:56.992 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:37:56.989+0000 7f649be00640 1 --2- 172.21.15.39:0/3769397038 >> [v2:172.21.15.39:6800/2187509357,v1:172.21.15.39:6801/2187509357] conn(0x7f647c0ab050 0x7f647c0ad440 secure :-1 s=READY pgs=31 cs=0 l=1 rev1=1 crypto rx=0x7f649419f830 tx=0x7f6480005f90 comp rx=0 tx=0).stop 2024-09-12T02:37:56.992 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:37:56.989+0000 7f649be00640 1 -- 172.21.15.39:0/3769397038 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f6494076bb0 msgr2=0x7f649419e320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:37:56.992 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:37:56.989+0000 7f649be00640 1 --2- 172.21.15.39:0/3769397038 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f6494076bb0 0x7f649419e320 secure :-1 s=READY pgs=117 cs=0 l=1 rev1=1 crypto rx=0x7f648800e9f0 tx=0x7f648800eeb0 comp rx=0 tx=0).stop 2024-09-12T02:37:56.992 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:37:56.989+0000 7f649be00640 1 -- 172.21.15.39:0/3769397038 shutdown_connections 2024-09-12T02:37:56.992 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:37:56.989+0000 7f649be00640 1 --2- 172.21.15.39:0/3769397038 >> [v2:172.21.15.39:6800/2187509357,v1:172.21.15.39:6801/2187509357] conn(0x7f647c0ab050 0x7f647c0ad440 unknown :-1 s=CLOSED pgs=31 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:37:56.992 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:37:56.989+0000 7f649be00640 1 --2- 172.21.15.39:0/3769397038 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f6494078790 0x7f64941a58d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:37:56.992 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:37:56.989+0000 7f649be00640 1 --2- 172.21.15.39:0/3769397038 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f6494077df0 0x7f649419e860 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:37:56.992 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:37:56.989+0000 7f649be00640 1 --2- 172.21.15.39:0/3769397038 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f6494076bb0 0x7f649419e320 unknown :-1 s=CLOSED pgs=117 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:37:56.993 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:37:56.989+0000 7f649be00640 1 -- 172.21.15.39:0/3769397038 >> 172.21.15.39:0/3769397038 conn(0x7f64940ff4e0 msgr2=0x7f6494100f70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:37:56.993 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:37:56.989+0000 7f649be00640 1 -- 172.21.15.39:0/3769397038 shutdown_connections 2024-09-12T02:37:56.993 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:37:56.989+0000 7f649be00640 1 -- 172.21.15.39:0/3769397038 wait complete. 2024-09-12T02:37:57.007 INFO:teuthology.run_tasks:Running task check-counter... 2024-09-12T02:37:57.018 INFO:teuthology.run_tasks:Running task exec... 2024-09-12T02:37:57.027 INFO:teuthology.task.exec:Executing custom commands... 2024-09-12T02:37:57.027 INFO:teuthology.task.exec:Running commands on role mon.a host ubuntu@smithi039.front.sepia.ceph.com 2024-09-12T02:37:57.027 DEBUG:teuthology.orchestra.run.smithi039:> sudo TESTDIR=/home/ubuntu/cephtest bash -c 'ceph config set mgr mgr/snap_schedule/log_level debug' 2024-09-12T02:37:57.193 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:37:57.192+0000 7f258b200640 1 -- 172.21.15.39:0/1458538230 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f2584104f50 msgr2=0x7f25841053d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:37:57.193 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:37:57.192+0000 7f258b200640 1 --2- 172.21.15.39:0/1458538230 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f2584104f50 0x7f25841053d0 secure :-1 s=READY pgs=135 cs=0 l=1 rev1=1 crypto rx=0x7f2570009860 tx=0x7f257002a340 comp rx=0 tx=0).stop 2024-09-12T02:37:57.193 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:37:57.192+0000 7f258b200640 1 -- 172.21.15.39:0/1458538230 shutdown_connections 2024-09-12T02:37:57.193 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:37:57.192+0000 7f258b200640 1 --2- 172.21.15.39:0/1458538230 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f2584105910 0x7f258410c1a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:37:57.194 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:37:57.192+0000 7f258b200640 1 --2- 172.21.15.39:0/1458538230 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f2584104f50 0x7f25841053d0 unknown :-1 s=CLOSED pgs=135 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:37:57.194 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:37:57.192+0000 7f258b200640 1 --2- 172.21.15.39:0/1458538230 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f2584103d60 0x7f2584104160 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:37:57.194 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:37:57.192+0000 7f258b200640 1 -- 172.21.15.39:0/1458538230 >> 172.21.15.39:0/1458538230 conn(0x7f25840ff4e0 msgr2=0x7f2584101900 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:37:57.194 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:37:57.192+0000 7f258b200640 1 -- 172.21.15.39:0/1458538230 shutdown_connections 2024-09-12T02:37:57.194 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:37:57.192+0000 7f258b200640 1 -- 172.21.15.39:0/1458538230 wait complete. 2024-09-12T02:37:57.196 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:37:57.193+0000 7f258b200640 1 Processor -- start 2024-09-12T02:37:57.196 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:37:57.193+0000 7f258b200640 1 -- start start 2024-09-12T02:37:57.196 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:37:57.193+0000 7f258b200640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f2584103d60 0x7f2584199fb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:37:57.196 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:37:57.193+0000 7f258b200640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f2584104f50 0x7f258419a4f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:37:57.196 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:37:57.194+0000 7f258b200640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f2584105910 0x7f25841a1560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:37:57.196 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:37:57.194+0000 7f258b200640 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 -- 0x7f258410f9c0 con 0x7f2584105910 2024-09-12T02:37:57.196 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:37:57.194+0000 7f258b200640 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x7f258410f840 con 0x7f2584104f50 2024-09-12T02:37:57.197 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:37:57.194+0000 7f258b200640 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7f258410fb40 con 0x7f2584103d60 2024-09-12T02:37:57.197 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:37:57.194+0000 7f2583e00640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f2584103d60 0x7f2584199fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:37:57.197 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:37:57.194+0000 7f2583e00640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f2584103d60 0x7f2584199fb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.172:3300/0 says I am v2:172.21.15.39:43064/0 (socket says 172.21.15.39:43064) 2024-09-12T02:37:57.197 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:37:57.194+0000 7f2583e00640 1 -- 172.21.15.39:0/1458767497 learned_addr learned my addr 172.21.15.39:0/1458767497 (peer_addr_for_me v2:172.21.15.39:0/0) 2024-09-12T02:37:57.197 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:37:57.194+0000 7f2589200640 1 --2- 172.21.15.39:0/1458767497 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f2584105910 0x7f25841a1560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:37:57.197 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:37:57.194+0000 7f2583400640 1 --2- 172.21.15.39:0/1458767497 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f2584104f50 0x7f258419a4f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:37:57.197 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:37:57.194+0000 7f2583400640 1 -- 172.21.15.39:0/1458767497 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f2584103d60 msgr2=0x7f2584199fb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:37:57.197 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:37:57.194+0000 7f2583400640 1 --2- 172.21.15.39:0/1458767497 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f2584103d60 0x7f2584199fb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:37:57.197 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:37:57.194+0000 7f2583400640 1 -- 172.21.15.39:0/1458767497 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f2584105910 msgr2=0x7f25841a1560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:37:57.197 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:37:57.194+0000 7f2583400640 1 --2- 172.21.15.39:0/1458767497 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f2584105910 0x7f25841a1560 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:37:57.197 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:37:57.194+0000 7f2583400640 1 -- 172.21.15.39:0/1458767497 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f25841a1bd0 con 0x7f2584104f50 2024-09-12T02:37:57.197 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:37:57.194+0000 7f2589200640 1 --2- 172.21.15.39:0/1458767497 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f2584105910 0x7f25841a1560 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-12T02:37:57.198 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:37:57.194+0000 7f2583e00640 1 --2- 172.21.15.39:0/1458767497 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f2584103d60 0x7f2584199fb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-12T02:37:57.198 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:37:57.195+0000 7f2583400640 1 --2- 172.21.15.39:0/1458767497 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f2584104f50 0x7f258419a4f0 secure :-1 s=READY pgs=136 cs=0 l=1 rev1=1 crypto rx=0x7f2570035040 tx=0x7f2570033d90 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:37:57.198 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:37:57.195+0000 7f2580c00640 1 -- 172.21.15.39:0/1458767497 <== mon.2 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2570037040 con 0x7f2584104f50 2024-09-12T02:37:57.198 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:37:57.195+0000 7f2580c00640 1 -- 172.21.15.39:0/1458767497 <== mon.2 v2:172.21.15.44:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f2570030850 con 0x7f2584104f50 2024-09-12T02:37:57.198 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:37:57.195+0000 7f258b200640 1 -- 172.21.15.39:0/1458767497 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f25841a1e60 con 0x7f2584104f50 2024-09-12T02:37:57.198 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:37:57.195+0000 7f2580c00640 1 -- 172.21.15.39:0/1458767497 <== mon.2 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f25700046c0 con 0x7f2584104f50 2024-09-12T02:37:57.198 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:37:57.195+0000 7f258b200640 1 -- 172.21.15.39:0/1458767497 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f25841a22c0 con 0x7f2584104f50 2024-09-12T02:37:57.198 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:37:57.197+0000 7f258b200640 1 -- 172.21.15.39:0/1458767497 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f258410b080 con 0x7f2584104f50 2024-09-12T02:37:57.199 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:37:57.199+0000 7f2580c00640 1 -- 172.21.15.39:0/1458767497 <== mon.2 v2:172.21.15.44:3300/0 4 ==== mgrmap(e 23) ==== 137645+0+0 (secure 0 0 0) 0x7f2570004050 con 0x7f2584104f50 2024-09-12T02:37:57.200 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:37:57.200+0000 7f2580c00640 1 --2- 172.21.15.39:0/1458767497 >> [v2:172.21.15.39:6800/2187509357,v1:172.21.15.39:6801/2187509357] conn(0x7f25680a2a40 0x7f25680a4f00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:37:57.201 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:37:57.200+0000 7f2580c00640 1 -- 172.21.15.39:0/1458767497 <== mon.2 v2:172.21.15.44:3300/0 5 ==== osd_map(96..96 src has 1..96) ==== 9387+0+0 (secure 0 0 0) 0x7f25700eef10 con 0x7f2584104f50 2024-09-12T02:37:57.201 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:37:57.200+0000 7f2583e00640 1 --2- 172.21.15.39:0/1458767497 >> [v2:172.21.15.39:6800/2187509357,v1:172.21.15.39:6801/2187509357] conn(0x7f25680a2a40 0x7f25680a4f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:37:57.201 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:37:57.201+0000 7f2583e00640 1 --2- 172.21.15.39:0/1458767497 >> [v2:172.21.15.39:6800/2187509357,v1:172.21.15.39:6801/2187509357] conn(0x7f25680a2a40 0x7f25680a4f00 secure :-1 s=READY pgs=36 cs=0 l=1 rev1=1 crypto rx=0x7f25740096c0 tx=0x7f2574009260 comp rx=0 tx=0).ready entity=mgr.25199 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:37:57.205 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:37:57.204+0000 7f2580c00640 1 -- 172.21.15.39:0/1458767497 <== mon.2 v2:172.21.15.44:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7f25700bbca0 con 0x7f2584104f50 2024-09-12T02:37:57.350 INFO:journalctl@ceph.mgr.x.smithi039.stdout:Sep 12 02:37:56 smithi039 ceph-4954ed46-70ae-11ef-bcea-c7b262605968-mgr-x[30736]: 2024-09-12T02:37:56.971+0000 7fba46800640 -1 client.0 error registering admin socket command: (17) File exists 2024-09-12T02:37:57.350 INFO:journalctl@ceph.mgr.x.smithi039.stdout:Sep 12 02:37:56 smithi039 ceph-4954ed46-70ae-11ef-bcea-c7b262605968-mgr-x[30736]: 2024-09-12T02:37:56.971+0000 7fba46800640 -1 client.0 error registering admin socket command: (17) File exists 2024-09-12T02:37:57.350 INFO:journalctl@ceph.mgr.x.smithi039.stdout:Sep 12 02:37:56 smithi039 ceph-4954ed46-70ae-11ef-bcea-c7b262605968-mgr-x[30736]: 2024-09-12T02:37:56.971+0000 7fba46800640 -1 client.0 error registering admin socket command: (17) File exists 2024-09-12T02:37:57.350 INFO:journalctl@ceph.mgr.x.smithi039.stdout:Sep 12 02:37:56 smithi039 ceph-4954ed46-70ae-11ef-bcea-c7b262605968-mgr-x[30736]: 2024-09-12T02:37:56.971+0000 7fba46800640 -1 client.0 error registering admin socket command: (17) File exists 2024-09-12T02:37:57.350 INFO:journalctl@ceph.mgr.x.smithi039.stdout:Sep 12 02:37:56 smithi039 ceph-4954ed46-70ae-11ef-bcea-c7b262605968-mgr-x[30736]: 2024-09-12T02:37:56.971+0000 7fba46800640 -1 client.0 error registering admin socket command: (17) File exists 2024-09-12T02:37:57.394 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:37:57.393+0000 7f258b200640 1 -- 172.21.15.39:0/1458767497 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_command([{prefix=config set, name=mgr/snap_schedule/log_level}] v 0) -- 0x7f2584062f00 con 0x7f2584104f50 2024-09-12T02:37:57.401 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:37:57.401+0000 7f2580c00640 1 -- 172.21.15.39:0/1458767497 <== mon.2 v2:172.21.15.44:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mgr/snap_schedule/log_level}]=0 v26)=0 v26) ==== 129+0+0 (secure 0 0 0) 0x7f25700bb5a0 con 0x7f2584104f50 2024-09-12T02:37:57.404 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:37:57.403+0000 7f258b200640 1 -- 172.21.15.39:0/1458767497 >> [v2:172.21.15.39:6800/2187509357,v1:172.21.15.39:6801/2187509357] conn(0x7f25680a2a40 msgr2=0x7f25680a4f00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:37:57.404 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:37:57.403+0000 7f258b200640 1 --2- 172.21.15.39:0/1458767497 >> [v2:172.21.15.39:6800/2187509357,v1:172.21.15.39:6801/2187509357] conn(0x7f25680a2a40 0x7f25680a4f00 secure :-1 s=READY pgs=36 cs=0 l=1 rev1=1 crypto rx=0x7f25740096c0 tx=0x7f2574009260 comp rx=0 tx=0).stop 2024-09-12T02:37:57.404 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:37:57.403+0000 7f258b200640 1 -- 172.21.15.39:0/1458767497 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f2584104f50 msgr2=0x7f258419a4f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:37:57.404 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:37:57.403+0000 7f258b200640 1 --2- 172.21.15.39:0/1458767497 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f2584104f50 0x7f258419a4f0 secure :-1 s=READY pgs=136 cs=0 l=1 rev1=1 crypto rx=0x7f2570035040 tx=0x7f2570033d90 comp rx=0 tx=0).stop 2024-09-12T02:37:57.404 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:37:57.403+0000 7f258b200640 1 -- 172.21.15.39:0/1458767497 shutdown_connections 2024-09-12T02:37:57.404 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:37:57.403+0000 7f258b200640 1 --2- 172.21.15.39:0/1458767497 >> [v2:172.21.15.39:6800/2187509357,v1:172.21.15.39:6801/2187509357] conn(0x7f25680a2a40 0x7f25680a4f00 unknown :-1 s=CLOSED pgs=36 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:37:57.405 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:37:57.403+0000 7f258b200640 1 --2- 172.21.15.39:0/1458767497 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f2584105910 0x7f25841a1560 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:37:57.405 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:37:57.403+0000 7f258b200640 1 --2- 172.21.15.39:0/1458767497 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f2584104f50 0x7f258419a4f0 unknown :-1 s=CLOSED pgs=136 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:37:57.405 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:37:57.403+0000 7f258b200640 1 --2- 172.21.15.39:0/1458767497 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f2584103d60 0x7f2584199fb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:37:57.405 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:37:57.403+0000 7f258b200640 1 -- 172.21.15.39:0/1458767497 >> 172.21.15.39:0/1458767497 conn(0x7f25840ff4e0 msgr2=0x7f2584108250 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:37:57.405 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:37:57.403+0000 7f258b200640 1 -- 172.21.15.39:0/1458767497 shutdown_connections 2024-09-12T02:37:57.405 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:37:57.404+0000 7f258b200640 1 -- 172.21.15.39:0/1458767497 wait complete. 2024-09-12T02:37:57.421 DEBUG:teuthology.orchestra.run.smithi039:> sudo TESTDIR=/home/ubuntu/cephtest bash -c 'ceph config set mgr mgr/snap_schedule/allow_m_granularity true' 2024-09-12T02:37:57.596 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:37:57.595+0000 7f0029200640 1 -- 172.21.15.39:0/2488976773 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f0024103d60 msgr2=0x7f0024104160 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:37:57.596 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:37:57.595+0000 7f0029200640 1 --2- 172.21.15.39:0/2488976773 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f0024103d60 0x7f0024104160 secure :-1 s=READY pgs=137 cs=0 l=1 rev1=1 crypto rx=0x7f0014009900 tx=0x7f001402a410 comp rx=0 tx=0).stop 2024-09-12T02:37:57.596 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:37:57.595+0000 7f0029200640 1 -- 172.21.15.39:0/2488976773 shutdown_connections 2024-09-12T02:37:57.597 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:37:57.595+0000 7f0029200640 1 --2- 172.21.15.39:0/2488976773 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f0024105910 0x7f002410c1a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:37:57.597 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:37:57.595+0000 7f0029200640 1 --2- 172.21.15.39:0/2488976773 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f0024104f50 0x7f00241053d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:37:57.597 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:37:57.595+0000 7f0029200640 1 --2- 172.21.15.39:0/2488976773 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f0024103d60 0x7f0024104160 unknown :-1 s=CLOSED pgs=137 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:37:57.597 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:37:57.595+0000 7f0029200640 1 -- 172.21.15.39:0/2488976773 >> 172.21.15.39:0/2488976773 conn(0x7f00240ff4e0 msgr2=0x7f0024101900 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:37:57.597 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:37:57.595+0000 7f0029200640 1 -- 172.21.15.39:0/2488976773 shutdown_connections 2024-09-12T02:37:57.597 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:37:57.595+0000 7f0029200640 1 -- 172.21.15.39:0/2488976773 wait complete. 2024-09-12T02:37:57.599 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:37:57.596+0000 7f0029200640 1 Processor -- start 2024-09-12T02:37:57.599 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:37:57.596+0000 7f0029200640 1 -- start start 2024-09-12T02:37:57.599 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:37:57.596+0000 7f0029200640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f0024103d60 0x7f0024199fc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:37:57.599 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:37:57.596+0000 7f0029200640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f0024104f50 0x7f002419a500 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:37:57.599 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:37:57.596+0000 7f0029200640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f0024105910 0x7f00241a1570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:37:57.599 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:37:57.596+0000 7f0029200640 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 -- 0x7f002410fa30 con 0x7f0024103d60 2024-09-12T02:37:57.600 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:37:57.597+0000 7f0029200640 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x7f002410f8b0 con 0x7f0024105910 2024-09-12T02:37:57.600 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:37:57.597+0000 7f0029200640 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7f002410fbb0 con 0x7f0024104f50 2024-09-12T02:37:57.600 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:37:57.597+0000 7f0021400640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f0024104f50 0x7f002419a500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:37:57.600 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:37:57.597+0000 7f0021400640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f0024104f50 0x7f002419a500 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.172:3300/0 says I am v2:172.21.15.39:43080/0 (socket says 172.21.15.39:43080) 2024-09-12T02:37:57.600 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:37:57.597+0000 7f0021400640 1 -- 172.21.15.39:0/2645277046 learned_addr learned my addr 172.21.15.39:0/2645277046 (peer_addr_for_me v2:172.21.15.39:0/0) 2024-09-12T02:37:57.600 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:37:57.597+0000 7f0021e00640 1 --2- 172.21.15.39:0/2645277046 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f0024103d60 0x7f0024199fc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:37:57.600 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:37:57.597+0000 7f0022800640 1 --2- 172.21.15.39:0/2645277046 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f0024105910 0x7f00241a1570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:37:57.600 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:37:57.597+0000 7f0021400640 1 -- 172.21.15.39:0/2645277046 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f0024105910 msgr2=0x7f00241a1570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:37:57.600 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:37:57.597+0000 7f0021400640 1 --2- 172.21.15.39:0/2645277046 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f0024105910 0x7f00241a1570 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:37:57.600 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:37:57.597+0000 7f0021400640 1 -- 172.21.15.39:0/2645277046 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f0024103d60 msgr2=0x7f0024199fc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:37:57.600 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:37:57.597+0000 7f0021400640 1 --2- 172.21.15.39:0/2645277046 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f0024103d60 0x7f0024199fc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:37:57.600 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:37:57.597+0000 7f0021400640 1 -- 172.21.15.39:0/2645277046 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f00241a1be0 con 0x7f0024104f50 2024-09-12T02:37:57.600 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:37:57.598+0000 7f0021400640 1 --2- 172.21.15.39:0/2645277046 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f0024104f50 0x7f002419a500 secure :-1 s=READY pgs=119 cs=0 l=1 rev1=1 crypto rx=0x7f001000e9f0 tx=0x7f001000eeb0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:37:57.601 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:37:57.598+0000 7f001aa00640 1 -- 172.21.15.39:0/2645277046 <== mon.1 v2:172.21.15.172:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f001000cd80 con 0x7f0024104f50 2024-09-12T02:37:57.601 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:37:57.598+0000 7f001aa00640 1 -- 172.21.15.39:0/2645277046 <== mon.1 v2:172.21.15.172:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f0010010910 con 0x7f0024104f50 2024-09-12T02:37:57.601 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:37:57.598+0000 7f0029200640 1 -- 172.21.15.39:0/2645277046 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f00241a1ed0 con 0x7f0024104f50 2024-09-12T02:37:57.601 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:37:57.598+0000 7f001aa00640 1 -- 172.21.15.39:0/2645277046 <== mon.1 v2:172.21.15.172:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f00100188f0 con 0x7f0024104f50 2024-09-12T02:37:57.601 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:37:57.598+0000 7f0029200640 1 -- 172.21.15.39:0/2645277046 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f00241a2390 con 0x7f0024104f50 2024-09-12T02:37:57.605 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:37:57.599+0000 7f0029200640 1 -- 172.21.15.39:0/2645277046 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f002410b080 con 0x7f0024104f50 2024-09-12T02:37:57.605 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:37:57.602+0000 7f001aa00640 1 -- 172.21.15.39:0/2645277046 <== mon.1 v2:172.21.15.172:3300/0 4 ==== mgrmap(e 23) ==== 137645+0+0 (secure 0 0 0) 0x7f0010010ac0 con 0x7f0024104f50 2024-09-12T02:37:57.605 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:37:57.603+0000 7f001aa00640 1 --2- 172.21.15.39:0/2645277046 >> [v2:172.21.15.39:6800/2187509357,v1:172.21.15.39:6801/2187509357] conn(0x7f00080a2a40 0x7f00080a4f00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:37:57.605 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:37:57.603+0000 7f001aa00640 1 -- 172.21.15.39:0/2645277046 <== mon.1 v2:172.21.15.172:3300/0 5 ==== osd_map(96..96 src has 1..96) ==== 9387+0+0 (secure 0 0 0) 0x7f00100cf4b0 con 0x7f0024104f50 2024-09-12T02:37:57.605 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:37:57.603+0000 7f0021e00640 1 --2- 172.21.15.39:0/2645277046 >> [v2:172.21.15.39:6800/2187509357,v1:172.21.15.39:6801/2187509357] conn(0x7f00080a2a40 0x7f00080a4f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:37:57.605 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:37:57.604+0000 7f0021e00640 1 --2- 172.21.15.39:0/2645277046 >> [v2:172.21.15.39:6800/2187509357,v1:172.21.15.39:6801/2187509357] conn(0x7f00080a2a40 0x7f00080a4f00 secure :-1 s=READY pgs=37 cs=0 l=1 rev1=1 crypto rx=0x7f001402aa00 tx=0x7f00140315b0 comp rx=0 tx=0).ready entity=mgr.25199 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:37:57.607 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:37:57.607+0000 7f001aa00640 1 -- 172.21.15.39:0/2645277046 <== mon.1 v2:172.21.15.172:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7f001009bbf0 con 0x7f0024104f50 2024-09-12T02:37:57.698 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 12 02:37:57 smithi044 ceph-mon[35411]: from='client.? ' entity='client.admin' cmd='[{"prefix": "fs set", "fs_name": "cephfs", "var": "balance_automate", "val": "false"}]': finished 2024-09-12T02:37:57.699 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 12 02:37:57 smithi044 ceph-mon[35411]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2024-09-12T02:37:57.699 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 12 02:37:57 smithi044 ceph-mon[35411]: mgrmap e23: x(active, since 1.02209s), standbys: y, z 2024-09-12T02:37:57.699 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 12 02:37:57 smithi044 ceph-mon[35411]: from='mgr.25199 172.21.15.39:0/1270637502' entity='mgr.x' 2024-09-12T02:37:57.699 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 12 02:37:57 smithi044 ceph-mon[35411]: from='mgr.25199 172.21.15.39:0/1270637502' entity='mgr.x' 2024-09-12T02:37:57.699 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 12 02:37:57 smithi044 ceph-mon[35411]: from='client.? ' entity='client.admin' 2024-09-12T02:37:57.804 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:37:57.804+0000 7f0029200640 1 -- 172.21.15.39:0/2645277046 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_command([{prefix=config set, name=mgr/snap_schedule/allow_m_granularity}] v 0) -- 0x7f0024062e90 con 0x7f0024104f50 2024-09-12T02:37:57.812 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:37:57.812+0000 7f001aa00640 1 -- 172.21.15.39:0/2645277046 <== mon.1 v2:172.21.15.172:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mgr/snap_schedule/allow_m_granularity}]=0 v27)=0 v27) ==== 138+0+0 (secure 0 0 0) 0x7f001009fef0 con 0x7f0024104f50 2024-09-12T02:37:57.816 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:37:57.815+0000 7f0029200640 1 -- 172.21.15.39:0/2645277046 >> [v2:172.21.15.39:6800/2187509357,v1:172.21.15.39:6801/2187509357] conn(0x7f00080a2a40 msgr2=0x7f00080a4f00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:37:57.816 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:37:57.815+0000 7f0029200640 1 --2- 172.21.15.39:0/2645277046 >> [v2:172.21.15.39:6800/2187509357,v1:172.21.15.39:6801/2187509357] conn(0x7f00080a2a40 0x7f00080a4f00 secure :-1 s=READY pgs=37 cs=0 l=1 rev1=1 crypto rx=0x7f001402aa00 tx=0x7f00140315b0 comp rx=0 tx=0).stop 2024-09-12T02:37:57.816 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:37:57.815+0000 7f0029200640 1 -- 172.21.15.39:0/2645277046 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f0024104f50 msgr2=0x7f002419a500 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:37:57.816 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:37:57.815+0000 7f0029200640 1 --2- 172.21.15.39:0/2645277046 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f0024104f50 0x7f002419a500 secure :-1 s=READY pgs=119 cs=0 l=1 rev1=1 crypto rx=0x7f001000e9f0 tx=0x7f001000eeb0 comp rx=0 tx=0).stop 2024-09-12T02:37:57.816 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:37:57.815+0000 7f0029200640 1 -- 172.21.15.39:0/2645277046 shutdown_connections 2024-09-12T02:37:57.816 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:37:57.815+0000 7f0029200640 1 --2- 172.21.15.39:0/2645277046 >> [v2:172.21.15.39:6800/2187509357,v1:172.21.15.39:6801/2187509357] conn(0x7f00080a2a40 0x7f00080a4f00 unknown :-1 s=CLOSED pgs=37 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:37:57.816 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:37:57.815+0000 7f0029200640 1 --2- 172.21.15.39:0/2645277046 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f0024105910 0x7f00241a1570 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:37:57.816 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:37:57.815+0000 7f0029200640 1 --2- 172.21.15.39:0/2645277046 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f0024104f50 0x7f002419a500 unknown :-1 s=CLOSED pgs=119 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:37:57.816 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:37:57.815+0000 7f0029200640 1 --2- 172.21.15.39:0/2645277046 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f0024103d60 0x7f0024199fc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:37:57.816 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:37:57.815+0000 7f0029200640 1 -- 172.21.15.39:0/2645277046 >> 172.21.15.39:0/2645277046 conn(0x7f00240ff4e0 msgr2=0x7f0024108250 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:37:57.817 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:37:57.815+0000 7f0029200640 1 -- 172.21.15.39:0/2645277046 shutdown_connections 2024-09-12T02:37:57.817 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:37:57.815+0000 7f0029200640 1 -- 172.21.15.39:0/2645277046 wait complete. 2024-09-12T02:37:57.830 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 02:37:57 smithi039 ceph-mon[30515]: from='client.? ' entity='client.admin' cmd='[{"prefix": "fs set", "fs_name": "cephfs", "var": "balance_automate", "val": "false"}]': finished 2024-09-12T02:37:57.830 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 02:37:57 smithi039 ceph-mon[30515]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2024-09-12T02:37:57.830 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 02:37:57 smithi039 ceph-mon[30515]: mgrmap e23: x(active, since 1.02209s), standbys: y, z 2024-09-12T02:37:57.830 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 02:37:57 smithi039 ceph-mon[30515]: from='mgr.25199 172.21.15.39:0/1270637502' entity='mgr.x' 2024-09-12T02:37:57.830 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 02:37:57 smithi039 ceph-mon[30515]: from='mgr.25199 172.21.15.39:0/1270637502' entity='mgr.x' 2024-09-12T02:37:57.831 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 02:37:57 smithi039 ceph-mon[30515]: from='client.? ' entity='client.admin' 2024-09-12T02:37:57.832 DEBUG:teuthology.orchestra.run.smithi039:> sudo TESTDIR=/home/ubuntu/cephtest bash -c 'ceph config set mgr mgr/snap_schedule/dump_on_update true' 2024-09-12T02:37:57.990 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:37:57.989+0000 7f2004200640 1 -- 172.21.15.39:0/2137178443 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f1ffc104f50 msgr2=0x7f1ffc1053d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:37:57.991 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:37:57.989+0000 7f2004200640 1 --2- 172.21.15.39:0/2137178443 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f1ffc104f50 0x7f1ffc1053d0 secure :-1 s=READY pgs=138 cs=0 l=1 rev1=1 crypto rx=0x7f1fe8009900 tx=0x7f1fe802a3f0 comp rx=0 tx=0).stop 2024-09-12T02:37:57.991 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:37:57.990+0000 7f2004200640 1 -- 172.21.15.39:0/2137178443 shutdown_connections 2024-09-12T02:37:57.991 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:37:57.990+0000 7f2004200640 1 --2- 172.21.15.39:0/2137178443 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f1ffc105910 0x7f1ffc10c1a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:37:57.991 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:37:57.990+0000 7f2004200640 1 --2- 172.21.15.39:0/2137178443 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f1ffc104f50 0x7f1ffc1053d0 unknown :-1 s=CLOSED pgs=138 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:37:57.991 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:37:57.990+0000 7f2004200640 1 --2- 172.21.15.39:0/2137178443 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f1ffc103d60 0x7f1ffc104160 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:37:57.991 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:37:57.990+0000 7f2004200640 1 -- 172.21.15.39:0/2137178443 >> 172.21.15.39:0/2137178443 conn(0x7f1ffc0ff4e0 msgr2=0x7f1ffc101900 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:37:57.991 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:37:57.990+0000 7f2004200640 1 -- 172.21.15.39:0/2137178443 shutdown_connections 2024-09-12T02:37:57.991 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:37:57.990+0000 7f2004200640 1 -- 172.21.15.39:0/2137178443 wait complete. 2024-09-12T02:37:57.993 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:37:57.991+0000 7f2004200640 1 Processor -- start 2024-09-12T02:37:57.993 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:37:57.991+0000 7f2004200640 1 -- start start 2024-09-12T02:37:57.993 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:37:57.991+0000 7f2004200640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f1ffc103d60 0x7f1ffc199fd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:37:57.994 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:37:57.991+0000 7f2004200640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f1ffc104f50 0x7f1ffc19a510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:37:57.994 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:37:57.991+0000 7f2004200640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f1ffc105910 0x7f1ffc1a1580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:37:57.994 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:37:57.991+0000 7f2004200640 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 -- 0x7f1ffc10fa10 con 0x7f1ffc104f50 2024-09-12T02:37:57.994 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:37:57.991+0000 7f2004200640 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x7f1ffc10f890 con 0x7f1ffc103d60 2024-09-12T02:37:57.994 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:37:57.991+0000 7f2004200640 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7f1ffc10fb90 con 0x7f1ffc105910 2024-09-12T02:37:57.994 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:37:57.991+0000 7f2001800640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f1ffc103d60 0x7f1ffc199fd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:37:57.994 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:37:57.991+0000 7f2000e00640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f1ffc104f50 0x7f1ffc19a510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:37:57.994 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:37:57.991+0000 7f2001800640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f1ffc103d60 0x7f1ffc199fd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.39:50090/0 (socket says 172.21.15.39:50090) 2024-09-12T02:37:57.994 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:37:57.991+0000 7f2001800640 1 -- 172.21.15.39:0/651752065 learned_addr learned my addr 172.21.15.39:0/651752065 (peer_addr_for_me v2:172.21.15.39:0/0) 2024-09-12T02:37:57.994 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:37:57.991+0000 7f2002200640 1 --2- 172.21.15.39:0/651752065 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f1ffc105910 0x7f1ffc1a1580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:37:57.994 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:37:57.992+0000 7f2001800640 1 -- 172.21.15.39:0/651752065 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f1ffc105910 msgr2=0x7f1ffc1a1580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:37:57.994 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:37:57.992+0000 7f2001800640 1 --2- 172.21.15.39:0/651752065 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f1ffc105910 0x7f1ffc1a1580 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:37:57.994 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:37:57.992+0000 7f2001800640 1 -- 172.21.15.39:0/651752065 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f1ffc104f50 msgr2=0x7f1ffc19a510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:37:57.994 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:37:57.992+0000 7f2001800640 1 --2- 172.21.15.39:0/651752065 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f1ffc104f50 0x7f1ffc19a510 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:37:57.995 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:37:57.992+0000 7f2001800640 1 -- 172.21.15.39:0/651752065 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1ffc1a1bf0 con 0x7f1ffc103d60 2024-09-12T02:37:57.995 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:37:57.992+0000 7f2001800640 1 --2- 172.21.15.39:0/651752065 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f1ffc103d60 0x7f1ffc199fd0 secure :-1 s=READY pgs=139 cs=0 l=1 rev1=1 crypto rx=0x7f1ff000e9c0 tx=0x7f1ff000edc0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:37:57.995 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:37:57.992+0000 7f1ffa000640 1 -- 172.21.15.39:0/651752065 <== mon.2 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1ff000cd80 con 0x7f1ffc103d60 2024-09-12T02:37:57.995 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:37:57.992+0000 7f1ffa000640 1 -- 172.21.15.39:0/651752065 <== mon.2 v2:172.21.15.44:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f1ff0010910 con 0x7f1ffc103d60 2024-09-12T02:37:57.995 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:37:57.992+0000 7f2004200640 1 -- 172.21.15.39:0/651752065 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f1ffc1a1ee0 con 0x7f1ffc103d60 2024-09-12T02:37:57.995 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:37:57.992+0000 7f1ffa000640 1 -- 172.21.15.39:0/651752065 <== mon.2 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1ff0018950 con 0x7f1ffc103d60 2024-09-12T02:37:57.995 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:37:57.993+0000 7f2004200640 1 -- 172.21.15.39:0/651752065 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f1ffc1a2340 con 0x7f1ffc103d60 2024-09-12T02:37:57.995 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:37:57.994+0000 7f2004200640 1 -- 172.21.15.39:0/651752065 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f1ffc10b0a0 con 0x7f1ffc103d60 2024-09-12T02:37:57.996 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:37:57.996+0000 7f1ffa000640 1 -- 172.21.15.39:0/651752065 <== mon.2 v2:172.21.15.44:3300/0 4 ==== mgrmap(e 23) ==== 137645+0+0 (secure 0 0 0) 0x7f1ff001f020 con 0x7f1ffc103d60 2024-09-12T02:37:57.998 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:37:57.997+0000 7f1ffa000640 1 --2- 172.21.15.39:0/651752065 >> [v2:172.21.15.39:6800/2187509357,v1:172.21.15.39:6801/2187509357] conn(0x7f1fe40a2a40 0x7f1fe40a4f00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:37:57.998 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:37:57.997+0000 7f1ffa000640 1 -- 172.21.15.39:0/651752065 <== mon.2 v2:172.21.15.44:3300/0 5 ==== osd_map(96..96 src has 1..96) ==== 9387+0+0 (secure 0 0 0) 0x7f1ff00cf180 con 0x7f1ffc103d60 2024-09-12T02:37:57.998 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:37:57.997+0000 7f2000e00640 1 --2- 172.21.15.39:0/651752065 >> [v2:172.21.15.39:6800/2187509357,v1:172.21.15.39:6801/2187509357] conn(0x7f1fe40a2a40 0x7f1fe40a4f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:37:57.998 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:37:57.998+0000 7f2000e00640 1 --2- 172.21.15.39:0/651752065 >> [v2:172.21.15.39:6800/2187509357,v1:172.21.15.39:6801/2187509357] conn(0x7f1fe40a2a40 0x7f1fe40a4f00 secure :-1 s=READY pgs=38 cs=0 l=1 rev1=1 crypto rx=0x7f1fe8031440 tx=0x7f1fe80315b0 comp rx=0 tx=0).ready entity=mgr.25199 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:37:58.001 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:37:58.001+0000 7f1ffa000640 1 -- 172.21.15.39:0/651752065 <== mon.2 v2:172.21.15.44:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7f1ff009bf10 con 0x7f1ffc103d60 2024-09-12T02:37:58.013 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 12 02:37:57 smithi172 ceph-mon[35609]: from='client.? ' entity='client.admin' cmd='[{"prefix": "fs set", "fs_name": "cephfs", "var": "balance_automate", "val": "false"}]': finished 2024-09-12T02:37:58.013 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 12 02:37:57 smithi172 ceph-mon[35609]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2024-09-12T02:37:58.013 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 12 02:37:57 smithi172 ceph-mon[35609]: mgrmap e23: x(active, since 1.02209s), standbys: y, z 2024-09-12T02:37:58.014 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 12 02:37:57 smithi172 ceph-mon[35609]: from='mgr.25199 172.21.15.39:0/1270637502' entity='mgr.x' 2024-09-12T02:37:58.014 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 12 02:37:57 smithi172 ceph-mon[35609]: from='mgr.25199 172.21.15.39:0/1270637502' entity='mgr.x' 2024-09-12T02:37:58.014 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 12 02:37:57 smithi172 ceph-mon[35609]: from='client.? ' entity='client.admin' 2024-09-12T02:37:58.100 INFO:journalctl@ceph.mgr.x.smithi039.stdout:Sep 12 02:37:57 smithi039 ceph-4954ed46-70ae-11ef-bcea-c7b262605968-mgr-x[30736]: 2024-09-12T02:37:57.915+0000 7fba2c400640 -1 log_channel(cephadm) log [ERR] : [12/Sep/2024:02:37:57] ENGINE Error in HTTPServer.serve 2024-09-12T02:37:58.101 INFO:journalctl@ceph.mgr.x.smithi039.stdout:Sep 12 02:37:57 smithi039 ceph-4954ed46-70ae-11ef-bcea-c7b262605968-mgr-x[30736]: Traceback (most recent call last): 2024-09-12T02:37:58.101 INFO:journalctl@ceph.mgr.x.smithi039.stdout:Sep 12 02:37:57 smithi039 ceph-4954ed46-70ae-11ef-bcea-c7b262605968-mgr-x[30736]: File "/lib/python3.9/site-packages/cheroot/server.py", line 1823, in serve 2024-09-12T02:37:58.101 INFO:journalctl@ceph.mgr.x.smithi039.stdout:Sep 12 02:37:57 smithi039 ceph-4954ed46-70ae-11ef-bcea-c7b262605968-mgr-x[30736]: self._connections.run(self.expiration_interval) 2024-09-12T02:37:58.101 INFO:journalctl@ceph.mgr.x.smithi039.stdout:Sep 12 02:37:57 smithi039 ceph-4954ed46-70ae-11ef-bcea-c7b262605968-mgr-x[30736]: File "/lib/python3.9/site-packages/cheroot/connections.py", line 203, in run 2024-09-12T02:37:58.101 INFO:journalctl@ceph.mgr.x.smithi039.stdout:Sep 12 02:37:57 smithi039 ceph-4954ed46-70ae-11ef-bcea-c7b262605968-mgr-x[30736]: self._run(expiration_interval) 2024-09-12T02:37:58.101 INFO:journalctl@ceph.mgr.x.smithi039.stdout:Sep 12 02:37:57 smithi039 ceph-4954ed46-70ae-11ef-bcea-c7b262605968-mgr-x[30736]: File "/lib/python3.9/site-packages/cheroot/connections.py", line 246, in _run 2024-09-12T02:37:58.101 INFO:journalctl@ceph.mgr.x.smithi039.stdout:Sep 12 02:37:57 smithi039 ceph-4954ed46-70ae-11ef-bcea-c7b262605968-mgr-x[30736]: new_conn = self._from_server_socket(self.server.socket) 2024-09-12T02:37:58.101 INFO:journalctl@ceph.mgr.x.smithi039.stdout:Sep 12 02:37:57 smithi039 ceph-4954ed46-70ae-11ef-bcea-c7b262605968-mgr-x[30736]: File "/lib/python3.9/site-packages/cheroot/connections.py", line 300, in _from_server_socket 2024-09-12T02:37:58.101 INFO:journalctl@ceph.mgr.x.smithi039.stdout:Sep 12 02:37:57 smithi039 ceph-4954ed46-70ae-11ef-bcea-c7b262605968-mgr-x[30736]: s, ssl_env = self.server.ssl_adapter.wrap(s) 2024-09-12T02:37:58.101 INFO:journalctl@ceph.mgr.x.smithi039.stdout:Sep 12 02:37:57 smithi039 ceph-4954ed46-70ae-11ef-bcea-c7b262605968-mgr-x[30736]: File "/lib/python3.9/site-packages/cheroot/ssl/builtin.py", line 277, in wrap 2024-09-12T02:37:58.102 INFO:journalctl@ceph.mgr.x.smithi039.stdout:Sep 12 02:37:57 smithi039 ceph-4954ed46-70ae-11ef-bcea-c7b262605968-mgr-x[30736]: s = self.context.wrap_socket( 2024-09-12T02:37:58.102 INFO:journalctl@ceph.mgr.x.smithi039.stdout:Sep 12 02:37:57 smithi039 ceph-4954ed46-70ae-11ef-bcea-c7b262605968-mgr-x[30736]: File "/lib64/python3.9/ssl.py", line 501, in wrap_socket 2024-09-12T02:37:58.102 INFO:journalctl@ceph.mgr.x.smithi039.stdout:Sep 12 02:37:57 smithi039 ceph-4954ed46-70ae-11ef-bcea-c7b262605968-mgr-x[30736]: return self.sslsocket_class._create( 2024-09-12T02:37:58.102 INFO:journalctl@ceph.mgr.x.smithi039.stdout:Sep 12 02:37:57 smithi039 ceph-4954ed46-70ae-11ef-bcea-c7b262605968-mgr-x[30736]: File "/lib64/python3.9/ssl.py", line 1074, in _create 2024-09-12T02:37:58.102 INFO:journalctl@ceph.mgr.x.smithi039.stdout:Sep 12 02:37:57 smithi039 ceph-4954ed46-70ae-11ef-bcea-c7b262605968-mgr-x[30736]: self.do_handshake() 2024-09-12T02:37:58.102 INFO:journalctl@ceph.mgr.x.smithi039.stdout:Sep 12 02:37:57 smithi039 ceph-4954ed46-70ae-11ef-bcea-c7b262605968-mgr-x[30736]: File "/lib64/python3.9/ssl.py", line 1343, in do_handshake 2024-09-12T02:37:58.102 INFO:journalctl@ceph.mgr.x.smithi039.stdout:Sep 12 02:37:57 smithi039 ceph-4954ed46-70ae-11ef-bcea-c7b262605968-mgr-x[30736]: self._sslobj.do_handshake() 2024-09-12T02:37:58.102 INFO:journalctl@ceph.mgr.x.smithi039.stdout:Sep 12 02:37:57 smithi039 ceph-4954ed46-70ae-11ef-bcea-c7b262605968-mgr-x[30736]: ssl.SSLZeroReturnError: TLS/SSL connection has been closed (EOF) (_ssl.c:1133) 2024-09-12T02:37:58.102 INFO:journalctl@ceph.mgr.x.smithi039.stdout:Sep 12 02:37:57 smithi039 ceph-4954ed46-70ae-11ef-bcea-c7b262605968-mgr-x[30736]: 2024-09-12T02:37:58.236 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:37:58.235+0000 7f2004200640 1 -- 172.21.15.39:0/651752065 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_command([{prefix=config set, name=mgr/snap_schedule/dump_on_update}] v 0) -- 0x7f1ffc062f30 con 0x7f1ffc103d60 2024-09-12T02:37:58.242 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:37:58.241+0000 7f1ffa000640 1 -- 172.21.15.39:0/651752065 <== mon.2 v2:172.21.15.44:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mgr/snap_schedule/dump_on_update}]=0 v28)=0 v28) ==== 133+0+0 (secure 0 0 0) 0x7f1ff009b810 con 0x7f1ffc103d60 2024-09-12T02:37:58.244 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:37:58.243+0000 7f2004200640 1 -- 172.21.15.39:0/651752065 >> [v2:172.21.15.39:6800/2187509357,v1:172.21.15.39:6801/2187509357] conn(0x7f1fe40a2a40 msgr2=0x7f1fe40a4f00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:37:58.244 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:37:58.243+0000 7f2004200640 1 --2- 172.21.15.39:0/651752065 >> [v2:172.21.15.39:6800/2187509357,v1:172.21.15.39:6801/2187509357] conn(0x7f1fe40a2a40 0x7f1fe40a4f00 secure :-1 s=READY pgs=38 cs=0 l=1 rev1=1 crypto rx=0x7f1fe8031440 tx=0x7f1fe80315b0 comp rx=0 tx=0).stop 2024-09-12T02:37:58.244 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:37:58.243+0000 7f2004200640 1 -- 172.21.15.39:0/651752065 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f1ffc103d60 msgr2=0x7f1ffc199fd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:37:58.244 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:37:58.243+0000 7f2004200640 1 --2- 172.21.15.39:0/651752065 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f1ffc103d60 0x7f1ffc199fd0 secure :-1 s=READY pgs=139 cs=0 l=1 rev1=1 crypto rx=0x7f1ff000e9c0 tx=0x7f1ff000edc0 comp rx=0 tx=0).stop 2024-09-12T02:37:58.245 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:37:58.243+0000 7f2004200640 1 -- 172.21.15.39:0/651752065 shutdown_connections 2024-09-12T02:37:58.245 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:37:58.243+0000 7f2004200640 1 --2- 172.21.15.39:0/651752065 >> [v2:172.21.15.39:6800/2187509357,v1:172.21.15.39:6801/2187509357] conn(0x7f1fe40a2a40 0x7f1fe40a4f00 unknown :-1 s=CLOSED pgs=38 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:37:58.245 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:37:58.243+0000 7f2004200640 1 --2- 172.21.15.39:0/651752065 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f1ffc105910 0x7f1ffc1a1580 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:37:58.245 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:37:58.243+0000 7f2004200640 1 --2- 172.21.15.39:0/651752065 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f1ffc104f50 0x7f1ffc19a510 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:37:58.245 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:37:58.243+0000 7f2004200640 1 --2- 172.21.15.39:0/651752065 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f1ffc103d60 0x7f1ffc199fd0 unknown :-1 s=CLOSED pgs=139 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:37:58.245 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:37:58.244+0000 7f2004200640 1 -- 172.21.15.39:0/651752065 >> 172.21.15.39:0/651752065 conn(0x7f1ffc0ff4e0 msgr2=0x7f1ffc108270 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:37:58.245 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:37:58.244+0000 7f2004200640 1 -- 172.21.15.39:0/651752065 shutdown_connections 2024-09-12T02:37:58.245 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:37:58.244+0000 7f2004200640 1 -- 172.21.15.39:0/651752065 wait complete. 2024-09-12T02:37:58.260 DEBUG:teuthology.orchestra.run.smithi039:> sudo TESTDIR=/home/ubuntu/cephtest bash -c 'ceph fs snap-schedule add --fs=cephfs --path=/ --snap_schedule=1m' 2024-09-12T02:37:58.422 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:37:58.421+0000 7f52b8400640 1 -- 172.21.15.39:0/718687711 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f52b0104f50 msgr2=0x7f52b01053d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:37:58.422 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:37:58.421+0000 7f52b8400640 1 --2- 172.21.15.39:0/718687711 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f52b0104f50 0x7f52b01053d0 secure :-1 s=READY pgs=142 cs=0 l=1 rev1=1 crypto rx=0x7f529c009860 tx=0x7f529c02a340 comp rx=0 tx=0).stop 2024-09-12T02:37:58.422 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:37:58.421+0000 7f52b8400640 1 -- 172.21.15.39:0/718687711 shutdown_connections 2024-09-12T02:37:58.422 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:37:58.421+0000 7f52b8400640 1 --2- 172.21.15.39:0/718687711 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f52b0105910 0x7f52b010c1a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:37:58.423 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:37:58.421+0000 7f52b8400640 1 --2- 172.21.15.39:0/718687711 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f52b0104f50 0x7f52b01053d0 unknown :-1 s=CLOSED pgs=142 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:37:58.423 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:37:58.421+0000 7f52b8400640 1 --2- 172.21.15.39:0/718687711 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f52b0103d60 0x7f52b0104160 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:37:58.424 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:37:58.421+0000 7f52b8400640 1 -- 172.21.15.39:0/718687711 >> 172.21.15.39:0/718687711 conn(0x7f52b00ff4e0 msgr2=0x7f52b0101900 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:37:58.424 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:37:58.421+0000 7f52b8400640 1 -- 172.21.15.39:0/718687711 shutdown_connections 2024-09-12T02:37:58.424 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:37:58.421+0000 7f52b8400640 1 -- 172.21.15.39:0/718687711 wait complete. 2024-09-12T02:37:58.426 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:37:58.422+0000 7f52b8400640 1 Processor -- start 2024-09-12T02:37:58.426 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:37:58.422+0000 7f52b8400640 1 -- start start 2024-09-12T02:37:58.426 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:37:58.422+0000 7f52b8400640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f52b0103d60 0x7f52b0199fd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:37:58.426 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:37:58.422+0000 7f52b8400640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f52b0104f50 0x7f52b019a510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:37:58.426 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:37:58.422+0000 7f52b8400640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f52b0105910 0x7f52b01a1580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:37:58.426 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:37:58.422+0000 7f52b8400640 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 -- 0x7f52b010f9e0 con 0x7f52b0103d60 2024-09-12T02:37:58.426 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:37:58.422+0000 7f52b8400640 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x7f52b010f860 con 0x7f52b0105910 2024-09-12T02:37:58.426 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:37:58.422+0000 7f52b8400640 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7f52b010fb60 con 0x7f52b0104f50 2024-09-12T02:37:58.426 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:37:58.422+0000 7f52b5a00640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f52b0103d60 0x7f52b0199fd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:37:58.426 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:37:58.422+0000 7f52b5a00640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f52b0103d60 0x7f52b0199fd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.39:3300/0 says I am v2:172.21.15.39:56578/0 (socket says 172.21.15.39:56578) 2024-09-12T02:37:58.426 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:37:58.423+0000 7f52b5a00640 1 -- 172.21.15.39:0/1823839426 learned_addr learned my addr 172.21.15.39:0/1823839426 (peer_addr_for_me v2:172.21.15.39:0/0) 2024-09-12T02:37:58.426 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:37:58.423+0000 7f52b5000640 1 --2- 172.21.15.39:0/1823839426 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f52b0104f50 0x7f52b019a510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:37:58.427 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:37:58.423+0000 7f52b6400640 1 --2- 172.21.15.39:0/1823839426 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f52b0105910 0x7f52b01a1580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:37:58.427 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:37:58.423+0000 7f52b5a00640 1 -- 172.21.15.39:0/1823839426 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f52b0104f50 msgr2=0x7f52b019a510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:37:58.427 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:37:58.423+0000 7f52b5a00640 1 --2- 172.21.15.39:0/1823839426 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f52b0104f50 0x7f52b019a510 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:37:58.427 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:37:58.423+0000 7f52b5a00640 1 -- 172.21.15.39:0/1823839426 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f52b0105910 msgr2=0x7f52b01a1580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:37:58.427 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:37:58.423+0000 7f52b5a00640 1 --2- 172.21.15.39:0/1823839426 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f52b0105910 0x7f52b01a1580 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:37:58.427 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:37:58.423+0000 7f52b5a00640 1 -- 172.21.15.39:0/1823839426 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f52b01a1bf0 con 0x7f52b0103d60 2024-09-12T02:37:58.427 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:37:58.423+0000 7f52b6400640 1 --2- 172.21.15.39:0/1823839426 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f52b0105910 0x7f52b01a1580 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-12T02:37:58.427 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:37:58.423+0000 7f52b5a00640 1 --2- 172.21.15.39:0/1823839426 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f52b0103d60 0x7f52b0199fd0 secure :-1 s=READY pgs=289 cs=0 l=1 rev1=1 crypto rx=0x7f52a400d950 tx=0x7f52a400de10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:37:58.427 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:37:58.424+0000 7f52ae000640 1 -- 172.21.15.39:0/1823839426 <== mon.0 v2:172.21.15.39:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f52a4017070 con 0x7f52b0103d60 2024-09-12T02:37:58.427 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:37:58.424+0000 7f52ae000640 1 -- 172.21.15.39:0/1823839426 <== mon.0 v2:172.21.15.39:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f52a4009c30 con 0x7f52b0103d60 2024-09-12T02:37:58.427 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:37:58.424+0000 7f52b8400640 1 -- 172.21.15.39:0/1823839426 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f52b01a1ee0 con 0x7f52b0103d60 2024-09-12T02:37:58.427 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:37:58.424+0000 7f52ae000640 1 -- 172.21.15.39:0/1823839426 <== mon.0 v2:172.21.15.39:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f52a400f600 con 0x7f52b0103d60 2024-09-12T02:37:58.427 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:37:58.424+0000 7f52b8400640 1 -- 172.21.15.39:0/1823839426 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f52b01a22f0 con 0x7f52b0103d60 2024-09-12T02:37:58.427 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:37:58.425+0000 7f52b8400640 1 -- 172.21.15.39:0/1823839426 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f52b010b0a0 con 0x7f52b0103d60 2024-09-12T02:37:58.428 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:37:58.427+0000 7f52ae000640 1 -- 172.21.15.39:0/1823839426 <== mon.0 v2:172.21.15.39:3300/0 4 ==== mgrmap(e 23) ==== 137645+0+0 (secure 0 0 0) 0x7f52a401a070 con 0x7f52b0103d60 2024-09-12T02:37:58.429 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:37:58.428+0000 7f52ae000640 1 --2- 172.21.15.39:0/1823839426 >> [v2:172.21.15.39:6800/2187509357,v1:172.21.15.39:6801/2187509357] conn(0x7f52980a2a40 0x7f52980a4f00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:37:58.429 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:37:58.428+0000 7f52ae000640 1 -- 172.21.15.39:0/1823839426 <== mon.0 v2:172.21.15.39:3300/0 5 ==== osd_map(96..96 src has 1..96) ==== 9387+0+0 (secure 0 0 0) 0x7f52a40ceab0 con 0x7f52b0103d60 2024-09-12T02:37:58.429 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:37:58.428+0000 7f52b5000640 1 --2- 172.21.15.39:0/1823839426 >> [v2:172.21.15.39:6800/2187509357,v1:172.21.15.39:6801/2187509357] conn(0x7f52980a2a40 0x7f52980a4f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:37:58.429 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:37:58.429+0000 7f52b5000640 1 --2- 172.21.15.39:0/1823839426 >> [v2:172.21.15.39:6800/2187509357,v1:172.21.15.39:6801/2187509357] conn(0x7f52980a2a40 0x7f52980a4f00 secure :-1 s=READY pgs=40 cs=0 l=1 rev1=1 crypto rx=0x7f529c02a930 tx=0x7f529c030570 comp rx=0 tx=0).ready entity=mgr.25199 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:37:58.433 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:37:58.433+0000 7f52ae000640 1 -- 172.21.15.39:0/1823839426 <== mon.0 v2:172.21.15.39:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7f52a4009de0 con 0x7f52b0103d60 2024-09-12T02:37:58.666 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:37:58.665+0000 7f52b8400640 1 -- 172.21.15.39:0/1823839426 --> [v2:172.21.15.39:6800/2187509357,v1:172.21.15.39:6801/2187509357] -- mgr_command(tid 0: {"prefix": "fs snap-schedule add", "fs": "cephfs", "path": "/", "snap_schedule": "1m", "target": ["mon-mgr", ""]}) -- 0x7f52b0062630 con 0x7f52980a2a40 2024-09-12T02:37:58.741 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:37:58.741+0000 7f52ae000640 1 -- 172.21.15.39:0/1823839426 <== mgr.25199 v2:172.21.15.39:6800/2187509357 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+24 (secure 0 0 0) 0x7f52b0062630 con 0x7f52980a2a40 2024-09-12T02:37:58.742 INFO:teuthology.orchestra.run.smithi039.stdout:Schedule set for path / 2024-09-12T02:37:58.744 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:37:58.743+0000 7f52b8400640 1 -- 172.21.15.39:0/1823839426 >> [v2:172.21.15.39:6800/2187509357,v1:172.21.15.39:6801/2187509357] conn(0x7f52980a2a40 msgr2=0x7f52980a4f00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:37:58.744 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:37:58.743+0000 7f52b8400640 1 --2- 172.21.15.39:0/1823839426 >> [v2:172.21.15.39:6800/2187509357,v1:172.21.15.39:6801/2187509357] conn(0x7f52980a2a40 0x7f52980a4f00 secure :-1 s=READY pgs=40 cs=0 l=1 rev1=1 crypto rx=0x7f529c02a930 tx=0x7f529c030570 comp rx=0 tx=0).stop 2024-09-12T02:37:58.744 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:37:58.743+0000 7f52b8400640 1 -- 172.21.15.39:0/1823839426 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f52b0103d60 msgr2=0x7f52b0199fd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:37:58.744 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:37:58.743+0000 7f52b8400640 1 --2- 172.21.15.39:0/1823839426 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f52b0103d60 0x7f52b0199fd0 secure :-1 s=READY pgs=289 cs=0 l=1 rev1=1 crypto rx=0x7f52a400d950 tx=0x7f52a400de10 comp rx=0 tx=0).stop 2024-09-12T02:37:58.744 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:37:58.743+0000 7f52b8400640 1 -- 172.21.15.39:0/1823839426 shutdown_connections 2024-09-12T02:37:58.744 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:37:58.743+0000 7f52b8400640 1 --2- 172.21.15.39:0/1823839426 >> [v2:172.21.15.39:6800/2187509357,v1:172.21.15.39:6801/2187509357] conn(0x7f52980a2a40 0x7f52980a4f00 unknown :-1 s=CLOSED pgs=40 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:37:58.744 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:37:58.743+0000 7f52b8400640 1 --2- 172.21.15.39:0/1823839426 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f52b0105910 0x7f52b01a1580 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:37:58.745 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:37:58.743+0000 7f52b8400640 1 --2- 172.21.15.39:0/1823839426 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f52b0104f50 0x7f52b019a510 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:37:58.745 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:37:58.743+0000 7f52b8400640 1 --2- 172.21.15.39:0/1823839426 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f52b0103d60 0x7f52b0199fd0 unknown :-1 s=CLOSED pgs=289 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:37:58.745 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:37:58.743+0000 7f52b8400640 1 -- 172.21.15.39:0/1823839426 >> 172.21.15.39:0/1823839426 conn(0x7f52b00ff4e0 msgr2=0x7f52b0108270 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:37:58.745 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:37:58.743+0000 7f52b8400640 1 -- 172.21.15.39:0/1823839426 shutdown_connections 2024-09-12T02:37:58.745 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:37:58.744+0000 7f52b8400640 1 -- 172.21.15.39:0/1823839426 wait complete. 2024-09-12T02:37:58.761 DEBUG:teuthology.orchestra.run.smithi039:> sudo TESTDIR=/home/ubuntu/cephtest bash -c 'ceph fs snap-schedule retention add --fs=cephfs --path=/ --retention-spec-or-period=6m3h' 2024-09-12T02:37:58.816 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 02:37:58 smithi039 ceph-mon[30515]: from='client.25249 -' entity='client.admin' cmd=[{"prefix": "fs subvolumegroup pin", "vol_name": "cephfs", "group_name": "qa", "pin_type": "random", "pin_setting": "0.10", "target": ["mon-mgr", ""]}]: dispatch 2024-09-12T02:37:58.817 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 02:37:58 smithi039 ceph-mon[30515]: pgmap v3: 129 pgs: 129 active+clean; 1.1 MiB data, 350 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-12T02:37:58.817 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 02:37:58 smithi039 ceph-mon[30515]: from='client.? ' entity='client.admin' 2024-09-12T02:37:58.817 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 02:37:58 smithi039 ceph-mon[30515]: from='mgr.25199 172.21.15.39:0/1270637502' entity='mgr.x' 2024-09-12T02:37:58.817 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 02:37:58 smithi039 ceph-mon[30515]: from='mgr.25199 172.21.15.39:0/1270637502' entity='mgr.x' 2024-09-12T02:37:58.817 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 02:37:58 smithi039 ceph-mon[30515]: from='mgr.25199 172.21.15.39:0/1270637502' entity='mgr.x' 2024-09-12T02:37:58.817 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 02:37:58 smithi039 ceph-mon[30515]: from='mgr.25199 172.21.15.39:0/1270637502' entity='mgr.x' 2024-09-12T02:37:58.817 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 02:37:58 smithi039 ceph-mon[30515]: from='client.? ' entity='client.admin' 2024-09-12T02:37:58.939 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:37:58.938+0000 7f2c6a600640 1 -- 172.21.15.39:0/2272952376 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f2c641023c0 msgr2=0x7f2c641047b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:37:58.939 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:37:58.938+0000 7f2c6a600640 1 --2- 172.21.15.39:0/2272952376 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f2c641023c0 0x7f2c641047b0 secure :-1 s=READY pgs=143 cs=0 l=1 rev1=1 crypto rx=0x7f2c58009900 tx=0x7f2c5802a400 comp rx=0 tx=0).stop 2024-09-12T02:37:58.939 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:37:58.938+0000 7f2c6a600640 1 -- 172.21.15.39:0/2272952376 shutdown_connections 2024-09-12T02:37:58.940 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:37:58.938+0000 7f2c6a600640 1 --2- 172.21.15.39:0/2272952376 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f2c64107620 0x7f2c64109a90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:37:58.940 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:37:58.938+0000 7f2c6a600640 1 --2- 172.21.15.39:0/2272952376 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f2c64104cf0 0x7f2c641070e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:37:58.940 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:37:58.938+0000 7f2c6a600640 1 --2- 172.21.15.39:0/2272952376 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f2c641023c0 0x7f2c641047b0 unknown :-1 s=CLOSED pgs=143 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:37:58.940 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:37:58.938+0000 7f2c6a600640 1 -- 172.21.15.39:0/2272952376 >> 172.21.15.39:0/2272952376 conn(0x7f2c640fbfa0 msgr2=0x7f2c640fe3e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:37:58.940 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:37:58.938+0000 7f2c6a600640 1 -- 172.21.15.39:0/2272952376 shutdown_connections 2024-09-12T02:37:58.940 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:37:58.938+0000 7f2c6a600640 1 -- 172.21.15.39:0/2272952376 wait complete. 2024-09-12T02:37:58.942 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:37:58.939+0000 7f2c6a600640 1 Processor -- start 2024-09-12T02:37:58.942 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:37:58.939+0000 7f2c6a600640 1 -- start start 2024-09-12T02:37:58.942 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:37:58.940+0000 7f2c6a600640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f2c641023c0 0x7f2c64101d30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:37:58.942 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:37:58.940+0000 7f2c6a600640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f2c64104cf0 0x7f2c64100370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:37:58.942 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:37:58.940+0000 7f2c6a600640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f2c64107620 0x7f2c641008b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:37:58.942 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:37:58.940+0000 7f2c6a600640 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 -- 0x7f2c6410d650 con 0x7f2c64104cf0 2024-09-12T02:37:58.943 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:37:58.940+0000 7f2c6a600640 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x7f2c6410d4d0 con 0x7f2c64107620 2024-09-12T02:37:58.943 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:37:58.940+0000 7f2c6a600640 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7f2c6410d7d0 con 0x7f2c641023c0 2024-09-12T02:37:58.943 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:37:58.940+0000 7f2c63e00640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f2c64104cf0 0x7f2c64100370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:37:58.943 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:37:58.940+0000 7f2c69200640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f2c641023c0 0x7f2c64101d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:37:58.943 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:37:58.940+0000 7f2c69200640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f2c641023c0 0x7f2c64101d30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.172:3300/0 says I am v2:172.21.15.39:57626/0 (socket says 172.21.15.39:57626) 2024-09-12T02:37:58.943 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:37:58.940+0000 7f2c69200640 1 -- 172.21.15.39:0/3914802137 learned_addr learned my addr 172.21.15.39:0/3914802137 (peer_addr_for_me v2:172.21.15.39:0/0) 2024-09-12T02:37:58.943 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:37:58.940+0000 7f2c69c00640 1 --2- 172.21.15.39:0/3914802137 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f2c64107620 0x7f2c641008b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:37:58.943 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:37:58.941+0000 7f2c69200640 1 -- 172.21.15.39:0/3914802137 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f2c64107620 msgr2=0x7f2c641008b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:37:58.943 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:37:58.941+0000 7f2c69200640 1 --2- 172.21.15.39:0/3914802137 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f2c64107620 0x7f2c641008b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:37:58.943 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:37:58.941+0000 7f2c69200640 1 -- 172.21.15.39:0/3914802137 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f2c64104cf0 msgr2=0x7f2c64100370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:37:58.943 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:37:58.941+0000 7f2c69200640 1 --2- 172.21.15.39:0/3914802137 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f2c64104cf0 0x7f2c64100370 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:37:58.943 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:37:58.941+0000 7f2c69200640 1 -- 172.21.15.39:0/3914802137 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2c64101140 con 0x7f2c641023c0 2024-09-12T02:37:58.944 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:37:58.941+0000 7f2c69200640 1 --2- 172.21.15.39:0/3914802137 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f2c641023c0 0x7f2c64101d30 secure :-1 s=READY pgs=120 cs=0 l=1 rev1=1 crypto rx=0x7f2c58031440 tx=0x7f2c58032ce0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:37:58.944 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:37:58.941+0000 7f2c61600640 1 -- 172.21.15.39:0/3914802137 <== mon.1 v2:172.21.15.172:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2c5803f030 con 0x7f2c641023c0 2024-09-12T02:37:58.944 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:37:58.941+0000 7f2c6a600640 1 -- 172.21.15.39:0/3914802137 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f2c641a1d90 con 0x7f2c641023c0 2024-09-12T02:37:58.944 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:37:58.941+0000 7f2c61600640 1 -- 172.21.15.39:0/3914802137 <== mon.1 v2:172.21.15.172:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f2c58003ce0 con 0x7f2c641023c0 2024-09-12T02:37:58.944 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:37:58.941+0000 7f2c61600640 1 -- 172.21.15.39:0/3914802137 <== mon.1 v2:172.21.15.172:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2c58035070 con 0x7f2c641023c0 2024-09-12T02:37:58.944 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:37:58.941+0000 7f2c6a600640 1 -- 172.21.15.39:0/3914802137 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f2c641a2200 con 0x7f2c641023c0 2024-09-12T02:37:58.944 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:37:58.943+0000 7f2c6a600640 1 -- 172.21.15.39:0/3914802137 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f2c640fda90 con 0x7f2c641023c0 2024-09-12T02:37:58.945 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:37:58.944+0000 7f2c61600640 1 -- 172.21.15.39:0/3914802137 <== mon.1 v2:172.21.15.172:3300/0 4 ==== mgrmap(e 24) ==== 138004+0+0 (secure 0 0 0) 0x7f2c58042030 con 0x7f2c641023c0 2024-09-12T02:37:58.946 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:37:58.946+0000 7f2c61600640 1 --2- 172.21.15.39:0/3914802137 >> [v2:172.21.15.39:6800/2187509357,v1:172.21.15.39:6801/2187509357] conn(0x7f2c4c0a2d80 0x7f2c4c0a5240 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:37:58.946 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:37:58.946+0000 7f2c61600640 1 -- 172.21.15.39:0/3914802137 <== mon.1 v2:172.21.15.172:3300/0 5 ==== osd_map(96..96 src has 1..96) ==== 9387+0+0 (secure 0 0 0) 0x7f2c580efe40 con 0x7f2c641023c0 2024-09-12T02:37:58.947 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:37:58.946+0000 7f2c63e00640 1 --2- 172.21.15.39:0/3914802137 >> [v2:172.21.15.39:6800/2187509357,v1:172.21.15.39:6801/2187509357] conn(0x7f2c4c0a2d80 0x7f2c4c0a5240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:37:58.947 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:37:58.947+0000 7f2c63e00640 1 --2- 172.21.15.39:0/3914802137 >> [v2:172.21.15.39:6800/2187509357,v1:172.21.15.39:6801/2187509357] conn(0x7f2c4c0a2d80 0x7f2c4c0a5240 secure :-1 s=READY pgs=41 cs=0 l=1 rev1=1 crypto rx=0x7f2c500095f0 tx=0x7f2c50005f90 comp rx=0 tx=0).ready entity=mgr.25199 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:37:58.948 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 12 02:37:58 smithi044 ceph-mon[35411]: from='client.25249 -' entity='client.admin' cmd=[{"prefix": "fs subvolumegroup pin", "vol_name": "cephfs", "group_name": "qa", "pin_type": "random", "pin_setting": "0.10", "target": ["mon-mgr", ""]}]: dispatch 2024-09-12T02:37:58.948 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 12 02:37:58 smithi044 ceph-mon[35411]: pgmap v3: 129 pgs: 129 active+clean; 1.1 MiB data, 350 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-12T02:37:58.948 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 12 02:37:58 smithi044 ceph-mon[35411]: from='client.? ' entity='client.admin' 2024-09-12T02:37:58.948 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 12 02:37:58 smithi044 ceph-mon[35411]: from='mgr.25199 172.21.15.39:0/1270637502' entity='mgr.x' 2024-09-12T02:37:58.948 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 12 02:37:58 smithi044 ceph-mon[35411]: from='mgr.25199 172.21.15.39:0/1270637502' entity='mgr.x' 2024-09-12T02:37:58.948 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 12 02:37:58 smithi044 ceph-mon[35411]: from='mgr.25199 172.21.15.39:0/1270637502' entity='mgr.x' 2024-09-12T02:37:58.948 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 12 02:37:58 smithi044 ceph-mon[35411]: from='mgr.25199 172.21.15.39:0/1270637502' entity='mgr.x' 2024-09-12T02:37:58.949 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 12 02:37:58 smithi044 ceph-mon[35411]: from='client.? ' entity='client.admin' 2024-09-12T02:37:58.951 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:37:58.950+0000 7f2c61600640 1 -- 172.21.15.39:0/3914802137 <== mon.1 v2:172.21.15.172:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7f2c580bbee0 con 0x7f2c641023c0 2024-09-12T02:37:59.014 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 12 02:37:58 smithi172 ceph-mon[35609]: from='client.25249 -' entity='client.admin' cmd=[{"prefix": "fs subvolumegroup pin", "vol_name": "cephfs", "group_name": "qa", "pin_type": "random", "pin_setting": "0.10", "target": ["mon-mgr", ""]}]: dispatch 2024-09-12T02:37:59.014 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 12 02:37:58 smithi172 ceph-mon[35609]: pgmap v3: 129 pgs: 129 active+clean; 1.1 MiB data, 350 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-12T02:37:59.014 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 12 02:37:58 smithi172 ceph-mon[35609]: from='client.? ' entity='client.admin' 2024-09-12T02:37:59.014 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 12 02:37:58 smithi172 ceph-mon[35609]: from='mgr.25199 172.21.15.39:0/1270637502' entity='mgr.x' 2024-09-12T02:37:59.014 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 12 02:37:58 smithi172 ceph-mon[35609]: from='mgr.25199 172.21.15.39:0/1270637502' entity='mgr.x' 2024-09-12T02:37:59.014 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 12 02:37:58 smithi172 ceph-mon[35609]: from='mgr.25199 172.21.15.39:0/1270637502' entity='mgr.x' 2024-09-12T02:37:59.014 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 12 02:37:58 smithi172 ceph-mon[35609]: from='mgr.25199 172.21.15.39:0/1270637502' entity='mgr.x' 2024-09-12T02:37:59.014 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 12 02:37:58 smithi172 ceph-mon[35609]: from='client.? ' entity='client.admin' 2024-09-12T02:37:59.182 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:37:59.182+0000 7f2c6a600640 1 -- 172.21.15.39:0/3914802137 --> [v2:172.21.15.39:6800/2187509357,v1:172.21.15.39:6801/2187509357] -- mgr_command(tid 0: {"prefix": "fs snap-schedule retention add", "fs": "cephfs", "path": "/", "retention_spec_or_period": "6m3h", "target": ["mon-mgr", ""]}) -- 0x7f2c64062790 con 0x7f2c4c0a2d80 2024-09-12T02:37:59.262 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:37:59.261+0000 7f2c61600640 1 -- 172.21.15.39:0/3914802137 <== mgr.25199 v2:172.21.15.39:6800/2187509357 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+26 (secure 0 0 0) 0x7f2c64062790 con 0x7f2c4c0a2d80 2024-09-12T02:37:59.262 INFO:teuthology.orchestra.run.smithi039.stdout:Retention added to path / 2024-09-12T02:37:59.264 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:37:59.263+0000 7f2c6a600640 1 -- 172.21.15.39:0/3914802137 >> [v2:172.21.15.39:6800/2187509357,v1:172.21.15.39:6801/2187509357] conn(0x7f2c4c0a2d80 msgr2=0x7f2c4c0a5240 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:37:59.264 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:37:59.263+0000 7f2c6a600640 1 --2- 172.21.15.39:0/3914802137 >> [v2:172.21.15.39:6800/2187509357,v1:172.21.15.39:6801/2187509357] conn(0x7f2c4c0a2d80 0x7f2c4c0a5240 secure :-1 s=READY pgs=41 cs=0 l=1 rev1=1 crypto rx=0x7f2c500095f0 tx=0x7f2c50005f90 comp rx=0 tx=0).stop 2024-09-12T02:37:59.264 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:37:59.263+0000 7f2c6a600640 1 -- 172.21.15.39:0/3914802137 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f2c641023c0 msgr2=0x7f2c64101d30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:37:59.264 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:37:59.263+0000 7f2c6a600640 1 --2- 172.21.15.39:0/3914802137 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f2c641023c0 0x7f2c64101d30 secure :-1 s=READY pgs=120 cs=0 l=1 rev1=1 crypto rx=0x7f2c58031440 tx=0x7f2c58032ce0 comp rx=0 tx=0).stop 2024-09-12T02:37:59.264 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:37:59.263+0000 7f2c6a600640 1 -- 172.21.15.39:0/3914802137 shutdown_connections 2024-09-12T02:37:59.264 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:37:59.263+0000 7f2c6a600640 1 --2- 172.21.15.39:0/3914802137 >> [v2:172.21.15.39:6800/2187509357,v1:172.21.15.39:6801/2187509357] conn(0x7f2c4c0a2d80 0x7f2c4c0a5240 unknown :-1 s=CLOSED pgs=41 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:37:59.264 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:37:59.263+0000 7f2c6a600640 1 --2- 172.21.15.39:0/3914802137 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f2c64107620 0x7f2c641008b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:37:59.264 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:37:59.263+0000 7f2c6a600640 1 --2- 172.21.15.39:0/3914802137 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f2c64104cf0 0x7f2c64100370 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:37:59.264 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:37:59.263+0000 7f2c6a600640 1 --2- 172.21.15.39:0/3914802137 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f2c641023c0 0x7f2c64101d30 unknown :-1 s=CLOSED pgs=120 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:37:59.265 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:37:59.263+0000 7f2c6a600640 1 -- 172.21.15.39:0/3914802137 >> 172.21.15.39:0/3914802137 conn(0x7f2c640fbfa0 msgr2=0x7f2c64102d60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:37:59.265 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:37:59.264+0000 7f2c6a600640 1 -- 172.21.15.39:0/3914802137 shutdown_connections 2024-09-12T02:37:59.265 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:37:59.264+0000 7f2c6a600640 1 -- 172.21.15.39:0/3914802137 wait complete. 2024-09-12T02:37:59.281 DEBUG:teuthology.orchestra.run.smithi039:> sudo TESTDIR=/home/ubuntu/cephtest bash -c 'ceph fs snap-schedule status --fs=cephfs --path=/' 2024-09-12T02:37:59.441 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:37:59.438+0000 7f8e20c00640 1 -- 172.21.15.39:0/1738954578 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f8e1c101b60 msgr2=0x7f8e1c101f60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:37:59.444 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:37:59.438+0000 7f8e20c00640 1 --2- 172.21.15.39:0/1738954578 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f8e1c101b60 0x7f8e1c101f60 secure :-1 s=READY pgs=290 cs=0 l=1 rev1=1 crypto rx=0x7f8e0c009900 tx=0x7f8e0c02a3f0 comp rx=0 tx=0).stop 2024-09-12T02:37:59.444 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:37:59.438+0000 7f8e20c00640 1 -- 172.21.15.39:0/1738954578 shutdown_connections 2024-09-12T02:37:59.444 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:37:59.438+0000 7f8e20c00640 1 --2- 172.21.15.39:0/1738954578 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f8e1c103710 0x7f8e1c109fa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:37:59.444 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:37:59.438+0000 7f8e20c00640 1 --2- 172.21.15.39:0/1738954578 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f8e1c102d50 0x7f8e1c1031d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:37:59.444 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:37:59.438+0000 7f8e20c00640 1 --2- 172.21.15.39:0/1738954578 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f8e1c101b60 0x7f8e1c101f60 unknown :-1 s=CLOSED pgs=290 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:37:59.444 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:37:59.438+0000 7f8e20c00640 1 -- 172.21.15.39:0/1738954578 >> 172.21.15.39:0/1738954578 conn(0x7f8e1c0fd2e0 msgr2=0x7f8e1c0ff700 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:37:59.444 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:37:59.438+0000 7f8e20c00640 1 -- 172.21.15.39:0/1738954578 shutdown_connections 2024-09-12T02:37:59.444 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:37:59.438+0000 7f8e20c00640 1 -- 172.21.15.39:0/1738954578 wait complete. 2024-09-12T02:37:59.445 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:37:59.439+0000 7f8e20c00640 1 Processor -- start 2024-09-12T02:37:59.445 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:37:59.439+0000 7f8e20c00640 1 -- start start 2024-09-12T02:37:59.445 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:37:59.440+0000 7f8e20c00640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f8e1c101b60 0x7f8e1c075fa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:37:59.445 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:37:59.440+0000 7f8e20c00640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f8e1c102d50 0x7f8e1c0745e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:37:59.445 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:37:59.440+0000 7f8e20c00640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f8e1c103710 0x7f8e1c074b20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:37:59.445 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:37:59.440+0000 7f8e20c00640 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 -- 0x7f8e1c10d7e0 con 0x7f8e1c103710 2024-09-12T02:37:59.445 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:37:59.440+0000 7f8e20c00640 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x7f8e1c10d660 con 0x7f8e1c101b60 2024-09-12T02:37:59.445 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:37:59.440+0000 7f8e20c00640 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7f8e1c10d960 con 0x7f8e1c102d50 2024-09-12T02:37:59.445 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:37:59.440+0000 7f8e1a800640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f8e1c103710 0x7f8e1c074b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:37:59.445 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:37:59.440+0000 7f8e19400640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f8e1c102d50 0x7f8e1c0745e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:37:59.445 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:37:59.440+0000 7f8e19400640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f8e1c102d50 0x7f8e1c0745e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.172:3300/0 says I am v2:172.21.15.39:57646/0 (socket says 172.21.15.39:57646) 2024-09-12T02:37:59.445 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:37:59.440+0000 7f8e1a800640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f8e1c103710 0x7f8e1c074b20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.39:3300/0 says I am v2:172.21.15.39:56612/0 (socket says 172.21.15.39:56612) 2024-09-12T02:37:59.446 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:37:59.440+0000 7f8e19400640 1 -- 172.21.15.39:0/1366153545 learned_addr learned my addr 172.21.15.39:0/1366153545 (peer_addr_for_me v2:172.21.15.39:0/0) 2024-09-12T02:37:59.446 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:37:59.440+0000 7f8e19e00640 1 --2- 172.21.15.39:0/1366153545 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f8e1c101b60 0x7f8e1c075fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:37:59.446 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:37:59.440+0000 7f8e19400640 1 -- 172.21.15.39:0/1366153545 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f8e1c101b60 msgr2=0x7f8e1c075fa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:37:59.446 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:37:59.440+0000 7f8e19400640 1 --2- 172.21.15.39:0/1366153545 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f8e1c101b60 0x7f8e1c075fa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:37:59.446 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:37:59.440+0000 7f8e19400640 1 -- 172.21.15.39:0/1366153545 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f8e1c103710 msgr2=0x7f8e1c074b20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:37:59.446 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:37:59.440+0000 7f8e19400640 1 --2- 172.21.15.39:0/1366153545 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f8e1c103710 0x7f8e1c074b20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:37:59.446 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:37:59.440+0000 7f8e19400640 1 -- 172.21.15.39:0/1366153545 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8e1c0753b0 con 0x7f8e1c102d50 2024-09-12T02:37:59.446 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:37:59.440+0000 7f8e1a800640 1 --2- 172.21.15.39:0/1366153545 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f8e1c103710 0x7f8e1c074b20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-12T02:37:59.446 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:37:59.441+0000 7f8e19400640 1 --2- 172.21.15.39:0/1366153545 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f8e1c102d50 0x7f8e1c0745e0 secure :-1 s=READY pgs=121 cs=0 l=1 rev1=1 crypto rx=0x7f8e0800e9f0 tx=0x7f8e0800edf0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:37:59.448 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:37:59.441+0000 7f8e12a00640 1 -- 172.21.15.39:0/1366153545 <== mon.1 v2:172.21.15.172:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8e0800cd80 con 0x7f8e1c102d50 2024-09-12T02:37:59.449 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:37:59.441+0000 7f8e12a00640 1 -- 172.21.15.39:0/1366153545 <== mon.1 v2:172.21.15.172:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f8e08005500 con 0x7f8e1c102d50 2024-09-12T02:37:59.449 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:37:59.441+0000 7f8e12a00640 1 -- 172.21.15.39:0/1366153545 <== mon.1 v2:172.21.15.172:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8e08010690 con 0x7f8e1c102d50 2024-09-12T02:37:59.449 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:37:59.441+0000 7f8e20c00640 1 -- 172.21.15.39:0/1366153545 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f8e1c1a1f50 con 0x7f8e1c102d50 2024-09-12T02:37:59.449 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:37:59.441+0000 7f8e20c00640 1 -- 172.21.15.39:0/1366153545 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f8e1c1a23b0 con 0x7f8e1c102d50 2024-09-12T02:37:59.449 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:37:59.442+0000 7f8e20c00640 1 -- 172.21.15.39:0/1366153545 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f8e1c108f50 con 0x7f8e1c102d50 2024-09-12T02:37:59.449 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:37:59.444+0000 7f8e12a00640 1 -- 172.21.15.39:0/1366153545 <== mon.1 v2:172.21.15.172:3300/0 4 ==== mgrmap(e 24) ==== 138004+0+0 (secure 0 0 0) 0x7f8e080046c0 con 0x7f8e1c102d50 2024-09-12T02:37:59.449 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:37:59.446+0000 7f8e12a00640 1 --2- 172.21.15.39:0/1366153545 >> [v2:172.21.15.39:6800/2187509357,v1:172.21.15.39:6801/2187509357] conn(0x7f8e000a2ec0 0x7f8e000a5380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:37:59.449 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:37:59.446+0000 7f8e12a00640 1 -- 172.21.15.39:0/1366153545 <== mon.1 v2:172.21.15.172:3300/0 5 ==== osd_map(96..96 src has 1..96) ==== 9387+0+0 (secure 0 0 0) 0x7f8e080cfcd0 con 0x7f8e1c102d50 2024-09-12T02:37:59.449 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:37:59.446+0000 7f8e19e00640 1 --2- 172.21.15.39:0/1366153545 >> [v2:172.21.15.39:6800/2187509357,v1:172.21.15.39:6801/2187509357] conn(0x7f8e000a2ec0 0x7f8e000a5380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:37:59.449 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:37:59.447+0000 7f8e19e00640 1 --2- 172.21.15.39:0/1366153545 >> [v2:172.21.15.39:6800/2187509357,v1:172.21.15.39:6801/2187509357] conn(0x7f8e000a2ec0 0x7f8e000a5380 secure :-1 s=READY pgs=42 cs=0 l=1 rev1=1 crypto rx=0x7f8e0c005ab0 tx=0x7f8e0c000bc0 comp rx=0 tx=0).ready entity=mgr.25199 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:37:59.450 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:37:59.450+0000 7f8e12a00640 1 -- 172.21.15.39:0/1366153545 <== mon.1 v2:172.21.15.172:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7f8e0809c3c0 con 0x7f8e1c102d50 2024-09-12T02:37:59.662 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:37:59.661+0000 7f8e20c00640 1 -- 172.21.15.39:0/1366153545 --> [v2:172.21.15.39:6800/2187509357,v1:172.21.15.39:6801/2187509357] -- mgr_command(tid 0: {"prefix": "fs snap-schedule status", "fs": "cephfs", "path": "/", "target": ["mon-mgr", ""]}) -- 0x7f8e1c062630 con 0x7f8e000a2ec0 2024-09-12T02:37:59.669 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:37:59.668+0000 7f8e12a00640 1 -- 172.21.15.39:0/1366153545 <== mgr.25199 v2:172.21.15.39:6800/2187509357 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+298 (secure 0 0 0) 0x7f8e1c062630 con 0x7f8e000a2ec0 2024-09-12T02:37:59.669 INFO:teuthology.orchestra.run.smithi039.stdout:{"fs": "cephfs", "subvol": null, "group": null, "path": "/", "rel_path": "/", "schedule": "1m", "retention": {"m": 6, "h": 3}, "start": "2024-09-12T00:00:00", "created": "2024-09-12T02:37:58", "first": null, "last": null, "last_pruned": null, "created_count": 0, "pruned_count": 0, "active": true} 2024-09-12T02:37:59.671 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:37:59.671+0000 7f8e20c00640 1 -- 172.21.15.39:0/1366153545 >> [v2:172.21.15.39:6800/2187509357,v1:172.21.15.39:6801/2187509357] conn(0x7f8e000a2ec0 msgr2=0x7f8e000a5380 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:37:59.672 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:37:59.671+0000 7f8e20c00640 1 --2- 172.21.15.39:0/1366153545 >> [v2:172.21.15.39:6800/2187509357,v1:172.21.15.39:6801/2187509357] conn(0x7f8e000a2ec0 0x7f8e000a5380 secure :-1 s=READY pgs=42 cs=0 l=1 rev1=1 crypto rx=0x7f8e0c005ab0 tx=0x7f8e0c000bc0 comp rx=0 tx=0).stop 2024-09-12T02:37:59.672 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:37:59.671+0000 7f8e20c00640 1 -- 172.21.15.39:0/1366153545 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f8e1c102d50 msgr2=0x7f8e1c0745e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:37:59.672 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:37:59.671+0000 7f8e20c00640 1 --2- 172.21.15.39:0/1366153545 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f8e1c102d50 0x7f8e1c0745e0 secure :-1 s=READY pgs=121 cs=0 l=1 rev1=1 crypto rx=0x7f8e0800e9f0 tx=0x7f8e0800edf0 comp rx=0 tx=0).stop 2024-09-12T02:37:59.672 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:37:59.671+0000 7f8e20c00640 1 -- 172.21.15.39:0/1366153545 shutdown_connections 2024-09-12T02:37:59.672 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:37:59.671+0000 7f8e20c00640 1 --2- 172.21.15.39:0/1366153545 >> [v2:172.21.15.39:6800/2187509357,v1:172.21.15.39:6801/2187509357] conn(0x7f8e000a2ec0 0x7f8e000a5380 unknown :-1 s=CLOSED pgs=42 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:37:59.672 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:37:59.671+0000 7f8e20c00640 1 --2- 172.21.15.39:0/1366153545 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f8e1c103710 0x7f8e1c074b20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:37:59.672 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:37:59.671+0000 7f8e20c00640 1 --2- 172.21.15.39:0/1366153545 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f8e1c102d50 0x7f8e1c0745e0 unknown :-1 s=CLOSED pgs=121 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:37:59.672 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:37:59.671+0000 7f8e20c00640 1 --2- 172.21.15.39:0/1366153545 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f8e1c101b60 0x7f8e1c075fa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:37:59.672 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:37:59.671+0000 7f8e20c00640 1 -- 172.21.15.39:0/1366153545 >> 172.21.15.39:0/1366153545 conn(0x7f8e1c0fd2e0 msgr2=0x7f8e1c106120 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:37:59.672 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:37:59.671+0000 7f8e20c00640 1 -- 172.21.15.39:0/1366153545 shutdown_connections 2024-09-12T02:37:59.672 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:37:59.671+0000 7f8e20c00640 1 -- 172.21.15.39:0/1366153545 wait complete. 2024-09-12T02:37:59.688 DEBUG:teuthology.orchestra.run.smithi039:> sudo TESTDIR=/home/ubuntu/cephtest bash -c 'ceph fs snap-schedule list --fs=cephfs --path=/ --recursive=true' 2024-09-12T02:37:59.849 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:37:59.848+0000 7f3544400640 1 -- 172.21.15.39:0/3092121568 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f353c103d60 msgr2=0x7f353c104160 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:37:59.849 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:37:59.848+0000 7f3544400640 1 --2- 172.21.15.39:0/3092121568 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f353c103d60 0x7f353c104160 secure :-1 s=READY pgs=291 cs=0 l=1 rev1=1 crypto rx=0x7f3530009ca0 tx=0x7f353002a8c0 comp rx=0 tx=0).stop 2024-09-12T02:37:59.849 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:37:59.848+0000 7f3544400640 1 -- 172.21.15.39:0/3092121568 shutdown_connections 2024-09-12T02:37:59.849 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:37:59.848+0000 7f3544400640 1 --2- 172.21.15.39:0/3092121568 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f353c105910 0x7f353c10c1a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:37:59.849 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:37:59.848+0000 7f3544400640 1 --2- 172.21.15.39:0/3092121568 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f353c104f50 0x7f353c1053d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:37:59.849 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:37:59.848+0000 7f3544400640 1 --2- 172.21.15.39:0/3092121568 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f353c103d60 0x7f353c104160 unknown :-1 s=CLOSED pgs=291 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:37:59.849 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:37:59.848+0000 7f3544400640 1 -- 172.21.15.39:0/3092121568 >> 172.21.15.39:0/3092121568 conn(0x7f353c0ff4e0 msgr2=0x7f353c101900 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:37:59.850 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:37:59.848+0000 7f3544400640 1 -- 172.21.15.39:0/3092121568 shutdown_connections 2024-09-12T02:37:59.852 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:37:59.848+0000 7f3544400640 1 -- 172.21.15.39:0/3092121568 wait complete. 2024-09-12T02:37:59.853 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:37:59.849+0000 7f3544400640 1 Processor -- start 2024-09-12T02:37:59.853 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:37:59.849+0000 7f3544400640 1 -- start start 2024-09-12T02:37:59.853 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:37:59.849+0000 7f3544400640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f353c103d60 0x7f353c199ff0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:37:59.854 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:37:59.849+0000 7f3544400640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f353c104f50 0x7f353c19a530 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:37:59.854 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:37:59.849+0000 7f3544400640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f353c105910 0x7f353c1a15a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:37:59.854 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:37:59.849+0000 7f3544400640 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 -- 0x7f353c10fa30 con 0x7f353c105910 2024-09-12T02:37:59.854 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:37:59.849+0000 7f3544400640 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x7f353c10f8b0 con 0x7f353c103d60 2024-09-12T02:37:59.854 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:37:59.849+0000 7f3544400640 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7f353c10fbb0 con 0x7f353c104f50 2024-09-12T02:37:59.854 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:37:59.849+0000 7f3541a00640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f353c103d60 0x7f353c199ff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:37:59.854 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:37:59.849+0000 7f3542400640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f353c105910 0x7f353c1a15a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:37:59.854 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:37:59.849+0000 7f3541a00640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f353c103d60 0x7f353c199ff0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.39:50182/0 (socket says 172.21.15.39:50182) 2024-09-12T02:37:59.854 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:37:59.849+0000 7f3541a00640 1 -- 172.21.15.39:0/737000940 learned_addr learned my addr 172.21.15.39:0/737000940 (peer_addr_for_me v2:172.21.15.39:0/0) 2024-09-12T02:37:59.854 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:37:59.850+0000 7f3541000640 1 --2- 172.21.15.39:0/737000940 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f353c104f50 0x7f353c19a530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:37:59.854 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:37:59.850+0000 7f3541a00640 1 -- 172.21.15.39:0/737000940 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f353c104f50 msgr2=0x7f353c19a530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:37:59.854 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:37:59.850+0000 7f3541a00640 1 --2- 172.21.15.39:0/737000940 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f353c104f50 0x7f353c19a530 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:37:59.854 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:37:59.850+0000 7f3541a00640 1 -- 172.21.15.39:0/737000940 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f353c105910 msgr2=0x7f353c1a15a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:37:59.855 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:37:59.850+0000 7f3541a00640 1 --2- 172.21.15.39:0/737000940 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f353c105910 0x7f353c1a15a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:37:59.855 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:37:59.850+0000 7f3541a00640 1 -- 172.21.15.39:0/737000940 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f353c1a1c10 con 0x7f353c103d60 2024-09-12T02:37:59.855 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:37:59.850+0000 7f3542400640 1 --2- 172.21.15.39:0/737000940 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f353c105910 0x7f353c1a15a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-12T02:37:59.855 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:37:59.850+0000 7f3541a00640 1 --2- 172.21.15.39:0/737000940 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f353c103d60 0x7f353c199ff0 secure :-1 s=READY pgs=144 cs=0 l=1 rev1=1 crypto rx=0x7f3530000f80 tx=0x7f35300319f0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:37:59.855 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:37:59.850+0000 7f353a000640 1 -- 172.21.15.39:0/737000940 <== mon.2 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3530003b70 con 0x7f353c103d60 2024-09-12T02:37:59.855 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:37:59.850+0000 7f3544400640 1 -- 172.21.15.39:0/737000940 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f353c1a1ea0 con 0x7f353c103d60 2024-09-12T02:37:59.855 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:37:59.850+0000 7f353a000640 1 -- 172.21.15.39:0/737000940 <== mon.2 v2:172.21.15.44:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f3530003d10 con 0x7f353c103d60 2024-09-12T02:37:59.855 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:37:59.850+0000 7f353a000640 1 -- 172.21.15.39:0/737000940 <== mon.2 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f353002fc50 con 0x7f353c103d60 2024-09-12T02:37:59.855 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:37:59.851+0000 7f3544400640 1 -- 172.21.15.39:0/737000940 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f353c1a2300 con 0x7f353c103d60 2024-09-12T02:37:59.855 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:37:59.852+0000 7f3544400640 1 -- 172.21.15.39:0/737000940 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f353c10b080 con 0x7f353c103d60 2024-09-12T02:37:59.856 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:37:59.853+0000 7f353a000640 1 -- 172.21.15.39:0/737000940 <== mon.2 v2:172.21.15.44:3300/0 4 ==== mgrmap(e 24) ==== 138004+0+0 (secure 0 0 0) 0x7f3530004b40 con 0x7f353c103d60 2024-09-12T02:37:59.856 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:37:59.855+0000 7f353a000640 1 --2- 172.21.15.39:0/737000940 >> [v2:172.21.15.39:6800/2187509357,v1:172.21.15.39:6801/2187509357] conn(0x7f35240a2e40 0x7f35240a5300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:37:59.856 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:37:59.855+0000 7f353a000640 1 -- 172.21.15.39:0/737000940 <== mon.2 v2:172.21.15.44:3300/0 5 ==== osd_map(96..96 src has 1..96) ==== 9387+0+0 (secure 0 0 0) 0x7f35300f0da0 con 0x7f353c103d60 2024-09-12T02:37:59.857 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:37:59.855+0000 7f3541000640 1 --2- 172.21.15.39:0/737000940 >> [v2:172.21.15.39:6800/2187509357,v1:172.21.15.39:6801/2187509357] conn(0x7f35240a2e40 0x7f35240a5300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:37:59.857 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:37:59.856+0000 7f3541000640 1 --2- 172.21.15.39:0/737000940 >> [v2:172.21.15.39:6800/2187509357,v1:172.21.15.39:6801/2187509357] conn(0x7f35240a2e40 0x7f35240a5300 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0x7f353c19b500 tx=0x7f3528005f90 comp rx=0 tx=0).ready entity=mgr.25199 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:37:59.857 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:37:59.857+0000 7f353a000640 1 -- 172.21.15.39:0/737000940 <== mon.2 v2:172.21.15.44:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7f35300bd5a0 con 0x7f353c103d60 2024-09-12T02:37:59.949 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 12 02:37:59 smithi044 ceph-mon[35411]: [12/Sep/2024:02:37:57] ENGINE Bus STARTING 2024-09-12T02:37:59.949 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 12 02:37:59 smithi044 ceph-mon[35411]: [12/Sep/2024:02:37:57] ENGINE Serving on https://172.21.15.39:7150 2024-09-12T02:37:59.949 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 12 02:37:59 smithi044 ceph-mon[35411]: [12/Sep/2024:02:37:57] ENGINE Error in HTTPServer.serve 2024-09-12T02:37:59.949 INFO:journalctl@ceph.mon.b.smithi044.stdout: Traceback (most recent call last): 2024-09-12T02:37:59.949 INFO:journalctl@ceph.mon.b.smithi044.stdout: File "/lib/python3.9/site-packages/cheroot/server.py", line 1823, in serve 2024-09-12T02:37:59.949 INFO:journalctl@ceph.mon.b.smithi044.stdout: self._connections.run(self.expiration_interval) 2024-09-12T02:37:59.950 INFO:journalctl@ceph.mon.b.smithi044.stdout: File "/lib/python3.9/site-packages/cheroot/connections.py", line 203, in run 2024-09-12T02:37:59.950 INFO:journalctl@ceph.mon.b.smithi044.stdout: self._run(expiration_interval) 2024-09-12T02:37:59.950 INFO:journalctl@ceph.mon.b.smithi044.stdout: File "/lib/python3.9/site-packages/cheroot/connections.py", line 246, in _run 2024-09-12T02:37:59.950 INFO:journalctl@ceph.mon.b.smithi044.stdout: new_conn = self._from_server_socket(self.server.socket) 2024-09-12T02:37:59.950 INFO:journalctl@ceph.mon.b.smithi044.stdout: File "/lib/python3.9/site-packages/cheroot/connections.py", line 300, in _from_server_socket 2024-09-12T02:37:59.950 INFO:journalctl@ceph.mon.b.smithi044.stdout: s, ssl_env = self.server.ssl_adapter.wrap(s) 2024-09-12T02:37:59.950 INFO:journalctl@ceph.mon.b.smithi044.stdout: File "/lib/python3.9/site-packages/cheroot/ssl/builtin.py", line 277, in wrap 2024-09-12T02:37:59.950 INFO:journalctl@ceph.mon.b.smithi044.stdout: s = self.context.wrap_socket( 2024-09-12T02:37:59.950 INFO:journalctl@ceph.mon.b.smithi044.stdout: File "/lib64/python3.9/ssl.py", line 501, in wrap_socket 2024-09-12T02:37:59.950 INFO:journalctl@ceph.mon.b.smithi044.stdout: return self.sslsocket_class._create( 2024-09-12T02:37:59.950 INFO:journalctl@ceph.mon.b.smithi044.stdout: File "/lib64/python3.9/ssl.py", line 1074, in _create 2024-09-12T02:37:59.950 INFO:journalctl@ceph.mon.b.smithi044.stdout: self.do_handshake() 2024-09-12T02:37:59.950 INFO:journalctl@ceph.mon.b.smithi044.stdout: File "/lib64/python3.9/ssl.py", line 1343, in do_handshake 2024-09-12T02:37:59.951 INFO:journalctl@ceph.mon.b.smithi044.stdout: self._sslobj.do_handshake() 2024-09-12T02:37:59.951 INFO:journalctl@ceph.mon.b.smithi044.stdout: ssl.SSLZeroReturnError: TLS/SSL connection has been closed (EOF) (_ssl.c:1133) 2024-09-12T02:37:59.951 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 12 02:37:59 smithi044 ceph-mon[35411]: pgmap v4: 129 pgs: 129 active+clean; 1.1 MiB data, 350 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-12T02:37:59.951 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 12 02:37:59 smithi044 ceph-mon[35411]: [12/Sep/2024:02:37:58] ENGINE Serving on http://172.21.15.39:8765 2024-09-12T02:37:59.951 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 12 02:37:59 smithi044 ceph-mon[35411]: [12/Sep/2024:02:37:58] ENGINE Bus STARTED 2024-09-12T02:37:59.951 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 12 02:37:59 smithi044 ceph-mon[35411]: from='client.15306 -' entity='client.admin' cmd=[{"prefix": "fs snap-schedule add", "fs": "cephfs", "path": "/", "snap_schedule": "1m", "target": ["mon-mgr", ""]}]: dispatch 2024-09-12T02:37:59.951 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 12 02:37:59 smithi044 ceph-mon[35411]: from='mgr.25199 172.21.15.39:0/1270637502' entity='mgr.x' 2024-09-12T02:37:59.951 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 12 02:37:59 smithi044 ceph-mon[35411]: from='mgr.25199 172.21.15.39:0/1270637502' entity='mgr.x' 2024-09-12T02:37:59.951 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 12 02:37:59 smithi044 ceph-mon[35411]: from='mgr.25199 172.21.15.39:0/1270637502' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2024-09-12T02:37:59.951 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 12 02:37:59 smithi044 ceph-mon[35411]: from='mgr.25199 172.21.15.39:0/1270637502' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2024-09-12T02:37:59.951 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 12 02:37:59 smithi044 ceph-mon[35411]: from='mgr.25199 172.21.15.39:0/1270637502' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.8", "name": "osd_memory_target"}]: dispatch 2024-09-12T02:37:59.951 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 12 02:37:59 smithi044 ceph-mon[35411]: from='mgr.25199 172.21.15.39:0/1270637502' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.11", "name": "osd_memory_target"}]: dispatch 2024-09-12T02:37:59.951 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 12 02:37:59 smithi044 ceph-mon[35411]: Adjusting osd_memory_target on smithi172 to 176.0M 2024-09-12T02:37:59.951 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 12 02:37:59 smithi044 ceph-mon[35411]: Unable to set osd_memory_target on smithi172 to 184592486: error parsing value: Value '184592486' is below minimum 939524096 2024-09-12T02:37:59.952 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 12 02:37:59 smithi044 ceph-mon[35411]: from='mgr.25199 172.21.15.39:0/1270637502' entity='mgr.x' 2024-09-12T02:37:59.952 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 12 02:37:59 smithi044 ceph-mon[35411]: from='mgr.25199 172.21.15.39:0/1270637502' entity='mgr.x' 2024-09-12T02:37:59.952 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 12 02:37:59 smithi044 ceph-mon[35411]: from='mgr.25199 172.21.15.39:0/1270637502' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2024-09-12T02:37:59.952 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 12 02:37:59 smithi044 ceph-mon[35411]: from='mgr.25199 172.21.15.39:0/1270637502' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2024-09-12T02:37:59.952 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 12 02:37:59 smithi044 ceph-mon[35411]: from='mgr.25199 172.21.15.39:0/1270637502' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"}]: dispatch 2024-09-12T02:37:59.952 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 12 02:37:59 smithi044 ceph-mon[35411]: from='mgr.25199 172.21.15.39:0/1270637502' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.10", "name": "osd_memory_target"}]: dispatch 2024-09-12T02:37:59.952 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 12 02:37:59 smithi044 ceph-mon[35411]: mgrmap e24: x(active, since 2s), standbys: y, z 2024-09-12T02:37:59.952 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 12 02:37:59 smithi044 ceph-mon[35411]: from='mgr.25199 172.21.15.39:0/1270637502' entity='mgr.x' 2024-09-12T02:37:59.952 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 12 02:37:59 smithi044 ceph-mon[35411]: from='mgr.25199 172.21.15.39:0/1270637502' entity='mgr.x' 2024-09-12T02:38:00.014 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 12 02:37:59 smithi172 ceph-mon[35609]: [12/Sep/2024:02:37:57] ENGINE Bus STARTING 2024-09-12T02:38:00.014 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 12 02:37:59 smithi172 ceph-mon[35609]: [12/Sep/2024:02:37:57] ENGINE Serving on https://172.21.15.39:7150 2024-09-12T02:38:00.014 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 12 02:37:59 smithi172 ceph-mon[35609]: [12/Sep/2024:02:37:57] ENGINE Error in HTTPServer.serve 2024-09-12T02:38:00.014 INFO:journalctl@ceph.mon.c.smithi172.stdout: Traceback (most recent call last): 2024-09-12T02:38:00.014 INFO:journalctl@ceph.mon.c.smithi172.stdout: File "/lib/python3.9/site-packages/cheroot/server.py", line 1823, in serve 2024-09-12T02:38:00.014 INFO:journalctl@ceph.mon.c.smithi172.stdout: self._connections.run(self.expiration_interval) 2024-09-12T02:38:00.014 INFO:journalctl@ceph.mon.c.smithi172.stdout: File "/lib/python3.9/site-packages/cheroot/connections.py", line 203, in run 2024-09-12T02:38:00.014 INFO:journalctl@ceph.mon.c.smithi172.stdout: self._run(expiration_interval) 2024-09-12T02:38:00.015 INFO:journalctl@ceph.mon.c.smithi172.stdout: File "/lib/python3.9/site-packages/cheroot/connections.py", line 246, in _run 2024-09-12T02:38:00.015 INFO:journalctl@ceph.mon.c.smithi172.stdout: new_conn = self._from_server_socket(self.server.socket) 2024-09-12T02:38:00.015 INFO:journalctl@ceph.mon.c.smithi172.stdout: File "/lib/python3.9/site-packages/cheroot/connections.py", line 300, in _from_server_socket 2024-09-12T02:38:00.015 INFO:journalctl@ceph.mon.c.smithi172.stdout: s, ssl_env = self.server.ssl_adapter.wrap(s) 2024-09-12T02:38:00.015 INFO:journalctl@ceph.mon.c.smithi172.stdout: File "/lib/python3.9/site-packages/cheroot/ssl/builtin.py", line 277, in wrap 2024-09-12T02:38:00.015 INFO:journalctl@ceph.mon.c.smithi172.stdout: s = self.context.wrap_socket( 2024-09-12T02:38:00.015 INFO:journalctl@ceph.mon.c.smithi172.stdout: File "/lib64/python3.9/ssl.py", line 501, in wrap_socket 2024-09-12T02:38:00.015 INFO:journalctl@ceph.mon.c.smithi172.stdout: return self.sslsocket_class._create( 2024-09-12T02:38:00.015 INFO:journalctl@ceph.mon.c.smithi172.stdout: File "/lib64/python3.9/ssl.py", line 1074, in _create 2024-09-12T02:38:00.015 INFO:journalctl@ceph.mon.c.smithi172.stdout: self.do_handshake() 2024-09-12T02:38:00.015 INFO:journalctl@ceph.mon.c.smithi172.stdout: File "/lib64/python3.9/ssl.py", line 1343, in do_handshake 2024-09-12T02:38:00.015 INFO:journalctl@ceph.mon.c.smithi172.stdout: self._sslobj.do_handshake() 2024-09-12T02:38:00.015 INFO:journalctl@ceph.mon.c.smithi172.stdout: ssl.SSLZeroReturnError: TLS/SSL connection has been closed (EOF) (_ssl.c:1133) 2024-09-12T02:38:00.016 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 12 02:37:59 smithi172 ceph-mon[35609]: pgmap v4: 129 pgs: 129 active+clean; 1.1 MiB data, 350 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-12T02:38:00.016 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 12 02:37:59 smithi172 ceph-mon[35609]: [12/Sep/2024:02:37:58] ENGINE Serving on http://172.21.15.39:8765 2024-09-12T02:38:00.016 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 12 02:37:59 smithi172 ceph-mon[35609]: [12/Sep/2024:02:37:58] ENGINE Bus STARTED 2024-09-12T02:38:00.016 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 12 02:37:59 smithi172 ceph-mon[35609]: from='client.15306 -' entity='client.admin' cmd=[{"prefix": "fs snap-schedule add", "fs": "cephfs", "path": "/", "snap_schedule": "1m", "target": ["mon-mgr", ""]}]: dispatch 2024-09-12T02:38:00.016 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 12 02:37:59 smithi172 ceph-mon[35609]: from='mgr.25199 172.21.15.39:0/1270637502' entity='mgr.x' 2024-09-12T02:38:00.016 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 12 02:37:59 smithi172 ceph-mon[35609]: from='mgr.25199 172.21.15.39:0/1270637502' entity='mgr.x' 2024-09-12T02:38:00.016 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 12 02:37:59 smithi172 ceph-mon[35609]: from='mgr.25199 172.21.15.39:0/1270637502' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2024-09-12T02:38:00.016 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 12 02:37:59 smithi172 ceph-mon[35609]: from='mgr.25199 172.21.15.39:0/1270637502' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2024-09-12T02:38:00.016 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 12 02:37:59 smithi172 ceph-mon[35609]: from='mgr.25199 172.21.15.39:0/1270637502' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.8", "name": "osd_memory_target"}]: dispatch 2024-09-12T02:38:00.016 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 12 02:37:59 smithi172 ceph-mon[35609]: from='mgr.25199 172.21.15.39:0/1270637502' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.11", "name": "osd_memory_target"}]: dispatch 2024-09-12T02:38:00.016 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 12 02:37:59 smithi172 ceph-mon[35609]: Adjusting osd_memory_target on smithi172 to 176.0M 2024-09-12T02:38:00.016 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 12 02:37:59 smithi172 ceph-mon[35609]: Unable to set osd_memory_target on smithi172 to 184592486: error parsing value: Value '184592486' is below minimum 939524096 2024-09-12T02:38:00.016 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 12 02:37:59 smithi172 ceph-mon[35609]: from='mgr.25199 172.21.15.39:0/1270637502' entity='mgr.x' 2024-09-12T02:38:00.017 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 12 02:37:59 smithi172 ceph-mon[35609]: from='mgr.25199 172.21.15.39:0/1270637502' entity='mgr.x' 2024-09-12T02:38:00.017 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 12 02:37:59 smithi172 ceph-mon[35609]: from='mgr.25199 172.21.15.39:0/1270637502' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2024-09-12T02:38:00.017 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 12 02:37:59 smithi172 ceph-mon[35609]: from='mgr.25199 172.21.15.39:0/1270637502' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2024-09-12T02:38:00.017 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 12 02:37:59 smithi172 ceph-mon[35609]: from='mgr.25199 172.21.15.39:0/1270637502' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"}]: dispatch 2024-09-12T02:38:00.017 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 12 02:37:59 smithi172 ceph-mon[35609]: from='mgr.25199 172.21.15.39:0/1270637502' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.10", "name": "osd_memory_target"}]: dispatch 2024-09-12T02:38:00.017 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 12 02:37:59 smithi172 ceph-mon[35609]: mgrmap e24: x(active, since 2s), standbys: y, z 2024-09-12T02:38:00.017 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 12 02:37:59 smithi172 ceph-mon[35609]: from='mgr.25199 172.21.15.39:0/1270637502' entity='mgr.x' 2024-09-12T02:38:00.017 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 12 02:37:59 smithi172 ceph-mon[35609]: from='mgr.25199 172.21.15.39:0/1270637502' entity='mgr.x' 2024-09-12T02:38:00.069 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:38:00.068+0000 7f3544400640 1 -- 172.21.15.39:0/737000940 --> [v2:172.21.15.39:6800/2187509357,v1:172.21.15.39:6801/2187509357] -- mgr_command(tid 0: {"prefix": "fs snap-schedule list", "fs": "cephfs", "path": "/", "recursive": true, "target": ["mon-mgr", ""]}) -- 0x7f353c062630 con 0x7f35240a2e40 2024-09-12T02:38:00.077 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:38:00.076+0000 7f353a000640 1 -- 172.21.15.39:0/737000940 <== mgr.25199 v2:172.21.15.39:6800/2187509357 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+10 (secure 0 0 0) 0x7f353c062630 con 0x7f35240a2e40 2024-09-12T02:38:00.077 INFO:teuthology.orchestra.run.smithi039.stdout:/ 1m 6m3h 2024-09-12T02:38:00.079 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:38:00.078+0000 7f3544400640 1 -- 172.21.15.39:0/737000940 >> [v2:172.21.15.39:6800/2187509357,v1:172.21.15.39:6801/2187509357] conn(0x7f35240a2e40 msgr2=0x7f35240a5300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:38:00.079 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:38:00.078+0000 7f3544400640 1 --2- 172.21.15.39:0/737000940 >> [v2:172.21.15.39:6800/2187509357,v1:172.21.15.39:6801/2187509357] conn(0x7f35240a2e40 0x7f35240a5300 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0x7f353c19b500 tx=0x7f3528005f90 comp rx=0 tx=0).stop 2024-09-12T02:38:00.079 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:38:00.078+0000 7f3544400640 1 -- 172.21.15.39:0/737000940 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f353c103d60 msgr2=0x7f353c199ff0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:38:00.079 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:38:00.078+0000 7f3544400640 1 --2- 172.21.15.39:0/737000940 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f353c103d60 0x7f353c199ff0 secure :-1 s=READY pgs=144 cs=0 l=1 rev1=1 crypto rx=0x7f3530000f80 tx=0x7f35300319f0 comp rx=0 tx=0).stop 2024-09-12T02:38:00.079 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:38:00.078+0000 7f3544400640 1 -- 172.21.15.39:0/737000940 shutdown_connections 2024-09-12T02:38:00.079 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:38:00.078+0000 7f3544400640 1 --2- 172.21.15.39:0/737000940 >> [v2:172.21.15.39:6800/2187509357,v1:172.21.15.39:6801/2187509357] conn(0x7f35240a2e40 0x7f35240a5300 unknown :-1 s=CLOSED pgs=43 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:38:00.079 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:38:00.078+0000 7f3544400640 1 --2- 172.21.15.39:0/737000940 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f353c105910 0x7f353c1a15a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:38:00.079 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:38:00.078+0000 7f3544400640 1 --2- 172.21.15.39:0/737000940 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f353c104f50 0x7f353c19a530 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:38:00.080 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:38:00.078+0000 7f3544400640 1 --2- 172.21.15.39:0/737000940 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f353c103d60 0x7f353c199ff0 unknown :-1 s=CLOSED pgs=144 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:38:00.080 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:38:00.078+0000 7f3544400640 1 -- 172.21.15.39:0/737000940 >> 172.21.15.39:0/737000940 conn(0x7f353c0ff4e0 msgr2=0x7f353c108250 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:38:00.080 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:38:00.078+0000 7f3544400640 1 -- 172.21.15.39:0/737000940 shutdown_connections 2024-09-12T02:38:00.080 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:38:00.078+0000 7f3544400640 1 -- 172.21.15.39:0/737000940 wait complete. 2024-09-12T02:38:00.095 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 02:37:59 smithi039 ceph-mon[30515]: [12/Sep/2024:02:37:57] ENGINE Bus STARTING 2024-09-12T02:38:00.095 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 02:37:59 smithi039 ceph-mon[30515]: [12/Sep/2024:02:37:57] ENGINE Serving on https://172.21.15.39:7150 2024-09-12T02:38:00.095 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 02:37:59 smithi039 ceph-mon[30515]: [12/Sep/2024:02:37:57] ENGINE Error in HTTPServer.serve 2024-09-12T02:38:00.095 INFO:journalctl@ceph.mon.a.smithi039.stdout: Traceback (most recent call last): 2024-09-12T02:38:00.095 INFO:journalctl@ceph.mon.a.smithi039.stdout: File "/lib/python3.9/site-packages/cheroot/server.py", line 1823, in serve 2024-09-12T02:38:00.095 INFO:journalctl@ceph.mon.a.smithi039.stdout: self._connections.run(self.expiration_interval) 2024-09-12T02:38:00.095 INFO:journalctl@ceph.mon.a.smithi039.stdout: File "/lib/python3.9/site-packages/cheroot/connections.py", line 203, in run 2024-09-12T02:38:00.095 INFO:journalctl@ceph.mon.a.smithi039.stdout: self._run(expiration_interval) 2024-09-12T02:38:00.096 INFO:journalctl@ceph.mon.a.smithi039.stdout: File "/lib/python3.9/site-packages/cheroot/connections.py", line 246, in _run 2024-09-12T02:38:00.096 INFO:journalctl@ceph.mon.a.smithi039.stdout: new_conn = self._from_server_socket(self.server.socket) 2024-09-12T02:38:00.096 INFO:journalctl@ceph.mon.a.smithi039.stdout: File "/lib/python3.9/site-packages/cheroot/connections.py", line 300, in _from_server_socket 2024-09-12T02:38:00.096 INFO:journalctl@ceph.mon.a.smithi039.stdout: s, ssl_env = self.server.ssl_adapter.wrap(s) 2024-09-12T02:38:00.096 INFO:journalctl@ceph.mon.a.smithi039.stdout: File "/lib/python3.9/site-packages/cheroot/ssl/builtin.py", line 277, in wrap 2024-09-12T02:38:00.096 INFO:journalctl@ceph.mon.a.smithi039.stdout: s = self.context.wrap_socket( 2024-09-12T02:38:00.096 INFO:journalctl@ceph.mon.a.smithi039.stdout: File "/lib64/python3.9/ssl.py", line 501, in wrap_socket 2024-09-12T02:38:00.096 INFO:journalctl@ceph.mon.a.smithi039.stdout: return self.sslsocket_class._create( 2024-09-12T02:38:00.096 INFO:journalctl@ceph.mon.a.smithi039.stdout: File "/lib64/python3.9/ssl.py", line 1074, in _create 2024-09-12T02:38:00.096 INFO:journalctl@ceph.mon.a.smithi039.stdout: self.do_handshake() 2024-09-12T02:38:00.096 INFO:journalctl@ceph.mon.a.smithi039.stdout: File "/lib64/python3.9/ssl.py", line 1343, in do_handshake 2024-09-12T02:38:00.096 INFO:journalctl@ceph.mon.a.smithi039.stdout: self._sslobj.do_handshake() 2024-09-12T02:38:00.096 INFO:journalctl@ceph.mon.a.smithi039.stdout: ssl.SSLZeroReturnError: TLS/SSL connection has been closed (EOF) (_ssl.c:1133) 2024-09-12T02:38:00.097 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 02:37:59 smithi039 ceph-mon[30515]: pgmap v4: 129 pgs: 129 active+clean; 1.1 MiB data, 350 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-12T02:38:00.097 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 02:37:59 smithi039 ceph-mon[30515]: [12/Sep/2024:02:37:58] ENGINE Serving on http://172.21.15.39:8765 2024-09-12T02:38:00.097 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 02:37:59 smithi039 ceph-mon[30515]: [12/Sep/2024:02:37:58] ENGINE Bus STARTED 2024-09-12T02:38:00.097 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 02:37:59 smithi039 ceph-mon[30515]: from='client.15306 -' entity='client.admin' cmd=[{"prefix": "fs snap-schedule add", "fs": "cephfs", "path": "/", "snap_schedule": "1m", "target": ["mon-mgr", ""]}]: dispatch 2024-09-12T02:38:00.097 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 02:37:59 smithi039 ceph-mon[30515]: from='mgr.25199 172.21.15.39:0/1270637502' entity='mgr.x' 2024-09-12T02:38:00.097 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 02:37:59 smithi039 ceph-mon[30515]: from='mgr.25199 172.21.15.39:0/1270637502' entity='mgr.x' 2024-09-12T02:38:00.097 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 02:37:59 smithi039 ceph-mon[30515]: from='mgr.25199 172.21.15.39:0/1270637502' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2024-09-12T02:38:00.097 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 02:37:59 smithi039 ceph-mon[30515]: from='mgr.25199 172.21.15.39:0/1270637502' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2024-09-12T02:38:00.097 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 02:37:59 smithi039 ceph-mon[30515]: from='mgr.25199 172.21.15.39:0/1270637502' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.8", "name": "osd_memory_target"}]: dispatch 2024-09-12T02:38:00.097 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 02:37:59 smithi039 ceph-mon[30515]: from='mgr.25199 172.21.15.39:0/1270637502' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.11", "name": "osd_memory_target"}]: dispatch 2024-09-12T02:38:00.097 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 02:37:59 smithi039 ceph-mon[30515]: Adjusting osd_memory_target on smithi172 to 176.0M 2024-09-12T02:38:00.097 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 02:37:59 smithi039 ceph-mon[30515]: Unable to set osd_memory_target on smithi172 to 184592486: error parsing value: Value '184592486' is below minimum 939524096 2024-09-12T02:38:00.097 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 02:37:59 smithi039 ceph-mon[30515]: from='mgr.25199 172.21.15.39:0/1270637502' entity='mgr.x' 2024-09-12T02:38:00.097 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 02:37:59 smithi039 ceph-mon[30515]: from='mgr.25199 172.21.15.39:0/1270637502' entity='mgr.x' 2024-09-12T02:38:00.098 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 02:37:59 smithi039 ceph-mon[30515]: from='mgr.25199 172.21.15.39:0/1270637502' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2024-09-12T02:38:00.098 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 02:37:59 smithi039 ceph-mon[30515]: from='mgr.25199 172.21.15.39:0/1270637502' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2024-09-12T02:38:00.098 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 02:37:59 smithi039 ceph-mon[30515]: from='mgr.25199 172.21.15.39:0/1270637502' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"}]: dispatch 2024-09-12T02:38:00.098 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 02:37:59 smithi039 ceph-mon[30515]: from='mgr.25199 172.21.15.39:0/1270637502' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.10", "name": "osd_memory_target"}]: dispatch 2024-09-12T02:38:00.098 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 02:37:59 smithi039 ceph-mon[30515]: mgrmap e24: x(active, since 2s), standbys: y, z 2024-09-12T02:38:00.098 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 02:37:59 smithi039 ceph-mon[30515]: from='mgr.25199 172.21.15.39:0/1270637502' entity='mgr.x' 2024-09-12T02:38:00.098 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 02:37:59 smithi039 ceph-mon[30515]: from='mgr.25199 172.21.15.39:0/1270637502' entity='mgr.x' 2024-09-12T02:38:00.099 DEBUG:teuthology.orchestra.run.smithi039:> sudo TESTDIR=/home/ubuntu/cephtest bash -c 'date +%s > START_TIME' 2024-09-12T02:38:00.159 INFO:teuthology.run_tasks:Running task full_sequential_finally... 2024-09-12T02:38:00.170 INFO:teuthology.run_tasks:Running task workunit... 2024-09-12T02:38:00.183 INFO:tasks.workunit:Pulling workunits from ref 086c737fa75c22d521a3932c59b31c5e1d1c9ef4 2024-09-12T02:38:00.183 INFO:tasks.workunit:Making a separate scratch dir for every client... 2024-09-12T02:38:00.184 INFO:tasks.workunit:timeout=3h 2024-09-12T02:38:00.184 INFO:tasks.workunit:cleanup=True 2024-09-12T02:38:00.184 DEBUG:teuthology.orchestra.run.smithi039:> stat -- /home/ubuntu/cephtest/mnt.0 2024-09-12T02:38:00.220 INFO:teuthology.orchestra.run.smithi039.stdout: File: /home/ubuntu/cephtest/mnt.0 2024-09-12T02:38:00.221 INFO:teuthology.orchestra.run.smithi039.stdout: Size: 0 Blocks: 0 IO Block: 65536 directory 2024-09-12T02:38:00.221 INFO:teuthology.orchestra.run.smithi039.stdout:Device: 6ch/108d Inode: 1099511628283 Links: 2 2024-09-12T02:38:00.221 INFO:teuthology.orchestra.run.smithi039.stdout:Access: (1777/drwxrwxrwt) Uid: ( 0/ root) Gid: ( 0/ root) 2024-09-12T02:38:00.221 INFO:teuthology.orchestra.run.smithi039.stdout:Context: system_u:object_r:unlabeled_t:s0 2024-09-12T02:38:00.221 INFO:teuthology.orchestra.run.smithi039.stdout:Access: 2024-09-12 02:36:02.416161222 +0000 2024-09-12T02:38:00.221 INFO:teuthology.orchestra.run.smithi039.stdout:Modify: 2024-09-12 02:36:02.416161222 +0000 2024-09-12T02:38:00.221 INFO:teuthology.orchestra.run.smithi039.stdout:Change: 2024-09-12 02:37:54.591549804 +0000 2024-09-12T02:38:00.221 INFO:teuthology.orchestra.run.smithi039.stdout: Birth: 2024-09-12 02:36:02.416161222 +0000 2024-09-12T02:38:00.221 INFO:tasks.workunit:Did not need to create dir /home/ubuntu/cephtest/mnt.0 2024-09-12T02:38:00.221 DEBUG:teuthology.orchestra.run.smithi039:> cd -- /home/ubuntu/cephtest/mnt.0 && sudo install -d -m 0755 --owner=ubuntu -- client.0 2024-09-12T02:38:00.338 DEBUG:teuthology.orchestra.run.smithi039:> rm -rf /home/ubuntu/cephtest/clone.client.0 && git clone https://git.ceph.com/ceph.git /home/ubuntu/cephtest/clone.client.0 && cd /home/ubuntu/cephtest/clone.client.0 && git checkout 086c737fa75c22d521a3932c59b31c5e1d1c9ef4 2024-09-12T02:38:00.349 INFO:journalctl@ceph.mgr.x.smithi039.stdout:Sep 12 02:38:00 smithi039 ceph-4954ed46-70ae-11ef-bcea-c7b262605968-mgr-x[30736]: 2024-09-12T02:38:00.271+0000 7fba18e00640 -1 client.0 error registering admin socket command: (17) File exists 2024-09-12T02:38:00.349 INFO:journalctl@ceph.mgr.x.smithi039.stdout:Sep 12 02:38:00 smithi039 ceph-4954ed46-70ae-11ef-bcea-c7b262605968-mgr-x[30736]: 2024-09-12T02:38:00.271+0000 7fba18e00640 -1 client.0 error registering admin socket command: (17) File exists 2024-09-12T02:38:00.350 INFO:journalctl@ceph.mgr.x.smithi039.stdout:Sep 12 02:38:00 smithi039 ceph-4954ed46-70ae-11ef-bcea-c7b262605968-mgr-x[30736]: 2024-09-12T02:38:00.271+0000 7fba18e00640 -1 client.0 error registering admin socket command: (17) File exists 2024-09-12T02:38:00.350 INFO:journalctl@ceph.mgr.x.smithi039.stdout:Sep 12 02:38:00 smithi039 ceph-4954ed46-70ae-11ef-bcea-c7b262605968-mgr-x[30736]: 2024-09-12T02:38:00.271+0000 7fba18e00640 -1 client.0 error registering admin socket command: (17) File exists 2024-09-12T02:38:00.350 INFO:journalctl@ceph.mgr.x.smithi039.stdout:Sep 12 02:38:00 smithi039 ceph-4954ed46-70ae-11ef-bcea-c7b262605968-mgr-x[30736]: 2024-09-12T02:38:00.271+0000 7fba18e00640 -1 client.0 error registering admin socket command: (17) File exists 2024-09-12T02:38:00.381 INFO:tasks.workunit.client.0.smithi039.stderr:Cloning into '/home/ubuntu/cephtest/clone.client.0'... 2024-09-12T02:38:00.948 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 12 02:38:00 smithi044 ceph-mon[35411]: Adjusting osd_memory_target on smithi044 to 177.0M 2024-09-12T02:38:00.949 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 12 02:38:00 smithi044 ceph-mon[35411]: Unable to set osd_memory_target on smithi044 to 185700659: error parsing value: Value '185700659' is below minimum 939524096 2024-09-12T02:38:00.949 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 12 02:38:00 smithi044 ceph-mon[35411]: from='client.25291 -' entity='client.admin' cmd=[{"prefix": "fs snap-schedule retention add", "fs": "cephfs", "path": "/", "retention_spec_or_period": "6m3h", "target": ["mon-mgr", ""]}]: dispatch 2024-09-12T02:38:00.949 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 12 02:38:00 smithi044 ceph-mon[35411]: from='client.25297 -' entity='client.admin' cmd=[{"prefix": "fs snap-schedule status", "fs": "cephfs", "path": "/", "target": ["mon-mgr", ""]}]: dispatch 2024-09-12T02:38:00.949 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 12 02:38:00 smithi044 ceph-mon[35411]: from='mgr.25199 172.21.15.39:0/1270637502' entity='mgr.x' 2024-09-12T02:38:00.949 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 12 02:38:00 smithi044 ceph-mon[35411]: from='mgr.25199 172.21.15.39:0/1270637502' entity='mgr.x' 2024-09-12T02:38:00.949 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 12 02:38:00 smithi044 ceph-mon[35411]: from='mgr.25199 172.21.15.39:0/1270637502' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-09-12T02:38:00.949 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 12 02:38:00 smithi044 ceph-mon[35411]: from='mgr.25199 172.21.15.39:0/1270637502' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2024-09-12T02:38:00.949 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 12 02:38:00 smithi044 ceph-mon[35411]: from='mgr.25199 172.21.15.39:0/1270637502' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.6", "name": "osd_memory_target"}]: dispatch 2024-09-12T02:38:00.949 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 12 02:38:00 smithi044 ceph-mon[35411]: from='mgr.25199 172.21.15.39:0/1270637502' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.9", "name": "osd_memory_target"}]: dispatch 2024-09-12T02:38:00.949 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 12 02:38:00 smithi044 ceph-mon[35411]: from='mgr.25199 172.21.15.39:0/1270637502' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-12T02:38:00.949 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 12 02:38:00 smithi044 ceph-mon[35411]: from='mgr.25199 172.21.15.39:0/1270637502' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-12T02:38:01.014 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 12 02:38:00 smithi172 ceph-mon[35609]: Adjusting osd_memory_target on smithi044 to 177.0M 2024-09-12T02:38:01.014 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 12 02:38:00 smithi172 ceph-mon[35609]: Unable to set osd_memory_target on smithi044 to 185700659: error parsing value: Value '185700659' is below minimum 939524096 2024-09-12T02:38:01.014 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 12 02:38:00 smithi172 ceph-mon[35609]: from='client.25291 -' entity='client.admin' cmd=[{"prefix": "fs snap-schedule retention add", "fs": "cephfs", "path": "/", "retention_spec_or_period": "6m3h", "target": ["mon-mgr", ""]}]: dispatch 2024-09-12T02:38:01.014 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 12 02:38:00 smithi172 ceph-mon[35609]: from='client.25297 -' entity='client.admin' cmd=[{"prefix": "fs snap-schedule status", "fs": "cephfs", "path": "/", "target": ["mon-mgr", ""]}]: dispatch 2024-09-12T02:38:01.014 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 12 02:38:00 smithi172 ceph-mon[35609]: from='mgr.25199 172.21.15.39:0/1270637502' entity='mgr.x' 2024-09-12T02:38:01.014 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 12 02:38:00 smithi172 ceph-mon[35609]: from='mgr.25199 172.21.15.39:0/1270637502' entity='mgr.x' 2024-09-12T02:38:01.014 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 12 02:38:00 smithi172 ceph-mon[35609]: from='mgr.25199 172.21.15.39:0/1270637502' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-09-12T02:38:01.014 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 12 02:38:00 smithi172 ceph-mon[35609]: from='mgr.25199 172.21.15.39:0/1270637502' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2024-09-12T02:38:01.015 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 12 02:38:00 smithi172 ceph-mon[35609]: from='mgr.25199 172.21.15.39:0/1270637502' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.6", "name": "osd_memory_target"}]: dispatch 2024-09-12T02:38:01.015 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 12 02:38:00 smithi172 ceph-mon[35609]: from='mgr.25199 172.21.15.39:0/1270637502' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.9", "name": "osd_memory_target"}]: dispatch 2024-09-12T02:38:01.015 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 12 02:38:00 smithi172 ceph-mon[35609]: from='mgr.25199 172.21.15.39:0/1270637502' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-12T02:38:01.015 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 12 02:38:00 smithi172 ceph-mon[35609]: from='mgr.25199 172.21.15.39:0/1270637502' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-12T02:38:01.100 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 02:38:00 smithi039 ceph-mon[30515]: Adjusting osd_memory_target on smithi044 to 177.0M 2024-09-12T02:38:01.100 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 02:38:00 smithi039 ceph-mon[30515]: Unable to set osd_memory_target on smithi044 to 185700659: error parsing value: Value '185700659' is below minimum 939524096 2024-09-12T02:38:01.100 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 02:38:00 smithi039 ceph-mon[30515]: from='client.25291 -' entity='client.admin' cmd=[{"prefix": "fs snap-schedule retention add", "fs": "cephfs", "path": "/", "retention_spec_or_period": "6m3h", "target": ["mon-mgr", ""]}]: dispatch 2024-09-12T02:38:01.100 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 02:38:00 smithi039 ceph-mon[30515]: from='client.25297 -' entity='client.admin' cmd=[{"prefix": "fs snap-schedule status", "fs": "cephfs", "path": "/", "target": ["mon-mgr", ""]}]: dispatch 2024-09-12T02:38:01.100 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 02:38:00 smithi039 ceph-mon[30515]: from='mgr.25199 172.21.15.39:0/1270637502' entity='mgr.x' 2024-09-12T02:38:01.100 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 02:38:00 smithi039 ceph-mon[30515]: from='mgr.25199 172.21.15.39:0/1270637502' entity='mgr.x' 2024-09-12T02:38:01.100 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 02:38:00 smithi039 ceph-mon[30515]: from='mgr.25199 172.21.15.39:0/1270637502' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-09-12T02:38:01.100 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 02:38:00 smithi039 ceph-mon[30515]: from='mgr.25199 172.21.15.39:0/1270637502' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2024-09-12T02:38:01.100 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 02:38:00 smithi039 ceph-mon[30515]: from='mgr.25199 172.21.15.39:0/1270637502' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.6", "name": "osd_memory_target"}]: dispatch 2024-09-12T02:38:01.100 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 02:38:00 smithi039 ceph-mon[30515]: from='mgr.25199 172.21.15.39:0/1270637502' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.9", "name": "osd_memory_target"}]: dispatch 2024-09-12T02:38:01.100 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 02:38:00 smithi039 ceph-mon[30515]: from='mgr.25199 172.21.15.39:0/1270637502' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-12T02:38:01.101 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 02:38:00 smithi039 ceph-mon[30515]: from='mgr.25199 172.21.15.39:0/1270637502' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-12T02:38:01.949 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 12 02:38:01 smithi044 ceph-mon[35411]: pgmap v5: 129 pgs: 129 active+clean; 1.1 MiB data, 350 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-12T02:38:01.949 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 12 02:38:01 smithi044 ceph-mon[35411]: from='client.25307 -' entity='client.admin' cmd=[{"prefix": "fs snap-schedule list", "fs": "cephfs", "path": "/", "recursive": true, "target": ["mon-mgr", ""]}]: dispatch 2024-09-12T02:38:01.949 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 12 02:38:01 smithi044 ceph-mon[35411]: Adjusting osd_memory_target on smithi039 to 176.4M 2024-09-12T02:38:01.949 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 12 02:38:01 smithi044 ceph-mon[35411]: Unable to set osd_memory_target on smithi039 to 185042636: error parsing value: Value '185042636' is below minimum 939524096 2024-09-12T02:38:01.949 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 12 02:38:01 smithi044 ceph-mon[35411]: Updating smithi039:/etc/ceph/ceph.conf 2024-09-12T02:38:01.949 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 12 02:38:01 smithi044 ceph-mon[35411]: Updating smithi044:/etc/ceph/ceph.conf 2024-09-12T02:38:01.949 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 12 02:38:01 smithi044 ceph-mon[35411]: Updating smithi172:/etc/ceph/ceph.conf 2024-09-12T02:38:01.949 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 12 02:38:01 smithi044 ceph-mon[35411]: mgrmap e25: x(active, since 4s), standbys: y, z 2024-09-12T02:38:01.949 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 12 02:38:01 smithi044 ceph-mon[35411]: Updating smithi172:/var/lib/ceph/4954ed46-70ae-11ef-bcea-c7b262605968/config/ceph.conf 2024-09-12T02:38:01.949 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 12 02:38:01 smithi044 ceph-mon[35411]: Updating smithi044:/var/lib/ceph/4954ed46-70ae-11ef-bcea-c7b262605968/config/ceph.conf 2024-09-12T02:38:01.949 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 12 02:38:01 smithi044 ceph-mon[35411]: from='mgr.25199 172.21.15.39:0/1270637502' entity='mgr.x' 2024-09-12T02:38:01.949 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 12 02:38:01 smithi044 ceph-mon[35411]: from='mgr.25199 172.21.15.39:0/1270637502' entity='mgr.x' 2024-09-12T02:38:01.950 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 12 02:38:01 smithi044 ceph-mon[35411]: from='mgr.25199 172.21.15.39:0/1270637502' entity='mgr.x' 2024-09-12T02:38:01.950 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 12 02:38:01 smithi044 ceph-mon[35411]: from='mgr.25199 172.21.15.39:0/1270637502' entity='mgr.x' 2024-09-12T02:38:02.014 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 12 02:38:01 smithi172 ceph-mon[35609]: pgmap v5: 129 pgs: 129 active+clean; 1.1 MiB data, 350 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-12T02:38:02.014 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 12 02:38:01 smithi172 ceph-mon[35609]: from='client.25307 -' entity='client.admin' cmd=[{"prefix": "fs snap-schedule list", "fs": "cephfs", "path": "/", "recursive": true, "target": ["mon-mgr", ""]}]: dispatch 2024-09-12T02:38:02.014 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 12 02:38:01 smithi172 ceph-mon[35609]: Adjusting osd_memory_target on smithi039 to 176.4M 2024-09-12T02:38:02.014 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 12 02:38:01 smithi172 ceph-mon[35609]: Unable to set osd_memory_target on smithi039 to 185042636: error parsing value: Value '185042636' is below minimum 939524096 2024-09-12T02:38:02.014 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 12 02:38:01 smithi172 ceph-mon[35609]: Updating smithi039:/etc/ceph/ceph.conf 2024-09-12T02:38:02.014 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 12 02:38:01 smithi172 ceph-mon[35609]: Updating smithi044:/etc/ceph/ceph.conf 2024-09-12T02:38:02.014 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 12 02:38:01 smithi172 ceph-mon[35609]: Updating smithi172:/etc/ceph/ceph.conf 2024-09-12T02:38:02.014 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 12 02:38:01 smithi172 ceph-mon[35609]: mgrmap e25: x(active, since 4s), standbys: y, z 2024-09-12T02:38:02.014 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 12 02:38:01 smithi172 ceph-mon[35609]: Updating smithi172:/var/lib/ceph/4954ed46-70ae-11ef-bcea-c7b262605968/config/ceph.conf 2024-09-12T02:38:02.014 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 12 02:38:01 smithi172 ceph-mon[35609]: Updating smithi044:/var/lib/ceph/4954ed46-70ae-11ef-bcea-c7b262605968/config/ceph.conf 2024-09-12T02:38:02.014 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 12 02:38:01 smithi172 ceph-mon[35609]: from='mgr.25199 172.21.15.39:0/1270637502' entity='mgr.x' 2024-09-12T02:38:02.014 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 12 02:38:01 smithi172 ceph-mon[35609]: from='mgr.25199 172.21.15.39:0/1270637502' entity='mgr.x' 2024-09-12T02:38:02.015 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 12 02:38:01 smithi172 ceph-mon[35609]: from='mgr.25199 172.21.15.39:0/1270637502' entity='mgr.x' 2024-09-12T02:38:02.015 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 12 02:38:01 smithi172 ceph-mon[35609]: from='mgr.25199 172.21.15.39:0/1270637502' entity='mgr.x' 2024-09-12T02:38:02.100 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 02:38:01 smithi039 ceph-mon[30515]: pgmap v5: 129 pgs: 129 active+clean; 1.1 MiB data, 350 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-12T02:38:02.100 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 02:38:01 smithi039 ceph-mon[30515]: from='client.25307 -' entity='client.admin' cmd=[{"prefix": "fs snap-schedule list", "fs": "cephfs", "path": "/", "recursive": true, "target": ["mon-mgr", ""]}]: dispatch 2024-09-12T02:38:02.100 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 02:38:01 smithi039 ceph-mon[30515]: Adjusting osd_memory_target on smithi039 to 176.4M 2024-09-12T02:38:02.100 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 02:38:01 smithi039 ceph-mon[30515]: Unable to set osd_memory_target on smithi039 to 185042636: error parsing value: Value '185042636' is below minimum 939524096 2024-09-12T02:38:02.100 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 02:38:01 smithi039 ceph-mon[30515]: Updating smithi039:/etc/ceph/ceph.conf 2024-09-12T02:38:02.100 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 02:38:01 smithi039 ceph-mon[30515]: Updating smithi044:/etc/ceph/ceph.conf 2024-09-12T02:38:02.100 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 02:38:01 smithi039 ceph-mon[30515]: Updating smithi172:/etc/ceph/ceph.conf 2024-09-12T02:38:02.100 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 02:38:01 smithi039 ceph-mon[30515]: mgrmap e25: x(active, since 4s), standbys: y, z 2024-09-12T02:38:02.100 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 02:38:01 smithi039 ceph-mon[30515]: Updating smithi172:/var/lib/ceph/4954ed46-70ae-11ef-bcea-c7b262605968/config/ceph.conf 2024-09-12T02:38:02.100 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 02:38:01 smithi039 ceph-mon[30515]: Updating smithi044:/var/lib/ceph/4954ed46-70ae-11ef-bcea-c7b262605968/config/ceph.conf 2024-09-12T02:38:02.100 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 02:38:01 smithi039 ceph-mon[30515]: from='mgr.25199 172.21.15.39:0/1270637502' entity='mgr.x' 2024-09-12T02:38:02.101 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 02:38:01 smithi039 ceph-mon[30515]: from='mgr.25199 172.21.15.39:0/1270637502' entity='mgr.x' 2024-09-12T02:38:02.101 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 02:38:01 smithi039 ceph-mon[30515]: from='mgr.25199 172.21.15.39:0/1270637502' entity='mgr.x' 2024-09-12T02:38:02.101 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 02:38:01 smithi039 ceph-mon[30515]: from='mgr.25199 172.21.15.39:0/1270637502' entity='mgr.x' 2024-09-12T02:38:02.948 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 12 02:38:02 smithi044 ceph-mon[35411]: Updating smithi172:/etc/ceph/ceph.client.admin.keyring 2024-09-12T02:38:02.949 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 12 02:38:02 smithi044 ceph-mon[35411]: Updating smithi044:/etc/ceph/ceph.client.admin.keyring 2024-09-12T02:38:02.949 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 12 02:38:02 smithi044 ceph-mon[35411]: Updating smithi039:/var/lib/ceph/4954ed46-70ae-11ef-bcea-c7b262605968/config/ceph.conf 2024-09-12T02:38:02.949 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 12 02:38:02 smithi044 ceph-mon[35411]: Updating smithi172:/var/lib/ceph/4954ed46-70ae-11ef-bcea-c7b262605968/config/ceph.client.admin.keyring 2024-09-12T02:38:02.949 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 12 02:38:02 smithi044 ceph-mon[35411]: Updating smithi044:/var/lib/ceph/4954ed46-70ae-11ef-bcea-c7b262605968/config/ceph.client.admin.keyring 2024-09-12T02:38:02.949 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 12 02:38:02 smithi044 ceph-mon[35411]: Updating smithi039:/etc/ceph/ceph.client.admin.keyring 2024-09-12T02:38:02.949 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 12 02:38:02 smithi044 ceph-mon[35411]: from='mgr.25199 172.21.15.39:0/1270637502' entity='mgr.x' 2024-09-12T02:38:02.949 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 12 02:38:02 smithi044 ceph-mon[35411]: from='mgr.25199 172.21.15.39:0/1270637502' entity='mgr.x' 2024-09-12T02:38:02.949 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 12 02:38:02 smithi044 ceph-mon[35411]: from='mgr.25199 172.21.15.39:0/1270637502' entity='mgr.x' 2024-09-12T02:38:02.949 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 12 02:38:02 smithi044 ceph-mon[35411]: from='mgr.25199 172.21.15.39:0/1270637502' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-12T02:38:02.949 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 12 02:38:02 smithi044 ceph-mon[35411]: from='mgr.25199 172.21.15.39:0/1270637502' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-12T02:38:02.949 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 12 02:38:02 smithi044 ceph-mon[35411]: from='mgr.25199 172.21.15.39:0/1270637502' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-12T02:38:02.949 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 12 02:38:02 smithi044 ceph-mon[35411]: from='mgr.25199 172.21.15.39:0/1270637502' entity='mgr.x' 2024-09-12T02:38:03.013 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 12 02:38:02 smithi172 ceph-mon[35609]: Updating smithi172:/etc/ceph/ceph.client.admin.keyring 2024-09-12T02:38:03.014 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 12 02:38:02 smithi172 ceph-mon[35609]: Updating smithi044:/etc/ceph/ceph.client.admin.keyring 2024-09-12T02:38:03.014 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 12 02:38:02 smithi172 ceph-mon[35609]: Updating smithi039:/var/lib/ceph/4954ed46-70ae-11ef-bcea-c7b262605968/config/ceph.conf 2024-09-12T02:38:03.014 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 12 02:38:02 smithi172 ceph-mon[35609]: Updating smithi172:/var/lib/ceph/4954ed46-70ae-11ef-bcea-c7b262605968/config/ceph.client.admin.keyring 2024-09-12T02:38:03.014 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 12 02:38:02 smithi172 ceph-mon[35609]: Updating smithi044:/var/lib/ceph/4954ed46-70ae-11ef-bcea-c7b262605968/config/ceph.client.admin.keyring 2024-09-12T02:38:03.014 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 12 02:38:02 smithi172 ceph-mon[35609]: Updating smithi039:/etc/ceph/ceph.client.admin.keyring 2024-09-12T02:38:03.014 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 12 02:38:02 smithi172 ceph-mon[35609]: from='mgr.25199 172.21.15.39:0/1270637502' entity='mgr.x' 2024-09-12T02:38:03.014 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 12 02:38:02 smithi172 ceph-mon[35609]: from='mgr.25199 172.21.15.39:0/1270637502' entity='mgr.x' 2024-09-12T02:38:03.014 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 12 02:38:02 smithi172 ceph-mon[35609]: from='mgr.25199 172.21.15.39:0/1270637502' entity='mgr.x' 2024-09-12T02:38:03.014 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 12 02:38:02 smithi172 ceph-mon[35609]: from='mgr.25199 172.21.15.39:0/1270637502' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-12T02:38:03.014 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 12 02:38:02 smithi172 ceph-mon[35609]: from='mgr.25199 172.21.15.39:0/1270637502' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-12T02:38:03.014 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 12 02:38:02 smithi172 ceph-mon[35609]: from='mgr.25199 172.21.15.39:0/1270637502' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-12T02:38:03.014 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 12 02:38:02 smithi172 ceph-mon[35609]: from='mgr.25199 172.21.15.39:0/1270637502' entity='mgr.x' 2024-09-12T02:38:03.100 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 02:38:02 smithi039 ceph-mon[30515]: Updating smithi172:/etc/ceph/ceph.client.admin.keyring 2024-09-12T02:38:03.100 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 02:38:02 smithi039 ceph-mon[30515]: Updating smithi044:/etc/ceph/ceph.client.admin.keyring 2024-09-12T02:38:03.100 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 02:38:02 smithi039 ceph-mon[30515]: Updating smithi039:/var/lib/ceph/4954ed46-70ae-11ef-bcea-c7b262605968/config/ceph.conf 2024-09-12T02:38:03.100 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 02:38:02 smithi039 ceph-mon[30515]: Updating smithi172:/var/lib/ceph/4954ed46-70ae-11ef-bcea-c7b262605968/config/ceph.client.admin.keyring 2024-09-12T02:38:03.100 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 02:38:02 smithi039 ceph-mon[30515]: Updating smithi044:/var/lib/ceph/4954ed46-70ae-11ef-bcea-c7b262605968/config/ceph.client.admin.keyring 2024-09-12T02:38:03.100 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 02:38:02 smithi039 ceph-mon[30515]: Updating smithi039:/etc/ceph/ceph.client.admin.keyring 2024-09-12T02:38:03.100 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 02:38:02 smithi039 ceph-mon[30515]: from='mgr.25199 172.21.15.39:0/1270637502' entity='mgr.x' 2024-09-12T02:38:03.100 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 02:38:02 smithi039 ceph-mon[30515]: from='mgr.25199 172.21.15.39:0/1270637502' entity='mgr.x' 2024-09-12T02:38:03.100 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 02:38:02 smithi039 ceph-mon[30515]: from='mgr.25199 172.21.15.39:0/1270637502' entity='mgr.x' 2024-09-12T02:38:03.100 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 02:38:02 smithi039 ceph-mon[30515]: from='mgr.25199 172.21.15.39:0/1270637502' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-12T02:38:03.101 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 02:38:02 smithi039 ceph-mon[30515]: from='mgr.25199 172.21.15.39:0/1270637502' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-12T02:38:03.101 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 02:38:02 smithi039 ceph-mon[30515]: from='mgr.25199 172.21.15.39:0/1270637502' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-12T02:38:03.101 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 02:38:02 smithi039 ceph-mon[30515]: from='mgr.25199 172.21.15.39:0/1270637502' entity='mgr.x' 2024-09-12T02:38:04.001 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 02:38:03 smithi039 ceph-mon[30515]: pgmap v6: 129 pgs: 129 active+clean; 1.1 MiB data, 350 MiB used, 1.0 TiB / 1.0 TiB avail; 43 KiB/s rd, 205 B/s wr, 25 op/s 2024-09-12T02:38:04.001 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 02:38:03 smithi039 ceph-mon[30515]: Updating smithi039:/var/lib/ceph/4954ed46-70ae-11ef-bcea-c7b262605968/config/ceph.client.admin.keyring 2024-09-12T02:38:04.001 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 02:38:03 smithi039 ceph-mon[30515]: mgrmap e26: x(active, since 6s), standbys: y, z 2024-09-12T02:38:04.013 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 12 02:38:03 smithi172 ceph-mon[35609]: pgmap v6: 129 pgs: 129 active+clean; 1.1 MiB data, 350 MiB used, 1.0 TiB / 1.0 TiB avail; 43 KiB/s rd, 205 B/s wr, 25 op/s 2024-09-12T02:38:04.013 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 12 02:38:03 smithi172 ceph-mon[35609]: Updating smithi039:/var/lib/ceph/4954ed46-70ae-11ef-bcea-c7b262605968/config/ceph.client.admin.keyring 2024-09-12T02:38:04.013 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 12 02:38:03 smithi172 ceph-mon[35609]: mgrmap e26: x(active, since 6s), standbys: y, z 2024-09-12T02:38:04.198 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 12 02:38:03 smithi044 ceph-mon[35411]: pgmap v6: 129 pgs: 129 active+clean; 1.1 MiB data, 350 MiB used, 1.0 TiB / 1.0 TiB avail; 43 KiB/s rd, 205 B/s wr, 25 op/s 2024-09-12T02:38:04.198 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 12 02:38:03 smithi044 ceph-mon[35411]: Updating smithi039:/var/lib/ceph/4954ed46-70ae-11ef-bcea-c7b262605968/config/ceph.client.admin.keyring 2024-09-12T02:38:04.198 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 12 02:38:03 smithi044 ceph-mon[35411]: mgrmap e26: x(active, since 6s), standbys: y, z 2024-09-12T02:38:06.013 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 12 02:38:05 smithi172 ceph-mon[35609]: pgmap v7: 129 pgs: 129 active+clean; 1.3 MiB data, 355 MiB used, 1.0 TiB / 1.0 TiB avail; 86 KiB/s rd, 172 KiB/s wr, 108 op/s 2024-09-12T02:38:06.100 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 02:38:05 smithi039 ceph-mon[30515]: pgmap v7: 129 pgs: 129 active+clean; 1.3 MiB data, 355 MiB used, 1.0 TiB / 1.0 TiB avail; 86 KiB/s rd, 172 KiB/s wr, 108 op/s 2024-09-12T02:38:06.198 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 12 02:38:05 smithi044 ceph-mon[35411]: pgmap v7: 129 pgs: 129 active+clean; 1.3 MiB data, 355 MiB used, 1.0 TiB / 1.0 TiB avail; 86 KiB/s rd, 172 KiB/s wr, 108 op/s 2024-09-12T02:38:08.013 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 12 02:38:07 smithi172 ceph-mon[35609]: pgmap v8: 129 pgs: 129 active+clean; 1.3 MiB data, 355 MiB used, 1.0 TiB / 1.0 TiB avail; 67 KiB/s rd, 134 KiB/s wr, 84 op/s 2024-09-12T02:38:08.100 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 02:38:07 smithi039 ceph-mon[30515]: pgmap v8: 129 pgs: 129 active+clean; 1.3 MiB data, 355 MiB used, 1.0 TiB / 1.0 TiB avail; 67 KiB/s rd, 134 KiB/s wr, 84 op/s 2024-09-12T02:38:08.198 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 12 02:38:07 smithi044 ceph-mon[35411]: pgmap v8: 129 pgs: 129 active+clean; 1.3 MiB data, 355 MiB used, 1.0 TiB / 1.0 TiB avail; 67 KiB/s rd, 134 KiB/s wr, 84 op/s 2024-09-12T02:38:10.013 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 12 02:38:09 smithi172 ceph-mon[35609]: pgmap v9: 129 pgs: 129 active+clean; 1.3 MiB data, 355 MiB used, 1.0 TiB / 1.0 TiB avail; 57 KiB/s rd, 110 KiB/s wr, 73 op/s 2024-09-12T02:38:10.100 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 02:38:09 smithi039 ceph-mon[30515]: pgmap v9: 129 pgs: 129 active+clean; 1.3 MiB data, 355 MiB used, 1.0 TiB / 1.0 TiB avail; 57 KiB/s rd, 110 KiB/s wr, 73 op/s 2024-09-12T02:38:10.198 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 12 02:38:09 smithi044 ceph-mon[35411]: pgmap v9: 129 pgs: 129 active+clean; 1.3 MiB data, 355 MiB used, 1.0 TiB / 1.0 TiB avail; 57 KiB/s rd, 110 KiB/s wr, 73 op/s 2024-09-12T02:38:12.013 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 12 02:38:11 smithi172 ceph-mon[35609]: pgmap v10: 129 pgs: 129 active+clean; 1.3 MiB data, 355 MiB used, 1.0 TiB / 1.0 TiB avail; 52 KiB/s rd, 100 KiB/s wr, 67 op/s 2024-09-12T02:38:12.099 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 02:38:11 smithi039 ceph-mon[30515]: pgmap v10: 129 pgs: 129 active+clean; 1.3 MiB data, 355 MiB used, 1.0 TiB / 1.0 TiB avail; 52 KiB/s rd, 100 KiB/s wr, 67 op/s 2024-09-12T02:38:12.198 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 12 02:38:11 smithi044 ceph-mon[35411]: pgmap v10: 129 pgs: 129 active+clean; 1.3 MiB data, 355 MiB used, 1.0 TiB / 1.0 TiB avail; 52 KiB/s rd, 100 KiB/s wr, 67 op/s 2024-09-12T02:38:14.014 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 12 02:38:13 smithi172 ceph-mon[35609]: pgmap v11: 129 pgs: 129 active+clean; 1.3 MiB data, 355 MiB used, 1.0 TiB / 1.0 TiB avail; 54 KiB/s rd, 100 KiB/s wr, 69 op/s 2024-09-12T02:38:14.100 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 02:38:13 smithi039 ceph-mon[30515]: pgmap v11: 129 pgs: 129 active+clean; 1.3 MiB data, 355 MiB used, 1.0 TiB / 1.0 TiB avail; 54 KiB/s rd, 100 KiB/s wr, 69 op/s 2024-09-12T02:38:14.198 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 12 02:38:13 smithi044 ceph-mon[35411]: pgmap v11: 129 pgs: 129 active+clean; 1.3 MiB data, 355 MiB used, 1.0 TiB / 1.0 TiB avail; 54 KiB/s rd, 100 KiB/s wr, 69 op/s 2024-09-12T02:38:16.014 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 12 02:38:15 smithi172 ceph-mon[35609]: pgmap v12: 129 pgs: 129 active+clean; 1.3 MiB data, 355 MiB used, 1.0 TiB / 1.0 TiB avail; 37 KiB/s rd, 100 KiB/s wr, 60 op/s 2024-09-12T02:38:16.014 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 02:38:15 smithi039 ceph-mon[30515]: pgmap v12: 129 pgs: 129 active+clean; 1.3 MiB data, 355 MiB used, 1.0 TiB / 1.0 TiB avail; 37 KiB/s rd, 100 KiB/s wr, 60 op/s 2024-09-12T02:38:16.198 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 12 02:38:15 smithi044 ceph-mon[35411]: pgmap v12: 129 pgs: 129 active+clean; 1.3 MiB data, 355 MiB used, 1.0 TiB / 1.0 TiB avail; 37 KiB/s rd, 100 KiB/s wr, 60 op/s 2024-09-12T02:38:18.013 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 12 02:38:17 smithi172 ceph-mon[35609]: pgmap v13: 129 pgs: 129 active+clean; 1.3 MiB data, 355 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 85 B/s wr, 8 op/s 2024-09-12T02:38:18.099 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 02:38:17 smithi039 ceph-mon[30515]: pgmap v13: 129 pgs: 129 active+clean; 1.3 MiB data, 355 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 85 B/s wr, 8 op/s 2024-09-12T02:38:18.198 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 12 02:38:17 smithi044 ceph-mon[35411]: pgmap v13: 129 pgs: 129 active+clean; 1.3 MiB data, 355 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 85 B/s wr, 8 op/s 2024-09-12T02:38:20.013 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 12 02:38:19 smithi172 ceph-mon[35609]: pgmap v14: 129 pgs: 129 active+clean; 1.3 MiB data, 355 MiB used, 1.0 TiB / 1.0 TiB avail; 6.3 KiB/s rd, 85 B/s wr, 12 op/s 2024-09-12T02:38:20.099 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 02:38:19 smithi039 ceph-mon[30515]: pgmap v14: 129 pgs: 129 active+clean; 1.3 MiB data, 355 MiB used, 1.0 TiB / 1.0 TiB avail; 6.3 KiB/s rd, 85 B/s wr, 12 op/s 2024-09-12T02:38:20.198 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 12 02:38:19 smithi044 ceph-mon[35411]: pgmap v14: 129 pgs: 129 active+clean; 1.3 MiB data, 355 MiB used, 1.0 TiB / 1.0 TiB avail; 6.3 KiB/s rd, 85 B/s wr, 12 op/s 2024-09-12T02:38:22.013 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 12 02:38:21 smithi172 ceph-mon[35609]: pgmap v15: 129 pgs: 129 active+clean; 1.3 MiB data, 355 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2024-09-12T02:38:22.099 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 02:38:21 smithi039 ceph-mon[30515]: pgmap v15: 129 pgs: 129 active+clean; 1.3 MiB data, 355 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2024-09-12T02:38:22.198 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 12 02:38:21 smithi044 ceph-mon[35411]: pgmap v15: 129 pgs: 129 active+clean; 1.3 MiB data, 355 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2024-09-12T02:38:24.016 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 12 02:38:23 smithi172 ceph-mon[35609]: pgmap v16: 129 pgs: 129 active+clean; 1.3 MiB data, 355 MiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 11 op/s 2024-09-12T02:38:24.099 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 02:38:23 smithi039 ceph-mon[30515]: pgmap v16: 129 pgs: 129 active+clean; 1.3 MiB data, 355 MiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 11 op/s 2024-09-12T02:38:24.198 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 12 02:38:23 smithi044 ceph-mon[35411]: pgmap v16: 129 pgs: 129 active+clean; 1.3 MiB data, 355 MiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 11 op/s 2024-09-12T02:38:26.014 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 12 02:38:25 smithi172 ceph-mon[35609]: pgmap v17: 129 pgs: 129 active+clean; 1.3 MiB data, 355 MiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 10 op/s 2024-09-12T02:38:26.099 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 02:38:25 smithi039 ceph-mon[30515]: pgmap v17: 129 pgs: 129 active+clean; 1.3 MiB data, 355 MiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 10 op/s 2024-09-12T02:38:26.198 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 12 02:38:25 smithi044 ceph-mon[35411]: pgmap v17: 129 pgs: 129 active+clean; 1.3 MiB data, 355 MiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 10 op/s 2024-09-12T02:38:27.061 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 12 02:38:26 smithi172 ceph-mon[35609]: pgmap v18: 129 pgs: 129 active+clean; 1.3 MiB data, 355 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2024-09-12T02:38:27.099 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 02:38:26 smithi039 ceph-mon[30515]: pgmap v18: 129 pgs: 129 active+clean; 1.3 MiB data, 355 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2024-09-12T02:38:27.198 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 12 02:38:26 smithi044 ceph-mon[35411]: pgmap v18: 129 pgs: 129 active+clean; 1.3 MiB data, 355 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2024-09-12T02:38:29.349 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 02:38:29 smithi039 ceph-mon[30515]: pgmap v19: 129 pgs: 129 active+clean; 1.3 MiB data, 355 MiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2024-09-12T02:38:29.448 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 12 02:38:29 smithi044 ceph-mon[35411]: pgmap v19: 129 pgs: 129 active+clean; 1.3 MiB data, 355 MiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2024-09-12T02:38:29.513 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 12 02:38:29 smithi172 ceph-mon[35609]: pgmap v19: 129 pgs: 129 active+clean; 1.3 MiB data, 355 MiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2024-09-12T02:38:31.349 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 02:38:31 smithi039 ceph-mon[30515]: pgmap v20: 129 pgs: 129 active+clean; 1.3 MiB data, 355 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2024-09-12T02:38:31.448 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 12 02:38:31 smithi044 ceph-mon[35411]: pgmap v20: 129 pgs: 129 active+clean; 1.3 MiB data, 355 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2024-09-12T02:38:31.513 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 12 02:38:31 smithi172 ceph-mon[35609]: pgmap v20: 129 pgs: 129 active+clean; 1.3 MiB data, 355 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2024-09-12T02:38:33.349 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 02:38:33 smithi039 ceph-mon[30515]: pgmap v21: 129 pgs: 129 active+clean; 1.3 MiB data, 355 MiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 11 op/s 2024-09-12T02:38:33.448 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 12 02:38:33 smithi044 ceph-mon[35411]: pgmap v21: 129 pgs: 129 active+clean; 1.3 MiB data, 355 MiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 11 op/s 2024-09-12T02:38:33.513 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 12 02:38:33 smithi172 ceph-mon[35609]: pgmap v21: 129 pgs: 129 active+clean; 1.3 MiB data, 355 MiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 11 op/s 2024-09-12T02:38:35.349 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 02:38:35 smithi039 ceph-mon[30515]: pgmap v22: 129 pgs: 129 active+clean; 1.3 MiB data, 355 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2024-09-12T02:38:35.448 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 12 02:38:35 smithi044 ceph-mon[35411]: pgmap v22: 129 pgs: 129 active+clean; 1.3 MiB data, 355 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2024-09-12T02:38:35.513 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 12 02:38:35 smithi172 ceph-mon[35609]: pgmap v22: 129 pgs: 129 active+clean; 1.3 MiB data, 355 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2024-09-12T02:38:37.349 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 02:38:37 smithi039 ceph-mon[30515]: pgmap v23: 129 pgs: 129 active+clean; 1.3 MiB data, 355 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2024-09-12T02:38:37.448 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 12 02:38:37 smithi044 ceph-mon[35411]: pgmap v23: 129 pgs: 129 active+clean; 1.3 MiB data, 355 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2024-09-12T02:38:37.514 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 12 02:38:37 smithi172 ceph-mon[35609]: pgmap v23: 129 pgs: 129 active+clean; 1.3 MiB data, 355 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2024-09-12T02:38:39.349 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 02:38:39 smithi039 ceph-mon[30515]: pgmap v24: 129 pgs: 129 active+clean; 1.3 MiB data, 354 MiB used, 1.0 TiB / 1.0 TiB avail; 6.9 KiB/s rd, 853 B/s wr, 12 op/s 2024-09-12T02:38:39.448 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 12 02:38:39 smithi044 ceph-mon[35411]: pgmap v24: 129 pgs: 129 active+clean; 1.3 MiB data, 354 MiB used, 1.0 TiB / 1.0 TiB avail; 6.9 KiB/s rd, 853 B/s wr, 12 op/s 2024-09-12T02:38:39.513 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 12 02:38:39 smithi172 ceph-mon[35609]: pgmap v24: 129 pgs: 129 active+clean; 1.3 MiB data, 354 MiB used, 1.0 TiB / 1.0 TiB avail; 6.9 KiB/s rd, 853 B/s wr, 12 op/s 2024-09-12T02:38:41.349 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 02:38:41 smithi039 ceph-mon[30515]: pgmap v25: 129 pgs: 129 active+clean; 1.3 MiB data, 354 MiB used, 1.0 TiB / 1.0 TiB avail; 4.8 KiB/s rd, 853 B/s wr, 8 op/s 2024-09-12T02:38:41.448 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 12 02:38:41 smithi044 ceph-mon[35411]: pgmap v25: 129 pgs: 129 active+clean; 1.3 MiB data, 354 MiB used, 1.0 TiB / 1.0 TiB avail; 4.8 KiB/s rd, 853 B/s wr, 8 op/s 2024-09-12T02:38:41.513 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 12 02:38:41 smithi172 ceph-mon[35609]: pgmap v25: 129 pgs: 129 active+clean; 1.3 MiB data, 354 MiB used, 1.0 TiB / 1.0 TiB avail; 4.8 KiB/s rd, 853 B/s wr, 8 op/s 2024-09-12T02:38:43.350 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 02:38:43 smithi039 ceph-mon[30515]: pgmap v26: 129 pgs: 129 active+clean; 1.3 MiB data, 354 MiB used, 1.0 TiB / 1.0 TiB avail; 6.5 KiB/s rd, 853 B/s wr, 11 op/s 2024-09-12T02:38:43.448 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 12 02:38:43 smithi044 ceph-mon[35411]: pgmap v26: 129 pgs: 129 active+clean; 1.3 MiB data, 354 MiB used, 1.0 TiB / 1.0 TiB avail; 6.5 KiB/s rd, 853 B/s wr, 11 op/s 2024-09-12T02:38:43.513 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 12 02:38:43 smithi172 ceph-mon[35609]: pgmap v26: 129 pgs: 129 active+clean; 1.3 MiB data, 354 MiB used, 1.0 TiB / 1.0 TiB avail; 6.5 KiB/s rd, 853 B/s wr, 11 op/s 2024-09-12T02:38:45.350 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 02:38:45 smithi039 ceph-mon[30515]: pgmap v27: 129 pgs: 129 active+clean; 1.3 MiB data, 354 MiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 853 B/s wr, 9 op/s 2024-09-12T02:38:45.448 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 12 02:38:45 smithi044 ceph-mon[35411]: pgmap v27: 129 pgs: 129 active+clean; 1.3 MiB data, 354 MiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 853 B/s wr, 9 op/s 2024-09-12T02:38:45.513 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 12 02:38:45 smithi172 ceph-mon[35609]: pgmap v27: 129 pgs: 129 active+clean; 1.3 MiB data, 354 MiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 853 B/s wr, 9 op/s 2024-09-12T02:38:47.349 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 02:38:47 smithi039 ceph-mon[30515]: pgmap v28: 129 pgs: 129 active+clean; 1.3 MiB data, 354 MiB used, 1.0 TiB / 1.0 TiB avail; 4.8 KiB/s rd, 853 B/s wr, 8 op/s 2024-09-12T02:38:47.448 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 12 02:38:47 smithi044 ceph-mon[35411]: pgmap v28: 129 pgs: 129 active+clean; 1.3 MiB data, 354 MiB used, 1.0 TiB / 1.0 TiB avail; 4.8 KiB/s rd, 853 B/s wr, 8 op/s 2024-09-12T02:38:47.513 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 12 02:38:47 smithi172 ceph-mon[35609]: pgmap v28: 129 pgs: 129 active+clean; 1.3 MiB data, 354 MiB used, 1.0 TiB / 1.0 TiB avail; 4.8 KiB/s rd, 853 B/s wr, 8 op/s 2024-09-12T02:38:49.350 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 02:38:49 smithi039 ceph-mon[30515]: pgmap v29: 129 pgs: 129 active+clean; 1.3 MiB data, 354 MiB used, 1.0 TiB / 1.0 TiB avail; 6.9 KiB/s rd, 853 B/s wr, 12 op/s 2024-09-12T02:38:49.448 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 12 02:38:49 smithi044 ceph-mon[35411]: pgmap v29: 129 pgs: 129 active+clean; 1.3 MiB data, 354 MiB used, 1.0 TiB / 1.0 TiB avail; 6.9 KiB/s rd, 853 B/s wr, 12 op/s 2024-09-12T02:38:49.513 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 12 02:38:49 smithi172 ceph-mon[35609]: pgmap v29: 129 pgs: 129 active+clean; 1.3 MiB data, 354 MiB used, 1.0 TiB / 1.0 TiB avail; 6.9 KiB/s rd, 853 B/s wr, 12 op/s 2024-09-12T02:38:51.448 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 12 02:38:51 smithi044 ceph-mon[35411]: pgmap v30: 129 pgs: 129 active+clean; 1.3 MiB data, 354 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2024-09-12T02:38:51.514 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 12 02:38:51 smithi172 ceph-mon[35609]: pgmap v30: 129 pgs: 129 active+clean; 1.3 MiB data, 354 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2024-09-12T02:38:51.599 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 02:38:51 smithi039 ceph-mon[30515]: pgmap v30: 129 pgs: 129 active+clean; 1.3 MiB data, 354 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2024-09-12T02:38:53.448 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 12 02:38:53 smithi044 ceph-mon[35411]: pgmap v31: 129 pgs: 129 active+clean; 1.3 MiB data, 354 MiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 11 op/s 2024-09-12T02:38:53.513 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 12 02:38:53 smithi172 ceph-mon[35609]: pgmap v31: 129 pgs: 129 active+clean; 1.3 MiB data, 354 MiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 11 op/s 2024-09-12T02:38:53.599 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 02:38:53 smithi039 ceph-mon[30515]: pgmap v31: 129 pgs: 129 active+clean; 1.3 MiB data, 354 MiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 11 op/s 2024-09-12T02:38:55.448 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 12 02:38:55 smithi044 ceph-mon[35411]: pgmap v32: 129 pgs: 129 active+clean; 1.3 MiB data, 354 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2024-09-12T02:38:55.516 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 12 02:38:55 smithi172 ceph-mon[35609]: pgmap v32: 129 pgs: 129 active+clean; 1.3 MiB data, 354 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2024-09-12T02:38:55.599 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 02:38:55 smithi039 ceph-mon[30515]: pgmap v32: 129 pgs: 129 active+clean; 1.3 MiB data, 354 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2024-09-12T02:38:57.448 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 12 02:38:57 smithi044 ceph-mon[35411]: pgmap v33: 129 pgs: 129 active+clean; 1.3 MiB data, 354 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2024-09-12T02:38:57.514 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 12 02:38:57 smithi172 ceph-mon[35609]: pgmap v33: 129 pgs: 129 active+clean; 1.3 MiB data, 354 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2024-09-12T02:38:57.599 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 02:38:57 smithi039 ceph-mon[30515]: pgmap v33: 129 pgs: 129 active+clean; 1.3 MiB data, 354 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2024-09-12T02:38:59.448 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 12 02:38:59 smithi044 ceph-mon[35411]: pgmap v34: 129 pgs: 129 active+clean; 1.3 MiB data, 354 MiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2024-09-12T02:38:59.513 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 12 02:38:59 smithi172 ceph-mon[35609]: pgmap v34: 129 pgs: 129 active+clean; 1.3 MiB data, 354 MiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2024-09-12T02:38:59.599 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 02:38:59 smithi039 ceph-mon[30515]: pgmap v34: 129 pgs: 129 active+clean; 1.3 MiB data, 354 MiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2024-09-12T02:39:01.448 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 12 02:39:01 smithi044 ceph-mon[35411]: pgmap v35: 129 pgs: 129 active+clean; 1.3 MiB data, 354 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2024-09-12T02:39:01.513 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 12 02:39:01 smithi172 ceph-mon[35609]: pgmap v35: 129 pgs: 129 active+clean; 1.3 MiB data, 354 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2024-09-12T02:39:01.599 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 02:39:01 smithi039 ceph-mon[30515]: pgmap v35: 129 pgs: 129 active+clean; 1.3 MiB data, 354 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2024-09-12T02:39:02.298 INFO:tasks.workunit.client.0.smithi039.stderr:Updating files: 62% (8068/12903) Updating files: 63% (8129/12903) Updating files: 64% (8258/12903) Updating files: 65% (8387/12903) Updating files: 66% (8516/12903) Updating files: 67% (8646/12903) Updating files: 68% (8775/12903) Updating files: 69% (8904/12903) Updating files: 70% (9033/12903) Updating files: 71% (9162/12903) Updating files: 72% (9291/12903) Updating files: 73% (9420/12903) Updating files: 74% (9549/12903) Updating files: 75% (9678/12903) Updating files: 76% (9807/12903) Updating files: 77% (9936/12903) Updating files: 78% (10065/12903) Updating files: 79% (10194/12903) Updating files: 80% (10323/12903) Updating files: 81% (10452/12903) Updating files: 82% (10581/12903) Updating files: 83% (10710/12903) Updating files: 84% (10839/12903) Updating files: 85% (10968/12903) Updating files: 86% (11097/12903) Updating files: 87% (11226/12903) Updating files: 88% (11355/12903) Updating files: 89% (11484/12903) Updating files: 90% (11613/12903) Updating files: 91% (11742/12903) Updating files: 92% (11871/12903) Updating files: 93% (12000/12903) Updating files: 94% (12129/12903) Updating files: 95% (12258/12903) Updating files: 96% (12387/12903) Updating files: 97% (12516/12903) Updating files: 98% (12645/12903) Updating files: 98% (12719/12903) Updating files: 99% (12774/12903) Updating files: 100% (12903/12903) Updating files: 100% (12903/12903), done. 2024-09-12T02:39:03.090 INFO:tasks.workunit.client.0.smithi039.stderr:Note: switching to '086c737fa75c22d521a3932c59b31c5e1d1c9ef4'. 2024-09-12T02:39:03.090 INFO:tasks.workunit.client.0.smithi039.stderr: 2024-09-12T02:39:03.090 INFO:tasks.workunit.client.0.smithi039.stderr:You are in 'detached HEAD' state. You can look around, make experimental 2024-09-12T02:39:03.090 INFO:tasks.workunit.client.0.smithi039.stderr:changes and commit them, and you can discard any commits you make in this 2024-09-12T02:39:03.091 INFO:tasks.workunit.client.0.smithi039.stderr:state without impacting any branches by switching back to a branch. 2024-09-12T02:39:03.091 INFO:tasks.workunit.client.0.smithi039.stderr: 2024-09-12T02:39:03.091 INFO:tasks.workunit.client.0.smithi039.stderr:If you want to create a new branch to retain commits you create, you may 2024-09-12T02:39:03.091 INFO:tasks.workunit.client.0.smithi039.stderr:do so (now or later) by using -c with the switch command. Example: 2024-09-12T02:39:03.091 INFO:tasks.workunit.client.0.smithi039.stderr: 2024-09-12T02:39:03.091 INFO:tasks.workunit.client.0.smithi039.stderr: git switch -c 2024-09-12T02:39:03.091 INFO:tasks.workunit.client.0.smithi039.stderr: 2024-09-12T02:39:03.091 INFO:tasks.workunit.client.0.smithi039.stderr:Or undo this operation with: 2024-09-12T02:39:03.091 INFO:tasks.workunit.client.0.smithi039.stderr: 2024-09-12T02:39:03.091 INFO:tasks.workunit.client.0.smithi039.stderr: git switch - 2024-09-12T02:39:03.091 INFO:tasks.workunit.client.0.smithi039.stderr: 2024-09-12T02:39:03.091 INFO:tasks.workunit.client.0.smithi039.stderr:Turn off this advice by setting config variable advice.detachedHead to false 2024-09-12T02:39:03.092 INFO:tasks.workunit.client.0.smithi039.stderr: 2024-09-12T02:39:03.092 INFO:tasks.workunit.client.0.smithi039.stderr:HEAD is now at 086c737fa75 Merge pull request #59733 from zdover23/wip-doc-2024-09-11-backport-59635-to-squid 2024-09-12T02:39:03.106 DEBUG:teuthology.orchestra.run.smithi039:> cd -- /home/ubuntu/cephtest/clone.client.0/qa/workunits && if test -e Makefile ; then make ; fi && find -executable -type f -printf '%P\0' >/home/ubuntu/cephtest/workunits.list.client.0 2024-09-12T02:39:03.201 INFO:tasks.workunit.client.0.smithi039.stdout:for d in direct_io fs ; do ( cd $d ; make all ) ; done 2024-09-12T02:39:03.207 INFO:tasks.workunit.client.0.smithi039.stdout:make[1]: Entering directory '/home/ubuntu/cephtest/clone.client.0/qa/workunits/direct_io' 2024-09-12T02:39:03.207 INFO:tasks.workunit.client.0.smithi039.stdout:cc -Wall -Wextra -D_GNU_SOURCE direct_io_test.c -o direct_io_test 2024-09-12T02:39:03.448 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 12 02:39:03 smithi044 ceph-mon[35411]: pgmap v36: 129 pgs: 129 active+clean; 1.3 MiB data, 354 MiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 11 KiB/s wr, 24 op/s 2024-09-12T02:39:03.448 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 12 02:39:03 smithi044 ceph-mon[35411]: from='mgr.25199 172.21.15.39:0/1270637502' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-12T02:39:03.513 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 12 02:39:03 smithi172 ceph-mon[35609]: pgmap v36: 129 pgs: 129 active+clean; 1.3 MiB data, 354 MiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 11 KiB/s wr, 24 op/s 2024-09-12T02:39:03.514 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 12 02:39:03 smithi172 ceph-mon[35609]: from='mgr.25199 172.21.15.39:0/1270637502' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-12T02:39:03.599 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 02:39:03 smithi039 ceph-mon[30515]: pgmap v36: 129 pgs: 129 active+clean; 1.3 MiB data, 354 MiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 11 KiB/s wr, 24 op/s 2024-09-12T02:39:03.600 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 02:39:03 smithi039 ceph-mon[30515]: from='mgr.25199 172.21.15.39:0/1270637502' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-12T02:39:03.972 INFO:tasks.workunit.client.0.smithi039.stdout:cc -Wall -Wextra -D_GNU_SOURCE test_sync_io.c -o test_sync_io 2024-09-12T02:39:04.089 INFO:tasks.workunit.client.0.smithi039.stdout:cc -Wall -Wextra -D_GNU_SOURCE test_short_dio_read.c -o test_short_dio_read 2024-09-12T02:39:04.155 INFO:tasks.workunit.client.0.smithi039.stdout:make[1]: Leaving directory '/home/ubuntu/cephtest/clone.client.0/qa/workunits/direct_io' 2024-09-12T02:39:04.159 INFO:tasks.workunit.client.0.smithi039.stdout:make[1]: Entering directory '/home/ubuntu/cephtest/clone.client.0/qa/workunits/fs' 2024-09-12T02:39:04.159 INFO:tasks.workunit.client.0.smithi039.stdout:cc -Wall -Wextra -D_GNU_SOURCE test_o_trunc.c -o test_o_trunc 2024-09-12T02:39:04.225 INFO:tasks.workunit.client.0.smithi039.stdout:make[1]: Leaving directory '/home/ubuntu/cephtest/clone.client.0/qa/workunits/fs' 2024-09-12T02:39:04.232 DEBUG:teuthology.orchestra.run.smithi039:> set -ex 2024-09-12T02:39:04.232 DEBUG:teuthology.orchestra.run.smithi039:> dd if=/home/ubuntu/cephtest/workunits.list.client.0 of=/dev/stdout 2024-09-12T02:39:04.268 INFO:tasks.workunit:Running workunits matching fs/test_o_trunc.sh on client.0... 2024-09-12T02:39:04.270 INFO:tasks.workunit:Running workunit fs/test_o_trunc.sh... 2024-09-12T02:39:04.271 DEBUG:teuthology.orchestra.run.smithi039:workunit test fs/test_o_trunc.sh> mkdir -p -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && cd -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && CEPH_CLI_TEST_DUP_COMMAND=1 CEPH_REF=086c737fa75c22d521a3932c59b31c5e1d1c9ef4 TESTDIR="/home/ubuntu/cephtest" CEPH_ARGS="--cluster ceph" CEPH_ID="0" PATH=$PATH:/usr/sbin CEPH_BASE=/home/ubuntu/cephtest/clone.client.0 CEPH_ROOT=/home/ubuntu/cephtest/clone.client.0 CEPH_MNT=/home/ubuntu/cephtest/mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 3h /home/ubuntu/cephtest/clone.client.0/qa/workunits/fs/test_o_trunc.sh 2024-09-12T02:39:04.357 INFO:tasks.workunit.client.0.smithi039.stderr:++ dirname /home/ubuntu/cephtest/clone.client.0/qa/workunits/fs/test_o_trunc.sh 2024-09-12T02:39:04.359 INFO:tasks.workunit.client.0.smithi039.stderr:+ mydir=/home/ubuntu/cephtest/clone.client.0/qa/workunits/fs 2024-09-12T02:39:04.359 INFO:tasks.workunit.client.0.smithi039.stderr:+ /home/ubuntu/cephtest/clone.client.0/qa/workunits/fs/test_o_trunc trunc.foo 600 2024-09-12T02:39:04.448 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 12 02:39:04 smithi044 ceph-mon[35411]: from='mgr.25199 172.21.15.39:0/1270637502' entity='mgr.x' 2024-09-12T02:39:04.449 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 12 02:39:04 smithi044 ceph-mon[35411]: from='mgr.25199 172.21.15.39:0/1270637502' entity='mgr.x' 2024-09-12T02:39:04.449 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 12 02:39:04 smithi044 ceph-mon[35411]: from='mgr.25199 172.21.15.39:0/1270637502' entity='mgr.x' 2024-09-12T02:39:04.449 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 12 02:39:04 smithi044 ceph-mon[35411]: from='mgr.25199 172.21.15.39:0/1270637502' entity='mgr.x' 2024-09-12T02:39:04.449 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 12 02:39:04 smithi044 ceph-mon[35411]: from='mgr.25199 172.21.15.39:0/1270637502' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-12T02:39:04.449 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 12 02:39:04 smithi044 ceph-mon[35411]: from='mgr.25199 172.21.15.39:0/1270637502' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-12T02:39:04.449 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 12 02:39:04 smithi044 ceph-mon[35411]: from='mgr.25199 172.21.15.39:0/1270637502' entity='mgr.x' 2024-09-12T02:39:04.514 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 12 02:39:04 smithi172 ceph-mon[35609]: from='mgr.25199 172.21.15.39:0/1270637502' entity='mgr.x' 2024-09-12T02:39:04.514 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 12 02:39:04 smithi172 ceph-mon[35609]: from='mgr.25199 172.21.15.39:0/1270637502' entity='mgr.x' 2024-09-12T02:39:04.514 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 12 02:39:04 smithi172 ceph-mon[35609]: from='mgr.25199 172.21.15.39:0/1270637502' entity='mgr.x' 2024-09-12T02:39:04.514 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 12 02:39:04 smithi172 ceph-mon[35609]: from='mgr.25199 172.21.15.39:0/1270637502' entity='mgr.x' 2024-09-12T02:39:04.514 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 12 02:39:04 smithi172 ceph-mon[35609]: from='mgr.25199 172.21.15.39:0/1270637502' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-12T02:39:04.514 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 12 02:39:04 smithi172 ceph-mon[35609]: from='mgr.25199 172.21.15.39:0/1270637502' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-12T02:39:04.514 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 12 02:39:04 smithi172 ceph-mon[35609]: from='mgr.25199 172.21.15.39:0/1270637502' entity='mgr.x' 2024-09-12T02:39:04.600 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 02:39:04 smithi039 ceph-mon[30515]: from='mgr.25199 172.21.15.39:0/1270637502' entity='mgr.x' 2024-09-12T02:39:04.600 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 02:39:04 smithi039 ceph-mon[30515]: from='mgr.25199 172.21.15.39:0/1270637502' entity='mgr.x' 2024-09-12T02:39:04.600 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 02:39:04 smithi039 ceph-mon[30515]: from='mgr.25199 172.21.15.39:0/1270637502' entity='mgr.x' 2024-09-12T02:39:04.600 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 02:39:04 smithi039 ceph-mon[30515]: from='mgr.25199 172.21.15.39:0/1270637502' entity='mgr.x' 2024-09-12T02:39:04.600 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 02:39:04 smithi039 ceph-mon[30515]: from='mgr.25199 172.21.15.39:0/1270637502' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-12T02:39:04.600 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 02:39:04 smithi039 ceph-mon[30515]: from='mgr.25199 172.21.15.39:0/1270637502' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-12T02:39:04.600 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 02:39:04 smithi039 ceph-mon[30515]: from='mgr.25199 172.21.15.39:0/1270637502' entity='mgr.x' 2024-09-12T02:39:05.948 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 12 02:39:05 smithi044 ceph-mon[35411]: pgmap v37: 129 pgs: 129 active+clean; 1.3 MiB data, 354 MiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 22 KiB/s wr, 24 op/s 2024-09-12T02:39:06.013 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 12 02:39:05 smithi172 ceph-mon[35609]: pgmap v37: 129 pgs: 129 active+clean; 1.3 MiB data, 354 MiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 22 KiB/s wr, 24 op/s 2024-09-12T02:39:06.100 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 02:39:05 smithi039 ceph-mon[30515]: pgmap v37: 129 pgs: 129 active+clean; 1.3 MiB data, 354 MiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 22 KiB/s wr, 24 op/s 2024-09-12T02:39:07.948 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 12 02:39:07 smithi044 ceph-mon[35411]: pgmap v38: 129 pgs: 129 active+clean; 1.3 MiB data, 354 MiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 22 KiB/s wr, 23 op/s 2024-09-12T02:39:08.013 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 12 02:39:07 smithi172 ceph-mon[35609]: pgmap v38: 129 pgs: 129 active+clean; 1.3 MiB data, 354 MiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 22 KiB/s wr, 23 op/s 2024-09-12T02:39:08.099 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 02:39:07 smithi039 ceph-mon[30515]: pgmap v38: 129 pgs: 129 active+clean; 1.3 MiB data, 354 MiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 22 KiB/s wr, 23 op/s 2024-09-12T02:39:09.948 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 12 02:39:09 smithi044 ceph-mon[35411]: pgmap v39: 129 pgs: 129 active+clean; 1.4 MiB data, 354 MiB used, 1.0 TiB / 1.0 TiB avail; 18 KiB/s rd, 27 KiB/s wr, 28 op/s 2024-09-12T02:39:10.013 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 12 02:39:09 smithi172 ceph-mon[35609]: pgmap v39: 129 pgs: 129 active+clean; 1.4 MiB data, 354 MiB used, 1.0 TiB / 1.0 TiB avail; 18 KiB/s rd, 27 KiB/s wr, 28 op/s 2024-09-12T02:39:10.099 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 02:39:09 smithi039 ceph-mon[30515]: pgmap v39: 129 pgs: 129 active+clean; 1.4 MiB data, 354 MiB used, 1.0 TiB / 1.0 TiB avail; 18 KiB/s rd, 27 KiB/s wr, 28 op/s 2024-09-12T02:39:11.948 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 12 02:39:11 smithi044 ceph-mon[35411]: pgmap v40: 129 pgs: 129 active+clean; 1.4 MiB data, 354 MiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 27 KiB/s wr, 24 op/s 2024-09-12T02:39:12.013 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 12 02:39:11 smithi172 ceph-mon[35609]: pgmap v40: 129 pgs: 129 active+clean; 1.4 MiB data, 354 MiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 27 KiB/s wr, 24 op/s 2024-09-12T02:39:12.100 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 02:39:11 smithi039 ceph-mon[30515]: pgmap v40: 129 pgs: 129 active+clean; 1.4 MiB data, 354 MiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 27 KiB/s wr, 24 op/s 2024-09-12T02:39:13.948 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 12 02:39:13 smithi044 ceph-mon[35411]: pgmap v41: 129 pgs: 129 active+clean; 1.5 MiB data, 354 MiB used, 1.0 TiB / 1.0 TiB avail; 25 KiB/s rd, 35 KiB/s wr, 30 op/s 2024-09-12T02:39:14.013 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 12 02:39:13 smithi172 ceph-mon[35609]: pgmap v41: 129 pgs: 129 active+clean; 1.5 MiB data, 354 MiB used, 1.0 TiB / 1.0 TiB avail; 25 KiB/s rd, 35 KiB/s wr, 30 op/s 2024-09-12T02:39:14.100 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 02:39:13 smithi039 ceph-mon[30515]: pgmap v41: 129 pgs: 129 active+clean; 1.5 MiB data, 354 MiB used, 1.0 TiB / 1.0 TiB avail; 25 KiB/s rd, 35 KiB/s wr, 30 op/s 2024-09-12T02:39:15.948 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 12 02:39:15 smithi044 ceph-mon[35411]: pgmap v42: 129 pgs: 129 active+clean; 1.5 MiB data, 354 MiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 24 KiB/s wr, 14 op/s 2024-09-12T02:39:16.013 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 12 02:39:15 smithi172 ceph-mon[35609]: pgmap v42: 129 pgs: 129 active+clean; 1.5 MiB data, 354 MiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 24 KiB/s wr, 14 op/s 2024-09-12T02:39:16.100 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 02:39:15 smithi039 ceph-mon[30515]: pgmap v42: 129 pgs: 129 active+clean; 1.5 MiB data, 354 MiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 24 KiB/s wr, 14 op/s 2024-09-12T02:39:17.948 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 12 02:39:17 smithi044 ceph-mon[35411]: pgmap v43: 129 pgs: 129 active+clean; 1.5 MiB data, 354 MiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 13 KiB/s wr, 11 op/s 2024-09-12T02:39:18.013 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 12 02:39:17 smithi172 ceph-mon[35609]: pgmap v43: 129 pgs: 129 active+clean; 1.5 MiB data, 354 MiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 13 KiB/s wr, 11 op/s 2024-09-12T02:39:18.100 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 02:39:17 smithi039 ceph-mon[30515]: pgmap v43: 129 pgs: 129 active+clean; 1.5 MiB data, 354 MiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 13 KiB/s wr, 11 op/s 2024-09-12T02:39:19.948 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 12 02:39:19 smithi044 ceph-mon[35411]: pgmap v44: 129 pgs: 129 active+clean; 1.6 MiB data, 355 MiB used, 1.0 TiB / 1.0 TiB avail; 23 KiB/s rd, 21 KiB/s wr, 18 op/s 2024-09-12T02:39:20.015 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 12 02:39:19 smithi172 ceph-mon[35609]: pgmap v44: 129 pgs: 129 active+clean; 1.6 MiB data, 355 MiB used, 1.0 TiB / 1.0 TiB avail; 23 KiB/s rd, 21 KiB/s wr, 18 op/s 2024-09-12T02:39:20.100 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 02:39:19 smithi039 ceph-mon[30515]: pgmap v44: 129 pgs: 129 active+clean; 1.6 MiB data, 355 MiB used, 1.0 TiB / 1.0 TiB avail; 23 KiB/s rd, 21 KiB/s wr, 18 op/s 2024-09-12T02:39:21.948 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 12 02:39:21 smithi044 ceph-mon[35411]: pgmap v45: 129 pgs: 129 active+clean; 1.6 MiB data, 355 MiB used, 1.0 TiB / 1.0 TiB avail; 18 KiB/s rd, 16 KiB/s wr, 12 op/s 2024-09-12T02:39:22.013 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 12 02:39:21 smithi172 ceph-mon[35609]: pgmap v45: 129 pgs: 129 active+clean; 1.6 MiB data, 355 MiB used, 1.0 TiB / 1.0 TiB avail; 18 KiB/s rd, 16 KiB/s wr, 12 op/s 2024-09-12T02:39:22.100 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 02:39:21 smithi039 ceph-mon[30515]: pgmap v45: 129 pgs: 129 active+clean; 1.6 MiB data, 355 MiB used, 1.0 TiB / 1.0 TiB avail; 18 KiB/s rd, 16 KiB/s wr, 12 op/s 2024-09-12T02:39:23.948 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 12 02:39:23 smithi044 ceph-mon[35411]: pgmap v46: 129 pgs: 129 active+clean; 1.6 MiB data, 355 MiB used, 1.0 TiB / 1.0 TiB avail; 27 KiB/s rd, 24 KiB/s wr, 19 op/s 2024-09-12T02:39:24.013 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 12 02:39:23 smithi172 ceph-mon[35609]: pgmap v46: 129 pgs: 129 active+clean; 1.6 MiB data, 355 MiB used, 1.0 TiB / 1.0 TiB avail; 27 KiB/s rd, 24 KiB/s wr, 19 op/s 2024-09-12T02:39:24.100 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 02:39:23 smithi039 ceph-mon[30515]: pgmap v46: 129 pgs: 129 active+clean; 1.6 MiB data, 355 MiB used, 1.0 TiB / 1.0 TiB avail; 27 KiB/s rd, 24 KiB/s wr, 19 op/s 2024-09-12T02:39:25.948 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 12 02:39:25 smithi044 ceph-mon[35411]: pgmap v47: 129 pgs: 129 active+clean; 1.6 MiB data, 355 MiB used, 1.0 TiB / 1.0 TiB avail; 18 KiB/s rd, 16 KiB/s wr, 12 op/s 2024-09-12T02:39:26.014 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 12 02:39:25 smithi172 ceph-mon[35609]: pgmap v47: 129 pgs: 129 active+clean; 1.6 MiB data, 355 MiB used, 1.0 TiB / 1.0 TiB avail; 18 KiB/s rd, 16 KiB/s wr, 12 op/s 2024-09-12T02:39:26.099 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 02:39:25 smithi039 ceph-mon[30515]: pgmap v47: 129 pgs: 129 active+clean; 1.6 MiB data, 355 MiB used, 1.0 TiB / 1.0 TiB avail; 18 KiB/s rd, 16 KiB/s wr, 12 op/s 2024-09-12T02:39:27.948 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 12 02:39:27 smithi044 ceph-mon[35411]: pgmap v48: 129 pgs: 129 active+clean; 1.6 MiB data, 355 MiB used, 1.0 TiB / 1.0 TiB avail; 18 KiB/s rd, 16 KiB/s wr, 12 op/s 2024-09-12T02:39:28.013 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 12 02:39:27 smithi172 ceph-mon[35609]: pgmap v48: 129 pgs: 129 active+clean; 1.6 MiB data, 355 MiB used, 1.0 TiB / 1.0 TiB avail; 18 KiB/s rd, 16 KiB/s wr, 12 op/s 2024-09-12T02:39:28.099 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 02:39:27 smithi039 ceph-mon[30515]: pgmap v48: 129 pgs: 129 active+clean; 1.6 MiB data, 355 MiB used, 1.0 TiB / 1.0 TiB avail; 18 KiB/s rd, 16 KiB/s wr, 12 op/s 2024-09-12T02:39:29.948 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 12 02:39:29 smithi044 ceph-mon[35411]: pgmap v49: 129 pgs: 129 active+clean; 1.7 MiB data, 355 MiB used, 1.0 TiB / 1.0 TiB avail; 28 KiB/s rd, 26 KiB/s wr, 20 op/s 2024-09-12T02:39:29.949 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 12 02:39:29 smithi044 ceph-mon[35411]: mgrmap e27: x(active, since 92s), standbys: y, z 2024-09-12T02:39:30.013 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 12 02:39:29 smithi172 ceph-mon[35609]: pgmap v49: 129 pgs: 129 active+clean; 1.7 MiB data, 355 MiB used, 1.0 TiB / 1.0 TiB avail; 28 KiB/s rd, 26 KiB/s wr, 20 op/s 2024-09-12T02:39:30.013 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 12 02:39:29 smithi172 ceph-mon[35609]: mgrmap e27: x(active, since 92s), standbys: y, z 2024-09-12T02:39:30.100 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 02:39:29 smithi039 ceph-mon[30515]: pgmap v49: 129 pgs: 129 active+clean; 1.7 MiB data, 355 MiB used, 1.0 TiB / 1.0 TiB avail; 28 KiB/s rd, 26 KiB/s wr, 20 op/s 2024-09-12T02:39:30.100 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 02:39:29 smithi039 ceph-mon[30515]: mgrmap e27: x(active, since 92s), standbys: y, z 2024-09-12T02:39:32.013 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 12 02:39:31 smithi172 ceph-mon[35609]: pgmap v50: 129 pgs: 129 active+clean; 1.7 MiB data, 355 MiB used, 1.0 TiB / 1.0 TiB avail; 19 KiB/s rd, 18 KiB/s wr, 14 op/s 2024-09-12T02:39:32.100 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 02:39:31 smithi039 ceph-mon[30515]: pgmap v50: 129 pgs: 129 active+clean; 1.7 MiB data, 355 MiB used, 1.0 TiB / 1.0 TiB avail; 19 KiB/s rd, 18 KiB/s wr, 14 op/s 2024-09-12T02:39:32.198 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 12 02:39:31 smithi044 ceph-mon[35411]: pgmap v50: 129 pgs: 129 active+clean; 1.7 MiB data, 355 MiB used, 1.0 TiB / 1.0 TiB avail; 19 KiB/s rd, 18 KiB/s wr, 14 op/s 2024-09-12T02:39:34.013 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 12 02:39:33 smithi172 ceph-mon[35609]: pgmap v51: 129 pgs: 129 active+clean; 1.8 MiB data, 355 MiB used, 1.0 TiB / 1.0 TiB avail; 29 KiB/s rd, 26 KiB/s wr, 20 op/s 2024-09-12T02:39:34.099 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 02:39:33 smithi039 ceph-mon[30515]: pgmap v51: 129 pgs: 129 active+clean; 1.8 MiB data, 355 MiB used, 1.0 TiB / 1.0 TiB avail; 29 KiB/s rd, 26 KiB/s wr, 20 op/s 2024-09-12T02:39:34.198 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 12 02:39:33 smithi044 ceph-mon[35411]: pgmap v51: 129 pgs: 129 active+clean; 1.8 MiB data, 355 MiB used, 1.0 TiB / 1.0 TiB avail; 29 KiB/s rd, 26 KiB/s wr, 20 op/s 2024-09-12T02:39:36.013 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 12 02:39:35 smithi172 ceph-mon[35609]: pgmap v52: 129 pgs: 129 active+clean; 1.8 MiB data, 355 MiB used, 1.0 TiB / 1.0 TiB avail; 20 KiB/s rd, 18 KiB/s wr, 14 op/s 2024-09-12T02:39:36.099 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 02:39:35 smithi039 ceph-mon[30515]: pgmap v52: 129 pgs: 129 active+clean; 1.8 MiB data, 355 MiB used, 1.0 TiB / 1.0 TiB avail; 20 KiB/s rd, 18 KiB/s wr, 14 op/s 2024-09-12T02:39:36.198 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 12 02:39:35 smithi044 ceph-mon[35411]: pgmap v52: 129 pgs: 129 active+clean; 1.8 MiB data, 355 MiB used, 1.0 TiB / 1.0 TiB avail; 20 KiB/s rd, 18 KiB/s wr, 14 op/s 2024-09-12T02:39:38.013 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 12 02:39:37 smithi172 ceph-mon[35609]: pgmap v53: 129 pgs: 129 active+clean; 1.8 MiB data, 355 MiB used, 1.0 TiB / 1.0 TiB avail; 20 KiB/s rd, 18 KiB/s wr, 14 op/s 2024-09-12T02:39:38.099 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 02:39:37 smithi039 ceph-mon[30515]: pgmap v53: 129 pgs: 129 active+clean; 1.8 MiB data, 355 MiB used, 1.0 TiB / 1.0 TiB avail; 20 KiB/s rd, 18 KiB/s wr, 14 op/s 2024-09-12T02:39:38.198 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 12 02:39:37 smithi044 ceph-mon[35411]: pgmap v53: 129 pgs: 129 active+clean; 1.8 MiB data, 355 MiB used, 1.0 TiB / 1.0 TiB avail; 20 KiB/s rd, 18 KiB/s wr, 14 op/s 2024-09-12T02:39:40.013 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 12 02:39:39 smithi172 ceph-mon[35609]: pgmap v54: 129 pgs: 129 active+clean; 1.9 MiB data, 356 MiB used, 1.0 TiB / 1.0 TiB avail; 29 KiB/s rd, 27 KiB/s wr, 21 op/s 2024-09-12T02:39:40.099 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 02:39:39 smithi039 ceph-mon[30515]: pgmap v54: 129 pgs: 129 active+clean; 1.9 MiB data, 356 MiB used, 1.0 TiB / 1.0 TiB avail; 29 KiB/s rd, 27 KiB/s wr, 21 op/s 2024-09-12T02:39:40.198 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 12 02:39:39 smithi044 ceph-mon[35411]: pgmap v54: 129 pgs: 129 active+clean; 1.9 MiB data, 356 MiB used, 1.0 TiB / 1.0 TiB avail; 29 KiB/s rd, 27 KiB/s wr, 21 op/s 2024-09-12T02:39:42.013 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 12 02:39:41 smithi172 ceph-mon[35609]: pgmap v55: 129 pgs: 129 active+clean; 1.9 MiB data, 356 MiB used, 1.0 TiB / 1.0 TiB avail; 19 KiB/s rd, 17 KiB/s wr, 13 op/s 2024-09-12T02:39:42.099 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 02:39:41 smithi039 ceph-mon[30515]: pgmap v55: 129 pgs: 129 active+clean; 1.9 MiB data, 356 MiB used, 1.0 TiB / 1.0 TiB avail; 19 KiB/s rd, 17 KiB/s wr, 13 op/s 2024-09-12T02:39:42.198 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 12 02:39:41 smithi044 ceph-mon[35411]: pgmap v55: 129 pgs: 129 active+clean; 1.9 MiB data, 356 MiB used, 1.0 TiB / 1.0 TiB avail; 19 KiB/s rd, 17 KiB/s wr, 13 op/s 2024-09-12T02:39:44.013 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 12 02:39:43 smithi172 ceph-mon[35609]: pgmap v56: 129 pgs: 129 active+clean; 2.0 MiB data, 356 MiB used, 1.0 TiB / 1.0 TiB avail; 28 KiB/s rd, 25 KiB/s wr, 19 op/s 2024-09-12T02:39:44.099 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 02:39:43 smithi039 ceph-mon[30515]: pgmap v56: 129 pgs: 129 active+clean; 2.0 MiB data, 356 MiB used, 1.0 TiB / 1.0 TiB avail; 28 KiB/s rd, 25 KiB/s wr, 19 op/s 2024-09-12T02:39:44.198 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 12 02:39:43 smithi044 ceph-mon[35411]: pgmap v56: 129 pgs: 129 active+clean; 2.0 MiB data, 356 MiB used, 1.0 TiB / 1.0 TiB avail; 28 KiB/s rd, 25 KiB/s wr, 19 op/s 2024-09-12T02:39:46.013 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 12 02:39:45 smithi172 ceph-mon[35609]: pgmap v57: 129 pgs: 129 active+clean; 2.0 MiB data, 356 MiB used, 1.0 TiB / 1.0 TiB avail; 19 KiB/s rd, 17 KiB/s wr, 13 op/s 2024-09-12T02:39:46.100 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 02:39:45 smithi039 ceph-mon[30515]: pgmap v57: 129 pgs: 129 active+clean; 2.0 MiB data, 356 MiB used, 1.0 TiB / 1.0 TiB avail; 19 KiB/s rd, 17 KiB/s wr, 13 op/s 2024-09-12T02:39:46.198 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 12 02:39:45 smithi044 ceph-mon[35411]: pgmap v57: 129 pgs: 129 active+clean; 2.0 MiB data, 356 MiB used, 1.0 TiB / 1.0 TiB avail; 19 KiB/s rd, 17 KiB/s wr, 13 op/s 2024-09-12T02:39:48.013 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 12 02:39:47 smithi172 ceph-mon[35609]: pgmap v58: 129 pgs: 129 active+clean; 2.0 MiB data, 356 MiB used, 1.0 TiB / 1.0 TiB avail; 19 KiB/s rd, 17 KiB/s wr, 13 op/s 2024-09-12T02:39:48.100 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 02:39:47 smithi039 ceph-mon[30515]: pgmap v58: 129 pgs: 129 active+clean; 2.0 MiB data, 356 MiB used, 1.0 TiB / 1.0 TiB avail; 19 KiB/s rd, 17 KiB/s wr, 13 op/s 2024-09-12T02:39:48.198 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 12 02:39:47 smithi044 ceph-mon[35411]: pgmap v58: 129 pgs: 129 active+clean; 2.0 MiB data, 356 MiB used, 1.0 TiB / 1.0 TiB avail; 19 KiB/s rd, 17 KiB/s wr, 13 op/s 2024-09-12T02:39:50.013 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 12 02:39:49 smithi172 ceph-mon[35609]: pgmap v59: 129 pgs: 129 active+clean; 2.1 MiB data, 360 MiB used, 1.0 TiB / 1.0 TiB avail; 29 KiB/s rd, 26 KiB/s wr, 19 op/s 2024-09-12T02:39:50.100 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 02:39:49 smithi039 ceph-mon[30515]: pgmap v59: 129 pgs: 129 active+clean; 2.1 MiB data, 360 MiB used, 1.0 TiB / 1.0 TiB avail; 29 KiB/s rd, 26 KiB/s wr, 19 op/s 2024-09-12T02:39:50.198 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 12 02:39:49 smithi044 ceph-mon[35411]: pgmap v59: 129 pgs: 129 active+clean; 2.1 MiB data, 360 MiB used, 1.0 TiB / 1.0 TiB avail; 29 KiB/s rd, 26 KiB/s wr, 19 op/s 2024-09-12T02:39:52.099 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 02:39:51 smithi039 ceph-mon[30515]: pgmap v60: 129 pgs: 129 active+clean; 2.1 MiB data, 360 MiB used, 1.0 TiB / 1.0 TiB avail; 19 KiB/s rd, 17 KiB/s wr, 13 op/s 2024-09-12T02:39:52.198 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 12 02:39:51 smithi044 ceph-mon[35411]: pgmap v60: 129 pgs: 129 active+clean; 2.1 MiB data, 360 MiB used, 1.0 TiB / 1.0 TiB avail; 19 KiB/s rd, 17 KiB/s wr, 13 op/s 2024-09-12T02:39:52.263 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 12 02:39:51 smithi172 ceph-mon[35609]: pgmap v60: 129 pgs: 129 active+clean; 2.1 MiB data, 360 MiB used, 1.0 TiB / 1.0 TiB avail; 19 KiB/s rd, 17 KiB/s wr, 13 op/s 2024-09-12T02:39:54.099 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 02:39:53 smithi039 ceph-mon[30515]: pgmap v61: 129 pgs: 129 active+clean; 2.1 MiB data, 360 MiB used, 1.0 TiB / 1.0 TiB avail; 29 KiB/s rd, 26 KiB/s wr, 19 op/s 2024-09-12T02:39:54.198 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 12 02:39:53 smithi044 ceph-mon[35411]: pgmap v61: 129 pgs: 129 active+clean; 2.1 MiB data, 360 MiB used, 1.0 TiB / 1.0 TiB avail; 29 KiB/s rd, 26 KiB/s wr, 19 op/s 2024-09-12T02:39:54.263 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 12 02:39:53 smithi172 ceph-mon[35609]: pgmap v61: 129 pgs: 129 active+clean; 2.1 MiB data, 360 MiB used, 1.0 TiB / 1.0 TiB avail; 29 KiB/s rd, 26 KiB/s wr, 19 op/s 2024-09-12T02:39:55.100 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 02:39:54 smithi039 ceph-mon[30515]: pgmap v62: 129 pgs: 129 active+clean; 2.1 MiB data, 360 MiB used, 1.0 TiB / 1.0 TiB avail; 19 KiB/s rd, 17 KiB/s wr, 13 op/s 2024-09-12T02:39:55.165 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 12 02:39:54 smithi172 ceph-mon[35609]: pgmap v62: 129 pgs: 129 active+clean; 2.1 MiB data, 360 MiB used, 1.0 TiB / 1.0 TiB avail; 19 KiB/s rd, 17 KiB/s wr, 13 op/s 2024-09-12T02:39:55.198 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 12 02:39:54 smithi044 ceph-mon[35411]: pgmap v62: 129 pgs: 129 active+clean; 2.1 MiB data, 360 MiB used, 1.0 TiB / 1.0 TiB avail; 19 KiB/s rd, 17 KiB/s wr, 13 op/s 2024-09-12T02:39:57.350 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 02:39:57 smithi039 ceph-mon[30515]: pgmap v63: 129 pgs: 129 active+clean; 2.1 MiB data, 360 MiB used, 1.0 TiB / 1.0 TiB avail; 19 KiB/s rd, 17 KiB/s wr, 13 op/s 2024-09-12T02:39:57.448 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 12 02:39:57 smithi044 ceph-mon[35411]: pgmap v63: 129 pgs: 129 active+clean; 2.1 MiB data, 360 MiB used, 1.0 TiB / 1.0 TiB avail; 19 KiB/s rd, 17 KiB/s wr, 13 op/s 2024-09-12T02:39:57.513 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 12 02:39:57 smithi172 ceph-mon[35609]: pgmap v63: 129 pgs: 129 active+clean; 2.1 MiB data, 360 MiB used, 1.0 TiB / 1.0 TiB avail; 19 KiB/s rd, 17 KiB/s wr, 13 op/s 2024-09-12T02:39:59.350 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 02:39:59 smithi039 ceph-mon[30515]: pgmap v64: 129 pgs: 129 active+clean; 2.2 MiB data, 361 MiB used, 1.0 TiB / 1.0 TiB avail; 29 KiB/s rd, 26 KiB/s wr, 19 op/s 2024-09-12T02:39:59.448 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 12 02:39:59 smithi044 ceph-mon[35411]: pgmap v64: 129 pgs: 129 active+clean; 2.2 MiB data, 361 MiB used, 1.0 TiB / 1.0 TiB avail; 29 KiB/s rd, 26 KiB/s wr, 19 op/s 2024-09-12T02:39:59.513 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 12 02:39:59 smithi172 ceph-mon[35609]: pgmap v64: 129 pgs: 129 active+clean; 2.2 MiB data, 361 MiB used, 1.0 TiB / 1.0 TiB avail; 29 KiB/s rd, 26 KiB/s wr, 19 op/s 2024-09-12T02:40:00.350 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 02:40:00 smithi039 ceph-mon[30515]: overall HEALTH_OK 2024-09-12T02:40:00.448 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 12 02:40:00 smithi044 ceph-mon[35411]: overall HEALTH_OK 2024-09-12T02:40:00.513 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 12 02:40:00 smithi172 ceph-mon[35609]: overall HEALTH_OK 2024-09-12T02:40:01.349 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 12 02:40:01 smithi044 ceph-mon[35411]: pgmap v65: 129 pgs: 129 active+clean; 2.2 MiB data, 361 MiB used, 1.0 TiB / 1.0 TiB avail; 19 KiB/s rd, 17 KiB/s wr, 13 op/s 2024-09-12T02:40:01.350 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 02:40:01 smithi039 ceph-mon[30515]: pgmap v65: 129 pgs: 129 active+clean; 2.2 MiB data, 361 MiB used, 1.0 TiB / 1.0 TiB avail; 19 KiB/s rd, 17 KiB/s wr, 13 op/s 2024-09-12T02:40:01.514 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 12 02:40:01 smithi172 ceph-mon[35609]: pgmap v65: 129 pgs: 129 active+clean; 2.2 MiB data, 361 MiB used, 1.0 TiB / 1.0 TiB avail; 19 KiB/s rd, 17 KiB/s wr, 13 op/s 2024-09-12T02:40:03.350 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 02:40:03 smithi039 ceph-mon[30515]: pgmap v66: 129 pgs: 129 active+clean; 2.3 MiB data, 361 MiB used, 1.0 TiB / 1.0 TiB avail; 38 KiB/s rd, 48 KiB/s wr, 34 op/s 2024-09-12T02:40:03.448 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 12 02:40:03 smithi044 ceph-mon[35411]: pgmap v66: 129 pgs: 129 active+clean; 2.3 MiB data, 361 MiB used, 1.0 TiB / 1.0 TiB avail; 38 KiB/s rd, 48 KiB/s wr, 34 op/s 2024-09-12T02:40:03.513 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 12 02:40:03 smithi172 ceph-mon[35609]: pgmap v66: 129 pgs: 129 active+clean; 2.3 MiB data, 361 MiB used, 1.0 TiB / 1.0 TiB avail; 38 KiB/s rd, 48 KiB/s wr, 34 op/s 2024-09-12T02:40:04.349 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 02:40:04 smithi039 ceph-mon[30515]: from='mgr.25199 172.21.15.39:0/1270637502' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-12T02:40:04.448 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 12 02:40:04 smithi044 ceph-mon[35411]: from='mgr.25199 172.21.15.39:0/1270637502' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-12T02:40:04.513 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 12 02:40:04 smithi172 ceph-mon[35609]: from='mgr.25199 172.21.15.39:0/1270637502' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-12T02:40:05.350 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 02:40:05 smithi039 ceph-mon[30515]: pgmap v67: 129 pgs: 129 active+clean; 2.3 MiB data, 361 MiB used, 1.0 TiB / 1.0 TiB avail; 29 KiB/s rd, 39 KiB/s wr, 27 op/s 2024-09-12T02:40:05.350 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 02:40:05 smithi039 ceph-mon[30515]: from='mgr.25199 172.21.15.39:0/1270637502' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-12T02:40:05.350 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 02:40:05 smithi039 ceph-mon[30515]: from='mgr.25199 172.21.15.39:0/1270637502' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-12T02:40:05.350 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 02:40:05 smithi039 ceph-mon[30515]: from='mgr.25199 172.21.15.39:0/1270637502' entity='mgr.x' 2024-09-12T02:40:05.449 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 12 02:40:05 smithi044 ceph-mon[35411]: pgmap v67: 129 pgs: 129 active+clean; 2.3 MiB data, 361 MiB used, 1.0 TiB / 1.0 TiB avail; 29 KiB/s rd, 39 KiB/s wr, 27 op/s 2024-09-12T02:40:05.449 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 12 02:40:05 smithi044 ceph-mon[35411]: from='mgr.25199 172.21.15.39:0/1270637502' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-12T02:40:05.449 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 12 02:40:05 smithi044 ceph-mon[35411]: from='mgr.25199 172.21.15.39:0/1270637502' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-12T02:40:05.449 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 12 02:40:05 smithi044 ceph-mon[35411]: from='mgr.25199 172.21.15.39:0/1270637502' entity='mgr.x' 2024-09-12T02:40:05.513 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 12 02:40:05 smithi172 ceph-mon[35609]: pgmap v67: 129 pgs: 129 active+clean; 2.3 MiB data, 361 MiB used, 1.0 TiB / 1.0 TiB avail; 29 KiB/s rd, 39 KiB/s wr, 27 op/s 2024-09-12T02:40:05.514 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 12 02:40:05 smithi172 ceph-mon[35609]: from='mgr.25199 172.21.15.39:0/1270637502' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-12T02:40:05.514 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 12 02:40:05 smithi172 ceph-mon[35609]: from='mgr.25199 172.21.15.39:0/1270637502' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-12T02:40:05.514 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 12 02:40:05 smithi172 ceph-mon[35609]: from='mgr.25199 172.21.15.39:0/1270637502' entity='mgr.x' 2024-09-12T02:40:07.350 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 02:40:07 smithi039 ceph-mon[30515]: pgmap v68: 129 pgs: 129 active+clean; 2.3 MiB data, 361 MiB used, 1.0 TiB / 1.0 TiB avail; 29 KiB/s rd, 39 KiB/s wr, 27 op/s 2024-09-12T02:40:07.448 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 12 02:40:07 smithi044 ceph-mon[35411]: pgmap v68: 129 pgs: 129 active+clean; 2.3 MiB data, 361 MiB used, 1.0 TiB / 1.0 TiB avail; 29 KiB/s rd, 39 KiB/s wr, 27 op/s 2024-09-12T02:40:07.513 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 12 02:40:07 smithi172 ceph-mon[35609]: pgmap v68: 129 pgs: 129 active+clean; 2.3 MiB data, 361 MiB used, 1.0 TiB / 1.0 TiB avail; 29 KiB/s rd, 39 KiB/s wr, 27 op/s 2024-09-12T02:40:07.839 INFO:tasks.workunit.client.0.smithi039.stdout:1/600: open fd = 3 2024-09-12T02:40:07.840 INFO:tasks.workunit.client.0.smithi039.stdout:write ret = 32 2024-09-12T02:40:07.840 INFO:tasks.workunit.client.0.smithi039.stdout:write ret = 32 2024-09-12T02:40:07.840 INFO:tasks.workunit.client.0.smithi039.stdout:pread ret = 64 2024-09-12T02:40:07.840 INFO:tasks.workunit.client.0.smithi039.stdout:2/600: open fd = 3 2024-09-12T02:40:07.840 INFO:tasks.workunit.client.0.smithi039.stdout:write ret = 32 2024-09-12T02:40:07.840 INFO:tasks.workunit.client.0.smithi039.stdout:write ret = 32 2024-09-12T02:40:07.840 INFO:tasks.workunit.client.0.smithi039.stdout:pread ret = 64 2024-09-12T02:40:07.840 INFO:tasks.workunit.client.0.smithi039.stdout:3/600: open fd = 3 2024-09-12T02:40:07.840 INFO:tasks.workunit.client.0.smithi039.stdout:write ret = 32 2024-09-12T02:40:07.840 INFO:tasks.workunit.client.0.smithi039.stdout:write ret = 32 2024-09-12T02:40:07.841 INFO:tasks.workunit.client.0.smithi039.stdout:pread ret = 64 2024-09-12T02:40:07.841 INFO:tasks.workunit.client.0.smithi039.stdout:4/600: open fd = 3 2024-09-12T02:40:07.841 INFO:tasks.workunit.client.0.smithi039.stdout:write ret = 32 2024-09-12T02:40:07.841 INFO:tasks.workunit.client.0.smithi039.stdout:write ret = 32 2024-09-12T02:40:07.841 INFO:tasks.workunit.client.0.smithi039.stdout:pread ret = 64 2024-09-12T02:40:07.841 INFO:tasks.workunit.client.0.smithi039.stdout:5/600: open fd = 3 2024-09-12T02:40:07.841 INFO:tasks.workunit.client.0.smithi039.stdout:write ret = 32 2024-09-12T02:40:07.841 INFO:tasks.workunit.client.0.smithi039.stdout:write ret = 32 2024-09-12T02:40:07.841 INFO:tasks.workunit.client.0.smithi039.stdout:pread ret = 64 2024-09-12T02:40:07.841 INFO:tasks.workunit.client.0.smithi039.stdout:6/600: open fd = 3 2024-09-12T02:40:07.841 INFO:tasks.workunit.client.0.smithi039.stdout:write ret = 32 2024-09-12T02:40:07.841 INFO:tasks.workunit.client.0.smithi039.stdout:write ret = 32 2024-09-12T02:40:07.841 INFO:tasks.workunit.client.0.smithi039.stdout:pread ret = 64 2024-09-12T02:40:07.842 INFO:tasks.workunit.client.0.smithi039.stdout:7/600: open fd = 3 2024-09-12T02:40:07.842 INFO:tasks.workunit.client.0.smithi039.stdout:write ret = 32 2024-09-12T02:40:07.842 INFO:tasks.workunit.client.0.smithi039.stdout:write ret = 32 2024-09-12T02:40:07.842 INFO:tasks.workunit.client.0.smithi039.stdout:pread ret = 64 2024-09-12T02:40:07.842 INFO:tasks.workunit.client.0.smithi039.stdout:8/600: open fd = 3 2024-09-12T02:40:07.842 INFO:tasks.workunit.client.0.smithi039.stdout:write ret = 32 2024-09-12T02:40:07.842 INFO:tasks.workunit.client.0.smithi039.stdout:write ret = 32 2024-09-12T02:40:07.842 INFO:tasks.workunit.client.0.smithi039.stdout:pread ret = 64 2024-09-12T02:40:07.842 INFO:tasks.workunit.client.0.smithi039.stdout:9/600: open fd = 3 2024-09-12T02:40:07.842 INFO:tasks.workunit.client.0.smithi039.stdout:write ret = 32 2024-09-12T02:40:07.842 INFO:tasks.workunit.client.0.smithi039.stdout:write ret = 32 2024-09-12T02:40:07.842 INFO:tasks.workunit.client.0.smithi039.stdout:pread ret = 64 2024-09-12T02:40:07.842 INFO:tasks.workunit.client.0.smithi039.stdout:10/600: open fd = 3 2024-09-12T02:40:07.842 INFO:tasks.workunit.client.0.smithi039.stdout:write ret = 32 2024-09-12T02:40:07.843 INFO:tasks.workunit.client.0.smithi039.stdout:write ret = 32 2024-09-12T02:40:07.843 INFO:tasks.workunit.client.0.smithi039.stdout:pread ret = 64 2024-09-12T02:40:07.843 INFO:tasks.workunit.client.0.smithi039.stdout:11/600: open fd = 3 2024-09-12T02:40:07.843 INFO:tasks.workunit.client.0.smithi039.stdout:write ret = 32 2024-09-12T02:40:07.843 INFO:tasks.workunit.client.0.smithi039.stdout:write ret = 32 2024-09-12T02:40:07.843 INFO:tasks.workunit.client.0.smithi039.stdout:pread ret = 64 2024-09-12T02:40:07.843 INFO:tasks.workunit.client.0.smithi039.stdout:12/600: open fd = 3 2024-09-12T02:40:07.843 INFO:tasks.workunit.client.0.smithi039.stdout:write ret = 32 2024-09-12T02:40:07.843 INFO:tasks.workunit.client.0.smithi039.stdout:write ret = 32 2024-09-12T02:40:07.843 INFO:tasks.workunit.client.0.smithi039.stdout:pread ret = 64 2024-09-12T02:40:07.843 INFO:tasks.workunit.client.0.smithi039.stdout:13/600: open fd = 3 2024-09-12T02:40:07.843 INFO:tasks.workunit.client.0.smithi039.stdout:write ret = 32 2024-09-12T02:40:07.843 INFO:tasks.workunit.client.0.smithi039.stdout:write ret = 32 2024-09-12T02:40:07.843 INFO:tasks.workunit.client.0.smithi039.stdout:pread ret = 64 2024-09-12T02:40:07.844 INFO:tasks.workunit.client.0.smithi039.stdout:14/600: open fd = 3 2024-09-12T02:40:07.844 INFO:tasks.workunit.client.0.smithi039.stdout:write ret = 32 2024-09-12T02:40:07.844 INFO:tasks.workunit.client.0.smithi039.stdout:write ret = 32 2024-09-12T02:40:07.844 INFO:tasks.workunit.client.0.smithi039.stdout:pread ret = 64 2024-09-12T02:40:07.844 INFO:tasks.workunit.client.0.smithi039.stdout:15/600: open fd = 3 2024-09-12T02:40:07.844 INFO:tasks.workunit.client.0.smithi039.stdout:write ret = 32 2024-09-12T02:40:07.844 INFO:tasks.workunit.client.0.smithi039.stdout:write ret = 32 2024-09-12T02:40:07.844 INFO:tasks.workunit.client.0.smithi039.stdout:pread ret = 64 2024-09-12T02:40:07.844 INFO:tasks.workunit.client.0.smithi039.stdout:16/600: open fd = 3 2024-09-12T02:40:07.844 INFO:tasks.workunit.client.0.smithi039.stdout:write ret = 32 2024-09-12T02:40:07.844 INFO:tasks.workunit.client.0.smithi039.stdout:write ret = 32 2024-09-12T02:40:07.844 INFO:tasks.workunit.client.0.smithi039.stdout:pread ret = 64 2024-09-12T02:40:07.844 INFO:tasks.workunit.client.0.smithi039.stdout:17/600: open fd = 3 2024-09-12T02:40:07.844 INFO:tasks.workunit.client.0.smithi039.stdout:write ret = 32 2024-09-12T02:40:07.845 INFO:tasks.workunit.client.0.smithi039.stdout:write ret = 32 2024-09-12T02:40:07.845 INFO:tasks.workunit.client.0.smithi039.stdout:pread ret = 64 2024-09-12T02:40:07.845 INFO:tasks.workunit.client.0.smithi039.stdout:18/600: open fd = 3 2024-09-12T02:40:07.845 INFO:tasks.workunit.client.0.smithi039.stdout:write ret = 32 2024-09-12T02:40:07.845 INFO:tasks.workunit.client.0.smithi039.stdout:write ret = 32 2024-09-12T02:40:07.845 INFO:tasks.workunit.client.0.smithi039.stdout:pread ret = 64 2024-09-12T02:40:07.845 INFO:tasks.workunit.client.0.smithi039.stdout:19/600: open fd = 3 2024-09-12T02:40:07.845 INFO:tasks.workunit.client.0.smithi039.stdout:write ret = 32 2024-09-12T02:40:07.845 INFO:tasks.workunit.client.0.smithi039.stdout:write ret = 32 2024-09-12T02:40:07.845 INFO:tasks.workunit.client.0.smithi039.stdout:pread ret = 64 2024-09-12T02:40:07.845 INFO:tasks.workunit.client.0.smithi039.stdout:20/600: open fd = 3 2024-09-12T02:40:07.845 INFO:tasks.workunit.client.0.smithi039.stdout:write ret = 32 2024-09-12T02:40:07.846 INFO:tasks.workunit.client.0.smithi039.stdout:write ret = 32 2024-09-12T02:40:07.846 INFO:tasks.workunit.client.0.smithi039.stdout:pread ret = 64 2024-09-12T02:40:07.846 INFO:tasks.workunit.client.0.smithi039.stdout:21/600: open fd = 3 2024-09-12T02:40:07.846 INFO:tasks.workunit.client.0.smithi039.stdout:write ret = 32 2024-09-12T02:40:07.846 INFO:tasks.workunit.client.0.smithi039.stdout:write ret = 32 2024-09-12T02:40:07.846 INFO:tasks.workunit.client.0.smithi039.stdout:pread ret = 64 2024-09-12T02:40:07.846 INFO:tasks.workunit.client.0.smithi039.stdout:22/600: open fd = 3 2024-09-12T02:40:07.846 INFO:tasks.workunit.client.0.smithi039.stdout:write ret = 32 2024-09-12T02:40:07.846 INFO:tasks.workunit.client.0.smithi039.stdout:write ret = 32 2024-09-12T02:40:07.846 INFO:tasks.workunit.client.0.smithi039.stdout:pread ret = 64 2024-09-12T02:40:07.846 INFO:tasks.workunit.client.0.smithi039.stdout:23/600: open fd = 3 2024-09-12T02:40:07.846 INFO:tasks.workunit.client.0.smithi039.stdout:write ret = 32 2024-09-12T02:40:07.846 INFO:tasks.workunit.client.0.smithi039.stdout:write ret = 32 2024-09-12T02:40:07.847 INFO:tasks.workunit.client.0.smithi039.stdout:pread ret = 64 2024-09-12T02:40:07.847 INFO:tasks.workunit.client.0.smithi039.stdout:24/600: open fd = 3 2024-09-12T02:40:07.847 INFO:tasks.workunit.client.0.smithi039.stdout:write ret = 32 2024-09-12T02:40:07.847 INFO:tasks.workunit.client.0.smithi039.stdout:write ret = 32 2024-09-12T02:40:07.847 INFO:tasks.workunit.client.0.smithi039.stdout:pread ret = 64 2024-09-12T02:40:07.847 INFO:tasks.workunit.client.0.smithi039.stdout:25/600: open fd = 3 2024-09-12T02:40:07.847 INFO:tasks.workunit.client.0.smithi039.stdout:write ret = 32 2024-09-12T02:40:07.847 INFO:tasks.workunit.client.0.smithi039.stdout:write ret = 32 2024-09-12T02:40:07.847 INFO:tasks.workunit.client.0.smithi039.stdout:pread ret = 64 2024-09-12T02:40:07.847 INFO:tasks.workunit.client.0.smithi039.stdout:26/600: open fd = 3 2024-09-12T02:40:07.847 INFO:tasks.workunit.client.0.smithi039.stdout:write ret = 32 2024-09-12T02:40:07.847 INFO:tasks.workunit.client.0.smithi039.stdout:write ret = 32 2024-09-12T02:40:07.847 INFO:tasks.workunit.client.0.smithi039.stdout:pread ret = 64 2024-09-12T02:40:07.847 INFO:tasks.workunit.client.0.smithi039.stdout:27/600: open fd = 3 2024-09-12T02:40:07.848 INFO:tasks.workunit.client.0.smithi039.stdout:write ret = 32 2024-09-12T02:40:07.848 INFO:tasks.workunit.client.0.smithi039.stdout:write ret = 32 2024-09-12T02:40:07.848 INFO:tasks.workunit.client.0.smithi039.stdout:pread ret = 64 2024-09-12T02:40:07.848 INFO:tasks.workunit.client.0.smithi039.stdout:28/600: open fd = 3 2024-09-12T02:40:07.848 INFO:tasks.workunit.client.0.smithi039.stdout:write ret = 32 2024-09-12T02:40:07.848 INFO:tasks.workunit.client.0.smithi039.stdout:write ret = 32 2024-09-12T02:40:07.848 INFO:tasks.workunit.client.0.smithi039.stdout:pread ret = 64 2024-09-12T02:40:07.848 INFO:tasks.workunit.client.0.smithi039.stdout:29/600: open fd = 3 2024-09-12T02:40:07.848 INFO:tasks.workunit.client.0.smithi039.stdout:write ret = 32 2024-09-12T02:40:07.848 INFO:tasks.workunit.client.0.smithi039.stdout:write ret = 32 2024-09-12T02:40:07.848 INFO:tasks.workunit.client.0.smithi039.stdout:pread ret = 64 2024-09-12T02:40:07.848 INFO:tasks.workunit.client.0.smithi039.stdout:30/600: open fd = 3 2024-09-12T02:40:07.848 INFO:tasks.workunit.client.0.smithi039.stdout:write ret = 32 2024-09-12T02:40:07.849 INFO:tasks.workunit.client.0.smithi039.stdout:write ret = 32 2024-09-12T02:40:07.849 INFO:tasks.workunit.client.0.smithi039.stdout:pread ret = 64 2024-09-12T02:40:07.849 INFO:tasks.workunit.client.0.smithi039.stdout:31/600: open fd = 3 2024-09-12T02:40:07.849 INFO:tasks.workunit.client.0.smithi039.stdout:write ret = 32 2024-09-12T02:40:07.849 INFO:tasks.workunit.client.0.smithi039.stdout:write ret = 32 2024-09-12T02:40:07.849 INFO:tasks.workunit.client.0.smithi039.stdout:pread ret = 64 2024-09-12T02:40:07.849 INFO:tasks.workunit.client.0.smithi039.stdout:32/600: open fd = 3 2024-09-12T02:40:07.849 INFO:tasks.workunit.client.0.smithi039.stdout:write ret = 32 2024-09-12T02:40:07.849 INFO:tasks.workunit.client.0.smithi039.stdout:write ret = 32 2024-09-12T02:40:07.849 INFO:tasks.workunit.client.0.smithi039.stdout:pread ret = 64 2024-09-12T02:40:07.849 INFO:tasks.workunit.client.0.smithi039.stdout:33/600: open fd = 3 2024-09-12T02:40:07.849 INFO:tasks.workunit.client.0.smithi039.stdout:write ret = 32 2024-09-12T02:40:07.849 INFO:tasks.workunit.client.0.smithi039.stdout:write ret = 32 2024-09-12T02:40:07.849 INFO:tasks.workunit.client.0.smithi039.stdout:pread ret = 64 2024-09-12T02:40:07.850 INFO:tasks.workunit.client.0.smithi039.stdout:34/600: open fd = 3 2024-09-12T02:40:07.850 INFO:tasks.workunit.client.0.smithi039.stdout:write ret = 32 2024-09-12T02:40:07.850 INFO:tasks.workunit.client.0.smithi039.stdout:write ret = 32 2024-09-12T02:40:07.850 INFO:tasks.workunit.client.0.smithi039.stdout:pread ret = 64 2024-09-12T02:40:07.850 INFO:tasks.workunit.client.0.smithi039.stdout:35/600: open fd = 3 2024-09-12T02:40:07.850 INFO:tasks.workunit.client.0.smithi039.stdout:write ret = 32 2024-09-12T02:40:07.850 INFO:tasks.workunit.client.0.smithi039.stdout:write ret = 32 2024-09-12T02:40:07.850 INFO:tasks.workunit.client.0.smithi039.stdout:pread ret = 64 2024-09-12T02:40:07.850 INFO:tasks.workunit.client.0.smithi039.stdout:36/600: open fd = 3 2024-09-12T02:40:07.850 INFO:tasks.workunit.client.0.smithi039.stdout:write ret = 32 2024-09-12T02:40:07.850 INFO:tasks.workunit.client.0.smithi039.stdout:write ret = 32 2024-09-12T02:40:07.850 INFO:tasks.workunit.client.0.smithi039.stdout:pread ret = 64 2024-09-12T02:40:07.850 INFO:tasks.workunit.client.0.smithi039.stdout:37/600: open fd = 3 2024-09-12T02:40:07.850 INFO:tasks.workunit.client.0.smithi039.stdout:write ret = 32 2024-09-12T02:40:07.851 INFO:tasks.workunit.client.0.smithi039.stdout:write ret = 32 2024-09-12T02:40:07.851 INFO:tasks.workunit.client.0.smithi039.stdout:pread ret = 64 2024-09-12T02:40:07.851 INFO:tasks.workunit.client.0.smithi039.stdout:38/600: open fd = 3 2024-09-12T02:40:07.851 INFO:tasks.workunit.client.0.smithi039.stdout:write ret = 32 2024-09-12T02:40:07.851 INFO:tasks.workunit.client.0.smithi039.stdout:write ret = 32 2024-09-12T02:40:07.851 INFO:tasks.workunit.client.0.smithi039.stdout:pread ret = 64 2024-09-12T02:40:07.851 INFO:tasks.workunit.client.0.smithi039.stdout:39/600: open fd = 3 2024-09-12T02:40:07.851 INFO:tasks.workunit.client.0.smithi039.stdout:write ret = 32 2024-09-12T02:40:07.851 INFO:tasks.workunit.client.0.smithi039.stdout:write ret = 32 2024-09-12T02:40:07.851 INFO:tasks.workunit.client.0.smithi039.stdout:pread ret = 64 2024-09-12T02:40:07.851 INFO:tasks.workunit.client.0.smithi039.stdout:40/600: open fd = 3 2024-09-12T02:40:07.851 INFO:tasks.workunit.client.0.smithi039.stdout:write ret = 32 2024-09-12T02:40:07.851 INFO:tasks.workunit.client.0.smithi039.stdout:write ret = 32 2024-09-12T02:40:07.851 INFO:tasks.workunit.client.0.smithi039.stdout:pread ret = 64 2024-09-12T02:40:07.851 INFO:tasks.workunit.client.0.smithi039.stdout:41/600: open fd = 3 2024-09-12T02:40:07.851 INFO:tasks.workunit.client.0.smithi039.stdout:write ret = 32 2024-09-12T02:40:07.852 INFO:tasks.workunit.client.0.smithi039.stdout:write ret = 32 2024-09-12T02:40:07.852 INFO:tasks.workunit.client.0.smithi039.stdout:pread ret = 64 2024-09-12T02:40:07.852 INFO:tasks.workunit.client.0.smithi039.stdout:42/600: open fd = 3 2024-09-12T02:40:07.852 INFO:tasks.workunit.client.0.smithi039.stdout:write ret = 32 2024-09-12T02:40:07.852 INFO:tasks.workunit.client.0.smithi039.stdout:write ret = 32 2024-09-12T02:40:07.852 INFO:tasks.workunit.client.0.smithi039.stdout:pread ret = 64 2024-09-12T02:40:07.852 INFO:tasks.workunit.client.0.smithi039.stdout:43/600: open fd = 3 2024-09-12T02:40:07.852 INFO:tasks.workunit.client.0.smithi039.stdout:write ret = 32 2024-09-12T02:40:07.852 INFO:tasks.workunit.client.0.smithi039.stdout:write ret = 32 2024-09-12T02:40:07.852 INFO:tasks.workunit.client.0.smithi039.stdout:pread ret = 64 2024-09-12T02:40:07.852 INFO:tasks.workunit.client.0.smithi039.stdout:44/600: open fd = 3 2024-09-12T02:40:07.852 INFO:tasks.workunit.client.0.smithi039.stdout:write ret = 32 2024-09-12T02:40:07.852 INFO:tasks.workunit.client.0.smithi039.stdout:write ret = 32 2024-09-12T02:40:07.852 INFO:tasks.workunit.client.0.smithi039.stdout:pread ret = 64 2024-09-12T02:40:07.852 INFO:tasks.workunit.client.0.smithi039.stdout:45/600: open fd = 3 2024-09-12T02:40:07.853 INFO:tasks.workunit.client.0.smithi039.stdout:write ret = 32 2024-09-12T02:40:07.853 INFO:tasks.workunit.client.0.smithi039.stdout:write ret = 32 2024-09-12T02:40:07.853 INFO:tasks.workunit.client.0.smithi039.stdout:pread ret = 64 2024-09-12T02:40:07.853 INFO:tasks.workunit.client.0.smithi039.stdout:46/600: open fd = 3 2024-09-12T02:40:07.853 INFO:tasks.workunit.client.0.smithi039.stdout:write ret = 32 2024-09-12T02:40:07.853 INFO:tasks.workunit.client.0.smithi039.stdout:write ret = 32 2024-09-12T02:40:07.853 INFO:tasks.workunit.client.0.smithi039.stdout:pread ret = 64 2024-09-12T02:40:07.853 INFO:tasks.workunit.client.0.smithi039.stdout:47/600: open fd = 3 2024-09-12T02:40:07.853 INFO:tasks.workunit.client.0.smithi039.stdout:write ret = 32 2024-09-12T02:40:07.853 INFO:tasks.workunit.client.0.smithi039.stdout:write ret = 32 2024-09-12T02:40:07.853 INFO:tasks.workunit.client.0.smithi039.stdout:pread ret = 64 2024-09-12T02:40:07.853 INFO:tasks.workunit.client.0.smithi039.stdout:48/600: open fd = 3 2024-09-12T02:40:07.853 INFO:tasks.workunit.client.0.smithi039.stdout:write ret = 32 2024-09-12T02:40:07.853 INFO:tasks.workunit.client.0.smithi039.stdout:write ret = 32 2024-09-12T02:40:07.853 INFO:tasks.workunit.client.0.smithi039.stdout:pread ret = 64 2024-09-12T02:40:07.854 INFO:tasks.workunit.client.0.smithi039.stdout:49/600: open fd = 3 2024-09-12T02:40:07.854 INFO:tasks.workunit.client.0.smithi039.stdout:write ret = 32 2024-09-12T02:40:07.854 INFO:tasks.workunit.client.0.smithi039.stdout:write ret = 32 2024-09-12T02:40:07.854 INFO:tasks.workunit.client.0.smithi039.stdout:pread ret = 64 2024-09-12T02:40:07.854 INFO:tasks.workunit.client.0.smithi039.stdout:50/600: open fd = 3 2024-09-12T02:40:07.854 INFO:tasks.workunit.client.0.smithi039.stdout:write ret = 32 2024-09-12T02:40:07.854 INFO:tasks.workunit.client.0.smithi039.stdout:write ret = 32 2024-09-12T02:40:07.854 INFO:tasks.workunit.client.0.smithi039.stdout:pread ret = 64 2024-09-12T02:40:07.854 INFO:tasks.workunit.client.0.smithi039.stdout:51/600: open fd = 3 2024-09-12T02:40:07.854 INFO:tasks.workunit.client.0.smithi039.stdout:write ret = 32 2024-09-12T02:40:07.854 INFO:tasks.workunit.client.0.smithi039.stdout:write ret = 32 2024-09-12T02:40:07.854 INFO:tasks.workunit.client.0.smithi039.stdout:pread ret = 64 2024-09-12T02:40:07.854 INFO:tasks.workunit.client.0.smithi039.stdout:52/600: open fd = 3 2024-09-12T02:40:07.855 INFO:tasks.workunit.client.0.smithi039.stdout:write ret = 32 2024-09-12T02:40:07.855 INFO:tasks.workunit.client.0.smithi039.stdout:write ret = 32 2024-09-12T02:40:07.855 INFO:tasks.workunit.client.0.smithi039.stdout:pread ret = 64 2024-09-12T02:40:07.855 INFO:tasks.workunit.client.0.smithi039.stdout:53/600: open fd = 3 2024-09-12T02:40:07.855 INFO:tasks.workunit.client.0.smithi039.stdout:write ret = 32 2024-09-12T02:40:07.855 INFO:tasks.workunit.client.0.smithi039.stdout:write ret = 32 2024-09-12T02:40:07.855 INFO:tasks.workunit.client.0.smithi039.stdout:pread ret = 64 2024-09-12T02:40:07.855 INFO:tasks.workunit.client.0.smithi039.stdout:54/600: open fd = 3 2024-09-12T02:40:07.855 INFO:tasks.workunit.client.0.smithi039.stdout:write ret = 32 2024-09-12T02:40:07.855 INFO:tasks.workunit.client.0.smithi039.stdout:write ret = 32 2024-09-12T02:40:07.855 INFO:tasks.workunit.client.0.smithi039.stdout:pread ret = 64 2024-09-12T02:40:07.855 INFO:tasks.workunit.client.0.smithi039.stdout:55/600: open fd = 3 2024-09-12T02:40:07.855 INFO:tasks.workunit.client.0.smithi039.stdout:write ret = 32 2024-09-12T02:40:07.855 INFO:tasks.workunit.client.0.smithi039.stdout:write ret = 32 2024-09-12T02:40:07.855 INFO:tasks.workunit.client.0.smithi039.stdout:pread ret = 64 2024-09-12T02:40:07.855 INFO:tasks.workunit.client.0.smithi039.stdout:56/600: open fd = 3 2024-09-12T02:40:07.856 INFO:tasks.workunit.client.0.smithi039.stdout:write ret = 32 2024-09-12T02:40:07.856 INFO:tasks.workunit.client.0.smithi039.stdout:write ret = 32 2024-09-12T02:40:07.856 INFO:tasks.workunit.client.0.smithi039.stdout:pread ret = 64 2024-09-12T02:40:07.856 INFO:tasks.workunit.client.0.smithi039.stdout:57/600: open fd = 3 2024-09-12T02:40:07.856 INFO:tasks.workunit.client.0.smithi039.stdout:write ret = 32 2024-09-12T02:40:07.856 INFO:tasks.workunit.client.0.smithi039.stdout:write ret = 32 2024-09-12T02:40:07.856 INFO:tasks.workunit.client.0.smithi039.stdout:pread ret = 64 2024-09-12T02:40:07.856 INFO:tasks.workunit.client.0.smithi039.stdout:58/600: open fd = 3 2024-09-12T02:40:07.856 INFO:tasks.workunit.client.0.smithi039.stdout:write ret = 32 2024-09-12T02:40:07.856 INFO:tasks.workunit.client.0.smithi039.stdout:write ret = 32 2024-09-12T02:40:07.856 INFO:tasks.workunit.client.0.smithi039.stdout:pread ret = 64 2024-09-12T02:40:07.856 INFO:tasks.workunit.client.0.smithi039.stdout:59/600: open fd = 3 2024-09-12T02:40:07.856 INFO:tasks.workunit.client.0.smithi039.stdout:write ret = 32 2024-09-12T02:40:07.856 INFO:tasks.workunit.client.0.smithi039.stdout:write ret = 32 2024-09-12T02:40:07.857 INFO:tasks.workunit.client.0.smithi039.stdout:pread ret = 64 2024-09-12T02:40:07.857 INFO:tasks.workunit.client.0.smithi039.stdout:60/600: open fd = 3 2024-09-12T02:40:07.857 INFO:tasks.workunit.client.0.smithi039.stdout:write ret = 32 2024-09-12T02:40:07.857 INFO:tasks.workunit.client.0.smithi039.stdout:write ret = 32 2024-09-12T02:40:07.857 INFO:tasks.workunit.client.0.smithi039.stdout:pread ret = 64 2024-09-12T02:40:07.857 INFO:tasks.workunit.client.0.smithi039.stdout:61/600: open fd = 3 2024-09-12T02:40:07.857 INFO:tasks.workunit.client.0.smithi039.stdout:write ret = 32 2024-09-12T02:40:07.857 INFO:tasks.workunit.client.0.smithi039.stdout:write ret = 32 2024-09-12T02:40:07.857 INFO:tasks.workunit.client.0.smithi039.stdout:pread ret = 64 2024-09-12T02:40:07.857 INFO:tasks.workunit.client.0.smithi039.stdout:62/600: open fd = 3 2024-09-12T02:40:07.857 INFO:tasks.workunit.client.0.smithi039.stdout:write ret = 32 2024-09-12T02:40:07.857 INFO:tasks.workunit.client.0.smithi039.stdout:write ret = 32 2024-09-12T02:40:07.857 INFO:tasks.workunit.client.0.smithi039.stdout:pread ret = 64 2024-09-12T02:40:07.857 INFO:tasks.workunit.client.0.smithi039.stdout:63/600: open fd = 3 2024-09-12T02:40:07.858 INFO:tasks.workunit.client.0.smithi039.stdout:write ret = 32 2024-09-12T02:40:07.858 INFO:tasks.workunit.client.0.smithi039.stdout:write ret = 32 2024-09-12T02:40:07.858 INFO:tasks.workunit.client.0.smithi039.stdout:pread ret = 64 2024-09-12T02:40:09.448 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 12 02:40:09 smithi044 ceph-mon[35411]: pgmap v69: 129 pgs: 129 active+clean; 2.4 MiB data, 361 MiB used, 1.0 TiB / 1.0 TiB avail; 41 KiB/s rd, 50 KiB/s wr, 34 op/s 2024-09-12T02:40:09.513 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 12 02:40:09 smithi172 ceph-mon[35609]: pgmap v69: 129 pgs: 129 active+clean; 2.4 MiB data, 361 MiB used, 1.0 TiB / 1.0 TiB avail; 41 KiB/s rd, 50 KiB/s wr, 34 op/s 2024-09-12T02:40:09.600 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 02:40:09 smithi039 ceph-mon[30515]: pgmap v69: 129 pgs: 129 active+clean; 2.4 MiB data, 361 MiB used, 1.0 TiB / 1.0 TiB avail; 41 KiB/s rd, 50 KiB/s wr, 34 op/s 2024-09-12T02:40:11.448 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 12 02:40:11 smithi044 ceph-mon[35411]: pgmap v70: 129 pgs: 129 active+clean; 2.4 MiB data, 361 MiB used, 1.0 TiB / 1.0 TiB avail; 32 KiB/s rd, 42 KiB/s wr, 27 op/s 2024-09-12T02:40:11.513 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 12 02:40:11 smithi172 ceph-mon[35609]: pgmap v70: 129 pgs: 129 active+clean; 2.4 MiB data, 361 MiB used, 1.0 TiB / 1.0 TiB avail; 32 KiB/s rd, 42 KiB/s wr, 27 op/s 2024-09-12T02:40:11.600 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 02:40:11 smithi039 ceph-mon[30515]: pgmap v70: 129 pgs: 129 active+clean; 2.4 MiB data, 361 MiB used, 1.0 TiB / 1.0 TiB avail; 32 KiB/s rd, 42 KiB/s wr, 27 op/s 2024-09-12T02:40:13.448 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 12 02:40:13 smithi044 ceph-mon[35411]: pgmap v71: 129 pgs: 129 active+clean; 2.6 MiB data, 362 MiB used, 1.0 TiB / 1.0 TiB avail; 43 KiB/s rd, 51 KiB/s wr, 34 op/s 2024-09-12T02:40:13.513 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 12 02:40:13 smithi172 ceph-mon[35609]: pgmap v71: 129 pgs: 129 active+clean; 2.6 MiB data, 362 MiB used, 1.0 TiB / 1.0 TiB avail; 43 KiB/s rd, 51 KiB/s wr, 34 op/s 2024-09-12T02:40:13.600 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 02:40:13 smithi039 ceph-mon[30515]: pgmap v71: 129 pgs: 129 active+clean; 2.6 MiB data, 362 MiB used, 1.0 TiB / 1.0 TiB avail; 43 KiB/s rd, 51 KiB/s wr, 34 op/s 2024-09-12T02:40:15.448 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 12 02:40:15 smithi044 ceph-mon[35411]: pgmap v72: 129 pgs: 129 active+clean; 2.6 MiB data, 362 MiB used, 1.0 TiB / 1.0 TiB avail; 23 KiB/s rd, 20 KiB/s wr, 13 op/s 2024-09-12T02:40:15.513 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 12 02:40:15 smithi172 ceph-mon[35609]: pgmap v72: 129 pgs: 129 active+clean; 2.6 MiB data, 362 MiB used, 1.0 TiB / 1.0 TiB avail; 23 KiB/s rd, 20 KiB/s wr, 13 op/s 2024-09-12T02:40:15.600 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 02:40:15 smithi039 ceph-mon[30515]: pgmap v72: 129 pgs: 129 active+clean; 2.6 MiB data, 362 MiB used, 1.0 TiB / 1.0 TiB avail; 23 KiB/s rd, 20 KiB/s wr, 13 op/s 2024-09-12T02:40:17.448 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 12 02:40:17 smithi044 ceph-mon[35411]: pgmap v73: 129 pgs: 129 active+clean; 2.6 MiB data, 362 MiB used, 1.0 TiB / 1.0 TiB avail; 23 KiB/s rd, 20 KiB/s wr, 13 op/s 2024-09-12T02:40:17.513 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 12 02:40:17 smithi172 ceph-mon[35609]: pgmap v73: 129 pgs: 129 active+clean; 2.6 MiB data, 362 MiB used, 1.0 TiB / 1.0 TiB avail; 23 KiB/s rd, 20 KiB/s wr, 13 op/s 2024-09-12T02:40:17.599 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 02:40:17 smithi039 ceph-mon[30515]: pgmap v73: 129 pgs: 129 active+clean; 2.6 MiB data, 362 MiB used, 1.0 TiB / 1.0 TiB avail; 23 KiB/s rd, 20 KiB/s wr, 13 op/s 2024-09-12T02:40:19.387 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 02:40:19 smithi039 ceph-mon[30515]: pgmap v74: 129 pgs: 129 active+clean; 2.7 MiB data, 362 MiB used, 1.0 TiB / 1.0 TiB avail; 35 KiB/s rd, 31 KiB/s wr, 20 op/s 2024-09-12T02:40:19.448 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 12 02:40:19 smithi044 ceph-mon[35411]: pgmap v74: 129 pgs: 129 active+clean; 2.7 MiB data, 362 MiB used, 1.0 TiB / 1.0 TiB avail; 35 KiB/s rd, 31 KiB/s wr, 20 op/s 2024-09-12T02:40:19.513 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 12 02:40:19 smithi172 ceph-mon[35609]: pgmap v74: 129 pgs: 129 active+clean; 2.7 MiB data, 362 MiB used, 1.0 TiB / 1.0 TiB avail; 35 KiB/s rd, 31 KiB/s wr, 20 op/s 2024-09-12T02:40:21.448 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 12 02:40:21 smithi044 ceph-mon[35411]: pgmap v75: 129 pgs: 129 active+clean; 2.7 MiB data, 362 MiB used, 1.0 TiB / 1.0 TiB avail; 23 KiB/s rd, 20 KiB/s wr, 13 op/s 2024-09-12T02:40:21.513 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 12 02:40:21 smithi172 ceph-mon[35609]: pgmap v75: 129 pgs: 129 active+clean; 2.7 MiB data, 362 MiB used, 1.0 TiB / 1.0 TiB avail; 23 KiB/s rd, 20 KiB/s wr, 13 op/s 2024-09-12T02:40:21.599 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 02:40:21 smithi039 ceph-mon[30515]: pgmap v75: 129 pgs: 129 active+clean; 2.7 MiB data, 362 MiB used, 1.0 TiB / 1.0 TiB avail; 23 KiB/s rd, 20 KiB/s wr, 13 op/s 2024-09-12T02:40:23.448 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 12 02:40:23 smithi044 ceph-mon[35411]: pgmap v76: 129 pgs: 129 active+clean; 2.8 MiB data, 366 MiB used, 1.0 TiB / 1.0 TiB avail; 34 KiB/s rd, 29 KiB/s wr, 19 op/s 2024-09-12T02:40:23.513 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 12 02:40:23 smithi172 ceph-mon[35609]: pgmap v76: 129 pgs: 129 active+clean; 2.8 MiB data, 366 MiB used, 1.0 TiB / 1.0 TiB avail; 34 KiB/s rd, 29 KiB/s wr, 19 op/s 2024-09-12T02:40:23.599 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 02:40:23 smithi039 ceph-mon[30515]: pgmap v76: 129 pgs: 129 active+clean; 2.8 MiB data, 366 MiB used, 1.0 TiB / 1.0 TiB avail; 34 KiB/s rd, 29 KiB/s wr, 19 op/s 2024-09-12T02:40:25.448 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 12 02:40:25 smithi044 ceph-mon[35411]: pgmap v77: 129 pgs: 129 active+clean; 2.8 MiB data, 366 MiB used, 1.0 TiB / 1.0 TiB avail; 23 KiB/s rd, 20 KiB/s wr, 13 op/s 2024-09-12T02:40:25.513 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 12 02:40:25 smithi172 ceph-mon[35609]: pgmap v77: 129 pgs: 129 active+clean; 2.8 MiB data, 366 MiB used, 1.0 TiB / 1.0 TiB avail; 23 KiB/s rd, 20 KiB/s wr, 13 op/s 2024-09-12T02:40:25.600 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 02:40:25 smithi039 ceph-mon[30515]: pgmap v77: 129 pgs: 129 active+clean; 2.8 MiB data, 366 MiB used, 1.0 TiB / 1.0 TiB avail; 23 KiB/s rd, 20 KiB/s wr, 13 op/s 2024-09-12T02:40:27.448 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 12 02:40:27 smithi044 ceph-mon[35411]: pgmap v78: 129 pgs: 129 active+clean; 2.8 MiB data, 366 MiB used, 1.0 TiB / 1.0 TiB avail; 23 KiB/s rd, 20 KiB/s wr, 13 op/s 2024-09-12T02:40:27.513 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 12 02:40:27 smithi172 ceph-mon[35609]: pgmap v78: 129 pgs: 129 active+clean; 2.8 MiB data, 366 MiB used, 1.0 TiB / 1.0 TiB avail; 23 KiB/s rd, 20 KiB/s wr, 13 op/s 2024-09-12T02:40:27.599 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 02:40:27 smithi039 ceph-mon[30515]: pgmap v78: 129 pgs: 129 active+clean; 2.8 MiB data, 366 MiB used, 1.0 TiB / 1.0 TiB avail; 23 KiB/s rd, 20 KiB/s wr, 13 op/s 2024-09-12T02:40:29.448 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 12 02:40:29 smithi044 ceph-mon[35411]: pgmap v79: 129 pgs: 129 active+clean; 2.9 MiB data, 367 MiB used, 1.0 TiB / 1.0 TiB avail; 35 KiB/s rd, 29 KiB/s wr, 19 op/s 2024-09-12T02:40:29.513 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 12 02:40:29 smithi172 ceph-mon[35609]: pgmap v79: 129 pgs: 129 active+clean; 2.9 MiB data, 367 MiB used, 1.0 TiB / 1.0 TiB avail; 35 KiB/s rd, 29 KiB/s wr, 19 op/s 2024-09-12T02:40:29.599 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 02:40:29 smithi039 ceph-mon[30515]: pgmap v79: 129 pgs: 129 active+clean; 2.9 MiB data, 367 MiB used, 1.0 TiB / 1.0 TiB avail; 35 KiB/s rd, 29 KiB/s wr, 19 op/s 2024-09-12T02:40:31.448 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 12 02:40:31 smithi044 ceph-mon[35411]: pgmap v80: 129 pgs: 129 active+clean; 2.9 MiB data, 367 MiB used, 1.0 TiB / 1.0 TiB avail; 23 KiB/s rd, 19 KiB/s wr, 12 op/s 2024-09-12T02:40:31.513 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 12 02:40:31 smithi172 ceph-mon[35609]: pgmap v80: 129 pgs: 129 active+clean; 2.9 MiB data, 367 MiB used, 1.0 TiB / 1.0 TiB avail; 23 KiB/s rd, 19 KiB/s wr, 12 op/s 2024-09-12T02:40:31.600 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 02:40:31 smithi039 ceph-mon[30515]: pgmap v80: 129 pgs: 129 active+clean; 2.9 MiB data, 367 MiB used, 1.0 TiB / 1.0 TiB avail; 23 KiB/s rd, 19 KiB/s wr, 12 op/s 2024-09-12T02:40:33.448 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 12 02:40:33 smithi044 ceph-mon[35411]: pgmap v81: 129 pgs: 129 active+clean; 3.0 MiB data, 367 MiB used, 1.0 TiB / 1.0 TiB avail; 34 KiB/s rd, 28 KiB/s wr, 19 op/s 2024-09-12T02:40:33.513 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 12 02:40:33 smithi172 ceph-mon[35609]: pgmap v81: 129 pgs: 129 active+clean; 3.0 MiB data, 367 MiB used, 1.0 TiB / 1.0 TiB avail; 34 KiB/s rd, 28 KiB/s wr, 19 op/s 2024-09-12T02:40:33.600 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 02:40:33 smithi039 ceph-mon[30515]: pgmap v81: 129 pgs: 129 active+clean; 3.0 MiB data, 367 MiB used, 1.0 TiB / 1.0 TiB avail; 34 KiB/s rd, 28 KiB/s wr, 19 op/s 2024-09-12T02:40:35.448 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 12 02:40:35 smithi044 ceph-mon[35411]: pgmap v82: 129 pgs: 129 active+clean; 3.0 MiB data, 367 MiB used, 1.0 TiB / 1.0 TiB avail; 23 KiB/s rd, 18 KiB/s wr, 12 op/s 2024-09-12T02:40:35.514 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 12 02:40:35 smithi172 ceph-mon[35609]: pgmap v82: 129 pgs: 129 active+clean; 3.0 MiB data, 367 MiB used, 1.0 TiB / 1.0 TiB avail; 23 KiB/s rd, 18 KiB/s wr, 12 op/s 2024-09-12T02:40:35.599 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 02:40:35 smithi039 ceph-mon[30515]: pgmap v82: 129 pgs: 129 active+clean; 3.0 MiB data, 367 MiB used, 1.0 TiB / 1.0 TiB avail; 23 KiB/s rd, 18 KiB/s wr, 12 op/s 2024-09-12T02:40:37.513 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 12 02:40:37 smithi172 ceph-mon[35609]: pgmap v83: 129 pgs: 129 active+clean; 3.0 MiB data, 367 MiB used, 1.0 TiB / 1.0 TiB avail; 23 KiB/s rd, 18 KiB/s wr, 12 op/s 2024-09-12T02:40:37.600 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 02:40:37 smithi039 ceph-mon[30515]: pgmap v83: 129 pgs: 129 active+clean; 3.0 MiB data, 367 MiB used, 1.0 TiB / 1.0 TiB avail; 23 KiB/s rd, 18 KiB/s wr, 12 op/s 2024-09-12T02:40:37.698 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 12 02:40:37 smithi044 ceph-mon[35411]: pgmap v83: 129 pgs: 129 active+clean; 3.0 MiB data, 367 MiB used, 1.0 TiB / 1.0 TiB avail; 23 KiB/s rd, 18 KiB/s wr, 12 op/s 2024-09-12T02:40:39.513 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 12 02:40:39 smithi172 ceph-mon[35609]: pgmap v84: 129 pgs: 129 active+clean; 3.1 MiB data, 367 MiB used, 1.0 TiB / 1.0 TiB avail; 35 KiB/s rd, 28 KiB/s wr, 19 op/s 2024-09-12T02:40:39.600 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 02:40:39 smithi039 ceph-mon[30515]: pgmap v84: 129 pgs: 129 active+clean; 3.1 MiB data, 367 MiB used, 1.0 TiB / 1.0 TiB avail; 35 KiB/s rd, 28 KiB/s wr, 19 op/s 2024-09-12T02:40:39.698 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 12 02:40:39 smithi044 ceph-mon[35411]: pgmap v84: 129 pgs: 129 active+clean; 3.1 MiB data, 367 MiB used, 1.0 TiB / 1.0 TiB avail; 35 KiB/s rd, 28 KiB/s wr, 19 op/s 2024-09-12T02:40:41.514 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 12 02:40:41 smithi172 ceph-mon[35609]: pgmap v85: 129 pgs: 129 active+clean; 3.1 MiB data, 367 MiB used, 1.0 TiB / 1.0 TiB avail; 22 KiB/s rd, 19 KiB/s wr, 13 op/s 2024-09-12T02:40:41.600 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 02:40:41 smithi039 ceph-mon[30515]: pgmap v85: 129 pgs: 129 active+clean; 3.1 MiB data, 367 MiB used, 1.0 TiB / 1.0 TiB avail; 22 KiB/s rd, 19 KiB/s wr, 13 op/s 2024-09-12T02:40:41.698 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 12 02:40:41 smithi044 ceph-mon[35411]: pgmap v85: 129 pgs: 129 active+clean; 3.1 MiB data, 367 MiB used, 1.0 TiB / 1.0 TiB avail; 22 KiB/s rd, 19 KiB/s wr, 13 op/s 2024-09-12T02:40:43.513 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 12 02:40:43 smithi172 ceph-mon[35609]: pgmap v86: 129 pgs: 129 active+clean; 3.2 MiB data, 368 MiB used, 1.0 TiB / 1.0 TiB avail; 33 KiB/s rd, 29 KiB/s wr, 19 op/s 2024-09-12T02:40:43.599 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 02:40:43 smithi039 ceph-mon[30515]: pgmap v86: 129 pgs: 129 active+clean; 3.2 MiB data, 368 MiB used, 1.0 TiB / 1.0 TiB avail; 33 KiB/s rd, 29 KiB/s wr, 19 op/s 2024-09-12T02:40:43.698 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 12 02:40:43 smithi044 ceph-mon[35411]: pgmap v86: 129 pgs: 129 active+clean; 3.2 MiB data, 368 MiB used, 1.0 TiB / 1.0 TiB avail; 33 KiB/s rd, 29 KiB/s wr, 19 op/s 2024-09-12T02:40:45.513 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 12 02:40:45 smithi172 ceph-mon[35609]: pgmap v87: 129 pgs: 129 active+clean; 3.2 MiB data, 368 MiB used, 1.0 TiB / 1.0 TiB avail; 23 KiB/s rd, 20 KiB/s wr, 13 op/s 2024-09-12T02:40:45.600 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 02:40:45 smithi039 ceph-mon[30515]: pgmap v87: 129 pgs: 129 active+clean; 3.2 MiB data, 368 MiB used, 1.0 TiB / 1.0 TiB avail; 23 KiB/s rd, 20 KiB/s wr, 13 op/s 2024-09-12T02:40:45.698 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 12 02:40:45 smithi044 ceph-mon[35411]: pgmap v87: 129 pgs: 129 active+clean; 3.2 MiB data, 368 MiB used, 1.0 TiB / 1.0 TiB avail; 23 KiB/s rd, 20 KiB/s wr, 13 op/s 2024-09-12T02:40:47.513 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 12 02:40:47 smithi172 ceph-mon[35609]: pgmap v88: 129 pgs: 129 active+clean; 3.2 MiB data, 368 MiB used, 1.0 TiB / 1.0 TiB avail; 23 KiB/s rd, 20 KiB/s wr, 13 op/s 2024-09-12T02:40:47.600 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 02:40:47 smithi039 ceph-mon[30515]: pgmap v88: 129 pgs: 129 active+clean; 3.2 MiB data, 368 MiB used, 1.0 TiB / 1.0 TiB avail; 23 KiB/s rd, 20 KiB/s wr, 13 op/s 2024-09-12T02:40:47.698 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 12 02:40:47 smithi044 ceph-mon[35411]: pgmap v88: 129 pgs: 129 active+clean; 3.2 MiB data, 368 MiB used, 1.0 TiB / 1.0 TiB avail; 23 KiB/s rd, 20 KiB/s wr, 13 op/s 2024-09-12T02:40:49.513 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 12 02:40:49 smithi172 ceph-mon[35609]: pgmap v89: 129 pgs: 129 active+clean; 3.3 MiB data, 368 MiB used, 1.0 TiB / 1.0 TiB avail; 34 KiB/s rd, 30 KiB/s wr, 19 op/s 2024-09-12T02:40:49.600 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 02:40:49 smithi039 ceph-mon[30515]: pgmap v89: 129 pgs: 129 active+clean; 3.3 MiB data, 368 MiB used, 1.0 TiB / 1.0 TiB avail; 34 KiB/s rd, 30 KiB/s wr, 19 op/s 2024-09-12T02:40:49.698 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 12 02:40:49 smithi044 ceph-mon[35411]: pgmap v89: 129 pgs: 129 active+clean; 3.3 MiB data, 368 MiB used, 1.0 TiB / 1.0 TiB avail; 34 KiB/s rd, 30 KiB/s wr, 19 op/s 2024-09-12T02:40:51.514 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 12 02:40:51 smithi172 ceph-mon[35609]: pgmap v90: 129 pgs: 129 active+clean; 3.3 MiB data, 368 MiB used, 1.0 TiB / 1.0 TiB avail; 23 KiB/s rd, 20 KiB/s wr, 13 op/s 2024-09-12T02:40:51.600 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 02:40:51 smithi039 ceph-mon[30515]: pgmap v90: 129 pgs: 129 active+clean; 3.3 MiB data, 368 MiB used, 1.0 TiB / 1.0 TiB avail; 23 KiB/s rd, 20 KiB/s wr, 13 op/s 2024-09-12T02:40:51.698 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 12 02:40:51 smithi044 ceph-mon[35411]: pgmap v90: 129 pgs: 129 active+clean; 3.3 MiB data, 368 MiB used, 1.0 TiB / 1.0 TiB avail; 23 KiB/s rd, 20 KiB/s wr, 13 op/s 2024-09-12T02:40:53.599 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 02:40:53 smithi039 ceph-mon[30515]: pgmap v91: 129 pgs: 129 active+clean; 3.4 MiB data, 368 MiB used, 1.0 TiB / 1.0 TiB avail; 34 KiB/s rd, 29 KiB/s wr, 19 op/s 2024-09-12T02:40:53.698 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 12 02:40:53 smithi044 ceph-mon[35411]: pgmap v91: 129 pgs: 129 active+clean; 3.4 MiB data, 368 MiB used, 1.0 TiB / 1.0 TiB avail; 34 KiB/s rd, 29 KiB/s wr, 19 op/s 2024-09-12T02:40:53.763 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 12 02:40:53 smithi172 ceph-mon[35609]: pgmap v91: 129 pgs: 129 active+clean; 3.4 MiB data, 368 MiB used, 1.0 TiB / 1.0 TiB avail; 34 KiB/s rd, 29 KiB/s wr, 19 op/s 2024-09-12T02:40:55.566 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 12 02:40:55 smithi172 ceph-mon[35609]: pgmap v92: 129 pgs: 129 active+clean; 3.4 MiB data, 368 MiB used, 1.0 TiB / 1.0 TiB avail; 23 KiB/s rd, 20 KiB/s wr, 13 op/s 2024-09-12T02:40:55.599 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 02:40:55 smithi039 ceph-mon[30515]: pgmap v92: 129 pgs: 129 active+clean; 3.4 MiB data, 368 MiB used, 1.0 TiB / 1.0 TiB avail; 23 KiB/s rd, 20 KiB/s wr, 13 op/s 2024-09-12T02:40:55.698 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 12 02:40:55 smithi044 ceph-mon[35411]: pgmap v92: 129 pgs: 129 active+clean; 3.4 MiB data, 368 MiB used, 1.0 TiB / 1.0 TiB avail; 23 KiB/s rd, 20 KiB/s wr, 13 op/s 2024-09-12T02:40:57.599 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 02:40:57 smithi039 ceph-mon[30515]: pgmap v93: 129 pgs: 129 active+clean; 3.4 MiB data, 368 MiB used, 1.0 TiB / 1.0 TiB avail; 23 KiB/s rd, 20 KiB/s wr, 13 op/s 2024-09-12T02:40:57.698 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 12 02:40:57 smithi044 ceph-mon[35411]: pgmap v93: 129 pgs: 129 active+clean; 3.4 MiB data, 368 MiB used, 1.0 TiB / 1.0 TiB avail; 23 KiB/s rd, 20 KiB/s wr, 13 op/s 2024-09-12T02:40:57.763 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 12 02:40:57 smithi172 ceph-mon[35609]: pgmap v93: 129 pgs: 129 active+clean; 3.4 MiB data, 368 MiB used, 1.0 TiB / 1.0 TiB avail; 23 KiB/s rd, 20 KiB/s wr, 13 op/s 2024-09-12T02:40:59.599 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 02:40:59 smithi039 ceph-mon[30515]: pgmap v94: 129 pgs: 129 active+clean; 3.5 MiB data, 373 MiB used, 1.0 TiB / 1.0 TiB avail; 35 KiB/s rd, 31 KiB/s wr, 20 op/s 2024-09-12T02:40:59.698 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 12 02:40:59 smithi044 ceph-mon[35411]: pgmap v94: 129 pgs: 129 active+clean; 3.5 MiB data, 373 MiB used, 1.0 TiB / 1.0 TiB avail; 35 KiB/s rd, 31 KiB/s wr, 20 op/s 2024-09-12T02:40:59.763 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 12 02:40:59 smithi172 ceph-mon[35609]: pgmap v94: 129 pgs: 129 active+clean; 3.5 MiB data, 373 MiB used, 1.0 TiB / 1.0 TiB avail; 35 KiB/s rd, 31 KiB/s wr, 20 op/s 2024-09-12T02:41:01.600 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 02:41:01 smithi039 ceph-mon[30515]: pgmap v95: 129 pgs: 129 active+clean; 3.5 MiB data, 373 MiB used, 1.0 TiB / 1.0 TiB avail; 24 KiB/s rd, 21 KiB/s wr, 13 op/s 2024-09-12T02:41:01.698 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 12 02:41:01 smithi044 ceph-mon[35411]: pgmap v95: 129 pgs: 129 active+clean; 3.5 MiB data, 373 MiB used, 1.0 TiB / 1.0 TiB avail; 24 KiB/s rd, 21 KiB/s wr, 13 op/s 2024-09-12T02:41:01.763 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 12 02:41:01 smithi172 ceph-mon[35609]: pgmap v95: 129 pgs: 129 active+clean; 3.5 MiB data, 373 MiB used, 1.0 TiB / 1.0 TiB avail; 24 KiB/s rd, 21 KiB/s wr, 13 op/s 2024-09-12T02:41:03.599 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 02:41:03 smithi039 ceph-mon[30515]: pgmap v96: 129 pgs: 129 active+clean; 3.6 MiB data, 373 MiB used, 1.0 TiB / 1.0 TiB avail; 45 KiB/s rd, 53 KiB/s wr, 34 op/s 2024-09-12T02:41:03.698 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 12 02:41:03 smithi044 ceph-mon[35411]: pgmap v96: 129 pgs: 129 active+clean; 3.6 MiB data, 373 MiB used, 1.0 TiB / 1.0 TiB avail; 45 KiB/s rd, 53 KiB/s wr, 34 op/s 2024-09-12T02:41:03.763 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 12 02:41:03 smithi172 ceph-mon[35609]: pgmap v96: 129 pgs: 129 active+clean; 3.6 MiB data, 373 MiB used, 1.0 TiB / 1.0 TiB avail; 45 KiB/s rd, 53 KiB/s wr, 34 op/s 2024-09-12T02:41:05.600 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 02:41:05 smithi039 ceph-mon[30515]: pgmap v97: 129 pgs: 129 active+clean; 3.6 MiB data, 373 MiB used, 1.0 TiB / 1.0 TiB avail; 34 KiB/s rd, 44 KiB/s wr, 28 op/s 2024-09-12T02:41:05.600 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 02:41:05 smithi039 ceph-mon[30515]: from='mgr.25199 172.21.15.39:0/1270637502' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-12T02:41:05.698 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 12 02:41:05 smithi044 ceph-mon[35411]: pgmap v97: 129 pgs: 129 active+clean; 3.6 MiB data, 373 MiB used, 1.0 TiB / 1.0 TiB avail; 34 KiB/s rd, 44 KiB/s wr, 28 op/s 2024-09-12T02:41:05.698 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 12 02:41:05 smithi044 ceph-mon[35411]: from='mgr.25199 172.21.15.39:0/1270637502' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-12T02:41:05.763 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 12 02:41:05 smithi172 ceph-mon[35609]: pgmap v97: 129 pgs: 129 active+clean; 3.6 MiB data, 373 MiB used, 1.0 TiB / 1.0 TiB avail; 34 KiB/s rd, 44 KiB/s wr, 28 op/s 2024-09-12T02:41:05.764 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 12 02:41:05 smithi172 ceph-mon[35609]: from='mgr.25199 172.21.15.39:0/1270637502' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-12T02:41:06.600 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 02:41:06 smithi039 ceph-mon[30515]: from='mgr.25199 172.21.15.39:0/1270637502' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-12T02:41:06.600 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 02:41:06 smithi039 ceph-mon[30515]: from='mgr.25199 172.21.15.39:0/1270637502' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-12T02:41:06.600 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 02:41:06 smithi039 ceph-mon[30515]: from='mgr.25199 172.21.15.39:0/1270637502' entity='mgr.x' 2024-09-12T02:41:06.698 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 12 02:41:06 smithi044 ceph-mon[35411]: from='mgr.25199 172.21.15.39:0/1270637502' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-12T02:41:06.699 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 12 02:41:06 smithi044 ceph-mon[35411]: from='mgr.25199 172.21.15.39:0/1270637502' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-12T02:41:06.699 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 12 02:41:06 smithi044 ceph-mon[35411]: from='mgr.25199 172.21.15.39:0/1270637502' entity='mgr.x' 2024-09-12T02:41:06.763 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 12 02:41:06 smithi172 ceph-mon[35609]: from='mgr.25199 172.21.15.39:0/1270637502' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-12T02:41:06.764 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 12 02:41:06 smithi172 ceph-mon[35609]: from='mgr.25199 172.21.15.39:0/1270637502' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-12T02:41:06.764 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 12 02:41:06 smithi172 ceph-mon[35609]: from='mgr.25199 172.21.15.39:0/1270637502' entity='mgr.x' 2024-09-12T02:41:07.698 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 12 02:41:07 smithi044 ceph-mon[35411]: pgmap v98: 129 pgs: 129 active+clean; 3.6 MiB data, 373 MiB used, 1.0 TiB / 1.0 TiB avail; 34 KiB/s rd, 44 KiB/s wr, 28 op/s 2024-09-12T02:41:07.763 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 12 02:41:07 smithi172 ceph-mon[35609]: pgmap v98: 129 pgs: 129 active+clean; 3.6 MiB data, 373 MiB used, 1.0 TiB / 1.0 TiB avail; 34 KiB/s rd, 44 KiB/s wr, 28 op/s 2024-09-12T02:41:07.850 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 02:41:07 smithi039 ceph-mon[30515]: pgmap v98: 129 pgs: 129 active+clean; 3.6 MiB data, 373 MiB used, 1.0 TiB / 1.0 TiB avail; 34 KiB/s rd, 44 KiB/s wr, 28 op/s 2024-09-12T02:41:09.698 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 12 02:41:09 smithi044 ceph-mon[35411]: pgmap v99: 129 pgs: 129 active+clean; 3.8 MiB data, 374 MiB used, 1.0 TiB / 1.0 TiB avail; 48 KiB/s rd, 57 KiB/s wr, 34 op/s 2024-09-12T02:41:09.763 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 12 02:41:09 smithi172 ceph-mon[35609]: pgmap v99: 129 pgs: 129 active+clean; 3.8 MiB data, 374 MiB used, 1.0 TiB / 1.0 TiB avail; 48 KiB/s rd, 57 KiB/s wr, 34 op/s 2024-09-12T02:41:09.850 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 02:41:09 smithi039 ceph-mon[30515]: pgmap v99: 129 pgs: 129 active+clean; 3.8 MiB data, 374 MiB used, 1.0 TiB / 1.0 TiB avail; 48 KiB/s rd, 57 KiB/s wr, 34 op/s 2024-09-12T02:41:11.332 INFO:tasks.workunit.client.0.smithi039.stdout:64/600: open fd = 3 2024-09-12T02:41:11.333 INFO:tasks.workunit.client.0.smithi039.stdout:write ret = 32 2024-09-12T02:41:11.333 INFO:tasks.workunit.client.0.smithi039.stdout:write ret = 32 2024-09-12T02:41:11.333 INFO:tasks.workunit.client.0.smithi039.stdout:pread ret = 64 2024-09-12T02:41:11.333 INFO:tasks.workunit.client.0.smithi039.stdout:65/600: open fd = 3 2024-09-12T02:41:11.333 INFO:tasks.workunit.client.0.smithi039.stdout:write ret = 32 2024-09-12T02:41:11.333 INFO:tasks.workunit.client.0.smithi039.stdout:write ret = 32 2024-09-12T02:41:11.333 INFO:tasks.workunit.client.0.smithi039.stdout:pread ret = 64 2024-09-12T02:41:11.333 INFO:tasks.workunit.client.0.smithi039.stdout:66/600: open fd = 3 2024-09-12T02:41:11.333 INFO:tasks.workunit.client.0.smithi039.stdout:write ret = 32 2024-09-12T02:41:11.333 INFO:tasks.workunit.client.0.smithi039.stdout:write ret = 32 2024-09-12T02:41:11.333 INFO:tasks.workunit.client.0.smithi039.stdout:pread ret = 64 2024-09-12T02:41:11.334 INFO:tasks.workunit.client.0.smithi039.stdout:67/600: open fd = 3 2024-09-12T02:41:11.334 INFO:tasks.workunit.client.0.smithi039.stdout:write ret = 32 2024-09-12T02:41:11.334 INFO:tasks.workunit.client.0.smithi039.stdout:write ret = 32 2024-09-12T02:41:11.334 INFO:tasks.workunit.client.0.smithi039.stdout:pread ret = 64 2024-09-12T02:41:11.334 INFO:tasks.workunit.client.0.smithi039.stdout:68/600: open fd = 3 2024-09-12T02:41:11.334 INFO:tasks.workunit.client.0.smithi039.stdout:write ret = 32 2024-09-12T02:41:11.334 INFO:tasks.workunit.client.0.smithi039.stdout:write ret = 32 2024-09-12T02:41:11.334 INFO:tasks.workunit.client.0.smithi039.stdout:pread ret = 64 2024-09-12T02:41:11.334 INFO:tasks.workunit.client.0.smithi039.stdout:69/600: open fd = 3 2024-09-12T02:41:11.334 INFO:tasks.workunit.client.0.smithi039.stdout:write ret = 32 2024-09-12T02:41:11.334 INFO:tasks.workunit.client.0.smithi039.stdout:write ret = 32 2024-09-12T02:41:11.334 INFO:tasks.workunit.client.0.smithi039.stdout:pread ret = 64 2024-09-12T02:41:11.334 INFO:tasks.workunit.client.0.smithi039.stdout:70/600: open fd = 3 2024-09-12T02:41:11.335 INFO:tasks.workunit.client.0.smithi039.stdout:write ret = 32 2024-09-12T02:41:11.335 INFO:tasks.workunit.client.0.smithi039.stdout:write ret = 32 2024-09-12T02:41:11.335 INFO:tasks.workunit.client.0.smithi039.stdout:pread ret = 64 2024-09-12T02:41:11.335 INFO:tasks.workunit.client.0.smithi039.stdout:71/600: open fd = 3 2024-09-12T02:41:11.335 INFO:tasks.workunit.client.0.smithi039.stdout:write ret = 32 2024-09-12T02:41:11.335 INFO:tasks.workunit.client.0.smithi039.stdout:write ret = 32 2024-09-12T02:41:11.335 INFO:tasks.workunit.client.0.smithi039.stdout:pread ret = 64 2024-09-12T02:41:11.335 INFO:tasks.workunit.client.0.smithi039.stdout:72/600: open fd = 3 2024-09-12T02:41:11.335 INFO:tasks.workunit.client.0.smithi039.stdout:write ret = 32 2024-09-12T02:41:11.335 INFO:tasks.workunit.client.0.smithi039.stdout:write ret = 32 2024-09-12T02:41:11.335 INFO:tasks.workunit.client.0.smithi039.stdout:pread ret = 64 2024-09-12T02:41:11.335 INFO:tasks.workunit.client.0.smithi039.stdout:73/600: open fd = 3 2024-09-12T02:41:11.335 INFO:tasks.workunit.client.0.smithi039.stdout:write ret = 32 2024-09-12T02:41:11.335 INFO:tasks.workunit.client.0.smithi039.stdout:write ret = 32 2024-09-12T02:41:11.336 INFO:tasks.workunit.client.0.smithi039.stdout:pread ret = 64 2024-09-12T02:41:11.336 INFO:tasks.workunit.client.0.smithi039.stdout:74/600: open fd = 3 2024-09-12T02:41:11.336 INFO:tasks.workunit.client.0.smithi039.stdout:write ret = 32 2024-09-12T02:41:11.336 INFO:tasks.workunit.client.0.smithi039.stdout:write ret = 32 2024-09-12T02:41:11.336 INFO:tasks.workunit.client.0.smithi039.stdout:pread ret = 64 2024-09-12T02:41:11.336 INFO:tasks.workunit.client.0.smithi039.stdout:75/600: open fd = 3 2024-09-12T02:41:11.336 INFO:tasks.workunit.client.0.smithi039.stdout:write ret = 32 2024-09-12T02:41:11.336 INFO:tasks.workunit.client.0.smithi039.stdout:write ret = 32 2024-09-12T02:41:11.336 INFO:tasks.workunit.client.0.smithi039.stdout:pread ret = 64 2024-09-12T02:41:11.336 INFO:tasks.workunit.client.0.smithi039.stdout:76/600: open fd = 3 2024-09-12T02:41:11.336 INFO:tasks.workunit.client.0.smithi039.stdout:write ret = 32 2024-09-12T02:41:11.336 INFO:tasks.workunit.client.0.smithi039.stdout:write ret = 32 2024-09-12T02:41:11.336 INFO:tasks.workunit.client.0.smithi039.stdout:pread ret = 64 2024-09-12T02:41:11.336 INFO:tasks.workunit.client.0.smithi039.stdout:77/600: open fd = 3 2024-09-12T02:41:11.337 INFO:tasks.workunit.client.0.smithi039.stdout:write ret = 32 2024-09-12T02:41:11.337 INFO:tasks.workunit.client.0.smithi039.stdout:write ret = 32 2024-09-12T02:41:11.337 INFO:tasks.workunit.client.0.smithi039.stdout:pread ret = 64 2024-09-12T02:41:11.337 INFO:tasks.workunit.client.0.smithi039.stdout:78/600: open fd = 3 2024-09-12T02:41:11.337 INFO:tasks.workunit.client.0.smithi039.stdout:write ret = 32 2024-09-12T02:41:11.337 INFO:tasks.workunit.client.0.smithi039.stdout:write ret = 32 2024-09-12T02:41:11.337 INFO:tasks.workunit.client.0.smithi039.stdout:pread ret = 64 2024-09-12T02:41:11.337 INFO:tasks.workunit.client.0.smithi039.stdout:79/600: open fd = 3 2024-09-12T02:41:11.337 INFO:tasks.workunit.client.0.smithi039.stdout:write ret = 32 2024-09-12T02:41:11.337 INFO:tasks.workunit.client.0.smithi039.stdout:write ret = 32 2024-09-12T02:41:11.337 INFO:tasks.workunit.client.0.smithi039.stdout:pread ret = 64 2024-09-12T02:41:11.337 INFO:tasks.workunit.client.0.smithi039.stdout:80/600: open fd = 3 2024-09-12T02:41:11.337 INFO:tasks.workunit.client.0.smithi039.stdout:write ret = 32 2024-09-12T02:41:11.338 INFO:tasks.workunit.client.0.smithi039.stdout:write ret = 32 2024-09-12T02:41:11.338 INFO:tasks.workunit.client.0.smithi039.stdout:pread ret = 64 2024-09-12T02:41:11.338 INFO:tasks.workunit.client.0.smithi039.stdout:81/600: open fd = 3 2024-09-12T02:41:11.338 INFO:tasks.workunit.client.0.smithi039.stdout:write ret = 32 2024-09-12T02:41:11.338 INFO:tasks.workunit.client.0.smithi039.stdout:write ret = 32 2024-09-12T02:41:11.338 INFO:tasks.workunit.client.0.smithi039.stdout:pread ret = 64 2024-09-12T02:41:11.338 INFO:tasks.workunit.client.0.smithi039.stdout:82/600: open fd = 3 2024-09-12T02:41:11.338 INFO:tasks.workunit.client.0.smithi039.stdout:write ret = 32 2024-09-12T02:41:11.338 INFO:tasks.workunit.client.0.smithi039.stdout:write ret = 32 2024-09-12T02:41:11.338 INFO:tasks.workunit.client.0.smithi039.stdout:pread ret = 64 2024-09-12T02:41:11.338 INFO:tasks.workunit.client.0.smithi039.stdout:83/600: open fd = 3 2024-09-12T02:41:11.338 INFO:tasks.workunit.client.0.smithi039.stdout:write ret = 32 2024-09-12T02:41:11.338 INFO:tasks.workunit.client.0.smithi039.stdout:write ret = 32 2024-09-12T02:41:11.338 INFO:tasks.workunit.client.0.smithi039.stdout:pread ret = 64 2024-09-12T02:41:11.338 INFO:tasks.workunit.client.0.smithi039.stdout:84/600: open fd = 3 2024-09-12T02:41:11.339 INFO:tasks.workunit.client.0.smithi039.stdout:write ret = 32 2024-09-12T02:41:11.339 INFO:tasks.workunit.client.0.smithi039.stdout:write ret = 32 2024-09-12T02:41:11.339 INFO:tasks.workunit.client.0.smithi039.stdout:pread ret = 64 2024-09-12T02:41:11.339 INFO:tasks.workunit.client.0.smithi039.stdout:85/600: open fd = 3 2024-09-12T02:41:11.339 INFO:tasks.workunit.client.0.smithi039.stdout:write ret = 32 2024-09-12T02:41:11.339 INFO:tasks.workunit.client.0.smithi039.stdout:write ret = 32 2024-09-12T02:41:11.339 INFO:tasks.workunit.client.0.smithi039.stdout:pread ret = 64 2024-09-12T02:41:11.339 INFO:tasks.workunit.client.0.smithi039.stdout:86/600: open fd = 3 2024-09-12T02:41:11.339 INFO:tasks.workunit.client.0.smithi039.stdout:write ret = 32 2024-09-12T02:41:11.339 INFO:tasks.workunit.client.0.smithi039.stdout:write ret = 32 2024-09-12T02:41:11.339 INFO:tasks.workunit.client.0.smithi039.stdout:pread ret = 64 2024-09-12T02:41:11.339 INFO:tasks.workunit.client.0.smithi039.stdout:87/600: open fd = 3 2024-09-12T02:41:11.339 INFO:tasks.workunit.client.0.smithi039.stdout:write ret = 32 2024-09-12T02:41:11.339 INFO:tasks.workunit.client.0.smithi039.stdout:write ret = 32 2024-09-12T02:41:11.340 INFO:tasks.workunit.client.0.smithi039.stdout:pread ret = 64 2024-09-12T02:41:11.340 INFO:tasks.workunit.client.0.smithi039.stdout:88/600: open fd = 3 2024-09-12T02:41:11.340 INFO:tasks.workunit.client.0.smithi039.stdout:write ret = 32 2024-09-12T02:41:11.340 INFO:tasks.workunit.client.0.smithi039.stdout:write ret = 32 2024-09-12T02:41:11.340 INFO:tasks.workunit.client.0.smithi039.stdout:pread ret = 64 2024-09-12T02:41:11.340 INFO:tasks.workunit.client.0.smithi039.stdout:89/600: open fd = 3 2024-09-12T02:41:11.340 INFO:tasks.workunit.client.0.smithi039.stdout:write ret = 32 2024-09-12T02:41:11.340 INFO:tasks.workunit.client.0.smithi039.stdout:write ret = 32 2024-09-12T02:41:11.340 INFO:tasks.workunit.client.0.smithi039.stdout:pread ret = 64 2024-09-12T02:41:11.340 INFO:tasks.workunit.client.0.smithi039.stdout:90/600: open fd = 3 2024-09-12T02:41:11.340 INFO:tasks.workunit.client.0.smithi039.stdout:write ret = 32 2024-09-12T02:41:11.340 INFO:tasks.workunit.client.0.smithi039.stdout:write ret = 32 2024-09-12T02:41:11.340 INFO:tasks.workunit.client.0.smithi039.stdout:pread ret = 64 2024-09-12T02:41:11.340 INFO:tasks.workunit.client.0.smithi039.stdout:91/600: open fd = 3 2024-09-12T02:41:11.341 INFO:tasks.workunit.client.0.smithi039.stdout:write ret = 32 2024-09-12T02:41:11.341 INFO:tasks.workunit.client.0.smithi039.stdout:write ret = 32 2024-09-12T02:41:11.341 INFO:tasks.workunit.client.0.smithi039.stdout:pread ret = 64 2024-09-12T02:41:11.341 INFO:tasks.workunit.client.0.smithi039.stdout:92/600: open fd = 3 2024-09-12T02:41:11.341 INFO:tasks.workunit.client.0.smithi039.stdout:write ret = 32 2024-09-12T02:41:11.341 INFO:tasks.workunit.client.0.smithi039.stdout:write ret = 32 2024-09-12T02:41:11.341 INFO:tasks.workunit.client.0.smithi039.stdout:pread ret = 64 2024-09-12T02:41:11.341 INFO:tasks.workunit.client.0.smithi039.stdout:93/600: open fd = 3 2024-09-12T02:41:11.341 INFO:tasks.workunit.client.0.smithi039.stdout:write ret = 32 2024-09-12T02:41:11.341 INFO:tasks.workunit.client.0.smithi039.stdout:write ret = 32 2024-09-12T02:41:11.341 INFO:tasks.workunit.client.0.smithi039.stdout:pread ret = 64 2024-09-12T02:41:11.341 INFO:tasks.workunit.client.0.smithi039.stdout:94/600: open fd = 3 2024-09-12T02:41:11.341 INFO:tasks.workunit.client.0.smithi039.stdout:write ret = 32 2024-09-12T02:41:11.341 INFO:tasks.workunit.client.0.smithi039.stdout:write ret = 32 2024-09-12T02:41:11.341 INFO:tasks.workunit.client.0.smithi039.stdout:pread ret = 64 2024-09-12T02:41:11.342 INFO:tasks.workunit.client.0.smithi039.stdout:95/600: open fd = 3 2024-09-12T02:41:11.342 INFO:tasks.workunit.client.0.smithi039.stdout:write ret = 32 2024-09-12T02:41:11.342 INFO:tasks.workunit.client.0.smithi039.stdout:write ret = 32 2024-09-12T02:41:11.342 INFO:tasks.workunit.client.0.smithi039.stdout:pread ret = 64 2024-09-12T02:41:11.342 INFO:tasks.workunit.client.0.smithi039.stdout:96/600: open fd = 3 2024-09-12T02:41:11.342 INFO:tasks.workunit.client.0.smithi039.stdout:write ret = 32 2024-09-12T02:41:11.342 INFO:tasks.workunit.client.0.smithi039.stdout:write ret = 32 2024-09-12T02:41:11.342 INFO:tasks.workunit.client.0.smithi039.stdout:pread ret = 64 2024-09-12T02:41:11.342 INFO:tasks.workunit.client.0.smithi039.stdout:97/600: open fd = 3 2024-09-12T02:41:11.342 INFO:tasks.workunit.client.0.smithi039.stdout:write ret = 32 2024-09-12T02:41:11.342 INFO:tasks.workunit.client.0.smithi039.stdout:write ret = 32 2024-09-12T02:41:11.342 INFO:tasks.workunit.client.0.smithi039.stdout:pread ret = 64 2024-09-12T02:41:11.342 INFO:tasks.workunit.client.0.smithi039.stdout:98/600: open fd = 3 2024-09-12T02:41:11.342 INFO:tasks.workunit.client.0.smithi039.stdout:write ret = 32 2024-09-12T02:41:11.343 INFO:tasks.workunit.client.0.smithi039.stdout:write ret = 32 2024-09-12T02:41:11.343 INFO:tasks.workunit.client.0.smithi039.stdout:pread ret = 64 2024-09-12T02:41:11.343 INFO:tasks.workunit.client.0.smithi039.stdout:99/600: open fd = 3 2024-09-12T02:41:11.343 INFO:tasks.workunit.client.0.smithi039.stdout:write ret = 32 2024-09-12T02:41:11.343 INFO:tasks.workunit.client.0.smithi039.stdout:write ret = 32 2024-09-12T02:41:11.343 INFO:tasks.workunit.client.0.smithi039.stdout:pread ret = 64 2024-09-12T02:41:11.343 INFO:tasks.workunit.client.0.smithi039.stdout:100/600: open fd = 3 2024-09-12T02:41:11.343 INFO:tasks.workunit.client.0.smithi039.stdout:write ret = 32 2024-09-12T02:41:11.343 INFO:tasks.workunit.client.0.smithi039.stdout:write ret = 32 2024-09-12T02:41:11.343 INFO:tasks.workunit.client.0.smithi039.stdout:pread ret = 64 2024-09-12T02:41:11.343 INFO:tasks.workunit.client.0.smithi039.stdout:101/600: open fd = 3 2024-09-12T02:41:11.343 INFO:tasks.workunit.client.0.smithi039.stdout:write ret = 32 2024-09-12T02:41:11.343 INFO:tasks.workunit.client.0.smithi039.stdout:write ret = 32 2024-09-12T02:41:11.343 INFO:tasks.workunit.client.0.smithi039.stdout:pread ret = 64 2024-09-12T02:41:11.343 INFO:tasks.workunit.client.0.smithi039.stdout:102/600: open fd = 3 2024-09-12T02:41:11.344 INFO:tasks.workunit.client.0.smithi039.stdout:write ret = 32 2024-09-12T02:41:11.344 INFO:tasks.workunit.client.0.smithi039.stdout:write ret = 32 2024-09-12T02:41:11.344 INFO:tasks.workunit.client.0.smithi039.stdout:pread ret = 64 2024-09-12T02:41:11.344 INFO:tasks.workunit.client.0.smithi039.stdout:103/600: open fd = 3 2024-09-12T02:41:11.344 INFO:tasks.workunit.client.0.smithi039.stdout:write ret = 32 2024-09-12T02:41:11.344 INFO:tasks.workunit.client.0.smithi039.stdout:write ret = 32 2024-09-12T02:41:11.344 INFO:tasks.workunit.client.0.smithi039.stdout:pread ret = 64 2024-09-12T02:41:11.344 INFO:tasks.workunit.client.0.smithi039.stdout:104/600: open fd = 3 2024-09-12T02:41:11.344 INFO:tasks.workunit.client.0.smithi039.stdout:write ret = 32 2024-09-12T02:41:11.344 INFO:tasks.workunit.client.0.smithi039.stdout:write ret = 32 2024-09-12T02:41:11.344 INFO:tasks.workunit.client.0.smithi039.stdout:pread ret = 64 2024-09-12T02:41:11.344 INFO:tasks.workunit.client.0.smithi039.stdout:105/600: open fd = 3 2024-09-12T02:41:11.344 INFO:tasks.workunit.client.0.smithi039.stdout:write ret = 32 2024-09-12T02:41:11.344 INFO:tasks.workunit.client.0.smithi039.stdout:write ret = 32 2024-09-12T02:41:11.345 INFO:tasks.workunit.client.0.smithi039.stdout:pread ret = 64 2024-09-12T02:41:11.345 INFO:tasks.workunit.client.0.smithi039.stdout:106/600: open fd = 3 2024-09-12T02:41:11.345 INFO:tasks.workunit.client.0.smithi039.stdout:write ret = 32 2024-09-12T02:41:11.345 INFO:tasks.workunit.client.0.smithi039.stdout:write ret = 32 2024-09-12T02:41:11.345 INFO:tasks.workunit.client.0.smithi039.stdout:pread ret = 64 2024-09-12T02:41:11.345 INFO:tasks.workunit.client.0.smithi039.stdout:107/600: open fd = 3 2024-09-12T02:41:11.345 INFO:tasks.workunit.client.0.smithi039.stdout:write ret = 32 2024-09-12T02:41:11.345 INFO:tasks.workunit.client.0.smithi039.stdout:write ret = 32 2024-09-12T02:41:11.345 INFO:tasks.workunit.client.0.smithi039.stdout:pread ret = 64 2024-09-12T02:41:11.345 INFO:tasks.workunit.client.0.smithi039.stdout:108/600: open fd = 3 2024-09-12T02:41:11.345 INFO:tasks.workunit.client.0.smithi039.stdout:write ret = 32 2024-09-12T02:41:11.345 INFO:tasks.workunit.client.0.smithi039.stdout:write ret = 32 2024-09-12T02:41:11.345 INFO:tasks.workunit.client.0.smithi039.stdout:pread ret = 64 2024-09-12T02:41:11.345 INFO:tasks.workunit.client.0.smithi039.stdout:109/600: open fd = 3 2024-09-12T02:41:11.345 INFO:tasks.workunit.client.0.smithi039.stdout:write ret = 32 2024-09-12T02:41:11.346 INFO:tasks.workunit.client.0.smithi039.stdout:write ret = 32 2024-09-12T02:41:11.346 INFO:tasks.workunit.client.0.smithi039.stdout:pread ret = 64 2024-09-12T02:41:11.346 INFO:tasks.workunit.client.0.smithi039.stdout:110/600: open fd = 3 2024-09-12T02:41:11.346 INFO:tasks.workunit.client.0.smithi039.stdout:write ret = 32 2024-09-12T02:41:11.346 INFO:tasks.workunit.client.0.smithi039.stdout:write ret = 32 2024-09-12T02:41:11.346 INFO:tasks.workunit.client.0.smithi039.stdout:pread ret = 64 2024-09-12T02:41:11.346 INFO:tasks.workunit.client.0.smithi039.stdout:111/600: open fd = 3 2024-09-12T02:41:11.346 INFO:tasks.workunit.client.0.smithi039.stdout:write ret = 32 2024-09-12T02:41:11.346 INFO:tasks.workunit.client.0.smithi039.stdout:write ret = 32 2024-09-12T02:41:11.346 INFO:tasks.workunit.client.0.smithi039.stdout:pread ret = 64 2024-09-12T02:41:11.346 INFO:tasks.workunit.client.0.smithi039.stdout:112/600: open fd = 3 2024-09-12T02:41:11.346 INFO:tasks.workunit.client.0.smithi039.stdout:write ret = 32 2024-09-12T02:41:11.346 INFO:tasks.workunit.client.0.smithi039.stdout:write ret = 32 2024-09-12T02:41:11.346 INFO:tasks.workunit.client.0.smithi039.stdout:pread ret = 64 2024-09-12T02:41:11.347 INFO:tasks.workunit.client.0.smithi039.stdout:113/600: open fd = 3 2024-09-12T02:41:11.347 INFO:tasks.workunit.client.0.smithi039.stdout:write ret = 32 2024-09-12T02:41:11.347 INFO:tasks.workunit.client.0.smithi039.stdout:write ret = 32 2024-09-12T02:41:11.347 INFO:tasks.workunit.client.0.smithi039.stdout:pread ret = 64 2024-09-12T02:41:11.347 INFO:tasks.workunit.client.0.smithi039.stdout:114/600: open fd = 3 2024-09-12T02:41:11.347 INFO:tasks.workunit.client.0.smithi039.stdout:write ret = 32 2024-09-12T02:41:11.347 INFO:tasks.workunit.client.0.smithi039.stdout:write ret = 32 2024-09-12T02:41:11.347 INFO:tasks.workunit.client.0.smithi039.stdout:pread ret = 64 2024-09-12T02:41:11.347 INFO:tasks.workunit.client.0.smithi039.stdout:115/600: open fd = 3 2024-09-12T02:41:11.347 INFO:tasks.workunit.client.0.smithi039.stdout:write ret = 32 2024-09-12T02:41:11.347 INFO:tasks.workunit.client.0.smithi039.stdout:write ret = 32 2024-09-12T02:41:11.347 INFO:tasks.workunit.client.0.smithi039.stdout:pread ret = 64 2024-09-12T02:41:11.347 INFO:tasks.workunit.client.0.smithi039.stdout:116/600: open fd = 3 2024-09-12T02:41:11.347 INFO:tasks.workunit.client.0.smithi039.stdout:write ret = 32 2024-09-12T02:41:11.348 INFO:tasks.workunit.client.0.smithi039.stdout:write ret = 32 2024-09-12T02:41:11.348 INFO:tasks.workunit.client.0.smithi039.stdout:pread ret = 64 2024-09-12T02:41:11.348 INFO:tasks.workunit.client.0.smithi039.stdout:117/600: open fd = 3 2024-09-12T02:41:11.348 INFO:tasks.workunit.client.0.smithi039.stdout:write ret = 32 2024-09-12T02:41:11.348 INFO:tasks.workunit.client.0.smithi039.stdout:write ret = 32 2024-09-12T02:41:11.348 INFO:tasks.workunit.client.0.smithi039.stdout:pread ret = 64 2024-09-12T02:41:11.348 INFO:tasks.workunit.client.0.smithi039.stdout:118/600: open fd = 3 2024-09-12T02:41:11.348 INFO:tasks.workunit.client.0.smithi039.stdout:write ret = 32 2024-09-12T02:41:11.348 INFO:tasks.workunit.client.0.smithi039.stdout:write ret = 32 2024-09-12T02:41:11.348 INFO:tasks.workunit.client.0.smithi039.stdout:pread ret = 64 2024-09-12T02:41:11.348 INFO:tasks.workunit.client.0.smithi039.stdout:119/600: open fd = 3 2024-09-12T02:41:11.348 INFO:tasks.workunit.client.0.smithi039.stdout:write ret = 32 2024-09-12T02:41:11.348 INFO:tasks.workunit.client.0.smithi039.stdout:write ret = 32 2024-09-12T02:41:11.348 INFO:tasks.workunit.client.0.smithi039.stdout:pread ret = 64 2024-09-12T02:41:11.349 INFO:tasks.workunit.client.0.smithi039.stdout:120/600: open fd = 3 2024-09-12T02:41:11.349 INFO:tasks.workunit.client.0.smithi039.stdout:write ret = 32 2024-09-12T02:41:11.349 INFO:tasks.workunit.client.0.smithi039.stdout:write ret = 32 2024-09-12T02:41:11.349 INFO:tasks.workunit.client.0.smithi039.stdout:pread ret = 64 2024-09-12T02:41:11.349 INFO:tasks.workunit.client.0.smithi039.stdout:121/600: open fd = 3 2024-09-12T02:41:11.349 INFO:tasks.workunit.client.0.smithi039.stdout:write ret = 32 2024-09-12T02:41:11.349 INFO:tasks.workunit.client.0.smithi039.stdout:write ret = 32 2024-09-12T02:41:11.349 INFO:tasks.workunit.client.0.smithi039.stdout:pread ret = 64 2024-09-12T02:41:11.349 INFO:tasks.workunit.client.0.smithi039.stdout:122/600: open fd = 3 2024-09-12T02:41:11.349 INFO:tasks.workunit.client.0.smithi039.stdout:write ret = 32 2024-09-12T02:41:11.349 INFO:tasks.workunit.client.0.smithi039.stdout:write ret = 32 2024-09-12T02:41:11.349 INFO:tasks.workunit.client.0.smithi039.stdout:pread ret = 64 2024-09-12T02:41:11.349 INFO:tasks.workunit.client.0.smithi039.stdout:123/600: open fd = 3 2024-09-12T02:41:11.349 INFO:tasks.workunit.client.0.smithi039.stdout:write ret = 32 2024-09-12T02:41:11.350 INFO:tasks.workunit.client.0.smithi039.stdout:write ret = 32 2024-09-12T02:41:11.350 INFO:tasks.workunit.client.0.smithi039.stdout:pread ret = 64 2024-09-12T02:41:11.350 INFO:tasks.workunit.client.0.smithi039.stdout:124/600: open fd = 3 2024-09-12T02:41:11.350 INFO:tasks.workunit.client.0.smithi039.stdout:write ret = 32 2024-09-12T02:41:11.350 INFO:tasks.workunit.client.0.smithi039.stdout:write ret = 32 2024-09-12T02:41:11.350 INFO:tasks.workunit.client.0.smithi039.stdout:pread ret = 64 2024-09-12T02:41:11.350 INFO:tasks.workunit.client.0.smithi039.stdout:125/600: open fd = 3 2024-09-12T02:41:11.350 INFO:tasks.workunit.client.0.smithi039.stdout:write ret = 32 2024-09-12T02:41:11.350 INFO:tasks.workunit.client.0.smithi039.stdout:write ret = 32 2024-09-12T02:41:11.350 INFO:tasks.workunit.client.0.smithi039.stdout:pread ret = 64 2024-09-12T02:41:11.350 INFO:tasks.workunit.client.0.smithi039.stdout:126/600: open fd = 3 2024-09-12T02:41:11.350 INFO:tasks.workunit.client.0.smithi039.stdout:write ret = 32 2024-09-12T02:41:11.698 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 12 02:41:11 smithi044 ceph-mon[35411]: pgmap v100: 129 pgs: 129 active+clean; 3.8 MiB data, 374 MiB used, 1.0 TiB / 1.0 TiB avail; 35 KiB/s rd, 45 KiB/s wr, 27 op/s 2024-09-12T02:41:11.763 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 12 02:41:11 smithi172 ceph-mon[35609]: pgmap v100: 129 pgs: 129 active+clean; 3.8 MiB data, 374 MiB used, 1.0 TiB / 1.0 TiB avail; 35 KiB/s rd, 45 KiB/s wr, 27 op/s 2024-09-12T02:41:11.849 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 02:41:11 smithi039 ceph-mon[30515]: pgmap v100: 129 pgs: 129 active+clean; 3.8 MiB data, 374 MiB used, 1.0 TiB / 1.0 TiB avail; 35 KiB/s rd, 45 KiB/s wr, 27 op/s 2024-09-12T02:41:13.698 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 12 02:41:13 smithi044 ceph-mon[35411]: pgmap v101: 129 pgs: 129 active+clean; 3.9 MiB data, 374 MiB used, 1.0 TiB / 1.0 TiB avail; 48 KiB/s rd, 57 KiB/s wr, 34 op/s 2024-09-12T02:41:13.763 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 12 02:41:13 smithi172 ceph-mon[35609]: pgmap v101: 129 pgs: 129 active+clean; 3.9 MiB data, 374 MiB used, 1.0 TiB / 1.0 TiB avail; 48 KiB/s rd, 57 KiB/s wr, 34 op/s 2024-09-12T02:41:13.850 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 02:41:13 smithi039 ceph-mon[30515]: pgmap v101: 129 pgs: 129 active+clean; 3.9 MiB data, 374 MiB used, 1.0 TiB / 1.0 TiB avail; 48 KiB/s rd, 57 KiB/s wr, 34 op/s 2024-09-12T02:41:15.763 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 12 02:41:15 smithi172 ceph-mon[35609]: pgmap v102: 129 pgs: 129 active+clean; 3.9 MiB data, 374 MiB used, 1.0 TiB / 1.0 TiB avail; 27 KiB/s rd, 25 KiB/s wr, 13 op/s 2024-09-12T02:41:15.849 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 02:41:15 smithi039 ceph-mon[30515]: pgmap v102: 129 pgs: 129 active+clean; 3.9 MiB data, 374 MiB used, 1.0 TiB / 1.0 TiB avail; 27 KiB/s rd, 25 KiB/s wr, 13 op/s 2024-09-12T02:41:15.948 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 12 02:41:15 smithi044 ceph-mon[35411]: pgmap v102: 129 pgs: 129 active+clean; 3.9 MiB data, 374 MiB used, 1.0 TiB / 1.0 TiB avail; 27 KiB/s rd, 25 KiB/s wr, 13 op/s 2024-09-12T02:41:17.763 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 12 02:41:17 smithi172 ceph-mon[35609]: pgmap v103: 129 pgs: 129 active+clean; 3.9 MiB data, 374 MiB used, 1.0 TiB / 1.0 TiB avail; 27 KiB/s rd, 25 KiB/s wr, 13 op/s 2024-09-12T02:41:17.850 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 02:41:17 smithi039 ceph-mon[30515]: pgmap v103: 129 pgs: 129 active+clean; 3.9 MiB data, 374 MiB used, 1.0 TiB / 1.0 TiB avail; 27 KiB/s rd, 25 KiB/s wr, 13 op/s 2024-09-12T02:41:17.949 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 12 02:41:17 smithi044 ceph-mon[35411]: pgmap v103: 129 pgs: 129 active+clean; 3.9 MiB data, 374 MiB used, 1.0 TiB / 1.0 TiB avail; 27 KiB/s rd, 25 KiB/s wr, 13 op/s 2024-09-12T02:41:19.763 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 12 02:41:19 smithi172 ceph-mon[35609]: pgmap v104: 129 pgs: 129 active+clean; 4.0 MiB data, 374 MiB used, 1.0 TiB / 1.0 TiB avail; 41 KiB/s rd, 38 KiB/s wr, 19 op/s 2024-09-12T02:41:19.850 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 02:41:19 smithi039 ceph-mon[30515]: pgmap v104: 129 pgs: 129 active+clean; 4.0 MiB data, 374 MiB used, 1.0 TiB / 1.0 TiB avail; 41 KiB/s rd, 38 KiB/s wr, 19 op/s 2024-09-12T02:41:19.948 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 12 02:41:19 smithi044 ceph-mon[35411]: pgmap v104: 129 pgs: 129 active+clean; 4.0 MiB data, 374 MiB used, 1.0 TiB / 1.0 TiB avail; 41 KiB/s rd, 38 KiB/s wr, 19 op/s 2024-09-12T02:41:21.763 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 12 02:41:21 smithi172 ceph-mon[35609]: pgmap v105: 129 pgs: 129 active+clean; 4.0 MiB data, 374 MiB used, 1.0 TiB / 1.0 TiB avail; 27 KiB/s rd, 25 KiB/s wr, 13 op/s 2024-09-12T02:41:21.850 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 02:41:21 smithi039 ceph-mon[30515]: pgmap v105: 129 pgs: 129 active+clean; 4.0 MiB data, 374 MiB used, 1.0 TiB / 1.0 TiB avail; 27 KiB/s rd, 25 KiB/s wr, 13 op/s 2024-09-12T02:41:21.948 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 12 02:41:21 smithi044 ceph-mon[35411]: pgmap v105: 129 pgs: 129 active+clean; 4.0 MiB data, 374 MiB used, 1.0 TiB / 1.0 TiB avail; 27 KiB/s rd, 25 KiB/s wr, 13 op/s 2024-09-12T02:41:23.764 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 12 02:41:23 smithi172 ceph-mon[35609]: pgmap v106: 129 pgs: 129 active+clean; 4.2 MiB data, 375 MiB used, 1.0 TiB / 1.0 TiB avail; 40 KiB/s rd, 37 KiB/s wr, 19 op/s 2024-09-12T02:41:23.849 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 02:41:23 smithi039 ceph-mon[30515]: pgmap v106: 129 pgs: 129 active+clean; 4.2 MiB data, 375 MiB used, 1.0 TiB / 1.0 TiB avail; 40 KiB/s rd, 37 KiB/s wr, 19 op/s 2024-09-12T02:41:23.948 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 12 02:41:23 smithi044 ceph-mon[35411]: pgmap v106: 129 pgs: 129 active+clean; 4.2 MiB data, 375 MiB used, 1.0 TiB / 1.0 TiB avail; 40 KiB/s rd, 37 KiB/s wr, 19 op/s 2024-09-12T02:41:25.765 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 12 02:41:25 smithi172 ceph-mon[35609]: pgmap v107: 129 pgs: 129 active+clean; 4.2 MiB data, 375 MiB used, 1.0 TiB / 1.0 TiB avail; 27 KiB/s rd, 25 KiB/s wr, 13 op/s 2024-09-12T02:41:25.850 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 02:41:25 smithi039 ceph-mon[30515]: pgmap v107: 129 pgs: 129 active+clean; 4.2 MiB data, 375 MiB used, 1.0 TiB / 1.0 TiB avail; 27 KiB/s rd, 25 KiB/s wr, 13 op/s 2024-09-12T02:41:25.948 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 12 02:41:25 smithi044 ceph-mon[35411]: pgmap v107: 129 pgs: 129 active+clean; 4.2 MiB data, 375 MiB used, 1.0 TiB / 1.0 TiB avail; 27 KiB/s rd, 25 KiB/s wr, 13 op/s 2024-09-12T02:41:27.764 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 12 02:41:27 smithi172 ceph-mon[35609]: pgmap v108: 129 pgs: 129 active+clean; 4.2 MiB data, 375 MiB used, 1.0 TiB / 1.0 TiB avail; 27 KiB/s rd, 25 KiB/s wr, 13 op/s 2024-09-12T02:41:27.850 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 02:41:27 smithi039 ceph-mon[30515]: pgmap v108: 129 pgs: 129 active+clean; 4.2 MiB data, 375 MiB used, 1.0 TiB / 1.0 TiB avail; 27 KiB/s rd, 25 KiB/s wr, 13 op/s 2024-09-12T02:41:27.948 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 12 02:41:27 smithi044 ceph-mon[35411]: pgmap v108: 129 pgs: 129 active+clean; 4.2 MiB data, 375 MiB used, 1.0 TiB / 1.0 TiB avail; 27 KiB/s rd, 25 KiB/s wr, 13 op/s 2024-09-12T02:41:29.764 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 12 02:41:29 smithi172 ceph-mon[35609]: pgmap v109: 129 pgs: 129 active+clean; 4.3 MiB data, 379 MiB used, 1.0 TiB / 1.0 TiB avail; 41 KiB/s rd, 38 KiB/s wr, 19 op/s 2024-09-12T02:41:29.849 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 02:41:29 smithi039 ceph-mon[30515]: pgmap v109: 129 pgs: 129 active+clean; 4.3 MiB data, 379 MiB used, 1.0 TiB / 1.0 TiB avail; 41 KiB/s rd, 38 KiB/s wr, 19 op/s 2024-09-12T02:41:29.948 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 12 02:41:29 smithi044 ceph-mon[35411]: pgmap v109: 129 pgs: 129 active+clean; 4.3 MiB data, 379 MiB used, 1.0 TiB / 1.0 TiB avail; 41 KiB/s rd, 38 KiB/s wr, 19 op/s 2024-09-12T02:41:31.850 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 02:41:31 smithi039 ceph-mon[30515]: pgmap v110: 129 pgs: 129 active+clean; 4.3 MiB data, 379 MiB used, 1.0 TiB / 1.0 TiB avail; 27 KiB/s rd, 24 KiB/s wr, 13 op/s 2024-09-12T02:41:31.948 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 12 02:41:31 smithi044 ceph-mon[35411]: pgmap v110: 129 pgs: 129 active+clean; 4.3 MiB data, 379 MiB used, 1.0 TiB / 1.0 TiB avail; 27 KiB/s rd, 24 KiB/s wr, 13 op/s 2024-09-12T02:41:32.013 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 12 02:41:31 smithi172 ceph-mon[35609]: pgmap v110: 129 pgs: 129 active+clean; 4.3 MiB data, 379 MiB used, 1.0 TiB / 1.0 TiB avail; 27 KiB/s rd, 24 KiB/s wr, 13 op/s 2024-09-12T02:41:33.849 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 02:41:33 smithi039 ceph-mon[30515]: pgmap v111: 129 pgs: 129 active+clean; 4.4 MiB data, 380 MiB used, 1.0 TiB / 1.0 TiB avail; 40 KiB/s rd, 37 KiB/s wr, 19 op/s 2024-09-12T02:41:33.948 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 12 02:41:33 smithi044 ceph-mon[35411]: pgmap v111: 129 pgs: 129 active+clean; 4.4 MiB data, 380 MiB used, 1.0 TiB / 1.0 TiB avail; 40 KiB/s rd, 37 KiB/s wr, 19 op/s 2024-09-12T02:41:34.013 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 12 02:41:33 smithi172 ceph-mon[35609]: pgmap v111: 129 pgs: 129 active+clean; 4.4 MiB data, 380 MiB used, 1.0 TiB / 1.0 TiB avail; 40 KiB/s rd, 37 KiB/s wr, 19 op/s 2024-09-12T02:41:35.849 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 02:41:35 smithi039 ceph-mon[30515]: pgmap v112: 129 pgs: 129 active+clean; 4.4 MiB data, 380 MiB used, 1.0 TiB / 1.0 TiB avail; 26 KiB/s rd, 25 KiB/s wr, 13 op/s 2024-09-12T02:41:35.948 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 12 02:41:35 smithi044 ceph-mon[35411]: pgmap v112: 129 pgs: 129 active+clean; 4.4 MiB data, 380 MiB used, 1.0 TiB / 1.0 TiB avail; 26 KiB/s rd, 25 KiB/s wr, 13 op/s 2024-09-12T02:41:36.013 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 12 02:41:35 smithi172 ceph-mon[35609]: pgmap v112: 129 pgs: 129 active+clean; 4.4 MiB data, 380 MiB used, 1.0 TiB / 1.0 TiB avail; 26 KiB/s rd, 25 KiB/s wr, 13 op/s 2024-09-12T02:41:37.850 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 02:41:37 smithi039 ceph-mon[30515]: pgmap v113: 129 pgs: 129 active+clean; 4.4 MiB data, 380 MiB used, 1.0 TiB / 1.0 TiB avail; 26 KiB/s rd, 25 KiB/s wr, 13 op/s 2024-09-12T02:41:37.948 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 12 02:41:37 smithi044 ceph-mon[35411]: pgmap v113: 129 pgs: 129 active+clean; 4.4 MiB data, 380 MiB used, 1.0 TiB / 1.0 TiB avail; 26 KiB/s rd, 25 KiB/s wr, 13 op/s 2024-09-12T02:41:38.013 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 12 02:41:37 smithi172 ceph-mon[35609]: pgmap v113: 129 pgs: 129 active+clean; 4.4 MiB data, 380 MiB used, 1.0 TiB / 1.0 TiB avail; 26 KiB/s rd, 25 KiB/s wr, 13 op/s 2024-09-12T02:41:39.850 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 02:41:39 smithi039 ceph-mon[30515]: pgmap v114: 129 pgs: 129 active+clean; 4.6 MiB data, 380 MiB used, 1.0 TiB / 1.0 TiB avail; 41 KiB/s rd, 38 KiB/s wr, 19 op/s 2024-09-12T02:41:39.948 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 12 02:41:39 smithi044 ceph-mon[35411]: pgmap v114: 129 pgs: 129 active+clean; 4.6 MiB data, 380 MiB used, 1.0 TiB / 1.0 TiB avail; 41 KiB/s rd, 38 KiB/s wr, 19 op/s 2024-09-12T02:41:40.013 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 12 02:41:39 smithi172 ceph-mon[35609]: pgmap v114: 129 pgs: 129 active+clean; 4.6 MiB data, 380 MiB used, 1.0 TiB / 1.0 TiB avail; 41 KiB/s rd, 38 KiB/s wr, 19 op/s 2024-09-12T02:41:41.850 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 02:41:41 smithi039 ceph-mon[30515]: pgmap v115: 129 pgs: 129 active+clean; 4.6 MiB data, 380 MiB used, 1.0 TiB / 1.0 TiB avail; 28 KiB/s rd, 26 KiB/s wr, 13 op/s 2024-09-12T02:41:41.948 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 12 02:41:41 smithi044 ceph-mon[35411]: pgmap v115: 129 pgs: 129 active+clean; 4.6 MiB data, 380 MiB used, 1.0 TiB / 1.0 TiB avail; 28 KiB/s rd, 26 KiB/s wr, 13 op/s 2024-09-12T02:41:42.013 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 12 02:41:41 smithi172 ceph-mon[35609]: pgmap v115: 129 pgs: 129 active+clean; 4.6 MiB data, 380 MiB used, 1.0 TiB / 1.0 TiB avail; 28 KiB/s rd, 26 KiB/s wr, 13 op/s 2024-09-12T02:41:43.851 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 02:41:43 smithi039 ceph-mon[30515]: pgmap v116: 129 pgs: 129 active+clean; 4.7 MiB data, 380 MiB used, 1.0 TiB / 1.0 TiB avail; 41 KiB/s rd, 38 KiB/s wr, 19 op/s 2024-09-12T02:41:43.948 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 12 02:41:43 smithi044 ceph-mon[35411]: pgmap v116: 129 pgs: 129 active+clean; 4.7 MiB data, 380 MiB used, 1.0 TiB / 1.0 TiB avail; 41 KiB/s rd, 38 KiB/s wr, 19 op/s 2024-09-12T02:41:44.013 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 12 02:41:43 smithi172 ceph-mon[35609]: pgmap v116: 129 pgs: 129 active+clean; 4.7 MiB data, 380 MiB used, 1.0 TiB / 1.0 TiB avail; 41 KiB/s rd, 38 KiB/s wr, 19 op/s 2024-09-12T02:41:45.850 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 02:41:45 smithi039 ceph-mon[30515]: pgmap v117: 129 pgs: 129 active+clean; 4.7 MiB data, 380 MiB used, 1.0 TiB / 1.0 TiB avail; 28 KiB/s rd, 25 KiB/s wr, 13 op/s 2024-09-12T02:41:45.948 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 12 02:41:45 smithi044 ceph-mon[35411]: pgmap v117: 129 pgs: 129 active+clean; 4.7 MiB data, 380 MiB used, 1.0 TiB / 1.0 TiB avail; 28 KiB/s rd, 25 KiB/s wr, 13 op/s 2024-09-12T02:41:46.013 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 12 02:41:45 smithi172 ceph-mon[35609]: pgmap v117: 129 pgs: 129 active+clean; 4.7 MiB data, 380 MiB used, 1.0 TiB / 1.0 TiB avail; 28 KiB/s rd, 25 KiB/s wr, 13 op/s 2024-09-12T02:41:47.850 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 02:41:47 smithi039 ceph-mon[30515]: pgmap v118: 129 pgs: 129 active+clean; 4.7 MiB data, 380 MiB used, 1.0 TiB / 1.0 TiB avail; 28 KiB/s rd, 25 KiB/s wr, 13 op/s 2024-09-12T02:41:47.948 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 12 02:41:47 smithi044 ceph-mon[35411]: pgmap v118: 129 pgs: 129 active+clean; 4.7 MiB data, 380 MiB used, 1.0 TiB / 1.0 TiB avail; 28 KiB/s rd, 25 KiB/s wr, 13 op/s 2024-09-12T02:41:48.013 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 12 02:41:47 smithi172 ceph-mon[35609]: pgmap v118: 129 pgs: 129 active+clean; 4.7 MiB data, 380 MiB used, 1.0 TiB / 1.0 TiB avail; 28 KiB/s rd, 25 KiB/s wr, 13 op/s 2024-09-12T02:41:49.849 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 02:41:49 smithi039 ceph-mon[30515]: pgmap v119: 129 pgs: 129 active+clean; 4.8 MiB data, 381 MiB used, 1.0 TiB / 1.0 TiB avail; 42 KiB/s rd, 38 KiB/s wr, 19 op/s 2024-09-12T02:41:49.948 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 12 02:41:49 smithi044 ceph-mon[35411]: pgmap v119: 129 pgs: 129 active+clean; 4.8 MiB data, 381 MiB used, 1.0 TiB / 1.0 TiB avail; 42 KiB/s rd, 38 KiB/s wr, 19 op/s 2024-09-12T02:41:50.014 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 12 02:41:49 smithi172 ceph-mon[35609]: pgmap v119: 129 pgs: 129 active+clean; 4.8 MiB data, 381 MiB used, 1.0 TiB / 1.0 TiB avail; 42 KiB/s rd, 38 KiB/s wr, 19 op/s 2024-09-12T02:41:51.850 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 02:41:51 smithi039 ceph-mon[30515]: pgmap v120: 129 pgs: 129 active+clean; 4.8 MiB data, 381 MiB used, 1.0 TiB / 1.0 TiB avail; 27 KiB/s rd, 25 KiB/s wr, 13 op/s 2024-09-12T02:41:51.948 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 12 02:41:51 smithi044 ceph-mon[35411]: pgmap v120: 129 pgs: 129 active+clean; 4.8 MiB data, 381 MiB used, 1.0 TiB / 1.0 TiB avail; 27 KiB/s rd, 25 KiB/s wr, 13 op/s 2024-09-12T02:41:52.013 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 12 02:41:51 smithi172 ceph-mon[35609]: pgmap v120: 129 pgs: 129 active+clean; 4.8 MiB data, 381 MiB used, 1.0 TiB / 1.0 TiB avail; 27 KiB/s rd, 25 KiB/s wr, 13 op/s 2024-09-12T02:41:53.949 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 12 02:41:53 smithi044 ceph-mon[35411]: pgmap v121: 129 pgs: 129 active+clean; 4.9 MiB data, 381 MiB used, 1.0 TiB / 1.0 TiB avail; 40 KiB/s rd, 37 KiB/s wr, 19 op/s 2024-09-12T02:41:54.013 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 12 02:41:53 smithi172 ceph-mon[35609]: pgmap v121: 129 pgs: 129 active+clean; 4.9 MiB data, 381 MiB used, 1.0 TiB / 1.0 TiB avail; 40 KiB/s rd, 37 KiB/s wr, 19 op/s 2024-09-12T02:41:54.100 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 02:41:53 smithi039 ceph-mon[30515]: pgmap v121: 129 pgs: 129 active+clean; 4.9 MiB data, 381 MiB used, 1.0 TiB / 1.0 TiB avail; 40 KiB/s rd, 37 KiB/s wr, 19 op/s 2024-09-12T02:41:55.948 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 12 02:41:55 smithi044 ceph-mon[35411]: pgmap v122: 129 pgs: 129 active+clean; 4.9 MiB data, 381 MiB used, 1.0 TiB / 1.0 TiB avail; 27 KiB/s rd, 25 KiB/s wr, 13 op/s 2024-09-12T02:41:56.013 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 12 02:41:55 smithi172 ceph-mon[35609]: pgmap v122: 129 pgs: 129 active+clean; 4.9 MiB data, 381 MiB used, 1.0 TiB / 1.0 TiB avail; 27 KiB/s rd, 25 KiB/s wr, 13 op/s 2024-09-12T02:41:56.100 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 02:41:55 smithi039 ceph-mon[30515]: pgmap v122: 129 pgs: 129 active+clean; 4.9 MiB data, 381 MiB used, 1.0 TiB / 1.0 TiB avail; 27 KiB/s rd, 25 KiB/s wr, 13 op/s 2024-09-12T02:41:57.948 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 12 02:41:57 smithi044 ceph-mon[35411]: pgmap v123: 129 pgs: 129 active+clean; 4.9 MiB data, 381 MiB used, 1.0 TiB / 1.0 TiB avail; 27 KiB/s rd, 25 KiB/s wr, 13 op/s 2024-09-12T02:41:58.017 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 12 02:41:57 smithi172 ceph-mon[35609]: pgmap v123: 129 pgs: 129 active+clean; 4.9 MiB data, 381 MiB used, 1.0 TiB / 1.0 TiB avail; 27 KiB/s rd, 25 KiB/s wr, 13 op/s 2024-09-12T02:41:58.099 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 02:41:57 smithi039 ceph-mon[30515]: pgmap v123: 129 pgs: 129 active+clean; 4.9 MiB data, 381 MiB used, 1.0 TiB / 1.0 TiB avail; 27 KiB/s rd, 25 KiB/s wr, 13 op/s 2024-09-12T02:41:59.948 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 12 02:41:59 smithi044 ceph-mon[35411]: pgmap v124: 129 pgs: 129 active+clean; 5.1 MiB data, 382 MiB used, 1.0 TiB / 1.0 TiB avail; 39 KiB/s rd, 39 KiB/s wr, 20 op/s 2024-09-12T02:42:00.013 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 12 02:41:59 smithi172 ceph-mon[35609]: pgmap v124: 129 pgs: 129 active+clean; 5.1 MiB data, 382 MiB used, 1.0 TiB / 1.0 TiB avail; 39 KiB/s rd, 39 KiB/s wr, 20 op/s 2024-09-12T02:42:00.100 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 02:41:59 smithi039 ceph-mon[30515]: pgmap v124: 129 pgs: 129 active+clean; 5.1 MiB data, 382 MiB used, 1.0 TiB / 1.0 TiB avail; 39 KiB/s rd, 39 KiB/s wr, 20 op/s 2024-09-12T02:42:01.949 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 12 02:42:01 smithi044 ceph-mon[35411]: pgmap v125: 129 pgs: 129 active+clean; 5.1 MiB data, 382 MiB used, 1.0 TiB / 1.0 TiB avail; 26 KiB/s rd, 26 KiB/s wr, 13 op/s 2024-09-12T02:42:02.013 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 12 02:42:01 smithi172 ceph-mon[35609]: pgmap v125: 129 pgs: 129 active+clean; 5.1 MiB data, 382 MiB used, 1.0 TiB / 1.0 TiB avail; 26 KiB/s rd, 26 KiB/s wr, 13 op/s 2024-09-12T02:42:02.100 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 02:42:01 smithi039 ceph-mon[30515]: pgmap v125: 129 pgs: 129 active+clean; 5.1 MiB data, 382 MiB used, 1.0 TiB / 1.0 TiB avail; 26 KiB/s rd, 26 KiB/s wr, 13 op/s 2024-09-12T02:42:03.948 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 12 02:42:03 smithi044 ceph-mon[35411]: pgmap v126: 129 pgs: 129 active+clean; 5.2 MiB data, 382 MiB used, 1.0 TiB / 1.0 TiB avail; 49 KiB/s rd, 61 KiB/s wr, 34 op/s 2024-09-12T02:42:04.013 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 12 02:42:03 smithi172 ceph-mon[35609]: pgmap v126: 129 pgs: 129 active+clean; 5.2 MiB data, 382 MiB used, 1.0 TiB / 1.0 TiB avail; 49 KiB/s rd, 61 KiB/s wr, 34 op/s 2024-09-12T02:42:04.099 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 02:42:03 smithi039 ceph-mon[30515]: pgmap v126: 129 pgs: 129 active+clean; 5.2 MiB data, 382 MiB used, 1.0 TiB / 1.0 TiB avail; 49 KiB/s rd, 61 KiB/s wr, 34 op/s 2024-09-12T02:42:05.948 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 12 02:42:05 smithi044 ceph-mon[35411]: pgmap v127: 129 pgs: 129 active+clean; 5.2 MiB data, 382 MiB used, 1.0 TiB / 1.0 TiB avail; 36 KiB/s rd, 49 KiB/s wr, 28 op/s 2024-09-12T02:42:05.949 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 12 02:42:05 smithi044 ceph-mon[35411]: from='mgr.25199 172.21.15.39:0/1270637502' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-12T02:42:06.013 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 12 02:42:05 smithi172 ceph-mon[35609]: pgmap v127: 129 pgs: 129 active+clean; 5.2 MiB data, 382 MiB used, 1.0 TiB / 1.0 TiB avail; 36 KiB/s rd, 49 KiB/s wr, 28 op/s 2024-09-12T02:42:06.013 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 12 02:42:05 smithi172 ceph-mon[35609]: from='mgr.25199 172.21.15.39:0/1270637502' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-12T02:42:06.099 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 02:42:05 smithi039 ceph-mon[30515]: pgmap v127: 129 pgs: 129 active+clean; 5.2 MiB data, 382 MiB used, 1.0 TiB / 1.0 TiB avail; 36 KiB/s rd, 49 KiB/s wr, 28 op/s 2024-09-12T02:42:06.100 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 02:42:05 smithi039 ceph-mon[30515]: from='mgr.25199 172.21.15.39:0/1270637502' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-12T02:42:06.948 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 12 02:42:06 smithi044 ceph-mon[35411]: from='mgr.25199 172.21.15.39:0/1270637502' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-12T02:42:06.949 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 12 02:42:06 smithi044 ceph-mon[35411]: from='mgr.25199 172.21.15.39:0/1270637502' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-12T02:42:06.949 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 12 02:42:06 smithi044 ceph-mon[35411]: from='mgr.25199 172.21.15.39:0/1270637502' entity='mgr.x' 2024-09-12T02:42:07.001 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 02:42:06 smithi039 ceph-mon[30515]: from='mgr.25199 172.21.15.39:0/1270637502' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-12T02:42:07.001 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 02:42:06 smithi039 ceph-mon[30515]: from='mgr.25199 172.21.15.39:0/1270637502' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-12T02:42:07.001 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 02:42:06 smithi039 ceph-mon[30515]: from='mgr.25199 172.21.15.39:0/1270637502' entity='mgr.x' 2024-09-12T02:42:07.013 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 12 02:42:06 smithi172 ceph-mon[35609]: from='mgr.25199 172.21.15.39:0/1270637502' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-12T02:42:07.014 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 12 02:42:06 smithi172 ceph-mon[35609]: from='mgr.25199 172.21.15.39:0/1270637502' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-12T02:42:07.014 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 12 02:42:06 smithi172 ceph-mon[35609]: from='mgr.25199 172.21.15.39:0/1270637502' entity='mgr.x' 2024-09-12T02:42:07.948 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 12 02:42:07 smithi044 ceph-mon[35411]: pgmap v128: 129 pgs: 129 active+clean; 5.2 MiB data, 382 MiB used, 1.0 TiB / 1.0 TiB avail; 36 KiB/s rd, 49 KiB/s wr, 28 op/s 2024-09-12T02:42:08.013 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 12 02:42:07 smithi172 ceph-mon[35609]: pgmap v128: 129 pgs: 129 active+clean; 5.2 MiB data, 382 MiB used, 1.0 TiB / 1.0 TiB avail; 36 KiB/s rd, 49 KiB/s wr, 28 op/s 2024-09-12T02:42:08.099 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 02:42:07 smithi039 ceph-mon[30515]: pgmap v128: 129 pgs: 129 active+clean; 5.2 MiB data, 382 MiB used, 1.0 TiB / 1.0 TiB avail; 36 KiB/s rd, 49 KiB/s wr, 28 op/s 2024-09-12T02:42:09.948 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 12 02:42:09 smithi044 ceph-mon[35411]: pgmap v129: 129 pgs: 129 active+clean; 5.4 MiB data, 382 MiB used, 1.0 TiB / 1.0 TiB avail; 52 KiB/s rd, 63 KiB/s wr, 35 op/s 2024-09-12T02:42:10.013 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 12 02:42:09 smithi172 ceph-mon[35609]: pgmap v129: 129 pgs: 129 active+clean; 5.4 MiB data, 382 MiB used, 1.0 TiB / 1.0 TiB avail; 52 KiB/s rd, 63 KiB/s wr, 35 op/s 2024-09-12T02:42:10.100 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 02:42:09 smithi039 ceph-mon[30515]: pgmap v129: 129 pgs: 129 active+clean; 5.4 MiB data, 382 MiB used, 1.0 TiB / 1.0 TiB avail; 52 KiB/s rd, 63 KiB/s wr, 35 op/s 2024-09-12T02:42:11.948 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 12 02:42:11 smithi044 ceph-mon[35411]: pgmap v130: 129 pgs: 129 active+clean; 5.4 MiB data, 382 MiB used, 1.0 TiB / 1.0 TiB avail; 39 KiB/s rd, 49 KiB/s wr, 28 op/s 2024-09-12T02:42:12.013 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 12 02:42:11 smithi172 ceph-mon[35609]: pgmap v130: 129 pgs: 129 active+clean; 5.4 MiB data, 382 MiB used, 1.0 TiB / 1.0 TiB avail; 39 KiB/s rd, 49 KiB/s wr, 28 op/s 2024-09-12T02:42:12.099 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 02:42:11 smithi039 ceph-mon[30515]: pgmap v130: 129 pgs: 129 active+clean; 5.4 MiB data, 382 MiB used, 1.0 TiB / 1.0 TiB avail; 39 KiB/s rd, 49 KiB/s wr, 28 op/s 2024-09-12T02:42:13.823 INFO:tasks.workunit.client.0.smithi039.stdout:write ret = 32 2024-09-12T02:42:13.824 INFO:tasks.workunit.client.0.smithi039.stdout:pread ret = 64 2024-09-12T02:42:13.824 INFO:tasks.workunit.client.0.smithi039.stdout:127/600: open fd = 3 2024-09-12T02:42:13.824 INFO:tasks.workunit.client.0.smithi039.stdout:write ret = 32 2024-09-12T02:42:13.824 INFO:tasks.workunit.client.0.smithi039.stdout:write ret = 32 2024-09-12T02:42:13.824 INFO:tasks.workunit.client.0.smithi039.stdout:pread ret = 64 2024-09-12T02:42:13.824 INFO:tasks.workunit.client.0.smithi039.stdout:128/600: open fd = 3 2024-09-12T02:42:13.824 INFO:tasks.workunit.client.0.smithi039.stdout:write ret = 32 2024-09-12T02:42:13.824 INFO:tasks.workunit.client.0.smithi039.stdout:write ret = 32 2024-09-12T02:42:13.824 INFO:tasks.workunit.client.0.smithi039.stdout:pread ret = 64 2024-09-12T02:42:13.824 INFO:tasks.workunit.client.0.smithi039.stdout:129/600: open fd = 3 2024-09-12T02:42:13.824 INFO:tasks.workunit.client.0.smithi039.stdout:write ret = 32 2024-09-12T02:42:13.825 INFO:tasks.workunit.client.0.smithi039.stdout:write ret = 32 2024-09-12T02:42:13.825 INFO:tasks.workunit.client.0.smithi039.stdout:pread ret = 64 2024-09-12T02:42:13.825 INFO:tasks.workunit.client.0.smithi039.stdout:130/600: open fd = 3 2024-09-12T02:42:13.825 INFO:tasks.workunit.client.0.smithi039.stdout:write ret = 32 2024-09-12T02:42:13.825 INFO:tasks.workunit.client.0.smithi039.stdout:write ret = 32 2024-09-12T02:42:13.825 INFO:tasks.workunit.client.0.smithi039.stdout:pread ret = 64 2024-09-12T02:42:13.825 INFO:tasks.workunit.client.0.smithi039.stdout:131/600: open fd = 3 2024-09-12T02:42:13.825 INFO:tasks.workunit.client.0.smithi039.stdout:write ret = 32 2024-09-12T02:42:13.825 INFO:tasks.workunit.client.0.smithi039.stdout:write ret = 32 2024-09-12T02:42:13.825 INFO:tasks.workunit.client.0.smithi039.stdout:pread ret = 64 2024-09-12T02:42:13.825 INFO:tasks.workunit.client.0.smithi039.stdout:132/600: open fd = 3 2024-09-12T02:42:13.825 INFO:tasks.workunit.client.0.smithi039.stdout:write ret = 32 2024-09-12T02:42:13.825 INFO:tasks.workunit.client.0.smithi039.stdout:write ret = 32 2024-09-12T02:42:13.825 INFO:tasks.workunit.client.0.smithi039.stdout:pread ret = 64 2024-09-12T02:42:13.826 INFO:tasks.workunit.client.0.smithi039.stdout:133/600: open fd = 3 2024-09-12T02:42:13.826 INFO:tasks.workunit.client.0.smithi039.stdout:write ret = 32 2024-09-12T02:42:13.826 INFO:tasks.workunit.client.0.smithi039.stdout:write ret = 32 2024-09-12T02:42:13.826 INFO:tasks.workunit.client.0.smithi039.stdout:pread ret = 64 2024-09-12T02:42:13.826 INFO:tasks.workunit.client.0.smithi039.stdout:134/600: open fd = 3 2024-09-12T02:42:13.826 INFO:tasks.workunit.client.0.smithi039.stdout:write ret = 32 2024-09-12T02:42:13.826 INFO:tasks.workunit.client.0.smithi039.stdout:write ret = 32 2024-09-12T02:42:13.826 INFO:tasks.workunit.client.0.smithi039.stdout:pread ret = 64 2024-09-12T02:42:13.826 INFO:tasks.workunit.client.0.smithi039.stdout:135/600: open fd = 3 2024-09-12T02:42:13.826 INFO:tasks.workunit.client.0.smithi039.stdout:write ret = 32 2024-09-12T02:42:13.826 INFO:tasks.workunit.client.0.smithi039.stdout:write ret = 32 2024-09-12T02:42:13.826 INFO:tasks.workunit.client.0.smithi039.stdout:pread ret = 64 2024-09-12T02:42:13.826 INFO:tasks.workunit.client.0.smithi039.stdout:136/600: open fd = 3 2024-09-12T02:42:13.827 INFO:tasks.workunit.client.0.smithi039.stdout:write ret = 32 2024-09-12T02:42:13.827 INFO:tasks.workunit.client.0.smithi039.stdout:write ret = 32 2024-09-12T02:42:13.827 INFO:tasks.workunit.client.0.smithi039.stdout:pread ret = 64 2024-09-12T02:42:13.827 INFO:tasks.workunit.client.0.smithi039.stdout:137/600: open fd = 3 2024-09-12T02:42:13.827 INFO:tasks.workunit.client.0.smithi039.stdout:write ret = 32 2024-09-12T02:42:13.827 INFO:tasks.workunit.client.0.smithi039.stdout:write ret = 32 2024-09-12T02:42:13.827 INFO:tasks.workunit.client.0.smithi039.stdout:pread ret = 64 2024-09-12T02:42:13.827 INFO:tasks.workunit.client.0.smithi039.stdout:138/600: open fd = 3 2024-09-12T02:42:13.827 INFO:tasks.workunit.client.0.smithi039.stdout:write ret = 32 2024-09-12T02:42:13.827 INFO:tasks.workunit.client.0.smithi039.stdout:write ret = 32 2024-09-12T02:42:13.827 INFO:tasks.workunit.client.0.smithi039.stdout:pread ret = 64 2024-09-12T02:42:13.827 INFO:tasks.workunit.client.0.smithi039.stdout:139/600: open fd = 3 2024-09-12T02:42:13.827 INFO:tasks.workunit.client.0.smithi039.stdout:write ret = 32 2024-09-12T02:42:13.828 INFO:tasks.workunit.client.0.smithi039.stdout:write ret = 32 2024-09-12T02:42:13.828 INFO:tasks.workunit.client.0.smithi039.stdout:pread ret = 64 2024-09-12T02:42:13.828 INFO:tasks.workunit.client.0.smithi039.stdout:140/600: open fd = 3 2024-09-12T02:42:13.828 INFO:tasks.workunit.client.0.smithi039.stdout:write ret = 32 2024-09-12T02:42:13.828 INFO:tasks.workunit.client.0.smithi039.stdout:write ret = 32 2024-09-12T02:42:13.828 INFO:tasks.workunit.client.0.smithi039.stdout:pread ret = 64 2024-09-12T02:42:13.828 INFO:tasks.workunit.client.0.smithi039.stdout:141/600: open fd = 3 2024-09-12T02:42:13.828 INFO:tasks.workunit.client.0.smithi039.stdout:write ret = 32 2024-09-12T02:42:13.828 INFO:tasks.workunit.client.0.smithi039.stdout:write ret = 32 2024-09-12T02:42:13.828 INFO:tasks.workunit.client.0.smithi039.stdout:pread ret = 64 2024-09-12T02:42:13.828 INFO:tasks.workunit.client.0.smithi039.stdout:142/600: open fd = 3 2024-09-12T02:42:13.828 INFO:tasks.workunit.client.0.smithi039.stdout:write ret = 32 2024-09-12T02:42:13.828 INFO:tasks.workunit.client.0.smithi039.stdout:write ret = 32 2024-09-12T02:42:13.829 INFO:tasks.workunit.client.0.smithi039.stdout:pread ret = 64 2024-09-12T02:42:13.829 INFO:tasks.workunit.client.0.smithi039.stdout:143/600: open fd = 3 2024-09-12T02:42:13.829 INFO:tasks.workunit.client.0.smithi039.stdout:write ret = 32 2024-09-12T02:42:13.829 INFO:tasks.workunit.client.0.smithi039.stdout:write ret = 32 2024-09-12T02:42:13.829 INFO:tasks.workunit.client.0.smithi039.stdout:pread ret = 64 2024-09-12T02:42:13.829 INFO:tasks.workunit.client.0.smithi039.stdout:144/600: open fd = 3 2024-09-12T02:42:13.829 INFO:tasks.workunit.client.0.smithi039.stdout:write ret = 32 2024-09-12T02:42:13.829 INFO:tasks.workunit.client.0.smithi039.stdout:write ret = 32 2024-09-12T02:42:13.829 INFO:tasks.workunit.client.0.smithi039.stdout:pread ret = 64 2024-09-12T02:42:13.829 INFO:tasks.workunit.client.0.smithi039.stdout:145/600: open fd = 3 2024-09-12T02:42:13.829 INFO:tasks.workunit.client.0.smithi039.stdout:write ret = 32 2024-09-12T02:42:13.829 INFO:tasks.workunit.client.0.smithi039.stdout:write ret = 32 2024-09-12T02:42:13.829 INFO:tasks.workunit.client.0.smithi039.stdout:pread ret = 64 2024-09-12T02:42:13.829 INFO:tasks.workunit.client.0.smithi039.stdout:146/600: open fd = 3 2024-09-12T02:42:13.830 INFO:tasks.workunit.client.0.smithi039.stdout:write ret = 32 2024-09-12T02:42:13.830 INFO:tasks.workunit.client.0.smithi039.stdout:write ret = 32 2024-09-12T02:42:13.830 INFO:tasks.workunit.client.0.smithi039.stdout:pread ret = 64 2024-09-12T02:42:13.830 INFO:tasks.workunit.client.0.smithi039.stdout:147/600: open fd = 3 2024-09-12T02:42:13.830 INFO:tasks.workunit.client.0.smithi039.stdout:write ret = 32 2024-09-12T02:42:13.830 INFO:tasks.workunit.client.0.smithi039.stdout:write ret = 32 2024-09-12T02:42:13.830 INFO:tasks.workunit.client.0.smithi039.stdout:pread ret = 64 2024-09-12T02:42:13.830 INFO:tasks.workunit.client.0.smithi039.stdout:148/600: open fd = 3 2024-09-12T02:42:13.830 INFO:tasks.workunit.client.0.smithi039.stdout:write ret = 32 2024-09-12T02:42:13.830 INFO:tasks.workunit.client.0.smithi039.stdout:write ret = 32 2024-09-12T02:42:13.830 INFO:tasks.workunit.client.0.smithi039.stdout:pread ret = 64 2024-09-12T02:42:13.830 INFO:tasks.workunit.client.0.smithi039.stdout:149/600: open fd = 3 2024-09-12T02:42:13.833 INFO:tasks.workunit.client.0.smithi039.stdout:write ret = 32 2024-09-12T02:42:13.833 INFO:tasks.workunit.client.0.smithi039.stdout:write ret = 32 2024-09-12T02:42:13.833 INFO:tasks.workunit.client.0.smithi039.stdout:pread ret = 64 2024-09-12T02:42:13.833 INFO:tasks.workunit.client.0.smithi039.stdout:150/600: open fd = 3 2024-09-12T02:42:13.833 INFO:tasks.workunit.client.0.smithi039.stdout:write ret = 32 2024-09-12T02:42:13.833 INFO:tasks.workunit.client.0.smithi039.stdout:write ret = 32 2024-09-12T02:42:13.833 INFO:tasks.workunit.client.0.smithi039.stdout:pread ret = 64 2024-09-12T02:42:13.833 INFO:tasks.workunit.client.0.smithi039.stdout:151/600: open fd = 3 2024-09-12T02:42:13.833 INFO:tasks.workunit.client.0.smithi039.stdout:write ret = 32 2024-09-12T02:42:13.833 INFO:tasks.workunit.client.0.smithi039.stdout:write ret = 32 2024-09-12T02:42:13.833 INFO:tasks.workunit.client.0.smithi039.stdout:pread ret = 64 2024-09-12T02:42:13.834 INFO:tasks.workunit.client.0.smithi039.stdout:152/600: open fd = 3 2024-09-12T02:42:13.834 INFO:tasks.workunit.client.0.smithi039.stdout:write ret = 32 2024-09-12T02:42:13.834 INFO:tasks.workunit.client.0.smithi039.stdout:write ret = 32 2024-09-12T02:42:13.834 INFO:tasks.workunit.client.0.smithi039.stdout:pread ret = 64 2024-09-12T02:42:13.834 INFO:tasks.workunit.client.0.smithi039.stdout:153/600: open fd = 3 2024-09-12T02:42:13.834 INFO:tasks.workunit.client.0.smithi039.stdout:write ret = 32 2024-09-12T02:42:13.834 INFO:tasks.workunit.client.0.smithi039.stdout:write ret = 32 2024-09-12T02:42:13.834 INFO:tasks.workunit.client.0.smithi039.stdout:pread ret = 64 2024-09-12T02:42:13.834 INFO:tasks.workunit.client.0.smithi039.stdout:154/600: open fd = 3 2024-09-12T02:42:13.834 INFO:tasks.workunit.client.0.smithi039.stdout:write ret = 32 2024-09-12T02:42:13.834 INFO:tasks.workunit.client.0.smithi039.stdout:write ret = 32 2024-09-12T02:42:13.834 INFO:tasks.workunit.client.0.smithi039.stdout:pread ret = 64 2024-09-12T02:42:13.834 INFO:tasks.workunit.client.0.smithi039.stdout:155/600: open fd = 3 2024-09-12T02:42:13.834 INFO:tasks.workunit.client.0.smithi039.stdout:write ret = 32 2024-09-12T02:42:13.835 INFO:tasks.workunit.client.0.smithi039.stdout:write ret = 32 2024-09-12T02:42:13.835 INFO:tasks.workunit.client.0.smithi039.stdout:pread ret = 64 2024-09-12T02:42:13.835 INFO:tasks.workunit.client.0.smithi039.stdout:156/600: open fd = 3 2024-09-12T02:42:13.835 INFO:tasks.workunit.client.0.smithi039.stdout:write ret = 32 2024-09-12T02:42:13.835 INFO:tasks.workunit.client.0.smithi039.stdout:write ret = 32 2024-09-12T02:42:13.835 INFO:tasks.workunit.client.0.smithi039.stdout:pread ret = 64 2024-09-12T02:42:13.835 INFO:tasks.workunit.client.0.smithi039.stdout:157/600: open fd = 3 2024-09-12T02:42:13.835 INFO:tasks.workunit.client.0.smithi039.stdout:write ret = 32 2024-09-12T02:42:13.835 INFO:tasks.workunit.client.0.smithi039.stdout:write ret = 32 2024-09-12T02:42:13.835 INFO:tasks.workunit.client.0.smithi039.stdout:pread ret = 64 2024-09-12T02:42:13.835 INFO:tasks.workunit.client.0.smithi039.stdout:158/600: open fd = 3 2024-09-12T02:42:13.835 INFO:tasks.workunit.client.0.smithi039.stdout:write ret = 32 2024-09-12T02:42:13.835 INFO:tasks.workunit.client.0.smithi039.stdout:write ret = 32 2024-09-12T02:42:13.836 INFO:tasks.workunit.client.0.smithi039.stdout:pread ret = 64 2024-09-12T02:42:13.836 INFO:tasks.workunit.client.0.smithi039.stdout:159/600: open fd = 3 2024-09-12T02:42:13.836 INFO:tasks.workunit.client.0.smithi039.stdout:write ret = 32 2024-09-12T02:42:13.836 INFO:tasks.workunit.client.0.smithi039.stdout:write ret = 32 2024-09-12T02:42:13.836 INFO:tasks.workunit.client.0.smithi039.stdout:pread ret = 64 2024-09-12T02:42:13.836 INFO:tasks.workunit.client.0.smithi039.stdout:160/600: open fd = 3 2024-09-12T02:42:13.836 INFO:tasks.workunit.client.0.smithi039.stdout:write ret = 32 2024-09-12T02:42:13.836 INFO:tasks.workunit.client.0.smithi039.stdout:write ret = 32 2024-09-12T02:42:13.836 INFO:tasks.workunit.client.0.smithi039.stdout:pread ret = 64 2024-09-12T02:42:13.836 INFO:tasks.workunit.client.0.smithi039.stdout:161/600: open fd = 3 2024-09-12T02:42:13.836 INFO:tasks.workunit.client.0.smithi039.stdout:write ret = 32 2024-09-12T02:42:13.836 INFO:tasks.workunit.client.0.smithi039.stdout:write ret = 32 2024-09-12T02:42:13.836 INFO:tasks.workunit.client.0.smithi039.stdout:pread ret = 64 2024-09-12T02:42:13.837 INFO:tasks.workunit.client.0.smithi039.stdout:162/600: open fd = 3 2024-09-12T02:42:13.837 INFO:tasks.workunit.client.0.smithi039.stdout:write ret = 32 2024-09-12T02:42:13.837 INFO:tasks.workunit.client.0.smithi039.stdout:write ret = 32 2024-09-12T02:42:13.837 INFO:tasks.workunit.client.0.smithi039.stdout:pread ret = 64 2024-09-12T02:42:13.837 INFO:tasks.workunit.client.0.smithi039.stdout:163/600: open fd = 3 2024-09-12T02:42:13.837 INFO:tasks.workunit.client.0.smithi039.stdout:write ret = 32 2024-09-12T02:42:13.837 INFO:tasks.workunit.client.0.smithi039.stdout:write ret = 32 2024-09-12T02:42:13.837 INFO:tasks.workunit.client.0.smithi039.stdout:pread ret = 64 2024-09-12T02:42:13.837 INFO:tasks.workunit.client.0.smithi039.stdout:164/600: open fd = 3 2024-09-12T02:42:13.837 INFO:tasks.workunit.client.0.smithi039.stdout:write ret = 32 2024-09-12T02:42:13.838 INFO:tasks.workunit.client.0.smithi039.stdout:write ret = 32 2024-09-12T02:42:13.838 INFO:tasks.workunit.client.0.smithi039.stdout:pread ret = 64 2024-09-12T02:42:13.838 INFO:tasks.workunit.client.0.smithi039.stdout:165/600: open fd = 3 2024-09-12T02:42:13.838 INFO:tasks.workunit.client.0.smithi039.stdout:write ret = 32 2024-09-12T02:42:13.838 INFO:tasks.workunit.client.0.smithi039.stdout:write ret = 32 2024-09-12T02:42:13.838 INFO:tasks.workunit.client.0.smithi039.stdout:pread ret = 64 2024-09-12T02:42:13.838 INFO:tasks.workunit.client.0.smithi039.stdout:166/600: open fd = 3 2024-09-12T02:42:13.838 INFO:tasks.workunit.client.0.smithi039.stdout:write ret = 32 2024-09-12T02:42:13.838 INFO:tasks.workunit.client.0.smithi039.stdout:write ret = 32 2024-09-12T02:42:13.838 INFO:tasks.workunit.client.0.smithi039.stdout:pread ret = 64 2024-09-12T02:42:13.838 INFO:tasks.workunit.client.0.smithi039.stdout:167/600: open fd = 3 2024-09-12T02:42:13.838 INFO:tasks.workunit.client.0.smithi039.stdout:write ret = 32 2024-09-12T02:42:13.839 INFO:tasks.workunit.client.0.smithi039.stdout:write ret = 32 2024-09-12T02:42:13.839 INFO:tasks.workunit.client.0.smithi039.stdout:pread ret = 64 2024-09-12T02:42:13.839 INFO:tasks.workunit.client.0.smithi039.stdout:168/600: open fd = 3 2024-09-12T02:42:13.839 INFO:tasks.workunit.client.0.smithi039.stdout:write ret = 32 2024-09-12T02:42:13.839 INFO:tasks.workunit.client.0.smithi039.stdout:write ret = 32 2024-09-12T02:42:13.839 INFO:tasks.workunit.client.0.smithi039.stdout:pread ret = 64 2024-09-12T02:42:13.839 INFO:tasks.workunit.client.0.smithi039.stdout:169/600: open fd = 3 2024-09-12T02:42:13.839 INFO:tasks.workunit.client.0.smithi039.stdout:write ret = 32 2024-09-12T02:42:13.839 INFO:tasks.workunit.client.0.smithi039.stdout:write ret = 32 2024-09-12T02:42:13.839 INFO:tasks.workunit.client.0.smithi039.stdout:pread ret = 64 2024-09-12T02:42:13.839 INFO:tasks.workunit.client.0.smithi039.stdout:170/600: open fd = 3 2024-09-12T02:42:13.839 INFO:tasks.workunit.client.0.smithi039.stdout:write ret = 32 2024-09-12T02:42:13.839 INFO:tasks.workunit.client.0.smithi039.stdout:write ret = 32 2024-09-12T02:42:13.840 INFO:tasks.workunit.client.0.smithi039.stdout:pread ret = 64 2024-09-12T02:42:13.840 INFO:tasks.workunit.client.0.smithi039.stdout:171/600: open fd = 3 2024-09-12T02:42:13.840 INFO:tasks.workunit.client.0.smithi039.stdout:write ret = 32 2024-09-12T02:42:13.840 INFO:tasks.workunit.client.0.smithi039.stdout:write ret = 32 2024-09-12T02:42:13.840 INFO:tasks.workunit.client.0.smithi039.stdout:pread ret = 64 2024-09-12T02:42:13.840 INFO:tasks.workunit.client.0.smithi039.stdout:172/600: open fd = 3 2024-09-12T02:42:13.840 INFO:tasks.workunit.client.0.smithi039.stdout:write ret = 32 2024-09-12T02:42:13.840 INFO:tasks.workunit.client.0.smithi039.stdout:write ret = 32 2024-09-12T02:42:13.840 INFO:tasks.workunit.client.0.smithi039.stdout:pread ret = 64 2024-09-12T02:42:13.840 INFO:tasks.workunit.client.0.smithi039.stdout:173/600: open fd = 3 2024-09-12T02:42:13.840 INFO:tasks.workunit.client.0.smithi039.stdout:write ret = 32 2024-09-12T02:42:13.840 INFO:tasks.workunit.client.0.smithi039.stdout:write ret = 32 2024-09-12T02:42:13.841 INFO:tasks.workunit.client.0.smithi039.stdout:pread ret = 64 2024-09-12T02:42:13.841 INFO:tasks.workunit.client.0.smithi039.stdout:174/600: open fd = 3 2024-09-12T02:42:13.841 INFO:tasks.workunit.client.0.smithi039.stdout:write ret = 32 2024-09-12T02:42:13.841 INFO:tasks.workunit.client.0.smithi039.stdout:write ret = 32 2024-09-12T02:42:13.841 INFO:tasks.workunit.client.0.smithi039.stdout:pread ret = 64 2024-09-12T02:42:13.841 INFO:tasks.workunit.client.0.smithi039.stdout:175/600: open fd = 3 2024-09-12T02:42:13.841 INFO:tasks.workunit.client.0.smithi039.stdout:write ret = 32 2024-09-12T02:42:13.841 INFO:tasks.workunit.client.0.smithi039.stdout:write ret = 32 2024-09-12T02:42:13.841 INFO:tasks.workunit.client.0.smithi039.stdout:pread ret = 64 2024-09-12T02:42:13.841 INFO:tasks.workunit.client.0.smithi039.stdout:176/600: open fd = 3 2024-09-12T02:42:13.841 INFO:tasks.workunit.client.0.smithi039.stdout:write ret = 32 2024-09-12T02:42:13.841 INFO:tasks.workunit.client.0.smithi039.stdout:write ret = 32 2024-09-12T02:42:13.842 INFO:tasks.workunit.client.0.smithi039.stdout:pread ret = 64 2024-09-12T02:42:13.842 INFO:tasks.workunit.client.0.smithi039.stdout:177/600: open fd = 3 2024-09-12T02:42:13.842 INFO:tasks.workunit.client.0.smithi039.stdout:write ret = 32 2024-09-12T02:42:13.842 INFO:tasks.workunit.client.0.smithi039.stdout:write ret = 32 2024-09-12T02:42:13.842 INFO:tasks.workunit.client.0.smithi039.stdout:pread ret = 64 2024-09-12T02:42:13.842 INFO:tasks.workunit.client.0.smithi039.stdout:178/600: open fd = 3 2024-09-12T02:42:13.842 INFO:tasks.workunit.client.0.smithi039.stdout:write ret = 32 2024-09-12T02:42:13.842 INFO:tasks.workunit.client.0.smithi039.stdout:write ret = 32 2024-09-12T02:42:13.842 INFO:tasks.workunit.client.0.smithi039.stdout:pread ret = 64 2024-09-12T02:42:13.842 INFO:tasks.workunit.client.0.smithi039.stdout:179/600: open fd = 3 2024-09-12T02:42:13.842 INFO:tasks.workunit.client.0.smithi039.stdout:write ret = 32 2024-09-12T02:42:13.842 INFO:tasks.workunit.client.0.smithi039.stdout:write ret = 32 2024-09-12T02:42:13.843 INFO:tasks.workunit.client.0.smithi039.stdout:pread ret = 64 2024-09-12T02:42:13.843 INFO:tasks.workunit.client.0.smithi039.stdout:180/600: open fd = 3 2024-09-12T02:42:13.843 INFO:tasks.workunit.client.0.smithi039.stdout:write ret = 32 2024-09-12T02:42:13.843 INFO:tasks.workunit.client.0.smithi039.stdout:write ret = 32 2024-09-12T02:42:13.843 INFO:tasks.workunit.client.0.smithi039.stdout:pread ret = 64 2024-09-12T02:42:13.843 INFO:tasks.workunit.client.0.smithi039.stdout:181/600: open fd = 3 2024-09-12T02:42:13.843 INFO:tasks.workunit.client.0.smithi039.stdout:write ret = 32 2024-09-12T02:42:13.843 INFO:tasks.workunit.client.0.smithi039.stdout:write ret = 32 2024-09-12T02:42:13.843 INFO:tasks.workunit.client.0.smithi039.stdout:pread ret = 64 2024-09-12T02:42:13.843 INFO:tasks.workunit.client.0.smithi039.stdout:182/600: open fd = 3 2024-09-12T02:42:13.843 INFO:tasks.workunit.client.0.smithi039.stdout:write ret = 32 2024-09-12T02:42:13.843 INFO:tasks.workunit.client.0.smithi039.stdout:write ret = 32 2024-09-12T02:42:13.843 INFO:tasks.workunit.client.0.smithi039.stdout:pread ret = 64 2024-09-12T02:42:13.843 INFO:tasks.workunit.client.0.smithi039.stdout:183/600: open fd = 3 2024-09-12T02:42:13.844 INFO:tasks.workunit.client.0.smithi039.stdout:write ret = 32 2024-09-12T02:42:13.844 INFO:tasks.workunit.client.0.smithi039.stdout:write ret = 32 2024-09-12T02:42:13.844 INFO:tasks.workunit.client.0.smithi039.stdout:pread ret = 64 2024-09-12T02:42:13.844 INFO:tasks.workunit.client.0.smithi039.stdout:184/600: open fd = 3 2024-09-12T02:42:13.844 INFO:tasks.workunit.client.0.smithi039.stdout:write ret = 32 2024-09-12T02:42:13.844 INFO:tasks.workunit.client.0.smithi039.stdout:write ret = 32 2024-09-12T02:42:13.844 INFO:tasks.workunit.client.0.smithi039.stdout:pread ret = 64 2024-09-12T02:42:13.844 INFO:tasks.workunit.client.0.smithi039.stdout:185/600: open fd = 3 2024-09-12T02:42:13.844 INFO:tasks.workunit.client.0.smithi039.stdout:write ret = 32 2024-09-12T02:42:13.844 INFO:tasks.workunit.client.0.smithi039.stdout:write ret = 32 2024-09-12T02:42:13.844 INFO:tasks.workunit.client.0.smithi039.stdout:pread ret = 64 2024-09-12T02:42:13.844 INFO:tasks.workunit.client.0.smithi039.stdout:186/600: open fd = 3 2024-09-12T02:42:13.844 INFO:tasks.workunit.client.0.smithi039.stdout:write ret = 32 2024-09-12T02:42:13.845 INFO:tasks.workunit.client.0.smithi039.stdout:write ret = 32 2024-09-12T02:42:13.845 INFO:tasks.workunit.client.0.smithi039.stdout:pread ret = 64 2024-09-12T02:42:13.845 INFO:tasks.workunit.client.0.smithi039.stdout:187/600: open fd = 3 2024-09-12T02:42:13.845 INFO:tasks.workunit.client.0.smithi039.stdout:write ret = 32 2024-09-12T02:42:13.845 INFO:tasks.workunit.client.0.smithi039.stdout:write ret = 32 2024-09-12T02:42:13.845 INFO:tasks.workunit.client.0.smithi039.stdout:pread ret = 64 2024-09-12T02:42:13.845 INFO:tasks.workunit.client.0.smithi039.stdout:188/600: open fd = 3 2024-09-12T02:42:13.845 INFO:tasks.workunit.client.0.smithi039.stdout:write ret = 32 2024-09-12T02:42:13.845 INFO:tasks.workunit.client.0.smithi039.stdout:write ret = 32 2024-09-12T02:42:13.948 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 12 02:42:13 smithi044 ceph-mon[35411]: pgmap v131: 129 pgs: 129 active+clean; 5.5 MiB data, 387 MiB used, 1.0 TiB / 1.0 TiB avail; 54 KiB/s rd, 62 KiB/s wr, 35 op/s 2024-09-12T02:42:14.013 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 12 02:42:13 smithi172 ceph-mon[35609]: pgmap v131: 129 pgs: 129 active+clean; 5.5 MiB data, 387 MiB used, 1.0 TiB / 1.0 TiB avail; 54 KiB/s rd, 62 KiB/s wr, 35 op/s 2024-09-12T02:42:14.099 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 02:42:13 smithi039 ceph-mon[30515]: pgmap v131: 129 pgs: 129 active+clean; 5.5 MiB data, 387 MiB used, 1.0 TiB / 1.0 TiB avail; 54 KiB/s rd, 62 KiB/s wr, 35 op/s 2024-09-12T02:42:15.948 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 12 02:42:15 smithi044 ceph-mon[35411]: pgmap v132: 129 pgs: 129 active+clean; 5.5 MiB data, 387 MiB used, 1.0 TiB / 1.0 TiB avail; 31 KiB/s rd, 27 KiB/s wr, 13 op/s 2024-09-12T02:42:16.013 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 12 02:42:15 smithi172 ceph-mon[35609]: pgmap v132: 129 pgs: 129 active+clean; 5.5 MiB data, 387 MiB used, 1.0 TiB / 1.0 TiB avail; 31 KiB/s rd, 27 KiB/s wr, 13 op/s 2024-09-12T02:42:16.099 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 02:42:15 smithi039 ceph-mon[30515]: pgmap v132: 129 pgs: 129 active+clean; 5.5 MiB data, 387 MiB used, 1.0 TiB / 1.0 TiB avail; 31 KiB/s rd, 27 KiB/s wr, 13 op/s 2024-09-12T02:42:17.949 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 12 02:42:17 smithi044 ceph-mon[35411]: pgmap v133: 129 pgs: 129 active+clean; 5.5 MiB data, 387 MiB used, 1.0 TiB / 1.0 TiB avail; 31 KiB/s rd, 27 KiB/s wr, 13 op/s 2024-09-12T02:42:18.014 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 12 02:42:17 smithi172 ceph-mon[35609]: pgmap v133: 129 pgs: 129 active+clean; 5.5 MiB data, 387 MiB used, 1.0 TiB / 1.0 TiB avail; 31 KiB/s rd, 27 KiB/s wr, 13 op/s 2024-09-12T02:42:18.100 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 02:42:17 smithi039 ceph-mon[30515]: pgmap v133: 129 pgs: 129 active+clean; 5.5 MiB data, 387 MiB used, 1.0 TiB / 1.0 TiB avail; 31 KiB/s rd, 27 KiB/s wr, 13 op/s 2024-09-12T02:42:19.948 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 12 02:42:19 smithi044 ceph-mon[35411]: pgmap v134: 129 pgs: 129 active+clean; 5.7 MiB data, 387 MiB used, 1.0 TiB / 1.0 TiB avail; 47 KiB/s rd, 42 KiB/s wr, 21 op/s 2024-09-12T02:42:20.013 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 12 02:42:19 smithi172 ceph-mon[35609]: pgmap v134: 129 pgs: 129 active+clean; 5.7 MiB data, 387 MiB used, 1.0 TiB / 1.0 TiB avail; 47 KiB/s rd, 42 KiB/s wr, 21 op/s 2024-09-12T02:42:20.099 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 02:42:19 smithi039 ceph-mon[30515]: pgmap v134: 129 pgs: 129 active+clean; 5.7 MiB data, 387 MiB used, 1.0 TiB / 1.0 TiB avail; 47 KiB/s rd, 42 KiB/s wr, 21 op/s 2024-09-12T02:42:22.013 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 12 02:42:21 smithi172 ceph-mon[35609]: pgmap v135: 129 pgs: 129 active+clean; 5.7 MiB data, 387 MiB used, 1.0 TiB / 1.0 TiB avail; 32 KiB/s rd, 29 KiB/s wr, 14 op/s 2024-09-12T02:42:22.099 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 02:42:21 smithi039 ceph-mon[30515]: pgmap v135: 129 pgs: 129 active+clean; 5.7 MiB data, 387 MiB used, 1.0 TiB / 1.0 TiB avail; 32 KiB/s rd, 29 KiB/s wr, 14 op/s 2024-09-12T02:42:22.198 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 12 02:42:21 smithi044 ceph-mon[35411]: pgmap v135: 129 pgs: 129 active+clean; 5.7 MiB data, 387 MiB used, 1.0 TiB / 1.0 TiB avail; 32 KiB/s rd, 29 KiB/s wr, 14 op/s 2024-09-12T02:42:24.013 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 12 02:42:23 smithi172 ceph-mon[35609]: pgmap v136: 129 pgs: 129 active+clean; 5.8 MiB data, 388 MiB used, 1.0 TiB / 1.0 TiB avail; 47 KiB/s rd, 42 KiB/s wr, 20 op/s 2024-09-12T02:42:24.099 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 02:42:23 smithi039 ceph-mon[30515]: pgmap v136: 129 pgs: 129 active+clean; 5.8 MiB data, 388 MiB used, 1.0 TiB / 1.0 TiB avail; 47 KiB/s rd, 42 KiB/s wr, 20 op/s 2024-09-12T02:42:24.198 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 12 02:42:23 smithi044 ceph-mon[35411]: pgmap v136: 129 pgs: 129 active+clean; 5.8 MiB data, 388 MiB used, 1.0 TiB / 1.0 TiB avail; 47 KiB/s rd, 42 KiB/s wr, 20 op/s 2024-09-12T02:42:26.013 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 12 02:42:25 smithi172 ceph-mon[35609]: pgmap v137: 129 pgs: 129 active+clean; 5.8 MiB data, 388 MiB used, 1.0 TiB / 1.0 TiB avail; 32 KiB/s rd, 29 KiB/s wr, 13 op/s 2024-09-12T02:42:26.099 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 02:42:25 smithi039 ceph-mon[30515]: pgmap v137: 129 pgs: 129 active+clean; 5.8 MiB data, 388 MiB used, 1.0 TiB / 1.0 TiB avail; 32 KiB/s rd, 29 KiB/s wr, 13 op/s 2024-09-12T02:42:26.198 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 12 02:42:25 smithi044 ceph-mon[35411]: pgmap v137: 129 pgs: 129 active+clean; 5.8 MiB data, 388 MiB used, 1.0 TiB / 1.0 TiB avail; 32 KiB/s rd, 29 KiB/s wr, 13 op/s 2024-09-12T02:42:28.013 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 12 02:42:27 smithi172 ceph-mon[35609]: pgmap v138: 129 pgs: 129 active+clean; 5.8 MiB data, 388 MiB used, 1.0 TiB / 1.0 TiB avail; 32 KiB/s rd, 29 KiB/s wr, 13 op/s 2024-09-12T02:42:28.099 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 02:42:27 smithi039 ceph-mon[30515]: pgmap v138: 129 pgs: 129 active+clean; 5.8 MiB data, 388 MiB used, 1.0 TiB / 1.0 TiB avail; 32 KiB/s rd, 29 KiB/s wr, 13 op/s 2024-09-12T02:42:28.198 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 12 02:42:27 smithi044 ceph-mon[35411]: pgmap v138: 129 pgs: 129 active+clean; 5.8 MiB data, 388 MiB used, 1.0 TiB / 1.0 TiB avail; 32 KiB/s rd, 29 KiB/s wr, 13 op/s 2024-09-12T02:42:30.014 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 12 02:42:29 smithi172 ceph-mon[35609]: pgmap v139: 129 pgs: 129 active+clean; 6.0 MiB data, 388 MiB used, 1.0 TiB / 1.0 TiB avail; 47 KiB/s rd, 42 KiB/s wr, 20 op/s 2024-09-12T02:42:30.100 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 02:42:29 smithi039 ceph-mon[30515]: pgmap v139: 129 pgs: 129 active+clean; 6.0 MiB data, 388 MiB used, 1.0 TiB / 1.0 TiB avail; 47 KiB/s rd, 42 KiB/s wr, 20 op/s 2024-09-12T02:42:30.198 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 12 02:42:29 smithi044 ceph-mon[35411]: pgmap v139: 129 pgs: 129 active+clean; 6.0 MiB data, 388 MiB used, 1.0 TiB / 1.0 TiB avail; 47 KiB/s rd, 42 KiB/s wr, 20 op/s 2024-09-12T02:42:32.001 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 12 02:42:31 smithi044 ceph-mon[35411]: pgmap v140: 129 pgs: 129 active+clean; 6.0 MiB data, 388 MiB used, 1.0 TiB / 1.0 TiB avail; 30 KiB/s rd, 27 KiB/s wr, 12 op/s 2024-09-12T02:42:32.013 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 12 02:42:31 smithi172 ceph-mon[35609]: pgmap v140: 129 pgs: 129 active+clean; 6.0 MiB data, 388 MiB used, 1.0 TiB / 1.0 TiB avail; 30 KiB/s rd, 27 KiB/s wr, 12 op/s 2024-09-12T02:42:32.099 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 02:42:31 smithi039 ceph-mon[30515]: pgmap v140: 129 pgs: 129 active+clean; 6.0 MiB data, 388 MiB used, 1.0 TiB / 1.0 TiB avail; 30 KiB/s rd, 27 KiB/s wr, 12 op/s 2024-09-12T02:42:34.013 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 12 02:42:33 smithi172 ceph-mon[35609]: pgmap v141: 129 pgs: 129 active+clean; 6.2 MiB data, 389 MiB used, 1.0 TiB / 1.0 TiB avail; 45 KiB/s rd, 40 KiB/s wr, 19 op/s 2024-09-12T02:42:34.099 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 02:42:33 smithi039 ceph-mon[30515]: pgmap v141: 129 pgs: 129 active+clean; 6.2 MiB data, 389 MiB used, 1.0 TiB / 1.0 TiB avail; 45 KiB/s rd, 40 KiB/s wr, 19 op/s 2024-09-12T02:42:34.198 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 12 02:42:33 smithi044 ceph-mon[35411]: pgmap v141: 129 pgs: 129 active+clean; 6.2 MiB data, 389 MiB used, 1.0 TiB / 1.0 TiB avail; 45 KiB/s rd, 40 KiB/s wr, 19 op/s 2024-09-12T02:42:36.100 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 02:42:35 smithi039 ceph-mon[30515]: pgmap v142: 129 pgs: 129 active+clean; 6.2 MiB data, 389 MiB used, 1.0 TiB / 1.0 TiB avail; 30 KiB/s rd, 27 KiB/s wr, 13 op/s 2024-09-12T02:42:36.198 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 12 02:42:35 smithi044 ceph-mon[35411]: pgmap v142: 129 pgs: 129 active+clean; 6.2 MiB data, 389 MiB used, 1.0 TiB / 1.0 TiB avail; 30 KiB/s rd, 27 KiB/s wr, 13 op/s 2024-09-12T02:42:36.263 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 12 02:42:35 smithi172 ceph-mon[35609]: pgmap v142: 129 pgs: 129 active+clean; 6.2 MiB data, 389 MiB used, 1.0 TiB / 1.0 TiB avail; 30 KiB/s rd, 27 KiB/s wr, 13 op/s 2024-09-12T02:42:38.100 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 02:42:37 smithi039 ceph-mon[30515]: pgmap v143: 129 pgs: 129 active+clean; 6.2 MiB data, 389 MiB used, 1.0 TiB / 1.0 TiB avail; 30 KiB/s rd, 27 KiB/s wr, 13 op/s 2024-09-12T02:42:38.198 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 12 02:42:37 smithi044 ceph-mon[35411]: pgmap v143: 129 pgs: 129 active+clean; 6.2 MiB data, 389 MiB used, 1.0 TiB / 1.0 TiB avail; 30 KiB/s rd, 27 KiB/s wr, 13 op/s 2024-09-12T02:42:38.263 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 12 02:42:37 smithi172 ceph-mon[35609]: pgmap v143: 129 pgs: 129 active+clean; 6.2 MiB data, 389 MiB used, 1.0 TiB / 1.0 TiB avail; 30 KiB/s rd, 27 KiB/s wr, 13 op/s 2024-09-12T02:42:40.099 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 02:42:39 smithi039 ceph-mon[30515]: pgmap v144: 129 pgs: 129 active+clean; 6.3 MiB data, 389 MiB used, 1.0 TiB / 1.0 TiB avail; 47 KiB/s rd, 39 KiB/s wr, 19 op/s 2024-09-12T02:42:40.198 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 12 02:42:39 smithi044 ceph-mon[35411]: pgmap v144: 129 pgs: 129 active+clean; 6.3 MiB data, 389 MiB used, 1.0 TiB / 1.0 TiB avail; 47 KiB/s rd, 39 KiB/s wr, 19 op/s 2024-09-12T02:42:40.263 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 12 02:42:39 smithi172 ceph-mon[35609]: pgmap v144: 129 pgs: 129 active+clean; 6.3 MiB data, 389 MiB used, 1.0 TiB / 1.0 TiB avail; 47 KiB/s rd, 39 KiB/s wr, 19 op/s 2024-09-12T02:42:42.100 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 02:42:41 smithi039 ceph-mon[30515]: pgmap v145: 129 pgs: 129 active+clean; 6.3 MiB data, 389 MiB used, 1.0 TiB / 1.0 TiB avail; 31 KiB/s rd, 26 KiB/s wr, 12 op/s 2024-09-12T02:42:42.198 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 12 02:42:41 smithi044 ceph-mon[35411]: pgmap v145: 129 pgs: 129 active+clean; 6.3 MiB data, 389 MiB used, 1.0 TiB / 1.0 TiB avail; 31 KiB/s rd, 26 KiB/s wr, 12 op/s 2024-09-12T02:42:42.263 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 12 02:42:41 smithi172 ceph-mon[35609]: pgmap v145: 129 pgs: 129 active+clean; 6.3 MiB data, 389 MiB used, 1.0 TiB / 1.0 TiB avail; 31 KiB/s rd, 26 KiB/s wr, 12 op/s 2024-09-12T02:42:44.100 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 02:42:43 smithi039 ceph-mon[30515]: pgmap v146: 129 pgs: 129 active+clean; 6.4 MiB data, 390 MiB used, 1.0 TiB / 1.0 TiB avail; 46 KiB/s rd, 39 KiB/s wr, 19 op/s 2024-09-12T02:42:44.198 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 12 02:42:43 smithi044 ceph-mon[35411]: pgmap v146: 129 pgs: 129 active+clean; 6.4 MiB data, 390 MiB used, 1.0 TiB / 1.0 TiB avail; 46 KiB/s rd, 39 KiB/s wr, 19 op/s 2024-09-12T02:42:44.263 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 12 02:42:43 smithi172 ceph-mon[35609]: pgmap v146: 129 pgs: 129 active+clean; 6.4 MiB data, 390 MiB used, 1.0 TiB / 1.0 TiB avail; 46 KiB/s rd, 39 KiB/s wr, 19 op/s 2024-09-12T02:42:46.099 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 02:42:45 smithi039 ceph-mon[30515]: pgmap v147: 129 pgs: 129 active+clean; 6.4 MiB data, 390 MiB used, 1.0 TiB / 1.0 TiB avail; 31 KiB/s rd, 25 KiB/s wr, 12 op/s 2024-09-12T02:42:46.198 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 12 02:42:45 smithi044 ceph-mon[35411]: pgmap v147: 129 pgs: 129 active+clean; 6.4 MiB data, 390 MiB used, 1.0 TiB / 1.0 TiB avail; 31 KiB/s rd, 25 KiB/s wr, 12 op/s 2024-09-12T02:42:46.263 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 12 02:42:45 smithi172 ceph-mon[35609]: pgmap v147: 129 pgs: 129 active+clean; 6.4 MiB data, 390 MiB used, 1.0 TiB / 1.0 TiB avail; 31 KiB/s rd, 25 KiB/s wr, 12 op/s 2024-09-12T02:42:48.099 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 02:42:47 smithi039 ceph-mon[30515]: pgmap v148: 129 pgs: 129 active+clean; 6.4 MiB data, 390 MiB used, 1.0 TiB / 1.0 TiB avail; 31 KiB/s rd, 25 KiB/s wr, 12 op/s 2024-09-12T02:42:48.198 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 12 02:42:47 smithi044 ceph-mon[35411]: pgmap v148: 129 pgs: 129 active+clean; 6.4 MiB data, 390 MiB used, 1.0 TiB / 1.0 TiB avail; 31 KiB/s rd, 25 KiB/s wr, 12 op/s 2024-09-12T02:42:48.263 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 12 02:42:47 smithi172 ceph-mon[35609]: pgmap v148: 129 pgs: 129 active+clean; 6.4 MiB data, 390 MiB used, 1.0 TiB / 1.0 TiB avail; 31 KiB/s rd, 25 KiB/s wr, 12 op/s 2024-09-12T02:42:50.100 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 02:42:49 smithi039 ceph-mon[30515]: pgmap v149: 129 pgs: 129 active+clean; 6.6 MiB data, 390 MiB used, 1.0 TiB / 1.0 TiB avail; 47 KiB/s rd, 40 KiB/s wr, 19 op/s 2024-09-12T02:42:50.200 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 12 02:42:49 smithi044 ceph-mon[35411]: pgmap v149: 129 pgs: 129 active+clean; 6.6 MiB data, 390 MiB used, 1.0 TiB / 1.0 TiB avail; 47 KiB/s rd, 40 KiB/s wr, 19 op/s 2024-09-12T02:42:50.263 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 12 02:42:49 smithi172 ceph-mon[35609]: pgmap v149: 129 pgs: 129 active+clean; 6.6 MiB data, 390 MiB used, 1.0 TiB / 1.0 TiB avail; 47 KiB/s rd, 40 KiB/s wr, 19 op/s 2024-09-12T02:42:52.100 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 02:42:51 smithi039 ceph-mon[30515]: pgmap v150: 129 pgs: 129 active+clean; 6.6 MiB data, 390 MiB used, 1.0 TiB / 1.0 TiB avail; 30 KiB/s rd, 27 KiB/s wr, 13 op/s 2024-09-12T02:42:52.198 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 12 02:42:51 smithi044 ceph-mon[35411]: pgmap v150: 129 pgs: 129 active+clean; 6.6 MiB data, 390 MiB used, 1.0 TiB / 1.0 TiB avail; 30 KiB/s rd, 27 KiB/s wr, 13 op/s 2024-09-12T02:42:52.263 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 12 02:42:51 smithi172 ceph-mon[35609]: pgmap v150: 129 pgs: 129 active+clean; 6.6 MiB data, 390 MiB used, 1.0 TiB / 1.0 TiB avail; 30 KiB/s rd, 27 KiB/s wr, 13 op/s 2024-09-12T02:42:53.198 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 12 02:42:52 smithi044 ceph-mon[35411]: pgmap v151: 129 pgs: 129 active+clean; 6.7 MiB data, 391 MiB used, 1.0 TiB / 1.0 TiB avail; 45 KiB/s rd, 41 KiB/s wr, 19 op/s 2024-09-12T02:42:53.265 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 12 02:42:52 smithi172 ceph-mon[35609]: pgmap v151: 129 pgs: 129 active+clean; 6.7 MiB data, 391 MiB used, 1.0 TiB / 1.0 TiB avail; 45 KiB/s rd, 41 KiB/s wr, 19 op/s 2024-09-12T02:42:53.350 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 02:42:52 smithi039 ceph-mon[30515]: pgmap v151: 129 pgs: 129 active+clean; 6.7 MiB data, 391 MiB used, 1.0 TiB / 1.0 TiB avail; 45 KiB/s rd, 41 KiB/s wr, 19 op/s 2024-09-12T02:42:55.448 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 12 02:42:55 smithi044 ceph-mon[35411]: pgmap v152: 129 pgs: 129 active+clean; 6.7 MiB data, 391 MiB used, 1.0 TiB / 1.0 TiB avail; 30 KiB/s rd, 27 KiB/s wr, 13 op/s 2024-09-12T02:42:55.513 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 12 02:42:55 smithi172 ceph-mon[35609]: pgmap v152: 129 pgs: 129 active+clean; 6.7 MiB data, 391 MiB used, 1.0 TiB / 1.0 TiB avail; 30 KiB/s rd, 27 KiB/s wr, 13 op/s 2024-09-12T02:42:55.600 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 02:42:55 smithi039 ceph-mon[30515]: pgmap v152: 129 pgs: 129 active+clean; 6.7 MiB data, 391 MiB used, 1.0 TiB / 1.0 TiB avail; 30 KiB/s rd, 27 KiB/s wr, 13 op/s 2024-09-12T02:42:57.448 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 12 02:42:57 smithi044 ceph-mon[35411]: pgmap v153: 129 pgs: 129 active+clean; 6.7 MiB data, 391 MiB used, 1.0 TiB / 1.0 TiB avail; 30 KiB/s rd, 27 KiB/s wr, 13 op/s 2024-09-12T02:42:57.513 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 12 02:42:57 smithi172 ceph-mon[35609]: pgmap v153: 129 pgs: 129 active+clean; 6.7 MiB data, 391 MiB used, 1.0 TiB / 1.0 TiB avail; 30 KiB/s rd, 27 KiB/s wr, 13 op/s 2024-09-12T02:42:57.599 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 02:42:57 smithi039 ceph-mon[30515]: pgmap v153: 129 pgs: 129 active+clean; 6.7 MiB data, 391 MiB used, 1.0 TiB / 1.0 TiB avail; 30 KiB/s rd, 27 KiB/s wr, 13 op/s 2024-09-12T02:42:59.448 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 12 02:42:59 smithi044 ceph-mon[35411]: pgmap v154: 129 pgs: 129 active+clean; 6.9 MiB data, 391 MiB used, 1.0 TiB / 1.0 TiB avail; 47 KiB/s rd, 43 KiB/s wr, 20 op/s 2024-09-12T02:42:59.513 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 12 02:42:59 smithi172 ceph-mon[35609]: pgmap v154: 129 pgs: 129 active+clean; 6.9 MiB data, 391 MiB used, 1.0 TiB / 1.0 TiB avail; 47 KiB/s rd, 43 KiB/s wr, 20 op/s 2024-09-12T02:42:59.599 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 02:42:59 smithi039 ceph-mon[30515]: pgmap v154: 129 pgs: 129 active+clean; 6.9 MiB data, 391 MiB used, 1.0 TiB / 1.0 TiB avail; 47 KiB/s rd, 43 KiB/s wr, 20 op/s 2024-09-12T02:43:01.448 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 12 02:43:01 smithi044 ceph-mon[35411]: pgmap v155: 129 pgs: 129 active+clean; 6.9 MiB data, 391 MiB used, 1.0 TiB / 1.0 TiB avail; 32 KiB/s rd, 29 KiB/s wr, 13 op/s 2024-09-12T02:43:01.514 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 12 02:43:01 smithi172 ceph-mon[35609]: pgmap v155: 129 pgs: 129 active+clean; 6.9 MiB data, 391 MiB used, 1.0 TiB / 1.0 TiB avail; 32 KiB/s rd, 29 KiB/s wr, 13 op/s 2024-09-12T02:43:01.599 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 02:43:01 smithi039 ceph-mon[30515]: pgmap v155: 129 pgs: 129 active+clean; 6.9 MiB data, 391 MiB used, 1.0 TiB / 1.0 TiB avail; 32 KiB/s rd, 29 KiB/s wr, 13 op/s 2024-09-12T02:43:03.448 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 12 02:43:03 smithi044 ceph-mon[35411]: pgmap v156: 129 pgs: 129 active+clean; 7.1 MiB data, 392 MiB used, 1.0 TiB / 1.0 TiB avail; 57 KiB/s rd, 65 KiB/s wr, 34 op/s 2024-09-12T02:43:03.513 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 12 02:43:03 smithi172 ceph-mon[35609]: pgmap v156: 129 pgs: 129 active+clean; 7.1 MiB data, 392 MiB used, 1.0 TiB / 1.0 TiB avail; 57 KiB/s rd, 65 KiB/s wr, 34 op/s 2024-09-12T02:43:03.599 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 02:43:03 smithi039 ceph-mon[30515]: pgmap v156: 129 pgs: 129 active+clean; 7.1 MiB data, 392 MiB used, 1.0 TiB / 1.0 TiB avail; 57 KiB/s rd, 65 KiB/s wr, 34 op/s 2024-09-12T02:43:05.448 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 12 02:43:05 smithi044 ceph-mon[35411]: pgmap v157: 129 pgs: 129 active+clean; 7.1 MiB data, 392 MiB used, 1.0 TiB / 1.0 TiB avail; 42 KiB/s rd, 52 KiB/s wr, 28 op/s 2024-09-12T02:43:05.513 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 12 02:43:05 smithi172 ceph-mon[35609]: pgmap v157: 129 pgs: 129 active+clean; 7.1 MiB data, 392 MiB used, 1.0 TiB / 1.0 TiB avail; 42 KiB/s rd, 52 KiB/s wr, 28 op/s 2024-09-12T02:43:05.599 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 02:43:05 smithi039 ceph-mon[30515]: pgmap v157: 129 pgs: 129 active+clean; 7.1 MiB data, 392 MiB used, 1.0 TiB / 1.0 TiB avail; 42 KiB/s rd, 52 KiB/s wr, 28 op/s 2024-09-12T02:43:07.401 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 02:43:07 smithi039 ceph-mon[30515]: pgmap v158: 129 pgs: 129 active+clean; 7.1 MiB data, 392 MiB used, 1.0 TiB / 1.0 TiB avail; 42 KiB/s rd, 52 KiB/s wr, 28 op/s 2024-09-12T02:43:07.401 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 02:43:07 smithi039 ceph-mon[30515]: from='mgr.25199 172.21.15.39:0/1270637502' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-12T02:43:07.448 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 12 02:43:07 smithi044 ceph-mon[35411]: pgmap v158: 129 pgs: 129 active+clean; 7.1 MiB data, 392 MiB used, 1.0 TiB / 1.0 TiB avail; 42 KiB/s rd, 52 KiB/s wr, 28 op/s 2024-09-12T02:43:07.448 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 12 02:43:07 smithi044 ceph-mon[35411]: from='mgr.25199 172.21.15.39:0/1270637502' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-12T02:43:07.513 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 12 02:43:07 smithi172 ceph-mon[35609]: pgmap v158: 129 pgs: 129 active+clean; 7.1 MiB data, 392 MiB used, 1.0 TiB / 1.0 TiB avail; 42 KiB/s rd, 52 KiB/s wr, 28 op/s 2024-09-12T02:43:07.513 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 12 02:43:07 smithi172 ceph-mon[35609]: from='mgr.25199 172.21.15.39:0/1270637502' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-12T02:43:08.448 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 12 02:43:08 smithi044 ceph-mon[35411]: from='mgr.25199 172.21.15.39:0/1270637502' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-12T02:43:08.449 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 12 02:43:08 smithi044 ceph-mon[35411]: from='mgr.25199 172.21.15.39:0/1270637502' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-12T02:43:08.449 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 12 02:43:08 smithi044 ceph-mon[35411]: from='mgr.25199 172.21.15.39:0/1270637502' entity='mgr.x' 2024-09-12T02:43:08.513 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 12 02:43:08 smithi172 ceph-mon[35609]: from='mgr.25199 172.21.15.39:0/1270637502' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-12T02:43:08.513 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 12 02:43:08 smithi172 ceph-mon[35609]: from='mgr.25199 172.21.15.39:0/1270637502' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-12T02:43:08.514 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 12 02:43:08 smithi172 ceph-mon[35609]: from='mgr.25199 172.21.15.39:0/1270637502' entity='mgr.x' 2024-09-12T02:43:08.600 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 02:43:08 smithi039 ceph-mon[30515]: from='mgr.25199 172.21.15.39:0/1270637502' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-12T02:43:08.600 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 02:43:08 smithi039 ceph-mon[30515]: from='mgr.25199 172.21.15.39:0/1270637502' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-12T02:43:08.600 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 02:43:08 smithi039 ceph-mon[30515]: from='mgr.25199 172.21.15.39:0/1270637502' entity='mgr.x' 2024-09-12T02:43:09.513 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 12 02:43:09 smithi172 ceph-mon[35609]: pgmap v159: 129 pgs: 129 active+clean; 7.3 MiB data, 392 MiB used, 1.0 TiB / 1.0 TiB avail; 60 KiB/s rd, 69 KiB/s wr, 34 op/s 2024-09-12T02:43:09.599 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 02:43:09 smithi039 ceph-mon[30515]: pgmap v159: 129 pgs: 129 active+clean; 7.3 MiB data, 392 MiB used, 1.0 TiB / 1.0 TiB avail; 60 KiB/s rd, 69 KiB/s wr, 34 op/s 2024-09-12T02:43:09.698 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 12 02:43:09 smithi044 ceph-mon[35411]: pgmap v159: 129 pgs: 129 active+clean; 7.3 MiB data, 392 MiB used, 1.0 TiB / 1.0 TiB avail; 60 KiB/s rd, 69 KiB/s wr, 34 op/s 2024-09-12T02:43:11.513 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 12 02:43:11 smithi172 ceph-mon[35609]: pgmap v160: 129 pgs: 129 active+clean; 7.3 MiB data, 392 MiB used, 1.0 TiB / 1.0 TiB avail; 43 KiB/s rd, 53 KiB/s wr, 27 op/s 2024-09-12T02:43:11.600 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 02:43:11 smithi039 ceph-mon[30515]: pgmap v160: 129 pgs: 129 active+clean; 7.3 MiB data, 392 MiB used, 1.0 TiB / 1.0 TiB avail; 43 KiB/s rd, 53 KiB/s wr, 27 op/s 2024-09-12T02:43:11.699 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 12 02:43:11 smithi044 ceph-mon[35411]: pgmap v160: 129 pgs: 129 active+clean; 7.3 MiB data, 392 MiB used, 1.0 TiB / 1.0 TiB avail; 43 KiB/s rd, 53 KiB/s wr, 27 op/s 2024-09-12T02:43:13.514 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 12 02:43:13 smithi172 ceph-mon[35609]: pgmap v161: 129 pgs: 129 active+clean; 7.4 MiB data, 393 MiB used, 1.0 TiB / 1.0 TiB avail; 60 KiB/s rd, 69 KiB/s wr, 34 op/s 2024-09-12T02:43:13.600 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 02:43:13 smithi039 ceph-mon[30515]: pgmap v161: 129 pgs: 129 active+clean; 7.4 MiB data, 393 MiB used, 1.0 TiB / 1.0 TiB avail; 60 KiB/s rd, 69 KiB/s wr, 34 op/s 2024-09-12T02:43:13.698 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 12 02:43:13 smithi044 ceph-mon[35411]: pgmap v161: 129 pgs: 129 active+clean; 7.4 MiB data, 393 MiB used, 1.0 TiB / 1.0 TiB avail; 60 KiB/s rd, 69 KiB/s wr, 34 op/s 2024-09-12T02:43:15.513 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 12 02:43:15 smithi172 ceph-mon[35609]: pgmap v162: 129 pgs: 129 active+clean; 7.4 MiB data, 393 MiB used, 1.0 TiB / 1.0 TiB avail; 35 KiB/s rd, 32 KiB/s wr, 13 op/s 2024-09-12T02:43:15.599 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 02:43:15 smithi039 ceph-mon[30515]: pgmap v162: 129 pgs: 129 active+clean; 7.4 MiB data, 393 MiB used, 1.0 TiB / 1.0 TiB avail; 35 KiB/s rd, 32 KiB/s wr, 13 op/s 2024-09-12T02:43:15.698 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 12 02:43:15 smithi044 ceph-mon[35411]: pgmap v162: 129 pgs: 129 active+clean; 7.4 MiB data, 393 MiB used, 1.0 TiB / 1.0 TiB avail; 35 KiB/s rd, 32 KiB/s wr, 13 op/s 2024-09-12T02:43:16.327 INFO:tasks.workunit.client.0.smithi039.stdout:pread ret = 64 2024-09-12T02:43:16.328 INFO:tasks.workunit.client.0.smithi039.stdout:189/600: open fd = 3 2024-09-12T02:43:16.328 INFO:tasks.workunit.client.0.smithi039.stdout:write ret = 32 2024-09-12T02:43:16.328 INFO:tasks.workunit.client.0.smithi039.stdout:write ret = 32 2024-09-12T02:43:16.328 INFO:tasks.workunit.client.0.smithi039.stdout:pread ret = 64 2024-09-12T02:43:16.328 INFO:tasks.workunit.client.0.smithi039.stdout:190/600: open fd = 3 2024-09-12T02:43:16.328 INFO:tasks.workunit.client.0.smithi039.stdout:write ret = 32 2024-09-12T02:43:16.328 INFO:tasks.workunit.client.0.smithi039.stdout:write ret = 32 2024-09-12T02:43:16.328 INFO:tasks.workunit.client.0.smithi039.stdout:pread ret = 64 2024-09-12T02:43:16.328 INFO:tasks.workunit.client.0.smithi039.stdout:191/600: open fd = 3 2024-09-12T02:43:16.328 INFO:tasks.workunit.client.0.smithi039.stdout:write ret = 32 2024-09-12T02:43:16.329 INFO:tasks.workunit.client.0.smithi039.stdout:write ret = 32 2024-09-12T02:43:16.329 INFO:tasks.workunit.client.0.smithi039.stdout:pread ret = 64 2024-09-12T02:43:16.329 INFO:tasks.workunit.client.0.smithi039.stdout:192/600: open fd = 3 2024-09-12T02:43:16.329 INFO:tasks.workunit.client.0.smithi039.stdout:write ret = 32 2024-09-12T02:43:16.329 INFO:tasks.workunit.client.0.smithi039.stdout:write ret = 32 2024-09-12T02:43:16.329 INFO:tasks.workunit.client.0.smithi039.stdout:pread ret = 64 2024-09-12T02:43:16.329 INFO:tasks.workunit.client.0.smithi039.stdout:193/600: open fd = 3 2024-09-12T02:43:16.329 INFO:tasks.workunit.client.0.smithi039.stdout:write ret = 32 2024-09-12T02:43:16.329 INFO:tasks.workunit.client.0.smithi039.stdout:write ret = 32 2024-09-12T02:43:16.329 INFO:tasks.workunit.client.0.smithi039.stdout:pread ret = 64 2024-09-12T02:43:16.329 INFO:tasks.workunit.client.0.smithi039.stdout:194/600: open fd = 3 2024-09-12T02:43:16.330 INFO:tasks.workunit.client.0.smithi039.stdout:write ret = 32 2024-09-12T02:43:16.330 INFO:tasks.workunit.client.0.smithi039.stdout:write ret = 32 2024-09-12T02:43:16.330 INFO:tasks.workunit.client.0.smithi039.stdout:pread ret = 64 2024-09-12T02:43:16.330 INFO:tasks.workunit.client.0.smithi039.stdout:195/600: open fd = 3 2024-09-12T02:43:16.330 INFO:tasks.workunit.client.0.smithi039.stdout:write ret = 32 2024-09-12T02:43:16.330 INFO:tasks.workunit.client.0.smithi039.stdout:write ret = 32 2024-09-12T02:43:16.330 INFO:tasks.workunit.client.0.smithi039.stdout:pread ret = 64 2024-09-12T02:43:16.330 INFO:tasks.workunit.client.0.smithi039.stdout:196/600: open fd = 3 2024-09-12T02:43:16.330 INFO:tasks.workunit.client.0.smithi039.stdout:write ret = 32 2024-09-12T02:43:16.330 INFO:tasks.workunit.client.0.smithi039.stdout:write ret = 32 2024-09-12T02:43:16.330 INFO:tasks.workunit.client.0.smithi039.stdout:pread ret = 64 2024-09-12T02:43:16.330 INFO:tasks.workunit.client.0.smithi039.stdout:197/600: open fd = 3 2024-09-12T02:43:16.330 INFO:tasks.workunit.client.0.smithi039.stdout:write ret = 32 2024-09-12T02:43:16.330 INFO:tasks.workunit.client.0.smithi039.stdout:write ret = 32 2024-09-12T02:43:16.331 INFO:tasks.workunit.client.0.smithi039.stdout:pread ret = 64 2024-09-12T02:43:16.331 INFO:tasks.workunit.client.0.smithi039.stdout:198/600: open fd = 3 2024-09-12T02:43:16.331 INFO:tasks.workunit.client.0.smithi039.stdout:write ret = 32 2024-09-12T02:43:16.331 INFO:tasks.workunit.client.0.smithi039.stdout:write ret = 32 2024-09-12T02:43:16.331 INFO:tasks.workunit.client.0.smithi039.stdout:pread ret = 64 2024-09-12T02:43:16.331 INFO:tasks.workunit.client.0.smithi039.stdout:199/600: open fd = 3 2024-09-12T02:43:16.331 INFO:tasks.workunit.client.0.smithi039.stdout:write ret = 32 2024-09-12T02:43:16.331 INFO:tasks.workunit.client.0.smithi039.stdout:write ret = 32 2024-09-12T02:43:16.331 INFO:tasks.workunit.client.0.smithi039.stdout:pread ret = 64 2024-09-12T02:43:16.331 INFO:tasks.workunit.client.0.smithi039.stdout:200/600: open fd = 3 2024-09-12T02:43:16.331 INFO:tasks.workunit.client.0.smithi039.stdout:write ret = 32 2024-09-12T02:43:16.331 INFO:tasks.workunit.client.0.smithi039.stdout:write ret = 32 2024-09-12T02:43:16.331 INFO:tasks.workunit.client.0.smithi039.stdout:pread ret = 64 2024-09-12T02:43:16.332 INFO:tasks.workunit.client.0.smithi039.stdout:201/600: open fd = 3 2024-09-12T02:43:16.332 INFO:tasks.workunit.client.0.smithi039.stdout:write ret = 32 2024-09-12T02:43:16.332 INFO:tasks.workunit.client.0.smithi039.stdout:write ret = 32 2024-09-12T02:43:16.332 INFO:tasks.workunit.client.0.smithi039.stdout:pread ret = 64 2024-09-12T02:43:16.332 INFO:tasks.workunit.client.0.smithi039.stdout:202/600: open fd = 3 2024-09-12T02:43:16.332 INFO:tasks.workunit.client.0.smithi039.stdout:write ret = 32 2024-09-12T02:43:16.332 INFO:tasks.workunit.client.0.smithi039.stdout:write ret = 32 2024-09-12T02:43:16.332 INFO:tasks.workunit.client.0.smithi039.stdout:pread ret = 64 2024-09-12T02:43:16.332 INFO:tasks.workunit.client.0.smithi039.stdout:203/600: open fd = 3 2024-09-12T02:43:16.332 INFO:tasks.workunit.client.0.smithi039.stdout:write ret = 32 2024-09-12T02:43:16.332 INFO:tasks.workunit.client.0.smithi039.stdout:write ret = 32 2024-09-12T02:43:16.332 INFO:tasks.workunit.client.0.smithi039.stdout:pread ret = 64 2024-09-12T02:43:16.332 INFO:tasks.workunit.client.0.smithi039.stdout:204/600: open fd = 3 2024-09-12T02:43:16.333 INFO:tasks.workunit.client.0.smithi039.stdout:write ret = 32 2024-09-12T02:43:16.333 INFO:tasks.workunit.client.0.smithi039.stdout:write ret = 32 2024-09-12T02:43:16.333 INFO:tasks.workunit.client.0.smithi039.stdout:pread ret = 64 2024-09-12T02:43:16.333 INFO:tasks.workunit.client.0.smithi039.stdout:205/600: open fd = 3 2024-09-12T02:43:16.333 INFO:tasks.workunit.client.0.smithi039.stdout:write ret = 32 2024-09-12T02:43:16.333 INFO:tasks.workunit.client.0.smithi039.stdout:write ret = 32 2024-09-12T02:43:16.333 INFO:tasks.workunit.client.0.smithi039.stdout:pread ret = 64 2024-09-12T02:43:16.333 INFO:tasks.workunit.client.0.smithi039.stdout:206/600: open fd = 3 2024-09-12T02:43:16.333 INFO:tasks.workunit.client.0.smithi039.stdout:write ret = 32 2024-09-12T02:43:16.333 INFO:tasks.workunit.client.0.smithi039.stdout:write ret = 32 2024-09-12T02:43:16.333 INFO:tasks.workunit.client.0.smithi039.stdout:pread ret = 64 2024-09-12T02:43:16.333 INFO:tasks.workunit.client.0.smithi039.stdout:207/600: open fd = 3 2024-09-12T02:43:16.333 INFO:tasks.workunit.client.0.smithi039.stdout:write ret = 32 2024-09-12T02:43:16.334 INFO:tasks.workunit.client.0.smithi039.stdout:write ret = 32 2024-09-12T02:43:16.334 INFO:tasks.workunit.client.0.smithi039.stdout:pread ret = 64 2024-09-12T02:43:16.334 INFO:tasks.workunit.client.0.smithi039.stdout:208/600: open fd = 3 2024-09-12T02:43:16.334 INFO:tasks.workunit.client.0.smithi039.stdout:write ret = 32 2024-09-12T02:43:16.334 INFO:tasks.workunit.client.0.smithi039.stdout:write ret = 32 2024-09-12T02:43:16.334 INFO:tasks.workunit.client.0.smithi039.stdout:pread ret = 64 2024-09-12T02:43:16.334 INFO:tasks.workunit.client.0.smithi039.stdout:209/600: open fd = 3 2024-09-12T02:43:16.334 INFO:tasks.workunit.client.0.smithi039.stdout:write ret = 32 2024-09-12T02:43:16.334 INFO:tasks.workunit.client.0.smithi039.stdout:write ret = 32 2024-09-12T02:43:16.334 INFO:tasks.workunit.client.0.smithi039.stdout:pread ret = 64 2024-09-12T02:43:16.334 INFO:tasks.workunit.client.0.smithi039.stdout:210/600: open fd = 3 2024-09-12T02:43:16.334 INFO:tasks.workunit.client.0.smithi039.stdout:write ret = 32 2024-09-12T02:43:16.334 INFO:tasks.workunit.client.0.smithi039.stdout:write ret = 32 2024-09-12T02:43:16.334 INFO:tasks.workunit.client.0.smithi039.stdout:pread ret = 64 2024-09-12T02:43:16.335 INFO:tasks.workunit.client.0.smithi039.stdout:211/600: open fd = 3 2024-09-12T02:43:16.335 INFO:tasks.workunit.client.0.smithi039.stdout:write ret = 32 2024-09-12T02:43:16.335 INFO:tasks.workunit.client.0.smithi039.stdout:write ret = 32 2024-09-12T02:43:16.335 INFO:tasks.workunit.client.0.smithi039.stdout:pread ret = 64 2024-09-12T02:43:16.335 INFO:tasks.workunit.client.0.smithi039.stdout:212/600: open fd = 3 2024-09-12T02:43:16.335 INFO:tasks.workunit.client.0.smithi039.stdout:write ret = 32 2024-09-12T02:43:16.335 INFO:tasks.workunit.client.0.smithi039.stdout:write ret = 32 2024-09-12T02:43:16.335 INFO:tasks.workunit.client.0.smithi039.stdout:pread ret = 64 2024-09-12T02:43:16.335 INFO:tasks.workunit.client.0.smithi039.stdout:213/600: open fd = 3 2024-09-12T02:43:16.335 INFO:tasks.workunit.client.0.smithi039.stdout:write ret = 32 2024-09-12T02:43:16.335 INFO:tasks.workunit.client.0.smithi039.stdout:write ret = 32 2024-09-12T02:43:16.335 INFO:tasks.workunit.client.0.smithi039.stdout:pread ret = 64 2024-09-12T02:43:16.335 INFO:tasks.workunit.client.0.smithi039.stdout:214/600: open fd = 3 2024-09-12T02:43:16.336 INFO:tasks.workunit.client.0.smithi039.stdout:write ret = 32 2024-09-12T02:43:16.336 INFO:tasks.workunit.client.0.smithi039.stdout:write ret = 32 2024-09-12T02:43:16.336 INFO:tasks.workunit.client.0.smithi039.stdout:pread ret = 64 2024-09-12T02:43:16.336 INFO:tasks.workunit.client.0.smithi039.stdout:215/600: open fd = 3 2024-09-12T02:43:16.336 INFO:tasks.workunit.client.0.smithi039.stdout:write ret = 32 2024-09-12T02:43:16.336 INFO:tasks.workunit.client.0.smithi039.stdout:write ret = 32 2024-09-12T02:43:16.336 INFO:tasks.workunit.client.0.smithi039.stdout:pread ret = 64 2024-09-12T02:43:16.336 INFO:tasks.workunit.client.0.smithi039.stdout:216/600: open fd = 3 2024-09-12T02:43:16.336 INFO:tasks.workunit.client.0.smithi039.stdout:write ret = 32 2024-09-12T02:43:16.336 INFO:tasks.workunit.client.0.smithi039.stdout:write ret = 32 2024-09-12T02:43:16.336 INFO:tasks.workunit.client.0.smithi039.stdout:pread ret = 64 2024-09-12T02:43:16.336 INFO:tasks.workunit.client.0.smithi039.stdout:217/600: open fd = 3 2024-09-12T02:43:16.336 INFO:tasks.workunit.client.0.smithi039.stdout:write ret = 32 2024-09-12T02:43:16.336 INFO:tasks.workunit.client.0.smithi039.stdout:write ret = 32 2024-09-12T02:43:16.337 INFO:tasks.workunit.client.0.smithi039.stdout:pread ret = 64 2024-09-12T02:43:16.337 INFO:tasks.workunit.client.0.smithi039.stdout:218/600: open fd = 3 2024-09-12T02:43:16.337 INFO:tasks.workunit.client.0.smithi039.stdout:write ret = 32 2024-09-12T02:43:16.337 INFO:tasks.workunit.client.0.smithi039.stdout:write ret = 32 2024-09-12T02:43:16.337 INFO:tasks.workunit.client.0.smithi039.stdout:pread ret = 64 2024-09-12T02:43:16.337 INFO:tasks.workunit.client.0.smithi039.stdout:219/600: open fd = 3 2024-09-12T02:43:16.337 INFO:tasks.workunit.client.0.smithi039.stdout:write ret = 32 2024-09-12T02:43:16.337 INFO:tasks.workunit.client.0.smithi039.stdout:write ret = 32 2024-09-12T02:43:16.337 INFO:tasks.workunit.client.0.smithi039.stdout:pread ret = 64 2024-09-12T02:43:16.337 INFO:tasks.workunit.client.0.smithi039.stdout:220/600: open fd = 3 2024-09-12T02:43:16.337 INFO:tasks.workunit.client.0.smithi039.stdout:write ret = 32 2024-09-12T02:43:16.337 INFO:tasks.workunit.client.0.smithi039.stdout:write ret = 32 2024-09-12T02:43:16.337 INFO:tasks.workunit.client.0.smithi039.stdout:pread ret = 64 2024-09-12T02:43:16.337 INFO:tasks.workunit.client.0.smithi039.stdout:221/600: open fd = 3 2024-09-12T02:43:16.338 INFO:tasks.workunit.client.0.smithi039.stdout:write ret = 32 2024-09-12T02:43:16.338 INFO:tasks.workunit.client.0.smithi039.stdout:write ret = 32 2024-09-12T02:43:16.338 INFO:tasks.workunit.client.0.smithi039.stdout:pread ret = 64 2024-09-12T02:43:16.338 INFO:tasks.workunit.client.0.smithi039.stdout:222/600: open fd = 3 2024-09-12T02:43:16.338 INFO:tasks.workunit.client.0.smithi039.stdout:write ret = 32 2024-09-12T02:43:16.338 INFO:tasks.workunit.client.0.smithi039.stdout:write ret = 32 2024-09-12T02:43:16.338 INFO:tasks.workunit.client.0.smithi039.stdout:pread ret = 64 2024-09-12T02:43:16.338 INFO:tasks.workunit.client.0.smithi039.stdout:223/600: open fd = 3 2024-09-12T02:43:16.338 INFO:tasks.workunit.client.0.smithi039.stdout:write ret = 32 2024-09-12T02:43:16.338 INFO:tasks.workunit.client.0.smithi039.stdout:write ret = 32 2024-09-12T02:43:16.338 INFO:tasks.workunit.client.0.smithi039.stdout:pread ret = 64 2024-09-12T02:43:16.338 INFO:tasks.workunit.client.0.smithi039.stdout:224/600: open fd = 3 2024-09-12T02:43:16.338 INFO:tasks.workunit.client.0.smithi039.stdout:write ret = 32 2024-09-12T02:43:16.338 INFO:tasks.workunit.client.0.smithi039.stdout:write ret = 32 2024-09-12T02:43:16.339 INFO:tasks.workunit.client.0.smithi039.stdout:pread ret = 64 2024-09-12T02:43:16.339 INFO:tasks.workunit.client.0.smithi039.stdout:225/600: open fd = 3 2024-09-12T02:43:16.339 INFO:tasks.workunit.client.0.smithi039.stdout:write ret = 32 2024-09-12T02:43:16.339 INFO:tasks.workunit.client.0.smithi039.stdout:write ret = 32 2024-09-12T02:43:16.339 INFO:tasks.workunit.client.0.smithi039.stdout:pread ret = 64 2024-09-12T02:43:16.339 INFO:tasks.workunit.client.0.smithi039.stdout:226/600: open fd = 3 2024-09-12T02:43:16.339 INFO:tasks.workunit.client.0.smithi039.stdout:write ret = 32 2024-09-12T02:43:16.339 INFO:tasks.workunit.client.0.smithi039.stdout:write ret = 32 2024-09-12T02:43:16.339 INFO:tasks.workunit.client.0.smithi039.stdout:pread ret = 64 2024-09-12T02:43:16.339 INFO:tasks.workunit.client.0.smithi039.stdout:227/600: open fd = 3 2024-09-12T02:43:16.339 INFO:tasks.workunit.client.0.smithi039.stdout:write ret = 32 2024-09-12T02:43:16.339 INFO:tasks.workunit.client.0.smithi039.stdout:write ret = 32 2024-09-12T02:43:16.339 INFO:tasks.workunit.client.0.smithi039.stdout:pread ret = 64 2024-09-12T02:43:16.339 INFO:tasks.workunit.client.0.smithi039.stdout:228/600: open fd = 3 2024-09-12T02:43:16.340 INFO:tasks.workunit.client.0.smithi039.stdout:write ret = 32 2024-09-12T02:43:16.340 INFO:tasks.workunit.client.0.smithi039.stdout:write ret = 32 2024-09-12T02:43:16.340 INFO:tasks.workunit.client.0.smithi039.stdout:pread ret = 64 2024-09-12T02:43:16.340 INFO:tasks.workunit.client.0.smithi039.stdout:229/600: open fd = 3 2024-09-12T02:43:16.340 INFO:tasks.workunit.client.0.smithi039.stdout:write ret = 32 2024-09-12T02:43:16.340 INFO:tasks.workunit.client.0.smithi039.stdout:write ret = 32 2024-09-12T02:43:16.340 INFO:tasks.workunit.client.0.smithi039.stdout:pread ret = 64 2024-09-12T02:43:16.340 INFO:tasks.workunit.client.0.smithi039.stdout:230/600: open fd = 3 2024-09-12T02:43:16.340 INFO:tasks.workunit.client.0.smithi039.stdout:write ret = 32 2024-09-12T02:43:16.340 INFO:tasks.workunit.client.0.smithi039.stdout:write ret = 32 2024-09-12T02:43:16.340 INFO:tasks.workunit.client.0.smithi039.stdout:pread ret = 64 2024-09-12T02:43:16.340 INFO:tasks.workunit.client.0.smithi039.stdout:231/600: open fd = 3 2024-09-12T02:43:16.340 INFO:tasks.workunit.client.0.smithi039.stdout:write ret = 32 2024-09-12T02:43:16.340 INFO:tasks.workunit.client.0.smithi039.stdout:write ret = 32 2024-09-12T02:43:16.340 INFO:tasks.workunit.client.0.smithi039.stdout:pread ret = 64 2024-09-12T02:43:16.341 INFO:tasks.workunit.client.0.smithi039.stdout:232/600: open fd = 3 2024-09-12T02:43:16.341 INFO:tasks.workunit.client.0.smithi039.stdout:write ret = 32 2024-09-12T02:43:16.341 INFO:tasks.workunit.client.0.smithi039.stdout:write ret = 32 2024-09-12T02:43:16.341 INFO:tasks.workunit.client.0.smithi039.stdout:pread ret = 64 2024-09-12T02:43:16.341 INFO:tasks.workunit.client.0.smithi039.stdout:233/600: open fd = 3 2024-09-12T02:43:16.341 INFO:tasks.workunit.client.0.smithi039.stdout:write ret = 32 2024-09-12T02:43:16.341 INFO:tasks.workunit.client.0.smithi039.stdout:write ret = 32 2024-09-12T02:43:16.341 INFO:tasks.workunit.client.0.smithi039.stdout:pread ret = 64 2024-09-12T02:43:16.341 INFO:tasks.workunit.client.0.smithi039.stdout:234/600: open fd = 3 2024-09-12T02:43:16.341 INFO:tasks.workunit.client.0.smithi039.stdout:write ret = 32 2024-09-12T02:43:16.341 INFO:tasks.workunit.client.0.smithi039.stdout:write ret = 32 2024-09-12T02:43:16.341 INFO:tasks.workunit.client.0.smithi039.stdout:pread ret = 64 2024-09-12T02:43:16.341 INFO:tasks.workunit.client.0.smithi039.stdout:235/600: open fd = 3 2024-09-12T02:43:16.341 INFO:tasks.workunit.client.0.smithi039.stdout:write ret = 32 2024-09-12T02:43:16.342 INFO:tasks.workunit.client.0.smithi039.stdout:write ret = 32 2024-09-12T02:43:16.342 INFO:tasks.workunit.client.0.smithi039.stdout:pread ret = 64 2024-09-12T02:43:16.342 INFO:tasks.workunit.client.0.smithi039.stdout:236/600: open fd = 3 2024-09-12T02:43:16.342 INFO:tasks.workunit.client.0.smithi039.stdout:write ret = 32 2024-09-12T02:43:16.342 INFO:tasks.workunit.client.0.smithi039.stdout:write ret = 32 2024-09-12T02:43:16.342 INFO:tasks.workunit.client.0.smithi039.stdout:pread ret = 64 2024-09-12T02:43:16.342 INFO:tasks.workunit.client.0.smithi039.stdout:237/600: open fd = 3 2024-09-12T02:43:16.342 INFO:tasks.workunit.client.0.smithi039.stdout:write ret = 32 2024-09-12T02:43:16.342 INFO:tasks.workunit.client.0.smithi039.stdout:write ret = 32 2024-09-12T02:43:16.342 INFO:tasks.workunit.client.0.smithi039.stdout:pread ret = 64 2024-09-12T02:43:16.342 INFO:tasks.workunit.client.0.smithi039.stdout:238/600: open fd = 3 2024-09-12T02:43:16.342 INFO:tasks.workunit.client.0.smithi039.stdout:write ret = 32 2024-09-12T02:43:16.342 INFO:tasks.workunit.client.0.smithi039.stdout:write ret = 32 2024-09-12T02:43:16.343 INFO:tasks.workunit.client.0.smithi039.stdout:pread ret = 64 2024-09-12T02:43:16.343 INFO:tasks.workunit.client.0.smithi039.stdout:239/600: open fd = 3 2024-09-12T02:43:16.343 INFO:tasks.workunit.client.0.smithi039.stdout:write ret = 32 2024-09-12T02:43:16.343 INFO:tasks.workunit.client.0.smithi039.stdout:write ret = 32 2024-09-12T02:43:16.343 INFO:tasks.workunit.client.0.smithi039.stdout:pread ret = 64 2024-09-12T02:43:16.343 INFO:tasks.workunit.client.0.smithi039.stdout:240/600: open fd = 3 2024-09-12T02:43:16.343 INFO:tasks.workunit.client.0.smithi039.stdout:write ret = 32 2024-09-12T02:43:16.343 INFO:tasks.workunit.client.0.smithi039.stdout:write ret = 32 2024-09-12T02:43:16.343 INFO:tasks.workunit.client.0.smithi039.stdout:pread ret = 64 2024-09-12T02:43:16.343 INFO:tasks.workunit.client.0.smithi039.stdout:241/600: open fd = 3 2024-09-12T02:43:16.343 INFO:tasks.workunit.client.0.smithi039.stdout:write ret = 32 2024-09-12T02:43:16.343 INFO:tasks.workunit.client.0.smithi039.stdout:write ret = 32 2024-09-12T02:43:16.343 INFO:tasks.workunit.client.0.smithi039.stdout:pread ret = 64 2024-09-12T02:43:16.344 INFO:tasks.workunit.client.0.smithi039.stdout:242/600: open fd = 3 2024-09-12T02:43:16.344 INFO:tasks.workunit.client.0.smithi039.stdout:write ret = 32 2024-09-12T02:43:16.344 INFO:tasks.workunit.client.0.smithi039.stdout:write ret = 32 2024-09-12T02:43:16.344 INFO:tasks.workunit.client.0.smithi039.stdout:pread ret = 64 2024-09-12T02:43:16.344 INFO:tasks.workunit.client.0.smithi039.stdout:243/600: open fd = 3 2024-09-12T02:43:16.344 INFO:tasks.workunit.client.0.smithi039.stdout:write ret = 32 2024-09-12T02:43:16.344 INFO:tasks.workunit.client.0.smithi039.stdout:write ret = 32 2024-09-12T02:43:16.344 INFO:tasks.workunit.client.0.smithi039.stdout:pread ret = 64 2024-09-12T02:43:16.344 INFO:tasks.workunit.client.0.smithi039.stdout:244/600: open fd = 3 2024-09-12T02:43:16.344 INFO:tasks.workunit.client.0.smithi039.stdout:write ret = 32 2024-09-12T02:43:16.344 INFO:tasks.workunit.client.0.smithi039.stdout:write ret = 32 2024-09-12T02:43:16.344 INFO:tasks.workunit.client.0.smithi039.stdout:pread ret = 64 2024-09-12T02:43:16.344 INFO:tasks.workunit.client.0.smithi039.stdout:245/600: open fd = 3 2024-09-12T02:43:16.344 INFO:tasks.workunit.client.0.smithi039.stdout:write ret = 32 2024-09-12T02:43:16.345 INFO:tasks.workunit.client.0.smithi039.stdout:write ret = 32 2024-09-12T02:43:16.345 INFO:tasks.workunit.client.0.smithi039.stdout:pread ret = 64 2024-09-12T02:43:16.345 INFO:tasks.workunit.client.0.smithi039.stdout:246/600: open fd = 3 2024-09-12T02:43:16.345 INFO:tasks.workunit.client.0.smithi039.stdout:write ret = 32 2024-09-12T02:43:16.345 INFO:tasks.workunit.client.0.smithi039.stdout:write ret = 32 2024-09-12T02:43:16.345 INFO:tasks.workunit.client.0.smithi039.stdout:pread ret = 64 2024-09-12T02:43:16.345 INFO:tasks.workunit.client.0.smithi039.stdout:247/600: open fd = 3 2024-09-12T02:43:16.345 INFO:tasks.workunit.client.0.smithi039.stdout:write ret = 32 2024-09-12T02:43:16.345 INFO:tasks.workunit.client.0.smithi039.stdout:write ret = 32 2024-09-12T02:43:16.345 INFO:tasks.workunit.client.0.smithi039.stdout:pread ret = 64 2024-09-12T02:43:16.345 INFO:tasks.workunit.client.0.smithi039.stdout:248/600: open fd = 3 2024-09-12T02:43:16.345 INFO:tasks.workunit.client.0.smithi039.stdout:write ret = 32 2024-09-12T02:43:16.345 INFO:tasks.workunit.client.0.smithi039.stdout:write ret = 32 2024-09-12T02:43:16.345 INFO:tasks.workunit.client.0.smithi039.stdout:pread ret = 64 2024-09-12T02:43:16.346 INFO:tasks.workunit.client.0.smithi039.stdout:249/600: open fd = 3 2024-09-12T02:43:16.346 INFO:tasks.workunit.client.0.smithi039.stdout:write ret = 32 2024-09-12T02:43:16.346 INFO:tasks.workunit.client.0.smithi039.stdout:write ret = 32 2024-09-12T02:43:16.346 INFO:tasks.workunit.client.0.smithi039.stdout:pread ret = 64 2024-09-12T02:43:16.346 INFO:tasks.workunit.client.0.smithi039.stdout:250/600: open fd = 3 2024-09-12T02:43:16.346 INFO:tasks.workunit.client.0.smithi039.stdout:write ret = 32 2024-09-12T02:43:16.346 INFO:tasks.workunit.client.0.smithi039.stdout:write ret = 32 2024-09-12T02:43:17.513 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 12 02:43:17 smithi172 ceph-mon[35609]: pgmap v163: 129 pgs: 129 active+clean; 7.4 MiB data, 393 MiB used, 1.0 TiB / 1.0 TiB avail; 35 KiB/s rd, 32 KiB/s wr, 13 op/s 2024-09-12T02:43:17.600 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 02:43:17 smithi039 ceph-mon[30515]: pgmap v163: 129 pgs: 129 active+clean; 7.4 MiB data, 393 MiB used, 1.0 TiB / 1.0 TiB avail; 35 KiB/s rd, 32 KiB/s wr, 13 op/s 2024-09-12T02:43:17.698 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 12 02:43:17 smithi044 ceph-mon[35411]: pgmap v163: 129 pgs: 129 active+clean; 7.4 MiB data, 393 MiB used, 1.0 TiB / 1.0 TiB avail; 35 KiB/s rd, 32 KiB/s wr, 13 op/s 2024-09-12T02:43:19.513 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 12 02:43:19 smithi172 ceph-mon[35609]: pgmap v164: 129 pgs: 129 active+clean; 7.6 MiB data, 397 MiB used, 1.0 TiB / 1.0 TiB avail; 53 KiB/s rd, 49 KiB/s wr, 19 op/s 2024-09-12T02:43:19.600 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 02:43:19 smithi039 ceph-mon[30515]: pgmap v164: 129 pgs: 129 active+clean; 7.6 MiB data, 397 MiB used, 1.0 TiB / 1.0 TiB avail; 53 KiB/s rd, 49 KiB/s wr, 19 op/s 2024-09-12T02:43:19.698 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 12 02:43:19 smithi044 ceph-mon[35411]: pgmap v164: 129 pgs: 129 active+clean; 7.6 MiB data, 397 MiB used, 1.0 TiB / 1.0 TiB avail; 53 KiB/s rd, 49 KiB/s wr, 19 op/s 2024-09-12T02:43:21.513 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 12 02:43:21 smithi172 ceph-mon[35609]: pgmap v165: 129 pgs: 129 active+clean; 7.6 MiB data, 397 MiB used, 1.0 TiB / 1.0 TiB avail; 35 KiB/s rd, 32 KiB/s wr, 13 op/s 2024-09-12T02:43:21.600 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 02:43:21 smithi039 ceph-mon[30515]: pgmap v165: 129 pgs: 129 active+clean; 7.6 MiB data, 397 MiB used, 1.0 TiB / 1.0 TiB avail; 35 KiB/s rd, 32 KiB/s wr, 13 op/s 2024-09-12T02:43:21.698 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 12 02:43:21 smithi044 ceph-mon[35411]: pgmap v165: 129 pgs: 129 active+clean; 7.6 MiB data, 397 MiB used, 1.0 TiB / 1.0 TiB avail; 35 KiB/s rd, 32 KiB/s wr, 13 op/s 2024-09-12T02:43:23.513 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 12 02:43:23 smithi172 ceph-mon[35609]: pgmap v166: 129 pgs: 129 active+clean; 7.8 MiB data, 398 MiB used, 1.0 TiB / 1.0 TiB avail; 52 KiB/s rd, 48 KiB/s wr, 19 op/s 2024-09-12T02:43:23.599 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 02:43:23 smithi039 ceph-mon[30515]: pgmap v166: 129 pgs: 129 active+clean; 7.8 MiB data, 398 MiB used, 1.0 TiB / 1.0 TiB avail; 52 KiB/s rd, 48 KiB/s wr, 19 op/s 2024-09-12T02:43:23.698 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 12 02:43:23 smithi044 ceph-mon[35411]: pgmap v166: 129 pgs: 129 active+clean; 7.8 MiB data, 398 MiB used, 1.0 TiB / 1.0 TiB avail; 52 KiB/s rd, 48 KiB/s wr, 19 op/s 2024-09-12T02:43:25.514 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 12 02:43:25 smithi172 ceph-mon[35609]: pgmap v167: 129 pgs: 129 active+clean; 7.8 MiB data, 398 MiB used, 1.0 TiB / 1.0 TiB avail; 35 KiB/s rd, 32 KiB/s wr, 13 op/s 2024-09-12T02:43:25.599 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 02:43:25 smithi039 ceph-mon[30515]: pgmap v167: 129 pgs: 129 active+clean; 7.8 MiB data, 398 MiB used, 1.0 TiB / 1.0 TiB avail; 35 KiB/s rd, 32 KiB/s wr, 13 op/s 2024-09-12T02:43:25.698 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 12 02:43:25 smithi044 ceph-mon[35411]: pgmap v167: 129 pgs: 129 active+clean; 7.8 MiB data, 398 MiB used, 1.0 TiB / 1.0 TiB avail; 35 KiB/s rd, 32 KiB/s wr, 13 op/s 2024-09-12T02:43:27.600 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 02:43:27 smithi039 ceph-mon[30515]: pgmap v168: 129 pgs: 129 active+clean; 7.8 MiB data, 398 MiB used, 1.0 TiB / 1.0 TiB avail; 35 KiB/s rd, 32 KiB/s wr, 13 op/s 2024-09-12T02:43:27.698 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 12 02:43:27 smithi044 ceph-mon[35411]: pgmap v168: 129 pgs: 129 active+clean; 7.8 MiB data, 398 MiB used, 1.0 TiB / 1.0 TiB avail; 35 KiB/s rd, 32 KiB/s wr, 13 op/s 2024-09-12T02:43:27.763 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 12 02:43:27 smithi172 ceph-mon[35609]: pgmap v168: 129 pgs: 129 active+clean; 7.8 MiB data, 398 MiB used, 1.0 TiB / 1.0 TiB avail; 35 KiB/s rd, 32 KiB/s wr, 13 op/s 2024-09-12T02:43:29.600 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 02:43:29 smithi039 ceph-mon[30515]: pgmap v169: 129 pgs: 129 active+clean; 8.0 MiB data, 402 MiB used, 1.0 TiB / 1.0 TiB avail; 54 KiB/s rd, 51 KiB/s wr, 20 op/s 2024-09-12T02:43:29.698 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 12 02:43:29 smithi044 ceph-mon[35411]: pgmap v169: 129 pgs: 129 active+clean; 8.0 MiB data, 402 MiB used, 1.0 TiB / 1.0 TiB avail; 54 KiB/s rd, 51 KiB/s wr, 20 op/s 2024-09-12T02:43:29.764 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 12 02:43:29 smithi172 ceph-mon[35609]: pgmap v169: 129 pgs: 129 active+clean; 8.0 MiB data, 402 MiB used, 1.0 TiB / 1.0 TiB avail; 54 KiB/s rd, 51 KiB/s wr, 20 op/s 2024-09-12T02:43:31.599 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 02:43:31 smithi039 ceph-mon[30515]: pgmap v170: 129 pgs: 129 active+clean; 8.0 MiB data, 402 MiB used, 1.0 TiB / 1.0 TiB avail; 36 KiB/s rd, 34 KiB/s wr, 13 op/s 2024-09-12T02:43:31.698 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 12 02:43:31 smithi044 ceph-mon[35411]: pgmap v170: 129 pgs: 129 active+clean; 8.0 MiB data, 402 MiB used, 1.0 TiB / 1.0 TiB avail; 36 KiB/s rd, 34 KiB/s wr, 13 op/s 2024-09-12T02:43:31.763 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 12 02:43:31 smithi172 ceph-mon[35609]: pgmap v170: 129 pgs: 129 active+clean; 8.0 MiB data, 402 MiB used, 1.0 TiB / 1.0 TiB avail; 36 KiB/s rd, 34 KiB/s wr, 13 op/s 2024-09-12T02:43:33.599 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 02:43:33 smithi039 ceph-mon[30515]: pgmap v171: 129 pgs: 129 active+clean; 8.2 MiB data, 403 MiB used, 1.0 TiB / 1.0 TiB avail; 53 KiB/s rd, 49 KiB/s wr, 19 op/s 2024-09-12T02:43:33.698 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 12 02:43:33 smithi044 ceph-mon[35411]: pgmap v171: 129 pgs: 129 active+clean; 8.2 MiB data, 403 MiB used, 1.0 TiB / 1.0 TiB avail; 53 KiB/s rd, 49 KiB/s wr, 19 op/s 2024-09-12T02:43:33.763 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 12 02:43:33 smithi172 ceph-mon[35609]: pgmap v171: 129 pgs: 129 active+clean; 8.2 MiB data, 403 MiB used, 1.0 TiB / 1.0 TiB avail; 53 KiB/s rd, 49 KiB/s wr, 19 op/s 2024-09-12T02:43:35.600 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 02:43:35 smithi039 ceph-mon[30515]: pgmap v172: 129 pgs: 129 active+clean; 8.2 MiB data, 403 MiB used, 1.0 TiB / 1.0 TiB avail; 36 KiB/s rd, 34 KiB/s wr, 13 op/s 2024-09-12T02:43:35.698 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 12 02:43:35 smithi044 ceph-mon[35411]: pgmap v172: 129 pgs: 129 active+clean; 8.2 MiB data, 403 MiB used, 1.0 TiB / 1.0 TiB avail; 36 KiB/s rd, 34 KiB/s wr, 13 op/s 2024-09-12T02:43:35.763 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 12 02:43:35 smithi172 ceph-mon[35609]: pgmap v172: 129 pgs: 129 active+clean; 8.2 MiB data, 403 MiB used, 1.0 TiB / 1.0 TiB avail; 36 KiB/s rd, 34 KiB/s wr, 13 op/s 2024-09-12T02:43:37.599 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 02:43:37 smithi039 ceph-mon[30515]: pgmap v173: 129 pgs: 129 active+clean; 8.2 MiB data, 403 MiB used, 1.0 TiB / 1.0 TiB avail; 36 KiB/s rd, 34 KiB/s wr, 13 op/s 2024-09-12T02:43:37.698 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 12 02:43:37 smithi044 ceph-mon[35411]: pgmap v173: 129 pgs: 129 active+clean; 8.2 MiB data, 403 MiB used, 1.0 TiB / 1.0 TiB avail; 36 KiB/s rd, 34 KiB/s wr, 13 op/s 2024-09-12T02:43:37.763 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 12 02:43:37 smithi172 ceph-mon[35609]: pgmap v173: 129 pgs: 129 active+clean; 8.2 MiB data, 403 MiB used, 1.0 TiB / 1.0 TiB avail; 36 KiB/s rd, 34 KiB/s wr, 13 op/s 2024-09-12T02:43:39.599 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 02:43:39 smithi039 ceph-mon[30515]: pgmap v174: 129 pgs: 129 active+clean; 8.3 MiB data, 404 MiB used, 1.0 TiB / 1.0 TiB avail; 54 KiB/s rd, 50 KiB/s wr, 20 op/s 2024-09-12T02:43:39.698 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 12 02:43:39 smithi044 ceph-mon[35411]: pgmap v174: 129 pgs: 129 active+clean; 8.3 MiB data, 404 MiB used, 1.0 TiB / 1.0 TiB avail; 54 KiB/s rd, 50 KiB/s wr, 20 op/s 2024-09-12T02:43:39.763 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 12 02:43:39 smithi172 ceph-mon[35609]: pgmap v174: 129 pgs: 129 active+clean; 8.3 MiB data, 404 MiB used, 1.0 TiB / 1.0 TiB avail; 54 KiB/s rd, 50 KiB/s wr, 20 op/s 2024-09-12T02:43:41.600 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 02:43:41 smithi039 ceph-mon[30515]: pgmap v175: 129 pgs: 129 active+clean; 8.3 MiB data, 404 MiB used, 1.0 TiB / 1.0 TiB avail; 35 KiB/s rd, 32 KiB/s wr, 13 op/s 2024-09-12T02:43:41.701 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 12 02:43:41 smithi044 ceph-mon[35411]: pgmap v175: 129 pgs: 129 active+clean; 8.3 MiB data, 404 MiB used, 1.0 TiB / 1.0 TiB avail; 35 KiB/s rd, 32 KiB/s wr, 13 op/s 2024-09-12T02:43:41.763 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 12 02:43:41 smithi172 ceph-mon[35609]: pgmap v175: 129 pgs: 129 active+clean; 8.3 MiB data, 404 MiB used, 1.0 TiB / 1.0 TiB avail; 35 KiB/s rd, 32 KiB/s wr, 13 op/s 2024-09-12T02:43:43.599 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 02:43:43 smithi039 ceph-mon[30515]: pgmap v176: 129 pgs: 129 active+clean; 8.5 MiB data, 404 MiB used, 1.0 TiB / 1.0 TiB avail; 52 KiB/s rd, 47 KiB/s wr, 19 op/s 2024-09-12T02:43:43.699 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 12 02:43:43 smithi044 ceph-mon[35411]: pgmap v176: 129 pgs: 129 active+clean; 8.5 MiB data, 404 MiB used, 1.0 TiB / 1.0 TiB avail; 52 KiB/s rd, 47 KiB/s wr, 19 op/s 2024-09-12T02:43:43.763 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 12 02:43:43 smithi172 ceph-mon[35609]: pgmap v176: 129 pgs: 129 active+clean; 8.5 MiB data, 404 MiB used, 1.0 TiB / 1.0 TiB avail; 52 KiB/s rd, 47 KiB/s wr, 19 op/s 2024-09-12T02:43:45.599 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 02:43:45 smithi039 ceph-mon[30515]: pgmap v177: 129 pgs: 129 active+clean; 8.5 MiB data, 404 MiB used, 1.0 TiB / 1.0 TiB avail; 35 KiB/s rd, 32 KiB/s wr, 13 op/s 2024-09-12T02:43:45.698 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 12 02:43:45 smithi044 ceph-mon[35411]: pgmap v177: 129 pgs: 129 active+clean; 8.5 MiB data, 404 MiB used, 1.0 TiB / 1.0 TiB avail; 35 KiB/s rd, 32 KiB/s wr, 13 op/s 2024-09-12T02:43:45.763 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 12 02:43:45 smithi172 ceph-mon[35609]: pgmap v177: 129 pgs: 129 active+clean; 8.5 MiB data, 404 MiB used, 1.0 TiB / 1.0 TiB avail; 35 KiB/s rd, 32 KiB/s wr, 13 op/s 2024-09-12T02:43:47.599 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 02:43:47 smithi039 ceph-mon[30515]: pgmap v178: 129 pgs: 129 active+clean; 8.5 MiB data, 404 MiB used, 1.0 TiB / 1.0 TiB avail; 35 KiB/s rd, 32 KiB/s wr, 13 op/s 2024-09-12T02:43:47.698 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 12 02:43:47 smithi044 ceph-mon[35411]: pgmap v178: 129 pgs: 129 active+clean; 8.5 MiB data, 404 MiB used, 1.0 TiB / 1.0 TiB avail; 35 KiB/s rd, 32 KiB/s wr, 13 op/s 2024-09-12T02:43:47.763 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 12 02:43:47 smithi172 ceph-mon[35609]: pgmap v178: 129 pgs: 129 active+clean; 8.5 MiB data, 404 MiB used, 1.0 TiB / 1.0 TiB avail; 35 KiB/s rd, 32 KiB/s wr, 13 op/s 2024-09-12T02:43:49.599 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 02:43:49 smithi039 ceph-mon[30515]: pgmap v179: 129 pgs: 129 active+clean; 8.7 MiB data, 405 MiB used, 1.0 TiB / 1.0 TiB avail; 54 KiB/s rd, 50 KiB/s wr, 19 op/s 2024-09-12T02:43:49.698 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 12 02:43:49 smithi044 ceph-mon[35411]: pgmap v179: 129 pgs: 129 active+clean; 8.7 MiB data, 405 MiB used, 1.0 TiB / 1.0 TiB avail; 54 KiB/s rd, 50 KiB/s wr, 19 op/s 2024-09-12T02:43:49.763 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 12 02:43:49 smithi172 ceph-mon[35609]: pgmap v179: 129 pgs: 129 active+clean; 8.7 MiB data, 405 MiB used, 1.0 TiB / 1.0 TiB avail; 54 KiB/s rd, 50 KiB/s wr, 19 op/s 2024-09-12T02:43:51.599 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 02:43:51 smithi039 ceph-mon[30515]: pgmap v180: 129 pgs: 129 active+clean; 8.7 MiB data, 405 MiB used, 1.0 TiB / 1.0 TiB avail; 36 KiB/s rd, 34 KiB/s wr, 13 op/s 2024-09-12T02:43:51.698 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 12 02:43:51 smithi044 ceph-mon[35411]: pgmap v180: 129 pgs: 129 active+clean; 8.7 MiB data, 405 MiB used, 1.0 TiB / 1.0 TiB avail; 36 KiB/s rd, 34 KiB/s wr, 13 op/s 2024-09-12T02:43:51.763 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 12 02:43:51 smithi172 ceph-mon[35609]: pgmap v180: 129 pgs: 129 active+clean; 8.7 MiB data, 405 MiB used, 1.0 TiB / 1.0 TiB avail; 36 KiB/s rd, 34 KiB/s wr, 13 op/s 2024-09-12T02:43:53.599 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 02:43:53 smithi039 ceph-mon[30515]: pgmap v181: 129 pgs: 129 active+clean; 8.9 MiB data, 405 MiB used, 1.0 TiB / 1.0 TiB avail; 53 KiB/s rd, 49 KiB/s wr, 19 op/s 2024-09-12T02:43:53.698 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 12 02:43:53 smithi044 ceph-mon[35411]: pgmap v181: 129 pgs: 129 active+clean; 8.9 MiB data, 405 MiB used, 1.0 TiB / 1.0 TiB avail; 53 KiB/s rd, 49 KiB/s wr, 19 op/s 2024-09-12T02:43:53.763 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 12 02:43:53 smithi172 ceph-mon[35609]: pgmap v181: 129 pgs: 129 active+clean; 8.9 MiB data, 405 MiB used, 1.0 TiB / 1.0 TiB avail; 53 KiB/s rd, 49 KiB/s wr, 19 op/s 2024-09-12T02:43:55.600 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 02:43:55 smithi039 ceph-mon[30515]: pgmap v182: 129 pgs: 129 active+clean; 8.9 MiB data, 405 MiB used, 1.0 TiB / 1.0 TiB avail; 36 KiB/s rd, 34 KiB/s wr, 13 op/s 2024-09-12T02:43:55.698 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 12 02:43:55 smithi044 ceph-mon[35411]: pgmap v182: 129 pgs: 129 active+clean; 8.9 MiB data, 405 MiB used, 1.0 TiB / 1.0 TiB avail; 36 KiB/s rd, 34 KiB/s wr, 13 op/s 2024-09-12T02:43:55.763 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 12 02:43:55 smithi172 ceph-mon[35609]: pgmap v182: 129 pgs: 129 active+clean; 8.9 MiB data, 405 MiB used, 1.0 TiB / 1.0 TiB avail; 36 KiB/s rd, 34 KiB/s wr, 13 op/s 2024-09-12T02:43:57.599 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 02:43:57 smithi039 ceph-mon[30515]: pgmap v183: 129 pgs: 129 active+clean; 8.9 MiB data, 405 MiB used, 1.0 TiB / 1.0 TiB avail; 36 KiB/s rd, 34 KiB/s wr, 13 op/s 2024-09-12T02:43:57.698 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 12 02:43:57 smithi044 ceph-mon[35411]: pgmap v183: 129 pgs: 129 active+clean; 8.9 MiB data, 405 MiB used, 1.0 TiB / 1.0 TiB avail; 36 KiB/s rd, 34 KiB/s wr, 13 op/s 2024-09-12T02:43:57.763 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 12 02:43:57 smithi172 ceph-mon[35609]: pgmap v183: 129 pgs: 129 active+clean; 8.9 MiB data, 405 MiB used, 1.0 TiB / 1.0 TiB avail; 36 KiB/s rd, 34 KiB/s wr, 13 op/s 2024-09-12T02:43:59.698 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 12 02:43:59 smithi044 ceph-mon[35411]: pgmap v184: 129 pgs: 129 active+clean; 9.1 MiB data, 406 MiB used, 1.0 TiB / 1.0 TiB avail; 50 KiB/s rd, 50 KiB/s wr, 19 op/s 2024-09-12T02:43:59.763 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 12 02:43:59 smithi172 ceph-mon[35609]: pgmap v184: 129 pgs: 129 active+clean; 9.1 MiB data, 406 MiB used, 1.0 TiB / 1.0 TiB avail; 50 KiB/s rd, 50 KiB/s wr, 19 op/s 2024-09-12T02:43:59.849 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 02:43:59 smithi039 ceph-mon[30515]: pgmap v184: 129 pgs: 129 active+clean; 9.1 MiB data, 406 MiB used, 1.0 TiB / 1.0 TiB avail; 50 KiB/s rd, 50 KiB/s wr, 19 op/s 2024-09-12T02:44:01.698 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 12 02:44:01 smithi044 ceph-mon[35411]: pgmap v185: 129 pgs: 129 active+clean; 9.1 MiB data, 406 MiB used, 1.0 TiB / 1.0 TiB avail; 31 KiB/s rd, 32 KiB/s wr, 12 op/s 2024-09-12T02:44:01.763 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 12 02:44:01 smithi172 ceph-mon[35609]: pgmap v185: 129 pgs: 129 active+clean; 9.1 MiB data, 406 MiB used, 1.0 TiB / 1.0 TiB avail; 31 KiB/s rd, 32 KiB/s wr, 12 op/s 2024-09-12T02:44:01.849 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 02:44:01 smithi039 ceph-mon[30515]: pgmap v185: 129 pgs: 129 active+clean; 9.1 MiB data, 406 MiB used, 1.0 TiB / 1.0 TiB avail; 31 KiB/s rd, 32 KiB/s wr, 12 op/s 2024-09-12T02:44:03.698 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 12 02:44:03 smithi044 ceph-mon[35411]: pgmap v186: 129 pgs: 129 active+clean; 9.3 MiB data, 407 MiB used, 1.0 TiB / 1.0 TiB avail; 59 KiB/s rd, 93 KiB/s wr, 36 op/s 2024-09-12T02:44:03.699 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 12 02:44:03 smithi044 ceph-mon[35411]: osdmap e97: 12 total, 12 up, 12 in 2024-09-12T02:44:03.763 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 12 02:44:03 smithi172 ceph-mon[35609]: pgmap v186: 129 pgs: 129 active+clean; 9.3 MiB data, 407 MiB used, 1.0 TiB / 1.0 TiB avail; 59 KiB/s rd, 93 KiB/s wr, 36 op/s 2024-09-12T02:44:03.764 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 12 02:44:03 smithi172 ceph-mon[35609]: osdmap e97: 12 total, 12 up, 12 in 2024-09-12T02:44:03.849 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 02:44:03 smithi039 ceph-mon[30515]: pgmap v186: 129 pgs: 129 active+clean; 9.3 MiB data, 407 MiB used, 1.0 TiB / 1.0 TiB avail; 59 KiB/s rd, 93 KiB/s wr, 36 op/s 2024-09-12T02:44:03.850 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 02:44:03 smithi039 ceph-mon[30515]: osdmap e97: 12 total, 12 up, 12 in 2024-09-12T02:44:05.698 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 12 02:44:05 smithi044 ceph-mon[35411]: pgmap v188: 129 pgs: 129 active+clean; 9.3 MiB data, 407 MiB used, 1.0 TiB / 1.0 TiB avail; 50 KiB/s rd, 93 KiB/s wr, 35 op/s 2024-09-12T02:44:05.763 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 12 02:44:05 smithi172 ceph-mon[35609]: pgmap v188: 129 pgs: 129 active+clean; 9.3 MiB data, 407 MiB used, 1.0 TiB / 1.0 TiB avail; 50 KiB/s rd, 93 KiB/s wr, 35 op/s 2024-09-12T02:44:05.849 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 02:44:05 smithi039 ceph-mon[30515]: pgmap v188: 129 pgs: 129 active+clean; 9.3 MiB data, 407 MiB used, 1.0 TiB / 1.0 TiB avail; 50 KiB/s rd, 93 KiB/s wr, 35 op/s 2024-09-12T02:44:07.652 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 02:44:07 smithi039 ceph-mon[30515]: pgmap v189: 129 pgs: 129 active+clean; 9.3 MiB data, 407 MiB used, 1.0 TiB / 1.0 TiB avail; 50 KiB/s rd, 93 KiB/s wr, 35 op/s 2024-09-12T02:44:07.652 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 02:44:07 smithi039 ceph-mon[30515]: from='mgr.25199 172.21.15.39:0/1270637502' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-12T02:44:07.698 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 12 02:44:07 smithi044 ceph-mon[35411]: pgmap v189: 129 pgs: 129 active+clean; 9.3 MiB data, 407 MiB used, 1.0 TiB / 1.0 TiB avail; 50 KiB/s rd, 93 KiB/s wr, 35 op/s 2024-09-12T02:44:07.698 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 12 02:44:07 smithi044 ceph-mon[35411]: from='mgr.25199 172.21.15.39:0/1270637502' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-12T02:44:07.763 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 12 02:44:07 smithi172 ceph-mon[35609]: pgmap v189: 129 pgs: 129 active+clean; 9.3 MiB data, 407 MiB used, 1.0 TiB / 1.0 TiB avail; 50 KiB/s rd, 93 KiB/s wr, 35 op/s 2024-09-12T02:44:07.763 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 12 02:44:07 smithi172 ceph-mon[35609]: from='mgr.25199 172.21.15.39:0/1270637502' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-12T02:44:08.698 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 12 02:44:08 smithi044 ceph-mon[35411]: from='mgr.25199 172.21.15.39:0/1270637502' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-12T02:44:08.699 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 12 02:44:08 smithi044 ceph-mon[35411]: from='mgr.25199 172.21.15.39:0/1270637502' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-12T02:44:08.699 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 12 02:44:08 smithi044 ceph-mon[35411]: from='mgr.25199 172.21.15.39:0/1270637502' entity='mgr.x' 2024-09-12T02:44:08.763 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 12 02:44:08 smithi172 ceph-mon[35609]: from='mgr.25199 172.21.15.39:0/1270637502' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-12T02:44:08.763 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 12 02:44:08 smithi172 ceph-mon[35609]: from='mgr.25199 172.21.15.39:0/1270637502' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-12T02:44:08.763 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 12 02:44:08 smithi172 ceph-mon[35609]: from='mgr.25199 172.21.15.39:0/1270637502' entity='mgr.x' 2024-09-12T02:44:08.849 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 02:44:08 smithi039 ceph-mon[30515]: from='mgr.25199 172.21.15.39:0/1270637502' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-12T02:44:08.850 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 02:44:08 smithi039 ceph-mon[30515]: from='mgr.25199 172.21.15.39:0/1270637502' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-12T02:44:08.850 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 02:44:08 smithi039 ceph-mon[30515]: from='mgr.25199 172.21.15.39:0/1270637502' entity='mgr.x' 2024-09-12T02:44:09.698 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 12 02:44:09 smithi044 ceph-mon[35411]: pgmap v190: 129 pgs: 129 active+clean; 9.5 MiB data, 407 MiB used, 1.0 TiB / 1.0 TiB avail; 59 KiB/s rd, 97 KiB/s wr, 36 op/s 2024-09-12T02:44:09.763 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 12 02:44:09 smithi172 ceph-mon[35609]: pgmap v190: 129 pgs: 129 active+clean; 9.5 MiB data, 407 MiB used, 1.0 TiB / 1.0 TiB avail; 59 KiB/s rd, 97 KiB/s wr, 36 op/s 2024-09-12T02:44:09.849 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 02:44:09 smithi039 ceph-mon[30515]: pgmap v190: 129 pgs: 129 active+clean; 9.5 MiB data, 407 MiB used, 1.0 TiB / 1.0 TiB avail; 59 KiB/s rd, 97 KiB/s wr, 36 op/s 2024-09-12T02:44:11.698 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 12 02:44:11 smithi044 ceph-mon[35411]: pgmap v191: 129 pgs: 129 active+clean; 9.5 MiB data, 407 MiB used, 1.0 TiB / 1.0 TiB avail; 59 KiB/s rd, 97 KiB/s wr, 36 op/s 2024-09-12T02:44:11.763 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 12 02:44:11 smithi172 ceph-mon[35609]: pgmap v191: 129 pgs: 129 active+clean; 9.5 MiB data, 407 MiB used, 1.0 TiB / 1.0 TiB avail; 59 KiB/s rd, 97 KiB/s wr, 36 op/s 2024-09-12T02:44:11.849 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 02:44:11 smithi039 ceph-mon[30515]: pgmap v191: 129 pgs: 129 active+clean; 9.5 MiB data, 407 MiB used, 1.0 TiB / 1.0 TiB avail; 59 KiB/s rd, 97 KiB/s wr, 36 op/s 2024-09-12T02:44:13.350 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 02:44:13 smithi039 ceph-mon[30515]: pgmap v192: 129 pgs: 129 active+clean; 9.7 MiB data, 408 MiB used, 1.0 TiB / 1.0 TiB avail; 48 KiB/s rd, 43 KiB/s wr, 16 op/s 2024-09-12T02:44:13.350 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 02:44:13 smithi039 ceph-mon[30515]: osdmap e98: 12 total, 12 up, 12 in 2024-09-12T02:44:13.448 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 12 02:44:13 smithi044 ceph-mon[35411]: pgmap v192: 129 pgs: 129 active+clean; 9.7 MiB data, 408 MiB used, 1.0 TiB / 1.0 TiB avail; 48 KiB/s rd, 43 KiB/s wr, 16 op/s 2024-09-12T02:44:13.449 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 12 02:44:13 smithi044 ceph-mon[35411]: osdmap e98: 12 total, 12 up, 12 in 2024-09-12T02:44:13.513 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 12 02:44:13 smithi172 ceph-mon[35609]: pgmap v192: 129 pgs: 129 active+clean; 9.7 MiB data, 408 MiB used, 1.0 TiB / 1.0 TiB avail; 48 KiB/s rd, 43 KiB/s wr, 16 op/s 2024-09-12T02:44:13.513 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 12 02:44:13 smithi172 ceph-mon[35609]: osdmap e98: 12 total, 12 up, 12 in 2024-09-12T02:44:15.349 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 02:44:15 smithi039 ceph-mon[30515]: pgmap v194: 129 pgs: 129 active+clean; 9.7 MiB data, 408 MiB used, 1.0 TiB / 1.0 TiB avail; 48 KiB/s rd, 43 KiB/s wr, 16 op/s 2024-09-12T02:44:15.448 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 12 02:44:15 smithi044 ceph-mon[35411]: pgmap v194: 129 pgs: 129 active+clean; 9.7 MiB data, 408 MiB used, 1.0 TiB / 1.0 TiB avail; 48 KiB/s rd, 43 KiB/s wr, 16 op/s 2024-09-12T02:44:15.513 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 12 02:44:15 smithi172 ceph-mon[35609]: pgmap v194: 129 pgs: 129 active+clean; 9.7 MiB data, 408 MiB used, 1.0 TiB / 1.0 TiB avail; 48 KiB/s rd, 43 KiB/s wr, 16 op/s 2024-09-12T02:44:17.448 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 12 02:44:17 smithi044 ceph-mon[35411]: pgmap v195: 129 pgs: 129 active+clean; 9.7 MiB data, 408 MiB used, 1.0 TiB / 1.0 TiB avail; 48 KiB/s rd, 43 KiB/s wr, 16 op/s 2024-09-12T02:44:17.513 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 12 02:44:17 smithi172 ceph-mon[35609]: pgmap v195: 129 pgs: 129 active+clean; 9.7 MiB data, 408 MiB used, 1.0 TiB / 1.0 TiB avail; 48 KiB/s rd, 43 KiB/s wr, 16 op/s 2024-09-12T02:44:17.599 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 02:44:17 smithi039 ceph-mon[30515]: pgmap v195: 129 pgs: 129 active+clean; 9.7 MiB data, 408 MiB used, 1.0 TiB / 1.0 TiB avail; 48 KiB/s rd, 43 KiB/s wr, 16 op/s 2024-09-12T02:44:18.827 INFO:tasks.workunit.client.0.smithi039.stdout:pread ret = 64 2024-09-12T02:44:18.827 INFO:tasks.workunit.client.0.smithi039.stdout:251/600: open fd = 3 2024-09-12T02:44:18.827 INFO:tasks.workunit.client.0.smithi039.stdout:write ret = 32 2024-09-12T02:44:18.827 INFO:tasks.workunit.client.0.smithi039.stdout:write ret = 32 2024-09-12T02:44:18.827 INFO:tasks.workunit.client.0.smithi039.stdout:pread ret = 64 2024-09-12T02:44:18.827 INFO:tasks.workunit.client.0.smithi039.stdout:252/600: open fd = 3 2024-09-12T02:44:18.827 INFO:tasks.workunit.client.0.smithi039.stdout:write ret = 32 2024-09-12T02:44:18.827 INFO:tasks.workunit.client.0.smithi039.stdout:write ret = 32 2024-09-12T02:44:18.827 INFO:tasks.workunit.client.0.smithi039.stdout:pread ret = 64 2024-09-12T02:44:18.828 INFO:tasks.workunit.client.0.smithi039.stdout:253/600: open fd = 3 2024-09-12T02:44:18.828 INFO:tasks.workunit.client.0.smithi039.stdout:write ret = 32 2024-09-12T02:44:18.828 INFO:tasks.workunit.client.0.smithi039.stdout:write ret = 32 2024-09-12T02:44:18.828 INFO:tasks.workunit.client.0.smithi039.stdout:pread ret = 64 2024-09-12T02:44:18.828 INFO:tasks.workunit.client.0.smithi039.stdout:254/600: open fd = 3 2024-09-12T02:44:18.828 INFO:tasks.workunit.client.0.smithi039.stdout:write ret = 32 2024-09-12T02:44:18.828 INFO:tasks.workunit.client.0.smithi039.stdout:write ret = 32 2024-09-12T02:44:18.828 INFO:tasks.workunit.client.0.smithi039.stdout:pread ret = 64 2024-09-12T02:44:18.828 INFO:tasks.workunit.client.0.smithi039.stdout:255/600: open fd = 3 2024-09-12T02:44:18.828 INFO:tasks.workunit.client.0.smithi039.stdout:write ret = 32 2024-09-12T02:44:18.828 INFO:tasks.workunit.client.0.smithi039.stdout:write ret = 32 2024-09-12T02:44:18.828 INFO:tasks.workunit.client.0.smithi039.stdout:pread ret = 64 2024-09-12T02:44:18.828 INFO:tasks.workunit.client.0.smithi039.stdout:256/600: open fd = 3 2024-09-12T02:44:18.829 INFO:tasks.workunit.client.0.smithi039.stdout:write ret = 32 2024-09-12T02:44:18.829 INFO:tasks.workunit.client.0.smithi039.stdout:write ret = 32 2024-09-12T02:44:18.829 INFO:tasks.workunit.client.0.smithi039.stdout:pread ret = 64 2024-09-12T02:44:18.829 INFO:tasks.workunit.client.0.smithi039.stdout:257/600: open fd = 3 2024-09-12T02:44:18.829 INFO:tasks.workunit.client.0.smithi039.stdout:write ret = 32 2024-09-12T02:44:18.829 INFO:tasks.workunit.client.0.smithi039.stdout:write ret = 32 2024-09-12T02:44:18.829 INFO:tasks.workunit.client.0.smithi039.stdout:pread ret = 64 2024-09-12T02:44:18.829 INFO:tasks.workunit.client.0.smithi039.stdout:258/600: open fd = 3 2024-09-12T02:44:18.829 INFO:tasks.workunit.client.0.smithi039.stdout:write ret = 32 2024-09-12T02:44:18.829 INFO:tasks.workunit.client.0.smithi039.stdout:write ret = 32 2024-09-12T02:44:18.829 INFO:tasks.workunit.client.0.smithi039.stdout:pread ret = 64 2024-09-12T02:44:18.829 INFO:tasks.workunit.client.0.smithi039.stdout:259/600: open fd = 3 2024-09-12T02:44:18.829 INFO:tasks.workunit.client.0.smithi039.stdout:write ret = 32 2024-09-12T02:44:18.829 INFO:tasks.workunit.client.0.smithi039.stdout:write ret = 32 2024-09-12T02:44:18.830 INFO:tasks.workunit.client.0.smithi039.stdout:pread ret = 64 2024-09-12T02:44:18.830 INFO:tasks.workunit.client.0.smithi039.stdout:260/600: open fd = 3 2024-09-12T02:44:18.830 INFO:tasks.workunit.client.0.smithi039.stdout:write ret = 32 2024-09-12T02:44:18.830 INFO:tasks.workunit.client.0.smithi039.stdout:write ret = 32 2024-09-12T02:44:18.830 INFO:tasks.workunit.client.0.smithi039.stdout:pread ret = 64 2024-09-12T02:44:18.830 INFO:tasks.workunit.client.0.smithi039.stdout:261/600: open fd = 3 2024-09-12T02:44:18.830 INFO:tasks.workunit.client.0.smithi039.stdout:write ret = 32 2024-09-12T02:44:18.830 INFO:tasks.workunit.client.0.smithi039.stdout:write ret = 32 2024-09-12T02:44:18.830 INFO:tasks.workunit.client.0.smithi039.stdout:pread ret = 64 2024-09-12T02:44:18.830 INFO:tasks.workunit.client.0.smithi039.stdout:262/600: open fd = 3 2024-09-12T02:44:18.830 INFO:tasks.workunit.client.0.smithi039.stdout:write ret = 32 2024-09-12T02:44:18.830 INFO:tasks.workunit.client.0.smithi039.stdout:write ret = 32 2024-09-12T02:44:18.830 INFO:tasks.workunit.client.0.smithi039.stdout:pread ret = 64 2024-09-12T02:44:18.830 INFO:tasks.workunit.client.0.smithi039.stdout:263/600: open fd = 3 2024-09-12T02:44:18.831 INFO:tasks.workunit.client.0.smithi039.stdout:write ret = 32 2024-09-12T02:44:18.831 INFO:tasks.workunit.client.0.smithi039.stdout:write ret = 32 2024-09-12T02:44:18.831 INFO:tasks.workunit.client.0.smithi039.stdout:pread ret = 64 2024-09-12T02:44:18.831 INFO:tasks.workunit.client.0.smithi039.stdout:264/600: open fd = 3 2024-09-12T02:44:18.831 INFO:tasks.workunit.client.0.smithi039.stdout:write ret = 32 2024-09-12T02:44:18.831 INFO:tasks.workunit.client.0.smithi039.stdout:write ret = 32 2024-09-12T02:44:18.831 INFO:tasks.workunit.client.0.smithi039.stdout:pread ret = 64 2024-09-12T02:44:18.831 INFO:tasks.workunit.client.0.smithi039.stdout:265/600: open fd = 3 2024-09-12T02:44:18.831 INFO:tasks.workunit.client.0.smithi039.stdout:write ret = 32 2024-09-12T02:44:18.831 INFO:tasks.workunit.client.0.smithi039.stdout:write ret = 32 2024-09-12T02:44:18.831 INFO:tasks.workunit.client.0.smithi039.stdout:pread ret = 64 2024-09-12T02:44:18.831 INFO:tasks.workunit.client.0.smithi039.stdout:266/600: open fd = 3 2024-09-12T02:44:18.831 INFO:tasks.workunit.client.0.smithi039.stdout:write ret = 32 2024-09-12T02:44:18.831 INFO:tasks.workunit.client.0.smithi039.stdout:write ret = 32 2024-09-12T02:44:18.832 INFO:tasks.workunit.client.0.smithi039.stdout:pread ret = 64 2024-09-12T02:44:18.832 INFO:tasks.workunit.client.0.smithi039.stdout:267/600: open fd = 3 2024-09-12T02:44:18.832 INFO:tasks.workunit.client.0.smithi039.stdout:write ret = 32 2024-09-12T02:44:18.832 INFO:tasks.workunit.client.0.smithi039.stdout:write ret = 32 2024-09-12T02:44:18.832 INFO:tasks.workunit.client.0.smithi039.stdout:pread ret = 64 2024-09-12T02:44:18.832 INFO:tasks.workunit.client.0.smithi039.stdout:268/600: open fd = 3 2024-09-12T02:44:18.832 INFO:tasks.workunit.client.0.smithi039.stdout:write ret = 32 2024-09-12T02:44:18.832 INFO:tasks.workunit.client.0.smithi039.stdout:write ret = 32 2024-09-12T02:44:18.832 INFO:tasks.workunit.client.0.smithi039.stdout:pread ret = 64 2024-09-12T02:44:18.832 INFO:tasks.workunit.client.0.smithi039.stdout:269/600: open fd = 3 2024-09-12T02:44:18.832 INFO:tasks.workunit.client.0.smithi039.stdout:write ret = 32 2024-09-12T02:44:18.832 INFO:tasks.workunit.client.0.smithi039.stdout:write ret = 32 2024-09-12T02:44:18.832 INFO:tasks.workunit.client.0.smithi039.stdout:pread ret = 64 2024-09-12T02:44:18.832 INFO:tasks.workunit.client.0.smithi039.stdout:270/600: open fd = 3 2024-09-12T02:44:18.833 INFO:tasks.workunit.client.0.smithi039.stdout:write ret = 32 2024-09-12T02:44:18.833 INFO:tasks.workunit.client.0.smithi039.stdout:write ret = 32 2024-09-12T02:44:18.833 INFO:tasks.workunit.client.0.smithi039.stdout:pread ret = 64 2024-09-12T02:44:18.833 INFO:tasks.workunit.client.0.smithi039.stdout:271/600: open fd = 3 2024-09-12T02:44:18.833 INFO:tasks.workunit.client.0.smithi039.stdout:write ret = 32 2024-09-12T02:44:18.833 INFO:tasks.workunit.client.0.smithi039.stdout:write ret = 32 2024-09-12T02:44:18.833 INFO:tasks.workunit.client.0.smithi039.stdout:pread ret = 64 2024-09-12T02:44:18.833 INFO:tasks.workunit.client.0.smithi039.stdout:272/600: open fd = 3 2024-09-12T02:44:18.833 INFO:tasks.workunit.client.0.smithi039.stdout:write ret = 32 2024-09-12T02:44:18.833 INFO:tasks.workunit.client.0.smithi039.stdout:write ret = 32 2024-09-12T02:44:18.833 INFO:tasks.workunit.client.0.smithi039.stdout:pread ret = 64 2024-09-12T02:44:18.833 INFO:tasks.workunit.client.0.smithi039.stdout:273/600: open fd = 3 2024-09-12T02:44:18.833 INFO:tasks.workunit.client.0.smithi039.stdout:write ret = 32 2024-09-12T02:44:18.833 INFO:tasks.workunit.client.0.smithi039.stdout:write ret = 32 2024-09-12T02:44:18.834 INFO:tasks.workunit.client.0.smithi039.stdout:pread ret = 64 2024-09-12T02:44:18.834 INFO:tasks.workunit.client.0.smithi039.stdout:274/600: open fd = 3 2024-09-12T02:44:18.834 INFO:tasks.workunit.client.0.smithi039.stdout:write ret = 32 2024-09-12T02:44:18.834 INFO:tasks.workunit.client.0.smithi039.stdout:write ret = 32 2024-09-12T02:44:18.834 INFO:tasks.workunit.client.0.smithi039.stdout:pread ret = 64 2024-09-12T02:44:18.834 INFO:tasks.workunit.client.0.smithi039.stdout:275/600: open fd = 3 2024-09-12T02:44:18.834 INFO:tasks.workunit.client.0.smithi039.stdout:write ret = 32 2024-09-12T02:44:18.834 INFO:tasks.workunit.client.0.smithi039.stdout:write ret = 32 2024-09-12T02:44:18.834 INFO:tasks.workunit.client.0.smithi039.stdout:pread ret = 64 2024-09-12T02:44:18.834 INFO:tasks.workunit.client.0.smithi039.stdout:276/600: open fd = 3 2024-09-12T02:44:18.834 INFO:tasks.workunit.client.0.smithi039.stdout:write ret = 32 2024-09-12T02:44:18.834 INFO:tasks.workunit.client.0.smithi039.stdout:write ret = 32 2024-09-12T02:44:18.834 INFO:tasks.workunit.client.0.smithi039.stdout:pread ret = 64 2024-09-12T02:44:18.834 INFO:tasks.workunit.client.0.smithi039.stdout:277/600: open fd = 3 2024-09-12T02:44:18.834 INFO:tasks.workunit.client.0.smithi039.stdout:write ret = 32 2024-09-12T02:44:18.835 INFO:tasks.workunit.client.0.smithi039.stdout:write ret = 32 2024-09-12T02:44:18.835 INFO:tasks.workunit.client.0.smithi039.stdout:pread ret = 64 2024-09-12T02:44:18.835 INFO:tasks.workunit.client.0.smithi039.stdout:278/600: open fd = 3 2024-09-12T02:44:18.835 INFO:tasks.workunit.client.0.smithi039.stdout:write ret = 32 2024-09-12T02:44:18.835 INFO:tasks.workunit.client.0.smithi039.stdout:write ret = 32 2024-09-12T02:44:18.835 INFO:tasks.workunit.client.0.smithi039.stdout:pread ret = 64 2024-09-12T02:44:18.835 INFO:tasks.workunit.client.0.smithi039.stdout:279/600: open fd = 3 2024-09-12T02:44:18.835 INFO:tasks.workunit.client.0.smithi039.stdout:write ret = 32 2024-09-12T02:44:18.835 INFO:tasks.workunit.client.0.smithi039.stdout:write ret = 32 2024-09-12T02:44:18.835 INFO:tasks.workunit.client.0.smithi039.stdout:pread ret = 64 2024-09-12T02:44:18.835 INFO:tasks.workunit.client.0.smithi039.stdout:280/600: open fd = 3 2024-09-12T02:44:18.835 INFO:tasks.workunit.client.0.smithi039.stdout:write ret = 32 2024-09-12T02:44:18.835 INFO:tasks.workunit.client.0.smithi039.stdout:write ret = 32 2024-09-12T02:44:18.835 INFO:tasks.workunit.client.0.smithi039.stdout:pread ret = 64 2024-09-12T02:44:18.835 INFO:tasks.workunit.client.0.smithi039.stdout:281/600: open fd = 3 2024-09-12T02:44:18.836 INFO:tasks.workunit.client.0.smithi039.stdout:write ret = 32 2024-09-12T02:44:18.836 INFO:tasks.workunit.client.0.smithi039.stdout:write ret = 32 2024-09-12T02:44:18.836 INFO:tasks.workunit.client.0.smithi039.stdout:pread ret = 64 2024-09-12T02:44:18.836 INFO:tasks.workunit.client.0.smithi039.stdout:282/600: open fd = 3 2024-09-12T02:44:18.836 INFO:tasks.workunit.client.0.smithi039.stdout:write ret = 32 2024-09-12T02:44:18.836 INFO:tasks.workunit.client.0.smithi039.stdout:write ret = 32 2024-09-12T02:44:18.836 INFO:tasks.workunit.client.0.smithi039.stdout:pread ret = 64 2024-09-12T02:44:18.836 INFO:tasks.workunit.client.0.smithi039.stdout:283/600: open fd = 3 2024-09-12T02:44:18.836 INFO:tasks.workunit.client.0.smithi039.stdout:write ret = 32 2024-09-12T02:44:18.836 INFO:tasks.workunit.client.0.smithi039.stdout:write ret = 32 2024-09-12T02:44:18.836 INFO:tasks.workunit.client.0.smithi039.stdout:pread ret = 64 2024-09-12T02:44:18.836 INFO:tasks.workunit.client.0.smithi039.stdout:284/600: open fd = 3 2024-09-12T02:44:18.836 INFO:tasks.workunit.client.0.smithi039.stdout:write ret = 32 2024-09-12T02:44:18.837 INFO:tasks.workunit.client.0.smithi039.stdout:write ret = 32 2024-09-12T02:44:18.837 INFO:tasks.workunit.client.0.smithi039.stdout:pread ret = 64 2024-09-12T02:44:18.837 INFO:tasks.workunit.client.0.smithi039.stdout:285/600: open fd = 3 2024-09-12T02:44:18.837 INFO:tasks.workunit.client.0.smithi039.stdout:write ret = 32 2024-09-12T02:44:18.837 INFO:tasks.workunit.client.0.smithi039.stdout:write ret = 32 2024-09-12T02:44:18.837 INFO:tasks.workunit.client.0.smithi039.stdout:pread ret = 64 2024-09-12T02:44:18.837 INFO:tasks.workunit.client.0.smithi039.stdout:286/600: open fd = 3 2024-09-12T02:44:18.837 INFO:tasks.workunit.client.0.smithi039.stdout:write ret = 32 2024-09-12T02:44:18.837 INFO:tasks.workunit.client.0.smithi039.stdout:write ret = 32 2024-09-12T02:44:18.837 INFO:tasks.workunit.client.0.smithi039.stdout:pread ret = 64 2024-09-12T02:44:18.837 INFO:tasks.workunit.client.0.smithi039.stdout:287/600: open fd = 3 2024-09-12T02:44:18.837 INFO:tasks.workunit.client.0.smithi039.stdout:write ret = 32 2024-09-12T02:44:18.837 INFO:tasks.workunit.client.0.smithi039.stdout:write ret = 32 2024-09-12T02:44:18.837 INFO:tasks.workunit.client.0.smithi039.stdout:pread ret = 64 2024-09-12T02:44:18.837 INFO:tasks.workunit.client.0.smithi039.stdout:288/600: open fd = 3 2024-09-12T02:44:18.838 INFO:tasks.workunit.client.0.smithi039.stdout:write ret = 32 2024-09-12T02:44:18.838 INFO:tasks.workunit.client.0.smithi039.stdout:write ret = 32 2024-09-12T02:44:18.838 INFO:tasks.workunit.client.0.smithi039.stdout:pread ret = 64 2024-09-12T02:44:18.838 INFO:tasks.workunit.client.0.smithi039.stdout:289/600: open fd = 3 2024-09-12T02:44:18.838 INFO:tasks.workunit.client.0.smithi039.stdout:write ret = 32 2024-09-12T02:44:18.838 INFO:tasks.workunit.client.0.smithi039.stdout:write ret = 32 2024-09-12T02:44:18.838 INFO:tasks.workunit.client.0.smithi039.stdout:pread ret = 64 2024-09-12T02:44:18.838 INFO:tasks.workunit.client.0.smithi039.stdout:290/600: open fd = 3 2024-09-12T02:44:18.838 INFO:tasks.workunit.client.0.smithi039.stdout:write ret = 32 2024-09-12T02:44:18.838 INFO:tasks.workunit.client.0.smithi039.stdout:write ret = 32 2024-09-12T02:44:18.838 INFO:tasks.workunit.client.0.smithi039.stdout:pread ret = 64 2024-09-12T02:44:18.838 INFO:tasks.workunit.client.0.smithi039.stdout:291/600: open fd = 3 2024-09-12T02:44:18.838 INFO:tasks.workunit.client.0.smithi039.stdout:write ret = 32 2024-09-12T02:44:18.838 INFO:tasks.workunit.client.0.smithi039.stdout:write ret = 32 2024-09-12T02:44:18.839 INFO:tasks.workunit.client.0.smithi039.stdout:pread ret = 64 2024-09-12T02:44:18.839 INFO:tasks.workunit.client.0.smithi039.stdout:292/600: open fd = 3 2024-09-12T02:44:18.839 INFO:tasks.workunit.client.0.smithi039.stdout:write ret = 32 2024-09-12T02:44:18.839 INFO:tasks.workunit.client.0.smithi039.stdout:write ret = 32 2024-09-12T02:44:18.839 INFO:tasks.workunit.client.0.smithi039.stdout:pread ret = 64 2024-09-12T02:44:18.839 INFO:tasks.workunit.client.0.smithi039.stdout:293/600: open fd = 3 2024-09-12T02:44:18.839 INFO:tasks.workunit.client.0.smithi039.stdout:write ret = 32 2024-09-12T02:44:18.839 INFO:tasks.workunit.client.0.smithi039.stdout:write ret = 32 2024-09-12T02:44:18.839 INFO:tasks.workunit.client.0.smithi039.stdout:pread ret = 64 2024-09-12T02:44:18.839 INFO:tasks.workunit.client.0.smithi039.stdout:294/600: open fd = 3 2024-09-12T02:44:18.839 INFO:tasks.workunit.client.0.smithi039.stdout:write ret = 32 2024-09-12T02:44:18.839 INFO:tasks.workunit.client.0.smithi039.stdout:write ret = 32 2024-09-12T02:44:18.839 INFO:tasks.workunit.client.0.smithi039.stdout:pread ret = 64 2024-09-12T02:44:18.839 INFO:tasks.workunit.client.0.smithi039.stdout:295/600: open fd = 3 2024-09-12T02:44:18.839 INFO:tasks.workunit.client.0.smithi039.stdout:write ret = 32 2024-09-12T02:44:18.840 INFO:tasks.workunit.client.0.smithi039.stdout:write ret = 32 2024-09-12T02:44:18.840 INFO:tasks.workunit.client.0.smithi039.stdout:pread ret = 64 2024-09-12T02:44:18.840 INFO:tasks.workunit.client.0.smithi039.stdout:296/600: open fd = 3 2024-09-12T02:44:18.840 INFO:tasks.workunit.client.0.smithi039.stdout:write ret = 32 2024-09-12T02:44:18.840 INFO:tasks.workunit.client.0.smithi039.stdout:write ret = 32 2024-09-12T02:44:18.840 INFO:tasks.workunit.client.0.smithi039.stdout:pread ret = 64 2024-09-12T02:44:18.840 INFO:tasks.workunit.client.0.smithi039.stdout:297/600: open fd = 3 2024-09-12T02:44:18.840 INFO:tasks.workunit.client.0.smithi039.stdout:write ret = 32 2024-09-12T02:44:18.840 INFO:tasks.workunit.client.0.smithi039.stdout:write ret = 32 2024-09-12T02:44:18.840 INFO:tasks.workunit.client.0.smithi039.stdout:pread ret = 64 2024-09-12T02:44:18.840 INFO:tasks.workunit.client.0.smithi039.stdout:298/600: open fd = 3 2024-09-12T02:44:18.840 INFO:tasks.workunit.client.0.smithi039.stdout:write ret = 32 2024-09-12T02:44:18.840 INFO:tasks.workunit.client.0.smithi039.stdout:write ret = 32 2024-09-12T02:44:18.841 INFO:tasks.workunit.client.0.smithi039.stdout:pread ret = 64 2024-09-12T02:44:18.841 INFO:tasks.workunit.client.0.smithi039.stdout:299/600: open fd = 3 2024-09-12T02:44:18.841 INFO:tasks.workunit.client.0.smithi039.stdout:write ret = 32 2024-09-12T02:44:18.841 INFO:tasks.workunit.client.0.smithi039.stdout:write ret = 32 2024-09-12T02:44:18.841 INFO:tasks.workunit.client.0.smithi039.stdout:pread ret = 64 2024-09-12T02:44:18.841 INFO:tasks.workunit.client.0.smithi039.stdout:300/600: open fd = 3 2024-09-12T02:44:18.841 INFO:tasks.workunit.client.0.smithi039.stdout:write ret = 32 2024-09-12T02:44:18.841 INFO:tasks.workunit.client.0.smithi039.stdout:write ret = 32 2024-09-12T02:44:18.841 INFO:tasks.workunit.client.0.smithi039.stdout:pread ret = 64 2024-09-12T02:44:18.841 INFO:tasks.workunit.client.0.smithi039.stdout:301/600: open fd = 3 2024-09-12T02:44:18.841 INFO:tasks.workunit.client.0.smithi039.stdout:write ret = 32 2024-09-12T02:44:18.841 INFO:tasks.workunit.client.0.smithi039.stdout:write ret = 32 2024-09-12T02:44:18.841 INFO:tasks.workunit.client.0.smithi039.stdout:pread ret = 64 2024-09-12T02:44:18.841 INFO:tasks.workunit.client.0.smithi039.stdout:302/600: open fd = 3 2024-09-12T02:44:18.842 INFO:tasks.workunit.client.0.smithi039.stdout:write ret = 32 2024-09-12T02:44:18.842 INFO:tasks.workunit.client.0.smithi039.stdout:write ret = 32 2024-09-12T02:44:18.842 INFO:tasks.workunit.client.0.smithi039.stdout:pread ret = 64 2024-09-12T02:44:18.842 INFO:tasks.workunit.client.0.smithi039.stdout:303/600: open fd = 3 2024-09-12T02:44:18.842 INFO:tasks.workunit.client.0.smithi039.stdout:write ret = 32 2024-09-12T02:44:18.842 INFO:tasks.workunit.client.0.smithi039.stdout:write ret = 32 2024-09-12T02:44:18.842 INFO:tasks.workunit.client.0.smithi039.stdout:pread ret = 64 2024-09-12T02:44:18.842 INFO:tasks.workunit.client.0.smithi039.stdout:304/600: open fd = 3 2024-09-12T02:44:18.842 INFO:tasks.workunit.client.0.smithi039.stdout:write ret = 32 2024-09-12T02:44:18.842 INFO:tasks.workunit.client.0.smithi039.stdout:write ret = 32 2024-09-12T02:44:18.842 INFO:tasks.workunit.client.0.smithi039.stdout:pread ret = 64 2024-09-12T02:44:18.843 INFO:tasks.workunit.client.0.smithi039.stdout:305/600: open fd = 3 2024-09-12T02:44:18.843 INFO:tasks.workunit.client.0.smithi039.stdout:write ret = 32 2024-09-12T02:44:18.843 INFO:tasks.workunit.client.0.smithi039.stdout:write ret = 32 2024-09-12T02:44:18.843 INFO:tasks.workunit.client.0.smithi039.stdout:pread ret = 64 2024-09-12T02:44:18.843 INFO:tasks.workunit.client.0.smithi039.stdout:306/600: open fd = 3 2024-09-12T02:44:18.843 INFO:tasks.workunit.client.0.smithi039.stdout:write ret = 32 2024-09-12T02:44:18.843 INFO:tasks.workunit.client.0.smithi039.stdout:write ret = 32 2024-09-12T02:44:18.843 INFO:tasks.workunit.client.0.smithi039.stdout:pread ret = 64 2024-09-12T02:44:18.843 INFO:tasks.workunit.client.0.smithi039.stdout:307/600: open fd = 3 2024-09-12T02:44:18.843 INFO:tasks.workunit.client.0.smithi039.stdout:write ret = 32 2024-09-12T02:44:18.843 INFO:tasks.workunit.client.0.smithi039.stdout:write ret = 32 2024-09-12T02:44:18.843 INFO:tasks.workunit.client.0.smithi039.stdout:pread ret = 64 2024-09-12T02:44:18.843 INFO:tasks.workunit.client.0.smithi039.stdout:308/600: open fd = 3 2024-09-12T02:44:18.843 INFO:tasks.workunit.client.0.smithi039.stdout:write ret = 32 2024-09-12T02:44:18.844 INFO:tasks.workunit.client.0.smithi039.stdout:write ret = 32 2024-09-12T02:44:18.844 INFO:tasks.workunit.client.0.smithi039.stdout:pread ret = 64 2024-09-12T02:44:18.844 INFO:tasks.workunit.client.0.smithi039.stdout:309/600: open fd = 3 2024-09-12T02:44:18.844 INFO:tasks.workunit.client.0.smithi039.stdout:write ret = 32 2024-09-12T02:44:18.844 INFO:tasks.workunit.client.0.smithi039.stdout:write ret = 32 2024-09-12T02:44:18.844 INFO:tasks.workunit.client.0.smithi039.stdout:pread ret = 64 2024-09-12T02:44:18.844 INFO:tasks.workunit.client.0.smithi039.stdout:310/600: open fd = 3 2024-09-12T02:44:18.844 INFO:tasks.workunit.client.0.smithi039.stdout:write ret = 32 2024-09-12T02:44:18.844 INFO:tasks.workunit.client.0.smithi039.stdout:write ret = 32 2024-09-12T02:44:18.844 INFO:tasks.workunit.client.0.smithi039.stdout:pread ret = 64 2024-09-12T02:44:18.844 INFO:tasks.workunit.client.0.smithi039.stdout:311/600: open fd = 3 2024-09-12T02:44:18.844 INFO:tasks.workunit.client.0.smithi039.stdout:write ret = 32 2024-09-12T02:44:18.844 INFO:tasks.workunit.client.0.smithi039.stdout:write ret = 32 2024-09-12T02:44:18.844 INFO:tasks.workunit.client.0.smithi039.stdout:pread ret = 64 2024-09-12T02:44:18.845 INFO:tasks.workunit.client.0.smithi039.stdout:312/600: open fd = 3 2024-09-12T02:44:18.845 INFO:tasks.workunit.client.0.smithi039.stdout:write ret = 32 2024-09-12T02:44:18.845 INFO:tasks.workunit.client.0.smithi039.stdout:write ret = 32 2024-09-12T02:44:19.448 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 12 02:44:19 smithi044 ceph-mon[35411]: pgmap v196: 129 pgs: 129 active+clean; 9.9 MiB data, 408 MiB used, 1.0 TiB / 1.0 TiB avail; 46 KiB/s rd, 41 KiB/s wr, 15 op/s 2024-09-12T02:44:19.513 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 12 02:44:19 smithi172 ceph-mon[35609]: pgmap v196: 129 pgs: 129 active+clean; 9.9 MiB data, 408 MiB used, 1.0 TiB / 1.0 TiB avail; 46 KiB/s rd, 41 KiB/s wr, 15 op/s 2024-09-12T02:44:19.599 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 02:44:19 smithi039 ceph-mon[30515]: pgmap v196: 129 pgs: 129 active+clean; 9.9 MiB data, 408 MiB used, 1.0 TiB / 1.0 TiB avail; 46 KiB/s rd, 41 KiB/s wr, 15 op/s 2024-09-12T02:44:21.448 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 12 02:44:21 smithi044 ceph-mon[35411]: pgmap v197: 129 pgs: 129 active+clean; 9.9 MiB data, 408 MiB used, 1.0 TiB / 1.0 TiB avail; 46 KiB/s rd, 41 KiB/s wr, 15 op/s 2024-09-12T02:44:21.513 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 12 02:44:21 smithi172 ceph-mon[35609]: pgmap v197: 129 pgs: 129 active+clean; 9.9 MiB data, 408 MiB used, 1.0 TiB / 1.0 TiB avail; 46 KiB/s rd, 41 KiB/s wr, 15 op/s 2024-09-12T02:44:21.599 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 02:44:21 smithi039 ceph-mon[30515]: pgmap v197: 129 pgs: 129 active+clean; 9.9 MiB data, 408 MiB used, 1.0 TiB / 1.0 TiB avail; 46 KiB/s rd, 41 KiB/s wr, 15 op/s 2024-09-12T02:44:23.448 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 12 02:44:23 smithi044 ceph-mon[35411]: pgmap v198: 129 pgs: 129 active+clean; 10 MiB data, 409 MiB used, 1.0 TiB / 1.0 TiB avail; 46 KiB/s rd, 41 KiB/s wr, 15 op/s 2024-09-12T02:44:23.513 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 12 02:44:23 smithi172 ceph-mon[35609]: pgmap v198: 129 pgs: 129 active+clean; 10 MiB data, 409 MiB used, 1.0 TiB / 1.0 TiB avail; 46 KiB/s rd, 41 KiB/s wr, 15 op/s 2024-09-12T02:44:23.600 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 02:44:23 smithi039 ceph-mon[30515]: pgmap v198: 129 pgs: 129 active+clean; 10 MiB data, 409 MiB used, 1.0 TiB / 1.0 TiB avail; 46 KiB/s rd, 41 KiB/s wr, 15 op/s 2024-09-12T02:44:25.448 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 12 02:44:25 smithi044 ceph-mon[35411]: pgmap v199: 129 pgs: 129 active+clean; 10 MiB data, 409 MiB used, 1.0 TiB / 1.0 TiB avail; 38 KiB/s rd, 35 KiB/s wr, 13 op/s 2024-09-12T02:44:25.513 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 12 02:44:25 smithi172 ceph-mon[35609]: pgmap v199: 129 pgs: 129 active+clean; 10 MiB data, 409 MiB used, 1.0 TiB / 1.0 TiB avail; 38 KiB/s rd, 35 KiB/s wr, 13 op/s 2024-09-12T02:44:25.600 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 02:44:25 smithi039 ceph-mon[30515]: pgmap v199: 129 pgs: 129 active+clean; 10 MiB data, 409 MiB used, 1.0 TiB / 1.0 TiB avail; 38 KiB/s rd, 35 KiB/s wr, 13 op/s 2024-09-12T02:44:27.448 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 12 02:44:27 smithi044 ceph-mon[35411]: pgmap v200: 129 pgs: 129 active+clean; 10 MiB data, 409 MiB used, 1.0 TiB / 1.0 TiB avail; 38 KiB/s rd, 35 KiB/s wr, 13 op/s 2024-09-12T02:44:27.513 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 12 02:44:27 smithi172 ceph-mon[35609]: pgmap v200: 129 pgs: 129 active+clean; 10 MiB data, 409 MiB used, 1.0 TiB / 1.0 TiB avail; 38 KiB/s rd, 35 KiB/s wr, 13 op/s 2024-09-12T02:44:27.600 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 02:44:27 smithi039 ceph-mon[30515]: pgmap v200: 129 pgs: 129 active+clean; 10 MiB data, 409 MiB used, 1.0 TiB / 1.0 TiB avail; 38 KiB/s rd, 35 KiB/s wr, 13 op/s 2024-09-12T02:44:29.448 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 12 02:44:29 smithi044 ceph-mon[35411]: pgmap v201: 129 pgs: 129 active+clean; 10 MiB data, 410 MiB used, 1.0 TiB / 1.0 TiB avail; 59 KiB/s rd, 54 KiB/s wr, 20 op/s 2024-09-12T02:44:29.513 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 12 02:44:29 smithi172 ceph-mon[35609]: pgmap v201: 129 pgs: 129 active+clean; 10 MiB data, 410 MiB used, 1.0 TiB / 1.0 TiB avail; 59 KiB/s rd, 54 KiB/s wr, 20 op/s 2024-09-12T02:44:29.599 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 02:44:29 smithi039 ceph-mon[30515]: pgmap v201: 129 pgs: 129 active+clean; 10 MiB data, 410 MiB used, 1.0 TiB / 1.0 TiB avail; 59 KiB/s rd, 54 KiB/s wr, 20 op/s 2024-09-12T02:44:31.448 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 12 02:44:31 smithi044 ceph-mon[35411]: pgmap v202: 129 pgs: 129 active+clean; 10 MiB data, 410 MiB used, 1.0 TiB / 1.0 TiB avail; 39 KiB/s rd, 36 KiB/s wr, 13 op/s 2024-09-12T02:44:31.513 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 12 02:44:31 smithi172 ceph-mon[35609]: pgmap v202: 129 pgs: 129 active+clean; 10 MiB data, 410 MiB used, 1.0 TiB / 1.0 TiB avail; 39 KiB/s rd, 36 KiB/s wr, 13 op/s 2024-09-12T02:44:31.599 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 02:44:31 smithi039 ceph-mon[30515]: pgmap v202: 129 pgs: 129 active+clean; 10 MiB data, 410 MiB used, 1.0 TiB / 1.0 TiB avail; 39 KiB/s rd, 36 KiB/s wr, 13 op/s 2024-09-12T02:44:33.448 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 12 02:44:33 smithi044 ceph-mon[35411]: pgmap v203: 129 pgs: 129 active+clean; 10 MiB data, 410 MiB used, 1.0 TiB / 1.0 TiB avail; 58 KiB/s rd, 53 KiB/s wr, 19 op/s 2024-09-12T02:44:33.513 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 12 02:44:33 smithi172 ceph-mon[35609]: pgmap v203: 129 pgs: 129 active+clean; 10 MiB data, 410 MiB used, 1.0 TiB / 1.0 TiB avail; 58 KiB/s rd, 53 KiB/s wr, 19 op/s 2024-09-12T02:44:33.599 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 02:44:33 smithi039 ceph-mon[30515]: pgmap v203: 129 pgs: 129 active+clean; 10 MiB data, 410 MiB used, 1.0 TiB / 1.0 TiB avail; 58 KiB/s rd, 53 KiB/s wr, 19 op/s 2024-09-12T02:44:35.448 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 12 02:44:35 smithi044 ceph-mon[35411]: pgmap v204: 129 pgs: 129 active+clean; 10 MiB data, 410 MiB used, 1.0 TiB / 1.0 TiB avail; 39 KiB/s rd, 36 KiB/s wr, 13 op/s 2024-09-12T02:44:35.513 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 12 02:44:35 smithi172 ceph-mon[35609]: pgmap v204: 129 pgs: 129 active+clean; 10 MiB data, 410 MiB used, 1.0 TiB / 1.0 TiB avail; 39 KiB/s rd, 36 KiB/s wr, 13 op/s 2024-09-12T02:44:35.599 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 02:44:35 smithi039 ceph-mon[30515]: pgmap v204: 129 pgs: 129 active+clean; 10 MiB data, 410 MiB used, 1.0 TiB / 1.0 TiB avail; 39 KiB/s rd, 36 KiB/s wr, 13 op/s 2024-09-12T02:44:37.449 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 12 02:44:37 smithi044 ceph-mon[35411]: pgmap v205: 129 pgs: 129 active+clean; 10 MiB data, 410 MiB used, 1.0 TiB / 1.0 TiB avail; 39 KiB/s rd, 36 KiB/s wr, 13 op/s 2024-09-12T02:44:37.513 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 12 02:44:37 smithi172 ceph-mon[35609]: pgmap v205: 129 pgs: 129 active+clean; 10 MiB data, 410 MiB used, 1.0 TiB / 1.0 TiB avail; 39 KiB/s rd, 36 KiB/s wr, 13 op/s 2024-09-12T02:44:37.599 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 02:44:37 smithi039 ceph-mon[30515]: pgmap v205: 129 pgs: 129 active+clean; 10 MiB data, 410 MiB used, 1.0 TiB / 1.0 TiB avail; 39 KiB/s rd, 36 KiB/s wr, 13 op/s 2024-09-12T02:44:39.448 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 12 02:44:39 smithi044 ceph-mon[35411]: pgmap v206: 129 pgs: 129 active+clean; 11 MiB data, 411 MiB used, 1.0 TiB / 1.0 TiB avail; 59 KiB/s rd, 54 KiB/s wr, 20 op/s 2024-09-12T02:44:39.513 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 12 02:44:39 smithi172 ceph-mon[35609]: pgmap v206: 129 pgs: 129 active+clean; 11 MiB data, 411 MiB used, 1.0 TiB / 1.0 TiB avail; 59 KiB/s rd, 54 KiB/s wr, 20 op/s 2024-09-12T02:44:39.599 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 02:44:39 smithi039 ceph-mon[30515]: pgmap v206: 129 pgs: 129 active+clean; 11 MiB data, 411 MiB used, 1.0 TiB / 1.0 TiB avail; 59 KiB/s rd, 54 KiB/s wr, 20 op/s 2024-09-12T02:44:41.448 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 12 02:44:41 smithi044 ceph-mon[35411]: pgmap v207: 129 pgs: 129 active+clean; 11 MiB data, 411 MiB used, 1.0 TiB / 1.0 TiB avail; 38 KiB/s rd, 35 KiB/s wr, 13 op/s 2024-09-12T02:44:41.513 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 12 02:44:41 smithi172 ceph-mon[35609]: pgmap v207: 129 pgs: 129 active+clean; 11 MiB data, 411 MiB used, 1.0 TiB / 1.0 TiB avail; 38 KiB/s rd, 35 KiB/s wr, 13 op/s 2024-09-12T02:44:41.599 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 02:44:41 smithi039 ceph-mon[30515]: pgmap v207: 129 pgs: 129 active+clean; 11 MiB data, 411 MiB used, 1.0 TiB / 1.0 TiB avail; 38 KiB/s rd, 35 KiB/s wr, 13 op/s 2024-09-12T02:44:43.448 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 12 02:44:43 smithi044 ceph-mon[35411]: pgmap v208: 129 pgs: 129 active+clean; 11 MiB data, 411 MiB used, 1.0 TiB / 1.0 TiB avail; 56 KiB/s rd, 48 KiB/s wr, 19 op/s 2024-09-12T02:44:43.513 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 12 02:44:43 smithi172 ceph-mon[35609]: pgmap v208: 129 pgs: 129 active+clean; 11 MiB data, 411 MiB used, 1.0 TiB / 1.0 TiB avail; 56 KiB/s rd, 48 KiB/s wr, 19 op/s 2024-09-12T02:44:43.599 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 02:44:43 smithi039 ceph-mon[30515]: pgmap v208: 129 pgs: 129 active+clean; 11 MiB data, 411 MiB used, 1.0 TiB / 1.0 TiB avail; 56 KiB/s rd, 48 KiB/s wr, 19 op/s 2024-09-12T02:44:45.513 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 12 02:44:45 smithi172 ceph-mon[35609]: pgmap v209: 129 pgs: 129 active+clean; 11 MiB data, 411 MiB used, 1.0 TiB / 1.0 TiB avail; 38 KiB/s rd, 31 KiB/s wr, 12 op/s 2024-09-12T02:44:45.599 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 02:44:45 smithi039 ceph-mon[30515]: pgmap v209: 129 pgs: 129 active+clean; 11 MiB data, 411 MiB used, 1.0 TiB / 1.0 TiB avail; 38 KiB/s rd, 31 KiB/s wr, 12 op/s 2024-09-12T02:44:45.698 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 12 02:44:45 smithi044 ceph-mon[35411]: pgmap v209: 129 pgs: 129 active+clean; 11 MiB data, 411 MiB used, 1.0 TiB / 1.0 TiB avail; 38 KiB/s rd, 31 KiB/s wr, 12 op/s 2024-09-12T02:44:47.513 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 12 02:44:47 smithi172 ceph-mon[35609]: pgmap v210: 129 pgs: 129 active+clean; 11 MiB data, 411 MiB used, 1.0 TiB / 1.0 TiB avail; 38 KiB/s rd, 31 KiB/s wr, 12 op/s 2024-09-12T02:44:47.600 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 02:44:47 smithi039 ceph-mon[30515]: pgmap v210: 129 pgs: 129 active+clean; 11 MiB data, 411 MiB used, 1.0 TiB / 1.0 TiB avail; 38 KiB/s rd, 31 KiB/s wr, 12 op/s 2024-09-12T02:44:47.698 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 12 02:44:47 smithi044 ceph-mon[35411]: pgmap v210: 129 pgs: 129 active+clean; 11 MiB data, 411 MiB used, 1.0 TiB / 1.0 TiB avail; 38 KiB/s rd, 31 KiB/s wr, 12 op/s 2024-09-12T02:44:49.513 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 12 02:44:49 smithi172 ceph-mon[35609]: pgmap v211: 129 pgs: 129 active+clean; 11 MiB data, 412 MiB used, 1.0 TiB / 1.0 TiB avail; 59 KiB/s rd, 50 KiB/s wr, 19 op/s 2024-09-12T02:44:49.599 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 02:44:49 smithi039 ceph-mon[30515]: pgmap v211: 129 pgs: 129 active+clean; 11 MiB data, 412 MiB used, 1.0 TiB / 1.0 TiB avail; 59 KiB/s rd, 50 KiB/s wr, 19 op/s 2024-09-12T02:44:49.698 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 12 02:44:49 smithi044 ceph-mon[35411]: pgmap v211: 129 pgs: 129 active+clean; 11 MiB data, 412 MiB used, 1.0 TiB / 1.0 TiB avail; 59 KiB/s rd, 50 KiB/s wr, 19 op/s 2024-09-12T02:44:51.513 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 12 02:44:51 smithi172 ceph-mon[35609]: pgmap v212: 129 pgs: 129 active+clean; 11 MiB data, 412 MiB used, 1.0 TiB / 1.0 TiB avail; 39 KiB/s rd, 32 KiB/s wr, 12 op/s 2024-09-12T02:44:51.600 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 02:44:51 smithi039 ceph-mon[30515]: pgmap v212: 129 pgs: 129 active+clean; 11 MiB data, 412 MiB used, 1.0 TiB / 1.0 TiB avail; 39 KiB/s rd, 32 KiB/s wr, 12 op/s 2024-09-12T02:44:51.698 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 12 02:44:51 smithi044 ceph-mon[35411]: pgmap v212: 129 pgs: 129 active+clean; 11 MiB data, 412 MiB used, 1.0 TiB / 1.0 TiB avail; 39 KiB/s rd, 32 KiB/s wr, 12 op/s 2024-09-12T02:44:53.513 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 12 02:44:53 smithi172 ceph-mon[35609]: pgmap v213: 129 pgs: 129 active+clean; 11 MiB data, 417 MiB used, 1.0 TiB / 1.0 TiB avail; 58 KiB/s rd, 49 KiB/s wr, 19 op/s 2024-09-12T02:44:53.600 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 02:44:53 smithi039 ceph-mon[30515]: pgmap v213: 129 pgs: 129 active+clean; 11 MiB data, 417 MiB used, 1.0 TiB / 1.0 TiB avail; 58 KiB/s rd, 49 KiB/s wr, 19 op/s 2024-09-12T02:44:53.698 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 12 02:44:53 smithi044 ceph-mon[35411]: pgmap v213: 129 pgs: 129 active+clean; 11 MiB data, 417 MiB used, 1.0 TiB / 1.0 TiB avail; 58 KiB/s rd, 49 KiB/s wr, 19 op/s 2024-09-12T02:44:55.513 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 12 02:44:55 smithi172 ceph-mon[35609]: pgmap v214: 129 pgs: 129 active+clean; 11 MiB data, 417 MiB used, 1.0 TiB / 1.0 TiB avail; 39 KiB/s rd, 36 KiB/s wr, 13 op/s 2024-09-12T02:44:55.599 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 02:44:55 smithi039 ceph-mon[30515]: pgmap v214: 129 pgs: 129 active+clean; 11 MiB data, 417 MiB used, 1.0 TiB / 1.0 TiB avail; 39 KiB/s rd, 36 KiB/s wr, 13 op/s 2024-09-12T02:44:55.698 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 12 02:44:55 smithi044 ceph-mon[35411]: pgmap v214: 129 pgs: 129 active+clean; 11 MiB data, 417 MiB used, 1.0 TiB / 1.0 TiB avail; 39 KiB/s rd, 36 KiB/s wr, 13 op/s 2024-09-12T02:44:57.514 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 12 02:44:57 smithi172 ceph-mon[35609]: pgmap v215: 129 pgs: 129 active+clean; 11 MiB data, 417 MiB used, 1.0 TiB / 1.0 TiB avail; 39 KiB/s rd, 36 KiB/s wr, 13 op/s 2024-09-12T02:44:57.599 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 02:44:57 smithi039 ceph-mon[30515]: pgmap v215: 129 pgs: 129 active+clean; 11 MiB data, 417 MiB used, 1.0 TiB / 1.0 TiB avail; 39 KiB/s rd, 36 KiB/s wr, 13 op/s 2024-09-12T02:44:57.698 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 12 02:44:57 smithi044 ceph-mon[35411]: pgmap v215: 129 pgs: 129 active+clean; 11 MiB data, 417 MiB used, 1.0 TiB / 1.0 TiB avail; 39 KiB/s rd, 36 KiB/s wr, 13 op/s 2024-09-12T02:44:59.514 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 12 02:44:59 smithi172 ceph-mon[35609]: pgmap v216: 129 pgs: 129 active+clean; 11 MiB data, 421 MiB used, 1.0 TiB / 1.0 TiB avail; 59 KiB/s rd, 54 KiB/s wr, 20 op/s 2024-09-12T02:44:59.599 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 02:44:59 smithi039 ceph-mon[30515]: pgmap v216: 129 pgs: 129 active+clean; 11 MiB data, 421 MiB used, 1.0 TiB / 1.0 TiB avail; 59 KiB/s rd, 54 KiB/s wr, 20 op/s 2024-09-12T02:44:59.698 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 12 02:44:59 smithi044 ceph-mon[35411]: pgmap v216: 129 pgs: 129 active+clean; 11 MiB data, 421 MiB used, 1.0 TiB / 1.0 TiB avail; 59 KiB/s rd, 54 KiB/s wr, 20 op/s 2024-09-12T02:45:01.513 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 12 02:45:01 smithi172 ceph-mon[35609]: pgmap v217: 129 pgs: 129 active+clean; 11 MiB data, 421 MiB used, 1.0 TiB / 1.0 TiB avail; 38 KiB/s rd, 35 KiB/s wr, 13 op/s 2024-09-12T02:45:01.599 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 02:45:01 smithi039 ceph-mon[30515]: pgmap v217: 129 pgs: 129 active+clean; 11 MiB data, 421 MiB used, 1.0 TiB / 1.0 TiB avail; 38 KiB/s rd, 35 KiB/s wr, 13 op/s 2024-09-12T02:45:01.698 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 12 02:45:01 smithi044 ceph-mon[35411]: pgmap v217: 129 pgs: 129 active+clean; 11 MiB data, 421 MiB used, 1.0 TiB / 1.0 TiB avail; 38 KiB/s rd, 35 KiB/s wr, 13 op/s 2024-09-12T02:45:03.513 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 12 02:45:03 smithi172 ceph-mon[35609]: pgmap v218: 129 pgs: 129 active+clean; 12 MiB data, 422 MiB used, 1.0 TiB / 1.0 TiB avail; 67 KiB/s rd, 97 KiB/s wr, 36 op/s 2024-09-12T02:45:03.514 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 12 02:45:03 smithi172 ceph-mon[35609]: osdmap e99: 12 total, 12 up, 12 in 2024-09-12T02:45:03.599 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 02:45:03 smithi039 ceph-mon[30515]: pgmap v218: 129 pgs: 129 active+clean; 12 MiB data, 422 MiB used, 1.0 TiB / 1.0 TiB avail; 67 KiB/s rd, 97 KiB/s wr, 36 op/s 2024-09-12T02:45:03.600 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 02:45:03 smithi039 ceph-mon[30515]: osdmap e99: 12 total, 12 up, 12 in 2024-09-12T02:45:03.698 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 12 02:45:03 smithi044 ceph-mon[35411]: pgmap v218: 129 pgs: 129 active+clean; 12 MiB data, 422 MiB used, 1.0 TiB / 1.0 TiB avail; 67 KiB/s rd, 97 KiB/s wr, 36 op/s 2024-09-12T02:45:03.698 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 12 02:45:03 smithi044 ceph-mon[35411]: osdmap e99: 12 total, 12 up, 12 in 2024-09-12T02:45:05.513 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 12 02:45:05 smithi172 ceph-mon[35609]: pgmap v220: 129 pgs: 129 active+clean; 12 MiB data, 422 MiB used, 1.0 TiB / 1.0 TiB avail; 58 KiB/s rd, 97 KiB/s wr, 36 op/s 2024-09-12T02:45:05.600 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 02:45:05 smithi039 ceph-mon[30515]: pgmap v220: 129 pgs: 129 active+clean; 12 MiB data, 422 MiB used, 1.0 TiB / 1.0 TiB avail; 58 KiB/s rd, 97 KiB/s wr, 36 op/s 2024-09-12T02:45:05.698 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 12 02:45:05 smithi044 ceph-mon[35411]: pgmap v220: 129 pgs: 129 active+clean; 12 MiB data, 422 MiB used, 1.0 TiB / 1.0 TiB avail; 58 KiB/s rd, 97 KiB/s wr, 36 op/s 2024-09-12T02:45:07.599 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 02:45:07 smithi039 ceph-mon[30515]: pgmap v221: 129 pgs: 129 active+clean; 12 MiB data, 422 MiB used, 1.0 TiB / 1.0 TiB avail; 58 KiB/s rd, 97 KiB/s wr, 36 op/s 2024-09-12T02:45:07.698 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 12 02:45:07 smithi044 ceph-mon[35411]: pgmap v221: 129 pgs: 129 active+clean; 12 MiB data, 422 MiB used, 1.0 TiB / 1.0 TiB avail; 58 KiB/s rd, 97 KiB/s wr, 36 op/s 2024-09-12T02:45:07.763 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 12 02:45:07 smithi172 ceph-mon[35609]: pgmap v221: 129 pgs: 129 active+clean; 12 MiB data, 422 MiB used, 1.0 TiB / 1.0 TiB avail; 58 KiB/s rd, 97 KiB/s wr, 36 op/s 2024-09-12T02:45:09.600 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 02:45:09 smithi039 ceph-mon[30515]: pgmap v222: 129 pgs: 129 active+clean; 12 MiB data, 427 MiB used, 1.0 TiB / 1.0 TiB avail; 59 KiB/s rd, 101 KiB/s wr, 36 op/s 2024-09-12T02:45:09.600 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 02:45:09 smithi039 ceph-mon[30515]: from='mgr.25199 172.21.15.39:0/1270637502' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-12T02:45:09.600 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 02:45:09 smithi039 ceph-mon[30515]: from='mgr.25199 172.21.15.39:0/1270637502' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-12T02:45:09.600 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 02:45:09 smithi039 ceph-mon[30515]: from='mgr.25199 172.21.15.39:0/1270637502' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-12T02:45:09.600 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 02:45:09 smithi039 ceph-mon[30515]: from='mgr.25199 172.21.15.39:0/1270637502' entity='mgr.x' 2024-09-12T02:45:09.698 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 12 02:45:09 smithi044 ceph-mon[35411]: pgmap v222: 129 pgs: 129 active+clean; 12 MiB data, 427 MiB used, 1.0 TiB / 1.0 TiB avail; 59 KiB/s rd, 101 KiB/s wr, 36 op/s 2024-09-12T02:45:09.698 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 12 02:45:09 smithi044 ceph-mon[35411]: from='mgr.25199 172.21.15.39:0/1270637502' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-12T02:45:09.699 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 12 02:45:09 smithi044 ceph-mon[35411]: from='mgr.25199 172.21.15.39:0/1270637502' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-12T02:45:09.699 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 12 02:45:09 smithi044 ceph-mon[35411]: from='mgr.25199 172.21.15.39:0/1270637502' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-12T02:45:09.699 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 12 02:45:09 smithi044 ceph-mon[35411]: from='mgr.25199 172.21.15.39:0/1270637502' entity='mgr.x' 2024-09-12T02:45:09.763 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 12 02:45:09 smithi172 ceph-mon[35609]: pgmap v222: 129 pgs: 129 active+clean; 12 MiB data, 427 MiB used, 1.0 TiB / 1.0 TiB avail; 59 KiB/s rd, 101 KiB/s wr, 36 op/s 2024-09-12T02:45:09.764 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 12 02:45:09 smithi172 ceph-mon[35609]: from='mgr.25199 172.21.15.39:0/1270637502' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-12T02:45:09.764 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 12 02:45:09 smithi172 ceph-mon[35609]: from='mgr.25199 172.21.15.39:0/1270637502' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-12T02:45:09.764 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 12 02:45:09 smithi172 ceph-mon[35609]: from='mgr.25199 172.21.15.39:0/1270637502' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-12T02:45:09.764 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 12 02:45:09 smithi172 ceph-mon[35609]: from='mgr.25199 172.21.15.39:0/1270637502' entity='mgr.x' 2024-09-12T02:45:11.600 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 02:45:11 smithi039 ceph-mon[30515]: pgmap v223: 129 pgs: 129 active+clean; 12 MiB data, 427 MiB used, 1.0 TiB / 1.0 TiB avail; 59 KiB/s rd, 101 KiB/s wr, 36 op/s 2024-09-12T02:45:11.698 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 12 02:45:11 smithi044 ceph-mon[35411]: pgmap v223: 129 pgs: 129 active+clean; 12 MiB data, 427 MiB used, 1.0 TiB / 1.0 TiB avail; 59 KiB/s rd, 101 KiB/s wr, 36 op/s 2024-09-12T02:45:11.764 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 12 02:45:11 smithi172 ceph-mon[35609]: pgmap v223: 129 pgs: 129 active+clean; 12 MiB data, 427 MiB used, 1.0 TiB / 1.0 TiB avail; 59 KiB/s rd, 101 KiB/s wr, 36 op/s 2024-09-12T02:45:13.448 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 12 02:45:13 smithi044 ceph-mon[35411]: pgmap v224: 129 pgs: 129 active+clean; 12 MiB data, 427 MiB used, 1.0 TiB / 1.0 TiB avail; 49 KiB/s rd, 48 KiB/s wr, 15 op/s 2024-09-12T02:45:13.449 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 12 02:45:13 smithi044 ceph-mon[35411]: osdmap e100: 12 total, 12 up, 12 in 2024-09-12T02:45:13.513 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 12 02:45:13 smithi172 ceph-mon[35609]: pgmap v224: 129 pgs: 129 active+clean; 12 MiB data, 427 MiB used, 1.0 TiB / 1.0 TiB avail; 49 KiB/s rd, 48 KiB/s wr, 15 op/s 2024-09-12T02:45:13.514 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 12 02:45:13 smithi172 ceph-mon[35609]: osdmap e100: 12 total, 12 up, 12 in 2024-09-12T02:45:13.599 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 02:45:13 smithi039 ceph-mon[30515]: pgmap v224: 129 pgs: 129 active+clean; 12 MiB data, 427 MiB used, 1.0 TiB / 1.0 TiB avail; 49 KiB/s rd, 48 KiB/s wr, 15 op/s 2024-09-12T02:45:13.600 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 02:45:13 smithi039 ceph-mon[30515]: osdmap e100: 12 total, 12 up, 12 in 2024-09-12T02:45:15.448 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 12 02:45:15 smithi044 ceph-mon[35411]: pgmap v226: 129 pgs: 129 active+clean; 12 MiB data, 427 MiB used, 1.0 TiB / 1.0 TiB avail; 49 KiB/s rd, 48 KiB/s wr, 15 op/s 2024-09-12T02:45:15.514 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 12 02:45:15 smithi172 ceph-mon[35609]: pgmap v226: 129 pgs: 129 active+clean; 12 MiB data, 427 MiB used, 1.0 TiB / 1.0 TiB avail; 49 KiB/s rd, 48 KiB/s wr, 15 op/s 2024-09-12T02:45:15.600 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 02:45:15 smithi039 ceph-mon[30515]: pgmap v226: 129 pgs: 129 active+clean; 12 MiB data, 427 MiB used, 1.0 TiB / 1.0 TiB avail; 49 KiB/s rd, 48 KiB/s wr, 15 op/s 2024-09-12T02:45:17.448 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 12 02:45:17 smithi044 ceph-mon[35411]: pgmap v227: 129 pgs: 129 active+clean; 12 MiB data, 427 MiB used, 1.0 TiB / 1.0 TiB avail; 49 KiB/s rd, 48 KiB/s wr, 15 op/s 2024-09-12T02:45:17.513 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 12 02:45:17 smithi172 ceph-mon[35609]: pgmap v227: 129 pgs: 129 active+clean; 12 MiB data, 427 MiB used, 1.0 TiB / 1.0 TiB avail; 49 KiB/s rd, 48 KiB/s wr, 15 op/s 2024-09-12T02:45:17.599 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 02:45:17 smithi039 ceph-mon[30515]: pgmap v227: 129 pgs: 129 active+clean; 12 MiB data, 427 MiB used, 1.0 TiB / 1.0 TiB avail; 49 KiB/s rd, 48 KiB/s wr, 15 op/s 2024-09-12T02:45:19.448 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 12 02:45:19 smithi044 ceph-mon[35411]: pgmap v228: 129 pgs: 129 active+clean; 12 MiB data, 428 MiB used, 1.0 TiB / 1.0 TiB avail; 50 KiB/s rd, 47 KiB/s wr, 15 op/s 2024-09-12T02:45:19.513 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 12 02:45:19 smithi172 ceph-mon[35609]: pgmap v228: 129 pgs: 129 active+clean; 12 MiB data, 428 MiB used, 1.0 TiB / 1.0 TiB avail; 50 KiB/s rd, 47 KiB/s wr, 15 op/s 2024-09-12T02:45:19.602 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 02:45:19 smithi039 ceph-mon[30515]: pgmap v228: 129 pgs: 129 active+clean; 12 MiB data, 428 MiB used, 1.0 TiB / 1.0 TiB avail; 50 KiB/s rd, 47 KiB/s wr, 15 op/s 2024-09-12T02:45:21.356 INFO:tasks.workunit.client.0.smithi039.stdout:pread ret = 64 2024-09-12T02:45:21.356 INFO:tasks.workunit.client.0.smithi039.stdout:313/600: open fd = 3 2024-09-12T02:45:21.356 INFO:tasks.workunit.client.0.smithi039.stdout:write ret = 32 2024-09-12T02:45:21.356 INFO:tasks.workunit.client.0.smithi039.stdout:write ret = 32 2024-09-12T02:45:21.356 INFO:tasks.workunit.client.0.smithi039.stdout:pread ret = 64 2024-09-12T02:45:21.356 INFO:tasks.workunit.client.0.smithi039.stdout:314/600: open fd = 3 2024-09-12T02:45:21.356 INFO:tasks.workunit.client.0.smithi039.stdout:write ret = 32 2024-09-12T02:45:21.356 INFO:tasks.workunit.client.0.smithi039.stdout:write ret = 32 2024-09-12T02:45:21.356 INFO:tasks.workunit.client.0.smithi039.stdout:pread ret = 64 2024-09-12T02:45:21.357 INFO:tasks.workunit.client.0.smithi039.stdout:315/600: open fd = 3 2024-09-12T02:45:21.357 INFO:tasks.workunit.client.0.smithi039.stdout:write ret = 32 2024-09-12T02:45:21.357 INFO:tasks.workunit.client.0.smithi039.stdout:write ret = 32 2024-09-12T02:45:21.357 INFO:tasks.workunit.client.0.smithi039.stdout:pread ret = 64 2024-09-12T02:45:21.357 INFO:tasks.workunit.client.0.smithi039.stdout:316/600: open fd = 3 2024-09-12T02:45:21.357 INFO:tasks.workunit.client.0.smithi039.stdout:write ret = 32 2024-09-12T02:45:21.357 INFO:tasks.workunit.client.0.smithi039.stdout:write ret = 32 2024-09-12T02:45:21.357 INFO:tasks.workunit.client.0.smithi039.stdout:pread ret = 64 2024-09-12T02:45:21.357 INFO:tasks.workunit.client.0.smithi039.stdout:317/600: open fd = 3 2024-09-12T02:45:21.357 INFO:tasks.workunit.client.0.smithi039.stdout:write ret = 32 2024-09-12T02:45:21.357 INFO:tasks.workunit.client.0.smithi039.stdout:write ret = 32 2024-09-12T02:45:21.357 INFO:tasks.workunit.client.0.smithi039.stdout:pread ret = 64 2024-09-12T02:45:21.357 INFO:tasks.workunit.client.0.smithi039.stdout:318/600: open fd = 3 2024-09-12T02:45:21.357 INFO:tasks.workunit.client.0.smithi039.stdout:write ret = 32 2024-09-12T02:45:21.358 INFO:tasks.workunit.client.0.smithi039.stdout:write ret = 32 2024-09-12T02:45:21.358 INFO:tasks.workunit.client.0.smithi039.stdout:pread ret = 64 2024-09-12T02:45:21.358 INFO:tasks.workunit.client.0.smithi039.stdout:319/600: open fd = 3 2024-09-12T02:45:21.358 INFO:tasks.workunit.client.0.smithi039.stdout:write ret = 32 2024-09-12T02:45:21.358 INFO:tasks.workunit.client.0.smithi039.stdout:write ret = 32 2024-09-12T02:45:21.358 INFO:tasks.workunit.client.0.smithi039.stdout:pread ret = 64 2024-09-12T02:45:21.358 INFO:tasks.workunit.client.0.smithi039.stdout:320/600: open fd = 3 2024-09-12T02:45:21.358 INFO:tasks.workunit.client.0.smithi039.stdout:write ret = 32 2024-09-12T02:45:21.358 INFO:tasks.workunit.client.0.smithi039.stdout:write ret = 32 2024-09-12T02:45:21.358 INFO:tasks.workunit.client.0.smithi039.stdout:pread ret = 64 2024-09-12T02:45:21.358 INFO:tasks.workunit.client.0.smithi039.stdout:321/600: open fd = 3 2024-09-12T02:45:21.358 INFO:tasks.workunit.client.0.smithi039.stdout:write ret = 32 2024-09-12T02:45:21.358 INFO:tasks.workunit.client.0.smithi039.stdout:write ret = 32 2024-09-12T02:45:21.359 INFO:tasks.workunit.client.0.smithi039.stdout:pread ret = 64 2024-09-12T02:45:21.359 INFO:tasks.workunit.client.0.smithi039.stdout:322/600: open fd = 3 2024-09-12T02:45:21.359 INFO:tasks.workunit.client.0.smithi039.stdout:write ret = 32 2024-09-12T02:45:21.359 INFO:tasks.workunit.client.0.smithi039.stdout:write ret = 32 2024-09-12T02:45:21.359 INFO:tasks.workunit.client.0.smithi039.stdout:pread ret = 64 2024-09-12T02:45:21.359 INFO:tasks.workunit.client.0.smithi039.stdout:323/600: open fd = 3 2024-09-12T02:45:21.359 INFO:tasks.workunit.client.0.smithi039.stdout:write ret = 32 2024-09-12T02:45:21.359 INFO:tasks.workunit.client.0.smithi039.stdout:write ret = 32 2024-09-12T02:45:21.359 INFO:tasks.workunit.client.0.smithi039.stdout:pread ret = 64 2024-09-12T02:45:21.359 INFO:tasks.workunit.client.0.smithi039.stdout:324/600: open fd = 3 2024-09-12T02:45:21.359 INFO:tasks.workunit.client.0.smithi039.stdout:write ret = 32 2024-09-12T02:45:21.359 INFO:tasks.workunit.client.0.smithi039.stdout:write ret = 32 2024-09-12T02:45:21.359 INFO:tasks.workunit.client.0.smithi039.stdout:pread ret = 64 2024-09-12T02:45:21.359 INFO:tasks.workunit.client.0.smithi039.stdout:325/600: open fd = 3 2024-09-12T02:45:21.360 INFO:tasks.workunit.client.0.smithi039.stdout:write ret = 32 2024-09-12T02:45:21.360 INFO:tasks.workunit.client.0.smithi039.stdout:write ret = 32 2024-09-12T02:45:21.360 INFO:tasks.workunit.client.0.smithi039.stdout:pread ret = 64 2024-09-12T02:45:21.360 INFO:tasks.workunit.client.0.smithi039.stdout:326/600: open fd = 3 2024-09-12T02:45:21.360 INFO:tasks.workunit.client.0.smithi039.stdout:write ret = 32 2024-09-12T02:45:21.360 INFO:tasks.workunit.client.0.smithi039.stdout:write ret = 32 2024-09-12T02:45:21.360 INFO:tasks.workunit.client.0.smithi039.stdout:pread ret = 64 2024-09-12T02:45:21.360 INFO:tasks.workunit.client.0.smithi039.stdout:327/600: open fd = 3 2024-09-12T02:45:21.360 INFO:tasks.workunit.client.0.smithi039.stdout:write ret = 32 2024-09-12T02:45:21.360 INFO:tasks.workunit.client.0.smithi039.stdout:write ret = 32 2024-09-12T02:45:21.360 INFO:tasks.workunit.client.0.smithi039.stdout:pread ret = 64 2024-09-12T02:45:21.360 INFO:tasks.workunit.client.0.smithi039.stdout:328/600: open fd = 3 2024-09-12T02:45:21.360 INFO:tasks.workunit.client.0.smithi039.stdout:write ret = 32 2024-09-12T02:45:21.360 INFO:tasks.workunit.client.0.smithi039.stdout:write ret = 32 2024-09-12T02:45:21.361 INFO:tasks.workunit.client.0.smithi039.stdout:pread ret = 64 2024-09-12T02:45:21.361 INFO:tasks.workunit.client.0.smithi039.stdout:329/600: open fd = 3 2024-09-12T02:45:21.361 INFO:tasks.workunit.client.0.smithi039.stdout:write ret = 32 2024-09-12T02:45:21.361 INFO:tasks.workunit.client.0.smithi039.stdout:write ret = 32 2024-09-12T02:45:21.361 INFO:tasks.workunit.client.0.smithi039.stdout:pread ret = 64 2024-09-12T02:45:21.361 INFO:tasks.workunit.client.0.smithi039.stdout:330/600: open fd = 3 2024-09-12T02:45:21.361 INFO:tasks.workunit.client.0.smithi039.stdout:write ret = 32 2024-09-12T02:45:21.361 INFO:tasks.workunit.client.0.smithi039.stdout:write ret = 32 2024-09-12T02:45:21.361 INFO:tasks.workunit.client.0.smithi039.stdout:pread ret = 64 2024-09-12T02:45:21.361 INFO:tasks.workunit.client.0.smithi039.stdout:331/600: open fd = 3 2024-09-12T02:45:21.361 INFO:tasks.workunit.client.0.smithi039.stdout:write ret = 32 2024-09-12T02:45:21.361 INFO:tasks.workunit.client.0.smithi039.stdout:write ret = 32 2024-09-12T02:45:21.361 INFO:tasks.workunit.client.0.smithi039.stdout:pread ret = 64 2024-09-12T02:45:21.361 INFO:tasks.workunit.client.0.smithi039.stdout:332/600: open fd = 3 2024-09-12T02:45:21.362 INFO:tasks.workunit.client.0.smithi039.stdout:write ret = 32 2024-09-12T02:45:21.362 INFO:tasks.workunit.client.0.smithi039.stdout:write ret = 32 2024-09-12T02:45:21.362 INFO:tasks.workunit.client.0.smithi039.stdout:pread ret = 64 2024-09-12T02:45:21.362 INFO:tasks.workunit.client.0.smithi039.stdout:333/600: open fd = 3 2024-09-12T02:45:21.362 INFO:tasks.workunit.client.0.smithi039.stdout:write ret = 32 2024-09-12T02:45:21.362 INFO:tasks.workunit.client.0.smithi039.stdout:write ret = 32 2024-09-12T02:45:21.362 INFO:tasks.workunit.client.0.smithi039.stdout:pread ret = 64 2024-09-12T02:45:21.362 INFO:tasks.workunit.client.0.smithi039.stdout:334/600: open fd = 3 2024-09-12T02:45:21.362 INFO:tasks.workunit.client.0.smithi039.stdout:write ret = 32 2024-09-12T02:45:21.362 INFO:tasks.workunit.client.0.smithi039.stdout:write ret = 32 2024-09-12T02:45:21.362 INFO:tasks.workunit.client.0.smithi039.stdout:pread ret = 64 2024-09-12T02:45:21.362 INFO:tasks.workunit.client.0.smithi039.stdout:335/600: open fd = 3 2024-09-12T02:45:21.362 INFO:tasks.workunit.client.0.smithi039.stdout:write ret = 32 2024-09-12T02:45:21.362 INFO:tasks.workunit.client.0.smithi039.stdout:write ret = 32 2024-09-12T02:45:21.363 INFO:tasks.workunit.client.0.smithi039.stdout:pread ret = 64 2024-09-12T02:45:21.363 INFO:tasks.workunit.client.0.smithi039.stdout:336/600: open fd = 3 2024-09-12T02:45:21.363 INFO:tasks.workunit.client.0.smithi039.stdout:write ret = 32 2024-09-12T02:45:21.363 INFO:tasks.workunit.client.0.smithi039.stdout:write ret = 32 2024-09-12T02:45:21.363 INFO:tasks.workunit.client.0.smithi039.stdout:pread ret = 64 2024-09-12T02:45:21.363 INFO:tasks.workunit.client.0.smithi039.stdout:337/600: open fd = 3 2024-09-12T02:45:21.363 INFO:tasks.workunit.client.0.smithi039.stdout:write ret = 32 2024-09-12T02:45:21.363 INFO:tasks.workunit.client.0.smithi039.stdout:write ret = 32 2024-09-12T02:45:21.363 INFO:tasks.workunit.client.0.smithi039.stdout:pread ret = 64 2024-09-12T02:45:21.363 INFO:tasks.workunit.client.0.smithi039.stdout:338/600: open fd = 3 2024-09-12T02:45:21.363 INFO:tasks.workunit.client.0.smithi039.stdout:write ret = 32 2024-09-12T02:45:21.363 INFO:tasks.workunit.client.0.smithi039.stdout:write ret = 32 2024-09-12T02:45:21.363 INFO:tasks.workunit.client.0.smithi039.stdout:pread ret = 64 2024-09-12T02:45:21.363 INFO:tasks.workunit.client.0.smithi039.stdout:339/600: open fd = 3 2024-09-12T02:45:21.363 INFO:tasks.workunit.client.0.smithi039.stdout:write ret = 32 2024-09-12T02:45:21.364 INFO:tasks.workunit.client.0.smithi039.stdout:write ret = 32 2024-09-12T02:45:21.364 INFO:tasks.workunit.client.0.smithi039.stdout:pread ret = 64 2024-09-12T02:45:21.364 INFO:tasks.workunit.client.0.smithi039.stdout:340/600: open fd = 3 2024-09-12T02:45:21.364 INFO:tasks.workunit.client.0.smithi039.stdout:write ret = 32 2024-09-12T02:45:21.364 INFO:tasks.workunit.client.0.smithi039.stdout:write ret = 32 2024-09-12T02:45:21.364 INFO:tasks.workunit.client.0.smithi039.stdout:pread ret = 64 2024-09-12T02:45:21.364 INFO:tasks.workunit.client.0.smithi039.stdout:341/600: open fd = 3 2024-09-12T02:45:21.364 INFO:tasks.workunit.client.0.smithi039.stdout:write ret = 32 2024-09-12T02:45:21.364 INFO:tasks.workunit.client.0.smithi039.stdout:write ret = 32 2024-09-12T02:45:21.364 INFO:tasks.workunit.client.0.smithi039.stdout:pread ret = 64 2024-09-12T02:45:21.364 INFO:tasks.workunit.client.0.smithi039.stdout:342/600: open fd = 3 2024-09-12T02:45:21.364 INFO:tasks.workunit.client.0.smithi039.stdout:write ret = 32 2024-09-12T02:45:21.364 INFO:tasks.workunit.client.0.smithi039.stdout:write ret = 32 2024-09-12T02:45:21.364 INFO:tasks.workunit.client.0.smithi039.stdout:pread ret = 64 2024-09-12T02:45:21.365 INFO:tasks.workunit.client.0.smithi039.stdout:343/600: open fd = 3 2024-09-12T02:45:21.365 INFO:tasks.workunit.client.0.smithi039.stdout:write ret = 32 2024-09-12T02:45:21.365 INFO:tasks.workunit.client.0.smithi039.stdout:write ret = 32 2024-09-12T02:45:21.365 INFO:tasks.workunit.client.0.smithi039.stdout:pread ret = 64 2024-09-12T02:45:21.365 INFO:tasks.workunit.client.0.smithi039.stdout:344/600: open fd = 3 2024-09-12T02:45:21.365 INFO:tasks.workunit.client.0.smithi039.stdout:write ret = 32 2024-09-12T02:45:21.365 INFO:tasks.workunit.client.0.smithi039.stdout:write ret = 32 2024-09-12T02:45:21.365 INFO:tasks.workunit.client.0.smithi039.stdout:pread ret = 64 2024-09-12T02:45:21.365 INFO:tasks.workunit.client.0.smithi039.stdout:345/600: open fd = 3 2024-09-12T02:45:21.365 INFO:tasks.workunit.client.0.smithi039.stdout:write ret = 32 2024-09-12T02:45:21.365 INFO:tasks.workunit.client.0.smithi039.stdout:write ret = 32 2024-09-12T02:45:21.365 INFO:tasks.workunit.client.0.smithi039.stdout:pread ret = 64 2024-09-12T02:45:21.365 INFO:tasks.workunit.client.0.smithi039.stdout:346/600: open fd = 3 2024-09-12T02:45:21.365 INFO:tasks.workunit.client.0.smithi039.stdout:write ret = 32 2024-09-12T02:45:21.366 INFO:tasks.workunit.client.0.smithi039.stdout:write ret = 32 2024-09-12T02:45:21.366 INFO:tasks.workunit.client.0.smithi039.stdout:pread ret = 64 2024-09-12T02:45:21.366 INFO:tasks.workunit.client.0.smithi039.stdout:347/600: open fd = 3 2024-09-12T02:45:21.366 INFO:tasks.workunit.client.0.smithi039.stdout:write ret = 32 2024-09-12T02:45:21.366 INFO:tasks.workunit.client.0.smithi039.stdout:write ret = 32 2024-09-12T02:45:21.366 INFO:tasks.workunit.client.0.smithi039.stdout:pread ret = 64 2024-09-12T02:45:21.366 INFO:tasks.workunit.client.0.smithi039.stdout:348/600: open fd = 3 2024-09-12T02:45:21.366 INFO:tasks.workunit.client.0.smithi039.stdout:write ret = 32 2024-09-12T02:45:21.366 INFO:tasks.workunit.client.0.smithi039.stdout:write ret = 32 2024-09-12T02:45:21.366 INFO:tasks.workunit.client.0.smithi039.stdout:pread ret = 64 2024-09-12T02:45:21.366 INFO:tasks.workunit.client.0.smithi039.stdout:349/600: open fd = 3 2024-09-12T02:45:21.366 INFO:tasks.workunit.client.0.smithi039.stdout:write ret = 32 2024-09-12T02:45:21.366 INFO:tasks.workunit.client.0.smithi039.stdout:write ret = 32 2024-09-12T02:45:21.366 INFO:tasks.workunit.client.0.smithi039.stdout:pread ret = 64 2024-09-12T02:45:21.367 INFO:tasks.workunit.client.0.smithi039.stdout:350/600: open fd = 3 2024-09-12T02:45:21.367 INFO:tasks.workunit.client.0.smithi039.stdout:write ret = 32 2024-09-12T02:45:21.367 INFO:tasks.workunit.client.0.smithi039.stdout:write ret = 32 2024-09-12T02:45:21.367 INFO:tasks.workunit.client.0.smithi039.stdout:pread ret = 64 2024-09-12T02:45:21.367 INFO:tasks.workunit.client.0.smithi039.stdout:351/600: open fd = 3 2024-09-12T02:45:21.367 INFO:tasks.workunit.client.0.smithi039.stdout:write ret = 32 2024-09-12T02:45:21.367 INFO:tasks.workunit.client.0.smithi039.stdout:write ret = 32 2024-09-12T02:45:21.367 INFO:tasks.workunit.client.0.smithi039.stdout:pread ret = 64 2024-09-12T02:45:21.367 INFO:tasks.workunit.client.0.smithi039.stdout:352/600: open fd = 3 2024-09-12T02:45:21.367 INFO:tasks.workunit.client.0.smithi039.stdout:write ret = 32 2024-09-12T02:45:21.367 INFO:tasks.workunit.client.0.smithi039.stdout:write ret = 32 2024-09-12T02:45:21.367 INFO:tasks.workunit.client.0.smithi039.stdout:pread ret = 64 2024-09-12T02:45:21.367 INFO:tasks.workunit.client.0.smithi039.stdout:353/600: open fd = 3 2024-09-12T02:45:21.367 INFO:tasks.workunit.client.0.smithi039.stdout:write ret = 32 2024-09-12T02:45:21.367 INFO:tasks.workunit.client.0.smithi039.stdout:write ret = 32 2024-09-12T02:45:21.368 INFO:tasks.workunit.client.0.smithi039.stdout:pread ret = 64 2024-09-12T02:45:21.368 INFO:tasks.workunit.client.0.smithi039.stdout:354/600: open fd = 3 2024-09-12T02:45:21.368 INFO:tasks.workunit.client.0.smithi039.stdout:write ret = 32 2024-09-12T02:45:21.368 INFO:tasks.workunit.client.0.smithi039.stdout:write ret = 32 2024-09-12T02:45:21.368 INFO:tasks.workunit.client.0.smithi039.stdout:pread ret = 64 2024-09-12T02:45:21.368 INFO:tasks.workunit.client.0.smithi039.stdout:355/600: open fd = 3 2024-09-12T02:45:21.368 INFO:tasks.workunit.client.0.smithi039.stdout:write ret = 32 2024-09-12T02:45:21.368 INFO:tasks.workunit.client.0.smithi039.stdout:write ret = 32 2024-09-12T02:45:21.368 INFO:tasks.workunit.client.0.smithi039.stdout:pread ret = 64 2024-09-12T02:45:21.368 INFO:tasks.workunit.client.0.smithi039.stdout:356/600: open fd = 3 2024-09-12T02:45:21.368 INFO:tasks.workunit.client.0.smithi039.stdout:write ret = 32 2024-09-12T02:45:21.368 INFO:tasks.workunit.client.0.smithi039.stdout:write ret = 32 2024-09-12T02:45:21.368 INFO:tasks.workunit.client.0.smithi039.stdout:pread ret = 64 2024-09-12T02:45:21.368 INFO:tasks.workunit.client.0.smithi039.stdout:357/600: open fd = 3 2024-09-12T02:45:21.369 INFO:tasks.workunit.client.0.smithi039.stdout:write ret = 32 2024-09-12T02:45:21.369 INFO:tasks.workunit.client.0.smithi039.stdout:write ret = 32 2024-09-12T02:45:21.369 INFO:tasks.workunit.client.0.smithi039.stdout:pread ret = 64 2024-09-12T02:45:21.369 INFO:tasks.workunit.client.0.smithi039.stdout:358/600: open fd = 3 2024-09-12T02:45:21.369 INFO:tasks.workunit.client.0.smithi039.stdout:write ret = 32 2024-09-12T02:45:21.369 INFO:tasks.workunit.client.0.smithi039.stdout:write ret = 32 2024-09-12T02:45:21.369 INFO:tasks.workunit.client.0.smithi039.stdout:pread ret = 64 2024-09-12T02:45:21.369 INFO:tasks.workunit.client.0.smithi039.stdout:359/600: open fd = 3 2024-09-12T02:45:21.369 INFO:tasks.workunit.client.0.smithi039.stdout:write ret = 32 2024-09-12T02:45:21.369 INFO:tasks.workunit.client.0.smithi039.stdout:write ret = 32 2024-09-12T02:45:21.369 INFO:tasks.workunit.client.0.smithi039.stdout:pread ret = 64 2024-09-12T02:45:21.369 INFO:tasks.workunit.client.0.smithi039.stdout:360/600: open fd = 3 2024-09-12T02:45:21.369 INFO:tasks.workunit.client.0.smithi039.stdout:write ret = 32 2024-09-12T02:45:21.370 INFO:tasks.workunit.client.0.smithi039.stdout:write ret = 32 2024-09-12T02:45:21.370 INFO:tasks.workunit.client.0.smithi039.stdout:pread ret = 64 2024-09-12T02:45:21.370 INFO:tasks.workunit.client.0.smithi039.stdout:361/600: open fd = 3 2024-09-12T02:45:21.370 INFO:tasks.workunit.client.0.smithi039.stdout:write ret = 32 2024-09-12T02:45:21.370 INFO:tasks.workunit.client.0.smithi039.stdout:write ret = 32 2024-09-12T02:45:21.370 INFO:tasks.workunit.client.0.smithi039.stdout:pread ret = 64 2024-09-12T02:45:21.370 INFO:tasks.workunit.client.0.smithi039.stdout:362/600: open fd = 3 2024-09-12T02:45:21.370 INFO:tasks.workunit.client.0.smithi039.stdout:write ret = 32 2024-09-12T02:45:21.370 INFO:tasks.workunit.client.0.smithi039.stdout:write ret = 32 2024-09-12T02:45:21.370 INFO:tasks.workunit.client.0.smithi039.stdout:pread ret = 64 2024-09-12T02:45:21.370 INFO:tasks.workunit.client.0.smithi039.stdout:363/600: open fd = 3 2024-09-12T02:45:21.370 INFO:tasks.workunit.client.0.smithi039.stdout:write ret = 32 2024-09-12T02:45:21.370 INFO:tasks.workunit.client.0.smithi039.stdout:write ret = 32 2024-09-12T02:45:21.370 INFO:tasks.workunit.client.0.smithi039.stdout:pread ret = 64 2024-09-12T02:45:21.371 INFO:tasks.workunit.client.0.smithi039.stdout:364/600: open fd = 3 2024-09-12T02:45:21.371 INFO:tasks.workunit.client.0.smithi039.stdout:write ret = 32 2024-09-12T02:45:21.371 INFO:tasks.workunit.client.0.smithi039.stdout:write ret = 32 2024-09-12T02:45:21.371 INFO:tasks.workunit.client.0.smithi039.stdout:pread ret = 64 2024-09-12T02:45:21.371 INFO:tasks.workunit.client.0.smithi039.stdout:365/600: open fd = 3 2024-09-12T02:45:21.371 INFO:tasks.workunit.client.0.smithi039.stdout:write ret = 32 2024-09-12T02:45:21.371 INFO:tasks.workunit.client.0.smithi039.stdout:write ret = 32 2024-09-12T02:45:21.371 INFO:tasks.workunit.client.0.smithi039.stdout:pread ret = 64 2024-09-12T02:45:21.371 INFO:tasks.workunit.client.0.smithi039.stdout:366/600: open fd = 3 2024-09-12T02:45:21.371 INFO:tasks.workunit.client.0.smithi039.stdout:write ret = 32 2024-09-12T02:45:21.371 INFO:tasks.workunit.client.0.smithi039.stdout:write ret = 32 2024-09-12T02:45:21.371 INFO:tasks.workunit.client.0.smithi039.stdout:pread ret = 64 2024-09-12T02:45:21.371 INFO:tasks.workunit.client.0.smithi039.stdout:367/600: open fd = 3 2024-09-12T02:45:21.371 INFO:tasks.workunit.client.0.smithi039.stdout:write ret = 32 2024-09-12T02:45:21.372 INFO:tasks.workunit.client.0.smithi039.stdout:write ret = 32 2024-09-12T02:45:21.372 INFO:tasks.workunit.client.0.smithi039.stdout:pread ret = 64 2024-09-12T02:45:21.372 INFO:tasks.workunit.client.0.smithi039.stdout:368/600: open fd = 3 2024-09-12T02:45:21.372 INFO:tasks.workunit.client.0.smithi039.stdout:write ret = 32 2024-09-12T02:45:21.372 INFO:tasks.workunit.client.0.smithi039.stdout:write ret = 32 2024-09-12T02:45:21.372 INFO:tasks.workunit.client.0.smithi039.stdout:pread ret = 64 2024-09-12T02:45:21.372 INFO:tasks.workunit.client.0.smithi039.stdout:369/600: open fd = 3 2024-09-12T02:45:21.372 INFO:tasks.workunit.client.0.smithi039.stdout:write ret = 32 2024-09-12T02:45:21.372 INFO:tasks.workunit.client.0.smithi039.stdout:write ret = 32 2024-09-12T02:45:21.372 INFO:tasks.workunit.client.0.smithi039.stdout:pread ret = 64 2024-09-12T02:45:21.372 INFO:tasks.workunit.client.0.smithi039.stdout:370/600: open fd = 3 2024-09-12T02:45:21.372 INFO:tasks.workunit.client.0.smithi039.stdout:write ret = 32 2024-09-12T02:45:21.372 INFO:tasks.workunit.client.0.smithi039.stdout:write ret = 32 2024-09-12T02:45:21.372 INFO:tasks.workunit.client.0.smithi039.stdout:pread ret = 64 2024-09-12T02:45:21.373 INFO:tasks.workunit.client.0.smithi039.stdout:371/600: open fd = 3 2024-09-12T02:45:21.373 INFO:tasks.workunit.client.0.smithi039.stdout:write ret = 32 2024-09-12T02:45:21.373 INFO:tasks.workunit.client.0.smithi039.stdout:write ret = 32 2024-09-12T02:45:21.373 INFO:tasks.workunit.client.0.smithi039.stdout:pread ret = 64 2024-09-12T02:45:21.373 INFO:tasks.workunit.client.0.smithi039.stdout:372/600: open fd = 3 2024-09-12T02:45:21.373 INFO:tasks.workunit.client.0.smithi039.stdout:write ret = 32 2024-09-12T02:45:21.373 INFO:tasks.workunit.client.0.smithi039.stdout:write ret = 32 2024-09-12T02:45:21.373 INFO:tasks.workunit.client.0.smithi039.stdout:pread ret = 64 2024-09-12T02:45:21.373 INFO:tasks.workunit.client.0.smithi039.stdout:373/600: open fd = 3 2024-09-12T02:45:21.373 INFO:tasks.workunit.client.0.smithi039.stdout:write ret = 32 2024-09-12T02:45:21.373 INFO:tasks.workunit.client.0.smithi039.stdout:write ret = 32 2024-09-12T02:45:21.373 INFO:tasks.workunit.client.0.smithi039.stdout:pread ret = 64 2024-09-12T02:45:21.373 INFO:tasks.workunit.client.0.smithi039.stdout:374/600: open fd = 3 2024-09-12T02:45:21.374 INFO:tasks.workunit.client.0.smithi039.stdout:write ret = 32 2024-09-12T02:45:21.374 INFO:tasks.workunit.client.0.smithi039.stdout:write ret = 32 2024-09-12T02:45:21.374 INFO:tasks.workunit.client.0.smithi039.stdout:pread ret = 64 2024-09-12T02:45:21.448 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 12 02:45:21 smithi044 ceph-mon[35411]: pgmap v229: 129 pgs: 129 active+clean; 12 MiB data, 428 MiB used, 1.0 TiB / 1.0 TiB avail; 50 KiB/s rd, 47 KiB/s wr, 15 op/s 2024-09-12T02:45:21.513 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 12 02:45:21 smithi172 ceph-mon[35609]: pgmap v229: 129 pgs: 129 active+clean; 12 MiB data, 428 MiB used, 1.0 TiB / 1.0 TiB avail; 50 KiB/s rd, 47 KiB/s wr, 15 op/s 2024-09-12T02:45:21.599 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 02:45:21 smithi039 ceph-mon[30515]: pgmap v229: 129 pgs: 129 active+clean; 12 MiB data, 428 MiB used, 1.0 TiB / 1.0 TiB avail; 50 KiB/s rd, 47 KiB/s wr, 15 op/s 2024-09-12T02:45:23.448 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 12 02:45:23 smithi044 ceph-mon[35411]: pgmap v230: 129 pgs: 129 active+clean; 13 MiB data, 429 MiB used, 1.0 TiB / 1.0 TiB avail; 50 KiB/s rd, 47 KiB/s wr, 15 op/s 2024-09-12T02:45:23.513 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 12 02:45:23 smithi172 ceph-mon[35609]: pgmap v230: 129 pgs: 129 active+clean; 13 MiB data, 429 MiB used, 1.0 TiB / 1.0 TiB avail; 50 KiB/s rd, 47 KiB/s wr, 15 op/s 2024-09-12T02:45:23.599 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 02:45:23 smithi039 ceph-mon[30515]: pgmap v230: 129 pgs: 129 active+clean; 13 MiB data, 429 MiB used, 1.0 TiB / 1.0 TiB avail; 50 KiB/s rd, 47 KiB/s wr, 15 op/s 2024-09-12T02:45:25.448 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 12 02:45:25 smithi044 ceph-mon[35411]: pgmap v231: 129 pgs: 129 active+clean; 13 MiB data, 429 MiB used, 1.0 TiB / 1.0 TiB avail; 42 KiB/s rd, 39 KiB/s wr, 13 op/s 2024-09-12T02:45:25.513 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 12 02:45:25 smithi172 ceph-mon[35609]: pgmap v231: 129 pgs: 129 active+clean; 13 MiB data, 429 MiB used, 1.0 TiB / 1.0 TiB avail; 42 KiB/s rd, 39 KiB/s wr, 13 op/s 2024-09-12T02:45:25.599 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 02:45:25 smithi039 ceph-mon[30515]: pgmap v231: 129 pgs: 129 active+clean; 13 MiB data, 429 MiB used, 1.0 TiB / 1.0 TiB avail; 42 KiB/s rd, 39 KiB/s wr, 13 op/s 2024-09-12T02:45:27.449 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 12 02:45:27 smithi044 ceph-mon[35411]: pgmap v232: 129 pgs: 129 active+clean; 13 MiB data, 429 MiB used, 1.0 TiB / 1.0 TiB avail; 42 KiB/s rd, 39 KiB/s wr, 13 op/s 2024-09-12T02:45:27.518 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 12 02:45:27 smithi172 ceph-mon[35609]: pgmap v232: 129 pgs: 129 active+clean; 13 MiB data, 429 MiB used, 1.0 TiB / 1.0 TiB avail; 42 KiB/s rd, 39 KiB/s wr, 13 op/s 2024-09-12T02:45:27.607 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 02:45:27 smithi039 ceph-mon[30515]: pgmap v232: 129 pgs: 129 active+clean; 13 MiB data, 429 MiB used, 1.0 TiB / 1.0 TiB avail; 42 KiB/s rd, 39 KiB/s wr, 13 op/s 2024-09-12T02:45:29.448 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 12 02:45:29 smithi044 ceph-mon[35411]: pgmap v233: 129 pgs: 129 active+clean; 13 MiB data, 430 MiB used, 1.0 TiB / 1.0 TiB avail; 65 KiB/s rd, 61 KiB/s wr, 20 op/s 2024-09-12T02:45:29.513 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 12 02:45:29 smithi172 ceph-mon[35609]: pgmap v233: 129 pgs: 129 active+clean; 13 MiB data, 430 MiB used, 1.0 TiB / 1.0 TiB avail; 65 KiB/s rd, 61 KiB/s wr, 20 op/s 2024-09-12T02:45:29.599 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 02:45:29 smithi039 ceph-mon[30515]: pgmap v233: 129 pgs: 129 active+clean; 13 MiB data, 430 MiB used, 1.0 TiB / 1.0 TiB avail; 65 KiB/s rd, 61 KiB/s wr, 20 op/s 2024-09-12T02:45:31.448 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 12 02:45:31 smithi044 ceph-mon[35411]: pgmap v234: 129 pgs: 129 active+clean; 13 MiB data, 430 MiB used, 1.0 TiB / 1.0 TiB avail; 43 KiB/s rd, 41 KiB/s wr, 13 op/s 2024-09-12T02:45:31.513 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 12 02:45:31 smithi172 ceph-mon[35609]: pgmap v234: 129 pgs: 129 active+clean; 13 MiB data, 430 MiB used, 1.0 TiB / 1.0 TiB avail; 43 KiB/s rd, 41 KiB/s wr, 13 op/s 2024-09-12T02:45:31.599 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 02:45:31 smithi039 ceph-mon[30515]: pgmap v234: 129 pgs: 129 active+clean; 13 MiB data, 430 MiB used, 1.0 TiB / 1.0 TiB avail; 43 KiB/s rd, 41 KiB/s wr, 13 op/s 2024-09-12T02:45:33.448 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 12 02:45:33 smithi044 ceph-mon[35411]: pgmap v235: 129 pgs: 129 active+clean; 13 MiB data, 430 MiB used, 1.0 TiB / 1.0 TiB avail; 64 KiB/s rd, 59 KiB/s wr, 19 op/s 2024-09-12T02:45:33.513 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 12 02:45:33 smithi172 ceph-mon[35609]: pgmap v235: 129 pgs: 129 active+clean; 13 MiB data, 430 MiB used, 1.0 TiB / 1.0 TiB avail; 64 KiB/s rd, 59 KiB/s wr, 19 op/s 2024-09-12T02:45:33.599 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 02:45:33 smithi039 ceph-mon[30515]: pgmap v235: 129 pgs: 129 active+clean; 13 MiB data, 430 MiB used, 1.0 TiB / 1.0 TiB avail; 64 KiB/s rd, 59 KiB/s wr, 19 op/s 2024-09-12T02:45:35.448 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 12 02:45:35 smithi044 ceph-mon[35411]: pgmap v236: 129 pgs: 129 active+clean; 13 MiB data, 430 MiB used, 1.0 TiB / 1.0 TiB avail; 43 KiB/s rd, 40 KiB/s wr, 13 op/s 2024-09-12T02:45:35.513 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 12 02:45:35 smithi172 ceph-mon[35609]: pgmap v236: 129 pgs: 129 active+clean; 13 MiB data, 430 MiB used, 1.0 TiB / 1.0 TiB avail; 43 KiB/s rd, 40 KiB/s wr, 13 op/s 2024-09-12T02:45:35.600 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 02:45:35 smithi039 ceph-mon[30515]: pgmap v236: 129 pgs: 129 active+clean; 13 MiB data, 430 MiB used, 1.0 TiB / 1.0 TiB avail; 43 KiB/s rd, 40 KiB/s wr, 13 op/s 2024-09-12T02:45:37.514 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 12 02:45:37 smithi172 ceph-mon[35609]: pgmap v237: 129 pgs: 129 active+clean; 13 MiB data, 430 MiB used, 1.0 TiB / 1.0 TiB avail; 43 KiB/s rd, 40 KiB/s wr, 13 op/s 2024-09-12T02:45:37.599 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 02:45:37 smithi039 ceph-mon[30515]: pgmap v237: 129 pgs: 129 active+clean; 13 MiB data, 430 MiB used, 1.0 TiB / 1.0 TiB avail; 43 KiB/s rd, 40 KiB/s wr, 13 op/s 2024-09-12T02:45:37.698 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 12 02:45:37 smithi044 ceph-mon[35411]: pgmap v237: 129 pgs: 129 active+clean; 13 MiB data, 430 MiB used, 1.0 TiB / 1.0 TiB avail; 43 KiB/s rd, 40 KiB/s wr, 13 op/s 2024-09-12T02:45:39.514 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 12 02:45:39 smithi172 ceph-mon[35609]: pgmap v238: 129 pgs: 129 active+clean; 13 MiB data, 431 MiB used, 1.0 TiB / 1.0 TiB avail; 64 KiB/s rd, 61 KiB/s wr, 20 op/s 2024-09-12T02:45:39.599 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 02:45:39 smithi039 ceph-mon[30515]: pgmap v238: 129 pgs: 129 active+clean; 13 MiB data, 431 MiB used, 1.0 TiB / 1.0 TiB avail; 64 KiB/s rd, 61 KiB/s wr, 20 op/s 2024-09-12T02:45:39.698 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 12 02:45:39 smithi044 ceph-mon[35411]: pgmap v238: 129 pgs: 129 active+clean; 13 MiB data, 431 MiB used, 1.0 TiB / 1.0 TiB avail; 64 KiB/s rd, 61 KiB/s wr, 20 op/s 2024-09-12T02:45:41.513 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 12 02:45:41 smithi172 ceph-mon[35609]: pgmap v239: 129 pgs: 129 active+clean; 13 MiB data, 431 MiB used, 1.0 TiB / 1.0 TiB avail; 41 KiB/s rd, 39 KiB/s wr, 13 op/s 2024-09-12T02:45:41.599 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 02:45:41 smithi039 ceph-mon[30515]: pgmap v239: 129 pgs: 129 active+clean; 13 MiB data, 431 MiB used, 1.0 TiB / 1.0 TiB avail; 41 KiB/s rd, 39 KiB/s wr, 13 op/s 2024-09-12T02:45:41.698 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 12 02:45:41 smithi044 ceph-mon[35411]: pgmap v239: 129 pgs: 129 active+clean; 13 MiB data, 431 MiB used, 1.0 TiB / 1.0 TiB avail; 41 KiB/s rd, 39 KiB/s wr, 13 op/s 2024-09-12T02:45:43.521 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 12 02:45:43 smithi172 ceph-mon[35609]: pgmap v240: 129 pgs: 129 active+clean; 13 MiB data, 432 MiB used, 1.0 TiB / 1.0 TiB avail; 62 KiB/s rd, 57 KiB/s wr, 19 op/s 2024-09-12T02:45:43.600 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 02:45:43 smithi039 ceph-mon[30515]: pgmap v240: 129 pgs: 129 active+clean; 13 MiB data, 432 MiB used, 1.0 TiB / 1.0 TiB avail; 62 KiB/s rd, 57 KiB/s wr, 19 op/s 2024-09-12T02:45:43.699 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 12 02:45:43 smithi044 ceph-mon[35411]: pgmap v240: 129 pgs: 129 active+clean; 13 MiB data, 432 MiB used, 1.0 TiB / 1.0 TiB avail; 62 KiB/s rd, 57 KiB/s wr, 19 op/s 2024-09-12T02:45:45.513 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 12 02:45:45 smithi172 ceph-mon[35609]: pgmap v241: 129 pgs: 129 active+clean; 13 MiB data, 432 MiB used, 1.0 TiB / 1.0 TiB avail; 41 KiB/s rd, 38 KiB/s wr, 13 op/s 2024-09-12T02:45:45.599 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 02:45:45 smithi039 ceph-mon[30515]: pgmap v241: 129 pgs: 129 active+clean; 13 MiB data, 432 MiB used, 1.0 TiB / 1.0 TiB avail; 41 KiB/s rd, 38 KiB/s wr, 13 op/s 2024-09-12T02:45:45.698 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 12 02:45:45 smithi044 ceph-mon[35411]: pgmap v241: 129 pgs: 129 active+clean; 13 MiB data, 432 MiB used, 1.0 TiB / 1.0 TiB avail; 41 KiB/s rd, 38 KiB/s wr, 13 op/s 2024-09-12T02:45:47.513 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 12 02:45:47 smithi172 ceph-mon[35609]: pgmap v242: 129 pgs: 129 active+clean; 13 MiB data, 432 MiB used, 1.0 TiB / 1.0 TiB avail; 41 KiB/s rd, 38 KiB/s wr, 13 op/s 2024-09-12T02:45:47.600 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 02:45:47 smithi039 ceph-mon[30515]: pgmap v242: 129 pgs: 129 active+clean; 13 MiB data, 432 MiB used, 1.0 TiB / 1.0 TiB avail; 41 KiB/s rd, 38 KiB/s wr, 13 op/s 2024-09-12T02:45:47.698 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 12 02:45:47 smithi044 ceph-mon[35411]: pgmap v242: 129 pgs: 129 active+clean; 13 MiB data, 432 MiB used, 1.0 TiB / 1.0 TiB avail; 41 KiB/s rd, 38 KiB/s wr, 13 op/s 2024-09-12T02:45:49.513 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 12 02:45:49 smithi172 ceph-mon[35609]: pgmap v243: 129 pgs: 129 active+clean; 14 MiB data, 432 MiB used, 1.0 TiB / 1.0 TiB avail; 64 KiB/s rd, 59 KiB/s wr, 20 op/s 2024-09-12T02:45:49.600 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 02:45:49 smithi039 ceph-mon[30515]: pgmap v243: 129 pgs: 129 active+clean; 14 MiB data, 432 MiB used, 1.0 TiB / 1.0 TiB avail; 64 KiB/s rd, 59 KiB/s wr, 20 op/s 2024-09-12T02:45:49.698 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 12 02:45:49 smithi044 ceph-mon[35411]: pgmap v243: 129 pgs: 129 active+clean; 14 MiB data, 432 MiB used, 1.0 TiB / 1.0 TiB avail; 64 KiB/s rd, 59 KiB/s wr, 20 op/s 2024-09-12T02:45:51.513 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 12 02:45:51 smithi172 ceph-mon[35609]: pgmap v244: 129 pgs: 129 active+clean; 14 MiB data, 432 MiB used, 1.0 TiB / 1.0 TiB avail; 43 KiB/s rd, 39 KiB/s wr, 13 op/s 2024-09-12T02:45:51.599 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 02:45:51 smithi039 ceph-mon[30515]: pgmap v244: 129 pgs: 129 active+clean; 14 MiB data, 432 MiB used, 1.0 TiB / 1.0 TiB avail; 43 KiB/s rd, 39 KiB/s wr, 13 op/s 2024-09-12T02:45:51.698 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 12 02:45:51 smithi044 ceph-mon[35411]: pgmap v244: 129 pgs: 129 active+clean; 14 MiB data, 432 MiB used, 1.0 TiB / 1.0 TiB avail; 43 KiB/s rd, 39 KiB/s wr, 13 op/s 2024-09-12T02:45:53.513 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 12 02:45:53 smithi172 ceph-mon[35609]: pgmap v245: 129 pgs: 129 active+clean; 14 MiB data, 433 MiB used, 1.0 TiB / 1.0 TiB avail; 63 KiB/s rd, 58 KiB/s wr, 20 op/s 2024-09-12T02:45:53.600 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 02:45:53 smithi039 ceph-mon[30515]: pgmap v245: 129 pgs: 129 active+clean; 14 MiB data, 433 MiB used, 1.0 TiB / 1.0 TiB avail; 63 KiB/s rd, 58 KiB/s wr, 20 op/s 2024-09-12T02:45:53.698 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 12 02:45:53 smithi044 ceph-mon[35411]: pgmap v245: 129 pgs: 129 active+clean; 14 MiB data, 433 MiB used, 1.0 TiB / 1.0 TiB avail; 63 KiB/s rd, 58 KiB/s wr, 20 op/s 2024-09-12T02:45:55.514 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 12 02:45:55 smithi172 ceph-mon[35609]: pgmap v246: 129 pgs: 129 active+clean; 14 MiB data, 433 MiB used, 1.0 TiB / 1.0 TiB avail; 43 KiB/s rd, 40 KiB/s wr, 13 op/s 2024-09-12T02:45:55.599 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 02:45:55 smithi039 ceph-mon[30515]: pgmap v246: 129 pgs: 129 active+clean; 14 MiB data, 433 MiB used, 1.0 TiB / 1.0 TiB avail; 43 KiB/s rd, 40 KiB/s wr, 13 op/s 2024-09-12T02:45:55.698 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 12 02:45:55 smithi044 ceph-mon[35411]: pgmap v246: 129 pgs: 129 active+clean; 14 MiB data, 433 MiB used, 1.0 TiB / 1.0 TiB avail; 43 KiB/s rd, 40 KiB/s wr, 13 op/s 2024-09-12T02:45:57.513 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 12 02:45:57 smithi172 ceph-mon[35609]: pgmap v247: 129 pgs: 129 active+clean; 14 MiB data, 433 MiB used, 1.0 TiB / 1.0 TiB avail; 43 KiB/s rd, 40 KiB/s wr, 13 op/s 2024-09-12T02:45:57.600 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 02:45:57 smithi039 ceph-mon[30515]: pgmap v247: 129 pgs: 129 active+clean; 14 MiB data, 433 MiB used, 1.0 TiB / 1.0 TiB avail; 43 KiB/s rd, 40 KiB/s wr, 13 op/s 2024-09-12T02:45:57.698 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 12 02:45:57 smithi044 ceph-mon[35411]: pgmap v247: 129 pgs: 129 active+clean; 14 MiB data, 433 MiB used, 1.0 TiB / 1.0 TiB avail; 43 KiB/s rd, 40 KiB/s wr, 13 op/s 2024-09-12T02:45:59.513 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 12 02:45:59 smithi172 ceph-mon[35609]: pgmap v248: 129 pgs: 129 active+clean; 14 MiB data, 434 MiB used, 1.0 TiB / 1.0 TiB avail; 64 KiB/s rd, 60 KiB/s wr, 20 op/s 2024-09-12T02:45:59.599 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 02:45:59 smithi039 ceph-mon[30515]: pgmap v248: 129 pgs: 129 active+clean; 14 MiB data, 434 MiB used, 1.0 TiB / 1.0 TiB avail; 64 KiB/s rd, 60 KiB/s wr, 20 op/s 2024-09-12T02:45:59.698 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 12 02:45:59 smithi044 ceph-mon[35411]: pgmap v248: 129 pgs: 129 active+clean; 14 MiB data, 434 MiB used, 1.0 TiB / 1.0 TiB avail; 64 KiB/s rd, 60 KiB/s wr, 20 op/s 2024-09-12T02:46:01.600 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 02:46:01 smithi039 ceph-mon[30515]: pgmap v249: 129 pgs: 129 active+clean; 14 MiB data, 434 MiB used, 1.0 TiB / 1.0 TiB avail; 42 KiB/s rd, 39 KiB/s wr, 13 op/s 2024-09-12T02:46:01.698 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 12 02:46:01 smithi044 ceph-mon[35411]: pgmap v249: 129 pgs: 129 active+clean; 14 MiB data, 434 MiB used, 1.0 TiB / 1.0 TiB avail; 42 KiB/s rd, 39 KiB/s wr, 13 op/s 2024-09-12T02:46:01.763 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 12 02:46:01 smithi172 ceph-mon[35609]: pgmap v249: 129 pgs: 129 active+clean; 14 MiB data, 434 MiB used, 1.0 TiB / 1.0 TiB avail; 42 KiB/s rd, 39 KiB/s wr, 13 op/s 2024-09-12T02:46:03.600 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 02:46:03 smithi039 ceph-mon[30515]: pgmap v250: 129 pgs: 129 active+clean; 14 MiB data, 435 MiB used, 1.0 TiB / 1.0 TiB avail; 73 KiB/s rd, 104 KiB/s wr, 36 op/s 2024-09-12T02:46:03.600 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 02:46:03 smithi039 ceph-mon[30515]: osdmap e101: 12 total, 12 up, 12 in 2024-09-12T02:46:03.698 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 12 02:46:03 smithi044 ceph-mon[35411]: pgmap v250: 129 pgs: 129 active+clean; 14 MiB data, 435 MiB used, 1.0 TiB / 1.0 TiB avail; 73 KiB/s rd, 104 KiB/s wr, 36 op/s 2024-09-12T02:46:03.698 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 12 02:46:03 smithi044 ceph-mon[35411]: osdmap e101: 12 total, 12 up, 12 in 2024-09-12T02:46:03.763 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 12 02:46:03 smithi172 ceph-mon[35609]: pgmap v250: 129 pgs: 129 active+clean; 14 MiB data, 435 MiB used, 1.0 TiB / 1.0 TiB avail; 73 KiB/s rd, 104 KiB/s wr, 36 op/s 2024-09-12T02:46:03.763 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 12 02:46:03 smithi172 ceph-mon[35609]: osdmap e101: 12 total, 12 up, 12 in 2024-09-12T02:46:05.600 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 02:46:05 smithi039 ceph-mon[30515]: pgmap v252: 129 pgs: 129 active+clean; 14 MiB data, 435 MiB used, 1.0 TiB / 1.0 TiB avail; 63 KiB/s rd, 102 KiB/s wr, 36 op/s 2024-09-12T02:46:05.698 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 12 02:46:05 smithi044 ceph-mon[35411]: pgmap v252: 129 pgs: 129 active+clean; 14 MiB data, 435 MiB used, 1.0 TiB / 1.0 TiB avail; 63 KiB/s rd, 102 KiB/s wr, 36 op/s 2024-09-12T02:46:05.763 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 12 02:46:05 smithi172 ceph-mon[35609]: pgmap v252: 129 pgs: 129 active+clean; 14 MiB data, 435 MiB used, 1.0 TiB / 1.0 TiB avail; 63 KiB/s rd, 102 KiB/s wr, 36 op/s 2024-09-12T02:46:07.599 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 02:46:07 smithi039 ceph-mon[30515]: pgmap v253: 129 pgs: 129 active+clean; 14 MiB data, 435 MiB used, 1.0 TiB / 1.0 TiB avail; 63 KiB/s rd, 102 KiB/s wr, 36 op/s 2024-09-12T02:46:07.698 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 12 02:46:07 smithi044 ceph-mon[35411]: pgmap v253: 129 pgs: 129 active+clean; 14 MiB data, 435 MiB used, 1.0 TiB / 1.0 TiB avail; 63 KiB/s rd, 102 KiB/s wr, 36 op/s 2024-09-12T02:46:07.763 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 12 02:46:07 smithi172 ceph-mon[35609]: pgmap v253: 129 pgs: 129 active+clean; 14 MiB data, 435 MiB used, 1.0 TiB / 1.0 TiB avail; 63 KiB/s rd, 102 KiB/s wr, 36 op/s 2024-09-12T02:46:09.599 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 02:46:09 smithi039 ceph-mon[30515]: pgmap v254: 129 pgs: 129 active+clean; 15 MiB data, 435 MiB used, 1.0 TiB / 1.0 TiB avail; 68 KiB/s rd, 106 KiB/s wr, 36 op/s 2024-09-12T02:46:09.600 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 02:46:09 smithi039 ceph-mon[30515]: from='mgr.25199 172.21.15.39:0/1270637502' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-12T02:46:09.698 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 12 02:46:09 smithi044 ceph-mon[35411]: pgmap v254: 129 pgs: 129 active+clean; 15 MiB data, 435 MiB used, 1.0 TiB / 1.0 TiB avail; 68 KiB/s rd, 106 KiB/s wr, 36 op/s 2024-09-12T02:46:09.699 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 12 02:46:09 smithi044 ceph-mon[35411]: from='mgr.25199 172.21.15.39:0/1270637502' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-12T02:46:09.763 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 12 02:46:09 smithi172 ceph-mon[35609]: pgmap v254: 129 pgs: 129 active+clean; 15 MiB data, 435 MiB used, 1.0 TiB / 1.0 TiB avail; 68 KiB/s rd, 106 KiB/s wr, 36 op/s 2024-09-12T02:46:09.763 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 12 02:46:09 smithi172 ceph-mon[35609]: from='mgr.25199 172.21.15.39:0/1270637502' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-12T02:46:10.600 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 02:46:10 smithi039 ceph-mon[30515]: from='mgr.25199 172.21.15.39:0/1270637502' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-12T02:46:10.601 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 02:46:10 smithi039 ceph-mon[30515]: from='mgr.25199 172.21.15.39:0/1270637502' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-12T02:46:10.601 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 02:46:10 smithi039 ceph-mon[30515]: from='mgr.25199 172.21.15.39:0/1270637502' entity='mgr.x' 2024-09-12T02:46:10.699 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 12 02:46:10 smithi044 ceph-mon[35411]: from='mgr.25199 172.21.15.39:0/1270637502' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-12T02:46:10.699 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 12 02:46:10 smithi044 ceph-mon[35411]: from='mgr.25199 172.21.15.39:0/1270637502' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-12T02:46:10.699 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 12 02:46:10 smithi044 ceph-mon[35411]: from='mgr.25199 172.21.15.39:0/1270637502' entity='mgr.x' 2024-09-12T02:46:10.763 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 12 02:46:10 smithi172 ceph-mon[35609]: from='mgr.25199 172.21.15.39:0/1270637502' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-12T02:46:10.763 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 12 02:46:10 smithi172 ceph-mon[35609]: from='mgr.25199 172.21.15.39:0/1270637502' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-12T02:46:10.764 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 12 02:46:10 smithi172 ceph-mon[35609]: from='mgr.25199 172.21.15.39:0/1270637502' entity='mgr.x' 2024-09-12T02:46:11.599 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 02:46:11 smithi039 ceph-mon[30515]: pgmap v255: 129 pgs: 129 active+clean; 15 MiB data, 435 MiB used, 1.0 TiB / 1.0 TiB avail; 68 KiB/s rd, 106 KiB/s wr, 36 op/s 2024-09-12T02:46:11.698 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 12 02:46:11 smithi044 ceph-mon[35411]: pgmap v255: 129 pgs: 129 active+clean; 15 MiB data, 435 MiB used, 1.0 TiB / 1.0 TiB avail; 68 KiB/s rd, 106 KiB/s wr, 36 op/s 2024-09-12T02:46:11.763 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 12 02:46:11 smithi172 ceph-mon[35609]: pgmap v255: 129 pgs: 129 active+clean; 15 MiB data, 435 MiB used, 1.0 TiB / 1.0 TiB avail; 68 KiB/s rd, 106 KiB/s wr, 36 op/s 2024-09-12T02:46:13.448 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 12 02:46:13 smithi044 ceph-mon[35411]: pgmap v256: 129 pgs: 129 active+clean; 15 MiB data, 440 MiB used, 1.0 TiB / 1.0 TiB avail; 57 KiB/s rd, 51 KiB/s wr, 15 op/s 2024-09-12T02:46:13.448 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 12 02:46:13 smithi044 ceph-mon[35411]: osdmap e102: 12 total, 12 up, 12 in 2024-09-12T02:46:13.513 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 12 02:46:13 smithi172 ceph-mon[35609]: pgmap v256: 129 pgs: 129 active+clean; 15 MiB data, 440 MiB used, 1.0 TiB / 1.0 TiB avail; 57 KiB/s rd, 51 KiB/s wr, 15 op/s 2024-09-12T02:46:13.514 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 12 02:46:13 smithi172 ceph-mon[35609]: osdmap e102: 12 total, 12 up, 12 in 2024-09-12T02:46:13.599 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 02:46:13 smithi039 ceph-mon[30515]: pgmap v256: 129 pgs: 129 active+clean; 15 MiB data, 440 MiB used, 1.0 TiB / 1.0 TiB avail; 57 KiB/s rd, 51 KiB/s wr, 15 op/s 2024-09-12T02:46:13.600 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 02:46:13 smithi039 ceph-mon[30515]: osdmap e102: 12 total, 12 up, 12 in 2024-09-12T02:46:15.448 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 12 02:46:15 smithi044 ceph-mon[35411]: pgmap v258: 129 pgs: 129 active+clean; 15 MiB data, 440 MiB used, 1.0 TiB / 1.0 TiB avail; 57 KiB/s rd, 51 KiB/s wr, 15 op/s 2024-09-12T02:46:15.513 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 12 02:46:15 smithi172 ceph-mon[35609]: pgmap v258: 129 pgs: 129 active+clean; 15 MiB data, 440 MiB used, 1.0 TiB / 1.0 TiB avail; 57 KiB/s rd, 51 KiB/s wr, 15 op/s 2024-09-12T02:46:15.599 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 02:46:15 smithi039 ceph-mon[30515]: pgmap v258: 129 pgs: 129 active+clean; 15 MiB data, 440 MiB used, 1.0 TiB / 1.0 TiB avail; 57 KiB/s rd, 51 KiB/s wr, 15 op/s 2024-09-12T02:46:17.448 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 12 02:46:17 smithi044 ceph-mon[35411]: pgmap v259: 129 pgs: 129 active+clean; 15 MiB data, 440 MiB used, 1.0 TiB / 1.0 TiB avail; 57 KiB/s rd, 51 KiB/s wr, 15 op/s 2024-09-12T02:46:17.513 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 12 02:46:17 smithi172 ceph-mon[35609]: pgmap v259: 129 pgs: 129 active+clean; 15 MiB data, 440 MiB used, 1.0 TiB / 1.0 TiB avail; 57 KiB/s rd, 51 KiB/s wr, 15 op/s 2024-09-12T02:46:17.600 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 02:46:17 smithi039 ceph-mon[30515]: pgmap v259: 129 pgs: 129 active+clean; 15 MiB data, 440 MiB used, 1.0 TiB / 1.0 TiB avail; 57 KiB/s rd, 51 KiB/s wr, 15 op/s 2024-09-12T02:46:19.448 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 12 02:46:19 smithi044 ceph-mon[35411]: pgmap v260: 129 pgs: 129 active+clean; 15 MiB data, 441 MiB used, 1.0 TiB / 1.0 TiB avail; 54 KiB/s rd, 49 KiB/s wr, 15 op/s 2024-09-12T02:46:19.513 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 12 02:46:19 smithi172 ceph-mon[35609]: pgmap v260: 129 pgs: 129 active+clean; 15 MiB data, 441 MiB used, 1.0 TiB / 1.0 TiB avail; 54 KiB/s rd, 49 KiB/s wr, 15 op/s 2024-09-12T02:46:19.600 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 02:46:19 smithi039 ceph-mon[30515]: pgmap v260: 129 pgs: 129 active+clean; 15 MiB data, 441 MiB used, 1.0 TiB / 1.0 TiB avail; 54 KiB/s rd, 49 KiB/s wr, 15 op/s 2024-09-12T02:46:21.448 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 12 02:46:21 smithi044 ceph-mon[35411]: pgmap v261: 129 pgs: 129 active+clean; 15 MiB data, 441 MiB used, 1.0 TiB / 1.0 TiB avail; 54 KiB/s rd, 49 KiB/s wr, 15 op/s 2024-09-12T02:46:21.513 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 12 02:46:21 smithi172 ceph-mon[35609]: pgmap v261: 129 pgs: 129 active+clean; 15 MiB data, 441 MiB used, 1.0 TiB / 1.0 TiB avail; 54 KiB/s rd, 49 KiB/s wr, 15 op/s 2024-09-12T02:46:21.599 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 02:46:21 smithi039 ceph-mon[30515]: pgmap v261: 129 pgs: 129 active+clean; 15 MiB data, 441 MiB used, 1.0 TiB / 1.0 TiB avail; 54 KiB/s rd, 49 KiB/s wr, 15 op/s 2024-09-12T02:46:23.448 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 12 02:46:23 smithi044 ceph-mon[35411]: pgmap v262: 129 pgs: 129 active+clean; 15 MiB data, 441 MiB used, 1.0 TiB / 1.0 TiB avail; 54 KiB/s rd, 50 KiB/s wr, 15 op/s 2024-09-12T02:46:23.516 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 12 02:46:23 smithi172 ceph-mon[35609]: pgmap v262: 129 pgs: 129 active+clean; 15 MiB data, 441 MiB used, 1.0 TiB / 1.0 TiB avail; 54 KiB/s rd, 50 KiB/s wr, 15 op/s 2024-09-12T02:46:23.599 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 02:46:23 smithi039 ceph-mon[30515]: pgmap v262: 129 pgs: 129 active+clean; 15 MiB data, 441 MiB used, 1.0 TiB / 1.0 TiB avail; 54 KiB/s rd, 50 KiB/s wr, 15 op/s 2024-09-12T02:46:23.885 INFO:tasks.workunit.client.0.smithi039.stdout:375/600: open fd = 3 2024-09-12T02:46:23.885 INFO:tasks.workunit.client.0.smithi039.stdout:write ret = 32 2024-09-12T02:46:23.885 INFO:tasks.workunit.client.0.smithi039.stdout:write ret = 32 2024-09-12T02:46:23.886 INFO:tasks.workunit.client.0.smithi039.stdout:pread ret = 64 2024-09-12T02:46:23.886 INFO:tasks.workunit.client.0.smithi039.stdout:376/600: open fd = 3 2024-09-12T02:46:23.886 INFO:tasks.workunit.client.0.smithi039.stdout:write ret = 32 2024-09-12T02:46:23.886 INFO:tasks.workunit.client.0.smithi039.stdout:write ret = 32 2024-09-12T02:46:23.886 INFO:tasks.workunit.client.0.smithi039.stdout:pread ret = 64 2024-09-12T02:46:23.887 INFO:tasks.workunit.client.0.smithi039.stdout:377/600: open fd = 3 2024-09-12T02:46:23.887 INFO:tasks.workunit.client.0.smithi039.stdout:write ret = 32 2024-09-12T02:46:23.887 INFO:tasks.workunit.client.0.smithi039.stdout:write ret = 32 2024-09-12T02:46:23.887 INFO:tasks.workunit.client.0.smithi039.stdout:pread ret = 64 2024-09-12T02:46:23.887 INFO:tasks.workunit.client.0.smithi039.stdout:378/600: open fd = 3 2024-09-12T02:46:23.887 INFO:tasks.workunit.client.0.smithi039.stdout:write ret = 32 2024-09-12T02:46:23.888 INFO:tasks.workunit.client.0.smithi039.stdout:write ret = 32 2024-09-12T02:46:23.888 INFO:tasks.workunit.client.0.smithi039.stdout:pread ret = 64 2024-09-12T02:46:23.888 INFO:tasks.workunit.client.0.smithi039.stdout:379/600: open fd = 3 2024-09-12T02:46:23.888 INFO:tasks.workunit.client.0.smithi039.stdout:write ret = 32 2024-09-12T02:46:23.888 INFO:tasks.workunit.client.0.smithi039.stdout:write ret = 32 2024-09-12T02:46:23.888 INFO:tasks.workunit.client.0.smithi039.stdout:pread ret = 64 2024-09-12T02:46:23.888 INFO:tasks.workunit.client.0.smithi039.stdout:380/600: open fd = 3 2024-09-12T02:46:23.888 INFO:tasks.workunit.client.0.smithi039.stdout:write ret = 32 2024-09-12T02:46:23.889 INFO:tasks.workunit.client.0.smithi039.stdout:write ret = 32 2024-09-12T02:46:23.889 INFO:tasks.workunit.client.0.smithi039.stdout:pread ret = 64 2024-09-12T02:46:23.889 INFO:tasks.workunit.client.0.smithi039.stdout:381/600: open fd = 3 2024-09-12T02:46:23.889 INFO:tasks.workunit.client.0.smithi039.stdout:write ret = 32 2024-09-12T02:46:23.889 INFO:tasks.workunit.client.0.smithi039.stdout:write ret = 32 2024-09-12T02:46:23.889 INFO:tasks.workunit.client.0.smithi039.stdout:pread ret = 64 2024-09-12T02:46:23.889 INFO:tasks.workunit.client.0.smithi039.stdout:382/600: open fd = 3 2024-09-12T02:46:23.889 INFO:tasks.workunit.client.0.smithi039.stdout:write ret = 32 2024-09-12T02:46:23.889 INFO:tasks.workunit.client.0.smithi039.stdout:write ret = 32 2024-09-12T02:46:23.889 INFO:tasks.workunit.client.0.smithi039.stdout:pread ret = 64 2024-09-12T02:46:23.889 INFO:tasks.workunit.client.0.smithi039.stdout:383/600: open fd = 3 2024-09-12T02:46:23.889 INFO:tasks.workunit.client.0.smithi039.stdout:write ret = 32 2024-09-12T02:46:23.890 INFO:tasks.workunit.client.0.smithi039.stdout:write ret = 32 2024-09-12T02:46:23.890 INFO:tasks.workunit.client.0.smithi039.stdout:pread ret = 64 2024-09-12T02:46:23.890 INFO:tasks.workunit.client.0.smithi039.stdout:384/600: open fd = 3 2024-09-12T02:46:23.890 INFO:tasks.workunit.client.0.smithi039.stdout:write ret = 32 2024-09-12T02:46:23.890 INFO:tasks.workunit.client.0.smithi039.stdout:write ret = 32 2024-09-12T02:46:23.890 INFO:tasks.workunit.client.0.smithi039.stdout:pread ret = 64 2024-09-12T02:46:23.890 INFO:tasks.workunit.client.0.smithi039.stdout:385/600: open fd = 3 2024-09-12T02:46:23.890 INFO:tasks.workunit.client.0.smithi039.stdout:write ret = 32 2024-09-12T02:46:23.890 INFO:tasks.workunit.client.0.smithi039.stdout:write ret = 32 2024-09-12T02:46:23.890 INFO:tasks.workunit.client.0.smithi039.stdout:pread ret = 64 2024-09-12T02:46:23.890 INFO:tasks.workunit.client.0.smithi039.stdout:386/600: open fd = 3 2024-09-12T02:46:23.890 INFO:tasks.workunit.client.0.smithi039.stdout:write ret = 32 2024-09-12T02:46:23.890 INFO:tasks.workunit.client.0.smithi039.stdout:write ret = 32 2024-09-12T02:46:23.890 INFO:tasks.workunit.client.0.smithi039.stdout:pread ret = 64 2024-09-12T02:46:23.891 INFO:tasks.workunit.client.0.smithi039.stdout:387/600: open fd = 3 2024-09-12T02:46:23.891 INFO:tasks.workunit.client.0.smithi039.stdout:write ret = 32 2024-09-12T02:46:23.891 INFO:tasks.workunit.client.0.smithi039.stdout:write ret = 32 2024-09-12T02:46:23.891 INFO:tasks.workunit.client.0.smithi039.stdout:pread ret = 64 2024-09-12T02:46:23.891 INFO:tasks.workunit.client.0.smithi039.stdout:388/600: open fd = 3 2024-09-12T02:46:23.891 INFO:tasks.workunit.client.0.smithi039.stdout:write ret = 32 2024-09-12T02:46:23.891 INFO:tasks.workunit.client.0.smithi039.stdout:write ret = 32 2024-09-12T02:46:23.891 INFO:tasks.workunit.client.0.smithi039.stdout:pread ret = 64 2024-09-12T02:46:23.891 INFO:tasks.workunit.client.0.smithi039.stdout:389/600: open fd = 3 2024-09-12T02:46:23.891 INFO:tasks.workunit.client.0.smithi039.stdout:write ret = 32 2024-09-12T02:46:23.891 INFO:tasks.workunit.client.0.smithi039.stdout:write ret = 32 2024-09-12T02:46:23.891 INFO:tasks.workunit.client.0.smithi039.stdout:pread ret = 64 2024-09-12T02:46:23.891 INFO:tasks.workunit.client.0.smithi039.stdout:390/600: open fd = 3 2024-09-12T02:46:23.891 INFO:tasks.workunit.client.0.smithi039.stdout:write ret = 32 2024-09-12T02:46:23.891 INFO:tasks.workunit.client.0.smithi039.stdout:write ret = 32 2024-09-12T02:46:23.892 INFO:tasks.workunit.client.0.smithi039.stdout:pread ret = 64 2024-09-12T02:46:23.892 INFO:tasks.workunit.client.0.smithi039.stdout:391/600: open fd = 3 2024-09-12T02:46:23.892 INFO:tasks.workunit.client.0.smithi039.stdout:write ret = 32 2024-09-12T02:46:23.892 INFO:tasks.workunit.client.0.smithi039.stdout:write ret = 32 2024-09-12T02:46:23.892 INFO:tasks.workunit.client.0.smithi039.stdout:pread ret = 64 2024-09-12T02:46:23.892 INFO:tasks.workunit.client.0.smithi039.stdout:392/600: open fd = 3 2024-09-12T02:46:23.892 INFO:tasks.workunit.client.0.smithi039.stdout:write ret = 32 2024-09-12T02:46:23.892 INFO:tasks.workunit.client.0.smithi039.stdout:write ret = 32 2024-09-12T02:46:23.892 INFO:tasks.workunit.client.0.smithi039.stdout:pread ret = 64 2024-09-12T02:46:23.892 INFO:tasks.workunit.client.0.smithi039.stdout:393/600: open fd = 3 2024-09-12T02:46:23.892 INFO:tasks.workunit.client.0.smithi039.stdout:write ret = 32 2024-09-12T02:46:23.892 INFO:tasks.workunit.client.0.smithi039.stdout:write ret = 32 2024-09-12T02:46:23.892 INFO:tasks.workunit.client.0.smithi039.stdout:pread ret = 64 2024-09-12T02:46:23.892 INFO:tasks.workunit.client.0.smithi039.stdout:394/600: open fd = 3 2024-09-12T02:46:23.893 INFO:tasks.workunit.client.0.smithi039.stdout:write ret = 32 2024-09-12T02:46:23.893 INFO:tasks.workunit.client.0.smithi039.stdout:write ret = 32 2024-09-12T02:46:23.893 INFO:tasks.workunit.client.0.smithi039.stdout:pread ret = 64 2024-09-12T02:46:23.893 INFO:tasks.workunit.client.0.smithi039.stdout:395/600: open fd = 3 2024-09-12T02:46:23.893 INFO:tasks.workunit.client.0.smithi039.stdout:write ret = 32 2024-09-12T02:46:23.893 INFO:tasks.workunit.client.0.smithi039.stdout:write ret = 32 2024-09-12T02:46:23.893 INFO:tasks.workunit.client.0.smithi039.stdout:pread ret = 64 2024-09-12T02:46:23.893 INFO:tasks.workunit.client.0.smithi039.stdout:396/600: open fd = 3 2024-09-12T02:46:23.893 INFO:tasks.workunit.client.0.smithi039.stdout:write ret = 32 2024-09-12T02:46:23.893 INFO:tasks.workunit.client.0.smithi039.stdout:write ret = 32 2024-09-12T02:46:23.893 INFO:tasks.workunit.client.0.smithi039.stdout:pread ret = 64 2024-09-12T02:46:23.893 INFO:tasks.workunit.client.0.smithi039.stdout:397/600: open fd = 3 2024-09-12T02:46:23.893 INFO:tasks.workunit.client.0.smithi039.stdout:write ret = 32 2024-09-12T02:46:23.893 INFO:tasks.workunit.client.0.smithi039.stdout:write ret = 32 2024-09-12T02:46:23.894 INFO:tasks.workunit.client.0.smithi039.stdout:pread ret = 64 2024-09-12T02:46:23.894 INFO:tasks.workunit.client.0.smithi039.stdout:398/600: open fd = 3 2024-09-12T02:46:23.894 INFO:tasks.workunit.client.0.smithi039.stdout:write ret = 32 2024-09-12T02:46:23.894 INFO:tasks.workunit.client.0.smithi039.stdout:write ret = 32 2024-09-12T02:46:23.894 INFO:tasks.workunit.client.0.smithi039.stdout:pread ret = 64 2024-09-12T02:46:23.894 INFO:tasks.workunit.client.0.smithi039.stdout:399/600: open fd = 3 2024-09-12T02:46:23.894 INFO:tasks.workunit.client.0.smithi039.stdout:write ret = 32 2024-09-12T02:46:23.894 INFO:tasks.workunit.client.0.smithi039.stdout:write ret = 32 2024-09-12T02:46:23.894 INFO:tasks.workunit.client.0.smithi039.stdout:pread ret = 64 2024-09-12T02:46:23.894 INFO:tasks.workunit.client.0.smithi039.stdout:400/600: open fd = 3 2024-09-12T02:46:23.894 INFO:tasks.workunit.client.0.smithi039.stdout:write ret = 32 2024-09-12T02:46:23.894 INFO:tasks.workunit.client.0.smithi039.stdout:write ret = 32 2024-09-12T02:46:23.894 INFO:tasks.workunit.client.0.smithi039.stdout:pread ret = 64 2024-09-12T02:46:23.894 INFO:tasks.workunit.client.0.smithi039.stdout:401/600: open fd = 3 2024-09-12T02:46:23.895 INFO:tasks.workunit.client.0.smithi039.stdout:write ret = 32 2024-09-12T02:46:23.895 INFO:tasks.workunit.client.0.smithi039.stdout:write ret = 32 2024-09-12T02:46:23.895 INFO:tasks.workunit.client.0.smithi039.stdout:pread ret = 64 2024-09-12T02:46:23.895 INFO:tasks.workunit.client.0.smithi039.stdout:402/600: open fd = 3 2024-09-12T02:46:23.895 INFO:tasks.workunit.client.0.smithi039.stdout:write ret = 32 2024-09-12T02:46:23.895 INFO:tasks.workunit.client.0.smithi039.stdout:write ret = 32 2024-09-12T02:46:23.895 INFO:tasks.workunit.client.0.smithi039.stdout:pread ret = 64 2024-09-12T02:46:23.895 INFO:tasks.workunit.client.0.smithi039.stdout:403/600: open fd = 3 2024-09-12T02:46:23.895 INFO:tasks.workunit.client.0.smithi039.stdout:write ret = 32 2024-09-12T02:46:23.895 INFO:tasks.workunit.client.0.smithi039.stdout:write ret = 32 2024-09-12T02:46:23.895 INFO:tasks.workunit.client.0.smithi039.stdout:pread ret = 64 2024-09-12T02:46:23.895 INFO:tasks.workunit.client.0.smithi039.stdout:404/600: open fd = 3 2024-09-12T02:46:23.895 INFO:tasks.workunit.client.0.smithi039.stdout:write ret = 32 2024-09-12T02:46:23.896 INFO:tasks.workunit.client.0.smithi039.stdout:write ret = 32 2024-09-12T02:46:23.896 INFO:tasks.workunit.client.0.smithi039.stdout:pread ret = 64 2024-09-12T02:46:23.896 INFO:tasks.workunit.client.0.smithi039.stdout:405/600: open fd = 3 2024-09-12T02:46:23.896 INFO:tasks.workunit.client.0.smithi039.stdout:write ret = 32 2024-09-12T02:46:23.896 INFO:tasks.workunit.client.0.smithi039.stdout:write ret = 32 2024-09-12T02:46:23.896 INFO:tasks.workunit.client.0.smithi039.stdout:pread ret = 64 2024-09-12T02:46:23.896 INFO:tasks.workunit.client.0.smithi039.stdout:406/600: open fd = 3 2024-09-12T02:46:23.897 INFO:tasks.workunit.client.0.smithi039.stdout:write ret = 32 2024-09-12T02:46:23.897 INFO:tasks.workunit.client.0.smithi039.stdout:write ret = 32 2024-09-12T02:46:23.897 INFO:tasks.workunit.client.0.smithi039.stdout:pread ret = 64 2024-09-12T02:46:23.897 INFO:tasks.workunit.client.0.smithi039.stdout:407/600: open fd = 3 2024-09-12T02:46:23.897 INFO:tasks.workunit.client.0.smithi039.stdout:write ret = 32 2024-09-12T02:46:23.897 INFO:tasks.workunit.client.0.smithi039.stdout:write ret = 32 2024-09-12T02:46:23.898 INFO:tasks.workunit.client.0.smithi039.stdout:pread ret = 64 2024-09-12T02:46:23.898 INFO:tasks.workunit.client.0.smithi039.stdout:408/600: open fd = 3 2024-09-12T02:46:23.898 INFO:tasks.workunit.client.0.smithi039.stdout:write ret = 32 2024-09-12T02:46:23.898 INFO:tasks.workunit.client.0.smithi039.stdout:write ret = 32 2024-09-12T02:46:23.898 INFO:tasks.workunit.client.0.smithi039.stdout:pread ret = 64 2024-09-12T02:46:23.898 INFO:tasks.workunit.client.0.smithi039.stdout:409/600: open fd = 3 2024-09-12T02:46:23.898 INFO:tasks.workunit.client.0.smithi039.stdout:write ret = 32 2024-09-12T02:46:23.898 INFO:tasks.workunit.client.0.smithi039.stdout:write ret = 32 2024-09-12T02:46:23.898 INFO:tasks.workunit.client.0.smithi039.stdout:pread ret = 64 2024-09-12T02:46:23.898 INFO:tasks.workunit.client.0.smithi039.stdout:410/600: open fd = 3 2024-09-12T02:46:23.898 INFO:tasks.workunit.client.0.smithi039.stdout:write ret = 32 2024-09-12T02:46:23.898 INFO:tasks.workunit.client.0.smithi039.stdout:write ret = 32 2024-09-12T02:46:23.898 INFO:tasks.workunit.client.0.smithi039.stdout:pread ret = 64 2024-09-12T02:46:23.898 INFO:tasks.workunit.client.0.smithi039.stdout:411/600: open fd = 3 2024-09-12T02:46:23.899 INFO:tasks.workunit.client.0.smithi039.stdout:write ret = 32 2024-09-12T02:46:23.899 INFO:tasks.workunit.client.0.smithi039.stdout:write ret = 32 2024-09-12T02:46:23.899 INFO:tasks.workunit.client.0.smithi039.stdout:pread ret = 64 2024-09-12T02:46:23.899 INFO:tasks.workunit.client.0.smithi039.stdout:412/600: open fd = 3 2024-09-12T02:46:23.899 INFO:tasks.workunit.client.0.smithi039.stdout:write ret = 32 2024-09-12T02:46:23.899 INFO:tasks.workunit.client.0.smithi039.stdout:write ret = 32 2024-09-12T02:46:23.899 INFO:tasks.workunit.client.0.smithi039.stdout:pread ret = 64 2024-09-12T02:46:23.899 INFO:tasks.workunit.client.0.smithi039.stdout:413/600: open fd = 3 2024-09-12T02:46:23.899 INFO:tasks.workunit.client.0.smithi039.stdout:write ret = 32 2024-09-12T02:46:23.899 INFO:tasks.workunit.client.0.smithi039.stdout:write ret = 32 2024-09-12T02:46:23.899 INFO:tasks.workunit.client.0.smithi039.stdout:pread ret = 64 2024-09-12T02:46:23.899 INFO:tasks.workunit.client.0.smithi039.stdout:414/600: open fd = 3 2024-09-12T02:46:23.899 INFO:tasks.workunit.client.0.smithi039.stdout:write ret = 32 2024-09-12T02:46:23.899 INFO:tasks.workunit.client.0.smithi039.stdout:write ret = 32 2024-09-12T02:46:23.899 INFO:tasks.workunit.client.0.smithi039.stdout:pread ret = 64 2024-09-12T02:46:23.900 INFO:tasks.workunit.client.0.smithi039.stdout:415/600: open fd = 3 2024-09-12T02:46:23.900 INFO:tasks.workunit.client.0.smithi039.stdout:write ret = 32 2024-09-12T02:46:23.900 INFO:tasks.workunit.client.0.smithi039.stdout:write ret = 32 2024-09-12T02:46:23.900 INFO:tasks.workunit.client.0.smithi039.stdout:pread ret = 64 2024-09-12T02:46:23.900 INFO:tasks.workunit.client.0.smithi039.stdout:416/600: open fd = 3 2024-09-12T02:46:23.900 INFO:tasks.workunit.client.0.smithi039.stdout:write ret = 32 2024-09-12T02:46:23.900 INFO:tasks.workunit.client.0.smithi039.stdout:write ret = 32 2024-09-12T02:46:23.900 INFO:tasks.workunit.client.0.smithi039.stdout:pread ret = 64 2024-09-12T02:46:23.900 INFO:tasks.workunit.client.0.smithi039.stdout:417/600: open fd = 3 2024-09-12T02:46:23.900 INFO:tasks.workunit.client.0.smithi039.stdout:write ret = 32 2024-09-12T02:46:23.900 INFO:tasks.workunit.client.0.smithi039.stdout:write ret = 32 2024-09-12T02:46:23.900 INFO:tasks.workunit.client.0.smithi039.stdout:pread ret = 64 2024-09-12T02:46:23.900 INFO:tasks.workunit.client.0.smithi039.stdout:418/600: open fd = 3 2024-09-12T02:46:23.900 INFO:tasks.workunit.client.0.smithi039.stdout:write ret = 32 2024-09-12T02:46:23.901 INFO:tasks.workunit.client.0.smithi039.stdout:write ret = 32 2024-09-12T02:46:23.901 INFO:tasks.workunit.client.0.smithi039.stdout:pread ret = 64 2024-09-12T02:46:23.901 INFO:tasks.workunit.client.0.smithi039.stdout:419/600: open fd = 3 2024-09-12T02:46:23.901 INFO:tasks.workunit.client.0.smithi039.stdout:write ret = 32 2024-09-12T02:46:23.901 INFO:tasks.workunit.client.0.smithi039.stdout:write ret = 32 2024-09-12T02:46:23.901 INFO:tasks.workunit.client.0.smithi039.stdout:pread ret = 64 2024-09-12T02:46:23.901 INFO:tasks.workunit.client.0.smithi039.stdout:420/600: open fd = 3 2024-09-12T02:46:23.901 INFO:tasks.workunit.client.0.smithi039.stdout:write ret = 32 2024-09-12T02:46:23.901 INFO:tasks.workunit.client.0.smithi039.stdout:write ret = 32 2024-09-12T02:46:23.901 INFO:tasks.workunit.client.0.smithi039.stdout:pread ret = 64 2024-09-12T02:46:23.901 INFO:tasks.workunit.client.0.smithi039.stdout:421/600: open fd = 3 2024-09-12T02:46:23.901 INFO:tasks.workunit.client.0.smithi039.stdout:write ret = 32 2024-09-12T02:46:23.901 INFO:tasks.workunit.client.0.smithi039.stdout:write ret = 32 2024-09-12T02:46:23.902 INFO:tasks.workunit.client.0.smithi039.stdout:pread ret = 64 2024-09-12T02:46:23.902 INFO:tasks.workunit.client.0.smithi039.stdout:422/600: open fd = 3 2024-09-12T02:46:23.902 INFO:tasks.workunit.client.0.smithi039.stdout:write ret = 32 2024-09-12T02:46:23.902 INFO:tasks.workunit.client.0.smithi039.stdout:write ret = 32 2024-09-12T02:46:23.902 INFO:tasks.workunit.client.0.smithi039.stdout:pread ret = 64 2024-09-12T02:46:23.902 INFO:tasks.workunit.client.0.smithi039.stdout:423/600: open fd = 3 2024-09-12T02:46:23.902 INFO:tasks.workunit.client.0.smithi039.stdout:write ret = 32 2024-09-12T02:46:23.902 INFO:tasks.workunit.client.0.smithi039.stdout:write ret = 32 2024-09-12T02:46:23.902 INFO:tasks.workunit.client.0.smithi039.stdout:pread ret = 64 2024-09-12T02:46:23.902 INFO:tasks.workunit.client.0.smithi039.stdout:424/600: open fd = 3 2024-09-12T02:46:23.903 INFO:tasks.workunit.client.0.smithi039.stdout:write ret = 32 2024-09-12T02:46:23.903 INFO:tasks.workunit.client.0.smithi039.stdout:write ret = 32 2024-09-12T02:46:23.903 INFO:tasks.workunit.client.0.smithi039.stdout:pread ret = 64 2024-09-12T02:46:23.903 INFO:tasks.workunit.client.0.smithi039.stdout:425/600: open fd = 3 2024-09-12T02:46:23.903 INFO:tasks.workunit.client.0.smithi039.stdout:write ret = 32 2024-09-12T02:46:23.903 INFO:tasks.workunit.client.0.smithi039.stdout:write ret = 32 2024-09-12T02:46:23.903 INFO:tasks.workunit.client.0.smithi039.stdout:pread ret = 64 2024-09-12T02:46:23.903 INFO:tasks.workunit.client.0.smithi039.stdout:426/600: open fd = 3 2024-09-12T02:46:23.903 INFO:tasks.workunit.client.0.smithi039.stdout:write ret = 32 2024-09-12T02:46:23.903 INFO:tasks.workunit.client.0.smithi039.stdout:write ret = 32 2024-09-12T02:46:23.903 INFO:tasks.workunit.client.0.smithi039.stdout:pread ret = 64 2024-09-12T02:46:23.903 INFO:tasks.workunit.client.0.smithi039.stdout:427/600: open fd = 3 2024-09-12T02:46:23.903 INFO:tasks.workunit.client.0.smithi039.stdout:write ret = 32 2024-09-12T02:46:23.903 INFO:tasks.workunit.client.0.smithi039.stdout:write ret = 32 2024-09-12T02:46:23.904 INFO:tasks.workunit.client.0.smithi039.stdout:pread ret = 64 2024-09-12T02:46:23.904 INFO:tasks.workunit.client.0.smithi039.stdout:428/600: open fd = 3 2024-09-12T02:46:23.904 INFO:tasks.workunit.client.0.smithi039.stdout:write ret = 32 2024-09-12T02:46:23.904 INFO:tasks.workunit.client.0.smithi039.stdout:write ret = 32 2024-09-12T02:46:23.904 INFO:tasks.workunit.client.0.smithi039.stdout:pread ret = 64 2024-09-12T02:46:23.904 INFO:tasks.workunit.client.0.smithi039.stdout:429/600: open fd = 3 2024-09-12T02:46:23.904 INFO:tasks.workunit.client.0.smithi039.stdout:write ret = 32 2024-09-12T02:46:23.905 INFO:tasks.workunit.client.0.smithi039.stdout:write ret = 32 2024-09-12T02:46:23.905 INFO:tasks.workunit.client.0.smithi039.stdout:pread ret = 64 2024-09-12T02:46:23.905 INFO:tasks.workunit.client.0.smithi039.stdout:430/600: open fd = 3 2024-09-12T02:46:23.905 INFO:tasks.workunit.client.0.smithi039.stdout:write ret = 32 2024-09-12T02:46:23.905 INFO:tasks.workunit.client.0.smithi039.stdout:write ret = 32 2024-09-12T02:46:23.905 INFO:tasks.workunit.client.0.smithi039.stdout:pread ret = 64 2024-09-12T02:46:23.905 INFO:tasks.workunit.client.0.smithi039.stdout:431/600: open fd = 3 2024-09-12T02:46:23.905 INFO:tasks.workunit.client.0.smithi039.stdout:write ret = 32 2024-09-12T02:46:23.905 INFO:tasks.workunit.client.0.smithi039.stdout:write ret = 32 2024-09-12T02:46:23.905 INFO:tasks.workunit.client.0.smithi039.stdout:pread ret = 64 2024-09-12T02:46:23.905 INFO:tasks.workunit.client.0.smithi039.stdout:432/600: open fd = 3 2024-09-12T02:46:23.905 INFO:tasks.workunit.client.0.smithi039.stdout:write ret = 32 2024-09-12T02:46:23.905 INFO:tasks.workunit.client.0.smithi039.stdout:write ret = 32 2024-09-12T02:46:23.905 INFO:tasks.workunit.client.0.smithi039.stdout:pread ret = 64 2024-09-12T02:46:23.906 INFO:tasks.workunit.client.0.smithi039.stdout:433/600: open fd = 3 2024-09-12T02:46:23.906 INFO:tasks.workunit.client.0.smithi039.stdout:write ret = 32 2024-09-12T02:46:23.906 INFO:tasks.workunit.client.0.smithi039.stdout:write ret = 32 2024-09-12T02:46:23.906 INFO:tasks.workunit.client.0.smithi039.stdout:pread ret = 64 2024-09-12T02:46:23.906 INFO:tasks.workunit.client.0.smithi039.stdout:434/600: open fd = 3 2024-09-12T02:46:23.906 INFO:tasks.workunit.client.0.smithi039.stdout:write ret = 32 2024-09-12T02:46:23.906 INFO:tasks.workunit.client.0.smithi039.stdout:write ret = 32 2024-09-12T02:46:23.906 INFO:tasks.workunit.client.0.smithi039.stdout:pread ret = 64 2024-09-12T02:46:23.906 INFO:tasks.workunit.client.0.smithi039.stdout:435/600: open fd = 3 2024-09-12T02:46:23.906 INFO:tasks.workunit.client.0.smithi039.stdout:write ret = 32 2024-09-12T02:46:23.906 INFO:tasks.workunit.client.0.smithi039.stdout:write ret = 32 2024-09-12T02:46:23.907 INFO:tasks.workunit.client.0.smithi039.stdout:pread ret = 64 2024-09-12T02:46:23.907 INFO:tasks.workunit.client.0.smithi039.stdout:436/600: open fd = 3 2024-09-12T02:46:23.907 INFO:tasks.workunit.client.0.smithi039.stdout:write ret = 32 2024-09-12T02:46:23.907 INFO:tasks.workunit.client.0.smithi039.stdout:write ret = 32 2024-09-12T02:46:23.907 INFO:tasks.workunit.client.0.smithi039.stdout:pread ret = 64 2024-09-12T02:46:25.448 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 12 02:46:25 smithi044 ceph-mon[35411]: pgmap v263: 129 pgs: 129 active+clean; 15 MiB data, 441 MiB used, 1.0 TiB / 1.0 TiB avail; 45 KiB/s rd, 42 KiB/s wr, 13 op/s 2024-09-12T02:46:25.513 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 12 02:46:25 smithi172 ceph-mon[35609]: pgmap v263: 129 pgs: 129 active+clean; 15 MiB data, 441 MiB used, 1.0 TiB / 1.0 TiB avail; 45 KiB/s rd, 42 KiB/s wr, 13 op/s 2024-09-12T02:46:25.599 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 02:46:25 smithi039 ceph-mon[30515]: pgmap v263: 129 pgs: 129 active+clean; 15 MiB data, 441 MiB used, 1.0 TiB / 1.0 TiB avail; 45 KiB/s rd, 42 KiB/s wr, 13 op/s 2024-09-12T02:46:27.448 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 12 02:46:27 smithi044 ceph-mon[35411]: pgmap v264: 129 pgs: 129 active+clean; 15 MiB data, 441 MiB used, 1.0 TiB / 1.0 TiB avail; 45 KiB/s rd, 42 KiB/s wr, 13 op/s 2024-09-12T02:46:27.513 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 12 02:46:27 smithi172 ceph-mon[35609]: pgmap v264: 129 pgs: 129 active+clean; 15 MiB data, 441 MiB used, 1.0 TiB / 1.0 TiB avail; 45 KiB/s rd, 42 KiB/s wr, 13 op/s 2024-09-12T02:46:27.599 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 02:46:27 smithi039 ceph-mon[30515]: pgmap v264: 129 pgs: 129 active+clean; 15 MiB data, 441 MiB used, 1.0 TiB / 1.0 TiB avail; 45 KiB/s rd, 42 KiB/s wr, 13 op/s 2024-09-12T02:46:29.448 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 12 02:46:29 smithi044 ceph-mon[35411]: pgmap v265: 129 pgs: 129 active+clean; 15 MiB data, 442 MiB used, 1.0 TiB / 1.0 TiB avail; 68 KiB/s rd, 63 KiB/s wr, 19 op/s 2024-09-12T02:46:29.513 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 12 02:46:29 smithi172 ceph-mon[35609]: pgmap v265: 129 pgs: 129 active+clean; 15 MiB data, 442 MiB used, 1.0 TiB / 1.0 TiB avail; 68 KiB/s rd, 63 KiB/s wr, 19 op/s 2024-09-12T02:46:29.600 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 02:46:29 smithi039 ceph-mon[30515]: pgmap v265: 129 pgs: 129 active+clean; 15 MiB data, 442 MiB used, 1.0 TiB / 1.0 TiB avail; 68 KiB/s rd, 63 KiB/s wr, 19 op/s 2024-09-12T02:46:31.448 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 12 02:46:31 smithi044 ceph-mon[35411]: pgmap v266: 129 pgs: 129 active+clean; 15 MiB data, 442 MiB used, 1.0 TiB / 1.0 TiB avail; 45 KiB/s rd, 42 KiB/s wr, 13 op/s 2024-09-12T02:46:31.517 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 12 02:46:31 smithi172 ceph-mon[35609]: pgmap v266: 129 pgs: 129 active+clean; 15 MiB data, 442 MiB used, 1.0 TiB / 1.0 TiB avail; 45 KiB/s rd, 42 KiB/s wr, 13 op/s 2024-09-12T02:46:31.600 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 02:46:31 smithi039 ceph-mon[30515]: pgmap v266: 129 pgs: 129 active+clean; 15 MiB data, 442 MiB used, 1.0 TiB / 1.0 TiB avail; 45 KiB/s rd, 42 KiB/s wr, 13 op/s 2024-09-12T02:46:33.448 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 12 02:46:33 smithi044 ceph-mon[35411]: pgmap v267: 129 pgs: 129 active+clean; 16 MiB data, 443 MiB used, 1.0 TiB / 1.0 TiB avail; 67 KiB/s rd, 62 KiB/s wr, 19 op/s 2024-09-12T02:46:33.513 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 12 02:46:33 smithi172 ceph-mon[35609]: pgmap v267: 129 pgs: 129 active+clean; 16 MiB data, 443 MiB used, 1.0 TiB / 1.0 TiB avail; 67 KiB/s rd, 62 KiB/s wr, 19 op/s 2024-09-12T02:46:33.599 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 02:46:33 smithi039 ceph-mon[30515]: pgmap v267: 129 pgs: 129 active+clean; 16 MiB data, 443 MiB used, 1.0 TiB / 1.0 TiB avail; 67 KiB/s rd, 62 KiB/s wr, 19 op/s 2024-09-12T02:46:35.448 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 12 02:46:35 smithi044 ceph-mon[35411]: pgmap v268: 129 pgs: 129 active+clean; 16 MiB data, 443 MiB used, 1.0 TiB / 1.0 TiB avail; 45 KiB/s rd, 41 KiB/s wr, 13 op/s 2024-09-12T02:46:35.513 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 12 02:46:35 smithi172 ceph-mon[35609]: pgmap v268: 129 pgs: 129 active+clean; 16 MiB data, 443 MiB used, 1.0 TiB / 1.0 TiB avail; 45 KiB/s rd, 41 KiB/s wr, 13 op/s 2024-09-12T02:46:35.599 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 02:46:35 smithi039 ceph-mon[30515]: pgmap v268: 129 pgs: 129 active+clean; 16 MiB data, 443 MiB used, 1.0 TiB / 1.0 TiB avail; 45 KiB/s rd, 41 KiB/s wr, 13 op/s 2024-09-12T02:46:37.449 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 12 02:46:37 smithi044 ceph-mon[35411]: pgmap v269: 129 pgs: 129 active+clean; 16 MiB data, 443 MiB used, 1.0 TiB / 1.0 TiB avail; 45 KiB/s rd, 41 KiB/s wr, 13 op/s 2024-09-12T02:46:37.513 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 12 02:46:37 smithi172 ceph-mon[35609]: pgmap v269: 129 pgs: 129 active+clean; 16 MiB data, 443 MiB used, 1.0 TiB / 1.0 TiB avail; 45 KiB/s rd, 41 KiB/s wr, 13 op/s 2024-09-12T02:46:37.600 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 02:46:37 smithi039 ceph-mon[30515]: pgmap v269: 129 pgs: 129 active+clean; 16 MiB data, 443 MiB used, 1.0 TiB / 1.0 TiB avail; 45 KiB/s rd, 41 KiB/s wr, 13 op/s 2024-09-12T02:46:39.448 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 12 02:46:39 smithi044 ceph-mon[35411]: pgmap v270: 129 pgs: 129 active+clean; 16 MiB data, 444 MiB used, 1.0 TiB / 1.0 TiB avail; 71 KiB/s rd, 66 KiB/s wr, 20 op/s 2024-09-12T02:46:39.513 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 12 02:46:39 smithi172 ceph-mon[35609]: pgmap v270: 129 pgs: 129 active+clean; 16 MiB data, 444 MiB used, 1.0 TiB / 1.0 TiB avail; 71 KiB/s rd, 66 KiB/s wr, 20 op/s 2024-09-12T02:46:39.599 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 02:46:39 smithi039 ceph-mon[30515]: pgmap v270: 129 pgs: 129 active+clean; 16 MiB data, 444 MiB used, 1.0 TiB / 1.0 TiB avail; 71 KiB/s rd, 66 KiB/s wr, 20 op/s 2024-09-12T02:46:41.448 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 12 02:46:41 smithi044 ceph-mon[35411]: pgmap v271: 129 pgs: 129 active+clean; 16 MiB data, 444 MiB used, 1.0 TiB / 1.0 TiB avail; 48 KiB/s rd, 44 KiB/s wr, 13 op/s 2024-09-12T02:46:41.513 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 12 02:46:41 smithi172 ceph-mon[35609]: pgmap v271: 129 pgs: 129 active+clean; 16 MiB data, 444 MiB used, 1.0 TiB / 1.0 TiB avail; 48 KiB/s rd, 44 KiB/s wr, 13 op/s 2024-09-12T02:46:41.599 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 02:46:41 smithi039 ceph-mon[30515]: pgmap v271: 129 pgs: 129 active+clean; 16 MiB data, 444 MiB used, 1.0 TiB / 1.0 TiB avail; 48 KiB/s rd, 44 KiB/s wr, 13 op/s 2024-09-12T02:46:43.448 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 12 02:46:43 smithi044 ceph-mon[35411]: pgmap v272: 129 pgs: 129 active+clean; 16 MiB data, 444 MiB used, 1.0 TiB / 1.0 TiB avail; 69 KiB/s rd, 60 KiB/s wr, 19 op/s 2024-09-12T02:46:43.513 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 12 02:46:43 smithi172 ceph-mon[35609]: pgmap v272: 129 pgs: 129 active+clean; 16 MiB data, 444 MiB used, 1.0 TiB / 1.0 TiB avail; 69 KiB/s rd, 60 KiB/s wr, 19 op/s 2024-09-12T02:46:43.600 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 02:46:43 smithi039 ceph-mon[30515]: pgmap v272: 129 pgs: 129 active+clean; 16 MiB data, 444 MiB used, 1.0 TiB / 1.0 TiB avail; 69 KiB/s rd, 60 KiB/s wr, 19 op/s 2024-09-12T02:46:45.448 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 12 02:46:45 smithi044 ceph-mon[35411]: pgmap v273: 129 pgs: 129 active+clean; 16 MiB data, 444 MiB used, 1.0 TiB / 1.0 TiB avail; 47 KiB/s rd, 40 KiB/s wr, 12 op/s 2024-09-12T02:46:45.513 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 12 02:46:45 smithi172 ceph-mon[35609]: pgmap v273: 129 pgs: 129 active+clean; 16 MiB data, 444 MiB used, 1.0 TiB / 1.0 TiB avail; 47 KiB/s rd, 40 KiB/s wr, 12 op/s 2024-09-12T02:46:45.599 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 02:46:45 smithi039 ceph-mon[30515]: pgmap v273: 129 pgs: 129 active+clean; 16 MiB data, 444 MiB used, 1.0 TiB / 1.0 TiB avail; 47 KiB/s rd, 40 KiB/s wr, 12 op/s 2024-09-12T02:46:47.448 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 12 02:46:47 smithi044 ceph-mon[35411]: pgmap v274: 129 pgs: 129 active+clean; 16 MiB data, 444 MiB used, 1.0 TiB / 1.0 TiB avail; 47 KiB/s rd, 40 KiB/s wr, 12 op/s 2024-09-12T02:46:47.513 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 12 02:46:47 smithi172 ceph-mon[35609]: pgmap v274: 129 pgs: 129 active+clean; 16 MiB data, 444 MiB used, 1.0 TiB / 1.0 TiB avail; 47 KiB/s rd, 40 KiB/s wr, 12 op/s 2024-09-12T02:46:47.600 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 02:46:47 smithi039 ceph-mon[30515]: pgmap v274: 129 pgs: 129 active+clean; 16 MiB data, 444 MiB used, 1.0 TiB / 1.0 TiB avail; 47 KiB/s rd, 40 KiB/s wr, 12 op/s 2024-09-12T02:46:49.513 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 12 02:46:49 smithi172 ceph-mon[35609]: pgmap v275: 129 pgs: 129 active+clean; 16 MiB data, 445 MiB used, 1.0 TiB / 1.0 TiB avail; 71 KiB/s rd, 61 KiB/s wr, 19 op/s 2024-09-12T02:46:49.600 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 02:46:49 smithi039 ceph-mon[30515]: pgmap v275: 129 pgs: 129 active+clean; 16 MiB data, 445 MiB used, 1.0 TiB / 1.0 TiB avail; 71 KiB/s rd, 61 KiB/s wr, 19 op/s 2024-09-12T02:46:49.698 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 12 02:46:49 smithi044 ceph-mon[35411]: pgmap v275: 129 pgs: 129 active+clean; 16 MiB data, 445 MiB used, 1.0 TiB / 1.0 TiB avail; 71 KiB/s rd, 61 KiB/s wr, 19 op/s 2024-09-12T02:46:51.513 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 12 02:46:51 smithi172 ceph-mon[35609]: pgmap v276: 129 pgs: 129 active+clean; 16 MiB data, 445 MiB used, 1.0 TiB / 1.0 TiB avail; 45 KiB/s rd, 37 KiB/s wr, 12 op/s 2024-09-12T02:46:51.601 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 02:46:51 smithi039 ceph-mon[30515]: pgmap v276: 129 pgs: 129 active+clean; 16 MiB data, 445 MiB used, 1.0 TiB / 1.0 TiB avail; 45 KiB/s rd, 37 KiB/s wr, 12 op/s 2024-09-12T02:46:51.698 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 12 02:46:51 smithi044 ceph-mon[35411]: pgmap v276: 129 pgs: 129 active+clean; 16 MiB data, 445 MiB used, 1.0 TiB / 1.0 TiB avail; 45 KiB/s rd, 37 KiB/s wr, 12 op/s 2024-09-12T02:46:53.513 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 12 02:46:53 smithi172 ceph-mon[35609]: pgmap v277: 129 pgs: 129 active+clean; 17 MiB data, 446 MiB used, 1.0 TiB / 1.0 TiB avail; 67 KiB/s rd, 58 KiB/s wr, 18 op/s 2024-09-12T02:46:53.599 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 02:46:53 smithi039 ceph-mon[30515]: pgmap v277: 129 pgs: 129 active+clean; 17 MiB data, 446 MiB used, 1.0 TiB / 1.0 TiB avail; 67 KiB/s rd, 58 KiB/s wr, 18 op/s 2024-09-12T02:46:53.698 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 12 02:46:53 smithi044 ceph-mon[35411]: pgmap v277: 129 pgs: 129 active+clean; 17 MiB data, 446 MiB used, 1.0 TiB / 1.0 TiB avail; 67 KiB/s rd, 58 KiB/s wr, 18 op/s 2024-09-12T02:46:55.513 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 12 02:46:55 smithi172 ceph-mon[35609]: pgmap v278: 129 pgs: 129 active+clean; 17 MiB data, 446 MiB used, 1.0 TiB / 1.0 TiB avail; 45 KiB/s rd, 42 KiB/s wr, 13 op/s 2024-09-12T02:46:55.599 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 02:46:55 smithi039 ceph-mon[30515]: pgmap v278: 129 pgs: 129 active+clean; 17 MiB data, 446 MiB used, 1.0 TiB / 1.0 TiB avail; 45 KiB/s rd, 42 KiB/s wr, 13 op/s 2024-09-12T02:46:55.701 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 12 02:46:55 smithi044 ceph-mon[35411]: pgmap v278: 129 pgs: 129 active+clean; 17 MiB data, 446 MiB used, 1.0 TiB / 1.0 TiB avail; 45 KiB/s rd, 42 KiB/s wr, 13 op/s 2024-09-12T02:46:57.513 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 12 02:46:57 smithi172 ceph-mon[35609]: pgmap v279: 129 pgs: 129 active+clean; 17 MiB data, 446 MiB used, 1.0 TiB / 1.0 TiB avail; 45 KiB/s rd, 42 KiB/s wr, 13 op/s 2024-09-12T02:46:57.600 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 02:46:57 smithi039 ceph-mon[30515]: pgmap v279: 129 pgs: 129 active+clean; 17 MiB data, 446 MiB used, 1.0 TiB / 1.0 TiB avail; 45 KiB/s rd, 42 KiB/s wr, 13 op/s 2024-09-12T02:46:57.698 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 12 02:46:57 smithi044 ceph-mon[35411]: pgmap v279: 129 pgs: 129 active+clean; 17 MiB data, 446 MiB used, 1.0 TiB / 1.0 TiB avail; 45 KiB/s rd, 42 KiB/s wr, 13 op/s 2024-09-12T02:46:59.513 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 12 02:46:59 smithi172 ceph-mon[35609]: pgmap v280: 129 pgs: 129 active+clean; 17 MiB data, 447 MiB used, 1.0 TiB / 1.0 TiB avail; 67 KiB/s rd, 62 KiB/s wr, 19 op/s 2024-09-12T02:46:59.600 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 02:46:59 smithi039 ceph-mon[30515]: pgmap v280: 129 pgs: 129 active+clean; 17 MiB data, 447 MiB used, 1.0 TiB / 1.0 TiB avail; 67 KiB/s rd, 62 KiB/s wr, 19 op/s 2024-09-12T02:46:59.698 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 12 02:46:59 smithi044 ceph-mon[35411]: pgmap v280: 129 pgs: 129 active+clean; 17 MiB data, 447 MiB used, 1.0 TiB / 1.0 TiB avail; 67 KiB/s rd, 62 KiB/s wr, 19 op/s 2024-09-12T02:47:01.513 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 12 02:47:01 smithi172 ceph-mon[35609]: pgmap v281: 129 pgs: 129 active+clean; 17 MiB data, 447 MiB used, 1.0 TiB / 1.0 TiB avail; 44 KiB/s rd, 41 KiB/s wr, 12 op/s 2024-09-12T02:47:01.600 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 02:47:01 smithi039 ceph-mon[30515]: pgmap v281: 129 pgs: 129 active+clean; 17 MiB data, 447 MiB used, 1.0 TiB / 1.0 TiB avail; 44 KiB/s rd, 41 KiB/s wr, 12 op/s 2024-09-12T02:47:01.698 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 12 02:47:01 smithi044 ceph-mon[35411]: pgmap v281: 129 pgs: 129 active+clean; 17 MiB data, 447 MiB used, 1.0 TiB / 1.0 TiB avail; 44 KiB/s rd, 41 KiB/s wr, 12 op/s 2024-09-12T02:47:03.501 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 12 02:47:03 smithi044 ceph-mon[35411]: pgmap v282: 129 pgs: 129 active+clean; 17 MiB data, 448 MiB used, 1.0 TiB / 1.0 TiB avail; 78 KiB/s rd, 107 KiB/s wr, 36 op/s 2024-09-12T02:47:03.501 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 12 02:47:03 smithi044 ceph-mon[35411]: osdmap e103: 12 total, 12 up, 12 in 2024-09-12T02:47:03.513 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 12 02:47:03 smithi172 ceph-mon[35609]: pgmap v282: 129 pgs: 129 active+clean; 17 MiB data, 448 MiB used, 1.0 TiB / 1.0 TiB avail; 78 KiB/s rd, 107 KiB/s wr, 36 op/s 2024-09-12T02:47:03.513 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 12 02:47:03 smithi172 ceph-mon[35609]: osdmap e103: 12 total, 12 up, 12 in 2024-09-12T02:47:03.599 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 02:47:03 smithi039 ceph-mon[30515]: pgmap v282: 129 pgs: 129 active+clean; 17 MiB data, 448 MiB used, 1.0 TiB / 1.0 TiB avail; 78 KiB/s rd, 107 KiB/s wr, 36 op/s 2024-09-12T02:47:03.600 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 02:47:03 smithi039 ceph-mon[30515]: osdmap e103: 12 total, 12 up, 12 in 2024-09-12T02:47:05.513 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 12 02:47:05 smithi172 ceph-mon[35609]: pgmap v284: 129 pgs: 129 active+clean; 17 MiB data, 448 MiB used, 1.0 TiB / 1.0 TiB avail; 67 KiB/s rd, 104 KiB/s wr, 35 op/s 2024-09-12T02:47:05.600 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 02:47:05 smithi039 ceph-mon[30515]: pgmap v284: 129 pgs: 129 active+clean; 17 MiB data, 448 MiB used, 1.0 TiB / 1.0 TiB avail; 67 KiB/s rd, 104 KiB/s wr, 35 op/s 2024-09-12T02:47:05.698 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 12 02:47:05 smithi044 ceph-mon[35411]: pgmap v284: 129 pgs: 129 active+clean; 17 MiB data, 448 MiB used, 1.0 TiB / 1.0 TiB avail; 67 KiB/s rd, 104 KiB/s wr, 35 op/s 2024-09-12T02:47:07.513 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 12 02:47:07 smithi172 ceph-mon[35609]: pgmap v285: 129 pgs: 129 active+clean; 17 MiB data, 448 MiB used, 1.0 TiB / 1.0 TiB avail; 67 KiB/s rd, 104 KiB/s wr, 35 op/s 2024-09-12T02:47:07.600 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 02:47:07 smithi039 ceph-mon[30515]: pgmap v285: 129 pgs: 129 active+clean; 17 MiB data, 448 MiB used, 1.0 TiB / 1.0 TiB avail; 67 KiB/s rd, 104 KiB/s wr, 35 op/s 2024-09-12T02:47:07.698 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 12 02:47:07 smithi044 ceph-mon[35411]: pgmap v285: 129 pgs: 129 active+clean; 17 MiB data, 448 MiB used, 1.0 TiB / 1.0 TiB avail; 67 KiB/s rd, 104 KiB/s wr, 35 op/s 2024-09-12T02:47:09.513 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 12 02:47:09 smithi172 ceph-mon[35609]: pgmap v286: 129 pgs: 129 active+clean; 17 MiB data, 448 MiB used, 1.0 TiB / 1.0 TiB avail; 73 KiB/s rd, 111 KiB/s wr, 36 op/s 2024-09-12T02:47:09.599 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 02:47:09 smithi039 ceph-mon[30515]: pgmap v286: 129 pgs: 129 active+clean; 17 MiB data, 448 MiB used, 1.0 TiB / 1.0 TiB avail; 73 KiB/s rd, 111 KiB/s wr, 36 op/s 2024-09-12T02:47:09.698 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 12 02:47:09 smithi044 ceph-mon[35411]: pgmap v286: 129 pgs: 129 active+clean; 17 MiB data, 448 MiB used, 1.0 TiB / 1.0 TiB avail; 73 KiB/s rd, 111 KiB/s wr, 36 op/s 2024-09-12T02:47:10.513 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 12 02:47:10 smithi172 ceph-mon[35609]: from='mgr.25199 172.21.15.39:0/1270637502' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-12T02:47:10.599 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 02:47:10 smithi039 ceph-mon[30515]: from='mgr.25199 172.21.15.39:0/1270637502' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-12T02:47:10.698 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 12 02:47:10 smithi044 ceph-mon[35411]: from='mgr.25199 172.21.15.39:0/1270637502' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-12T02:47:11.514 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 12 02:47:11 smithi172 ceph-mon[35609]: pgmap v287: 129 pgs: 129 active+clean; 17 MiB data, 448 MiB used, 1.0 TiB / 1.0 TiB avail; 73 KiB/s rd, 111 KiB/s wr, 36 op/s 2024-09-12T02:47:11.514 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 12 02:47:11 smithi172 ceph-mon[35609]: from='mgr.25199 172.21.15.39:0/1270637502' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-12T02:47:11.514 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 12 02:47:11 smithi172 ceph-mon[35609]: from='mgr.25199 172.21.15.39:0/1270637502' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-12T02:47:11.514 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 12 02:47:11 smithi172 ceph-mon[35609]: from='mgr.25199 172.21.15.39:0/1270637502' entity='mgr.x' 2024-09-12T02:47:11.600 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 02:47:11 smithi039 ceph-mon[30515]: pgmap v287: 129 pgs: 129 active+clean; 17 MiB data, 448 MiB used, 1.0 TiB / 1.0 TiB avail; 73 KiB/s rd, 111 KiB/s wr, 36 op/s 2024-09-12T02:47:11.600 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 02:47:11 smithi039 ceph-mon[30515]: from='mgr.25199 172.21.15.39:0/1270637502' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-12T02:47:11.600 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 02:47:11 smithi039 ceph-mon[30515]: from='mgr.25199 172.21.15.39:0/1270637502' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-12T02:47:11.600 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 02:47:11 smithi039 ceph-mon[30515]: from='mgr.25199 172.21.15.39:0/1270637502' entity='mgr.x' 2024-09-12T02:47:11.698 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 12 02:47:11 smithi044 ceph-mon[35411]: pgmap v287: 129 pgs: 129 active+clean; 17 MiB data, 448 MiB used, 1.0 TiB / 1.0 TiB avail; 73 KiB/s rd, 111 KiB/s wr, 36 op/s 2024-09-12T02:47:11.721 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 12 02:47:11 smithi044 ceph-mon[35411]: from='mgr.25199 172.21.15.39:0/1270637502' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-12T02:47:11.721 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 12 02:47:11 smithi044 ceph-mon[35411]: from='mgr.25199 172.21.15.39:0/1270637502' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-12T02:47:11.721 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 12 02:47:11 smithi044 ceph-mon[35411]: from='mgr.25199 172.21.15.39:0/1270637502' entity='mgr.x' 2024-09-12T02:47:13.448 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 12 02:47:13 smithi044 ceph-mon[35411]: pgmap v288: 129 pgs: 129 active+clean; 18 MiB data, 449 MiB used, 1.0 TiB / 1.0 TiB avail; 61 KiB/s rd, 58 KiB/s wr, 16 op/s 2024-09-12T02:47:13.449 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 12 02:47:13 smithi044 ceph-mon[35411]: osdmap e104: 12 total, 12 up, 12 in 2024-09-12T02:47:13.513 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 12 02:47:13 smithi172 ceph-mon[35609]: pgmap v288: 129 pgs: 129 active+clean; 18 MiB data, 449 MiB used, 1.0 TiB / 1.0 TiB avail; 61 KiB/s rd, 58 KiB/s wr, 16 op/s 2024-09-12T02:47:13.514 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 12 02:47:13 smithi172 ceph-mon[35609]: osdmap e104: 12 total, 12 up, 12 in 2024-09-12T02:47:13.600 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 02:47:13 smithi039 ceph-mon[30515]: pgmap v288: 129 pgs: 129 active+clean; 18 MiB data, 449 MiB used, 1.0 TiB / 1.0 TiB avail; 61 KiB/s rd, 58 KiB/s wr, 16 op/s 2024-09-12T02:47:13.600 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 02:47:13 smithi039 ceph-mon[30515]: osdmap e104: 12 total, 12 up, 12 in 2024-09-12T02:47:15.448 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 12 02:47:15 smithi044 ceph-mon[35411]: pgmap v290: 129 pgs: 129 active+clean; 18 MiB data, 449 MiB used, 1.0 TiB / 1.0 TiB avail; 61 KiB/s rd, 58 KiB/s wr, 16 op/s 2024-09-12T02:47:15.513 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 12 02:47:15 smithi172 ceph-mon[35609]: pgmap v290: 129 pgs: 129 active+clean; 18 MiB data, 449 MiB used, 1.0 TiB / 1.0 TiB avail; 61 KiB/s rd, 58 KiB/s wr, 16 op/s 2024-09-12T02:47:15.600 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 02:47:15 smithi039 ceph-mon[30515]: pgmap v290: 129 pgs: 129 active+clean; 18 MiB data, 449 MiB used, 1.0 TiB / 1.0 TiB avail; 61 KiB/s rd, 58 KiB/s wr, 16 op/s 2024-09-12T02:47:17.448 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 12 02:47:17 smithi044 ceph-mon[35411]: pgmap v291: 129 pgs: 129 active+clean; 18 MiB data, 449 MiB used, 1.0 TiB / 1.0 TiB avail; 61 KiB/s rd, 58 KiB/s wr, 16 op/s 2024-09-12T02:47:17.513 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 12 02:47:17 smithi172 ceph-mon[35609]: pgmap v291: 129 pgs: 129 active+clean; 18 MiB data, 449 MiB used, 1.0 TiB / 1.0 TiB avail; 61 KiB/s rd, 58 KiB/s wr, 16 op/s 2024-09-12T02:47:17.599 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 02:47:17 smithi039 ceph-mon[30515]: pgmap v291: 129 pgs: 129 active+clean; 18 MiB data, 449 MiB used, 1.0 TiB / 1.0 TiB avail; 61 KiB/s rd, 58 KiB/s wr, 16 op/s 2024-09-12T02:47:19.449 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 12 02:47:19 smithi044 ceph-mon[35411]: pgmap v292: 129 pgs: 129 active+clean; 18 MiB data, 450 MiB used, 1.0 TiB / 1.0 TiB avail; 58 KiB/s rd, 55 KiB/s wr, 15 op/s 2024-09-12T02:47:19.513 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 12 02:47:19 smithi172 ceph-mon[35609]: pgmap v292: 129 pgs: 129 active+clean; 18 MiB data, 450 MiB used, 1.0 TiB / 1.0 TiB avail; 58 KiB/s rd, 55 KiB/s wr, 15 op/s 2024-09-12T02:47:19.599 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 02:47:19 smithi039 ceph-mon[30515]: pgmap v292: 129 pgs: 129 active+clean; 18 MiB data, 450 MiB used, 1.0 TiB / 1.0 TiB avail; 58 KiB/s rd, 55 KiB/s wr, 15 op/s 2024-09-12T02:47:21.448 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 12 02:47:21 smithi044 ceph-mon[35411]: pgmap v293: 129 pgs: 129 active+clean; 18 MiB data, 450 MiB used, 1.0 TiB / 1.0 TiB avail; 58 KiB/s rd, 55 KiB/s wr, 15 op/s 2024-09-12T02:47:21.513 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 12 02:47:21 smithi172 ceph-mon[35609]: pgmap v293: 129 pgs: 129 active+clean; 18 MiB data, 450 MiB used, 1.0 TiB / 1.0 TiB avail; 58 KiB/s rd, 55 KiB/s wr, 15 op/s 2024-09-12T02:47:21.599 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 02:47:21 smithi039 ceph-mon[30515]: pgmap v293: 129 pgs: 129 active+clean; 18 MiB data, 450 MiB used, 1.0 TiB / 1.0 TiB avail; 58 KiB/s rd, 55 KiB/s wr, 15 op/s 2024-09-12T02:47:23.448 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 12 02:47:23 smithi044 ceph-mon[35411]: pgmap v294: 129 pgs: 129 active+clean; 18 MiB data, 451 MiB used, 1.0 TiB / 1.0 TiB avail; 59 KiB/s rd, 55 KiB/s wr, 15 op/s 2024-09-12T02:47:23.513 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 12 02:47:23 smithi172 ceph-mon[35609]: pgmap v294: 129 pgs: 129 active+clean; 18 MiB data, 451 MiB used, 1.0 TiB / 1.0 TiB avail; 59 KiB/s rd, 55 KiB/s wr, 15 op/s 2024-09-12T02:47:23.600 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 02:47:23 smithi039 ceph-mon[30515]: pgmap v294: 129 pgs: 129 active+clean; 18 MiB data, 451 MiB used, 1.0 TiB / 1.0 TiB avail; 59 KiB/s rd, 55 KiB/s wr, 15 op/s 2024-09-12T02:47:25.448 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 12 02:47:25 smithi044 ceph-mon[35411]: pgmap v295: 129 pgs: 129 active+clean; 18 MiB data, 451 MiB used, 1.0 TiB / 1.0 TiB avail; 49 KiB/s rd, 46 KiB/s wr, 13 op/s 2024-09-12T02:47:25.514 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 12 02:47:25 smithi172 ceph-mon[35609]: pgmap v295: 129 pgs: 129 active+clean; 18 MiB data, 451 MiB used, 1.0 TiB / 1.0 TiB avail; 49 KiB/s rd, 46 KiB/s wr, 13 op/s 2024-09-12T02:47:25.600 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 02:47:25 smithi039 ceph-mon[30515]: pgmap v295: 129 pgs: 129 active+clean; 18 MiB data, 451 MiB used, 1.0 TiB / 1.0 TiB avail; 49 KiB/s rd, 46 KiB/s wr, 13 op/s 2024-09-12T02:47:26.419 INFO:tasks.workunit.client.0.smithi039.stdout:437/600: open fd = 3 2024-09-12T02:47:26.419 INFO:tasks.workunit.client.0.smithi039.stdout:write ret = 32 2024-09-12T02:47:26.420 INFO:tasks.workunit.client.0.smithi039.stdout:write ret = 32 2024-09-12T02:47:26.420 INFO:tasks.workunit.client.0.smithi039.stdout:pread ret = 64 2024-09-12T02:47:26.420 INFO:tasks.workunit.client.0.smithi039.stdout:438/600: open fd = 3 2024-09-12T02:47:26.420 INFO:tasks.workunit.client.0.smithi039.stdout:write ret = 32 2024-09-12T02:47:26.420 INFO:tasks.workunit.client.0.smithi039.stdout:write ret = 32 2024-09-12T02:47:26.420 INFO:tasks.workunit.client.0.smithi039.stdout:pread ret = 64 2024-09-12T02:47:26.420 INFO:tasks.workunit.client.0.smithi039.stdout:439/600: open fd = 3 2024-09-12T02:47:26.420 INFO:tasks.workunit.client.0.smithi039.stdout:write ret = 32 2024-09-12T02:47:26.420 INFO:tasks.workunit.client.0.smithi039.stdout:write ret = 32 2024-09-12T02:47:26.420 INFO:tasks.workunit.client.0.smithi039.stdout:pread ret = 64 2024-09-12T02:47:26.420 INFO:tasks.workunit.client.0.smithi039.stdout:440/600: open fd = 3 2024-09-12T02:47:26.421 INFO:tasks.workunit.client.0.smithi039.stdout:write ret = 32 2024-09-12T02:47:26.421 INFO:tasks.workunit.client.0.smithi039.stdout:write ret = 32 2024-09-12T02:47:26.421 INFO:tasks.workunit.client.0.smithi039.stdout:pread ret = 64 2024-09-12T02:47:26.421 INFO:tasks.workunit.client.0.smithi039.stdout:441/600: open fd = 3 2024-09-12T02:47:26.421 INFO:tasks.workunit.client.0.smithi039.stdout:write ret = 32 2024-09-12T02:47:26.421 INFO:tasks.workunit.client.0.smithi039.stdout:write ret = 32 2024-09-12T02:47:26.421 INFO:tasks.workunit.client.0.smithi039.stdout:pread ret = 64 2024-09-12T02:47:26.421 INFO:tasks.workunit.client.0.smithi039.stdout:442/600: open fd = 3 2024-09-12T02:47:26.421 INFO:tasks.workunit.client.0.smithi039.stdout:write ret = 32 2024-09-12T02:47:26.421 INFO:tasks.workunit.client.0.smithi039.stdout:write ret = 32 2024-09-12T02:47:26.421 INFO:tasks.workunit.client.0.smithi039.stdout:pread ret = 64 2024-09-12T02:47:26.421 INFO:tasks.workunit.client.0.smithi039.stdout:443/600: open fd = 3 2024-09-12T02:47:26.422 INFO:tasks.workunit.client.0.smithi039.stdout:write ret = 32 2024-09-12T02:47:26.422 INFO:tasks.workunit.client.0.smithi039.stdout:write ret = 32 2024-09-12T02:47:26.422 INFO:tasks.workunit.client.0.smithi039.stdout:pread ret = 64 2024-09-12T02:47:26.422 INFO:tasks.workunit.client.0.smithi039.stdout:444/600: open fd = 3 2024-09-12T02:47:26.422 INFO:tasks.workunit.client.0.smithi039.stdout:write ret = 32 2024-09-12T02:47:26.422 INFO:tasks.workunit.client.0.smithi039.stdout:write ret = 32 2024-09-12T02:47:26.422 INFO:tasks.workunit.client.0.smithi039.stdout:pread ret = 64 2024-09-12T02:47:26.422 INFO:tasks.workunit.client.0.smithi039.stdout:445/600: open fd = 3 2024-09-12T02:47:26.422 INFO:tasks.workunit.client.0.smithi039.stdout:write ret = 32 2024-09-12T02:47:26.422 INFO:tasks.workunit.client.0.smithi039.stdout:write ret = 32 2024-09-12T02:47:26.422 INFO:tasks.workunit.client.0.smithi039.stdout:pread ret = 64 2024-09-12T02:47:26.422 INFO:tasks.workunit.client.0.smithi039.stdout:446/600: open fd = 3 2024-09-12T02:47:26.422 INFO:tasks.workunit.client.0.smithi039.stdout:write ret = 32 2024-09-12T02:47:26.423 INFO:tasks.workunit.client.0.smithi039.stdout:write ret = 32 2024-09-12T02:47:26.423 INFO:tasks.workunit.client.0.smithi039.stdout:pread ret = 64 2024-09-12T02:47:26.423 INFO:tasks.workunit.client.0.smithi039.stdout:447/600: open fd = 3 2024-09-12T02:47:26.423 INFO:tasks.workunit.client.0.smithi039.stdout:write ret = 32 2024-09-12T02:47:26.423 INFO:tasks.workunit.client.0.smithi039.stdout:write ret = 32 2024-09-12T02:47:26.423 INFO:tasks.workunit.client.0.smithi039.stdout:pread ret = 64 2024-09-12T02:47:26.423 INFO:tasks.workunit.client.0.smithi039.stdout:448/600: open fd = 3 2024-09-12T02:47:26.423 INFO:tasks.workunit.client.0.smithi039.stdout:write ret = 32 2024-09-12T02:47:26.423 INFO:tasks.workunit.client.0.smithi039.stdout:write ret = 32 2024-09-12T02:47:26.423 INFO:tasks.workunit.client.0.smithi039.stdout:pread ret = 64 2024-09-12T02:47:26.423 INFO:tasks.workunit.client.0.smithi039.stdout:449/600: open fd = 3 2024-09-12T02:47:26.423 INFO:tasks.workunit.client.0.smithi039.stdout:write ret = 32 2024-09-12T02:47:26.424 INFO:tasks.workunit.client.0.smithi039.stdout:write ret = 32 2024-09-12T02:47:26.424 INFO:tasks.workunit.client.0.smithi039.stdout:pread ret = 64 2024-09-12T02:47:26.424 INFO:tasks.workunit.client.0.smithi039.stdout:450/600: open fd = 3 2024-09-12T02:47:26.424 INFO:tasks.workunit.client.0.smithi039.stdout:write ret = 32 2024-09-12T02:47:26.424 INFO:tasks.workunit.client.0.smithi039.stdout:write ret = 32 2024-09-12T02:47:26.424 INFO:tasks.workunit.client.0.smithi039.stdout:pread ret = 64 2024-09-12T02:47:26.424 INFO:tasks.workunit.client.0.smithi039.stdout:451/600: open fd = 3 2024-09-12T02:47:26.424 INFO:tasks.workunit.client.0.smithi039.stdout:write ret = 32 2024-09-12T02:47:26.424 INFO:tasks.workunit.client.0.smithi039.stdout:write ret = 32 2024-09-12T02:47:26.424 INFO:tasks.workunit.client.0.smithi039.stdout:pread ret = 64 2024-09-12T02:47:26.424 INFO:tasks.workunit.client.0.smithi039.stdout:452/600: open fd = 3 2024-09-12T02:47:26.424 INFO:tasks.workunit.client.0.smithi039.stdout:write ret = 32 2024-09-12T02:47:26.424 INFO:tasks.workunit.client.0.smithi039.stdout:write ret = 32 2024-09-12T02:47:26.425 INFO:tasks.workunit.client.0.smithi039.stdout:pread ret = 64 2024-09-12T02:47:26.425 INFO:tasks.workunit.client.0.smithi039.stdout:453/600: open fd = 3 2024-09-12T02:47:26.425 INFO:tasks.workunit.client.0.smithi039.stdout:write ret = 32 2024-09-12T02:47:26.425 INFO:tasks.workunit.client.0.smithi039.stdout:write ret = 32 2024-09-12T02:47:26.425 INFO:tasks.workunit.client.0.smithi039.stdout:pread ret = 64 2024-09-12T02:47:26.425 INFO:tasks.workunit.client.0.smithi039.stdout:454/600: open fd = 3 2024-09-12T02:47:26.425 INFO:tasks.workunit.client.0.smithi039.stdout:write ret = 32 2024-09-12T02:47:26.425 INFO:tasks.workunit.client.0.smithi039.stdout:write ret = 32 2024-09-12T02:47:26.425 INFO:tasks.workunit.client.0.smithi039.stdout:pread ret = 64 2024-09-12T02:47:26.425 INFO:tasks.workunit.client.0.smithi039.stdout:455/600: open fd = 3 2024-09-12T02:47:26.425 INFO:tasks.workunit.client.0.smithi039.stdout:write ret = 32 2024-09-12T02:47:26.425 INFO:tasks.workunit.client.0.smithi039.stdout:write ret = 32 2024-09-12T02:47:26.425 INFO:tasks.workunit.client.0.smithi039.stdout:pread ret = 64 2024-09-12T02:47:26.426 INFO:tasks.workunit.client.0.smithi039.stdout:456/600: open fd = 3 2024-09-12T02:47:26.426 INFO:tasks.workunit.client.0.smithi039.stdout:write ret = 32 2024-09-12T02:47:26.426 INFO:tasks.workunit.client.0.smithi039.stdout:write ret = 32 2024-09-12T02:47:26.426 INFO:tasks.workunit.client.0.smithi039.stdout:pread ret = 64 2024-09-12T02:47:26.426 INFO:tasks.workunit.client.0.smithi039.stdout:457/600: open fd = 3 2024-09-12T02:47:26.426 INFO:tasks.workunit.client.0.smithi039.stdout:write ret = 32 2024-09-12T02:47:26.426 INFO:tasks.workunit.client.0.smithi039.stdout:write ret = 32 2024-09-12T02:47:26.426 INFO:tasks.workunit.client.0.smithi039.stdout:pread ret = 64 2024-09-12T02:47:26.426 INFO:tasks.workunit.client.0.smithi039.stdout:458/600: open fd = 3 2024-09-12T02:47:26.426 INFO:tasks.workunit.client.0.smithi039.stdout:write ret = 32 2024-09-12T02:47:26.426 INFO:tasks.workunit.client.0.smithi039.stdout:write ret = 32 2024-09-12T02:47:26.426 INFO:tasks.workunit.client.0.smithi039.stdout:pread ret = 64 2024-09-12T02:47:26.426 INFO:tasks.workunit.client.0.smithi039.stdout:459/600: open fd = 3 2024-09-12T02:47:26.426 INFO:tasks.workunit.client.0.smithi039.stdout:write ret = 32 2024-09-12T02:47:26.427 INFO:tasks.workunit.client.0.smithi039.stdout:write ret = 32 2024-09-12T02:47:26.427 INFO:tasks.workunit.client.0.smithi039.stdout:pread ret = 64 2024-09-12T02:47:26.427 INFO:tasks.workunit.client.0.smithi039.stdout:460/600: open fd = 3 2024-09-12T02:47:26.427 INFO:tasks.workunit.client.0.smithi039.stdout:write ret = 32 2024-09-12T02:47:26.427 INFO:tasks.workunit.client.0.smithi039.stdout:write ret = 32 2024-09-12T02:47:26.427 INFO:tasks.workunit.client.0.smithi039.stdout:pread ret = 64 2024-09-12T02:47:26.427 INFO:tasks.workunit.client.0.smithi039.stdout:461/600: open fd = 3 2024-09-12T02:47:26.427 INFO:tasks.workunit.client.0.smithi039.stdout:write ret = 32 2024-09-12T02:47:26.427 INFO:tasks.workunit.client.0.smithi039.stdout:write ret = 32 2024-09-12T02:47:26.427 INFO:tasks.workunit.client.0.smithi039.stdout:pread ret = 64 2024-09-12T02:47:26.427 INFO:tasks.workunit.client.0.smithi039.stdout:462/600: open fd = 3 2024-09-12T02:47:26.427 INFO:tasks.workunit.client.0.smithi039.stdout:write ret = 32 2024-09-12T02:47:26.427 INFO:tasks.workunit.client.0.smithi039.stdout:write ret = 32 2024-09-12T02:47:26.428 INFO:tasks.workunit.client.0.smithi039.stdout:pread ret = 64 2024-09-12T02:47:26.428 INFO:tasks.workunit.client.0.smithi039.stdout:463/600: open fd = 3 2024-09-12T02:47:26.428 INFO:tasks.workunit.client.0.smithi039.stdout:write ret = 32 2024-09-12T02:47:26.428 INFO:tasks.workunit.client.0.smithi039.stdout:write ret = 32 2024-09-12T02:47:26.428 INFO:tasks.workunit.client.0.smithi039.stdout:pread ret = 64 2024-09-12T02:47:26.428 INFO:tasks.workunit.client.0.smithi039.stdout:464/600: open fd = 3 2024-09-12T02:47:26.428 INFO:tasks.workunit.client.0.smithi039.stdout:write ret = 32 2024-09-12T02:47:26.428 INFO:tasks.workunit.client.0.smithi039.stdout:write ret = 32 2024-09-12T02:47:26.428 INFO:tasks.workunit.client.0.smithi039.stdout:pread ret = 64 2024-09-12T02:47:26.428 INFO:tasks.workunit.client.0.smithi039.stdout:465/600: open fd = 3 2024-09-12T02:47:26.428 INFO:tasks.workunit.client.0.smithi039.stdout:write ret = 32 2024-09-12T02:47:26.428 INFO:tasks.workunit.client.0.smithi039.stdout:write ret = 32 2024-09-12T02:47:26.428 INFO:tasks.workunit.client.0.smithi039.stdout:pread ret = 64 2024-09-12T02:47:26.429 INFO:tasks.workunit.client.0.smithi039.stdout:466/600: open fd = 3 2024-09-12T02:47:26.429 INFO:tasks.workunit.client.0.smithi039.stdout:write ret = 32 2024-09-12T02:47:26.429 INFO:tasks.workunit.client.0.smithi039.stdout:write ret = 32 2024-09-12T02:47:26.429 INFO:tasks.workunit.client.0.smithi039.stdout:pread ret = 64 2024-09-12T02:47:26.429 INFO:tasks.workunit.client.0.smithi039.stdout:467/600: open fd = 3 2024-09-12T02:47:26.429 INFO:tasks.workunit.client.0.smithi039.stdout:write ret = 32 2024-09-12T02:47:26.429 INFO:tasks.workunit.client.0.smithi039.stdout:write ret = 32 2024-09-12T02:47:26.429 INFO:tasks.workunit.client.0.smithi039.stdout:pread ret = 64 2024-09-12T02:47:26.429 INFO:tasks.workunit.client.0.smithi039.stdout:468/600: open fd = 3 2024-09-12T02:47:26.429 INFO:tasks.workunit.client.0.smithi039.stdout:write ret = 32 2024-09-12T02:47:26.429 INFO:tasks.workunit.client.0.smithi039.stdout:write ret = 32 2024-09-12T02:47:26.429 INFO:tasks.workunit.client.0.smithi039.stdout:pread ret = 64 2024-09-12T02:47:26.429 INFO:tasks.workunit.client.0.smithi039.stdout:469/600: open fd = 3 2024-09-12T02:47:26.430 INFO:tasks.workunit.client.0.smithi039.stdout:write ret = 32 2024-09-12T02:47:26.430 INFO:tasks.workunit.client.0.smithi039.stdout:write ret = 32 2024-09-12T02:47:26.430 INFO:tasks.workunit.client.0.smithi039.stdout:pread ret = 64 2024-09-12T02:47:26.430 INFO:tasks.workunit.client.0.smithi039.stdout:470/600: open fd = 3 2024-09-12T02:47:26.430 INFO:tasks.workunit.client.0.smithi039.stdout:write ret = 32 2024-09-12T02:47:26.430 INFO:tasks.workunit.client.0.smithi039.stdout:write ret = 32 2024-09-12T02:47:26.430 INFO:tasks.workunit.client.0.smithi039.stdout:pread ret = 64 2024-09-12T02:47:26.430 INFO:tasks.workunit.client.0.smithi039.stdout:471/600: open fd = 3 2024-09-12T02:47:26.430 INFO:tasks.workunit.client.0.smithi039.stdout:write ret = 32 2024-09-12T02:47:26.430 INFO:tasks.workunit.client.0.smithi039.stdout:write ret = 32 2024-09-12T02:47:26.430 INFO:tasks.workunit.client.0.smithi039.stdout:pread ret = 64 2024-09-12T02:47:26.430 INFO:tasks.workunit.client.0.smithi039.stdout:472/600: open fd = 3 2024-09-12T02:47:26.430 INFO:tasks.workunit.client.0.smithi039.stdout:write ret = 32 2024-09-12T02:47:26.431 INFO:tasks.workunit.client.0.smithi039.stdout:write ret = 32 2024-09-12T02:47:26.431 INFO:tasks.workunit.client.0.smithi039.stdout:pread ret = 64 2024-09-12T02:47:26.431 INFO:tasks.workunit.client.0.smithi039.stdout:473/600: open fd = 3 2024-09-12T02:47:26.431 INFO:tasks.workunit.client.0.smithi039.stdout:write ret = 32 2024-09-12T02:47:26.431 INFO:tasks.workunit.client.0.smithi039.stdout:write ret = 32 2024-09-12T02:47:26.431 INFO:tasks.workunit.client.0.smithi039.stdout:pread ret = 64 2024-09-12T02:47:26.431 INFO:tasks.workunit.client.0.smithi039.stdout:474/600: open fd = 3 2024-09-12T02:47:26.431 INFO:tasks.workunit.client.0.smithi039.stdout:write ret = 32 2024-09-12T02:47:26.431 INFO:tasks.workunit.client.0.smithi039.stdout:write ret = 32 2024-09-12T02:47:26.431 INFO:tasks.workunit.client.0.smithi039.stdout:pread ret = 64 2024-09-12T02:47:26.431 INFO:tasks.workunit.client.0.smithi039.stdout:475/600: open fd = 3 2024-09-12T02:47:26.431 INFO:tasks.workunit.client.0.smithi039.stdout:write ret = 32 2024-09-12T02:47:26.431 INFO:tasks.workunit.client.0.smithi039.stdout:write ret = 32 2024-09-12T02:47:26.432 INFO:tasks.workunit.client.0.smithi039.stdout:pread ret = 64 2024-09-12T02:47:26.432 INFO:tasks.workunit.client.0.smithi039.stdout:476/600: open fd = 3 2024-09-12T02:47:26.432 INFO:tasks.workunit.client.0.smithi039.stdout:write ret = 32 2024-09-12T02:47:26.432 INFO:tasks.workunit.client.0.smithi039.stdout:write ret = 32 2024-09-12T02:47:26.432 INFO:tasks.workunit.client.0.smithi039.stdout:pread ret = 64 2024-09-12T02:47:26.432 INFO:tasks.workunit.client.0.smithi039.stdout:477/600: open fd = 3 2024-09-12T02:47:26.432 INFO:tasks.workunit.client.0.smithi039.stdout:write ret = 32 2024-09-12T02:47:26.432 INFO:tasks.workunit.client.0.smithi039.stdout:write ret = 32 2024-09-12T02:47:26.432 INFO:tasks.workunit.client.0.smithi039.stdout:pread ret = 64 2024-09-12T02:47:26.432 INFO:tasks.workunit.client.0.smithi039.stdout:478/600: open fd = 3 2024-09-12T02:47:26.432 INFO:tasks.workunit.client.0.smithi039.stdout:write ret = 32 2024-09-12T02:47:26.432 INFO:tasks.workunit.client.0.smithi039.stdout:write ret = 32 2024-09-12T02:47:26.432 INFO:tasks.workunit.client.0.smithi039.stdout:pread ret = 64 2024-09-12T02:47:26.433 INFO:tasks.workunit.client.0.smithi039.stdout:479/600: open fd = 3 2024-09-12T02:47:26.433 INFO:tasks.workunit.client.0.smithi039.stdout:write ret = 32 2024-09-12T02:47:26.433 INFO:tasks.workunit.client.0.smithi039.stdout:write ret = 32 2024-09-12T02:47:26.433 INFO:tasks.workunit.client.0.smithi039.stdout:pread ret = 64 2024-09-12T02:47:26.433 INFO:tasks.workunit.client.0.smithi039.stdout:480/600: open fd = 3 2024-09-12T02:47:26.433 INFO:tasks.workunit.client.0.smithi039.stdout:write ret = 32 2024-09-12T02:47:26.433 INFO:tasks.workunit.client.0.smithi039.stdout:write ret = 32 2024-09-12T02:47:26.433 INFO:tasks.workunit.client.0.smithi039.stdout:pread ret = 64 2024-09-12T02:47:26.433 INFO:tasks.workunit.client.0.smithi039.stdout:481/600: open fd = 3 2024-09-12T02:47:26.433 INFO:tasks.workunit.client.0.smithi039.stdout:write ret = 32 2024-09-12T02:47:26.433 INFO:tasks.workunit.client.0.smithi039.stdout:write ret = 32 2024-09-12T02:47:26.433 INFO:tasks.workunit.client.0.smithi039.stdout:pread ret = 64 2024-09-12T02:47:26.433 INFO:tasks.workunit.client.0.smithi039.stdout:482/600: open fd = 3 2024-09-12T02:47:26.434 INFO:tasks.workunit.client.0.smithi039.stdout:write ret = 32 2024-09-12T02:47:26.434 INFO:tasks.workunit.client.0.smithi039.stdout:write ret = 32 2024-09-12T02:47:26.434 INFO:tasks.workunit.client.0.smithi039.stdout:pread ret = 64 2024-09-12T02:47:26.434 INFO:tasks.workunit.client.0.smithi039.stdout:483/600: open fd = 3 2024-09-12T02:47:26.434 INFO:tasks.workunit.client.0.smithi039.stdout:write ret = 32 2024-09-12T02:47:26.434 INFO:tasks.workunit.client.0.smithi039.stdout:write ret = 32 2024-09-12T02:47:26.434 INFO:tasks.workunit.client.0.smithi039.stdout:pread ret = 64 2024-09-12T02:47:26.434 INFO:tasks.workunit.client.0.smithi039.stdout:484/600: open fd = 3 2024-09-12T02:47:26.434 INFO:tasks.workunit.client.0.smithi039.stdout:write ret = 32 2024-09-12T02:47:26.434 INFO:tasks.workunit.client.0.smithi039.stdout:write ret = 32 2024-09-12T02:47:26.434 INFO:tasks.workunit.client.0.smithi039.stdout:pread ret = 64 2024-09-12T02:47:26.434 INFO:tasks.workunit.client.0.smithi039.stdout:485/600: open fd = 3 2024-09-12T02:47:26.434 INFO:tasks.workunit.client.0.smithi039.stdout:write ret = 32 2024-09-12T02:47:26.435 INFO:tasks.workunit.client.0.smithi039.stdout:write ret = 32 2024-09-12T02:47:26.435 INFO:tasks.workunit.client.0.smithi039.stdout:pread ret = 64 2024-09-12T02:47:26.435 INFO:tasks.workunit.client.0.smithi039.stdout:486/600: open fd = 3 2024-09-12T02:47:26.435 INFO:tasks.workunit.client.0.smithi039.stdout:write ret = 32 2024-09-12T02:47:26.435 INFO:tasks.workunit.client.0.smithi039.stdout:write ret = 32 2024-09-12T02:47:26.435 INFO:tasks.workunit.client.0.smithi039.stdout:pread ret = 64 2024-09-12T02:47:26.435 INFO:tasks.workunit.client.0.smithi039.stdout:487/600: open fd = 3 2024-09-12T02:47:26.435 INFO:tasks.workunit.client.0.smithi039.stdout:write ret = 32 2024-09-12T02:47:26.435 INFO:tasks.workunit.client.0.smithi039.stdout:write ret = 32 2024-09-12T02:47:26.435 INFO:tasks.workunit.client.0.smithi039.stdout:pread ret = 64 2024-09-12T02:47:26.435 INFO:tasks.workunit.client.0.smithi039.stdout:488/600: open fd = 3 2024-09-12T02:47:26.435 INFO:tasks.workunit.client.0.smithi039.stdout:write ret = 32 2024-09-12T02:47:26.435 INFO:tasks.workunit.client.0.smithi039.stdout:write ret = 32 2024-09-12T02:47:26.436 INFO:tasks.workunit.client.0.smithi039.stdout:pread ret = 64 2024-09-12T02:47:26.436 INFO:tasks.workunit.client.0.smithi039.stdout:489/600: open fd = 3 2024-09-12T02:47:26.436 INFO:tasks.workunit.client.0.smithi039.stdout:write ret = 32 2024-09-12T02:47:26.436 INFO:tasks.workunit.client.0.smithi039.stdout:write ret = 32 2024-09-12T02:47:26.436 INFO:tasks.workunit.client.0.smithi039.stdout:pread ret = 64 2024-09-12T02:47:26.436 INFO:tasks.workunit.client.0.smithi039.stdout:490/600: open fd = 3 2024-09-12T02:47:26.436 INFO:tasks.workunit.client.0.smithi039.stdout:write ret = 32 2024-09-12T02:47:26.436 INFO:tasks.workunit.client.0.smithi039.stdout:write ret = 32 2024-09-12T02:47:26.436 INFO:tasks.workunit.client.0.smithi039.stdout:pread ret = 64 2024-09-12T02:47:26.436 INFO:tasks.workunit.client.0.smithi039.stdout:491/600: open fd = 3 2024-09-12T02:47:26.436 INFO:tasks.workunit.client.0.smithi039.stdout:write ret = 32 2024-09-12T02:47:26.436 INFO:tasks.workunit.client.0.smithi039.stdout:write ret = 32 2024-09-12T02:47:26.436 INFO:tasks.workunit.client.0.smithi039.stdout:pread ret = 64 2024-09-12T02:47:26.437 INFO:tasks.workunit.client.0.smithi039.stdout:492/600: open fd = 3 2024-09-12T02:47:26.437 INFO:tasks.workunit.client.0.smithi039.stdout:write ret = 32 2024-09-12T02:47:26.437 INFO:tasks.workunit.client.0.smithi039.stdout:write ret = 32 2024-09-12T02:47:26.437 INFO:tasks.workunit.client.0.smithi039.stdout:pread ret = 64 2024-09-12T02:47:26.437 INFO:tasks.workunit.client.0.smithi039.stdout:493/600: open fd = 3 2024-09-12T02:47:26.437 INFO:tasks.workunit.client.0.smithi039.stdout:write ret = 32 2024-09-12T02:47:26.437 INFO:tasks.workunit.client.0.smithi039.stdout:write ret = 32 2024-09-12T02:47:26.437 INFO:tasks.workunit.client.0.smithi039.stdout:pread ret = 64 2024-09-12T02:47:26.437 INFO:tasks.workunit.client.0.smithi039.stdout:494/600: open fd = 3 2024-09-12T02:47:26.437 INFO:tasks.workunit.client.0.smithi039.stdout:write ret = 32 2024-09-12T02:47:26.437 INFO:tasks.workunit.client.0.smithi039.stdout:write ret = 32 2024-09-12T02:47:26.437 INFO:tasks.workunit.client.0.smithi039.stdout:pread ret = 64 2024-09-12T02:47:26.437 INFO:tasks.workunit.client.0.smithi039.stdout:495/600: open fd = 3 2024-09-12T02:47:26.437 INFO:tasks.workunit.client.0.smithi039.stdout:write ret = 32 2024-09-12T02:47:26.438 INFO:tasks.workunit.client.0.smithi039.stdout:write ret = 32 2024-09-12T02:47:26.438 INFO:tasks.workunit.client.0.smithi039.stdout:pread ret = 64 2024-09-12T02:47:26.438 INFO:tasks.workunit.client.0.smithi039.stdout:496/600: open fd = 3 2024-09-12T02:47:26.438 INFO:tasks.workunit.client.0.smithi039.stdout:write ret = 32 2024-09-12T02:47:26.438 INFO:tasks.workunit.client.0.smithi039.stdout:write ret = 32 2024-09-12T02:47:26.438 INFO:tasks.workunit.client.0.smithi039.stdout:pread ret = 64 2024-09-12T02:47:26.438 INFO:tasks.workunit.client.0.smithi039.stdout:497/600: open fd = 3 2024-09-12T02:47:26.438 INFO:tasks.workunit.client.0.smithi039.stdout:write ret = 32 2024-09-12T02:47:26.438 INFO:tasks.workunit.client.0.smithi039.stdout:write ret = 32 2024-09-12T02:47:26.439 INFO:tasks.workunit.client.0.smithi039.stdout:pread ret = 64 2024-09-12T02:47:26.439 INFO:tasks.workunit.client.0.smithi039.stdout:498/600: open fd = 3 2024-09-12T02:47:26.439 INFO:tasks.workunit.client.0.smithi039.stdout:write ret = 32 2024-09-12T02:47:26.439 INFO:tasks.workunit.client.0.smithi039.stdout:write ret = 32 2024-09-12T02:47:26.439 INFO:tasks.workunit.client.0.smithi039.stdout:pread ret = 64 2024-09-12T02:47:27.448 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 12 02:47:27 smithi044 ceph-mon[35411]: pgmap v296: 129 pgs: 129 active+clean; 18 MiB data, 451 MiB used, 1.0 TiB / 1.0 TiB avail; 49 KiB/s rd, 46 KiB/s wr, 13 op/s 2024-09-12T02:47:27.513 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 12 02:47:27 smithi172 ceph-mon[35609]: pgmap v296: 129 pgs: 129 active+clean; 18 MiB data, 451 MiB used, 1.0 TiB / 1.0 TiB avail; 49 KiB/s rd, 46 KiB/s wr, 13 op/s 2024-09-12T02:47:27.599 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 02:47:27 smithi039 ceph-mon[30515]: pgmap v296: 129 pgs: 129 active+clean; 18 MiB data, 451 MiB used, 1.0 TiB / 1.0 TiB avail; 49 KiB/s rd, 46 KiB/s wr, 13 op/s 2024-09-12T02:47:29.448 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 12 02:47:29 smithi044 ceph-mon[35411]: pgmap v297: 129 pgs: 129 active+clean; 18 MiB data, 452 MiB used, 1.0 TiB / 1.0 TiB avail; 74 KiB/s rd, 69 KiB/s wr, 19 op/s 2024-09-12T02:47:29.513 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 12 02:47:29 smithi172 ceph-mon[35609]: pgmap v297: 129 pgs: 129 active+clean; 18 MiB data, 452 MiB used, 1.0 TiB / 1.0 TiB avail; 74 KiB/s rd, 69 KiB/s wr, 19 op/s 2024-09-12T02:47:29.599 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 02:47:29 smithi039 ceph-mon[30515]: pgmap v297: 129 pgs: 129 active+clean; 18 MiB data, 452 MiB used, 1.0 TiB / 1.0 TiB avail; 74 KiB/s rd, 69 KiB/s wr, 19 op/s 2024-09-12T02:47:31.448 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 12 02:47:31 smithi044 ceph-mon[35411]: pgmap v298: 129 pgs: 129 active+clean; 18 MiB data, 452 MiB used, 1.0 TiB / 1.0 TiB avail; 49 KiB/s rd, 46 KiB/s wr, 13 op/s 2024-09-12T02:47:31.513 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 12 02:47:31 smithi172 ceph-mon[35609]: pgmap v298: 129 pgs: 129 active+clean; 18 MiB data, 452 MiB used, 1.0 TiB / 1.0 TiB avail; 49 KiB/s rd, 46 KiB/s wr, 13 op/s 2024-09-12T02:47:31.600 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 02:47:31 smithi039 ceph-mon[30515]: pgmap v298: 129 pgs: 129 active+clean; 18 MiB data, 452 MiB used, 1.0 TiB / 1.0 TiB avail; 49 KiB/s rd, 46 KiB/s wr, 13 op/s 2024-09-12T02:47:33.449 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 12 02:47:33 smithi044 ceph-mon[35411]: pgmap v299: 129 pgs: 129 active+clean; 19 MiB data, 452 MiB used, 1.0 TiB / 1.0 TiB avail; 72 KiB/s rd, 68 KiB/s wr, 19 op/s 2024-09-12T02:47:33.514 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 12 02:47:33 smithi172 ceph-mon[35609]: pgmap v299: 129 pgs: 129 active+clean; 19 MiB data, 452 MiB used, 1.0 TiB / 1.0 TiB avail; 72 KiB/s rd, 68 KiB/s wr, 19 op/s 2024-09-12T02:47:33.599 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 02:47:33 smithi039 ceph-mon[30515]: pgmap v299: 129 pgs: 129 active+clean; 19 MiB data, 452 MiB used, 1.0 TiB / 1.0 TiB avail; 72 KiB/s rd, 68 KiB/s wr, 19 op/s 2024-09-12T02:47:35.513 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 12 02:47:35 smithi172 ceph-mon[35609]: pgmap v300: 129 pgs: 129 active+clean; 19 MiB data, 452 MiB used, 1.0 TiB / 1.0 TiB avail; 49 KiB/s rd, 46 KiB/s wr, 12 op/s 2024-09-12T02:47:35.600 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 02:47:35 smithi039 ceph-mon[30515]: pgmap v300: 129 pgs: 129 active+clean; 19 MiB data, 452 MiB used, 1.0 TiB / 1.0 TiB avail; 49 KiB/s rd, 46 KiB/s wr, 12 op/s 2024-09-12T02:47:35.698 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 12 02:47:35 smithi044 ceph-mon[35411]: pgmap v300: 129 pgs: 129 active+clean; 19 MiB data, 452 MiB used, 1.0 TiB / 1.0 TiB avail; 49 KiB/s rd, 46 KiB/s wr, 12 op/s 2024-09-12T02:47:37.513 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 12 02:47:37 smithi172 ceph-mon[35609]: pgmap v301: 129 pgs: 129 active+clean; 19 MiB data, 452 MiB used, 1.0 TiB / 1.0 TiB avail; 49 KiB/s rd, 46 KiB/s wr, 12 op/s 2024-09-12T02:47:37.600 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 02:47:37 smithi039 ceph-mon[30515]: pgmap v301: 129 pgs: 129 active+clean; 19 MiB data, 452 MiB used, 1.0 TiB / 1.0 TiB avail; 49 KiB/s rd, 46 KiB/s wr, 12 op/s 2024-09-12T02:47:37.698 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 12 02:47:37 smithi044 ceph-mon[35411]: pgmap v301: 129 pgs: 129 active+clean; 19 MiB data, 452 MiB used, 1.0 TiB / 1.0 TiB avail; 49 KiB/s rd, 46 KiB/s wr, 12 op/s 2024-09-12T02:47:39.514 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 12 02:47:39 smithi172 ceph-mon[35609]: pgmap v302: 129 pgs: 129 active+clean; 19 MiB data, 453 MiB used, 1.0 TiB / 1.0 TiB avail; 73 KiB/s rd, 68 KiB/s wr, 19 op/s 2024-09-12T02:47:39.600 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 02:47:39 smithi039 ceph-mon[30515]: pgmap v302: 129 pgs: 129 active+clean; 19 MiB data, 453 MiB used, 1.0 TiB / 1.0 TiB avail; 73 KiB/s rd, 68 KiB/s wr, 19 op/s 2024-09-12T02:47:39.698 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 12 02:47:39 smithi044 ceph-mon[35411]: pgmap v302: 129 pgs: 129 active+clean; 19 MiB data, 453 MiB used, 1.0 TiB / 1.0 TiB avail; 73 KiB/s rd, 68 KiB/s wr, 19 op/s 2024-09-12T02:47:41.513 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 12 02:47:41 smithi172 ceph-mon[35609]: pgmap v303: 129 pgs: 129 active+clean; 19 MiB data, 453 MiB used, 1.0 TiB / 1.0 TiB avail; 48 KiB/s rd, 45 KiB/s wr, 12 op/s 2024-09-12T02:47:41.599 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 02:47:41 smithi039 ceph-mon[30515]: pgmap v303: 129 pgs: 129 active+clean; 19 MiB data, 453 MiB used, 1.0 TiB / 1.0 TiB avail; 48 KiB/s rd, 45 KiB/s wr, 12 op/s 2024-09-12T02:47:41.698 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 12 02:47:41 smithi044 ceph-mon[35411]: pgmap v303: 129 pgs: 129 active+clean; 19 MiB data, 453 MiB used, 1.0 TiB / 1.0 TiB avail; 48 KiB/s rd, 45 KiB/s wr, 12 op/s 2024-09-12T02:47:43.514 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 12 02:47:43 smithi172 ceph-mon[35609]: pgmap v304: 129 pgs: 129 active+clean; 19 MiB data, 454 MiB used, 1.0 TiB / 1.0 TiB avail; 71 KiB/s rd, 67 KiB/s wr, 19 op/s 2024-09-12T02:47:43.599 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 02:47:43 smithi039 ceph-mon[30515]: pgmap v304: 129 pgs: 129 active+clean; 19 MiB data, 454 MiB used, 1.0 TiB / 1.0 TiB avail; 71 KiB/s rd, 67 KiB/s wr, 19 op/s 2024-09-12T02:47:43.698 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 12 02:47:43 smithi044 ceph-mon[35411]: pgmap v304: 129 pgs: 129 active+clean; 19 MiB data, 454 MiB used, 1.0 TiB / 1.0 TiB avail; 71 KiB/s rd, 67 KiB/s wr, 19 op/s 2024-09-12T02:47:45.514 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 12 02:47:45 smithi172 ceph-mon[35609]: pgmap v305: 129 pgs: 129 active+clean; 19 MiB data, 454 MiB used, 1.0 TiB / 1.0 TiB avail; 47 KiB/s rd, 44 KiB/s wr, 12 op/s 2024-09-12T02:47:45.599 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 02:47:45 smithi039 ceph-mon[30515]: pgmap v305: 129 pgs: 129 active+clean; 19 MiB data, 454 MiB used, 1.0 TiB / 1.0 TiB avail; 47 KiB/s rd, 44 KiB/s wr, 12 op/s 2024-09-12T02:47:45.698 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 12 02:47:45 smithi044 ceph-mon[35411]: pgmap v305: 129 pgs: 129 active+clean; 19 MiB data, 454 MiB used, 1.0 TiB / 1.0 TiB avail; 47 KiB/s rd, 44 KiB/s wr, 12 op/s 2024-09-12T02:47:47.514 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 12 02:47:47 smithi172 ceph-mon[35609]: pgmap v306: 129 pgs: 129 active+clean; 19 MiB data, 454 MiB used, 1.0 TiB / 1.0 TiB avail; 47 KiB/s rd, 44 KiB/s wr, 12 op/s 2024-09-12T02:47:47.599 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 02:47:47 smithi039 ceph-mon[30515]: pgmap v306: 129 pgs: 129 active+clean; 19 MiB data, 454 MiB used, 1.0 TiB / 1.0 TiB avail; 47 KiB/s rd, 44 KiB/s wr, 12 op/s 2024-09-12T02:47:47.698 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 12 02:47:47 smithi044 ceph-mon[35411]: pgmap v306: 129 pgs: 129 active+clean; 19 MiB data, 454 MiB used, 1.0 TiB / 1.0 TiB avail; 47 KiB/s rd, 44 KiB/s wr, 12 op/s 2024-09-12T02:47:49.513 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 12 02:47:49 smithi172 ceph-mon[35609]: pgmap v307: 129 pgs: 129 active+clean; 19 MiB data, 455 MiB used, 1.0 TiB / 1.0 TiB avail; 73 KiB/s rd, 69 KiB/s wr, 19 op/s 2024-09-12T02:47:49.600 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 02:47:49 smithi039 ceph-mon[30515]: pgmap v307: 129 pgs: 129 active+clean; 19 MiB data, 455 MiB used, 1.0 TiB / 1.0 TiB avail; 73 KiB/s rd, 69 KiB/s wr, 19 op/s 2024-09-12T02:47:49.698 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 12 02:47:49 smithi044 ceph-mon[35411]: pgmap v307: 129 pgs: 129 active+clean; 19 MiB data, 455 MiB used, 1.0 TiB / 1.0 TiB avail; 73 KiB/s rd, 69 KiB/s wr, 19 op/s 2024-09-12T02:47:51.513 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 12 02:47:51 smithi172 ceph-mon[35609]: pgmap v308: 129 pgs: 129 active+clean; 19 MiB data, 455 MiB used, 1.0 TiB / 1.0 TiB avail; 50 KiB/s rd, 46 KiB/s wr, 12 op/s 2024-09-12T02:47:51.600 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 02:47:51 smithi039 ceph-mon[30515]: pgmap v308: 129 pgs: 129 active+clean; 19 MiB data, 455 MiB used, 1.0 TiB / 1.0 TiB avail; 50 KiB/s rd, 46 KiB/s wr, 12 op/s 2024-09-12T02:47:51.698 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 12 02:47:51 smithi044 ceph-mon[35411]: pgmap v308: 129 pgs: 129 active+clean; 19 MiB data, 455 MiB used, 1.0 TiB / 1.0 TiB avail; 50 KiB/s rd, 46 KiB/s wr, 12 op/s 2024-09-12T02:47:53.513 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 12 02:47:53 smithi172 ceph-mon[35609]: pgmap v309: 129 pgs: 129 active+clean; 20 MiB data, 455 MiB used, 1.0 TiB / 1.0 TiB avail; 73 KiB/s rd, 68 KiB/s wr, 19 op/s 2024-09-12T02:47:53.600 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 02:47:53 smithi039 ceph-mon[30515]: pgmap v309: 129 pgs: 129 active+clean; 20 MiB data, 455 MiB used, 1.0 TiB / 1.0 TiB avail; 73 KiB/s rd, 68 KiB/s wr, 19 op/s 2024-09-12T02:47:53.698 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 12 02:47:53 smithi044 ceph-mon[35411]: pgmap v309: 129 pgs: 129 active+clean; 20 MiB data, 455 MiB used, 1.0 TiB / 1.0 TiB avail; 73 KiB/s rd, 68 KiB/s wr, 19 op/s 2024-09-12T02:47:55.513 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 12 02:47:55 smithi172 ceph-mon[35609]: pgmap v310: 129 pgs: 129 active+clean; 20 MiB data, 455 MiB used, 1.0 TiB / 1.0 TiB avail; 50 KiB/s rd, 47 KiB/s wr, 12 op/s 2024-09-12T02:47:55.599 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 02:47:55 smithi039 ceph-mon[30515]: pgmap v310: 129 pgs: 129 active+clean; 20 MiB data, 455 MiB used, 1.0 TiB / 1.0 TiB avail; 50 KiB/s rd, 47 KiB/s wr, 12 op/s 2024-09-12T02:47:55.698 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 12 02:47:55 smithi044 ceph-mon[35411]: pgmap v310: 129 pgs: 129 active+clean; 20 MiB data, 455 MiB used, 1.0 TiB / 1.0 TiB avail; 50 KiB/s rd, 47 KiB/s wr, 12 op/s 2024-09-12T02:47:57.513 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 12 02:47:57 smithi172 ceph-mon[35609]: pgmap v311: 129 pgs: 129 active+clean; 20 MiB data, 455 MiB used, 1.0 TiB / 1.0 TiB avail; 50 KiB/s rd, 47 KiB/s wr, 12 op/s 2024-09-12T02:47:57.599 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 02:47:57 smithi039 ceph-mon[30515]: pgmap v311: 129 pgs: 129 active+clean; 20 MiB data, 455 MiB used, 1.0 TiB / 1.0 TiB avail; 50 KiB/s rd, 47 KiB/s wr, 12 op/s 2024-09-12T02:47:57.698 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 12 02:47:57 smithi044 ceph-mon[35411]: pgmap v311: 129 pgs: 129 active+clean; 20 MiB data, 455 MiB used, 1.0 TiB / 1.0 TiB avail; 50 KiB/s rd, 47 KiB/s wr, 12 op/s 2024-09-12T02:47:59.513 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 12 02:47:59 smithi172 ceph-mon[35609]: pgmap v312: 129 pgs: 129 active+clean; 20 MiB data, 456 MiB used, 1.0 TiB / 1.0 TiB avail; 74 KiB/s rd, 69 KiB/s wr, 19 op/s 2024-09-12T02:47:59.600 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 02:47:59 smithi039 ceph-mon[30515]: pgmap v312: 129 pgs: 129 active+clean; 20 MiB data, 456 MiB used, 1.0 TiB / 1.0 TiB avail; 74 KiB/s rd, 69 KiB/s wr, 19 op/s 2024-09-12T02:47:59.698 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 12 02:47:59 smithi044 ceph-mon[35411]: pgmap v312: 129 pgs: 129 active+clean; 20 MiB data, 456 MiB used, 1.0 TiB / 1.0 TiB avail; 74 KiB/s rd, 69 KiB/s wr, 19 op/s 2024-09-12T02:48:01.513 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 12 02:48:01 smithi172 ceph-mon[35609]: pgmap v313: 129 pgs: 129 active+clean; 20 MiB data, 456 MiB used, 1.0 TiB / 1.0 TiB avail; 48 KiB/s rd, 45 KiB/s wr, 12 op/s 2024-09-12T02:48:01.599 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 02:48:01 smithi039 ceph-mon[30515]: pgmap v313: 129 pgs: 129 active+clean; 20 MiB data, 456 MiB used, 1.0 TiB / 1.0 TiB avail; 48 KiB/s rd, 45 KiB/s wr, 12 op/s 2024-09-12T02:48:01.698 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 12 02:48:01 smithi044 ceph-mon[35411]: pgmap v313: 129 pgs: 129 active+clean; 20 MiB data, 456 MiB used, 1.0 TiB / 1.0 TiB avail; 48 KiB/s rd, 45 KiB/s wr, 12 op/s 2024-09-12T02:48:03.600 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 02:48:03 smithi039 ceph-mon[30515]: pgmap v314: 129 pgs: 129 active+clean; 20 MiB data, 461 MiB used, 1.0 TiB / 1.0 TiB avail; 83 KiB/s rd, 113 KiB/s wr, 36 op/s 2024-09-12T02:48:03.600 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 02:48:03 smithi039 ceph-mon[30515]: osdmap e105: 12 total, 12 up, 12 in 2024-09-12T02:48:03.698 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 12 02:48:03 smithi044 ceph-mon[35411]: pgmap v314: 129 pgs: 129 active+clean; 20 MiB data, 461 MiB used, 1.0 TiB / 1.0 TiB avail; 83 KiB/s rd, 113 KiB/s wr, 36 op/s 2024-09-12T02:48:03.698 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 12 02:48:03 smithi044 ceph-mon[35411]: osdmap e105: 12 total, 12 up, 12 in 2024-09-12T02:48:03.763 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 12 02:48:03 smithi172 ceph-mon[35609]: pgmap v314: 129 pgs: 129 active+clean; 20 MiB data, 461 MiB used, 1.0 TiB / 1.0 TiB avail; 83 KiB/s rd, 113 KiB/s wr, 36 op/s 2024-09-12T02:48:03.764 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 12 02:48:03 smithi172 ceph-mon[35609]: osdmap e105: 12 total, 12 up, 12 in 2024-09-12T02:48:05.599 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 02:48:05 smithi039 ceph-mon[30515]: pgmap v316: 129 pgs: 129 active+clean; 20 MiB data, 461 MiB used, 1.0 TiB / 1.0 TiB avail; 71 KiB/s rd, 109 KiB/s wr, 35 op/s 2024-09-12T02:48:05.698 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 12 02:48:05 smithi044 ceph-mon[35411]: pgmap v316: 129 pgs: 129 active+clean; 20 MiB data, 461 MiB used, 1.0 TiB / 1.0 TiB avail; 71 KiB/s rd, 109 KiB/s wr, 35 op/s 2024-09-12T02:48:05.763 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 12 02:48:05 smithi172 ceph-mon[35609]: pgmap v316: 129 pgs: 129 active+clean; 20 MiB data, 461 MiB used, 1.0 TiB / 1.0 TiB avail; 71 KiB/s rd, 109 KiB/s wr, 35 op/s 2024-09-12T02:48:07.600 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 02:48:07 smithi039 ceph-mon[30515]: pgmap v317: 129 pgs: 129 active+clean; 20 MiB data, 461 MiB used, 1.0 TiB / 1.0 TiB avail; 71 KiB/s rd, 109 KiB/s wr, 35 op/s 2024-09-12T02:48:07.698 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 12 02:48:07 smithi044 ceph-mon[35411]: pgmap v317: 129 pgs: 129 active+clean; 20 MiB data, 461 MiB used, 1.0 TiB / 1.0 TiB avail; 71 KiB/s rd, 109 KiB/s wr, 35 op/s 2024-09-12T02:48:07.763 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 12 02:48:07 smithi172 ceph-mon[35609]: pgmap v317: 129 pgs: 129 active+clean; 20 MiB data, 461 MiB used, 1.0 TiB / 1.0 TiB avail; 71 KiB/s rd, 109 KiB/s wr, 35 op/s 2024-09-12T02:48:09.600 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 02:48:09 smithi039 ceph-mon[30515]: pgmap v318: 129 pgs: 129 active+clean; 21 MiB data, 462 MiB used, 1.0 TiB / 1.0 TiB avail; 71 KiB/s rd, 113 KiB/s wr, 36 op/s 2024-09-12T02:48:09.698 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 12 02:48:09 smithi044 ceph-mon[35411]: pgmap v318: 129 pgs: 129 active+clean; 21 MiB data, 462 MiB used, 1.0 TiB / 1.0 TiB avail; 71 KiB/s rd, 113 KiB/s wr, 36 op/s 2024-09-12T02:48:09.763 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 12 02:48:09 smithi172 ceph-mon[35609]: pgmap v318: 129 pgs: 129 active+clean; 21 MiB data, 462 MiB used, 1.0 TiB / 1.0 TiB avail; 71 KiB/s rd, 113 KiB/s wr, 36 op/s 2024-09-12T02:48:11.599 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 02:48:11 smithi039 ceph-mon[30515]: pgmap v319: 129 pgs: 129 active+clean; 21 MiB data, 462 MiB used, 1.0 TiB / 1.0 TiB avail; 71 KiB/s rd, 113 KiB/s wr, 36 op/s 2024-09-12T02:48:11.600 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 02:48:11 smithi039 ceph-mon[30515]: from='mgr.25199 172.21.15.39:0/1270637502' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-12T02:48:11.603 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 12 02:48:11 smithi044 ceph-mon[35411]: pgmap v319: 129 pgs: 129 active+clean; 21 MiB data, 462 MiB used, 1.0 TiB / 1.0 TiB avail; 71 KiB/s rd, 113 KiB/s wr, 36 op/s 2024-09-12T02:48:11.603 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 12 02:48:11 smithi044 ceph-mon[35411]: from='mgr.25199 172.21.15.39:0/1270637502' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-12T02:48:11.763 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 12 02:48:11 smithi172 ceph-mon[35609]: pgmap v319: 129 pgs: 129 active+clean; 21 MiB data, 462 MiB used, 1.0 TiB / 1.0 TiB avail; 71 KiB/s rd, 113 KiB/s wr, 36 op/s 2024-09-12T02:48:11.763 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 12 02:48:11 smithi172 ceph-mon[35609]: from='mgr.25199 172.21.15.39:0/1270637502' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-12T02:48:12.437 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 12 02:48:12 smithi172 ceph-mon[35609]: from='mgr.25199 172.21.15.39:0/1270637502' entity='mgr.x' 2024-09-12T02:48:12.437 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 12 02:48:12 smithi172 ceph-mon[35609]: from='mgr.25199 172.21.15.39:0/1270637502' entity='mgr.x' 2024-09-12T02:48:12.437 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 12 02:48:12 smithi172 ceph-mon[35609]: osdmap e106: 12 total, 12 up, 12 in 2024-09-12T02:48:12.600 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 02:48:12 smithi039 ceph-mon[30515]: from='mgr.25199 172.21.15.39:0/1270637502' entity='mgr.x' 2024-09-12T02:48:12.600 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 02:48:12 smithi039 ceph-mon[30515]: from='mgr.25199 172.21.15.39:0/1270637502' entity='mgr.x' 2024-09-12T02:48:12.600 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 02:48:12 smithi039 ceph-mon[30515]: osdmap e106: 12 total, 12 up, 12 in 2024-09-12T02:48:12.698 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 12 02:48:12 smithi044 ceph-mon[35411]: from='mgr.25199 172.21.15.39:0/1270637502' entity='mgr.x' 2024-09-12T02:48:12.698 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 12 02:48:12 smithi044 ceph-mon[35411]: from='mgr.25199 172.21.15.39:0/1270637502' entity='mgr.x' 2024-09-12T02:48:12.698 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 12 02:48:12 smithi044 ceph-mon[35411]: osdmap e106: 12 total, 12 up, 12 in 2024-09-12T02:48:13.764 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 12 02:48:13 smithi172 ceph-mon[35609]: pgmap v320: 129 pgs: 129 active+clean; 21 MiB data, 463 MiB used, 1.0 TiB / 1.0 TiB avail; 58 KiB/s rd, 59 KiB/s wr, 15 op/s 2024-09-12T02:48:13.791 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 12 02:48:13 smithi172 ceph-mon[35609]: from='mgr.25199 172.21.15.39:0/1270637502' entity='mgr.x' 2024-09-12T02:48:13.791 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 12 02:48:13 smithi172 ceph-mon[35609]: from='mgr.25199 172.21.15.39:0/1270637502' entity='mgr.x' 2024-09-12T02:48:13.791 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 12 02:48:13 smithi172 ceph-mon[35609]: from='mgr.25199 172.21.15.39:0/1270637502' entity='mgr.x' 2024-09-12T02:48:13.791 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 12 02:48:13 smithi172 ceph-mon[35609]: from='mgr.25199 172.21.15.39:0/1270637502' entity='mgr.x' 2024-09-12T02:48:13.791 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 12 02:48:13 smithi172 ceph-mon[35609]: from='mgr.25199 172.21.15.39:0/1270637502' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2024-09-12T02:48:13.791 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 12 02:48:13 smithi172 ceph-mon[35609]: from='mgr.25199 172.21.15.39:0/1270637502' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2024-09-12T02:48:13.792 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 12 02:48:13 smithi172 ceph-mon[35609]: from='mgr.25199 172.21.15.39:0/1270637502' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"}]: dispatch 2024-09-12T02:48:13.792 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 12 02:48:13 smithi172 ceph-mon[35609]: from='mgr.25199 172.21.15.39:0/1270637502' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.10", "name": "osd_memory_target"}]: dispatch 2024-09-12T02:48:13.792 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 12 02:48:13 smithi172 ceph-mon[35609]: Adjusting osd_memory_target on smithi044 to 177.0M 2024-09-12T02:48:13.792 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 12 02:48:13 smithi172 ceph-mon[35609]: Unable to set osd_memory_target on smithi044 to 185700659: error parsing value: Value '185700659' is below minimum 939524096 2024-09-12T02:48:13.792 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 12 02:48:13 smithi172 ceph-mon[35609]: from='mgr.25199 172.21.15.39:0/1270637502' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2024-09-12T02:48:13.792 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 12 02:48:13 smithi172 ceph-mon[35609]: from='mgr.25199 172.21.15.39:0/1270637502' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2024-09-12T02:48:13.792 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 12 02:48:13 smithi172 ceph-mon[35609]: from='mgr.25199 172.21.15.39:0/1270637502' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.8", "name": "osd_memory_target"}]: dispatch 2024-09-12T02:48:13.792 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 12 02:48:13 smithi172 ceph-mon[35609]: from='mgr.25199 172.21.15.39:0/1270637502' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.11", "name": "osd_memory_target"}]: dispatch 2024-09-12T02:48:13.850 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 02:48:13 smithi039 ceph-mon[30515]: pgmap v320: 129 pgs: 129 active+clean; 21 MiB data, 463 MiB used, 1.0 TiB / 1.0 TiB avail; 58 KiB/s rd, 59 KiB/s wr, 15 op/s 2024-09-12T02:48:13.850 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 02:48:13 smithi039 ceph-mon[30515]: from='mgr.25199 172.21.15.39:0/1270637502' entity='mgr.x' 2024-09-12T02:48:13.850 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 02:48:13 smithi039 ceph-mon[30515]: from='mgr.25199 172.21.15.39:0/1270637502' entity='mgr.x' 2024-09-12T02:48:13.850 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 02:48:13 smithi039 ceph-mon[30515]: from='mgr.25199 172.21.15.39:0/1270637502' entity='mgr.x' 2024-09-12T02:48:13.850 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 02:48:13 smithi039 ceph-mon[30515]: from='mgr.25199 172.21.15.39:0/1270637502' entity='mgr.x' 2024-09-12T02:48:13.851 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 02:48:13 smithi039 ceph-mon[30515]: from='mgr.25199 172.21.15.39:0/1270637502' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2024-09-12T02:48:13.851 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 02:48:13 smithi039 ceph-mon[30515]: from='mgr.25199 172.21.15.39:0/1270637502' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2024-09-12T02:48:13.851 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 02:48:13 smithi039 ceph-mon[30515]: from='mgr.25199 172.21.15.39:0/1270637502' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"}]: dispatch 2024-09-12T02:48:13.851 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 02:48:13 smithi039 ceph-mon[30515]: from='mgr.25199 172.21.15.39:0/1270637502' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.10", "name": "osd_memory_target"}]: dispatch 2024-09-12T02:48:13.851 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 02:48:13 smithi039 ceph-mon[30515]: Adjusting osd_memory_target on smithi044 to 177.0M 2024-09-12T02:48:13.851 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 02:48:13 smithi039 ceph-mon[30515]: Unable to set osd_memory_target on smithi044 to 185700659: error parsing value: Value '185700659' is below minimum 939524096 2024-09-12T02:48:13.851 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 02:48:13 smithi039 ceph-mon[30515]: from='mgr.25199 172.21.15.39:0/1270637502' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2024-09-12T02:48:13.851 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 02:48:13 smithi039 ceph-mon[30515]: from='mgr.25199 172.21.15.39:0/1270637502' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2024-09-12T02:48:13.851 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 02:48:13 smithi039 ceph-mon[30515]: from='mgr.25199 172.21.15.39:0/1270637502' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.8", "name": "osd_memory_target"}]: dispatch 2024-09-12T02:48:13.851 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 02:48:13 smithi039 ceph-mon[30515]: from='mgr.25199 172.21.15.39:0/1270637502' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.11", "name": "osd_memory_target"}]: dispatch 2024-09-12T02:48:13.949 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 12 02:48:13 smithi044 ceph-mon[35411]: pgmap v320: 129 pgs: 129 active+clean; 21 MiB data, 463 MiB used, 1.0 TiB / 1.0 TiB avail; 58 KiB/s rd, 59 KiB/s wr, 15 op/s 2024-09-12T02:48:13.949 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 12 02:48:13 smithi044 ceph-mon[35411]: from='mgr.25199 172.21.15.39:0/1270637502' entity='mgr.x' 2024-09-12T02:48:13.949 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 12 02:48:13 smithi044 ceph-mon[35411]: from='mgr.25199 172.21.15.39:0/1270637502' entity='mgr.x' 2024-09-12T02:48:13.949 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 12 02:48:13 smithi044 ceph-mon[35411]: from='mgr.25199 172.21.15.39:0/1270637502' entity='mgr.x' 2024-09-12T02:48:13.950 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 12 02:48:13 smithi044 ceph-mon[35411]: from='mgr.25199 172.21.15.39:0/1270637502' entity='mgr.x' 2024-09-12T02:48:13.950 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 12 02:48:13 smithi044 ceph-mon[35411]: from='mgr.25199 172.21.15.39:0/1270637502' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2024-09-12T02:48:13.950 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 12 02:48:13 smithi044 ceph-mon[35411]: from='mgr.25199 172.21.15.39:0/1270637502' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2024-09-12T02:48:13.950 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 12 02:48:13 smithi044 ceph-mon[35411]: from='mgr.25199 172.21.15.39:0/1270637502' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"}]: dispatch 2024-09-12T02:48:13.950 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 12 02:48:13 smithi044 ceph-mon[35411]: from='mgr.25199 172.21.15.39:0/1270637502' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.10", "name": "osd_memory_target"}]: dispatch 2024-09-12T02:48:13.950 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 12 02:48:13 smithi044 ceph-mon[35411]: Adjusting osd_memory_target on smithi044 to 177.0M 2024-09-12T02:48:13.950 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 12 02:48:13 smithi044 ceph-mon[35411]: Unable to set osd_memory_target on smithi044 to 185700659: error parsing value: Value '185700659' is below minimum 939524096 2024-09-12T02:48:13.950 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 12 02:48:13 smithi044 ceph-mon[35411]: from='mgr.25199 172.21.15.39:0/1270637502' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2024-09-12T02:48:13.950 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 12 02:48:13 smithi044 ceph-mon[35411]: from='mgr.25199 172.21.15.39:0/1270637502' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2024-09-12T02:48:13.950 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 12 02:48:13 smithi044 ceph-mon[35411]: from='mgr.25199 172.21.15.39:0/1270637502' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.8", "name": "osd_memory_target"}]: dispatch 2024-09-12T02:48:13.950 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 12 02:48:13 smithi044 ceph-mon[35411]: from='mgr.25199 172.21.15.39:0/1270637502' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.11", "name": "osd_memory_target"}]: dispatch 2024-09-12T02:48:14.763 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 12 02:48:14 smithi172 ceph-mon[35609]: Adjusting osd_memory_target on smithi172 to 176.0M 2024-09-12T02:48:14.764 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 12 02:48:14 smithi172 ceph-mon[35609]: Unable to set osd_memory_target on smithi172 to 184592486: error parsing value: Value '184592486' is below minimum 939524096 2024-09-12T02:48:14.764 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 12 02:48:14 smithi172 ceph-mon[35609]: from='mgr.25199 172.21.15.39:0/1270637502' entity='mgr.x' 2024-09-12T02:48:14.764 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 12 02:48:14 smithi172 ceph-mon[35609]: from='mgr.25199 172.21.15.39:0/1270637502' entity='mgr.x' 2024-09-12T02:48:14.764 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 12 02:48:14 smithi172 ceph-mon[35609]: from='mgr.25199 172.21.15.39:0/1270637502' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-09-12T02:48:14.764 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 12 02:48:14 smithi172 ceph-mon[35609]: from='mgr.25199 172.21.15.39:0/1270637502' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2024-09-12T02:48:14.764 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 12 02:48:14 smithi172 ceph-mon[35609]: from='mgr.25199 172.21.15.39:0/1270637502' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.6", "name": "osd_memory_target"}]: dispatch 2024-09-12T02:48:14.764 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 12 02:48:14 smithi172 ceph-mon[35609]: from='mgr.25199 172.21.15.39:0/1270637502' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.9", "name": "osd_memory_target"}]: dispatch 2024-09-12T02:48:14.764 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 12 02:48:14 smithi172 ceph-mon[35609]: from='mgr.25199 172.21.15.39:0/1270637502' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-12T02:48:14.764 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 12 02:48:14 smithi172 ceph-mon[35609]: from='mgr.25199 172.21.15.39:0/1270637502' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-12T02:48:14.764 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 12 02:48:14 smithi172 ceph-mon[35609]: from='mgr.25199 172.21.15.39:0/1270637502' entity='mgr.x' 2024-09-12T02:48:14.850 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 02:48:14 smithi039 ceph-mon[30515]: Adjusting osd_memory_target on smithi172 to 176.0M 2024-09-12T02:48:14.850 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 02:48:14 smithi039 ceph-mon[30515]: Unable to set osd_memory_target on smithi172 to 184592486: error parsing value: Value '184592486' is below minimum 939524096 2024-09-12T02:48:14.850 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 02:48:14 smithi039 ceph-mon[30515]: from='mgr.25199 172.21.15.39:0/1270637502' entity='mgr.x' 2024-09-12T02:48:14.850 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 02:48:14 smithi039 ceph-mon[30515]: from='mgr.25199 172.21.15.39:0/1270637502' entity='mgr.x' 2024-09-12T02:48:14.850 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 02:48:14 smithi039 ceph-mon[30515]: from='mgr.25199 172.21.15.39:0/1270637502' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-09-12T02:48:14.850 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 02:48:14 smithi039 ceph-mon[30515]: from='mgr.25199 172.21.15.39:0/1270637502' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2024-09-12T02:48:14.850 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 02:48:14 smithi039 ceph-mon[30515]: from='mgr.25199 172.21.15.39:0/1270637502' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.6", "name": "osd_memory_target"}]: dispatch 2024-09-12T02:48:14.850 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 02:48:14 smithi039 ceph-mon[30515]: from='mgr.25199 172.21.15.39:0/1270637502' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.9", "name": "osd_memory_target"}]: dispatch 2024-09-12T02:48:14.850 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 02:48:14 smithi039 ceph-mon[30515]: from='mgr.25199 172.21.15.39:0/1270637502' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-12T02:48:14.851 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 02:48:14 smithi039 ceph-mon[30515]: from='mgr.25199 172.21.15.39:0/1270637502' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-12T02:48:14.851 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 02:48:14 smithi039 ceph-mon[30515]: from='mgr.25199 172.21.15.39:0/1270637502' entity='mgr.x' 2024-09-12T02:48:14.949 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 12 02:48:14 smithi044 ceph-mon[35411]: Adjusting osd_memory_target on smithi172 to 176.0M 2024-09-12T02:48:14.949 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 12 02:48:14 smithi044 ceph-mon[35411]: Unable to set osd_memory_target on smithi172 to 184592486: error parsing value: Value '184592486' is below minimum 939524096 2024-09-12T02:48:14.949 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 12 02:48:14 smithi044 ceph-mon[35411]: from='mgr.25199 172.21.15.39:0/1270637502' entity='mgr.x' 2024-09-12T02:48:14.949 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 12 02:48:14 smithi044 ceph-mon[35411]: from='mgr.25199 172.21.15.39:0/1270637502' entity='mgr.x' 2024-09-12T02:48:14.949 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 12 02:48:14 smithi044 ceph-mon[35411]: from='mgr.25199 172.21.15.39:0/1270637502' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-09-12T02:48:14.949 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 12 02:48:14 smithi044 ceph-mon[35411]: from='mgr.25199 172.21.15.39:0/1270637502' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2024-09-12T02:48:14.949 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 12 02:48:14 smithi044 ceph-mon[35411]: from='mgr.25199 172.21.15.39:0/1270637502' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.6", "name": "osd_memory_target"}]: dispatch 2024-09-12T02:48:14.949 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 12 02:48:14 smithi044 ceph-mon[35411]: from='mgr.25199 172.21.15.39:0/1270637502' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.9", "name": "osd_memory_target"}]: dispatch 2024-09-12T02:48:14.950 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 12 02:48:14 smithi044 ceph-mon[35411]: from='mgr.25199 172.21.15.39:0/1270637502' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-12T02:48:14.950 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 12 02:48:14 smithi044 ceph-mon[35411]: from='mgr.25199 172.21.15.39:0/1270637502' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-12T02:48:14.950 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 12 02:48:14 smithi044 ceph-mon[35411]: from='mgr.25199 172.21.15.39:0/1270637502' entity='mgr.x' 2024-09-12T02:48:15.763 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 12 02:48:15 smithi172 ceph-mon[35609]: pgmap v322: 129 pgs: 129 active+clean; 21 MiB data, 463 MiB used, 1.0 TiB / 1.0 TiB avail; 58 KiB/s rd, 59 KiB/s wr, 15 op/s 2024-09-12T02:48:15.764 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 12 02:48:15 smithi172 ceph-mon[35609]: Adjusting osd_memory_target on smithi039 to 176.4M 2024-09-12T02:48:15.764 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 12 02:48:15 smithi172 ceph-mon[35609]: Unable to set osd_memory_target on smithi039 to 185042636: error parsing value: Value '185042636' is below minimum 939524096 2024-09-12T02:48:15.849 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 02:48:15 smithi039 ceph-mon[30515]: pgmap v322: 129 pgs: 129 active+clean; 21 MiB data, 463 MiB used, 1.0 TiB / 1.0 TiB avail; 58 KiB/s rd, 59 KiB/s wr, 15 op/s 2024-09-12T02:48:15.850 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 02:48:15 smithi039 ceph-mon[30515]: Adjusting osd_memory_target on smithi039 to 176.4M 2024-09-12T02:48:15.850 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 02:48:15 smithi039 ceph-mon[30515]: Unable to set osd_memory_target on smithi039 to 185042636: error parsing value: Value '185042636' is below minimum 939524096 2024-09-12T02:48:15.948 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 12 02:48:15 smithi044 ceph-mon[35411]: pgmap v322: 129 pgs: 129 active+clean; 21 MiB data, 463 MiB used, 1.0 TiB / 1.0 TiB avail; 58 KiB/s rd, 59 KiB/s wr, 15 op/s 2024-09-12T02:48:15.949 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 12 02:48:15 smithi044 ceph-mon[35411]: Adjusting osd_memory_target on smithi039 to 176.4M 2024-09-12T02:48:15.949 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 12 02:48:15 smithi044 ceph-mon[35411]: Unable to set osd_memory_target on smithi039 to 185042636: error parsing value: Value '185042636' is below minimum 939524096 2024-09-12T02:48:17.764 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 12 02:48:17 smithi172 ceph-mon[35609]: pgmap v323: 129 pgs: 129 active+clean; 21 MiB data, 463 MiB used, 1.0 TiB / 1.0 TiB avail; 58 KiB/s rd, 59 KiB/s wr, 15 op/s 2024-09-12T02:48:17.849 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 02:48:17 smithi039 ceph-mon[30515]: pgmap v323: 129 pgs: 129 active+clean; 21 MiB data, 463 MiB used, 1.0 TiB / 1.0 TiB avail; 58 KiB/s rd, 59 KiB/s wr, 15 op/s 2024-09-12T02:48:17.948 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 12 02:48:17 smithi044 ceph-mon[35411]: pgmap v323: 129 pgs: 129 active+clean; 21 MiB data, 463 MiB used, 1.0 TiB / 1.0 TiB avail; 58 KiB/s rd, 59 KiB/s wr, 15 op/s 2024-09-12T02:48:19.763 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 12 02:48:19 smithi172 ceph-mon[35609]: pgmap v324: 129 pgs: 129 active+clean; 21 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 60 KiB/s rd, 57 KiB/s wr, 15 op/s 2024-09-12T02:48:19.849 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 02:48:19 smithi039 ceph-mon[30515]: pgmap v324: 129 pgs: 129 active+clean; 21 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 60 KiB/s rd, 57 KiB/s wr, 15 op/s 2024-09-12T02:48:19.948 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 12 02:48:19 smithi044 ceph-mon[35411]: pgmap v324: 129 pgs: 129 active+clean; 21 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 60 KiB/s rd, 57 KiB/s wr, 15 op/s 2024-09-12T02:48:21.850 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 02:48:21 smithi039 ceph-mon[30515]: pgmap v325: 129 pgs: 129 active+clean; 21 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 60 KiB/s rd, 57 KiB/s wr, 15 op/s 2024-09-12T02:48:21.948 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 12 02:48:21 smithi044 ceph-mon[35411]: pgmap v325: 129 pgs: 129 active+clean; 21 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 60 KiB/s rd, 57 KiB/s wr, 15 op/s 2024-09-12T02:48:22.013 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 12 02:48:21 smithi172 ceph-mon[35609]: pgmap v325: 129 pgs: 129 active+clean; 21 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 60 KiB/s rd, 57 KiB/s wr, 15 op/s 2024-09-12T02:48:23.850 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 02:48:23 smithi039 ceph-mon[30515]: pgmap v326: 129 pgs: 129 active+clean; 21 MiB data, 465 MiB used, 1.0 TiB / 1.0 TiB avail; 61 KiB/s rd, 57 KiB/s wr, 15 op/s 2024-09-12T02:48:23.948 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 12 02:48:23 smithi044 ceph-mon[35411]: pgmap v326: 129 pgs: 129 active+clean; 21 MiB data, 465 MiB used, 1.0 TiB / 1.0 TiB avail; 61 KiB/s rd, 57 KiB/s wr, 15 op/s 2024-09-12T02:48:24.014 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 12 02:48:23 smithi172 ceph-mon[35609]: pgmap v326: 129 pgs: 129 active+clean; 21 MiB data, 465 MiB used, 1.0 TiB / 1.0 TiB avail; 61 KiB/s rd, 57 KiB/s wr, 15 op/s 2024-09-12T02:48:25.816 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 12 02:48:25 smithi172 ceph-mon[35609]: pgmap v327: 129 pgs: 129 active+clean; 21 MiB data, 465 MiB used, 1.0 TiB / 1.0 TiB avail; 51 KiB/s rd, 47 KiB/s wr, 13 op/s 2024-09-12T02:48:25.850 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 02:48:25 smithi039 ceph-mon[30515]: pgmap v327: 129 pgs: 129 active+clean; 21 MiB data, 465 MiB used, 1.0 TiB / 1.0 TiB avail; 51 KiB/s rd, 47 KiB/s wr, 13 op/s 2024-09-12T02:48:25.948 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 12 02:48:25 smithi044 ceph-mon[35411]: pgmap v327: 129 pgs: 129 active+clean; 21 MiB data, 465 MiB used, 1.0 TiB / 1.0 TiB avail; 51 KiB/s rd, 47 KiB/s wr, 13 op/s 2024-09-12T02:48:27.850 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 02:48:27 smithi039 ceph-mon[30515]: pgmap v328: 129 pgs: 129 active+clean; 21 MiB data, 465 MiB used, 1.0 TiB / 1.0 TiB avail; 50 KiB/s rd, 47 KiB/s wr, 13 op/s 2024-09-12T02:48:27.948 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 12 02:48:27 smithi044 ceph-mon[35411]: pgmap v328: 129 pgs: 129 active+clean; 21 MiB data, 465 MiB used, 1.0 TiB / 1.0 TiB avail; 50 KiB/s rd, 47 KiB/s wr, 13 op/s 2024-09-12T02:48:28.014 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 12 02:48:27 smithi172 ceph-mon[35609]: pgmap v328: 129 pgs: 129 active+clean; 21 MiB data, 465 MiB used, 1.0 TiB / 1.0 TiB avail; 50 KiB/s rd, 47 KiB/s wr, 13 op/s 2024-09-12T02:48:28.954 INFO:tasks.workunit.client.0.smithi039.stdout:499/600: open fd = 3 2024-09-12T02:48:28.954 INFO:tasks.workunit.client.0.smithi039.stdout:write ret = 32 2024-09-12T02:48:28.955 INFO:tasks.workunit.client.0.smithi039.stdout:write ret = 32 2024-09-12T02:48:28.955 INFO:tasks.workunit.client.0.smithi039.stdout:pread ret = 64 2024-09-12T02:48:28.955 INFO:tasks.workunit.client.0.smithi039.stdout:500/600: open fd = 3 2024-09-12T02:48:28.955 INFO:tasks.workunit.client.0.smithi039.stdout:write ret = 32 2024-09-12T02:48:28.955 INFO:tasks.workunit.client.0.smithi039.stdout:write ret = 32 2024-09-12T02:48:28.955 INFO:tasks.workunit.client.0.smithi039.stdout:pread ret = 64 2024-09-12T02:48:28.955 INFO:tasks.workunit.client.0.smithi039.stdout:501/600: open fd = 3 2024-09-12T02:48:28.955 INFO:tasks.workunit.client.0.smithi039.stdout:write ret = 32 2024-09-12T02:48:28.955 INFO:tasks.workunit.client.0.smithi039.stdout:write ret = 32 2024-09-12T02:48:28.955 INFO:tasks.workunit.client.0.smithi039.stdout:pread ret = 64 2024-09-12T02:48:28.955 INFO:tasks.workunit.client.0.smithi039.stdout:502/600: open fd = 3 2024-09-12T02:48:28.955 INFO:tasks.workunit.client.0.smithi039.stdout:write ret = 32 2024-09-12T02:48:28.955 INFO:tasks.workunit.client.0.smithi039.stdout:write ret = 32 2024-09-12T02:48:28.956 INFO:tasks.workunit.client.0.smithi039.stdout:pread ret = 64 2024-09-12T02:48:28.956 INFO:tasks.workunit.client.0.smithi039.stdout:503/600: open fd = 3 2024-09-12T02:48:28.956 INFO:tasks.workunit.client.0.smithi039.stdout:write ret = 32 2024-09-12T02:48:28.956 INFO:tasks.workunit.client.0.smithi039.stdout:write ret = 32 2024-09-12T02:48:28.956 INFO:tasks.workunit.client.0.smithi039.stdout:pread ret = 64 2024-09-12T02:48:28.956 INFO:tasks.workunit.client.0.smithi039.stdout:504/600: open fd = 3 2024-09-12T02:48:28.956 INFO:tasks.workunit.client.0.smithi039.stdout:write ret = 32 2024-09-12T02:48:28.956 INFO:tasks.workunit.client.0.smithi039.stdout:write ret = 32 2024-09-12T02:48:28.956 INFO:tasks.workunit.client.0.smithi039.stdout:pread ret = 64 2024-09-12T02:48:28.956 INFO:tasks.workunit.client.0.smithi039.stdout:505/600: open fd = 3 2024-09-12T02:48:28.956 INFO:tasks.workunit.client.0.smithi039.stdout:write ret = 32 2024-09-12T02:48:28.956 INFO:tasks.workunit.client.0.smithi039.stdout:write ret = 32 2024-09-12T02:48:28.956 INFO:tasks.workunit.client.0.smithi039.stdout:pread ret = 64 2024-09-12T02:48:28.957 INFO:tasks.workunit.client.0.smithi039.stdout:506/600: open fd = 3 2024-09-12T02:48:28.957 INFO:tasks.workunit.client.0.smithi039.stdout:write ret = 32 2024-09-12T02:48:28.957 INFO:tasks.workunit.client.0.smithi039.stdout:write ret = 32 2024-09-12T02:48:28.957 INFO:tasks.workunit.client.0.smithi039.stdout:pread ret = 64 2024-09-12T02:48:28.957 INFO:tasks.workunit.client.0.smithi039.stdout:507/600: open fd = 3 2024-09-12T02:48:28.957 INFO:tasks.workunit.client.0.smithi039.stdout:write ret = 32 2024-09-12T02:48:28.957 INFO:tasks.workunit.client.0.smithi039.stdout:write ret = 32 2024-09-12T02:48:28.957 INFO:tasks.workunit.client.0.smithi039.stdout:pread ret = 64 2024-09-12T02:48:28.957 INFO:tasks.workunit.client.0.smithi039.stdout:508/600: open fd = 3 2024-09-12T02:48:28.957 INFO:tasks.workunit.client.0.smithi039.stdout:write ret = 32 2024-09-12T02:48:28.957 INFO:tasks.workunit.client.0.smithi039.stdout:write ret = 32 2024-09-12T02:48:28.957 INFO:tasks.workunit.client.0.smithi039.stdout:pread ret = 64 2024-09-12T02:48:28.957 INFO:tasks.workunit.client.0.smithi039.stdout:509/600: open fd = 3 2024-09-12T02:48:28.958 INFO:tasks.workunit.client.0.smithi039.stdout:write ret = 32 2024-09-12T02:48:28.958 INFO:tasks.workunit.client.0.smithi039.stdout:write ret = 32 2024-09-12T02:48:28.958 INFO:tasks.workunit.client.0.smithi039.stdout:pread ret = 64 2024-09-12T02:48:28.958 INFO:tasks.workunit.client.0.smithi039.stdout:510/600: open fd = 3 2024-09-12T02:48:28.958 INFO:tasks.workunit.client.0.smithi039.stdout:write ret = 32 2024-09-12T02:48:28.958 INFO:tasks.workunit.client.0.smithi039.stdout:write ret = 32 2024-09-12T02:48:28.958 INFO:tasks.workunit.client.0.smithi039.stdout:pread ret = 64 2024-09-12T02:48:28.958 INFO:tasks.workunit.client.0.smithi039.stdout:511/600: open fd = 3 2024-09-12T02:48:28.958 INFO:tasks.workunit.client.0.smithi039.stdout:write ret = 32 2024-09-12T02:48:28.958 INFO:tasks.workunit.client.0.smithi039.stdout:write ret = 32 2024-09-12T02:48:28.958 INFO:tasks.workunit.client.0.smithi039.stdout:pread ret = 64 2024-09-12T02:48:28.958 INFO:tasks.workunit.client.0.smithi039.stdout:512/600: open fd = 3 2024-09-12T02:48:28.958 INFO:tasks.workunit.client.0.smithi039.stdout:write ret = 32 2024-09-12T02:48:28.958 INFO:tasks.workunit.client.0.smithi039.stdout:write ret = 32 2024-09-12T02:48:28.959 INFO:tasks.workunit.client.0.smithi039.stdout:pread ret = 64 2024-09-12T02:48:28.959 INFO:tasks.workunit.client.0.smithi039.stdout:513/600: open fd = 3 2024-09-12T02:48:28.959 INFO:tasks.workunit.client.0.smithi039.stdout:write ret = 32 2024-09-12T02:48:28.959 INFO:tasks.workunit.client.0.smithi039.stdout:write ret = 32 2024-09-12T02:48:28.959 INFO:tasks.workunit.client.0.smithi039.stdout:pread ret = 64 2024-09-12T02:48:28.959 INFO:tasks.workunit.client.0.smithi039.stdout:514/600: open fd = 3 2024-09-12T02:48:28.959 INFO:tasks.workunit.client.0.smithi039.stdout:write ret = 32 2024-09-12T02:48:28.959 INFO:tasks.workunit.client.0.smithi039.stdout:write ret = 32 2024-09-12T02:48:28.959 INFO:tasks.workunit.client.0.smithi039.stdout:pread ret = 64 2024-09-12T02:48:28.959 INFO:tasks.workunit.client.0.smithi039.stdout:515/600: open fd = 3 2024-09-12T02:48:28.959 INFO:tasks.workunit.client.0.smithi039.stdout:write ret = 32 2024-09-12T02:48:28.959 INFO:tasks.workunit.client.0.smithi039.stdout:write ret = 32 2024-09-12T02:48:28.959 INFO:tasks.workunit.client.0.smithi039.stdout:pread ret = 64 2024-09-12T02:48:28.959 INFO:tasks.workunit.client.0.smithi039.stdout:516/600: open fd = 3 2024-09-12T02:48:28.960 INFO:tasks.workunit.client.0.smithi039.stdout:write ret = 32 2024-09-12T02:48:28.960 INFO:tasks.workunit.client.0.smithi039.stdout:write ret = 32 2024-09-12T02:48:28.960 INFO:tasks.workunit.client.0.smithi039.stdout:pread ret = 64 2024-09-12T02:48:28.960 INFO:tasks.workunit.client.0.smithi039.stdout:517/600: open fd = 3 2024-09-12T02:48:28.960 INFO:tasks.workunit.client.0.smithi039.stdout:write ret = 32 2024-09-12T02:48:28.960 INFO:tasks.workunit.client.0.smithi039.stdout:write ret = 32 2024-09-12T02:48:28.960 INFO:tasks.workunit.client.0.smithi039.stdout:pread ret = 64 2024-09-12T02:48:28.960 INFO:tasks.workunit.client.0.smithi039.stdout:518/600: open fd = 3 2024-09-12T02:48:28.960 INFO:tasks.workunit.client.0.smithi039.stdout:write ret = 32 2024-09-12T02:48:28.960 INFO:tasks.workunit.client.0.smithi039.stdout:write ret = 32 2024-09-12T02:48:28.960 INFO:tasks.workunit.client.0.smithi039.stdout:pread ret = 64 2024-09-12T02:48:28.960 INFO:tasks.workunit.client.0.smithi039.stdout:519/600: open fd = 3 2024-09-12T02:48:28.960 INFO:tasks.workunit.client.0.smithi039.stdout:write ret = 32 2024-09-12T02:48:28.961 INFO:tasks.workunit.client.0.smithi039.stdout:write ret = 32 2024-09-12T02:48:28.961 INFO:tasks.workunit.client.0.smithi039.stdout:pread ret = 64 2024-09-12T02:48:28.961 INFO:tasks.workunit.client.0.smithi039.stdout:520/600: open fd = 3 2024-09-12T02:48:28.961 INFO:tasks.workunit.client.0.smithi039.stdout:write ret = 32 2024-09-12T02:48:28.961 INFO:tasks.workunit.client.0.smithi039.stdout:write ret = 32 2024-09-12T02:48:28.961 INFO:tasks.workunit.client.0.smithi039.stdout:pread ret = 64 2024-09-12T02:48:28.961 INFO:tasks.workunit.client.0.smithi039.stdout:521/600: open fd = 3 2024-09-12T02:48:28.961 INFO:tasks.workunit.client.0.smithi039.stdout:write ret = 32 2024-09-12T02:48:28.961 INFO:tasks.workunit.client.0.smithi039.stdout:write ret = 32 2024-09-12T02:48:28.961 INFO:tasks.workunit.client.0.smithi039.stdout:pread ret = 64 2024-09-12T02:48:28.961 INFO:tasks.workunit.client.0.smithi039.stdout:522/600: open fd = 3 2024-09-12T02:48:28.961 INFO:tasks.workunit.client.0.smithi039.stdout:write ret = 32 2024-09-12T02:48:28.961 INFO:tasks.workunit.client.0.smithi039.stdout:write ret = 32 2024-09-12T02:48:28.962 INFO:tasks.workunit.client.0.smithi039.stdout:pread ret = 64 2024-09-12T02:48:28.962 INFO:tasks.workunit.client.0.smithi039.stdout:523/600: open fd = 3 2024-09-12T02:48:28.962 INFO:tasks.workunit.client.0.smithi039.stdout:write ret = 32 2024-09-12T02:48:28.962 INFO:tasks.workunit.client.0.smithi039.stdout:write ret = 32 2024-09-12T02:48:28.962 INFO:tasks.workunit.client.0.smithi039.stdout:pread ret = 64 2024-09-12T02:48:28.962 INFO:tasks.workunit.client.0.smithi039.stdout:524/600: open fd = 3 2024-09-12T02:48:28.962 INFO:tasks.workunit.client.0.smithi039.stdout:write ret = 32 2024-09-12T02:48:28.962 INFO:tasks.workunit.client.0.smithi039.stdout:write ret = 32 2024-09-12T02:48:28.962 INFO:tasks.workunit.client.0.smithi039.stdout:pread ret = 64 2024-09-12T02:48:28.962 INFO:tasks.workunit.client.0.smithi039.stdout:525/600: open fd = 3 2024-09-12T02:48:28.962 INFO:tasks.workunit.client.0.smithi039.stdout:write ret = 32 2024-09-12T02:48:28.962 INFO:tasks.workunit.client.0.smithi039.stdout:write ret = 32 2024-09-12T02:48:28.962 INFO:tasks.workunit.client.0.smithi039.stdout:pread ret = 64 2024-09-12T02:48:28.962 INFO:tasks.workunit.client.0.smithi039.stdout:526/600: open fd = 3 2024-09-12T02:48:28.962 INFO:tasks.workunit.client.0.smithi039.stdout:write ret = 32 2024-09-12T02:48:28.963 INFO:tasks.workunit.client.0.smithi039.stdout:write ret = 32 2024-09-12T02:48:28.963 INFO:tasks.workunit.client.0.smithi039.stdout:pread ret = 64 2024-09-12T02:48:28.963 INFO:tasks.workunit.client.0.smithi039.stdout:527/600: open fd = 3 2024-09-12T02:48:28.963 INFO:tasks.workunit.client.0.smithi039.stdout:write ret = 32 2024-09-12T02:48:28.963 INFO:tasks.workunit.client.0.smithi039.stdout:write ret = 32 2024-09-12T02:48:28.963 INFO:tasks.workunit.client.0.smithi039.stdout:pread ret = 64 2024-09-12T02:48:28.963 INFO:tasks.workunit.client.0.smithi039.stdout:528/600: open fd = 3 2024-09-12T02:48:28.963 INFO:tasks.workunit.client.0.smithi039.stdout:write ret = 32 2024-09-12T02:48:28.963 INFO:tasks.workunit.client.0.smithi039.stdout:write ret = 32 2024-09-12T02:48:28.963 INFO:tasks.workunit.client.0.smithi039.stdout:pread ret = 64 2024-09-12T02:48:28.963 INFO:tasks.workunit.client.0.smithi039.stdout:529/600: open fd = 3 2024-09-12T02:48:28.963 INFO:tasks.workunit.client.0.smithi039.stdout:write ret = 32 2024-09-12T02:48:28.963 INFO:tasks.workunit.client.0.smithi039.stdout:write ret = 32 2024-09-12T02:48:28.964 INFO:tasks.workunit.client.0.smithi039.stdout:pread ret = 64 2024-09-12T02:48:28.964 INFO:tasks.workunit.client.0.smithi039.stdout:530/600: open fd = 3 2024-09-12T02:48:28.964 INFO:tasks.workunit.client.0.smithi039.stdout:write ret = 32 2024-09-12T02:48:28.964 INFO:tasks.workunit.client.0.smithi039.stdout:write ret = 32 2024-09-12T02:48:28.964 INFO:tasks.workunit.client.0.smithi039.stdout:pread ret = 64 2024-09-12T02:48:28.964 INFO:tasks.workunit.client.0.smithi039.stdout:531/600: open fd = 3 2024-09-12T02:48:28.964 INFO:tasks.workunit.client.0.smithi039.stdout:write ret = 32 2024-09-12T02:48:28.964 INFO:tasks.workunit.client.0.smithi039.stdout:write ret = 32 2024-09-12T02:48:28.964 INFO:tasks.workunit.client.0.smithi039.stdout:pread ret = 64 2024-09-12T02:48:28.964 INFO:tasks.workunit.client.0.smithi039.stdout:532/600: open fd = 3 2024-09-12T02:48:28.964 INFO:tasks.workunit.client.0.smithi039.stdout:write ret = 32 2024-09-12T02:48:28.964 INFO:tasks.workunit.client.0.smithi039.stdout:write ret = 32 2024-09-12T02:48:28.964 INFO:tasks.workunit.client.0.smithi039.stdout:pread ret = 64 2024-09-12T02:48:28.964 INFO:tasks.workunit.client.0.smithi039.stdout:533/600: open fd = 3 2024-09-12T02:48:28.965 INFO:tasks.workunit.client.0.smithi039.stdout:write ret = 32 2024-09-12T02:48:28.965 INFO:tasks.workunit.client.0.smithi039.stdout:write ret = 32 2024-09-12T02:48:28.965 INFO:tasks.workunit.client.0.smithi039.stdout:pread ret = 64 2024-09-12T02:48:28.965 INFO:tasks.workunit.client.0.smithi039.stdout:534/600: open fd = 3 2024-09-12T02:48:28.965 INFO:tasks.workunit.client.0.smithi039.stdout:write ret = 32 2024-09-12T02:48:28.965 INFO:tasks.workunit.client.0.smithi039.stdout:write ret = 32 2024-09-12T02:48:28.965 INFO:tasks.workunit.client.0.smithi039.stdout:pread ret = 64 2024-09-12T02:48:28.965 INFO:tasks.workunit.client.0.smithi039.stdout:535/600: open fd = 3 2024-09-12T02:48:28.965 INFO:tasks.workunit.client.0.smithi039.stdout:write ret = 32 2024-09-12T02:48:28.965 INFO:tasks.workunit.client.0.smithi039.stdout:write ret = 32 2024-09-12T02:48:28.965 INFO:tasks.workunit.client.0.smithi039.stdout:pread ret = 64 2024-09-12T02:48:28.965 INFO:tasks.workunit.client.0.smithi039.stdout:536/600: open fd = 3 2024-09-12T02:48:28.965 INFO:tasks.workunit.client.0.smithi039.stdout:write ret = 32 2024-09-12T02:48:28.965 INFO:tasks.workunit.client.0.smithi039.stdout:write ret = 32 2024-09-12T02:48:28.966 INFO:tasks.workunit.client.0.smithi039.stdout:pread ret = 64 2024-09-12T02:48:28.966 INFO:tasks.workunit.client.0.smithi039.stdout:537/600: open fd = 3 2024-09-12T02:48:28.966 INFO:tasks.workunit.client.0.smithi039.stdout:write ret = 32 2024-09-12T02:48:28.966 INFO:tasks.workunit.client.0.smithi039.stdout:write ret = 32 2024-09-12T02:48:28.966 INFO:tasks.workunit.client.0.smithi039.stdout:pread ret = 64 2024-09-12T02:48:28.966 INFO:tasks.workunit.client.0.smithi039.stdout:538/600: open fd = 3 2024-09-12T02:48:28.966 INFO:tasks.workunit.client.0.smithi039.stdout:write ret = 32 2024-09-12T02:48:28.966 INFO:tasks.workunit.client.0.smithi039.stdout:write ret = 32 2024-09-12T02:48:28.966 INFO:tasks.workunit.client.0.smithi039.stdout:pread ret = 64 2024-09-12T02:48:28.966 INFO:tasks.workunit.client.0.smithi039.stdout:539/600: open fd = 3 2024-09-12T02:48:28.966 INFO:tasks.workunit.client.0.smithi039.stdout:write ret = 32 2024-09-12T02:48:28.966 INFO:tasks.workunit.client.0.smithi039.stdout:write ret = 32 2024-09-12T02:48:28.966 INFO:tasks.workunit.client.0.smithi039.stdout:pread ret = 64 2024-09-12T02:48:28.966 INFO:tasks.workunit.client.0.smithi039.stdout:540/600: open fd = 3 2024-09-12T02:48:28.967 INFO:tasks.workunit.client.0.smithi039.stdout:write ret = 32 2024-09-12T02:48:28.967 INFO:tasks.workunit.client.0.smithi039.stdout:write ret = 32 2024-09-12T02:48:28.967 INFO:tasks.workunit.client.0.smithi039.stdout:pread ret = 64 2024-09-12T02:48:28.967 INFO:tasks.workunit.client.0.smithi039.stdout:541/600: open fd = 3 2024-09-12T02:48:28.967 INFO:tasks.workunit.client.0.smithi039.stdout:write ret = 32 2024-09-12T02:48:28.967 INFO:tasks.workunit.client.0.smithi039.stdout:write ret = 32 2024-09-12T02:48:28.967 INFO:tasks.workunit.client.0.smithi039.stdout:pread ret = 64 2024-09-12T02:48:28.967 INFO:tasks.workunit.client.0.smithi039.stdout:542/600: open fd = 3 2024-09-12T02:48:28.967 INFO:tasks.workunit.client.0.smithi039.stdout:write ret = 32 2024-09-12T02:48:28.967 INFO:tasks.workunit.client.0.smithi039.stdout:write ret = 32 2024-09-12T02:48:28.967 INFO:tasks.workunit.client.0.smithi039.stdout:pread ret = 64 2024-09-12T02:48:28.967 INFO:tasks.workunit.client.0.smithi039.stdout:543/600: open fd = 3 2024-09-12T02:48:28.967 INFO:tasks.workunit.client.0.smithi039.stdout:write ret = 32 2024-09-12T02:48:28.967 INFO:tasks.workunit.client.0.smithi039.stdout:write ret = 32 2024-09-12T02:48:28.968 INFO:tasks.workunit.client.0.smithi039.stdout:pread ret = 64 2024-09-12T02:48:28.968 INFO:tasks.workunit.client.0.smithi039.stdout:544/600: open fd = 3 2024-09-12T02:48:28.968 INFO:tasks.workunit.client.0.smithi039.stdout:write ret = 32 2024-09-12T02:48:28.968 INFO:tasks.workunit.client.0.smithi039.stdout:write ret = 32 2024-09-12T02:48:28.968 INFO:tasks.workunit.client.0.smithi039.stdout:pread ret = 64 2024-09-12T02:48:28.968 INFO:tasks.workunit.client.0.smithi039.stdout:545/600: open fd = 3 2024-09-12T02:48:28.968 INFO:tasks.workunit.client.0.smithi039.stdout:write ret = 32 2024-09-12T02:48:28.968 INFO:tasks.workunit.client.0.smithi039.stdout:write ret = 32 2024-09-12T02:48:28.968 INFO:tasks.workunit.client.0.smithi039.stdout:pread ret = 64 2024-09-12T02:48:28.968 INFO:tasks.workunit.client.0.smithi039.stdout:546/600: open fd = 3 2024-09-12T02:48:28.968 INFO:tasks.workunit.client.0.smithi039.stdout:write ret = 32 2024-09-12T02:48:28.968 INFO:tasks.workunit.client.0.smithi039.stdout:write ret = 32 2024-09-12T02:48:28.968 INFO:tasks.workunit.client.0.smithi039.stdout:pread ret = 64 2024-09-12T02:48:28.969 INFO:tasks.workunit.client.0.smithi039.stdout:547/600: open fd = 3 2024-09-12T02:48:28.969 INFO:tasks.workunit.client.0.smithi039.stdout:write ret = 32 2024-09-12T02:48:28.969 INFO:tasks.workunit.client.0.smithi039.stdout:write ret = 32 2024-09-12T02:48:28.969 INFO:tasks.workunit.client.0.smithi039.stdout:pread ret = 64 2024-09-12T02:48:28.969 INFO:tasks.workunit.client.0.smithi039.stdout:548/600: open fd = 3 2024-09-12T02:48:28.969 INFO:tasks.workunit.client.0.smithi039.stdout:write ret = 32 2024-09-12T02:48:28.969 INFO:tasks.workunit.client.0.smithi039.stdout:write ret = 32 2024-09-12T02:48:28.969 INFO:tasks.workunit.client.0.smithi039.stdout:pread ret = 64 2024-09-12T02:48:28.969 INFO:tasks.workunit.client.0.smithi039.stdout:549/600: open fd = 3 2024-09-12T02:48:28.969 INFO:tasks.workunit.client.0.smithi039.stdout:write ret = 32 2024-09-12T02:48:28.969 INFO:tasks.workunit.client.0.smithi039.stdout:write ret = 32 2024-09-12T02:48:28.969 INFO:tasks.workunit.client.0.smithi039.stdout:pread ret = 64 2024-09-12T02:48:28.969 INFO:tasks.workunit.client.0.smithi039.stdout:550/600: open fd = 3 2024-09-12T02:48:28.970 INFO:tasks.workunit.client.0.smithi039.stdout:write ret = 32 2024-09-12T02:48:28.970 INFO:tasks.workunit.client.0.smithi039.stdout:write ret = 32 2024-09-12T02:48:28.970 INFO:tasks.workunit.client.0.smithi039.stdout:pread ret = 64 2024-09-12T02:48:28.970 INFO:tasks.workunit.client.0.smithi039.stdout:551/600: open fd = 3 2024-09-12T02:48:28.970 INFO:tasks.workunit.client.0.smithi039.stdout:write ret = 32 2024-09-12T02:48:28.970 INFO:tasks.workunit.client.0.smithi039.stdout:write ret = 32 2024-09-12T02:48:28.970 INFO:tasks.workunit.client.0.smithi039.stdout:pread ret = 64 2024-09-12T02:48:28.970 INFO:tasks.workunit.client.0.smithi039.stdout:552/600: open fd = 3 2024-09-12T02:48:28.970 INFO:tasks.workunit.client.0.smithi039.stdout:write ret = 32 2024-09-12T02:48:28.970 INFO:tasks.workunit.client.0.smithi039.stdout:write ret = 32 2024-09-12T02:48:28.970 INFO:tasks.workunit.client.0.smithi039.stdout:pread ret = 64 2024-09-12T02:48:28.971 INFO:tasks.workunit.client.0.smithi039.stdout:553/600: open fd = 3 2024-09-12T02:48:28.971 INFO:tasks.workunit.client.0.smithi039.stdout:write ret = 32 2024-09-12T02:48:28.971 INFO:tasks.workunit.client.0.smithi039.stdout:write ret = 32 2024-09-12T02:48:28.971 INFO:tasks.workunit.client.0.smithi039.stdout:pread ret = 64 2024-09-12T02:48:28.971 INFO:tasks.workunit.client.0.smithi039.stdout:554/600: open fd = 3 2024-09-12T02:48:28.971 INFO:tasks.workunit.client.0.smithi039.stdout:write ret = 32 2024-09-12T02:48:28.971 INFO:tasks.workunit.client.0.smithi039.stdout:write ret = 32 2024-09-12T02:48:28.971 INFO:tasks.workunit.client.0.smithi039.stdout:pread ret = 64 2024-09-12T02:48:28.971 INFO:tasks.workunit.client.0.smithi039.stdout:555/600: open fd = 3 2024-09-12T02:48:28.971 INFO:tasks.workunit.client.0.smithi039.stdout:write ret = 32 2024-09-12T02:48:28.971 INFO:tasks.workunit.client.0.smithi039.stdout:write ret = 32 2024-09-12T02:48:28.971 INFO:tasks.workunit.client.0.smithi039.stdout:pread ret = 64 2024-09-12T02:48:28.972 INFO:tasks.workunit.client.0.smithi039.stdout:556/600: open fd = 3 2024-09-12T02:48:28.972 INFO:tasks.workunit.client.0.smithi039.stdout:write ret = 32 2024-09-12T02:48:28.972 INFO:tasks.workunit.client.0.smithi039.stdout:write ret = 32 2024-09-12T02:48:28.972 INFO:tasks.workunit.client.0.smithi039.stdout:pread ret = 64 2024-09-12T02:48:28.972 INFO:tasks.workunit.client.0.smithi039.stdout:557/600: open fd = 3 2024-09-12T02:48:28.972 INFO:tasks.workunit.client.0.smithi039.stdout:write ret = 32 2024-09-12T02:48:28.972 INFO:tasks.workunit.client.0.smithi039.stdout:write ret = 32 2024-09-12T02:48:28.972 INFO:tasks.workunit.client.0.smithi039.stdout:pread ret = 64 2024-09-12T02:48:28.972 INFO:tasks.workunit.client.0.smithi039.stdout:558/600: open fd = 3 2024-09-12T02:48:28.972 INFO:tasks.workunit.client.0.smithi039.stdout:write ret = 32 2024-09-12T02:48:28.972 INFO:tasks.workunit.client.0.smithi039.stdout:write ret = 32 2024-09-12T02:48:28.972 INFO:tasks.workunit.client.0.smithi039.stdout:pread ret = 64 2024-09-12T02:48:28.972 INFO:tasks.workunit.client.0.smithi039.stdout:559/600: open fd = 3 2024-09-12T02:48:28.972 INFO:tasks.workunit.client.0.smithi039.stdout:write ret = 32 2024-09-12T02:48:28.972 INFO:tasks.workunit.client.0.smithi039.stdout:write ret = 32 2024-09-12T02:48:28.973 INFO:tasks.workunit.client.0.smithi039.stdout:pread ret = 64 2024-09-12T02:48:28.973 INFO:tasks.workunit.client.0.smithi039.stdout:560/600: open fd = 3 2024-09-12T02:48:28.973 INFO:tasks.workunit.client.0.smithi039.stdout:write ret = 32 2024-09-12T02:48:28.973 INFO:tasks.workunit.client.0.smithi039.stdout:write ret = 32 2024-09-12T02:48:28.973 INFO:tasks.workunit.client.0.smithi039.stdout:pread ret = 64 2024-09-12T02:48:29.850 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 02:48:29 smithi039 ceph-mon[30515]: pgmap v329: 129 pgs: 129 active+clean; 22 MiB data, 465 MiB used, 1.0 TiB / 1.0 TiB avail; 78 KiB/s rd, 74 KiB/s wr, 20 op/s 2024-09-12T02:48:29.948 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 12 02:48:29 smithi044 ceph-mon[35411]: pgmap v329: 129 pgs: 129 active+clean; 22 MiB data, 465 MiB used, 1.0 TiB / 1.0 TiB avail; 78 KiB/s rd, 74 KiB/s wr, 20 op/s 2024-09-12T02:48:30.013 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 12 02:48:29 smithi172 ceph-mon[35609]: pgmap v329: 129 pgs: 129 active+clean; 22 MiB data, 465 MiB used, 1.0 TiB / 1.0 TiB avail; 78 KiB/s rd, 74 KiB/s wr, 20 op/s 2024-09-12T02:48:31.849 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 02:48:31 smithi039 ceph-mon[30515]: pgmap v330: 129 pgs: 129 active+clean; 22 MiB data, 465 MiB used, 1.0 TiB / 1.0 TiB avail; 52 KiB/s rd, 49 KiB/s wr, 13 op/s 2024-09-12T02:48:31.948 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 12 02:48:31 smithi044 ceph-mon[35411]: pgmap v330: 129 pgs: 129 active+clean; 22 MiB data, 465 MiB used, 1.0 TiB / 1.0 TiB avail; 52 KiB/s rd, 49 KiB/s wr, 13 op/s 2024-09-12T02:48:32.013 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 12 02:48:31 smithi172 ceph-mon[35609]: pgmap v330: 129 pgs: 129 active+clean; 22 MiB data, 465 MiB used, 1.0 TiB / 1.0 TiB avail; 52 KiB/s rd, 49 KiB/s wr, 13 op/s 2024-09-12T02:48:33.850 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 02:48:33 smithi039 ceph-mon[30515]: pgmap v331: 129 pgs: 129 active+clean; 22 MiB data, 466 MiB used, 1.0 TiB / 1.0 TiB avail; 78 KiB/s rd, 73 KiB/s wr, 20 op/s 2024-09-12T02:48:33.948 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 12 02:48:33 smithi044 ceph-mon[35411]: pgmap v331: 129 pgs: 129 active+clean; 22 MiB data, 466 MiB used, 1.0 TiB / 1.0 TiB avail; 78 KiB/s rd, 73 KiB/s wr, 20 op/s 2024-09-12T02:48:34.013 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 12 02:48:33 smithi172 ceph-mon[35609]: pgmap v331: 129 pgs: 129 active+clean; 22 MiB data, 466 MiB used, 1.0 TiB / 1.0 TiB avail; 78 KiB/s rd, 73 KiB/s wr, 20 op/s 2024-09-12T02:48:35.850 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 02:48:35 smithi039 ceph-mon[30515]: pgmap v332: 129 pgs: 129 active+clean; 22 MiB data, 466 MiB used, 1.0 TiB / 1.0 TiB avail; 53 KiB/s rd, 50 KiB/s wr, 13 op/s 2024-09-12T02:48:35.949 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 12 02:48:35 smithi044 ceph-mon[35411]: pgmap v332: 129 pgs: 129 active+clean; 22 MiB data, 466 MiB used, 1.0 TiB / 1.0 TiB avail; 53 KiB/s rd, 50 KiB/s wr, 13 op/s 2024-09-12T02:48:36.013 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 12 02:48:35 smithi172 ceph-mon[35609]: pgmap v332: 129 pgs: 129 active+clean; 22 MiB data, 466 MiB used, 1.0 TiB / 1.0 TiB avail; 53 KiB/s rd, 50 KiB/s wr, 13 op/s 2024-09-12T02:48:37.850 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 02:48:37 smithi039 ceph-mon[30515]: pgmap v333: 129 pgs: 129 active+clean; 22 MiB data, 466 MiB used, 1.0 TiB / 1.0 TiB avail; 53 KiB/s rd, 50 KiB/s wr, 13 op/s 2024-09-12T02:48:37.948 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 12 02:48:37 smithi044 ceph-mon[35411]: pgmap v333: 129 pgs: 129 active+clean; 22 MiB data, 466 MiB used, 1.0 TiB / 1.0 TiB avail; 53 KiB/s rd, 50 KiB/s wr, 13 op/s 2024-09-12T02:48:38.013 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 12 02:48:37 smithi172 ceph-mon[35609]: pgmap v333: 129 pgs: 129 active+clean; 22 MiB data, 466 MiB used, 1.0 TiB / 1.0 TiB avail; 53 KiB/s rd, 50 KiB/s wr, 13 op/s 2024-09-12T02:48:39.850 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 02:48:39 smithi039 ceph-mon[30515]: pgmap v334: 129 pgs: 129 active+clean; 22 MiB data, 467 MiB used, 1.0 TiB / 1.0 TiB avail; 79 KiB/s rd, 74 KiB/s wr, 20 op/s 2024-09-12T02:48:39.949 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 12 02:48:39 smithi044 ceph-mon[35411]: pgmap v334: 129 pgs: 129 active+clean; 22 MiB data, 467 MiB used, 1.0 TiB / 1.0 TiB avail; 79 KiB/s rd, 74 KiB/s wr, 20 op/s 2024-09-12T02:48:40.013 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 12 02:48:39 smithi172 ceph-mon[35609]: pgmap v334: 129 pgs: 129 active+clean; 22 MiB data, 467 MiB used, 1.0 TiB / 1.0 TiB avail; 79 KiB/s rd, 74 KiB/s wr, 20 op/s 2024-09-12T02:48:41.849 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 02:48:41 smithi039 ceph-mon[30515]: pgmap v335: 129 pgs: 129 active+clean; 22 MiB data, 467 MiB used, 1.0 TiB / 1.0 TiB avail; 51 KiB/s rd, 48 KiB/s wr, 13 op/s 2024-09-12T02:48:41.949 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 12 02:48:41 smithi044 ceph-mon[35411]: pgmap v335: 129 pgs: 129 active+clean; 22 MiB data, 467 MiB used, 1.0 TiB / 1.0 TiB avail; 51 KiB/s rd, 48 KiB/s wr, 13 op/s 2024-09-12T02:48:42.013 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 12 02:48:41 smithi172 ceph-mon[35609]: pgmap v335: 129 pgs: 129 active+clean; 22 MiB data, 467 MiB used, 1.0 TiB / 1.0 TiB avail; 51 KiB/s rd, 48 KiB/s wr, 13 op/s 2024-09-12T02:48:43.849 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 02:48:43 smithi039 ceph-mon[30515]: pgmap v336: 129 pgs: 129 active+clean; 22 MiB data, 468 MiB used, 1.0 TiB / 1.0 TiB avail; 76 KiB/s rd, 66 KiB/s wr, 19 op/s 2024-09-12T02:48:43.949 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 12 02:48:43 smithi044 ceph-mon[35411]: pgmap v336: 129 pgs: 129 active+clean; 22 MiB data, 468 MiB used, 1.0 TiB / 1.0 TiB avail; 76 KiB/s rd, 66 KiB/s wr, 19 op/s 2024-09-12T02:48:44.013 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 12 02:48:43 smithi172 ceph-mon[35609]: pgmap v336: 129 pgs: 129 active+clean; 22 MiB data, 468 MiB used, 1.0 TiB / 1.0 TiB avail; 76 KiB/s rd, 66 KiB/s wr, 19 op/s 2024-09-12T02:48:45.850 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 02:48:45 smithi039 ceph-mon[30515]: pgmap v337: 129 pgs: 129 active+clean; 22 MiB data, 468 MiB used, 1.0 TiB / 1.0 TiB avail; 50 KiB/s rd, 43 KiB/s wr, 12 op/s 2024-09-12T02:48:45.948 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 12 02:48:45 smithi044 ceph-mon[35411]: pgmap v337: 129 pgs: 129 active+clean; 22 MiB data, 468 MiB used, 1.0 TiB / 1.0 TiB avail; 50 KiB/s rd, 43 KiB/s wr, 12 op/s 2024-09-12T02:48:46.013 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 12 02:48:45 smithi172 ceph-mon[35609]: pgmap v337: 129 pgs: 129 active+clean; 22 MiB data, 468 MiB used, 1.0 TiB / 1.0 TiB avail; 50 KiB/s rd, 43 KiB/s wr, 12 op/s 2024-09-12T02:48:47.849 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 02:48:47 smithi039 ceph-mon[30515]: pgmap v338: 129 pgs: 129 active+clean; 22 MiB data, 468 MiB used, 1.0 TiB / 1.0 TiB avail; 50 KiB/s rd, 43 KiB/s wr, 12 op/s 2024-09-12T02:48:47.948 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 12 02:48:47 smithi044 ceph-mon[35411]: pgmap v338: 129 pgs: 129 active+clean; 22 MiB data, 468 MiB used, 1.0 TiB / 1.0 TiB avail; 50 KiB/s rd, 43 KiB/s wr, 12 op/s 2024-09-12T02:48:48.013 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 12 02:48:47 smithi172 ceph-mon[35609]: pgmap v338: 129 pgs: 129 active+clean; 22 MiB data, 468 MiB used, 1.0 TiB / 1.0 TiB avail; 50 KiB/s rd, 43 KiB/s wr, 12 op/s 2024-09-12T02:48:49.849 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 02:48:49 smithi039 ceph-mon[30515]: pgmap v339: 129 pgs: 129 active+clean; 23 MiB data, 473 MiB used, 1.0 TiB / 1.0 TiB avail; 78 KiB/s rd, 69 KiB/s wr, 19 op/s 2024-09-12T02:48:49.948 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 12 02:48:49 smithi044 ceph-mon[35411]: pgmap v339: 129 pgs: 129 active+clean; 23 MiB data, 473 MiB used, 1.0 TiB / 1.0 TiB avail; 78 KiB/s rd, 69 KiB/s wr, 19 op/s 2024-09-12T02:48:50.013 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 12 02:48:49 smithi172 ceph-mon[35609]: pgmap v339: 129 pgs: 129 active+clean; 23 MiB data, 473 MiB used, 1.0 TiB / 1.0 TiB avail; 78 KiB/s rd, 69 KiB/s wr, 19 op/s 2024-09-12T02:48:51.849 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 02:48:51 smithi039 ceph-mon[30515]: pgmap v340: 129 pgs: 129 active+clean; 23 MiB data, 473 MiB used, 1.0 TiB / 1.0 TiB avail; 52 KiB/s rd, 45 KiB/s wr, 12 op/s 2024-09-12T02:48:51.948 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 12 02:48:51 smithi044 ceph-mon[35411]: pgmap v340: 129 pgs: 129 active+clean; 23 MiB data, 473 MiB used, 1.0 TiB / 1.0 TiB avail; 52 KiB/s rd, 45 KiB/s wr, 12 op/s 2024-09-12T02:48:52.013 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 12 02:48:51 smithi172 ceph-mon[35609]: pgmap v340: 129 pgs: 129 active+clean; 23 MiB data, 473 MiB used, 1.0 TiB / 1.0 TiB avail; 52 KiB/s rd, 45 KiB/s wr, 12 op/s 2024-09-12T02:48:53.849 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 02:48:53 smithi039 ceph-mon[30515]: pgmap v341: 129 pgs: 129 active+clean; 23 MiB data, 474 MiB used, 1.0 TiB / 1.0 TiB avail; 77 KiB/s rd, 68 KiB/s wr, 18 op/s 2024-09-12T02:48:53.948 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 12 02:48:53 smithi044 ceph-mon[35411]: pgmap v341: 129 pgs: 129 active+clean; 23 MiB data, 474 MiB used, 1.0 TiB / 1.0 TiB avail; 77 KiB/s rd, 68 KiB/s wr, 18 op/s 2024-09-12T02:48:54.013 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 12 02:48:53 smithi172 ceph-mon[35609]: pgmap v341: 129 pgs: 129 active+clean; 23 MiB data, 474 MiB used, 1.0 TiB / 1.0 TiB avail; 77 KiB/s rd, 68 KiB/s wr, 18 op/s 2024-09-12T02:48:55.850 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 02:48:55 smithi039 ceph-mon[30515]: pgmap v342: 129 pgs: 129 active+clean; 23 MiB data, 474 MiB used, 1.0 TiB / 1.0 TiB avail; 52 KiB/s rd, 49 KiB/s wr, 12 op/s 2024-09-12T02:48:55.948 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 12 02:48:55 smithi044 ceph-mon[35411]: pgmap v342: 129 pgs: 129 active+clean; 23 MiB data, 474 MiB used, 1.0 TiB / 1.0 TiB avail; 52 KiB/s rd, 49 KiB/s wr, 12 op/s 2024-09-12T02:48:56.013 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 12 02:48:55 smithi172 ceph-mon[35609]: pgmap v342: 129 pgs: 129 active+clean; 23 MiB data, 474 MiB used, 1.0 TiB / 1.0 TiB avail; 52 KiB/s rd, 49 KiB/s wr, 12 op/s 2024-09-12T02:48:57.850 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 02:48:57 smithi039 ceph-mon[30515]: pgmap v343: 129 pgs: 129 active+clean; 23 MiB data, 474 MiB used, 1.0 TiB / 1.0 TiB avail; 52 KiB/s rd, 49 KiB/s wr, 12 op/s 2024-09-12T02:48:57.948 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 12 02:48:57 smithi044 ceph-mon[35411]: pgmap v343: 129 pgs: 129 active+clean; 23 MiB data, 474 MiB used, 1.0 TiB / 1.0 TiB avail; 52 KiB/s rd, 49 KiB/s wr, 12 op/s 2024-09-12T02:48:58.013 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 12 02:48:57 smithi172 ceph-mon[35609]: pgmap v343: 129 pgs: 129 active+clean; 23 MiB data, 474 MiB used, 1.0 TiB / 1.0 TiB avail; 52 KiB/s rd, 49 KiB/s wr, 12 op/s 2024-09-12T02:48:59.850 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 02:48:59 smithi039 ceph-mon[30515]: pgmap v344: 129 pgs: 129 active+clean; 23 MiB data, 475 MiB used, 1.0 TiB / 1.0 TiB avail; 78 KiB/s rd, 74 KiB/s wr, 19 op/s 2024-09-12T02:48:59.948 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 12 02:48:59 smithi044 ceph-mon[35411]: pgmap v344: 129 pgs: 129 active+clean; 23 MiB data, 475 MiB used, 1.0 TiB / 1.0 TiB avail; 78 KiB/s rd, 74 KiB/s wr, 19 op/s 2024-09-12T02:49:00.013 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 12 02:48:59 smithi172 ceph-mon[35609]: pgmap v344: 129 pgs: 129 active+clean; 23 MiB data, 475 MiB used, 1.0 TiB / 1.0 TiB avail; 78 KiB/s rd, 74 KiB/s wr, 19 op/s 2024-09-12T02:49:01.849 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 02:49:01 smithi039 ceph-mon[30515]: pgmap v345: 129 pgs: 129 active+clean; 23 MiB data, 475 MiB used, 1.0 TiB / 1.0 TiB avail; 50 KiB/s rd, 47 KiB/s wr, 12 op/s 2024-09-12T02:49:01.948 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 12 02:49:01 smithi044 ceph-mon[35411]: pgmap v345: 129 pgs: 129 active+clean; 23 MiB data, 475 MiB used, 1.0 TiB / 1.0 TiB avail; 50 KiB/s rd, 47 KiB/s wr, 12 op/s 2024-09-12T02:49:02.013 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 12 02:49:01 smithi172 ceph-mon[35609]: pgmap v345: 129 pgs: 129 active+clean; 23 MiB data, 475 MiB used, 1.0 TiB / 1.0 TiB avail; 50 KiB/s rd, 47 KiB/s wr, 12 op/s 2024-09-12T02:49:03.948 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 12 02:49:03 smithi044 ceph-mon[35411]: pgmap v346: 129 pgs: 129 active+clean; 24 MiB data, 476 MiB used, 1.0 TiB / 1.0 TiB avail; 87 KiB/s rd, 117 KiB/s wr, 36 op/s 2024-09-12T02:49:03.949 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 12 02:49:03 smithi044 ceph-mon[35411]: osdmap e107: 12 total, 12 up, 12 in 2024-09-12T02:49:04.013 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 12 02:49:03 smithi172 ceph-mon[35609]: pgmap v346: 129 pgs: 129 active+clean; 24 MiB data, 476 MiB used, 1.0 TiB / 1.0 TiB avail; 87 KiB/s rd, 117 KiB/s wr, 36 op/s 2024-09-12T02:49:04.014 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 12 02:49:03 smithi172 ceph-mon[35609]: osdmap e107: 12 total, 12 up, 12 in 2024-09-12T02:49:04.099 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 02:49:03 smithi039 ceph-mon[30515]: pgmap v346: 129 pgs: 129 active+clean; 24 MiB data, 476 MiB used, 1.0 TiB / 1.0 TiB avail; 87 KiB/s rd, 117 KiB/s wr, 36 op/s 2024-09-12T02:49:04.100 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 02:49:03 smithi039 ceph-mon[30515]: osdmap e107: 12 total, 12 up, 12 in 2024-09-12T02:49:05.949 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 12 02:49:05 smithi044 ceph-mon[35411]: pgmap v348: 129 pgs: 129 active+clean; 24 MiB data, 476 MiB used, 1.0 TiB / 1.0 TiB avail; 75 KiB/s rd, 112 KiB/s wr, 35 op/s 2024-09-12T02:49:06.014 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 12 02:49:05 smithi172 ceph-mon[35609]: pgmap v348: 129 pgs: 129 active+clean; 24 MiB data, 476 MiB used, 1.0 TiB / 1.0 TiB avail; 75 KiB/s rd, 112 KiB/s wr, 35 op/s 2024-09-12T02:49:06.101 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 02:49:05 smithi039 ceph-mon[30515]: pgmap v348: 129 pgs: 129 active+clean; 24 MiB data, 476 MiB used, 1.0 TiB / 1.0 TiB avail; 75 KiB/s rd, 112 KiB/s wr, 35 op/s 2024-09-12T02:49:07.902 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 02:49:07 smithi039 ceph-mon[30515]: pgmap v349: 129 pgs: 129 active+clean; 24 MiB data, 476 MiB used, 1.0 TiB / 1.0 TiB avail; 75 KiB/s rd, 112 KiB/s wr, 35 op/s 2024-09-12T02:49:07.948 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 12 02:49:07 smithi044 ceph-mon[35411]: pgmap v349: 129 pgs: 129 active+clean; 24 MiB data, 476 MiB used, 1.0 TiB / 1.0 TiB avail; 75 KiB/s rd, 112 KiB/s wr, 35 op/s 2024-09-12T02:49:08.013 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 12 02:49:07 smithi172 ceph-mon[35609]: pgmap v349: 129 pgs: 129 active+clean; 24 MiB data, 476 MiB used, 1.0 TiB / 1.0 TiB avail; 75 KiB/s rd, 112 KiB/s wr, 35 op/s 2024-09-12T02:49:09.305 INFO:tasks.workunit.client.0.smithi039.stdout:561/600: open fd = 3 2024-09-12T02:49:09.306 INFO:tasks.workunit.client.0.smithi039.stdout:write ret = 32 2024-09-12T02:49:09.306 INFO:tasks.workunit.client.0.smithi039.stdout:write ret = 32 2024-09-12T02:49:09.306 INFO:tasks.workunit.client.0.smithi039.stdout:pread ret = 64 2024-09-12T02:49:09.306 INFO:tasks.workunit.client.0.smithi039.stdout:562/600: open fd = 3 2024-09-12T02:49:09.306 INFO:tasks.workunit.client.0.smithi039.stdout:write ret = 32 2024-09-12T02:49:09.306 INFO:tasks.workunit.client.0.smithi039.stdout:write ret = 32 2024-09-12T02:49:09.306 INFO:tasks.workunit.client.0.smithi039.stdout:pread ret = 64 2024-09-12T02:49:09.306 INFO:tasks.workunit.client.0.smithi039.stdout:563/600: open fd = 3 2024-09-12T02:49:09.306 INFO:tasks.workunit.client.0.smithi039.stdout:write ret = 32 2024-09-12T02:49:09.306 INFO:tasks.workunit.client.0.smithi039.stdout:write ret = 32 2024-09-12T02:49:09.306 INFO:tasks.workunit.client.0.smithi039.stdout:pread ret = 64 2024-09-12T02:49:09.307 INFO:tasks.workunit.client.0.smithi039.stdout:564/600: open fd = 3 2024-09-12T02:49:09.307 INFO:tasks.workunit.client.0.smithi039.stdout:write ret = 32 2024-09-12T02:49:09.307 INFO:tasks.workunit.client.0.smithi039.stdout:write ret = 32 2024-09-12T02:49:09.307 INFO:tasks.workunit.client.0.smithi039.stdout:pread ret = 64 2024-09-12T02:49:09.307 INFO:tasks.workunit.client.0.smithi039.stdout:565/600: open fd = 3 2024-09-12T02:49:09.307 INFO:tasks.workunit.client.0.smithi039.stdout:write ret = 32 2024-09-12T02:49:09.307 INFO:tasks.workunit.client.0.smithi039.stdout:write ret = 32 2024-09-12T02:49:09.307 INFO:tasks.workunit.client.0.smithi039.stdout:pread ret = 64 2024-09-12T02:49:09.307 INFO:tasks.workunit.client.0.smithi039.stdout:566/600: open fd = 3 2024-09-12T02:49:09.307 INFO:tasks.workunit.client.0.smithi039.stdout:write ret = 32 2024-09-12T02:49:09.307 INFO:tasks.workunit.client.0.smithi039.stdout:write ret = 32 2024-09-12T02:49:09.307 INFO:tasks.workunit.client.0.smithi039.stdout:pread ret = 64 2024-09-12T02:49:09.307 INFO:tasks.workunit.client.0.smithi039.stdout:567/600: open fd = 3 2024-09-12T02:49:09.307 INFO:tasks.workunit.client.0.smithi039.stdout:write ret = 32 2024-09-12T02:49:09.308 INFO:tasks.workunit.client.0.smithi039.stdout:write ret = 32 2024-09-12T02:49:09.308 INFO:tasks.workunit.client.0.smithi039.stdout:pread ret = 64 2024-09-12T02:49:09.308 INFO:tasks.workunit.client.0.smithi039.stdout:568/600: open fd = 3 2024-09-12T02:49:09.308 INFO:tasks.workunit.client.0.smithi039.stdout:write ret = 32 2024-09-12T02:49:09.308 INFO:tasks.workunit.client.0.smithi039.stdout:write ret = 32 2024-09-12T02:49:09.308 INFO:tasks.workunit.client.0.smithi039.stdout:pread ret = 64 2024-09-12T02:49:09.308 INFO:tasks.workunit.client.0.smithi039.stdout:569/600: open fd = 3 2024-09-12T02:49:09.308 INFO:tasks.workunit.client.0.smithi039.stdout:write ret = 32 2024-09-12T02:49:09.308 INFO:tasks.workunit.client.0.smithi039.stdout:write ret = 32 2024-09-12T02:49:09.308 INFO:tasks.workunit.client.0.smithi039.stdout:pread ret = 64 2024-09-12T02:49:09.308 INFO:tasks.workunit.client.0.smithi039.stdout:570/600: open fd = 3 2024-09-12T02:49:09.308 INFO:tasks.workunit.client.0.smithi039.stdout:write ret = 32 2024-09-12T02:49:09.308 INFO:tasks.workunit.client.0.smithi039.stdout:write ret = 32 2024-09-12T02:49:09.309 INFO:tasks.workunit.client.0.smithi039.stdout:pread ret = 64 2024-09-12T02:49:09.309 INFO:tasks.workunit.client.0.smithi039.stdout:571/600: open fd = 3 2024-09-12T02:49:09.309 INFO:tasks.workunit.client.0.smithi039.stdout:write ret = 32 2024-09-12T02:49:09.309 INFO:tasks.workunit.client.0.smithi039.stdout:write ret = 32 2024-09-12T02:49:09.309 INFO:tasks.workunit.client.0.smithi039.stdout:pread ret = 64 2024-09-12T02:49:09.309 INFO:tasks.workunit.client.0.smithi039.stdout:572/600: open fd = 3 2024-09-12T02:49:09.309 INFO:tasks.workunit.client.0.smithi039.stdout:write ret = 32 2024-09-12T02:49:09.309 INFO:tasks.workunit.client.0.smithi039.stdout:write ret = 32 2024-09-12T02:49:09.309 INFO:tasks.workunit.client.0.smithi039.stdout:pread ret = 64 2024-09-12T02:49:09.309 INFO:tasks.workunit.client.0.smithi039.stdout:573/600: open fd = 3 2024-09-12T02:49:09.309 INFO:tasks.workunit.client.0.smithi039.stdout:write ret = 32 2024-09-12T02:49:09.309 INFO:tasks.workunit.client.0.smithi039.stdout:write ret = 32 2024-09-12T02:49:09.309 INFO:tasks.workunit.client.0.smithi039.stdout:pread ret = 64 2024-09-12T02:49:09.309 INFO:tasks.workunit.client.0.smithi039.stdout:574/600: open fd = 3 2024-09-12T02:49:09.310 INFO:tasks.workunit.client.0.smithi039.stdout:write ret = 32 2024-09-12T02:49:09.310 INFO:tasks.workunit.client.0.smithi039.stdout:write ret = 32 2024-09-12T02:49:09.310 INFO:tasks.workunit.client.0.smithi039.stdout:pread ret = 64 2024-09-12T02:49:09.310 INFO:tasks.workunit.client.0.smithi039.stdout:575/600: open fd = 3 2024-09-12T02:49:09.310 INFO:tasks.workunit.client.0.smithi039.stdout:write ret = 32 2024-09-12T02:49:09.310 INFO:tasks.workunit.client.0.smithi039.stdout:write ret = 32 2024-09-12T02:49:09.310 INFO:tasks.workunit.client.0.smithi039.stdout:pread ret = 64 2024-09-12T02:49:09.310 INFO:tasks.workunit.client.0.smithi039.stdout:576/600: open fd = 3 2024-09-12T02:49:09.310 INFO:tasks.workunit.client.0.smithi039.stdout:write ret = 32 2024-09-12T02:49:09.310 INFO:tasks.workunit.client.0.smithi039.stdout:write ret = 32 2024-09-12T02:49:09.311 INFO:tasks.workunit.client.0.smithi039.stdout:pread ret = 64 2024-09-12T02:49:09.311 INFO:tasks.workunit.client.0.smithi039.stdout:577/600: open fd = 3 2024-09-12T02:49:09.311 INFO:tasks.workunit.client.0.smithi039.stdout:write ret = 32 2024-09-12T02:49:09.311 INFO:tasks.workunit.client.0.smithi039.stdout:write ret = 32 2024-09-12T02:49:09.311 INFO:tasks.workunit.client.0.smithi039.stdout:pread ret = 64 2024-09-12T02:49:09.311 INFO:tasks.workunit.client.0.smithi039.stdout:578/600: open fd = 3 2024-09-12T02:49:09.311 INFO:tasks.workunit.client.0.smithi039.stdout:write ret = 32 2024-09-12T02:49:09.311 INFO:tasks.workunit.client.0.smithi039.stdout:write ret = 32 2024-09-12T02:49:09.311 INFO:tasks.workunit.client.0.smithi039.stdout:pread ret = 64 2024-09-12T02:49:09.311 INFO:tasks.workunit.client.0.smithi039.stdout:579/600: open fd = 3 2024-09-12T02:49:09.311 INFO:tasks.workunit.client.0.smithi039.stdout:write ret = 32 2024-09-12T02:49:09.311 INFO:tasks.workunit.client.0.smithi039.stdout:write ret = 32 2024-09-12T02:49:09.311 INFO:tasks.workunit.client.0.smithi039.stdout:pread ret = 64 2024-09-12T02:49:09.311 INFO:tasks.workunit.client.0.smithi039.stdout:580/600: open fd = 3 2024-09-12T02:49:09.312 INFO:tasks.workunit.client.0.smithi039.stdout:write ret = 32 2024-09-12T02:49:09.312 INFO:tasks.workunit.client.0.smithi039.stdout:write ret = 32 2024-09-12T02:49:09.312 INFO:tasks.workunit.client.0.smithi039.stdout:pread ret = 64 2024-09-12T02:49:09.312 INFO:tasks.workunit.client.0.smithi039.stdout:581/600: open fd = 3 2024-09-12T02:49:09.312 INFO:tasks.workunit.client.0.smithi039.stdout:write ret = 32 2024-09-12T02:49:09.312 INFO:tasks.workunit.client.0.smithi039.stdout:write ret = 32 2024-09-12T02:49:09.312 INFO:tasks.workunit.client.0.smithi039.stdout:pread ret = 64 2024-09-12T02:49:09.312 INFO:tasks.workunit.client.0.smithi039.stdout:582/600: open fd = 3 2024-09-12T02:49:09.312 INFO:tasks.workunit.client.0.smithi039.stdout:write ret = 32 2024-09-12T02:49:09.312 INFO:tasks.workunit.client.0.smithi039.stdout:write ret = 32 2024-09-12T02:49:09.312 INFO:tasks.workunit.client.0.smithi039.stdout:pread ret = 64 2024-09-12T02:49:09.312 INFO:tasks.workunit.client.0.smithi039.stdout:583/600: open fd = 3 2024-09-12T02:49:09.312 INFO:tasks.workunit.client.0.smithi039.stdout:write ret = 32 2024-09-12T02:49:09.312 INFO:tasks.workunit.client.0.smithi039.stdout:write ret = 32 2024-09-12T02:49:09.313 INFO:tasks.workunit.client.0.smithi039.stdout:pread ret = 64 2024-09-12T02:49:09.313 INFO:tasks.workunit.client.0.smithi039.stdout:584/600: open fd = 3 2024-09-12T02:49:09.313 INFO:tasks.workunit.client.0.smithi039.stdout:write ret = 32 2024-09-12T02:49:09.313 INFO:tasks.workunit.client.0.smithi039.stdout:write ret = 32 2024-09-12T02:49:09.313 INFO:tasks.workunit.client.0.smithi039.stdout:pread ret = 64 2024-09-12T02:49:09.313 INFO:tasks.workunit.client.0.smithi039.stdout:585/600: open fd = 3 2024-09-12T02:49:09.313 INFO:tasks.workunit.client.0.smithi039.stdout:write ret = 32 2024-09-12T02:49:09.313 INFO:tasks.workunit.client.0.smithi039.stdout:write ret = 32 2024-09-12T02:49:09.313 INFO:tasks.workunit.client.0.smithi039.stdout:pread ret = 64 2024-09-12T02:49:09.313 INFO:tasks.workunit.client.0.smithi039.stdout:586/600: open fd = 3 2024-09-12T02:49:09.313 INFO:tasks.workunit.client.0.smithi039.stdout:write ret = 32 2024-09-12T02:49:09.313 INFO:tasks.workunit.client.0.smithi039.stdout:write ret = 32 2024-09-12T02:49:09.313 INFO:tasks.workunit.client.0.smithi039.stdout:pread ret = 64 2024-09-12T02:49:09.314 INFO:tasks.workunit.client.0.smithi039.stdout:587/600: open fd = 3 2024-09-12T02:49:09.314 INFO:tasks.workunit.client.0.smithi039.stdout:write ret = 32 2024-09-12T02:49:09.314 INFO:tasks.workunit.client.0.smithi039.stdout:write ret = 32 2024-09-12T02:49:09.314 INFO:tasks.workunit.client.0.smithi039.stdout:pread ret = 64 2024-09-12T02:49:09.314 INFO:tasks.workunit.client.0.smithi039.stdout:588/600: open fd = 3 2024-09-12T02:49:09.314 INFO:tasks.workunit.client.0.smithi039.stdout:write ret = 32 2024-09-12T02:49:09.314 INFO:tasks.workunit.client.0.smithi039.stdout:write ret = 32 2024-09-12T02:49:09.314 INFO:tasks.workunit.client.0.smithi039.stdout:pread ret = 64 2024-09-12T02:49:09.314 INFO:tasks.workunit.client.0.smithi039.stdout:589/600: open fd = 3 2024-09-12T02:49:09.314 INFO:tasks.workunit.client.0.smithi039.stdout:write ret = 32 2024-09-12T02:49:09.314 INFO:tasks.workunit.client.0.smithi039.stdout:write ret = 32 2024-09-12T02:49:09.314 INFO:tasks.workunit.client.0.smithi039.stdout:pread ret = 64 2024-09-12T02:49:09.314 INFO:tasks.workunit.client.0.smithi039.stdout:590/600: open fd = 3 2024-09-12T02:49:09.315 INFO:tasks.workunit.client.0.smithi039.stdout:write ret = 32 2024-09-12T02:49:09.315 INFO:tasks.workunit.client.0.smithi039.stdout:write ret = 32 2024-09-12T02:49:09.315 INFO:tasks.workunit.client.0.smithi039.stdout:pread ret = 64 2024-09-12T02:49:09.315 INFO:tasks.workunit.client.0.smithi039.stdout:591/600: open fd = 3 2024-09-12T02:49:09.315 INFO:tasks.workunit.client.0.smithi039.stdout:write ret = 32 2024-09-12T02:49:09.315 INFO:tasks.workunit.client.0.smithi039.stdout:write ret = 32 2024-09-12T02:49:09.315 INFO:tasks.workunit.client.0.smithi039.stdout:pread ret = 64 2024-09-12T02:49:09.315 INFO:tasks.workunit.client.0.smithi039.stdout:592/600: open fd = 3 2024-09-12T02:49:09.315 INFO:tasks.workunit.client.0.smithi039.stdout:write ret = 32 2024-09-12T02:49:09.315 INFO:tasks.workunit.client.0.smithi039.stdout:write ret = 32 2024-09-12T02:49:09.315 INFO:tasks.workunit.client.0.smithi039.stdout:pread ret = 64 2024-09-12T02:49:09.315 INFO:tasks.workunit.client.0.smithi039.stdout:593/600: open fd = 3 2024-09-12T02:49:09.316 INFO:tasks.workunit.client.0.smithi039.stdout:write ret = 32 2024-09-12T02:49:09.316 INFO:tasks.workunit.client.0.smithi039.stdout:write ret = 32 2024-09-12T02:49:09.316 INFO:tasks.workunit.client.0.smithi039.stdout:pread ret = 64 2024-09-12T02:49:09.316 INFO:tasks.workunit.client.0.smithi039.stdout:594/600: open fd = 3 2024-09-12T02:49:09.316 INFO:tasks.workunit.client.0.smithi039.stdout:write ret = 32 2024-09-12T02:49:09.316 INFO:tasks.workunit.client.0.smithi039.stdout:write ret = 32 2024-09-12T02:49:09.316 INFO:tasks.workunit.client.0.smithi039.stdout:pread ret = 64 2024-09-12T02:49:09.316 INFO:tasks.workunit.client.0.smithi039.stdout:595/600: open fd = 3 2024-09-12T02:49:09.316 INFO:tasks.workunit.client.0.smithi039.stdout:write ret = 32 2024-09-12T02:49:09.316 INFO:tasks.workunit.client.0.smithi039.stdout:write ret = 32 2024-09-12T02:49:09.316 INFO:tasks.workunit.client.0.smithi039.stdout:pread ret = 64 2024-09-12T02:49:09.316 INFO:tasks.workunit.client.0.smithi039.stdout:596/600: open fd = 3 2024-09-12T02:49:09.316 INFO:tasks.workunit.client.0.smithi039.stdout:write ret = 32 2024-09-12T02:49:09.317 INFO:tasks.workunit.client.0.smithi039.stdout:write ret = 32 2024-09-12T02:49:09.317 INFO:tasks.workunit.client.0.smithi039.stdout:pread ret = 64 2024-09-12T02:49:09.317 INFO:tasks.workunit.client.0.smithi039.stdout:597/600: open fd = 3 2024-09-12T02:49:09.317 INFO:tasks.workunit.client.0.smithi039.stdout:write ret = 32 2024-09-12T02:49:09.317 INFO:tasks.workunit.client.0.smithi039.stdout:write ret = 32 2024-09-12T02:49:09.317 INFO:tasks.workunit.client.0.smithi039.stdout:pread ret = 64 2024-09-12T02:49:09.317 INFO:tasks.workunit.client.0.smithi039.stdout:598/600: open fd = 3 2024-09-12T02:49:09.317 INFO:tasks.workunit.client.0.smithi039.stdout:write ret = 32 2024-09-12T02:49:09.317 INFO:tasks.workunit.client.0.smithi039.stdout:write ret = 32 2024-09-12T02:49:09.317 INFO:tasks.workunit.client.0.smithi039.stdout:pread ret = 64 2024-09-12T02:49:09.317 INFO:tasks.workunit.client.0.smithi039.stdout:599/600: open fd = 3 2024-09-12T02:49:09.317 INFO:tasks.workunit.client.0.smithi039.stdout:write ret = 32 2024-09-12T02:49:09.317 INFO:tasks.workunit.client.0.smithi039.stdout:write ret = 32 2024-09-12T02:49:09.317 INFO:tasks.workunit.client.0.smithi039.stdout:pread ret = 64 2024-09-12T02:49:09.318 INFO:tasks.workunit.client.0.smithi039.stdout:600/600: open fd = 3 2024-09-12T02:49:09.318 INFO:tasks.workunit.client.0.smithi039.stdout:write ret = 32 2024-09-12T02:49:09.318 INFO:tasks.workunit.client.0.smithi039.stdout:write ret = 32 2024-09-12T02:49:09.318 INFO:tasks.workunit.client.0.smithi039.stdout:pread ret = 64 2024-09-12T02:49:09.318 INFO:tasks.workunit.client.0.smithi039.stderr:+ echo OK 2024-09-12T02:49:09.319 INFO:tasks.workunit.client.0.smithi039.stdout:OK 2024-09-12T02:49:09.320 INFO:teuthology.orchestra.run:Running command with timeout 3600 2024-09-12T02:49:09.320 DEBUG:teuthology.orchestra.run.smithi039:> sudo rm -rf -- /home/ubuntu/cephtest/mnt.0/client.0/tmp 2024-09-12T02:49:09.399 INFO:tasks.workunit:Stopping ['fs/test_o_trunc.sh'] on client.0... 2024-09-12T02:49:09.399 DEBUG:teuthology.orchestra.run.smithi039:> sudo rm -rf -- /home/ubuntu/cephtest/workunits.list.client.0 /home/ubuntu/cephtest/clone.client.0 2024-09-12T02:49:09.849 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 02:49:09 smithi039 ceph-mon[30515]: pgmap v350: 129 pgs: 129 active+clean; 24 MiB data, 485 MiB used, 1.0 TiB / 1.0 TiB avail; 81 KiB/s rd, 119 KiB/s wr, 36 op/s 2024-09-12T02:49:09.948 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 12 02:49:09 smithi044 ceph-mon[35411]: pgmap v350: 129 pgs: 129 active+clean; 24 MiB data, 485 MiB used, 1.0 TiB / 1.0 TiB avail; 81 KiB/s rd, 119 KiB/s wr, 36 op/s 2024-09-12T02:49:10.013 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 12 02:49:09 smithi172 ceph-mon[35609]: pgmap v350: 129 pgs: 129 active+clean; 24 MiB data, 485 MiB used, 1.0 TiB / 1.0 TiB avail; 81 KiB/s rd, 119 KiB/s wr, 36 op/s 2024-09-12T02:49:10.529 DEBUG:teuthology.parallel:result is None 2024-09-12T02:49:10.529 DEBUG:teuthology.orchestra.run.smithi039:> sudo rm -rf -- /home/ubuntu/cephtest/mnt.0/client.0 2024-09-12T02:49:10.601 INFO:tasks.workunit:Deleted dir /home/ubuntu/cephtest/mnt.0/client.0 2024-09-12T02:49:10.601 DEBUG:teuthology.run_tasks:Unwinding manager full_sequential_finally 2024-09-12T02:49:10.611 INFO:teuthology.task.full_sequential_finally:In full_sequential_finally, running task exec... 2024-09-12T02:49:10.611 INFO:teuthology.task.exec:Executing custom commands... 2024-09-12T02:49:10.611 INFO:teuthology.task.exec:Running commands on role mon.a host ubuntu@smithi039.front.sepia.ceph.com 2024-09-12T02:49:10.611 DEBUG:teuthology.orchestra.run.smithi039:> sudo TESTDIR=/home/ubuntu/cephtest bash -c 'date +%s > END_TIME' 2024-09-12T02:49:10.671 DEBUG:teuthology.orchestra.run.smithi039:> sudo TESTDIR=/home/ubuntu/cephtest bash -c 'START_TIME=$(cat START_TIME); END_TIME=$(cat END_TIME); DIFF_TIME=$((600-(END_TIME-START_TIME))); if [ "$DIFF_TIME" -gt 0 ]; then sleep "$DIFF_TIME"; fi' 2024-09-12T02:49:10.732 DEBUG:teuthology.orchestra.run.smithi039:> sudo TESTDIR=/home/ubuntu/cephtest bash -c 'ceph fs snap-schedule status --fs=cephfs --path=/' 2024-09-12T02:49:10.889 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:49:10.888+0000 7fcc89600640 1 -- 172.21.15.39:0/3652888870 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fcc84112960 msgr2=0x7fcc84114d50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:49:10.889 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:49:10.888+0000 7fcc89600640 1 --2- 172.21.15.39:0/3652888870 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fcc84112960 0x7fcc84114d50 secure :-1 s=READY pgs=293 cs=0 l=1 rev1=1 crypto rx=0x7fcc7c009ca0 tx=0x7fcc7c02a8c0 comp rx=0 tx=0).stop 2024-09-12T02:49:10.889 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:49:10.888+0000 7fcc89600640 1 -- 172.21.15.39:0/3652888870 shutdown_connections 2024-09-12T02:49:10.889 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:49:10.888+0000 7fcc89600640 1 --2- 172.21.15.39:0/3652888870 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fcc84112960 0x7fcc84114d50 unknown :-1 s=CLOSED pgs=293 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:49:10.889 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:49:10.888+0000 7fcc89600640 1 --2- 172.21.15.39:0/3652888870 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fcc84077040 0x7fcc84112420 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:49:10.890 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:49:10.888+0000 7fcc89600640 1 --2- 172.21.15.39:0/3652888870 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fcc84076720 0x7fcc84076b00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:49:10.890 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:49:10.888+0000 7fcc89600640 1 -- 172.21.15.39:0/3652888870 >> 172.21.15.39:0/3652888870 conn(0x7fcc840ff980 msgr2=0x7fcc84101da0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:49:10.890 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:49:10.888+0000 7fcc89600640 1 -- 172.21.15.39:0/3652888870 shutdown_connections 2024-09-12T02:49:10.890 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:49:10.888+0000 7fcc89600640 1 -- 172.21.15.39:0/3652888870 wait complete. 2024-09-12T02:49:10.892 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:49:10.889+0000 7fcc89600640 1 Processor -- start 2024-09-12T02:49:10.892 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:49:10.889+0000 7fcc89600640 1 -- start start 2024-09-12T02:49:10.892 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:49:10.890+0000 7fcc89600640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fcc84076720 0x7fcc841a4650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:49:10.892 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:49:10.890+0000 7fcc89600640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fcc84077040 0x7fcc841a4b90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:49:10.892 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:49:10.890+0000 7fcc89600640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fcc84112960 0x7fcc8419e7c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:49:10.892 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:49:10.890+0000 7fcc89600640 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 -- 0x7fcc841184b0 con 0x7fcc84076720 2024-09-12T02:49:10.892 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:49:10.890+0000 7fcc89600640 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x7fcc84118330 con 0x7fcc84077040 2024-09-12T02:49:10.892 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:49:10.890+0000 7fcc89600640 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7fcc84118630 con 0x7fcc84112960 2024-09-12T02:49:10.893 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:49:10.890+0000 7fcc82a00640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fcc84076720 0x7fcc841a4650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:49:10.893 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:49:10.890+0000 7fcc82a00640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fcc84076720 0x7fcc841a4650 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.39:3300/0 says I am v2:172.21.15.39:42720/0 (socket says 172.21.15.39:42720) 2024-09-12T02:49:10.893 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:49:10.890+0000 7fcc82a00640 1 -- 172.21.15.39:0/2630497852 learned_addr learned my addr 172.21.15.39:0/2630497852 (peer_addr_for_me v2:172.21.15.39:0/0) 2024-09-12T02:49:10.893 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:49:10.890+0000 7fcc7be00640 1 --2- 172.21.15.39:0/2630497852 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fcc84077040 0x7fcc841a4b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:49:10.893 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:49:10.890+0000 7fcc83400640 1 --2- 172.21.15.39:0/2630497852 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fcc84112960 0x7fcc8419e7c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:49:10.893 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:49:10.890+0000 7fcc82a00640 1 -- 172.21.15.39:0/2630497852 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fcc84112960 msgr2=0x7fcc8419e7c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:49:10.893 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:49:10.890+0000 7fcc82a00640 1 --2- 172.21.15.39:0/2630497852 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fcc84112960 0x7fcc8419e7c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:49:10.893 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:49:10.890+0000 7fcc82a00640 1 -- 172.21.15.39:0/2630497852 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fcc84077040 msgr2=0x7fcc841a4b90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:49:10.893 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:49:10.890+0000 7fcc82a00640 1 --2- 172.21.15.39:0/2630497852 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fcc84077040 0x7fcc841a4b90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:49:10.893 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:49:10.890+0000 7fcc82a00640 1 -- 172.21.15.39:0/2630497852 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fcc8419ef90 con 0x7fcc84076720 2024-09-12T02:49:10.893 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:49:10.890+0000 7fcc7be00640 1 --2- 172.21.15.39:0/2630497852 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fcc84077040 0x7fcc841a4b90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-12T02:49:10.893 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:49:10.891+0000 7fcc82a00640 1 --2- 172.21.15.39:0/2630497852 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fcc84076720 0x7fcc841a4650 secure :-1 s=READY pgs=294 cs=0 l=1 rev1=1 crypto rx=0x7fcc7400e9f0 tx=0x7fcc7400edf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:49:10.893 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:49:10.891+0000 7fcc7b400640 1 -- 172.21.15.39:0/2630497852 <== mon.0 v2:172.21.15.39:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcc7400cd80 con 0x7fcc84076720 2024-09-12T02:49:10.893 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:49:10.891+0000 7fcc7b400640 1 -- 172.21.15.39:0/2630497852 <== mon.0 v2:172.21.15.39:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fcc74005500 con 0x7fcc84076720 2024-09-12T02:49:10.894 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:49:10.891+0000 7fcc89600640 1 -- 172.21.15.39:0/2630497852 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fcc8419f280 con 0x7fcc84076720 2024-09-12T02:49:10.894 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:49:10.891+0000 7fcc7b400640 1 -- 172.21.15.39:0/2630497852 <== mon.0 v2:172.21.15.39:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcc74010690 con 0x7fcc84076720 2024-09-12T02:49:10.894 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:49:10.891+0000 7fcc89600640 1 -- 172.21.15.39:0/2630497852 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fcc841ab4a0 con 0x7fcc84076720 2024-09-12T02:49:10.894 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:49:10.892+0000 7fcc89600640 1 -- 172.21.15.39:0/2630497852 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fcc84077e60 con 0x7fcc84076720 2024-09-12T02:49:10.895 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:49:10.894+0000 7fcc7b400640 1 -- 172.21.15.39:0/2630497852 <== mon.0 v2:172.21.15.39:3300/0 4 ==== mgrmap(e 27) ==== 137964+0+0 (secure 0 0 0) 0x7fcc740046c0 con 0x7fcc84076720 2024-09-12T02:49:10.896 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:49:10.895+0000 7fcc7b400640 1 --2- 172.21.15.39:0/2630497852 >> [v2:172.21.15.39:6800/2187509357,v1:172.21.15.39:6801/2187509357] conn(0x7fcc680a2e20 0x7fcc680a52e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:49:10.896 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:49:10.895+0000 7fcc7b400640 1 -- 172.21.15.39:0/2630497852 <== mon.0 v2:172.21.15.39:3300/0 5 ==== osd_map(107..107 src has 1..107) ==== 9563+0+0 (secure 0 0 0) 0x7fcc740cfc40 con 0x7fcc84076720 2024-09-12T02:49:10.896 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:49:10.896+0000 7fcc7be00640 1 --2- 172.21.15.39:0/2630497852 >> [v2:172.21.15.39:6800/2187509357,v1:172.21.15.39:6801/2187509357] conn(0x7fcc680a2e20 0x7fcc680a52e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:49:10.897 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:49:10.896+0000 7fcc7be00640 1 --2- 172.21.15.39:0/2630497852 >> [v2:172.21.15.39:6800/2187509357,v1:172.21.15.39:6801/2187509357] conn(0x7fcc680a2e20 0x7fcc680a52e0 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 crypto rx=0x7fcc84103540 tx=0x7fcc6c005f90 comp rx=0 tx=0).ready entity=mgr.25199 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:49:10.900 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:49:10.900+0000 7fcc7b400640 1 -- 172.21.15.39:0/2630497852 <== mon.0 v2:172.21.15.39:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7fcc7409c3f0 con 0x7fcc84076720 2024-09-12T02:49:11.107 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:49:11.106+0000 7fcc89600640 1 -- 172.21.15.39:0/2630497852 --> [v2:172.21.15.39:6800/2187509357,v1:172.21.15.39:6801/2187509357] -- mgr_command(tid 0: {"prefix": "fs snap-schedule status", "fs": "cephfs", "path": "/", "target": ["mon-mgr", ""]}) -- 0x7fcc84114610 con 0x7fcc680a2e20 2024-09-12T02:49:11.116 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:49:11.115+0000 7fcc7b400640 1 -- 172.21.15.39:0/2630497852 <== mgr.25199 v2:172.21.15.39:6800/2187509357 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+350 (secure 0 0 0) 0x7fcc84114610 con 0x7fcc680a2e20 2024-09-12T02:49:11.116 INFO:teuthology.orchestra.run.smithi039.stdout:{"fs": "cephfs", "subvol": null, "group": null, "path": "/", "rel_path": "/", "schedule": "1m", "retention": {"m": 6, "h": 3}, "start": "2024-09-12T00:00:00", "created": "2024-09-12T02:37:58", "first": "2024-09-12T02:38:00", "last": "2024-09-12T02:49:00", "last_pruned": "2024-09-12T02:49:00", "created_count": 12, "pruned_count": 6, "active": true} 2024-09-12T02:49:11.118 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:49:11.117+0000 7fcc89600640 1 -- 172.21.15.39:0/2630497852 >> [v2:172.21.15.39:6800/2187509357,v1:172.21.15.39:6801/2187509357] conn(0x7fcc680a2e20 msgr2=0x7fcc680a52e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:49:11.118 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:49:11.117+0000 7fcc89600640 1 --2- 172.21.15.39:0/2630497852 >> [v2:172.21.15.39:6800/2187509357,v1:172.21.15.39:6801/2187509357] conn(0x7fcc680a2e20 0x7fcc680a52e0 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 crypto rx=0x7fcc84103540 tx=0x7fcc6c005f90 comp rx=0 tx=0).stop 2024-09-12T02:49:11.118 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:49:11.117+0000 7fcc89600640 1 -- 172.21.15.39:0/2630497852 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fcc84076720 msgr2=0x7fcc841a4650 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:49:11.118 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:49:11.117+0000 7fcc89600640 1 --2- 172.21.15.39:0/2630497852 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fcc84076720 0x7fcc841a4650 secure :-1 s=READY pgs=294 cs=0 l=1 rev1=1 crypto rx=0x7fcc7400e9f0 tx=0x7fcc7400edf0 comp rx=0 tx=0).stop 2024-09-12T02:49:11.118 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:49:11.117+0000 7fcc89600640 1 -- 172.21.15.39:0/2630497852 shutdown_connections 2024-09-12T02:49:11.119 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:49:11.117+0000 7fcc89600640 1 --2- 172.21.15.39:0/2630497852 >> [v2:172.21.15.39:6800/2187509357,v1:172.21.15.39:6801/2187509357] conn(0x7fcc680a2e20 0x7fcc680a52e0 unknown :-1 s=CLOSED pgs=44 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:49:11.119 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:49:11.117+0000 7fcc89600640 1 --2- 172.21.15.39:0/2630497852 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fcc84112960 0x7fcc8419e7c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:49:11.119 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:49:11.117+0000 7fcc89600640 1 --2- 172.21.15.39:0/2630497852 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fcc84077040 0x7fcc841a4b90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:49:11.119 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:49:11.117+0000 7fcc89600640 1 --2- 172.21.15.39:0/2630497852 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fcc84076720 0x7fcc841a4650 unknown :-1 s=CLOSED pgs=294 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:49:11.119 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:49:11.117+0000 7fcc89600640 1 -- 172.21.15.39:0/2630497852 >> 172.21.15.39:0/2630497852 conn(0x7fcc840ff980 msgr2=0x7fcc84101d70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:49:11.119 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:49:11.117+0000 7fcc89600640 1 -- 172.21.15.39:0/2630497852 shutdown_connections 2024-09-12T02:49:11.119 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:49:11.118+0000 7fcc89600640 1 -- 172.21.15.39:0/2630497852 wait complete. 2024-09-12T02:49:11.134 DEBUG:teuthology.orchestra.run.smithi039:> sudo TESTDIR=/home/ubuntu/cephtest bash -c 'ceph fs snap-schedule list --fs=cephfs --path=/ --recursive=true' 2024-09-12T02:49:11.291 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:49:11.290+0000 7fb040600640 1 -- 172.21.15.39:0/3485857310 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fb038101ac0 msgr2=0x7fb038101f20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:49:11.291 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:49:11.290+0000 7fb040600640 1 --2- 172.21.15.39:0/3485857310 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fb038101ac0 0x7fb038101f20 secure :-1 s=READY pgs=295 cs=0 l=1 rev1=1 crypto rx=0x7fb024009930 tx=0x7fb02402a440 comp rx=0 tx=0).stop 2024-09-12T02:49:11.291 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:49:11.290+0000 7fb040600640 1 -- 172.21.15.39:0/3485857310 shutdown_connections 2024-09-12T02:49:11.291 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:49:11.290+0000 7fb040600640 1 --2- 172.21.15.39:0/3485857310 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fb038102460 0x7fb03810e990 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:49:11.291 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:49:11.290+0000 7fb040600640 1 --2- 172.21.15.39:0/3485857310 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fb038101ac0 0x7fb038101f20 unknown :-1 s=CLOSED pgs=295 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:49:11.291 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:49:11.290+0000 7fb040600640 1 --2- 172.21.15.39:0/3485857310 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fb038107ad0 0x7fb038107eb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:49:11.291 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:49:11.290+0000 7fb040600640 1 -- 172.21.15.39:0/3485857310 >> 172.21.15.39:0/3485857310 conn(0x7fb0380fd7e0 msgr2=0x7fb0380ffc00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:49:11.292 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:49:11.290+0000 7fb040600640 1 -- 172.21.15.39:0/3485857310 shutdown_connections 2024-09-12T02:49:11.292 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:49:11.290+0000 7fb040600640 1 -- 172.21.15.39:0/3485857310 wait complete. 2024-09-12T02:49:11.293 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:49:11.291+0000 7fb040600640 1 Processor -- start 2024-09-12T02:49:11.294 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:49:11.291+0000 7fb040600640 1 -- start start 2024-09-12T02:49:11.294 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:49:11.291+0000 7fb040600640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fb038101ac0 0x7fb03819a5a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:49:11.294 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:49:11.291+0000 7fb040600640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fb038102460 0x7fb03819aae0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:49:11.294 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:49:11.291+0000 7fb040600640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fb038107ad0 0x7fb03819ee60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:49:11.294 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:49:11.291+0000 7fb040600640 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 -- 0x7fb038111f20 con 0x7fb038102460 2024-09-12T02:49:11.294 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:49:11.292+0000 7fb040600640 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x7fb038111da0 con 0x7fb038101ac0 2024-09-12T02:49:11.294 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:49:11.292+0000 7fb040600640 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7fb0381120a0 con 0x7fb038107ad0 2024-09-12T02:49:11.294 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:49:11.292+0000 7fb03dc00640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fb038101ac0 0x7fb03819a5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:49:11.294 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:49:11.292+0000 7fb03d200640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fb038102460 0x7fb03819aae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:49:11.294 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:49:11.292+0000 7fb03dc00640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fb038101ac0 0x7fb03819a5a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.39:38960/0 (socket says 172.21.15.39:38960) 2024-09-12T02:49:11.294 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:49:11.292+0000 7fb03dc00640 1 -- 172.21.15.39:0/3776944139 learned_addr learned my addr 172.21.15.39:0/3776944139 (peer_addr_for_me v2:172.21.15.39:0/0) 2024-09-12T02:49:11.294 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:49:11.292+0000 7fb03e600640 1 --2- 172.21.15.39:0/3776944139 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fb038107ad0 0x7fb03819ee60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:49:11.294 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:49:11.292+0000 7fb03dc00640 1 -- 172.21.15.39:0/3776944139 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fb038107ad0 msgr2=0x7fb03819ee60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:49:11.295 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:49:11.292+0000 7fb03dc00640 1 --2- 172.21.15.39:0/3776944139 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fb038107ad0 0x7fb03819ee60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:49:11.295 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:49:11.292+0000 7fb03dc00640 1 -- 172.21.15.39:0/3776944139 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fb038102460 msgr2=0x7fb03819aae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:49:11.295 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:49:11.292+0000 7fb03dc00640 1 --2- 172.21.15.39:0/3776944139 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fb038102460 0x7fb03819aae0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:49:11.295 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:49:11.292+0000 7fb03dc00640 1 -- 172.21.15.39:0/3776944139 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb03819f590 con 0x7fb038101ac0 2024-09-12T02:49:11.295 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:49:11.292+0000 7fb03dc00640 1 --2- 172.21.15.39:0/3776944139 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fb038101ac0 0x7fb03819a5a0 secure :-1 s=READY pgs=146 cs=0 l=1 rev1=1 crypto rx=0x7fb02c00e9f0 tx=0x7fb02c00eeb0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:49:11.295 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:49:11.293+0000 7fb036000640 1 -- 172.21.15.39:0/3776944139 <== mon.2 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb02c00cd80 con 0x7fb038101ac0 2024-09-12T02:49:11.295 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:49:11.293+0000 7fb036000640 1 -- 172.21.15.39:0/3776944139 <== mon.2 v2:172.21.15.44:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fb02c010910 con 0x7fb038101ac0 2024-09-12T02:49:11.295 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:49:11.293+0000 7fb040600640 1 -- 172.21.15.39:0/3776944139 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb03819f880 con 0x7fb038101ac0 2024-09-12T02:49:11.295 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:49:11.293+0000 7fb036000640 1 -- 172.21.15.39:0/3776944139 <== mon.2 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb02c018990 con 0x7fb038101ac0 2024-09-12T02:49:11.296 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:49:11.293+0000 7fb040600640 1 -- 172.21.15.39:0/3776944139 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb0381a7110 con 0x7fb038101ac0 2024-09-12T02:49:11.296 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:49:11.294+0000 7fb040600640 1 -- 172.21.15.39:0/3776944139 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fb038103200 con 0x7fb038101ac0 2024-09-12T02:49:11.296 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:49:11.296+0000 7fb036000640 1 -- 172.21.15.39:0/3776944139 <== mon.2 v2:172.21.15.44:3300/0 4 ==== mgrmap(e 27) ==== 137964+0+0 (secure 0 0 0) 0x7fb02c010ac0 con 0x7fb038101ac0 2024-09-12T02:49:11.298 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:49:11.297+0000 7fb036000640 1 --2- 172.21.15.39:0/3776944139 >> [v2:172.21.15.39:6800/2187509357,v1:172.21.15.39:6801/2187509357] conn(0x7fb0200a2da0 0x7fb0200a5260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:49:11.298 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:49:11.298+0000 7fb036000640 1 -- 172.21.15.39:0/3776944139 <== mon.2 v2:172.21.15.44:3300/0 5 ==== osd_map(107..107 src has 1..107) ==== 9563+0+0 (secure 0 0 0) 0x7fb02c0cfff0 con 0x7fb038101ac0 2024-09-12T02:49:11.298 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:49:11.298+0000 7fb03d200640 1 --2- 172.21.15.39:0/3776944139 >> [v2:172.21.15.39:6800/2187509357,v1:172.21.15.39:6801/2187509357] conn(0x7fb0200a2da0 0x7fb0200a5260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:49:11.299 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:49:11.298+0000 7fb03d200640 1 --2- 172.21.15.39:0/3776944139 >> [v2:172.21.15.39:6800/2187509357,v1:172.21.15.39:6801/2187509357] conn(0x7fb0200a2da0 0x7fb0200a5260 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0x7fb024006010 tx=0x7fb024000bc0 comp rx=0 tx=0).ready entity=mgr.25199 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:49:11.300 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:49:11.300+0000 7fb036000640 1 -- 172.21.15.39:0/3776944139 <== mon.2 v2:172.21.15.44:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7fb02c09c1b0 con 0x7fb038101ac0 2024-09-12T02:49:11.505 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:49:11.504+0000 7fb040600640 1 -- 172.21.15.39:0/3776944139 --> [v2:172.21.15.39:6800/2187509357,v1:172.21.15.39:6801/2187509357] -- mgr_command(tid 0: {"prefix": "fs snap-schedule list", "fs": "cephfs", "path": "/", "recursive": true, "target": ["mon-mgr", ""]}) -- 0x7fb0380fe560 con 0x7fb0200a2da0 2024-09-12T02:49:11.513 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:49:11.512+0000 7fb036000640 1 -- 172.21.15.39:0/3776944139 <== mgr.25199 v2:172.21.15.39:6800/2187509357 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+10 (secure 0 0 0) 0x7fb0380fe560 con 0x7fb0200a2da0 2024-09-12T02:49:11.513 INFO:teuthology.orchestra.run.smithi039.stdout:/ 1m 6m3h 2024-09-12T02:49:11.515 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:49:11.514+0000 7fb040600640 1 -- 172.21.15.39:0/3776944139 >> [v2:172.21.15.39:6800/2187509357,v1:172.21.15.39:6801/2187509357] conn(0x7fb0200a2da0 msgr2=0x7fb0200a5260 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:49:11.515 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:49:11.514+0000 7fb040600640 1 --2- 172.21.15.39:0/3776944139 >> [v2:172.21.15.39:6800/2187509357,v1:172.21.15.39:6801/2187509357] conn(0x7fb0200a2da0 0x7fb0200a5260 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0x7fb024006010 tx=0x7fb024000bc0 comp rx=0 tx=0).stop 2024-09-12T02:49:11.515 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:49:11.514+0000 7fb040600640 1 -- 172.21.15.39:0/3776944139 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fb038101ac0 msgr2=0x7fb03819a5a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:49:11.515 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:49:11.514+0000 7fb040600640 1 --2- 172.21.15.39:0/3776944139 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fb038101ac0 0x7fb03819a5a0 secure :-1 s=READY pgs=146 cs=0 l=1 rev1=1 crypto rx=0x7fb02c00e9f0 tx=0x7fb02c00eeb0 comp rx=0 tx=0).stop 2024-09-12T02:49:11.516 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:49:11.514+0000 7fb040600640 1 -- 172.21.15.39:0/3776944139 shutdown_connections 2024-09-12T02:49:11.516 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:49:11.514+0000 7fb040600640 1 --2- 172.21.15.39:0/3776944139 >> [v2:172.21.15.39:6800/2187509357,v1:172.21.15.39:6801/2187509357] conn(0x7fb0200a2da0 0x7fb0200a5260 unknown :-1 s=CLOSED pgs=45 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:49:11.516 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:49:11.514+0000 7fb040600640 1 --2- 172.21.15.39:0/3776944139 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fb038107ad0 0x7fb03819ee60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:49:11.516 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:49:11.514+0000 7fb040600640 1 --2- 172.21.15.39:0/3776944139 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fb038102460 0x7fb03819aae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:49:11.516 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:49:11.514+0000 7fb040600640 1 --2- 172.21.15.39:0/3776944139 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fb038101ac0 0x7fb03819a5a0 unknown :-1 s=CLOSED pgs=146 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:49:11.516 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:49:11.514+0000 7fb040600640 1 -- 172.21.15.39:0/3776944139 >> 172.21.15.39:0/3776944139 conn(0x7fb0380fd7e0 msgr2=0x7fb0380fde50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:49:11.516 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:49:11.514+0000 7fb040600640 1 -- 172.21.15.39:0/3776944139 shutdown_connections 2024-09-12T02:49:11.516 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:49:11.514+0000 7fb040600640 1 -- 172.21.15.39:0/3776944139 wait complete. 2024-09-12T02:49:11.531 DEBUG:teuthology.run_tasks:Unwinding manager check-counter 2024-09-12T02:49:11.806 DEBUG:teuthology.orchestra.run.smithi039:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-12T02:49:11.849 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 02:49:11 smithi039 ceph-mon[30515]: pgmap v351: 129 pgs: 129 active+clean; 24 MiB data, 485 MiB used, 1.0 TiB / 1.0 TiB avail; 81 KiB/s rd, 119 KiB/s wr, 36 op/s 2024-09-12T02:49:11.948 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 12 02:49:11 smithi044 ceph-mon[35411]: pgmap v351: 129 pgs: 129 active+clean; 24 MiB data, 485 MiB used, 1.0 TiB / 1.0 TiB avail; 81 KiB/s rd, 119 KiB/s wr, 36 op/s 2024-09-12T02:49:11.965 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:49:11.964+0000 7f1c70000640 1 -- 172.21.15.39:0/3666956953 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f1c68109060 msgr2=0x7f1c68110bb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:49:11.966 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:49:11.964+0000 7f1c70000640 1 --2- 172.21.15.39:0/3666956953 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f1c68109060 0x7f1c68110bb0 secure :-1 s=READY pgs=147 cs=0 l=1 rev1=1 crypto rx=0x7f1c60009be0 tx=0x7f1c6002a6c0 comp rx=0 tx=0).stop 2024-09-12T02:49:11.966 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:49:11.964+0000 7f1c70000640 1 -- 172.21.15.39:0/3666956953 shutdown_connections 2024-09-12T02:49:11.966 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:49:11.964+0000 7f1c70000640 1 --2- 172.21.15.39:0/3666956953 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f1c68109060 0x7f1c68110bb0 unknown :-1 s=CLOSED pgs=147 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:49:11.966 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:49:11.964+0000 7f1c70000640 1 --2- 172.21.15.39:0/3666956953 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f1c681048c0 0x7f1c68108900 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:49:11.966 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:49:11.964+0000 7f1c70000640 1 --2- 172.21.15.39:0/3666956953 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f1c68103f10 0x7f1c681042f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:49:11.966 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:49:11.964+0000 7f1c70000640 1 -- 172.21.15.39:0/3666956953 >> 172.21.15.39:0/3666956953 conn(0x7f1c680ff980 msgr2=0x7f1c68101da0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:49:11.966 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:49:11.965+0000 7f1c70000640 1 -- 172.21.15.39:0/3666956953 shutdown_connections 2024-09-12T02:49:11.966 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:49:11.965+0000 7f1c70000640 1 -- 172.21.15.39:0/3666956953 wait complete. 2024-09-12T02:49:11.968 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:49:11.965+0000 7f1c70000640 1 Processor -- start 2024-09-12T02:49:11.968 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:49:11.966+0000 7f1c70000640 1 -- start start 2024-09-12T02:49:11.968 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:49:11.966+0000 7f1c70000640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f1c68103f10 0x7f1c6819a5b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:49:11.968 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:49:11.966+0000 7f1c70000640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f1c68109060 0x7f1c6819aaf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:49:11.968 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:49:11.966+0000 7f1c70000640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f1c6819ee70 0x7f1c6819f320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:49:11.968 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:49:11.966+0000 7f1c70000640 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 -- 0x7f1c681140a0 con 0x7f1c68109060 2024-09-12T02:49:11.969 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:49:11.966+0000 7f1c70000640 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x7f1c68113f20 con 0x7f1c6819ee70 2024-09-12T02:49:11.969 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:49:11.966+0000 7f1c70000640 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7f1c68114220 con 0x7f1c68103f10 2024-09-12T02:49:11.969 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:49:11.966+0000 7f1c6cc00640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f1c68109060 0x7f1c6819aaf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:49:11.969 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:49:11.966+0000 7f1c6cc00640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f1c68109060 0x7f1c6819aaf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.39:3300/0 says I am v2:172.21.15.39:42752/0 (socket says 172.21.15.39:42752) 2024-09-12T02:49:11.969 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:49:11.966+0000 7f1c6cc00640 1 -- 172.21.15.39:0/1219012848 learned_addr learned my addr 172.21.15.39:0/1219012848 (peer_addr_for_me v2:172.21.15.39:0/0) 2024-09-12T02:49:11.969 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:49:11.966+0000 7f1c6d600640 1 --2- 172.21.15.39:0/1219012848 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f1c68103f10 0x7f1c6819a5b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:49:11.969 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:49:11.966+0000 7f1c6e000640 1 --2- 172.21.15.39:0/1219012848 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f1c6819ee70 0x7f1c6819f320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:49:11.969 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:49:11.967+0000 7f1c6cc00640 1 -- 172.21.15.39:0/1219012848 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f1c68103f10 msgr2=0x7f1c6819a5b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:49:11.969 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:49:11.967+0000 7f1c6cc00640 1 --2- 172.21.15.39:0/1219012848 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f1c68103f10 0x7f1c6819a5b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:49:11.969 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:49:11.967+0000 7f1c6cc00640 1 -- 172.21.15.39:0/1219012848 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f1c6819ee70 msgr2=0x7f1c6819f320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:49:11.970 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:49:11.967+0000 7f1c6cc00640 1 --2- 172.21.15.39:0/1219012848 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f1c6819ee70 0x7f1c6819f320 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:49:11.970 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:49:11.967+0000 7f1c6cc00640 1 -- 172.21.15.39:0/1219012848 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1c6819f960 con 0x7f1c68109060 2024-09-12T02:49:11.970 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:49:11.967+0000 7f1c6cc00640 1 --2- 172.21.15.39:0/1219012848 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f1c68109060 0x7f1c6819aaf0 secure :-1 s=READY pgs=296 cs=0 l=1 rev1=1 crypto rx=0x7f1c5400e9a0 tx=0x7f1c5400ee60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:49:11.970 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:49:11.967+0000 7f1c66000640 1 -- 172.21.15.39:0/1219012848 <== mon.0 v2:172.21.15.39:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1c5400cd80 con 0x7f1c68109060 2024-09-12T02:49:11.970 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:49:11.967+0000 7f1c70000640 1 -- 172.21.15.39:0/1219012848 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f1c6819fc50 con 0x7f1c68109060 2024-09-12T02:49:11.970 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:49:11.967+0000 7f1c66000640 1 -- 172.21.15.39:0/1219012848 <== mon.0 v2:172.21.15.39:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f1c540035f0 con 0x7f1c68109060 2024-09-12T02:49:11.970 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:49:11.967+0000 7f1c70000640 1 -- 172.21.15.39:0/1219012848 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f1c681a7490 con 0x7f1c68109060 2024-09-12T02:49:11.970 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:49:11.967+0000 7f1c66000640 1 -- 172.21.15.39:0/1219012848 <== mon.0 v2:172.21.15.39:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1c54018630 con 0x7f1c68109060 2024-09-12T02:49:11.970 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:49:11.969+0000 7f1c70000640 1 -- 172.21.15.39:0/1219012848 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f1c681042f0 con 0x7f1c68109060 2024-09-12T02:49:11.972 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:49:11.971+0000 7f1c66000640 1 -- 172.21.15.39:0/1219012848 <== mon.0 v2:172.21.15.39:3300/0 4 ==== mgrmap(e 27) ==== 137964+0+0 (secure 0 0 0) 0x7f1c540037a0 con 0x7f1c68109060 2024-09-12T02:49:11.973 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:49:11.972+0000 7f1c66000640 1 --2- 172.21.15.39:0/1219012848 >> [v2:172.21.15.39:6800/2187509357,v1:172.21.15.39:6801/2187509357] conn(0x7f1c500a2d00 0x7f1c500a51c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:49:11.973 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:49:11.973+0000 7f1c66000640 1 -- 172.21.15.39:0/1219012848 <== mon.0 v2:172.21.15.39:3300/0 5 ==== osd_map(107..107 src has 1..107) ==== 9563+0+0 (secure 0 0 0) 0x7f1c540cfa30 con 0x7f1c68109060 2024-09-12T02:49:11.973 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:49:11.973+0000 7f1c6d600640 1 --2- 172.21.15.39:0/1219012848 >> [v2:172.21.15.39:6800/2187509357,v1:172.21.15.39:6801/2187509357] conn(0x7f1c500a2d00 0x7f1c500a51c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:49:11.974 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:49:11.974+0000 7f1c6d600640 1 --2- 172.21.15.39:0/1219012848 >> [v2:172.21.15.39:6800/2187509357,v1:172.21.15.39:6801/2187509357] conn(0x7f1c500a2d00 0x7f1c500a51c0 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0x7f1c5c009bd0 tx=0x7f1c5c005f90 comp rx=0 tx=0).ready entity=mgr.25199 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:49:11.977 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:49:11.977+0000 7f1c66000640 1 -- 172.21.15.39:0/1219012848 <== mon.0 v2:172.21.15.39:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7f1c5409c1e0 con 0x7f1c68109060 2024-09-12T02:49:12.013 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 12 02:49:11 smithi172 ceph-mon[35609]: pgmap v351: 129 pgs: 129 active+clean; 24 MiB data, 485 MiB used, 1.0 TiB / 1.0 TiB avail; 81 KiB/s rd, 119 KiB/s wr, 36 op/s 2024-09-12T02:49:12.164 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:49:12.163+0000 7f1c70000640 1 -- 172.21.15.39:0/1219012848 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f1c681048c0 con 0x7f1c68109060 2024-09-12T02:49:12.166 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:49:12.165+0000 7f1c66000640 1 -- 172.21.15.39:0/1219012848 <== mon.0 v2:172.21.15.39:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v107) ==== 74+0+25468 (secure 0 0 0) 0x7f1c5409bae0 con 0x7f1c68109060 2024-09-12T02:49:12.166 INFO:teuthology.orchestra.run.smithi039.stdout: 2024-09-12T02:49:12.167 INFO:teuthology.orchestra.run.smithi039.stdout:{"epoch":107,"fsid":"4954ed46-70ae-11ef-bcea-c7b262605968","created":"2024-09-12T02:26:43.086467+0000","modified":"2024-09-12T02:49:02.597508+0000","last_up_change":"2024-09-12T02:34:08.626341+0000","last_in_change":"2024-09-12T02:33:45.553591+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":27,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":12,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-12T02:30:09.347905+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":12,"score_stable":12,"optimal_score":0.25,"raw_score_acting":3,"raw_score_stable":3,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-09-12T02:34:58.580872+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"84","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.8799999952316284,"score_stable":1.8799999952316284,"optimal_score":1,"raw_score_acting":1.8799999952316284,"raw_score_stable":1.8799999952316284,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-09-12T02:35:01.469805+0000","flags":8193,"flags_names":"hashpspool,selfmanaged_snaps","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"107","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":19,"snap_epoch":107,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2024-09-12T02:35:11.088109+0000","flags":8197,"flags_names":"hashpspool,ec_overwrites,selfmanaged_snaps","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"107","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":19,"snap_epoch":107,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"c967b48e-8a39-4797-871b-8b1b83d9472f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":87,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6802","nonce":2437586899},{"type":"v1","addr":"172.21.15.39:6803","nonce":2437586899}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6804","nonce":2437586899},{"type":"v1","addr":"172.21.15.39:6805","nonce":2437586899}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6808","nonce":2437586899},{"type":"v1","addr":"172.21.15.39:6809","nonce":2437586899}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6806","nonce":2437586899},{"type":"v1","addr":"172.21.15.39:6807","nonce":2437586899}]},"public_addr":"172.21.15.39:6803/2437586899","cluster_addr":"172.21.15.39:6805/2437586899","heartbeat_back_addr":"172.21.15.39:6809/2437586899","heartbeat_front_addr":"172.21.15.39:6807/2437586899","state":["exists","up"]},{"osd":1,"uuid":"30e1e4f4-1d50-4003-8978-cb183dca7fbb","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":87,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6800","nonce":2349287000},{"type":"v1","addr":"172.21.15.44:6801","nonce":2349287000}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6802","nonce":2349287000},{"type":"v1","addr":"172.21.15.44:6803","nonce":2349287000}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6806","nonce":2349287000},{"type":"v1","addr":"172.21.15.44:6807","nonce":2349287000}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6804","nonce":2349287000},{"type":"v1","addr":"172.21.15.44:6805","nonce":2349287000}]},"public_addr":"172.21.15.44:6801/2349287000","cluster_addr":"172.21.15.44:6803/2349287000","heartbeat_back_addr":"172.21.15.44:6807/2349287000","heartbeat_front_addr":"172.21.15.44:6805/2349287000","state":["exists","up"]},{"osd":2,"uuid":"a758803f-8668-4fc8-9417-b8d080cd9a7c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":18,"up_thru":94,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6800","nonce":1176898232},{"type":"v1","addr":"172.21.15.172:6801","nonce":1176898232}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6802","nonce":1176898232},{"type":"v1","addr":"172.21.15.172:6803","nonce":1176898232}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6806","nonce":1176898232},{"type":"v1","addr":"172.21.15.172:6807","nonce":1176898232}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6804","nonce":1176898232},{"type":"v1","addr":"172.21.15.172:6805","nonce":1176898232}]},"public_addr":"172.21.15.172:6801/1176898232","cluster_addr":"172.21.15.172:6803/1176898232","heartbeat_back_addr":"172.21.15.172:6807/1176898232","heartbeat_front_addr":"172.21.15.172:6805/1176898232","state":["exists","up"]},{"osd":3,"uuid":"8b256567-7efe-429c-bc4c-80e93228f139","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":26,"up_thru":87,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6810","nonce":2013565859},{"type":"v1","addr":"172.21.15.39:6811","nonce":2013565859}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6812","nonce":2013565859},{"type":"v1","addr":"172.21.15.39:6813","nonce":2013565859}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6816","nonce":2013565859},{"type":"v1","addr":"172.21.15.39:6817","nonce":2013565859}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6814","nonce":2013565859},{"type":"v1","addr":"172.21.15.39:6815","nonce":2013565859}]},"public_addr":"172.21.15.39:6811/2013565859","cluster_addr":"172.21.15.39:6813/2013565859","heartbeat_back_addr":"172.21.15.39:6817/2013565859","heartbeat_front_addr":"172.21.15.39:6815/2013565859","state":["exists","up"]},{"osd":4,"uuid":"e86b6756-e2b3-49fe-9b87-1a2b015bb17a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":33,"up_thru":87,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6808","nonce":3663639110},{"type":"v1","addr":"172.21.15.44:6809","nonce":3663639110}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6810","nonce":3663639110},{"type":"v1","addr":"172.21.15.44:6811","nonce":3663639110}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6814","nonce":3663639110},{"type":"v1","addr":"172.21.15.44:6815","nonce":3663639110}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6812","nonce":3663639110},{"type":"v1","addr":"172.21.15.44:6813","nonce":3663639110}]},"public_addr":"172.21.15.44:6809/3663639110","cluster_addr":"172.21.15.44:6811/3663639110","heartbeat_back_addr":"172.21.15.44:6815/3663639110","heartbeat_front_addr":"172.21.15.44:6813/3663639110","state":["exists","up"]},{"osd":5,"uuid":"9c907c92-b323-48e7-99ad-ec9756d26312","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":38,"up_thru":92,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6808","nonce":998885347},{"type":"v1","addr":"172.21.15.172:6809","nonce":998885347}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6810","nonce":998885347},{"type":"v1","addr":"172.21.15.172:6811","nonce":998885347}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6814","nonce":998885347},{"type":"v1","addr":"172.21.15.172:6815","nonce":998885347}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6812","nonce":998885347},{"type":"v1","addr":"172.21.15.172:6813","nonce":998885347}]},"public_addr":"172.21.15.172:6809/998885347","cluster_addr":"172.21.15.172:6811/998885347","heartbeat_back_addr":"172.21.15.172:6815/998885347","heartbeat_front_addr":"172.21.15.172:6813/998885347","state":["exists","up"]},{"osd":6,"uuid":"1fcb9bb2-6f4b-4d97-a401-aeb6a9706613","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":45,"up_thru":92,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6818","nonce":2569059542},{"type":"v1","addr":"172.21.15.39:6819","nonce":2569059542}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6820","nonce":2569059542},{"type":"v1","addr":"172.21.15.39:6821","nonce":2569059542}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6824","nonce":2569059542},{"type":"v1","addr":"172.21.15.39:6825","nonce":2569059542}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6822","nonce":2569059542},{"type":"v1","addr":"172.21.15.39:6823","nonce":2569059542}]},"public_addr":"172.21.15.39:6819/2569059542","cluster_addr":"172.21.15.39:6821/2569059542","heartbeat_back_addr":"172.21.15.39:6825/2569059542","heartbeat_front_addr":"172.21.15.39:6823/2569059542","state":["exists","up"]},{"osd":7,"uuid":"59e0caf9-8ce5-4161-8875-84862eba743e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":50,"up_thru":87,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6816","nonce":709635079},{"type":"v1","addr":"172.21.15.44:6817","nonce":709635079}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6818","nonce":709635079},{"type":"v1","addr":"172.21.15.44:6819","nonce":709635079}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6822","nonce":709635079},{"type":"v1","addr":"172.21.15.44:6823","nonce":709635079}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6820","nonce":709635079},{"type":"v1","addr":"172.21.15.44:6821","nonce":709635079}]},"public_addr":"172.21.15.44:6817/709635079","cluster_addr":"172.21.15.44:6819/709635079","heartbeat_back_addr":"172.21.15.44:6823/709635079","heartbeat_front_addr":"172.21.15.44:6821/709635079","state":["exists","up"]},{"osd":8,"uuid":"2f6fb5c7-86cc-43eb-bdfb-45a69316937e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":57,"up_thru":94,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6816","nonce":1162792895},{"type":"v1","addr":"172.21.15.172:6817","nonce":1162792895}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6818","nonce":1162792895},{"type":"v1","addr":"172.21.15.172:6819","nonce":1162792895}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6822","nonce":1162792895},{"type":"v1","addr":"172.21.15.172:6823","nonce":1162792895}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6820","nonce":1162792895},{"type":"v1","addr":"172.21.15.172:6821","nonce":1162792895}]},"public_addr":"172.21.15.172:6817/1162792895","cluster_addr":"172.21.15.172:6819/1162792895","heartbeat_back_addr":"172.21.15.172:6823/1162792895","heartbeat_front_addr":"172.21.15.172:6821/1162792895","state":["exists","up"]},{"osd":9,"uuid":"87e5dd9e-8191-4db6-83fa-cfff7c31e17e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":65,"up_thru":92,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6826","nonce":945860346},{"type":"v1","addr":"172.21.15.39:6827","nonce":945860346}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6828","nonce":945860346},{"type":"v1","addr":"172.21.15.39:6829","nonce":945860346}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6832","nonce":945860346},{"type":"v1","addr":"172.21.15.39:6833","nonce":945860346}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6830","nonce":945860346},{"type":"v1","addr":"172.21.15.39:6831","nonce":945860346}]},"public_addr":"172.21.15.39:6827/945860346","cluster_addr":"172.21.15.39:6829/945860346","heartbeat_back_addr":"172.21.15.39:6833/945860346","heartbeat_front_addr":"172.21.15.39:6831/945860346","state":["exists","up"]},{"osd":10,"uuid":"b55d8a00-850f-4910-a5bf-97d9ed545be7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":70,"up_thru":81,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6824","nonce":3899352344},{"type":"v1","addr":"172.21.15.44:6825","nonce":3899352344}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6826","nonce":3899352344},{"type":"v1","addr":"172.21.15.44:6827","nonce":3899352344}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6830","nonce":3899352344},{"type":"v1","addr":"172.21.15.44:6831","nonce":3899352344}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6828","nonce":3899352344},{"type":"v1","addr":"172.21.15.44:6829","nonce":3899352344}]},"public_addr":"172.21.15.44:6825/3899352344","cluster_addr":"172.21.15.44:6827/3899352344","heartbeat_back_addr":"172.21.15.44:6831/3899352344","heartbeat_front_addr":"172.21.15.44:6829/3899352344","state":["exists","up"]},{"osd":11,"uuid":"20cf5df1-5a80-4272-acc0-919c6a1da55a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":77,"up_thru":92,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6824","nonce":3627635035},{"type":"v1","addr":"172.21.15.172:6825","nonce":3627635035}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6826","nonce":3627635035},{"type":"v1","addr":"172.21.15.172:6827","nonce":3627635035}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6830","nonce":3627635035},{"type":"v1","addr":"172.21.15.172:6831","nonce":3627635035}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6828","nonce":3627635035},{"type":"v1","addr":"172.21.15.172:6829","nonce":3627635035}]},"public_addr":"172.21.15.172:6825/3627635035","cluster_addr":"172.21.15.172:6827/3627635035","heartbeat_back_addr":"172.21.15.172:6831/3627635035","heartbeat_front_addr":"172.21.15.172:6829/3627635035","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T02:29:15.367468+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T02:29:41.518207+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T02:30:06.004371+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T02:30:34.793371+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T02:31:00.878517+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T02:31:26.675956+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T02:31:55.950748+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T02:32:22.824017+0000","dead_epoch":0},{"osd":8,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T02:32:46.775880+0000","dead_epoch":0},{"osd":9,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T02:33:16.420347+0000","dead_epoch":0},{"osd":10,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T02:33:42.185837+0000","dead_epoch":0},{"osd":11,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T02:34:07.312555+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"2.0","mappings":[{"from":7,"to":11}]},{"pgid":"2.b","mappings":[{"from":2,"to":1}]},{"pgid":"2.10","mappings":[{"from":8,"to":11}]},{"pgid":"2.1b","mappings":[{"from":2,"to":4}]},{"pgid":"3.11","mappings":[{"from":4,"to":8}]},{"pgid":"3.24","mappings":[{"from":4,"to":9}]},{"pgid":"3.33","mappings":[{"from":5,"to":9}]},{"pgid":"3.34","mappings":[{"from":4,"to":9}]},{"pgid":"4.2","mappings":[{"from":9,"to":1}]},{"pgid":"4.6","mappings":[{"from":9,"to":11},{"from":5,"to":8}]},{"pgid":"4.19","mappings":[{"from":9,"to":8}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.39:0/684883181":"2024-09-13T02:37:55.928405+0000","172.21.15.39:6801/1725006999":"2024-09-13T02:37:55.928405+0000","172.21.15.39:6800/1074685700":"2024-09-13T02:27:16.531986+0000","172.21.15.39:6801/3152613618":"2024-09-13T02:27:44.717224+0000","172.21.15.39:0/1147479345":"2024-09-13T02:37:55.928405+0000","172.21.15.39:6801/1074685700":"2024-09-13T02:27:16.531986+0000","172.21.15.39:6800/1725006999":"2024-09-13T02:37:55.928405+0000","172.21.15.39:0/4167553412":"2024-09-13T02:37:55.928405+0000","172.21.15.39:0/4075322467":"2024-09-13T02:27:16.531986+0000","172.21.15.39:0/2827440002":"2024-09-13T02:27:16.531986+0000","172.21.15.39:0/2913347539":"2024-09-13T02:27:16.531986+0000","172.21.15.39:0/1527429435":"2024-09-13T02:27:44.717224+0000","172.21.15.39:0/1941318538":"2024-09-13T02:27:44.717224+0000","172.21.15.39:0/2301206766":"2024-09-13T02:27:44.717224+0000","172.21.15.39:6800/3152613618":"2024-09-13T02:27:44.717224+0000","172.21.15.39:0/4180631617":"2024-09-13T02:37:55.928405+0000"},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[{"pool":3,"snaps":[{"begin":7,"length":1},{"begin":19,"length":1}]},{"pool":4,"snaps":[{"begin":7,"length":1},{"begin":19,"length":1}]}],"new_removed_snaps":[{"pool":3,"snaps":[{"begin":7,"length":1},{"begin":19,"length":1}]},{"pool":4,"snaps":[{"begin":7,"length":1},{"begin":19,"length":1}]}],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-12T02:49:12.169 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:49:12.168+0000 7f1c70000640 1 -- 172.21.15.39:0/1219012848 >> [v2:172.21.15.39:6800/2187509357,v1:172.21.15.39:6801/2187509357] conn(0x7f1c500a2d00 msgr2=0x7f1c500a51c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:49:12.169 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:49:12.168+0000 7f1c70000640 1 --2- 172.21.15.39:0/1219012848 >> [v2:172.21.15.39:6800/2187509357,v1:172.21.15.39:6801/2187509357] conn(0x7f1c500a2d00 0x7f1c500a51c0 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0x7f1c5c009bd0 tx=0x7f1c5c005f90 comp rx=0 tx=0).stop 2024-09-12T02:49:12.169 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:49:12.168+0000 7f1c70000640 1 -- 172.21.15.39:0/1219012848 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f1c68109060 msgr2=0x7f1c6819aaf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:49:12.169 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:49:12.168+0000 7f1c70000640 1 --2- 172.21.15.39:0/1219012848 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f1c68109060 0x7f1c6819aaf0 secure :-1 s=READY pgs=296 cs=0 l=1 rev1=1 crypto rx=0x7f1c5400e9a0 tx=0x7f1c5400ee60 comp rx=0 tx=0).stop 2024-09-12T02:49:12.169 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:49:12.168+0000 7f1c70000640 1 -- 172.21.15.39:0/1219012848 shutdown_connections 2024-09-12T02:49:12.169 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:49:12.168+0000 7f1c70000640 1 --2- 172.21.15.39:0/1219012848 >> [v2:172.21.15.39:6800/2187509357,v1:172.21.15.39:6801/2187509357] conn(0x7f1c500a2d00 0x7f1c500a51c0 unknown :-1 s=CLOSED pgs=46 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:49:12.169 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:49:12.168+0000 7f1c70000640 1 --2- 172.21.15.39:0/1219012848 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f1c6819ee70 0x7f1c6819f320 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:49:12.169 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:49:12.168+0000 7f1c70000640 1 --2- 172.21.15.39:0/1219012848 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f1c68109060 0x7f1c6819aaf0 unknown :-1 s=CLOSED pgs=296 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:49:12.169 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:49:12.168+0000 7f1c70000640 1 --2- 172.21.15.39:0/1219012848 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f1c68103f10 0x7f1c6819a5b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:49:12.169 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:49:12.168+0000 7f1c70000640 1 -- 172.21.15.39:0/1219012848 >> 172.21.15.39:0/1219012848 conn(0x7f1c680ff980 msgr2=0x7f1c68100c50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:49:12.169 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:49:12.168+0000 7f1c70000640 1 -- 172.21.15.39:0/1219012848 shutdown_connections 2024-09-12T02:49:12.170 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:49:12.168+0000 7f1c70000640 1 -- 172.21.15.39:0/1219012848 wait complete. 2024-09-12T02:49:12.188 INFO:tasks.check_counter.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-09-12T02:30:09.347905+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 3, 'min_size': 2, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'is_stretch_pool': False, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '22', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 12, 'score_stable': 12, 'optimal_score': 0.25, 'raw_score_acting': 3, 'raw_score_stable': 3, 'primary_affinity_weighted': 0.9999998807907104, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'cephfs_metadata', 'create_time': '2024-09-12T02:34:58.580872+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 3, 'min_size': 2, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'is_stretch_pool': False, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '84', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.8799999952316284, 'score_stable': 1.8799999952316284, 'optimal_score': 1, 'raw_score_acting': 1.8799999952316284, 'raw_score_stable': 1.8799999952316284, 'primary_affinity_weighted': 0.9999998807907104, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_data', 'create_time': '2024-09-12T02:35:01.469805+0000', 'flags': 8193, 'flags_names': 'hashpspool,selfmanaged_snaps', 'type': 1, 'size': 3, 'min_size': 2, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'is_stretch_pool': False, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '107', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 19, 'snap_epoch': 107, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.05000000074505806}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 0.9999998807907104, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 4, 'pool_name': 'cephfs_data_ec', 'create_time': '2024-09-12T02:35:11.088109+0000', 'flags': 8197, 'flags_names': 'hashpspool,ec_overwrites,selfmanaged_snaps', 'type': 3, 'size': 4, 'min_size': 3, 'crush_rule': 1, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'is_stretch_pool': False, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '107', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 19, 'snap_epoch': 107, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': 'cephfs_data_ec', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 8192, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}}] 2024-09-12T02:49:12.188 DEBUG:teuthology.orchestra.run.smithi039:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-09-12T02:49:12.399 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:49:12.398+0000 7f6fa9000640 1 -- 172.21.15.39:0/2511262785 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f6fa4109060 msgr2=0x7f6fa4110bb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:49:12.399 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:49:12.398+0000 7f6fa9000640 1 --2- 172.21.15.39:0/2511262785 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f6fa4109060 0x7f6fa4110bb0 secure :-1 s=READY pgs=297 cs=0 l=1 rev1=1 crypto rx=0x7f6f9c009ca0 tx=0x7f6f9c02a8c0 comp rx=0 tx=0).stop 2024-09-12T02:49:12.399 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:49:12.398+0000 7f6fa9000640 1 -- 172.21.15.39:0/2511262785 shutdown_connections 2024-09-12T02:49:12.399 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:49:12.398+0000 7f6fa9000640 1 --2- 172.21.15.39:0/2511262785 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f6fa4109060 0x7f6fa4110bb0 unknown :-1 s=CLOSED pgs=297 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:49:12.399 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:49:12.398+0000 7f6fa9000640 1 --2- 172.21.15.39:0/2511262785 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f6fa41048c0 0x7f6fa4108900 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:49:12.399 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:49:12.398+0000 7f6fa9000640 1 --2- 172.21.15.39:0/2511262785 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f6fa4103f10 0x7f6fa41042f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:49:12.399 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:49:12.398+0000 7f6fa9000640 1 -- 172.21.15.39:0/2511262785 >> 172.21.15.39:0/2511262785 conn(0x7f6fa40ff980 msgr2=0x7f6fa4101da0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:49:12.400 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:49:12.398+0000 7f6fa9000640 1 -- 172.21.15.39:0/2511262785 shutdown_connections 2024-09-12T02:49:12.400 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:49:12.398+0000 7f6fa9000640 1 -- 172.21.15.39:0/2511262785 wait complete. 2024-09-12T02:49:12.401 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:49:12.399+0000 7f6fa9000640 1 Processor -- start 2024-09-12T02:49:12.401 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:49:12.399+0000 7f6fa9000640 1 -- start start 2024-09-12T02:49:12.401 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:49:12.399+0000 7f6fa9000640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f6fa4103f10 0x7f6fa419a5d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:49:12.401 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:49:12.399+0000 7f6fa9000640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f6fa4109060 0x7f6fa419ab10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:49:12.401 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:49:12.399+0000 7f6fa9000640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f6fa419ee90 0x7f6fa419f340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:49:12.402 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:49:12.399+0000 7f6fa9000640 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 -- 0x7f6fa4114100 con 0x7f6fa4103f10 2024-09-12T02:49:12.402 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:49:12.399+0000 7f6fa9000640 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x7f6fa4113f80 con 0x7f6fa419ee90 2024-09-12T02:49:12.402 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:49:12.399+0000 7f6fa9000640 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7f6fa4114280 con 0x7f6fa4109060 2024-09-12T02:49:12.402 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:49:12.400+0000 7f6fa1e00640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f6fa4103f10 0x7f6fa419a5d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:49:12.402 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:49:12.400+0000 7f6fa2800640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f6fa419ee90 0x7f6fa419f340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:49:12.402 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:49:12.400+0000 7f6f9be00640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f6fa4109060 0x7f6fa419ab10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:49:12.402 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:49:12.400+0000 7f6fa2800640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f6fa419ee90 0x7f6fa419f340 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.39:39000/0 (socket says 172.21.15.39:39000) 2024-09-12T02:49:12.402 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:49:12.400+0000 7f6fa2800640 1 -- 172.21.15.39:0/3622023880 learned_addr learned my addr 172.21.15.39:0/3622023880 (peer_addr_for_me v2:172.21.15.39:0/0) 2024-09-12T02:49:12.402 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:49:12.400+0000 7f6fa2800640 1 -- 172.21.15.39:0/3622023880 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f6fa4109060 msgr2=0x7f6fa419ab10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:49:12.402 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:49:12.400+0000 7f6fa2800640 1 --2- 172.21.15.39:0/3622023880 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f6fa4109060 0x7f6fa419ab10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:49:12.402 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:49:12.400+0000 7f6fa2800640 1 -- 172.21.15.39:0/3622023880 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f6fa4103f10 msgr2=0x7f6fa419a5d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:49:12.402 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:49:12.400+0000 7f6fa2800640 1 --2- 172.21.15.39:0/3622023880 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f6fa4103f10 0x7f6fa419a5d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:49:12.402 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:49:12.400+0000 7f6fa2800640 1 -- 172.21.15.39:0/3622023880 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6fa419f980 con 0x7f6fa419ee90 2024-09-12T02:49:12.402 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:49:12.400+0000 7f6fa1e00640 1 --2- 172.21.15.39:0/3622023880 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f6fa4103f10 0x7f6fa419a5d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-12T02:49:12.403 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:49:12.401+0000 7f6fa2800640 1 --2- 172.21.15.39:0/3622023880 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f6fa419ee90 0x7f6fa419f340 secure :-1 s=READY pgs=148 cs=0 l=1 rev1=1 crypto rx=0x7f6f9c005e30 tx=0x7f6f9c003d00 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:49:12.403 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:49:12.401+0000 7f6f9aa00640 1 -- 172.21.15.39:0/3622023880 <== mon.2 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6f9c031650 con 0x7f6fa419ee90 2024-09-12T02:49:12.403 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:49:12.401+0000 7f6fa9000640 1 -- 172.21.15.39:0/3622023880 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f6fa419fc10 con 0x7f6fa419ee90 2024-09-12T02:49:12.403 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:49:12.401+0000 7f6fa9000640 1 -- 172.21.15.39:0/3622023880 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f6fa41a7460 con 0x7f6fa419ee90 2024-09-12T02:49:12.404 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:49:12.401+0000 7f6f9aa00640 1 -- 172.21.15.39:0/3622023880 <== mon.2 v2:172.21.15.44:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f6f9c0317f0 con 0x7f6fa419ee90 2024-09-12T02:49:12.404 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:49:12.401+0000 7f6f9aa00640 1 -- 172.21.15.39:0/3622023880 <== mon.2 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6f9c02f9f0 con 0x7f6fa419ee90 2024-09-12T02:49:12.404 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:49:12.402+0000 7f6fa9000640 1 -- 172.21.15.39:0/3622023880 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f6fa41042f0 con 0x7f6fa419ee90 2024-09-12T02:49:12.405 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:49:12.404+0000 7f6f9aa00640 1 -- 172.21.15.39:0/3622023880 <== mon.2 v2:172.21.15.44:3300/0 4 ==== mgrmap(e 27) ==== 137964+0+0 (secure 0 0 0) 0x7f6f9c004b40 con 0x7f6fa419ee90 2024-09-12T02:49:12.406 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:49:12.406+0000 7f6f9aa00640 1 --2- 172.21.15.39:0/3622023880 >> [v2:172.21.15.39:6800/2187509357,v1:172.21.15.39:6801/2187509357] conn(0x7f6f880a2d80 0x7f6f880a5240 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:49:12.406 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:49:12.406+0000 7f6f9aa00640 1 -- 172.21.15.39:0/3622023880 <== mon.2 v2:172.21.15.44:3300/0 5 ==== osd_map(108..108 src has 1..108) ==== 9475+0+0 (secure 0 0 0) 0x7f6f9c0f0bc0 con 0x7f6fa419ee90 2024-09-12T02:49:12.407 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:49:12.406+0000 7f6fa1e00640 1 --2- 172.21.15.39:0/3622023880 >> [v2:172.21.15.39:6800/2187509357,v1:172.21.15.39:6801/2187509357] conn(0x7f6f880a2d80 0x7f6f880a5240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:49:12.407 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:49:12.407+0000 7f6fa1e00640 1 --2- 172.21.15.39:0/3622023880 >> [v2:172.21.15.39:6800/2187509357,v1:172.21.15.39:6801/2187509357] conn(0x7f6f880a2d80 0x7f6f880a5240 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0x7f6f94009fc0 tx=0x7f6f94005f90 comp rx=0 tx=0).ready entity=mgr.25199 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:49:12.408 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:49:12.408+0000 7f6f9aa00640 1 -- 172.21.15.39:0/3622023880 <== mon.2 v2:172.21.15.44:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7f6f9c0bd4d0 con 0x7f6fa419ee90 2024-09-12T02:49:12.595 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:49:12.594+0000 7f6fa9000640 1 -- 172.21.15.39:0/3622023880 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) -- 0x7f6fa41048c0 con 0x7f6fa419ee90 2024-09-12T02:49:12.596 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:49:12.596+0000 7f6f9aa00640 1 -- 172.21.15.39:0/3622023880 <== mon.2 v2:172.21.15.44:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v108) ==== 93+0+10 (secure 0 0 0) 0x7f6f9c0bcdd0 con 0x7f6fa419ee90 2024-09-12T02:49:12.596 INFO:teuthology.orchestra.run.smithi039.stdout:pg_num: 1 2024-09-12T02:49:12.598 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:49:12.597+0000 7f6fa9000640 1 -- 172.21.15.39:0/3622023880 >> [v2:172.21.15.39:6800/2187509357,v1:172.21.15.39:6801/2187509357] conn(0x7f6f880a2d80 msgr2=0x7f6f880a5240 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:49:12.598 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:49:12.597+0000 7f6fa9000640 1 --2- 172.21.15.39:0/3622023880 >> [v2:172.21.15.39:6800/2187509357,v1:172.21.15.39:6801/2187509357] conn(0x7f6f880a2d80 0x7f6f880a5240 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0x7f6f94009fc0 tx=0x7f6f94005f90 comp rx=0 tx=0).stop 2024-09-12T02:49:12.598 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:49:12.597+0000 7f6fa9000640 1 -- 172.21.15.39:0/3622023880 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f6fa419ee90 msgr2=0x7f6fa419f340 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:49:12.598 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:49:12.597+0000 7f6fa9000640 1 --2- 172.21.15.39:0/3622023880 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f6fa419ee90 0x7f6fa419f340 secure :-1 s=READY pgs=148 cs=0 l=1 rev1=1 crypto rx=0x7f6f9c005e30 tx=0x7f6f9c003d00 comp rx=0 tx=0).stop 2024-09-12T02:49:12.598 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:49:12.597+0000 7f6fa9000640 1 -- 172.21.15.39:0/3622023880 shutdown_connections 2024-09-12T02:49:12.599 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:49:12.597+0000 7f6fa9000640 1 --2- 172.21.15.39:0/3622023880 >> [v2:172.21.15.39:6800/2187509357,v1:172.21.15.39:6801/2187509357] conn(0x7f6f880a2d80 0x7f6f880a5240 unknown :-1 s=CLOSED pgs=47 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:49:12.599 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:49:12.597+0000 7f6fa9000640 1 --2- 172.21.15.39:0/3622023880 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f6fa419ee90 0x7f6fa419f340 unknown :-1 s=CLOSED pgs=148 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:49:12.599 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:49:12.597+0000 7f6fa9000640 1 --2- 172.21.15.39:0/3622023880 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f6fa4109060 0x7f6fa419ab10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:49:12.599 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:49:12.597+0000 7f6fa9000640 1 --2- 172.21.15.39:0/3622023880 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f6fa4103f10 0x7f6fa419a5d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:49:12.599 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:49:12.597+0000 7f6fa9000640 1 -- 172.21.15.39:0/3622023880 >> 172.21.15.39:0/3622023880 conn(0x7f6fa40ff980 msgr2=0x7f6fa4100ca0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:49:12.599 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:49:12.598+0000 7f6fa9000640 1 -- 172.21.15.39:0/3622023880 shutdown_connections 2024-09-12T02:49:12.599 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:49:12.598+0000 7f6fa9000640 1 -- 172.21.15.39:0/3622023880 wait complete. 2024-09-12T02:49:12.617 DEBUG:teuthology.orchestra.run.smithi039:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2024-09-12T02:49:12.781 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:49:12.780+0000 7f542a200640 1 -- 172.21.15.39:0/759465804 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f542410e230 msgr2=0x7f5424110640 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:49:12.781 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:49:12.780+0000 7f542a200640 1 --2- 172.21.15.39:0/759465804 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f542410e230 0x7f5424110640 secure :-1 s=READY pgs=122 cs=0 l=1 rev1=1 crypto rx=0x7f541c009ca0 tx=0x7f541c02a950 comp rx=0 tx=0).stop 2024-09-12T02:49:12.781 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:49:12.780+0000 7f542a200640 1 -- 172.21.15.39:0/759465804 shutdown_connections 2024-09-12T02:49:12.781 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:49:12.780+0000 7f542a200640 1 --2- 172.21.15.39:0/759465804 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f542410e230 0x7f5424110640 unknown :-1 s=CLOSED pgs=122 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:49:12.781 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:49:12.780+0000 7f542a200640 1 --2- 172.21.15.39:0/759465804 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f5424074ee0 0x7f542410dcf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:49:12.781 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:49:12.780+0000 7f542a200640 1 --2- 172.21.15.39:0/759465804 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f54240745c0 0x7f54240749a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:49:12.781 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:49:12.780+0000 7f542a200640 1 -- 172.21.15.39:0/759465804 >> 172.21.15.39:0/759465804 conn(0x7f54240fd670 msgr2=0x7f54240ffa90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:49:12.782 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:49:12.780+0000 7f542a200640 1 -- 172.21.15.39:0/759465804 shutdown_connections 2024-09-12T02:49:12.782 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:49:12.780+0000 7f542a200640 1 -- 172.21.15.39:0/759465804 wait complete. 2024-09-12T02:49:12.784 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:49:12.781+0000 7f542a200640 1 Processor -- start 2024-09-12T02:49:12.784 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:49:12.781+0000 7f542a200640 1 -- start start 2024-09-12T02:49:12.784 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:49:12.782+0000 7f542a200640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f54240745c0 0x7f542419a4c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:49:12.784 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:49:12.782+0000 7f542a200640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f5424074ee0 0x7f542419aa00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:49:12.784 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:49:12.782+0000 7f542a200640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f542410e230 0x7f542419ed80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:49:12.784 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:49:12.782+0000 7f542a200640 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 -- 0x7f5424113ff0 con 0x7f54240745c0 2024-09-12T02:49:12.784 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:49:12.782+0000 7f542a200640 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x7f5424113e70 con 0x7f5424074ee0 2024-09-12T02:49:12.784 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:49:12.782+0000 7f542a200640 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7f5424114170 con 0x7f542410e230 2024-09-12T02:49:12.784 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:49:12.782+0000 7f5428e00640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f54240745c0 0x7f542419a4c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:49:12.784 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:49:12.782+0000 7f541be00640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f5424074ee0 0x7f542419aa00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:49:12.784 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:49:12.782+0000 7f5428e00640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f54240745c0 0x7f542419a4c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.39:3300/0 says I am v2:172.21.15.39:42790/0 (socket says 172.21.15.39:42790) 2024-09-12T02:49:12.784 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:49:12.782+0000 7f5428e00640 1 -- 172.21.15.39:0/3981015059 learned_addr learned my addr 172.21.15.39:0/3981015059 (peer_addr_for_me v2:172.21.15.39:0/0) 2024-09-12T02:49:12.785 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:49:12.782+0000 7f5429800640 1 --2- 172.21.15.39:0/3981015059 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f542410e230 0x7f542419ed80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:49:12.785 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:49:12.782+0000 7f5428e00640 1 -- 172.21.15.39:0/3981015059 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f542410e230 msgr2=0x7f542419ed80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:49:12.785 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:49:12.782+0000 7f5428e00640 1 --2- 172.21.15.39:0/3981015059 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f542410e230 0x7f542419ed80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:49:12.785 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:49:12.782+0000 7f5428e00640 1 -- 172.21.15.39:0/3981015059 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f5424074ee0 msgr2=0x7f542419aa00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:49:12.785 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:49:12.782+0000 7f5428e00640 1 --2- 172.21.15.39:0/3981015059 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f5424074ee0 0x7f542419aa00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:49:12.785 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:49:12.782+0000 7f5428e00640 1 -- 172.21.15.39:0/3981015059 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f542419f4b0 con 0x7f54240745c0 2024-09-12T02:49:12.785 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:49:12.782+0000 7f541be00640 1 --2- 172.21.15.39:0/3981015059 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f5424074ee0 0x7f542419aa00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-12T02:49:12.785 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:49:12.783+0000 7f5428e00640 1 --2- 172.21.15.39:0/3981015059 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f54240745c0 0x7f542419a4c0 secure :-1 s=READY pgs=298 cs=0 l=1 rev1=1 crypto rx=0x7f541400e9f0 tx=0x7f541400edf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:49:12.785 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:49:12.783+0000 7f5422000640 1 -- 172.21.15.39:0/3981015059 <== mon.0 v2:172.21.15.39:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f541400cd80 con 0x7f54240745c0 2024-09-12T02:49:12.785 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:49:12.783+0000 7f5422000640 1 -- 172.21.15.39:0/3981015059 <== mon.0 v2:172.21.15.39:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f5414005500 con 0x7f54240745c0 2024-09-12T02:49:12.785 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:49:12.783+0000 7f5422000640 1 -- 172.21.15.39:0/3981015059 <== mon.0 v2:172.21.15.39:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5414010690 con 0x7f54240745c0 2024-09-12T02:49:12.785 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:49:12.783+0000 7f542a200640 1 -- 172.21.15.39:0/3981015059 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f542419f7a0 con 0x7f54240745c0 2024-09-12T02:49:12.785 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:49:12.783+0000 7f542a200640 1 -- 172.21.15.39:0/3981015059 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f54241a7030 con 0x7f54240745c0 2024-09-12T02:49:12.786 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:49:12.784+0000 7f542a200640 1 -- 172.21.15.39:0/3981015059 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f54240749a0 con 0x7f54240745c0 2024-09-12T02:49:12.787 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:49:12.786+0000 7f5422000640 1 -- 172.21.15.39:0/3981015059 <== mon.0 v2:172.21.15.39:3300/0 4 ==== mgrmap(e 27) ==== 137964+0+0 (secure 0 0 0) 0x7f54140046c0 con 0x7f54240745c0 2024-09-12T02:49:12.788 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:49:12.787+0000 7f5422000640 1 --2- 172.21.15.39:0/3981015059 >> [v2:172.21.15.39:6800/2187509357,v1:172.21.15.39:6801/2187509357] conn(0x7f54080a2d80 0x7f54080a5240 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:49:12.788 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:49:12.788+0000 7f5422000640 1 -- 172.21.15.39:0/3981015059 <== mon.0 v2:172.21.15.39:3300/0 5 ==== osd_map(108..108 src has 1..108) ==== 9475+0+0 (secure 0 0 0) 0x7f54140cfbf0 con 0x7f54240745c0 2024-09-12T02:49:12.788 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:49:12.788+0000 7f541be00640 1 --2- 172.21.15.39:0/3981015059 >> [v2:172.21.15.39:6800/2187509357,v1:172.21.15.39:6801/2187509357] conn(0x7f54080a2d80 0x7f54080a5240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:49:12.789 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:49:12.788+0000 7f541be00640 1 --2- 172.21.15.39:0/3981015059 >> [v2:172.21.15.39:6800/2187509357,v1:172.21.15.39:6801/2187509357] conn(0x7f54080a2d80 0x7f54080a5240 secure :-1 s=READY pgs=48 cs=0 l=1 rev1=1 crypto rx=0x7f54240ffc20 tx=0x7f540c005f90 comp rx=0 tx=0).ready entity=mgr.25199 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:49:12.792 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:49:12.792+0000 7f5422000640 1 -- 172.21.15.39:0/3981015059 <== mon.0 v2:172.21.15.39:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7f541409c3f0 con 0x7f54240745c0 2024-09-12T02:49:12.948 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 12 02:49:12 smithi044 ceph-mon[35411]: from='client.15336 -' entity='client.admin' cmd=[{"prefix": "fs snap-schedule status", "fs": "cephfs", "path": "/", "target": ["mon-mgr", ""]}]: dispatch 2024-09-12T02:49:12.949 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 12 02:49:12 smithi044 ceph-mon[35411]: from='client.25325 -' entity='client.admin' cmd=[{"prefix": "fs snap-schedule list", "fs": "cephfs", "path": "/", "recursive": true, "target": ["mon-mgr", ""]}]: dispatch 2024-09-12T02:49:12.949 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 12 02:49:12 smithi044 ceph-mon[35411]: from='client.? 172.21.15.39:0/1219012848' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-09-12T02:49:12.949 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 12 02:49:12 smithi044 ceph-mon[35411]: osdmap e108: 12 total, 12 up, 12 in 2024-09-12T02:49:12.949 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 12 02:49:12 smithi044 ceph-mon[35411]: from='client.? 172.21.15.39:0/3622023880' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]: dispatch 2024-09-12T02:49:12.977 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:49:12.977+0000 7f542a200640 1 -- 172.21.15.39:0/3981015059 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) -- 0x7f54241a7290 con 0x7f54240745c0 2024-09-12T02:49:12.978 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:49:12.977+0000 7f5422000640 1 -- 172.21.15.39:0/3981015059 <== mon.0 v2:172.21.15.39:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v108) ==== 104+0+11 (secure 0 0 0) 0x7f541409bcf0 con 0x7f54240745c0 2024-09-12T02:49:12.978 INFO:teuthology.orchestra.run.smithi039.stdout:pg_num: 32 2024-09-12T02:49:12.981 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:49:12.980+0000 7f542a200640 1 -- 172.21.15.39:0/3981015059 >> [v2:172.21.15.39:6800/2187509357,v1:172.21.15.39:6801/2187509357] conn(0x7f54080a2d80 msgr2=0x7f54080a5240 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:49:12.981 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:49:12.980+0000 7f542a200640 1 --2- 172.21.15.39:0/3981015059 >> [v2:172.21.15.39:6800/2187509357,v1:172.21.15.39:6801/2187509357] conn(0x7f54080a2d80 0x7f54080a5240 secure :-1 s=READY pgs=48 cs=0 l=1 rev1=1 crypto rx=0x7f54240ffc20 tx=0x7f540c005f90 comp rx=0 tx=0).stop 2024-09-12T02:49:12.981 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:49:12.980+0000 7f542a200640 1 -- 172.21.15.39:0/3981015059 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f54240745c0 msgr2=0x7f542419a4c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:49:12.981 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:49:12.980+0000 7f542a200640 1 --2- 172.21.15.39:0/3981015059 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f54240745c0 0x7f542419a4c0 secure :-1 s=READY pgs=298 cs=0 l=1 rev1=1 crypto rx=0x7f541400e9f0 tx=0x7f541400edf0 comp rx=0 tx=0).stop 2024-09-12T02:49:12.981 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:49:12.980+0000 7f542a200640 1 -- 172.21.15.39:0/3981015059 shutdown_connections 2024-09-12T02:49:12.981 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:49:12.980+0000 7f542a200640 1 --2- 172.21.15.39:0/3981015059 >> [v2:172.21.15.39:6800/2187509357,v1:172.21.15.39:6801/2187509357] conn(0x7f54080a2d80 0x7f54080a5240 unknown :-1 s=CLOSED pgs=48 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:49:12.981 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:49:12.980+0000 7f542a200640 1 --2- 172.21.15.39:0/3981015059 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f542410e230 0x7f542419ed80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:49:12.981 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:49:12.980+0000 7f542a200640 1 --2- 172.21.15.39:0/3981015059 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f5424074ee0 0x7f542419aa00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:49:12.981 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:49:12.980+0000 7f542a200640 1 --2- 172.21.15.39:0/3981015059 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f54240745c0 0x7f542419a4c0 unknown :-1 s=CLOSED pgs=298 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:49:12.981 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:49:12.980+0000 7f542a200640 1 -- 172.21.15.39:0/3981015059 >> 172.21.15.39:0/3981015059 conn(0x7f54240fd670 msgr2=0x7f54240fec80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:49:12.981 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:49:12.980+0000 7f542a200640 1 -- 172.21.15.39:0/3981015059 shutdown_connections 2024-09-12T02:49:12.981 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:49:12.980+0000 7f542a200640 1 -- 172.21.15.39:0/3981015059 wait complete. 2024-09-12T02:49:12.995 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 02:49:12 smithi039 ceph-mon[30515]: from='client.15336 -' entity='client.admin' cmd=[{"prefix": "fs snap-schedule status", "fs": "cephfs", "path": "/", "target": ["mon-mgr", ""]}]: dispatch 2024-09-12T02:49:12.995 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 02:49:12 smithi039 ceph-mon[30515]: from='client.25325 -' entity='client.admin' cmd=[{"prefix": "fs snap-schedule list", "fs": "cephfs", "path": "/", "recursive": true, "target": ["mon-mgr", ""]}]: dispatch 2024-09-12T02:49:12.995 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 02:49:12 smithi039 ceph-mon[30515]: from='client.? 172.21.15.39:0/1219012848' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-09-12T02:49:12.995 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 02:49:12 smithi039 ceph-mon[30515]: osdmap e108: 12 total, 12 up, 12 in 2024-09-12T02:49:12.995 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 02:49:12 smithi039 ceph-mon[30515]: from='client.? 172.21.15.39:0/3622023880' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]: dispatch 2024-09-12T02:49:12.997 DEBUG:teuthology.orchestra.run.smithi039:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2024-09-12T02:49:13.013 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 12 02:49:12 smithi172 ceph-mon[35609]: from='client.15336 -' entity='client.admin' cmd=[{"prefix": "fs snap-schedule status", "fs": "cephfs", "path": "/", "target": ["mon-mgr", ""]}]: dispatch 2024-09-12T02:49:13.014 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 12 02:49:12 smithi172 ceph-mon[35609]: from='client.25325 -' entity='client.admin' cmd=[{"prefix": "fs snap-schedule list", "fs": "cephfs", "path": "/", "recursive": true, "target": ["mon-mgr", ""]}]: dispatch 2024-09-12T02:49:13.014 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 12 02:49:12 smithi172 ceph-mon[35609]: from='client.? 172.21.15.39:0/1219012848' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-09-12T02:49:13.014 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 12 02:49:12 smithi172 ceph-mon[35609]: osdmap e108: 12 total, 12 up, 12 in 2024-09-12T02:49:13.014 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 12 02:49:12 smithi172 ceph-mon[35609]: from='client.? 172.21.15.39:0/3622023880' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]: dispatch 2024-09-12T02:49:13.159 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:49:13.157+0000 7f2f92000640 1 -- 172.21.15.39:0/2702761798 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f2f8c1048c0 msgr2=0x7f2f8c108900 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:49:13.159 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:49:13.157+0000 7f2f92000640 1 --2- 172.21.15.39:0/2702761798 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f2f8c1048c0 0x7f2f8c108900 secure :-1 s=READY pgs=299 cs=0 l=1 rev1=1 crypto rx=0x7f2f74009900 tx=0x7f2f7402a3f0 comp rx=0 tx=0).stop 2024-09-12T02:49:13.159 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:49:13.158+0000 7f2f92000640 1 -- 172.21.15.39:0/2702761798 shutdown_connections 2024-09-12T02:49:13.159 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:49:13.158+0000 7f2f92000640 1 --2- 172.21.15.39:0/2702761798 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f2f8c109060 0x7f2f8c110bb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:49:13.159 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:49:13.158+0000 7f2f92000640 1 --2- 172.21.15.39:0/2702761798 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f2f8c1048c0 0x7f2f8c108900 unknown :-1 s=CLOSED pgs=299 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:49:13.160 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:49:13.158+0000 7f2f92000640 1 --2- 172.21.15.39:0/2702761798 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f2f8c103f10 0x7f2f8c1042f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:49:13.160 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:49:13.158+0000 7f2f92000640 1 -- 172.21.15.39:0/2702761798 >> 172.21.15.39:0/2702761798 conn(0x7f2f8c0ff940 msgr2=0x7f2f8c101d60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:49:13.160 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:49:13.158+0000 7f2f92000640 1 -- 172.21.15.39:0/2702761798 shutdown_connections 2024-09-12T02:49:13.160 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:49:13.158+0000 7f2f92000640 1 -- 172.21.15.39:0/2702761798 wait complete. 2024-09-12T02:49:13.160 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:49:13.158+0000 7f2f92000640 1 Processor -- start 2024-09-12T02:49:13.163 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:49:13.159+0000 7f2f92000640 1 -- start start 2024-09-12T02:49:13.163 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:49:13.159+0000 7f2f92000640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f2f8c103f10 0x7f2f8c19a620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:49:13.163 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:49:13.159+0000 7f2f92000640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f2f8c109060 0x7f2f8c19ab60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:49:13.163 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:49:13.159+0000 7f2f92000640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f2f8c19eee0 0x7f2f8c19f390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:49:13.163 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:49:13.159+0000 7f2f92000640 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 -- 0x7f2f8c114080 con 0x7f2f8c109060 2024-09-12T02:49:13.163 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:49:13.159+0000 7f2f92000640 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x7f2f8c113f00 con 0x7f2f8c19eee0 2024-09-12T02:49:13.163 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:49:13.159+0000 7f2f92000640 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7f2f8c114200 con 0x7f2f8c103f10 2024-09-12T02:49:13.163 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:49:13.159+0000 7f2f82a00640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f2f8c109060 0x7f2f8c19ab60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:49:13.163 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:49:13.159+0000 7f2f8b400640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f2f8c103f10 0x7f2f8c19a620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:49:13.163 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:49:13.159+0000 7f2f8b400640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f2f8c103f10 0x7f2f8c19a620 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.172:3300/0 says I am v2:172.21.15.39:60432/0 (socket says 172.21.15.39:60432) 2024-09-12T02:49:13.163 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:49:13.159+0000 7f2f82a00640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f2f8c109060 0x7f2f8c19ab60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.39:3300/0 says I am v2:172.21.15.39:42806/0 (socket says 172.21.15.39:42806) 2024-09-12T02:49:13.164 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:49:13.159+0000 7f2f8b400640 1 -- 172.21.15.39:0/1895280536 learned_addr learned my addr 172.21.15.39:0/1895280536 (peer_addr_for_me v2:172.21.15.39:0/0) 2024-09-12T02:49:13.164 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:49:13.159+0000 7f2f8be00640 1 --2- 172.21.15.39:0/1895280536 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f2f8c19eee0 0x7f2f8c19f390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:49:13.164 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:49:13.160+0000 7f2f8b400640 1 -- 172.21.15.39:0/1895280536 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f2f8c19eee0 msgr2=0x7f2f8c19f390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:49:13.164 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:49:13.160+0000 7f2f8b400640 1 --2- 172.21.15.39:0/1895280536 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f2f8c19eee0 0x7f2f8c19f390 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:49:13.164 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:49:13.160+0000 7f2f8b400640 1 -- 172.21.15.39:0/1895280536 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f2f8c109060 msgr2=0x7f2f8c19ab60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:49:13.164 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:49:13.160+0000 7f2f8b400640 1 --2- 172.21.15.39:0/1895280536 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f2f8c109060 0x7f2f8c19ab60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:49:13.164 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:49:13.160+0000 7f2f8b400640 1 -- 172.21.15.39:0/1895280536 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2f8c19f9d0 con 0x7f2f8c103f10 2024-09-12T02:49:13.164 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:49:13.160+0000 7f2f82a00640 1 --2- 172.21.15.39:0/1895280536 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f2f8c109060 0x7f2f8c19ab60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-12T02:49:13.164 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:49:13.160+0000 7f2f8b400640 1 --2- 172.21.15.39:0/1895280536 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f2f8c103f10 0x7f2f8c19a620 secure :-1 s=READY pgs=123 cs=0 l=1 rev1=1 crypto rx=0x7f2f7c00ebc0 tx=0x7f2f7c00c6a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:49:13.164 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:49:13.160+0000 7f2f88c00640 1 -- 172.21.15.39:0/1895280536 <== mon.1 v2:172.21.15.172:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2f7c010630 con 0x7f2f8c103f10 2024-09-12T02:49:13.164 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:49:13.160+0000 7f2f92000640 1 -- 172.21.15.39:0/1895280536 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f2f8c19fcc0 con 0x7f2f8c103f10 2024-09-12T02:49:13.164 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:49:13.160+0000 7f2f88c00640 1 -- 172.21.15.39:0/1895280536 <== mon.1 v2:172.21.15.172:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f2f7c010cb0 con 0x7f2f8c103f10 2024-09-12T02:49:13.164 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:49:13.160+0000 7f2f88c00640 1 -- 172.21.15.39:0/1895280536 <== mon.1 v2:172.21.15.172:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2f7c018bd0 con 0x7f2f8c103f10 2024-09-12T02:49:13.165 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:49:13.160+0000 7f2f92000640 1 -- 172.21.15.39:0/1895280536 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f2f8c1a74d0 con 0x7f2f8c103f10 2024-09-12T02:49:13.165 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:49:13.161+0000 7f2f92000640 1 -- 172.21.15.39:0/1895280536 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f2f8c1042f0 con 0x7f2f8c103f10 2024-09-12T02:49:13.165 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:49:13.164+0000 7f2f88c00640 1 -- 172.21.15.39:0/1895280536 <== mon.1 v2:172.21.15.172:3300/0 4 ==== mgrmap(e 27) ==== 137964+0+0 (secure 0 0 0) 0x7f2f7c0107d0 con 0x7f2f8c103f10 2024-09-12T02:49:13.166 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:49:13.165+0000 7f2f88c00640 1 --2- 172.21.15.39:0/1895280536 >> [v2:172.21.15.39:6800/2187509357,v1:172.21.15.39:6801/2187509357] conn(0x7f2f700a2d80 0x7f2f700a5240 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:49:13.166 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:49:13.165+0000 7f2f88c00640 1 -- 172.21.15.39:0/1895280536 <== mon.1 v2:172.21.15.172:3300/0 5 ==== osd_map(108..108 src has 1..108) ==== 9475+0+0 (secure 0 0 0) 0x7f2f7c0cffe0 con 0x7f2f8c103f10 2024-09-12T02:49:13.166 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:49:13.165+0000 7f2f82a00640 1 --2- 172.21.15.39:0/1895280536 >> [v2:172.21.15.39:6800/2187509357,v1:172.21.15.39:6801/2187509357] conn(0x7f2f700a2d80 0x7f2f700a5240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:49:13.166 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:49:13.166+0000 7f2f82a00640 1 --2- 172.21.15.39:0/1895280536 >> [v2:172.21.15.39:6800/2187509357,v1:172.21.15.39:6801/2187509357] conn(0x7f2f700a2d80 0x7f2f700a5240 secure :-1 s=READY pgs=49 cs=0 l=1 rev1=1 crypto rx=0x7f2f74004770 tx=0x7f2f740058d0 comp rx=0 tx=0).ready entity=mgr.25199 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:49:13.167 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:49:13.167+0000 7f2f88c00640 1 -- 172.21.15.39:0/1895280536 <== mon.1 v2:172.21.15.172:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7f2f7c09c190 con 0x7f2f8c103f10 2024-09-12T02:49:13.356 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:49:13.356+0000 7f2f92000640 1 -- 172.21.15.39:0/1895280536 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) -- 0x7f2f8c1048c0 con 0x7f2f8c103f10 2024-09-12T02:49:13.357 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:49:13.356+0000 7f2f88c00640 1 -- 172.21.15.39:0/1895280536 <== mon.1 v2:172.21.15.172:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v108) ==== 100+0+11 (secure 0 0 0) 0x7f2f7c0a0490 con 0x7f2f8c103f10 2024-09-12T02:49:13.358 INFO:teuthology.orchestra.run.smithi039.stdout:pg_num: 64 2024-09-12T02:49:13.360 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:49:13.359+0000 7f2f92000640 1 -- 172.21.15.39:0/1895280536 >> [v2:172.21.15.39:6800/2187509357,v1:172.21.15.39:6801/2187509357] conn(0x7f2f700a2d80 msgr2=0x7f2f700a5240 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:49:13.360 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:49:13.359+0000 7f2f92000640 1 --2- 172.21.15.39:0/1895280536 >> [v2:172.21.15.39:6800/2187509357,v1:172.21.15.39:6801/2187509357] conn(0x7f2f700a2d80 0x7f2f700a5240 secure :-1 s=READY pgs=49 cs=0 l=1 rev1=1 crypto rx=0x7f2f74004770 tx=0x7f2f740058d0 comp rx=0 tx=0).stop 2024-09-12T02:49:13.360 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:49:13.359+0000 7f2f92000640 1 -- 172.21.15.39:0/1895280536 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f2f8c103f10 msgr2=0x7f2f8c19a620 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:49:13.360 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:49:13.359+0000 7f2f92000640 1 --2- 172.21.15.39:0/1895280536 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f2f8c103f10 0x7f2f8c19a620 secure :-1 s=READY pgs=123 cs=0 l=1 rev1=1 crypto rx=0x7f2f7c00ebc0 tx=0x7f2f7c00c6a0 comp rx=0 tx=0).stop 2024-09-12T02:49:13.360 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:49:13.359+0000 7f2f92000640 1 -- 172.21.15.39:0/1895280536 shutdown_connections 2024-09-12T02:49:13.361 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:49:13.359+0000 7f2f92000640 1 --2- 172.21.15.39:0/1895280536 >> [v2:172.21.15.39:6800/2187509357,v1:172.21.15.39:6801/2187509357] conn(0x7f2f700a2d80 0x7f2f700a5240 unknown :-1 s=CLOSED pgs=49 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:49:13.361 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:49:13.359+0000 7f2f92000640 1 --2- 172.21.15.39:0/1895280536 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f2f8c19eee0 0x7f2f8c19f390 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:49:13.361 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:49:13.359+0000 7f2f92000640 1 --2- 172.21.15.39:0/1895280536 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f2f8c109060 0x7f2f8c19ab60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:49:13.361 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:49:13.359+0000 7f2f92000640 1 --2- 172.21.15.39:0/1895280536 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f2f8c103f10 0x7f2f8c19a620 unknown :-1 s=CLOSED pgs=123 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:49:13.361 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:49:13.359+0000 7f2f92000640 1 -- 172.21.15.39:0/1895280536 >> 172.21.15.39:0/1895280536 conn(0x7f2f8c0ff940 msgr2=0x7f2f8c100d50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:49:13.361 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:49:13.359+0000 7f2f92000640 1 -- 172.21.15.39:0/1895280536 shutdown_connections 2024-09-12T02:49:13.361 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:49:13.359+0000 7f2f92000640 1 -- 172.21.15.39:0/1895280536 wait complete. 2024-09-12T02:49:13.377 DEBUG:teuthology.orchestra.run.smithi039:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data_ec pg_num 2024-09-12T02:49:13.538 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:49:13.537+0000 7f5318000640 1 -- 172.21.15.39:0/3519114623 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f5310109060 msgr2=0x7f5310110bb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:49:13.539 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:49:13.537+0000 7f5318000640 1 --2- 172.21.15.39:0/3519114623 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f5310109060 0x7f5310110bb0 secure :-1 s=READY pgs=300 cs=0 l=1 rev1=1 crypto rx=0x7f5308009ca0 tx=0x7f530802a8c0 comp rx=0 tx=0).stop 2024-09-12T02:49:13.539 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:49:13.538+0000 7f5318000640 1 -- 172.21.15.39:0/3519114623 shutdown_connections 2024-09-12T02:49:13.539 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:49:13.538+0000 7f5318000640 1 --2- 172.21.15.39:0/3519114623 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f5310109060 0x7f5310110bb0 unknown :-1 s=CLOSED pgs=300 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:49:13.539 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:49:13.538+0000 7f5318000640 1 --2- 172.21.15.39:0/3519114623 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f53101048c0 0x7f5310108900 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:49:13.539 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:49:13.538+0000 7f5318000640 1 --2- 172.21.15.39:0/3519114623 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f5310103f10 0x7f53101042f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:49:13.539 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:49:13.538+0000 7f5318000640 1 -- 172.21.15.39:0/3519114623 >> 172.21.15.39:0/3519114623 conn(0x7f53100ff940 msgr2=0x7f5310101d60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:49:13.539 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:49:13.538+0000 7f5318000640 1 -- 172.21.15.39:0/3519114623 shutdown_connections 2024-09-12T02:49:13.539 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:49:13.538+0000 7f5318000640 1 -- 172.21.15.39:0/3519114623 wait complete. 2024-09-12T02:49:13.541 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:49:13.539+0000 7f5318000640 1 Processor -- start 2024-09-12T02:49:13.541 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:49:13.539+0000 7f5318000640 1 -- start start 2024-09-12T02:49:13.542 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:49:13.539+0000 7f5318000640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f5310103f10 0x7f531019a5d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:49:13.542 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:49:13.539+0000 7f5318000640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f5310109060 0x7f531019ab10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:49:13.542 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:49:13.539+0000 7f5318000640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f531019ee90 0x7f531019f340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:49:13.542 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:49:13.539+0000 7f5318000640 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 -- 0x7f53101140e0 con 0x7f531019ee90 2024-09-12T02:49:13.542 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:49:13.539+0000 7f5318000640 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x7f5310113f60 con 0x7f5310103f10 2024-09-12T02:49:13.542 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:49:13.539+0000 7f5318000640 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7f5310114260 con 0x7f5310109060 2024-09-12T02:49:13.542 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:49:13.539+0000 7f5316000640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f531019ee90 0x7f531019f340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:49:13.542 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:49:13.539+0000 7f5316000640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f531019ee90 0x7f531019f340 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.39:3300/0 says I am v2:172.21.15.39:42816/0 (socket says 172.21.15.39:42816) 2024-09-12T02:49:13.542 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:49:13.539+0000 7f5316000640 1 -- 172.21.15.39:0/90102503 learned_addr learned my addr 172.21.15.39:0/90102503 (peer_addr_for_me v2:172.21.15.39:0/0) 2024-09-12T02:49:13.542 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:49:13.539+0000 7f5315600640 1 --2- 172.21.15.39:0/90102503 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f5310103f10 0x7f531019a5d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:49:13.542 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:49:13.539+0000 7f5314c00640 1 --2- 172.21.15.39:0/90102503 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f5310109060 0x7f531019ab10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:49:13.542 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:49:13.540+0000 7f5316000640 1 -- 172.21.15.39:0/90102503 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f5310109060 msgr2=0x7f531019ab10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:49:13.542 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:49:13.540+0000 7f5316000640 1 --2- 172.21.15.39:0/90102503 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f5310109060 0x7f531019ab10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:49:13.542 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:49:13.540+0000 7f5316000640 1 -- 172.21.15.39:0/90102503 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f5310103f10 msgr2=0x7f531019a5d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:49:13.543 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:49:13.540+0000 7f5316000640 1 --2- 172.21.15.39:0/90102503 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f5310103f10 0x7f531019a5d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:49:13.543 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:49:13.540+0000 7f5316000640 1 -- 172.21.15.39:0/90102503 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f531019f980 con 0x7f531019ee90 2024-09-12T02:49:13.543 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:49:13.540+0000 7f5316000640 1 --2- 172.21.15.39:0/90102503 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f531019ee90 0x7f531019f340 secure :-1 s=READY pgs=301 cs=0 l=1 rev1=1 crypto rx=0x7f5308005e30 tx=0x7f5308003d00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:49:13.543 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:49:13.540+0000 7f530e000640 1 -- 172.21.15.39:0/90102503 <== mon.0 v2:172.21.15.39:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5308031650 con 0x7f531019ee90 2024-09-12T02:49:13.543 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:49:13.540+0000 7f530e000640 1 -- 172.21.15.39:0/90102503 <== mon.0 v2:172.21.15.39:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f53080317f0 con 0x7f531019ee90 2024-09-12T02:49:13.543 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:49:13.540+0000 7f530e000640 1 -- 172.21.15.39:0/90102503 <== mon.0 v2:172.21.15.39:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f530802f9d0 con 0x7f531019ee90 2024-09-12T02:49:13.543 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:49:13.540+0000 7f5318000640 1 -- 172.21.15.39:0/90102503 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f531019fc10 con 0x7f531019ee90 2024-09-12T02:49:13.543 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:49:13.541+0000 7f5318000640 1 -- 172.21.15.39:0/90102503 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f53101a73e0 con 0x7f531019ee90 2024-09-12T02:49:13.544 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:49:13.542+0000 7f5318000640 1 -- 172.21.15.39:0/90102503 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f53101042f0 con 0x7f531019ee90 2024-09-12T02:49:13.544 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:49:13.544+0000 7f530e000640 1 -- 172.21.15.39:0/90102503 <== mon.0 v2:172.21.15.39:3300/0 4 ==== mgrmap(e 27) ==== 137964+0+0 (secure 0 0 0) 0x7f530802fbf0 con 0x7f531019ee90 2024-09-12T02:49:13.546 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:49:13.546+0000 7f530e000640 1 --2- 172.21.15.39:0/90102503 >> [v2:172.21.15.39:6800/2187509357,v1:172.21.15.39:6801/2187509357] conn(0x7f52f80a2d80 0x7f52f80a5240 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:49:13.546 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:49:13.546+0000 7f530e000640 1 -- 172.21.15.39:0/90102503 <== mon.0 v2:172.21.15.39:3300/0 5 ==== osd_map(108..108 src has 1..108) ==== 9475+0+0 (secure 0 0 0) 0x7f53080f0a00 con 0x7f531019ee90 2024-09-12T02:49:13.547 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:49:13.546+0000 7f5315600640 1 --2- 172.21.15.39:0/90102503 >> [v2:172.21.15.39:6800/2187509357,v1:172.21.15.39:6801/2187509357] conn(0x7f52f80a2d80 0x7f52f80a5240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:49:13.547 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:49:13.547+0000 7f5315600640 1 --2- 172.21.15.39:0/90102503 >> [v2:172.21.15.39:6800/2187509357,v1:172.21.15.39:6801/2187509357] conn(0x7f52f80a2d80 0x7f52f80a5240 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 crypto rx=0x7f5304009bd0 tx=0x7f5304005f90 comp rx=0 tx=0).ready entity=mgr.25199 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:49:13.550 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:49:13.550+0000 7f530e000640 1 -- 172.21.15.39:0/90102503 <== mon.0 v2:172.21.15.39:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7f53080bd310 con 0x7f531019ee90 2024-09-12T02:49:13.737 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:49:13.737+0000 7f5318000640 1 -- 172.21.15.39:0/90102503 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"} v 0) -- 0x7f53101048c0 con 0x7f531019ee90 2024-09-12T02:49:13.738 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:49:13.737+0000 7f530e000640 1 -- 172.21.15.39:0/90102503 <== mon.0 v2:172.21.15.39:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"}]=0 v108) ==== 103+0+11 (secure 0 0 0) 0x7f53080bcc10 con 0x7f531019ee90 2024-09-12T02:49:13.738 INFO:teuthology.orchestra.run.smithi039.stdout:pg_num: 32 2024-09-12T02:49:13.740 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:49:13.739+0000 7f5318000640 1 -- 172.21.15.39:0/90102503 >> [v2:172.21.15.39:6800/2187509357,v1:172.21.15.39:6801/2187509357] conn(0x7f52f80a2d80 msgr2=0x7f52f80a5240 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:49:13.740 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:49:13.739+0000 7f5318000640 1 --2- 172.21.15.39:0/90102503 >> [v2:172.21.15.39:6800/2187509357,v1:172.21.15.39:6801/2187509357] conn(0x7f52f80a2d80 0x7f52f80a5240 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 crypto rx=0x7f5304009bd0 tx=0x7f5304005f90 comp rx=0 tx=0).stop 2024-09-12T02:49:13.740 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:49:13.739+0000 7f5318000640 1 -- 172.21.15.39:0/90102503 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f531019ee90 msgr2=0x7f531019f340 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:49:13.740 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:49:13.739+0000 7f5318000640 1 --2- 172.21.15.39:0/90102503 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f531019ee90 0x7f531019f340 secure :-1 s=READY pgs=301 cs=0 l=1 rev1=1 crypto rx=0x7f5308005e30 tx=0x7f5308003d00 comp rx=0 tx=0).stop 2024-09-12T02:49:13.740 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:49:13.739+0000 7f5318000640 1 -- 172.21.15.39:0/90102503 shutdown_connections 2024-09-12T02:49:13.741 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:49:13.739+0000 7f5318000640 1 --2- 172.21.15.39:0/90102503 >> [v2:172.21.15.39:6800/2187509357,v1:172.21.15.39:6801/2187509357] conn(0x7f52f80a2d80 0x7f52f80a5240 unknown :-1 s=CLOSED pgs=50 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:49:13.741 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:49:13.739+0000 7f5318000640 1 --2- 172.21.15.39:0/90102503 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f531019ee90 0x7f531019f340 unknown :-1 s=CLOSED pgs=301 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:49:13.741 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:49:13.739+0000 7f5318000640 1 --2- 172.21.15.39:0/90102503 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f5310109060 0x7f531019ab10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:49:13.741 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:49:13.739+0000 7f5318000640 1 --2- 172.21.15.39:0/90102503 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f5310103f10 0x7f531019a5d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:49:13.741 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:49:13.739+0000 7f5318000640 1 -- 172.21.15.39:0/90102503 >> 172.21.15.39:0/90102503 conn(0x7f53100ff940 msgr2=0x7f5310100bc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:49:13.741 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:49:13.739+0000 7f5318000640 1 -- 172.21.15.39:0/90102503 shutdown_connections 2024-09-12T02:49:13.741 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:49:13.740+0000 7f5318000640 1 -- 172.21.15.39:0/90102503 wait complete. 2024-09-12T02:49:13.756 DEBUG:teuthology.orchestra.run.smithi039:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph mgr dump --format=json-pretty 2024-09-12T02:49:13.916 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:49:13.914+0000 7fd5db000640 1 -- 172.21.15.39:0/1133245548 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fd5d41078f0 msgr2=0x7fd5d4107cd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:49:13.916 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:49:13.914+0000 7fd5db000640 1 --2- 172.21.15.39:0/1133245548 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fd5d41078f0 0x7fd5d4107cd0 secure :-1 s=READY pgs=302 cs=0 l=1 rev1=1 crypto rx=0x7fd5c8009ca0 tx=0x7fd5c802a8c0 comp rx=0 tx=0).stop 2024-09-12T02:49:13.916 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:49:13.914+0000 7fd5db000640 1 -- 172.21.15.39:0/1133245548 shutdown_connections 2024-09-12T02:49:13.916 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:49:13.914+0000 7fd5db000640 1 --2- 172.21.15.39:0/1133245548 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fd5d4069d00 0x7fd5d410e7b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:49:13.917 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:49:13.914+0000 7fd5db000640 1 --2- 172.21.15.39:0/1133245548 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fd5d4069380 0x7fd5d40697c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:49:13.917 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:49:13.914+0000 7fd5db000640 1 --2- 172.21.15.39:0/1133245548 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fd5d41078f0 0x7fd5d4107cd0 unknown :-1 s=CLOSED pgs=302 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:49:13.917 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:49:13.914+0000 7fd5db000640 1 -- 172.21.15.39:0/1133245548 >> 172.21.15.39:0/1133245548 conn(0x7fd5d4076550 msgr2=0x7fd5d4076960 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:49:13.917 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:49:13.914+0000 7fd5db000640 1 -- 172.21.15.39:0/1133245548 shutdown_connections 2024-09-12T02:49:13.917 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:49:13.914+0000 7fd5db000640 1 -- 172.21.15.39:0/1133245548 wait complete. 2024-09-12T02:49:13.917 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:49:13.915+0000 7fd5db000640 1 Processor -- start 2024-09-12T02:49:13.917 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:49:13.915+0000 7fd5db000640 1 -- start start 2024-09-12T02:49:13.920 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:49:13.916+0000 7fd5db000640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fd5d4069380 0x7fd5d419a3f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:49:13.920 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:49:13.916+0000 7fd5db000640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fd5d4069d00 0x7fd5d419a930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:49:13.920 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:49:13.916+0000 7fd5db000640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fd5d41078f0 0x7fd5d419ecb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:49:13.920 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:49:13.916+0000 7fd5db000640 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 -- 0x7fd5d4111d20 con 0x7fd5d4069380 2024-09-12T02:49:13.920 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:49:13.916+0000 7fd5db000640 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x7fd5d4111ba0 con 0x7fd5d4069d00 2024-09-12T02:49:13.920 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:49:13.916+0000 7fd5db000640 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7fd5d4111ea0 con 0x7fd5d41078f0 2024-09-12T02:49:13.921 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:49:13.916+0000 7fd5d9c00640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fd5d4069380 0x7fd5d419a3f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:49:13.922 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:49:13.916+0000 7fd5d9c00640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fd5d4069380 0x7fd5d419a3f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.39:3300/0 says I am v2:172.21.15.39:42842/0 (socket says 172.21.15.39:42842) 2024-09-12T02:49:13.922 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:49:13.916+0000 7fd5d9c00640 1 -- 172.21.15.39:0/1812803664 learned_addr learned my addr 172.21.15.39:0/1812803664 (peer_addr_for_me v2:172.21.15.39:0/0) 2024-09-12T02:49:13.922 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:49:13.916+0000 7fd5d9200640 1 --2- 172.21.15.39:0/1812803664 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fd5d4069d00 0x7fd5d419a930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:49:13.922 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:49:13.916+0000 7fd5da600640 1 --2- 172.21.15.39:0/1812803664 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fd5d41078f0 0x7fd5d419ecb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:49:13.922 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:49:13.916+0000 7fd5d9c00640 1 -- 172.21.15.39:0/1812803664 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fd5d41078f0 msgr2=0x7fd5d419ecb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:49:13.922 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:49:13.916+0000 7fd5d9c00640 1 --2- 172.21.15.39:0/1812803664 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fd5d41078f0 0x7fd5d419ecb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:49:13.922 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:49:13.916+0000 7fd5d9c00640 1 -- 172.21.15.39:0/1812803664 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fd5d4069d00 msgr2=0x7fd5d419a930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:49:13.922 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:49:13.916+0000 7fd5d9c00640 1 --2- 172.21.15.39:0/1812803664 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fd5d4069d00 0x7fd5d419a930 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:49:13.922 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:49:13.916+0000 7fd5d9c00640 1 -- 172.21.15.39:0/1812803664 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd5d419f3e0 con 0x7fd5d4069380 2024-09-12T02:49:13.922 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:49:13.917+0000 7fd5d9c00640 1 --2- 172.21.15.39:0/1812803664 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fd5d4069380 0x7fd5d419a3f0 secure :-1 s=READY pgs=303 cs=0 l=1 rev1=1 crypto rx=0x7fd5c8005e30 tx=0x7fd5c8003f90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:49:13.922 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:49:13.917+0000 7fd5d2000640 1 -- 172.21.15.39:0/1812803664 <== mon.0 v2:172.21.15.39:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd5c8031650 con 0x7fd5d4069380 2024-09-12T02:49:13.923 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:49:13.917+0000 7fd5d2000640 1 -- 172.21.15.39:0/1812803664 <== mon.0 v2:172.21.15.39:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fd5c80317f0 con 0x7fd5d4069380 2024-09-12T02:49:13.923 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:49:13.917+0000 7fd5d2000640 1 -- 172.21.15.39:0/1812803664 <== mon.0 v2:172.21.15.39:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd5c802fad0 con 0x7fd5d4069380 2024-09-12T02:49:13.923 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:49:13.917+0000 7fd5db000640 1 -- 172.21.15.39:0/1812803664 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd5d419f670 con 0x7fd5d4069380 2024-09-12T02:49:13.923 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:49:13.917+0000 7fd5db000640 1 -- 172.21.15.39:0/1812803664 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd5d41a6f60 con 0x7fd5d4069380 2024-09-12T02:49:13.923 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:49:13.918+0000 7fd5db000640 1 -- 172.21.15.39:0/1812803664 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fd5d40697c0 con 0x7fd5d4069380 2024-09-12T02:49:13.924 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:49:13.920+0000 7fd5d2000640 1 -- 172.21.15.39:0/1812803664 <== mon.0 v2:172.21.15.39:3300/0 4 ==== mgrmap(e 27) ==== 137964+0+0 (secure 0 0 0) 0x7fd5c80045b0 con 0x7fd5d4069380 2024-09-12T02:49:13.924 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:49:13.921+0000 7fd5d2000640 1 --2- 172.21.15.39:0/1812803664 >> [v2:172.21.15.39:6800/2187509357,v1:172.21.15.39:6801/2187509357] conn(0x7fd5bc0a2d80 0x7fd5bc0a5240 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:49:13.924 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:49:13.921+0000 7fd5d2000640 1 -- 172.21.15.39:0/1812803664 <== mon.0 v2:172.21.15.39:3300/0 5 ==== osd_map(108..108 src has 1..108) ==== 9475+0+0 (secure 0 0 0) 0x7fd5c80f0a80 con 0x7fd5d4069380 2024-09-12T02:49:13.924 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:49:13.922+0000 7fd5d9200640 1 --2- 172.21.15.39:0/1812803664 >> [v2:172.21.15.39:6800/2187509357,v1:172.21.15.39:6801/2187509357] conn(0x7fd5bc0a2d80 0x7fd5bc0a5240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:49:13.924 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:49:13.922+0000 7fd5d9200640 1 --2- 172.21.15.39:0/1812803664 >> [v2:172.21.15.39:6800/2187509357,v1:172.21.15.39:6801/2187509357] conn(0x7fd5bc0a2d80 0x7fd5bc0a5240 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0x7fd5d410ec60 tx=0x7fd5c0005f90 comp rx=0 tx=0).ready entity=mgr.25199 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:49:13.926 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:49:13.925+0000 7fd5d2000640 1 -- 172.21.15.39:0/1812803664 <== mon.0 v2:172.21.15.39:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7fd5c80f2e20 con 0x7fd5d4069380 2024-09-12T02:49:13.949 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 12 02:49:13 smithi044 ceph-mon[35411]: pgmap v352: 129 pgs: 129 active+clean; 24 MiB data, 485 MiB used, 1.0 TiB / 1.0 TiB avail; 59 KiB/s rd, 54 KiB/s wr, 18 op/s 2024-09-12T02:49:13.949 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 12 02:49:13 smithi044 ceph-mon[35411]: from='client.? 172.21.15.39:0/3981015059' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]: dispatch 2024-09-12T02:49:13.949 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 12 02:49:13 smithi044 ceph-mon[35411]: from='client.? 172.21.15.39:0/1895280536' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]: dispatch 2024-09-12T02:49:14.013 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 12 02:49:13 smithi172 ceph-mon[35609]: pgmap v352: 129 pgs: 129 active+clean; 24 MiB data, 485 MiB used, 1.0 TiB / 1.0 TiB avail; 59 KiB/s rd, 54 KiB/s wr, 18 op/s 2024-09-12T02:49:14.014 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 12 02:49:13 smithi172 ceph-mon[35609]: from='client.? 172.21.15.39:0/3981015059' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]: dispatch 2024-09-12T02:49:14.014 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 12 02:49:13 smithi172 ceph-mon[35609]: from='client.? 172.21.15.39:0/1895280536' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]: dispatch 2024-09-12T02:49:14.099 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 02:49:13 smithi039 ceph-mon[30515]: pgmap v352: 129 pgs: 129 active+clean; 24 MiB data, 485 MiB used, 1.0 TiB / 1.0 TiB avail; 59 KiB/s rd, 54 KiB/s wr, 18 op/s 2024-09-12T02:49:14.100 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 02:49:13 smithi039 ceph-mon[30515]: from='client.? 172.21.15.39:0/3981015059' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]: dispatch 2024-09-12T02:49:14.100 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 02:49:13 smithi039 ceph-mon[30515]: from='client.? 172.21.15.39:0/1895280536' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]: dispatch 2024-09-12T02:49:14.160 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:49:14.159+0000 7fd5db000640 1 -- 172.21.15.39:0/1812803664 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_command({"prefix": "mgr dump", "format": "json-pretty"} v 0) -- 0x7fd5d41a71b0 con 0x7fd5d4069380 2024-09-12T02:49:14.171 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:49:14.171+0000 7fd5d2000640 1 -- 172.21.15.39:0/1812803664 <== mon.0 v2:172.21.15.39:3300/0 7 ==== mon_command_ack([{"prefix": "mgr dump", "format": "json-pretty"}]=0 v27) ==== 81+0+740901 (secure 0 0 0) 0x7fd5c80bd390 con 0x7fd5d4069380 2024-09-12T02:49:14.183 INFO:teuthology.orchestra.run.smithi039.stdout: 2024-09-12T02:49:14.183 INFO:teuthology.orchestra.run.smithi039.stdout:{ 2024-09-12T02:49:14.183 INFO:teuthology.orchestra.run.smithi039.stdout: "epoch": 27, 2024-09-12T02:49:14.184 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 0, 2024-09-12T02:49:14.184 INFO:teuthology.orchestra.run.smithi039.stdout: "active_gid": 25199, 2024-09-12T02:49:14.184 INFO:teuthology.orchestra.run.smithi039.stdout: "active_name": "x", 2024-09-12T02:49:14.184 INFO:teuthology.orchestra.run.smithi039.stdout: "active_addrs": { 2024-09-12T02:49:14.184 INFO:teuthology.orchestra.run.smithi039.stdout: "addrvec": [ 2024-09-12T02:49:14.184 INFO:teuthology.orchestra.run.smithi039.stdout: { 2024-09-12T02:49:14.184 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "v2", 2024-09-12T02:49:14.185 INFO:teuthology.orchestra.run.smithi039.stdout: "addr": "172.21.15.39:6800", 2024-09-12T02:49:14.185 INFO:teuthology.orchestra.run.smithi039.stdout: "nonce": 2187509357 2024-09-12T02:49:14.185 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-09-12T02:49:14.185 INFO:teuthology.orchestra.run.smithi039.stdout: { 2024-09-12T02:49:14.185 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "v1", 2024-09-12T02:49:14.185 INFO:teuthology.orchestra.run.smithi039.stdout: "addr": "172.21.15.39:6801", 2024-09-12T02:49:14.185 INFO:teuthology.orchestra.run.smithi039.stdout: "nonce": 2187509357 2024-09-12T02:49:14.185 INFO:teuthology.orchestra.run.smithi039.stdout: } 2024-09-12T02:49:14.185 INFO:teuthology.orchestra.run.smithi039.stdout: ] 2024-09-12T02:49:14.185 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-09-12T02:49:14.185 INFO:teuthology.orchestra.run.smithi039.stdout: "active_addr": "172.21.15.39:6801/2187509357", 2024-09-12T02:49:14.186 INFO:teuthology.orchestra.run.smithi039.stdout: "active_change": "2024-09-12T02:37:55.928690+0000", 2024-09-12T02:49:14.186 INFO:teuthology.orchestra.run.smithi039.stdout: "active_mgr_features": 4540701547738038271, 2024-09-12T02:49:14.186 INFO:teuthology.orchestra.run.smithi039.stdout: "available": true, 2024-09-12T02:49:14.186 INFO:teuthology.orchestra.run.smithi039.stdout: "standbys": [ 2024-09-12T02:49:14.186 INFO:teuthology.orchestra.run.smithi039.stdout: { 2024-09-12T02:49:14.186 INFO:teuthology.orchestra.run.smithi039.stdout: "gid": 25196, 2024-09-12T02:49:14.186 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "y", 2024-09-12T02:49:14.186 INFO:teuthology.orchestra.run.smithi039.stdout: "mgr_features": 4540701547738038271, 2024-09-12T02:49:14.186 INFO:teuthology.orchestra.run.smithi039.stdout: "available_modules": [ 2024-09-12T02:49:14.186 INFO:teuthology.orchestra.run.smithi039.stdout: { 2024-09-12T02:49:14.186 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "alerts", 2024-09-12T02:49:14.186 INFO:teuthology.orchestra.run.smithi039.stdout: "can_run": true, 2024-09-12T02:49:14.186 INFO:teuthology.orchestra.run.smithi039.stdout: "error_string": "", 2024-09-12T02:49:14.186 INFO:teuthology.orchestra.run.smithi039.stdout: "module_options": { 2024-09-12T02:49:14.187 INFO:teuthology.orchestra.run.smithi039.stdout: "interval": { 2024-09-12T02:49:14.187 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "interval", 2024-09-12T02:49:14.187 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "secs", 2024-09-12T02:49:14.187 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "advanced", 2024-09-12T02:49:14.187 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 1, 2024-09-12T02:49:14.187 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "60", 2024-09-12T02:49:14.187 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-09-12T02:49:14.187 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-09-12T02:49:14.187 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [], 2024-09-12T02:49:14.187 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "How frequently to reexamine health status", 2024-09-12T02:49:14.187 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-09-12T02:49:14.187 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-09-12T02:49:14.188 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-09-12T02:49:14.188 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-09-12T02:49:14.188 INFO:teuthology.orchestra.run.smithi039.stdout: "log_level": { 2024-09-12T02:49:14.188 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "log_level", 2024-09-12T02:49:14.188 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "str", 2024-09-12T02:49:14.188 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "advanced", 2024-09-12T02:49:14.188 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 1, 2024-09-12T02:49:14.188 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "", 2024-09-12T02:49:14.188 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-09-12T02:49:14.190 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-09-12T02:49:14.190 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [ 2024-09-12T02:49:14.191 INFO:teuthology.orchestra.run.smithi039.stdout: "", 2024-09-12T02:49:14.191 INFO:teuthology.orchestra.run.smithi039.stdout: "critical", 2024-09-12T02:49:14.191 INFO:teuthology.orchestra.run.smithi039.stdout: "debug", 2024-09-12T02:49:14.191 INFO:teuthology.orchestra.run.smithi039.stdout: "error", 2024-09-12T02:49:14.191 INFO:teuthology.orchestra.run.smithi039.stdout: "info", 2024-09-12T02:49:14.191 INFO:teuthology.orchestra.run.smithi039.stdout: "warning" 2024-09-12T02:49:14.191 INFO:teuthology.orchestra.run.smithi039.stdout: ], 2024-09-12T02:49:14.191 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "", 2024-09-12T02:49:14.191 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-09-12T02:49:14.191 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-09-12T02:49:14.191 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-09-12T02:49:14.191 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-09-12T02:49:14.192 INFO:teuthology.orchestra.run.smithi039.stdout: "log_to_cluster": { 2024-09-12T02:49:14.192 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "log_to_cluster", 2024-09-12T02:49:14.192 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "bool", 2024-09-12T02:49:14.192 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "advanced", 2024-09-12T02:49:14.192 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 1, 2024-09-12T02:49:14.192 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "False", 2024-09-12T02:49:14.192 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-09-12T02:49:14.192 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-09-12T02:49:14.192 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [], 2024-09-12T02:49:14.192 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "", 2024-09-12T02:49:14.192 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-09-12T02:49:14.192 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-09-12T02:49:14.192 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-09-12T02:49:14.193 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-09-12T02:49:14.193 INFO:teuthology.orchestra.run.smithi039.stdout: "log_to_cluster_level": { 2024-09-12T02:49:14.193 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "log_to_cluster_level", 2024-09-12T02:49:14.193 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "str", 2024-09-12T02:49:14.193 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "advanced", 2024-09-12T02:49:14.193 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 1, 2024-09-12T02:49:14.193 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "info", 2024-09-12T02:49:14.193 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-09-12T02:49:14.193 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-09-12T02:49:14.193 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [ 2024-09-12T02:49:14.193 INFO:teuthology.orchestra.run.smithi039.stdout: "", 2024-09-12T02:49:14.193 INFO:teuthology.orchestra.run.smithi039.stdout: "critical", 2024-09-12T02:49:14.193 INFO:teuthology.orchestra.run.smithi039.stdout: "debug", 2024-09-12T02:49:14.194 INFO:teuthology.orchestra.run.smithi039.stdout: "error", 2024-09-12T02:49:14.194 INFO:teuthology.orchestra.run.smithi039.stdout: "info", 2024-09-12T02:49:14.194 INFO:teuthology.orchestra.run.smithi039.stdout: "warning" 2024-09-12T02:49:14.194 INFO:teuthology.orchestra.run.smithi039.stdout: ], 2024-09-12T02:49:14.194 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "", 2024-09-12T02:49:14.194 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-09-12T02:49:14.194 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-09-12T02:49:14.194 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-09-12T02:49:14.194 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-09-12T02:49:14.194 INFO:teuthology.orchestra.run.smithi039.stdout: "log_to_file": { 2024-09-12T02:49:14.194 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "log_to_file", 2024-09-12T02:49:14.194 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "bool", 2024-09-12T02:49:14.194 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "advanced", 2024-09-12T02:49:14.195 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 1, 2024-09-12T02:49:14.195 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "False", 2024-09-12T02:49:14.195 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-09-12T02:49:14.195 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-09-12T02:49:14.195 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [], 2024-09-12T02:49:14.195 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "", 2024-09-12T02:49:14.195 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-09-12T02:49:14.195 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-09-12T02:49:14.195 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-09-12T02:49:14.195 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-09-12T02:49:14.195 INFO:teuthology.orchestra.run.smithi039.stdout: "smtp_destination": { 2024-09-12T02:49:14.195 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "smtp_destination", 2024-09-12T02:49:14.195 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "str", 2024-09-12T02:49:14.195 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "advanced", 2024-09-12T02:49:14.196 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 1, 2024-09-12T02:49:14.196 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "", 2024-09-12T02:49:14.196 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-09-12T02:49:14.196 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-09-12T02:49:14.196 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [], 2024-09-12T02:49:14.196 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "Email address to send alerts to", 2024-09-12T02:49:14.196 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-09-12T02:49:14.196 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-09-12T02:49:14.196 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-09-12T02:49:14.196 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-09-12T02:49:14.196 INFO:teuthology.orchestra.run.smithi039.stdout: "smtp_from_name": { 2024-09-12T02:49:14.196 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "smtp_from_name", 2024-09-12T02:49:14.196 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "str", 2024-09-12T02:49:14.197 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "advanced", 2024-09-12T02:49:14.197 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 1, 2024-09-12T02:49:14.197 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "Ceph", 2024-09-12T02:49:14.197 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-09-12T02:49:14.197 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-09-12T02:49:14.197 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [], 2024-09-12T02:49:14.197 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "Email From: name", 2024-09-12T02:49:14.197 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-09-12T02:49:14.197 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-09-12T02:49:14.197 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-09-12T02:49:14.197 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-09-12T02:49:14.197 INFO:teuthology.orchestra.run.smithi039.stdout: "smtp_host": { 2024-09-12T02:49:14.198 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "smtp_host", 2024-09-12T02:49:14.198 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "str", 2024-09-12T02:49:14.198 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "advanced", 2024-09-12T02:49:14.198 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 1, 2024-09-12T02:49:14.198 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "", 2024-09-12T02:49:14.198 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-09-12T02:49:14.198 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-09-12T02:49:14.198 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [], 2024-09-12T02:49:14.198 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "SMTP server", 2024-09-12T02:49:14.198 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-09-12T02:49:14.198 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-09-12T02:49:14.198 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-09-12T02:49:14.198 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-09-12T02:49:14.198 INFO:teuthology.orchestra.run.smithi039.stdout: "smtp_password": { 2024-09-12T02:49:14.199 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "smtp_password", 2024-09-12T02:49:14.199 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "str", 2024-09-12T02:49:14.199 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "advanced", 2024-09-12T02:49:14.199 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 1, 2024-09-12T02:49:14.199 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "", 2024-09-12T02:49:14.199 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-09-12T02:49:14.199 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-09-12T02:49:14.199 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [], 2024-09-12T02:49:14.199 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "Password to authenticate with", 2024-09-12T02:49:14.199 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-09-12T02:49:14.199 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-09-12T02:49:14.199 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-09-12T02:49:14.199 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-09-12T02:49:14.199 INFO:teuthology.orchestra.run.smithi039.stdout: "smtp_port": { 2024-09-12T02:49:14.200 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "smtp_port", 2024-09-12T02:49:14.200 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "int", 2024-09-12T02:49:14.200 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "advanced", 2024-09-12T02:49:14.200 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 1, 2024-09-12T02:49:14.200 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "465", 2024-09-12T02:49:14.200 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-09-12T02:49:14.200 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-09-12T02:49:14.200 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [], 2024-09-12T02:49:14.200 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "SMTP port", 2024-09-12T02:49:14.200 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-09-12T02:49:14.200 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-09-12T02:49:14.200 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-09-12T02:49:14.200 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-09-12T02:49:14.200 INFO:teuthology.orchestra.run.smithi039.stdout: "smtp_sender": { 2024-09-12T02:49:14.201 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "smtp_sender", 2024-09-12T02:49:14.201 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "str", 2024-09-12T02:49:14.201 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "advanced", 2024-09-12T02:49:14.201 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 1, 2024-09-12T02:49:14.201 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "", 2024-09-12T02:49:14.201 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-09-12T02:49:14.201 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-09-12T02:49:14.201 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [], 2024-09-12T02:49:14.201 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "SMTP envelope sender", 2024-09-12T02:49:14.201 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-09-12T02:49:14.201 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-09-12T02:49:14.201 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-09-12T02:49:14.202 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-09-12T02:49:14.202 INFO:teuthology.orchestra.run.smithi039.stdout: "smtp_ssl": { 2024-09-12T02:49:14.202 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "smtp_ssl", 2024-09-12T02:49:14.202 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "bool", 2024-09-12T02:49:14.202 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "advanced", 2024-09-12T02:49:14.202 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 1, 2024-09-12T02:49:14.202 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "True", 2024-09-12T02:49:14.202 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-09-12T02:49:14.202 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-09-12T02:49:14.202 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [], 2024-09-12T02:49:14.202 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "Use SSL to connect to SMTP server", 2024-09-12T02:49:14.202 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-09-12T02:49:14.203 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-09-12T02:49:14.203 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-09-12T02:49:14.203 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-09-12T02:49:14.203 INFO:teuthology.orchestra.run.smithi039.stdout: "smtp_user": { 2024-09-12T02:49:14.203 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "smtp_user", 2024-09-12T02:49:14.203 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "str", 2024-09-12T02:49:14.203 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "advanced", 2024-09-12T02:49:14.203 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 1, 2024-09-12T02:49:14.203 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "", 2024-09-12T02:49:14.203 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-09-12T02:49:14.203 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-09-12T02:49:14.203 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [], 2024-09-12T02:49:14.203 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "User to authenticate as", 2024-09-12T02:49:14.203 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-09-12T02:49:14.204 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-09-12T02:49:14.204 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-09-12T02:49:14.204 INFO:teuthology.orchestra.run.smithi039.stdout: } 2024-09-12T02:49:14.204 INFO:teuthology.orchestra.run.smithi039.stdout: } 2024-09-12T02:49:14.204 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-09-12T02:49:14.204 INFO:teuthology.orchestra.run.smithi039.stdout: { 2024-09-12T02:49:14.204 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "balancer", 2024-09-12T02:49:14.204 INFO:teuthology.orchestra.run.smithi039.stdout: "can_run": true, 2024-09-12T02:49:14.204 INFO:teuthology.orchestra.run.smithi039.stdout: "error_string": "", 2024-09-12T02:49:14.204 INFO:teuthology.orchestra.run.smithi039.stdout: "module_options": { 2024-09-12T02:49:14.204 INFO:teuthology.orchestra.run.smithi039.stdout: "active": { 2024-09-12T02:49:14.204 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "active", 2024-09-12T02:49:14.204 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "bool", 2024-09-12T02:49:14.205 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "advanced", 2024-09-12T02:49:14.205 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 1, 2024-09-12T02:49:14.205 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "True", 2024-09-12T02:49:14.205 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-09-12T02:49:14.205 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-09-12T02:49:14.205 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [], 2024-09-12T02:49:14.205 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "automatically balance PGs across cluster", 2024-09-12T02:49:14.205 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-09-12T02:49:14.205 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-09-12T02:49:14.205 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-09-12T02:49:14.205 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-09-12T02:49:14.205 INFO:teuthology.orchestra.run.smithi039.stdout: "begin_time": { 2024-09-12T02:49:14.205 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "begin_time", 2024-09-12T02:49:14.206 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "str", 2024-09-12T02:49:14.206 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "advanced", 2024-09-12T02:49:14.206 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 1, 2024-09-12T02:49:14.206 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "0000", 2024-09-12T02:49:14.206 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-09-12T02:49:14.206 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-09-12T02:49:14.206 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [], 2024-09-12T02:49:14.206 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "beginning time of day to automatically balance", 2024-09-12T02:49:14.206 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "This is a time of day in the format HHMM.", 2024-09-12T02:49:14.206 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-09-12T02:49:14.206 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-09-12T02:49:14.206 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-09-12T02:49:14.206 INFO:teuthology.orchestra.run.smithi039.stdout: "begin_weekday": { 2024-09-12T02:49:14.206 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "begin_weekday", 2024-09-12T02:49:14.207 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "uint", 2024-09-12T02:49:14.207 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "advanced", 2024-09-12T02:49:14.207 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 1, 2024-09-12T02:49:14.207 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "0", 2024-09-12T02:49:14.207 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "0", 2024-09-12T02:49:14.207 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "6", 2024-09-12T02:49:14.207 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [], 2024-09-12T02:49:14.207 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "Restrict automatic balancing to this day of the week or later", 2024-09-12T02:49:14.207 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "0 = Sunday, 1 = Monday, etc.", 2024-09-12T02:49:14.207 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-09-12T02:49:14.207 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-09-12T02:49:14.207 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-09-12T02:49:14.207 INFO:teuthology.orchestra.run.smithi039.stdout: "crush_compat_max_iterations": { 2024-09-12T02:49:14.208 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "crush_compat_max_iterations", 2024-09-12T02:49:14.208 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "uint", 2024-09-12T02:49:14.208 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "advanced", 2024-09-12T02:49:14.208 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 1, 2024-09-12T02:49:14.208 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "25", 2024-09-12T02:49:14.208 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "1", 2024-09-12T02:49:14.208 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "250", 2024-09-12T02:49:14.208 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [], 2024-09-12T02:49:14.208 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "maximum number of iterations to attempt optimization", 2024-09-12T02:49:14.208 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-09-12T02:49:14.208 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-09-12T02:49:14.208 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-09-12T02:49:14.208 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-09-12T02:49:14.208 INFO:teuthology.orchestra.run.smithi039.stdout: "crush_compat_metrics": { 2024-09-12T02:49:14.209 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "crush_compat_metrics", 2024-09-12T02:49:14.209 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "str", 2024-09-12T02:49:14.209 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "advanced", 2024-09-12T02:49:14.209 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 1, 2024-09-12T02:49:14.209 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "pgs,objects,bytes", 2024-09-12T02:49:14.209 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-09-12T02:49:14.209 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-09-12T02:49:14.209 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [], 2024-09-12T02:49:14.209 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "metrics with which to calculate OSD utilization", 2024-09-12T02:49:14.209 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "Value is a list of one or more of \"pgs\", \"objects\", or \"bytes\", and indicates which metrics to use to balance utilization.", 2024-09-12T02:49:14.209 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-09-12T02:49:14.209 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-09-12T02:49:14.209 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-09-12T02:49:14.209 INFO:teuthology.orchestra.run.smithi039.stdout: "crush_compat_step": { 2024-09-12T02:49:14.210 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "crush_compat_step", 2024-09-12T02:49:14.210 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "float", 2024-09-12T02:49:14.210 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "advanced", 2024-09-12T02:49:14.210 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 1, 2024-09-12T02:49:14.210 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "0.5", 2024-09-12T02:49:14.210 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "0.001", 2024-09-12T02:49:14.210 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "0.999", 2024-09-12T02:49:14.210 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [], 2024-09-12T02:49:14.210 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "aggressiveness of optimization", 2024-09-12T02:49:14.210 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": ".99 is very aggressive, .01 is less aggressive", 2024-09-12T02:49:14.210 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-09-12T02:49:14.210 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-09-12T02:49:14.210 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-09-12T02:49:14.210 INFO:teuthology.orchestra.run.smithi039.stdout: "end_time": { 2024-09-12T02:49:14.211 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "end_time", 2024-09-12T02:49:14.211 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "str", 2024-09-12T02:49:14.211 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "advanced", 2024-09-12T02:49:14.211 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 1, 2024-09-12T02:49:14.211 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "2359", 2024-09-12T02:49:14.211 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-09-12T02:49:14.211 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-09-12T02:49:14.211 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [], 2024-09-12T02:49:14.211 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "ending time of day to automatically balance", 2024-09-12T02:49:14.211 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "This is a time of day in the format HHMM.", 2024-09-12T02:49:14.211 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-09-12T02:49:14.211 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-09-12T02:49:14.211 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-09-12T02:49:14.211 INFO:teuthology.orchestra.run.smithi039.stdout: "end_weekday": { 2024-09-12T02:49:14.212 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "end_weekday", 2024-09-12T02:49:14.212 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "uint", 2024-09-12T02:49:14.212 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "advanced", 2024-09-12T02:49:14.212 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 1, 2024-09-12T02:49:14.212 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "0", 2024-09-12T02:49:14.212 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "0", 2024-09-12T02:49:14.212 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "6", 2024-09-12T02:49:14.212 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [], 2024-09-12T02:49:14.212 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "Restrict automatic balancing to days of the week earlier than this", 2024-09-12T02:49:14.212 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "0 = Sunday, 1 = Monday, etc.", 2024-09-12T02:49:14.212 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-09-12T02:49:14.212 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-09-12T02:49:14.212 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-09-12T02:49:14.213 INFO:teuthology.orchestra.run.smithi039.stdout: "log_level": { 2024-09-12T02:49:14.213 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "log_level", 2024-09-12T02:49:14.213 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "str", 2024-09-12T02:49:14.213 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "advanced", 2024-09-12T02:49:14.213 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 1, 2024-09-12T02:49:14.213 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "", 2024-09-12T02:49:14.213 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-09-12T02:49:14.213 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-09-12T02:49:14.213 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [ 2024-09-12T02:49:14.213 INFO:teuthology.orchestra.run.smithi039.stdout: "", 2024-09-12T02:49:14.213 INFO:teuthology.orchestra.run.smithi039.stdout: "critical", 2024-09-12T02:49:14.213 INFO:teuthology.orchestra.run.smithi039.stdout: "debug", 2024-09-12T02:49:14.213 INFO:teuthology.orchestra.run.smithi039.stdout: "error", 2024-09-12T02:49:14.213 INFO:teuthology.orchestra.run.smithi039.stdout: "info", 2024-09-12T02:49:14.214 INFO:teuthology.orchestra.run.smithi039.stdout: "warning" 2024-09-12T02:49:14.214 INFO:teuthology.orchestra.run.smithi039.stdout: ], 2024-09-12T02:49:14.214 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "", 2024-09-12T02:49:14.214 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-09-12T02:49:14.214 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-09-12T02:49:14.214 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-09-12T02:49:14.214 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-09-12T02:49:14.214 INFO:teuthology.orchestra.run.smithi039.stdout: "log_to_cluster": { 2024-09-12T02:49:14.214 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "log_to_cluster", 2024-09-12T02:49:14.214 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "bool", 2024-09-12T02:49:14.214 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "advanced", 2024-09-12T02:49:14.214 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 1, 2024-09-12T02:49:14.214 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "False", 2024-09-12T02:49:14.215 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-09-12T02:49:14.215 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-09-12T02:49:14.215 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [], 2024-09-12T02:49:14.215 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "", 2024-09-12T02:49:14.215 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-09-12T02:49:14.215 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-09-12T02:49:14.215 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-09-12T02:49:14.215 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-09-12T02:49:14.215 INFO:teuthology.orchestra.run.smithi039.stdout: "log_to_cluster_level": { 2024-09-12T02:49:14.216 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "log_to_cluster_level", 2024-09-12T02:49:14.216 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "str", 2024-09-12T02:49:14.216 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "advanced", 2024-09-12T02:49:14.216 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 1, 2024-09-12T02:49:14.216 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "info", 2024-09-12T02:49:14.216 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-09-12T02:49:14.216 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-09-12T02:49:14.216 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [ 2024-09-12T02:49:14.216 INFO:teuthology.orchestra.run.smithi039.stdout: "", 2024-09-12T02:49:14.216 INFO:teuthology.orchestra.run.smithi039.stdout: "critical", 2024-09-12T02:49:14.216 INFO:teuthology.orchestra.run.smithi039.stdout: "debug", 2024-09-12T02:49:14.216 INFO:teuthology.orchestra.run.smithi039.stdout: "error", 2024-09-12T02:49:14.217 INFO:teuthology.orchestra.run.smithi039.stdout: "info", 2024-09-12T02:49:14.217 INFO:teuthology.orchestra.run.smithi039.stdout: "warning" 2024-09-12T02:49:14.217 INFO:teuthology.orchestra.run.smithi039.stdout: ], 2024-09-12T02:49:14.217 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "", 2024-09-12T02:49:14.217 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-09-12T02:49:14.217 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-09-12T02:49:14.217 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-09-12T02:49:14.217 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-09-12T02:49:14.217 INFO:teuthology.orchestra.run.smithi039.stdout: "log_to_file": { 2024-09-12T02:49:14.217 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "log_to_file", 2024-09-12T02:49:14.217 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "bool", 2024-09-12T02:49:14.217 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "advanced", 2024-09-12T02:49:14.217 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 1, 2024-09-12T02:49:14.217 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "False", 2024-09-12T02:49:14.218 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-09-12T02:49:14.218 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-09-12T02:49:14.218 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [], 2024-09-12T02:49:14.218 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "", 2024-09-12T02:49:14.218 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-09-12T02:49:14.218 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-09-12T02:49:14.218 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-09-12T02:49:14.218 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-09-12T02:49:14.218 INFO:teuthology.orchestra.run.smithi039.stdout: "min_score": { 2024-09-12T02:49:14.218 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "min_score", 2024-09-12T02:49:14.218 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "float", 2024-09-12T02:49:14.218 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "advanced", 2024-09-12T02:49:14.218 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 1, 2024-09-12T02:49:14.219 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "0", 2024-09-12T02:49:14.219 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-09-12T02:49:14.219 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-09-12T02:49:14.219 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [], 2024-09-12T02:49:14.219 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "minimum score, below which no optimization is attempted", 2024-09-12T02:49:14.219 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-09-12T02:49:14.219 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-09-12T02:49:14.219 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-09-12T02:49:14.219 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-09-12T02:49:14.219 INFO:teuthology.orchestra.run.smithi039.stdout: "mode": { 2024-09-12T02:49:14.219 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "mode", 2024-09-12T02:49:14.219 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "str", 2024-09-12T02:49:14.219 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "advanced", 2024-09-12T02:49:14.220 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 1, 2024-09-12T02:49:14.220 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "upmap", 2024-09-12T02:49:14.220 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-09-12T02:49:14.220 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-09-12T02:49:14.220 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [ 2024-09-12T02:49:14.220 INFO:teuthology.orchestra.run.smithi039.stdout: "crush-compat", 2024-09-12T02:49:14.220 INFO:teuthology.orchestra.run.smithi039.stdout: "none", 2024-09-12T02:49:14.220 INFO:teuthology.orchestra.run.smithi039.stdout: "read", 2024-09-12T02:49:14.220 INFO:teuthology.orchestra.run.smithi039.stdout: "upmap", 2024-09-12T02:49:14.220 INFO:teuthology.orchestra.run.smithi039.stdout: "upmap-read" 2024-09-12T02:49:14.220 INFO:teuthology.orchestra.run.smithi039.stdout: ], 2024-09-12T02:49:14.220 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "Balancer mode", 2024-09-12T02:49:14.220 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-09-12T02:49:14.221 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-09-12T02:49:14.221 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-09-12T02:49:14.221 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-09-12T02:49:14.221 INFO:teuthology.orchestra.run.smithi039.stdout: "pool_ids": { 2024-09-12T02:49:14.221 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "pool_ids", 2024-09-12T02:49:14.221 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "str", 2024-09-12T02:49:14.221 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "advanced", 2024-09-12T02:49:14.221 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 1, 2024-09-12T02:49:14.221 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "", 2024-09-12T02:49:14.221 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-09-12T02:49:14.221 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-09-12T02:49:14.221 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [], 2024-09-12T02:49:14.221 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "pools which the automatic balancing will be limited to", 2024-09-12T02:49:14.221 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-09-12T02:49:14.222 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-09-12T02:49:14.222 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-09-12T02:49:14.222 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-09-12T02:49:14.222 INFO:teuthology.orchestra.run.smithi039.stdout: "sleep_interval": { 2024-09-12T02:49:14.222 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "sleep_interval", 2024-09-12T02:49:14.222 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "secs", 2024-09-12T02:49:14.222 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "advanced", 2024-09-12T02:49:14.222 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 1, 2024-09-12T02:49:14.222 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "60", 2024-09-12T02:49:14.222 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-09-12T02:49:14.222 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-09-12T02:49:14.222 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [], 2024-09-12T02:49:14.222 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "how frequently to wake up and attempt optimization", 2024-09-12T02:49:14.223 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-09-12T02:49:14.223 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-09-12T02:49:14.223 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-09-12T02:49:14.223 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-09-12T02:49:14.223 INFO:teuthology.orchestra.run.smithi039.stdout: "upmap_max_deviation": { 2024-09-12T02:49:14.223 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "upmap_max_deviation", 2024-09-12T02:49:14.223 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "int", 2024-09-12T02:49:14.223 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "advanced", 2024-09-12T02:49:14.223 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 1, 2024-09-12T02:49:14.223 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "5", 2024-09-12T02:49:14.223 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "1", 2024-09-12T02:49:14.223 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-09-12T02:49:14.223 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [], 2024-09-12T02:49:14.223 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "deviation below which no optimization is attempted", 2024-09-12T02:49:14.224 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "If the number of PGs are within this count then no optimization is attempted", 2024-09-12T02:49:14.224 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-09-12T02:49:14.224 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-09-12T02:49:14.224 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-09-12T02:49:14.224 INFO:teuthology.orchestra.run.smithi039.stdout: "upmap_max_optimizations": { 2024-09-12T02:49:14.224 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "upmap_max_optimizations", 2024-09-12T02:49:14.224 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "uint", 2024-09-12T02:49:14.224 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "advanced", 2024-09-12T02:49:14.224 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 1, 2024-09-12T02:49:14.224 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "10", 2024-09-12T02:49:14.224 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-09-12T02:49:14.224 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-09-12T02:49:14.224 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [], 2024-09-12T02:49:14.224 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "maximum upmap optimizations to make per attempt", 2024-09-12T02:49:14.225 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-09-12T02:49:14.225 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-09-12T02:49:14.225 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-09-12T02:49:14.225 INFO:teuthology.orchestra.run.smithi039.stdout: } 2024-09-12T02:49:14.225 INFO:teuthology.orchestra.run.smithi039.stdout: } 2024-09-12T02:49:14.225 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-09-12T02:49:14.225 INFO:teuthology.orchestra.run.smithi039.stdout: { 2024-09-12T02:49:14.225 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "cephadm", 2024-09-12T02:49:14.225 INFO:teuthology.orchestra.run.smithi039.stdout: "can_run": true, 2024-09-12T02:49:14.225 INFO:teuthology.orchestra.run.smithi039.stdout: "error_string": "", 2024-09-12T02:49:14.225 INFO:teuthology.orchestra.run.smithi039.stdout: "module_options": { 2024-09-12T02:49:14.225 INFO:teuthology.orchestra.run.smithi039.stdout: "agent_down_multiplier": { 2024-09-12T02:49:14.225 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "agent_down_multiplier", 2024-09-12T02:49:14.225 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "float", 2024-09-12T02:49:14.226 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "advanced", 2024-09-12T02:49:14.226 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 0, 2024-09-12T02:49:14.226 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "3.0", 2024-09-12T02:49:14.226 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-09-12T02:49:14.226 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-09-12T02:49:14.226 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [], 2024-09-12T02:49:14.226 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "Multiplied by agent refresh rate to calculate how long agent must not report before being marked down", 2024-09-12T02:49:14.226 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-09-12T02:49:14.226 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-09-12T02:49:14.226 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-09-12T02:49:14.226 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-09-12T02:49:14.226 INFO:teuthology.orchestra.run.smithi039.stdout: "agent_refresh_rate": { 2024-09-12T02:49:14.226 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "agent_refresh_rate", 2024-09-12T02:49:14.226 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "secs", 2024-09-12T02:49:14.227 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "advanced", 2024-09-12T02:49:14.227 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 0, 2024-09-12T02:49:14.227 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "20", 2024-09-12T02:49:14.227 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-09-12T02:49:14.227 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-09-12T02:49:14.227 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [], 2024-09-12T02:49:14.227 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "How often agent on each host will try to gather and send metadata", 2024-09-12T02:49:14.227 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-09-12T02:49:14.227 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-09-12T02:49:14.227 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-09-12T02:49:14.227 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-09-12T02:49:14.227 INFO:teuthology.orchestra.run.smithi039.stdout: "agent_starting_port": { 2024-09-12T02:49:14.227 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "agent_starting_port", 2024-09-12T02:49:14.227 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "int", 2024-09-12T02:49:14.228 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "advanced", 2024-09-12T02:49:14.228 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 0, 2024-09-12T02:49:14.228 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "4721", 2024-09-12T02:49:14.228 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-09-12T02:49:14.228 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-09-12T02:49:14.228 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [], 2024-09-12T02:49:14.228 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "First port agent will try to bind to (will also try up to next 1000 subsequent ports if blocked)", 2024-09-12T02:49:14.228 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-09-12T02:49:14.228 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-09-12T02:49:14.228 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-09-12T02:49:14.228 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-09-12T02:49:14.228 INFO:teuthology.orchestra.run.smithi039.stdout: "allow_ptrace": { 2024-09-12T02:49:14.229 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "allow_ptrace", 2024-09-12T02:49:14.229 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "bool", 2024-09-12T02:49:14.229 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "advanced", 2024-09-12T02:49:14.229 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 0, 2024-09-12T02:49:14.229 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "False", 2024-09-12T02:49:14.229 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-09-12T02:49:14.229 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-09-12T02:49:14.229 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [], 2024-09-12T02:49:14.229 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "allow SYS_PTRACE capability on ceph containers", 2024-09-12T02:49:14.229 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "The SYS_PTRACE capability is needed to attach to a process with gdb or strace. Enabling this options can allow debugging daemons that encounter problems at runtime.", 2024-09-12T02:49:14.229 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-09-12T02:49:14.229 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-09-12T02:49:14.229 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-09-12T02:49:14.229 INFO:teuthology.orchestra.run.smithi039.stdout: "autotune_interval": { 2024-09-12T02:49:14.230 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "autotune_interval", 2024-09-12T02:49:14.230 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "secs", 2024-09-12T02:49:14.230 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "advanced", 2024-09-12T02:49:14.230 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 0, 2024-09-12T02:49:14.230 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "600", 2024-09-12T02:49:14.230 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-09-12T02:49:14.230 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-09-12T02:49:14.230 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [], 2024-09-12T02:49:14.230 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "how frequently to autotune daemon memory", 2024-09-12T02:49:14.230 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-09-12T02:49:14.230 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-09-12T02:49:14.230 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-09-12T02:49:14.230 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-09-12T02:49:14.230 INFO:teuthology.orchestra.run.smithi039.stdout: "autotune_memory_target_ratio": { 2024-09-12T02:49:14.231 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "autotune_memory_target_ratio", 2024-09-12T02:49:14.231 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "float", 2024-09-12T02:49:14.231 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "advanced", 2024-09-12T02:49:14.231 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 0, 2024-09-12T02:49:14.231 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "0.7", 2024-09-12T02:49:14.231 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-09-12T02:49:14.231 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-09-12T02:49:14.231 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [], 2024-09-12T02:49:14.231 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "ratio of total system memory to divide amongst autotuned daemons", 2024-09-12T02:49:14.231 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-09-12T02:49:14.231 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-09-12T02:49:14.231 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-09-12T02:49:14.231 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-09-12T02:49:14.232 INFO:teuthology.orchestra.run.smithi039.stdout: "cephadm_log_destination": { 2024-09-12T02:49:14.232 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "cephadm_log_destination", 2024-09-12T02:49:14.232 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "str", 2024-09-12T02:49:14.232 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "advanced", 2024-09-12T02:49:14.232 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 0, 2024-09-12T02:49:14.232 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "", 2024-09-12T02:49:14.232 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-09-12T02:49:14.232 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-09-12T02:49:14.232 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [ 2024-09-12T02:49:14.232 INFO:teuthology.orchestra.run.smithi039.stdout: "file", 2024-09-12T02:49:14.232 INFO:teuthology.orchestra.run.smithi039.stdout: "file,syslog", 2024-09-12T02:49:14.232 INFO:teuthology.orchestra.run.smithi039.stdout: "syslog" 2024-09-12T02:49:14.232 INFO:teuthology.orchestra.run.smithi039.stdout: ], 2024-09-12T02:49:14.232 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "Destination for cephadm command's persistent logging", 2024-09-12T02:49:14.233 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-09-12T02:49:14.233 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-09-12T02:49:14.233 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-09-12T02:49:14.233 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-09-12T02:49:14.233 INFO:teuthology.orchestra.run.smithi039.stdout: "cgroups_split": { 2024-09-12T02:49:14.233 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "cgroups_split", 2024-09-12T02:49:14.233 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "bool", 2024-09-12T02:49:14.233 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "advanced", 2024-09-12T02:49:14.233 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 0, 2024-09-12T02:49:14.233 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "True", 2024-09-12T02:49:14.233 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-09-12T02:49:14.233 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-09-12T02:49:14.233 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [], 2024-09-12T02:49:14.234 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "Pass --cgroups=split when cephadm creates containers (currently podman only)", 2024-09-12T02:49:14.234 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-09-12T02:49:14.234 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-09-12T02:49:14.234 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-09-12T02:49:14.234 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-09-12T02:49:14.234 INFO:teuthology.orchestra.run.smithi039.stdout: "config_checks_enabled": { 2024-09-12T02:49:14.234 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "config_checks_enabled", 2024-09-12T02:49:14.234 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "bool", 2024-09-12T02:49:14.234 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "advanced", 2024-09-12T02:49:14.234 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 0, 2024-09-12T02:49:14.234 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "False", 2024-09-12T02:49:14.234 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-09-12T02:49:14.234 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-09-12T02:49:14.234 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [], 2024-09-12T02:49:14.235 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "Enable or disable the cephadm configuration analysis", 2024-09-12T02:49:14.235 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-09-12T02:49:14.235 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-09-12T02:49:14.235 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-09-12T02:49:14.235 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-09-12T02:49:14.235 INFO:teuthology.orchestra.run.smithi039.stdout: "config_dashboard": { 2024-09-12T02:49:14.235 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "config_dashboard", 2024-09-12T02:49:14.235 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "bool", 2024-09-12T02:49:14.235 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "advanced", 2024-09-12T02:49:14.235 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 0, 2024-09-12T02:49:14.235 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "True", 2024-09-12T02:49:14.235 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-09-12T02:49:14.235 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-09-12T02:49:14.235 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [], 2024-09-12T02:49:14.236 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "manage configs like API endpoints in Dashboard.", 2024-09-12T02:49:14.236 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-09-12T02:49:14.236 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-09-12T02:49:14.236 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-09-12T02:49:14.236 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-09-12T02:49:14.236 INFO:teuthology.orchestra.run.smithi039.stdout: "container_image_alertmanager": { 2024-09-12T02:49:14.236 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "container_image_alertmanager", 2024-09-12T02:49:14.236 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "str", 2024-09-12T02:49:14.236 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "advanced", 2024-09-12T02:49:14.236 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 0, 2024-09-12T02:49:14.236 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "quay.io/prometheus/alertmanager:v0.25.0", 2024-09-12T02:49:14.236 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-09-12T02:49:14.236 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-09-12T02:49:14.236 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [], 2024-09-12T02:49:14.237 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "Prometheus container image", 2024-09-12T02:49:14.237 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-09-12T02:49:14.237 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-09-12T02:49:14.237 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-09-12T02:49:14.237 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-09-12T02:49:14.237 INFO:teuthology.orchestra.run.smithi039.stdout: "container_image_base": { 2024-09-12T02:49:14.237 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "container_image_base", 2024-09-12T02:49:14.237 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "str", 2024-09-12T02:49:14.237 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "advanced", 2024-09-12T02:49:14.237 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 1, 2024-09-12T02:49:14.237 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "quay.io/ceph/ceph", 2024-09-12T02:49:14.237 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-09-12T02:49:14.237 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-09-12T02:49:14.237 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [], 2024-09-12T02:49:14.238 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "Container image name, without the tag", 2024-09-12T02:49:14.238 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-09-12T02:49:14.238 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-09-12T02:49:14.238 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-09-12T02:49:14.238 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-09-12T02:49:14.238 INFO:teuthology.orchestra.run.smithi039.stdout: "container_image_elasticsearch": { 2024-09-12T02:49:14.238 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "container_image_elasticsearch", 2024-09-12T02:49:14.238 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "str", 2024-09-12T02:49:14.238 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "advanced", 2024-09-12T02:49:14.238 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 0, 2024-09-12T02:49:14.238 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "quay.io/omrizeneva/elasticsearch:6.8.23", 2024-09-12T02:49:14.238 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-09-12T02:49:14.238 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-09-12T02:49:14.238 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [], 2024-09-12T02:49:14.239 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "elasticsearch container image", 2024-09-12T02:49:14.239 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-09-12T02:49:14.239 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-09-12T02:49:14.239 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-09-12T02:49:14.239 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-09-12T02:49:14.239 INFO:teuthology.orchestra.run.smithi039.stdout: "container_image_grafana": { 2024-09-12T02:49:14.239 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "container_image_grafana", 2024-09-12T02:49:14.239 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "str", 2024-09-12T02:49:14.239 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "advanced", 2024-09-12T02:49:14.239 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 0, 2024-09-12T02:49:14.239 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "quay.io/ceph/grafana:9.4.12", 2024-09-12T02:49:14.239 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-09-12T02:49:14.239 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-09-12T02:49:14.239 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [], 2024-09-12T02:49:14.240 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "Prometheus container image", 2024-09-12T02:49:14.240 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-09-12T02:49:14.240 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-09-12T02:49:14.240 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-09-12T02:49:14.240 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-09-12T02:49:14.240 INFO:teuthology.orchestra.run.smithi039.stdout: "container_image_haproxy": { 2024-09-12T02:49:14.240 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "container_image_haproxy", 2024-09-12T02:49:14.240 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "str", 2024-09-12T02:49:14.240 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "advanced", 2024-09-12T02:49:14.240 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 0, 2024-09-12T02:49:14.240 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "quay.io/ceph/haproxy:2.3", 2024-09-12T02:49:14.240 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-09-12T02:49:14.241 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-09-12T02:49:14.241 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [], 2024-09-12T02:49:14.241 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "HAproxy container image", 2024-09-12T02:49:14.241 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-09-12T02:49:14.241 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-09-12T02:49:14.241 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-09-12T02:49:14.241 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-09-12T02:49:14.241 INFO:teuthology.orchestra.run.smithi039.stdout: "container_image_jaeger_agent": { 2024-09-12T02:49:14.241 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "container_image_jaeger_agent", 2024-09-12T02:49:14.241 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "str", 2024-09-12T02:49:14.241 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "advanced", 2024-09-12T02:49:14.241 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 0, 2024-09-12T02:49:14.241 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "quay.io/jaegertracing/jaeger-agent:1.29", 2024-09-12T02:49:14.242 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-09-12T02:49:14.242 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-09-12T02:49:14.242 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [], 2024-09-12T02:49:14.242 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "Jaeger agent container image", 2024-09-12T02:49:14.242 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-09-12T02:49:14.242 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-09-12T02:49:14.242 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-09-12T02:49:14.242 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-09-12T02:49:14.242 INFO:teuthology.orchestra.run.smithi039.stdout: "container_image_jaeger_collector": { 2024-09-12T02:49:14.242 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "container_image_jaeger_collector", 2024-09-12T02:49:14.242 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "str", 2024-09-12T02:49:14.242 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "advanced", 2024-09-12T02:49:14.242 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 0, 2024-09-12T02:49:14.242 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "quay.io/jaegertracing/jaeger-collector:1.29", 2024-09-12T02:49:14.243 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-09-12T02:49:14.243 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-09-12T02:49:14.243 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [], 2024-09-12T02:49:14.243 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "Jaeger collector container image", 2024-09-12T02:49:14.243 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-09-12T02:49:14.243 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-09-12T02:49:14.243 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-09-12T02:49:14.243 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-09-12T02:49:14.243 INFO:teuthology.orchestra.run.smithi039.stdout: "container_image_jaeger_query": { 2024-09-12T02:49:14.243 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "container_image_jaeger_query", 2024-09-12T02:49:14.243 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "str", 2024-09-12T02:49:14.243 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "advanced", 2024-09-12T02:49:14.243 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 0, 2024-09-12T02:49:14.243 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "quay.io/jaegertracing/jaeger-query:1.29", 2024-09-12T02:49:14.244 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-09-12T02:49:14.244 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-09-12T02:49:14.244 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [], 2024-09-12T02:49:14.244 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "Jaeger query container image", 2024-09-12T02:49:14.244 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-09-12T02:49:14.244 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-09-12T02:49:14.244 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-09-12T02:49:14.244 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-09-12T02:49:14.244 INFO:teuthology.orchestra.run.smithi039.stdout: "container_image_keepalived": { 2024-09-12T02:49:14.244 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "container_image_keepalived", 2024-09-12T02:49:14.244 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "str", 2024-09-12T02:49:14.244 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "advanced", 2024-09-12T02:49:14.244 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 0, 2024-09-12T02:49:14.245 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "quay.io/ceph/keepalived:2.2.4", 2024-09-12T02:49:14.245 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-09-12T02:49:14.245 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-09-12T02:49:14.245 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [], 2024-09-12T02:49:14.245 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "Keepalived container image", 2024-09-12T02:49:14.245 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-09-12T02:49:14.245 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-09-12T02:49:14.245 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-09-12T02:49:14.245 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-09-12T02:49:14.245 INFO:teuthology.orchestra.run.smithi039.stdout: "container_image_loki": { 2024-09-12T02:49:14.245 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "container_image_loki", 2024-09-12T02:49:14.245 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "str", 2024-09-12T02:49:14.245 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "advanced", 2024-09-12T02:49:14.245 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 0, 2024-09-12T02:49:14.246 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "docker.io/grafana/loki:3.0.0", 2024-09-12T02:49:14.246 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-09-12T02:49:14.246 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-09-12T02:49:14.246 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [], 2024-09-12T02:49:14.246 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "Loki container image", 2024-09-12T02:49:14.246 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-09-12T02:49:14.246 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-09-12T02:49:14.246 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-09-12T02:49:14.246 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-09-12T02:49:14.246 INFO:teuthology.orchestra.run.smithi039.stdout: "container_image_node_exporter": { 2024-09-12T02:49:14.246 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "container_image_node_exporter", 2024-09-12T02:49:14.246 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "str", 2024-09-12T02:49:14.246 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "advanced", 2024-09-12T02:49:14.247 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 0, 2024-09-12T02:49:14.247 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "quay.io/prometheus/node-exporter:v1.5.0", 2024-09-12T02:49:14.247 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-09-12T02:49:14.247 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-09-12T02:49:14.247 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [], 2024-09-12T02:49:14.247 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "Prometheus container image", 2024-09-12T02:49:14.247 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-09-12T02:49:14.247 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-09-12T02:49:14.247 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-09-12T02:49:14.247 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-09-12T02:49:14.247 INFO:teuthology.orchestra.run.smithi039.stdout: "container_image_nvmeof": { 2024-09-12T02:49:14.247 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "container_image_nvmeof", 2024-09-12T02:49:14.247 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "str", 2024-09-12T02:49:14.248 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "advanced", 2024-09-12T02:49:14.248 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 0, 2024-09-12T02:49:14.248 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "quay.io/ceph/nvmeof:1.2.5", 2024-09-12T02:49:14.248 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-09-12T02:49:14.248 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-09-12T02:49:14.248 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [], 2024-09-12T02:49:14.248 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "Nvme-of container image", 2024-09-12T02:49:14.248 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-09-12T02:49:14.248 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-09-12T02:49:14.248 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-09-12T02:49:14.248 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-09-12T02:49:14.248 INFO:teuthology.orchestra.run.smithi039.stdout: "container_image_prometheus": { 2024-09-12T02:49:14.248 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "container_image_prometheus", 2024-09-12T02:49:14.248 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "str", 2024-09-12T02:49:14.249 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "advanced", 2024-09-12T02:49:14.249 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 0, 2024-09-12T02:49:14.249 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "quay.io/prometheus/prometheus:v2.43.0", 2024-09-12T02:49:14.249 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-09-12T02:49:14.249 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-09-12T02:49:14.249 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [], 2024-09-12T02:49:14.249 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "Prometheus container image", 2024-09-12T02:49:14.249 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-09-12T02:49:14.249 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-09-12T02:49:14.249 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-09-12T02:49:14.249 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-09-12T02:49:14.249 INFO:teuthology.orchestra.run.smithi039.stdout: "container_image_promtail": { 2024-09-12T02:49:14.249 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "container_image_promtail", 2024-09-12T02:49:14.250 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "str", 2024-09-12T02:49:14.250 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "advanced", 2024-09-12T02:49:14.250 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 0, 2024-09-12T02:49:14.250 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "docker.io/grafana/promtail:3.0.0", 2024-09-12T02:49:14.250 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-09-12T02:49:14.250 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-09-12T02:49:14.250 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [], 2024-09-12T02:49:14.250 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "Promtail container image", 2024-09-12T02:49:14.250 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-09-12T02:49:14.250 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-09-12T02:49:14.250 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-09-12T02:49:14.250 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-09-12T02:49:14.250 INFO:teuthology.orchestra.run.smithi039.stdout: "container_image_samba": { 2024-09-12T02:49:14.251 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "container_image_samba", 2024-09-12T02:49:14.251 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "str", 2024-09-12T02:49:14.251 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "advanced", 2024-09-12T02:49:14.251 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 0, 2024-09-12T02:49:14.251 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "quay.io/samba.org/samba-server:devbuilds-centos-amd64", 2024-09-12T02:49:14.251 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-09-12T02:49:14.251 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-09-12T02:49:14.251 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [], 2024-09-12T02:49:14.251 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "Samba/SMB container image", 2024-09-12T02:49:14.251 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-09-12T02:49:14.251 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-09-12T02:49:14.251 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-09-12T02:49:14.251 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-09-12T02:49:14.252 INFO:teuthology.orchestra.run.smithi039.stdout: "container_image_snmp_gateway": { 2024-09-12T02:49:14.252 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "container_image_snmp_gateway", 2024-09-12T02:49:14.252 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "str", 2024-09-12T02:49:14.252 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "advanced", 2024-09-12T02:49:14.252 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 0, 2024-09-12T02:49:14.252 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "docker.io/maxwo/snmp-notifier:v1.2.1", 2024-09-12T02:49:14.252 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-09-12T02:49:14.252 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-09-12T02:49:14.252 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [], 2024-09-12T02:49:14.252 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "SNMP Gateway container image", 2024-09-12T02:49:14.252 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-09-12T02:49:14.252 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-09-12T02:49:14.252 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-09-12T02:49:14.252 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-09-12T02:49:14.253 INFO:teuthology.orchestra.run.smithi039.stdout: "container_init": { 2024-09-12T02:49:14.253 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "container_init", 2024-09-12T02:49:14.253 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "bool", 2024-09-12T02:49:14.253 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "advanced", 2024-09-12T02:49:14.253 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 0, 2024-09-12T02:49:14.253 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "True", 2024-09-12T02:49:14.253 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-09-12T02:49:14.253 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-09-12T02:49:14.253 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [], 2024-09-12T02:49:14.253 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "Run podman/docker with `--init`", 2024-09-12T02:49:14.253 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-09-12T02:49:14.253 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-09-12T02:49:14.254 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-09-12T02:49:14.254 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-09-12T02:49:14.254 INFO:teuthology.orchestra.run.smithi039.stdout: "daemon_cache_timeout": { 2024-09-12T02:49:14.254 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "daemon_cache_timeout", 2024-09-12T02:49:14.254 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "secs", 2024-09-12T02:49:14.254 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "advanced", 2024-09-12T02:49:14.254 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 0, 2024-09-12T02:49:14.254 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "600", 2024-09-12T02:49:14.254 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-09-12T02:49:14.254 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-09-12T02:49:14.254 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [], 2024-09-12T02:49:14.254 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "seconds to cache service (daemon) inventory", 2024-09-12T02:49:14.254 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-09-12T02:49:14.255 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-09-12T02:49:14.255 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-09-12T02:49:14.255 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-09-12T02:49:14.255 INFO:teuthology.orchestra.run.smithi039.stdout: "default_cephadm_command_timeout": { 2024-09-12T02:49:14.255 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "default_cephadm_command_timeout", 2024-09-12T02:49:14.255 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "int", 2024-09-12T02:49:14.255 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "advanced", 2024-09-12T02:49:14.255 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 0, 2024-09-12T02:49:14.255 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "900", 2024-09-12T02:49:14.255 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-09-12T02:49:14.255 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-09-12T02:49:14.255 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [], 2024-09-12T02:49:14.255 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "Default timeout applied to cephadm commands run directly on the host (in seconds)", 2024-09-12T02:49:14.255 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-09-12T02:49:14.256 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-09-12T02:49:14.256 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-09-12T02:49:14.256 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-09-12T02:49:14.256 INFO:teuthology.orchestra.run.smithi039.stdout: "default_registry": { 2024-09-12T02:49:14.256 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "default_registry", 2024-09-12T02:49:14.256 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "str", 2024-09-12T02:49:14.256 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "advanced", 2024-09-12T02:49:14.256 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 0, 2024-09-12T02:49:14.256 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "docker.io", 2024-09-12T02:49:14.256 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-09-12T02:49:14.256 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-09-12T02:49:14.256 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [], 2024-09-12T02:49:14.256 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "Search-registry to which we should normalize unqualified image names. This is not the default registry", 2024-09-12T02:49:14.257 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-09-12T02:49:14.257 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-09-12T02:49:14.257 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-09-12T02:49:14.257 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-09-12T02:49:14.257 INFO:teuthology.orchestra.run.smithi039.stdout: "device_cache_timeout": { 2024-09-12T02:49:14.257 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "device_cache_timeout", 2024-09-12T02:49:14.257 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "secs", 2024-09-12T02:49:14.257 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "advanced", 2024-09-12T02:49:14.257 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 0, 2024-09-12T02:49:14.257 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "1800", 2024-09-12T02:49:14.257 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-09-12T02:49:14.257 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-09-12T02:49:14.257 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [], 2024-09-12T02:49:14.258 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "seconds to cache device inventory", 2024-09-12T02:49:14.258 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-09-12T02:49:14.258 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-09-12T02:49:14.258 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-09-12T02:49:14.258 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-09-12T02:49:14.258 INFO:teuthology.orchestra.run.smithi039.stdout: "device_enhanced_scan": { 2024-09-12T02:49:14.258 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "device_enhanced_scan", 2024-09-12T02:49:14.258 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "bool", 2024-09-12T02:49:14.258 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "advanced", 2024-09-12T02:49:14.258 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 0, 2024-09-12T02:49:14.258 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "False", 2024-09-12T02:49:14.258 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-09-12T02:49:14.258 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-09-12T02:49:14.258 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [], 2024-09-12T02:49:14.259 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "Use libstoragemgmt during device scans", 2024-09-12T02:49:14.259 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-09-12T02:49:14.259 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-09-12T02:49:14.259 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-09-12T02:49:14.259 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-09-12T02:49:14.259 INFO:teuthology.orchestra.run.smithi039.stdout: "facts_cache_timeout": { 2024-09-12T02:49:14.259 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "facts_cache_timeout", 2024-09-12T02:49:14.259 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "secs", 2024-09-12T02:49:14.259 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "advanced", 2024-09-12T02:49:14.259 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 0, 2024-09-12T02:49:14.259 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "60", 2024-09-12T02:49:14.259 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-09-12T02:49:14.259 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-09-12T02:49:14.260 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [], 2024-09-12T02:49:14.260 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "seconds to cache host facts data", 2024-09-12T02:49:14.260 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-09-12T02:49:14.260 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-09-12T02:49:14.260 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-09-12T02:49:14.260 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-09-12T02:49:14.260 INFO:teuthology.orchestra.run.smithi039.stdout: "grafana_dashboards_path": { 2024-09-12T02:49:14.260 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "grafana_dashboards_path", 2024-09-12T02:49:14.260 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "str", 2024-09-12T02:49:14.260 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "advanced", 2024-09-12T02:49:14.260 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 0, 2024-09-12T02:49:14.260 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "/etc/grafana/dashboards/ceph-dashboard/", 2024-09-12T02:49:14.260 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-09-12T02:49:14.260 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-09-12T02:49:14.261 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [], 2024-09-12T02:49:14.261 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "location of dashboards to include in grafana deployments", 2024-09-12T02:49:14.261 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-09-12T02:49:14.261 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-09-12T02:49:14.261 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-09-12T02:49:14.261 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-09-12T02:49:14.261 INFO:teuthology.orchestra.run.smithi039.stdout: "host_check_interval": { 2024-09-12T02:49:14.261 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "host_check_interval", 2024-09-12T02:49:14.261 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "secs", 2024-09-12T02:49:14.261 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "advanced", 2024-09-12T02:49:14.261 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 0, 2024-09-12T02:49:14.261 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "600", 2024-09-12T02:49:14.261 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-09-12T02:49:14.261 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-09-12T02:49:14.262 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [], 2024-09-12T02:49:14.262 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "how frequently to perform a host check", 2024-09-12T02:49:14.262 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-09-12T02:49:14.262 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-09-12T02:49:14.262 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-09-12T02:49:14.262 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-09-12T02:49:14.262 INFO:teuthology.orchestra.run.smithi039.stdout: "hw_monitoring": { 2024-09-12T02:49:14.262 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "hw_monitoring", 2024-09-12T02:49:14.262 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "bool", 2024-09-12T02:49:14.262 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "advanced", 2024-09-12T02:49:14.262 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 0, 2024-09-12T02:49:14.262 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "False", 2024-09-12T02:49:14.262 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-09-12T02:49:14.262 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-09-12T02:49:14.263 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [], 2024-09-12T02:49:14.263 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "Deploy hw monitoring daemon on every host.", 2024-09-12T02:49:14.263 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-09-12T02:49:14.263 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-09-12T02:49:14.263 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-09-12T02:49:14.263 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-09-12T02:49:14.263 INFO:teuthology.orchestra.run.smithi039.stdout: "inventory_list_all": { 2024-09-12T02:49:14.263 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "inventory_list_all", 2024-09-12T02:49:14.263 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "bool", 2024-09-12T02:49:14.263 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "advanced", 2024-09-12T02:49:14.263 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 0, 2024-09-12T02:49:14.263 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "False", 2024-09-12T02:49:14.263 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-09-12T02:49:14.263 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-09-12T02:49:14.264 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [], 2024-09-12T02:49:14.264 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "Whether ceph-volume inventory should report more devices (mostly mappers (LVs / mpaths), partitions...)", 2024-09-12T02:49:14.264 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-09-12T02:49:14.264 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-09-12T02:49:14.264 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-09-12T02:49:14.264 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-09-12T02:49:14.264 INFO:teuthology.orchestra.run.smithi039.stdout: "log_level": { 2024-09-12T02:49:14.264 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "log_level", 2024-09-12T02:49:14.264 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "str", 2024-09-12T02:49:14.264 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "advanced", 2024-09-12T02:49:14.264 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 1, 2024-09-12T02:49:14.264 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "", 2024-09-12T02:49:14.264 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-09-12T02:49:14.265 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-09-12T02:49:14.265 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [ 2024-09-12T02:49:14.265 INFO:teuthology.orchestra.run.smithi039.stdout: "", 2024-09-12T02:49:14.265 INFO:teuthology.orchestra.run.smithi039.stdout: "critical", 2024-09-12T02:49:14.265 INFO:teuthology.orchestra.run.smithi039.stdout: "debug", 2024-09-12T02:49:14.265 INFO:teuthology.orchestra.run.smithi039.stdout: "error", 2024-09-12T02:49:14.265 INFO:teuthology.orchestra.run.smithi039.stdout: "info", 2024-09-12T02:49:14.265 INFO:teuthology.orchestra.run.smithi039.stdout: "warning" 2024-09-12T02:49:14.265 INFO:teuthology.orchestra.run.smithi039.stdout: ], 2024-09-12T02:49:14.265 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "", 2024-09-12T02:49:14.265 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-09-12T02:49:14.265 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-09-12T02:49:14.265 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-09-12T02:49:14.265 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-09-12T02:49:14.265 INFO:teuthology.orchestra.run.smithi039.stdout: "log_refresh_metadata": { 2024-09-12T02:49:14.266 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "log_refresh_metadata", 2024-09-12T02:49:14.266 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "bool", 2024-09-12T02:49:14.266 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "advanced", 2024-09-12T02:49:14.266 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 0, 2024-09-12T02:49:14.266 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "False", 2024-09-12T02:49:14.266 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-09-12T02:49:14.266 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-09-12T02:49:14.266 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [], 2024-09-12T02:49:14.266 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "Log all refresh metadata. Includes daemon, device, and host info collected regularly. Only has effect if logging at debug level", 2024-09-12T02:49:14.266 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-09-12T02:49:14.266 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-09-12T02:49:14.266 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-09-12T02:49:14.267 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-09-12T02:49:14.267 INFO:teuthology.orchestra.run.smithi039.stdout: "log_to_cluster": { 2024-09-12T02:49:14.267 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "log_to_cluster", 2024-09-12T02:49:14.267 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "bool", 2024-09-12T02:49:14.267 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "advanced", 2024-09-12T02:49:14.267 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 0, 2024-09-12T02:49:14.267 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "True", 2024-09-12T02:49:14.267 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-09-12T02:49:14.267 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-09-12T02:49:14.267 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [], 2024-09-12T02:49:14.267 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "log to the \"cephadm\" cluster log channel\"", 2024-09-12T02:49:14.267 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-09-12T02:49:14.267 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-09-12T02:49:14.268 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-09-12T02:49:14.268 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-09-12T02:49:14.268 INFO:teuthology.orchestra.run.smithi039.stdout: "log_to_cluster_level": { 2024-09-12T02:49:14.268 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "log_to_cluster_level", 2024-09-12T02:49:14.268 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "str", 2024-09-12T02:49:14.268 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "advanced", 2024-09-12T02:49:14.268 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 1, 2024-09-12T02:49:14.268 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "info", 2024-09-12T02:49:14.268 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-09-12T02:49:14.268 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-09-12T02:49:14.268 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [ 2024-09-12T02:49:14.268 INFO:teuthology.orchestra.run.smithi039.stdout: "", 2024-09-12T02:49:14.268 INFO:teuthology.orchestra.run.smithi039.stdout: "critical", 2024-09-12T02:49:14.269 INFO:teuthology.orchestra.run.smithi039.stdout: "debug", 2024-09-12T02:49:14.269 INFO:teuthology.orchestra.run.smithi039.stdout: "error", 2024-09-12T02:49:14.269 INFO:teuthology.orchestra.run.smithi039.stdout: "info", 2024-09-12T02:49:14.269 INFO:teuthology.orchestra.run.smithi039.stdout: "warning" 2024-09-12T02:49:14.269 INFO:teuthology.orchestra.run.smithi039.stdout: ], 2024-09-12T02:49:14.269 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "", 2024-09-12T02:49:14.269 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-09-12T02:49:14.270 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-09-12T02:49:14.270 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-09-12T02:49:14.270 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-09-12T02:49:14.270 INFO:teuthology.orchestra.run.smithi039.stdout: "log_to_file": { 2024-09-12T02:49:14.270 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "log_to_file", 2024-09-12T02:49:14.270 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "bool", 2024-09-12T02:49:14.270 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "advanced", 2024-09-12T02:49:14.270 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 1, 2024-09-12T02:49:14.270 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "False", 2024-09-12T02:49:14.270 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-09-12T02:49:14.270 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-09-12T02:49:14.270 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [], 2024-09-12T02:49:14.270 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "", 2024-09-12T02:49:14.271 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-09-12T02:49:14.271 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-09-12T02:49:14.271 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-09-12T02:49:14.271 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-09-12T02:49:14.271 INFO:teuthology.orchestra.run.smithi039.stdout: "manage_etc_ceph_ceph_conf": { 2024-09-12T02:49:14.271 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "manage_etc_ceph_ceph_conf", 2024-09-12T02:49:14.271 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "bool", 2024-09-12T02:49:14.271 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "advanced", 2024-09-12T02:49:14.271 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 0, 2024-09-12T02:49:14.272 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "False", 2024-09-12T02:49:14.272 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-09-12T02:49:14.272 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-09-12T02:49:14.272 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [], 2024-09-12T02:49:14.272 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "Manage and own /etc/ceph/ceph.conf on the hosts.", 2024-09-12T02:49:14.272 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-09-12T02:49:14.272 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-09-12T02:49:14.272 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-09-12T02:49:14.272 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-09-12T02:49:14.272 INFO:teuthology.orchestra.run.smithi039.stdout: "manage_etc_ceph_ceph_conf_hosts": { 2024-09-12T02:49:14.272 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "manage_etc_ceph_ceph_conf_hosts", 2024-09-12T02:49:14.272 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "str", 2024-09-12T02:49:14.272 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "advanced", 2024-09-12T02:49:14.273 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 0, 2024-09-12T02:49:14.273 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "*", 2024-09-12T02:49:14.273 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-09-12T02:49:14.273 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-09-12T02:49:14.273 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [], 2024-09-12T02:49:14.273 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "PlacementSpec describing on which hosts to manage /etc/ceph/ceph.conf", 2024-09-12T02:49:14.273 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-09-12T02:49:14.273 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-09-12T02:49:14.273 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-09-12T02:49:14.273 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-09-12T02:49:14.273 INFO:teuthology.orchestra.run.smithi039.stdout: "max_count_per_host": { 2024-09-12T02:49:14.273 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "max_count_per_host", 2024-09-12T02:49:14.273 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "int", 2024-09-12T02:49:14.274 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "advanced", 2024-09-12T02:49:14.274 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 0, 2024-09-12T02:49:14.274 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "10", 2024-09-12T02:49:14.274 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-09-12T02:49:14.274 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-09-12T02:49:14.274 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [], 2024-09-12T02:49:14.274 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "max number of daemons per service per host", 2024-09-12T02:49:14.274 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-09-12T02:49:14.274 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-09-12T02:49:14.274 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-09-12T02:49:14.274 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-09-12T02:49:14.274 INFO:teuthology.orchestra.run.smithi039.stdout: "max_osd_draining_count": { 2024-09-12T02:49:14.274 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "max_osd_draining_count", 2024-09-12T02:49:14.275 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "int", 2024-09-12T02:49:14.275 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "advanced", 2024-09-12T02:49:14.275 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 0, 2024-09-12T02:49:14.275 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "10", 2024-09-12T02:49:14.275 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-09-12T02:49:14.275 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-09-12T02:49:14.275 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [], 2024-09-12T02:49:14.275 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "max number of osds that will be drained simultaneously when osds are removed", 2024-09-12T02:49:14.275 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-09-12T02:49:14.275 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-09-12T02:49:14.275 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-09-12T02:49:14.275 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-09-12T02:49:14.275 INFO:teuthology.orchestra.run.smithi039.stdout: "migration_current": { 2024-09-12T02:49:14.276 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "migration_current", 2024-09-12T02:49:14.276 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "int", 2024-09-12T02:49:14.276 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "advanced", 2024-09-12T02:49:14.276 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 0, 2024-09-12T02:49:14.276 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "", 2024-09-12T02:49:14.276 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-09-12T02:49:14.276 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-09-12T02:49:14.276 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [], 2024-09-12T02:49:14.276 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "internal - do not modify", 2024-09-12T02:49:14.276 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-09-12T02:49:14.276 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-09-12T02:49:14.276 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-09-12T02:49:14.276 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-09-12T02:49:14.276 INFO:teuthology.orchestra.run.smithi039.stdout: "mode": { 2024-09-12T02:49:14.277 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "mode", 2024-09-12T02:49:14.277 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "str", 2024-09-12T02:49:14.277 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "advanced", 2024-09-12T02:49:14.277 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 0, 2024-09-12T02:49:14.277 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "root", 2024-09-12T02:49:14.277 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-09-12T02:49:14.277 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-09-12T02:49:14.277 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [ 2024-09-12T02:49:14.277 INFO:teuthology.orchestra.run.smithi039.stdout: "cephadm-package", 2024-09-12T02:49:14.277 INFO:teuthology.orchestra.run.smithi039.stdout: "root" 2024-09-12T02:49:14.277 INFO:teuthology.orchestra.run.smithi039.stdout: ], 2024-09-12T02:49:14.277 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "mode for remote execution of cephadm", 2024-09-12T02:49:14.277 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-09-12T02:49:14.278 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-09-12T02:49:14.278 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-09-12T02:49:14.278 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-09-12T02:49:14.278 INFO:teuthology.orchestra.run.smithi039.stdout: "oob_default_addr": { 2024-09-12T02:49:14.278 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "oob_default_addr", 2024-09-12T02:49:14.278 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "str", 2024-09-12T02:49:14.278 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "advanced", 2024-09-12T02:49:14.278 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 0, 2024-09-12T02:49:14.278 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "169.254.1.1", 2024-09-12T02:49:14.278 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-09-12T02:49:14.278 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-09-12T02:49:14.278 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [], 2024-09-12T02:49:14.278 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "Default address for RedFish API (oob management).", 2024-09-12T02:49:14.278 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-09-12T02:49:14.279 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-09-12T02:49:14.279 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-09-12T02:49:14.279 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-09-12T02:49:14.279 INFO:teuthology.orchestra.run.smithi039.stdout: "prometheus_alerts_path": { 2024-09-12T02:49:14.279 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "prometheus_alerts_path", 2024-09-12T02:49:14.279 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "str", 2024-09-12T02:49:14.279 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "advanced", 2024-09-12T02:49:14.279 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 0, 2024-09-12T02:49:14.279 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "/etc/prometheus/ceph/ceph_default_alerts.yml", 2024-09-12T02:49:14.279 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-09-12T02:49:14.279 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-09-12T02:49:14.279 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [], 2024-09-12T02:49:14.279 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "location of alerts to include in prometheus deployments", 2024-09-12T02:49:14.279 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-09-12T02:49:14.279 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-09-12T02:49:14.280 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-09-12T02:49:14.280 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-09-12T02:49:14.280 INFO:teuthology.orchestra.run.smithi039.stdout: "registry_insecure": { 2024-09-12T02:49:14.280 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "registry_insecure", 2024-09-12T02:49:14.280 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "bool", 2024-09-12T02:49:14.280 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "advanced", 2024-09-12T02:49:14.280 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 0, 2024-09-12T02:49:14.280 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "False", 2024-09-12T02:49:14.280 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-09-12T02:49:14.280 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-09-12T02:49:14.280 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [], 2024-09-12T02:49:14.281 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "Registry is to be considered insecure (no TLS available). Only for development purposes.", 2024-09-12T02:49:14.281 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-09-12T02:49:14.281 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-09-12T02:49:14.281 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-09-12T02:49:14.281 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-09-12T02:49:14.281 INFO:teuthology.orchestra.run.smithi039.stdout: "registry_password": { 2024-09-12T02:49:14.281 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "registry_password", 2024-09-12T02:49:14.281 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "str", 2024-09-12T02:49:14.281 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "advanced", 2024-09-12T02:49:14.281 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 0, 2024-09-12T02:49:14.281 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "", 2024-09-12T02:49:14.282 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-09-12T02:49:14.282 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-09-12T02:49:14.282 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [], 2024-09-12T02:49:14.282 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "Custom repository password. Only used for logging into a registry.", 2024-09-12T02:49:14.282 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-09-12T02:49:14.282 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-09-12T02:49:14.282 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-09-12T02:49:14.282 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-09-12T02:49:14.282 INFO:teuthology.orchestra.run.smithi039.stdout: "registry_url": { 2024-09-12T02:49:14.282 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "registry_url", 2024-09-12T02:49:14.282 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "str", 2024-09-12T02:49:14.282 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "advanced", 2024-09-12T02:49:14.282 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 0, 2024-09-12T02:49:14.283 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "", 2024-09-12T02:49:14.283 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-09-12T02:49:14.283 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-09-12T02:49:14.283 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [], 2024-09-12T02:49:14.283 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "Registry url for login purposes. This is not the default registry", 2024-09-12T02:49:14.283 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-09-12T02:49:14.283 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-09-12T02:49:14.283 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-09-12T02:49:14.283 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-09-12T02:49:14.283 INFO:teuthology.orchestra.run.smithi039.stdout: "registry_username": { 2024-09-12T02:49:14.283 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "registry_username", 2024-09-12T02:49:14.283 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "str", 2024-09-12T02:49:14.283 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "advanced", 2024-09-12T02:49:14.283 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 0, 2024-09-12T02:49:14.284 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "", 2024-09-12T02:49:14.284 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-09-12T02:49:14.284 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-09-12T02:49:14.284 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [], 2024-09-12T02:49:14.284 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "Custom repository username. Only used for logging into a registry.", 2024-09-12T02:49:14.284 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-09-12T02:49:14.284 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-09-12T02:49:14.284 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-09-12T02:49:14.284 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-09-12T02:49:14.284 INFO:teuthology.orchestra.run.smithi039.stdout: "secure_monitoring_stack": { 2024-09-12T02:49:14.284 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "secure_monitoring_stack", 2024-09-12T02:49:14.284 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "bool", 2024-09-12T02:49:14.284 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "advanced", 2024-09-12T02:49:14.285 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 0, 2024-09-12T02:49:14.285 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "False", 2024-09-12T02:49:14.285 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-09-12T02:49:14.285 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-09-12T02:49:14.285 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [], 2024-09-12T02:49:14.285 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "Enable TLS security for all the monitoring stack daemons", 2024-09-12T02:49:14.285 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-09-12T02:49:14.285 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-09-12T02:49:14.285 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-09-12T02:49:14.285 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-09-12T02:49:14.285 INFO:teuthology.orchestra.run.smithi039.stdout: "service_discovery_port": { 2024-09-12T02:49:14.285 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "service_discovery_port", 2024-09-12T02:49:14.285 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "int", 2024-09-12T02:49:14.285 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "advanced", 2024-09-12T02:49:14.286 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 0, 2024-09-12T02:49:14.286 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "8765", 2024-09-12T02:49:14.286 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-09-12T02:49:14.286 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-09-12T02:49:14.286 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [], 2024-09-12T02:49:14.286 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "cephadm service discovery port", 2024-09-12T02:49:14.286 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-09-12T02:49:14.286 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-09-12T02:49:14.286 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-09-12T02:49:14.286 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-09-12T02:49:14.286 INFO:teuthology.orchestra.run.smithi039.stdout: "ssh_config_file": { 2024-09-12T02:49:14.286 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "ssh_config_file", 2024-09-12T02:49:14.286 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "str", 2024-09-12T02:49:14.287 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "advanced", 2024-09-12T02:49:14.287 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 0, 2024-09-12T02:49:14.287 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "", 2024-09-12T02:49:14.287 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-09-12T02:49:14.287 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-09-12T02:49:14.287 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [], 2024-09-12T02:49:14.287 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "customized SSH config file to connect to managed hosts", 2024-09-12T02:49:14.287 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-09-12T02:49:14.287 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-09-12T02:49:14.287 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-09-12T02:49:14.287 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-09-12T02:49:14.287 INFO:teuthology.orchestra.run.smithi039.stdout: "use_agent": { 2024-09-12T02:49:14.287 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "use_agent", 2024-09-12T02:49:14.287 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "bool", 2024-09-12T02:49:14.288 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "advanced", 2024-09-12T02:49:14.288 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 0, 2024-09-12T02:49:14.288 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "False", 2024-09-12T02:49:14.288 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-09-12T02:49:14.288 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-09-12T02:49:14.288 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [], 2024-09-12T02:49:14.288 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "Use cephadm agent on each host to gather and send metadata", 2024-09-12T02:49:14.288 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-09-12T02:49:14.288 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-09-12T02:49:14.288 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-09-12T02:49:14.288 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-09-12T02:49:14.288 INFO:teuthology.orchestra.run.smithi039.stdout: "use_repo_digest": { 2024-09-12T02:49:14.288 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "use_repo_digest", 2024-09-12T02:49:14.288 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "bool", 2024-09-12T02:49:14.289 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "advanced", 2024-09-12T02:49:14.289 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 0, 2024-09-12T02:49:14.289 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "True", 2024-09-12T02:49:14.289 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-09-12T02:49:14.289 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-09-12T02:49:14.289 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [], 2024-09-12T02:49:14.289 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "Automatically convert image tags to image digest. Make sure all daemons use the same image", 2024-09-12T02:49:14.289 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-09-12T02:49:14.289 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-09-12T02:49:14.289 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-09-12T02:49:14.289 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-09-12T02:49:14.289 INFO:teuthology.orchestra.run.smithi039.stdout: "warn_on_failed_host_check": { 2024-09-12T02:49:14.289 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "warn_on_failed_host_check", 2024-09-12T02:49:14.290 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "bool", 2024-09-12T02:49:14.290 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "advanced", 2024-09-12T02:49:14.290 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 0, 2024-09-12T02:49:14.290 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "True", 2024-09-12T02:49:14.290 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-09-12T02:49:14.290 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-09-12T02:49:14.290 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [], 2024-09-12T02:49:14.290 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "raise a health warning if the host check fails", 2024-09-12T02:49:14.290 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-09-12T02:49:14.290 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-09-12T02:49:14.290 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-09-12T02:49:14.290 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-09-12T02:49:14.290 INFO:teuthology.orchestra.run.smithi039.stdout: "warn_on_stray_daemons": { 2024-09-12T02:49:14.290 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "warn_on_stray_daemons", 2024-09-12T02:49:14.291 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "bool", 2024-09-12T02:49:14.291 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "advanced", 2024-09-12T02:49:14.291 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 0, 2024-09-12T02:49:14.291 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "True", 2024-09-12T02:49:14.291 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-09-12T02:49:14.291 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-09-12T02:49:14.291 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [], 2024-09-12T02:49:14.291 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "raise a health warning if daemons are detected that are not managed by cephadm", 2024-09-12T02:49:14.291 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-09-12T02:49:14.291 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-09-12T02:49:14.291 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-09-12T02:49:14.291 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-09-12T02:49:14.291 INFO:teuthology.orchestra.run.smithi039.stdout: "warn_on_stray_hosts": { 2024-09-12T02:49:14.291 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "warn_on_stray_hosts", 2024-09-12T02:49:14.292 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "bool", 2024-09-12T02:49:14.292 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "advanced", 2024-09-12T02:49:14.292 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 0, 2024-09-12T02:49:14.292 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "True", 2024-09-12T02:49:14.292 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-09-12T02:49:14.292 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-09-12T02:49:14.292 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [], 2024-09-12T02:49:14.292 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "raise a health warning if daemons are detected on a host that is not managed by cephadm", 2024-09-12T02:49:14.292 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-09-12T02:49:14.292 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-09-12T02:49:14.292 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-09-12T02:49:14.292 INFO:teuthology.orchestra.run.smithi039.stdout: } 2024-09-12T02:49:14.292 INFO:teuthology.orchestra.run.smithi039.stdout: } 2024-09-12T02:49:14.292 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-09-12T02:49:14.293 INFO:teuthology.orchestra.run.smithi039.stdout: { 2024-09-12T02:49:14.293 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "crash", 2024-09-12T02:49:14.293 INFO:teuthology.orchestra.run.smithi039.stdout: "can_run": true, 2024-09-12T02:49:14.293 INFO:teuthology.orchestra.run.smithi039.stdout: "error_string": "", 2024-09-12T02:49:14.293 INFO:teuthology.orchestra.run.smithi039.stdout: "module_options": { 2024-09-12T02:49:14.293 INFO:teuthology.orchestra.run.smithi039.stdout: "log_level": { 2024-09-12T02:49:14.293 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "log_level", 2024-09-12T02:49:14.293 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "str", 2024-09-12T02:49:14.293 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "advanced", 2024-09-12T02:49:14.293 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 1, 2024-09-12T02:49:14.293 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "", 2024-09-12T02:49:14.294 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-09-12T02:49:14.294 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-09-12T02:49:14.294 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [ 2024-09-12T02:49:14.294 INFO:teuthology.orchestra.run.smithi039.stdout: "", 2024-09-12T02:49:14.294 INFO:teuthology.orchestra.run.smithi039.stdout: "critical", 2024-09-12T02:49:14.294 INFO:teuthology.orchestra.run.smithi039.stdout: "debug", 2024-09-12T02:49:14.294 INFO:teuthology.orchestra.run.smithi039.stdout: "error", 2024-09-12T02:49:14.294 INFO:teuthology.orchestra.run.smithi039.stdout: "info", 2024-09-12T02:49:14.294 INFO:teuthology.orchestra.run.smithi039.stdout: "warning" 2024-09-12T02:49:14.294 INFO:teuthology.orchestra.run.smithi039.stdout: ], 2024-09-12T02:49:14.294 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "", 2024-09-12T02:49:14.294 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-09-12T02:49:14.294 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-09-12T02:49:14.295 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-09-12T02:49:14.295 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-09-12T02:49:14.295 INFO:teuthology.orchestra.run.smithi039.stdout: "log_to_cluster": { 2024-09-12T02:49:14.295 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "log_to_cluster", 2024-09-12T02:49:14.295 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "bool", 2024-09-12T02:49:14.295 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "advanced", 2024-09-12T02:49:14.295 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 1, 2024-09-12T02:49:14.295 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "False", 2024-09-12T02:49:14.295 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-09-12T02:49:14.295 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-09-12T02:49:14.295 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [], 2024-09-12T02:49:14.295 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "", 2024-09-12T02:49:14.295 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-09-12T02:49:14.296 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-09-12T02:49:14.296 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-09-12T02:49:14.296 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-09-12T02:49:14.296 INFO:teuthology.orchestra.run.smithi039.stdout: "log_to_cluster_level": { 2024-09-12T02:49:14.296 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "log_to_cluster_level", 2024-09-12T02:49:14.296 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "str", 2024-09-12T02:49:14.296 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "advanced", 2024-09-12T02:49:14.296 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 1, 2024-09-12T02:49:14.296 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "info", 2024-09-12T02:49:14.296 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-09-12T02:49:14.296 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-09-12T02:49:14.296 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [ 2024-09-12T02:49:14.296 INFO:teuthology.orchestra.run.smithi039.stdout: "", 2024-09-12T02:49:14.297 INFO:teuthology.orchestra.run.smithi039.stdout: "critical", 2024-09-12T02:49:14.297 INFO:teuthology.orchestra.run.smithi039.stdout: "debug", 2024-09-12T02:49:14.297 INFO:teuthology.orchestra.run.smithi039.stdout: "error", 2024-09-12T02:49:14.297 INFO:teuthology.orchestra.run.smithi039.stdout: "info", 2024-09-12T02:49:14.297 INFO:teuthology.orchestra.run.smithi039.stdout: "warning" 2024-09-12T02:49:14.297 INFO:teuthology.orchestra.run.smithi039.stdout: ], 2024-09-12T02:49:14.297 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "", 2024-09-12T02:49:14.297 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-09-12T02:49:14.297 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-09-12T02:49:14.297 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-09-12T02:49:14.297 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-09-12T02:49:14.297 INFO:teuthology.orchestra.run.smithi039.stdout: "log_to_file": { 2024-09-12T02:49:14.297 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "log_to_file", 2024-09-12T02:49:14.298 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "bool", 2024-09-12T02:49:14.298 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "advanced", 2024-09-12T02:49:14.298 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 1, 2024-09-12T02:49:14.298 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "False", 2024-09-12T02:49:14.298 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-09-12T02:49:14.298 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-09-12T02:49:14.298 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [], 2024-09-12T02:49:14.298 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "", 2024-09-12T02:49:14.298 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-09-12T02:49:14.298 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-09-12T02:49:14.298 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-09-12T02:49:14.298 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-09-12T02:49:14.298 INFO:teuthology.orchestra.run.smithi039.stdout: "retain_interval": { 2024-09-12T02:49:14.298 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "retain_interval", 2024-09-12T02:49:14.299 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "secs", 2024-09-12T02:49:14.299 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "advanced", 2024-09-12T02:49:14.299 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 1, 2024-09-12T02:49:14.299 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "31536000", 2024-09-12T02:49:14.299 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-09-12T02:49:14.299 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-09-12T02:49:14.299 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [], 2024-09-12T02:49:14.299 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "how long to retain crashes before pruning them", 2024-09-12T02:49:14.299 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-09-12T02:49:14.299 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-09-12T02:49:14.299 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-09-12T02:49:14.299 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-09-12T02:49:14.299 INFO:teuthology.orchestra.run.smithi039.stdout: "warn_recent_interval": { 2024-09-12T02:49:14.300 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "warn_recent_interval", 2024-09-12T02:49:14.300 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "secs", 2024-09-12T02:49:14.300 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "advanced", 2024-09-12T02:49:14.300 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 1, 2024-09-12T02:49:14.300 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "1209600", 2024-09-12T02:49:14.300 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-09-12T02:49:14.300 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-09-12T02:49:14.300 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [], 2024-09-12T02:49:14.300 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "time interval in which to warn about recent crashes", 2024-09-12T02:49:14.300 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-09-12T02:49:14.300 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-09-12T02:49:14.300 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-09-12T02:49:14.300 INFO:teuthology.orchestra.run.smithi039.stdout: } 2024-09-12T02:49:14.301 INFO:teuthology.orchestra.run.smithi039.stdout: } 2024-09-12T02:49:14.301 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-09-12T02:49:14.301 INFO:teuthology.orchestra.run.smithi039.stdout: { 2024-09-12T02:49:14.301 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "dashboard", 2024-09-12T02:49:14.301 INFO:teuthology.orchestra.run.smithi039.stdout: "can_run": true, 2024-09-12T02:49:14.301 INFO:teuthology.orchestra.run.smithi039.stdout: "error_string": "", 2024-09-12T02:49:14.301 INFO:teuthology.orchestra.run.smithi039.stdout: "module_options": { 2024-09-12T02:49:14.301 INFO:teuthology.orchestra.run.smithi039.stdout: "ACCOUNT_LOCKOUT_ATTEMPTS": { 2024-09-12T02:49:14.301 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "ACCOUNT_LOCKOUT_ATTEMPTS", 2024-09-12T02:49:14.301 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "int", 2024-09-12T02:49:14.301 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "advanced", 2024-09-12T02:49:14.301 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 0, 2024-09-12T02:49:14.301 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "10", 2024-09-12T02:49:14.301 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-09-12T02:49:14.302 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-09-12T02:49:14.302 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [], 2024-09-12T02:49:14.302 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "", 2024-09-12T02:49:14.302 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-09-12T02:49:14.302 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-09-12T02:49:14.302 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-09-12T02:49:14.302 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-09-12T02:49:14.302 INFO:teuthology.orchestra.run.smithi039.stdout: "ALERTMANAGER_API_HOST": { 2024-09-12T02:49:14.302 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "ALERTMANAGER_API_HOST", 2024-09-12T02:49:14.302 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "str", 2024-09-12T02:49:14.302 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "advanced", 2024-09-12T02:49:14.302 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 0, 2024-09-12T02:49:14.302 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "", 2024-09-12T02:49:14.302 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-09-12T02:49:14.303 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-09-12T02:49:14.303 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [], 2024-09-12T02:49:14.303 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "", 2024-09-12T02:49:14.303 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-09-12T02:49:14.303 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-09-12T02:49:14.303 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-09-12T02:49:14.303 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-09-12T02:49:14.303 INFO:teuthology.orchestra.run.smithi039.stdout: "ALERTMANAGER_API_SSL_VERIFY": { 2024-09-12T02:49:14.303 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "ALERTMANAGER_API_SSL_VERIFY", 2024-09-12T02:49:14.303 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "bool", 2024-09-12T02:49:14.303 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "advanced", 2024-09-12T02:49:14.303 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 0, 2024-09-12T02:49:14.303 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "True", 2024-09-12T02:49:14.303 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-09-12T02:49:14.304 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-09-12T02:49:14.304 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [], 2024-09-12T02:49:14.304 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "", 2024-09-12T02:49:14.304 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-09-12T02:49:14.304 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-09-12T02:49:14.304 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-09-12T02:49:14.304 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-09-12T02:49:14.304 INFO:teuthology.orchestra.run.smithi039.stdout: "AUDIT_API_ENABLED": { 2024-09-12T02:49:14.304 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "AUDIT_API_ENABLED", 2024-09-12T02:49:14.304 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "bool", 2024-09-12T02:49:14.304 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "advanced", 2024-09-12T02:49:14.304 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 0, 2024-09-12T02:49:14.304 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "False", 2024-09-12T02:49:14.305 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-09-12T02:49:14.305 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-09-12T02:49:14.305 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [], 2024-09-12T02:49:14.305 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "", 2024-09-12T02:49:14.305 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-09-12T02:49:14.305 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-09-12T02:49:14.305 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-09-12T02:49:14.305 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-09-12T02:49:14.305 INFO:teuthology.orchestra.run.smithi039.stdout: "AUDIT_API_LOG_PAYLOAD": { 2024-09-12T02:49:14.305 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "AUDIT_API_LOG_PAYLOAD", 2024-09-12T02:49:14.305 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "bool", 2024-09-12T02:49:14.305 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "advanced", 2024-09-12T02:49:14.305 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 0, 2024-09-12T02:49:14.305 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "True", 2024-09-12T02:49:14.306 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-09-12T02:49:14.306 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-09-12T02:49:14.306 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [], 2024-09-12T02:49:14.306 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "", 2024-09-12T02:49:14.306 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-09-12T02:49:14.306 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-09-12T02:49:14.306 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-09-12T02:49:14.306 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-09-12T02:49:14.306 INFO:teuthology.orchestra.run.smithi039.stdout: "ENABLE_BROWSABLE_API": { 2024-09-12T02:49:14.306 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "ENABLE_BROWSABLE_API", 2024-09-12T02:49:14.309 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "bool", 2024-09-12T02:49:14.309 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "advanced", 2024-09-12T02:49:14.309 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 0, 2024-09-12T02:49:14.309 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "True", 2024-09-12T02:49:14.309 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-09-12T02:49:14.309 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-09-12T02:49:14.309 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [], 2024-09-12T02:49:14.309 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "", 2024-09-12T02:49:14.309 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-09-12T02:49:14.310 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-09-12T02:49:14.310 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-09-12T02:49:14.310 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-09-12T02:49:14.310 INFO:teuthology.orchestra.run.smithi039.stdout: "FEATURE_TOGGLE_CEPHFS": { 2024-09-12T02:49:14.310 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "FEATURE_TOGGLE_CEPHFS", 2024-09-12T02:49:14.310 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "bool", 2024-09-12T02:49:14.310 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "advanced", 2024-09-12T02:49:14.310 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 0, 2024-09-12T02:49:14.310 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "True", 2024-09-12T02:49:14.310 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-09-12T02:49:14.310 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-09-12T02:49:14.310 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [], 2024-09-12T02:49:14.311 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "", 2024-09-12T02:49:14.311 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-09-12T02:49:14.311 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-09-12T02:49:14.311 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-09-12T02:49:14.311 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-09-12T02:49:14.311 INFO:teuthology.orchestra.run.smithi039.stdout: "FEATURE_TOGGLE_DASHBOARD": { 2024-09-12T02:49:14.311 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "FEATURE_TOGGLE_DASHBOARD", 2024-09-12T02:49:14.311 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "bool", 2024-09-12T02:49:14.311 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "advanced", 2024-09-12T02:49:14.311 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 0, 2024-09-12T02:49:14.311 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "True", 2024-09-12T02:49:14.312 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-09-12T02:49:14.312 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-09-12T02:49:14.312 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [], 2024-09-12T02:49:14.312 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "", 2024-09-12T02:49:14.312 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-09-12T02:49:14.313 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-09-12T02:49:14.313 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-09-12T02:49:14.313 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-09-12T02:49:14.313 INFO:teuthology.orchestra.run.smithi039.stdout: "FEATURE_TOGGLE_ISCSI": { 2024-09-12T02:49:14.313 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "FEATURE_TOGGLE_ISCSI", 2024-09-12T02:49:14.313 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "bool", 2024-09-12T02:49:14.314 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "advanced", 2024-09-12T02:49:14.314 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 0, 2024-09-12T02:49:14.314 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "True", 2024-09-12T02:49:14.314 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-09-12T02:49:14.314 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-09-12T02:49:14.314 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [], 2024-09-12T02:49:14.315 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "", 2024-09-12T02:49:14.315 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-09-12T02:49:14.315 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-09-12T02:49:14.315 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-09-12T02:49:14.315 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-09-12T02:49:14.316 INFO:teuthology.orchestra.run.smithi039.stdout: "FEATURE_TOGGLE_MIRRORING": { 2024-09-12T02:49:14.316 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "FEATURE_TOGGLE_MIRRORING", 2024-09-12T02:49:14.316 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "bool", 2024-09-12T02:49:14.316 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "advanced", 2024-09-12T02:49:14.316 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 0, 2024-09-12T02:49:14.316 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "True", 2024-09-12T02:49:14.316 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-09-12T02:49:14.316 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-09-12T02:49:14.316 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [], 2024-09-12T02:49:14.316 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "", 2024-09-12T02:49:14.317 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-09-12T02:49:14.317 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-09-12T02:49:14.317 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-09-12T02:49:14.317 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-09-12T02:49:14.317 INFO:teuthology.orchestra.run.smithi039.stdout: "FEATURE_TOGGLE_NFS": { 2024-09-12T02:49:14.317 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "FEATURE_TOGGLE_NFS", 2024-09-12T02:49:14.317 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "bool", 2024-09-12T02:49:14.317 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "advanced", 2024-09-12T02:49:14.317 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 0, 2024-09-12T02:49:14.317 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "True", 2024-09-12T02:49:14.317 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-09-12T02:49:14.317 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-09-12T02:49:14.317 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [], 2024-09-12T02:49:14.318 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "", 2024-09-12T02:49:14.318 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-09-12T02:49:14.318 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-09-12T02:49:14.318 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-09-12T02:49:14.318 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-09-12T02:49:14.318 INFO:teuthology.orchestra.run.smithi039.stdout: "FEATURE_TOGGLE_RBD": { 2024-09-12T02:49:14.318 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "FEATURE_TOGGLE_RBD", 2024-09-12T02:49:14.318 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "bool", 2024-09-12T02:49:14.318 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "advanced", 2024-09-12T02:49:14.318 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 0, 2024-09-12T02:49:14.318 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "True", 2024-09-12T02:49:14.318 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-09-12T02:49:14.319 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-09-12T02:49:14.319 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [], 2024-09-12T02:49:14.319 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "", 2024-09-12T02:49:14.319 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-09-12T02:49:14.319 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-09-12T02:49:14.319 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-09-12T02:49:14.319 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-09-12T02:49:14.319 INFO:teuthology.orchestra.run.smithi039.stdout: "FEATURE_TOGGLE_RGW": { 2024-09-12T02:49:14.319 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "FEATURE_TOGGLE_RGW", 2024-09-12T02:49:14.319 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "bool", 2024-09-12T02:49:14.319 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "advanced", 2024-09-12T02:49:14.319 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 0, 2024-09-12T02:49:14.319 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "True", 2024-09-12T02:49:14.319 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-09-12T02:49:14.320 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-09-12T02:49:14.320 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [], 2024-09-12T02:49:14.320 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "", 2024-09-12T02:49:14.320 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-09-12T02:49:14.320 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-09-12T02:49:14.320 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-09-12T02:49:14.320 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-09-12T02:49:14.320 INFO:teuthology.orchestra.run.smithi039.stdout: "GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE": { 2024-09-12T02:49:14.320 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE", 2024-09-12T02:49:14.321 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "str", 2024-09-12T02:49:14.321 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "advanced", 2024-09-12T02:49:14.321 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 0, 2024-09-12T02:49:14.321 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "", 2024-09-12T02:49:14.321 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-09-12T02:49:14.321 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-09-12T02:49:14.321 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [], 2024-09-12T02:49:14.321 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "", 2024-09-12T02:49:14.321 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-09-12T02:49:14.321 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-09-12T02:49:14.321 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-09-12T02:49:14.321 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-09-12T02:49:14.321 INFO:teuthology.orchestra.run.smithi039.stdout: "GRAFANA_API_PASSWORD": { 2024-09-12T02:49:14.322 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "GRAFANA_API_PASSWORD", 2024-09-12T02:49:14.322 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "str", 2024-09-12T02:49:14.322 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "advanced", 2024-09-12T02:49:14.322 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 0, 2024-09-12T02:49:14.322 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "admin", 2024-09-12T02:49:14.322 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-09-12T02:49:14.322 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-09-12T02:49:14.322 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [], 2024-09-12T02:49:14.322 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "", 2024-09-12T02:49:14.322 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-09-12T02:49:14.322 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-09-12T02:49:14.322 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-09-12T02:49:14.322 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-09-12T02:49:14.322 INFO:teuthology.orchestra.run.smithi039.stdout: "GRAFANA_API_SSL_VERIFY": { 2024-09-12T02:49:14.323 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "GRAFANA_API_SSL_VERIFY", 2024-09-12T02:49:14.323 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "bool", 2024-09-12T02:49:14.323 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "advanced", 2024-09-12T02:49:14.323 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 0, 2024-09-12T02:49:14.323 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "True", 2024-09-12T02:49:14.323 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-09-12T02:49:14.323 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-09-12T02:49:14.323 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [], 2024-09-12T02:49:14.323 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "", 2024-09-12T02:49:14.323 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-09-12T02:49:14.323 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-09-12T02:49:14.323 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-09-12T02:49:14.323 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-09-12T02:49:14.323 INFO:teuthology.orchestra.run.smithi039.stdout: "GRAFANA_API_URL": { 2024-09-12T02:49:14.324 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "GRAFANA_API_URL", 2024-09-12T02:49:14.324 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "str", 2024-09-12T02:49:14.324 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "advanced", 2024-09-12T02:49:14.324 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 0, 2024-09-12T02:49:14.324 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "", 2024-09-12T02:49:14.324 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-09-12T02:49:14.324 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-09-12T02:49:14.324 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [], 2024-09-12T02:49:14.324 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "", 2024-09-12T02:49:14.324 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-09-12T02:49:14.324 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-09-12T02:49:14.324 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-09-12T02:49:14.324 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-09-12T02:49:14.325 INFO:teuthology.orchestra.run.smithi039.stdout: "GRAFANA_API_USERNAME": { 2024-09-12T02:49:14.325 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "GRAFANA_API_USERNAME", 2024-09-12T02:49:14.325 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "str", 2024-09-12T02:49:14.325 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "advanced", 2024-09-12T02:49:14.325 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 0, 2024-09-12T02:49:14.325 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "admin", 2024-09-12T02:49:14.325 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-09-12T02:49:14.325 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-09-12T02:49:14.325 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [], 2024-09-12T02:49:14.325 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "", 2024-09-12T02:49:14.325 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-09-12T02:49:14.325 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-09-12T02:49:14.325 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-09-12T02:49:14.325 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-09-12T02:49:14.326 INFO:teuthology.orchestra.run.smithi039.stdout: "GRAFANA_FRONTEND_API_URL": { 2024-09-12T02:49:14.326 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "GRAFANA_FRONTEND_API_URL", 2024-09-12T02:49:14.326 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "str", 2024-09-12T02:49:14.326 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "advanced", 2024-09-12T02:49:14.326 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 0, 2024-09-12T02:49:14.326 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "", 2024-09-12T02:49:14.326 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-09-12T02:49:14.326 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-09-12T02:49:14.326 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [], 2024-09-12T02:49:14.326 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "", 2024-09-12T02:49:14.326 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-09-12T02:49:14.326 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-09-12T02:49:14.326 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-09-12T02:49:14.326 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-09-12T02:49:14.327 INFO:teuthology.orchestra.run.smithi039.stdout: "GRAFANA_UPDATE_DASHBOARDS": { 2024-09-12T02:49:14.327 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "GRAFANA_UPDATE_DASHBOARDS", 2024-09-12T02:49:14.327 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "bool", 2024-09-12T02:49:14.327 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "advanced", 2024-09-12T02:49:14.327 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 0, 2024-09-12T02:49:14.327 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "False", 2024-09-12T02:49:14.327 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-09-12T02:49:14.327 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-09-12T02:49:14.327 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [], 2024-09-12T02:49:14.327 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "", 2024-09-12T02:49:14.327 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-09-12T02:49:14.327 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-09-12T02:49:14.328 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-09-12T02:49:14.328 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-09-12T02:49:14.328 INFO:teuthology.orchestra.run.smithi039.stdout: "ISCSI_API_SSL_VERIFICATION": { 2024-09-12T02:49:14.328 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "ISCSI_API_SSL_VERIFICATION", 2024-09-12T02:49:14.328 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "bool", 2024-09-12T02:49:14.328 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "advanced", 2024-09-12T02:49:14.328 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 0, 2024-09-12T02:49:14.328 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "True", 2024-09-12T02:49:14.328 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-09-12T02:49:14.328 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-09-12T02:49:14.328 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [], 2024-09-12T02:49:14.328 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "", 2024-09-12T02:49:14.328 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-09-12T02:49:14.329 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-09-12T02:49:14.329 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-09-12T02:49:14.329 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-09-12T02:49:14.329 INFO:teuthology.orchestra.run.smithi039.stdout: "ISSUE_TRACKER_API_KEY": { 2024-09-12T02:49:14.329 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "ISSUE_TRACKER_API_KEY", 2024-09-12T02:49:14.329 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "str", 2024-09-12T02:49:14.329 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "advanced", 2024-09-12T02:49:14.329 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 0, 2024-09-12T02:49:14.329 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "", 2024-09-12T02:49:14.329 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-09-12T02:49:14.329 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-09-12T02:49:14.329 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [], 2024-09-12T02:49:14.329 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "", 2024-09-12T02:49:14.330 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-09-12T02:49:14.330 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-09-12T02:49:14.330 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-09-12T02:49:14.330 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-09-12T02:49:14.330 INFO:teuthology.orchestra.run.smithi039.stdout: "PROMETHEUS_API_HOST": { 2024-09-12T02:49:14.330 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "PROMETHEUS_API_HOST", 2024-09-12T02:49:14.330 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "str", 2024-09-12T02:49:14.330 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "advanced", 2024-09-12T02:49:14.330 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 0, 2024-09-12T02:49:14.330 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "", 2024-09-12T02:49:14.330 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-09-12T02:49:14.330 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-09-12T02:49:14.330 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [], 2024-09-12T02:49:14.330 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "", 2024-09-12T02:49:14.331 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-09-12T02:49:14.331 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-09-12T02:49:14.331 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-09-12T02:49:14.331 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-09-12T02:49:14.331 INFO:teuthology.orchestra.run.smithi039.stdout: "PROMETHEUS_API_SSL_VERIFY": { 2024-09-12T02:49:14.331 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "PROMETHEUS_API_SSL_VERIFY", 2024-09-12T02:49:14.331 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "bool", 2024-09-12T02:49:14.331 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "advanced", 2024-09-12T02:49:14.331 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 0, 2024-09-12T02:49:14.331 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "True", 2024-09-12T02:49:14.331 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-09-12T02:49:14.331 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-09-12T02:49:14.331 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [], 2024-09-12T02:49:14.332 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "", 2024-09-12T02:49:14.332 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-09-12T02:49:14.332 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-09-12T02:49:14.332 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-09-12T02:49:14.332 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-09-12T02:49:14.332 INFO:teuthology.orchestra.run.smithi039.stdout: "PWD_POLICY_CHECK_COMPLEXITY_ENABLED": { 2024-09-12T02:49:14.332 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "PWD_POLICY_CHECK_COMPLEXITY_ENABLED", 2024-09-12T02:49:14.332 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "bool", 2024-09-12T02:49:14.332 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "advanced", 2024-09-12T02:49:14.332 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 0, 2024-09-12T02:49:14.332 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "False", 2024-09-12T02:49:14.332 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-09-12T02:49:14.332 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-09-12T02:49:14.333 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [], 2024-09-12T02:49:14.333 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "", 2024-09-12T02:49:14.333 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-09-12T02:49:14.333 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-09-12T02:49:14.333 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-09-12T02:49:14.333 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-09-12T02:49:14.333 INFO:teuthology.orchestra.run.smithi039.stdout: "PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED": { 2024-09-12T02:49:14.333 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED", 2024-09-12T02:49:14.333 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "bool", 2024-09-12T02:49:14.333 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "advanced", 2024-09-12T02:49:14.333 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 0, 2024-09-12T02:49:14.333 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "False", 2024-09-12T02:49:14.333 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-09-12T02:49:14.333 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-09-12T02:49:14.334 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [], 2024-09-12T02:49:14.334 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "", 2024-09-12T02:49:14.334 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-09-12T02:49:14.334 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-09-12T02:49:14.334 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-09-12T02:49:14.334 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-09-12T02:49:14.334 INFO:teuthology.orchestra.run.smithi039.stdout: "PWD_POLICY_CHECK_LENGTH_ENABLED": { 2024-09-12T02:49:14.334 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "PWD_POLICY_CHECK_LENGTH_ENABLED", 2024-09-12T02:49:14.334 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "bool", 2024-09-12T02:49:14.334 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "advanced", 2024-09-12T02:49:14.334 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 0, 2024-09-12T02:49:14.334 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "True", 2024-09-12T02:49:14.334 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-09-12T02:49:14.335 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-09-12T02:49:14.335 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [], 2024-09-12T02:49:14.335 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "", 2024-09-12T02:49:14.335 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-09-12T02:49:14.335 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-09-12T02:49:14.335 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-09-12T02:49:14.335 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-09-12T02:49:14.335 INFO:teuthology.orchestra.run.smithi039.stdout: "PWD_POLICY_CHECK_OLDPWD_ENABLED": { 2024-09-12T02:49:14.335 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "PWD_POLICY_CHECK_OLDPWD_ENABLED", 2024-09-12T02:49:14.335 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "bool", 2024-09-12T02:49:14.335 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "advanced", 2024-09-12T02:49:14.335 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 0, 2024-09-12T02:49:14.335 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "True", 2024-09-12T02:49:14.335 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-09-12T02:49:14.336 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-09-12T02:49:14.336 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [], 2024-09-12T02:49:14.336 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "", 2024-09-12T02:49:14.336 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-09-12T02:49:14.336 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-09-12T02:49:14.336 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-09-12T02:49:14.336 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-09-12T02:49:14.336 INFO:teuthology.orchestra.run.smithi039.stdout: "PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED": { 2024-09-12T02:49:14.336 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED", 2024-09-12T02:49:14.336 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "bool", 2024-09-12T02:49:14.336 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "advanced", 2024-09-12T02:49:14.336 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 0, 2024-09-12T02:49:14.336 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "False", 2024-09-12T02:49:14.336 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-09-12T02:49:14.337 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-09-12T02:49:14.337 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [], 2024-09-12T02:49:14.337 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "", 2024-09-12T02:49:14.337 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-09-12T02:49:14.337 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-09-12T02:49:14.337 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-09-12T02:49:14.337 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-09-12T02:49:14.337 INFO:teuthology.orchestra.run.smithi039.stdout: "PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED": { 2024-09-12T02:49:14.337 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED", 2024-09-12T02:49:14.337 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "bool", 2024-09-12T02:49:14.337 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "advanced", 2024-09-12T02:49:14.337 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 0, 2024-09-12T02:49:14.337 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "False", 2024-09-12T02:49:14.338 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-09-12T02:49:14.338 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-09-12T02:49:14.338 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [], 2024-09-12T02:49:14.338 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "", 2024-09-12T02:49:14.338 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-09-12T02:49:14.338 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-09-12T02:49:14.338 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-09-12T02:49:14.338 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-09-12T02:49:14.338 INFO:teuthology.orchestra.run.smithi039.stdout: "PWD_POLICY_CHECK_USERNAME_ENABLED": { 2024-09-12T02:49:14.338 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "PWD_POLICY_CHECK_USERNAME_ENABLED", 2024-09-12T02:49:14.338 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "bool", 2024-09-12T02:49:14.338 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "advanced", 2024-09-12T02:49:14.338 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 0, 2024-09-12T02:49:14.338 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "False", 2024-09-12T02:49:14.339 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-09-12T02:49:14.339 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-09-12T02:49:14.339 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [], 2024-09-12T02:49:14.339 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "", 2024-09-12T02:49:14.339 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-09-12T02:49:14.339 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-09-12T02:49:14.339 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-09-12T02:49:14.339 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-09-12T02:49:14.339 INFO:teuthology.orchestra.run.smithi039.stdout: "PWD_POLICY_ENABLED": { 2024-09-12T02:49:14.339 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "PWD_POLICY_ENABLED", 2024-09-12T02:49:14.339 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "bool", 2024-09-12T02:49:14.339 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "advanced", 2024-09-12T02:49:14.339 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 0, 2024-09-12T02:49:14.340 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "True", 2024-09-12T02:49:14.340 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-09-12T02:49:14.340 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-09-12T02:49:14.340 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [], 2024-09-12T02:49:14.340 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "", 2024-09-12T02:49:14.340 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-09-12T02:49:14.340 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-09-12T02:49:14.340 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-09-12T02:49:14.340 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-09-12T02:49:14.340 INFO:teuthology.orchestra.run.smithi039.stdout: "PWD_POLICY_EXCLUSION_LIST": { 2024-09-12T02:49:14.340 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "PWD_POLICY_EXCLUSION_LIST", 2024-09-12T02:49:14.340 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "str", 2024-09-12T02:49:14.341 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "advanced", 2024-09-12T02:49:14.341 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 0, 2024-09-12T02:49:14.341 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "osd,host,dashboard,pool,block,nfs,ceph,monitors,gateway,logs,crush,maps", 2024-09-12T02:49:14.341 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-09-12T02:49:14.341 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-09-12T02:49:14.341 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [], 2024-09-12T02:49:14.341 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "", 2024-09-12T02:49:14.341 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-09-12T02:49:14.341 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-09-12T02:49:14.341 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-09-12T02:49:14.341 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-09-12T02:49:14.341 INFO:teuthology.orchestra.run.smithi039.stdout: "PWD_POLICY_MIN_COMPLEXITY": { 2024-09-12T02:49:14.341 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "PWD_POLICY_MIN_COMPLEXITY", 2024-09-12T02:49:14.342 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "int", 2024-09-12T02:49:14.342 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "advanced", 2024-09-12T02:49:14.342 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 0, 2024-09-12T02:49:14.342 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "10", 2024-09-12T02:49:14.342 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-09-12T02:49:14.342 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-09-12T02:49:14.342 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [], 2024-09-12T02:49:14.342 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "", 2024-09-12T02:49:14.342 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-09-12T02:49:14.342 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-09-12T02:49:14.342 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-09-12T02:49:14.342 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-09-12T02:49:14.342 INFO:teuthology.orchestra.run.smithi039.stdout: "PWD_POLICY_MIN_LENGTH": { 2024-09-12T02:49:14.343 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "PWD_POLICY_MIN_LENGTH", 2024-09-12T02:49:14.343 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "int", 2024-09-12T02:49:14.343 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "advanced", 2024-09-12T02:49:14.343 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 0, 2024-09-12T02:49:14.343 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "8", 2024-09-12T02:49:14.343 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-09-12T02:49:14.343 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-09-12T02:49:14.343 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [], 2024-09-12T02:49:14.343 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "", 2024-09-12T02:49:14.343 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-09-12T02:49:14.343 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-09-12T02:49:14.343 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-09-12T02:49:14.343 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-09-12T02:49:14.343 INFO:teuthology.orchestra.run.smithi039.stdout: "REST_REQUESTS_TIMEOUT": { 2024-09-12T02:49:14.344 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "REST_REQUESTS_TIMEOUT", 2024-09-12T02:49:14.344 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "int", 2024-09-12T02:49:14.344 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "advanced", 2024-09-12T02:49:14.344 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 0, 2024-09-12T02:49:14.344 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "45", 2024-09-12T02:49:14.344 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-09-12T02:49:14.344 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-09-12T02:49:14.344 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [], 2024-09-12T02:49:14.344 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "", 2024-09-12T02:49:14.344 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-09-12T02:49:14.344 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-09-12T02:49:14.344 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-09-12T02:49:14.345 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-09-12T02:49:14.345 INFO:teuthology.orchestra.run.smithi039.stdout: "RGW_API_ACCESS_KEY": { 2024-09-12T02:49:14.345 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "RGW_API_ACCESS_KEY", 2024-09-12T02:49:14.345 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "str", 2024-09-12T02:49:14.345 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "advanced", 2024-09-12T02:49:14.345 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 0, 2024-09-12T02:49:14.345 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "", 2024-09-12T02:49:14.345 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-09-12T02:49:14.345 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-09-12T02:49:14.345 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [], 2024-09-12T02:49:14.345 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "", 2024-09-12T02:49:14.345 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-09-12T02:49:14.345 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-09-12T02:49:14.346 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-09-12T02:49:14.346 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-09-12T02:49:14.346 INFO:teuthology.orchestra.run.smithi039.stdout: "RGW_API_ADMIN_RESOURCE": { 2024-09-12T02:49:14.346 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "RGW_API_ADMIN_RESOURCE", 2024-09-12T02:49:14.346 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "str", 2024-09-12T02:49:14.346 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "advanced", 2024-09-12T02:49:14.346 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 0, 2024-09-12T02:49:14.346 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "admin", 2024-09-12T02:49:14.346 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-09-12T02:49:14.346 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-09-12T02:49:14.346 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [], 2024-09-12T02:49:14.346 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "", 2024-09-12T02:49:14.346 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-09-12T02:49:14.346 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-09-12T02:49:14.347 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-09-12T02:49:14.347 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-09-12T02:49:14.347 INFO:teuthology.orchestra.run.smithi039.stdout: "RGW_API_SECRET_KEY": { 2024-09-12T02:49:14.347 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "RGW_API_SECRET_KEY", 2024-09-12T02:49:14.347 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "str", 2024-09-12T02:49:14.347 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "advanced", 2024-09-12T02:49:14.347 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 0, 2024-09-12T02:49:14.347 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "", 2024-09-12T02:49:14.347 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-09-12T02:49:14.347 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-09-12T02:49:14.347 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [], 2024-09-12T02:49:14.347 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "", 2024-09-12T02:49:14.347 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-09-12T02:49:14.348 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-09-12T02:49:14.348 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-09-12T02:49:14.348 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-09-12T02:49:14.348 INFO:teuthology.orchestra.run.smithi039.stdout: "RGW_API_SSL_VERIFY": { 2024-09-12T02:49:14.348 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "RGW_API_SSL_VERIFY", 2024-09-12T02:49:14.348 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "bool", 2024-09-12T02:49:14.348 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "advanced", 2024-09-12T02:49:14.348 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 0, 2024-09-12T02:49:14.348 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "True", 2024-09-12T02:49:14.348 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-09-12T02:49:14.348 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-09-12T02:49:14.348 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [], 2024-09-12T02:49:14.348 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "", 2024-09-12T02:49:14.349 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-09-12T02:49:14.349 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-09-12T02:49:14.349 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-09-12T02:49:14.349 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-09-12T02:49:14.349 INFO:teuthology.orchestra.run.smithi039.stdout: "USER_PWD_EXPIRATION_SPAN": { 2024-09-12T02:49:14.349 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "USER_PWD_EXPIRATION_SPAN", 2024-09-12T02:49:14.349 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "int", 2024-09-12T02:49:14.349 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "advanced", 2024-09-12T02:49:14.349 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 0, 2024-09-12T02:49:14.349 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "0", 2024-09-12T02:49:14.349 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-09-12T02:49:14.349 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-09-12T02:49:14.349 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [], 2024-09-12T02:49:14.350 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "", 2024-09-12T02:49:14.350 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-09-12T02:49:14.350 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-09-12T02:49:14.350 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-09-12T02:49:14.350 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-09-12T02:49:14.350 INFO:teuthology.orchestra.run.smithi039.stdout: "USER_PWD_EXPIRATION_WARNING_1": { 2024-09-12T02:49:14.350 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "USER_PWD_EXPIRATION_WARNING_1", 2024-09-12T02:49:14.350 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "int", 2024-09-12T02:49:14.350 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "advanced", 2024-09-12T02:49:14.350 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 0, 2024-09-12T02:49:14.350 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "10", 2024-09-12T02:49:14.350 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-09-12T02:49:14.350 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-09-12T02:49:14.350 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [], 2024-09-12T02:49:14.351 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "", 2024-09-12T02:49:14.351 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-09-12T02:49:14.351 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-09-12T02:49:14.351 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-09-12T02:49:14.351 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-09-12T02:49:14.351 INFO:teuthology.orchestra.run.smithi039.stdout: "USER_PWD_EXPIRATION_WARNING_2": { 2024-09-12T02:49:14.351 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "USER_PWD_EXPIRATION_WARNING_2", 2024-09-12T02:49:14.351 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "int", 2024-09-12T02:49:14.351 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "advanced", 2024-09-12T02:49:14.351 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 0, 2024-09-12T02:49:14.351 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "5", 2024-09-12T02:49:14.351 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-09-12T02:49:14.351 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-09-12T02:49:14.351 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [], 2024-09-12T02:49:14.352 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "", 2024-09-12T02:49:14.352 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-09-12T02:49:14.352 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-09-12T02:49:14.352 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-09-12T02:49:14.352 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-09-12T02:49:14.352 INFO:teuthology.orchestra.run.smithi039.stdout: "cross_origin_url": { 2024-09-12T02:49:14.352 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "cross_origin_url", 2024-09-12T02:49:14.352 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "str", 2024-09-12T02:49:14.352 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "advanced", 2024-09-12T02:49:14.352 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 0, 2024-09-12T02:49:14.352 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "", 2024-09-12T02:49:14.352 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-09-12T02:49:14.352 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-09-12T02:49:14.353 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [], 2024-09-12T02:49:14.353 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "", 2024-09-12T02:49:14.353 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-09-12T02:49:14.353 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-09-12T02:49:14.353 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-09-12T02:49:14.353 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-09-12T02:49:14.353 INFO:teuthology.orchestra.run.smithi039.stdout: "crt_file": { 2024-09-12T02:49:14.353 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "crt_file", 2024-09-12T02:49:14.354 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "str", 2024-09-12T02:49:14.354 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "advanced", 2024-09-12T02:49:14.354 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 0, 2024-09-12T02:49:14.354 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "", 2024-09-12T02:49:14.354 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-09-12T02:49:14.354 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-09-12T02:49:14.354 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [], 2024-09-12T02:49:14.354 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "", 2024-09-12T02:49:14.354 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-09-12T02:49:14.355 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-09-12T02:49:14.355 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-09-12T02:49:14.355 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-09-12T02:49:14.355 INFO:teuthology.orchestra.run.smithi039.stdout: "debug": { 2024-09-12T02:49:14.355 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "debug", 2024-09-12T02:49:14.355 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "bool", 2024-09-12T02:49:14.355 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "advanced", 2024-09-12T02:49:14.356 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 0, 2024-09-12T02:49:14.356 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "False", 2024-09-12T02:49:14.356 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-09-12T02:49:14.356 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-09-12T02:49:14.356 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [], 2024-09-12T02:49:14.356 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "Enable/disable debug options", 2024-09-12T02:49:14.356 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-09-12T02:49:14.356 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-09-12T02:49:14.357 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-09-12T02:49:14.357 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-09-12T02:49:14.357 INFO:teuthology.orchestra.run.smithi039.stdout: "jwt_token_ttl": { 2024-09-12T02:49:14.357 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "jwt_token_ttl", 2024-09-12T02:49:14.357 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "int", 2024-09-12T02:49:14.357 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "advanced", 2024-09-12T02:49:14.357 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 0, 2024-09-12T02:49:14.357 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "28800", 2024-09-12T02:49:14.357 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-09-12T02:49:14.357 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-09-12T02:49:14.357 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [], 2024-09-12T02:49:14.357 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "", 2024-09-12T02:49:14.358 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-09-12T02:49:14.358 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-09-12T02:49:14.358 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-09-12T02:49:14.358 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-09-12T02:49:14.358 INFO:teuthology.orchestra.run.smithi039.stdout: "key_file": { 2024-09-12T02:49:14.358 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "key_file", 2024-09-12T02:49:14.358 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "str", 2024-09-12T02:49:14.358 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "advanced", 2024-09-12T02:49:14.358 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 0, 2024-09-12T02:49:14.358 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "", 2024-09-12T02:49:14.358 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-09-12T02:49:14.358 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-09-12T02:49:14.358 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [], 2024-09-12T02:49:14.358 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "", 2024-09-12T02:49:14.359 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-09-12T02:49:14.359 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-09-12T02:49:14.359 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-09-12T02:49:14.359 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-09-12T02:49:14.359 INFO:teuthology.orchestra.run.smithi039.stdout: "log_level": { 2024-09-12T02:49:14.359 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "log_level", 2024-09-12T02:49:14.359 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "str", 2024-09-12T02:49:14.359 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "advanced", 2024-09-12T02:49:14.359 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 1, 2024-09-12T02:49:14.359 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "", 2024-09-12T02:49:14.359 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-09-12T02:49:14.359 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-09-12T02:49:14.359 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [ 2024-09-12T02:49:14.359 INFO:teuthology.orchestra.run.smithi039.stdout: "", 2024-09-12T02:49:14.360 INFO:teuthology.orchestra.run.smithi039.stdout: "critical", 2024-09-12T02:49:14.360 INFO:teuthology.orchestra.run.smithi039.stdout: "debug", 2024-09-12T02:49:14.360 INFO:teuthology.orchestra.run.smithi039.stdout: "error", 2024-09-12T02:49:14.360 INFO:teuthology.orchestra.run.smithi039.stdout: "info", 2024-09-12T02:49:14.360 INFO:teuthology.orchestra.run.smithi039.stdout: "warning" 2024-09-12T02:49:14.360 INFO:teuthology.orchestra.run.smithi039.stdout: ], 2024-09-12T02:49:14.360 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "", 2024-09-12T02:49:14.360 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-09-12T02:49:14.360 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-09-12T02:49:14.360 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-09-12T02:49:14.360 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-09-12T02:49:14.360 INFO:teuthology.orchestra.run.smithi039.stdout: "log_to_cluster": { 2024-09-12T02:49:14.360 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "log_to_cluster", 2024-09-12T02:49:14.361 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "bool", 2024-09-12T02:49:14.361 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "advanced", 2024-09-12T02:49:14.361 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 1, 2024-09-12T02:49:14.361 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "False", 2024-09-12T02:49:14.361 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-09-12T02:49:14.361 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-09-12T02:49:14.361 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [], 2024-09-12T02:49:14.361 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "", 2024-09-12T02:49:14.361 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-09-12T02:49:14.361 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-09-12T02:49:14.361 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-09-12T02:49:14.361 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-09-12T02:49:14.361 INFO:teuthology.orchestra.run.smithi039.stdout: "log_to_cluster_level": { 2024-09-12T02:49:14.361 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "log_to_cluster_level", 2024-09-12T02:49:14.362 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "str", 2024-09-12T02:49:14.362 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "advanced", 2024-09-12T02:49:14.362 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 1, 2024-09-12T02:49:14.362 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "info", 2024-09-12T02:49:14.362 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-09-12T02:49:14.362 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-09-12T02:49:14.362 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [ 2024-09-12T02:49:14.362 INFO:teuthology.orchestra.run.smithi039.stdout: "", 2024-09-12T02:49:14.362 INFO:teuthology.orchestra.run.smithi039.stdout: "critical", 2024-09-12T02:49:14.362 INFO:teuthology.orchestra.run.smithi039.stdout: "debug", 2024-09-12T02:49:14.362 INFO:teuthology.orchestra.run.smithi039.stdout: "error", 2024-09-12T02:49:14.362 INFO:teuthology.orchestra.run.smithi039.stdout: "info", 2024-09-12T02:49:14.362 INFO:teuthology.orchestra.run.smithi039.stdout: "warning" 2024-09-12T02:49:14.362 INFO:teuthology.orchestra.run.smithi039.stdout: ], 2024-09-12T02:49:14.363 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "", 2024-09-12T02:49:14.363 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-09-12T02:49:14.363 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-09-12T02:49:14.363 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-09-12T02:49:14.363 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-09-12T02:49:14.363 INFO:teuthology.orchestra.run.smithi039.stdout: "log_to_file": { 2024-09-12T02:49:14.363 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "log_to_file", 2024-09-12T02:49:14.363 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "bool", 2024-09-12T02:49:14.363 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "advanced", 2024-09-12T02:49:14.363 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 1, 2024-09-12T02:49:14.363 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "False", 2024-09-12T02:49:14.363 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-09-12T02:49:14.363 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-09-12T02:49:14.363 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [], 2024-09-12T02:49:14.364 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "", 2024-09-12T02:49:14.364 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-09-12T02:49:14.364 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-09-12T02:49:14.364 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-09-12T02:49:14.364 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-09-12T02:49:14.364 INFO:teuthology.orchestra.run.smithi039.stdout: "motd": { 2024-09-12T02:49:14.364 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "motd", 2024-09-12T02:49:14.364 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "str", 2024-09-12T02:49:14.364 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "advanced", 2024-09-12T02:49:14.364 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 0, 2024-09-12T02:49:14.364 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "", 2024-09-12T02:49:14.364 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-09-12T02:49:14.364 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-09-12T02:49:14.364 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [], 2024-09-12T02:49:14.365 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "The message of the day", 2024-09-12T02:49:14.365 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-09-12T02:49:14.365 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-09-12T02:49:14.365 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-09-12T02:49:14.365 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-09-12T02:49:14.365 INFO:teuthology.orchestra.run.smithi039.stdout: "redirect_resolve_ip_addr": { 2024-09-12T02:49:14.365 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "redirect_resolve_ip_addr", 2024-09-12T02:49:14.365 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "bool", 2024-09-12T02:49:14.365 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "advanced", 2024-09-12T02:49:14.365 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 0, 2024-09-12T02:49:14.365 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "False", 2024-09-12T02:49:14.365 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-09-12T02:49:14.365 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-09-12T02:49:14.366 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [], 2024-09-12T02:49:14.366 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "", 2024-09-12T02:49:14.366 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-09-12T02:49:14.366 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-09-12T02:49:14.366 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-09-12T02:49:14.366 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-09-12T02:49:14.366 INFO:teuthology.orchestra.run.smithi039.stdout: "server_addr": { 2024-09-12T02:49:14.366 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "server_addr", 2024-09-12T02:49:14.366 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "str", 2024-09-12T02:49:14.366 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "advanced", 2024-09-12T02:49:14.366 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 0, 2024-09-12T02:49:14.366 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "::", 2024-09-12T02:49:14.366 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-09-12T02:49:14.366 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-09-12T02:49:14.366 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [], 2024-09-12T02:49:14.367 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "", 2024-09-12T02:49:14.367 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-09-12T02:49:14.367 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-09-12T02:49:14.367 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-09-12T02:49:14.367 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-09-12T02:49:14.367 INFO:teuthology.orchestra.run.smithi039.stdout: "server_port": { 2024-09-12T02:49:14.367 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "server_port", 2024-09-12T02:49:14.367 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "int", 2024-09-12T02:49:14.367 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "advanced", 2024-09-12T02:49:14.367 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 0, 2024-09-12T02:49:14.367 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "8080", 2024-09-12T02:49:14.367 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-09-12T02:49:14.367 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-09-12T02:49:14.367 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [], 2024-09-12T02:49:14.368 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "", 2024-09-12T02:49:14.368 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-09-12T02:49:14.368 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-09-12T02:49:14.368 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-09-12T02:49:14.368 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-09-12T02:49:14.368 INFO:teuthology.orchestra.run.smithi039.stdout: "ssl": { 2024-09-12T02:49:14.368 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "ssl", 2024-09-12T02:49:14.368 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "bool", 2024-09-12T02:49:14.368 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "advanced", 2024-09-12T02:49:14.368 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 0, 2024-09-12T02:49:14.368 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "True", 2024-09-12T02:49:14.368 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-09-12T02:49:14.368 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-09-12T02:49:14.368 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [], 2024-09-12T02:49:14.369 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "", 2024-09-12T02:49:14.369 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-09-12T02:49:14.369 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-09-12T02:49:14.369 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-09-12T02:49:14.369 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-09-12T02:49:14.369 INFO:teuthology.orchestra.run.smithi039.stdout: "ssl_server_port": { 2024-09-12T02:49:14.369 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "ssl_server_port", 2024-09-12T02:49:14.369 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "int", 2024-09-12T02:49:14.369 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "advanced", 2024-09-12T02:49:14.369 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 0, 2024-09-12T02:49:14.369 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "8443", 2024-09-12T02:49:14.369 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-09-12T02:49:14.369 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-09-12T02:49:14.369 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [], 2024-09-12T02:49:14.370 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "", 2024-09-12T02:49:14.370 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-09-12T02:49:14.370 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-09-12T02:49:14.370 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-09-12T02:49:14.370 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-09-12T02:49:14.370 INFO:teuthology.orchestra.run.smithi039.stdout: "standby_behaviour": { 2024-09-12T02:49:14.370 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "standby_behaviour", 2024-09-12T02:49:14.370 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "str", 2024-09-12T02:49:14.370 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "advanced", 2024-09-12T02:49:14.370 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 0, 2024-09-12T02:49:14.370 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "redirect", 2024-09-12T02:49:14.371 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-09-12T02:49:14.371 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-09-12T02:49:14.371 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [ 2024-09-12T02:49:14.371 INFO:teuthology.orchestra.run.smithi039.stdout: "error", 2024-09-12T02:49:14.371 INFO:teuthology.orchestra.run.smithi039.stdout: "redirect" 2024-09-12T02:49:14.371 INFO:teuthology.orchestra.run.smithi039.stdout: ], 2024-09-12T02:49:14.371 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "", 2024-09-12T02:49:14.371 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-09-12T02:49:14.371 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-09-12T02:49:14.371 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-09-12T02:49:14.371 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-09-12T02:49:14.371 INFO:teuthology.orchestra.run.smithi039.stdout: "standby_error_status_code": { 2024-09-12T02:49:14.372 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "standby_error_status_code", 2024-09-12T02:49:14.372 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "int", 2024-09-12T02:49:14.372 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "advanced", 2024-09-12T02:49:14.372 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 0, 2024-09-12T02:49:14.372 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "500", 2024-09-12T02:49:14.372 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "400", 2024-09-12T02:49:14.372 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "599", 2024-09-12T02:49:14.372 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [], 2024-09-12T02:49:14.372 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "", 2024-09-12T02:49:14.372 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-09-12T02:49:14.372 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-09-12T02:49:14.373 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-09-12T02:49:14.373 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-09-12T02:49:14.373 INFO:teuthology.orchestra.run.smithi039.stdout: "url_prefix": { 2024-09-12T02:49:14.373 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "url_prefix", 2024-09-12T02:49:14.373 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "str", 2024-09-12T02:49:14.373 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "advanced", 2024-09-12T02:49:14.373 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 0, 2024-09-12T02:49:14.373 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "", 2024-09-12T02:49:14.373 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-09-12T02:49:14.373 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-09-12T02:49:14.373 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [], 2024-09-12T02:49:14.373 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "", 2024-09-12T02:49:14.373 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-09-12T02:49:14.373 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-09-12T02:49:14.374 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-09-12T02:49:14.374 INFO:teuthology.orchestra.run.smithi039.stdout: } 2024-09-12T02:49:14.374 INFO:teuthology.orchestra.run.smithi039.stdout: } 2024-09-12T02:49:14.374 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-09-12T02:49:14.374 INFO:teuthology.orchestra.run.smithi039.stdout: { 2024-09-12T02:49:14.374 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "devicehealth", 2024-09-12T02:49:14.374 INFO:teuthology.orchestra.run.smithi039.stdout: "can_run": true, 2024-09-12T02:49:14.374 INFO:teuthology.orchestra.run.smithi039.stdout: "error_string": "", 2024-09-12T02:49:14.374 INFO:teuthology.orchestra.run.smithi039.stdout: "module_options": { 2024-09-12T02:49:14.374 INFO:teuthology.orchestra.run.smithi039.stdout: "enable_monitoring": { 2024-09-12T02:49:14.374 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "enable_monitoring", 2024-09-12T02:49:14.374 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "bool", 2024-09-12T02:49:14.374 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "advanced", 2024-09-12T02:49:14.374 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 1, 2024-09-12T02:49:14.375 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "True", 2024-09-12T02:49:14.375 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-09-12T02:49:14.375 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-09-12T02:49:14.375 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [], 2024-09-12T02:49:14.375 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "monitor device health metrics", 2024-09-12T02:49:14.375 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-09-12T02:49:14.375 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-09-12T02:49:14.375 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-09-12T02:49:14.375 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-09-12T02:49:14.375 INFO:teuthology.orchestra.run.smithi039.stdout: "log_level": { 2024-09-12T02:49:14.375 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "log_level", 2024-09-12T02:49:14.375 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "str", 2024-09-12T02:49:14.375 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "advanced", 2024-09-12T02:49:14.375 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 1, 2024-09-12T02:49:14.376 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "", 2024-09-12T02:49:14.376 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-09-12T02:49:14.376 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-09-12T02:49:14.376 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [ 2024-09-12T02:49:14.376 INFO:teuthology.orchestra.run.smithi039.stdout: "", 2024-09-12T02:49:14.376 INFO:teuthology.orchestra.run.smithi039.stdout: "critical", 2024-09-12T02:49:14.376 INFO:teuthology.orchestra.run.smithi039.stdout: "debug", 2024-09-12T02:49:14.376 INFO:teuthology.orchestra.run.smithi039.stdout: "error", 2024-09-12T02:49:14.376 INFO:teuthology.orchestra.run.smithi039.stdout: "info", 2024-09-12T02:49:14.376 INFO:teuthology.orchestra.run.smithi039.stdout: "warning" 2024-09-12T02:49:14.376 INFO:teuthology.orchestra.run.smithi039.stdout: ], 2024-09-12T02:49:14.376 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "", 2024-09-12T02:49:14.376 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-09-12T02:49:14.377 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-09-12T02:49:14.377 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-09-12T02:49:14.377 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-09-12T02:49:14.377 INFO:teuthology.orchestra.run.smithi039.stdout: "log_to_cluster": { 2024-09-12T02:49:14.377 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "log_to_cluster", 2024-09-12T02:49:14.377 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "bool", 2024-09-12T02:49:14.377 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "advanced", 2024-09-12T02:49:14.377 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 1, 2024-09-12T02:49:14.377 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "False", 2024-09-12T02:49:14.377 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-09-12T02:49:14.377 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-09-12T02:49:14.377 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [], 2024-09-12T02:49:14.377 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "", 2024-09-12T02:49:14.377 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-09-12T02:49:14.378 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-09-12T02:49:14.378 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-09-12T02:49:14.378 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-09-12T02:49:14.378 INFO:teuthology.orchestra.run.smithi039.stdout: "log_to_cluster_level": { 2024-09-12T02:49:14.378 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "log_to_cluster_level", 2024-09-12T02:49:14.378 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "str", 2024-09-12T02:49:14.378 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "advanced", 2024-09-12T02:49:14.378 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 1, 2024-09-12T02:49:14.378 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "info", 2024-09-12T02:49:14.378 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-09-12T02:49:14.378 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-09-12T02:49:14.378 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [ 2024-09-12T02:49:14.378 INFO:teuthology.orchestra.run.smithi039.stdout: "", 2024-09-12T02:49:14.378 INFO:teuthology.orchestra.run.smithi039.stdout: "critical", 2024-09-12T02:49:14.379 INFO:teuthology.orchestra.run.smithi039.stdout: "debug", 2024-09-12T02:49:14.379 INFO:teuthology.orchestra.run.smithi039.stdout: "error", 2024-09-12T02:49:14.379 INFO:teuthology.orchestra.run.smithi039.stdout: "info", 2024-09-12T02:49:14.379 INFO:teuthology.orchestra.run.smithi039.stdout: "warning" 2024-09-12T02:49:14.379 INFO:teuthology.orchestra.run.smithi039.stdout: ], 2024-09-12T02:49:14.379 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "", 2024-09-12T02:49:14.379 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-09-12T02:49:14.379 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-09-12T02:49:14.379 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-09-12T02:49:14.379 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-09-12T02:49:14.379 INFO:teuthology.orchestra.run.smithi039.stdout: "log_to_file": { 2024-09-12T02:49:14.379 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "log_to_file", 2024-09-12T02:49:14.379 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "bool", 2024-09-12T02:49:14.379 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "advanced", 2024-09-12T02:49:14.379 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 1, 2024-09-12T02:49:14.380 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "False", 2024-09-12T02:49:14.380 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-09-12T02:49:14.380 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-09-12T02:49:14.380 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [], 2024-09-12T02:49:14.380 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "", 2024-09-12T02:49:14.380 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-09-12T02:49:14.380 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-09-12T02:49:14.380 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-09-12T02:49:14.380 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-09-12T02:49:14.380 INFO:teuthology.orchestra.run.smithi039.stdout: "mark_out_threshold": { 2024-09-12T02:49:14.380 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "mark_out_threshold", 2024-09-12T02:49:14.380 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "secs", 2024-09-12T02:49:14.380 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "advanced", 2024-09-12T02:49:14.381 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 1, 2024-09-12T02:49:14.381 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "2419200", 2024-09-12T02:49:14.381 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-09-12T02:49:14.381 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-09-12T02:49:14.381 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [], 2024-09-12T02:49:14.381 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "automatically mark OSD if it may fail before this long", 2024-09-12T02:49:14.381 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-09-12T02:49:14.381 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-09-12T02:49:14.381 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-09-12T02:49:14.381 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-09-12T02:49:14.381 INFO:teuthology.orchestra.run.smithi039.stdout: "pool_name": { 2024-09-12T02:49:14.381 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "pool_name", 2024-09-12T02:49:14.381 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "str", 2024-09-12T02:49:14.381 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "advanced", 2024-09-12T02:49:14.381 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 1, 2024-09-12T02:49:14.382 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "device_health_metrics", 2024-09-12T02:49:14.382 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-09-12T02:49:14.382 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-09-12T02:49:14.382 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [], 2024-09-12T02:49:14.382 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "name of pool in which to store device health metrics", 2024-09-12T02:49:14.382 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-09-12T02:49:14.382 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-09-12T02:49:14.382 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-09-12T02:49:14.382 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-09-12T02:49:14.382 INFO:teuthology.orchestra.run.smithi039.stdout: "retention_period": { 2024-09-12T02:49:14.382 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "retention_period", 2024-09-12T02:49:14.382 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "secs", 2024-09-12T02:49:14.382 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "advanced", 2024-09-12T02:49:14.382 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 1, 2024-09-12T02:49:14.383 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "15552000", 2024-09-12T02:49:14.383 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-09-12T02:49:14.383 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-09-12T02:49:14.383 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [], 2024-09-12T02:49:14.383 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "how long to retain device health metrics", 2024-09-12T02:49:14.383 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-09-12T02:49:14.383 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-09-12T02:49:14.383 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-09-12T02:49:14.383 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-09-12T02:49:14.383 INFO:teuthology.orchestra.run.smithi039.stdout: "scrape_frequency": { 2024-09-12T02:49:14.383 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "scrape_frequency", 2024-09-12T02:49:14.383 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "secs", 2024-09-12T02:49:14.383 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "advanced", 2024-09-12T02:49:14.383 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 1, 2024-09-12T02:49:14.384 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "86400", 2024-09-12T02:49:14.384 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-09-12T02:49:14.384 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-09-12T02:49:14.384 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [], 2024-09-12T02:49:14.384 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "how frequently to scrape device health metrics", 2024-09-12T02:49:14.384 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-09-12T02:49:14.384 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-09-12T02:49:14.384 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-09-12T02:49:14.384 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-09-12T02:49:14.384 INFO:teuthology.orchestra.run.smithi039.stdout: "self_heal": { 2024-09-12T02:49:14.384 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "self_heal", 2024-09-12T02:49:14.384 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "bool", 2024-09-12T02:49:14.385 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "advanced", 2024-09-12T02:49:14.385 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 1, 2024-09-12T02:49:14.385 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "True", 2024-09-12T02:49:14.385 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-09-12T02:49:14.385 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-09-12T02:49:14.385 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [], 2024-09-12T02:49:14.385 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "preemptively heal cluster around devices that may fail", 2024-09-12T02:49:14.385 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-09-12T02:49:14.385 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-09-12T02:49:14.385 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-09-12T02:49:14.385 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-09-12T02:49:14.385 INFO:teuthology.orchestra.run.smithi039.stdout: "sleep_interval": { 2024-09-12T02:49:14.385 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "sleep_interval", 2024-09-12T02:49:14.385 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "secs", 2024-09-12T02:49:14.386 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "advanced", 2024-09-12T02:49:14.386 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 1, 2024-09-12T02:49:14.386 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "600", 2024-09-12T02:49:14.386 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-09-12T02:49:14.386 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-09-12T02:49:14.386 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [], 2024-09-12T02:49:14.386 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "how frequently to wake up and check device health", 2024-09-12T02:49:14.386 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-09-12T02:49:14.386 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-09-12T02:49:14.386 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-09-12T02:49:14.386 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-09-12T02:49:14.386 INFO:teuthology.orchestra.run.smithi039.stdout: "warn_threshold": { 2024-09-12T02:49:14.386 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "warn_threshold", 2024-09-12T02:49:14.386 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "secs", 2024-09-12T02:49:14.387 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "advanced", 2024-09-12T02:49:14.387 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 1, 2024-09-12T02:49:14.387 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "7257600", 2024-09-12T02:49:14.387 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-09-12T02:49:14.387 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-09-12T02:49:14.387 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [], 2024-09-12T02:49:14.387 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "raise health warning if OSD may fail before this long", 2024-09-12T02:49:14.387 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-09-12T02:49:14.387 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-09-12T02:49:14.387 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-09-12T02:49:14.387 INFO:teuthology.orchestra.run.smithi039.stdout: } 2024-09-12T02:49:14.387 INFO:teuthology.orchestra.run.smithi039.stdout: } 2024-09-12T02:49:14.387 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-09-12T02:49:14.387 INFO:teuthology.orchestra.run.smithi039.stdout: { 2024-09-12T02:49:14.388 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "diskprediction_local", 2024-09-12T02:49:14.388 INFO:teuthology.orchestra.run.smithi039.stdout: "can_run": true, 2024-09-12T02:49:14.388 INFO:teuthology.orchestra.run.smithi039.stdout: "error_string": "", 2024-09-12T02:49:14.388 INFO:teuthology.orchestra.run.smithi039.stdout: "module_options": { 2024-09-12T02:49:14.388 INFO:teuthology.orchestra.run.smithi039.stdout: "log_level": { 2024-09-12T02:49:14.388 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "log_level", 2024-09-12T02:49:14.388 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "str", 2024-09-12T02:49:14.388 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "advanced", 2024-09-12T02:49:14.388 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 1, 2024-09-12T02:49:14.388 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "", 2024-09-12T02:49:14.388 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-09-12T02:49:14.388 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-09-12T02:49:14.388 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [ 2024-09-12T02:49:14.389 INFO:teuthology.orchestra.run.smithi039.stdout: "", 2024-09-12T02:49:14.389 INFO:teuthology.orchestra.run.smithi039.stdout: "critical", 2024-09-12T02:49:14.389 INFO:teuthology.orchestra.run.smithi039.stdout: "debug", 2024-09-12T02:49:14.389 INFO:teuthology.orchestra.run.smithi039.stdout: "error", 2024-09-12T02:49:14.389 INFO:teuthology.orchestra.run.smithi039.stdout: "info", 2024-09-12T02:49:14.389 INFO:teuthology.orchestra.run.smithi039.stdout: "warning" 2024-09-12T02:49:14.389 INFO:teuthology.orchestra.run.smithi039.stdout: ], 2024-09-12T02:49:14.389 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "", 2024-09-12T02:49:14.389 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-09-12T02:49:14.389 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-09-12T02:49:14.389 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-09-12T02:49:14.389 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-09-12T02:49:14.389 INFO:teuthology.orchestra.run.smithi039.stdout: "log_to_cluster": { 2024-09-12T02:49:14.389 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "log_to_cluster", 2024-09-12T02:49:14.390 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "bool", 2024-09-12T02:49:14.390 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "advanced", 2024-09-12T02:49:14.390 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 1, 2024-09-12T02:49:14.390 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "False", 2024-09-12T02:49:14.390 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-09-12T02:49:14.390 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-09-12T02:49:14.390 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [], 2024-09-12T02:49:14.390 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "", 2024-09-12T02:49:14.390 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-09-12T02:49:14.390 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-09-12T02:49:14.390 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-09-12T02:49:14.390 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-09-12T02:49:14.390 INFO:teuthology.orchestra.run.smithi039.stdout: "log_to_cluster_level": { 2024-09-12T02:49:14.390 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "log_to_cluster_level", 2024-09-12T02:49:14.391 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "str", 2024-09-12T02:49:14.391 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "advanced", 2024-09-12T02:49:14.391 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 1, 2024-09-12T02:49:14.391 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "info", 2024-09-12T02:49:14.391 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-09-12T02:49:14.391 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-09-12T02:49:14.391 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [ 2024-09-12T02:49:14.391 INFO:teuthology.orchestra.run.smithi039.stdout: "", 2024-09-12T02:49:14.391 INFO:teuthology.orchestra.run.smithi039.stdout: "critical", 2024-09-12T02:49:14.391 INFO:teuthology.orchestra.run.smithi039.stdout: "debug", 2024-09-12T02:49:14.391 INFO:teuthology.orchestra.run.smithi039.stdout: "error", 2024-09-12T02:49:14.391 INFO:teuthology.orchestra.run.smithi039.stdout: "info", 2024-09-12T02:49:14.391 INFO:teuthology.orchestra.run.smithi039.stdout: "warning" 2024-09-12T02:49:14.391 INFO:teuthology.orchestra.run.smithi039.stdout: ], 2024-09-12T02:49:14.392 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "", 2024-09-12T02:49:14.392 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-09-12T02:49:14.392 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-09-12T02:49:14.392 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-09-12T02:49:14.392 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-09-12T02:49:14.392 INFO:teuthology.orchestra.run.smithi039.stdout: "log_to_file": { 2024-09-12T02:49:14.392 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "log_to_file", 2024-09-12T02:49:14.392 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "bool", 2024-09-12T02:49:14.392 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "advanced", 2024-09-12T02:49:14.392 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 1, 2024-09-12T02:49:14.392 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "False", 2024-09-12T02:49:14.392 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-09-12T02:49:14.392 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-09-12T02:49:14.392 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [], 2024-09-12T02:49:14.393 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "", 2024-09-12T02:49:14.393 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-09-12T02:49:14.393 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-09-12T02:49:14.393 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-09-12T02:49:14.393 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-09-12T02:49:14.393 INFO:teuthology.orchestra.run.smithi039.stdout: "predict_interval": { 2024-09-12T02:49:14.393 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "predict_interval", 2024-09-12T02:49:14.393 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "str", 2024-09-12T02:49:14.393 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "advanced", 2024-09-12T02:49:14.393 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 0, 2024-09-12T02:49:14.393 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "86400", 2024-09-12T02:49:14.393 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-09-12T02:49:14.393 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-09-12T02:49:14.393 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [], 2024-09-12T02:49:14.394 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "", 2024-09-12T02:49:14.394 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-09-12T02:49:14.394 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-09-12T02:49:14.394 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-09-12T02:49:14.394 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-09-12T02:49:14.394 INFO:teuthology.orchestra.run.smithi039.stdout: "predictor_model": { 2024-09-12T02:49:14.394 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "predictor_model", 2024-09-12T02:49:14.394 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "str", 2024-09-12T02:49:14.394 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "advanced", 2024-09-12T02:49:14.394 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 0, 2024-09-12T02:49:14.394 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "prophetstor", 2024-09-12T02:49:14.394 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-09-12T02:49:14.394 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-09-12T02:49:14.394 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [], 2024-09-12T02:49:14.394 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "", 2024-09-12T02:49:14.395 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-09-12T02:49:14.395 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-09-12T02:49:14.395 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-09-12T02:49:14.395 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-09-12T02:49:14.395 INFO:teuthology.orchestra.run.smithi039.stdout: "sleep_interval": { 2024-09-12T02:49:14.395 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "sleep_interval", 2024-09-12T02:49:14.395 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "str", 2024-09-12T02:49:14.395 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "advanced", 2024-09-12T02:49:14.395 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 0, 2024-09-12T02:49:14.395 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "600", 2024-09-12T02:49:14.395 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-09-12T02:49:14.395 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-09-12T02:49:14.395 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [], 2024-09-12T02:49:14.395 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "", 2024-09-12T02:49:14.396 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-09-12T02:49:14.396 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-09-12T02:49:14.396 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-09-12T02:49:14.396 INFO:teuthology.orchestra.run.smithi039.stdout: } 2024-09-12T02:49:14.396 INFO:teuthology.orchestra.run.smithi039.stdout: } 2024-09-12T02:49:14.396 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-09-12T02:49:14.396 INFO:teuthology.orchestra.run.smithi039.stdout: { 2024-09-12T02:49:14.396 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "influx", 2024-09-12T02:49:14.396 INFO:teuthology.orchestra.run.smithi039.stdout: "can_run": false, 2024-09-12T02:49:14.396 INFO:teuthology.orchestra.run.smithi039.stdout: "error_string": "influxdb python module not found", 2024-09-12T02:49:14.396 INFO:teuthology.orchestra.run.smithi039.stdout: "module_options": { 2024-09-12T02:49:14.396 INFO:teuthology.orchestra.run.smithi039.stdout: "batch_size": { 2024-09-12T02:49:14.396 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "batch_size", 2024-09-12T02:49:14.396 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "int", 2024-09-12T02:49:14.397 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "advanced", 2024-09-12T02:49:14.397 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 0, 2024-09-12T02:49:14.397 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "5000", 2024-09-12T02:49:14.397 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-09-12T02:49:14.397 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-09-12T02:49:14.397 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [], 2024-09-12T02:49:14.397 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "How big batches of data points should be when sending to InfluxDB.", 2024-09-12T02:49:14.397 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-09-12T02:49:14.397 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-09-12T02:49:14.397 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-09-12T02:49:14.397 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-09-12T02:49:14.397 INFO:teuthology.orchestra.run.smithi039.stdout: "database": { 2024-09-12T02:49:14.398 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "database", 2024-09-12T02:49:14.398 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "str", 2024-09-12T02:49:14.398 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "advanced", 2024-09-12T02:49:14.398 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 0, 2024-09-12T02:49:14.398 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "ceph", 2024-09-12T02:49:14.398 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-09-12T02:49:14.398 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-09-12T02:49:14.398 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [], 2024-09-12T02:49:14.398 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "InfluxDB database name. You will need to create this database and grant write privileges to the configured username or the username must have admin privileges to create it.", 2024-09-12T02:49:14.398 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-09-12T02:49:14.398 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-09-12T02:49:14.398 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-09-12T02:49:14.398 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-09-12T02:49:14.398 INFO:teuthology.orchestra.run.smithi039.stdout: "hostname": { 2024-09-12T02:49:14.399 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "hostname", 2024-09-12T02:49:14.399 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "str", 2024-09-12T02:49:14.399 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "advanced", 2024-09-12T02:49:14.399 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 0, 2024-09-12T02:49:14.399 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "", 2024-09-12T02:49:14.399 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-09-12T02:49:14.399 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-09-12T02:49:14.399 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [], 2024-09-12T02:49:14.399 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "InfluxDB server hostname", 2024-09-12T02:49:14.399 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-09-12T02:49:14.399 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-09-12T02:49:14.399 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-09-12T02:49:14.399 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-09-12T02:49:14.399 INFO:teuthology.orchestra.run.smithi039.stdout: "interval": { 2024-09-12T02:49:14.400 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "interval", 2024-09-12T02:49:14.400 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "secs", 2024-09-12T02:49:14.400 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "advanced", 2024-09-12T02:49:14.400 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 0, 2024-09-12T02:49:14.400 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "30", 2024-09-12T02:49:14.400 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "5", 2024-09-12T02:49:14.400 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-09-12T02:49:14.400 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [], 2024-09-12T02:49:14.400 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "Time between reports to InfluxDB. Default 30 seconds.", 2024-09-12T02:49:14.400 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-09-12T02:49:14.400 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-09-12T02:49:14.400 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-09-12T02:49:14.400 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-09-12T02:49:14.401 INFO:teuthology.orchestra.run.smithi039.stdout: "log_level": { 2024-09-12T02:49:14.401 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "log_level", 2024-09-12T02:49:14.401 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "str", 2024-09-12T02:49:14.401 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "advanced", 2024-09-12T02:49:14.401 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 1, 2024-09-12T02:49:14.401 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "", 2024-09-12T02:49:14.401 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-09-12T02:49:14.401 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-09-12T02:49:14.401 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [ 2024-09-12T02:49:14.401 INFO:teuthology.orchestra.run.smithi039.stdout: "", 2024-09-12T02:49:14.401 INFO:teuthology.orchestra.run.smithi039.stdout: "critical", 2024-09-12T02:49:14.401 INFO:teuthology.orchestra.run.smithi039.stdout: "debug", 2024-09-12T02:49:14.401 INFO:teuthology.orchestra.run.smithi039.stdout: "error", 2024-09-12T02:49:14.401 INFO:teuthology.orchestra.run.smithi039.stdout: "info", 2024-09-12T02:49:14.402 INFO:teuthology.orchestra.run.smithi039.stdout: "warning" 2024-09-12T02:49:14.402 INFO:teuthology.orchestra.run.smithi039.stdout: ], 2024-09-12T02:49:14.402 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "", 2024-09-12T02:49:14.402 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-09-12T02:49:14.402 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-09-12T02:49:14.402 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-09-12T02:49:14.402 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-09-12T02:49:14.402 INFO:teuthology.orchestra.run.smithi039.stdout: "log_to_cluster": { 2024-09-12T02:49:14.402 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "log_to_cluster", 2024-09-12T02:49:14.402 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "bool", 2024-09-12T02:49:14.402 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "advanced", 2024-09-12T02:49:14.402 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 1, 2024-09-12T02:49:14.402 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "False", 2024-09-12T02:49:14.403 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-09-12T02:49:14.403 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-09-12T02:49:14.403 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [], 2024-09-12T02:49:14.403 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "", 2024-09-12T02:49:14.403 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-09-12T02:49:14.403 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-09-12T02:49:14.403 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-09-12T02:49:14.403 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-09-12T02:49:14.403 INFO:teuthology.orchestra.run.smithi039.stdout: "log_to_cluster_level": { 2024-09-12T02:49:14.403 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "log_to_cluster_level", 2024-09-12T02:49:14.403 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "str", 2024-09-12T02:49:14.403 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "advanced", 2024-09-12T02:49:14.403 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 1, 2024-09-12T02:49:14.403 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "info", 2024-09-12T02:49:14.404 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-09-12T02:49:14.404 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-09-12T02:49:14.404 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [ 2024-09-12T02:49:14.404 INFO:teuthology.orchestra.run.smithi039.stdout: "", 2024-09-12T02:49:14.404 INFO:teuthology.orchestra.run.smithi039.stdout: "critical", 2024-09-12T02:49:14.404 INFO:teuthology.orchestra.run.smithi039.stdout: "debug", 2024-09-12T02:49:14.404 INFO:teuthology.orchestra.run.smithi039.stdout: "error", 2024-09-12T02:49:14.404 INFO:teuthology.orchestra.run.smithi039.stdout: "info", 2024-09-12T02:49:14.404 INFO:teuthology.orchestra.run.smithi039.stdout: "warning" 2024-09-12T02:49:14.404 INFO:teuthology.orchestra.run.smithi039.stdout: ], 2024-09-12T02:49:14.404 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "", 2024-09-12T02:49:14.404 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-09-12T02:49:14.404 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-09-12T02:49:14.405 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-09-12T02:49:14.405 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-09-12T02:49:14.405 INFO:teuthology.orchestra.run.smithi039.stdout: "log_to_file": { 2024-09-12T02:49:14.405 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "log_to_file", 2024-09-12T02:49:14.405 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "bool", 2024-09-12T02:49:14.405 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "advanced", 2024-09-12T02:49:14.405 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 1, 2024-09-12T02:49:14.405 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "False", 2024-09-12T02:49:14.405 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-09-12T02:49:14.405 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-09-12T02:49:14.405 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [], 2024-09-12T02:49:14.405 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "", 2024-09-12T02:49:14.405 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-09-12T02:49:14.405 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-09-12T02:49:14.406 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-09-12T02:49:14.406 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-09-12T02:49:14.406 INFO:teuthology.orchestra.run.smithi039.stdout: "password": { 2024-09-12T02:49:14.406 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "password", 2024-09-12T02:49:14.406 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "str", 2024-09-12T02:49:14.406 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "advanced", 2024-09-12T02:49:14.406 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 0, 2024-09-12T02:49:14.406 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "", 2024-09-12T02:49:14.406 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-09-12T02:49:14.406 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-09-12T02:49:14.406 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [], 2024-09-12T02:49:14.406 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "password of InfluxDB server user", 2024-09-12T02:49:14.406 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-09-12T02:49:14.406 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-09-12T02:49:14.407 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-09-12T02:49:14.407 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-09-12T02:49:14.407 INFO:teuthology.orchestra.run.smithi039.stdout: "port": { 2024-09-12T02:49:14.407 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "port", 2024-09-12T02:49:14.407 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "int", 2024-09-12T02:49:14.407 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "advanced", 2024-09-12T02:49:14.407 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 0, 2024-09-12T02:49:14.407 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "8086", 2024-09-12T02:49:14.407 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-09-12T02:49:14.407 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-09-12T02:49:14.407 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [], 2024-09-12T02:49:14.407 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "InfluxDB server port", 2024-09-12T02:49:14.407 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-09-12T02:49:14.407 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-09-12T02:49:14.407 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-09-12T02:49:14.408 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-09-12T02:49:14.408 INFO:teuthology.orchestra.run.smithi039.stdout: "ssl": { 2024-09-12T02:49:14.408 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "ssl", 2024-09-12T02:49:14.408 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "str", 2024-09-12T02:49:14.408 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "advanced", 2024-09-12T02:49:14.408 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 0, 2024-09-12T02:49:14.408 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "false", 2024-09-12T02:49:14.408 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-09-12T02:49:14.408 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-09-12T02:49:14.408 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [], 2024-09-12T02:49:14.408 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "Use https connection for InfluxDB server. Use \"true\" or \"false\".", 2024-09-12T02:49:14.408 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-09-12T02:49:14.408 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-09-12T02:49:14.409 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-09-12T02:49:14.409 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-09-12T02:49:14.409 INFO:teuthology.orchestra.run.smithi039.stdout: "threads": { 2024-09-12T02:49:14.409 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "threads", 2024-09-12T02:49:14.409 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "int", 2024-09-12T02:49:14.409 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "advanced", 2024-09-12T02:49:14.409 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 0, 2024-09-12T02:49:14.409 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "5", 2024-09-12T02:49:14.409 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "1", 2024-09-12T02:49:14.409 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "32", 2024-09-12T02:49:14.409 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [], 2024-09-12T02:49:14.409 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "How many worker threads should be spawned for sending data to InfluxDB.", 2024-09-12T02:49:14.409 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-09-12T02:49:14.409 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-09-12T02:49:14.410 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-09-12T02:49:14.410 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-09-12T02:49:14.410 INFO:teuthology.orchestra.run.smithi039.stdout: "username": { 2024-09-12T02:49:14.410 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "username", 2024-09-12T02:49:14.410 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "str", 2024-09-12T02:49:14.410 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "advanced", 2024-09-12T02:49:14.410 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 0, 2024-09-12T02:49:14.410 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "", 2024-09-12T02:49:14.410 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-09-12T02:49:14.410 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-09-12T02:49:14.410 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [], 2024-09-12T02:49:14.410 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "username of InfluxDB server user", 2024-09-12T02:49:14.410 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-09-12T02:49:14.410 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-09-12T02:49:14.411 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-09-12T02:49:14.411 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-09-12T02:49:14.411 INFO:teuthology.orchestra.run.smithi039.stdout: "verify_ssl": { 2024-09-12T02:49:14.411 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "verify_ssl", 2024-09-12T02:49:14.411 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "str", 2024-09-12T02:49:14.411 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "advanced", 2024-09-12T02:49:14.411 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 0, 2024-09-12T02:49:14.411 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "true", 2024-09-12T02:49:14.411 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-09-12T02:49:14.411 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-09-12T02:49:14.411 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [], 2024-09-12T02:49:14.411 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "Verify https cert for InfluxDB server. Use \"true\" or \"false\".", 2024-09-12T02:49:14.412 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-09-12T02:49:14.412 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-09-12T02:49:14.412 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-09-12T02:49:14.412 INFO:teuthology.orchestra.run.smithi039.stdout: } 2024-09-12T02:49:14.412 INFO:teuthology.orchestra.run.smithi039.stdout: } 2024-09-12T02:49:14.412 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-09-12T02:49:14.412 INFO:teuthology.orchestra.run.smithi039.stdout: { 2024-09-12T02:49:14.412 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "insights", 2024-09-12T02:49:14.412 INFO:teuthology.orchestra.run.smithi039.stdout: "can_run": true, 2024-09-12T02:49:14.412 INFO:teuthology.orchestra.run.smithi039.stdout: "error_string": "", 2024-09-12T02:49:14.412 INFO:teuthology.orchestra.run.smithi039.stdout: "module_options": { 2024-09-12T02:49:14.412 INFO:teuthology.orchestra.run.smithi039.stdout: "log_level": { 2024-09-12T02:49:14.412 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "log_level", 2024-09-12T02:49:14.412 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "str", 2024-09-12T02:49:14.413 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "advanced", 2024-09-12T02:49:14.413 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 1, 2024-09-12T02:49:14.413 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "", 2024-09-12T02:49:14.413 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-09-12T02:49:14.413 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-09-12T02:49:14.413 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [ 2024-09-12T02:49:14.413 INFO:teuthology.orchestra.run.smithi039.stdout: "", 2024-09-12T02:49:14.413 INFO:teuthology.orchestra.run.smithi039.stdout: "critical", 2024-09-12T02:49:14.413 INFO:teuthology.orchestra.run.smithi039.stdout: "debug", 2024-09-12T02:49:14.413 INFO:teuthology.orchestra.run.smithi039.stdout: "error", 2024-09-12T02:49:14.413 INFO:teuthology.orchestra.run.smithi039.stdout: "info", 2024-09-12T02:49:14.413 INFO:teuthology.orchestra.run.smithi039.stdout: "warning" 2024-09-12T02:49:14.413 INFO:teuthology.orchestra.run.smithi039.stdout: ], 2024-09-12T02:49:14.414 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "", 2024-09-12T02:49:14.414 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-09-12T02:49:14.414 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-09-12T02:49:14.414 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-09-12T02:49:14.414 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-09-12T02:49:14.414 INFO:teuthology.orchestra.run.smithi039.stdout: "log_to_cluster": { 2024-09-12T02:49:14.414 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "log_to_cluster", 2024-09-12T02:49:14.414 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "bool", 2024-09-12T02:49:14.414 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "advanced", 2024-09-12T02:49:14.414 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 1, 2024-09-12T02:49:14.414 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "False", 2024-09-12T02:49:14.414 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-09-12T02:49:14.414 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-09-12T02:49:14.414 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [], 2024-09-12T02:49:14.415 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "", 2024-09-12T02:49:14.415 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-09-12T02:49:14.415 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-09-12T02:49:14.415 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-09-12T02:49:14.415 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-09-12T02:49:14.415 INFO:teuthology.orchestra.run.smithi039.stdout: "log_to_cluster_level": { 2024-09-12T02:49:14.415 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "log_to_cluster_level", 2024-09-12T02:49:14.415 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "str", 2024-09-12T02:49:14.415 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "advanced", 2024-09-12T02:49:14.415 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 1, 2024-09-12T02:49:14.415 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "info", 2024-09-12T02:49:14.415 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-09-12T02:49:14.415 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-09-12T02:49:14.416 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [ 2024-09-12T02:49:14.416 INFO:teuthology.orchestra.run.smithi039.stdout: "", 2024-09-12T02:49:14.416 INFO:teuthology.orchestra.run.smithi039.stdout: "critical", 2024-09-12T02:49:14.416 INFO:teuthology.orchestra.run.smithi039.stdout: "debug", 2024-09-12T02:49:14.416 INFO:teuthology.orchestra.run.smithi039.stdout: "error", 2024-09-12T02:49:14.416 INFO:teuthology.orchestra.run.smithi039.stdout: "info", 2024-09-12T02:49:14.416 INFO:teuthology.orchestra.run.smithi039.stdout: "warning" 2024-09-12T02:49:14.416 INFO:teuthology.orchestra.run.smithi039.stdout: ], 2024-09-12T02:49:14.416 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "", 2024-09-12T02:49:14.416 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-09-12T02:49:14.416 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-09-12T02:49:14.416 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-09-12T02:49:14.416 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-09-12T02:49:14.417 INFO:teuthology.orchestra.run.smithi039.stdout: "log_to_file": { 2024-09-12T02:49:14.417 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "log_to_file", 2024-09-12T02:49:14.417 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "bool", 2024-09-12T02:49:14.417 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "advanced", 2024-09-12T02:49:14.417 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 1, 2024-09-12T02:49:14.417 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "False", 2024-09-12T02:49:14.417 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-09-12T02:49:14.417 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-09-12T02:49:14.417 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [], 2024-09-12T02:49:14.417 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "", 2024-09-12T02:49:14.417 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-09-12T02:49:14.417 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-09-12T02:49:14.417 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-09-12T02:49:14.417 INFO:teuthology.orchestra.run.smithi039.stdout: } 2024-09-12T02:49:14.418 INFO:teuthology.orchestra.run.smithi039.stdout: } 2024-09-12T02:49:14.418 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-09-12T02:49:14.418 INFO:teuthology.orchestra.run.smithi039.stdout: { 2024-09-12T02:49:14.418 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "iostat", 2024-09-12T02:49:14.418 INFO:teuthology.orchestra.run.smithi039.stdout: "can_run": true, 2024-09-12T02:49:14.418 INFO:teuthology.orchestra.run.smithi039.stdout: "error_string": "", 2024-09-12T02:49:14.418 INFO:teuthology.orchestra.run.smithi039.stdout: "module_options": { 2024-09-12T02:49:14.418 INFO:teuthology.orchestra.run.smithi039.stdout: "log_level": { 2024-09-12T02:49:14.418 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "log_level", 2024-09-12T02:49:14.418 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "str", 2024-09-12T02:49:14.418 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "advanced", 2024-09-12T02:49:14.418 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 1, 2024-09-12T02:49:14.418 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "", 2024-09-12T02:49:14.418 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-09-12T02:49:14.419 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-09-12T02:49:14.419 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [ 2024-09-12T02:49:14.419 INFO:teuthology.orchestra.run.smithi039.stdout: "", 2024-09-12T02:49:14.419 INFO:teuthology.orchestra.run.smithi039.stdout: "critical", 2024-09-12T02:49:14.419 INFO:teuthology.orchestra.run.smithi039.stdout: "debug", 2024-09-12T02:49:14.419 INFO:teuthology.orchestra.run.smithi039.stdout: "error", 2024-09-12T02:49:14.419 INFO:teuthology.orchestra.run.smithi039.stdout: "info", 2024-09-12T02:49:14.419 INFO:teuthology.orchestra.run.smithi039.stdout: "warning" 2024-09-12T02:49:14.419 INFO:teuthology.orchestra.run.smithi039.stdout: ], 2024-09-12T02:49:14.419 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "", 2024-09-12T02:49:14.419 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-09-12T02:49:14.419 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-09-12T02:49:14.419 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-09-12T02:49:14.419 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-09-12T02:49:14.420 INFO:teuthology.orchestra.run.smithi039.stdout: "log_to_cluster": { 2024-09-12T02:49:14.420 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "log_to_cluster", 2024-09-12T02:49:14.420 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "bool", 2024-09-12T02:49:14.420 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "advanced", 2024-09-12T02:49:14.420 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 1, 2024-09-12T02:49:14.420 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "False", 2024-09-12T02:49:14.420 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-09-12T02:49:14.420 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-09-12T02:49:14.420 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [], 2024-09-12T02:49:14.420 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "", 2024-09-12T02:49:14.420 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-09-12T02:49:14.420 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-09-12T02:49:14.420 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-09-12T02:49:14.420 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-09-12T02:49:14.421 INFO:teuthology.orchestra.run.smithi039.stdout: "log_to_cluster_level": { 2024-09-12T02:49:14.421 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "log_to_cluster_level", 2024-09-12T02:49:14.421 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "str", 2024-09-12T02:49:14.421 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "advanced", 2024-09-12T02:49:14.421 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 1, 2024-09-12T02:49:14.421 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "info", 2024-09-12T02:49:14.421 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-09-12T02:49:14.421 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-09-12T02:49:14.421 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [ 2024-09-12T02:49:14.421 INFO:teuthology.orchestra.run.smithi039.stdout: "", 2024-09-12T02:49:14.421 INFO:teuthology.orchestra.run.smithi039.stdout: "critical", 2024-09-12T02:49:14.421 INFO:teuthology.orchestra.run.smithi039.stdout: "debug", 2024-09-12T02:49:14.421 INFO:teuthology.orchestra.run.smithi039.stdout: "error", 2024-09-12T02:49:14.421 INFO:teuthology.orchestra.run.smithi039.stdout: "info", 2024-09-12T02:49:14.422 INFO:teuthology.orchestra.run.smithi039.stdout: "warning" 2024-09-12T02:49:14.422 INFO:teuthology.orchestra.run.smithi039.stdout: ], 2024-09-12T02:49:14.422 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "", 2024-09-12T02:49:14.422 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-09-12T02:49:14.422 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-09-12T02:49:14.422 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-09-12T02:49:14.422 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-09-12T02:49:14.422 INFO:teuthology.orchestra.run.smithi039.stdout: "log_to_file": { 2024-09-12T02:49:14.422 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "log_to_file", 2024-09-12T02:49:14.422 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "bool", 2024-09-12T02:49:14.422 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "advanced", 2024-09-12T02:49:14.422 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 1, 2024-09-12T02:49:14.422 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "False", 2024-09-12T02:49:14.422 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-09-12T02:49:14.423 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-09-12T02:49:14.423 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [], 2024-09-12T02:49:14.423 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "", 2024-09-12T02:49:14.423 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-09-12T02:49:14.423 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-09-12T02:49:14.423 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-09-12T02:49:14.423 INFO:teuthology.orchestra.run.smithi039.stdout: } 2024-09-12T02:49:14.423 INFO:teuthology.orchestra.run.smithi039.stdout: } 2024-09-12T02:49:14.423 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-09-12T02:49:14.423 INFO:teuthology.orchestra.run.smithi039.stdout: { 2024-09-12T02:49:14.423 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "k8sevents", 2024-09-12T02:49:14.423 INFO:teuthology.orchestra.run.smithi039.stdout: "can_run": true, 2024-09-12T02:49:14.423 INFO:teuthology.orchestra.run.smithi039.stdout: "error_string": "", 2024-09-12T02:49:14.423 INFO:teuthology.orchestra.run.smithi039.stdout: "module_options": { 2024-09-12T02:49:14.423 INFO:teuthology.orchestra.run.smithi039.stdout: "ceph_event_retention_days": { 2024-09-12T02:49:14.424 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "ceph_event_retention_days", 2024-09-12T02:49:14.424 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "int", 2024-09-12T02:49:14.424 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "advanced", 2024-09-12T02:49:14.424 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 0, 2024-09-12T02:49:14.424 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "7", 2024-09-12T02:49:14.424 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-09-12T02:49:14.424 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-09-12T02:49:14.424 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [], 2024-09-12T02:49:14.424 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "Days to hold ceph event information within local cache", 2024-09-12T02:49:14.424 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-09-12T02:49:14.424 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-09-12T02:49:14.424 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-09-12T02:49:14.424 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-09-12T02:49:14.425 INFO:teuthology.orchestra.run.smithi039.stdout: "config_check_secs": { 2024-09-12T02:49:14.425 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "config_check_secs", 2024-09-12T02:49:14.425 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "int", 2024-09-12T02:49:14.425 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "advanced", 2024-09-12T02:49:14.425 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 0, 2024-09-12T02:49:14.425 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "10", 2024-09-12T02:49:14.425 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "10", 2024-09-12T02:49:14.425 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-09-12T02:49:14.425 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [], 2024-09-12T02:49:14.425 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "interval (secs) to check for cluster configuration changes", 2024-09-12T02:49:14.425 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-09-12T02:49:14.425 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-09-12T02:49:14.425 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-09-12T02:49:14.426 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-09-12T02:49:14.426 INFO:teuthology.orchestra.run.smithi039.stdout: "log_level": { 2024-09-12T02:49:14.426 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "log_level", 2024-09-12T02:49:14.426 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "str", 2024-09-12T02:49:14.426 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "advanced", 2024-09-12T02:49:14.426 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 1, 2024-09-12T02:49:14.426 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "", 2024-09-12T02:49:14.426 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-09-12T02:49:14.426 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-09-12T02:49:14.426 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [ 2024-09-12T02:49:14.426 INFO:teuthology.orchestra.run.smithi039.stdout: "", 2024-09-12T02:49:14.426 INFO:teuthology.orchestra.run.smithi039.stdout: "critical", 2024-09-12T02:49:14.426 INFO:teuthology.orchestra.run.smithi039.stdout: "debug", 2024-09-12T02:49:14.427 INFO:teuthology.orchestra.run.smithi039.stdout: "error", 2024-09-12T02:49:14.427 INFO:teuthology.orchestra.run.smithi039.stdout: "info", 2024-09-12T02:49:14.427 INFO:teuthology.orchestra.run.smithi039.stdout: "warning" 2024-09-12T02:49:14.427 INFO:teuthology.orchestra.run.smithi039.stdout: ], 2024-09-12T02:49:14.427 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "", 2024-09-12T02:49:14.427 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-09-12T02:49:14.427 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-09-12T02:49:14.427 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-09-12T02:49:14.427 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-09-12T02:49:14.427 INFO:teuthology.orchestra.run.smithi039.stdout: "log_to_cluster": { 2024-09-12T02:49:14.427 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "log_to_cluster", 2024-09-12T02:49:14.427 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "bool", 2024-09-12T02:49:14.427 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "advanced", 2024-09-12T02:49:14.427 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 1, 2024-09-12T02:49:14.428 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "False", 2024-09-12T02:49:14.428 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-09-12T02:49:14.428 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-09-12T02:49:14.428 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [], 2024-09-12T02:49:14.428 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "", 2024-09-12T02:49:14.428 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-09-12T02:49:14.428 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-09-12T02:49:14.428 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-09-12T02:49:14.428 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-09-12T02:49:14.428 INFO:teuthology.orchestra.run.smithi039.stdout: "log_to_cluster_level": { 2024-09-12T02:49:14.428 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "log_to_cluster_level", 2024-09-12T02:49:14.428 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "str", 2024-09-12T02:49:14.428 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "advanced", 2024-09-12T02:49:14.429 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 1, 2024-09-12T02:49:14.429 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "info", 2024-09-12T02:49:14.429 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-09-12T02:49:14.429 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-09-12T02:49:14.429 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [ 2024-09-12T02:49:14.429 INFO:teuthology.orchestra.run.smithi039.stdout: "", 2024-09-12T02:49:14.429 INFO:teuthology.orchestra.run.smithi039.stdout: "critical", 2024-09-12T02:49:14.429 INFO:teuthology.orchestra.run.smithi039.stdout: "debug", 2024-09-12T02:49:14.429 INFO:teuthology.orchestra.run.smithi039.stdout: "error", 2024-09-12T02:49:14.429 INFO:teuthology.orchestra.run.smithi039.stdout: "info", 2024-09-12T02:49:14.429 INFO:teuthology.orchestra.run.smithi039.stdout: "warning" 2024-09-12T02:49:14.429 INFO:teuthology.orchestra.run.smithi039.stdout: ], 2024-09-12T02:49:14.429 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "", 2024-09-12T02:49:14.429 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-09-12T02:49:14.430 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-09-12T02:49:14.430 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-09-12T02:49:14.430 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-09-12T02:49:14.430 INFO:teuthology.orchestra.run.smithi039.stdout: "log_to_file": { 2024-09-12T02:49:14.430 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "log_to_file", 2024-09-12T02:49:14.430 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "bool", 2024-09-12T02:49:14.430 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "advanced", 2024-09-12T02:49:14.430 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 1, 2024-09-12T02:49:14.430 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "False", 2024-09-12T02:49:14.430 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-09-12T02:49:14.430 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-09-12T02:49:14.430 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [], 2024-09-12T02:49:14.430 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "", 2024-09-12T02:49:14.430 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-09-12T02:49:14.431 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-09-12T02:49:14.431 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-09-12T02:49:14.431 INFO:teuthology.orchestra.run.smithi039.stdout: } 2024-09-12T02:49:14.431 INFO:teuthology.orchestra.run.smithi039.stdout: } 2024-09-12T02:49:14.431 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-09-12T02:49:14.431 INFO:teuthology.orchestra.run.smithi039.stdout: { 2024-09-12T02:49:14.431 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "localpool", 2024-09-12T02:49:14.431 INFO:teuthology.orchestra.run.smithi039.stdout: "can_run": true, 2024-09-12T02:49:14.431 INFO:teuthology.orchestra.run.smithi039.stdout: "error_string": "", 2024-09-12T02:49:14.431 INFO:teuthology.orchestra.run.smithi039.stdout: "module_options": { 2024-09-12T02:49:14.431 INFO:teuthology.orchestra.run.smithi039.stdout: "failure_domain": { 2024-09-12T02:49:14.431 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "failure_domain", 2024-09-12T02:49:14.431 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "str", 2024-09-12T02:49:14.432 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "advanced", 2024-09-12T02:49:14.432 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 1, 2024-09-12T02:49:14.432 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "host", 2024-09-12T02:49:14.432 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-09-12T02:49:14.432 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-09-12T02:49:14.432 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [], 2024-09-12T02:49:14.432 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "failure domain for any created local pool", 2024-09-12T02:49:14.432 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "what failure domain we should separate data replicas across.", 2024-09-12T02:49:14.432 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-09-12T02:49:14.432 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-09-12T02:49:14.432 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-09-12T02:49:14.432 INFO:teuthology.orchestra.run.smithi039.stdout: "log_level": { 2024-09-12T02:49:14.432 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "log_level", 2024-09-12T02:49:14.432 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "str", 2024-09-12T02:49:14.433 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "advanced", 2024-09-12T02:49:14.433 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 1, 2024-09-12T02:49:14.433 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "", 2024-09-12T02:49:14.433 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-09-12T02:49:14.433 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-09-12T02:49:14.433 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [ 2024-09-12T02:49:14.433 INFO:teuthology.orchestra.run.smithi039.stdout: "", 2024-09-12T02:49:14.433 INFO:teuthology.orchestra.run.smithi039.stdout: "critical", 2024-09-12T02:49:14.433 INFO:teuthology.orchestra.run.smithi039.stdout: "debug", 2024-09-12T02:49:14.433 INFO:teuthology.orchestra.run.smithi039.stdout: "error", 2024-09-12T02:49:14.433 INFO:teuthology.orchestra.run.smithi039.stdout: "info", 2024-09-12T02:49:14.433 INFO:teuthology.orchestra.run.smithi039.stdout: "warning" 2024-09-12T02:49:14.433 INFO:teuthology.orchestra.run.smithi039.stdout: ], 2024-09-12T02:49:14.433 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "", 2024-09-12T02:49:14.434 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-09-12T02:49:14.434 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-09-12T02:49:14.434 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-09-12T02:49:14.434 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-09-12T02:49:14.434 INFO:teuthology.orchestra.run.smithi039.stdout: "log_to_cluster": { 2024-09-12T02:49:14.434 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "log_to_cluster", 2024-09-12T02:49:14.434 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "bool", 2024-09-12T02:49:14.434 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "advanced", 2024-09-12T02:49:14.434 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 1, 2024-09-12T02:49:14.434 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "False", 2024-09-12T02:49:14.434 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-09-12T02:49:14.434 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-09-12T02:49:14.434 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [], 2024-09-12T02:49:14.434 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "", 2024-09-12T02:49:14.435 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-09-12T02:49:14.435 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-09-12T02:49:14.435 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-09-12T02:49:14.435 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-09-12T02:49:14.435 INFO:teuthology.orchestra.run.smithi039.stdout: "log_to_cluster_level": { 2024-09-12T02:49:14.435 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "log_to_cluster_level", 2024-09-12T02:49:14.435 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "str", 2024-09-12T02:49:14.435 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "advanced", 2024-09-12T02:49:14.435 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 1, 2024-09-12T02:49:14.435 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "info", 2024-09-12T02:49:14.435 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-09-12T02:49:14.435 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-09-12T02:49:14.435 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [ 2024-09-12T02:49:14.435 INFO:teuthology.orchestra.run.smithi039.stdout: "", 2024-09-12T02:49:14.436 INFO:teuthology.orchestra.run.smithi039.stdout: "critical", 2024-09-12T02:49:14.436 INFO:teuthology.orchestra.run.smithi039.stdout: "debug", 2024-09-12T02:49:14.436 INFO:teuthology.orchestra.run.smithi039.stdout: "error", 2024-09-12T02:49:14.436 INFO:teuthology.orchestra.run.smithi039.stdout: "info", 2024-09-12T02:49:14.436 INFO:teuthology.orchestra.run.smithi039.stdout: "warning" 2024-09-12T02:49:14.436 INFO:teuthology.orchestra.run.smithi039.stdout: ], 2024-09-12T02:49:14.436 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "", 2024-09-12T02:49:14.436 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-09-12T02:49:14.436 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-09-12T02:49:14.436 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-09-12T02:49:14.436 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-09-12T02:49:14.436 INFO:teuthology.orchestra.run.smithi039.stdout: "log_to_file": { 2024-09-12T02:49:14.436 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "log_to_file", 2024-09-12T02:49:14.436 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "bool", 2024-09-12T02:49:14.437 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "advanced", 2024-09-12T02:49:14.437 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 1, 2024-09-12T02:49:14.437 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "False", 2024-09-12T02:49:14.437 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-09-12T02:49:14.437 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-09-12T02:49:14.437 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [], 2024-09-12T02:49:14.437 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "", 2024-09-12T02:49:14.437 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-09-12T02:49:14.437 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-09-12T02:49:14.437 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-09-12T02:49:14.437 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-09-12T02:49:14.437 INFO:teuthology.orchestra.run.smithi039.stdout: "min_size": { 2024-09-12T02:49:14.437 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "min_size", 2024-09-12T02:49:14.437 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "int", 2024-09-12T02:49:14.438 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "advanced", 2024-09-12T02:49:14.438 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 1, 2024-09-12T02:49:14.438 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "", 2024-09-12T02:49:14.438 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-09-12T02:49:14.438 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-09-12T02:49:14.438 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [], 2024-09-12T02:49:14.438 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "default min_size for any created local pool", 2024-09-12T02:49:14.438 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "value to set min_size to (unchanged from Ceph's default if this option is not set)", 2024-09-12T02:49:14.438 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-09-12T02:49:14.438 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-09-12T02:49:14.438 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-09-12T02:49:14.438 INFO:teuthology.orchestra.run.smithi039.stdout: "num_rep": { 2024-09-12T02:49:14.438 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "num_rep", 2024-09-12T02:49:14.438 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "int", 2024-09-12T02:49:14.439 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "advanced", 2024-09-12T02:49:14.439 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 1, 2024-09-12T02:49:14.439 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "3", 2024-09-12T02:49:14.439 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-09-12T02:49:14.439 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-09-12T02:49:14.439 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [], 2024-09-12T02:49:14.439 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "default replica count for any created local pool", 2024-09-12T02:49:14.439 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-09-12T02:49:14.439 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-09-12T02:49:14.439 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-09-12T02:49:14.439 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-09-12T02:49:14.439 INFO:teuthology.orchestra.run.smithi039.stdout: "pg_num": { 2024-09-12T02:49:14.440 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "pg_num", 2024-09-12T02:49:14.440 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "int", 2024-09-12T02:49:14.440 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "advanced", 2024-09-12T02:49:14.440 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 1, 2024-09-12T02:49:14.440 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "128", 2024-09-12T02:49:14.440 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-09-12T02:49:14.440 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-09-12T02:49:14.440 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [], 2024-09-12T02:49:14.440 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "default pg_num for any created local pool", 2024-09-12T02:49:14.440 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-09-12T02:49:14.440 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-09-12T02:49:14.440 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-09-12T02:49:14.440 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-09-12T02:49:14.441 INFO:teuthology.orchestra.run.smithi039.stdout: "prefix": { 2024-09-12T02:49:14.441 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "prefix", 2024-09-12T02:49:14.441 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "str", 2024-09-12T02:49:14.441 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "advanced", 2024-09-12T02:49:14.441 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 1, 2024-09-12T02:49:14.441 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "", 2024-09-12T02:49:14.441 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-09-12T02:49:14.441 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-09-12T02:49:14.441 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [], 2024-09-12T02:49:14.441 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "name prefix for any created local pool", 2024-09-12T02:49:14.441 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-09-12T02:49:14.441 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-09-12T02:49:14.441 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-09-12T02:49:14.442 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-09-12T02:49:14.442 INFO:teuthology.orchestra.run.smithi039.stdout: "subtree": { 2024-09-12T02:49:14.442 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "subtree", 2024-09-12T02:49:14.442 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "str", 2024-09-12T02:49:14.442 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "advanced", 2024-09-12T02:49:14.442 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 1, 2024-09-12T02:49:14.442 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "rack", 2024-09-12T02:49:14.442 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-09-12T02:49:14.442 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-09-12T02:49:14.442 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [], 2024-09-12T02:49:14.442 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "CRUSH level for which to create a local pool", 2024-09-12T02:49:14.442 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "which CRUSH subtree type the module should create a pool for.", 2024-09-12T02:49:14.442 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-09-12T02:49:14.443 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-09-12T02:49:14.443 INFO:teuthology.orchestra.run.smithi039.stdout: } 2024-09-12T02:49:14.443 INFO:teuthology.orchestra.run.smithi039.stdout: } 2024-09-12T02:49:14.443 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-09-12T02:49:14.443 INFO:teuthology.orchestra.run.smithi039.stdout: { 2024-09-12T02:49:14.443 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "mds_autoscaler", 2024-09-12T02:49:14.443 INFO:teuthology.orchestra.run.smithi039.stdout: "can_run": true, 2024-09-12T02:49:14.443 INFO:teuthology.orchestra.run.smithi039.stdout: "error_string": "", 2024-09-12T02:49:14.443 INFO:teuthology.orchestra.run.smithi039.stdout: "module_options": { 2024-09-12T02:49:14.443 INFO:teuthology.orchestra.run.smithi039.stdout: "log_level": { 2024-09-12T02:49:14.443 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "log_level", 2024-09-12T02:49:14.443 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "str", 2024-09-12T02:49:14.443 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "advanced", 2024-09-12T02:49:14.443 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 1, 2024-09-12T02:49:14.444 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "", 2024-09-12T02:49:14.444 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-09-12T02:49:14.444 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-09-12T02:49:14.444 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [ 2024-09-12T02:49:14.444 INFO:teuthology.orchestra.run.smithi039.stdout: "", 2024-09-12T02:49:14.444 INFO:teuthology.orchestra.run.smithi039.stdout: "critical", 2024-09-12T02:49:14.444 INFO:teuthology.orchestra.run.smithi039.stdout: "debug", 2024-09-12T02:49:14.444 INFO:teuthology.orchestra.run.smithi039.stdout: "error", 2024-09-12T02:49:14.444 INFO:teuthology.orchestra.run.smithi039.stdout: "info", 2024-09-12T02:49:14.444 INFO:teuthology.orchestra.run.smithi039.stdout: "warning" 2024-09-12T02:49:14.444 INFO:teuthology.orchestra.run.smithi039.stdout: ], 2024-09-12T02:49:14.444 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "", 2024-09-12T02:49:14.444 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-09-12T02:49:14.445 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-09-12T02:49:14.445 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-09-12T02:49:14.445 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-09-12T02:49:14.445 INFO:teuthology.orchestra.run.smithi039.stdout: "log_to_cluster": { 2024-09-12T02:49:14.445 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "log_to_cluster", 2024-09-12T02:49:14.445 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "bool", 2024-09-12T02:49:14.445 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "advanced", 2024-09-12T02:49:14.445 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 1, 2024-09-12T02:49:14.445 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "False", 2024-09-12T02:49:14.445 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-09-12T02:49:14.445 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-09-12T02:49:14.445 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [], 2024-09-12T02:49:14.445 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "", 2024-09-12T02:49:14.445 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-09-12T02:49:14.446 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-09-12T02:49:14.446 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-09-12T02:49:14.446 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-09-12T02:49:14.446 INFO:teuthology.orchestra.run.smithi039.stdout: "log_to_cluster_level": { 2024-09-12T02:49:14.446 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "log_to_cluster_level", 2024-09-12T02:49:14.446 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "str", 2024-09-12T02:49:14.446 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "advanced", 2024-09-12T02:49:14.446 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 1, 2024-09-12T02:49:14.446 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "info", 2024-09-12T02:49:14.446 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-09-12T02:49:14.446 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-09-12T02:49:14.446 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [ 2024-09-12T02:49:14.446 INFO:teuthology.orchestra.run.smithi039.stdout: "", 2024-09-12T02:49:14.446 INFO:teuthology.orchestra.run.smithi039.stdout: "critical", 2024-09-12T02:49:14.447 INFO:teuthology.orchestra.run.smithi039.stdout: "debug", 2024-09-12T02:49:14.447 INFO:teuthology.orchestra.run.smithi039.stdout: "error", 2024-09-12T02:49:14.447 INFO:teuthology.orchestra.run.smithi039.stdout: "info", 2024-09-12T02:49:14.447 INFO:teuthology.orchestra.run.smithi039.stdout: "warning" 2024-09-12T02:49:14.447 INFO:teuthology.orchestra.run.smithi039.stdout: ], 2024-09-12T02:49:14.447 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "", 2024-09-12T02:49:14.447 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-09-12T02:49:14.447 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-09-12T02:49:14.447 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-09-12T02:49:14.447 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-09-12T02:49:14.447 INFO:teuthology.orchestra.run.smithi039.stdout: "log_to_file": { 2024-09-12T02:49:14.447 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "log_to_file", 2024-09-12T02:49:14.447 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "bool", 2024-09-12T02:49:14.447 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "advanced", 2024-09-12T02:49:14.448 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 1, 2024-09-12T02:49:14.448 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "False", 2024-09-12T02:49:14.448 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-09-12T02:49:14.448 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-09-12T02:49:14.448 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [], 2024-09-12T02:49:14.448 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "", 2024-09-12T02:49:14.448 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-09-12T02:49:14.448 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-09-12T02:49:14.448 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-09-12T02:49:14.448 INFO:teuthology.orchestra.run.smithi039.stdout: } 2024-09-12T02:49:14.448 INFO:teuthology.orchestra.run.smithi039.stdout: } 2024-09-12T02:49:14.448 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-09-12T02:49:14.448 INFO:teuthology.orchestra.run.smithi039.stdout: { 2024-09-12T02:49:14.448 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "mirroring", 2024-09-12T02:49:14.449 INFO:teuthology.orchestra.run.smithi039.stdout: "can_run": true, 2024-09-12T02:49:14.449 INFO:teuthology.orchestra.run.smithi039.stdout: "error_string": "", 2024-09-12T02:49:14.449 INFO:teuthology.orchestra.run.smithi039.stdout: "module_options": { 2024-09-12T02:49:14.449 INFO:teuthology.orchestra.run.smithi039.stdout: "log_level": { 2024-09-12T02:49:14.449 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "log_level", 2024-09-12T02:49:14.449 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "str", 2024-09-12T02:49:14.449 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "advanced", 2024-09-12T02:49:14.449 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 1, 2024-09-12T02:49:14.449 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "", 2024-09-12T02:49:14.449 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-09-12T02:49:14.449 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-09-12T02:49:14.449 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [ 2024-09-12T02:49:14.449 INFO:teuthology.orchestra.run.smithi039.stdout: "", 2024-09-12T02:49:14.449 INFO:teuthology.orchestra.run.smithi039.stdout: "critical", 2024-09-12T02:49:14.450 INFO:teuthology.orchestra.run.smithi039.stdout: "debug", 2024-09-12T02:49:14.450 INFO:teuthology.orchestra.run.smithi039.stdout: "error", 2024-09-12T02:49:14.450 INFO:teuthology.orchestra.run.smithi039.stdout: "info", 2024-09-12T02:49:14.450 INFO:teuthology.orchestra.run.smithi039.stdout: "warning" 2024-09-12T02:49:14.450 INFO:teuthology.orchestra.run.smithi039.stdout: ], 2024-09-12T02:49:14.450 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "", 2024-09-12T02:49:14.450 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-09-12T02:49:14.450 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-09-12T02:49:14.450 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-09-12T02:49:14.450 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-09-12T02:49:14.450 INFO:teuthology.orchestra.run.smithi039.stdout: "log_to_cluster": { 2024-09-12T02:49:14.450 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "log_to_cluster", 2024-09-12T02:49:14.450 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "bool", 2024-09-12T02:49:14.450 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "advanced", 2024-09-12T02:49:14.451 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 1, 2024-09-12T02:49:14.451 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "False", 2024-09-12T02:49:14.451 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-09-12T02:49:14.451 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-09-12T02:49:14.451 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [], 2024-09-12T02:49:14.451 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "", 2024-09-12T02:49:14.451 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-09-12T02:49:14.451 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-09-12T02:49:14.451 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-09-12T02:49:14.451 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-09-12T02:49:14.451 INFO:teuthology.orchestra.run.smithi039.stdout: "log_to_cluster_level": { 2024-09-12T02:49:14.451 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "log_to_cluster_level", 2024-09-12T02:49:14.451 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "str", 2024-09-12T02:49:14.451 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "advanced", 2024-09-12T02:49:14.452 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 1, 2024-09-12T02:49:14.452 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "info", 2024-09-12T02:49:14.452 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-09-12T02:49:14.452 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-09-12T02:49:14.452 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [ 2024-09-12T02:49:14.452 INFO:teuthology.orchestra.run.smithi039.stdout: "", 2024-09-12T02:49:14.452 INFO:teuthology.orchestra.run.smithi039.stdout: "critical", 2024-09-12T02:49:14.452 INFO:teuthology.orchestra.run.smithi039.stdout: "debug", 2024-09-12T02:49:14.452 INFO:teuthology.orchestra.run.smithi039.stdout: "error", 2024-09-12T02:49:14.452 INFO:teuthology.orchestra.run.smithi039.stdout: "info", 2024-09-12T02:49:14.452 INFO:teuthology.orchestra.run.smithi039.stdout: "warning" 2024-09-12T02:49:14.452 INFO:teuthology.orchestra.run.smithi039.stdout: ], 2024-09-12T02:49:14.452 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "", 2024-09-12T02:49:14.452 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-09-12T02:49:14.453 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-09-12T02:49:14.453 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-09-12T02:49:14.453 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-09-12T02:49:14.453 INFO:teuthology.orchestra.run.smithi039.stdout: "log_to_file": { 2024-09-12T02:49:14.453 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "log_to_file", 2024-09-12T02:49:14.453 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "bool", 2024-09-12T02:49:14.453 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "advanced", 2024-09-12T02:49:14.453 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 1, 2024-09-12T02:49:14.453 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "False", 2024-09-12T02:49:14.453 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-09-12T02:49:14.453 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-09-12T02:49:14.453 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [], 2024-09-12T02:49:14.453 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "", 2024-09-12T02:49:14.454 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-09-12T02:49:14.454 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-09-12T02:49:14.454 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-09-12T02:49:14.454 INFO:teuthology.orchestra.run.smithi039.stdout: } 2024-09-12T02:49:14.454 INFO:teuthology.orchestra.run.smithi039.stdout: } 2024-09-12T02:49:14.454 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-09-12T02:49:14.454 INFO:teuthology.orchestra.run.smithi039.stdout: { 2024-09-12T02:49:14.454 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "nfs", 2024-09-12T02:49:14.454 INFO:teuthology.orchestra.run.smithi039.stdout: "can_run": true, 2024-09-12T02:49:14.454 INFO:teuthology.orchestra.run.smithi039.stdout: "error_string": "", 2024-09-12T02:49:14.454 INFO:teuthology.orchestra.run.smithi039.stdout: "module_options": { 2024-09-12T02:49:14.454 INFO:teuthology.orchestra.run.smithi039.stdout: "log_level": { 2024-09-12T02:49:14.454 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "log_level", 2024-09-12T02:49:14.454 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "str", 2024-09-12T02:49:14.455 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "advanced", 2024-09-12T02:49:14.455 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 1, 2024-09-12T02:49:14.455 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "", 2024-09-12T02:49:14.455 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-09-12T02:49:14.455 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-09-12T02:49:14.455 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [ 2024-09-12T02:49:14.455 INFO:teuthology.orchestra.run.smithi039.stdout: "", 2024-09-12T02:49:14.455 INFO:teuthology.orchestra.run.smithi039.stdout: "critical", 2024-09-12T02:49:14.455 INFO:teuthology.orchestra.run.smithi039.stdout: "debug", 2024-09-12T02:49:14.455 INFO:teuthology.orchestra.run.smithi039.stdout: "error", 2024-09-12T02:49:14.455 INFO:teuthology.orchestra.run.smithi039.stdout: "info", 2024-09-12T02:49:14.455 INFO:teuthology.orchestra.run.smithi039.stdout: "warning" 2024-09-12T02:49:14.455 INFO:teuthology.orchestra.run.smithi039.stdout: ], 2024-09-12T02:49:14.456 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "", 2024-09-12T02:49:14.456 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-09-12T02:49:14.456 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-09-12T02:49:14.456 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-09-12T02:49:14.456 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-09-12T02:49:14.456 INFO:teuthology.orchestra.run.smithi039.stdout: "log_to_cluster": { 2024-09-12T02:49:14.456 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "log_to_cluster", 2024-09-12T02:49:14.456 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "bool", 2024-09-12T02:49:14.456 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "advanced", 2024-09-12T02:49:14.456 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 1, 2024-09-12T02:49:14.456 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "False", 2024-09-12T02:49:14.456 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-09-12T02:49:14.456 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-09-12T02:49:14.457 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [], 2024-09-12T02:49:14.457 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "", 2024-09-12T02:49:14.457 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-09-12T02:49:14.457 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-09-12T02:49:14.457 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-09-12T02:49:14.457 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-09-12T02:49:14.457 INFO:teuthology.orchestra.run.smithi039.stdout: "log_to_cluster_level": { 2024-09-12T02:49:14.457 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "log_to_cluster_level", 2024-09-12T02:49:14.457 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "str", 2024-09-12T02:49:14.457 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "advanced", 2024-09-12T02:49:14.457 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 1, 2024-09-12T02:49:14.457 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "info", 2024-09-12T02:49:14.457 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-09-12T02:49:14.457 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-09-12T02:49:14.458 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [ 2024-09-12T02:49:14.458 INFO:teuthology.orchestra.run.smithi039.stdout: "", 2024-09-12T02:49:14.458 INFO:teuthology.orchestra.run.smithi039.stdout: "critical", 2024-09-12T02:49:14.458 INFO:teuthology.orchestra.run.smithi039.stdout: "debug", 2024-09-12T02:49:14.458 INFO:teuthology.orchestra.run.smithi039.stdout: "error", 2024-09-12T02:49:14.458 INFO:teuthology.orchestra.run.smithi039.stdout: "info", 2024-09-12T02:49:14.458 INFO:teuthology.orchestra.run.smithi039.stdout: "warning" 2024-09-12T02:49:14.458 INFO:teuthology.orchestra.run.smithi039.stdout: ], 2024-09-12T02:49:14.458 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "", 2024-09-12T02:49:14.458 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-09-12T02:49:14.458 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-09-12T02:49:14.458 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-09-12T02:49:14.458 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-09-12T02:49:14.458 INFO:teuthology.orchestra.run.smithi039.stdout: "log_to_file": { 2024-09-12T02:49:14.459 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "log_to_file", 2024-09-12T02:49:14.459 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "bool", 2024-09-12T02:49:14.459 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "advanced", 2024-09-12T02:49:14.459 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 1, 2024-09-12T02:49:14.459 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "False", 2024-09-12T02:49:14.459 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-09-12T02:49:14.459 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-09-12T02:49:14.459 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [], 2024-09-12T02:49:14.459 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "", 2024-09-12T02:49:14.459 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-09-12T02:49:14.459 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-09-12T02:49:14.459 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-09-12T02:49:14.459 INFO:teuthology.orchestra.run.smithi039.stdout: } 2024-09-12T02:49:14.459 INFO:teuthology.orchestra.run.smithi039.stdout: } 2024-09-12T02:49:14.460 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-09-12T02:49:14.460 INFO:teuthology.orchestra.run.smithi039.stdout: { 2024-09-12T02:49:14.460 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "orchestrator", 2024-09-12T02:49:14.460 INFO:teuthology.orchestra.run.smithi039.stdout: "can_run": true, 2024-09-12T02:49:14.460 INFO:teuthology.orchestra.run.smithi039.stdout: "error_string": "", 2024-09-12T02:49:14.460 INFO:teuthology.orchestra.run.smithi039.stdout: "module_options": { 2024-09-12T02:49:14.460 INFO:teuthology.orchestra.run.smithi039.stdout: "fail_fs": { 2024-09-12T02:49:14.460 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "fail_fs", 2024-09-12T02:49:14.460 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "bool", 2024-09-12T02:49:14.460 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "advanced", 2024-09-12T02:49:14.460 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 0, 2024-09-12T02:49:14.460 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "False", 2024-09-12T02:49:14.460 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-09-12T02:49:14.461 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-09-12T02:49:14.461 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [], 2024-09-12T02:49:14.461 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "Fail filesystem for rapid multi-rank mds upgrade", 2024-09-12T02:49:14.461 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-09-12T02:49:14.461 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-09-12T02:49:14.461 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-09-12T02:49:14.461 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-09-12T02:49:14.461 INFO:teuthology.orchestra.run.smithi039.stdout: "log_level": { 2024-09-12T02:49:14.461 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "log_level", 2024-09-12T02:49:14.461 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "str", 2024-09-12T02:49:14.461 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "advanced", 2024-09-12T02:49:14.461 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 1, 2024-09-12T02:49:14.461 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "", 2024-09-12T02:49:14.461 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-09-12T02:49:14.462 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-09-12T02:49:14.462 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [ 2024-09-12T02:49:14.462 INFO:teuthology.orchestra.run.smithi039.stdout: "", 2024-09-12T02:49:14.462 INFO:teuthology.orchestra.run.smithi039.stdout: "critical", 2024-09-12T02:49:14.462 INFO:teuthology.orchestra.run.smithi039.stdout: "debug", 2024-09-12T02:49:14.462 INFO:teuthology.orchestra.run.smithi039.stdout: "error", 2024-09-12T02:49:14.462 INFO:teuthology.orchestra.run.smithi039.stdout: "info", 2024-09-12T02:49:14.462 INFO:teuthology.orchestra.run.smithi039.stdout: "warning" 2024-09-12T02:49:14.462 INFO:teuthology.orchestra.run.smithi039.stdout: ], 2024-09-12T02:49:14.462 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "", 2024-09-12T02:49:14.462 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-09-12T02:49:14.462 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-09-12T02:49:14.462 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-09-12T02:49:14.462 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-09-12T02:49:14.462 INFO:teuthology.orchestra.run.smithi039.stdout: "log_to_cluster": { 2024-09-12T02:49:14.463 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "log_to_cluster", 2024-09-12T02:49:14.463 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "bool", 2024-09-12T02:49:14.463 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "advanced", 2024-09-12T02:49:14.463 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 1, 2024-09-12T02:49:14.463 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "False", 2024-09-12T02:49:14.463 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-09-12T02:49:14.463 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-09-12T02:49:14.463 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [], 2024-09-12T02:49:14.463 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "", 2024-09-12T02:49:14.463 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-09-12T02:49:14.463 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-09-12T02:49:14.463 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-09-12T02:49:14.463 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-09-12T02:49:14.464 INFO:teuthology.orchestra.run.smithi039.stdout: "log_to_cluster_level": { 2024-09-12T02:49:14.464 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "log_to_cluster_level", 2024-09-12T02:49:14.464 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "str", 2024-09-12T02:49:14.464 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "advanced", 2024-09-12T02:49:14.464 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 1, 2024-09-12T02:49:14.464 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "info", 2024-09-12T02:49:14.464 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-09-12T02:49:14.464 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-09-12T02:49:14.464 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [ 2024-09-12T02:49:14.464 INFO:teuthology.orchestra.run.smithi039.stdout: "", 2024-09-12T02:49:14.464 INFO:teuthology.orchestra.run.smithi039.stdout: "critical", 2024-09-12T02:49:14.464 INFO:teuthology.orchestra.run.smithi039.stdout: "debug", 2024-09-12T02:49:14.464 INFO:teuthology.orchestra.run.smithi039.stdout: "error", 2024-09-12T02:49:14.464 INFO:teuthology.orchestra.run.smithi039.stdout: "info", 2024-09-12T02:49:14.465 INFO:teuthology.orchestra.run.smithi039.stdout: "warning" 2024-09-12T02:49:14.465 INFO:teuthology.orchestra.run.smithi039.stdout: ], 2024-09-12T02:49:14.465 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "", 2024-09-12T02:49:14.465 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-09-12T02:49:14.465 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-09-12T02:49:14.465 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-09-12T02:49:14.465 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-09-12T02:49:14.465 INFO:teuthology.orchestra.run.smithi039.stdout: "log_to_file": { 2024-09-12T02:49:14.465 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "log_to_file", 2024-09-12T02:49:14.465 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "bool", 2024-09-12T02:49:14.465 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "advanced", 2024-09-12T02:49:14.465 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 1, 2024-09-12T02:49:14.465 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "False", 2024-09-12T02:49:14.466 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-09-12T02:49:14.466 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-09-12T02:49:14.466 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [], 2024-09-12T02:49:14.466 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "", 2024-09-12T02:49:14.466 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-09-12T02:49:14.466 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-09-12T02:49:14.466 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-09-12T02:49:14.466 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-09-12T02:49:14.466 INFO:teuthology.orchestra.run.smithi039.stdout: "orchestrator": { 2024-09-12T02:49:14.466 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "orchestrator", 2024-09-12T02:49:14.466 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "str", 2024-09-12T02:49:14.466 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "advanced", 2024-09-12T02:49:14.466 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 1, 2024-09-12T02:49:14.466 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "", 2024-09-12T02:49:14.467 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-09-12T02:49:14.467 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-09-12T02:49:14.467 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [ 2024-09-12T02:49:14.467 INFO:teuthology.orchestra.run.smithi039.stdout: "cephadm", 2024-09-12T02:49:14.467 INFO:teuthology.orchestra.run.smithi039.stdout: "rook", 2024-09-12T02:49:14.467 INFO:teuthology.orchestra.run.smithi039.stdout: "test_orchestrator" 2024-09-12T02:49:14.467 INFO:teuthology.orchestra.run.smithi039.stdout: ], 2024-09-12T02:49:14.467 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "Orchestrator backend", 2024-09-12T02:49:14.467 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-09-12T02:49:14.467 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-09-12T02:49:14.467 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-09-12T02:49:14.467 INFO:teuthology.orchestra.run.smithi039.stdout: } 2024-09-12T02:49:14.467 INFO:teuthology.orchestra.run.smithi039.stdout: } 2024-09-12T02:49:14.468 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-09-12T02:49:14.468 INFO:teuthology.orchestra.run.smithi039.stdout: { 2024-09-12T02:49:14.468 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "osd_perf_query", 2024-09-12T02:49:14.468 INFO:teuthology.orchestra.run.smithi039.stdout: "can_run": true, 2024-09-12T02:49:14.468 INFO:teuthology.orchestra.run.smithi039.stdout: "error_string": "", 2024-09-12T02:49:14.468 INFO:teuthology.orchestra.run.smithi039.stdout: "module_options": { 2024-09-12T02:49:14.468 INFO:teuthology.orchestra.run.smithi039.stdout: "log_level": { 2024-09-12T02:49:14.468 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "log_level", 2024-09-12T02:49:14.468 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "str", 2024-09-12T02:49:14.468 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "advanced", 2024-09-12T02:49:14.468 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 1, 2024-09-12T02:49:14.468 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "", 2024-09-12T02:49:14.469 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-09-12T02:49:14.469 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-09-12T02:49:14.469 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [ 2024-09-12T02:49:14.469 INFO:teuthology.orchestra.run.smithi039.stdout: "", 2024-09-12T02:49:14.469 INFO:teuthology.orchestra.run.smithi039.stdout: "critical", 2024-09-12T02:49:14.469 INFO:teuthology.orchestra.run.smithi039.stdout: "debug", 2024-09-12T02:49:14.469 INFO:teuthology.orchestra.run.smithi039.stdout: "error", 2024-09-12T02:49:14.469 INFO:teuthology.orchestra.run.smithi039.stdout: "info", 2024-09-12T02:49:14.469 INFO:teuthology.orchestra.run.smithi039.stdout: "warning" 2024-09-12T02:49:14.469 INFO:teuthology.orchestra.run.smithi039.stdout: ], 2024-09-12T02:49:14.469 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "", 2024-09-12T02:49:14.469 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-09-12T02:49:14.469 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-09-12T02:49:14.469 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-09-12T02:49:14.470 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-09-12T02:49:14.470 INFO:teuthology.orchestra.run.smithi039.stdout: "log_to_cluster": { 2024-09-12T02:49:14.470 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "log_to_cluster", 2024-09-12T02:49:14.470 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "bool", 2024-09-12T02:49:14.470 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "advanced", 2024-09-12T02:49:14.470 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 1, 2024-09-12T02:49:14.470 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "False", 2024-09-12T02:49:14.470 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-09-12T02:49:14.470 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-09-12T02:49:14.470 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [], 2024-09-12T02:49:14.470 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "", 2024-09-12T02:49:14.470 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-09-12T02:49:14.470 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-09-12T02:49:14.470 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-09-12T02:49:14.471 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-09-12T02:49:14.471 INFO:teuthology.orchestra.run.smithi039.stdout: "log_to_cluster_level": { 2024-09-12T02:49:14.471 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "log_to_cluster_level", 2024-09-12T02:49:14.471 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "str", 2024-09-12T02:49:14.471 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "advanced", 2024-09-12T02:49:14.471 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 1, 2024-09-12T02:49:14.471 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "info", 2024-09-12T02:49:14.471 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-09-12T02:49:14.471 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-09-12T02:49:14.471 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [ 2024-09-12T02:49:14.471 INFO:teuthology.orchestra.run.smithi039.stdout: "", 2024-09-12T02:49:14.471 INFO:teuthology.orchestra.run.smithi039.stdout: "critical", 2024-09-12T02:49:14.471 INFO:teuthology.orchestra.run.smithi039.stdout: "debug", 2024-09-12T02:49:14.471 INFO:teuthology.orchestra.run.smithi039.stdout: "error", 2024-09-12T02:49:14.472 INFO:teuthology.orchestra.run.smithi039.stdout: "info", 2024-09-12T02:49:14.472 INFO:teuthology.orchestra.run.smithi039.stdout: "warning" 2024-09-12T02:49:14.472 INFO:teuthology.orchestra.run.smithi039.stdout: ], 2024-09-12T02:49:14.472 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "", 2024-09-12T02:49:14.472 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-09-12T02:49:14.472 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-09-12T02:49:14.472 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-09-12T02:49:14.472 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-09-12T02:49:14.472 INFO:teuthology.orchestra.run.smithi039.stdout: "log_to_file": { 2024-09-12T02:49:14.473 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "log_to_file", 2024-09-12T02:49:14.473 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "bool", 2024-09-12T02:49:14.473 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "advanced", 2024-09-12T02:49:14.473 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 1, 2024-09-12T02:49:14.473 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "False", 2024-09-12T02:49:14.473 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-09-12T02:49:14.477 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-09-12T02:49:14.477 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [], 2024-09-12T02:49:14.477 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "", 2024-09-12T02:49:14.477 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-09-12T02:49:14.477 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-09-12T02:49:14.477 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-09-12T02:49:14.477 INFO:teuthology.orchestra.run.smithi039.stdout: } 2024-09-12T02:49:14.478 INFO:teuthology.orchestra.run.smithi039.stdout: } 2024-09-12T02:49:14.478 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-09-12T02:49:14.478 INFO:teuthology.orchestra.run.smithi039.stdout: { 2024-09-12T02:49:14.478 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "osd_support", 2024-09-12T02:49:14.478 INFO:teuthology.orchestra.run.smithi039.stdout: "can_run": true, 2024-09-12T02:49:14.478 INFO:teuthology.orchestra.run.smithi039.stdout: "error_string": "", 2024-09-12T02:49:14.478 INFO:teuthology.orchestra.run.smithi039.stdout: "module_options": { 2024-09-12T02:49:14.478 INFO:teuthology.orchestra.run.smithi039.stdout: "log_level": { 2024-09-12T02:49:14.478 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "log_level", 2024-09-12T02:49:14.478 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "str", 2024-09-12T02:49:14.478 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "advanced", 2024-09-12T02:49:14.478 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 1, 2024-09-12T02:49:14.478 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "", 2024-09-12T02:49:14.479 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-09-12T02:49:14.479 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-09-12T02:49:14.479 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [ 2024-09-12T02:49:14.479 INFO:teuthology.orchestra.run.smithi039.stdout: "", 2024-09-12T02:49:14.479 INFO:teuthology.orchestra.run.smithi039.stdout: "critical", 2024-09-12T02:49:14.479 INFO:teuthology.orchestra.run.smithi039.stdout: "debug", 2024-09-12T02:49:14.479 INFO:teuthology.orchestra.run.smithi039.stdout: "error", 2024-09-12T02:49:14.479 INFO:teuthology.orchestra.run.smithi039.stdout: "info", 2024-09-12T02:49:14.479 INFO:teuthology.orchestra.run.smithi039.stdout: "warning" 2024-09-12T02:49:14.479 INFO:teuthology.orchestra.run.smithi039.stdout: ], 2024-09-12T02:49:14.479 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "", 2024-09-12T02:49:14.479 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-09-12T02:49:14.479 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-09-12T02:49:14.480 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-09-12T02:49:14.480 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-09-12T02:49:14.480 INFO:teuthology.orchestra.run.smithi039.stdout: "log_to_cluster": { 2024-09-12T02:49:14.480 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "log_to_cluster", 2024-09-12T02:49:14.480 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "bool", 2024-09-12T02:49:14.480 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "advanced", 2024-09-12T02:49:14.480 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 1, 2024-09-12T02:49:14.480 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "False", 2024-09-12T02:49:14.480 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-09-12T02:49:14.480 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-09-12T02:49:14.480 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [], 2024-09-12T02:49:14.480 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "", 2024-09-12T02:49:14.480 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-09-12T02:49:14.480 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-09-12T02:49:14.481 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-09-12T02:49:14.481 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-09-12T02:49:14.481 INFO:teuthology.orchestra.run.smithi039.stdout: "log_to_cluster_level": { 2024-09-12T02:49:14.481 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "log_to_cluster_level", 2024-09-12T02:49:14.481 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "str", 2024-09-12T02:49:14.481 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "advanced", 2024-09-12T02:49:14.481 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 1, 2024-09-12T02:49:14.481 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "info", 2024-09-12T02:49:14.481 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-09-12T02:49:14.481 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-09-12T02:49:14.481 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [ 2024-09-12T02:49:14.481 INFO:teuthology.orchestra.run.smithi039.stdout: "", 2024-09-12T02:49:14.481 INFO:teuthology.orchestra.run.smithi039.stdout: "critical", 2024-09-12T02:49:14.482 INFO:teuthology.orchestra.run.smithi039.stdout: "debug", 2024-09-12T02:49:14.482 INFO:teuthology.orchestra.run.smithi039.stdout: "error", 2024-09-12T02:49:14.482 INFO:teuthology.orchestra.run.smithi039.stdout: "info", 2024-09-12T02:49:14.482 INFO:teuthology.orchestra.run.smithi039.stdout: "warning" 2024-09-12T02:49:14.482 INFO:teuthology.orchestra.run.smithi039.stdout: ], 2024-09-12T02:49:14.482 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "", 2024-09-12T02:49:14.482 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-09-12T02:49:14.482 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-09-12T02:49:14.482 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-09-12T02:49:14.482 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-09-12T02:49:14.482 INFO:teuthology.orchestra.run.smithi039.stdout: "log_to_file": { 2024-09-12T02:49:14.482 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "log_to_file", 2024-09-12T02:49:14.482 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "bool", 2024-09-12T02:49:14.482 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "advanced", 2024-09-12T02:49:14.483 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 1, 2024-09-12T02:49:14.483 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "False", 2024-09-12T02:49:14.483 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-09-12T02:49:14.483 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-09-12T02:49:14.483 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [], 2024-09-12T02:49:14.483 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "", 2024-09-12T02:49:14.483 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-09-12T02:49:14.483 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-09-12T02:49:14.483 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-09-12T02:49:14.483 INFO:teuthology.orchestra.run.smithi039.stdout: } 2024-09-12T02:49:14.483 INFO:teuthology.orchestra.run.smithi039.stdout: } 2024-09-12T02:49:14.483 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-09-12T02:49:14.483 INFO:teuthology.orchestra.run.smithi039.stdout: { 2024-09-12T02:49:14.483 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "pg_autoscaler", 2024-09-12T02:49:14.484 INFO:teuthology.orchestra.run.smithi039.stdout: "can_run": true, 2024-09-12T02:49:14.484 INFO:teuthology.orchestra.run.smithi039.stdout: "error_string": "", 2024-09-12T02:49:14.484 INFO:teuthology.orchestra.run.smithi039.stdout: "module_options": { 2024-09-12T02:49:14.484 INFO:teuthology.orchestra.run.smithi039.stdout: "log_level": { 2024-09-12T02:49:14.484 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "log_level", 2024-09-12T02:49:14.484 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "str", 2024-09-12T02:49:14.484 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "advanced", 2024-09-12T02:49:14.484 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 1, 2024-09-12T02:49:14.484 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "", 2024-09-12T02:49:14.484 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-09-12T02:49:14.484 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-09-12T02:49:14.484 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [ 2024-09-12T02:49:14.484 INFO:teuthology.orchestra.run.smithi039.stdout: "", 2024-09-12T02:49:14.484 INFO:teuthology.orchestra.run.smithi039.stdout: "critical", 2024-09-12T02:49:14.485 INFO:teuthology.orchestra.run.smithi039.stdout: "debug", 2024-09-12T02:49:14.485 INFO:teuthology.orchestra.run.smithi039.stdout: "error", 2024-09-12T02:49:14.485 INFO:teuthology.orchestra.run.smithi039.stdout: "info", 2024-09-12T02:49:14.485 INFO:teuthology.orchestra.run.smithi039.stdout: "warning" 2024-09-12T02:49:14.485 INFO:teuthology.orchestra.run.smithi039.stdout: ], 2024-09-12T02:49:14.485 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "", 2024-09-12T02:49:14.485 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-09-12T02:49:14.485 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-09-12T02:49:14.485 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-09-12T02:49:14.485 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-09-12T02:49:14.485 INFO:teuthology.orchestra.run.smithi039.stdout: "log_to_cluster": { 2024-09-12T02:49:14.485 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "log_to_cluster", 2024-09-12T02:49:14.485 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "bool", 2024-09-12T02:49:14.485 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "advanced", 2024-09-12T02:49:14.486 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 1, 2024-09-12T02:49:14.486 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "False", 2024-09-12T02:49:14.486 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-09-12T02:49:14.486 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-09-12T02:49:14.486 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [], 2024-09-12T02:49:14.486 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "", 2024-09-12T02:49:14.486 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-09-12T02:49:14.486 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-09-12T02:49:14.486 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-09-12T02:49:14.486 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-09-12T02:49:14.486 INFO:teuthology.orchestra.run.smithi039.stdout: "log_to_cluster_level": { 2024-09-12T02:49:14.486 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "log_to_cluster_level", 2024-09-12T02:49:14.486 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "str", 2024-09-12T02:49:14.487 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "advanced", 2024-09-12T02:49:14.487 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 1, 2024-09-12T02:49:14.487 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "info", 2024-09-12T02:49:14.487 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-09-12T02:49:14.487 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-09-12T02:49:14.487 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [ 2024-09-12T02:49:14.487 INFO:teuthology.orchestra.run.smithi039.stdout: "", 2024-09-12T02:49:14.487 INFO:teuthology.orchestra.run.smithi039.stdout: "critical", 2024-09-12T02:49:14.487 INFO:teuthology.orchestra.run.smithi039.stdout: "debug", 2024-09-12T02:49:14.487 INFO:teuthology.orchestra.run.smithi039.stdout: "error", 2024-09-12T02:49:14.487 INFO:teuthology.orchestra.run.smithi039.stdout: "info", 2024-09-12T02:49:14.487 INFO:teuthology.orchestra.run.smithi039.stdout: "warning" 2024-09-12T02:49:14.488 INFO:teuthology.orchestra.run.smithi039.stdout: ], 2024-09-12T02:49:14.488 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "", 2024-09-12T02:49:14.488 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-09-12T02:49:14.488 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-09-12T02:49:14.488 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-09-12T02:49:14.488 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-09-12T02:49:14.488 INFO:teuthology.orchestra.run.smithi039.stdout: "log_to_file": { 2024-09-12T02:49:14.488 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "log_to_file", 2024-09-12T02:49:14.488 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "bool", 2024-09-12T02:49:14.488 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "advanced", 2024-09-12T02:49:14.488 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 1, 2024-09-12T02:49:14.488 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "False", 2024-09-12T02:49:14.488 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-09-12T02:49:14.489 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-09-12T02:49:14.489 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [], 2024-09-12T02:49:14.489 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "", 2024-09-12T02:49:14.489 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-09-12T02:49:14.489 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-09-12T02:49:14.489 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-09-12T02:49:14.489 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-09-12T02:49:14.489 INFO:teuthology.orchestra.run.smithi039.stdout: "sleep_interval": { 2024-09-12T02:49:14.489 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "sleep_interval", 2024-09-12T02:49:14.489 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "secs", 2024-09-12T02:49:14.489 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "advanced", 2024-09-12T02:49:14.489 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 0, 2024-09-12T02:49:14.489 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "60", 2024-09-12T02:49:14.490 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-09-12T02:49:14.490 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-09-12T02:49:14.490 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [], 2024-09-12T02:49:14.490 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "", 2024-09-12T02:49:14.490 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-09-12T02:49:14.490 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-09-12T02:49:14.490 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-09-12T02:49:14.490 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-09-12T02:49:14.490 INFO:teuthology.orchestra.run.smithi039.stdout: "threshold": { 2024-09-12T02:49:14.490 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "threshold", 2024-09-12T02:49:14.490 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "float", 2024-09-12T02:49:14.490 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "advanced", 2024-09-12T02:49:14.490 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 0, 2024-09-12T02:49:14.491 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "3.0", 2024-09-12T02:49:14.491 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "1.0", 2024-09-12T02:49:14.491 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-09-12T02:49:14.491 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [], 2024-09-12T02:49:14.491 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "scaling threshold", 2024-09-12T02:49:14.491 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "The factor by which the `NEW PG_NUM` must vary from the current`PG_NUM` before being accepted. Cannot be less than 1.0", 2024-09-12T02:49:14.491 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-09-12T02:49:14.491 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-09-12T02:49:14.491 INFO:teuthology.orchestra.run.smithi039.stdout: } 2024-09-12T02:49:14.491 INFO:teuthology.orchestra.run.smithi039.stdout: } 2024-09-12T02:49:14.491 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-09-12T02:49:14.491 INFO:teuthology.orchestra.run.smithi039.stdout: { 2024-09-12T02:49:14.491 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "progress", 2024-09-12T02:49:14.491 INFO:teuthology.orchestra.run.smithi039.stdout: "can_run": true, 2024-09-12T02:49:14.492 INFO:teuthology.orchestra.run.smithi039.stdout: "error_string": "", 2024-09-12T02:49:14.492 INFO:teuthology.orchestra.run.smithi039.stdout: "module_options": { 2024-09-12T02:49:14.492 INFO:teuthology.orchestra.run.smithi039.stdout: "allow_pg_recovery_event": { 2024-09-12T02:49:14.492 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "allow_pg_recovery_event", 2024-09-12T02:49:14.492 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "bool", 2024-09-12T02:49:14.492 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "advanced", 2024-09-12T02:49:14.492 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 1, 2024-09-12T02:49:14.492 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "False", 2024-09-12T02:49:14.492 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-09-12T02:49:14.492 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-09-12T02:49:14.492 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [], 2024-09-12T02:49:14.492 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "allow the module to show pg recovery progress", 2024-09-12T02:49:14.492 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-09-12T02:49:14.493 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-09-12T02:49:14.493 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-09-12T02:49:14.493 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-09-12T02:49:14.493 INFO:teuthology.orchestra.run.smithi039.stdout: "enabled": { 2024-09-12T02:49:14.493 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "enabled", 2024-09-12T02:49:14.493 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "bool", 2024-09-12T02:49:14.493 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "advanced", 2024-09-12T02:49:14.493 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 0, 2024-09-12T02:49:14.493 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "True", 2024-09-12T02:49:14.493 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-09-12T02:49:14.493 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-09-12T02:49:14.493 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [], 2024-09-12T02:49:14.493 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "", 2024-09-12T02:49:14.493 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-09-12T02:49:14.494 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-09-12T02:49:14.494 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-09-12T02:49:14.494 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-09-12T02:49:14.494 INFO:teuthology.orchestra.run.smithi039.stdout: "log_level": { 2024-09-12T02:49:14.494 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "log_level", 2024-09-12T02:49:14.494 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "str", 2024-09-12T02:49:14.494 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "advanced", 2024-09-12T02:49:14.494 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 1, 2024-09-12T02:49:14.494 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "", 2024-09-12T02:49:14.494 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-09-12T02:49:14.494 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-09-12T02:49:14.494 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [ 2024-09-12T02:49:14.494 INFO:teuthology.orchestra.run.smithi039.stdout: "", 2024-09-12T02:49:14.495 INFO:teuthology.orchestra.run.smithi039.stdout: "critical", 2024-09-12T02:49:14.495 INFO:teuthology.orchestra.run.smithi039.stdout: "debug", 2024-09-12T02:49:14.495 INFO:teuthology.orchestra.run.smithi039.stdout: "error", 2024-09-12T02:49:14.495 INFO:teuthology.orchestra.run.smithi039.stdout: "info", 2024-09-12T02:49:14.495 INFO:teuthology.orchestra.run.smithi039.stdout: "warning" 2024-09-12T02:49:14.495 INFO:teuthology.orchestra.run.smithi039.stdout: ], 2024-09-12T02:49:14.495 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "", 2024-09-12T02:49:14.495 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-09-12T02:49:14.495 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-09-12T02:49:14.495 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-09-12T02:49:14.495 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-09-12T02:49:14.495 INFO:teuthology.orchestra.run.smithi039.stdout: "log_to_cluster": { 2024-09-12T02:49:14.495 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "log_to_cluster", 2024-09-12T02:49:14.496 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "bool", 2024-09-12T02:49:14.496 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "advanced", 2024-09-12T02:49:14.496 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 1, 2024-09-12T02:49:14.496 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "False", 2024-09-12T02:49:14.496 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-09-12T02:49:14.496 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-09-12T02:49:14.496 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [], 2024-09-12T02:49:14.496 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "", 2024-09-12T02:49:14.496 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-09-12T02:49:14.496 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-09-12T02:49:14.496 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-09-12T02:49:14.496 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-09-12T02:49:14.496 INFO:teuthology.orchestra.run.smithi039.stdout: "log_to_cluster_level": { 2024-09-12T02:49:14.496 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "log_to_cluster_level", 2024-09-12T02:49:14.497 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "str", 2024-09-12T02:49:14.497 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "advanced", 2024-09-12T02:49:14.497 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 1, 2024-09-12T02:49:14.497 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "info", 2024-09-12T02:49:14.497 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-09-12T02:49:14.497 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-09-12T02:49:14.497 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [ 2024-09-12T02:49:14.497 INFO:teuthology.orchestra.run.smithi039.stdout: "", 2024-09-12T02:49:14.497 INFO:teuthology.orchestra.run.smithi039.stdout: "critical", 2024-09-12T02:49:14.497 INFO:teuthology.orchestra.run.smithi039.stdout: "debug", 2024-09-12T02:49:14.497 INFO:teuthology.orchestra.run.smithi039.stdout: "error", 2024-09-12T02:49:14.497 INFO:teuthology.orchestra.run.smithi039.stdout: "info", 2024-09-12T02:49:14.497 INFO:teuthology.orchestra.run.smithi039.stdout: "warning" 2024-09-12T02:49:14.497 INFO:teuthology.orchestra.run.smithi039.stdout: ], 2024-09-12T02:49:14.498 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "", 2024-09-12T02:49:14.498 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-09-12T02:49:14.498 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-09-12T02:49:14.498 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-09-12T02:49:14.498 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-09-12T02:49:14.498 INFO:teuthology.orchestra.run.smithi039.stdout: "log_to_file": { 2024-09-12T02:49:14.498 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "log_to_file", 2024-09-12T02:49:14.498 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "bool", 2024-09-12T02:49:14.498 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "advanced", 2024-09-12T02:49:14.498 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 1, 2024-09-12T02:49:14.498 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "False", 2024-09-12T02:49:14.498 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-09-12T02:49:14.498 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-09-12T02:49:14.498 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [], 2024-09-12T02:49:14.499 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "", 2024-09-12T02:49:14.499 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-09-12T02:49:14.499 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-09-12T02:49:14.499 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-09-12T02:49:14.499 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-09-12T02:49:14.499 INFO:teuthology.orchestra.run.smithi039.stdout: "max_completed_events": { 2024-09-12T02:49:14.499 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "max_completed_events", 2024-09-12T02:49:14.499 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "int", 2024-09-12T02:49:14.499 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "advanced", 2024-09-12T02:49:14.499 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 1, 2024-09-12T02:49:14.499 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "50", 2024-09-12T02:49:14.499 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-09-12T02:49:14.499 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-09-12T02:49:14.499 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [], 2024-09-12T02:49:14.500 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "number of past completed events to remember", 2024-09-12T02:49:14.500 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-09-12T02:49:14.500 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-09-12T02:49:14.500 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-09-12T02:49:14.500 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-09-12T02:49:14.500 INFO:teuthology.orchestra.run.smithi039.stdout: "sleep_interval": { 2024-09-12T02:49:14.500 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "sleep_interval", 2024-09-12T02:49:14.500 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "secs", 2024-09-12T02:49:14.500 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "advanced", 2024-09-12T02:49:14.500 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 1, 2024-09-12T02:49:14.500 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "5", 2024-09-12T02:49:14.500 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-09-12T02:49:14.500 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-09-12T02:49:14.500 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [], 2024-09-12T02:49:14.501 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "how long the module is going to sleep", 2024-09-12T02:49:14.501 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-09-12T02:49:14.501 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-09-12T02:49:14.501 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-09-12T02:49:14.501 INFO:teuthology.orchestra.run.smithi039.stdout: } 2024-09-12T02:49:14.501 INFO:teuthology.orchestra.run.smithi039.stdout: } 2024-09-12T02:49:14.501 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-09-12T02:49:14.501 INFO:teuthology.orchestra.run.smithi039.stdout: { 2024-09-12T02:49:14.501 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "prometheus", 2024-09-12T02:49:14.501 INFO:teuthology.orchestra.run.smithi039.stdout: "can_run": true, 2024-09-12T02:49:14.501 INFO:teuthology.orchestra.run.smithi039.stdout: "error_string": "", 2024-09-12T02:49:14.501 INFO:teuthology.orchestra.run.smithi039.stdout: "module_options": { 2024-09-12T02:49:14.501 INFO:teuthology.orchestra.run.smithi039.stdout: "cache": { 2024-09-12T02:49:14.502 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "cache", 2024-09-12T02:49:14.502 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "bool", 2024-09-12T02:49:14.502 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "advanced", 2024-09-12T02:49:14.502 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 0, 2024-09-12T02:49:14.502 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "True", 2024-09-12T02:49:14.502 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-09-12T02:49:14.502 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-09-12T02:49:14.502 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [], 2024-09-12T02:49:14.502 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "", 2024-09-12T02:49:14.502 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-09-12T02:49:14.502 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-09-12T02:49:14.502 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-09-12T02:49:14.502 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-09-12T02:49:14.502 INFO:teuthology.orchestra.run.smithi039.stdout: "exclude_perf_counters": { 2024-09-12T02:49:14.503 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "exclude_perf_counters", 2024-09-12T02:49:14.503 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "bool", 2024-09-12T02:49:14.503 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "advanced", 2024-09-12T02:49:14.503 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 1, 2024-09-12T02:49:14.503 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "True", 2024-09-12T02:49:14.503 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-09-12T02:49:14.503 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-09-12T02:49:14.503 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [], 2024-09-12T02:49:14.503 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "Do not include perf-counters in the metrics output", 2024-09-12T02:49:14.503 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "Gathering perf-counters from a single Prometheus exporter can degrade ceph-mgr performance, especially in large clusters. Instead, Ceph-exporter daemons are now used by default for perf-counter gathering. This should only be disabled when no ceph-exporters are deployed.", 2024-09-12T02:49:14.503 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-09-12T02:49:14.503 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-09-12T02:49:14.503 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-09-12T02:49:14.504 INFO:teuthology.orchestra.run.smithi039.stdout: "log_level": { 2024-09-12T02:49:14.504 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "log_level", 2024-09-12T02:49:14.504 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "str", 2024-09-12T02:49:14.504 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "advanced", 2024-09-12T02:49:14.504 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 1, 2024-09-12T02:49:14.504 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "", 2024-09-12T02:49:14.504 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-09-12T02:49:14.504 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-09-12T02:49:14.504 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [ 2024-09-12T02:49:14.504 INFO:teuthology.orchestra.run.smithi039.stdout: "", 2024-09-12T02:49:14.504 INFO:teuthology.orchestra.run.smithi039.stdout: "critical", 2024-09-12T02:49:14.504 INFO:teuthology.orchestra.run.smithi039.stdout: "debug", 2024-09-12T02:49:14.504 INFO:teuthology.orchestra.run.smithi039.stdout: "error", 2024-09-12T02:49:14.504 INFO:teuthology.orchestra.run.smithi039.stdout: "info", 2024-09-12T02:49:14.505 INFO:teuthology.orchestra.run.smithi039.stdout: "warning" 2024-09-12T02:49:14.505 INFO:teuthology.orchestra.run.smithi039.stdout: ], 2024-09-12T02:49:14.505 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "", 2024-09-12T02:49:14.505 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-09-12T02:49:14.505 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-09-12T02:49:14.505 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-09-12T02:49:14.505 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-09-12T02:49:14.505 INFO:teuthology.orchestra.run.smithi039.stdout: "log_to_cluster": { 2024-09-12T02:49:14.505 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "log_to_cluster", 2024-09-12T02:49:14.505 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "bool", 2024-09-12T02:49:14.505 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "advanced", 2024-09-12T02:49:14.505 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 1, 2024-09-12T02:49:14.506 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "False", 2024-09-12T02:49:14.506 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-09-12T02:49:14.506 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-09-12T02:49:14.506 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [], 2024-09-12T02:49:14.506 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "", 2024-09-12T02:49:14.506 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-09-12T02:49:14.506 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-09-12T02:49:14.506 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-09-12T02:49:14.506 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-09-12T02:49:14.506 INFO:teuthology.orchestra.run.smithi039.stdout: "log_to_cluster_level": { 2024-09-12T02:49:14.506 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "log_to_cluster_level", 2024-09-12T02:49:14.506 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "str", 2024-09-12T02:49:14.506 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "advanced", 2024-09-12T02:49:14.506 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 1, 2024-09-12T02:49:14.506 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "info", 2024-09-12T02:49:14.507 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-09-12T02:49:14.507 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-09-12T02:49:14.507 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [ 2024-09-12T02:49:14.507 INFO:teuthology.orchestra.run.smithi039.stdout: "", 2024-09-12T02:49:14.507 INFO:teuthology.orchestra.run.smithi039.stdout: "critical", 2024-09-12T02:49:14.507 INFO:teuthology.orchestra.run.smithi039.stdout: "debug", 2024-09-12T02:49:14.507 INFO:teuthology.orchestra.run.smithi039.stdout: "error", 2024-09-12T02:49:14.507 INFO:teuthology.orchestra.run.smithi039.stdout: "info", 2024-09-12T02:49:14.507 INFO:teuthology.orchestra.run.smithi039.stdout: "warning" 2024-09-12T02:49:14.507 INFO:teuthology.orchestra.run.smithi039.stdout: ], 2024-09-12T02:49:14.507 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "", 2024-09-12T02:49:14.507 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-09-12T02:49:14.507 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-09-12T02:49:14.507 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-09-12T02:49:14.507 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-09-12T02:49:14.508 INFO:teuthology.orchestra.run.smithi039.stdout: "log_to_file": { 2024-09-12T02:49:14.508 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "log_to_file", 2024-09-12T02:49:14.508 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "bool", 2024-09-12T02:49:14.508 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "advanced", 2024-09-12T02:49:14.508 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 1, 2024-09-12T02:49:14.508 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "False", 2024-09-12T02:49:14.508 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-09-12T02:49:14.508 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-09-12T02:49:14.508 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [], 2024-09-12T02:49:14.508 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "", 2024-09-12T02:49:14.508 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-09-12T02:49:14.508 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-09-12T02:49:14.508 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-09-12T02:49:14.509 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-09-12T02:49:14.509 INFO:teuthology.orchestra.run.smithi039.stdout: "rbd_stats_pools": { 2024-09-12T02:49:14.509 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "rbd_stats_pools", 2024-09-12T02:49:14.509 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "str", 2024-09-12T02:49:14.509 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "advanced", 2024-09-12T02:49:14.509 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 0, 2024-09-12T02:49:14.509 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "", 2024-09-12T02:49:14.509 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-09-12T02:49:14.509 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-09-12T02:49:14.509 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [], 2024-09-12T02:49:14.509 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "", 2024-09-12T02:49:14.509 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-09-12T02:49:14.509 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-09-12T02:49:14.509 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-09-12T02:49:14.510 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-09-12T02:49:14.510 INFO:teuthology.orchestra.run.smithi039.stdout: "rbd_stats_pools_refresh_interval": { 2024-09-12T02:49:14.510 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "rbd_stats_pools_refresh_interval", 2024-09-12T02:49:14.510 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "int", 2024-09-12T02:49:14.510 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "advanced", 2024-09-12T02:49:14.510 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 0, 2024-09-12T02:49:14.510 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "300", 2024-09-12T02:49:14.510 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-09-12T02:49:14.510 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-09-12T02:49:14.510 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [], 2024-09-12T02:49:14.510 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "", 2024-09-12T02:49:14.510 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-09-12T02:49:14.510 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-09-12T02:49:14.511 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-09-12T02:49:14.511 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-09-12T02:49:14.511 INFO:teuthology.orchestra.run.smithi039.stdout: "scrape_interval": { 2024-09-12T02:49:14.511 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "scrape_interval", 2024-09-12T02:49:14.511 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "float", 2024-09-12T02:49:14.511 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "advanced", 2024-09-12T02:49:14.511 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 0, 2024-09-12T02:49:14.511 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "15.0", 2024-09-12T02:49:14.511 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-09-12T02:49:14.511 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-09-12T02:49:14.511 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [], 2024-09-12T02:49:14.511 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "", 2024-09-12T02:49:14.511 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-09-12T02:49:14.511 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-09-12T02:49:14.512 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-09-12T02:49:14.512 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-09-12T02:49:14.512 INFO:teuthology.orchestra.run.smithi039.stdout: "server_addr": { 2024-09-12T02:49:14.512 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "server_addr", 2024-09-12T02:49:14.512 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "str", 2024-09-12T02:49:14.512 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "advanced", 2024-09-12T02:49:14.512 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 0, 2024-09-12T02:49:14.512 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "::", 2024-09-12T02:49:14.512 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-09-12T02:49:14.512 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-09-12T02:49:14.512 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [], 2024-09-12T02:49:14.512 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "the IPv4 or IPv6 address on which the module listens for HTTP requests", 2024-09-12T02:49:14.512 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-09-12T02:49:14.513 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-09-12T02:49:14.513 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-09-12T02:49:14.513 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-09-12T02:49:14.513 INFO:teuthology.orchestra.run.smithi039.stdout: "server_port": { 2024-09-12T02:49:14.513 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "server_port", 2024-09-12T02:49:14.513 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "int", 2024-09-12T02:49:14.513 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "advanced", 2024-09-12T02:49:14.513 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 1, 2024-09-12T02:49:14.513 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "9283", 2024-09-12T02:49:14.513 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-09-12T02:49:14.513 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-09-12T02:49:14.513 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [], 2024-09-12T02:49:14.513 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "the port on which the module listens for HTTP requests", 2024-09-12T02:49:14.513 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-09-12T02:49:14.514 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-09-12T02:49:14.514 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-09-12T02:49:14.514 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-09-12T02:49:14.514 INFO:teuthology.orchestra.run.smithi039.stdout: "stale_cache_strategy": { 2024-09-12T02:49:14.514 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "stale_cache_strategy", 2024-09-12T02:49:14.514 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "str", 2024-09-12T02:49:14.514 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "advanced", 2024-09-12T02:49:14.514 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 0, 2024-09-12T02:49:14.514 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "log", 2024-09-12T02:49:14.514 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-09-12T02:49:14.514 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-09-12T02:49:14.514 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [], 2024-09-12T02:49:14.515 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "", 2024-09-12T02:49:14.515 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-09-12T02:49:14.515 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-09-12T02:49:14.515 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-09-12T02:49:14.515 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-09-12T02:49:14.515 INFO:teuthology.orchestra.run.smithi039.stdout: "standby_behaviour": { 2024-09-12T02:49:14.515 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "standby_behaviour", 2024-09-12T02:49:14.515 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "str", 2024-09-12T02:49:14.515 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "advanced", 2024-09-12T02:49:14.515 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 1, 2024-09-12T02:49:14.515 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "default", 2024-09-12T02:49:14.515 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-09-12T02:49:14.515 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-09-12T02:49:14.515 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [ 2024-09-12T02:49:14.516 INFO:teuthology.orchestra.run.smithi039.stdout: "default", 2024-09-12T02:49:14.516 INFO:teuthology.orchestra.run.smithi039.stdout: "error" 2024-09-12T02:49:14.516 INFO:teuthology.orchestra.run.smithi039.stdout: ], 2024-09-12T02:49:14.516 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "", 2024-09-12T02:49:14.516 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-09-12T02:49:14.516 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-09-12T02:49:14.516 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-09-12T02:49:14.516 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-09-12T02:49:14.516 INFO:teuthology.orchestra.run.smithi039.stdout: "standby_error_status_code": { 2024-09-12T02:49:14.516 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "standby_error_status_code", 2024-09-12T02:49:14.516 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "int", 2024-09-12T02:49:14.516 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "advanced", 2024-09-12T02:49:14.516 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 1, 2024-09-12T02:49:14.516 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "500", 2024-09-12T02:49:14.517 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "400", 2024-09-12T02:49:14.517 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "599", 2024-09-12T02:49:14.517 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [], 2024-09-12T02:49:14.517 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "", 2024-09-12T02:49:14.517 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-09-12T02:49:14.517 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-09-12T02:49:14.517 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-09-12T02:49:14.517 INFO:teuthology.orchestra.run.smithi039.stdout: } 2024-09-12T02:49:14.517 INFO:teuthology.orchestra.run.smithi039.stdout: } 2024-09-12T02:49:14.517 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-09-12T02:49:14.517 INFO:teuthology.orchestra.run.smithi039.stdout: { 2024-09-12T02:49:14.517 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "rbd_support", 2024-09-12T02:49:14.517 INFO:teuthology.orchestra.run.smithi039.stdout: "can_run": true, 2024-09-12T02:49:14.517 INFO:teuthology.orchestra.run.smithi039.stdout: "error_string": "", 2024-09-12T02:49:14.518 INFO:teuthology.orchestra.run.smithi039.stdout: "module_options": { 2024-09-12T02:49:14.518 INFO:teuthology.orchestra.run.smithi039.stdout: "log_level": { 2024-09-12T02:49:14.518 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "log_level", 2024-09-12T02:49:14.518 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "str", 2024-09-12T02:49:14.518 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "advanced", 2024-09-12T02:49:14.518 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 1, 2024-09-12T02:49:14.518 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "", 2024-09-12T02:49:14.518 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-09-12T02:49:14.518 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-09-12T02:49:14.518 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [ 2024-09-12T02:49:14.518 INFO:teuthology.orchestra.run.smithi039.stdout: "", 2024-09-12T02:49:14.518 INFO:teuthology.orchestra.run.smithi039.stdout: "critical", 2024-09-12T02:49:14.518 INFO:teuthology.orchestra.run.smithi039.stdout: "debug", 2024-09-12T02:49:14.518 INFO:teuthology.orchestra.run.smithi039.stdout: "error", 2024-09-12T02:49:14.519 INFO:teuthology.orchestra.run.smithi039.stdout: "info", 2024-09-12T02:49:14.519 INFO:teuthology.orchestra.run.smithi039.stdout: "warning" 2024-09-12T02:49:14.519 INFO:teuthology.orchestra.run.smithi039.stdout: ], 2024-09-12T02:49:14.519 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "", 2024-09-12T02:49:14.519 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-09-12T02:49:14.519 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-09-12T02:49:14.519 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-09-12T02:49:14.519 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-09-12T02:49:14.519 INFO:teuthology.orchestra.run.smithi039.stdout: "log_to_cluster": { 2024-09-12T02:49:14.519 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "log_to_cluster", 2024-09-12T02:49:14.519 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "bool", 2024-09-12T02:49:14.519 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "advanced", 2024-09-12T02:49:14.519 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 1, 2024-09-12T02:49:14.520 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "False", 2024-09-12T02:49:14.520 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-09-12T02:49:14.520 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-09-12T02:49:14.520 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [], 2024-09-12T02:49:14.520 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "", 2024-09-12T02:49:14.520 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-09-12T02:49:14.520 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-09-12T02:49:14.520 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-09-12T02:49:14.520 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-09-12T02:49:14.520 INFO:teuthology.orchestra.run.smithi039.stdout: "log_to_cluster_level": { 2024-09-12T02:49:14.520 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "log_to_cluster_level", 2024-09-12T02:49:14.520 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "str", 2024-09-12T02:49:14.520 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "advanced", 2024-09-12T02:49:14.520 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 1, 2024-09-12T02:49:14.521 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "info", 2024-09-12T02:49:14.521 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-09-12T02:49:14.521 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-09-12T02:49:14.521 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [ 2024-09-12T02:49:14.521 INFO:teuthology.orchestra.run.smithi039.stdout: "", 2024-09-12T02:49:14.521 INFO:teuthology.orchestra.run.smithi039.stdout: "critical", 2024-09-12T02:49:14.521 INFO:teuthology.orchestra.run.smithi039.stdout: "debug", 2024-09-12T02:49:14.521 INFO:teuthology.orchestra.run.smithi039.stdout: "error", 2024-09-12T02:49:14.521 INFO:teuthology.orchestra.run.smithi039.stdout: "info", 2024-09-12T02:49:14.521 INFO:teuthology.orchestra.run.smithi039.stdout: "warning" 2024-09-12T02:49:14.521 INFO:teuthology.orchestra.run.smithi039.stdout: ], 2024-09-12T02:49:14.521 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "", 2024-09-12T02:49:14.521 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-09-12T02:49:14.522 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-09-12T02:49:14.522 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-09-12T02:49:14.522 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-09-12T02:49:14.522 INFO:teuthology.orchestra.run.smithi039.stdout: "log_to_file": { 2024-09-12T02:49:14.522 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "log_to_file", 2024-09-12T02:49:14.522 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "bool", 2024-09-12T02:49:14.522 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "advanced", 2024-09-12T02:49:14.522 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 1, 2024-09-12T02:49:14.522 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "False", 2024-09-12T02:49:14.522 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-09-12T02:49:14.522 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-09-12T02:49:14.522 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [], 2024-09-12T02:49:14.522 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "", 2024-09-12T02:49:14.522 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-09-12T02:49:14.523 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-09-12T02:49:14.523 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-09-12T02:49:14.523 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-09-12T02:49:14.523 INFO:teuthology.orchestra.run.smithi039.stdout: "max_concurrent_snap_create": { 2024-09-12T02:49:14.523 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "max_concurrent_snap_create", 2024-09-12T02:49:14.523 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "int", 2024-09-12T02:49:14.523 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "advanced", 2024-09-12T02:49:14.523 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 0, 2024-09-12T02:49:14.523 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "10", 2024-09-12T02:49:14.523 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-09-12T02:49:14.523 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-09-12T02:49:14.523 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [], 2024-09-12T02:49:14.523 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "", 2024-09-12T02:49:14.523 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-09-12T02:49:14.524 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-09-12T02:49:14.524 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-09-12T02:49:14.524 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-09-12T02:49:14.524 INFO:teuthology.orchestra.run.smithi039.stdout: "mirror_snapshot_schedule": { 2024-09-12T02:49:14.524 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "mirror_snapshot_schedule", 2024-09-12T02:49:14.524 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "str", 2024-09-12T02:49:14.524 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "advanced", 2024-09-12T02:49:14.524 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 0, 2024-09-12T02:49:14.524 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "", 2024-09-12T02:49:14.524 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-09-12T02:49:14.524 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-09-12T02:49:14.524 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [], 2024-09-12T02:49:14.524 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "", 2024-09-12T02:49:14.524 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-09-12T02:49:14.525 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-09-12T02:49:14.525 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-09-12T02:49:14.525 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-09-12T02:49:14.525 INFO:teuthology.orchestra.run.smithi039.stdout: "trash_purge_schedule": { 2024-09-12T02:49:14.525 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "trash_purge_schedule", 2024-09-12T02:49:14.525 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "str", 2024-09-12T02:49:14.525 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "advanced", 2024-09-12T02:49:14.525 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 0, 2024-09-12T02:49:14.525 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "", 2024-09-12T02:49:14.525 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-09-12T02:49:14.525 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-09-12T02:49:14.525 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [], 2024-09-12T02:49:14.525 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "", 2024-09-12T02:49:14.525 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-09-12T02:49:14.526 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-09-12T02:49:14.526 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-09-12T02:49:14.526 INFO:teuthology.orchestra.run.smithi039.stdout: } 2024-09-12T02:49:14.526 INFO:teuthology.orchestra.run.smithi039.stdout: } 2024-09-12T02:49:14.526 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-09-12T02:49:14.526 INFO:teuthology.orchestra.run.smithi039.stdout: { 2024-09-12T02:49:14.526 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "restful", 2024-09-12T02:49:14.526 INFO:teuthology.orchestra.run.smithi039.stdout: "can_run": true, 2024-09-12T02:49:14.526 INFO:teuthology.orchestra.run.smithi039.stdout: "error_string": "", 2024-09-12T02:49:14.526 INFO:teuthology.orchestra.run.smithi039.stdout: "module_options": { 2024-09-12T02:49:14.526 INFO:teuthology.orchestra.run.smithi039.stdout: "enable_auth": { 2024-09-12T02:49:14.526 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "enable_auth", 2024-09-12T02:49:14.526 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "bool", 2024-09-12T02:49:14.527 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "advanced", 2024-09-12T02:49:14.527 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 0, 2024-09-12T02:49:14.527 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "True", 2024-09-12T02:49:14.527 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-09-12T02:49:14.527 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-09-12T02:49:14.527 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [], 2024-09-12T02:49:14.527 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "", 2024-09-12T02:49:14.527 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-09-12T02:49:14.527 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-09-12T02:49:14.527 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-09-12T02:49:14.527 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-09-12T02:49:14.527 INFO:teuthology.orchestra.run.smithi039.stdout: "key_file": { 2024-09-12T02:49:14.527 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "key_file", 2024-09-12T02:49:14.527 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "str", 2024-09-12T02:49:14.528 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "advanced", 2024-09-12T02:49:14.528 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 0, 2024-09-12T02:49:14.528 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "", 2024-09-12T02:49:14.528 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-09-12T02:49:14.528 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-09-12T02:49:14.528 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [], 2024-09-12T02:49:14.528 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "", 2024-09-12T02:49:14.528 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-09-12T02:49:14.528 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-09-12T02:49:14.528 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-09-12T02:49:14.529 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-09-12T02:49:14.529 INFO:teuthology.orchestra.run.smithi039.stdout: "log_level": { 2024-09-12T02:49:14.529 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "log_level", 2024-09-12T02:49:14.529 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "str", 2024-09-12T02:49:14.529 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "advanced", 2024-09-12T02:49:14.529 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 1, 2024-09-12T02:49:14.529 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "", 2024-09-12T02:49:14.529 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-09-12T02:49:14.529 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-09-12T02:49:14.529 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [ 2024-09-12T02:49:14.529 INFO:teuthology.orchestra.run.smithi039.stdout: "", 2024-09-12T02:49:14.529 INFO:teuthology.orchestra.run.smithi039.stdout: "critical", 2024-09-12T02:49:14.529 INFO:teuthology.orchestra.run.smithi039.stdout: "debug", 2024-09-12T02:49:14.530 INFO:teuthology.orchestra.run.smithi039.stdout: "error", 2024-09-12T02:49:14.530 INFO:teuthology.orchestra.run.smithi039.stdout: "info", 2024-09-12T02:49:14.530 INFO:teuthology.orchestra.run.smithi039.stdout: "warning" 2024-09-12T02:49:14.530 INFO:teuthology.orchestra.run.smithi039.stdout: ], 2024-09-12T02:49:14.530 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "", 2024-09-12T02:49:14.530 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-09-12T02:49:14.530 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-09-12T02:49:14.530 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-09-12T02:49:14.530 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-09-12T02:49:14.530 INFO:teuthology.orchestra.run.smithi039.stdout: "log_to_cluster": { 2024-09-12T02:49:14.530 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "log_to_cluster", 2024-09-12T02:49:14.530 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "bool", 2024-09-12T02:49:14.530 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "advanced", 2024-09-12T02:49:14.530 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 1, 2024-09-12T02:49:14.531 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "False", 2024-09-12T02:49:14.531 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-09-12T02:49:14.531 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-09-12T02:49:14.531 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [], 2024-09-12T02:49:14.531 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "", 2024-09-12T02:49:14.531 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-09-12T02:49:14.531 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-09-12T02:49:14.531 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-09-12T02:49:14.531 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-09-12T02:49:14.531 INFO:teuthology.orchestra.run.smithi039.stdout: "log_to_cluster_level": { 2024-09-12T02:49:14.531 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "log_to_cluster_level", 2024-09-12T02:49:14.531 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "str", 2024-09-12T02:49:14.531 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "advanced", 2024-09-12T02:49:14.532 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 1, 2024-09-12T02:49:14.532 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "info", 2024-09-12T02:49:14.532 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-09-12T02:49:14.532 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-09-12T02:49:14.532 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [ 2024-09-12T02:49:14.532 INFO:teuthology.orchestra.run.smithi039.stdout: "", 2024-09-12T02:49:14.532 INFO:teuthology.orchestra.run.smithi039.stdout: "critical", 2024-09-12T02:49:14.532 INFO:teuthology.orchestra.run.smithi039.stdout: "debug", 2024-09-12T02:49:14.532 INFO:teuthology.orchestra.run.smithi039.stdout: "error", 2024-09-12T02:49:14.532 INFO:teuthology.orchestra.run.smithi039.stdout: "info", 2024-09-12T02:49:14.532 INFO:teuthology.orchestra.run.smithi039.stdout: "warning" 2024-09-12T02:49:14.532 INFO:teuthology.orchestra.run.smithi039.stdout: ], 2024-09-12T02:49:14.533 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "", 2024-09-12T02:49:14.533 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-09-12T02:49:14.533 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-09-12T02:49:14.533 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-09-12T02:49:14.533 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-09-12T02:49:14.533 INFO:teuthology.orchestra.run.smithi039.stdout: "log_to_file": { 2024-09-12T02:49:14.533 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "log_to_file", 2024-09-12T02:49:14.533 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "bool", 2024-09-12T02:49:14.533 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "advanced", 2024-09-12T02:49:14.533 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 1, 2024-09-12T02:49:14.533 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "False", 2024-09-12T02:49:14.533 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-09-12T02:49:14.533 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-09-12T02:49:14.534 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [], 2024-09-12T02:49:14.534 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "", 2024-09-12T02:49:14.534 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-09-12T02:49:14.534 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-09-12T02:49:14.534 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-09-12T02:49:14.534 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-09-12T02:49:14.534 INFO:teuthology.orchestra.run.smithi039.stdout: "server_addr": { 2024-09-12T02:49:14.534 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "server_addr", 2024-09-12T02:49:14.534 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "str", 2024-09-12T02:49:14.534 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "advanced", 2024-09-12T02:49:14.534 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 0, 2024-09-12T02:49:14.534 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "", 2024-09-12T02:49:14.534 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-09-12T02:49:14.535 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-09-12T02:49:14.535 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [], 2024-09-12T02:49:14.535 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "", 2024-09-12T02:49:14.535 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-09-12T02:49:14.535 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-09-12T02:49:14.535 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-09-12T02:49:14.535 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-09-12T02:49:14.535 INFO:teuthology.orchestra.run.smithi039.stdout: "server_port": { 2024-09-12T02:49:14.535 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "server_port", 2024-09-12T02:49:14.535 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "str", 2024-09-12T02:49:14.535 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "advanced", 2024-09-12T02:49:14.535 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 0, 2024-09-12T02:49:14.535 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "", 2024-09-12T02:49:14.535 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-09-12T02:49:14.536 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-09-12T02:49:14.536 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [], 2024-09-12T02:49:14.536 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "", 2024-09-12T02:49:14.536 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-09-12T02:49:14.536 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-09-12T02:49:14.536 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-09-12T02:49:14.536 INFO:teuthology.orchestra.run.smithi039.stdout: } 2024-09-12T02:49:14.536 INFO:teuthology.orchestra.run.smithi039.stdout: } 2024-09-12T02:49:14.536 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-09-12T02:49:14.536 INFO:teuthology.orchestra.run.smithi039.stdout: { 2024-09-12T02:49:14.536 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "rgw", 2024-09-12T02:49:14.536 INFO:teuthology.orchestra.run.smithi039.stdout: "can_run": true, 2024-09-12T02:49:14.536 INFO:teuthology.orchestra.run.smithi039.stdout: "error_string": "", 2024-09-12T02:49:14.536 INFO:teuthology.orchestra.run.smithi039.stdout: "module_options": { 2024-09-12T02:49:14.537 INFO:teuthology.orchestra.run.smithi039.stdout: "log_level": { 2024-09-12T02:49:14.537 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "log_level", 2024-09-12T02:49:14.537 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "str", 2024-09-12T02:49:14.537 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "advanced", 2024-09-12T02:49:14.537 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 1, 2024-09-12T02:49:14.537 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "", 2024-09-12T02:49:14.537 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-09-12T02:49:14.537 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-09-12T02:49:14.537 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [ 2024-09-12T02:49:14.537 INFO:teuthology.orchestra.run.smithi039.stdout: "", 2024-09-12T02:49:14.537 INFO:teuthology.orchestra.run.smithi039.stdout: "critical", 2024-09-12T02:49:14.537 INFO:teuthology.orchestra.run.smithi039.stdout: "debug", 2024-09-12T02:49:14.537 INFO:teuthology.orchestra.run.smithi039.stdout: "error", 2024-09-12T02:49:14.538 INFO:teuthology.orchestra.run.smithi039.stdout: "info", 2024-09-12T02:49:14.538 INFO:teuthology.orchestra.run.smithi039.stdout: "warning" 2024-09-12T02:49:14.538 INFO:teuthology.orchestra.run.smithi039.stdout: ], 2024-09-12T02:49:14.538 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "", 2024-09-12T02:49:14.538 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-09-12T02:49:14.538 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-09-12T02:49:14.538 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-09-12T02:49:14.538 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-09-12T02:49:14.538 INFO:teuthology.orchestra.run.smithi039.stdout: "log_to_cluster": { 2024-09-12T02:49:14.538 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "log_to_cluster", 2024-09-12T02:49:14.538 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "bool", 2024-09-12T02:49:14.538 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "advanced", 2024-09-12T02:49:14.538 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 1, 2024-09-12T02:49:14.539 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "False", 2024-09-12T02:49:14.539 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-09-12T02:49:14.539 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-09-12T02:49:14.539 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [], 2024-09-12T02:49:14.539 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "", 2024-09-12T02:49:14.539 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-09-12T02:49:14.539 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-09-12T02:49:14.539 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-09-12T02:49:14.539 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-09-12T02:49:14.539 INFO:teuthology.orchestra.run.smithi039.stdout: "log_to_cluster_level": { 2024-09-12T02:49:14.539 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "log_to_cluster_level", 2024-09-12T02:49:14.539 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "str", 2024-09-12T02:49:14.539 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "advanced", 2024-09-12T02:49:14.539 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 1, 2024-09-12T02:49:14.540 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "info", 2024-09-12T02:49:14.540 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-09-12T02:49:14.540 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-09-12T02:49:14.540 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [ 2024-09-12T02:49:14.540 INFO:teuthology.orchestra.run.smithi039.stdout: "", 2024-09-12T02:49:14.540 INFO:teuthology.orchestra.run.smithi039.stdout: "critical", 2024-09-12T02:49:14.540 INFO:teuthology.orchestra.run.smithi039.stdout: "debug", 2024-09-12T02:49:14.540 INFO:teuthology.orchestra.run.smithi039.stdout: "error", 2024-09-12T02:49:14.540 INFO:teuthology.orchestra.run.smithi039.stdout: "info", 2024-09-12T02:49:14.540 INFO:teuthology.orchestra.run.smithi039.stdout: "warning" 2024-09-12T02:49:14.540 INFO:teuthology.orchestra.run.smithi039.stdout: ], 2024-09-12T02:49:14.540 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "", 2024-09-12T02:49:14.541 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-09-12T02:49:14.541 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-09-12T02:49:14.541 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-09-12T02:49:14.541 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-09-12T02:49:14.541 INFO:teuthology.orchestra.run.smithi039.stdout: "log_to_file": { 2024-09-12T02:49:14.541 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "log_to_file", 2024-09-12T02:49:14.541 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "bool", 2024-09-12T02:49:14.541 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "advanced", 2024-09-12T02:49:14.541 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 1, 2024-09-12T02:49:14.541 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "False", 2024-09-12T02:49:14.541 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-09-12T02:49:14.541 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-09-12T02:49:14.541 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [], 2024-09-12T02:49:14.542 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "", 2024-09-12T02:49:14.542 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-09-12T02:49:14.542 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-09-12T02:49:14.542 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-09-12T02:49:14.542 INFO:teuthology.orchestra.run.smithi039.stdout: } 2024-09-12T02:49:14.542 INFO:teuthology.orchestra.run.smithi039.stdout: } 2024-09-12T02:49:14.542 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-09-12T02:49:14.542 INFO:teuthology.orchestra.run.smithi039.stdout: { 2024-09-12T02:49:14.542 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "rook", 2024-09-12T02:49:14.542 INFO:teuthology.orchestra.run.smithi039.stdout: "can_run": true, 2024-09-12T02:49:14.542 INFO:teuthology.orchestra.run.smithi039.stdout: "error_string": "", 2024-09-12T02:49:14.542 INFO:teuthology.orchestra.run.smithi039.stdout: "module_options": { 2024-09-12T02:49:14.542 INFO:teuthology.orchestra.run.smithi039.stdout: "log_level": { 2024-09-12T02:49:14.542 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "log_level", 2024-09-12T02:49:14.542 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "str", 2024-09-12T02:49:14.543 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "advanced", 2024-09-12T02:49:14.543 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 1, 2024-09-12T02:49:14.543 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "", 2024-09-12T02:49:14.543 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-09-12T02:49:14.543 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-09-12T02:49:14.543 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [ 2024-09-12T02:49:14.543 INFO:teuthology.orchestra.run.smithi039.stdout: "", 2024-09-12T02:49:14.543 INFO:teuthology.orchestra.run.smithi039.stdout: "critical", 2024-09-12T02:49:14.543 INFO:teuthology.orchestra.run.smithi039.stdout: "debug", 2024-09-12T02:49:14.543 INFO:teuthology.orchestra.run.smithi039.stdout: "error", 2024-09-12T02:49:14.543 INFO:teuthology.orchestra.run.smithi039.stdout: "info", 2024-09-12T02:49:14.543 INFO:teuthology.orchestra.run.smithi039.stdout: "warning" 2024-09-12T02:49:14.543 INFO:teuthology.orchestra.run.smithi039.stdout: ], 2024-09-12T02:49:14.544 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "", 2024-09-12T02:49:14.544 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-09-12T02:49:14.544 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-09-12T02:49:14.544 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-09-12T02:49:14.544 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-09-12T02:49:14.544 INFO:teuthology.orchestra.run.smithi039.stdout: "log_to_cluster": { 2024-09-12T02:49:14.544 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "log_to_cluster", 2024-09-12T02:49:14.544 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "bool", 2024-09-12T02:49:14.544 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "advanced", 2024-09-12T02:49:14.544 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 1, 2024-09-12T02:49:14.544 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "False", 2024-09-12T02:49:14.544 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-09-12T02:49:14.544 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-09-12T02:49:14.545 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [], 2024-09-12T02:49:14.545 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "", 2024-09-12T02:49:14.545 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-09-12T02:49:14.545 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-09-12T02:49:14.545 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-09-12T02:49:14.545 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-09-12T02:49:14.545 INFO:teuthology.orchestra.run.smithi039.stdout: "log_to_cluster_level": { 2024-09-12T02:49:14.545 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "log_to_cluster_level", 2024-09-12T02:49:14.545 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "str", 2024-09-12T02:49:14.545 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "advanced", 2024-09-12T02:49:14.545 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 1, 2024-09-12T02:49:14.545 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "info", 2024-09-12T02:49:14.546 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-09-12T02:49:14.546 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-09-12T02:49:14.546 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [ 2024-09-12T02:49:14.546 INFO:teuthology.orchestra.run.smithi039.stdout: "", 2024-09-12T02:49:14.546 INFO:teuthology.orchestra.run.smithi039.stdout: "critical", 2024-09-12T02:49:14.546 INFO:teuthology.orchestra.run.smithi039.stdout: "debug", 2024-09-12T02:49:14.546 INFO:teuthology.orchestra.run.smithi039.stdout: "error", 2024-09-12T02:49:14.546 INFO:teuthology.orchestra.run.smithi039.stdout: "info", 2024-09-12T02:49:14.546 INFO:teuthology.orchestra.run.smithi039.stdout: "warning" 2024-09-12T02:49:14.546 INFO:teuthology.orchestra.run.smithi039.stdout: ], 2024-09-12T02:49:14.546 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "", 2024-09-12T02:49:14.546 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-09-12T02:49:14.546 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-09-12T02:49:14.546 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-09-12T02:49:14.547 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-09-12T02:49:14.547 INFO:teuthology.orchestra.run.smithi039.stdout: "log_to_file": { 2024-09-12T02:49:14.547 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "log_to_file", 2024-09-12T02:49:14.547 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "bool", 2024-09-12T02:49:14.547 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "advanced", 2024-09-12T02:49:14.547 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 1, 2024-09-12T02:49:14.547 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "False", 2024-09-12T02:49:14.547 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-09-12T02:49:14.547 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-09-12T02:49:14.547 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [], 2024-09-12T02:49:14.547 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "", 2024-09-12T02:49:14.547 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-09-12T02:49:14.547 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-09-12T02:49:14.547 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-09-12T02:49:14.548 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-09-12T02:49:14.548 INFO:teuthology.orchestra.run.smithi039.stdout: "storage_class": { 2024-09-12T02:49:14.548 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "storage_class", 2024-09-12T02:49:14.548 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "str", 2024-09-12T02:49:14.548 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "advanced", 2024-09-12T02:49:14.548 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 0, 2024-09-12T02:49:14.548 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "local", 2024-09-12T02:49:14.548 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-09-12T02:49:14.548 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-09-12T02:49:14.548 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [], 2024-09-12T02:49:14.548 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "storage class name for LSO-discovered PVs", 2024-09-12T02:49:14.548 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-09-12T02:49:14.548 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-09-12T02:49:14.549 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-09-12T02:49:14.549 INFO:teuthology.orchestra.run.smithi039.stdout: } 2024-09-12T02:49:14.549 INFO:teuthology.orchestra.run.smithi039.stdout: } 2024-09-12T02:49:14.549 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-09-12T02:49:14.549 INFO:teuthology.orchestra.run.smithi039.stdout: { 2024-09-12T02:49:14.549 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "selftest", 2024-09-12T02:49:14.549 INFO:teuthology.orchestra.run.smithi039.stdout: "can_run": true, 2024-09-12T02:49:14.549 INFO:teuthology.orchestra.run.smithi039.stdout: "error_string": "", 2024-09-12T02:49:14.549 INFO:teuthology.orchestra.run.smithi039.stdout: "module_options": { 2024-09-12T02:49:14.549 INFO:teuthology.orchestra.run.smithi039.stdout: "log_level": { 2024-09-12T02:49:14.549 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "log_level", 2024-09-12T02:49:14.549 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "str", 2024-09-12T02:49:14.549 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "advanced", 2024-09-12T02:49:14.549 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 1, 2024-09-12T02:49:14.550 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "", 2024-09-12T02:49:14.550 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-09-12T02:49:14.550 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-09-12T02:49:14.550 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [ 2024-09-12T02:49:14.550 INFO:teuthology.orchestra.run.smithi039.stdout: "", 2024-09-12T02:49:14.550 INFO:teuthology.orchestra.run.smithi039.stdout: "critical", 2024-09-12T02:49:14.550 INFO:teuthology.orchestra.run.smithi039.stdout: "debug", 2024-09-12T02:49:14.550 INFO:teuthology.orchestra.run.smithi039.stdout: "error", 2024-09-12T02:49:14.550 INFO:teuthology.orchestra.run.smithi039.stdout: "info", 2024-09-12T02:49:14.550 INFO:teuthology.orchestra.run.smithi039.stdout: "warning" 2024-09-12T02:49:14.550 INFO:teuthology.orchestra.run.smithi039.stdout: ], 2024-09-12T02:49:14.550 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "", 2024-09-12T02:49:14.550 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-09-12T02:49:14.550 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-09-12T02:49:14.551 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-09-12T02:49:14.551 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-09-12T02:49:14.551 INFO:teuthology.orchestra.run.smithi039.stdout: "log_to_cluster": { 2024-09-12T02:49:14.551 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "log_to_cluster", 2024-09-12T02:49:14.551 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "bool", 2024-09-12T02:49:14.551 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "advanced", 2024-09-12T02:49:14.551 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 1, 2024-09-12T02:49:14.551 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "False", 2024-09-12T02:49:14.551 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-09-12T02:49:14.551 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-09-12T02:49:14.551 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [], 2024-09-12T02:49:14.551 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "", 2024-09-12T02:49:14.551 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-09-12T02:49:14.551 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-09-12T02:49:14.552 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-09-12T02:49:14.552 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-09-12T02:49:14.552 INFO:teuthology.orchestra.run.smithi039.stdout: "log_to_cluster_level": { 2024-09-12T02:49:14.552 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "log_to_cluster_level", 2024-09-12T02:49:14.552 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "str", 2024-09-12T02:49:14.552 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "advanced", 2024-09-12T02:49:14.552 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 1, 2024-09-12T02:49:14.552 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "info", 2024-09-12T02:49:14.552 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-09-12T02:49:14.552 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-09-12T02:49:14.552 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [ 2024-09-12T02:49:14.552 INFO:teuthology.orchestra.run.smithi039.stdout: "", 2024-09-12T02:49:14.552 INFO:teuthology.orchestra.run.smithi039.stdout: "critical", 2024-09-12T02:49:14.552 INFO:teuthology.orchestra.run.smithi039.stdout: "debug", 2024-09-12T02:49:14.553 INFO:teuthology.orchestra.run.smithi039.stdout: "error", 2024-09-12T02:49:14.553 INFO:teuthology.orchestra.run.smithi039.stdout: "info", 2024-09-12T02:49:14.553 INFO:teuthology.orchestra.run.smithi039.stdout: "warning" 2024-09-12T02:49:14.553 INFO:teuthology.orchestra.run.smithi039.stdout: ], 2024-09-12T02:49:14.553 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "", 2024-09-12T02:49:14.553 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-09-12T02:49:14.553 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-09-12T02:49:14.553 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-09-12T02:49:14.553 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-09-12T02:49:14.553 INFO:teuthology.orchestra.run.smithi039.stdout: "log_to_file": { 2024-09-12T02:49:14.553 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "log_to_file", 2024-09-12T02:49:14.553 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "bool", 2024-09-12T02:49:14.553 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "advanced", 2024-09-12T02:49:14.553 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 1, 2024-09-12T02:49:14.554 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "False", 2024-09-12T02:49:14.554 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-09-12T02:49:14.554 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-09-12T02:49:14.554 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [], 2024-09-12T02:49:14.554 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "", 2024-09-12T02:49:14.554 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-09-12T02:49:14.554 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-09-12T02:49:14.554 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-09-12T02:49:14.554 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-09-12T02:49:14.554 INFO:teuthology.orchestra.run.smithi039.stdout: "roption1": { 2024-09-12T02:49:14.554 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "roption1", 2024-09-12T02:49:14.554 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "str", 2024-09-12T02:49:14.554 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "advanced", 2024-09-12T02:49:14.554 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 0, 2024-09-12T02:49:14.555 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "", 2024-09-12T02:49:14.555 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-09-12T02:49:14.555 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-09-12T02:49:14.555 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [], 2024-09-12T02:49:14.555 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "", 2024-09-12T02:49:14.555 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-09-12T02:49:14.555 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-09-12T02:49:14.555 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-09-12T02:49:14.555 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-09-12T02:49:14.555 INFO:teuthology.orchestra.run.smithi039.stdout: "roption2": { 2024-09-12T02:49:14.555 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "roption2", 2024-09-12T02:49:14.555 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "str", 2024-09-12T02:49:14.555 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "advanced", 2024-09-12T02:49:14.556 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 0, 2024-09-12T02:49:14.556 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "xyz", 2024-09-12T02:49:14.556 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-09-12T02:49:14.556 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-09-12T02:49:14.556 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [], 2024-09-12T02:49:14.556 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "", 2024-09-12T02:49:14.556 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-09-12T02:49:14.556 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-09-12T02:49:14.556 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-09-12T02:49:14.556 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-09-12T02:49:14.556 INFO:teuthology.orchestra.run.smithi039.stdout: "rwoption1": { 2024-09-12T02:49:14.556 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "rwoption1", 2024-09-12T02:49:14.556 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "str", 2024-09-12T02:49:14.557 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "advanced", 2024-09-12T02:49:14.557 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 0, 2024-09-12T02:49:14.557 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "", 2024-09-12T02:49:14.557 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-09-12T02:49:14.557 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-09-12T02:49:14.557 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [], 2024-09-12T02:49:14.557 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "", 2024-09-12T02:49:14.557 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-09-12T02:49:14.557 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-09-12T02:49:14.557 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-09-12T02:49:14.557 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-09-12T02:49:14.557 INFO:teuthology.orchestra.run.smithi039.stdout: "rwoption2": { 2024-09-12T02:49:14.557 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "rwoption2", 2024-09-12T02:49:14.558 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "int", 2024-09-12T02:49:14.558 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "advanced", 2024-09-12T02:49:14.558 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 0, 2024-09-12T02:49:14.558 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "", 2024-09-12T02:49:14.558 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-09-12T02:49:14.558 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-09-12T02:49:14.558 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [], 2024-09-12T02:49:14.558 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "", 2024-09-12T02:49:14.558 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-09-12T02:49:14.558 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-09-12T02:49:14.558 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-09-12T02:49:14.559 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-09-12T02:49:14.559 INFO:teuthology.orchestra.run.smithi039.stdout: "rwoption3": { 2024-09-12T02:49:14.559 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "rwoption3", 2024-09-12T02:49:14.559 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "float", 2024-09-12T02:49:14.559 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "advanced", 2024-09-12T02:49:14.559 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 0, 2024-09-12T02:49:14.559 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "", 2024-09-12T02:49:14.559 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-09-12T02:49:14.559 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-09-12T02:49:14.559 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [], 2024-09-12T02:49:14.559 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "", 2024-09-12T02:49:14.559 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-09-12T02:49:14.559 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-09-12T02:49:14.559 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-09-12T02:49:14.560 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-09-12T02:49:14.560 INFO:teuthology.orchestra.run.smithi039.stdout: "rwoption4": { 2024-09-12T02:49:14.560 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "rwoption4", 2024-09-12T02:49:14.560 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "str", 2024-09-12T02:49:14.560 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "advanced", 2024-09-12T02:49:14.560 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 0, 2024-09-12T02:49:14.560 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "", 2024-09-12T02:49:14.560 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-09-12T02:49:14.560 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-09-12T02:49:14.560 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [], 2024-09-12T02:49:14.560 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "", 2024-09-12T02:49:14.560 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-09-12T02:49:14.561 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-09-12T02:49:14.561 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-09-12T02:49:14.561 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-09-12T02:49:14.561 INFO:teuthology.orchestra.run.smithi039.stdout: "rwoption5": { 2024-09-12T02:49:14.561 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "rwoption5", 2024-09-12T02:49:14.561 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "bool", 2024-09-12T02:49:14.561 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "advanced", 2024-09-12T02:49:14.561 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 0, 2024-09-12T02:49:14.561 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "", 2024-09-12T02:49:14.561 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-09-12T02:49:14.561 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-09-12T02:49:14.561 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [], 2024-09-12T02:49:14.561 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "", 2024-09-12T02:49:14.562 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-09-12T02:49:14.562 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-09-12T02:49:14.562 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-09-12T02:49:14.562 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-09-12T02:49:14.562 INFO:teuthology.orchestra.run.smithi039.stdout: "rwoption6": { 2024-09-12T02:49:14.562 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "rwoption6", 2024-09-12T02:49:14.562 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "bool", 2024-09-12T02:49:14.562 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "advanced", 2024-09-12T02:49:14.562 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 0, 2024-09-12T02:49:14.562 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "True", 2024-09-12T02:49:14.562 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-09-12T02:49:14.562 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-09-12T02:49:14.562 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [], 2024-09-12T02:49:14.562 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "", 2024-09-12T02:49:14.563 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-09-12T02:49:14.563 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-09-12T02:49:14.563 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-09-12T02:49:14.563 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-09-12T02:49:14.563 INFO:teuthology.orchestra.run.smithi039.stdout: "rwoption7": { 2024-09-12T02:49:14.563 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "rwoption7", 2024-09-12T02:49:14.563 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "int", 2024-09-12T02:49:14.563 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "advanced", 2024-09-12T02:49:14.563 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 0, 2024-09-12T02:49:14.563 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "", 2024-09-12T02:49:14.563 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "1", 2024-09-12T02:49:14.563 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "42", 2024-09-12T02:49:14.563 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [], 2024-09-12T02:49:14.564 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "", 2024-09-12T02:49:14.564 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-09-12T02:49:14.564 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-09-12T02:49:14.564 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-09-12T02:49:14.564 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-09-12T02:49:14.564 INFO:teuthology.orchestra.run.smithi039.stdout: "testkey": { 2024-09-12T02:49:14.564 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "testkey", 2024-09-12T02:49:14.564 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "str", 2024-09-12T02:49:14.564 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "advanced", 2024-09-12T02:49:14.564 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 0, 2024-09-12T02:49:14.564 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "", 2024-09-12T02:49:14.564 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-09-12T02:49:14.565 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-09-12T02:49:14.565 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [], 2024-09-12T02:49:14.565 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "", 2024-09-12T02:49:14.565 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-09-12T02:49:14.565 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-09-12T02:49:14.565 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-09-12T02:49:14.565 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-09-12T02:49:14.565 INFO:teuthology.orchestra.run.smithi039.stdout: "testlkey": { 2024-09-12T02:49:14.565 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "testlkey", 2024-09-12T02:49:14.565 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "str", 2024-09-12T02:49:14.565 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "advanced", 2024-09-12T02:49:14.565 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 0, 2024-09-12T02:49:14.565 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "", 2024-09-12T02:49:14.565 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-09-12T02:49:14.566 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-09-12T02:49:14.566 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [], 2024-09-12T02:49:14.566 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "", 2024-09-12T02:49:14.566 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-09-12T02:49:14.566 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-09-12T02:49:14.566 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-09-12T02:49:14.566 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-09-12T02:49:14.566 INFO:teuthology.orchestra.run.smithi039.stdout: "testnewline": { 2024-09-12T02:49:14.566 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "testnewline", 2024-09-12T02:49:14.566 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "str", 2024-09-12T02:49:14.566 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "advanced", 2024-09-12T02:49:14.566 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 0, 2024-09-12T02:49:14.566 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "", 2024-09-12T02:49:14.567 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-09-12T02:49:14.567 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-09-12T02:49:14.567 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [], 2024-09-12T02:49:14.567 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "", 2024-09-12T02:49:14.567 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-09-12T02:49:14.567 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-09-12T02:49:14.567 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-09-12T02:49:14.567 INFO:teuthology.orchestra.run.smithi039.stdout: } 2024-09-12T02:49:14.567 INFO:teuthology.orchestra.run.smithi039.stdout: } 2024-09-12T02:49:14.567 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-09-12T02:49:14.567 INFO:teuthology.orchestra.run.smithi039.stdout: { 2024-09-12T02:49:14.567 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "snap_schedule", 2024-09-12T02:49:14.567 INFO:teuthology.orchestra.run.smithi039.stdout: "can_run": true, 2024-09-12T02:49:14.568 INFO:teuthology.orchestra.run.smithi039.stdout: "error_string": "", 2024-09-12T02:49:14.568 INFO:teuthology.orchestra.run.smithi039.stdout: "module_options": { 2024-09-12T02:49:14.568 INFO:teuthology.orchestra.run.smithi039.stdout: "allow_m_granularity": { 2024-09-12T02:49:14.568 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "allow_m_granularity", 2024-09-12T02:49:14.568 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "bool", 2024-09-12T02:49:14.568 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "advanced", 2024-09-12T02:49:14.568 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 1, 2024-09-12T02:49:14.568 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "False", 2024-09-12T02:49:14.568 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-09-12T02:49:14.568 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-09-12T02:49:14.568 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [], 2024-09-12T02:49:14.568 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "allow minute scheduled snapshots", 2024-09-12T02:49:14.568 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-09-12T02:49:14.568 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-09-12T02:49:14.569 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-09-12T02:49:14.569 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-09-12T02:49:14.569 INFO:teuthology.orchestra.run.smithi039.stdout: "dump_on_update": { 2024-09-12T02:49:14.569 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "dump_on_update", 2024-09-12T02:49:14.569 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "bool", 2024-09-12T02:49:14.569 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "advanced", 2024-09-12T02:49:14.569 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 1, 2024-09-12T02:49:14.569 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "False", 2024-09-12T02:49:14.569 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-09-12T02:49:14.569 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-09-12T02:49:14.569 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [], 2024-09-12T02:49:14.569 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "dump database to debug log on update", 2024-09-12T02:49:14.569 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-09-12T02:49:14.570 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-09-12T02:49:14.570 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-09-12T02:49:14.570 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-09-12T02:49:14.570 INFO:teuthology.orchestra.run.smithi039.stdout: "log_level": { 2024-09-12T02:49:14.570 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "log_level", 2024-09-12T02:49:14.570 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "str", 2024-09-12T02:49:14.570 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "advanced", 2024-09-12T02:49:14.570 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 1, 2024-09-12T02:49:14.570 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "", 2024-09-12T02:49:14.570 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-09-12T02:49:14.570 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-09-12T02:49:14.570 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [ 2024-09-12T02:49:14.570 INFO:teuthology.orchestra.run.smithi039.stdout: "", 2024-09-12T02:49:14.571 INFO:teuthology.orchestra.run.smithi039.stdout: "critical", 2024-09-12T02:49:14.571 INFO:teuthology.orchestra.run.smithi039.stdout: "debug", 2024-09-12T02:49:14.571 INFO:teuthology.orchestra.run.smithi039.stdout: "error", 2024-09-12T02:49:14.571 INFO:teuthology.orchestra.run.smithi039.stdout: "info", 2024-09-12T02:49:14.571 INFO:teuthology.orchestra.run.smithi039.stdout: "warning" 2024-09-12T02:49:14.571 INFO:teuthology.orchestra.run.smithi039.stdout: ], 2024-09-12T02:49:14.571 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "", 2024-09-12T02:49:14.571 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-09-12T02:49:14.571 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-09-12T02:49:14.571 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-09-12T02:49:14.571 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-09-12T02:49:14.571 INFO:teuthology.orchestra.run.smithi039.stdout: "log_to_cluster": { 2024-09-12T02:49:14.571 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "log_to_cluster", 2024-09-12T02:49:14.571 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "bool", 2024-09-12T02:49:14.572 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "advanced", 2024-09-12T02:49:14.572 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 1, 2024-09-12T02:49:14.572 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "False", 2024-09-12T02:49:14.572 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-09-12T02:49:14.572 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-09-12T02:49:14.572 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [], 2024-09-12T02:49:14.572 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "", 2024-09-12T02:49:14.572 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-09-12T02:49:14.572 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-09-12T02:49:14.572 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-09-12T02:49:14.572 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-09-12T02:49:14.572 INFO:teuthology.orchestra.run.smithi039.stdout: "log_to_cluster_level": { 2024-09-12T02:49:14.572 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "log_to_cluster_level", 2024-09-12T02:49:14.573 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "str", 2024-09-12T02:49:14.573 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "advanced", 2024-09-12T02:49:14.573 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 1, 2024-09-12T02:49:14.573 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "info", 2024-09-12T02:49:14.573 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-09-12T02:49:14.573 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-09-12T02:49:14.573 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [ 2024-09-12T02:49:14.573 INFO:teuthology.orchestra.run.smithi039.stdout: "", 2024-09-12T02:49:14.573 INFO:teuthology.orchestra.run.smithi039.stdout: "critical", 2024-09-12T02:49:14.573 INFO:teuthology.orchestra.run.smithi039.stdout: "debug", 2024-09-12T02:49:14.573 INFO:teuthology.orchestra.run.smithi039.stdout: "error", 2024-09-12T02:49:14.573 INFO:teuthology.orchestra.run.smithi039.stdout: "info", 2024-09-12T02:49:14.573 INFO:teuthology.orchestra.run.smithi039.stdout: "warning" 2024-09-12T02:49:14.574 INFO:teuthology.orchestra.run.smithi039.stdout: ], 2024-09-12T02:49:14.574 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "", 2024-09-12T02:49:14.574 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-09-12T02:49:14.574 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-09-12T02:49:14.574 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-09-12T02:49:14.574 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-09-12T02:49:14.574 INFO:teuthology.orchestra.run.smithi039.stdout: "log_to_file": { 2024-09-12T02:49:14.574 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "log_to_file", 2024-09-12T02:49:14.574 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "bool", 2024-09-12T02:49:14.574 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "advanced", 2024-09-12T02:49:14.574 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 1, 2024-09-12T02:49:14.574 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "False", 2024-09-12T02:49:14.574 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-09-12T02:49:14.575 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-09-12T02:49:14.575 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [], 2024-09-12T02:49:14.575 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "", 2024-09-12T02:49:14.575 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-09-12T02:49:14.575 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-09-12T02:49:14.575 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-09-12T02:49:14.575 INFO:teuthology.orchestra.run.smithi039.stdout: } 2024-09-12T02:49:14.575 INFO:teuthology.orchestra.run.smithi039.stdout: } 2024-09-12T02:49:14.575 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-09-12T02:49:14.575 INFO:teuthology.orchestra.run.smithi039.stdout: { 2024-09-12T02:49:14.575 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "stats", 2024-09-12T02:49:14.575 INFO:teuthology.orchestra.run.smithi039.stdout: "can_run": true, 2024-09-12T02:49:14.575 INFO:teuthology.orchestra.run.smithi039.stdout: "error_string": "", 2024-09-12T02:49:14.575 INFO:teuthology.orchestra.run.smithi039.stdout: "module_options": { 2024-09-12T02:49:14.576 INFO:teuthology.orchestra.run.smithi039.stdout: "log_level": { 2024-09-12T02:49:14.576 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "log_level", 2024-09-12T02:49:14.576 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "str", 2024-09-12T02:49:14.576 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "advanced", 2024-09-12T02:49:14.576 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 1, 2024-09-12T02:49:14.576 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "", 2024-09-12T02:49:14.576 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-09-12T02:49:14.576 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-09-12T02:49:14.576 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [ 2024-09-12T02:49:14.576 INFO:teuthology.orchestra.run.smithi039.stdout: "", 2024-09-12T02:49:14.576 INFO:teuthology.orchestra.run.smithi039.stdout: "critical", 2024-09-12T02:49:14.576 INFO:teuthology.orchestra.run.smithi039.stdout: "debug", 2024-09-12T02:49:14.576 INFO:teuthology.orchestra.run.smithi039.stdout: "error", 2024-09-12T02:49:14.577 INFO:teuthology.orchestra.run.smithi039.stdout: "info", 2024-09-12T02:49:14.577 INFO:teuthology.orchestra.run.smithi039.stdout: "warning" 2024-09-12T02:49:14.577 INFO:teuthology.orchestra.run.smithi039.stdout: ], 2024-09-12T02:49:14.577 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "", 2024-09-12T02:49:14.577 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-09-12T02:49:14.577 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-09-12T02:49:14.577 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-09-12T02:49:14.577 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-09-12T02:49:14.577 INFO:teuthology.orchestra.run.smithi039.stdout: "log_to_cluster": { 2024-09-12T02:49:14.577 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "log_to_cluster", 2024-09-12T02:49:14.577 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "bool", 2024-09-12T02:49:14.577 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "advanced", 2024-09-12T02:49:14.577 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 1, 2024-09-12T02:49:14.578 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "False", 2024-09-12T02:49:14.578 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-09-12T02:49:14.578 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-09-12T02:49:14.578 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [], 2024-09-12T02:49:14.578 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "", 2024-09-12T02:49:14.578 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-09-12T02:49:14.578 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-09-12T02:49:14.578 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-09-12T02:49:14.578 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-09-12T02:49:14.578 INFO:teuthology.orchestra.run.smithi039.stdout: "log_to_cluster_level": { 2024-09-12T02:49:14.578 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "log_to_cluster_level", 2024-09-12T02:49:14.578 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "str", 2024-09-12T02:49:14.578 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "advanced", 2024-09-12T02:49:14.578 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 1, 2024-09-12T02:49:14.579 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "info", 2024-09-12T02:49:14.579 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-09-12T02:49:14.579 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-09-12T02:49:14.579 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [ 2024-09-12T02:49:14.579 INFO:teuthology.orchestra.run.smithi039.stdout: "", 2024-09-12T02:49:14.579 INFO:teuthology.orchestra.run.smithi039.stdout: "critical", 2024-09-12T02:49:14.579 INFO:teuthology.orchestra.run.smithi039.stdout: "debug", 2024-09-12T02:49:14.579 INFO:teuthology.orchestra.run.smithi039.stdout: "error", 2024-09-12T02:49:14.579 INFO:teuthology.orchestra.run.smithi039.stdout: "info", 2024-09-12T02:49:14.579 INFO:teuthology.orchestra.run.smithi039.stdout: "warning" 2024-09-12T02:49:14.579 INFO:teuthology.orchestra.run.smithi039.stdout: ], 2024-09-12T02:49:14.579 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "", 2024-09-12T02:49:14.580 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-09-12T02:49:14.580 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-09-12T02:49:14.580 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-09-12T02:49:14.580 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-09-12T02:49:14.580 INFO:teuthology.orchestra.run.smithi039.stdout: "log_to_file": { 2024-09-12T02:49:14.580 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "log_to_file", 2024-09-12T02:49:14.580 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "bool", 2024-09-12T02:49:14.580 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "advanced", 2024-09-12T02:49:14.580 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 1, 2024-09-12T02:49:14.580 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "False", 2024-09-12T02:49:14.580 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-09-12T02:49:14.580 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-09-12T02:49:14.580 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [], 2024-09-12T02:49:14.580 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "", 2024-09-12T02:49:14.581 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-09-12T02:49:14.581 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-09-12T02:49:14.581 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-09-12T02:49:14.581 INFO:teuthology.orchestra.run.smithi039.stdout: } 2024-09-12T02:49:14.581 INFO:teuthology.orchestra.run.smithi039.stdout: } 2024-09-12T02:49:14.581 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-09-12T02:49:14.581 INFO:teuthology.orchestra.run.smithi039.stdout: { 2024-09-12T02:49:14.581 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "status", 2024-09-12T02:49:14.581 INFO:teuthology.orchestra.run.smithi039.stdout: "can_run": true, 2024-09-12T02:49:14.581 INFO:teuthology.orchestra.run.smithi039.stdout: "error_string": "", 2024-09-12T02:49:14.581 INFO:teuthology.orchestra.run.smithi039.stdout: "module_options": { 2024-09-12T02:49:14.581 INFO:teuthology.orchestra.run.smithi039.stdout: "log_level": { 2024-09-12T02:49:14.581 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "log_level", 2024-09-12T02:49:14.581 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "str", 2024-09-12T02:49:14.582 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "advanced", 2024-09-12T02:49:14.582 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 1, 2024-09-12T02:49:14.582 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "", 2024-09-12T02:49:14.582 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-09-12T02:49:14.582 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-09-12T02:49:14.582 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [ 2024-09-12T02:49:14.582 INFO:teuthology.orchestra.run.smithi039.stdout: "", 2024-09-12T02:49:14.582 INFO:teuthology.orchestra.run.smithi039.stdout: "critical", 2024-09-12T02:49:14.582 INFO:teuthology.orchestra.run.smithi039.stdout: "debug", 2024-09-12T02:49:14.582 INFO:teuthology.orchestra.run.smithi039.stdout: "error", 2024-09-12T02:49:14.582 INFO:teuthology.orchestra.run.smithi039.stdout: "info", 2024-09-12T02:49:14.582 INFO:teuthology.orchestra.run.smithi039.stdout: "warning" 2024-09-12T02:49:14.582 INFO:teuthology.orchestra.run.smithi039.stdout: ], 2024-09-12T02:49:14.582 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "", 2024-09-12T02:49:14.582 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-09-12T02:49:14.583 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-09-12T02:49:14.583 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-09-12T02:49:14.583 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-09-12T02:49:14.583 INFO:teuthology.orchestra.run.smithi039.stdout: "log_to_cluster": { 2024-09-12T02:49:14.583 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "log_to_cluster", 2024-09-12T02:49:14.583 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "bool", 2024-09-12T02:49:14.583 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "advanced", 2024-09-12T02:49:14.583 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 1, 2024-09-12T02:49:14.583 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "False", 2024-09-12T02:49:14.583 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-09-12T02:49:14.583 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-09-12T02:49:14.583 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [], 2024-09-12T02:49:14.583 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "", 2024-09-12T02:49:14.583 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-09-12T02:49:14.584 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-09-12T02:49:14.584 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-09-12T02:49:14.585 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-09-12T02:49:14.585 INFO:teuthology.orchestra.run.smithi039.stdout: "log_to_cluster_level": { 2024-09-12T02:49:14.585 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "log_to_cluster_level", 2024-09-12T02:49:14.585 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "str", 2024-09-12T02:49:14.585 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "advanced", 2024-09-12T02:49:14.585 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 1, 2024-09-12T02:49:14.585 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "info", 2024-09-12T02:49:14.585 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-09-12T02:49:14.585 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-09-12T02:49:14.585 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [ 2024-09-12T02:49:14.586 INFO:teuthology.orchestra.run.smithi039.stdout: "", 2024-09-12T02:49:14.586 INFO:teuthology.orchestra.run.smithi039.stdout: "critical", 2024-09-12T02:49:14.586 INFO:teuthology.orchestra.run.smithi039.stdout: "debug", 2024-09-12T02:49:14.586 INFO:teuthology.orchestra.run.smithi039.stdout: "error", 2024-09-12T02:49:14.586 INFO:teuthology.orchestra.run.smithi039.stdout: "info", 2024-09-12T02:49:14.586 INFO:teuthology.orchestra.run.smithi039.stdout: "warning" 2024-09-12T02:49:14.586 INFO:teuthology.orchestra.run.smithi039.stdout: ], 2024-09-12T02:49:14.586 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "", 2024-09-12T02:49:14.587 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-09-12T02:49:14.587 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-09-12T02:49:14.587 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-09-12T02:49:14.587 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-09-12T02:49:14.587 INFO:teuthology.orchestra.run.smithi039.stdout: "log_to_file": { 2024-09-12T02:49:14.587 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "log_to_file", 2024-09-12T02:49:14.587 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "bool", 2024-09-12T02:49:14.587 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "advanced", 2024-09-12T02:49:14.587 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 1, 2024-09-12T02:49:14.588 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "False", 2024-09-12T02:49:14.588 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-09-12T02:49:14.588 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-09-12T02:49:14.588 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [], 2024-09-12T02:49:14.588 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "", 2024-09-12T02:49:14.588 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-09-12T02:49:14.588 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-09-12T02:49:14.589 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-09-12T02:49:14.589 INFO:teuthology.orchestra.run.smithi039.stdout: } 2024-09-12T02:49:14.589 INFO:teuthology.orchestra.run.smithi039.stdout: } 2024-09-12T02:49:14.589 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-09-12T02:49:14.589 INFO:teuthology.orchestra.run.smithi039.stdout: { 2024-09-12T02:49:14.589 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "telegraf", 2024-09-12T02:49:14.590 INFO:teuthology.orchestra.run.smithi039.stdout: "can_run": true, 2024-09-12T02:49:14.590 INFO:teuthology.orchestra.run.smithi039.stdout: "error_string": "", 2024-09-12T02:49:14.591 INFO:teuthology.orchestra.run.smithi039.stdout: "module_options": { 2024-09-12T02:49:14.591 INFO:teuthology.orchestra.run.smithi039.stdout: "address": { 2024-09-12T02:49:14.591 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "address", 2024-09-12T02:49:14.591 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "str", 2024-09-12T02:49:14.591 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "advanced", 2024-09-12T02:49:14.591 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 0, 2024-09-12T02:49:14.591 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "unixgram:///tmp/telegraf.sock", 2024-09-12T02:49:14.591 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-09-12T02:49:14.592 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-09-12T02:49:14.592 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [], 2024-09-12T02:49:14.592 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "", 2024-09-12T02:49:14.592 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-09-12T02:49:14.592 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-09-12T02:49:14.592 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-09-12T02:49:14.592 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-09-12T02:49:14.592 INFO:teuthology.orchestra.run.smithi039.stdout: "interval": { 2024-09-12T02:49:14.593 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "interval", 2024-09-12T02:49:14.593 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "secs", 2024-09-12T02:49:14.593 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "advanced", 2024-09-12T02:49:14.593 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 0, 2024-09-12T02:49:14.593 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "15", 2024-09-12T02:49:14.593 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-09-12T02:49:14.595 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-09-12T02:49:14.595 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [], 2024-09-12T02:49:14.595 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "", 2024-09-12T02:49:14.595 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-09-12T02:49:14.595 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-09-12T02:49:14.595 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-09-12T02:49:14.596 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-09-12T02:49:14.596 INFO:teuthology.orchestra.run.smithi039.stdout: "log_level": { 2024-09-12T02:49:14.596 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "log_level", 2024-09-12T02:49:14.596 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "str", 2024-09-12T02:49:14.597 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "advanced", 2024-09-12T02:49:14.597 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 1, 2024-09-12T02:49:14.597 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "", 2024-09-12T02:49:14.597 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-09-12T02:49:14.597 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-09-12T02:49:14.597 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [ 2024-09-12T02:49:14.598 INFO:teuthology.orchestra.run.smithi039.stdout: "", 2024-09-12T02:49:14.598 INFO:teuthology.orchestra.run.smithi039.stdout: "critical", 2024-09-12T02:49:14.598 INFO:teuthology.orchestra.run.smithi039.stdout: "debug", 2024-09-12T02:49:14.598 INFO:teuthology.orchestra.run.smithi039.stdout: "error", 2024-09-12T02:49:14.598 INFO:teuthology.orchestra.run.smithi039.stdout: "info", 2024-09-12T02:49:14.598 INFO:teuthology.orchestra.run.smithi039.stdout: "warning" 2024-09-12T02:49:14.599 INFO:teuthology.orchestra.run.smithi039.stdout: ], 2024-09-12T02:49:14.599 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "", 2024-09-12T02:49:14.599 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-09-12T02:49:14.599 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-09-12T02:49:14.599 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-09-12T02:49:14.599 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-09-12T02:49:14.600 INFO:teuthology.orchestra.run.smithi039.stdout: "log_to_cluster": { 2024-09-12T02:49:14.600 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "log_to_cluster", 2024-09-12T02:49:14.600 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "bool", 2024-09-12T02:49:14.600 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "advanced", 2024-09-12T02:49:14.600 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 1, 2024-09-12T02:49:14.601 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "False", 2024-09-12T02:49:14.601 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-09-12T02:49:14.601 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-09-12T02:49:14.601 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [], 2024-09-12T02:49:14.601 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "", 2024-09-12T02:49:14.601 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-09-12T02:49:14.602 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-09-12T02:49:14.602 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-09-12T02:49:14.602 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-09-12T02:49:14.602 INFO:teuthology.orchestra.run.smithi039.stdout: "log_to_cluster_level": { 2024-09-12T02:49:14.602 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "log_to_cluster_level", 2024-09-12T02:49:14.602 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "str", 2024-09-12T02:49:14.603 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "advanced", 2024-09-12T02:49:14.603 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 1, 2024-09-12T02:49:14.603 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "info", 2024-09-12T02:49:14.603 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-09-12T02:49:14.603 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-09-12T02:49:14.603 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [ 2024-09-12T02:49:14.604 INFO:teuthology.orchestra.run.smithi039.stdout: "", 2024-09-12T02:49:14.604 INFO:teuthology.orchestra.run.smithi039.stdout: "critical", 2024-09-12T02:49:14.604 INFO:teuthology.orchestra.run.smithi039.stdout: "debug", 2024-09-12T02:49:14.604 INFO:teuthology.orchestra.run.smithi039.stdout: "error", 2024-09-12T02:49:14.604 INFO:teuthology.orchestra.run.smithi039.stdout: "info", 2024-09-12T02:49:14.604 INFO:teuthology.orchestra.run.smithi039.stdout: "warning" 2024-09-12T02:49:14.605 INFO:teuthology.orchestra.run.smithi039.stdout: ], 2024-09-12T02:49:14.605 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "", 2024-09-12T02:49:14.605 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-09-12T02:49:14.605 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-09-12T02:49:14.605 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-09-12T02:49:14.605 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-09-12T02:49:14.606 INFO:teuthology.orchestra.run.smithi039.stdout: "log_to_file": { 2024-09-12T02:49:14.606 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "log_to_file", 2024-09-12T02:49:14.606 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "bool", 2024-09-12T02:49:14.606 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "advanced", 2024-09-12T02:49:14.606 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 1, 2024-09-12T02:49:14.606 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "False", 2024-09-12T02:49:14.606 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-09-12T02:49:14.606 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-09-12T02:49:14.606 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [], 2024-09-12T02:49:14.607 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "", 2024-09-12T02:49:14.607 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-09-12T02:49:14.607 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-09-12T02:49:14.607 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-09-12T02:49:14.607 INFO:teuthology.orchestra.run.smithi039.stdout: } 2024-09-12T02:49:14.607 INFO:teuthology.orchestra.run.smithi039.stdout: } 2024-09-12T02:49:14.607 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-09-12T02:49:14.607 INFO:teuthology.orchestra.run.smithi039.stdout: { 2024-09-12T02:49:14.607 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "telemetry", 2024-09-12T02:49:14.607 INFO:teuthology.orchestra.run.smithi039.stdout: "can_run": true, 2024-09-12T02:49:14.607 INFO:teuthology.orchestra.run.smithi039.stdout: "error_string": "", 2024-09-12T02:49:14.607 INFO:teuthology.orchestra.run.smithi039.stdout: "module_options": { 2024-09-12T02:49:14.607 INFO:teuthology.orchestra.run.smithi039.stdout: "channel_basic": { 2024-09-12T02:49:14.607 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "channel_basic", 2024-09-12T02:49:14.608 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "bool", 2024-09-12T02:49:14.608 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "advanced", 2024-09-12T02:49:14.608 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 0, 2024-09-12T02:49:14.608 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "True", 2024-09-12T02:49:14.608 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-09-12T02:49:14.608 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-09-12T02:49:14.608 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [], 2024-09-12T02:49:14.608 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "Share basic cluster information (size, version)", 2024-09-12T02:49:14.608 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-09-12T02:49:14.608 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-09-12T02:49:14.608 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-09-12T02:49:14.608 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-09-12T02:49:14.608 INFO:teuthology.orchestra.run.smithi039.stdout: "channel_crash": { 2024-09-12T02:49:14.608 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "channel_crash", 2024-09-12T02:49:14.609 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "bool", 2024-09-12T02:49:14.609 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "advanced", 2024-09-12T02:49:14.609 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 0, 2024-09-12T02:49:14.609 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "True", 2024-09-12T02:49:14.609 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-09-12T02:49:14.609 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-09-12T02:49:14.609 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [], 2024-09-12T02:49:14.609 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "Share metadata about Ceph daemon crashes (version, stack straces, etc)", 2024-09-12T02:49:14.609 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-09-12T02:49:14.609 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-09-12T02:49:14.609 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-09-12T02:49:14.609 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-09-12T02:49:14.609 INFO:teuthology.orchestra.run.smithi039.stdout: "channel_device": { 2024-09-12T02:49:14.610 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "channel_device", 2024-09-12T02:49:14.610 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "bool", 2024-09-12T02:49:14.610 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "advanced", 2024-09-12T02:49:14.610 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 0, 2024-09-12T02:49:14.610 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "True", 2024-09-12T02:49:14.610 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-09-12T02:49:14.610 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-09-12T02:49:14.610 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [], 2024-09-12T02:49:14.610 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "Share device health metrics (e.g., SMART data, minus potentially identifying info like serial numbers)", 2024-09-12T02:49:14.610 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-09-12T02:49:14.610 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-09-12T02:49:14.610 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-09-12T02:49:14.610 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-09-12T02:49:14.610 INFO:teuthology.orchestra.run.smithi039.stdout: "channel_ident": { 2024-09-12T02:49:14.611 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "channel_ident", 2024-09-12T02:49:14.611 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "bool", 2024-09-12T02:49:14.611 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "advanced", 2024-09-12T02:49:14.611 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 0, 2024-09-12T02:49:14.611 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "False", 2024-09-12T02:49:14.611 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-09-12T02:49:14.611 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-09-12T02:49:14.611 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [], 2024-09-12T02:49:14.611 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "Share a user-provided description and/or contact email for the cluster", 2024-09-12T02:49:14.611 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-09-12T02:49:14.611 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-09-12T02:49:14.611 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-09-12T02:49:14.611 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-09-12T02:49:14.612 INFO:teuthology.orchestra.run.smithi039.stdout: "channel_perf": { 2024-09-12T02:49:14.612 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "channel_perf", 2024-09-12T02:49:14.612 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "bool", 2024-09-12T02:49:14.612 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "advanced", 2024-09-12T02:49:14.612 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 0, 2024-09-12T02:49:14.612 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "False", 2024-09-12T02:49:14.612 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-09-12T02:49:14.612 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-09-12T02:49:14.612 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [], 2024-09-12T02:49:14.612 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "Share various performance metrics of a cluster", 2024-09-12T02:49:14.612 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-09-12T02:49:14.612 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-09-12T02:49:14.612 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-09-12T02:49:14.612 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-09-12T02:49:14.613 INFO:teuthology.orchestra.run.smithi039.stdout: "contact": { 2024-09-12T02:49:14.613 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "contact", 2024-09-12T02:49:14.613 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "str", 2024-09-12T02:49:14.613 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "advanced", 2024-09-12T02:49:14.613 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 0, 2024-09-12T02:49:14.613 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "", 2024-09-12T02:49:14.613 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-09-12T02:49:14.613 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-09-12T02:49:14.613 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [], 2024-09-12T02:49:14.613 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "", 2024-09-12T02:49:14.613 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-09-12T02:49:14.613 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-09-12T02:49:14.613 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-09-12T02:49:14.614 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-09-12T02:49:14.614 INFO:teuthology.orchestra.run.smithi039.stdout: "description": { 2024-09-12T02:49:14.614 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "description", 2024-09-12T02:49:14.614 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "str", 2024-09-12T02:49:14.614 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "advanced", 2024-09-12T02:49:14.614 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 0, 2024-09-12T02:49:14.614 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "", 2024-09-12T02:49:14.614 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-09-12T02:49:14.614 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-09-12T02:49:14.614 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [], 2024-09-12T02:49:14.614 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "", 2024-09-12T02:49:14.614 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-09-12T02:49:14.615 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-09-12T02:49:14.615 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-09-12T02:49:14.615 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-09-12T02:49:14.615 INFO:teuthology.orchestra.run.smithi039.stdout: "device_url": { 2024-09-12T02:49:14.615 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "device_url", 2024-09-12T02:49:14.615 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "str", 2024-09-12T02:49:14.615 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "advanced", 2024-09-12T02:49:14.615 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 0, 2024-09-12T02:49:14.615 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "https://telemetry.ceph.com/device", 2024-09-12T02:49:14.615 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-09-12T02:49:14.615 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-09-12T02:49:14.615 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [], 2024-09-12T02:49:14.615 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "", 2024-09-12T02:49:14.616 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-09-12T02:49:14.616 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-09-12T02:49:14.616 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-09-12T02:49:14.616 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-09-12T02:49:14.616 INFO:teuthology.orchestra.run.smithi039.stdout: "enabled": { 2024-09-12T02:49:14.616 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "enabled", 2024-09-12T02:49:14.616 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "bool", 2024-09-12T02:49:14.616 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "advanced", 2024-09-12T02:49:14.616 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 0, 2024-09-12T02:49:14.616 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "False", 2024-09-12T02:49:14.616 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-09-12T02:49:14.616 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-09-12T02:49:14.616 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [], 2024-09-12T02:49:14.617 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "", 2024-09-12T02:49:14.617 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-09-12T02:49:14.617 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-09-12T02:49:14.617 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-09-12T02:49:14.617 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-09-12T02:49:14.617 INFO:teuthology.orchestra.run.smithi039.stdout: "interval": { 2024-09-12T02:49:14.617 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "interval", 2024-09-12T02:49:14.617 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "int", 2024-09-12T02:49:14.617 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "advanced", 2024-09-12T02:49:14.617 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 0, 2024-09-12T02:49:14.617 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "24", 2024-09-12T02:49:14.617 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "8", 2024-09-12T02:49:14.617 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-09-12T02:49:14.618 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [], 2024-09-12T02:49:14.618 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "", 2024-09-12T02:49:14.618 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-09-12T02:49:14.618 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-09-12T02:49:14.618 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-09-12T02:49:14.618 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-09-12T02:49:14.618 INFO:teuthology.orchestra.run.smithi039.stdout: "last_opt_revision": { 2024-09-12T02:49:14.618 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "last_opt_revision", 2024-09-12T02:49:14.618 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "int", 2024-09-12T02:49:14.618 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "advanced", 2024-09-12T02:49:14.618 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 0, 2024-09-12T02:49:14.618 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "1", 2024-09-12T02:49:14.618 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-09-12T02:49:14.618 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-09-12T02:49:14.619 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [], 2024-09-12T02:49:14.619 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "", 2024-09-12T02:49:14.619 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-09-12T02:49:14.619 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-09-12T02:49:14.619 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-09-12T02:49:14.619 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-09-12T02:49:14.619 INFO:teuthology.orchestra.run.smithi039.stdout: "leaderboard": { 2024-09-12T02:49:14.619 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "leaderboard", 2024-09-12T02:49:14.619 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "bool", 2024-09-12T02:49:14.619 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "advanced", 2024-09-12T02:49:14.619 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 0, 2024-09-12T02:49:14.619 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "False", 2024-09-12T02:49:14.619 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-09-12T02:49:14.620 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-09-12T02:49:14.620 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [], 2024-09-12T02:49:14.620 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "", 2024-09-12T02:49:14.620 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-09-12T02:49:14.620 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-09-12T02:49:14.620 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-09-12T02:49:14.620 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-09-12T02:49:14.620 INFO:teuthology.orchestra.run.smithi039.stdout: "leaderboard_description": { 2024-09-12T02:49:14.620 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "leaderboard_description", 2024-09-12T02:49:14.620 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "str", 2024-09-12T02:49:14.620 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "advanced", 2024-09-12T02:49:14.620 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 0, 2024-09-12T02:49:14.620 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "", 2024-09-12T02:49:14.621 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-09-12T02:49:14.621 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-09-12T02:49:14.621 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [], 2024-09-12T02:49:14.621 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "", 2024-09-12T02:49:14.621 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-09-12T02:49:14.621 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-09-12T02:49:14.621 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-09-12T02:49:14.621 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-09-12T02:49:14.621 INFO:teuthology.orchestra.run.smithi039.stdout: "log_level": { 2024-09-12T02:49:14.621 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "log_level", 2024-09-12T02:49:14.621 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "str", 2024-09-12T02:49:14.621 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "advanced", 2024-09-12T02:49:14.621 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 1, 2024-09-12T02:49:14.621 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "", 2024-09-12T02:49:14.622 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-09-12T02:49:14.622 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-09-12T02:49:14.622 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [ 2024-09-12T02:49:14.622 INFO:teuthology.orchestra.run.smithi039.stdout: "", 2024-09-12T02:49:14.622 INFO:teuthology.orchestra.run.smithi039.stdout: "critical", 2024-09-12T02:49:14.622 INFO:teuthology.orchestra.run.smithi039.stdout: "debug", 2024-09-12T02:49:14.622 INFO:teuthology.orchestra.run.smithi039.stdout: "error", 2024-09-12T02:49:14.622 INFO:teuthology.orchestra.run.smithi039.stdout: "info", 2024-09-12T02:49:14.622 INFO:teuthology.orchestra.run.smithi039.stdout: "warning" 2024-09-12T02:49:14.622 INFO:teuthology.orchestra.run.smithi039.stdout: ], 2024-09-12T02:49:14.622 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "", 2024-09-12T02:49:14.622 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-09-12T02:49:14.622 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-09-12T02:49:14.623 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-09-12T02:49:14.623 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-09-12T02:49:14.623 INFO:teuthology.orchestra.run.smithi039.stdout: "log_to_cluster": { 2024-09-12T02:49:14.623 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "log_to_cluster", 2024-09-12T02:49:14.623 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "bool", 2024-09-12T02:49:14.623 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "advanced", 2024-09-12T02:49:14.623 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 1, 2024-09-12T02:49:14.623 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "False", 2024-09-12T02:49:14.623 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-09-12T02:49:14.623 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-09-12T02:49:14.623 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [], 2024-09-12T02:49:14.623 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "", 2024-09-12T02:49:14.623 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-09-12T02:49:14.623 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-09-12T02:49:14.624 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-09-12T02:49:14.624 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-09-12T02:49:14.624 INFO:teuthology.orchestra.run.smithi039.stdout: "log_to_cluster_level": { 2024-09-12T02:49:14.624 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "log_to_cluster_level", 2024-09-12T02:49:14.624 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "str", 2024-09-12T02:49:14.624 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "advanced", 2024-09-12T02:49:14.624 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 1, 2024-09-12T02:49:14.624 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "info", 2024-09-12T02:49:14.624 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-09-12T02:49:14.624 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-09-12T02:49:14.624 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [ 2024-09-12T02:49:14.624 INFO:teuthology.orchestra.run.smithi039.stdout: "", 2024-09-12T02:49:14.624 INFO:teuthology.orchestra.run.smithi039.stdout: "critical", 2024-09-12T02:49:14.624 INFO:teuthology.orchestra.run.smithi039.stdout: "debug", 2024-09-12T02:49:14.625 INFO:teuthology.orchestra.run.smithi039.stdout: "error", 2024-09-12T02:49:14.625 INFO:teuthology.orchestra.run.smithi039.stdout: "info", 2024-09-12T02:49:14.625 INFO:teuthology.orchestra.run.smithi039.stdout: "warning" 2024-09-12T02:49:14.625 INFO:teuthology.orchestra.run.smithi039.stdout: ], 2024-09-12T02:49:14.625 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "", 2024-09-12T02:49:14.625 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-09-12T02:49:14.625 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-09-12T02:49:14.625 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-09-12T02:49:14.625 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-09-12T02:49:14.625 INFO:teuthology.orchestra.run.smithi039.stdout: "log_to_file": { 2024-09-12T02:49:14.625 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "log_to_file", 2024-09-12T02:49:14.625 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "bool", 2024-09-12T02:49:14.625 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "advanced", 2024-09-12T02:49:14.626 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 1, 2024-09-12T02:49:14.626 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "False", 2024-09-12T02:49:14.626 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-09-12T02:49:14.626 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-09-12T02:49:14.626 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [], 2024-09-12T02:49:14.626 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "", 2024-09-12T02:49:14.626 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-09-12T02:49:14.626 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-09-12T02:49:14.626 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-09-12T02:49:14.626 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-09-12T02:49:14.626 INFO:teuthology.orchestra.run.smithi039.stdout: "organization": { 2024-09-12T02:49:14.626 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "organization", 2024-09-12T02:49:14.626 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "str", 2024-09-12T02:49:14.626 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "advanced", 2024-09-12T02:49:14.626 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 0, 2024-09-12T02:49:14.627 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "", 2024-09-12T02:49:14.627 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-09-12T02:49:14.627 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-09-12T02:49:14.627 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [], 2024-09-12T02:49:14.627 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "", 2024-09-12T02:49:14.627 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-09-12T02:49:14.627 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-09-12T02:49:14.627 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-09-12T02:49:14.627 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-09-12T02:49:14.627 INFO:teuthology.orchestra.run.smithi039.stdout: "proxy": { 2024-09-12T02:49:14.627 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "proxy", 2024-09-12T02:49:14.627 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "str", 2024-09-12T02:49:14.627 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "advanced", 2024-09-12T02:49:14.627 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 0, 2024-09-12T02:49:14.628 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "", 2024-09-12T02:49:14.628 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-09-12T02:49:14.628 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-09-12T02:49:14.628 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [], 2024-09-12T02:49:14.628 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "", 2024-09-12T02:49:14.628 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-09-12T02:49:14.628 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-09-12T02:49:14.628 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-09-12T02:49:14.628 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-09-12T02:49:14.628 INFO:teuthology.orchestra.run.smithi039.stdout: "url": { 2024-09-12T02:49:14.628 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "url", 2024-09-12T02:49:14.628 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "str", 2024-09-12T02:49:14.629 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "advanced", 2024-09-12T02:49:14.629 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 0, 2024-09-12T02:49:14.629 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "https://telemetry.ceph.com/report", 2024-09-12T02:49:14.629 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-09-12T02:49:14.629 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-09-12T02:49:14.629 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [], 2024-09-12T02:49:14.629 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "", 2024-09-12T02:49:14.629 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-09-12T02:49:14.629 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-09-12T02:49:14.629 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-09-12T02:49:14.629 INFO:teuthology.orchestra.run.smithi039.stdout: } 2024-09-12T02:49:14.629 INFO:teuthology.orchestra.run.smithi039.stdout: } 2024-09-12T02:49:14.629 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-09-12T02:49:14.629 INFO:teuthology.orchestra.run.smithi039.stdout: { 2024-09-12T02:49:14.630 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "test_orchestrator", 2024-09-12T02:49:14.630 INFO:teuthology.orchestra.run.smithi039.stdout: "can_run": true, 2024-09-12T02:49:14.630 INFO:teuthology.orchestra.run.smithi039.stdout: "error_string": "", 2024-09-12T02:49:14.630 INFO:teuthology.orchestra.run.smithi039.stdout: "module_options": { 2024-09-12T02:49:14.630 INFO:teuthology.orchestra.run.smithi039.stdout: "log_level": { 2024-09-12T02:49:14.630 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "log_level", 2024-09-12T02:49:14.630 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "str", 2024-09-12T02:49:14.630 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "advanced", 2024-09-12T02:49:14.630 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 1, 2024-09-12T02:49:14.630 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "", 2024-09-12T02:49:14.630 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-09-12T02:49:14.630 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-09-12T02:49:14.630 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [ 2024-09-12T02:49:14.631 INFO:teuthology.orchestra.run.smithi039.stdout: "", 2024-09-12T02:49:14.631 INFO:teuthology.orchestra.run.smithi039.stdout: "critical", 2024-09-12T02:49:14.631 INFO:teuthology.orchestra.run.smithi039.stdout: "debug", 2024-09-12T02:49:14.631 INFO:teuthology.orchestra.run.smithi039.stdout: "error", 2024-09-12T02:49:14.631 INFO:teuthology.orchestra.run.smithi039.stdout: "info", 2024-09-12T02:49:14.631 INFO:teuthology.orchestra.run.smithi039.stdout: "warning" 2024-09-12T02:49:14.631 INFO:teuthology.orchestra.run.smithi039.stdout: ], 2024-09-12T02:49:14.631 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "", 2024-09-12T02:49:14.631 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-09-12T02:49:14.631 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-09-12T02:49:14.631 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-09-12T02:49:14.631 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-09-12T02:49:14.631 INFO:teuthology.orchestra.run.smithi039.stdout: "log_to_cluster": { 2024-09-12T02:49:14.631 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "log_to_cluster", 2024-09-12T02:49:14.632 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "bool", 2024-09-12T02:49:14.632 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "advanced", 2024-09-12T02:49:14.632 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 1, 2024-09-12T02:49:14.632 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "False", 2024-09-12T02:49:14.632 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-09-12T02:49:14.632 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-09-12T02:49:14.632 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [], 2024-09-12T02:49:14.632 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "", 2024-09-12T02:49:14.632 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-09-12T02:49:14.632 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-09-12T02:49:14.632 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-09-12T02:49:14.632 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-09-12T02:49:14.632 INFO:teuthology.orchestra.run.smithi039.stdout: "log_to_cluster_level": { 2024-09-12T02:49:14.633 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "log_to_cluster_level", 2024-09-12T02:49:14.633 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "str", 2024-09-12T02:49:14.633 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "advanced", 2024-09-12T02:49:14.633 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 1, 2024-09-12T02:49:14.633 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "info", 2024-09-12T02:49:14.633 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-09-12T02:49:14.633 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-09-12T02:49:14.633 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [ 2024-09-12T02:49:14.633 INFO:teuthology.orchestra.run.smithi039.stdout: "", 2024-09-12T02:49:14.633 INFO:teuthology.orchestra.run.smithi039.stdout: "critical", 2024-09-12T02:49:14.633 INFO:teuthology.orchestra.run.smithi039.stdout: "debug", 2024-09-12T02:49:14.633 INFO:teuthology.orchestra.run.smithi039.stdout: "error", 2024-09-12T02:49:14.633 INFO:teuthology.orchestra.run.smithi039.stdout: "info", 2024-09-12T02:49:14.633 INFO:teuthology.orchestra.run.smithi039.stdout: "warning" 2024-09-12T02:49:14.634 INFO:teuthology.orchestra.run.smithi039.stdout: ], 2024-09-12T02:49:14.634 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "", 2024-09-12T02:49:14.634 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-09-12T02:49:14.634 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-09-12T02:49:14.634 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-09-12T02:49:14.634 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-09-12T02:49:14.634 INFO:teuthology.orchestra.run.smithi039.stdout: "log_to_file": { 2024-09-12T02:49:14.634 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "log_to_file", 2024-09-12T02:49:14.634 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "bool", 2024-09-12T02:49:14.634 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "advanced", 2024-09-12T02:49:14.634 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 1, 2024-09-12T02:49:14.634 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "False", 2024-09-12T02:49:14.634 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-09-12T02:49:14.635 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-09-12T02:49:14.635 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [], 2024-09-12T02:49:14.635 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "", 2024-09-12T02:49:14.635 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-09-12T02:49:14.635 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-09-12T02:49:14.635 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-09-12T02:49:14.635 INFO:teuthology.orchestra.run.smithi039.stdout: } 2024-09-12T02:49:14.635 INFO:teuthology.orchestra.run.smithi039.stdout: } 2024-09-12T02:49:14.635 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-09-12T02:49:14.635 INFO:teuthology.orchestra.run.smithi039.stdout: { 2024-09-12T02:49:14.635 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "volumes", 2024-09-12T02:49:14.635 INFO:teuthology.orchestra.run.smithi039.stdout: "can_run": true, 2024-09-12T02:49:14.635 INFO:teuthology.orchestra.run.smithi039.stdout: "error_string": "", 2024-09-12T02:49:14.635 INFO:teuthology.orchestra.run.smithi039.stdout: "module_options": { 2024-09-12T02:49:14.636 INFO:teuthology.orchestra.run.smithi039.stdout: "log_level": { 2024-09-12T02:49:14.636 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "log_level", 2024-09-12T02:49:14.636 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "str", 2024-09-12T02:49:14.636 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "advanced", 2024-09-12T02:49:14.636 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 1, 2024-09-12T02:49:14.636 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "", 2024-09-12T02:49:14.636 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-09-12T02:49:14.636 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-09-12T02:49:14.636 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [ 2024-09-12T02:49:14.636 INFO:teuthology.orchestra.run.smithi039.stdout: "", 2024-09-12T02:49:14.636 INFO:teuthology.orchestra.run.smithi039.stdout: "critical", 2024-09-12T02:49:14.636 INFO:teuthology.orchestra.run.smithi039.stdout: "debug", 2024-09-12T02:49:14.636 INFO:teuthology.orchestra.run.smithi039.stdout: "error", 2024-09-12T02:49:14.637 INFO:teuthology.orchestra.run.smithi039.stdout: "info", 2024-09-12T02:49:14.637 INFO:teuthology.orchestra.run.smithi039.stdout: "warning" 2024-09-12T02:49:14.637 INFO:teuthology.orchestra.run.smithi039.stdout: ], 2024-09-12T02:49:14.637 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "", 2024-09-12T02:49:14.637 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-09-12T02:49:14.637 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-09-12T02:49:14.637 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-09-12T02:49:14.637 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-09-12T02:49:14.637 INFO:teuthology.orchestra.run.smithi039.stdout: "log_to_cluster": { 2024-09-12T02:49:14.637 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "log_to_cluster", 2024-09-12T02:49:14.637 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "bool", 2024-09-12T02:49:14.637 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "advanced", 2024-09-12T02:49:14.637 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 1, 2024-09-12T02:49:14.637 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "False", 2024-09-12T02:49:14.638 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-09-12T02:49:14.638 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-09-12T02:49:14.638 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [], 2024-09-12T02:49:14.638 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "", 2024-09-12T02:49:14.638 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-09-12T02:49:14.638 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-09-12T02:49:14.638 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-09-12T02:49:14.638 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-09-12T02:49:14.638 INFO:teuthology.orchestra.run.smithi039.stdout: "log_to_cluster_level": { 2024-09-12T02:49:14.638 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "log_to_cluster_level", 2024-09-12T02:49:14.638 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "str", 2024-09-12T02:49:14.638 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "advanced", 2024-09-12T02:49:14.638 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 1, 2024-09-12T02:49:14.638 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "info", 2024-09-12T02:49:14.639 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-09-12T02:49:14.639 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-09-12T02:49:14.639 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [ 2024-09-12T02:49:14.639 INFO:teuthology.orchestra.run.smithi039.stdout: "", 2024-09-12T02:49:14.639 INFO:teuthology.orchestra.run.smithi039.stdout: "critical", 2024-09-12T02:49:14.639 INFO:teuthology.orchestra.run.smithi039.stdout: "debug", 2024-09-12T02:49:14.639 INFO:teuthology.orchestra.run.smithi039.stdout: "error", 2024-09-12T02:49:14.639 INFO:teuthology.orchestra.run.smithi039.stdout: "info", 2024-09-12T02:49:14.639 INFO:teuthology.orchestra.run.smithi039.stdout: "warning" 2024-09-12T02:49:14.639 INFO:teuthology.orchestra.run.smithi039.stdout: ], 2024-09-12T02:49:14.639 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "", 2024-09-12T02:49:14.639 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-09-12T02:49:14.639 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-09-12T02:49:14.639 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-09-12T02:49:14.639 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-09-12T02:49:14.640 INFO:teuthology.orchestra.run.smithi039.stdout: "log_to_file": { 2024-09-12T02:49:14.640 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "log_to_file", 2024-09-12T02:49:14.640 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "bool", 2024-09-12T02:49:14.640 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "advanced", 2024-09-12T02:49:14.640 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 1, 2024-09-12T02:49:14.640 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "False", 2024-09-12T02:49:14.640 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-09-12T02:49:14.640 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-09-12T02:49:14.640 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [], 2024-09-12T02:49:14.640 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "", 2024-09-12T02:49:14.640 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-09-12T02:49:14.640 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-09-12T02:49:14.640 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-09-12T02:49:14.640 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-09-12T02:49:14.641 INFO:teuthology.orchestra.run.smithi039.stdout: "max_concurrent_clones": { 2024-09-12T02:49:14.641 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "max_concurrent_clones", 2024-09-12T02:49:14.641 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "int", 2024-09-12T02:49:14.641 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "advanced", 2024-09-12T02:49:14.641 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 0, 2024-09-12T02:49:14.641 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "4", 2024-09-12T02:49:14.641 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-09-12T02:49:14.641 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-09-12T02:49:14.641 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [], 2024-09-12T02:49:14.641 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "Number of asynchronous cloner threads", 2024-09-12T02:49:14.641 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-09-12T02:49:14.641 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-09-12T02:49:14.641 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-09-12T02:49:14.641 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-09-12T02:49:14.642 INFO:teuthology.orchestra.run.smithi039.stdout: "periodic_async_work": { 2024-09-12T02:49:14.642 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "periodic_async_work", 2024-09-12T02:49:14.642 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "bool", 2024-09-12T02:49:14.642 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "advanced", 2024-09-12T02:49:14.642 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 0, 2024-09-12T02:49:14.642 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "False", 2024-09-12T02:49:14.642 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-09-12T02:49:14.642 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-09-12T02:49:14.642 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [], 2024-09-12T02:49:14.642 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "Periodically check for async work", 2024-09-12T02:49:14.642 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-09-12T02:49:14.642 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-09-12T02:49:14.643 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-09-12T02:49:14.643 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-09-12T02:49:14.643 INFO:teuthology.orchestra.run.smithi039.stdout: "snapshot_clone_delay": { 2024-09-12T02:49:14.643 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "snapshot_clone_delay", 2024-09-12T02:49:14.643 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "int", 2024-09-12T02:49:14.643 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "advanced", 2024-09-12T02:49:14.643 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 0, 2024-09-12T02:49:14.643 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "0", 2024-09-12T02:49:14.643 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-09-12T02:49:14.643 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-09-12T02:49:14.643 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [], 2024-09-12T02:49:14.643 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "Delay clone begin operation by snapshot_clone_delay seconds", 2024-09-12T02:49:14.643 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-09-12T02:49:14.643 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-09-12T02:49:14.644 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-09-12T02:49:14.644 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-09-12T02:49:14.644 INFO:teuthology.orchestra.run.smithi039.stdout: "snapshot_clone_no_wait": { 2024-09-12T02:49:14.644 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "snapshot_clone_no_wait", 2024-09-12T02:49:14.644 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "bool", 2024-09-12T02:49:14.644 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "advanced", 2024-09-12T02:49:14.644 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 0, 2024-09-12T02:49:14.644 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "True", 2024-09-12T02:49:14.644 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-09-12T02:49:14.644 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-09-12T02:49:14.644 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [], 2024-09-12T02:49:14.644 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "Reject subvolume clone request when cloner threads are busy", 2024-09-12T02:49:14.644 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-09-12T02:49:14.645 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-09-12T02:49:14.645 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-09-12T02:49:14.645 INFO:teuthology.orchestra.run.smithi039.stdout: } 2024-09-12T02:49:14.645 INFO:teuthology.orchestra.run.smithi039.stdout: } 2024-09-12T02:49:14.645 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-09-12T02:49:14.645 INFO:teuthology.orchestra.run.smithi039.stdout: { 2024-09-12T02:49:14.645 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "zabbix", 2024-09-12T02:49:14.645 INFO:teuthology.orchestra.run.smithi039.stdout: "can_run": true, 2024-09-12T02:49:14.645 INFO:teuthology.orchestra.run.smithi039.stdout: "error_string": "", 2024-09-12T02:49:14.645 INFO:teuthology.orchestra.run.smithi039.stdout: "module_options": { 2024-09-12T02:49:14.645 INFO:teuthology.orchestra.run.smithi039.stdout: "discovery_interval": { 2024-09-12T02:49:14.645 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "discovery_interval", 2024-09-12T02:49:14.645 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "uint", 2024-09-12T02:49:14.645 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "advanced", 2024-09-12T02:49:14.646 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 0, 2024-09-12T02:49:14.646 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "100", 2024-09-12T02:49:14.646 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-09-12T02:49:14.646 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-09-12T02:49:14.646 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [], 2024-09-12T02:49:14.646 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "", 2024-09-12T02:49:14.646 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-09-12T02:49:14.646 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-09-12T02:49:14.647 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-09-12T02:49:14.647 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-09-12T02:49:14.647 INFO:teuthology.orchestra.run.smithi039.stdout: "identifier": { 2024-09-12T02:49:14.647 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "identifier", 2024-09-12T02:49:14.647 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "str", 2024-09-12T02:49:14.647 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "advanced", 2024-09-12T02:49:14.647 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 0, 2024-09-12T02:49:14.647 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "", 2024-09-12T02:49:14.647 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-09-12T02:49:14.647 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-09-12T02:49:14.647 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [], 2024-09-12T02:49:14.647 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "", 2024-09-12T02:49:14.647 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-09-12T02:49:14.648 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-09-12T02:49:14.648 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-09-12T02:49:14.648 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-09-12T02:49:14.648 INFO:teuthology.orchestra.run.smithi039.stdout: "interval": { 2024-09-12T02:49:14.648 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "interval", 2024-09-12T02:49:14.648 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "secs", 2024-09-12T02:49:14.648 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "advanced", 2024-09-12T02:49:14.648 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 0, 2024-09-12T02:49:14.648 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "60", 2024-09-12T02:49:14.648 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-09-12T02:49:14.648 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-09-12T02:49:14.648 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [], 2024-09-12T02:49:14.648 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "", 2024-09-12T02:49:14.649 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-09-12T02:49:14.649 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-09-12T02:49:14.649 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-09-12T02:49:14.649 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-09-12T02:49:14.649 INFO:teuthology.orchestra.run.smithi039.stdout: "log_level": { 2024-09-12T02:49:14.649 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "log_level", 2024-09-12T02:49:14.649 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "str", 2024-09-12T02:49:14.649 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "advanced", 2024-09-12T02:49:14.649 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 1, 2024-09-12T02:49:14.649 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "", 2024-09-12T02:49:14.649 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-09-12T02:49:14.649 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-09-12T02:49:14.649 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [ 2024-09-12T02:49:14.649 INFO:teuthology.orchestra.run.smithi039.stdout: "", 2024-09-12T02:49:14.650 INFO:teuthology.orchestra.run.smithi039.stdout: "critical", 2024-09-12T02:49:14.650 INFO:teuthology.orchestra.run.smithi039.stdout: "debug", 2024-09-12T02:49:14.650 INFO:teuthology.orchestra.run.smithi039.stdout: "error", 2024-09-12T02:49:14.650 INFO:teuthology.orchestra.run.smithi039.stdout: "info", 2024-09-12T02:49:14.650 INFO:teuthology.orchestra.run.smithi039.stdout: "warning" 2024-09-12T02:49:14.650 INFO:teuthology.orchestra.run.smithi039.stdout: ], 2024-09-12T02:49:14.650 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "", 2024-09-12T02:49:14.650 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-09-12T02:49:14.650 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-09-12T02:49:14.650 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-09-12T02:49:14.650 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-09-12T02:49:14.650 INFO:teuthology.orchestra.run.smithi039.stdout: "log_to_cluster": { 2024-09-12T02:49:14.650 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "log_to_cluster", 2024-09-12T02:49:14.650 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "bool", 2024-09-12T02:49:14.651 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "advanced", 2024-09-12T02:49:14.651 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 1, 2024-09-12T02:49:14.651 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "False", 2024-09-12T02:49:14.651 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-09-12T02:49:14.651 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-09-12T02:49:14.651 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [], 2024-09-12T02:49:14.651 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "", 2024-09-12T02:49:14.651 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-09-12T02:49:14.651 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-09-12T02:49:14.651 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-09-12T02:49:14.651 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-09-12T02:49:14.651 INFO:teuthology.orchestra.run.smithi039.stdout: "log_to_cluster_level": { 2024-09-12T02:49:14.651 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "log_to_cluster_level", 2024-09-12T02:49:14.651 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "str", 2024-09-12T02:49:14.652 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "advanced", 2024-09-12T02:49:14.652 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 1, 2024-09-12T02:49:14.652 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "info", 2024-09-12T02:49:14.652 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-09-12T02:49:14.652 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-09-12T02:49:14.652 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [ 2024-09-12T02:49:14.652 INFO:teuthology.orchestra.run.smithi039.stdout: "", 2024-09-12T02:49:14.652 INFO:teuthology.orchestra.run.smithi039.stdout: "critical", 2024-09-12T02:49:14.652 INFO:teuthology.orchestra.run.smithi039.stdout: "debug", 2024-09-12T02:49:14.652 INFO:teuthology.orchestra.run.smithi039.stdout: "error", 2024-09-12T02:49:14.652 INFO:teuthology.orchestra.run.smithi039.stdout: "info", 2024-09-12T02:49:14.652 INFO:teuthology.orchestra.run.smithi039.stdout: "warning" 2024-09-12T02:49:14.652 INFO:teuthology.orchestra.run.smithi039.stdout: ], 2024-09-12T02:49:14.652 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "", 2024-09-12T02:49:14.653 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-09-12T02:49:14.653 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-09-12T02:49:14.653 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-09-12T02:49:14.653 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-09-12T02:49:14.653 INFO:teuthology.orchestra.run.smithi039.stdout: "log_to_file": { 2024-09-12T02:49:14.653 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "log_to_file", 2024-09-12T02:49:14.653 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "bool", 2024-09-12T02:49:14.653 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "advanced", 2024-09-12T02:49:14.653 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 1, 2024-09-12T02:49:14.653 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "False", 2024-09-12T02:49:14.653 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-09-12T02:49:14.653 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-09-12T02:49:14.653 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [], 2024-09-12T02:49:14.653 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "", 2024-09-12T02:49:14.654 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-09-12T02:49:14.654 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-09-12T02:49:14.654 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-09-12T02:49:14.654 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-09-12T02:49:14.654 INFO:teuthology.orchestra.run.smithi039.stdout: "zabbix_host": { 2024-09-12T02:49:14.654 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "zabbix_host", 2024-09-12T02:49:14.654 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "str", 2024-09-12T02:49:14.654 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "advanced", 2024-09-12T02:49:14.654 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 0, 2024-09-12T02:49:14.654 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "", 2024-09-12T02:49:14.654 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-09-12T02:49:14.654 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-09-12T02:49:14.654 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [], 2024-09-12T02:49:14.654 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "", 2024-09-12T02:49:14.655 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-09-12T02:49:14.655 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-09-12T02:49:14.655 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-09-12T02:49:14.655 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-09-12T02:49:14.655 INFO:teuthology.orchestra.run.smithi039.stdout: "zabbix_port": { 2024-09-12T02:49:14.655 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "zabbix_port", 2024-09-12T02:49:14.655 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "int", 2024-09-12T02:49:14.655 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "advanced", 2024-09-12T02:49:14.655 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 0, 2024-09-12T02:49:14.655 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "10051", 2024-09-12T02:49:14.655 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-09-12T02:49:14.655 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-09-12T02:49:14.655 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [], 2024-09-12T02:49:14.655 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "", 2024-09-12T02:49:14.656 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-09-12T02:49:14.656 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-09-12T02:49:14.656 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-09-12T02:49:14.656 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-09-12T02:49:14.656 INFO:teuthology.orchestra.run.smithi039.stdout: "zabbix_sender": { 2024-09-12T02:49:14.656 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "zabbix_sender", 2024-09-12T02:49:14.656 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "str", 2024-09-12T02:49:14.656 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "advanced", 2024-09-12T02:49:14.656 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 0, 2024-09-12T02:49:14.656 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "/usr/bin/zabbix_sender", 2024-09-12T02:49:14.656 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-09-12T02:49:14.656 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-09-12T02:49:14.656 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [], 2024-09-12T02:49:14.657 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "", 2024-09-12T02:49:14.657 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-09-12T02:49:14.657 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-09-12T02:49:14.657 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-09-12T02:49:14.657 INFO:teuthology.orchestra.run.smithi039.stdout: } 2024-09-12T02:49:14.657 INFO:teuthology.orchestra.run.smithi039.stdout: } 2024-09-12T02:49:14.657 INFO:teuthology.orchestra.run.smithi039.stdout: } 2024-09-12T02:49:14.657 INFO:teuthology.orchestra.run.smithi039.stdout: ] 2024-09-12T02:49:14.657 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-09-12T02:49:14.657 INFO:teuthology.orchestra.run.smithi039.stdout: { 2024-09-12T02:49:14.657 INFO:teuthology.orchestra.run.smithi039.stdout: "gid": 25198, 2024-09-12T02:49:14.657 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "z", 2024-09-12T02:49:14.657 INFO:teuthology.orchestra.run.smithi039.stdout: "mgr_features": 4540701547738038271, 2024-09-12T02:49:14.658 INFO:teuthology.orchestra.run.smithi039.stdout: "available_modules": [ 2024-09-12T02:49:14.658 INFO:teuthology.orchestra.run.smithi039.stdout: { 2024-09-12T02:49:14.658 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "alerts", 2024-09-12T02:49:14.658 INFO:teuthology.orchestra.run.smithi039.stdout: "can_run": true, 2024-09-12T02:49:14.658 INFO:teuthology.orchestra.run.smithi039.stdout: "error_string": "", 2024-09-12T02:49:14.658 INFO:teuthology.orchestra.run.smithi039.stdout: "module_options": { 2024-09-12T02:49:14.658 INFO:teuthology.orchestra.run.smithi039.stdout: "interval": { 2024-09-12T02:49:14.658 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "interval", 2024-09-12T02:49:14.658 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "secs", 2024-09-12T02:49:14.658 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "advanced", 2024-09-12T02:49:14.658 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 1, 2024-09-12T02:49:14.658 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "60", 2024-09-12T02:49:14.658 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-09-12T02:49:14.658 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-09-12T02:49:14.659 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [], 2024-09-12T02:49:14.659 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "How frequently to reexamine health status", 2024-09-12T02:49:14.659 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-09-12T02:49:14.659 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-09-12T02:49:14.659 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-09-12T02:49:14.659 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-09-12T02:49:14.659 INFO:teuthology.orchestra.run.smithi039.stdout: "log_level": { 2024-09-12T02:49:14.659 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "log_level", 2024-09-12T02:49:14.659 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "str", 2024-09-12T02:49:14.659 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "advanced", 2024-09-12T02:49:14.659 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 1, 2024-09-12T02:49:14.659 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "", 2024-09-12T02:49:14.659 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-09-12T02:49:14.660 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-09-12T02:49:14.660 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [ 2024-09-12T02:49:14.660 INFO:teuthology.orchestra.run.smithi039.stdout: "", 2024-09-12T02:49:14.660 INFO:teuthology.orchestra.run.smithi039.stdout: "critical", 2024-09-12T02:49:14.660 INFO:teuthology.orchestra.run.smithi039.stdout: "debug", 2024-09-12T02:49:14.660 INFO:teuthology.orchestra.run.smithi039.stdout: "error", 2024-09-12T02:49:14.660 INFO:teuthology.orchestra.run.smithi039.stdout: "info", 2024-09-12T02:49:14.660 INFO:teuthology.orchestra.run.smithi039.stdout: "warning" 2024-09-12T02:49:14.660 INFO:teuthology.orchestra.run.smithi039.stdout: ], 2024-09-12T02:49:14.660 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "", 2024-09-12T02:49:14.660 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-09-12T02:49:14.660 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-09-12T02:49:14.660 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-09-12T02:49:14.661 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-09-12T02:49:14.661 INFO:teuthology.orchestra.run.smithi039.stdout: "log_to_cluster": { 2024-09-12T02:49:14.661 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "log_to_cluster", 2024-09-12T02:49:14.661 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "bool", 2024-09-12T02:49:14.661 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "advanced", 2024-09-12T02:49:14.661 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 1, 2024-09-12T02:49:14.661 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "False", 2024-09-12T02:49:14.661 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-09-12T02:49:14.661 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-09-12T02:49:14.661 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [], 2024-09-12T02:49:14.661 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "", 2024-09-12T02:49:14.661 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-09-12T02:49:14.661 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-09-12T02:49:14.661 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-09-12T02:49:14.662 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-09-12T02:49:14.662 INFO:teuthology.orchestra.run.smithi039.stdout: "log_to_cluster_level": { 2024-09-12T02:49:14.662 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "log_to_cluster_level", 2024-09-12T02:49:14.662 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "str", 2024-09-12T02:49:14.662 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "advanced", 2024-09-12T02:49:14.662 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 1, 2024-09-12T02:49:14.662 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "info", 2024-09-12T02:49:14.662 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-09-12T02:49:14.662 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-09-12T02:49:14.662 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [ 2024-09-12T02:49:14.662 INFO:teuthology.orchestra.run.smithi039.stdout: "", 2024-09-12T02:49:14.662 INFO:teuthology.orchestra.run.smithi039.stdout: "critical", 2024-09-12T02:49:14.662 INFO:teuthology.orchestra.run.smithi039.stdout: "debug", 2024-09-12T02:49:14.662 INFO:teuthology.orchestra.run.smithi039.stdout: "error", 2024-09-12T02:49:14.663 INFO:teuthology.orchestra.run.smithi039.stdout: "info", 2024-09-12T02:49:14.663 INFO:teuthology.orchestra.run.smithi039.stdout: "warning" 2024-09-12T02:49:14.663 INFO:teuthology.orchestra.run.smithi039.stdout: ], 2024-09-12T02:49:14.663 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "", 2024-09-12T02:49:14.663 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-09-12T02:49:14.663 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-09-12T02:49:14.663 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-09-12T02:49:14.663 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-09-12T02:49:14.663 INFO:teuthology.orchestra.run.smithi039.stdout: "log_to_file": { 2024-09-12T02:49:14.663 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "log_to_file", 2024-09-12T02:49:14.663 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "bool", 2024-09-12T02:49:14.663 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "advanced", 2024-09-12T02:49:14.663 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 1, 2024-09-12T02:49:14.664 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "False", 2024-09-12T02:49:14.664 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-09-12T02:49:14.664 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-09-12T02:49:14.664 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [], 2024-09-12T02:49:14.664 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "", 2024-09-12T02:49:14.664 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-09-12T02:49:14.664 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-09-12T02:49:14.664 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-09-12T02:49:14.664 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-09-12T02:49:14.664 INFO:teuthology.orchestra.run.smithi039.stdout: "smtp_destination": { 2024-09-12T02:49:14.664 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "smtp_destination", 2024-09-12T02:49:14.664 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "str", 2024-09-12T02:49:14.664 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "advanced", 2024-09-12T02:49:14.665 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 1, 2024-09-12T02:49:14.665 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "", 2024-09-12T02:49:14.665 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-09-12T02:49:14.665 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-09-12T02:49:14.665 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [], 2024-09-12T02:49:14.665 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "Email address to send alerts to", 2024-09-12T02:49:14.665 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-09-12T02:49:14.665 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-09-12T02:49:14.665 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-09-12T02:49:14.665 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-09-12T02:49:14.665 INFO:teuthology.orchestra.run.smithi039.stdout: "smtp_from_name": { 2024-09-12T02:49:14.665 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "smtp_from_name", 2024-09-12T02:49:14.665 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "str", 2024-09-12T02:49:14.665 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "advanced", 2024-09-12T02:49:14.666 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 1, 2024-09-12T02:49:14.666 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "Ceph", 2024-09-12T02:49:14.666 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-09-12T02:49:14.666 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-09-12T02:49:14.666 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [], 2024-09-12T02:49:14.666 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "Email From: name", 2024-09-12T02:49:14.666 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-09-12T02:49:14.666 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-09-12T02:49:14.666 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-09-12T02:49:14.666 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-09-12T02:49:14.666 INFO:teuthology.orchestra.run.smithi039.stdout: "smtp_host": { 2024-09-12T02:49:14.666 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "smtp_host", 2024-09-12T02:49:14.666 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "str", 2024-09-12T02:49:14.666 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "advanced", 2024-09-12T02:49:14.667 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 1, 2024-09-12T02:49:14.667 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "", 2024-09-12T02:49:14.667 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-09-12T02:49:14.667 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-09-12T02:49:14.667 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [], 2024-09-12T02:49:14.667 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "SMTP server", 2024-09-12T02:49:14.667 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-09-12T02:49:14.667 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-09-12T02:49:14.667 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-09-12T02:49:14.667 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-09-12T02:49:14.667 INFO:teuthology.orchestra.run.smithi039.stdout: "smtp_password": { 2024-09-12T02:49:14.667 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "smtp_password", 2024-09-12T02:49:14.667 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "str", 2024-09-12T02:49:14.667 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "advanced", 2024-09-12T02:49:14.668 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 1, 2024-09-12T02:49:14.668 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "", 2024-09-12T02:49:14.668 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-09-12T02:49:14.668 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-09-12T02:49:14.668 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [], 2024-09-12T02:49:14.668 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "Password to authenticate with", 2024-09-12T02:49:14.668 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-09-12T02:49:14.668 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-09-12T02:49:14.668 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-09-12T02:49:14.668 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-09-12T02:49:14.668 INFO:teuthology.orchestra.run.smithi039.stdout: "smtp_port": { 2024-09-12T02:49:14.668 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "smtp_port", 2024-09-12T02:49:14.668 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "int", 2024-09-12T02:49:14.668 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "advanced", 2024-09-12T02:49:14.669 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 1, 2024-09-12T02:49:14.669 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "465", 2024-09-12T02:49:14.669 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-09-12T02:49:14.669 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-09-12T02:49:14.669 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [], 2024-09-12T02:49:14.669 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "SMTP port", 2024-09-12T02:49:14.669 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-09-12T02:49:14.669 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-09-12T02:49:14.669 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-09-12T02:49:14.669 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-09-12T02:49:14.669 INFO:teuthology.orchestra.run.smithi039.stdout: "smtp_sender": { 2024-09-12T02:49:14.669 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "smtp_sender", 2024-09-12T02:49:14.669 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "str", 2024-09-12T02:49:14.669 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "advanced", 2024-09-12T02:49:14.670 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 1, 2024-09-12T02:49:14.670 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "", 2024-09-12T02:49:14.670 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-09-12T02:49:14.670 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-09-12T02:49:14.670 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [], 2024-09-12T02:49:14.670 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "SMTP envelope sender", 2024-09-12T02:49:14.670 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-09-12T02:49:14.670 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-09-12T02:49:14.670 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-09-12T02:49:14.670 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-09-12T02:49:14.670 INFO:teuthology.orchestra.run.smithi039.stdout: "smtp_ssl": { 2024-09-12T02:49:14.670 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "smtp_ssl", 2024-09-12T02:49:14.670 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "bool", 2024-09-12T02:49:14.670 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "advanced", 2024-09-12T02:49:14.671 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 1, 2024-09-12T02:49:14.671 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "True", 2024-09-12T02:49:14.671 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-09-12T02:49:14.671 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-09-12T02:49:14.671 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [], 2024-09-12T02:49:14.671 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "Use SSL to connect to SMTP server", 2024-09-12T02:49:14.671 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-09-12T02:49:14.671 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-09-12T02:49:14.671 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-09-12T02:49:14.671 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-09-12T02:49:14.671 INFO:teuthology.orchestra.run.smithi039.stdout: "smtp_user": { 2024-09-12T02:49:14.671 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "smtp_user", 2024-09-12T02:49:14.672 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "str", 2024-09-12T02:49:14.672 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "advanced", 2024-09-12T02:49:14.672 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 1, 2024-09-12T02:49:14.672 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "", 2024-09-12T02:49:14.672 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-09-12T02:49:14.672 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-09-12T02:49:14.672 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [], 2024-09-12T02:49:14.672 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "User to authenticate as", 2024-09-12T02:49:14.672 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-09-12T02:49:14.672 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-09-12T02:49:14.672 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-09-12T02:49:14.672 INFO:teuthology.orchestra.run.smithi039.stdout: } 2024-09-12T02:49:14.672 INFO:teuthology.orchestra.run.smithi039.stdout: } 2024-09-12T02:49:14.673 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-09-12T02:49:14.673 INFO:teuthology.orchestra.run.smithi039.stdout: { 2024-09-12T02:49:14.673 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "balancer", 2024-09-12T02:49:14.673 INFO:teuthology.orchestra.run.smithi039.stdout: "can_run": true, 2024-09-12T02:49:14.673 INFO:teuthology.orchestra.run.smithi039.stdout: "error_string": "", 2024-09-12T02:49:14.673 INFO:teuthology.orchestra.run.smithi039.stdout: "module_options": { 2024-09-12T02:49:14.673 INFO:teuthology.orchestra.run.smithi039.stdout: "active": { 2024-09-12T02:49:14.673 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "active", 2024-09-12T02:49:14.673 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "bool", 2024-09-12T02:49:14.673 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "advanced", 2024-09-12T02:49:14.673 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 1, 2024-09-12T02:49:14.673 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "True", 2024-09-12T02:49:14.673 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-09-12T02:49:14.673 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-09-12T02:49:14.674 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [], 2024-09-12T02:49:14.674 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "automatically balance PGs across cluster", 2024-09-12T02:49:14.674 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-09-12T02:49:14.674 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-09-12T02:49:14.674 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-09-12T02:49:14.674 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-09-12T02:49:14.674 INFO:teuthology.orchestra.run.smithi039.stdout: "begin_time": { 2024-09-12T02:49:14.674 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "begin_time", 2024-09-12T02:49:14.674 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "str", 2024-09-12T02:49:14.674 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "advanced", 2024-09-12T02:49:14.674 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 1, 2024-09-12T02:49:14.674 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "0000", 2024-09-12T02:49:14.674 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-09-12T02:49:14.675 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-09-12T02:49:14.675 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [], 2024-09-12T02:49:14.675 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "beginning time of day to automatically balance", 2024-09-12T02:49:14.675 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "This is a time of day in the format HHMM.", 2024-09-12T02:49:14.675 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-09-12T02:49:14.675 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-09-12T02:49:14.675 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-09-12T02:49:14.675 INFO:teuthology.orchestra.run.smithi039.stdout: "begin_weekday": { 2024-09-12T02:49:14.675 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "begin_weekday", 2024-09-12T02:49:14.675 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "uint", 2024-09-12T02:49:14.675 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "advanced", 2024-09-12T02:49:14.675 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 1, 2024-09-12T02:49:14.675 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "0", 2024-09-12T02:49:14.675 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "0", 2024-09-12T02:49:14.676 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "6", 2024-09-12T02:49:14.676 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [], 2024-09-12T02:49:14.676 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "Restrict automatic balancing to this day of the week or later", 2024-09-12T02:49:14.676 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "0 = Sunday, 1 = Monday, etc.", 2024-09-12T02:49:14.676 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-09-12T02:49:14.676 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-09-12T02:49:14.676 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-09-12T02:49:14.676 INFO:teuthology.orchestra.run.smithi039.stdout: "crush_compat_max_iterations": { 2024-09-12T02:49:14.676 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "crush_compat_max_iterations", 2024-09-12T02:49:14.676 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "uint", 2024-09-12T02:49:14.676 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "advanced", 2024-09-12T02:49:14.676 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 1, 2024-09-12T02:49:14.676 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "25", 2024-09-12T02:49:14.677 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "1", 2024-09-12T02:49:14.677 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "250", 2024-09-12T02:49:14.677 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [], 2024-09-12T02:49:14.677 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "maximum number of iterations to attempt optimization", 2024-09-12T02:49:14.677 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-09-12T02:49:14.677 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-09-12T02:49:14.677 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-09-12T02:49:14.677 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-09-12T02:49:14.677 INFO:teuthology.orchestra.run.smithi039.stdout: "crush_compat_metrics": { 2024-09-12T02:49:14.677 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "crush_compat_metrics", 2024-09-12T02:49:14.677 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "str", 2024-09-12T02:49:14.677 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "advanced", 2024-09-12T02:49:14.677 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 1, 2024-09-12T02:49:14.677 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "pgs,objects,bytes", 2024-09-12T02:49:14.678 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-09-12T02:49:14.678 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-09-12T02:49:14.678 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [], 2024-09-12T02:49:14.678 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "metrics with which to calculate OSD utilization", 2024-09-12T02:49:14.678 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "Value is a list of one or more of \"pgs\", \"objects\", or \"bytes\", and indicates which metrics to use to balance utilization.", 2024-09-12T02:49:14.678 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-09-12T02:49:14.678 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-09-12T02:49:14.678 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-09-12T02:49:14.681 INFO:teuthology.orchestra.run.smithi039.stdout: "crush_compat_step": { 2024-09-12T02:49:14.681 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "crush_compat_step", 2024-09-12T02:49:14.681 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "float", 2024-09-12T02:49:14.681 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "advanced", 2024-09-12T02:49:14.681 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 1, 2024-09-12T02:49:14.681 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "0.5", 2024-09-12T02:49:14.681 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "0.001", 2024-09-12T02:49:14.681 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "0.999", 2024-09-12T02:49:14.681 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [], 2024-09-12T02:49:14.681 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "aggressiveness of optimization", 2024-09-12T02:49:14.681 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": ".99 is very aggressive, .01 is less aggressive", 2024-09-12T02:49:14.681 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-09-12T02:49:14.682 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-09-12T02:49:14.682 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-09-12T02:49:14.682 INFO:teuthology.orchestra.run.smithi039.stdout: "end_time": { 2024-09-12T02:49:14.682 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "end_time", 2024-09-12T02:49:14.682 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "str", 2024-09-12T02:49:14.682 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "advanced", 2024-09-12T02:49:14.682 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 1, 2024-09-12T02:49:14.682 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "2359", 2024-09-12T02:49:14.682 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-09-12T02:49:14.682 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-09-12T02:49:14.682 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [], 2024-09-12T02:49:14.682 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "ending time of day to automatically balance", 2024-09-12T02:49:14.682 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "This is a time of day in the format HHMM.", 2024-09-12T02:49:14.682 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-09-12T02:49:14.683 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-09-12T02:49:14.683 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-09-12T02:49:14.683 INFO:teuthology.orchestra.run.smithi039.stdout: "end_weekday": { 2024-09-12T02:49:14.683 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "end_weekday", 2024-09-12T02:49:14.683 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "uint", 2024-09-12T02:49:14.683 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "advanced", 2024-09-12T02:49:14.683 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 1, 2024-09-12T02:49:14.683 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "0", 2024-09-12T02:49:14.683 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "0", 2024-09-12T02:49:14.683 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "6", 2024-09-12T02:49:14.683 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [], 2024-09-12T02:49:14.683 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "Restrict automatic balancing to days of the week earlier than this", 2024-09-12T02:49:14.683 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "0 = Sunday, 1 = Monday, etc.", 2024-09-12T02:49:14.684 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-09-12T02:49:14.684 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-09-12T02:49:14.684 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-09-12T02:49:14.684 INFO:teuthology.orchestra.run.smithi039.stdout: "log_level": { 2024-09-12T02:49:14.684 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "log_level", 2024-09-12T02:49:14.684 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "str", 2024-09-12T02:49:14.684 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "advanced", 2024-09-12T02:49:14.684 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 1, 2024-09-12T02:49:14.684 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "", 2024-09-12T02:49:14.684 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-09-12T02:49:14.684 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-09-12T02:49:14.684 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [ 2024-09-12T02:49:14.684 INFO:teuthology.orchestra.run.smithi039.stdout: "", 2024-09-12T02:49:14.684 INFO:teuthology.orchestra.run.smithi039.stdout: "critical", 2024-09-12T02:49:14.685 INFO:teuthology.orchestra.run.smithi039.stdout: "debug", 2024-09-12T02:49:14.685 INFO:teuthology.orchestra.run.smithi039.stdout: "error", 2024-09-12T02:49:14.685 INFO:teuthology.orchestra.run.smithi039.stdout: "info", 2024-09-12T02:49:14.685 INFO:teuthology.orchestra.run.smithi039.stdout: "warning" 2024-09-12T02:49:14.685 INFO:teuthology.orchestra.run.smithi039.stdout: ], 2024-09-12T02:49:14.685 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "", 2024-09-12T02:49:14.685 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-09-12T02:49:14.685 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-09-12T02:49:14.685 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-09-12T02:49:14.685 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-09-12T02:49:14.685 INFO:teuthology.orchestra.run.smithi039.stdout: "log_to_cluster": { 2024-09-12T02:49:14.685 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "log_to_cluster", 2024-09-12T02:49:14.685 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "bool", 2024-09-12T02:49:14.686 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "advanced", 2024-09-12T02:49:14.686 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 1, 2024-09-12T02:49:14.686 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "False", 2024-09-12T02:49:14.686 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-09-12T02:49:14.686 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-09-12T02:49:14.686 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [], 2024-09-12T02:49:14.686 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "", 2024-09-12T02:49:14.686 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-09-12T02:49:14.686 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-09-12T02:49:14.686 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-09-12T02:49:14.686 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-09-12T02:49:14.686 INFO:teuthology.orchestra.run.smithi039.stdout: "log_to_cluster_level": { 2024-09-12T02:49:14.686 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "log_to_cluster_level", 2024-09-12T02:49:14.686 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "str", 2024-09-12T02:49:14.687 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "advanced", 2024-09-12T02:49:14.687 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 1, 2024-09-12T02:49:14.687 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "info", 2024-09-12T02:49:14.687 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-09-12T02:49:14.687 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-09-12T02:49:14.687 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [ 2024-09-12T02:49:14.687 INFO:teuthology.orchestra.run.smithi039.stdout: "", 2024-09-12T02:49:14.687 INFO:teuthology.orchestra.run.smithi039.stdout: "critical", 2024-09-12T02:49:14.687 INFO:teuthology.orchestra.run.smithi039.stdout: "debug", 2024-09-12T02:49:14.687 INFO:teuthology.orchestra.run.smithi039.stdout: "error", 2024-09-12T02:49:14.687 INFO:teuthology.orchestra.run.smithi039.stdout: "info", 2024-09-12T02:49:14.687 INFO:teuthology.orchestra.run.smithi039.stdout: "warning" 2024-09-12T02:49:14.688 INFO:teuthology.orchestra.run.smithi039.stdout: ], 2024-09-12T02:49:14.688 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "", 2024-09-12T02:49:14.688 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-09-12T02:49:14.688 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-09-12T02:49:14.688 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-09-12T02:49:14.688 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-09-12T02:49:14.688 INFO:teuthology.orchestra.run.smithi039.stdout: "log_to_file": { 2024-09-12T02:49:14.688 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "log_to_file", 2024-09-12T02:49:14.688 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "bool", 2024-09-12T02:49:14.688 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "advanced", 2024-09-12T02:49:14.688 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 1, 2024-09-12T02:49:14.688 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "False", 2024-09-12T02:49:14.688 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-09-12T02:49:14.689 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-09-12T02:49:14.689 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [], 2024-09-12T02:49:14.689 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "", 2024-09-12T02:49:14.689 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-09-12T02:49:14.689 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-09-12T02:49:14.689 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-09-12T02:49:14.689 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-09-12T02:49:14.689 INFO:teuthology.orchestra.run.smithi039.stdout: "min_score": { 2024-09-12T02:49:14.689 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "min_score", 2024-09-12T02:49:14.689 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "float", 2024-09-12T02:49:14.689 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "advanced", 2024-09-12T02:49:14.689 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 1, 2024-09-12T02:49:14.689 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "0", 2024-09-12T02:49:14.690 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-09-12T02:49:14.690 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-09-12T02:49:14.690 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [], 2024-09-12T02:49:14.690 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "minimum score, below which no optimization is attempted", 2024-09-12T02:49:14.690 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-09-12T02:49:14.690 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-09-12T02:49:14.690 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-09-12T02:49:14.690 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-09-12T02:49:14.690 INFO:teuthology.orchestra.run.smithi039.stdout: "mode": { 2024-09-12T02:49:14.690 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "mode", 2024-09-12T02:49:14.690 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "str", 2024-09-12T02:49:14.690 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "advanced", 2024-09-12T02:49:14.690 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 1, 2024-09-12T02:49:14.690 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "upmap", 2024-09-12T02:49:14.691 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-09-12T02:49:14.691 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-09-12T02:49:14.691 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [ 2024-09-12T02:49:14.691 INFO:teuthology.orchestra.run.smithi039.stdout: "crush-compat", 2024-09-12T02:49:14.691 INFO:teuthology.orchestra.run.smithi039.stdout: "none", 2024-09-12T02:49:14.691 INFO:teuthology.orchestra.run.smithi039.stdout: "read", 2024-09-12T02:49:14.691 INFO:teuthology.orchestra.run.smithi039.stdout: "upmap", 2024-09-12T02:49:14.691 INFO:teuthology.orchestra.run.smithi039.stdout: "upmap-read" 2024-09-12T02:49:14.691 INFO:teuthology.orchestra.run.smithi039.stdout: ], 2024-09-12T02:49:14.691 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "Balancer mode", 2024-09-12T02:49:14.691 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-09-12T02:49:14.691 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-09-12T02:49:14.691 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-09-12T02:49:14.692 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-09-12T02:49:14.692 INFO:teuthology.orchestra.run.smithi039.stdout: "pool_ids": { 2024-09-12T02:49:14.692 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "pool_ids", 2024-09-12T02:49:14.692 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "str", 2024-09-12T02:49:14.692 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "advanced", 2024-09-12T02:49:14.692 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 1, 2024-09-12T02:49:14.692 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "", 2024-09-12T02:49:14.692 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-09-12T02:49:14.692 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-09-12T02:49:14.692 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [], 2024-09-12T02:49:14.692 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "pools which the automatic balancing will be limited to", 2024-09-12T02:49:14.692 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-09-12T02:49:14.692 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-09-12T02:49:14.693 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-09-12T02:49:14.693 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-09-12T02:49:14.693 INFO:teuthology.orchestra.run.smithi039.stdout: "sleep_interval": { 2024-09-12T02:49:14.693 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "sleep_interval", 2024-09-12T02:49:14.693 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "secs", 2024-09-12T02:49:14.693 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "advanced", 2024-09-12T02:49:14.693 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 1, 2024-09-12T02:49:14.693 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "60", 2024-09-12T02:49:14.693 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-09-12T02:49:14.693 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-09-12T02:49:14.693 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [], 2024-09-12T02:49:14.693 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "how frequently to wake up and attempt optimization", 2024-09-12T02:49:14.693 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-09-12T02:49:14.693 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-09-12T02:49:14.694 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-09-12T02:49:14.694 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-09-12T02:49:14.694 INFO:teuthology.orchestra.run.smithi039.stdout: "upmap_max_deviation": { 2024-09-12T02:49:14.694 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "upmap_max_deviation", 2024-09-12T02:49:14.694 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "int", 2024-09-12T02:49:14.694 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "advanced", 2024-09-12T02:49:14.694 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 1, 2024-09-12T02:49:14.694 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "5", 2024-09-12T02:49:14.695 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "1", 2024-09-12T02:49:14.695 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-09-12T02:49:14.695 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [], 2024-09-12T02:49:14.695 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "deviation below which no optimization is attempted", 2024-09-12T02:49:14.695 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "If the number of PGs are within this count then no optimization is attempted", 2024-09-12T02:49:14.695 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-09-12T02:49:14.695 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-09-12T02:49:14.695 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-09-12T02:49:14.695 INFO:teuthology.orchestra.run.smithi039.stdout: "upmap_max_optimizations": { 2024-09-12T02:49:14.695 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "upmap_max_optimizations", 2024-09-12T02:49:14.695 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "uint", 2024-09-12T02:49:14.695 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "advanced", 2024-09-12T02:49:14.695 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 1, 2024-09-12T02:49:14.695 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "10", 2024-09-12T02:49:14.696 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-09-12T02:49:14.696 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-09-12T02:49:14.696 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [], 2024-09-12T02:49:14.696 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "maximum upmap optimizations to make per attempt", 2024-09-12T02:49:14.696 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-09-12T02:49:14.696 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-09-12T02:49:14.696 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-09-12T02:49:14.696 INFO:teuthology.orchestra.run.smithi039.stdout: } 2024-09-12T02:49:14.696 INFO:teuthology.orchestra.run.smithi039.stdout: } 2024-09-12T02:49:14.696 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-09-12T02:49:14.696 INFO:teuthology.orchestra.run.smithi039.stdout: { 2024-09-12T02:49:14.696 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "cephadm", 2024-09-12T02:49:14.696 INFO:teuthology.orchestra.run.smithi039.stdout: "can_run": true, 2024-09-12T02:49:14.696 INFO:teuthology.orchestra.run.smithi039.stdout: "error_string": "", 2024-09-12T02:49:14.697 INFO:teuthology.orchestra.run.smithi039.stdout: "module_options": { 2024-09-12T02:49:14.697 INFO:teuthology.orchestra.run.smithi039.stdout: "agent_down_multiplier": { 2024-09-12T02:49:14.697 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "agent_down_multiplier", 2024-09-12T02:49:14.697 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "float", 2024-09-12T02:49:14.697 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "advanced", 2024-09-12T02:49:14.697 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 0, 2024-09-12T02:49:14.697 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "3.0", 2024-09-12T02:49:14.697 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-09-12T02:49:14.697 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-09-12T02:49:14.697 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [], 2024-09-12T02:49:14.697 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "Multiplied by agent refresh rate to calculate how long agent must not report before being marked down", 2024-09-12T02:49:14.697 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-09-12T02:49:14.697 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-09-12T02:49:14.697 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-09-12T02:49:14.698 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-09-12T02:49:14.698 INFO:teuthology.orchestra.run.smithi039.stdout: "agent_refresh_rate": { 2024-09-12T02:49:14.698 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "agent_refresh_rate", 2024-09-12T02:49:14.698 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "secs", 2024-09-12T02:49:14.698 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "advanced", 2024-09-12T02:49:14.698 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 0, 2024-09-12T02:49:14.698 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "20", 2024-09-12T02:49:14.698 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-09-12T02:49:14.698 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-09-12T02:49:14.698 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [], 2024-09-12T02:49:14.698 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "How often agent on each host will try to gather and send metadata", 2024-09-12T02:49:14.698 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-09-12T02:49:14.698 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-09-12T02:49:14.698 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-09-12T02:49:14.699 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-09-12T02:49:14.699 INFO:teuthology.orchestra.run.smithi039.stdout: "agent_starting_port": { 2024-09-12T02:49:14.699 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "agent_starting_port", 2024-09-12T02:49:14.699 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "int", 2024-09-12T02:49:14.699 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "advanced", 2024-09-12T02:49:14.699 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 0, 2024-09-12T02:49:14.699 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "4721", 2024-09-12T02:49:14.699 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-09-12T02:49:14.699 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-09-12T02:49:14.699 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [], 2024-09-12T02:49:14.699 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "First port agent will try to bind to (will also try up to next 1000 subsequent ports if blocked)", 2024-09-12T02:49:14.699 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-09-12T02:49:14.699 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-09-12T02:49:14.699 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-09-12T02:49:14.700 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-09-12T02:49:14.700 INFO:teuthology.orchestra.run.smithi039.stdout: "allow_ptrace": { 2024-09-12T02:49:14.700 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "allow_ptrace", 2024-09-12T02:49:14.700 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "bool", 2024-09-12T02:49:14.700 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "advanced", 2024-09-12T02:49:14.700 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 0, 2024-09-12T02:49:14.700 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "False", 2024-09-12T02:49:14.700 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-09-12T02:49:14.700 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-09-12T02:49:14.700 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [], 2024-09-12T02:49:14.700 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "allow SYS_PTRACE capability on ceph containers", 2024-09-12T02:49:14.700 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "The SYS_PTRACE capability is needed to attach to a process with gdb or strace. Enabling this options can allow debugging daemons that encounter problems at runtime.", 2024-09-12T02:49:14.701 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-09-12T02:49:14.701 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-09-12T02:49:14.701 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-09-12T02:49:14.701 INFO:teuthology.orchestra.run.smithi039.stdout: "autotune_interval": { 2024-09-12T02:49:14.701 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "autotune_interval", 2024-09-12T02:49:14.701 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "secs", 2024-09-12T02:49:14.701 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "advanced", 2024-09-12T02:49:14.701 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 0, 2024-09-12T02:49:14.701 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "600", 2024-09-12T02:49:14.701 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-09-12T02:49:14.701 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-09-12T02:49:14.701 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [], 2024-09-12T02:49:14.702 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "how frequently to autotune daemon memory", 2024-09-12T02:49:14.702 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-09-12T02:49:14.702 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-09-12T02:49:14.702 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-09-12T02:49:14.702 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-09-12T02:49:14.702 INFO:teuthology.orchestra.run.smithi039.stdout: "autotune_memory_target_ratio": { 2024-09-12T02:49:14.702 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "autotune_memory_target_ratio", 2024-09-12T02:49:14.702 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "float", 2024-09-12T02:49:14.702 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "advanced", 2024-09-12T02:49:14.702 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 0, 2024-09-12T02:49:14.702 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "0.7", 2024-09-12T02:49:14.702 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-09-12T02:49:14.702 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-09-12T02:49:14.702 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [], 2024-09-12T02:49:14.703 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "ratio of total system memory to divide amongst autotuned daemons", 2024-09-12T02:49:14.703 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-09-12T02:49:14.703 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-09-12T02:49:14.703 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-09-12T02:49:14.703 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-09-12T02:49:14.703 INFO:teuthology.orchestra.run.smithi039.stdout: "cephadm_log_destination": { 2024-09-12T02:49:14.703 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "cephadm_log_destination", 2024-09-12T02:49:14.703 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "str", 2024-09-12T02:49:14.703 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "advanced", 2024-09-12T02:49:14.703 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 0, 2024-09-12T02:49:14.703 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "", 2024-09-12T02:49:14.703 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-09-12T02:49:14.703 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-09-12T02:49:14.704 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [ 2024-09-12T02:49:14.704 INFO:teuthology.orchestra.run.smithi039.stdout: "file", 2024-09-12T02:49:14.704 INFO:teuthology.orchestra.run.smithi039.stdout: "file,syslog", 2024-09-12T02:49:14.704 INFO:teuthology.orchestra.run.smithi039.stdout: "syslog" 2024-09-12T02:49:14.704 INFO:teuthology.orchestra.run.smithi039.stdout: ], 2024-09-12T02:49:14.704 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "Destination for cephadm command's persistent logging", 2024-09-12T02:49:14.704 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-09-12T02:49:14.704 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-09-12T02:49:14.704 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-09-12T02:49:14.704 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-09-12T02:49:14.704 INFO:teuthology.orchestra.run.smithi039.stdout: "cgroups_split": { 2024-09-12T02:49:14.704 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "cgroups_split", 2024-09-12T02:49:14.704 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "bool", 2024-09-12T02:49:14.705 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "advanced", 2024-09-12T02:49:14.705 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 0, 2024-09-12T02:49:14.705 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "True", 2024-09-12T02:49:14.705 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-09-12T02:49:14.705 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-09-12T02:49:14.705 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [], 2024-09-12T02:49:14.705 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "Pass --cgroups=split when cephadm creates containers (currently podman only)", 2024-09-12T02:49:14.705 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-09-12T02:49:14.705 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-09-12T02:49:14.705 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-09-12T02:49:14.705 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-09-12T02:49:14.705 INFO:teuthology.orchestra.run.smithi039.stdout: "config_checks_enabled": { 2024-09-12T02:49:14.705 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "config_checks_enabled", 2024-09-12T02:49:14.705 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "bool", 2024-09-12T02:49:14.706 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "advanced", 2024-09-12T02:49:14.706 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 0, 2024-09-12T02:49:14.706 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "False", 2024-09-12T02:49:14.706 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-09-12T02:49:14.706 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-09-12T02:49:14.706 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [], 2024-09-12T02:49:14.706 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "Enable or disable the cephadm configuration analysis", 2024-09-12T02:49:14.706 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-09-12T02:49:14.706 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-09-12T02:49:14.706 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-09-12T02:49:14.706 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-09-12T02:49:14.706 INFO:teuthology.orchestra.run.smithi039.stdout: "config_dashboard": { 2024-09-12T02:49:14.706 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "config_dashboard", 2024-09-12T02:49:14.706 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "bool", 2024-09-12T02:49:14.707 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "advanced", 2024-09-12T02:49:14.707 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 0, 2024-09-12T02:49:14.707 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "True", 2024-09-12T02:49:14.707 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-09-12T02:49:14.707 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-09-12T02:49:14.707 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [], 2024-09-12T02:49:14.707 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "manage configs like API endpoints in Dashboard.", 2024-09-12T02:49:14.707 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-09-12T02:49:14.707 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-09-12T02:49:14.707 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-09-12T02:49:14.707 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-09-12T02:49:14.707 INFO:teuthology.orchestra.run.smithi039.stdout: "container_image_alertmanager": { 2024-09-12T02:49:14.708 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "container_image_alertmanager", 2024-09-12T02:49:14.708 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "str", 2024-09-12T02:49:14.708 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "advanced", 2024-09-12T02:49:14.708 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 0, 2024-09-12T02:49:14.708 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "quay.io/prometheus/alertmanager:v0.25.0", 2024-09-12T02:49:14.708 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-09-12T02:49:14.708 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-09-12T02:49:14.708 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [], 2024-09-12T02:49:14.708 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "Prometheus container image", 2024-09-12T02:49:14.708 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-09-12T02:49:14.708 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-09-12T02:49:14.708 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-09-12T02:49:14.708 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-09-12T02:49:14.709 INFO:teuthology.orchestra.run.smithi039.stdout: "container_image_base": { 2024-09-12T02:49:14.709 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "container_image_base", 2024-09-12T02:49:14.709 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "str", 2024-09-12T02:49:14.709 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "advanced", 2024-09-12T02:49:14.709 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 1, 2024-09-12T02:49:14.709 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "quay.io/ceph/ceph", 2024-09-12T02:49:14.709 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-09-12T02:49:14.709 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-09-12T02:49:14.709 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [], 2024-09-12T02:49:14.709 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "Container image name, without the tag", 2024-09-12T02:49:14.709 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-09-12T02:49:14.709 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-09-12T02:49:14.709 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-09-12T02:49:14.709 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-09-12T02:49:14.710 INFO:teuthology.orchestra.run.smithi039.stdout: "container_image_elasticsearch": { 2024-09-12T02:49:14.710 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "container_image_elasticsearch", 2024-09-12T02:49:14.710 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "str", 2024-09-12T02:49:14.710 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "advanced", 2024-09-12T02:49:14.710 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 0, 2024-09-12T02:49:14.710 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "quay.io/omrizeneva/elasticsearch:6.8.23", 2024-09-12T02:49:14.710 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-09-12T02:49:14.710 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-09-12T02:49:14.710 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [], 2024-09-12T02:49:14.710 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "elasticsearch container image", 2024-09-12T02:49:14.710 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-09-12T02:49:14.710 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-09-12T02:49:14.710 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-09-12T02:49:14.710 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-09-12T02:49:14.711 INFO:teuthology.orchestra.run.smithi039.stdout: "container_image_grafana": { 2024-09-12T02:49:14.711 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "container_image_grafana", 2024-09-12T02:49:14.711 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "str", 2024-09-12T02:49:14.711 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "advanced", 2024-09-12T02:49:14.711 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 0, 2024-09-12T02:49:14.711 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "quay.io/ceph/grafana:9.4.12", 2024-09-12T02:49:14.711 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-09-12T02:49:14.711 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-09-12T02:49:14.711 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [], 2024-09-12T02:49:14.711 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "Prometheus container image", 2024-09-12T02:49:14.711 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-09-12T02:49:14.711 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-09-12T02:49:14.711 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-09-12T02:49:14.711 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-09-12T02:49:14.712 INFO:teuthology.orchestra.run.smithi039.stdout: "container_image_haproxy": { 2024-09-12T02:49:14.712 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "container_image_haproxy", 2024-09-12T02:49:14.712 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "str", 2024-09-12T02:49:14.712 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "advanced", 2024-09-12T02:49:14.712 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 0, 2024-09-12T02:49:14.712 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "quay.io/ceph/haproxy:2.3", 2024-09-12T02:49:14.712 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-09-12T02:49:14.712 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-09-12T02:49:14.712 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [], 2024-09-12T02:49:14.712 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "HAproxy container image", 2024-09-12T02:49:14.712 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-09-12T02:49:14.712 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-09-12T02:49:14.712 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-09-12T02:49:14.712 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-09-12T02:49:14.713 INFO:teuthology.orchestra.run.smithi039.stdout: "container_image_jaeger_agent": { 2024-09-12T02:49:14.713 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "container_image_jaeger_agent", 2024-09-12T02:49:14.713 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "str", 2024-09-12T02:49:14.713 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "advanced", 2024-09-12T02:49:14.713 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 0, 2024-09-12T02:49:14.713 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "quay.io/jaegertracing/jaeger-agent:1.29", 2024-09-12T02:49:14.713 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-09-12T02:49:14.713 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-09-12T02:49:14.713 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [], 2024-09-12T02:49:14.713 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "Jaeger agent container image", 2024-09-12T02:49:14.713 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-09-12T02:49:14.713 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-09-12T02:49:14.714 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-09-12T02:49:14.714 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-09-12T02:49:14.714 INFO:teuthology.orchestra.run.smithi039.stdout: "container_image_jaeger_collector": { 2024-09-12T02:49:14.714 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "container_image_jaeger_collector", 2024-09-12T02:49:14.714 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "str", 2024-09-12T02:49:14.714 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "advanced", 2024-09-12T02:49:14.714 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 0, 2024-09-12T02:49:14.714 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "quay.io/jaegertracing/jaeger-collector:1.29", 2024-09-12T02:49:14.714 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-09-12T02:49:14.714 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-09-12T02:49:14.714 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [], 2024-09-12T02:49:14.714 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "Jaeger collector container image", 2024-09-12T02:49:14.714 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-09-12T02:49:14.715 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-09-12T02:49:14.715 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-09-12T02:49:14.715 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-09-12T02:49:14.715 INFO:teuthology.orchestra.run.smithi039.stdout: "container_image_jaeger_query": { 2024-09-12T02:49:14.715 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "container_image_jaeger_query", 2024-09-12T02:49:14.715 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "str", 2024-09-12T02:49:14.715 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "advanced", 2024-09-12T02:49:14.715 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 0, 2024-09-12T02:49:14.715 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "quay.io/jaegertracing/jaeger-query:1.29", 2024-09-12T02:49:14.715 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-09-12T02:49:14.715 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-09-12T02:49:14.715 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [], 2024-09-12T02:49:14.715 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "Jaeger query container image", 2024-09-12T02:49:14.716 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-09-12T02:49:14.716 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-09-12T02:49:14.716 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-09-12T02:49:14.716 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-09-12T02:49:14.716 INFO:teuthology.orchestra.run.smithi039.stdout: "container_image_keepalived": { 2024-09-12T02:49:14.716 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "container_image_keepalived", 2024-09-12T02:49:14.716 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "str", 2024-09-12T02:49:14.716 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "advanced", 2024-09-12T02:49:14.716 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 0, 2024-09-12T02:49:14.716 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "quay.io/ceph/keepalived:2.2.4", 2024-09-12T02:49:14.716 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-09-12T02:49:14.716 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-09-12T02:49:14.716 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [], 2024-09-12T02:49:14.716 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "Keepalived container image", 2024-09-12T02:49:14.717 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-09-12T02:49:14.717 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-09-12T02:49:14.717 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-09-12T02:49:14.717 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-09-12T02:49:14.717 INFO:teuthology.orchestra.run.smithi039.stdout: "container_image_loki": { 2024-09-12T02:49:14.717 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "container_image_loki", 2024-09-12T02:49:14.717 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "str", 2024-09-12T02:49:14.717 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "advanced", 2024-09-12T02:49:14.717 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 0, 2024-09-12T02:49:14.717 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "docker.io/grafana/loki:3.0.0", 2024-09-12T02:49:14.717 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-09-12T02:49:14.717 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-09-12T02:49:14.717 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [], 2024-09-12T02:49:14.718 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "Loki container image", 2024-09-12T02:49:14.718 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-09-12T02:49:14.718 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-09-12T02:49:14.718 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-09-12T02:49:14.718 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-09-12T02:49:14.718 INFO:teuthology.orchestra.run.smithi039.stdout: "container_image_node_exporter": { 2024-09-12T02:49:14.718 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "container_image_node_exporter", 2024-09-12T02:49:14.718 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "str", 2024-09-12T02:49:14.718 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "advanced", 2024-09-12T02:49:14.718 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 0, 2024-09-12T02:49:14.718 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "quay.io/prometheus/node-exporter:v1.5.0", 2024-09-12T02:49:14.718 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-09-12T02:49:14.718 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-09-12T02:49:14.718 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [], 2024-09-12T02:49:14.719 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "Prometheus container image", 2024-09-12T02:49:14.719 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-09-12T02:49:14.719 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-09-12T02:49:14.719 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-09-12T02:49:14.719 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-09-12T02:49:14.719 INFO:teuthology.orchestra.run.smithi039.stdout: "container_image_nvmeof": { 2024-09-12T02:49:14.719 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "container_image_nvmeof", 2024-09-12T02:49:14.719 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "str", 2024-09-12T02:49:14.719 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "advanced", 2024-09-12T02:49:14.719 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 0, 2024-09-12T02:49:14.719 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "quay.io/ceph/nvmeof:1.2.5", 2024-09-12T02:49:14.719 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-09-12T02:49:14.719 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-09-12T02:49:14.719 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [], 2024-09-12T02:49:14.720 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "Nvme-of container image", 2024-09-12T02:49:14.720 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-09-12T02:49:14.720 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-09-12T02:49:14.720 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-09-12T02:49:14.720 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-09-12T02:49:14.720 INFO:teuthology.orchestra.run.smithi039.stdout: "container_image_prometheus": { 2024-09-12T02:49:14.720 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "container_image_prometheus", 2024-09-12T02:49:14.720 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "str", 2024-09-12T02:49:14.720 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "advanced", 2024-09-12T02:49:14.720 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 0, 2024-09-12T02:49:14.720 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "quay.io/prometheus/prometheus:v2.43.0", 2024-09-12T02:49:14.720 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-09-12T02:49:14.720 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-09-12T02:49:14.721 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [], 2024-09-12T02:49:14.721 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "Prometheus container image", 2024-09-12T02:49:14.721 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-09-12T02:49:14.721 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-09-12T02:49:14.721 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-09-12T02:49:14.721 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-09-12T02:49:14.721 INFO:teuthology.orchestra.run.smithi039.stdout: "container_image_promtail": { 2024-09-12T02:49:14.721 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "container_image_promtail", 2024-09-12T02:49:14.721 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "str", 2024-09-12T02:49:14.721 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "advanced", 2024-09-12T02:49:14.721 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 0, 2024-09-12T02:49:14.721 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "docker.io/grafana/promtail:3.0.0", 2024-09-12T02:49:14.721 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-09-12T02:49:14.721 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-09-12T02:49:14.722 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [], 2024-09-12T02:49:14.722 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "Promtail container image", 2024-09-12T02:49:14.722 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-09-12T02:49:14.722 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-09-12T02:49:14.722 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-09-12T02:49:14.722 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-09-12T02:49:14.722 INFO:teuthology.orchestra.run.smithi039.stdout: "container_image_samba": { 2024-09-12T02:49:14.722 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "container_image_samba", 2024-09-12T02:49:14.722 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "str", 2024-09-12T02:49:14.722 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "advanced", 2024-09-12T02:49:14.722 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 0, 2024-09-12T02:49:14.722 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "quay.io/samba.org/samba-server:devbuilds-centos-amd64", 2024-09-12T02:49:14.722 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-09-12T02:49:14.722 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-09-12T02:49:14.723 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [], 2024-09-12T02:49:14.723 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "Samba/SMB container image", 2024-09-12T02:49:14.723 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-09-12T02:49:14.723 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-09-12T02:49:14.723 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-09-12T02:49:14.723 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-09-12T02:49:14.723 INFO:teuthology.orchestra.run.smithi039.stdout: "container_image_snmp_gateway": { 2024-09-12T02:49:14.723 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "container_image_snmp_gateway", 2024-09-12T02:49:14.723 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "str", 2024-09-12T02:49:14.723 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "advanced", 2024-09-12T02:49:14.723 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 0, 2024-09-12T02:49:14.723 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "docker.io/maxwo/snmp-notifier:v1.2.1", 2024-09-12T02:49:14.723 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-09-12T02:49:14.723 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-09-12T02:49:14.724 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [], 2024-09-12T02:49:14.724 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "SNMP Gateway container image", 2024-09-12T02:49:14.724 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-09-12T02:49:14.724 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-09-12T02:49:14.724 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-09-12T02:49:14.724 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-09-12T02:49:14.724 INFO:teuthology.orchestra.run.smithi039.stdout: "container_init": { 2024-09-12T02:49:14.724 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "container_init", 2024-09-12T02:49:14.724 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "bool", 2024-09-12T02:49:14.724 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "advanced", 2024-09-12T02:49:14.724 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 0, 2024-09-12T02:49:14.724 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "True", 2024-09-12T02:49:14.724 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-09-12T02:49:14.724 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-09-12T02:49:14.725 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [], 2024-09-12T02:49:14.725 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "Run podman/docker with `--init`", 2024-09-12T02:49:14.725 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-09-12T02:49:14.725 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-09-12T02:49:14.725 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-09-12T02:49:14.725 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-09-12T02:49:14.725 INFO:teuthology.orchestra.run.smithi039.stdout: "daemon_cache_timeout": { 2024-09-12T02:49:14.725 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "daemon_cache_timeout", 2024-09-12T02:49:14.725 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "secs", 2024-09-12T02:49:14.725 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "advanced", 2024-09-12T02:49:14.725 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 0, 2024-09-12T02:49:14.725 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "600", 2024-09-12T02:49:14.726 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-09-12T02:49:14.726 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-09-12T02:49:14.726 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [], 2024-09-12T02:49:14.726 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "seconds to cache service (daemon) inventory", 2024-09-12T02:49:14.726 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-09-12T02:49:14.726 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-09-12T02:49:14.726 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-09-12T02:49:14.726 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-09-12T02:49:14.726 INFO:teuthology.orchestra.run.smithi039.stdout: "default_cephadm_command_timeout": { 2024-09-12T02:49:14.726 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "default_cephadm_command_timeout", 2024-09-12T02:49:14.726 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "int", 2024-09-12T02:49:14.726 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "advanced", 2024-09-12T02:49:14.726 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 0, 2024-09-12T02:49:14.726 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "900", 2024-09-12T02:49:14.727 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-09-12T02:49:14.727 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-09-12T02:49:14.727 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [], 2024-09-12T02:49:14.727 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "Default timeout applied to cephadm commands run directly on the host (in seconds)", 2024-09-12T02:49:14.727 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-09-12T02:49:14.727 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-09-12T02:49:14.727 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-09-12T02:49:14.727 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-09-12T02:49:14.727 INFO:teuthology.orchestra.run.smithi039.stdout: "default_registry": { 2024-09-12T02:49:14.727 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "default_registry", 2024-09-12T02:49:14.727 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "str", 2024-09-12T02:49:14.727 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "advanced", 2024-09-12T02:49:14.727 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 0, 2024-09-12T02:49:14.727 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "docker.io", 2024-09-12T02:49:14.728 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-09-12T02:49:14.728 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-09-12T02:49:14.728 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [], 2024-09-12T02:49:14.728 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "Search-registry to which we should normalize unqualified image names. This is not the default registry", 2024-09-12T02:49:14.728 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-09-12T02:49:14.728 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-09-12T02:49:14.728 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-09-12T02:49:14.728 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-09-12T02:49:14.728 INFO:teuthology.orchestra.run.smithi039.stdout: "device_cache_timeout": { 2024-09-12T02:49:14.728 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "device_cache_timeout", 2024-09-12T02:49:14.728 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "secs", 2024-09-12T02:49:14.728 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "advanced", 2024-09-12T02:49:14.728 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 0, 2024-09-12T02:49:14.729 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "1800", 2024-09-12T02:49:14.729 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-09-12T02:49:14.729 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-09-12T02:49:14.729 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [], 2024-09-12T02:49:14.729 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "seconds to cache device inventory", 2024-09-12T02:49:14.729 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-09-12T02:49:14.729 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-09-12T02:49:14.729 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-09-12T02:49:14.729 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-09-12T02:49:14.729 INFO:teuthology.orchestra.run.smithi039.stdout: "device_enhanced_scan": { 2024-09-12T02:49:14.729 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "device_enhanced_scan", 2024-09-12T02:49:14.729 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "bool", 2024-09-12T02:49:14.729 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "advanced", 2024-09-12T02:49:14.730 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 0, 2024-09-12T02:49:14.730 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "False", 2024-09-12T02:49:14.730 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-09-12T02:49:14.730 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-09-12T02:49:14.730 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [], 2024-09-12T02:49:14.730 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "Use libstoragemgmt during device scans", 2024-09-12T02:49:14.730 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-09-12T02:49:14.730 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-09-12T02:49:14.730 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-09-12T02:49:14.730 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-09-12T02:49:14.730 INFO:teuthology.orchestra.run.smithi039.stdout: "facts_cache_timeout": { 2024-09-12T02:49:14.730 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "facts_cache_timeout", 2024-09-12T02:49:14.730 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "secs", 2024-09-12T02:49:14.730 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "advanced", 2024-09-12T02:49:14.731 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 0, 2024-09-12T02:49:14.731 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "60", 2024-09-12T02:49:14.731 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-09-12T02:49:14.731 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-09-12T02:49:14.731 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [], 2024-09-12T02:49:14.731 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "seconds to cache host facts data", 2024-09-12T02:49:14.731 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-09-12T02:49:14.731 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-09-12T02:49:14.731 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-09-12T02:49:14.731 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-09-12T02:49:14.731 INFO:teuthology.orchestra.run.smithi039.stdout: "grafana_dashboards_path": { 2024-09-12T02:49:14.731 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "grafana_dashboards_path", 2024-09-12T02:49:14.731 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "str", 2024-09-12T02:49:14.732 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "advanced", 2024-09-12T02:49:14.732 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 0, 2024-09-12T02:49:14.732 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "/etc/grafana/dashboards/ceph-dashboard/", 2024-09-12T02:49:14.732 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-09-12T02:49:14.732 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-09-12T02:49:14.732 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [], 2024-09-12T02:49:14.732 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "location of dashboards to include in grafana deployments", 2024-09-12T02:49:14.732 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-09-12T02:49:14.732 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-09-12T02:49:14.732 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-09-12T02:49:14.732 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-09-12T02:49:14.732 INFO:teuthology.orchestra.run.smithi039.stdout: "host_check_interval": { 2024-09-12T02:49:14.732 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "host_check_interval", 2024-09-12T02:49:14.732 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "secs", 2024-09-12T02:49:14.733 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "advanced", 2024-09-12T02:49:14.733 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 0, 2024-09-12T02:49:14.733 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "600", 2024-09-12T02:49:14.733 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-09-12T02:49:14.733 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-09-12T02:49:14.733 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [], 2024-09-12T02:49:14.733 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "how frequently to perform a host check", 2024-09-12T02:49:14.733 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-09-12T02:49:14.733 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-09-12T02:49:14.733 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-09-12T02:49:14.733 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-09-12T02:49:14.733 INFO:teuthology.orchestra.run.smithi039.stdout: "hw_monitoring": { 2024-09-12T02:49:14.733 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "hw_monitoring", 2024-09-12T02:49:14.734 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "bool", 2024-09-12T02:49:14.734 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "advanced", 2024-09-12T02:49:14.734 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 0, 2024-09-12T02:49:14.734 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "False", 2024-09-12T02:49:14.734 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-09-12T02:49:14.734 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-09-12T02:49:14.734 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [], 2024-09-12T02:49:14.734 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "Deploy hw monitoring daemon on every host.", 2024-09-12T02:49:14.734 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-09-12T02:49:14.734 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-09-12T02:49:14.734 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-09-12T02:49:14.734 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-09-12T02:49:14.734 INFO:teuthology.orchestra.run.smithi039.stdout: "inventory_list_all": { 2024-09-12T02:49:14.734 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "inventory_list_all", 2024-09-12T02:49:14.734 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "bool", 2024-09-12T02:49:14.735 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "advanced", 2024-09-12T02:49:14.735 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 0, 2024-09-12T02:49:14.735 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "False", 2024-09-12T02:49:14.735 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-09-12T02:49:14.735 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-09-12T02:49:14.735 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [], 2024-09-12T02:49:14.735 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "Whether ceph-volume inventory should report more devices (mostly mappers (LVs / mpaths), partitions...)", 2024-09-12T02:49:14.735 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-09-12T02:49:14.735 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-09-12T02:49:14.735 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-09-12T02:49:14.735 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-09-12T02:49:14.735 INFO:teuthology.orchestra.run.smithi039.stdout: "log_level": { 2024-09-12T02:49:14.735 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "log_level", 2024-09-12T02:49:14.736 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "str", 2024-09-12T02:49:14.736 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "advanced", 2024-09-12T02:49:14.736 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 1, 2024-09-12T02:49:14.736 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "", 2024-09-12T02:49:14.736 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-09-12T02:49:14.736 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-09-12T02:49:14.736 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [ 2024-09-12T02:49:14.736 INFO:teuthology.orchestra.run.smithi039.stdout: "", 2024-09-12T02:49:14.736 INFO:teuthology.orchestra.run.smithi039.stdout: "critical", 2024-09-12T02:49:14.736 INFO:teuthology.orchestra.run.smithi039.stdout: "debug", 2024-09-12T02:49:14.736 INFO:teuthology.orchestra.run.smithi039.stdout: "error", 2024-09-12T02:49:14.736 INFO:teuthology.orchestra.run.smithi039.stdout: "info", 2024-09-12T02:49:14.736 INFO:teuthology.orchestra.run.smithi039.stdout: "warning" 2024-09-12T02:49:14.736 INFO:teuthology.orchestra.run.smithi039.stdout: ], 2024-09-12T02:49:14.737 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "", 2024-09-12T02:49:14.737 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-09-12T02:49:14.737 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-09-12T02:49:14.737 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-09-12T02:49:14.737 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-09-12T02:49:14.737 INFO:teuthology.orchestra.run.smithi039.stdout: "log_refresh_metadata": { 2024-09-12T02:49:14.737 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "log_refresh_metadata", 2024-09-12T02:49:14.737 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "bool", 2024-09-12T02:49:14.737 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "advanced", 2024-09-12T02:49:14.737 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 0, 2024-09-12T02:49:14.737 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "False", 2024-09-12T02:49:14.737 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-09-12T02:49:14.737 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-09-12T02:49:14.737 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [], 2024-09-12T02:49:14.738 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "Log all refresh metadata. Includes daemon, device, and host info collected regularly. Only has effect if logging at debug level", 2024-09-12T02:49:14.738 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-09-12T02:49:14.738 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-09-12T02:49:14.738 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-09-12T02:49:14.738 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-09-12T02:49:14.738 INFO:teuthology.orchestra.run.smithi039.stdout: "log_to_cluster": { 2024-09-12T02:49:14.738 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "log_to_cluster", 2024-09-12T02:49:14.738 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "bool", 2024-09-12T02:49:14.738 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "advanced", 2024-09-12T02:49:14.738 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 0, 2024-09-12T02:49:14.738 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "True", 2024-09-12T02:49:14.738 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-09-12T02:49:14.738 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-09-12T02:49:14.739 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [], 2024-09-12T02:49:14.739 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "log to the \"cephadm\" cluster log channel\"", 2024-09-12T02:49:14.739 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-09-12T02:49:14.739 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-09-12T02:49:14.739 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-09-12T02:49:14.739 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-09-12T02:49:14.739 INFO:teuthology.orchestra.run.smithi039.stdout: "log_to_cluster_level": { 2024-09-12T02:49:14.739 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "log_to_cluster_level", 2024-09-12T02:49:14.739 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "str", 2024-09-12T02:49:14.739 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "advanced", 2024-09-12T02:49:14.739 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 1, 2024-09-12T02:49:14.739 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "info", 2024-09-12T02:49:14.739 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-09-12T02:49:14.739 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-09-12T02:49:14.740 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [ 2024-09-12T02:49:14.740 INFO:teuthology.orchestra.run.smithi039.stdout: "", 2024-09-12T02:49:14.740 INFO:teuthology.orchestra.run.smithi039.stdout: "critical", 2024-09-12T02:49:14.740 INFO:teuthology.orchestra.run.smithi039.stdout: "debug", 2024-09-12T02:49:14.740 INFO:teuthology.orchestra.run.smithi039.stdout: "error", 2024-09-12T02:49:14.740 INFO:teuthology.orchestra.run.smithi039.stdout: "info", 2024-09-12T02:49:14.740 INFO:teuthology.orchestra.run.smithi039.stdout: "warning" 2024-09-12T02:49:14.740 INFO:teuthology.orchestra.run.smithi039.stdout: ], 2024-09-12T02:49:14.740 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "", 2024-09-12T02:49:14.740 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-09-12T02:49:14.740 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-09-12T02:49:14.740 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-09-12T02:49:14.740 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-09-12T02:49:14.741 INFO:teuthology.orchestra.run.smithi039.stdout: "log_to_file": { 2024-09-12T02:49:14.741 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "log_to_file", 2024-09-12T02:49:14.741 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "bool", 2024-09-12T02:49:14.741 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "advanced", 2024-09-12T02:49:14.741 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 1, 2024-09-12T02:49:14.741 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "False", 2024-09-12T02:49:14.741 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-09-12T02:49:14.741 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-09-12T02:49:14.741 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [], 2024-09-12T02:49:14.741 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "", 2024-09-12T02:49:14.741 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-09-12T02:49:14.741 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-09-12T02:49:14.741 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-09-12T02:49:14.741 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-09-12T02:49:14.742 INFO:teuthology.orchestra.run.smithi039.stdout: "manage_etc_ceph_ceph_conf": { 2024-09-12T02:49:14.742 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "manage_etc_ceph_ceph_conf", 2024-09-12T02:49:14.742 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "bool", 2024-09-12T02:49:14.742 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "advanced", 2024-09-12T02:49:14.742 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 0, 2024-09-12T02:49:14.742 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "False", 2024-09-12T02:49:14.742 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-09-12T02:49:14.742 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-09-12T02:49:14.742 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [], 2024-09-12T02:49:14.742 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "Manage and own /etc/ceph/ceph.conf on the hosts.", 2024-09-12T02:49:14.742 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-09-12T02:49:14.742 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-09-12T02:49:14.742 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-09-12T02:49:14.742 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-09-12T02:49:14.743 INFO:teuthology.orchestra.run.smithi039.stdout: "manage_etc_ceph_ceph_conf_hosts": { 2024-09-12T02:49:14.743 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "manage_etc_ceph_ceph_conf_hosts", 2024-09-12T02:49:14.743 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "str", 2024-09-12T02:49:14.743 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "advanced", 2024-09-12T02:49:14.743 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 0, 2024-09-12T02:49:14.743 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "*", 2024-09-12T02:49:14.743 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-09-12T02:49:14.743 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-09-12T02:49:14.743 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [], 2024-09-12T02:49:14.743 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "PlacementSpec describing on which hosts to manage /etc/ceph/ceph.conf", 2024-09-12T02:49:14.743 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-09-12T02:49:14.743 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-09-12T02:49:14.743 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-09-12T02:49:14.744 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-09-12T02:49:14.744 INFO:teuthology.orchestra.run.smithi039.stdout: "max_count_per_host": { 2024-09-12T02:49:14.744 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "max_count_per_host", 2024-09-12T02:49:14.744 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "int", 2024-09-12T02:49:14.744 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "advanced", 2024-09-12T02:49:14.744 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 0, 2024-09-12T02:49:14.744 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "10", 2024-09-12T02:49:14.744 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-09-12T02:49:14.744 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-09-12T02:49:14.744 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [], 2024-09-12T02:49:14.744 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "max number of daemons per service per host", 2024-09-12T02:49:14.744 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-09-12T02:49:14.744 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-09-12T02:49:14.744 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-09-12T02:49:14.745 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-09-12T02:49:14.745 INFO:teuthology.orchestra.run.smithi039.stdout: "max_osd_draining_count": { 2024-09-12T02:49:14.745 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "max_osd_draining_count", 2024-09-12T02:49:14.745 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "int", 2024-09-12T02:49:14.745 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "advanced", 2024-09-12T02:49:14.745 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 0, 2024-09-12T02:49:14.745 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "10", 2024-09-12T02:49:14.745 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-09-12T02:49:14.745 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-09-12T02:49:14.745 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [], 2024-09-12T02:49:14.745 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "max number of osds that will be drained simultaneously when osds are removed", 2024-09-12T02:49:14.745 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-09-12T02:49:14.745 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-09-12T02:49:14.746 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-09-12T02:49:14.746 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-09-12T02:49:14.746 INFO:teuthology.orchestra.run.smithi039.stdout: "migration_current": { 2024-09-12T02:49:14.746 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "migration_current", 2024-09-12T02:49:14.746 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "int", 2024-09-12T02:49:14.746 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "advanced", 2024-09-12T02:49:14.746 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 0, 2024-09-12T02:49:14.746 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "", 2024-09-12T02:49:14.746 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-09-12T02:49:14.746 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-09-12T02:49:14.746 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [], 2024-09-12T02:49:14.746 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "internal - do not modify", 2024-09-12T02:49:14.746 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-09-12T02:49:14.746 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-09-12T02:49:14.747 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-09-12T02:49:14.747 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-09-12T02:49:14.747 INFO:teuthology.orchestra.run.smithi039.stdout: "mode": { 2024-09-12T02:49:14.747 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "mode", 2024-09-12T02:49:14.747 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "str", 2024-09-12T02:49:14.747 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "advanced", 2024-09-12T02:49:14.747 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 0, 2024-09-12T02:49:14.747 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "root", 2024-09-12T02:49:14.747 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-09-12T02:49:14.747 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-09-12T02:49:14.747 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [ 2024-09-12T02:49:14.747 INFO:teuthology.orchestra.run.smithi039.stdout: "cephadm-package", 2024-09-12T02:49:14.747 INFO:teuthology.orchestra.run.smithi039.stdout: "root" 2024-09-12T02:49:14.747 INFO:teuthology.orchestra.run.smithi039.stdout: ], 2024-09-12T02:49:14.748 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "mode for remote execution of cephadm", 2024-09-12T02:49:14.748 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-09-12T02:49:14.748 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-09-12T02:49:14.748 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-09-12T02:49:14.748 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-09-12T02:49:14.748 INFO:teuthology.orchestra.run.smithi039.stdout: "oob_default_addr": { 2024-09-12T02:49:14.748 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "oob_default_addr", 2024-09-12T02:49:14.748 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "str", 2024-09-12T02:49:14.748 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "advanced", 2024-09-12T02:49:14.748 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 0, 2024-09-12T02:49:14.748 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "169.254.1.1", 2024-09-12T02:49:14.748 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-09-12T02:49:14.748 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-09-12T02:49:14.748 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [], 2024-09-12T02:49:14.749 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "Default address for RedFish API (oob management).", 2024-09-12T02:49:14.749 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-09-12T02:49:14.749 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-09-12T02:49:14.749 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-09-12T02:49:14.749 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-09-12T02:49:14.749 INFO:teuthology.orchestra.run.smithi039.stdout: "prometheus_alerts_path": { 2024-09-12T02:49:14.749 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "prometheus_alerts_path", 2024-09-12T02:49:14.749 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "str", 2024-09-12T02:49:14.749 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "advanced", 2024-09-12T02:49:14.749 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 0, 2024-09-12T02:49:14.749 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "/etc/prometheus/ceph/ceph_default_alerts.yml", 2024-09-12T02:49:14.749 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-09-12T02:49:14.749 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-09-12T02:49:14.749 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [], 2024-09-12T02:49:14.750 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "location of alerts to include in prometheus deployments", 2024-09-12T02:49:14.750 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-09-12T02:49:14.750 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-09-12T02:49:14.750 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-09-12T02:49:14.750 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-09-12T02:49:14.750 INFO:teuthology.orchestra.run.smithi039.stdout: "registry_insecure": { 2024-09-12T02:49:14.750 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "registry_insecure", 2024-09-12T02:49:14.750 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "bool", 2024-09-12T02:49:14.750 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "advanced", 2024-09-12T02:49:14.750 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 0, 2024-09-12T02:49:14.750 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "False", 2024-09-12T02:49:14.750 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-09-12T02:49:14.750 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-09-12T02:49:14.750 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [], 2024-09-12T02:49:14.751 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "Registry is to be considered insecure (no TLS available). Only for development purposes.", 2024-09-12T02:49:14.751 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-09-12T02:49:14.751 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-09-12T02:49:14.751 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-09-12T02:49:14.751 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-09-12T02:49:14.751 INFO:teuthology.orchestra.run.smithi039.stdout: "registry_password": { 2024-09-12T02:49:14.751 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "registry_password", 2024-09-12T02:49:14.751 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "str", 2024-09-12T02:49:14.751 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "advanced", 2024-09-12T02:49:14.751 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 0, 2024-09-12T02:49:14.751 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "", 2024-09-12T02:49:14.751 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-09-12T02:49:14.751 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-09-12T02:49:14.752 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [], 2024-09-12T02:49:14.752 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "Custom repository password. Only used for logging into a registry.", 2024-09-12T02:49:14.752 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-09-12T02:49:14.752 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-09-12T02:49:14.752 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-09-12T02:49:14.752 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-09-12T02:49:14.752 INFO:teuthology.orchestra.run.smithi039.stdout: "registry_url": { 2024-09-12T02:49:14.752 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "registry_url", 2024-09-12T02:49:14.752 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "str", 2024-09-12T02:49:14.752 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "advanced", 2024-09-12T02:49:14.752 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 0, 2024-09-12T02:49:14.752 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "", 2024-09-12T02:49:14.752 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-09-12T02:49:14.753 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-09-12T02:49:14.753 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [], 2024-09-12T02:49:14.753 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "Registry url for login purposes. This is not the default registry", 2024-09-12T02:49:14.753 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-09-12T02:49:14.753 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-09-12T02:49:14.753 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-09-12T02:49:14.753 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-09-12T02:49:14.753 INFO:teuthology.orchestra.run.smithi039.stdout: "registry_username": { 2024-09-12T02:49:14.753 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "registry_username", 2024-09-12T02:49:14.753 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "str", 2024-09-12T02:49:14.753 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "advanced", 2024-09-12T02:49:14.753 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 0, 2024-09-12T02:49:14.753 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "", 2024-09-12T02:49:14.754 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-09-12T02:49:14.754 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-09-12T02:49:14.754 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [], 2024-09-12T02:49:14.754 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "Custom repository username. Only used for logging into a registry.", 2024-09-12T02:49:14.754 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-09-12T02:49:14.754 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-09-12T02:49:14.754 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-09-12T02:49:14.754 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-09-12T02:49:14.754 INFO:teuthology.orchestra.run.smithi039.stdout: "secure_monitoring_stack": { 2024-09-12T02:49:14.754 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "secure_monitoring_stack", 2024-09-12T02:49:14.754 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "bool", 2024-09-12T02:49:14.754 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "advanced", 2024-09-12T02:49:14.754 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 0, 2024-09-12T02:49:14.754 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "False", 2024-09-12T02:49:14.755 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-09-12T02:49:14.755 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-09-12T02:49:14.755 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [], 2024-09-12T02:49:14.755 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "Enable TLS security for all the monitoring stack daemons", 2024-09-12T02:49:14.755 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-09-12T02:49:14.755 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-09-12T02:49:14.755 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-09-12T02:49:14.755 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-09-12T02:49:14.755 INFO:teuthology.orchestra.run.smithi039.stdout: "service_discovery_port": { 2024-09-12T02:49:14.755 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "service_discovery_port", 2024-09-12T02:49:14.755 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "int", 2024-09-12T02:49:14.755 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "advanced", 2024-09-12T02:49:14.755 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 0, 2024-09-12T02:49:14.756 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "8765", 2024-09-12T02:49:14.756 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-09-12T02:49:14.756 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-09-12T02:49:14.756 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [], 2024-09-12T02:49:14.756 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "cephadm service discovery port", 2024-09-12T02:49:14.756 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-09-12T02:49:14.756 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-09-12T02:49:14.756 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-09-12T02:49:14.756 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-09-12T02:49:14.756 INFO:teuthology.orchestra.run.smithi039.stdout: "ssh_config_file": { 2024-09-12T02:49:14.756 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "ssh_config_file", 2024-09-12T02:49:14.756 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "str", 2024-09-12T02:49:14.756 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "advanced", 2024-09-12T02:49:14.757 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 0, 2024-09-12T02:49:14.757 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "", 2024-09-12T02:49:14.757 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-09-12T02:49:14.757 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-09-12T02:49:14.757 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [], 2024-09-12T02:49:14.757 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "customized SSH config file to connect to managed hosts", 2024-09-12T02:49:14.757 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-09-12T02:49:14.757 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-09-12T02:49:14.757 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-09-12T02:49:14.757 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-09-12T02:49:14.757 INFO:teuthology.orchestra.run.smithi039.stdout: "use_agent": { 2024-09-12T02:49:14.757 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "use_agent", 2024-09-12T02:49:14.757 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "bool", 2024-09-12T02:49:14.757 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "advanced", 2024-09-12T02:49:14.758 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 0, 2024-09-12T02:49:14.758 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "False", 2024-09-12T02:49:14.758 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-09-12T02:49:14.758 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-09-12T02:49:14.758 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [], 2024-09-12T02:49:14.758 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "Use cephadm agent on each host to gather and send metadata", 2024-09-12T02:49:14.758 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-09-12T02:49:14.758 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-09-12T02:49:14.758 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-09-12T02:49:14.758 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-09-12T02:49:14.758 INFO:teuthology.orchestra.run.smithi039.stdout: "use_repo_digest": { 2024-09-12T02:49:14.758 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "use_repo_digest", 2024-09-12T02:49:14.758 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "bool", 2024-09-12T02:49:14.758 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "advanced", 2024-09-12T02:49:14.759 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 0, 2024-09-12T02:49:14.759 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "True", 2024-09-12T02:49:14.759 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-09-12T02:49:14.759 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-09-12T02:49:14.759 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [], 2024-09-12T02:49:14.759 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "Automatically convert image tags to image digest. Make sure all daemons use the same image", 2024-09-12T02:49:14.759 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-09-12T02:49:14.759 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-09-12T02:49:14.759 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-09-12T02:49:14.759 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-09-12T02:49:14.759 INFO:teuthology.orchestra.run.smithi039.stdout: "warn_on_failed_host_check": { 2024-09-12T02:49:14.759 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "warn_on_failed_host_check", 2024-09-12T02:49:14.759 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "bool", 2024-09-12T02:49:14.759 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "advanced", 2024-09-12T02:49:14.760 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 0, 2024-09-12T02:49:14.760 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "True", 2024-09-12T02:49:14.760 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-09-12T02:49:14.760 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-09-12T02:49:14.760 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [], 2024-09-12T02:49:14.760 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "raise a health warning if the host check fails", 2024-09-12T02:49:14.760 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-09-12T02:49:14.760 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-09-12T02:49:14.760 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-09-12T02:49:14.760 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-09-12T02:49:14.760 INFO:teuthology.orchestra.run.smithi039.stdout: "warn_on_stray_daemons": { 2024-09-12T02:49:14.760 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "warn_on_stray_daemons", 2024-09-12T02:49:14.760 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "bool", 2024-09-12T02:49:14.760 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "advanced", 2024-09-12T02:49:14.761 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 0, 2024-09-12T02:49:14.761 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "True", 2024-09-12T02:49:14.761 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-09-12T02:49:14.761 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-09-12T02:49:14.761 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [], 2024-09-12T02:49:14.761 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "raise a health warning if daemons are detected that are not managed by cephadm", 2024-09-12T02:49:14.761 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-09-12T02:49:14.761 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-09-12T02:49:14.761 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-09-12T02:49:14.761 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-09-12T02:49:14.761 INFO:teuthology.orchestra.run.smithi039.stdout: "warn_on_stray_hosts": { 2024-09-12T02:49:14.761 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "warn_on_stray_hosts", 2024-09-12T02:49:14.761 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "bool", 2024-09-12T02:49:14.761 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "advanced", 2024-09-12T02:49:14.762 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 0, 2024-09-12T02:49:14.762 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "True", 2024-09-12T02:49:14.762 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-09-12T02:49:14.762 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-09-12T02:49:14.762 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [], 2024-09-12T02:49:14.762 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "raise a health warning if daemons are detected on a host that is not managed by cephadm", 2024-09-12T02:49:14.762 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-09-12T02:49:14.762 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-09-12T02:49:14.762 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-09-12T02:49:14.762 INFO:teuthology.orchestra.run.smithi039.stdout: } 2024-09-12T02:49:14.762 INFO:teuthology.orchestra.run.smithi039.stdout: } 2024-09-12T02:49:14.762 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-09-12T02:49:14.762 INFO:teuthology.orchestra.run.smithi039.stdout: { 2024-09-12T02:49:14.762 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "crash", 2024-09-12T02:49:14.762 INFO:teuthology.orchestra.run.smithi039.stdout: "can_run": true, 2024-09-12T02:49:14.763 INFO:teuthology.orchestra.run.smithi039.stdout: "error_string": "", 2024-09-12T02:49:14.763 INFO:teuthology.orchestra.run.smithi039.stdout: "module_options": { 2024-09-12T02:49:14.763 INFO:teuthology.orchestra.run.smithi039.stdout: "log_level": { 2024-09-12T02:49:14.763 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "log_level", 2024-09-12T02:49:14.763 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "str", 2024-09-12T02:49:14.763 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "advanced", 2024-09-12T02:49:14.763 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 1, 2024-09-12T02:49:14.763 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "", 2024-09-12T02:49:14.763 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-09-12T02:49:14.763 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-09-12T02:49:14.763 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [ 2024-09-12T02:49:14.763 INFO:teuthology.orchestra.run.smithi039.stdout: "", 2024-09-12T02:49:14.763 INFO:teuthology.orchestra.run.smithi039.stdout: "critical", 2024-09-12T02:49:14.764 INFO:teuthology.orchestra.run.smithi039.stdout: "debug", 2024-09-12T02:49:14.764 INFO:teuthology.orchestra.run.smithi039.stdout: "error", 2024-09-12T02:49:14.764 INFO:teuthology.orchestra.run.smithi039.stdout: "info", 2024-09-12T02:49:14.764 INFO:teuthology.orchestra.run.smithi039.stdout: "warning" 2024-09-12T02:49:14.764 INFO:teuthology.orchestra.run.smithi039.stdout: ], 2024-09-12T02:49:14.764 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "", 2024-09-12T02:49:14.764 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-09-12T02:49:14.764 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-09-12T02:49:14.764 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-09-12T02:49:14.764 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-09-12T02:49:14.764 INFO:teuthology.orchestra.run.smithi039.stdout: "log_to_cluster": { 2024-09-12T02:49:14.764 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "log_to_cluster", 2024-09-12T02:49:14.764 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "bool", 2024-09-12T02:49:14.764 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "advanced", 2024-09-12T02:49:14.765 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 1, 2024-09-12T02:49:14.765 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "False", 2024-09-12T02:49:14.765 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-09-12T02:49:14.765 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-09-12T02:49:14.765 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [], 2024-09-12T02:49:14.765 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "", 2024-09-12T02:49:14.765 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-09-12T02:49:14.765 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-09-12T02:49:14.765 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-09-12T02:49:14.765 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-09-12T02:49:14.765 INFO:teuthology.orchestra.run.smithi039.stdout: "log_to_cluster_level": { 2024-09-12T02:49:14.765 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "log_to_cluster_level", 2024-09-12T02:49:14.765 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "str", 2024-09-12T02:49:14.766 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "advanced", 2024-09-12T02:49:14.766 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 1, 2024-09-12T02:49:14.766 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "info", 2024-09-12T02:49:14.766 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-09-12T02:49:14.766 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-09-12T02:49:14.766 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [ 2024-09-12T02:49:14.766 INFO:teuthology.orchestra.run.smithi039.stdout: "", 2024-09-12T02:49:14.766 INFO:teuthology.orchestra.run.smithi039.stdout: "critical", 2024-09-12T02:49:14.766 INFO:teuthology.orchestra.run.smithi039.stdout: "debug", 2024-09-12T02:49:14.766 INFO:teuthology.orchestra.run.smithi039.stdout: "error", 2024-09-12T02:49:14.766 INFO:teuthology.orchestra.run.smithi039.stdout: "info", 2024-09-12T02:49:14.766 INFO:teuthology.orchestra.run.smithi039.stdout: "warning" 2024-09-12T02:49:14.766 INFO:teuthology.orchestra.run.smithi039.stdout: ], 2024-09-12T02:49:14.766 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "", 2024-09-12T02:49:14.767 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-09-12T02:49:14.767 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-09-12T02:49:14.767 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-09-12T02:49:14.767 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-09-12T02:49:14.767 INFO:teuthology.orchestra.run.smithi039.stdout: "log_to_file": { 2024-09-12T02:49:14.767 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "log_to_file", 2024-09-12T02:49:14.767 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "bool", 2024-09-12T02:49:14.767 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "advanced", 2024-09-12T02:49:14.767 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 1, 2024-09-12T02:49:14.767 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "False", 2024-09-12T02:49:14.767 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-09-12T02:49:14.767 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-09-12T02:49:14.767 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [], 2024-09-12T02:49:14.767 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "", 2024-09-12T02:49:14.768 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-09-12T02:49:14.768 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-09-12T02:49:14.768 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-09-12T02:49:14.768 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-09-12T02:49:14.768 INFO:teuthology.orchestra.run.smithi039.stdout: "retain_interval": { 2024-09-12T02:49:14.768 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "retain_interval", 2024-09-12T02:49:14.768 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "secs", 2024-09-12T02:49:14.768 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "advanced", 2024-09-12T02:49:14.768 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 1, 2024-09-12T02:49:14.768 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "31536000", 2024-09-12T02:49:14.768 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-09-12T02:49:14.768 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-09-12T02:49:14.768 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [], 2024-09-12T02:49:14.769 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "how long to retain crashes before pruning them", 2024-09-12T02:49:14.769 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-09-12T02:49:14.769 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-09-12T02:49:14.769 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-09-12T02:49:14.769 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-09-12T02:49:14.769 INFO:teuthology.orchestra.run.smithi039.stdout: "warn_recent_interval": { 2024-09-12T02:49:14.769 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "warn_recent_interval", 2024-09-12T02:49:14.769 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "secs", 2024-09-12T02:49:14.769 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "advanced", 2024-09-12T02:49:14.769 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 1, 2024-09-12T02:49:14.769 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "1209600", 2024-09-12T02:49:14.769 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-09-12T02:49:14.769 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-09-12T02:49:14.770 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [], 2024-09-12T02:49:14.770 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "time interval in which to warn about recent crashes", 2024-09-12T02:49:14.770 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-09-12T02:49:14.770 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-09-12T02:49:14.770 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-09-12T02:49:14.770 INFO:teuthology.orchestra.run.smithi039.stdout: } 2024-09-12T02:49:14.770 INFO:teuthology.orchestra.run.smithi039.stdout: } 2024-09-12T02:49:14.770 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-09-12T02:49:14.770 INFO:teuthology.orchestra.run.smithi039.stdout: { 2024-09-12T02:49:14.770 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "dashboard", 2024-09-12T02:49:14.770 INFO:teuthology.orchestra.run.smithi039.stdout: "can_run": true, 2024-09-12T02:49:14.770 INFO:teuthology.orchestra.run.smithi039.stdout: "error_string": "", 2024-09-12T02:49:14.770 INFO:teuthology.orchestra.run.smithi039.stdout: "module_options": { 2024-09-12T02:49:14.770 INFO:teuthology.orchestra.run.smithi039.stdout: "ACCOUNT_LOCKOUT_ATTEMPTS": { 2024-09-12T02:49:14.771 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "ACCOUNT_LOCKOUT_ATTEMPTS", 2024-09-12T02:49:14.771 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "int", 2024-09-12T02:49:14.771 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "advanced", 2024-09-12T02:49:14.771 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 0, 2024-09-12T02:49:14.771 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "10", 2024-09-12T02:49:14.771 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-09-12T02:49:14.771 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-09-12T02:49:14.771 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [], 2024-09-12T02:49:14.771 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "", 2024-09-12T02:49:14.771 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-09-12T02:49:14.771 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-09-12T02:49:14.771 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-09-12T02:49:14.771 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-09-12T02:49:14.771 INFO:teuthology.orchestra.run.smithi039.stdout: "ALERTMANAGER_API_HOST": { 2024-09-12T02:49:14.772 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "ALERTMANAGER_API_HOST", 2024-09-12T02:49:14.772 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "str", 2024-09-12T02:49:14.772 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "advanced", 2024-09-12T02:49:14.772 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 0, 2024-09-12T02:49:14.772 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "", 2024-09-12T02:49:14.772 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-09-12T02:49:14.772 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-09-12T02:49:14.772 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [], 2024-09-12T02:49:14.772 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "", 2024-09-12T02:49:14.772 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-09-12T02:49:14.772 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-09-12T02:49:14.772 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-09-12T02:49:14.772 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-09-12T02:49:14.772 INFO:teuthology.orchestra.run.smithi039.stdout: "ALERTMANAGER_API_SSL_VERIFY": { 2024-09-12T02:49:14.773 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "ALERTMANAGER_API_SSL_VERIFY", 2024-09-12T02:49:14.773 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "bool", 2024-09-12T02:49:14.773 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "advanced", 2024-09-12T02:49:14.773 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 0, 2024-09-12T02:49:14.773 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "True", 2024-09-12T02:49:14.773 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-09-12T02:49:14.773 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-09-12T02:49:14.773 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [], 2024-09-12T02:49:14.773 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "", 2024-09-12T02:49:14.773 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-09-12T02:49:14.773 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-09-12T02:49:14.773 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-09-12T02:49:14.773 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-09-12T02:49:14.773 INFO:teuthology.orchestra.run.smithi039.stdout: "AUDIT_API_ENABLED": { 2024-09-12T02:49:14.774 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "AUDIT_API_ENABLED", 2024-09-12T02:49:14.774 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "bool", 2024-09-12T02:49:14.774 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "advanced", 2024-09-12T02:49:14.774 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 0, 2024-09-12T02:49:14.774 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "False", 2024-09-12T02:49:14.774 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-09-12T02:49:14.774 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-09-12T02:49:14.774 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [], 2024-09-12T02:49:14.774 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "", 2024-09-12T02:49:14.774 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-09-12T02:49:14.774 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-09-12T02:49:14.774 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-09-12T02:49:14.774 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-09-12T02:49:14.775 INFO:teuthology.orchestra.run.smithi039.stdout: "AUDIT_API_LOG_PAYLOAD": { 2024-09-12T02:49:14.775 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "AUDIT_API_LOG_PAYLOAD", 2024-09-12T02:49:14.775 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "bool", 2024-09-12T02:49:14.775 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "advanced", 2024-09-12T02:49:14.775 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 0, 2024-09-12T02:49:14.775 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "True", 2024-09-12T02:49:14.775 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-09-12T02:49:14.775 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-09-12T02:49:14.775 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [], 2024-09-12T02:49:14.775 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "", 2024-09-12T02:49:14.775 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-09-12T02:49:14.775 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-09-12T02:49:14.775 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-09-12T02:49:14.775 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-09-12T02:49:14.776 INFO:teuthology.orchestra.run.smithi039.stdout: "ENABLE_BROWSABLE_API": { 2024-09-12T02:49:14.776 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "ENABLE_BROWSABLE_API", 2024-09-12T02:49:14.776 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "bool", 2024-09-12T02:49:14.776 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "advanced", 2024-09-12T02:49:14.776 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 0, 2024-09-12T02:49:14.776 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "True", 2024-09-12T02:49:14.776 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-09-12T02:49:14.776 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-09-12T02:49:14.776 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [], 2024-09-12T02:49:14.776 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "", 2024-09-12T02:49:14.776 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-09-12T02:49:14.776 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-09-12T02:49:14.776 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-09-12T02:49:14.776 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-09-12T02:49:14.777 INFO:teuthology.orchestra.run.smithi039.stdout: "FEATURE_TOGGLE_CEPHFS": { 2024-09-12T02:49:14.777 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "FEATURE_TOGGLE_CEPHFS", 2024-09-12T02:49:14.777 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "bool", 2024-09-12T02:49:14.777 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "advanced", 2024-09-12T02:49:14.777 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 0, 2024-09-12T02:49:14.777 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "True", 2024-09-12T02:49:14.777 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-09-12T02:49:14.777 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-09-12T02:49:14.777 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [], 2024-09-12T02:49:14.777 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "", 2024-09-12T02:49:14.777 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-09-12T02:49:14.777 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-09-12T02:49:14.777 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-09-12T02:49:14.778 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-09-12T02:49:14.778 INFO:teuthology.orchestra.run.smithi039.stdout: "FEATURE_TOGGLE_DASHBOARD": { 2024-09-12T02:49:14.778 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "FEATURE_TOGGLE_DASHBOARD", 2024-09-12T02:49:14.778 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "bool", 2024-09-12T02:49:14.778 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "advanced", 2024-09-12T02:49:14.778 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 0, 2024-09-12T02:49:14.778 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "True", 2024-09-12T02:49:14.778 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-09-12T02:49:14.778 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-09-12T02:49:14.778 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [], 2024-09-12T02:49:14.778 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "", 2024-09-12T02:49:14.778 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-09-12T02:49:14.778 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-09-12T02:49:14.779 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-09-12T02:49:14.779 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-09-12T02:49:14.779 INFO:teuthology.orchestra.run.smithi039.stdout: "FEATURE_TOGGLE_ISCSI": { 2024-09-12T02:49:14.779 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "FEATURE_TOGGLE_ISCSI", 2024-09-12T02:49:14.779 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "bool", 2024-09-12T02:49:14.779 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "advanced", 2024-09-12T02:49:14.779 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 0, 2024-09-12T02:49:14.779 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "True", 2024-09-12T02:49:14.779 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-09-12T02:49:14.779 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-09-12T02:49:14.779 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [], 2024-09-12T02:49:14.779 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "", 2024-09-12T02:49:14.779 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-09-12T02:49:14.780 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-09-12T02:49:14.780 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-09-12T02:49:14.780 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-09-12T02:49:14.780 INFO:teuthology.orchestra.run.smithi039.stdout: "FEATURE_TOGGLE_MIRRORING": { 2024-09-12T02:49:14.780 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "FEATURE_TOGGLE_MIRRORING", 2024-09-12T02:49:14.780 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "bool", 2024-09-12T02:49:14.780 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "advanced", 2024-09-12T02:49:14.780 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 0, 2024-09-12T02:49:14.780 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "True", 2024-09-12T02:49:14.780 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-09-12T02:49:14.780 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-09-12T02:49:14.780 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [], 2024-09-12T02:49:14.780 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "", 2024-09-12T02:49:14.781 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-09-12T02:49:14.781 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-09-12T02:49:14.781 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-09-12T02:49:14.781 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-09-12T02:49:14.781 INFO:teuthology.orchestra.run.smithi039.stdout: "FEATURE_TOGGLE_NFS": { 2024-09-12T02:49:14.781 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "FEATURE_TOGGLE_NFS", 2024-09-12T02:49:14.781 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "bool", 2024-09-12T02:49:14.781 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "advanced", 2024-09-12T02:49:14.781 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 0, 2024-09-12T02:49:14.781 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "True", 2024-09-12T02:49:14.781 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-09-12T02:49:14.781 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-09-12T02:49:14.781 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [], 2024-09-12T02:49:14.781 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "", 2024-09-12T02:49:14.782 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-09-12T02:49:14.782 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-09-12T02:49:14.782 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-09-12T02:49:14.782 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-09-12T02:49:14.782 INFO:teuthology.orchestra.run.smithi039.stdout: "FEATURE_TOGGLE_RBD": { 2024-09-12T02:49:14.782 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "FEATURE_TOGGLE_RBD", 2024-09-12T02:49:14.782 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "bool", 2024-09-12T02:49:14.782 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "advanced", 2024-09-12T02:49:14.782 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 0, 2024-09-12T02:49:14.782 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "True", 2024-09-12T02:49:14.782 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-09-12T02:49:14.782 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-09-12T02:49:14.782 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [], 2024-09-12T02:49:14.783 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "", 2024-09-12T02:49:14.783 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-09-12T02:49:14.783 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-09-12T02:49:14.783 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-09-12T02:49:14.783 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-09-12T02:49:14.783 INFO:teuthology.orchestra.run.smithi039.stdout: "FEATURE_TOGGLE_RGW": { 2024-09-12T02:49:14.783 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "FEATURE_TOGGLE_RGW", 2024-09-12T02:49:14.783 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "bool", 2024-09-12T02:49:14.783 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "advanced", 2024-09-12T02:49:14.783 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 0, 2024-09-12T02:49:14.783 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "True", 2024-09-12T02:49:14.783 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-09-12T02:49:14.783 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-09-12T02:49:14.783 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [], 2024-09-12T02:49:14.784 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "", 2024-09-12T02:49:14.784 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-09-12T02:49:14.784 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-09-12T02:49:14.784 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-09-12T02:49:14.784 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-09-12T02:49:14.784 INFO:teuthology.orchestra.run.smithi039.stdout: "GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE": { 2024-09-12T02:49:14.784 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE", 2024-09-12T02:49:14.784 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "str", 2024-09-12T02:49:14.784 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "advanced", 2024-09-12T02:49:14.784 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 0, 2024-09-12T02:49:14.784 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "", 2024-09-12T02:49:14.784 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-09-12T02:49:14.784 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-09-12T02:49:14.785 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [], 2024-09-12T02:49:14.785 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "", 2024-09-12T02:49:14.785 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-09-12T02:49:14.785 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-09-12T02:49:14.785 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-09-12T02:49:14.785 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-09-12T02:49:14.785 INFO:teuthology.orchestra.run.smithi039.stdout: "GRAFANA_API_PASSWORD": { 2024-09-12T02:49:14.785 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "GRAFANA_API_PASSWORD", 2024-09-12T02:49:14.785 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "str", 2024-09-12T02:49:14.785 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "advanced", 2024-09-12T02:49:14.785 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 0, 2024-09-12T02:49:14.785 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "admin", 2024-09-12T02:49:14.785 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-09-12T02:49:14.785 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-09-12T02:49:14.786 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [], 2024-09-12T02:49:14.786 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "", 2024-09-12T02:49:14.786 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-09-12T02:49:14.786 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-09-12T02:49:14.786 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-09-12T02:49:14.786 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-09-12T02:49:14.786 INFO:teuthology.orchestra.run.smithi039.stdout: "GRAFANA_API_SSL_VERIFY": { 2024-09-12T02:49:14.786 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "GRAFANA_API_SSL_VERIFY", 2024-09-12T02:49:14.786 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "bool", 2024-09-12T02:49:14.786 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "advanced", 2024-09-12T02:49:14.786 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 0, 2024-09-12T02:49:14.786 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "True", 2024-09-12T02:49:14.786 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-09-12T02:49:14.786 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-09-12T02:49:14.787 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [], 2024-09-12T02:49:14.787 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "", 2024-09-12T02:49:14.787 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-09-12T02:49:14.787 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-09-12T02:49:14.787 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-09-12T02:49:14.787 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-09-12T02:49:14.787 INFO:teuthology.orchestra.run.smithi039.stdout: "GRAFANA_API_URL": { 2024-09-12T02:49:14.787 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "GRAFANA_API_URL", 2024-09-12T02:49:14.787 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "str", 2024-09-12T02:49:14.787 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "advanced", 2024-09-12T02:49:14.787 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 0, 2024-09-12T02:49:14.787 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "", 2024-09-12T02:49:14.787 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-09-12T02:49:14.787 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-09-12T02:49:14.788 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [], 2024-09-12T02:49:14.788 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "", 2024-09-12T02:49:14.788 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-09-12T02:49:14.788 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-09-12T02:49:14.788 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-09-12T02:49:14.788 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-09-12T02:49:14.788 INFO:teuthology.orchestra.run.smithi039.stdout: "GRAFANA_API_USERNAME": { 2024-09-12T02:49:14.788 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "GRAFANA_API_USERNAME", 2024-09-12T02:49:14.788 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "str", 2024-09-12T02:49:14.788 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "advanced", 2024-09-12T02:49:14.788 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 0, 2024-09-12T02:49:14.788 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "admin", 2024-09-12T02:49:14.788 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-09-12T02:49:14.788 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-09-12T02:49:14.789 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [], 2024-09-12T02:49:14.789 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "", 2024-09-12T02:49:14.789 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-09-12T02:49:14.789 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-09-12T02:49:14.789 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-09-12T02:49:14.789 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-09-12T02:49:14.789 INFO:teuthology.orchestra.run.smithi039.stdout: "GRAFANA_FRONTEND_API_URL": { 2024-09-12T02:49:14.789 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "GRAFANA_FRONTEND_API_URL", 2024-09-12T02:49:14.789 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "str", 2024-09-12T02:49:14.789 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "advanced", 2024-09-12T02:49:14.789 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 0, 2024-09-12T02:49:14.789 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "", 2024-09-12T02:49:14.789 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-09-12T02:49:14.789 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-09-12T02:49:14.790 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [], 2024-09-12T02:49:14.790 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "", 2024-09-12T02:49:14.790 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-09-12T02:49:14.790 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-09-12T02:49:14.790 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-09-12T02:49:14.790 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-09-12T02:49:14.790 INFO:teuthology.orchestra.run.smithi039.stdout: "GRAFANA_UPDATE_DASHBOARDS": { 2024-09-12T02:49:14.790 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "GRAFANA_UPDATE_DASHBOARDS", 2024-09-12T02:49:14.790 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "bool", 2024-09-12T02:49:14.790 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "advanced", 2024-09-12T02:49:14.790 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 0, 2024-09-12T02:49:14.790 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "False", 2024-09-12T02:49:14.790 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-09-12T02:49:14.790 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-09-12T02:49:14.791 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [], 2024-09-12T02:49:14.791 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "", 2024-09-12T02:49:14.791 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-09-12T02:49:14.791 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-09-12T02:49:14.791 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-09-12T02:49:14.791 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-09-12T02:49:14.791 INFO:teuthology.orchestra.run.smithi039.stdout: "ISCSI_API_SSL_VERIFICATION": { 2024-09-12T02:49:14.791 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "ISCSI_API_SSL_VERIFICATION", 2024-09-12T02:49:14.791 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "bool", 2024-09-12T02:49:14.791 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "advanced", 2024-09-12T02:49:14.791 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 0, 2024-09-12T02:49:14.791 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "True", 2024-09-12T02:49:14.791 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-09-12T02:49:14.792 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-09-12T02:49:14.792 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [], 2024-09-12T02:49:14.792 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "", 2024-09-12T02:49:14.792 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-09-12T02:49:14.792 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-09-12T02:49:14.792 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-09-12T02:49:14.792 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-09-12T02:49:14.792 INFO:teuthology.orchestra.run.smithi039.stdout: "ISSUE_TRACKER_API_KEY": { 2024-09-12T02:49:14.792 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "ISSUE_TRACKER_API_KEY", 2024-09-12T02:49:14.792 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "str", 2024-09-12T02:49:14.792 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "advanced", 2024-09-12T02:49:14.792 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 0, 2024-09-12T02:49:14.792 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "", 2024-09-12T02:49:14.793 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-09-12T02:49:14.793 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-09-12T02:49:14.793 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [], 2024-09-12T02:49:14.793 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "", 2024-09-12T02:49:14.793 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-09-12T02:49:14.793 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-09-12T02:49:14.793 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-09-12T02:49:14.793 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-09-12T02:49:14.793 INFO:teuthology.orchestra.run.smithi039.stdout: "PROMETHEUS_API_HOST": { 2024-09-12T02:49:14.793 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "PROMETHEUS_API_HOST", 2024-09-12T02:49:14.793 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "str", 2024-09-12T02:49:14.793 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "advanced", 2024-09-12T02:49:14.793 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 0, 2024-09-12T02:49:14.793 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "", 2024-09-12T02:49:14.794 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-09-12T02:49:14.794 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-09-12T02:49:14.794 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [], 2024-09-12T02:49:14.794 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "", 2024-09-12T02:49:14.794 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-09-12T02:49:14.794 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-09-12T02:49:14.794 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-09-12T02:49:14.794 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-09-12T02:49:14.794 INFO:teuthology.orchestra.run.smithi039.stdout: "PROMETHEUS_API_SSL_VERIFY": { 2024-09-12T02:49:14.794 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "PROMETHEUS_API_SSL_VERIFY", 2024-09-12T02:49:14.794 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "bool", 2024-09-12T02:49:14.794 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "advanced", 2024-09-12T02:49:14.794 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 0, 2024-09-12T02:49:14.795 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "True", 2024-09-12T02:49:14.795 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-09-12T02:49:14.795 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-09-12T02:49:14.795 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [], 2024-09-12T02:49:14.795 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "", 2024-09-12T02:49:14.795 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-09-12T02:49:14.795 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-09-12T02:49:14.795 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-09-12T02:49:14.795 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-09-12T02:49:14.795 INFO:teuthology.orchestra.run.smithi039.stdout: "PWD_POLICY_CHECK_COMPLEXITY_ENABLED": { 2024-09-12T02:49:14.795 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "PWD_POLICY_CHECK_COMPLEXITY_ENABLED", 2024-09-12T02:49:14.795 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "bool", 2024-09-12T02:49:14.795 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "advanced", 2024-09-12T02:49:14.795 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 0, 2024-09-12T02:49:14.796 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "False", 2024-09-12T02:49:14.796 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-09-12T02:49:14.796 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-09-12T02:49:14.796 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [], 2024-09-12T02:49:14.796 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "", 2024-09-12T02:49:14.796 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-09-12T02:49:14.796 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-09-12T02:49:14.796 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-09-12T02:49:14.796 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-09-12T02:49:14.796 INFO:teuthology.orchestra.run.smithi039.stdout: "PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED": { 2024-09-12T02:49:14.796 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED", 2024-09-12T02:49:14.796 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "bool", 2024-09-12T02:49:14.796 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "advanced", 2024-09-12T02:49:14.797 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 0, 2024-09-12T02:49:14.797 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "False", 2024-09-12T02:49:14.797 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-09-12T02:49:14.797 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-09-12T02:49:14.797 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [], 2024-09-12T02:49:14.797 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "", 2024-09-12T02:49:14.797 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-09-12T02:49:14.797 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-09-12T02:49:14.797 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-09-12T02:49:14.797 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-09-12T02:49:14.797 INFO:teuthology.orchestra.run.smithi039.stdout: "PWD_POLICY_CHECK_LENGTH_ENABLED": { 2024-09-12T02:49:14.797 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "PWD_POLICY_CHECK_LENGTH_ENABLED", 2024-09-12T02:49:14.797 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "bool", 2024-09-12T02:49:14.797 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "advanced", 2024-09-12T02:49:14.798 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 0, 2024-09-12T02:49:14.798 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "True", 2024-09-12T02:49:14.798 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-09-12T02:49:14.798 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-09-12T02:49:14.798 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [], 2024-09-12T02:49:14.798 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "", 2024-09-12T02:49:14.798 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-09-12T02:49:14.798 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-09-12T02:49:14.798 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-09-12T02:49:14.798 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-09-12T02:49:14.798 INFO:teuthology.orchestra.run.smithi039.stdout: "PWD_POLICY_CHECK_OLDPWD_ENABLED": { 2024-09-12T02:49:14.798 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "PWD_POLICY_CHECK_OLDPWD_ENABLED", 2024-09-12T02:49:14.798 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "bool", 2024-09-12T02:49:14.798 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "advanced", 2024-09-12T02:49:14.799 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 0, 2024-09-12T02:49:14.799 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "True", 2024-09-12T02:49:14.799 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-09-12T02:49:14.799 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-09-12T02:49:14.799 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [], 2024-09-12T02:49:14.799 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "", 2024-09-12T02:49:14.799 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-09-12T02:49:14.799 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-09-12T02:49:14.799 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-09-12T02:49:14.799 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-09-12T02:49:14.799 INFO:teuthology.orchestra.run.smithi039.stdout: "PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED": { 2024-09-12T02:49:14.799 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED", 2024-09-12T02:49:14.799 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "bool", 2024-09-12T02:49:14.799 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "advanced", 2024-09-12T02:49:14.800 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 0, 2024-09-12T02:49:14.800 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "False", 2024-09-12T02:49:14.800 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-09-12T02:49:14.800 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-09-12T02:49:14.800 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [], 2024-09-12T02:49:14.800 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "", 2024-09-12T02:49:14.800 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-09-12T02:49:14.800 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-09-12T02:49:14.800 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-09-12T02:49:14.800 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-09-12T02:49:14.800 INFO:teuthology.orchestra.run.smithi039.stdout: "PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED": { 2024-09-12T02:49:14.800 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED", 2024-09-12T02:49:14.800 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "bool", 2024-09-12T02:49:14.800 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "advanced", 2024-09-12T02:49:14.801 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 0, 2024-09-12T02:49:14.801 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "False", 2024-09-12T02:49:14.801 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-09-12T02:49:14.801 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-09-12T02:49:14.801 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [], 2024-09-12T02:49:14.801 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "", 2024-09-12T02:49:14.801 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-09-12T02:49:14.801 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-09-12T02:49:14.801 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-09-12T02:49:14.801 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-09-12T02:49:14.801 INFO:teuthology.orchestra.run.smithi039.stdout: "PWD_POLICY_CHECK_USERNAME_ENABLED": { 2024-09-12T02:49:14.801 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "PWD_POLICY_CHECK_USERNAME_ENABLED", 2024-09-12T02:49:14.801 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "bool", 2024-09-12T02:49:14.802 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "advanced", 2024-09-12T02:49:14.802 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 0, 2024-09-12T02:49:14.802 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "False", 2024-09-12T02:49:14.802 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-09-12T02:49:14.802 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-09-12T02:49:14.802 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [], 2024-09-12T02:49:14.802 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "", 2024-09-12T02:49:14.802 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-09-12T02:49:14.802 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-09-12T02:49:14.802 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-09-12T02:49:14.802 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-09-12T02:49:14.802 INFO:teuthology.orchestra.run.smithi039.stdout: "PWD_POLICY_ENABLED": { 2024-09-12T02:49:14.802 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "PWD_POLICY_ENABLED", 2024-09-12T02:49:14.802 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "bool", 2024-09-12T02:49:14.803 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "advanced", 2024-09-12T02:49:14.803 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 0, 2024-09-12T02:49:14.803 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "True", 2024-09-12T02:49:14.803 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-09-12T02:49:14.803 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-09-12T02:49:14.803 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [], 2024-09-12T02:49:14.803 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "", 2024-09-12T02:49:14.803 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-09-12T02:49:14.803 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-09-12T02:49:14.803 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-09-12T02:49:14.803 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-09-12T02:49:14.803 INFO:teuthology.orchestra.run.smithi039.stdout: "PWD_POLICY_EXCLUSION_LIST": { 2024-09-12T02:49:14.803 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "PWD_POLICY_EXCLUSION_LIST", 2024-09-12T02:49:14.803 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "str", 2024-09-12T02:49:14.803 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "advanced", 2024-09-12T02:49:14.804 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 0, 2024-09-12T02:49:14.804 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "osd,host,dashboard,pool,block,nfs,ceph,monitors,gateway,logs,crush,maps", 2024-09-12T02:49:14.804 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-09-12T02:49:14.804 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-09-12T02:49:14.804 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [], 2024-09-12T02:49:14.804 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "", 2024-09-12T02:49:14.804 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-09-12T02:49:14.804 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-09-12T02:49:14.804 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-09-12T02:49:14.804 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-09-12T02:49:14.804 INFO:teuthology.orchestra.run.smithi039.stdout: "PWD_POLICY_MIN_COMPLEXITY": { 2024-09-12T02:49:14.804 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "PWD_POLICY_MIN_COMPLEXITY", 2024-09-12T02:49:14.805 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "int", 2024-09-12T02:49:14.805 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "advanced", 2024-09-12T02:49:14.805 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 0, 2024-09-12T02:49:14.805 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "10", 2024-09-12T02:49:14.805 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-09-12T02:49:14.805 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-09-12T02:49:14.805 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [], 2024-09-12T02:49:14.805 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "", 2024-09-12T02:49:14.805 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-09-12T02:49:14.805 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-09-12T02:49:14.805 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-09-12T02:49:14.805 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-09-12T02:49:14.805 INFO:teuthology.orchestra.run.smithi039.stdout: "PWD_POLICY_MIN_LENGTH": { 2024-09-12T02:49:14.805 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "PWD_POLICY_MIN_LENGTH", 2024-09-12T02:49:14.806 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "int", 2024-09-12T02:49:14.806 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "advanced", 2024-09-12T02:49:14.806 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 0, 2024-09-12T02:49:14.806 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "8", 2024-09-12T02:49:14.806 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-09-12T02:49:14.806 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-09-12T02:49:14.806 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [], 2024-09-12T02:49:14.806 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "", 2024-09-12T02:49:14.806 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-09-12T02:49:14.806 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-09-12T02:49:14.806 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-09-12T02:49:14.806 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-09-12T02:49:14.806 INFO:teuthology.orchestra.run.smithi039.stdout: "REST_REQUESTS_TIMEOUT": { 2024-09-12T02:49:14.806 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "REST_REQUESTS_TIMEOUT", 2024-09-12T02:49:14.807 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "int", 2024-09-12T02:49:14.807 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "advanced", 2024-09-12T02:49:14.807 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 0, 2024-09-12T02:49:14.807 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "45", 2024-09-12T02:49:14.807 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-09-12T02:49:14.807 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-09-12T02:49:14.807 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [], 2024-09-12T02:49:14.807 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "", 2024-09-12T02:49:14.807 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-09-12T02:49:14.807 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-09-12T02:49:14.807 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-09-12T02:49:14.807 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-09-12T02:49:14.807 INFO:teuthology.orchestra.run.smithi039.stdout: "RGW_API_ACCESS_KEY": { 2024-09-12T02:49:14.808 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "RGW_API_ACCESS_KEY", 2024-09-12T02:49:14.808 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "str", 2024-09-12T02:49:14.808 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "advanced", 2024-09-12T02:49:14.808 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 0, 2024-09-12T02:49:14.808 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "", 2024-09-12T02:49:14.808 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-09-12T02:49:14.808 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-09-12T02:49:14.808 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [], 2024-09-12T02:49:14.808 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "", 2024-09-12T02:49:14.808 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-09-12T02:49:14.808 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-09-12T02:49:14.808 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-09-12T02:49:14.808 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-09-12T02:49:14.808 INFO:teuthology.orchestra.run.smithi039.stdout: "RGW_API_ADMIN_RESOURCE": { 2024-09-12T02:49:14.809 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "RGW_API_ADMIN_RESOURCE", 2024-09-12T02:49:14.809 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "str", 2024-09-12T02:49:14.809 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "advanced", 2024-09-12T02:49:14.809 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 0, 2024-09-12T02:49:14.809 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "admin", 2024-09-12T02:49:14.809 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-09-12T02:49:14.809 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-09-12T02:49:14.809 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [], 2024-09-12T02:49:14.809 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "", 2024-09-12T02:49:14.809 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-09-12T02:49:14.809 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-09-12T02:49:14.809 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-09-12T02:49:14.809 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-09-12T02:49:14.810 INFO:teuthology.orchestra.run.smithi039.stdout: "RGW_API_SECRET_KEY": { 2024-09-12T02:49:14.810 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "RGW_API_SECRET_KEY", 2024-09-12T02:49:14.810 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "str", 2024-09-12T02:49:14.810 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "advanced", 2024-09-12T02:49:14.810 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 0, 2024-09-12T02:49:14.810 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "", 2024-09-12T02:49:14.810 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-09-12T02:49:14.810 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-09-12T02:49:14.810 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [], 2024-09-12T02:49:14.810 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "", 2024-09-12T02:49:14.810 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-09-12T02:49:14.810 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-09-12T02:49:14.810 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-09-12T02:49:14.810 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-09-12T02:49:14.811 INFO:teuthology.orchestra.run.smithi039.stdout: "RGW_API_SSL_VERIFY": { 2024-09-12T02:49:14.811 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "RGW_API_SSL_VERIFY", 2024-09-12T02:49:14.811 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "bool", 2024-09-12T02:49:14.811 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "advanced", 2024-09-12T02:49:14.811 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 0, 2024-09-12T02:49:14.811 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "True", 2024-09-12T02:49:14.811 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-09-12T02:49:14.811 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-09-12T02:49:14.811 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [], 2024-09-12T02:49:14.811 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "", 2024-09-12T02:49:14.811 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-09-12T02:49:14.811 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-09-12T02:49:14.811 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-09-12T02:49:14.811 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-09-12T02:49:14.811 INFO:teuthology.orchestra.run.smithi039.stdout: "USER_PWD_EXPIRATION_SPAN": { 2024-09-12T02:49:14.812 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "USER_PWD_EXPIRATION_SPAN", 2024-09-12T02:49:14.812 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "int", 2024-09-12T02:49:14.812 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "advanced", 2024-09-12T02:49:14.812 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 0, 2024-09-12T02:49:14.812 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "0", 2024-09-12T02:49:14.812 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-09-12T02:49:14.812 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-09-12T02:49:14.812 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [], 2024-09-12T02:49:14.812 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "", 2024-09-12T02:49:14.812 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-09-12T02:49:14.812 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-09-12T02:49:14.812 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-09-12T02:49:14.812 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-09-12T02:49:14.813 INFO:teuthology.orchestra.run.smithi039.stdout: "USER_PWD_EXPIRATION_WARNING_1": { 2024-09-12T02:49:14.813 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "USER_PWD_EXPIRATION_WARNING_1", 2024-09-12T02:49:14.813 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "int", 2024-09-12T02:49:14.813 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "advanced", 2024-09-12T02:49:14.813 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 0, 2024-09-12T02:49:14.813 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "10", 2024-09-12T02:49:14.813 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-09-12T02:49:14.813 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-09-12T02:49:14.813 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [], 2024-09-12T02:49:14.813 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "", 2024-09-12T02:49:14.813 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-09-12T02:49:14.813 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-09-12T02:49:14.813 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-09-12T02:49:14.813 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-09-12T02:49:14.813 INFO:teuthology.orchestra.run.smithi039.stdout: "USER_PWD_EXPIRATION_WARNING_2": { 2024-09-12T02:49:14.814 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "USER_PWD_EXPIRATION_WARNING_2", 2024-09-12T02:49:14.814 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "int", 2024-09-12T02:49:14.814 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "advanced", 2024-09-12T02:49:14.814 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 0, 2024-09-12T02:49:14.814 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "5", 2024-09-12T02:49:14.814 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-09-12T02:49:14.814 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-09-12T02:49:14.814 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [], 2024-09-12T02:49:14.814 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "", 2024-09-12T02:49:14.814 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-09-12T02:49:14.814 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-09-12T02:49:14.814 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-09-12T02:49:14.814 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-09-12T02:49:14.814 INFO:teuthology.orchestra.run.smithi039.stdout: "cross_origin_url": { 2024-09-12T02:49:14.815 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "cross_origin_url", 2024-09-12T02:49:14.815 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "str", 2024-09-12T02:49:14.815 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "advanced", 2024-09-12T02:49:14.815 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 0, 2024-09-12T02:49:14.815 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "", 2024-09-12T02:49:14.815 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-09-12T02:49:14.815 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-09-12T02:49:14.815 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [], 2024-09-12T02:49:14.815 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "", 2024-09-12T02:49:14.815 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-09-12T02:49:14.815 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-09-12T02:49:14.815 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-09-12T02:49:14.815 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-09-12T02:49:14.815 INFO:teuthology.orchestra.run.smithi039.stdout: "crt_file": { 2024-09-12T02:49:14.816 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "crt_file", 2024-09-12T02:49:14.816 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "str", 2024-09-12T02:49:14.816 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "advanced", 2024-09-12T02:49:14.816 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 0, 2024-09-12T02:49:14.816 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "", 2024-09-12T02:49:14.816 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-09-12T02:49:14.816 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-09-12T02:49:14.816 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [], 2024-09-12T02:49:14.816 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "", 2024-09-12T02:49:14.816 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-09-12T02:49:14.816 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-09-12T02:49:14.816 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-09-12T02:49:14.816 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-09-12T02:49:14.816 INFO:teuthology.orchestra.run.smithi039.stdout: "debug": { 2024-09-12T02:49:14.817 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "debug", 2024-09-12T02:49:14.817 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "bool", 2024-09-12T02:49:14.817 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "advanced", 2024-09-12T02:49:14.817 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 0, 2024-09-12T02:49:14.817 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "False", 2024-09-12T02:49:14.817 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-09-12T02:49:14.817 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-09-12T02:49:14.817 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [], 2024-09-12T02:49:14.817 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "Enable/disable debug options", 2024-09-12T02:49:14.817 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-09-12T02:49:14.817 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-09-12T02:49:14.817 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-09-12T02:49:14.817 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-09-12T02:49:14.818 INFO:teuthology.orchestra.run.smithi039.stdout: "jwt_token_ttl": { 2024-09-12T02:49:14.818 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "jwt_token_ttl", 2024-09-12T02:49:14.818 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "int", 2024-09-12T02:49:14.818 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "advanced", 2024-09-12T02:49:14.818 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 0, 2024-09-12T02:49:14.818 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "28800", 2024-09-12T02:49:14.818 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-09-12T02:49:14.818 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-09-12T02:49:14.818 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [], 2024-09-12T02:49:14.818 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "", 2024-09-12T02:49:14.818 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-09-12T02:49:14.818 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-09-12T02:49:14.818 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-09-12T02:49:14.819 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-09-12T02:49:14.819 INFO:teuthology.orchestra.run.smithi039.stdout: "key_file": { 2024-09-12T02:49:14.819 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "key_file", 2024-09-12T02:49:14.819 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "str", 2024-09-12T02:49:14.819 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "advanced", 2024-09-12T02:49:14.819 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 0, 2024-09-12T02:49:14.819 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "", 2024-09-12T02:49:14.819 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-09-12T02:49:14.819 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-09-12T02:49:14.819 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [], 2024-09-12T02:49:14.819 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "", 2024-09-12T02:49:14.819 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-09-12T02:49:14.819 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-09-12T02:49:14.820 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-09-12T02:49:14.820 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-09-12T02:49:14.820 INFO:teuthology.orchestra.run.smithi039.stdout: "log_level": { 2024-09-12T02:49:14.820 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "log_level", 2024-09-12T02:49:14.820 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "str", 2024-09-12T02:49:14.820 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "advanced", 2024-09-12T02:49:14.820 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 1, 2024-09-12T02:49:14.820 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "", 2024-09-12T02:49:14.820 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-09-12T02:49:14.820 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-09-12T02:49:14.820 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [ 2024-09-12T02:49:14.820 INFO:teuthology.orchestra.run.smithi039.stdout: "", 2024-09-12T02:49:14.820 INFO:teuthology.orchestra.run.smithi039.stdout: "critical", 2024-09-12T02:49:14.820 INFO:teuthology.orchestra.run.smithi039.stdout: "debug", 2024-09-12T02:49:14.821 INFO:teuthology.orchestra.run.smithi039.stdout: "error", 2024-09-12T02:49:14.821 INFO:teuthology.orchestra.run.smithi039.stdout: "info", 2024-09-12T02:49:14.821 INFO:teuthology.orchestra.run.smithi039.stdout: "warning" 2024-09-12T02:49:14.821 INFO:teuthology.orchestra.run.smithi039.stdout: ], 2024-09-12T02:49:14.821 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "", 2024-09-12T02:49:14.821 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-09-12T02:49:14.821 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-09-12T02:49:14.821 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-09-12T02:49:14.821 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-09-12T02:49:14.821 INFO:teuthology.orchestra.run.smithi039.stdout: "log_to_cluster": { 2024-09-12T02:49:14.821 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "log_to_cluster", 2024-09-12T02:49:14.821 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "bool", 2024-09-12T02:49:14.821 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "advanced", 2024-09-12T02:49:14.822 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 1, 2024-09-12T02:49:14.822 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "False", 2024-09-12T02:49:14.822 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-09-12T02:49:14.822 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-09-12T02:49:14.822 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [], 2024-09-12T02:49:14.822 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "", 2024-09-12T02:49:14.822 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-09-12T02:49:14.822 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-09-12T02:49:14.822 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-09-12T02:49:14.822 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-09-12T02:49:14.822 INFO:teuthology.orchestra.run.smithi039.stdout: "log_to_cluster_level": { 2024-09-12T02:49:14.822 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "log_to_cluster_level", 2024-09-12T02:49:14.822 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "str", 2024-09-12T02:49:14.822 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "advanced", 2024-09-12T02:49:14.823 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 1, 2024-09-12T02:49:14.823 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "info", 2024-09-12T02:49:14.823 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-09-12T02:49:14.823 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-09-12T02:49:14.823 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [ 2024-09-12T02:49:14.823 INFO:teuthology.orchestra.run.smithi039.stdout: "", 2024-09-12T02:49:14.823 INFO:teuthology.orchestra.run.smithi039.stdout: "critical", 2024-09-12T02:49:14.823 INFO:teuthology.orchestra.run.smithi039.stdout: "debug", 2024-09-12T02:49:14.823 INFO:teuthology.orchestra.run.smithi039.stdout: "error", 2024-09-12T02:49:14.823 INFO:teuthology.orchestra.run.smithi039.stdout: "info", 2024-09-12T02:49:14.823 INFO:teuthology.orchestra.run.smithi039.stdout: "warning" 2024-09-12T02:49:14.823 INFO:teuthology.orchestra.run.smithi039.stdout: ], 2024-09-12T02:49:14.823 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "", 2024-09-12T02:49:14.824 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-09-12T02:49:14.824 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-09-12T02:49:14.824 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-09-12T02:49:14.824 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-09-12T02:49:14.824 INFO:teuthology.orchestra.run.smithi039.stdout: "log_to_file": { 2024-09-12T02:49:14.824 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "log_to_file", 2024-09-12T02:49:14.824 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "bool", 2024-09-12T02:49:14.824 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "advanced", 2024-09-12T02:49:14.824 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 1, 2024-09-12T02:49:14.824 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "False", 2024-09-12T02:49:14.824 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-09-12T02:49:14.824 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-09-12T02:49:14.824 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [], 2024-09-12T02:49:14.824 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "", 2024-09-12T02:49:14.825 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-09-12T02:49:14.825 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-09-12T02:49:14.825 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-09-12T02:49:14.825 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-09-12T02:49:14.825 INFO:teuthology.orchestra.run.smithi039.stdout: "motd": { 2024-09-12T02:49:14.825 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "motd", 2024-09-12T02:49:14.825 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "str", 2024-09-12T02:49:14.825 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "advanced", 2024-09-12T02:49:14.825 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 0, 2024-09-12T02:49:14.825 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "", 2024-09-12T02:49:14.825 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-09-12T02:49:14.825 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-09-12T02:49:14.825 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [], 2024-09-12T02:49:14.825 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "The message of the day", 2024-09-12T02:49:14.826 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-09-12T02:49:14.826 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-09-12T02:49:14.826 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-09-12T02:49:14.826 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-09-12T02:49:14.826 INFO:teuthology.orchestra.run.smithi039.stdout: "redirect_resolve_ip_addr": { 2024-09-12T02:49:14.826 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "redirect_resolve_ip_addr", 2024-09-12T02:49:14.826 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "bool", 2024-09-12T02:49:14.826 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "advanced", 2024-09-12T02:49:14.826 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 0, 2024-09-12T02:49:14.826 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "False", 2024-09-12T02:49:14.826 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-09-12T02:49:14.826 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-09-12T02:49:14.826 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [], 2024-09-12T02:49:14.826 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "", 2024-09-12T02:49:14.827 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-09-12T02:49:14.827 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-09-12T02:49:14.827 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-09-12T02:49:14.827 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-09-12T02:49:14.827 INFO:teuthology.orchestra.run.smithi039.stdout: "server_addr": { 2024-09-12T02:49:14.827 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "server_addr", 2024-09-12T02:49:14.827 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "str", 2024-09-12T02:49:14.827 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "advanced", 2024-09-12T02:49:14.827 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 0, 2024-09-12T02:49:14.827 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "::", 2024-09-12T02:49:14.827 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-09-12T02:49:14.827 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-09-12T02:49:14.827 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [], 2024-09-12T02:49:14.827 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "", 2024-09-12T02:49:14.828 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-09-12T02:49:14.828 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-09-12T02:49:14.828 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-09-12T02:49:14.828 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-09-12T02:49:14.828 INFO:teuthology.orchestra.run.smithi039.stdout: "server_port": { 2024-09-12T02:49:14.828 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "server_port", 2024-09-12T02:49:14.828 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "int", 2024-09-12T02:49:14.828 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "advanced", 2024-09-12T02:49:14.828 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 0, 2024-09-12T02:49:14.828 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "8080", 2024-09-12T02:49:14.828 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-09-12T02:49:14.828 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-09-12T02:49:14.828 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [], 2024-09-12T02:49:14.828 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "", 2024-09-12T02:49:14.829 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-09-12T02:49:14.829 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-09-12T02:49:14.829 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-09-12T02:49:14.829 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-09-12T02:49:14.829 INFO:teuthology.orchestra.run.smithi039.stdout: "ssl": { 2024-09-12T02:49:14.829 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "ssl", 2024-09-12T02:49:14.829 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "bool", 2024-09-12T02:49:14.829 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "advanced", 2024-09-12T02:49:14.829 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 0, 2024-09-12T02:49:14.829 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "True", 2024-09-12T02:49:14.829 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-09-12T02:49:14.829 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-09-12T02:49:14.829 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [], 2024-09-12T02:49:14.829 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "", 2024-09-12T02:49:14.830 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-09-12T02:49:14.830 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-09-12T02:49:14.830 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-09-12T02:49:14.830 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-09-12T02:49:14.830 INFO:teuthology.orchestra.run.smithi039.stdout: "ssl_server_port": { 2024-09-12T02:49:14.830 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "ssl_server_port", 2024-09-12T02:49:14.830 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "int", 2024-09-12T02:49:14.830 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "advanced", 2024-09-12T02:49:14.830 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 0, 2024-09-12T02:49:14.830 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "8443", 2024-09-12T02:49:14.830 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-09-12T02:49:14.830 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-09-12T02:49:14.830 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [], 2024-09-12T02:49:14.830 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "", 2024-09-12T02:49:14.831 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-09-12T02:49:14.831 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-09-12T02:49:14.831 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-09-12T02:49:14.831 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-09-12T02:49:14.831 INFO:teuthology.orchestra.run.smithi039.stdout: "standby_behaviour": { 2024-09-12T02:49:14.831 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "standby_behaviour", 2024-09-12T02:49:14.831 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "str", 2024-09-12T02:49:14.831 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "advanced", 2024-09-12T02:49:14.831 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 0, 2024-09-12T02:49:14.831 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "redirect", 2024-09-12T02:49:14.831 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-09-12T02:49:14.831 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-09-12T02:49:14.831 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [ 2024-09-12T02:49:14.832 INFO:teuthology.orchestra.run.smithi039.stdout: "error", 2024-09-12T02:49:14.832 INFO:teuthology.orchestra.run.smithi039.stdout: "redirect" 2024-09-12T02:49:14.832 INFO:teuthology.orchestra.run.smithi039.stdout: ], 2024-09-12T02:49:14.832 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "", 2024-09-12T02:49:14.832 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-09-12T02:49:14.832 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-09-12T02:49:14.832 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-09-12T02:49:14.832 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-09-12T02:49:14.832 INFO:teuthology.orchestra.run.smithi039.stdout: "standby_error_status_code": { 2024-09-12T02:49:14.832 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "standby_error_status_code", 2024-09-12T02:49:14.832 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "int", 2024-09-12T02:49:14.832 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "advanced", 2024-09-12T02:49:14.832 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 0, 2024-09-12T02:49:14.832 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "500", 2024-09-12T02:49:14.833 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "400", 2024-09-12T02:49:14.833 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "599", 2024-09-12T02:49:14.833 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [], 2024-09-12T02:49:14.833 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "", 2024-09-12T02:49:14.833 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-09-12T02:49:14.833 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-09-12T02:49:14.833 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-09-12T02:49:14.833 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-09-12T02:49:14.833 INFO:teuthology.orchestra.run.smithi039.stdout: "url_prefix": { 2024-09-12T02:49:14.833 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "url_prefix", 2024-09-12T02:49:14.833 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "str", 2024-09-12T02:49:14.833 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "advanced", 2024-09-12T02:49:14.833 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 0, 2024-09-12T02:49:14.834 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "", 2024-09-12T02:49:14.834 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-09-12T02:49:14.834 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-09-12T02:49:14.834 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [], 2024-09-12T02:49:14.834 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "", 2024-09-12T02:49:14.834 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-09-12T02:49:14.834 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-09-12T02:49:14.834 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-09-12T02:49:14.834 INFO:teuthology.orchestra.run.smithi039.stdout: } 2024-09-12T02:49:14.834 INFO:teuthology.orchestra.run.smithi039.stdout: } 2024-09-12T02:49:14.834 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-09-12T02:49:14.834 INFO:teuthology.orchestra.run.smithi039.stdout: { 2024-09-12T02:49:14.834 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "devicehealth", 2024-09-12T02:49:14.834 INFO:teuthology.orchestra.run.smithi039.stdout: "can_run": true, 2024-09-12T02:49:14.835 INFO:teuthology.orchestra.run.smithi039.stdout: "error_string": "", 2024-09-12T02:49:14.835 INFO:teuthology.orchestra.run.smithi039.stdout: "module_options": { 2024-09-12T02:49:14.835 INFO:teuthology.orchestra.run.smithi039.stdout: "enable_monitoring": { 2024-09-12T02:49:14.835 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "enable_monitoring", 2024-09-12T02:49:14.835 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "bool", 2024-09-12T02:49:14.835 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "advanced", 2024-09-12T02:49:14.835 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 1, 2024-09-12T02:49:14.835 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "True", 2024-09-12T02:49:14.835 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-09-12T02:49:14.835 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-09-12T02:49:14.835 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [], 2024-09-12T02:49:14.835 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "monitor device health metrics", 2024-09-12T02:49:14.835 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-09-12T02:49:14.835 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-09-12T02:49:14.836 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-09-12T02:49:14.836 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-09-12T02:49:14.836 INFO:teuthology.orchestra.run.smithi039.stdout: "log_level": { 2024-09-12T02:49:14.836 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "log_level", 2024-09-12T02:49:14.836 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "str", 2024-09-12T02:49:14.836 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "advanced", 2024-09-12T02:49:14.836 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 1, 2024-09-12T02:49:14.836 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "", 2024-09-12T02:49:14.836 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-09-12T02:49:14.836 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-09-12T02:49:14.836 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [ 2024-09-12T02:49:14.836 INFO:teuthology.orchestra.run.smithi039.stdout: "", 2024-09-12T02:49:14.836 INFO:teuthology.orchestra.run.smithi039.stdout: "critical", 2024-09-12T02:49:14.837 INFO:teuthology.orchestra.run.smithi039.stdout: "debug", 2024-09-12T02:49:14.837 INFO:teuthology.orchestra.run.smithi039.stdout: "error", 2024-09-12T02:49:14.837 INFO:teuthology.orchestra.run.smithi039.stdout: "info", 2024-09-12T02:49:14.837 INFO:teuthology.orchestra.run.smithi039.stdout: "warning" 2024-09-12T02:49:14.837 INFO:teuthology.orchestra.run.smithi039.stdout: ], 2024-09-12T02:49:14.837 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "", 2024-09-12T02:49:14.837 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-09-12T02:49:14.837 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-09-12T02:49:14.837 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-09-12T02:49:14.837 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-09-12T02:49:14.837 INFO:teuthology.orchestra.run.smithi039.stdout: "log_to_cluster": { 2024-09-12T02:49:14.837 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "log_to_cluster", 2024-09-12T02:49:14.837 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "bool", 2024-09-12T02:49:14.837 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "advanced", 2024-09-12T02:49:14.838 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 1, 2024-09-12T02:49:14.838 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "False", 2024-09-12T02:49:14.838 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-09-12T02:49:14.838 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-09-12T02:49:14.838 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [], 2024-09-12T02:49:14.838 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "", 2024-09-12T02:49:14.838 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-09-12T02:49:14.838 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-09-12T02:49:14.838 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-09-12T02:49:14.838 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-09-12T02:49:14.838 INFO:teuthology.orchestra.run.smithi039.stdout: "log_to_cluster_level": { 2024-09-12T02:49:14.838 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "log_to_cluster_level", 2024-09-12T02:49:14.838 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "str", 2024-09-12T02:49:14.838 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "advanced", 2024-09-12T02:49:14.839 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 1, 2024-09-12T02:49:14.839 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "info", 2024-09-12T02:49:14.839 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-09-12T02:49:14.839 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-09-12T02:49:14.839 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [ 2024-09-12T02:49:14.839 INFO:teuthology.orchestra.run.smithi039.stdout: "", 2024-09-12T02:49:14.839 INFO:teuthology.orchestra.run.smithi039.stdout: "critical", 2024-09-12T02:49:14.839 INFO:teuthology.orchestra.run.smithi039.stdout: "debug", 2024-09-12T02:49:14.839 INFO:teuthology.orchestra.run.smithi039.stdout: "error", 2024-09-12T02:49:14.839 INFO:teuthology.orchestra.run.smithi039.stdout: "info", 2024-09-12T02:49:14.839 INFO:teuthology.orchestra.run.smithi039.stdout: "warning" 2024-09-12T02:49:14.839 INFO:teuthology.orchestra.run.smithi039.stdout: ], 2024-09-12T02:49:14.839 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "", 2024-09-12T02:49:14.839 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-09-12T02:49:14.840 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-09-12T02:49:14.840 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-09-12T02:49:14.840 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-09-12T02:49:14.840 INFO:teuthology.orchestra.run.smithi039.stdout: "log_to_file": { 2024-09-12T02:49:14.840 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "log_to_file", 2024-09-12T02:49:14.840 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "bool", 2024-09-12T02:49:14.840 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "advanced", 2024-09-12T02:49:14.840 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 1, 2024-09-12T02:49:14.840 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "False", 2024-09-12T02:49:14.840 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-09-12T02:49:14.840 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-09-12T02:49:14.840 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [], 2024-09-12T02:49:14.840 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "", 2024-09-12T02:49:14.840 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-09-12T02:49:14.841 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-09-12T02:49:14.841 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-09-12T02:49:14.841 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-09-12T02:49:14.841 INFO:teuthology.orchestra.run.smithi039.stdout: "mark_out_threshold": { 2024-09-12T02:49:14.841 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "mark_out_threshold", 2024-09-12T02:49:14.841 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "secs", 2024-09-12T02:49:14.841 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "advanced", 2024-09-12T02:49:14.841 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 1, 2024-09-12T02:49:14.841 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "2419200", 2024-09-12T02:49:14.841 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-09-12T02:49:14.841 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-09-12T02:49:14.841 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [], 2024-09-12T02:49:14.841 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "automatically mark OSD if it may fail before this long", 2024-09-12T02:49:14.842 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-09-12T02:49:14.842 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-09-12T02:49:14.842 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-09-12T02:49:14.842 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-09-12T02:49:14.842 INFO:teuthology.orchestra.run.smithi039.stdout: "pool_name": { 2024-09-12T02:49:14.842 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "pool_name", 2024-09-12T02:49:14.842 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "str", 2024-09-12T02:49:14.842 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "advanced", 2024-09-12T02:49:14.842 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 1, 2024-09-12T02:49:14.842 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "device_health_metrics", 2024-09-12T02:49:14.842 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-09-12T02:49:14.842 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-09-12T02:49:14.842 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [], 2024-09-12T02:49:14.842 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "name of pool in which to store device health metrics", 2024-09-12T02:49:14.843 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-09-12T02:49:14.843 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-09-12T02:49:14.843 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-09-12T02:49:14.843 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-09-12T02:49:14.843 INFO:teuthology.orchestra.run.smithi039.stdout: "retention_period": { 2024-09-12T02:49:14.843 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "retention_period", 2024-09-12T02:49:14.843 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "secs", 2024-09-12T02:49:14.843 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "advanced", 2024-09-12T02:49:14.843 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 1, 2024-09-12T02:49:14.843 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "15552000", 2024-09-12T02:49:14.843 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-09-12T02:49:14.843 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-09-12T02:49:14.843 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [], 2024-09-12T02:49:14.843 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "how long to retain device health metrics", 2024-09-12T02:49:14.844 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-09-12T02:49:14.844 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-09-12T02:49:14.844 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-09-12T02:49:14.844 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-09-12T02:49:14.844 INFO:teuthology.orchestra.run.smithi039.stdout: "scrape_frequency": { 2024-09-12T02:49:14.844 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "scrape_frequency", 2024-09-12T02:49:14.844 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "secs", 2024-09-12T02:49:14.844 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "advanced", 2024-09-12T02:49:14.844 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 1, 2024-09-12T02:49:14.844 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "86400", 2024-09-12T02:49:14.844 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-09-12T02:49:14.844 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-09-12T02:49:14.845 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [], 2024-09-12T02:49:14.845 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "how frequently to scrape device health metrics", 2024-09-12T02:49:14.845 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-09-12T02:49:14.845 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-09-12T02:49:14.845 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-09-12T02:49:14.845 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-09-12T02:49:14.845 INFO:teuthology.orchestra.run.smithi039.stdout: "self_heal": { 2024-09-12T02:49:14.845 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "self_heal", 2024-09-12T02:49:14.845 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "bool", 2024-09-12T02:49:14.845 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "advanced", 2024-09-12T02:49:14.845 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 1, 2024-09-12T02:49:14.845 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "True", 2024-09-12T02:49:14.845 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-09-12T02:49:14.846 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-09-12T02:49:14.846 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [], 2024-09-12T02:49:14.846 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "preemptively heal cluster around devices that may fail", 2024-09-12T02:49:14.846 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-09-12T02:49:14.846 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-09-12T02:49:14.846 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-09-12T02:49:14.846 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-09-12T02:49:14.846 INFO:teuthology.orchestra.run.smithi039.stdout: "sleep_interval": { 2024-09-12T02:49:14.846 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "sleep_interval", 2024-09-12T02:49:14.846 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "secs", 2024-09-12T02:49:14.846 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "advanced", 2024-09-12T02:49:14.846 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 1, 2024-09-12T02:49:14.846 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "600", 2024-09-12T02:49:14.847 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-09-12T02:49:14.847 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-09-12T02:49:14.847 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [], 2024-09-12T02:49:14.847 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "how frequently to wake up and check device health", 2024-09-12T02:49:14.847 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-09-12T02:49:14.847 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-09-12T02:49:14.847 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-09-12T02:49:14.847 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-09-12T02:49:14.847 INFO:teuthology.orchestra.run.smithi039.stdout: "warn_threshold": { 2024-09-12T02:49:14.847 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "warn_threshold", 2024-09-12T02:49:14.847 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "secs", 2024-09-12T02:49:14.847 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "advanced", 2024-09-12T02:49:14.847 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 1, 2024-09-12T02:49:14.847 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "7257600", 2024-09-12T02:49:14.848 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-09-12T02:49:14.848 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-09-12T02:49:14.848 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [], 2024-09-12T02:49:14.848 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "raise health warning if OSD may fail before this long", 2024-09-12T02:49:14.848 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-09-12T02:49:14.848 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-09-12T02:49:14.848 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-09-12T02:49:14.848 INFO:teuthology.orchestra.run.smithi039.stdout: } 2024-09-12T02:49:14.848 INFO:teuthology.orchestra.run.smithi039.stdout: } 2024-09-12T02:49:14.848 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-09-12T02:49:14.848 INFO:teuthology.orchestra.run.smithi039.stdout: { 2024-09-12T02:49:14.848 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "diskprediction_local", 2024-09-12T02:49:14.848 INFO:teuthology.orchestra.run.smithi039.stdout: "can_run": true, 2024-09-12T02:49:14.849 INFO:teuthology.orchestra.run.smithi039.stdout: "error_string": "", 2024-09-12T02:49:14.849 INFO:teuthology.orchestra.run.smithi039.stdout: "module_options": { 2024-09-12T02:49:14.849 INFO:teuthology.orchestra.run.smithi039.stdout: "log_level": { 2024-09-12T02:49:14.849 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "log_level", 2024-09-12T02:49:14.849 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "str", 2024-09-12T02:49:14.849 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "advanced", 2024-09-12T02:49:14.849 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 1, 2024-09-12T02:49:14.849 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "", 2024-09-12T02:49:14.849 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-09-12T02:49:14.849 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-09-12T02:49:14.849 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [ 2024-09-12T02:49:14.849 INFO:teuthology.orchestra.run.smithi039.stdout: "", 2024-09-12T02:49:14.849 INFO:teuthology.orchestra.run.smithi039.stdout: "critical", 2024-09-12T02:49:14.849 INFO:teuthology.orchestra.run.smithi039.stdout: "debug", 2024-09-12T02:49:14.850 INFO:teuthology.orchestra.run.smithi039.stdout: "error", 2024-09-12T02:49:14.850 INFO:teuthology.orchestra.run.smithi039.stdout: "info", 2024-09-12T02:49:14.850 INFO:teuthology.orchestra.run.smithi039.stdout: "warning" 2024-09-12T02:49:14.850 INFO:teuthology.orchestra.run.smithi039.stdout: ], 2024-09-12T02:49:14.850 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "", 2024-09-12T02:49:14.850 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-09-12T02:49:14.850 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-09-12T02:49:14.850 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-09-12T02:49:14.850 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-09-12T02:49:14.850 INFO:teuthology.orchestra.run.smithi039.stdout: "log_to_cluster": { 2024-09-12T02:49:14.850 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "log_to_cluster", 2024-09-12T02:49:14.850 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "bool", 2024-09-12T02:49:14.850 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "advanced", 2024-09-12T02:49:14.850 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 1, 2024-09-12T02:49:14.851 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "False", 2024-09-12T02:49:14.851 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-09-12T02:49:14.851 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-09-12T02:49:14.851 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [], 2024-09-12T02:49:14.851 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "", 2024-09-12T02:49:14.851 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-09-12T02:49:14.851 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-09-12T02:49:14.851 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-09-12T02:49:14.851 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-09-12T02:49:14.851 INFO:teuthology.orchestra.run.smithi039.stdout: "log_to_cluster_level": { 2024-09-12T02:49:14.851 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "log_to_cluster_level", 2024-09-12T02:49:14.851 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "str", 2024-09-12T02:49:14.851 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "advanced", 2024-09-12T02:49:14.852 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 1, 2024-09-12T02:49:14.852 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "info", 2024-09-12T02:49:14.852 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-09-12T02:49:14.852 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-09-12T02:49:14.852 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [ 2024-09-12T02:49:14.852 INFO:teuthology.orchestra.run.smithi039.stdout: "", 2024-09-12T02:49:14.852 INFO:teuthology.orchestra.run.smithi039.stdout: "critical", 2024-09-12T02:49:14.852 INFO:teuthology.orchestra.run.smithi039.stdout: "debug", 2024-09-12T02:49:14.852 INFO:teuthology.orchestra.run.smithi039.stdout: "error", 2024-09-12T02:49:14.852 INFO:teuthology.orchestra.run.smithi039.stdout: "info", 2024-09-12T02:49:14.852 INFO:teuthology.orchestra.run.smithi039.stdout: "warning" 2024-09-12T02:49:14.852 INFO:teuthology.orchestra.run.smithi039.stdout: ], 2024-09-12T02:49:14.852 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "", 2024-09-12T02:49:14.852 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-09-12T02:49:14.853 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-09-12T02:49:14.853 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-09-12T02:49:14.853 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-09-12T02:49:14.853 INFO:teuthology.orchestra.run.smithi039.stdout: "log_to_file": { 2024-09-12T02:49:14.853 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "log_to_file", 2024-09-12T02:49:14.853 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "bool", 2024-09-12T02:49:14.853 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "advanced", 2024-09-12T02:49:14.853 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 1, 2024-09-12T02:49:14.853 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "False", 2024-09-12T02:49:14.853 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-09-12T02:49:14.853 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-09-12T02:49:14.853 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [], 2024-09-12T02:49:14.853 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "", 2024-09-12T02:49:14.853 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-09-12T02:49:14.854 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-09-12T02:49:14.854 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-09-12T02:49:14.854 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-09-12T02:49:14.854 INFO:teuthology.orchestra.run.smithi039.stdout: "predict_interval": { 2024-09-12T02:49:14.854 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "predict_interval", 2024-09-12T02:49:14.854 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "str", 2024-09-12T02:49:14.854 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "advanced", 2024-09-12T02:49:14.854 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 0, 2024-09-12T02:49:14.854 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "86400", 2024-09-12T02:49:14.854 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-09-12T02:49:14.854 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-09-12T02:49:14.854 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [], 2024-09-12T02:49:14.854 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "", 2024-09-12T02:49:14.854 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-09-12T02:49:14.855 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-09-12T02:49:14.855 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-09-12T02:49:14.855 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-09-12T02:49:14.855 INFO:teuthology.orchestra.run.smithi039.stdout: "predictor_model": { 2024-09-12T02:49:14.855 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "predictor_model", 2024-09-12T02:49:14.855 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "str", 2024-09-12T02:49:14.855 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "advanced", 2024-09-12T02:49:14.855 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 0, 2024-09-12T02:49:14.855 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "prophetstor", 2024-09-12T02:49:14.855 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-09-12T02:49:14.855 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-09-12T02:49:14.855 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [], 2024-09-12T02:49:14.855 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "", 2024-09-12T02:49:14.855 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-09-12T02:49:14.855 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-09-12T02:49:14.856 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-09-12T02:49:14.856 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-09-12T02:49:14.856 INFO:teuthology.orchestra.run.smithi039.stdout: "sleep_interval": { 2024-09-12T02:49:14.856 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "sleep_interval", 2024-09-12T02:49:14.856 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "str", 2024-09-12T02:49:14.856 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "advanced", 2024-09-12T02:49:14.856 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 0, 2024-09-12T02:49:14.856 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "600", 2024-09-12T02:49:14.856 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-09-12T02:49:14.856 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-09-12T02:49:14.856 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [], 2024-09-12T02:49:14.856 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "", 2024-09-12T02:49:14.856 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-09-12T02:49:14.856 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-09-12T02:49:14.857 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-09-12T02:49:14.857 INFO:teuthology.orchestra.run.smithi039.stdout: } 2024-09-12T02:49:14.857 INFO:teuthology.orchestra.run.smithi039.stdout: } 2024-09-12T02:49:14.857 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-09-12T02:49:14.857 INFO:teuthology.orchestra.run.smithi039.stdout: { 2024-09-12T02:49:14.857 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "influx", 2024-09-12T02:49:14.857 INFO:teuthology.orchestra.run.smithi039.stdout: "can_run": false, 2024-09-12T02:49:14.857 INFO:teuthology.orchestra.run.smithi039.stdout: "error_string": "influxdb python module not found", 2024-09-12T02:49:14.857 INFO:teuthology.orchestra.run.smithi039.stdout: "module_options": { 2024-09-12T02:49:14.857 INFO:teuthology.orchestra.run.smithi039.stdout: "batch_size": { 2024-09-12T02:49:14.857 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "batch_size", 2024-09-12T02:49:14.857 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "int", 2024-09-12T02:49:14.858 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "advanced", 2024-09-12T02:49:14.858 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 0, 2024-09-12T02:49:14.858 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "5000", 2024-09-12T02:49:14.858 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-09-12T02:49:14.858 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-09-12T02:49:14.858 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [], 2024-09-12T02:49:14.858 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "How big batches of data points should be when sending to InfluxDB.", 2024-09-12T02:49:14.858 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-09-12T02:49:14.858 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-09-12T02:49:14.858 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-09-12T02:49:14.858 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-09-12T02:49:14.858 INFO:teuthology.orchestra.run.smithi039.stdout: "database": { 2024-09-12T02:49:14.858 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "database", 2024-09-12T02:49:14.858 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "str", 2024-09-12T02:49:14.859 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "advanced", 2024-09-12T02:49:14.859 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 0, 2024-09-12T02:49:14.859 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "ceph", 2024-09-12T02:49:14.859 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-09-12T02:49:14.859 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-09-12T02:49:14.859 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [], 2024-09-12T02:49:14.859 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "InfluxDB database name. You will need to create this database and grant write privileges to the configured username or the username must have admin privileges to create it.", 2024-09-12T02:49:14.859 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-09-12T02:49:14.859 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-09-12T02:49:14.859 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-09-12T02:49:14.859 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-09-12T02:49:14.859 INFO:teuthology.orchestra.run.smithi039.stdout: "hostname": { 2024-09-12T02:49:14.859 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "hostname", 2024-09-12T02:49:14.860 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "str", 2024-09-12T02:49:14.860 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "advanced", 2024-09-12T02:49:14.860 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 0, 2024-09-12T02:49:14.860 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "", 2024-09-12T02:49:14.860 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-09-12T02:49:14.860 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-09-12T02:49:14.860 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [], 2024-09-12T02:49:14.860 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "InfluxDB server hostname", 2024-09-12T02:49:14.860 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-09-12T02:49:14.860 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-09-12T02:49:14.860 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-09-12T02:49:14.860 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-09-12T02:49:14.860 INFO:teuthology.orchestra.run.smithi039.stdout: "interval": { 2024-09-12T02:49:14.860 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "interval", 2024-09-12T02:49:14.861 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "secs", 2024-09-12T02:49:14.861 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "advanced", 2024-09-12T02:49:14.861 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 0, 2024-09-12T02:49:14.861 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "30", 2024-09-12T02:49:14.861 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "5", 2024-09-12T02:49:14.861 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-09-12T02:49:14.861 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [], 2024-09-12T02:49:14.861 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "Time between reports to InfluxDB. Default 30 seconds.", 2024-09-12T02:49:14.861 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-09-12T02:49:14.861 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-09-12T02:49:14.861 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-09-12T02:49:14.861 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-09-12T02:49:14.861 INFO:teuthology.orchestra.run.smithi039.stdout: "log_level": { 2024-09-12T02:49:14.862 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "log_level", 2024-09-12T02:49:14.862 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "str", 2024-09-12T02:49:14.862 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "advanced", 2024-09-12T02:49:14.862 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 1, 2024-09-12T02:49:14.862 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "", 2024-09-12T02:49:14.862 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-09-12T02:49:14.862 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-09-12T02:49:14.862 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [ 2024-09-12T02:49:14.862 INFO:teuthology.orchestra.run.smithi039.stdout: "", 2024-09-12T02:49:14.862 INFO:teuthology.orchestra.run.smithi039.stdout: "critical", 2024-09-12T02:49:14.862 INFO:teuthology.orchestra.run.smithi039.stdout: "debug", 2024-09-12T02:49:14.862 INFO:teuthology.orchestra.run.smithi039.stdout: "error", 2024-09-12T02:49:14.862 INFO:teuthology.orchestra.run.smithi039.stdout: "info", 2024-09-12T02:49:14.862 INFO:teuthology.orchestra.run.smithi039.stdout: "warning" 2024-09-12T02:49:14.863 INFO:teuthology.orchestra.run.smithi039.stdout: ], 2024-09-12T02:49:14.863 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "", 2024-09-12T02:49:14.863 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-09-12T02:49:14.863 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-09-12T02:49:14.863 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-09-12T02:49:14.863 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-09-12T02:49:14.863 INFO:teuthology.orchestra.run.smithi039.stdout: "log_to_cluster": { 2024-09-12T02:49:14.863 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "log_to_cluster", 2024-09-12T02:49:14.863 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "bool", 2024-09-12T02:49:14.863 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "advanced", 2024-09-12T02:49:14.863 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 1, 2024-09-12T02:49:14.863 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "False", 2024-09-12T02:49:14.863 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-09-12T02:49:14.863 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-09-12T02:49:14.864 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [], 2024-09-12T02:49:14.864 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "", 2024-09-12T02:49:14.864 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-09-12T02:49:14.864 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-09-12T02:49:14.864 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-09-12T02:49:14.864 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-09-12T02:49:14.864 INFO:teuthology.orchestra.run.smithi039.stdout: "log_to_cluster_level": { 2024-09-12T02:49:14.864 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "log_to_cluster_level", 2024-09-12T02:49:14.864 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "str", 2024-09-12T02:49:14.864 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "advanced", 2024-09-12T02:49:14.864 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 1, 2024-09-12T02:49:14.864 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "info", 2024-09-12T02:49:14.864 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-09-12T02:49:14.865 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-09-12T02:49:14.865 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [ 2024-09-12T02:49:14.865 INFO:teuthology.orchestra.run.smithi039.stdout: "", 2024-09-12T02:49:14.865 INFO:teuthology.orchestra.run.smithi039.stdout: "critical", 2024-09-12T02:49:14.865 INFO:teuthology.orchestra.run.smithi039.stdout: "debug", 2024-09-12T02:49:14.865 INFO:teuthology.orchestra.run.smithi039.stdout: "error", 2024-09-12T02:49:14.865 INFO:teuthology.orchestra.run.smithi039.stdout: "info", 2024-09-12T02:49:14.865 INFO:teuthology.orchestra.run.smithi039.stdout: "warning" 2024-09-12T02:49:14.865 INFO:teuthology.orchestra.run.smithi039.stdout: ], 2024-09-12T02:49:14.865 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "", 2024-09-12T02:49:14.865 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-09-12T02:49:14.865 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-09-12T02:49:14.865 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-09-12T02:49:14.865 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-09-12T02:49:14.866 INFO:teuthology.orchestra.run.smithi039.stdout: "log_to_file": { 2024-09-12T02:49:14.866 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "log_to_file", 2024-09-12T02:49:14.866 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "bool", 2024-09-12T02:49:14.866 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "advanced", 2024-09-12T02:49:14.866 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 1, 2024-09-12T02:49:14.866 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "False", 2024-09-12T02:49:14.866 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-09-12T02:49:14.866 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-09-12T02:49:14.866 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [], 2024-09-12T02:49:14.866 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "", 2024-09-12T02:49:14.866 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-09-12T02:49:14.866 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-09-12T02:49:14.866 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-09-12T02:49:14.867 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-09-12T02:49:14.867 INFO:teuthology.orchestra.run.smithi039.stdout: "password": { 2024-09-12T02:49:14.867 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "password", 2024-09-12T02:49:14.867 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "str", 2024-09-12T02:49:14.867 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "advanced", 2024-09-12T02:49:14.867 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 0, 2024-09-12T02:49:14.867 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "", 2024-09-12T02:49:14.867 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-09-12T02:49:14.867 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-09-12T02:49:14.867 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [], 2024-09-12T02:49:14.867 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "password of InfluxDB server user", 2024-09-12T02:49:14.867 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-09-12T02:49:14.867 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-09-12T02:49:14.867 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-09-12T02:49:14.868 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-09-12T02:49:14.868 INFO:teuthology.orchestra.run.smithi039.stdout: "port": { 2024-09-12T02:49:14.868 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "port", 2024-09-12T02:49:14.868 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "int", 2024-09-12T02:49:14.868 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "advanced", 2024-09-12T02:49:14.868 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 0, 2024-09-12T02:49:14.868 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "8086", 2024-09-12T02:49:14.868 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-09-12T02:49:14.868 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-09-12T02:49:14.868 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [], 2024-09-12T02:49:14.868 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "InfluxDB server port", 2024-09-12T02:49:14.868 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-09-12T02:49:14.868 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-09-12T02:49:14.868 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-09-12T02:49:14.869 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-09-12T02:49:14.869 INFO:teuthology.orchestra.run.smithi039.stdout: "ssl": { 2024-09-12T02:49:14.869 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "ssl", 2024-09-12T02:49:14.869 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "str", 2024-09-12T02:49:14.869 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "advanced", 2024-09-12T02:49:14.869 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 0, 2024-09-12T02:49:14.869 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "false", 2024-09-12T02:49:14.869 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-09-12T02:49:14.869 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-09-12T02:49:14.869 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [], 2024-09-12T02:49:14.869 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "Use https connection for InfluxDB server. Use \"true\" or \"false\".", 2024-09-12T02:49:14.869 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-09-12T02:49:14.869 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-09-12T02:49:14.869 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-09-12T02:49:14.870 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-09-12T02:49:14.870 INFO:teuthology.orchestra.run.smithi039.stdout: "threads": { 2024-09-12T02:49:14.870 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "threads", 2024-09-12T02:49:14.870 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "int", 2024-09-12T02:49:14.870 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "advanced", 2024-09-12T02:49:14.870 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 0, 2024-09-12T02:49:14.870 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "5", 2024-09-12T02:49:14.870 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "1", 2024-09-12T02:49:14.870 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "32", 2024-09-12T02:49:14.870 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [], 2024-09-12T02:49:14.870 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "How many worker threads should be spawned for sending data to InfluxDB.", 2024-09-12T02:49:14.870 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-09-12T02:49:14.870 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-09-12T02:49:14.870 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-09-12T02:49:14.871 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-09-12T02:49:14.871 INFO:teuthology.orchestra.run.smithi039.stdout: "username": { 2024-09-12T02:49:14.871 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "username", 2024-09-12T02:49:14.871 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "str", 2024-09-12T02:49:14.871 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "advanced", 2024-09-12T02:49:14.871 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 0, 2024-09-12T02:49:14.871 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "", 2024-09-12T02:49:14.871 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-09-12T02:49:14.871 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-09-12T02:49:14.871 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [], 2024-09-12T02:49:14.871 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "username of InfluxDB server user", 2024-09-12T02:49:14.871 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-09-12T02:49:14.871 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-09-12T02:49:14.871 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-09-12T02:49:14.872 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-09-12T02:49:14.872 INFO:teuthology.orchestra.run.smithi039.stdout: "verify_ssl": { 2024-09-12T02:49:14.872 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "verify_ssl", 2024-09-12T02:49:14.872 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "str", 2024-09-12T02:49:14.872 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "advanced", 2024-09-12T02:49:14.872 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 0, 2024-09-12T02:49:14.872 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "true", 2024-09-12T02:49:14.872 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-09-12T02:49:14.872 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-09-12T02:49:14.872 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [], 2024-09-12T02:49:14.872 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "Verify https cert for InfluxDB server. Use \"true\" or \"false\".", 2024-09-12T02:49:14.872 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-09-12T02:49:14.872 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-09-12T02:49:14.873 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-09-12T02:49:14.873 INFO:teuthology.orchestra.run.smithi039.stdout: } 2024-09-12T02:49:14.873 INFO:teuthology.orchestra.run.smithi039.stdout: } 2024-09-12T02:49:14.873 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-09-12T02:49:14.873 INFO:teuthology.orchestra.run.smithi039.stdout: { 2024-09-12T02:49:14.873 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "insights", 2024-09-12T02:49:14.873 INFO:teuthology.orchestra.run.smithi039.stdout: "can_run": true, 2024-09-12T02:49:14.873 INFO:teuthology.orchestra.run.smithi039.stdout: "error_string": "", 2024-09-12T02:49:14.873 INFO:teuthology.orchestra.run.smithi039.stdout: "module_options": { 2024-09-12T02:49:14.873 INFO:teuthology.orchestra.run.smithi039.stdout: "log_level": { 2024-09-12T02:49:14.873 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "log_level", 2024-09-12T02:49:14.873 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "str", 2024-09-12T02:49:14.873 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "advanced", 2024-09-12T02:49:14.874 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 1, 2024-09-12T02:49:14.874 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "", 2024-09-12T02:49:14.874 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-09-12T02:49:14.874 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-09-12T02:49:14.874 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [ 2024-09-12T02:49:14.874 INFO:teuthology.orchestra.run.smithi039.stdout: "", 2024-09-12T02:49:14.874 INFO:teuthology.orchestra.run.smithi039.stdout: "critical", 2024-09-12T02:49:14.874 INFO:teuthology.orchestra.run.smithi039.stdout: "debug", 2024-09-12T02:49:14.874 INFO:teuthology.orchestra.run.smithi039.stdout: "error", 2024-09-12T02:49:14.874 INFO:teuthology.orchestra.run.smithi039.stdout: "info", 2024-09-12T02:49:14.874 INFO:teuthology.orchestra.run.smithi039.stdout: "warning" 2024-09-12T02:49:14.874 INFO:teuthology.orchestra.run.smithi039.stdout: ], 2024-09-12T02:49:14.874 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "", 2024-09-12T02:49:14.874 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-09-12T02:49:14.875 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-09-12T02:49:14.875 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-09-12T02:49:14.875 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-09-12T02:49:14.875 INFO:teuthology.orchestra.run.smithi039.stdout: "log_to_cluster": { 2024-09-12T02:49:14.875 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "log_to_cluster", 2024-09-12T02:49:14.875 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "bool", 2024-09-12T02:49:14.875 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "advanced", 2024-09-12T02:49:14.875 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 1, 2024-09-12T02:49:14.875 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "False", 2024-09-12T02:49:14.875 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-09-12T02:49:14.875 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-09-12T02:49:14.875 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [], 2024-09-12T02:49:14.875 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "", 2024-09-12T02:49:14.875 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-09-12T02:49:14.876 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-09-12T02:49:14.876 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-09-12T02:49:14.876 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-09-12T02:49:14.876 INFO:teuthology.orchestra.run.smithi039.stdout: "log_to_cluster_level": { 2024-09-12T02:49:14.876 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "log_to_cluster_level", 2024-09-12T02:49:14.876 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "str", 2024-09-12T02:49:14.876 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "advanced", 2024-09-12T02:49:14.876 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 1, 2024-09-12T02:49:14.876 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "info", 2024-09-12T02:49:14.876 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-09-12T02:49:14.876 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-09-12T02:49:14.876 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [ 2024-09-12T02:49:14.876 INFO:teuthology.orchestra.run.smithi039.stdout: "", 2024-09-12T02:49:14.877 INFO:teuthology.orchestra.run.smithi039.stdout: "critical", 2024-09-12T02:49:14.877 INFO:teuthology.orchestra.run.smithi039.stdout: "debug", 2024-09-12T02:49:14.877 INFO:teuthology.orchestra.run.smithi039.stdout: "error", 2024-09-12T02:49:14.877 INFO:teuthology.orchestra.run.smithi039.stdout: "info", 2024-09-12T02:49:14.877 INFO:teuthology.orchestra.run.smithi039.stdout: "warning" 2024-09-12T02:49:14.877 INFO:teuthology.orchestra.run.smithi039.stdout: ], 2024-09-12T02:49:14.877 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "", 2024-09-12T02:49:14.877 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-09-12T02:49:14.877 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-09-12T02:49:14.877 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-09-12T02:49:14.877 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-09-12T02:49:14.877 INFO:teuthology.orchestra.run.smithi039.stdout: "log_to_file": { 2024-09-12T02:49:14.877 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "log_to_file", 2024-09-12T02:49:14.877 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "bool", 2024-09-12T02:49:14.878 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "advanced", 2024-09-12T02:49:14.878 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 1, 2024-09-12T02:49:14.878 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "False", 2024-09-12T02:49:14.878 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-09-12T02:49:14.878 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-09-12T02:49:14.878 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [], 2024-09-12T02:49:14.878 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "", 2024-09-12T02:49:14.878 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-09-12T02:49:14.878 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-09-12T02:49:14.878 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-09-12T02:49:14.878 INFO:teuthology.orchestra.run.smithi039.stdout: } 2024-09-12T02:49:14.878 INFO:teuthology.orchestra.run.smithi039.stdout: } 2024-09-12T02:49:14.878 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-09-12T02:49:14.879 INFO:teuthology.orchestra.run.smithi039.stdout: { 2024-09-12T02:49:14.879 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "iostat", 2024-09-12T02:49:14.879 INFO:teuthology.orchestra.run.smithi039.stdout: "can_run": true, 2024-09-12T02:49:14.879 INFO:teuthology.orchestra.run.smithi039.stdout: "error_string": "", 2024-09-12T02:49:14.879 INFO:teuthology.orchestra.run.smithi039.stdout: "module_options": { 2024-09-12T02:49:14.879 INFO:teuthology.orchestra.run.smithi039.stdout: "log_level": { 2024-09-12T02:49:14.879 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "log_level", 2024-09-12T02:49:14.879 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "str", 2024-09-12T02:49:14.879 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "advanced", 2024-09-12T02:49:14.879 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 1, 2024-09-12T02:49:14.879 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "", 2024-09-12T02:49:14.879 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-09-12T02:49:14.879 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-09-12T02:49:14.879 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [ 2024-09-12T02:49:14.880 INFO:teuthology.orchestra.run.smithi039.stdout: "", 2024-09-12T02:49:14.880 INFO:teuthology.orchestra.run.smithi039.stdout: "critical", 2024-09-12T02:49:14.880 INFO:teuthology.orchestra.run.smithi039.stdout: "debug", 2024-09-12T02:49:14.880 INFO:teuthology.orchestra.run.smithi039.stdout: "error", 2024-09-12T02:49:14.880 INFO:teuthology.orchestra.run.smithi039.stdout: "info", 2024-09-12T02:49:14.880 INFO:teuthology.orchestra.run.smithi039.stdout: "warning" 2024-09-12T02:49:14.880 INFO:teuthology.orchestra.run.smithi039.stdout: ], 2024-09-12T02:49:14.880 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "", 2024-09-12T02:49:14.880 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-09-12T02:49:14.880 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-09-12T02:49:14.880 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-09-12T02:49:14.880 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-09-12T02:49:14.880 INFO:teuthology.orchestra.run.smithi039.stdout: "log_to_cluster": { 2024-09-12T02:49:14.881 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "log_to_cluster", 2024-09-12T02:49:14.881 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "bool", 2024-09-12T02:49:14.881 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "advanced", 2024-09-12T02:49:14.881 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 1, 2024-09-12T02:49:14.881 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "False", 2024-09-12T02:49:14.881 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-09-12T02:49:14.881 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-09-12T02:49:14.881 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [], 2024-09-12T02:49:14.881 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "", 2024-09-12T02:49:14.881 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-09-12T02:49:14.881 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-09-12T02:49:14.881 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-09-12T02:49:14.881 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-09-12T02:49:14.881 INFO:teuthology.orchestra.run.smithi039.stdout: "log_to_cluster_level": { 2024-09-12T02:49:14.882 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "log_to_cluster_level", 2024-09-12T02:49:14.882 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "str", 2024-09-12T02:49:14.882 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "advanced", 2024-09-12T02:49:14.882 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 1, 2024-09-12T02:49:14.882 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "info", 2024-09-12T02:49:14.882 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-09-12T02:49:14.882 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-09-12T02:49:14.882 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [ 2024-09-12T02:49:14.882 INFO:teuthology.orchestra.run.smithi039.stdout: "", 2024-09-12T02:49:14.882 INFO:teuthology.orchestra.run.smithi039.stdout: "critical", 2024-09-12T02:49:14.882 INFO:teuthology.orchestra.run.smithi039.stdout: "debug", 2024-09-12T02:49:14.882 INFO:teuthology.orchestra.run.smithi039.stdout: "error", 2024-09-12T02:49:14.882 INFO:teuthology.orchestra.run.smithi039.stdout: "info", 2024-09-12T02:49:14.882 INFO:teuthology.orchestra.run.smithi039.stdout: "warning" 2024-09-12T02:49:14.883 INFO:teuthology.orchestra.run.smithi039.stdout: ], 2024-09-12T02:49:14.883 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "", 2024-09-12T02:49:14.883 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-09-12T02:49:14.883 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-09-12T02:49:14.883 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-09-12T02:49:14.883 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-09-12T02:49:14.883 INFO:teuthology.orchestra.run.smithi039.stdout: "log_to_file": { 2024-09-12T02:49:14.883 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "log_to_file", 2024-09-12T02:49:14.883 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "bool", 2024-09-12T02:49:14.883 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "advanced", 2024-09-12T02:49:14.883 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 1, 2024-09-12T02:49:14.883 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "False", 2024-09-12T02:49:14.883 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-09-12T02:49:14.883 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-09-12T02:49:14.884 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [], 2024-09-12T02:49:14.884 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "", 2024-09-12T02:49:14.884 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-09-12T02:49:14.884 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-09-12T02:49:14.884 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-09-12T02:49:14.884 INFO:teuthology.orchestra.run.smithi039.stdout: } 2024-09-12T02:49:14.884 INFO:teuthology.orchestra.run.smithi039.stdout: } 2024-09-12T02:49:14.884 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-09-12T02:49:14.884 INFO:teuthology.orchestra.run.smithi039.stdout: { 2024-09-12T02:49:14.884 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "k8sevents", 2024-09-12T02:49:14.884 INFO:teuthology.orchestra.run.smithi039.stdout: "can_run": true, 2024-09-12T02:49:14.884 INFO:teuthology.orchestra.run.smithi039.stdout: "error_string": "", 2024-09-12T02:49:14.884 INFO:teuthology.orchestra.run.smithi039.stdout: "module_options": { 2024-09-12T02:49:14.884 INFO:teuthology.orchestra.run.smithi039.stdout: "ceph_event_retention_days": { 2024-09-12T02:49:14.885 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "ceph_event_retention_days", 2024-09-12T02:49:14.885 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "int", 2024-09-12T02:49:14.885 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "advanced", 2024-09-12T02:49:14.885 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 0, 2024-09-12T02:49:14.885 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "7", 2024-09-12T02:49:14.885 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-09-12T02:49:14.885 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-09-12T02:49:14.885 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [], 2024-09-12T02:49:14.885 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "Days to hold ceph event information within local cache", 2024-09-12T02:49:14.885 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-09-12T02:49:14.885 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-09-12T02:49:14.885 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-09-12T02:49:14.885 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-09-12T02:49:14.885 INFO:teuthology.orchestra.run.smithi039.stdout: "config_check_secs": { 2024-09-12T02:49:14.888 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "config_check_secs", 2024-09-12T02:49:14.888 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "int", 2024-09-12T02:49:14.888 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "advanced", 2024-09-12T02:49:14.889 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 0, 2024-09-12T02:49:14.889 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "10", 2024-09-12T02:49:14.889 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "10", 2024-09-12T02:49:14.889 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-09-12T02:49:14.889 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [], 2024-09-12T02:49:14.889 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "interval (secs) to check for cluster configuration changes", 2024-09-12T02:49:14.889 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-09-12T02:49:14.889 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-09-12T02:49:14.889 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-09-12T02:49:14.889 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-09-12T02:49:14.889 INFO:teuthology.orchestra.run.smithi039.stdout: "log_level": { 2024-09-12T02:49:14.889 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "log_level", 2024-09-12T02:49:14.889 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "str", 2024-09-12T02:49:14.889 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "advanced", 2024-09-12T02:49:14.890 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 1, 2024-09-12T02:49:14.890 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "", 2024-09-12T02:49:14.890 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-09-12T02:49:14.890 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-09-12T02:49:14.890 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [ 2024-09-12T02:49:14.890 INFO:teuthology.orchestra.run.smithi039.stdout: "", 2024-09-12T02:49:14.890 INFO:teuthology.orchestra.run.smithi039.stdout: "critical", 2024-09-12T02:49:14.890 INFO:teuthology.orchestra.run.smithi039.stdout: "debug", 2024-09-12T02:49:14.890 INFO:teuthology.orchestra.run.smithi039.stdout: "error", 2024-09-12T02:49:14.890 INFO:teuthology.orchestra.run.smithi039.stdout: "info", 2024-09-12T02:49:14.890 INFO:teuthology.orchestra.run.smithi039.stdout: "warning" 2024-09-12T02:49:14.890 INFO:teuthology.orchestra.run.smithi039.stdout: ], 2024-09-12T02:49:14.890 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "", 2024-09-12T02:49:14.891 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-09-12T02:49:14.891 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-09-12T02:49:14.891 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-09-12T02:49:14.891 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-09-12T02:49:14.891 INFO:teuthology.orchestra.run.smithi039.stdout: "log_to_cluster": { 2024-09-12T02:49:14.891 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "log_to_cluster", 2024-09-12T02:49:14.891 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "bool", 2024-09-12T02:49:14.891 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "advanced", 2024-09-12T02:49:14.891 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 1, 2024-09-12T02:49:14.891 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "False", 2024-09-12T02:49:14.891 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-09-12T02:49:14.891 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-09-12T02:49:14.891 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [], 2024-09-12T02:49:14.892 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "", 2024-09-12T02:49:14.892 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-09-12T02:49:14.892 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-09-12T02:49:14.892 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-09-12T02:49:14.892 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-09-12T02:49:14.892 INFO:teuthology.orchestra.run.smithi039.stdout: "log_to_cluster_level": { 2024-09-12T02:49:14.892 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "log_to_cluster_level", 2024-09-12T02:49:14.892 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "str", 2024-09-12T02:49:14.892 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "advanced", 2024-09-12T02:49:14.892 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 1, 2024-09-12T02:49:14.892 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "info", 2024-09-12T02:49:14.892 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-09-12T02:49:14.892 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-09-12T02:49:14.893 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [ 2024-09-12T02:49:14.893 INFO:teuthology.orchestra.run.smithi039.stdout: "", 2024-09-12T02:49:14.893 INFO:teuthology.orchestra.run.smithi039.stdout: "critical", 2024-09-12T02:49:14.893 INFO:teuthology.orchestra.run.smithi039.stdout: "debug", 2024-09-12T02:49:14.893 INFO:teuthology.orchestra.run.smithi039.stdout: "error", 2024-09-12T02:49:14.893 INFO:teuthology.orchestra.run.smithi039.stdout: "info", 2024-09-12T02:49:14.893 INFO:teuthology.orchestra.run.smithi039.stdout: "warning" 2024-09-12T02:49:14.893 INFO:teuthology.orchestra.run.smithi039.stdout: ], 2024-09-12T02:49:14.893 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "", 2024-09-12T02:49:14.893 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-09-12T02:49:14.893 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-09-12T02:49:14.893 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-09-12T02:49:14.893 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-09-12T02:49:14.893 INFO:teuthology.orchestra.run.smithi039.stdout: "log_to_file": { 2024-09-12T02:49:14.894 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "log_to_file", 2024-09-12T02:49:14.894 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "bool", 2024-09-12T02:49:14.894 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "advanced", 2024-09-12T02:49:14.894 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 1, 2024-09-12T02:49:14.894 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "False", 2024-09-12T02:49:14.894 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-09-12T02:49:14.894 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-09-12T02:49:14.894 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [], 2024-09-12T02:49:14.894 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "", 2024-09-12T02:49:14.894 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-09-12T02:49:14.894 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-09-12T02:49:14.894 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-09-12T02:49:14.894 INFO:teuthology.orchestra.run.smithi039.stdout: } 2024-09-12T02:49:14.895 INFO:teuthology.orchestra.run.smithi039.stdout: } 2024-09-12T02:49:14.895 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-09-12T02:49:14.895 INFO:teuthology.orchestra.run.smithi039.stdout: { 2024-09-12T02:49:14.895 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "localpool", 2024-09-12T02:49:14.895 INFO:teuthology.orchestra.run.smithi039.stdout: "can_run": true, 2024-09-12T02:49:14.895 INFO:teuthology.orchestra.run.smithi039.stdout: "error_string": "", 2024-09-12T02:49:14.895 INFO:teuthology.orchestra.run.smithi039.stdout: "module_options": { 2024-09-12T02:49:14.895 INFO:teuthology.orchestra.run.smithi039.stdout: "failure_domain": { 2024-09-12T02:49:14.895 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "failure_domain", 2024-09-12T02:49:14.895 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "str", 2024-09-12T02:49:14.895 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "advanced", 2024-09-12T02:49:14.895 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 1, 2024-09-12T02:49:14.895 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "host", 2024-09-12T02:49:14.895 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-09-12T02:49:14.896 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-09-12T02:49:14.896 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [], 2024-09-12T02:49:14.896 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "failure domain for any created local pool", 2024-09-12T02:49:14.896 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "what failure domain we should separate data replicas across.", 2024-09-12T02:49:14.896 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-09-12T02:49:14.896 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-09-12T02:49:14.896 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-09-12T02:49:14.896 INFO:teuthology.orchestra.run.smithi039.stdout: "log_level": { 2024-09-12T02:49:14.896 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "log_level", 2024-09-12T02:49:14.896 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "str", 2024-09-12T02:49:14.896 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "advanced", 2024-09-12T02:49:14.896 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 1, 2024-09-12T02:49:14.896 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "", 2024-09-12T02:49:14.897 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-09-12T02:49:14.897 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-09-12T02:49:14.897 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [ 2024-09-12T02:49:14.897 INFO:teuthology.orchestra.run.smithi039.stdout: "", 2024-09-12T02:49:14.897 INFO:teuthology.orchestra.run.smithi039.stdout: "critical", 2024-09-12T02:49:14.897 INFO:teuthology.orchestra.run.smithi039.stdout: "debug", 2024-09-12T02:49:14.897 INFO:teuthology.orchestra.run.smithi039.stdout: "error", 2024-09-12T02:49:14.897 INFO:teuthology.orchestra.run.smithi039.stdout: "info", 2024-09-12T02:49:14.897 INFO:teuthology.orchestra.run.smithi039.stdout: "warning" 2024-09-12T02:49:14.897 INFO:teuthology.orchestra.run.smithi039.stdout: ], 2024-09-12T02:49:14.897 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "", 2024-09-12T02:49:14.897 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-09-12T02:49:14.897 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-09-12T02:49:14.898 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-09-12T02:49:14.898 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-09-12T02:49:14.898 INFO:teuthology.orchestra.run.smithi039.stdout: "log_to_cluster": { 2024-09-12T02:49:14.898 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "log_to_cluster", 2024-09-12T02:49:14.898 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "bool", 2024-09-12T02:49:14.898 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "advanced", 2024-09-12T02:49:14.898 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 1, 2024-09-12T02:49:14.898 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "False", 2024-09-12T02:49:14.898 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-09-12T02:49:14.898 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-09-12T02:49:14.898 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [], 2024-09-12T02:49:14.898 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "", 2024-09-12T02:49:14.898 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-09-12T02:49:14.898 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-09-12T02:49:14.899 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-09-12T02:49:14.899 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-09-12T02:49:14.899 INFO:teuthology.orchestra.run.smithi039.stdout: "log_to_cluster_level": { 2024-09-12T02:49:14.899 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "log_to_cluster_level", 2024-09-12T02:49:14.899 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "str", 2024-09-12T02:49:14.899 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "advanced", 2024-09-12T02:49:14.899 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 1, 2024-09-12T02:49:14.899 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "info", 2024-09-12T02:49:14.899 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-09-12T02:49:14.899 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-09-12T02:49:14.899 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [ 2024-09-12T02:49:14.899 INFO:teuthology.orchestra.run.smithi039.stdout: "", 2024-09-12T02:49:14.899 INFO:teuthology.orchestra.run.smithi039.stdout: "critical", 2024-09-12T02:49:14.899 INFO:teuthology.orchestra.run.smithi039.stdout: "debug", 2024-09-12T02:49:14.900 INFO:teuthology.orchestra.run.smithi039.stdout: "error", 2024-09-12T02:49:14.900 INFO:teuthology.orchestra.run.smithi039.stdout: "info", 2024-09-12T02:49:14.900 INFO:teuthology.orchestra.run.smithi039.stdout: "warning" 2024-09-12T02:49:14.900 INFO:teuthology.orchestra.run.smithi039.stdout: ], 2024-09-12T02:49:14.900 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "", 2024-09-12T02:49:14.900 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-09-12T02:49:14.900 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-09-12T02:49:14.900 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-09-12T02:49:14.900 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-09-12T02:49:14.900 INFO:teuthology.orchestra.run.smithi039.stdout: "log_to_file": { 2024-09-12T02:49:14.900 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "log_to_file", 2024-09-12T02:49:14.900 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "bool", 2024-09-12T02:49:14.900 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "advanced", 2024-09-12T02:49:14.900 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 1, 2024-09-12T02:49:14.901 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "False", 2024-09-12T02:49:14.901 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-09-12T02:49:14.901 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-09-12T02:49:14.901 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [], 2024-09-12T02:49:14.901 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "", 2024-09-12T02:49:14.901 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-09-12T02:49:14.901 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-09-12T02:49:14.901 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-09-12T02:49:14.901 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-09-12T02:49:14.901 INFO:teuthology.orchestra.run.smithi039.stdout: "min_size": { 2024-09-12T02:49:14.901 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "min_size", 2024-09-12T02:49:14.901 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "int", 2024-09-12T02:49:14.901 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "advanced", 2024-09-12T02:49:14.901 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 1, 2024-09-12T02:49:14.902 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "", 2024-09-12T02:49:14.902 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-09-12T02:49:14.902 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-09-12T02:49:14.902 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [], 2024-09-12T02:49:14.902 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "default min_size for any created local pool", 2024-09-12T02:49:14.902 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "value to set min_size to (unchanged from Ceph's default if this option is not set)", 2024-09-12T02:49:14.902 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-09-12T02:49:14.902 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-09-12T02:49:14.902 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-09-12T02:49:14.902 INFO:teuthology.orchestra.run.smithi039.stdout: "num_rep": { 2024-09-12T02:49:14.902 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "num_rep", 2024-09-12T02:49:14.902 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "int", 2024-09-12T02:49:14.902 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "advanced", 2024-09-12T02:49:14.903 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 1, 2024-09-12T02:49:14.903 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "3", 2024-09-12T02:49:14.903 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-09-12T02:49:14.903 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-09-12T02:49:14.903 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [], 2024-09-12T02:49:14.903 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "default replica count for any created local pool", 2024-09-12T02:49:14.903 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-09-12T02:49:14.903 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-09-12T02:49:14.903 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-09-12T02:49:14.903 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-09-12T02:49:14.903 INFO:teuthology.orchestra.run.smithi039.stdout: "pg_num": { 2024-09-12T02:49:14.903 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "pg_num", 2024-09-12T02:49:14.903 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "int", 2024-09-12T02:49:14.903 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "advanced", 2024-09-12T02:49:14.903 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 1, 2024-09-12T02:49:14.904 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "128", 2024-09-12T02:49:14.904 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-09-12T02:49:14.904 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-09-12T02:49:14.904 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [], 2024-09-12T02:49:14.904 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "default pg_num for any created local pool", 2024-09-12T02:49:14.904 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-09-12T02:49:14.904 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-09-12T02:49:14.904 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-09-12T02:49:14.904 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-09-12T02:49:14.905 INFO:teuthology.orchestra.run.smithi039.stdout: "prefix": { 2024-09-12T02:49:14.905 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "prefix", 2024-09-12T02:49:14.905 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "str", 2024-09-12T02:49:14.905 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "advanced", 2024-09-12T02:49:14.905 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 1, 2024-09-12T02:49:14.905 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "", 2024-09-12T02:49:14.905 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-09-12T02:49:14.905 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-09-12T02:49:14.905 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [], 2024-09-12T02:49:14.905 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "name prefix for any created local pool", 2024-09-12T02:49:14.905 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-09-12T02:49:14.905 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-09-12T02:49:14.905 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-09-12T02:49:14.905 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-09-12T02:49:14.906 INFO:teuthology.orchestra.run.smithi039.stdout: "subtree": { 2024-09-12T02:49:14.906 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "subtree", 2024-09-12T02:49:14.906 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "str", 2024-09-12T02:49:14.906 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "advanced", 2024-09-12T02:49:14.906 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 1, 2024-09-12T02:49:14.906 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "rack", 2024-09-12T02:49:14.906 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-09-12T02:49:14.906 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-09-12T02:49:14.906 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [], 2024-09-12T02:49:14.906 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "CRUSH level for which to create a local pool", 2024-09-12T02:49:14.906 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "which CRUSH subtree type the module should create a pool for.", 2024-09-12T02:49:14.906 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-09-12T02:49:14.906 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-09-12T02:49:14.907 INFO:teuthology.orchestra.run.smithi039.stdout: } 2024-09-12T02:49:14.907 INFO:teuthology.orchestra.run.smithi039.stdout: } 2024-09-12T02:49:14.907 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-09-12T02:49:14.907 INFO:teuthology.orchestra.run.smithi039.stdout: { 2024-09-12T02:49:14.907 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "mds_autoscaler", 2024-09-12T02:49:14.907 INFO:teuthology.orchestra.run.smithi039.stdout: "can_run": true, 2024-09-12T02:49:14.907 INFO:teuthology.orchestra.run.smithi039.stdout: "error_string": "", 2024-09-12T02:49:14.907 INFO:teuthology.orchestra.run.smithi039.stdout: "module_options": { 2024-09-12T02:49:14.907 INFO:teuthology.orchestra.run.smithi039.stdout: "log_level": { 2024-09-12T02:49:14.907 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "log_level", 2024-09-12T02:49:14.907 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "str", 2024-09-12T02:49:14.907 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "advanced", 2024-09-12T02:49:14.907 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 1, 2024-09-12T02:49:14.907 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "", 2024-09-12T02:49:14.908 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-09-12T02:49:14.908 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-09-12T02:49:14.908 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [ 2024-09-12T02:49:14.908 INFO:teuthology.orchestra.run.smithi039.stdout: "", 2024-09-12T02:49:14.908 INFO:teuthology.orchestra.run.smithi039.stdout: "critical", 2024-09-12T02:49:14.908 INFO:teuthology.orchestra.run.smithi039.stdout: "debug", 2024-09-12T02:49:14.908 INFO:teuthology.orchestra.run.smithi039.stdout: "error", 2024-09-12T02:49:14.908 INFO:teuthology.orchestra.run.smithi039.stdout: "info", 2024-09-12T02:49:14.908 INFO:teuthology.orchestra.run.smithi039.stdout: "warning" 2024-09-12T02:49:14.908 INFO:teuthology.orchestra.run.smithi039.stdout: ], 2024-09-12T02:49:14.908 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "", 2024-09-12T02:49:14.908 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-09-12T02:49:14.908 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-09-12T02:49:14.909 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-09-12T02:49:14.909 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-09-12T02:49:14.909 INFO:teuthology.orchestra.run.smithi039.stdout: "log_to_cluster": { 2024-09-12T02:49:14.909 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "log_to_cluster", 2024-09-12T02:49:14.909 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "bool", 2024-09-12T02:49:14.909 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "advanced", 2024-09-12T02:49:14.909 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 1, 2024-09-12T02:49:14.909 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "False", 2024-09-12T02:49:14.909 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-09-12T02:49:14.909 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-09-12T02:49:14.909 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [], 2024-09-12T02:49:14.909 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "", 2024-09-12T02:49:14.909 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-09-12T02:49:14.909 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-09-12T02:49:14.910 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-09-12T02:49:14.910 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-09-12T02:49:14.910 INFO:teuthology.orchestra.run.smithi039.stdout: "log_to_cluster_level": { 2024-09-12T02:49:14.910 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "log_to_cluster_level", 2024-09-12T02:49:14.910 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "str", 2024-09-12T02:49:14.910 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "advanced", 2024-09-12T02:49:14.910 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 1, 2024-09-12T02:49:14.910 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "info", 2024-09-12T02:49:14.910 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-09-12T02:49:14.910 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-09-12T02:49:14.910 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [ 2024-09-12T02:49:14.910 INFO:teuthology.orchestra.run.smithi039.stdout: "", 2024-09-12T02:49:14.910 INFO:teuthology.orchestra.run.smithi039.stdout: "critical", 2024-09-12T02:49:14.911 INFO:teuthology.orchestra.run.smithi039.stdout: "debug", 2024-09-12T02:49:14.911 INFO:teuthology.orchestra.run.smithi039.stdout: "error", 2024-09-12T02:49:14.911 INFO:teuthology.orchestra.run.smithi039.stdout: "info", 2024-09-12T02:49:14.911 INFO:teuthology.orchestra.run.smithi039.stdout: "warning" 2024-09-12T02:49:14.911 INFO:teuthology.orchestra.run.smithi039.stdout: ], 2024-09-12T02:49:14.911 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "", 2024-09-12T02:49:14.911 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-09-12T02:49:14.911 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-09-12T02:49:14.911 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-09-12T02:49:14.911 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-09-12T02:49:14.911 INFO:teuthology.orchestra.run.smithi039.stdout: "log_to_file": { 2024-09-12T02:49:14.911 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "log_to_file", 2024-09-12T02:49:14.911 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "bool", 2024-09-12T02:49:14.911 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "advanced", 2024-09-12T02:49:14.912 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 1, 2024-09-12T02:49:14.912 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "False", 2024-09-12T02:49:14.912 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-09-12T02:49:14.912 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-09-12T02:49:14.912 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [], 2024-09-12T02:49:14.912 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "", 2024-09-12T02:49:14.912 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-09-12T02:49:14.912 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-09-12T02:49:14.912 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-09-12T02:49:14.912 INFO:teuthology.orchestra.run.smithi039.stdout: } 2024-09-12T02:49:14.912 INFO:teuthology.orchestra.run.smithi039.stdout: } 2024-09-12T02:49:14.912 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-09-12T02:49:14.912 INFO:teuthology.orchestra.run.smithi039.stdout: { 2024-09-12T02:49:14.913 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "mirroring", 2024-09-12T02:49:14.913 INFO:teuthology.orchestra.run.smithi039.stdout: "can_run": true, 2024-09-12T02:49:14.913 INFO:teuthology.orchestra.run.smithi039.stdout: "error_string": "", 2024-09-12T02:49:14.913 INFO:teuthology.orchestra.run.smithi039.stdout: "module_options": { 2024-09-12T02:49:14.913 INFO:teuthology.orchestra.run.smithi039.stdout: "log_level": { 2024-09-12T02:49:14.913 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "log_level", 2024-09-12T02:49:14.913 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "str", 2024-09-12T02:49:14.913 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "advanced", 2024-09-12T02:49:14.913 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 1, 2024-09-12T02:49:14.913 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "", 2024-09-12T02:49:14.913 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-09-12T02:49:14.913 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-09-12T02:49:14.913 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [ 2024-09-12T02:49:14.913 INFO:teuthology.orchestra.run.smithi039.stdout: "", 2024-09-12T02:49:14.914 INFO:teuthology.orchestra.run.smithi039.stdout: "critical", 2024-09-12T02:49:14.914 INFO:teuthology.orchestra.run.smithi039.stdout: "debug", 2024-09-12T02:49:14.914 INFO:teuthology.orchestra.run.smithi039.stdout: "error", 2024-09-12T02:49:14.914 INFO:teuthology.orchestra.run.smithi039.stdout: "info", 2024-09-12T02:49:14.914 INFO:teuthology.orchestra.run.smithi039.stdout: "warning" 2024-09-12T02:49:14.914 INFO:teuthology.orchestra.run.smithi039.stdout: ], 2024-09-12T02:49:14.914 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "", 2024-09-12T02:49:14.914 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-09-12T02:49:14.914 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-09-12T02:49:14.914 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-09-12T02:49:14.914 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-09-12T02:49:14.914 INFO:teuthology.orchestra.run.smithi039.stdout: "log_to_cluster": { 2024-09-12T02:49:14.914 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "log_to_cluster", 2024-09-12T02:49:14.914 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "bool", 2024-09-12T02:49:14.914 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "advanced", 2024-09-12T02:49:14.915 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 1, 2024-09-12T02:49:14.915 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "False", 2024-09-12T02:49:14.915 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-09-12T02:49:14.915 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-09-12T02:49:14.915 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [], 2024-09-12T02:49:14.915 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "", 2024-09-12T02:49:14.915 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-09-12T02:49:14.915 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-09-12T02:49:14.915 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-09-12T02:49:14.915 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-09-12T02:49:14.915 INFO:teuthology.orchestra.run.smithi039.stdout: "log_to_cluster_level": { 2024-09-12T02:49:14.915 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "log_to_cluster_level", 2024-09-12T02:49:14.915 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "str", 2024-09-12T02:49:14.915 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "advanced", 2024-09-12T02:49:14.916 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 1, 2024-09-12T02:49:14.916 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "info", 2024-09-12T02:49:14.916 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-09-12T02:49:14.916 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-09-12T02:49:14.916 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [ 2024-09-12T02:49:14.916 INFO:teuthology.orchestra.run.smithi039.stdout: "", 2024-09-12T02:49:14.916 INFO:teuthology.orchestra.run.smithi039.stdout: "critical", 2024-09-12T02:49:14.916 INFO:teuthology.orchestra.run.smithi039.stdout: "debug", 2024-09-12T02:49:14.916 INFO:teuthology.orchestra.run.smithi039.stdout: "error", 2024-09-12T02:49:14.916 INFO:teuthology.orchestra.run.smithi039.stdout: "info", 2024-09-12T02:49:14.916 INFO:teuthology.orchestra.run.smithi039.stdout: "warning" 2024-09-12T02:49:14.916 INFO:teuthology.orchestra.run.smithi039.stdout: ], 2024-09-12T02:49:14.916 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "", 2024-09-12T02:49:14.917 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-09-12T02:49:14.917 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-09-12T02:49:14.917 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-09-12T02:49:14.917 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-09-12T02:49:14.917 INFO:teuthology.orchestra.run.smithi039.stdout: "log_to_file": { 2024-09-12T02:49:14.917 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "log_to_file", 2024-09-12T02:49:14.917 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "bool", 2024-09-12T02:49:14.917 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "advanced", 2024-09-12T02:49:14.917 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 1, 2024-09-12T02:49:14.917 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "False", 2024-09-12T02:49:14.917 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-09-12T02:49:14.917 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-09-12T02:49:14.917 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [], 2024-09-12T02:49:14.917 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "", 2024-09-12T02:49:14.918 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-09-12T02:49:14.918 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-09-12T02:49:14.918 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-09-12T02:49:14.918 INFO:teuthology.orchestra.run.smithi039.stdout: } 2024-09-12T02:49:14.918 INFO:teuthology.orchestra.run.smithi039.stdout: } 2024-09-12T02:49:14.918 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-09-12T02:49:14.918 INFO:teuthology.orchestra.run.smithi039.stdout: { 2024-09-12T02:49:14.918 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "nfs", 2024-09-12T02:49:14.918 INFO:teuthology.orchestra.run.smithi039.stdout: "can_run": true, 2024-09-12T02:49:14.918 INFO:teuthology.orchestra.run.smithi039.stdout: "error_string": "", 2024-09-12T02:49:14.918 INFO:teuthology.orchestra.run.smithi039.stdout: "module_options": { 2024-09-12T02:49:14.918 INFO:teuthology.orchestra.run.smithi039.stdout: "log_level": { 2024-09-12T02:49:14.918 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "log_level", 2024-09-12T02:49:14.919 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "str", 2024-09-12T02:49:14.919 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "advanced", 2024-09-12T02:49:14.919 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 1, 2024-09-12T02:49:14.919 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "", 2024-09-12T02:49:14.919 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-09-12T02:49:14.919 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-09-12T02:49:14.919 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [ 2024-09-12T02:49:14.919 INFO:teuthology.orchestra.run.smithi039.stdout: "", 2024-09-12T02:49:14.919 INFO:teuthology.orchestra.run.smithi039.stdout: "critical", 2024-09-12T02:49:14.919 INFO:teuthology.orchestra.run.smithi039.stdout: "debug", 2024-09-12T02:49:14.919 INFO:teuthology.orchestra.run.smithi039.stdout: "error", 2024-09-12T02:49:14.919 INFO:teuthology.orchestra.run.smithi039.stdout: "info", 2024-09-12T02:49:14.919 INFO:teuthology.orchestra.run.smithi039.stdout: "warning" 2024-09-12T02:49:14.920 INFO:teuthology.orchestra.run.smithi039.stdout: ], 2024-09-12T02:49:14.920 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "", 2024-09-12T02:49:14.920 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-09-12T02:49:14.920 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-09-12T02:49:14.920 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-09-12T02:49:14.920 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-09-12T02:49:14.920 INFO:teuthology.orchestra.run.smithi039.stdout: "log_to_cluster": { 2024-09-12T02:49:14.920 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "log_to_cluster", 2024-09-12T02:49:14.920 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "bool", 2024-09-12T02:49:14.920 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "advanced", 2024-09-12T02:49:14.920 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 1, 2024-09-12T02:49:14.920 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "False", 2024-09-12T02:49:14.920 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-09-12T02:49:14.921 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-09-12T02:49:14.921 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [], 2024-09-12T02:49:14.921 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "", 2024-09-12T02:49:14.921 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-09-12T02:49:14.921 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-09-12T02:49:14.921 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-09-12T02:49:14.921 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-09-12T02:49:14.921 INFO:teuthology.orchestra.run.smithi039.stdout: "log_to_cluster_level": { 2024-09-12T02:49:14.921 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "log_to_cluster_level", 2024-09-12T02:49:14.921 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "str", 2024-09-12T02:49:14.921 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "advanced", 2024-09-12T02:49:14.921 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 1, 2024-09-12T02:49:14.921 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "info", 2024-09-12T02:49:14.922 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-09-12T02:49:14.922 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-09-12T02:49:14.922 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [ 2024-09-12T02:49:14.922 INFO:teuthology.orchestra.run.smithi039.stdout: "", 2024-09-12T02:49:14.922 INFO:teuthology.orchestra.run.smithi039.stdout: "critical", 2024-09-12T02:49:14.922 INFO:teuthology.orchestra.run.smithi039.stdout: "debug", 2024-09-12T02:49:14.922 INFO:teuthology.orchestra.run.smithi039.stdout: "error", 2024-09-12T02:49:14.922 INFO:teuthology.orchestra.run.smithi039.stdout: "info", 2024-09-12T02:49:14.922 INFO:teuthology.orchestra.run.smithi039.stdout: "warning" 2024-09-12T02:49:14.922 INFO:teuthology.orchestra.run.smithi039.stdout: ], 2024-09-12T02:49:14.922 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "", 2024-09-12T02:49:14.922 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-09-12T02:49:14.922 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-09-12T02:49:14.922 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-09-12T02:49:14.923 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-09-12T02:49:14.923 INFO:teuthology.orchestra.run.smithi039.stdout: "log_to_file": { 2024-09-12T02:49:14.923 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "log_to_file", 2024-09-12T02:49:14.923 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "bool", 2024-09-12T02:49:14.923 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "advanced", 2024-09-12T02:49:14.923 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 1, 2024-09-12T02:49:14.923 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "False", 2024-09-12T02:49:14.923 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-09-12T02:49:14.923 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-09-12T02:49:14.923 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [], 2024-09-12T02:49:14.923 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "", 2024-09-12T02:49:14.923 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-09-12T02:49:14.923 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-09-12T02:49:14.924 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-09-12T02:49:14.924 INFO:teuthology.orchestra.run.smithi039.stdout: } 2024-09-12T02:49:14.924 INFO:teuthology.orchestra.run.smithi039.stdout: } 2024-09-12T02:49:14.924 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-09-12T02:49:14.924 INFO:teuthology.orchestra.run.smithi039.stdout: { 2024-09-12T02:49:14.924 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "orchestrator", 2024-09-12T02:49:14.924 INFO:teuthology.orchestra.run.smithi039.stdout: "can_run": true, 2024-09-12T02:49:14.924 INFO:teuthology.orchestra.run.smithi039.stdout: "error_string": "", 2024-09-12T02:49:14.924 INFO:teuthology.orchestra.run.smithi039.stdout: "module_options": { 2024-09-12T02:49:14.924 INFO:teuthology.orchestra.run.smithi039.stdout: "fail_fs": { 2024-09-12T02:49:14.924 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "fail_fs", 2024-09-12T02:49:14.924 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "bool", 2024-09-12T02:49:14.924 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "advanced", 2024-09-12T02:49:14.925 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 0, 2024-09-12T02:49:14.925 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "False", 2024-09-12T02:49:14.925 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-09-12T02:49:14.925 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-09-12T02:49:14.925 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [], 2024-09-12T02:49:14.925 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "Fail filesystem for rapid multi-rank mds upgrade", 2024-09-12T02:49:14.925 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-09-12T02:49:14.925 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-09-12T02:49:14.925 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-09-12T02:49:14.925 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-09-12T02:49:14.925 INFO:teuthology.orchestra.run.smithi039.stdout: "log_level": { 2024-09-12T02:49:14.925 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "log_level", 2024-09-12T02:49:14.925 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "str", 2024-09-12T02:49:14.925 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "advanced", 2024-09-12T02:49:14.926 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 1, 2024-09-12T02:49:14.926 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "", 2024-09-12T02:49:14.926 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-09-12T02:49:14.926 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-09-12T02:49:14.926 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [ 2024-09-12T02:49:14.926 INFO:teuthology.orchestra.run.smithi039.stdout: "", 2024-09-12T02:49:14.926 INFO:teuthology.orchestra.run.smithi039.stdout: "critical", 2024-09-12T02:49:14.926 INFO:teuthology.orchestra.run.smithi039.stdout: "debug", 2024-09-12T02:49:14.926 INFO:teuthology.orchestra.run.smithi039.stdout: "error", 2024-09-12T02:49:14.926 INFO:teuthology.orchestra.run.smithi039.stdout: "info", 2024-09-12T02:49:14.926 INFO:teuthology.orchestra.run.smithi039.stdout: "warning" 2024-09-12T02:49:14.926 INFO:teuthology.orchestra.run.smithi039.stdout: ], 2024-09-12T02:49:14.926 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "", 2024-09-12T02:49:14.926 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-09-12T02:49:14.927 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-09-12T02:49:14.927 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-09-12T02:49:14.927 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-09-12T02:49:14.927 INFO:teuthology.orchestra.run.smithi039.stdout: "log_to_cluster": { 2024-09-12T02:49:14.927 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "log_to_cluster", 2024-09-12T02:49:14.927 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "bool", 2024-09-12T02:49:14.927 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "advanced", 2024-09-12T02:49:14.927 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 1, 2024-09-12T02:49:14.927 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "False", 2024-09-12T02:49:14.927 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-09-12T02:49:14.927 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-09-12T02:49:14.927 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [], 2024-09-12T02:49:14.927 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "", 2024-09-12T02:49:14.927 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-09-12T02:49:14.928 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-09-12T02:49:14.928 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-09-12T02:49:14.928 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-09-12T02:49:14.928 INFO:teuthology.orchestra.run.smithi039.stdout: "log_to_cluster_level": { 2024-09-12T02:49:14.928 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "log_to_cluster_level", 2024-09-12T02:49:14.928 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "str", 2024-09-12T02:49:14.928 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "advanced", 2024-09-12T02:49:14.928 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 1, 2024-09-12T02:49:14.928 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "info", 2024-09-12T02:49:14.928 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-09-12T02:49:14.928 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-09-12T02:49:14.928 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [ 2024-09-12T02:49:14.928 INFO:teuthology.orchestra.run.smithi039.stdout: "", 2024-09-12T02:49:14.929 INFO:teuthology.orchestra.run.smithi039.stdout: "critical", 2024-09-12T02:49:14.929 INFO:teuthology.orchestra.run.smithi039.stdout: "debug", 2024-09-12T02:49:14.929 INFO:teuthology.orchestra.run.smithi039.stdout: "error", 2024-09-12T02:49:14.929 INFO:teuthology.orchestra.run.smithi039.stdout: "info", 2024-09-12T02:49:14.929 INFO:teuthology.orchestra.run.smithi039.stdout: "warning" 2024-09-12T02:49:14.929 INFO:teuthology.orchestra.run.smithi039.stdout: ], 2024-09-12T02:49:14.929 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "", 2024-09-12T02:49:14.929 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-09-12T02:49:14.929 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-09-12T02:49:14.929 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-09-12T02:49:14.929 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-09-12T02:49:14.929 INFO:teuthology.orchestra.run.smithi039.stdout: "log_to_file": { 2024-09-12T02:49:14.929 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "log_to_file", 2024-09-12T02:49:14.929 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "bool", 2024-09-12T02:49:14.930 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "advanced", 2024-09-12T02:49:14.930 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 1, 2024-09-12T02:49:14.930 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "False", 2024-09-12T02:49:14.930 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-09-12T02:49:14.930 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-09-12T02:49:14.930 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [], 2024-09-12T02:49:14.930 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "", 2024-09-12T02:49:14.930 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-09-12T02:49:14.930 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-09-12T02:49:14.930 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-09-12T02:49:14.930 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-09-12T02:49:14.930 INFO:teuthology.orchestra.run.smithi039.stdout: "orchestrator": { 2024-09-12T02:49:14.930 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "orchestrator", 2024-09-12T02:49:14.930 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "str", 2024-09-12T02:49:14.931 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "advanced", 2024-09-12T02:49:14.931 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 1, 2024-09-12T02:49:14.931 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "", 2024-09-12T02:49:14.931 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-09-12T02:49:14.931 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-09-12T02:49:14.931 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [ 2024-09-12T02:49:14.931 INFO:teuthology.orchestra.run.smithi039.stdout: "cephadm", 2024-09-12T02:49:14.931 INFO:teuthology.orchestra.run.smithi039.stdout: "rook", 2024-09-12T02:49:14.931 INFO:teuthology.orchestra.run.smithi039.stdout: "test_orchestrator" 2024-09-12T02:49:14.931 INFO:teuthology.orchestra.run.smithi039.stdout: ], 2024-09-12T02:49:14.931 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "Orchestrator backend", 2024-09-12T02:49:14.931 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-09-12T02:49:14.931 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-09-12T02:49:14.931 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-09-12T02:49:14.932 INFO:teuthology.orchestra.run.smithi039.stdout: } 2024-09-12T02:49:14.932 INFO:teuthology.orchestra.run.smithi039.stdout: } 2024-09-12T02:49:14.932 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-09-12T02:49:14.932 INFO:teuthology.orchestra.run.smithi039.stdout: { 2024-09-12T02:49:14.932 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "osd_perf_query", 2024-09-12T02:49:14.932 INFO:teuthology.orchestra.run.smithi039.stdout: "can_run": true, 2024-09-12T02:49:14.932 INFO:teuthology.orchestra.run.smithi039.stdout: "error_string": "", 2024-09-12T02:49:14.932 INFO:teuthology.orchestra.run.smithi039.stdout: "module_options": { 2024-09-12T02:49:14.932 INFO:teuthology.orchestra.run.smithi039.stdout: "log_level": { 2024-09-12T02:49:14.932 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "log_level", 2024-09-12T02:49:14.932 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "str", 2024-09-12T02:49:14.932 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "advanced", 2024-09-12T02:49:14.932 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 1, 2024-09-12T02:49:14.932 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "", 2024-09-12T02:49:14.933 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-09-12T02:49:14.933 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-09-12T02:49:14.933 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [ 2024-09-12T02:49:14.933 INFO:teuthology.orchestra.run.smithi039.stdout: "", 2024-09-12T02:49:14.933 INFO:teuthology.orchestra.run.smithi039.stdout: "critical", 2024-09-12T02:49:14.933 INFO:teuthology.orchestra.run.smithi039.stdout: "debug", 2024-09-12T02:49:14.933 INFO:teuthology.orchestra.run.smithi039.stdout: "error", 2024-09-12T02:49:14.933 INFO:teuthology.orchestra.run.smithi039.stdout: "info", 2024-09-12T02:49:14.933 INFO:teuthology.orchestra.run.smithi039.stdout: "warning" 2024-09-12T02:49:14.933 INFO:teuthology.orchestra.run.smithi039.stdout: ], 2024-09-12T02:49:14.933 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "", 2024-09-12T02:49:14.933 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-09-12T02:49:14.933 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-09-12T02:49:14.934 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-09-12T02:49:14.934 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-09-12T02:49:14.934 INFO:teuthology.orchestra.run.smithi039.stdout: "log_to_cluster": { 2024-09-12T02:49:14.934 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "log_to_cluster", 2024-09-12T02:49:14.934 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "bool", 2024-09-12T02:49:14.934 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "advanced", 2024-09-12T02:49:14.934 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 1, 2024-09-12T02:49:14.934 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "False", 2024-09-12T02:49:14.934 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-09-12T02:49:14.934 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-09-12T02:49:14.934 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [], 2024-09-12T02:49:14.934 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "", 2024-09-12T02:49:14.934 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-09-12T02:49:14.934 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-09-12T02:49:14.935 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-09-12T02:49:14.935 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-09-12T02:49:14.935 INFO:teuthology.orchestra.run.smithi039.stdout: "log_to_cluster_level": { 2024-09-12T02:49:14.935 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "log_to_cluster_level", 2024-09-12T02:49:14.935 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "str", 2024-09-12T02:49:14.935 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "advanced", 2024-09-12T02:49:14.935 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 1, 2024-09-12T02:49:14.935 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "info", 2024-09-12T02:49:14.935 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-09-12T02:49:14.935 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-09-12T02:49:14.935 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [ 2024-09-12T02:49:14.935 INFO:teuthology.orchestra.run.smithi039.stdout: "", 2024-09-12T02:49:14.935 INFO:teuthology.orchestra.run.smithi039.stdout: "critical", 2024-09-12T02:49:14.935 INFO:teuthology.orchestra.run.smithi039.stdout: "debug", 2024-09-12T02:49:14.936 INFO:teuthology.orchestra.run.smithi039.stdout: "error", 2024-09-12T02:49:14.936 INFO:teuthology.orchestra.run.smithi039.stdout: "info", 2024-09-12T02:49:14.936 INFO:teuthology.orchestra.run.smithi039.stdout: "warning" 2024-09-12T02:49:14.936 INFO:teuthology.orchestra.run.smithi039.stdout: ], 2024-09-12T02:49:14.936 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "", 2024-09-12T02:49:14.936 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-09-12T02:49:14.936 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-09-12T02:49:14.936 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-09-12T02:49:14.936 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-09-12T02:49:14.936 INFO:teuthology.orchestra.run.smithi039.stdout: "log_to_file": { 2024-09-12T02:49:14.936 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "log_to_file", 2024-09-12T02:49:14.936 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "bool", 2024-09-12T02:49:14.936 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "advanced", 2024-09-12T02:49:14.936 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 1, 2024-09-12T02:49:14.937 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "False", 2024-09-12T02:49:14.937 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-09-12T02:49:14.937 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-09-12T02:49:14.937 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [], 2024-09-12T02:49:14.937 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "", 2024-09-12T02:49:14.937 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-09-12T02:49:14.937 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-09-12T02:49:14.937 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-09-12T02:49:14.937 INFO:teuthology.orchestra.run.smithi039.stdout: } 2024-09-12T02:49:14.937 INFO:teuthology.orchestra.run.smithi039.stdout: } 2024-09-12T02:49:14.937 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-09-12T02:49:14.937 INFO:teuthology.orchestra.run.smithi039.stdout: { 2024-09-12T02:49:14.937 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "osd_support", 2024-09-12T02:49:14.937 INFO:teuthology.orchestra.run.smithi039.stdout: "can_run": true, 2024-09-12T02:49:14.938 INFO:teuthology.orchestra.run.smithi039.stdout: "error_string": "", 2024-09-12T02:49:14.938 INFO:teuthology.orchestra.run.smithi039.stdout: "module_options": { 2024-09-12T02:49:14.938 INFO:teuthology.orchestra.run.smithi039.stdout: "log_level": { 2024-09-12T02:49:14.938 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "log_level", 2024-09-12T02:49:14.938 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "str", 2024-09-12T02:49:14.938 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "advanced", 2024-09-12T02:49:14.938 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 1, 2024-09-12T02:49:14.938 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "", 2024-09-12T02:49:14.938 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-09-12T02:49:14.938 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-09-12T02:49:14.938 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [ 2024-09-12T02:49:14.938 INFO:teuthology.orchestra.run.smithi039.stdout: "", 2024-09-12T02:49:14.938 INFO:teuthology.orchestra.run.smithi039.stdout: "critical", 2024-09-12T02:49:14.938 INFO:teuthology.orchestra.run.smithi039.stdout: "debug", 2024-09-12T02:49:14.939 INFO:teuthology.orchestra.run.smithi039.stdout: "error", 2024-09-12T02:49:14.939 INFO:teuthology.orchestra.run.smithi039.stdout: "info", 2024-09-12T02:49:14.939 INFO:teuthology.orchestra.run.smithi039.stdout: "warning" 2024-09-12T02:49:14.939 INFO:teuthology.orchestra.run.smithi039.stdout: ], 2024-09-12T02:49:14.939 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "", 2024-09-12T02:49:14.939 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-09-12T02:49:14.939 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-09-12T02:49:14.939 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-09-12T02:49:14.939 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-09-12T02:49:14.939 INFO:teuthology.orchestra.run.smithi039.stdout: "log_to_cluster": { 2024-09-12T02:49:14.939 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "log_to_cluster", 2024-09-12T02:49:14.939 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "bool", 2024-09-12T02:49:14.939 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "advanced", 2024-09-12T02:49:14.940 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 1, 2024-09-12T02:49:14.940 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "False", 2024-09-12T02:49:14.940 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-09-12T02:49:14.940 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-09-12T02:49:14.940 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [], 2024-09-12T02:49:14.940 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "", 2024-09-12T02:49:14.940 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-09-12T02:49:14.940 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-09-12T02:49:14.940 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-09-12T02:49:14.940 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-09-12T02:49:14.940 INFO:teuthology.orchestra.run.smithi039.stdout: "log_to_cluster_level": { 2024-09-12T02:49:14.940 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "log_to_cluster_level", 2024-09-12T02:49:14.940 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "str", 2024-09-12T02:49:14.940 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "advanced", 2024-09-12T02:49:14.941 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 1, 2024-09-12T02:49:14.941 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "info", 2024-09-12T02:49:14.941 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-09-12T02:49:14.941 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-09-12T02:49:14.941 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [ 2024-09-12T02:49:14.941 INFO:teuthology.orchestra.run.smithi039.stdout: "", 2024-09-12T02:49:14.941 INFO:teuthology.orchestra.run.smithi039.stdout: "critical", 2024-09-12T02:49:14.941 INFO:teuthology.orchestra.run.smithi039.stdout: "debug", 2024-09-12T02:49:14.941 INFO:teuthology.orchestra.run.smithi039.stdout: "error", 2024-09-12T02:49:14.941 INFO:teuthology.orchestra.run.smithi039.stdout: "info", 2024-09-12T02:49:14.941 INFO:teuthology.orchestra.run.smithi039.stdout: "warning" 2024-09-12T02:49:14.941 INFO:teuthology.orchestra.run.smithi039.stdout: ], 2024-09-12T02:49:14.941 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "", 2024-09-12T02:49:14.941 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-09-12T02:49:14.942 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-09-12T02:49:14.942 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-09-12T02:49:14.942 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-09-12T02:49:14.942 INFO:teuthology.orchestra.run.smithi039.stdout: "log_to_file": { 2024-09-12T02:49:14.942 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "log_to_file", 2024-09-12T02:49:14.942 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "bool", 2024-09-12T02:49:14.942 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "advanced", 2024-09-12T02:49:14.942 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 1, 2024-09-12T02:49:14.942 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "False", 2024-09-12T02:49:14.942 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-09-12T02:49:14.942 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-09-12T02:49:14.942 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [], 2024-09-12T02:49:14.942 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "", 2024-09-12T02:49:14.942 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-09-12T02:49:14.943 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-09-12T02:49:14.943 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-09-12T02:49:14.943 INFO:teuthology.orchestra.run.smithi039.stdout: } 2024-09-12T02:49:14.943 INFO:teuthology.orchestra.run.smithi039.stdout: } 2024-09-12T02:49:14.943 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-09-12T02:49:14.943 INFO:teuthology.orchestra.run.smithi039.stdout: { 2024-09-12T02:49:14.943 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "pg_autoscaler", 2024-09-12T02:49:14.943 INFO:teuthology.orchestra.run.smithi039.stdout: "can_run": true, 2024-09-12T02:49:14.943 INFO:teuthology.orchestra.run.smithi039.stdout: "error_string": "", 2024-09-12T02:49:14.943 INFO:teuthology.orchestra.run.smithi039.stdout: "module_options": { 2024-09-12T02:49:14.943 INFO:teuthology.orchestra.run.smithi039.stdout: "log_level": { 2024-09-12T02:49:14.943 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "log_level", 2024-09-12T02:49:14.943 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "str", 2024-09-12T02:49:14.943 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "advanced", 2024-09-12T02:49:14.944 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 1, 2024-09-12T02:49:14.944 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "", 2024-09-12T02:49:14.944 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-09-12T02:49:14.944 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-09-12T02:49:14.944 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [ 2024-09-12T02:49:14.944 INFO:teuthology.orchestra.run.smithi039.stdout: "", 2024-09-12T02:49:14.944 INFO:teuthology.orchestra.run.smithi039.stdout: "critical", 2024-09-12T02:49:14.944 INFO:teuthology.orchestra.run.smithi039.stdout: "debug", 2024-09-12T02:49:14.944 INFO:teuthology.orchestra.run.smithi039.stdout: "error", 2024-09-12T02:49:14.944 INFO:teuthology.orchestra.run.smithi039.stdout: "info", 2024-09-12T02:49:14.944 INFO:teuthology.orchestra.run.smithi039.stdout: "warning" 2024-09-12T02:49:14.944 INFO:teuthology.orchestra.run.smithi039.stdout: ], 2024-09-12T02:49:14.944 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "", 2024-09-12T02:49:14.945 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-09-12T02:49:14.945 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-09-12T02:49:14.945 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-09-12T02:49:14.945 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-09-12T02:49:14.945 INFO:teuthology.orchestra.run.smithi039.stdout: "log_to_cluster": { 2024-09-12T02:49:14.945 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "log_to_cluster", 2024-09-12T02:49:14.945 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "bool", 2024-09-12T02:49:14.945 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "advanced", 2024-09-12T02:49:14.945 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 1, 2024-09-12T02:49:14.945 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "False", 2024-09-12T02:49:14.945 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-09-12T02:49:14.945 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-09-12T02:49:14.945 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [], 2024-09-12T02:49:14.945 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "", 2024-09-12T02:49:14.946 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-09-12T02:49:14.946 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-09-12T02:49:14.946 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-09-12T02:49:14.946 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-09-12T02:49:14.946 INFO:teuthology.orchestra.run.smithi039.stdout: "log_to_cluster_level": { 2024-09-12T02:49:14.946 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "log_to_cluster_level", 2024-09-12T02:49:14.946 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "str", 2024-09-12T02:49:14.946 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "advanced", 2024-09-12T02:49:14.946 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 1, 2024-09-12T02:49:14.946 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "info", 2024-09-12T02:49:14.946 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-09-12T02:49:14.946 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-09-12T02:49:14.946 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [ 2024-09-12T02:49:14.946 INFO:teuthology.orchestra.run.smithi039.stdout: "", 2024-09-12T02:49:14.947 INFO:teuthology.orchestra.run.smithi039.stdout: "critical", 2024-09-12T02:49:14.947 INFO:teuthology.orchestra.run.smithi039.stdout: "debug", 2024-09-12T02:49:14.947 INFO:teuthology.orchestra.run.smithi039.stdout: "error", 2024-09-12T02:49:14.947 INFO:teuthology.orchestra.run.smithi039.stdout: "info", 2024-09-12T02:49:14.947 INFO:teuthology.orchestra.run.smithi039.stdout: "warning" 2024-09-12T02:49:14.947 INFO:teuthology.orchestra.run.smithi039.stdout: ], 2024-09-12T02:49:14.947 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "", 2024-09-12T02:49:14.947 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-09-12T02:49:14.947 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-09-12T02:49:14.947 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-09-12T02:49:14.947 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-09-12T02:49:14.947 INFO:teuthology.orchestra.run.smithi039.stdout: "log_to_file": { 2024-09-12T02:49:14.947 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "log_to_file", 2024-09-12T02:49:14.948 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "bool", 2024-09-12T02:49:14.948 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "advanced", 2024-09-12T02:49:14.948 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 1, 2024-09-12T02:49:14.948 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "False", 2024-09-12T02:49:14.948 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-09-12T02:49:14.948 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-09-12T02:49:14.948 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [], 2024-09-12T02:49:14.948 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "", 2024-09-12T02:49:14.948 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-09-12T02:49:14.948 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-09-12T02:49:14.948 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-09-12T02:49:14.948 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-09-12T02:49:14.948 INFO:teuthology.orchestra.run.smithi039.stdout: "sleep_interval": { 2024-09-12T02:49:14.949 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "sleep_interval", 2024-09-12T02:49:14.949 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "secs", 2024-09-12T02:49:14.949 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "advanced", 2024-09-12T02:49:14.949 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 0, 2024-09-12T02:49:14.949 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "60", 2024-09-12T02:49:14.949 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-09-12T02:49:14.949 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-09-12T02:49:14.949 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [], 2024-09-12T02:49:14.949 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "", 2024-09-12T02:49:14.949 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-09-12T02:49:14.949 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-09-12T02:49:14.949 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-09-12T02:49:14.949 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-09-12T02:49:14.949 INFO:teuthology.orchestra.run.smithi039.stdout: "threshold": { 2024-09-12T02:49:14.950 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "threshold", 2024-09-12T02:49:14.950 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "float", 2024-09-12T02:49:14.950 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "advanced", 2024-09-12T02:49:14.950 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 0, 2024-09-12T02:49:14.950 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "3.0", 2024-09-12T02:49:14.950 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "1.0", 2024-09-12T02:49:14.950 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-09-12T02:49:14.950 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [], 2024-09-12T02:49:14.950 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "scaling threshold", 2024-09-12T02:49:14.950 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "The factor by which the `NEW PG_NUM` must vary from the current`PG_NUM` before being accepted. Cannot be less than 1.0", 2024-09-12T02:49:14.950 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-09-12T02:49:14.950 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-09-12T02:49:14.950 INFO:teuthology.orchestra.run.smithi039.stdout: } 2024-09-12T02:49:14.950 INFO:teuthology.orchestra.run.smithi039.stdout: } 2024-09-12T02:49:14.951 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-09-12T02:49:14.951 INFO:teuthology.orchestra.run.smithi039.stdout: { 2024-09-12T02:49:14.951 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "progress", 2024-09-12T02:49:14.951 INFO:teuthology.orchestra.run.smithi039.stdout: "can_run": true, 2024-09-12T02:49:14.951 INFO:teuthology.orchestra.run.smithi039.stdout: "error_string": "", 2024-09-12T02:49:14.951 INFO:teuthology.orchestra.run.smithi039.stdout: "module_options": { 2024-09-12T02:49:14.951 INFO:teuthology.orchestra.run.smithi039.stdout: "allow_pg_recovery_event": { 2024-09-12T02:49:14.951 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "allow_pg_recovery_event", 2024-09-12T02:49:14.951 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "bool", 2024-09-12T02:49:14.951 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "advanced", 2024-09-12T02:49:14.951 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 1, 2024-09-12T02:49:14.951 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "False", 2024-09-12T02:49:14.951 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-09-12T02:49:14.952 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-09-12T02:49:14.952 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [], 2024-09-12T02:49:14.952 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "allow the module to show pg recovery progress", 2024-09-12T02:49:14.952 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-09-12T02:49:14.952 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-09-12T02:49:14.952 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-09-12T02:49:14.952 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-09-12T02:49:14.952 INFO:teuthology.orchestra.run.smithi039.stdout: "enabled": { 2024-09-12T02:49:14.952 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "enabled", 2024-09-12T02:49:14.952 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "bool", 2024-09-12T02:49:14.952 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "advanced", 2024-09-12T02:49:14.952 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 0, 2024-09-12T02:49:14.952 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "True", 2024-09-12T02:49:14.953 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-09-12T02:49:14.953 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-09-12T02:49:14.953 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [], 2024-09-12T02:49:14.953 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "", 2024-09-12T02:49:14.953 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-09-12T02:49:14.953 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-09-12T02:49:14.953 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-09-12T02:49:14.953 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-09-12T02:49:14.953 INFO:teuthology.orchestra.run.smithi039.stdout: "log_level": { 2024-09-12T02:49:14.953 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "log_level", 2024-09-12T02:49:14.953 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "str", 2024-09-12T02:49:14.953 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "advanced", 2024-09-12T02:49:14.953 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 1, 2024-09-12T02:49:14.953 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "", 2024-09-12T02:49:14.954 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-09-12T02:49:14.954 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-09-12T02:49:14.954 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [ 2024-09-12T02:49:14.954 INFO:teuthology.orchestra.run.smithi039.stdout: "", 2024-09-12T02:49:14.954 INFO:teuthology.orchestra.run.smithi039.stdout: "critical", 2024-09-12T02:49:14.954 INFO:teuthology.orchestra.run.smithi039.stdout: "debug", 2024-09-12T02:49:14.954 INFO:teuthology.orchestra.run.smithi039.stdout: "error", 2024-09-12T02:49:14.954 INFO:teuthology.orchestra.run.smithi039.stdout: "info", 2024-09-12T02:49:14.954 INFO:teuthology.orchestra.run.smithi039.stdout: "warning" 2024-09-12T02:49:14.954 INFO:teuthology.orchestra.run.smithi039.stdout: ], 2024-09-12T02:49:14.954 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "", 2024-09-12T02:49:14.954 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-09-12T02:49:14.954 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-09-12T02:49:14.954 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-09-12T02:49:14.955 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-09-12T02:49:14.955 INFO:teuthology.orchestra.run.smithi039.stdout: "log_to_cluster": { 2024-09-12T02:49:14.955 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "log_to_cluster", 2024-09-12T02:49:14.955 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "bool", 2024-09-12T02:49:14.955 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "advanced", 2024-09-12T02:49:14.955 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 1, 2024-09-12T02:49:14.955 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "False", 2024-09-12T02:49:14.955 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-09-12T02:49:14.955 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-09-12T02:49:14.955 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [], 2024-09-12T02:49:14.955 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "", 2024-09-12T02:49:14.955 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-09-12T02:49:14.955 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-09-12T02:49:14.955 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-09-12T02:49:14.956 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-09-12T02:49:14.956 INFO:teuthology.orchestra.run.smithi039.stdout: "log_to_cluster_level": { 2024-09-12T02:49:14.956 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "log_to_cluster_level", 2024-09-12T02:49:14.956 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "str", 2024-09-12T02:49:14.956 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "advanced", 2024-09-12T02:49:14.956 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 1, 2024-09-12T02:49:14.956 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "info", 2024-09-12T02:49:14.956 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-09-12T02:49:14.956 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-09-12T02:49:14.956 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [ 2024-09-12T02:49:14.956 INFO:teuthology.orchestra.run.smithi039.stdout: "", 2024-09-12T02:49:14.956 INFO:teuthology.orchestra.run.smithi039.stdout: "critical", 2024-09-12T02:49:14.956 INFO:teuthology.orchestra.run.smithi039.stdout: "debug", 2024-09-12T02:49:14.956 INFO:teuthology.orchestra.run.smithi039.stdout: "error", 2024-09-12T02:49:14.957 INFO:teuthology.orchestra.run.smithi039.stdout: "info", 2024-09-12T02:49:14.957 INFO:teuthology.orchestra.run.smithi039.stdout: "warning" 2024-09-12T02:49:14.957 INFO:teuthology.orchestra.run.smithi039.stdout: ], 2024-09-12T02:49:14.957 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "", 2024-09-12T02:49:14.957 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-09-12T02:49:14.957 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-09-12T02:49:14.957 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-09-12T02:49:14.957 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-09-12T02:49:14.957 INFO:teuthology.orchestra.run.smithi039.stdout: "log_to_file": { 2024-09-12T02:49:14.957 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "log_to_file", 2024-09-12T02:49:14.957 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "bool", 2024-09-12T02:49:14.957 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "advanced", 2024-09-12T02:49:14.957 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 1, 2024-09-12T02:49:14.957 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "False", 2024-09-12T02:49:14.958 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-09-12T02:49:14.958 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-09-12T02:49:14.958 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [], 2024-09-12T02:49:14.958 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "", 2024-09-12T02:49:14.958 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-09-12T02:49:14.958 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-09-12T02:49:14.958 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-09-12T02:49:14.958 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-09-12T02:49:14.958 INFO:teuthology.orchestra.run.smithi039.stdout: "max_completed_events": { 2024-09-12T02:49:14.958 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "max_completed_events", 2024-09-12T02:49:14.958 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "int", 2024-09-12T02:49:14.958 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "advanced", 2024-09-12T02:49:14.958 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 1, 2024-09-12T02:49:14.958 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "50", 2024-09-12T02:49:14.959 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-09-12T02:49:14.959 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-09-12T02:49:14.959 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [], 2024-09-12T02:49:14.959 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "number of past completed events to remember", 2024-09-12T02:49:14.959 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-09-12T02:49:14.959 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-09-12T02:49:14.959 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-09-12T02:49:14.959 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-09-12T02:49:14.959 INFO:teuthology.orchestra.run.smithi039.stdout: "sleep_interval": { 2024-09-12T02:49:14.959 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "sleep_interval", 2024-09-12T02:49:14.959 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "secs", 2024-09-12T02:49:14.959 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "advanced", 2024-09-12T02:49:14.959 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 1, 2024-09-12T02:49:14.959 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "5", 2024-09-12T02:49:14.960 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-09-12T02:49:14.960 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-09-12T02:49:14.960 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [], 2024-09-12T02:49:14.960 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "how long the module is going to sleep", 2024-09-12T02:49:14.960 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-09-12T02:49:14.960 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-09-12T02:49:14.960 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-09-12T02:49:14.960 INFO:teuthology.orchestra.run.smithi039.stdout: } 2024-09-12T02:49:14.960 INFO:teuthology.orchestra.run.smithi039.stdout: } 2024-09-12T02:49:14.960 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-09-12T02:49:14.960 INFO:teuthology.orchestra.run.smithi039.stdout: { 2024-09-12T02:49:14.960 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "prometheus", 2024-09-12T02:49:14.960 INFO:teuthology.orchestra.run.smithi039.stdout: "can_run": true, 2024-09-12T02:49:14.960 INFO:teuthology.orchestra.run.smithi039.stdout: "error_string": "", 2024-09-12T02:49:14.961 INFO:teuthology.orchestra.run.smithi039.stdout: "module_options": { 2024-09-12T02:49:14.961 INFO:teuthology.orchestra.run.smithi039.stdout: "cache": { 2024-09-12T02:49:14.961 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "cache", 2024-09-12T02:49:14.961 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "bool", 2024-09-12T02:49:14.961 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "advanced", 2024-09-12T02:49:14.961 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 0, 2024-09-12T02:49:14.961 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "True", 2024-09-12T02:49:14.961 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-09-12T02:49:14.961 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-09-12T02:49:14.961 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [], 2024-09-12T02:49:14.961 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "", 2024-09-12T02:49:14.961 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-09-12T02:49:14.961 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-09-12T02:49:14.962 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-09-12T02:49:14.962 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-09-12T02:49:14.962 INFO:teuthology.orchestra.run.smithi039.stdout: "exclude_perf_counters": { 2024-09-12T02:49:14.962 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "exclude_perf_counters", 2024-09-12T02:49:14.962 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "bool", 2024-09-12T02:49:14.962 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "advanced", 2024-09-12T02:49:14.962 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 1, 2024-09-12T02:49:14.962 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "True", 2024-09-12T02:49:14.962 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-09-12T02:49:14.962 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-09-12T02:49:14.962 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [], 2024-09-12T02:49:14.962 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "Do not include perf-counters in the metrics output", 2024-09-12T02:49:14.962 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "Gathering perf-counters from a single Prometheus exporter can degrade ceph-mgr performance, especially in large clusters. Instead, Ceph-exporter daemons are now used by default for perf-counter gathering. This should only be disabled when no ceph-exporters are deployed.", 2024-09-12T02:49:14.962 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-09-12T02:49:14.963 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-09-12T02:49:14.963 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-09-12T02:49:14.963 INFO:teuthology.orchestra.run.smithi039.stdout: "log_level": { 2024-09-12T02:49:14.963 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "log_level", 2024-09-12T02:49:14.963 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "str", 2024-09-12T02:49:14.963 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "advanced", 2024-09-12T02:49:14.963 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 1, 2024-09-12T02:49:14.963 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "", 2024-09-12T02:49:14.963 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-09-12T02:49:14.963 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-09-12T02:49:14.963 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [ 2024-09-12T02:49:14.963 INFO:teuthology.orchestra.run.smithi039.stdout: "", 2024-09-12T02:49:14.963 INFO:teuthology.orchestra.run.smithi039.stdout: "critical", 2024-09-12T02:49:14.964 INFO:teuthology.orchestra.run.smithi039.stdout: "debug", 2024-09-12T02:49:14.964 INFO:teuthology.orchestra.run.smithi039.stdout: "error", 2024-09-12T02:49:14.964 INFO:teuthology.orchestra.run.smithi039.stdout: "info", 2024-09-12T02:49:14.964 INFO:teuthology.orchestra.run.smithi039.stdout: "warning" 2024-09-12T02:49:14.964 INFO:teuthology.orchestra.run.smithi039.stdout: ], 2024-09-12T02:49:14.964 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "", 2024-09-12T02:49:14.964 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-09-12T02:49:14.964 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-09-12T02:49:14.964 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-09-12T02:49:14.964 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-09-12T02:49:14.964 INFO:teuthology.orchestra.run.smithi039.stdout: "log_to_cluster": { 2024-09-12T02:49:14.964 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "log_to_cluster", 2024-09-12T02:49:14.964 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "bool", 2024-09-12T02:49:14.965 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "advanced", 2024-09-12T02:49:14.965 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 1, 2024-09-12T02:49:14.965 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "False", 2024-09-12T02:49:14.965 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-09-12T02:49:14.965 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-09-12T02:49:14.965 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [], 2024-09-12T02:49:14.965 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "", 2024-09-12T02:49:14.965 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-09-12T02:49:14.965 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-09-12T02:49:14.965 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-09-12T02:49:14.965 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-09-12T02:49:14.965 INFO:teuthology.orchestra.run.smithi039.stdout: "log_to_cluster_level": { 2024-09-12T02:49:14.965 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "log_to_cluster_level", 2024-09-12T02:49:14.965 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "str", 2024-09-12T02:49:14.966 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "advanced", 2024-09-12T02:49:14.966 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 1, 2024-09-12T02:49:14.966 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "info", 2024-09-12T02:49:14.966 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-09-12T02:49:14.966 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-09-12T02:49:14.966 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [ 2024-09-12T02:49:14.966 INFO:teuthology.orchestra.run.smithi039.stdout: "", 2024-09-12T02:49:14.966 INFO:teuthology.orchestra.run.smithi039.stdout: "critical", 2024-09-12T02:49:14.966 INFO:teuthology.orchestra.run.smithi039.stdout: "debug", 2024-09-12T02:49:14.966 INFO:teuthology.orchestra.run.smithi039.stdout: "error", 2024-09-12T02:49:14.966 INFO:teuthology.orchestra.run.smithi039.stdout: "info", 2024-09-12T02:49:14.966 INFO:teuthology.orchestra.run.smithi039.stdout: "warning" 2024-09-12T02:49:14.966 INFO:teuthology.orchestra.run.smithi039.stdout: ], 2024-09-12T02:49:14.966 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "", 2024-09-12T02:49:14.967 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-09-12T02:49:14.967 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-09-12T02:49:14.967 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-09-12T02:49:14.967 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-09-12T02:49:14.967 INFO:teuthology.orchestra.run.smithi039.stdout: "log_to_file": { 2024-09-12T02:49:14.967 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "log_to_file", 2024-09-12T02:49:14.967 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "bool", 2024-09-12T02:49:14.967 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "advanced", 2024-09-12T02:49:14.967 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 1, 2024-09-12T02:49:14.967 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "False", 2024-09-12T02:49:14.967 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-09-12T02:49:14.967 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-09-12T02:49:14.967 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [], 2024-09-12T02:49:14.967 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "", 2024-09-12T02:49:14.968 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-09-12T02:49:14.968 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-09-12T02:49:14.968 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-09-12T02:49:14.968 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-09-12T02:49:14.968 INFO:teuthology.orchestra.run.smithi039.stdout: "rbd_stats_pools": { 2024-09-12T02:49:14.968 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "rbd_stats_pools", 2024-09-12T02:49:14.968 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "str", 2024-09-12T02:49:14.968 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "advanced", 2024-09-12T02:49:14.968 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 0, 2024-09-12T02:49:14.968 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "", 2024-09-12T02:49:14.968 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-09-12T02:49:14.968 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-09-12T02:49:14.968 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [], 2024-09-12T02:49:14.969 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "", 2024-09-12T02:49:14.969 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-09-12T02:49:14.969 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-09-12T02:49:14.969 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-09-12T02:49:14.969 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-09-12T02:49:14.969 INFO:teuthology.orchestra.run.smithi039.stdout: "rbd_stats_pools_refresh_interval": { 2024-09-12T02:49:14.969 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "rbd_stats_pools_refresh_interval", 2024-09-12T02:49:14.969 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "int", 2024-09-12T02:49:14.969 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "advanced", 2024-09-12T02:49:14.969 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 0, 2024-09-12T02:49:14.969 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "300", 2024-09-12T02:49:14.969 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-09-12T02:49:14.969 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-09-12T02:49:14.969 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [], 2024-09-12T02:49:14.970 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "", 2024-09-12T02:49:14.970 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-09-12T02:49:14.970 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-09-12T02:49:14.970 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-09-12T02:49:14.970 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-09-12T02:49:14.970 INFO:teuthology.orchestra.run.smithi039.stdout: "scrape_interval": { 2024-09-12T02:49:14.970 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "scrape_interval", 2024-09-12T02:49:14.970 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "float", 2024-09-12T02:49:14.970 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "advanced", 2024-09-12T02:49:14.970 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 0, 2024-09-12T02:49:14.970 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "15.0", 2024-09-12T02:49:14.970 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-09-12T02:49:14.970 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-09-12T02:49:14.970 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [], 2024-09-12T02:49:14.971 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "", 2024-09-12T02:49:14.971 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-09-12T02:49:14.971 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-09-12T02:49:14.971 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-09-12T02:49:14.971 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-09-12T02:49:14.971 INFO:teuthology.orchestra.run.smithi039.stdout: "server_addr": { 2024-09-12T02:49:14.971 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "server_addr", 2024-09-12T02:49:14.971 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "str", 2024-09-12T02:49:14.971 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "advanced", 2024-09-12T02:49:14.971 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 0, 2024-09-12T02:49:14.971 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "::", 2024-09-12T02:49:14.971 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-09-12T02:49:14.971 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-09-12T02:49:14.971 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [], 2024-09-12T02:49:14.972 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "the IPv4 or IPv6 address on which the module listens for HTTP requests", 2024-09-12T02:49:14.972 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-09-12T02:49:14.972 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-09-12T02:49:14.972 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-09-12T02:49:14.972 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-09-12T02:49:14.972 INFO:teuthology.orchestra.run.smithi039.stdout: "server_port": { 2024-09-12T02:49:14.972 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "server_port", 2024-09-12T02:49:14.972 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "int", 2024-09-12T02:49:14.972 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "advanced", 2024-09-12T02:49:14.972 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 1, 2024-09-12T02:49:14.972 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "9283", 2024-09-12T02:49:14.972 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-09-12T02:49:14.972 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-09-12T02:49:14.972 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [], 2024-09-12T02:49:14.973 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "the port on which the module listens for HTTP requests", 2024-09-12T02:49:14.973 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-09-12T02:49:14.973 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-09-12T02:49:14.973 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-09-12T02:49:14.973 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-09-12T02:49:14.973 INFO:teuthology.orchestra.run.smithi039.stdout: "stale_cache_strategy": { 2024-09-12T02:49:14.973 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "stale_cache_strategy", 2024-09-12T02:49:14.973 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "str", 2024-09-12T02:49:14.973 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "advanced", 2024-09-12T02:49:14.973 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 0, 2024-09-12T02:49:14.973 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "log", 2024-09-12T02:49:14.973 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-09-12T02:49:14.973 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-09-12T02:49:14.973 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [], 2024-09-12T02:49:14.974 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "", 2024-09-12T02:49:14.974 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-09-12T02:49:14.974 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-09-12T02:49:14.974 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-09-12T02:49:14.974 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-09-12T02:49:14.974 INFO:teuthology.orchestra.run.smithi039.stdout: "standby_behaviour": { 2024-09-12T02:49:14.974 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "standby_behaviour", 2024-09-12T02:49:14.974 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "str", 2024-09-12T02:49:14.974 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "advanced", 2024-09-12T02:49:14.974 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 1, 2024-09-12T02:49:14.974 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "default", 2024-09-12T02:49:14.974 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-09-12T02:49:14.974 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-09-12T02:49:14.975 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [ 2024-09-12T02:49:14.975 INFO:teuthology.orchestra.run.smithi039.stdout: "default", 2024-09-12T02:49:14.975 INFO:teuthology.orchestra.run.smithi039.stdout: "error" 2024-09-12T02:49:14.975 INFO:teuthology.orchestra.run.smithi039.stdout: ], 2024-09-12T02:49:14.975 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "", 2024-09-12T02:49:14.975 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-09-12T02:49:14.975 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-09-12T02:49:14.975 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-09-12T02:49:14.975 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-09-12T02:49:14.975 INFO:teuthology.orchestra.run.smithi039.stdout: "standby_error_status_code": { 2024-09-12T02:49:14.975 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "standby_error_status_code", 2024-09-12T02:49:14.975 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "int", 2024-09-12T02:49:14.975 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "advanced", 2024-09-12T02:49:14.975 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 1, 2024-09-12T02:49:14.976 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "500", 2024-09-12T02:49:14.976 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "400", 2024-09-12T02:49:14.976 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "599", 2024-09-12T02:49:14.976 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [], 2024-09-12T02:49:14.976 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "", 2024-09-12T02:49:14.976 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-09-12T02:49:14.976 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-09-12T02:49:14.976 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-09-12T02:49:14.976 INFO:teuthology.orchestra.run.smithi039.stdout: } 2024-09-12T02:49:14.976 INFO:teuthology.orchestra.run.smithi039.stdout: } 2024-09-12T02:49:14.976 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-09-12T02:49:14.976 INFO:teuthology.orchestra.run.smithi039.stdout: { 2024-09-12T02:49:14.976 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "rbd_support", 2024-09-12T02:49:14.977 INFO:teuthology.orchestra.run.smithi039.stdout: "can_run": true, 2024-09-12T02:49:14.977 INFO:teuthology.orchestra.run.smithi039.stdout: "error_string": "", 2024-09-12T02:49:14.977 INFO:teuthology.orchestra.run.smithi039.stdout: "module_options": { 2024-09-12T02:49:14.977 INFO:teuthology.orchestra.run.smithi039.stdout: "log_level": { 2024-09-12T02:49:14.977 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "log_level", 2024-09-12T02:49:14.977 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "str", 2024-09-12T02:49:14.977 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "advanced", 2024-09-12T02:49:14.977 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 1, 2024-09-12T02:49:14.977 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "", 2024-09-12T02:49:14.977 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-09-12T02:49:14.977 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-09-12T02:49:14.977 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [ 2024-09-12T02:49:14.977 INFO:teuthology.orchestra.run.smithi039.stdout: "", 2024-09-12T02:49:14.978 INFO:teuthology.orchestra.run.smithi039.stdout: "critical", 2024-09-12T02:49:14.978 INFO:teuthology.orchestra.run.smithi039.stdout: "debug", 2024-09-12T02:49:14.978 INFO:teuthology.orchestra.run.smithi039.stdout: "error", 2024-09-12T02:49:14.978 INFO:teuthology.orchestra.run.smithi039.stdout: "info", 2024-09-12T02:49:14.978 INFO:teuthology.orchestra.run.smithi039.stdout: "warning" 2024-09-12T02:49:14.978 INFO:teuthology.orchestra.run.smithi039.stdout: ], 2024-09-12T02:49:14.978 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "", 2024-09-12T02:49:14.978 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-09-12T02:49:14.978 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-09-12T02:49:14.978 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-09-12T02:49:14.978 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-09-12T02:49:14.978 INFO:teuthology.orchestra.run.smithi039.stdout: "log_to_cluster": { 2024-09-12T02:49:14.978 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "log_to_cluster", 2024-09-12T02:49:14.978 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "bool", 2024-09-12T02:49:14.979 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "advanced", 2024-09-12T02:49:14.979 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 1, 2024-09-12T02:49:14.979 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "False", 2024-09-12T02:49:14.979 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-09-12T02:49:14.979 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-09-12T02:49:14.979 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [], 2024-09-12T02:49:14.979 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "", 2024-09-12T02:49:14.979 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-09-12T02:49:14.979 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-09-12T02:49:14.979 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-09-12T02:49:14.979 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-09-12T02:49:14.979 INFO:teuthology.orchestra.run.smithi039.stdout: "log_to_cluster_level": { 2024-09-12T02:49:14.979 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "log_to_cluster_level", 2024-09-12T02:49:14.979 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "str", 2024-09-12T02:49:14.980 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "advanced", 2024-09-12T02:49:14.980 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 1, 2024-09-12T02:49:14.980 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "info", 2024-09-12T02:49:14.980 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-09-12T02:49:14.980 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-09-12T02:49:14.980 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [ 2024-09-12T02:49:14.980 INFO:teuthology.orchestra.run.smithi039.stdout: "", 2024-09-12T02:49:14.980 INFO:teuthology.orchestra.run.smithi039.stdout: "critical", 2024-09-12T02:49:14.980 INFO:teuthology.orchestra.run.smithi039.stdout: "debug", 2024-09-12T02:49:14.980 INFO:teuthology.orchestra.run.smithi039.stdout: "error", 2024-09-12T02:49:14.980 INFO:teuthology.orchestra.run.smithi039.stdout: "info", 2024-09-12T02:49:14.980 INFO:teuthology.orchestra.run.smithi039.stdout: "warning" 2024-09-12T02:49:14.980 INFO:teuthology.orchestra.run.smithi039.stdout: ], 2024-09-12T02:49:14.981 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "", 2024-09-12T02:49:14.981 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-09-12T02:49:14.981 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-09-12T02:49:14.981 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-09-12T02:49:14.981 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-09-12T02:49:14.981 INFO:teuthology.orchestra.run.smithi039.stdout: "log_to_file": { 2024-09-12T02:49:14.981 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "log_to_file", 2024-09-12T02:49:14.981 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "bool", 2024-09-12T02:49:14.981 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "advanced", 2024-09-12T02:49:14.981 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 1, 2024-09-12T02:49:14.981 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "False", 2024-09-12T02:49:14.981 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-09-12T02:49:14.981 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-09-12T02:49:14.981 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [], 2024-09-12T02:49:14.982 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "", 2024-09-12T02:49:14.982 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-09-12T02:49:14.982 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-09-12T02:49:14.982 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-09-12T02:49:14.982 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-09-12T02:49:14.982 INFO:teuthology.orchestra.run.smithi039.stdout: "max_concurrent_snap_create": { 2024-09-12T02:49:14.982 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "max_concurrent_snap_create", 2024-09-12T02:49:14.982 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "int", 2024-09-12T02:49:14.982 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "advanced", 2024-09-12T02:49:14.982 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 0, 2024-09-12T02:49:14.982 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "10", 2024-09-12T02:49:14.982 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-09-12T02:49:14.982 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-09-12T02:49:14.982 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [], 2024-09-12T02:49:14.983 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "", 2024-09-12T02:49:14.983 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-09-12T02:49:14.983 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-09-12T02:49:14.983 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-09-12T02:49:14.983 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-09-12T02:49:14.983 INFO:teuthology.orchestra.run.smithi039.stdout: "mirror_snapshot_schedule": { 2024-09-12T02:49:14.983 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "mirror_snapshot_schedule", 2024-09-12T02:49:14.983 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "str", 2024-09-12T02:49:14.983 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "advanced", 2024-09-12T02:49:14.983 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 0, 2024-09-12T02:49:14.983 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "", 2024-09-12T02:49:14.983 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-09-12T02:49:14.983 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-09-12T02:49:14.983 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [], 2024-09-12T02:49:14.984 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "", 2024-09-12T02:49:14.984 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-09-12T02:49:14.984 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-09-12T02:49:14.984 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-09-12T02:49:14.984 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-09-12T02:49:14.984 INFO:teuthology.orchestra.run.smithi039.stdout: "trash_purge_schedule": { 2024-09-12T02:49:14.984 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "trash_purge_schedule", 2024-09-12T02:49:14.984 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "str", 2024-09-12T02:49:14.984 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "advanced", 2024-09-12T02:49:14.984 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 0, 2024-09-12T02:49:14.984 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "", 2024-09-12T02:49:14.984 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-09-12T02:49:14.984 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-09-12T02:49:14.985 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [], 2024-09-12T02:49:14.985 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "", 2024-09-12T02:49:14.985 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-09-12T02:49:14.985 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-09-12T02:49:14.985 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-09-12T02:49:14.985 INFO:teuthology.orchestra.run.smithi039.stdout: } 2024-09-12T02:49:14.985 INFO:teuthology.orchestra.run.smithi039.stdout: } 2024-09-12T02:49:14.985 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-09-12T02:49:14.985 INFO:teuthology.orchestra.run.smithi039.stdout: { 2024-09-12T02:49:14.985 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "restful", 2024-09-12T02:49:14.985 INFO:teuthology.orchestra.run.smithi039.stdout: "can_run": true, 2024-09-12T02:49:14.985 INFO:teuthology.orchestra.run.smithi039.stdout: "error_string": "", 2024-09-12T02:49:14.985 INFO:teuthology.orchestra.run.smithi039.stdout: "module_options": { 2024-09-12T02:49:14.985 INFO:teuthology.orchestra.run.smithi039.stdout: "enable_auth": { 2024-09-12T02:49:14.986 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "enable_auth", 2024-09-12T02:49:14.986 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "bool", 2024-09-12T02:49:14.986 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "advanced", 2024-09-12T02:49:14.986 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 0, 2024-09-12T02:49:14.986 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "True", 2024-09-12T02:49:14.986 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-09-12T02:49:14.986 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-09-12T02:49:14.986 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [], 2024-09-12T02:49:14.986 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "", 2024-09-12T02:49:14.986 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-09-12T02:49:14.986 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-09-12T02:49:14.986 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-09-12T02:49:14.986 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-09-12T02:49:14.986 INFO:teuthology.orchestra.run.smithi039.stdout: "key_file": { 2024-09-12T02:49:14.987 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "key_file", 2024-09-12T02:49:14.987 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "str", 2024-09-12T02:49:14.987 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "advanced", 2024-09-12T02:49:14.987 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 0, 2024-09-12T02:49:14.987 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "", 2024-09-12T02:49:14.987 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-09-12T02:49:14.987 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-09-12T02:49:14.987 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [], 2024-09-12T02:49:14.987 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "", 2024-09-12T02:49:14.987 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-09-12T02:49:14.987 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-09-12T02:49:14.987 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-09-12T02:49:14.987 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-09-12T02:49:14.987 INFO:teuthology.orchestra.run.smithi039.stdout: "log_level": { 2024-09-12T02:49:14.988 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "log_level", 2024-09-12T02:49:14.988 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "str", 2024-09-12T02:49:14.988 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "advanced", 2024-09-12T02:49:14.988 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 1, 2024-09-12T02:49:14.988 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "", 2024-09-12T02:49:14.988 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-09-12T02:49:14.988 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-09-12T02:49:14.988 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [ 2024-09-12T02:49:14.988 INFO:teuthology.orchestra.run.smithi039.stdout: "", 2024-09-12T02:49:14.988 INFO:teuthology.orchestra.run.smithi039.stdout: "critical", 2024-09-12T02:49:14.988 INFO:teuthology.orchestra.run.smithi039.stdout: "debug", 2024-09-12T02:49:14.988 INFO:teuthology.orchestra.run.smithi039.stdout: "error", 2024-09-12T02:49:14.988 INFO:teuthology.orchestra.run.smithi039.stdout: "info", 2024-09-12T02:49:14.989 INFO:teuthology.orchestra.run.smithi039.stdout: "warning" 2024-09-12T02:49:14.989 INFO:teuthology.orchestra.run.smithi039.stdout: ], 2024-09-12T02:49:14.989 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "", 2024-09-12T02:49:14.989 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-09-12T02:49:14.989 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-09-12T02:49:14.989 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-09-12T02:49:14.989 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-09-12T02:49:14.989 INFO:teuthology.orchestra.run.smithi039.stdout: "log_to_cluster": { 2024-09-12T02:49:14.989 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "log_to_cluster", 2024-09-12T02:49:14.989 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "bool", 2024-09-12T02:49:14.989 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "advanced", 2024-09-12T02:49:14.989 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 1, 2024-09-12T02:49:14.989 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "False", 2024-09-12T02:49:14.989 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-09-12T02:49:14.990 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-09-12T02:49:14.990 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [], 2024-09-12T02:49:14.990 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "", 2024-09-12T02:49:14.990 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-09-12T02:49:14.990 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-09-12T02:49:14.990 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-09-12T02:49:14.990 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-09-12T02:49:14.990 INFO:teuthology.orchestra.run.smithi039.stdout: "log_to_cluster_level": { 2024-09-12T02:49:14.990 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "log_to_cluster_level", 2024-09-12T02:49:14.990 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "str", 2024-09-12T02:49:14.990 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "advanced", 2024-09-12T02:49:14.990 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 1, 2024-09-12T02:49:14.990 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "info", 2024-09-12T02:49:14.990 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-09-12T02:49:14.991 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-09-12T02:49:14.991 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [ 2024-09-12T02:49:14.991 INFO:teuthology.orchestra.run.smithi039.stdout: "", 2024-09-12T02:49:14.991 INFO:teuthology.orchestra.run.smithi039.stdout: "critical", 2024-09-12T02:49:14.991 INFO:teuthology.orchestra.run.smithi039.stdout: "debug", 2024-09-12T02:49:14.991 INFO:teuthology.orchestra.run.smithi039.stdout: "error", 2024-09-12T02:49:14.991 INFO:teuthology.orchestra.run.smithi039.stdout: "info", 2024-09-12T02:49:14.991 INFO:teuthology.orchestra.run.smithi039.stdout: "warning" 2024-09-12T02:49:14.991 INFO:teuthology.orchestra.run.smithi039.stdout: ], 2024-09-12T02:49:14.991 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "", 2024-09-12T02:49:14.991 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-09-12T02:49:14.991 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-09-12T02:49:14.991 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-09-12T02:49:14.991 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-09-12T02:49:14.992 INFO:teuthology.orchestra.run.smithi039.stdout: "log_to_file": { 2024-09-12T02:49:14.992 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "log_to_file", 2024-09-12T02:49:14.992 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "bool", 2024-09-12T02:49:14.992 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "advanced", 2024-09-12T02:49:14.992 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 1, 2024-09-12T02:49:14.992 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "False", 2024-09-12T02:49:14.992 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-09-12T02:49:14.992 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-09-12T02:49:14.992 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [], 2024-09-12T02:49:14.992 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "", 2024-09-12T02:49:14.992 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-09-12T02:49:14.992 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-09-12T02:49:14.992 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-09-12T02:49:14.993 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-09-12T02:49:14.993 INFO:teuthology.orchestra.run.smithi039.stdout: "server_addr": { 2024-09-12T02:49:14.993 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "server_addr", 2024-09-12T02:49:14.993 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "str", 2024-09-12T02:49:14.993 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "advanced", 2024-09-12T02:49:14.993 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 0, 2024-09-12T02:49:14.993 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "", 2024-09-12T02:49:14.993 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-09-12T02:49:14.993 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-09-12T02:49:14.993 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [], 2024-09-12T02:49:14.993 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "", 2024-09-12T02:49:14.993 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-09-12T02:49:14.993 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-09-12T02:49:14.993 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-09-12T02:49:14.994 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-09-12T02:49:14.994 INFO:teuthology.orchestra.run.smithi039.stdout: "server_port": { 2024-09-12T02:49:14.994 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "server_port", 2024-09-12T02:49:14.994 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "str", 2024-09-12T02:49:14.994 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "advanced", 2024-09-12T02:49:14.994 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 0, 2024-09-12T02:49:14.994 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "", 2024-09-12T02:49:14.994 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-09-12T02:49:14.994 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-09-12T02:49:14.994 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [], 2024-09-12T02:49:14.994 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "", 2024-09-12T02:49:14.994 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-09-12T02:49:14.994 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-09-12T02:49:14.995 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-09-12T02:49:14.995 INFO:teuthology.orchestra.run.smithi039.stdout: } 2024-09-12T02:49:14.995 INFO:teuthology.orchestra.run.smithi039.stdout: } 2024-09-12T02:49:14.995 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-09-12T02:49:14.995 INFO:teuthology.orchestra.run.smithi039.stdout: { 2024-09-12T02:49:14.995 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "rgw", 2024-09-12T02:49:14.995 INFO:teuthology.orchestra.run.smithi039.stdout: "can_run": true, 2024-09-12T02:49:14.995 INFO:teuthology.orchestra.run.smithi039.stdout: "error_string": "", 2024-09-12T02:49:14.995 INFO:teuthology.orchestra.run.smithi039.stdout: "module_options": { 2024-09-12T02:49:14.995 INFO:teuthology.orchestra.run.smithi039.stdout: "log_level": { 2024-09-12T02:49:14.995 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "log_level", 2024-09-12T02:49:14.995 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "str", 2024-09-12T02:49:14.995 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "advanced", 2024-09-12T02:49:14.995 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 1, 2024-09-12T02:49:14.996 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "", 2024-09-12T02:49:14.996 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-09-12T02:49:14.996 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-09-12T02:49:14.996 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [ 2024-09-12T02:49:14.996 INFO:teuthology.orchestra.run.smithi039.stdout: "", 2024-09-12T02:49:14.996 INFO:teuthology.orchestra.run.smithi039.stdout: "critical", 2024-09-12T02:49:14.996 INFO:teuthology.orchestra.run.smithi039.stdout: "debug", 2024-09-12T02:49:14.996 INFO:teuthology.orchestra.run.smithi039.stdout: "error", 2024-09-12T02:49:14.996 INFO:teuthology.orchestra.run.smithi039.stdout: "info", 2024-09-12T02:49:14.996 INFO:teuthology.orchestra.run.smithi039.stdout: "warning" 2024-09-12T02:49:14.996 INFO:teuthology.orchestra.run.smithi039.stdout: ], 2024-09-12T02:49:14.996 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "", 2024-09-12T02:49:14.996 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-09-12T02:49:14.996 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-09-12T02:49:14.997 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-09-12T02:49:14.997 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-09-12T02:49:14.997 INFO:teuthology.orchestra.run.smithi039.stdout: "log_to_cluster": { 2024-09-12T02:49:14.997 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "log_to_cluster", 2024-09-12T02:49:14.997 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "bool", 2024-09-12T02:49:14.997 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "advanced", 2024-09-12T02:49:14.997 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 1, 2024-09-12T02:49:14.997 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "False", 2024-09-12T02:49:14.997 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-09-12T02:49:14.997 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-09-12T02:49:14.997 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [], 2024-09-12T02:49:14.997 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "", 2024-09-12T02:49:14.997 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-09-12T02:49:14.997 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-09-12T02:49:14.998 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-09-12T02:49:14.998 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-09-12T02:49:14.998 INFO:teuthology.orchestra.run.smithi039.stdout: "log_to_cluster_level": { 2024-09-12T02:49:14.998 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "log_to_cluster_level", 2024-09-12T02:49:14.998 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "str", 2024-09-12T02:49:14.998 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "advanced", 2024-09-12T02:49:14.998 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 1, 2024-09-12T02:49:14.998 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "info", 2024-09-12T02:49:14.998 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-09-12T02:49:14.998 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-09-12T02:49:14.998 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [ 2024-09-12T02:49:14.998 INFO:teuthology.orchestra.run.smithi039.stdout: "", 2024-09-12T02:49:14.998 INFO:teuthology.orchestra.run.smithi039.stdout: "critical", 2024-09-12T02:49:14.998 INFO:teuthology.orchestra.run.smithi039.stdout: "debug", 2024-09-12T02:49:14.999 INFO:teuthology.orchestra.run.smithi039.stdout: "error", 2024-09-12T02:49:14.999 INFO:teuthology.orchestra.run.smithi039.stdout: "info", 2024-09-12T02:49:14.999 INFO:teuthology.orchestra.run.smithi039.stdout: "warning" 2024-09-12T02:49:14.999 INFO:teuthology.orchestra.run.smithi039.stdout: ], 2024-09-12T02:49:14.999 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "", 2024-09-12T02:49:14.999 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-09-12T02:49:14.999 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-09-12T02:49:14.999 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-09-12T02:49:14.999 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-09-12T02:49:14.999 INFO:teuthology.orchestra.run.smithi039.stdout: "log_to_file": { 2024-09-12T02:49:14.999 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "log_to_file", 2024-09-12T02:49:14.999 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "bool", 2024-09-12T02:49:14.999 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "advanced", 2024-09-12T02:49:14.999 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 1, 2024-09-12T02:49:15.000 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "False", 2024-09-12T02:49:15.000 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-09-12T02:49:15.000 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-09-12T02:49:15.000 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [], 2024-09-12T02:49:15.000 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "", 2024-09-12T02:49:15.000 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-09-12T02:49:15.000 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-09-12T02:49:15.000 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-09-12T02:49:15.000 INFO:teuthology.orchestra.run.smithi039.stdout: } 2024-09-12T02:49:15.000 INFO:teuthology.orchestra.run.smithi039.stdout: } 2024-09-12T02:49:15.000 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-09-12T02:49:15.000 INFO:teuthology.orchestra.run.smithi039.stdout: { 2024-09-12T02:49:15.000 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "rook", 2024-09-12T02:49:15.000 INFO:teuthology.orchestra.run.smithi039.stdout: "can_run": true, 2024-09-12T02:49:15.001 INFO:teuthology.orchestra.run.smithi039.stdout: "error_string": "", 2024-09-12T02:49:15.001 INFO:teuthology.orchestra.run.smithi039.stdout: "module_options": { 2024-09-12T02:49:15.001 INFO:teuthology.orchestra.run.smithi039.stdout: "log_level": { 2024-09-12T02:49:15.001 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "log_level", 2024-09-12T02:49:15.001 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "str", 2024-09-12T02:49:15.001 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "advanced", 2024-09-12T02:49:15.001 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 1, 2024-09-12T02:49:15.001 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "", 2024-09-12T02:49:15.001 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-09-12T02:49:15.001 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-09-12T02:49:15.001 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [ 2024-09-12T02:49:15.001 INFO:teuthology.orchestra.run.smithi039.stdout: "", 2024-09-12T02:49:15.001 INFO:teuthology.orchestra.run.smithi039.stdout: "critical", 2024-09-12T02:49:15.001 INFO:teuthology.orchestra.run.smithi039.stdout: "debug", 2024-09-12T02:49:15.002 INFO:teuthology.orchestra.run.smithi039.stdout: "error", 2024-09-12T02:49:15.002 INFO:teuthology.orchestra.run.smithi039.stdout: "info", 2024-09-12T02:49:15.002 INFO:teuthology.orchestra.run.smithi039.stdout: "warning" 2024-09-12T02:49:15.002 INFO:teuthology.orchestra.run.smithi039.stdout: ], 2024-09-12T02:49:15.002 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "", 2024-09-12T02:49:15.002 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-09-12T02:49:15.002 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-09-12T02:49:15.002 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-09-12T02:49:15.002 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-09-12T02:49:15.002 INFO:teuthology.orchestra.run.smithi039.stdout: "log_to_cluster": { 2024-09-12T02:49:15.002 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "log_to_cluster", 2024-09-12T02:49:15.002 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "bool", 2024-09-12T02:49:15.002 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "advanced", 2024-09-12T02:49:15.002 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 1, 2024-09-12T02:49:15.003 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "False", 2024-09-12T02:49:15.003 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-09-12T02:49:15.003 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-09-12T02:49:15.003 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [], 2024-09-12T02:49:15.003 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "", 2024-09-12T02:49:15.003 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-09-12T02:49:15.003 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-09-12T02:49:15.003 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-09-12T02:49:15.003 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-09-12T02:49:15.003 INFO:teuthology.orchestra.run.smithi039.stdout: "log_to_cluster_level": { 2024-09-12T02:49:15.003 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "log_to_cluster_level", 2024-09-12T02:49:15.003 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "str", 2024-09-12T02:49:15.003 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "advanced", 2024-09-12T02:49:15.004 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 1, 2024-09-12T02:49:15.004 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "info", 2024-09-12T02:49:15.004 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-09-12T02:49:15.004 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-09-12T02:49:15.004 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [ 2024-09-12T02:49:15.004 INFO:teuthology.orchestra.run.smithi039.stdout: "", 2024-09-12T02:49:15.004 INFO:teuthology.orchestra.run.smithi039.stdout: "critical", 2024-09-12T02:49:15.004 INFO:teuthology.orchestra.run.smithi039.stdout: "debug", 2024-09-12T02:49:15.004 INFO:teuthology.orchestra.run.smithi039.stdout: "error", 2024-09-12T02:49:15.004 INFO:teuthology.orchestra.run.smithi039.stdout: "info", 2024-09-12T02:49:15.004 INFO:teuthology.orchestra.run.smithi039.stdout: "warning" 2024-09-12T02:49:15.004 INFO:teuthology.orchestra.run.smithi039.stdout: ], 2024-09-12T02:49:15.004 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "", 2024-09-12T02:49:15.004 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-09-12T02:49:15.005 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-09-12T02:49:15.005 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-09-12T02:49:15.005 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-09-12T02:49:15.005 INFO:teuthology.orchestra.run.smithi039.stdout: "log_to_file": { 2024-09-12T02:49:15.005 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "log_to_file", 2024-09-12T02:49:15.005 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "bool", 2024-09-12T02:49:15.005 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "advanced", 2024-09-12T02:49:15.005 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 1, 2024-09-12T02:49:15.005 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "False", 2024-09-12T02:49:15.005 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-09-12T02:49:15.005 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-09-12T02:49:15.005 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [], 2024-09-12T02:49:15.005 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "", 2024-09-12T02:49:15.006 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-09-12T02:49:15.006 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-09-12T02:49:15.006 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-09-12T02:49:15.006 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-09-12T02:49:15.006 INFO:teuthology.orchestra.run.smithi039.stdout: "storage_class": { 2024-09-12T02:49:15.006 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "storage_class", 2024-09-12T02:49:15.006 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "str", 2024-09-12T02:49:15.006 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "advanced", 2024-09-12T02:49:15.006 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 0, 2024-09-12T02:49:15.006 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "local", 2024-09-12T02:49:15.006 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-09-12T02:49:15.006 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-09-12T02:49:15.006 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [], 2024-09-12T02:49:15.006 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "storage class name for LSO-discovered PVs", 2024-09-12T02:49:15.007 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-09-12T02:49:15.007 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-09-12T02:49:15.007 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-09-12T02:49:15.007 INFO:teuthology.orchestra.run.smithi039.stdout: } 2024-09-12T02:49:15.007 INFO:teuthology.orchestra.run.smithi039.stdout: } 2024-09-12T02:49:15.007 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-09-12T02:49:15.007 INFO:teuthology.orchestra.run.smithi039.stdout: { 2024-09-12T02:49:15.007 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "selftest", 2024-09-12T02:49:15.007 INFO:teuthology.orchestra.run.smithi039.stdout: "can_run": true, 2024-09-12T02:49:15.007 INFO:teuthology.orchestra.run.smithi039.stdout: "error_string": "", 2024-09-12T02:49:15.007 INFO:teuthology.orchestra.run.smithi039.stdout: "module_options": { 2024-09-12T02:49:15.007 INFO:teuthology.orchestra.run.smithi039.stdout: "log_level": { 2024-09-12T02:49:15.007 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "log_level", 2024-09-12T02:49:15.007 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "str", 2024-09-12T02:49:15.008 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "advanced", 2024-09-12T02:49:15.008 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 1, 2024-09-12T02:49:15.008 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "", 2024-09-12T02:49:15.008 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-09-12T02:49:15.008 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-09-12T02:49:15.008 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [ 2024-09-12T02:49:15.008 INFO:teuthology.orchestra.run.smithi039.stdout: "", 2024-09-12T02:49:15.008 INFO:teuthology.orchestra.run.smithi039.stdout: "critical", 2024-09-12T02:49:15.008 INFO:teuthology.orchestra.run.smithi039.stdout: "debug", 2024-09-12T02:49:15.008 INFO:teuthology.orchestra.run.smithi039.stdout: "error", 2024-09-12T02:49:15.008 INFO:teuthology.orchestra.run.smithi039.stdout: "info", 2024-09-12T02:49:15.008 INFO:teuthology.orchestra.run.smithi039.stdout: "warning" 2024-09-12T02:49:15.008 INFO:teuthology.orchestra.run.smithi039.stdout: ], 2024-09-12T02:49:15.009 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "", 2024-09-12T02:49:15.009 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-09-12T02:49:15.009 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-09-12T02:49:15.009 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-09-12T02:49:15.009 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-09-12T02:49:15.009 INFO:teuthology.orchestra.run.smithi039.stdout: "log_to_cluster": { 2024-09-12T02:49:15.009 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "log_to_cluster", 2024-09-12T02:49:15.009 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "bool", 2024-09-12T02:49:15.009 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "advanced", 2024-09-12T02:49:15.009 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 1, 2024-09-12T02:49:15.009 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "False", 2024-09-12T02:49:15.009 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-09-12T02:49:15.009 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-09-12T02:49:15.009 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [], 2024-09-12T02:49:15.010 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "", 2024-09-12T02:49:15.010 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-09-12T02:49:15.010 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-09-12T02:49:15.010 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-09-12T02:49:15.010 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-09-12T02:49:15.010 INFO:teuthology.orchestra.run.smithi039.stdout: "log_to_cluster_level": { 2024-09-12T02:49:15.010 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "log_to_cluster_level", 2024-09-12T02:49:15.010 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "str", 2024-09-12T02:49:15.010 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "advanced", 2024-09-12T02:49:15.010 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 1, 2024-09-12T02:49:15.010 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "info", 2024-09-12T02:49:15.010 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-09-12T02:49:15.010 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-09-12T02:49:15.010 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [ 2024-09-12T02:49:15.011 INFO:teuthology.orchestra.run.smithi039.stdout: "", 2024-09-12T02:49:15.011 INFO:teuthology.orchestra.run.smithi039.stdout: "critical", 2024-09-12T02:49:15.011 INFO:teuthology.orchestra.run.smithi039.stdout: "debug", 2024-09-12T02:49:15.011 INFO:teuthology.orchestra.run.smithi039.stdout: "error", 2024-09-12T02:49:15.011 INFO:teuthology.orchestra.run.smithi039.stdout: "info", 2024-09-12T02:49:15.011 INFO:teuthology.orchestra.run.smithi039.stdout: "warning" 2024-09-12T02:49:15.011 INFO:teuthology.orchestra.run.smithi039.stdout: ], 2024-09-12T02:49:15.011 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "", 2024-09-12T02:49:15.011 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-09-12T02:49:15.011 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-09-12T02:49:15.011 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-09-12T02:49:15.011 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-09-12T02:49:15.011 INFO:teuthology.orchestra.run.smithi039.stdout: "log_to_file": { 2024-09-12T02:49:15.011 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "log_to_file", 2024-09-12T02:49:15.012 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "bool", 2024-09-12T02:49:15.012 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "advanced", 2024-09-12T02:49:15.012 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 1, 2024-09-12T02:49:15.012 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "False", 2024-09-12T02:49:15.012 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-09-12T02:49:15.012 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-09-12T02:49:15.012 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [], 2024-09-12T02:49:15.012 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "", 2024-09-12T02:49:15.012 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-09-12T02:49:15.012 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-09-12T02:49:15.012 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-09-12T02:49:15.012 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-09-12T02:49:15.012 INFO:teuthology.orchestra.run.smithi039.stdout: "roption1": { 2024-09-12T02:49:15.012 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "roption1", 2024-09-12T02:49:15.013 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "str", 2024-09-12T02:49:15.013 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "advanced", 2024-09-12T02:49:15.013 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 0, 2024-09-12T02:49:15.013 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "", 2024-09-12T02:49:15.013 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-09-12T02:49:15.013 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-09-12T02:49:15.013 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [], 2024-09-12T02:49:15.013 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "", 2024-09-12T02:49:15.013 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-09-12T02:49:15.013 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-09-12T02:49:15.013 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-09-12T02:49:15.013 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-09-12T02:49:15.013 INFO:teuthology.orchestra.run.smithi039.stdout: "roption2": { 2024-09-12T02:49:15.013 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "roption2", 2024-09-12T02:49:15.014 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "str", 2024-09-12T02:49:15.014 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "advanced", 2024-09-12T02:49:15.014 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 0, 2024-09-12T02:49:15.014 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "xyz", 2024-09-12T02:49:15.014 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-09-12T02:49:15.014 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-09-12T02:49:15.014 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [], 2024-09-12T02:49:15.014 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "", 2024-09-12T02:49:15.014 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-09-12T02:49:15.014 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-09-12T02:49:15.014 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-09-12T02:49:15.014 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-09-12T02:49:15.014 INFO:teuthology.orchestra.run.smithi039.stdout: "rwoption1": { 2024-09-12T02:49:15.014 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "rwoption1", 2024-09-12T02:49:15.015 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "str", 2024-09-12T02:49:15.015 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "advanced", 2024-09-12T02:49:15.015 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 0, 2024-09-12T02:49:15.015 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "", 2024-09-12T02:49:15.015 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-09-12T02:49:15.015 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-09-12T02:49:15.015 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [], 2024-09-12T02:49:15.015 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "", 2024-09-12T02:49:15.015 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-09-12T02:49:15.015 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-09-12T02:49:15.015 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-09-12T02:49:15.015 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-09-12T02:49:15.015 INFO:teuthology.orchestra.run.smithi039.stdout: "rwoption2": { 2024-09-12T02:49:15.015 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "rwoption2", 2024-09-12T02:49:15.016 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "int", 2024-09-12T02:49:15.016 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "advanced", 2024-09-12T02:49:15.016 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 0, 2024-09-12T02:49:15.016 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "", 2024-09-12T02:49:15.016 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-09-12T02:49:15.016 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-09-12T02:49:15.016 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [], 2024-09-12T02:49:15.016 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "", 2024-09-12T02:49:15.016 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-09-12T02:49:15.016 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-09-12T02:49:15.016 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-09-12T02:49:15.016 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-09-12T02:49:15.016 INFO:teuthology.orchestra.run.smithi039.stdout: "rwoption3": { 2024-09-12T02:49:15.016 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "rwoption3", 2024-09-12T02:49:15.017 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "float", 2024-09-12T02:49:15.017 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "advanced", 2024-09-12T02:49:15.017 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 0, 2024-09-12T02:49:15.017 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "", 2024-09-12T02:49:15.017 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-09-12T02:49:15.017 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-09-12T02:49:15.017 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [], 2024-09-12T02:49:15.017 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "", 2024-09-12T02:49:15.017 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-09-12T02:49:15.017 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-09-12T02:49:15.017 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-09-12T02:49:15.017 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-09-12T02:49:15.017 INFO:teuthology.orchestra.run.smithi039.stdout: "rwoption4": { 2024-09-12T02:49:15.018 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "rwoption4", 2024-09-12T02:49:15.018 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "str", 2024-09-12T02:49:15.018 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "advanced", 2024-09-12T02:49:15.018 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 0, 2024-09-12T02:49:15.018 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "", 2024-09-12T02:49:15.018 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-09-12T02:49:15.018 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-09-12T02:49:15.018 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [], 2024-09-12T02:49:15.018 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "", 2024-09-12T02:49:15.018 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-09-12T02:49:15.018 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-09-12T02:49:15.018 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-09-12T02:49:15.018 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-09-12T02:49:15.018 INFO:teuthology.orchestra.run.smithi039.stdout: "rwoption5": { 2024-09-12T02:49:15.019 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "rwoption5", 2024-09-12T02:49:15.019 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "bool", 2024-09-12T02:49:15.019 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "advanced", 2024-09-12T02:49:15.019 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 0, 2024-09-12T02:49:15.019 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "", 2024-09-12T02:49:15.019 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-09-12T02:49:15.019 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-09-12T02:49:15.019 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [], 2024-09-12T02:49:15.019 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "", 2024-09-12T02:49:15.019 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-09-12T02:49:15.019 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-09-12T02:49:15.020 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-09-12T02:49:15.020 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-09-12T02:49:15.020 INFO:teuthology.orchestra.run.smithi039.stdout: "rwoption6": { 2024-09-12T02:49:15.020 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "rwoption6", 2024-09-12T02:49:15.020 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "bool", 2024-09-12T02:49:15.020 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "advanced", 2024-09-12T02:49:15.020 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 0, 2024-09-12T02:49:15.020 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "True", 2024-09-12T02:49:15.020 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-09-12T02:49:15.020 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-09-12T02:49:15.020 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [], 2024-09-12T02:49:15.021 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "", 2024-09-12T02:49:15.021 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-09-12T02:49:15.021 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-09-12T02:49:15.021 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-09-12T02:49:15.021 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-09-12T02:49:15.021 INFO:teuthology.orchestra.run.smithi039.stdout: "rwoption7": { 2024-09-12T02:49:15.021 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "rwoption7", 2024-09-12T02:49:15.021 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "int", 2024-09-12T02:49:15.021 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "advanced", 2024-09-12T02:49:15.021 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 0, 2024-09-12T02:49:15.021 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "", 2024-09-12T02:49:15.021 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "1", 2024-09-12T02:49:15.021 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "42", 2024-09-12T02:49:15.022 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [], 2024-09-12T02:49:15.022 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "", 2024-09-12T02:49:15.022 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-09-12T02:49:15.022 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-09-12T02:49:15.022 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-09-12T02:49:15.022 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-09-12T02:49:15.022 INFO:teuthology.orchestra.run.smithi039.stdout: "testkey": { 2024-09-12T02:49:15.022 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "testkey", 2024-09-12T02:49:15.022 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "str", 2024-09-12T02:49:15.022 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "advanced", 2024-09-12T02:49:15.022 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 0, 2024-09-12T02:49:15.022 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "", 2024-09-12T02:49:15.022 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-09-12T02:49:15.023 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-09-12T02:49:15.023 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [], 2024-09-12T02:49:15.023 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "", 2024-09-12T02:49:15.023 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-09-12T02:49:15.023 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-09-12T02:49:15.023 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-09-12T02:49:15.023 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-09-12T02:49:15.023 INFO:teuthology.orchestra.run.smithi039.stdout: "testlkey": { 2024-09-12T02:49:15.023 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "testlkey", 2024-09-12T02:49:15.023 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "str", 2024-09-12T02:49:15.023 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "advanced", 2024-09-12T02:49:15.023 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 0, 2024-09-12T02:49:15.023 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "", 2024-09-12T02:49:15.024 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-09-12T02:49:15.024 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-09-12T02:49:15.024 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [], 2024-09-12T02:49:15.024 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "", 2024-09-12T02:49:15.024 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-09-12T02:49:15.024 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-09-12T02:49:15.024 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-09-12T02:49:15.024 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-09-12T02:49:15.024 INFO:teuthology.orchestra.run.smithi039.stdout: "testnewline": { 2024-09-12T02:49:15.024 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "testnewline", 2024-09-12T02:49:15.024 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "str", 2024-09-12T02:49:15.024 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "advanced", 2024-09-12T02:49:15.024 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 0, 2024-09-12T02:49:15.025 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "", 2024-09-12T02:49:15.025 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-09-12T02:49:15.025 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-09-12T02:49:15.025 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [], 2024-09-12T02:49:15.025 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "", 2024-09-12T02:49:15.025 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-09-12T02:49:15.025 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-09-12T02:49:15.025 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-09-12T02:49:15.025 INFO:teuthology.orchestra.run.smithi039.stdout: } 2024-09-12T02:49:15.025 INFO:teuthology.orchestra.run.smithi039.stdout: } 2024-09-12T02:49:15.025 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-09-12T02:49:15.025 INFO:teuthology.orchestra.run.smithi039.stdout: { 2024-09-12T02:49:15.025 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "snap_schedule", 2024-09-12T02:49:15.026 INFO:teuthology.orchestra.run.smithi039.stdout: "can_run": true, 2024-09-12T02:49:15.026 INFO:teuthology.orchestra.run.smithi039.stdout: "error_string": "", 2024-09-12T02:49:15.026 INFO:teuthology.orchestra.run.smithi039.stdout: "module_options": { 2024-09-12T02:49:15.026 INFO:teuthology.orchestra.run.smithi039.stdout: "allow_m_granularity": { 2024-09-12T02:49:15.026 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "allow_m_granularity", 2024-09-12T02:49:15.026 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "bool", 2024-09-12T02:49:15.026 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "advanced", 2024-09-12T02:49:15.026 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 1, 2024-09-12T02:49:15.026 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "False", 2024-09-12T02:49:15.026 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-09-12T02:49:15.026 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-09-12T02:49:15.026 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [], 2024-09-12T02:49:15.026 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "allow minute scheduled snapshots", 2024-09-12T02:49:15.026 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-09-12T02:49:15.027 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-09-12T02:49:15.027 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-09-12T02:49:15.027 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-09-12T02:49:15.027 INFO:teuthology.orchestra.run.smithi039.stdout: "dump_on_update": { 2024-09-12T02:49:15.027 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "dump_on_update", 2024-09-12T02:49:15.027 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "bool", 2024-09-12T02:49:15.027 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "advanced", 2024-09-12T02:49:15.027 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 1, 2024-09-12T02:49:15.027 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "False", 2024-09-12T02:49:15.027 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-09-12T02:49:15.027 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-09-12T02:49:15.027 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [], 2024-09-12T02:49:15.027 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "dump database to debug log on update", 2024-09-12T02:49:15.028 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-09-12T02:49:15.028 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-09-12T02:49:15.028 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-09-12T02:49:15.028 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-09-12T02:49:15.028 INFO:teuthology.orchestra.run.smithi039.stdout: "log_level": { 2024-09-12T02:49:15.028 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "log_level", 2024-09-12T02:49:15.028 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "str", 2024-09-12T02:49:15.028 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "advanced", 2024-09-12T02:49:15.028 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 1, 2024-09-12T02:49:15.028 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "", 2024-09-12T02:49:15.028 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-09-12T02:49:15.028 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-09-12T02:49:15.028 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [ 2024-09-12T02:49:15.029 INFO:teuthology.orchestra.run.smithi039.stdout: "", 2024-09-12T02:49:15.029 INFO:teuthology.orchestra.run.smithi039.stdout: "critical", 2024-09-12T02:49:15.029 INFO:teuthology.orchestra.run.smithi039.stdout: "debug", 2024-09-12T02:49:15.029 INFO:teuthology.orchestra.run.smithi039.stdout: "error", 2024-09-12T02:49:15.029 INFO:teuthology.orchestra.run.smithi039.stdout: "info", 2024-09-12T02:49:15.029 INFO:teuthology.orchestra.run.smithi039.stdout: "warning" 2024-09-12T02:49:15.029 INFO:teuthology.orchestra.run.smithi039.stdout: ], 2024-09-12T02:49:15.029 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "", 2024-09-12T02:49:15.029 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-09-12T02:49:15.029 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-09-12T02:49:15.029 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-09-12T02:49:15.029 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-09-12T02:49:15.029 INFO:teuthology.orchestra.run.smithi039.stdout: "log_to_cluster": { 2024-09-12T02:49:15.029 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "log_to_cluster", 2024-09-12T02:49:15.030 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "bool", 2024-09-12T02:49:15.030 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "advanced", 2024-09-12T02:49:15.030 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 1, 2024-09-12T02:49:15.030 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "False", 2024-09-12T02:49:15.030 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-09-12T02:49:15.030 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-09-12T02:49:15.030 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [], 2024-09-12T02:49:15.030 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "", 2024-09-12T02:49:15.030 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-09-12T02:49:15.030 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-09-12T02:49:15.030 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-09-12T02:49:15.030 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-09-12T02:49:15.030 INFO:teuthology.orchestra.run.smithi039.stdout: "log_to_cluster_level": { 2024-09-12T02:49:15.030 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "log_to_cluster_level", 2024-09-12T02:49:15.031 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "str", 2024-09-12T02:49:15.031 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "advanced", 2024-09-12T02:49:15.031 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 1, 2024-09-12T02:49:15.031 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "info", 2024-09-12T02:49:15.031 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-09-12T02:49:15.031 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-09-12T02:49:15.031 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [ 2024-09-12T02:49:15.031 INFO:teuthology.orchestra.run.smithi039.stdout: "", 2024-09-12T02:49:15.031 INFO:teuthology.orchestra.run.smithi039.stdout: "critical", 2024-09-12T02:49:15.031 INFO:teuthology.orchestra.run.smithi039.stdout: "debug", 2024-09-12T02:49:15.031 INFO:teuthology.orchestra.run.smithi039.stdout: "error", 2024-09-12T02:49:15.031 INFO:teuthology.orchestra.run.smithi039.stdout: "info", 2024-09-12T02:49:15.031 INFO:teuthology.orchestra.run.smithi039.stdout: "warning" 2024-09-12T02:49:15.032 INFO:teuthology.orchestra.run.smithi039.stdout: ], 2024-09-12T02:49:15.032 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "", 2024-09-12T02:49:15.032 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-09-12T02:49:15.032 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-09-12T02:49:15.032 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-09-12T02:49:15.032 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-09-12T02:49:15.032 INFO:teuthology.orchestra.run.smithi039.stdout: "log_to_file": { 2024-09-12T02:49:15.032 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "log_to_file", 2024-09-12T02:49:15.032 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "bool", 2024-09-12T02:49:15.032 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "advanced", 2024-09-12T02:49:15.032 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 1, 2024-09-12T02:49:15.032 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "False", 2024-09-12T02:49:15.033 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-09-12T02:49:15.033 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-09-12T02:49:15.033 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [], 2024-09-12T02:49:15.033 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "", 2024-09-12T02:49:15.033 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-09-12T02:49:15.033 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-09-12T02:49:15.033 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-09-12T02:49:15.033 INFO:teuthology.orchestra.run.smithi039.stdout: } 2024-09-12T02:49:15.033 INFO:teuthology.orchestra.run.smithi039.stdout: } 2024-09-12T02:49:15.033 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-09-12T02:49:15.033 INFO:teuthology.orchestra.run.smithi039.stdout: { 2024-09-12T02:49:15.033 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "stats", 2024-09-12T02:49:15.034 INFO:teuthology.orchestra.run.smithi039.stdout: "can_run": true, 2024-09-12T02:49:15.034 INFO:teuthology.orchestra.run.smithi039.stdout: "error_string": "", 2024-09-12T02:49:15.034 INFO:teuthology.orchestra.run.smithi039.stdout: "module_options": { 2024-09-12T02:49:15.034 INFO:teuthology.orchestra.run.smithi039.stdout: "log_level": { 2024-09-12T02:49:15.034 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "log_level", 2024-09-12T02:49:15.034 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "str", 2024-09-12T02:49:15.034 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "advanced", 2024-09-12T02:49:15.034 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 1, 2024-09-12T02:49:15.034 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "", 2024-09-12T02:49:15.034 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-09-12T02:49:15.034 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-09-12T02:49:15.034 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [ 2024-09-12T02:49:15.034 INFO:teuthology.orchestra.run.smithi039.stdout: "", 2024-09-12T02:49:15.034 INFO:teuthology.orchestra.run.smithi039.stdout: "critical", 2024-09-12T02:49:15.035 INFO:teuthology.orchestra.run.smithi039.stdout: "debug", 2024-09-12T02:49:15.035 INFO:teuthology.orchestra.run.smithi039.stdout: "error", 2024-09-12T02:49:15.035 INFO:teuthology.orchestra.run.smithi039.stdout: "info", 2024-09-12T02:49:15.035 INFO:teuthology.orchestra.run.smithi039.stdout: "warning" 2024-09-12T02:49:15.035 INFO:teuthology.orchestra.run.smithi039.stdout: ], 2024-09-12T02:49:15.035 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "", 2024-09-12T02:49:15.035 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-09-12T02:49:15.035 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-09-12T02:49:15.035 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-09-12T02:49:15.035 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-09-12T02:49:15.035 INFO:teuthology.orchestra.run.smithi039.stdout: "log_to_cluster": { 2024-09-12T02:49:15.035 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "log_to_cluster", 2024-09-12T02:49:15.035 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "bool", 2024-09-12T02:49:15.036 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "advanced", 2024-09-12T02:49:15.036 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 1, 2024-09-12T02:49:15.036 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "False", 2024-09-12T02:49:15.036 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-09-12T02:49:15.036 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-09-12T02:49:15.036 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [], 2024-09-12T02:49:15.036 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "", 2024-09-12T02:49:15.036 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-09-12T02:49:15.036 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-09-12T02:49:15.036 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-09-12T02:49:15.036 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-09-12T02:49:15.036 INFO:teuthology.orchestra.run.smithi039.stdout: "log_to_cluster_level": { 2024-09-12T02:49:15.036 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "log_to_cluster_level", 2024-09-12T02:49:15.037 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "str", 2024-09-12T02:49:15.037 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "advanced", 2024-09-12T02:49:15.037 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 1, 2024-09-12T02:49:15.037 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "info", 2024-09-12T02:49:15.037 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-09-12T02:49:15.037 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-09-12T02:49:15.037 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [ 2024-09-12T02:49:15.037 INFO:teuthology.orchestra.run.smithi039.stdout: "", 2024-09-12T02:49:15.037 INFO:teuthology.orchestra.run.smithi039.stdout: "critical", 2024-09-12T02:49:15.037 INFO:teuthology.orchestra.run.smithi039.stdout: "debug", 2024-09-12T02:49:15.037 INFO:teuthology.orchestra.run.smithi039.stdout: "error", 2024-09-12T02:49:15.037 INFO:teuthology.orchestra.run.smithi039.stdout: "info", 2024-09-12T02:49:15.037 INFO:teuthology.orchestra.run.smithi039.stdout: "warning" 2024-09-12T02:49:15.038 INFO:teuthology.orchestra.run.smithi039.stdout: ], 2024-09-12T02:49:15.038 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "", 2024-09-12T02:49:15.038 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-09-12T02:49:15.038 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-09-12T02:49:15.038 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-09-12T02:49:15.038 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-09-12T02:49:15.038 INFO:teuthology.orchestra.run.smithi039.stdout: "log_to_file": { 2024-09-12T02:49:15.038 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "log_to_file", 2024-09-12T02:49:15.038 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "bool", 2024-09-12T02:49:15.038 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "advanced", 2024-09-12T02:49:15.038 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 1, 2024-09-12T02:49:15.038 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "False", 2024-09-12T02:49:15.038 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-09-12T02:49:15.038 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-09-12T02:49:15.039 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [], 2024-09-12T02:49:15.039 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "", 2024-09-12T02:49:15.039 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-09-12T02:49:15.039 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-09-12T02:49:15.039 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-09-12T02:49:15.039 INFO:teuthology.orchestra.run.smithi039.stdout: } 2024-09-12T02:49:15.039 INFO:teuthology.orchestra.run.smithi039.stdout: } 2024-09-12T02:49:15.039 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-09-12T02:49:15.039 INFO:teuthology.orchestra.run.smithi039.stdout: { 2024-09-12T02:49:15.039 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "status", 2024-09-12T02:49:15.039 INFO:teuthology.orchestra.run.smithi039.stdout: "can_run": true, 2024-09-12T02:49:15.039 INFO:teuthology.orchestra.run.smithi039.stdout: "error_string": "", 2024-09-12T02:49:15.039 INFO:teuthology.orchestra.run.smithi039.stdout: "module_options": { 2024-09-12T02:49:15.039 INFO:teuthology.orchestra.run.smithi039.stdout: "log_level": { 2024-09-12T02:49:15.040 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "log_level", 2024-09-12T02:49:15.040 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "str", 2024-09-12T02:49:15.040 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "advanced", 2024-09-12T02:49:15.040 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 1, 2024-09-12T02:49:15.040 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "", 2024-09-12T02:49:15.040 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-09-12T02:49:15.040 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-09-12T02:49:15.040 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [ 2024-09-12T02:49:15.040 INFO:teuthology.orchestra.run.smithi039.stdout: "", 2024-09-12T02:49:15.040 INFO:teuthology.orchestra.run.smithi039.stdout: "critical", 2024-09-12T02:49:15.040 INFO:teuthology.orchestra.run.smithi039.stdout: "debug", 2024-09-12T02:49:15.040 INFO:teuthology.orchestra.run.smithi039.stdout: "error", 2024-09-12T02:49:15.040 INFO:teuthology.orchestra.run.smithi039.stdout: "info", 2024-09-12T02:49:15.041 INFO:teuthology.orchestra.run.smithi039.stdout: "warning" 2024-09-12T02:49:15.041 INFO:teuthology.orchestra.run.smithi039.stdout: ], 2024-09-12T02:49:15.041 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "", 2024-09-12T02:49:15.041 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-09-12T02:49:15.041 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-09-12T02:49:15.041 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-09-12T02:49:15.041 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-09-12T02:49:15.041 INFO:teuthology.orchestra.run.smithi039.stdout: "log_to_cluster": { 2024-09-12T02:49:15.041 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "log_to_cluster", 2024-09-12T02:49:15.041 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "bool", 2024-09-12T02:49:15.041 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "advanced", 2024-09-12T02:49:15.041 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 1, 2024-09-12T02:49:15.041 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "False", 2024-09-12T02:49:15.042 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-09-12T02:49:15.042 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-09-12T02:49:15.042 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [], 2024-09-12T02:49:15.042 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "", 2024-09-12T02:49:15.042 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-09-12T02:49:15.042 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-09-12T02:49:15.042 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-09-12T02:49:15.042 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-09-12T02:49:15.042 INFO:teuthology.orchestra.run.smithi039.stdout: "log_to_cluster_level": { 2024-09-12T02:49:15.042 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "log_to_cluster_level", 2024-09-12T02:49:15.042 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "str", 2024-09-12T02:49:15.042 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "advanced", 2024-09-12T02:49:15.042 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 1, 2024-09-12T02:49:15.042 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "info", 2024-09-12T02:49:15.043 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-09-12T02:49:15.043 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-09-12T02:49:15.043 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [ 2024-09-12T02:49:15.043 INFO:teuthology.orchestra.run.smithi039.stdout: "", 2024-09-12T02:49:15.043 INFO:teuthology.orchestra.run.smithi039.stdout: "critical", 2024-09-12T02:49:15.043 INFO:teuthology.orchestra.run.smithi039.stdout: "debug", 2024-09-12T02:49:15.043 INFO:teuthology.orchestra.run.smithi039.stdout: "error", 2024-09-12T02:49:15.043 INFO:teuthology.orchestra.run.smithi039.stdout: "info", 2024-09-12T02:49:15.043 INFO:teuthology.orchestra.run.smithi039.stdout: "warning" 2024-09-12T02:49:15.043 INFO:teuthology.orchestra.run.smithi039.stdout: ], 2024-09-12T02:49:15.043 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "", 2024-09-12T02:49:15.043 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-09-12T02:49:15.043 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-09-12T02:49:15.043 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-09-12T02:49:15.044 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-09-12T02:49:15.044 INFO:teuthology.orchestra.run.smithi039.stdout: "log_to_file": { 2024-09-12T02:49:15.044 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "log_to_file", 2024-09-12T02:49:15.044 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "bool", 2024-09-12T02:49:15.044 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "advanced", 2024-09-12T02:49:15.044 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 1, 2024-09-12T02:49:15.044 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "False", 2024-09-12T02:49:15.044 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-09-12T02:49:15.044 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-09-12T02:49:15.044 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [], 2024-09-12T02:49:15.044 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "", 2024-09-12T02:49:15.044 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-09-12T02:49:15.044 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-09-12T02:49:15.045 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-09-12T02:49:15.045 INFO:teuthology.orchestra.run.smithi039.stdout: } 2024-09-12T02:49:15.045 INFO:teuthology.orchestra.run.smithi039.stdout: } 2024-09-12T02:49:15.045 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-09-12T02:49:15.045 INFO:teuthology.orchestra.run.smithi039.stdout: { 2024-09-12T02:49:15.045 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "telegraf", 2024-09-12T02:49:15.045 INFO:teuthology.orchestra.run.smithi039.stdout: "can_run": true, 2024-09-12T02:49:15.045 INFO:teuthology.orchestra.run.smithi039.stdout: "error_string": "", 2024-09-12T02:49:15.045 INFO:teuthology.orchestra.run.smithi039.stdout: "module_options": { 2024-09-12T02:49:15.045 INFO:teuthology.orchestra.run.smithi039.stdout: "address": { 2024-09-12T02:49:15.045 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "address", 2024-09-12T02:49:15.045 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "str", 2024-09-12T02:49:15.045 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "advanced", 2024-09-12T02:49:15.045 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 0, 2024-09-12T02:49:15.046 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "unixgram:///tmp/telegraf.sock", 2024-09-12T02:49:15.046 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-09-12T02:49:15.046 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-09-12T02:49:15.046 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [], 2024-09-12T02:49:15.046 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "", 2024-09-12T02:49:15.046 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-09-12T02:49:15.046 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-09-12T02:49:15.046 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-09-12T02:49:15.046 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-09-12T02:49:15.046 INFO:teuthology.orchestra.run.smithi039.stdout: "interval": { 2024-09-12T02:49:15.046 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "interval", 2024-09-12T02:49:15.046 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "secs", 2024-09-12T02:49:15.046 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "advanced", 2024-09-12T02:49:15.047 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 0, 2024-09-12T02:49:15.047 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "15", 2024-09-12T02:49:15.047 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-09-12T02:49:15.047 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-09-12T02:49:15.047 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [], 2024-09-12T02:49:15.047 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "", 2024-09-12T02:49:15.047 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-09-12T02:49:15.047 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-09-12T02:49:15.047 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-09-12T02:49:15.047 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-09-12T02:49:15.047 INFO:teuthology.orchestra.run.smithi039.stdout: "log_level": { 2024-09-12T02:49:15.047 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "log_level", 2024-09-12T02:49:15.047 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "str", 2024-09-12T02:49:15.048 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "advanced", 2024-09-12T02:49:15.048 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 1, 2024-09-12T02:49:15.048 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "", 2024-09-12T02:49:15.048 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-09-12T02:49:15.048 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-09-12T02:49:15.048 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [ 2024-09-12T02:49:15.048 INFO:teuthology.orchestra.run.smithi039.stdout: "", 2024-09-12T02:49:15.048 INFO:teuthology.orchestra.run.smithi039.stdout: "critical", 2024-09-12T02:49:15.048 INFO:teuthology.orchestra.run.smithi039.stdout: "debug", 2024-09-12T02:49:15.048 INFO:teuthology.orchestra.run.smithi039.stdout: "error", 2024-09-12T02:49:15.048 INFO:teuthology.orchestra.run.smithi039.stdout: "info", 2024-09-12T02:49:15.048 INFO:teuthology.orchestra.run.smithi039.stdout: "warning" 2024-09-12T02:49:15.048 INFO:teuthology.orchestra.run.smithi039.stdout: ], 2024-09-12T02:49:15.049 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "", 2024-09-12T02:49:15.049 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-09-12T02:49:15.049 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-09-12T02:49:15.049 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-09-12T02:49:15.049 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-09-12T02:49:15.049 INFO:teuthology.orchestra.run.smithi039.stdout: "log_to_cluster": { 2024-09-12T02:49:15.049 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "log_to_cluster", 2024-09-12T02:49:15.049 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "bool", 2024-09-12T02:49:15.049 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "advanced", 2024-09-12T02:49:15.049 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 1, 2024-09-12T02:49:15.049 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "False", 2024-09-12T02:49:15.049 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-09-12T02:49:15.049 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-09-12T02:49:15.050 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [], 2024-09-12T02:49:15.050 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "", 2024-09-12T02:49:15.050 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-09-12T02:49:15.050 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-09-12T02:49:15.050 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-09-12T02:49:15.050 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-09-12T02:49:15.050 INFO:teuthology.orchestra.run.smithi039.stdout: "log_to_cluster_level": { 2024-09-12T02:49:15.050 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "log_to_cluster_level", 2024-09-12T02:49:15.050 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "str", 2024-09-12T02:49:15.050 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "advanced", 2024-09-12T02:49:15.050 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 1, 2024-09-12T02:49:15.050 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "info", 2024-09-12T02:49:15.050 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-09-12T02:49:15.050 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-09-12T02:49:15.051 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [ 2024-09-12T02:49:15.051 INFO:teuthology.orchestra.run.smithi039.stdout: "", 2024-09-12T02:49:15.051 INFO:teuthology.orchestra.run.smithi039.stdout: "critical", 2024-09-12T02:49:15.051 INFO:teuthology.orchestra.run.smithi039.stdout: "debug", 2024-09-12T02:49:15.051 INFO:teuthology.orchestra.run.smithi039.stdout: "error", 2024-09-12T02:49:15.051 INFO:teuthology.orchestra.run.smithi039.stdout: "info", 2024-09-12T02:49:15.051 INFO:teuthology.orchestra.run.smithi039.stdout: "warning" 2024-09-12T02:49:15.051 INFO:teuthology.orchestra.run.smithi039.stdout: ], 2024-09-12T02:49:15.051 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "", 2024-09-12T02:49:15.051 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-09-12T02:49:15.051 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-09-12T02:49:15.051 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-09-12T02:49:15.051 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-09-12T02:49:15.051 INFO:teuthology.orchestra.run.smithi039.stdout: "log_to_file": { 2024-09-12T02:49:15.052 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "log_to_file", 2024-09-12T02:49:15.052 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "bool", 2024-09-12T02:49:15.052 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "advanced", 2024-09-12T02:49:15.052 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 1, 2024-09-12T02:49:15.052 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "False", 2024-09-12T02:49:15.052 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-09-12T02:49:15.052 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-09-12T02:49:15.052 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [], 2024-09-12T02:49:15.052 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "", 2024-09-12T02:49:15.052 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-09-12T02:49:15.052 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-09-12T02:49:15.052 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-09-12T02:49:15.052 INFO:teuthology.orchestra.run.smithi039.stdout: } 2024-09-12T02:49:15.053 INFO:teuthology.orchestra.run.smithi039.stdout: } 2024-09-12T02:49:15.053 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-09-12T02:49:15.053 INFO:teuthology.orchestra.run.smithi039.stdout: { 2024-09-12T02:49:15.053 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "telemetry", 2024-09-12T02:49:15.053 INFO:teuthology.orchestra.run.smithi039.stdout: "can_run": true, 2024-09-12T02:49:15.053 INFO:teuthology.orchestra.run.smithi039.stdout: "error_string": "", 2024-09-12T02:49:15.053 INFO:teuthology.orchestra.run.smithi039.stdout: "module_options": { 2024-09-12T02:49:15.053 INFO:teuthology.orchestra.run.smithi039.stdout: "channel_basic": { 2024-09-12T02:49:15.053 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "channel_basic", 2024-09-12T02:49:15.053 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "bool", 2024-09-12T02:49:15.053 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "advanced", 2024-09-12T02:49:15.053 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 0, 2024-09-12T02:49:15.053 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "True", 2024-09-12T02:49:15.054 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-09-12T02:49:15.054 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-09-12T02:49:15.054 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [], 2024-09-12T02:49:15.054 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "Share basic cluster information (size, version)", 2024-09-12T02:49:15.054 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-09-12T02:49:15.054 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-09-12T02:49:15.054 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-09-12T02:49:15.054 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-09-12T02:49:15.054 INFO:teuthology.orchestra.run.smithi039.stdout: "channel_crash": { 2024-09-12T02:49:15.054 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "channel_crash", 2024-09-12T02:49:15.054 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "bool", 2024-09-12T02:49:15.054 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "advanced", 2024-09-12T02:49:15.054 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 0, 2024-09-12T02:49:15.054 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "True", 2024-09-12T02:49:15.055 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-09-12T02:49:15.055 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-09-12T02:49:15.055 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [], 2024-09-12T02:49:15.055 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "Share metadata about Ceph daemon crashes (version, stack straces, etc)", 2024-09-12T02:49:15.055 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-09-12T02:49:15.055 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-09-12T02:49:15.055 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-09-12T02:49:15.055 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-09-12T02:49:15.055 INFO:teuthology.orchestra.run.smithi039.stdout: "channel_device": { 2024-09-12T02:49:15.055 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "channel_device", 2024-09-12T02:49:15.055 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "bool", 2024-09-12T02:49:15.055 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "advanced", 2024-09-12T02:49:15.055 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 0, 2024-09-12T02:49:15.055 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "True", 2024-09-12T02:49:15.056 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-09-12T02:49:15.056 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-09-12T02:49:15.056 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [], 2024-09-12T02:49:15.056 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "Share device health metrics (e.g., SMART data, minus potentially identifying info like serial numbers)", 2024-09-12T02:49:15.056 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-09-12T02:49:15.056 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-09-12T02:49:15.056 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-09-12T02:49:15.056 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-09-12T02:49:15.056 INFO:teuthology.orchestra.run.smithi039.stdout: "channel_ident": { 2024-09-12T02:49:15.056 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "channel_ident", 2024-09-12T02:49:15.056 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "bool", 2024-09-12T02:49:15.056 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "advanced", 2024-09-12T02:49:15.056 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 0, 2024-09-12T02:49:15.057 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "False", 2024-09-12T02:49:15.057 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-09-12T02:49:15.057 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-09-12T02:49:15.057 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [], 2024-09-12T02:49:15.057 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "Share a user-provided description and/or contact email for the cluster", 2024-09-12T02:49:15.057 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-09-12T02:49:15.057 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-09-12T02:49:15.057 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-09-12T02:49:15.057 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-09-12T02:49:15.057 INFO:teuthology.orchestra.run.smithi039.stdout: "channel_perf": { 2024-09-12T02:49:15.057 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "channel_perf", 2024-09-12T02:49:15.057 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "bool", 2024-09-12T02:49:15.057 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "advanced", 2024-09-12T02:49:15.057 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 0, 2024-09-12T02:49:15.058 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "False", 2024-09-12T02:49:15.058 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-09-12T02:49:15.058 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-09-12T02:49:15.058 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [], 2024-09-12T02:49:15.058 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "Share various performance metrics of a cluster", 2024-09-12T02:49:15.058 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-09-12T02:49:15.058 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-09-12T02:49:15.058 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-09-12T02:49:15.058 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-09-12T02:49:15.058 INFO:teuthology.orchestra.run.smithi039.stdout: "contact": { 2024-09-12T02:49:15.058 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "contact", 2024-09-12T02:49:15.058 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "str", 2024-09-12T02:49:15.058 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "advanced", 2024-09-12T02:49:15.059 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 0, 2024-09-12T02:49:15.059 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "", 2024-09-12T02:49:15.059 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-09-12T02:49:15.059 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-09-12T02:49:15.059 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [], 2024-09-12T02:49:15.059 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "", 2024-09-12T02:49:15.059 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-09-12T02:49:15.059 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-09-12T02:49:15.059 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-09-12T02:49:15.059 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-09-12T02:49:15.059 INFO:teuthology.orchestra.run.smithi039.stdout: "description": { 2024-09-12T02:49:15.059 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "description", 2024-09-12T02:49:15.059 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "str", 2024-09-12T02:49:15.060 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "advanced", 2024-09-12T02:49:15.060 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 0, 2024-09-12T02:49:15.060 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "", 2024-09-12T02:49:15.060 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-09-12T02:49:15.060 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-09-12T02:49:15.060 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [], 2024-09-12T02:49:15.060 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "", 2024-09-12T02:49:15.060 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-09-12T02:49:15.060 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-09-12T02:49:15.060 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-09-12T02:49:15.060 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-09-12T02:49:15.060 INFO:teuthology.orchestra.run.smithi039.stdout: "device_url": { 2024-09-12T02:49:15.060 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "device_url", 2024-09-12T02:49:15.061 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "str", 2024-09-12T02:49:15.061 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "advanced", 2024-09-12T02:49:15.061 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 0, 2024-09-12T02:49:15.061 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "https://telemetry.ceph.com/device", 2024-09-12T02:49:15.061 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-09-12T02:49:15.061 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-09-12T02:49:15.061 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [], 2024-09-12T02:49:15.061 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "", 2024-09-12T02:49:15.061 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-09-12T02:49:15.061 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-09-12T02:49:15.061 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-09-12T02:49:15.061 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-09-12T02:49:15.061 INFO:teuthology.orchestra.run.smithi039.stdout: "enabled": { 2024-09-12T02:49:15.062 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "enabled", 2024-09-12T02:49:15.062 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "bool", 2024-09-12T02:49:15.062 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "advanced", 2024-09-12T02:49:15.062 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 0, 2024-09-12T02:49:15.062 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "False", 2024-09-12T02:49:15.062 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-09-12T02:49:15.062 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-09-12T02:49:15.062 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [], 2024-09-12T02:49:15.062 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "", 2024-09-12T02:49:15.062 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-09-12T02:49:15.062 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-09-12T02:49:15.062 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-09-12T02:49:15.062 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-09-12T02:49:15.063 INFO:teuthology.orchestra.run.smithi039.stdout: "interval": { 2024-09-12T02:49:15.063 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "interval", 2024-09-12T02:49:15.063 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "int", 2024-09-12T02:49:15.063 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "advanced", 2024-09-12T02:49:15.063 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 0, 2024-09-12T02:49:15.063 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "24", 2024-09-12T02:49:15.063 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "8", 2024-09-12T02:49:15.063 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-09-12T02:49:15.063 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [], 2024-09-12T02:49:15.063 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "", 2024-09-12T02:49:15.063 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-09-12T02:49:15.063 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-09-12T02:49:15.063 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-09-12T02:49:15.063 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-09-12T02:49:15.064 INFO:teuthology.orchestra.run.smithi039.stdout: "last_opt_revision": { 2024-09-12T02:49:15.064 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "last_opt_revision", 2024-09-12T02:49:15.064 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "int", 2024-09-12T02:49:15.064 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "advanced", 2024-09-12T02:49:15.064 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 0, 2024-09-12T02:49:15.064 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "1", 2024-09-12T02:49:15.064 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-09-12T02:49:15.064 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-09-12T02:49:15.064 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [], 2024-09-12T02:49:15.064 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "", 2024-09-12T02:49:15.064 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-09-12T02:49:15.064 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-09-12T02:49:15.064 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-09-12T02:49:15.065 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-09-12T02:49:15.065 INFO:teuthology.orchestra.run.smithi039.stdout: "leaderboard": { 2024-09-12T02:49:15.065 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "leaderboard", 2024-09-12T02:49:15.065 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "bool", 2024-09-12T02:49:15.065 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "advanced", 2024-09-12T02:49:15.065 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 0, 2024-09-12T02:49:15.065 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "False", 2024-09-12T02:49:15.065 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-09-12T02:49:15.065 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-09-12T02:49:15.065 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [], 2024-09-12T02:49:15.065 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "", 2024-09-12T02:49:15.065 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-09-12T02:49:15.065 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-09-12T02:49:15.066 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-09-12T02:49:15.066 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-09-12T02:49:15.066 INFO:teuthology.orchestra.run.smithi039.stdout: "leaderboard_description": { 2024-09-12T02:49:15.066 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "leaderboard_description", 2024-09-12T02:49:15.066 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "str", 2024-09-12T02:49:15.066 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "advanced", 2024-09-12T02:49:15.066 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 0, 2024-09-12T02:49:15.066 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "", 2024-09-12T02:49:15.066 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-09-12T02:49:15.066 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-09-12T02:49:15.066 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [], 2024-09-12T02:49:15.066 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "", 2024-09-12T02:49:15.066 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-09-12T02:49:15.066 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-09-12T02:49:15.067 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-09-12T02:49:15.067 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-09-12T02:49:15.067 INFO:teuthology.orchestra.run.smithi039.stdout: "log_level": { 2024-09-12T02:49:15.067 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "log_level", 2024-09-12T02:49:15.067 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "str", 2024-09-12T02:49:15.067 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "advanced", 2024-09-12T02:49:15.067 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 1, 2024-09-12T02:49:15.067 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "", 2024-09-12T02:49:15.067 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-09-12T02:49:15.067 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-09-12T02:49:15.067 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [ 2024-09-12T02:49:15.067 INFO:teuthology.orchestra.run.smithi039.stdout: "", 2024-09-12T02:49:15.067 INFO:teuthology.orchestra.run.smithi039.stdout: "critical", 2024-09-12T02:49:15.067 INFO:teuthology.orchestra.run.smithi039.stdout: "debug", 2024-09-12T02:49:15.068 INFO:teuthology.orchestra.run.smithi039.stdout: "error", 2024-09-12T02:49:15.068 INFO:teuthology.orchestra.run.smithi039.stdout: "info", 2024-09-12T02:49:15.068 INFO:teuthology.orchestra.run.smithi039.stdout: "warning" 2024-09-12T02:49:15.068 INFO:teuthology.orchestra.run.smithi039.stdout: ], 2024-09-12T02:49:15.068 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "", 2024-09-12T02:49:15.068 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-09-12T02:49:15.068 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-09-12T02:49:15.068 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-09-12T02:49:15.068 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-09-12T02:49:15.068 INFO:teuthology.orchestra.run.smithi039.stdout: "log_to_cluster": { 2024-09-12T02:49:15.068 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "log_to_cluster", 2024-09-12T02:49:15.068 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "bool", 2024-09-12T02:49:15.068 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "advanced", 2024-09-12T02:49:15.069 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 1, 2024-09-12T02:49:15.069 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "False", 2024-09-12T02:49:15.069 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-09-12T02:49:15.069 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-09-12T02:49:15.069 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [], 2024-09-12T02:49:15.069 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "", 2024-09-12T02:49:15.069 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-09-12T02:49:15.069 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-09-12T02:49:15.069 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-09-12T02:49:15.069 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-09-12T02:49:15.069 INFO:teuthology.orchestra.run.smithi039.stdout: "log_to_cluster_level": { 2024-09-12T02:49:15.069 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "log_to_cluster_level", 2024-09-12T02:49:15.069 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "str", 2024-09-12T02:49:15.069 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "advanced", 2024-09-12T02:49:15.070 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 1, 2024-09-12T02:49:15.070 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "info", 2024-09-12T02:49:15.070 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-09-12T02:49:15.070 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-09-12T02:49:15.070 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [ 2024-09-12T02:49:15.070 INFO:teuthology.orchestra.run.smithi039.stdout: "", 2024-09-12T02:49:15.070 INFO:teuthology.orchestra.run.smithi039.stdout: "critical", 2024-09-12T02:49:15.070 INFO:teuthology.orchestra.run.smithi039.stdout: "debug", 2024-09-12T02:49:15.070 INFO:teuthology.orchestra.run.smithi039.stdout: "error", 2024-09-12T02:49:15.070 INFO:teuthology.orchestra.run.smithi039.stdout: "info", 2024-09-12T02:49:15.070 INFO:teuthology.orchestra.run.smithi039.stdout: "warning" 2024-09-12T02:49:15.070 INFO:teuthology.orchestra.run.smithi039.stdout: ], 2024-09-12T02:49:15.070 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "", 2024-09-12T02:49:15.071 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-09-12T02:49:15.071 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-09-12T02:49:15.071 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-09-12T02:49:15.071 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-09-12T02:49:15.071 INFO:teuthology.orchestra.run.smithi039.stdout: "log_to_file": { 2024-09-12T02:49:15.071 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "log_to_file", 2024-09-12T02:49:15.071 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "bool", 2024-09-12T02:49:15.071 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "advanced", 2024-09-12T02:49:15.071 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 1, 2024-09-12T02:49:15.071 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "False", 2024-09-12T02:49:15.071 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-09-12T02:49:15.071 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-09-12T02:49:15.071 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [], 2024-09-12T02:49:15.071 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "", 2024-09-12T02:49:15.072 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-09-12T02:49:15.072 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-09-12T02:49:15.072 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-09-12T02:49:15.072 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-09-12T02:49:15.072 INFO:teuthology.orchestra.run.smithi039.stdout: "organization": { 2024-09-12T02:49:15.072 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "organization", 2024-09-12T02:49:15.072 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "str", 2024-09-12T02:49:15.072 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "advanced", 2024-09-12T02:49:15.072 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 0, 2024-09-12T02:49:15.072 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "", 2024-09-12T02:49:15.072 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-09-12T02:49:15.072 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-09-12T02:49:15.072 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [], 2024-09-12T02:49:15.073 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "", 2024-09-12T02:49:15.073 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-09-12T02:49:15.073 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-09-12T02:49:15.073 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-09-12T02:49:15.073 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-09-12T02:49:15.073 INFO:teuthology.orchestra.run.smithi039.stdout: "proxy": { 2024-09-12T02:49:15.073 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "proxy", 2024-09-12T02:49:15.073 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "str", 2024-09-12T02:49:15.073 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "advanced", 2024-09-12T02:49:15.073 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 0, 2024-09-12T02:49:15.073 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "", 2024-09-12T02:49:15.073 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-09-12T02:49:15.073 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-09-12T02:49:15.073 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [], 2024-09-12T02:49:15.074 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "", 2024-09-12T02:49:15.074 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-09-12T02:49:15.074 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-09-12T02:49:15.074 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-09-12T02:49:15.074 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-09-12T02:49:15.074 INFO:teuthology.orchestra.run.smithi039.stdout: "url": { 2024-09-12T02:49:15.074 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "url", 2024-09-12T02:49:15.074 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "str", 2024-09-12T02:49:15.074 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "advanced", 2024-09-12T02:49:15.074 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 0, 2024-09-12T02:49:15.074 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "https://telemetry.ceph.com/report", 2024-09-12T02:49:15.074 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-09-12T02:49:15.075 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-09-12T02:49:15.075 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [], 2024-09-12T02:49:15.075 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "", 2024-09-12T02:49:15.075 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-09-12T02:49:15.075 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-09-12T02:49:15.075 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-09-12T02:49:15.075 INFO:teuthology.orchestra.run.smithi039.stdout: } 2024-09-12T02:49:15.075 INFO:teuthology.orchestra.run.smithi039.stdout: } 2024-09-12T02:49:15.075 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-09-12T02:49:15.075 INFO:teuthology.orchestra.run.smithi039.stdout: { 2024-09-12T02:49:15.075 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "test_orchestrator", 2024-09-12T02:49:15.075 INFO:teuthology.orchestra.run.smithi039.stdout: "can_run": true, 2024-09-12T02:49:15.075 INFO:teuthology.orchestra.run.smithi039.stdout: "error_string": "", 2024-09-12T02:49:15.076 INFO:teuthology.orchestra.run.smithi039.stdout: "module_options": { 2024-09-12T02:49:15.076 INFO:teuthology.orchestra.run.smithi039.stdout: "log_level": { 2024-09-12T02:49:15.076 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "log_level", 2024-09-12T02:49:15.076 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "str", 2024-09-12T02:49:15.076 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "advanced", 2024-09-12T02:49:15.076 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 1, 2024-09-12T02:49:15.076 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "", 2024-09-12T02:49:15.076 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-09-12T02:49:15.076 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-09-12T02:49:15.076 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [ 2024-09-12T02:49:15.076 INFO:teuthology.orchestra.run.smithi039.stdout: "", 2024-09-12T02:49:15.076 INFO:teuthology.orchestra.run.smithi039.stdout: "critical", 2024-09-12T02:49:15.076 INFO:teuthology.orchestra.run.smithi039.stdout: "debug", 2024-09-12T02:49:15.077 INFO:teuthology.orchestra.run.smithi039.stdout: "error", 2024-09-12T02:49:15.077 INFO:teuthology.orchestra.run.smithi039.stdout: "info", 2024-09-12T02:49:15.077 INFO:teuthology.orchestra.run.smithi039.stdout: "warning" 2024-09-12T02:49:15.077 INFO:teuthology.orchestra.run.smithi039.stdout: ], 2024-09-12T02:49:15.077 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "", 2024-09-12T02:49:15.077 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-09-12T02:49:15.077 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-09-12T02:49:15.077 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-09-12T02:49:15.077 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-09-12T02:49:15.077 INFO:teuthology.orchestra.run.smithi039.stdout: "log_to_cluster": { 2024-09-12T02:49:15.077 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "log_to_cluster", 2024-09-12T02:49:15.077 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "bool", 2024-09-12T02:49:15.077 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "advanced", 2024-09-12T02:49:15.078 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 1, 2024-09-12T02:49:15.078 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "False", 2024-09-12T02:49:15.078 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-09-12T02:49:15.078 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-09-12T02:49:15.078 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [], 2024-09-12T02:49:15.078 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "", 2024-09-12T02:49:15.078 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-09-12T02:49:15.078 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-09-12T02:49:15.078 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-09-12T02:49:15.078 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-09-12T02:49:15.078 INFO:teuthology.orchestra.run.smithi039.stdout: "log_to_cluster_level": { 2024-09-12T02:49:15.078 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "log_to_cluster_level", 2024-09-12T02:49:15.078 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "str", 2024-09-12T02:49:15.079 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "advanced", 2024-09-12T02:49:15.079 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 1, 2024-09-12T02:49:15.079 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "info", 2024-09-12T02:49:15.079 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-09-12T02:49:15.079 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-09-12T02:49:15.079 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [ 2024-09-12T02:49:15.079 INFO:teuthology.orchestra.run.smithi039.stdout: "", 2024-09-12T02:49:15.079 INFO:teuthology.orchestra.run.smithi039.stdout: "critical", 2024-09-12T02:49:15.079 INFO:teuthology.orchestra.run.smithi039.stdout: "debug", 2024-09-12T02:49:15.079 INFO:teuthology.orchestra.run.smithi039.stdout: "error", 2024-09-12T02:49:15.079 INFO:teuthology.orchestra.run.smithi039.stdout: "info", 2024-09-12T02:49:15.079 INFO:teuthology.orchestra.run.smithi039.stdout: "warning" 2024-09-12T02:49:15.079 INFO:teuthology.orchestra.run.smithi039.stdout: ], 2024-09-12T02:49:15.079 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "", 2024-09-12T02:49:15.080 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-09-12T02:49:15.080 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-09-12T02:49:15.080 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-09-12T02:49:15.080 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-09-12T02:49:15.080 INFO:teuthology.orchestra.run.smithi039.stdout: "log_to_file": { 2024-09-12T02:49:15.080 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "log_to_file", 2024-09-12T02:49:15.080 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "bool", 2024-09-12T02:49:15.080 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "advanced", 2024-09-12T02:49:15.080 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 1, 2024-09-12T02:49:15.080 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "False", 2024-09-12T02:49:15.080 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-09-12T02:49:15.080 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-09-12T02:49:15.080 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [], 2024-09-12T02:49:15.081 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "", 2024-09-12T02:49:15.081 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-09-12T02:49:15.081 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-09-12T02:49:15.081 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-09-12T02:49:15.081 INFO:teuthology.orchestra.run.smithi039.stdout: } 2024-09-12T02:49:15.081 INFO:teuthology.orchestra.run.smithi039.stdout: } 2024-09-12T02:49:15.081 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-09-12T02:49:15.081 INFO:teuthology.orchestra.run.smithi039.stdout: { 2024-09-12T02:49:15.081 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "volumes", 2024-09-12T02:49:15.081 INFO:teuthology.orchestra.run.smithi039.stdout: "can_run": true, 2024-09-12T02:49:15.081 INFO:teuthology.orchestra.run.smithi039.stdout: "error_string": "", 2024-09-12T02:49:15.081 INFO:teuthology.orchestra.run.smithi039.stdout: "module_options": { 2024-09-12T02:49:15.081 INFO:teuthology.orchestra.run.smithi039.stdout: "log_level": { 2024-09-12T02:49:15.081 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "log_level", 2024-09-12T02:49:15.082 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "str", 2024-09-12T02:49:15.082 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "advanced", 2024-09-12T02:49:15.082 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 1, 2024-09-12T02:49:15.082 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "", 2024-09-12T02:49:15.082 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-09-12T02:49:15.082 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-09-12T02:49:15.082 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [ 2024-09-12T02:49:15.082 INFO:teuthology.orchestra.run.smithi039.stdout: "", 2024-09-12T02:49:15.082 INFO:teuthology.orchestra.run.smithi039.stdout: "critical", 2024-09-12T02:49:15.082 INFO:teuthology.orchestra.run.smithi039.stdout: "debug", 2024-09-12T02:49:15.082 INFO:teuthology.orchestra.run.smithi039.stdout: "error", 2024-09-12T02:49:15.082 INFO:teuthology.orchestra.run.smithi039.stdout: "info", 2024-09-12T02:49:15.082 INFO:teuthology.orchestra.run.smithi039.stdout: "warning" 2024-09-12T02:49:15.082 INFO:teuthology.orchestra.run.smithi039.stdout: ], 2024-09-12T02:49:15.083 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "", 2024-09-12T02:49:15.083 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-09-12T02:49:15.083 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-09-12T02:49:15.083 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-09-12T02:49:15.083 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-09-12T02:49:15.083 INFO:teuthology.orchestra.run.smithi039.stdout: "log_to_cluster": { 2024-09-12T02:49:15.083 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "log_to_cluster", 2024-09-12T02:49:15.083 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "bool", 2024-09-12T02:49:15.083 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "advanced", 2024-09-12T02:49:15.083 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 1, 2024-09-12T02:49:15.083 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "False", 2024-09-12T02:49:15.083 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-09-12T02:49:15.083 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-09-12T02:49:15.084 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [], 2024-09-12T02:49:15.084 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "", 2024-09-12T02:49:15.084 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-09-12T02:49:15.084 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-09-12T02:49:15.084 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-09-12T02:49:15.084 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-09-12T02:49:15.084 INFO:teuthology.orchestra.run.smithi039.stdout: "log_to_cluster_level": { 2024-09-12T02:49:15.084 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "log_to_cluster_level", 2024-09-12T02:49:15.084 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "str", 2024-09-12T02:49:15.084 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "advanced", 2024-09-12T02:49:15.084 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 1, 2024-09-12T02:49:15.084 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "info", 2024-09-12T02:49:15.084 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-09-12T02:49:15.084 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-09-12T02:49:15.085 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [ 2024-09-12T02:49:15.085 INFO:teuthology.orchestra.run.smithi039.stdout: "", 2024-09-12T02:49:15.085 INFO:teuthology.orchestra.run.smithi039.stdout: "critical", 2024-09-12T02:49:15.085 INFO:teuthology.orchestra.run.smithi039.stdout: "debug", 2024-09-12T02:49:15.085 INFO:teuthology.orchestra.run.smithi039.stdout: "error", 2024-09-12T02:49:15.085 INFO:teuthology.orchestra.run.smithi039.stdout: "info", 2024-09-12T02:49:15.085 INFO:teuthology.orchestra.run.smithi039.stdout: "warning" 2024-09-12T02:49:15.085 INFO:teuthology.orchestra.run.smithi039.stdout: ], 2024-09-12T02:49:15.085 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "", 2024-09-12T02:49:15.085 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-09-12T02:49:15.085 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-09-12T02:49:15.085 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-09-12T02:49:15.085 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-09-12T02:49:15.085 INFO:teuthology.orchestra.run.smithi039.stdout: "log_to_file": { 2024-09-12T02:49:15.086 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "log_to_file", 2024-09-12T02:49:15.086 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "bool", 2024-09-12T02:49:15.086 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "advanced", 2024-09-12T02:49:15.086 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 1, 2024-09-12T02:49:15.086 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "False", 2024-09-12T02:49:15.086 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-09-12T02:49:15.086 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-09-12T02:49:15.086 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [], 2024-09-12T02:49:15.086 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "", 2024-09-12T02:49:15.086 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-09-12T02:49:15.086 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-09-12T02:49:15.086 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-09-12T02:49:15.086 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-09-12T02:49:15.086 INFO:teuthology.orchestra.run.smithi039.stdout: "max_concurrent_clones": { 2024-09-12T02:49:15.087 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "max_concurrent_clones", 2024-09-12T02:49:15.087 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "int", 2024-09-12T02:49:15.087 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "advanced", 2024-09-12T02:49:15.087 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 0, 2024-09-12T02:49:15.087 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "4", 2024-09-12T02:49:15.087 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-09-12T02:49:15.087 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-09-12T02:49:15.087 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [], 2024-09-12T02:49:15.087 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "Number of asynchronous cloner threads", 2024-09-12T02:49:15.087 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-09-12T02:49:15.087 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-09-12T02:49:15.087 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-09-12T02:49:15.087 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-09-12T02:49:15.088 INFO:teuthology.orchestra.run.smithi039.stdout: "periodic_async_work": { 2024-09-12T02:49:15.088 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "periodic_async_work", 2024-09-12T02:49:15.088 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "bool", 2024-09-12T02:49:15.088 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "advanced", 2024-09-12T02:49:15.088 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 0, 2024-09-12T02:49:15.088 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "False", 2024-09-12T02:49:15.088 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-09-12T02:49:15.088 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-09-12T02:49:15.088 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [], 2024-09-12T02:49:15.088 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "Periodically check for async work", 2024-09-12T02:49:15.088 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-09-12T02:49:15.088 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-09-12T02:49:15.088 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-09-12T02:49:15.088 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-09-12T02:49:15.089 INFO:teuthology.orchestra.run.smithi039.stdout: "snapshot_clone_delay": { 2024-09-12T02:49:15.089 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "snapshot_clone_delay", 2024-09-12T02:49:15.089 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "int", 2024-09-12T02:49:15.089 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "advanced", 2024-09-12T02:49:15.089 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 0, 2024-09-12T02:49:15.089 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "0", 2024-09-12T02:49:15.089 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-09-12T02:49:15.089 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-09-12T02:49:15.089 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [], 2024-09-12T02:49:15.092 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "Delay clone begin operation by snapshot_clone_delay seconds", 2024-09-12T02:49:15.092 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-09-12T02:49:15.092 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-09-12T02:49:15.092 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-09-12T02:49:15.093 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-09-12T02:49:15.093 INFO:teuthology.orchestra.run.smithi039.stdout: "snapshot_clone_no_wait": { 2024-09-12T02:49:15.093 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "snapshot_clone_no_wait", 2024-09-12T02:49:15.093 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "bool", 2024-09-12T02:49:15.093 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "advanced", 2024-09-12T02:49:15.093 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 0, 2024-09-12T02:49:15.093 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "True", 2024-09-12T02:49:15.093 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-09-12T02:49:15.093 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-09-12T02:49:15.093 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [], 2024-09-12T02:49:15.093 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "Reject subvolume clone request when cloner threads are busy", 2024-09-12T02:49:15.093 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-09-12T02:49:15.093 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-09-12T02:49:15.094 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-09-12T02:49:15.094 INFO:teuthology.orchestra.run.smithi039.stdout: } 2024-09-12T02:49:15.094 INFO:teuthology.orchestra.run.smithi039.stdout: } 2024-09-12T02:49:15.094 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-09-12T02:49:15.094 INFO:teuthology.orchestra.run.smithi039.stdout: { 2024-09-12T02:49:15.094 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "zabbix", 2024-09-12T02:49:15.094 INFO:teuthology.orchestra.run.smithi039.stdout: "can_run": true, 2024-09-12T02:49:15.094 INFO:teuthology.orchestra.run.smithi039.stdout: "error_string": "", 2024-09-12T02:49:15.094 INFO:teuthology.orchestra.run.smithi039.stdout: "module_options": { 2024-09-12T02:49:15.094 INFO:teuthology.orchestra.run.smithi039.stdout: "discovery_interval": { 2024-09-12T02:49:15.094 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "discovery_interval", 2024-09-12T02:49:15.094 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "uint", 2024-09-12T02:49:15.094 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "advanced", 2024-09-12T02:49:15.095 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 0, 2024-09-12T02:49:15.095 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "100", 2024-09-12T02:49:15.095 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-09-12T02:49:15.095 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-09-12T02:49:15.095 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [], 2024-09-12T02:49:15.095 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "", 2024-09-12T02:49:15.095 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-09-12T02:49:15.095 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-09-12T02:49:15.095 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-09-12T02:49:15.095 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-09-12T02:49:15.095 INFO:teuthology.orchestra.run.smithi039.stdout: "identifier": { 2024-09-12T02:49:15.095 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "identifier", 2024-09-12T02:49:15.095 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "str", 2024-09-12T02:49:15.096 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "advanced", 2024-09-12T02:49:15.096 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 0, 2024-09-12T02:49:15.096 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "", 2024-09-12T02:49:15.096 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-09-12T02:49:15.096 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-09-12T02:49:15.096 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [], 2024-09-12T02:49:15.096 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "", 2024-09-12T02:49:15.096 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-09-12T02:49:15.096 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-09-12T02:49:15.096 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-09-12T02:49:15.096 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-09-12T02:49:15.096 INFO:teuthology.orchestra.run.smithi039.stdout: "interval": { 2024-09-12T02:49:15.096 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "interval", 2024-09-12T02:49:15.097 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "secs", 2024-09-12T02:49:15.097 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "advanced", 2024-09-12T02:49:15.097 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 0, 2024-09-12T02:49:15.097 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "60", 2024-09-12T02:49:15.097 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-09-12T02:49:15.097 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-09-12T02:49:15.097 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [], 2024-09-12T02:49:15.097 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "", 2024-09-12T02:49:15.097 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-09-12T02:49:15.097 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-09-12T02:49:15.097 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-09-12T02:49:15.097 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-09-12T02:49:15.097 INFO:teuthology.orchestra.run.smithi039.stdout: "log_level": { 2024-09-12T02:49:15.097 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "log_level", 2024-09-12T02:49:15.098 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "str", 2024-09-12T02:49:15.098 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "advanced", 2024-09-12T02:49:15.098 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 1, 2024-09-12T02:49:15.098 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "", 2024-09-12T02:49:15.098 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-09-12T02:49:15.098 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-09-12T02:49:15.098 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [ 2024-09-12T02:49:15.098 INFO:teuthology.orchestra.run.smithi039.stdout: "", 2024-09-12T02:49:15.098 INFO:teuthology.orchestra.run.smithi039.stdout: "critical", 2024-09-12T02:49:15.098 INFO:teuthology.orchestra.run.smithi039.stdout: "debug", 2024-09-12T02:49:15.098 INFO:teuthology.orchestra.run.smithi039.stdout: "error", 2024-09-12T02:49:15.098 INFO:teuthology.orchestra.run.smithi039.stdout: "info", 2024-09-12T02:49:15.098 INFO:teuthology.orchestra.run.smithi039.stdout: "warning" 2024-09-12T02:49:15.099 INFO:teuthology.orchestra.run.smithi039.stdout: ], 2024-09-12T02:49:15.099 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "", 2024-09-12T02:49:15.099 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-09-12T02:49:15.099 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-09-12T02:49:15.099 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-09-12T02:49:15.099 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-09-12T02:49:15.099 INFO:teuthology.orchestra.run.smithi039.stdout: "log_to_cluster": { 2024-09-12T02:49:15.099 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "log_to_cluster", 2024-09-12T02:49:15.099 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "bool", 2024-09-12T02:49:15.099 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "advanced", 2024-09-12T02:49:15.099 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 1, 2024-09-12T02:49:15.099 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "False", 2024-09-12T02:49:15.099 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-09-12T02:49:15.099 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-09-12T02:49:15.100 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [], 2024-09-12T02:49:15.100 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "", 2024-09-12T02:49:15.100 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-09-12T02:49:15.100 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-09-12T02:49:15.100 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-09-12T02:49:15.100 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-09-12T02:49:15.100 INFO:teuthology.orchestra.run.smithi039.stdout: "log_to_cluster_level": { 2024-09-12T02:49:15.100 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "log_to_cluster_level", 2024-09-12T02:49:15.100 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "str", 2024-09-12T02:49:15.100 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "advanced", 2024-09-12T02:49:15.100 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 1, 2024-09-12T02:49:15.100 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "info", 2024-09-12T02:49:15.100 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-09-12T02:49:15.101 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-09-12T02:49:15.101 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [ 2024-09-12T02:49:15.101 INFO:teuthology.orchestra.run.smithi039.stdout: "", 2024-09-12T02:49:15.101 INFO:teuthology.orchestra.run.smithi039.stdout: "critical", 2024-09-12T02:49:15.101 INFO:teuthology.orchestra.run.smithi039.stdout: "debug", 2024-09-12T02:49:15.101 INFO:teuthology.orchestra.run.smithi039.stdout: "error", 2024-09-12T02:49:15.101 INFO:teuthology.orchestra.run.smithi039.stdout: "info", 2024-09-12T02:49:15.101 INFO:teuthology.orchestra.run.smithi039.stdout: "warning" 2024-09-12T02:49:15.101 INFO:teuthology.orchestra.run.smithi039.stdout: ], 2024-09-12T02:49:15.101 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "", 2024-09-12T02:49:15.101 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-09-12T02:49:15.101 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-09-12T02:49:15.101 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-09-12T02:49:15.101 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-09-12T02:49:15.102 INFO:teuthology.orchestra.run.smithi039.stdout: "log_to_file": { 2024-09-12T02:49:15.102 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "log_to_file", 2024-09-12T02:49:15.102 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "bool", 2024-09-12T02:49:15.102 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "advanced", 2024-09-12T02:49:15.102 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 1, 2024-09-12T02:49:15.102 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "False", 2024-09-12T02:49:15.102 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-09-12T02:49:15.102 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-09-12T02:49:15.102 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [], 2024-09-12T02:49:15.102 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "", 2024-09-12T02:49:15.102 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-09-12T02:49:15.102 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-09-12T02:49:15.102 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-09-12T02:49:15.102 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-09-12T02:49:15.103 INFO:teuthology.orchestra.run.smithi039.stdout: "zabbix_host": { 2024-09-12T02:49:15.103 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "zabbix_host", 2024-09-12T02:49:15.103 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "str", 2024-09-12T02:49:15.103 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "advanced", 2024-09-12T02:49:15.103 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 0, 2024-09-12T02:49:15.103 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "", 2024-09-12T02:49:15.103 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-09-12T02:49:15.103 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-09-12T02:49:15.103 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [], 2024-09-12T02:49:15.103 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "", 2024-09-12T02:49:15.103 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-09-12T02:49:15.103 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-09-12T02:49:15.103 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-09-12T02:49:15.103 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-09-12T02:49:15.104 INFO:teuthology.orchestra.run.smithi039.stdout: "zabbix_port": { 2024-09-12T02:49:15.104 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "zabbix_port", 2024-09-12T02:49:15.104 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "int", 2024-09-12T02:49:15.104 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "advanced", 2024-09-12T02:49:15.104 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 0, 2024-09-12T02:49:15.104 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "10051", 2024-09-12T02:49:15.104 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-09-12T02:49:15.104 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-09-12T02:49:15.104 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [], 2024-09-12T02:49:15.104 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "", 2024-09-12T02:49:15.104 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-09-12T02:49:15.104 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-09-12T02:49:15.104 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-09-12T02:49:15.105 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-09-12T02:49:15.105 INFO:teuthology.orchestra.run.smithi039.stdout: "zabbix_sender": { 2024-09-12T02:49:15.105 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "zabbix_sender", 2024-09-12T02:49:15.105 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "str", 2024-09-12T02:49:15.105 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "advanced", 2024-09-12T02:49:15.105 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 0, 2024-09-12T02:49:15.105 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "/usr/bin/zabbix_sender", 2024-09-12T02:49:15.105 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-09-12T02:49:15.105 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-09-12T02:49:15.105 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [], 2024-09-12T02:49:15.105 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "", 2024-09-12T02:49:15.105 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-09-12T02:49:15.105 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-09-12T02:49:15.105 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-09-12T02:49:15.106 INFO:teuthology.orchestra.run.smithi039.stdout: } 2024-09-12T02:49:15.106 INFO:teuthology.orchestra.run.smithi039.stdout: } 2024-09-12T02:49:15.106 INFO:teuthology.orchestra.run.smithi039.stdout: } 2024-09-12T02:49:15.106 INFO:teuthology.orchestra.run.smithi039.stdout: ] 2024-09-12T02:49:15.106 INFO:teuthology.orchestra.run.smithi039.stdout: } 2024-09-12T02:49:15.106 INFO:teuthology.orchestra.run.smithi039.stdout: ], 2024-09-12T02:49:15.106 INFO:teuthology.orchestra.run.smithi039.stdout: "modules": [ 2024-09-12T02:49:15.106 INFO:teuthology.orchestra.run.smithi039.stdout: "cephadm", 2024-09-12T02:49:15.106 INFO:teuthology.orchestra.run.smithi039.stdout: "dashboard", 2024-09-12T02:49:15.106 INFO:teuthology.orchestra.run.smithi039.stdout: "iostat", 2024-09-12T02:49:15.106 INFO:teuthology.orchestra.run.smithi039.stdout: "nfs", 2024-09-12T02:49:15.106 INFO:teuthology.orchestra.run.smithi039.stdout: "restful", 2024-09-12T02:49:15.106 INFO:teuthology.orchestra.run.smithi039.stdout: "snap_schedule" 2024-09-12T02:49:15.106 INFO:teuthology.orchestra.run.smithi039.stdout: ], 2024-09-12T02:49:15.107 INFO:teuthology.orchestra.run.smithi039.stdout: "available_modules": [ 2024-09-12T02:49:15.107 INFO:teuthology.orchestra.run.smithi039.stdout: { 2024-09-12T02:49:15.107 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "alerts", 2024-09-12T02:49:15.107 INFO:teuthology.orchestra.run.smithi039.stdout: "can_run": true, 2024-09-12T02:49:15.107 INFO:teuthology.orchestra.run.smithi039.stdout: "error_string": "", 2024-09-12T02:49:15.107 INFO:teuthology.orchestra.run.smithi039.stdout: "module_options": { 2024-09-12T02:49:15.107 INFO:teuthology.orchestra.run.smithi039.stdout: "interval": { 2024-09-12T02:49:15.107 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "interval", 2024-09-12T02:49:15.107 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "secs", 2024-09-12T02:49:15.107 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "advanced", 2024-09-12T02:49:15.107 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 1, 2024-09-12T02:49:15.107 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "60", 2024-09-12T02:49:15.107 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-09-12T02:49:15.108 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-09-12T02:49:15.108 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [], 2024-09-12T02:49:15.108 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "How frequently to reexamine health status", 2024-09-12T02:49:15.108 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-09-12T02:49:15.108 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-09-12T02:49:15.108 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-09-12T02:49:15.108 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-09-12T02:49:15.108 INFO:teuthology.orchestra.run.smithi039.stdout: "log_level": { 2024-09-12T02:49:15.108 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "log_level", 2024-09-12T02:49:15.108 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "str", 2024-09-12T02:49:15.108 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "advanced", 2024-09-12T02:49:15.108 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 1, 2024-09-12T02:49:15.108 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "", 2024-09-12T02:49:15.109 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-09-12T02:49:15.109 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-09-12T02:49:15.109 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [ 2024-09-12T02:49:15.109 INFO:teuthology.orchestra.run.smithi039.stdout: "", 2024-09-12T02:49:15.109 INFO:teuthology.orchestra.run.smithi039.stdout: "critical", 2024-09-12T02:49:15.109 INFO:teuthology.orchestra.run.smithi039.stdout: "debug", 2024-09-12T02:49:15.109 INFO:teuthology.orchestra.run.smithi039.stdout: "error", 2024-09-12T02:49:15.109 INFO:teuthology.orchestra.run.smithi039.stdout: "info", 2024-09-12T02:49:15.109 INFO:teuthology.orchestra.run.smithi039.stdout: "warning" 2024-09-12T02:49:15.109 INFO:teuthology.orchestra.run.smithi039.stdout: ], 2024-09-12T02:49:15.109 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "", 2024-09-12T02:49:15.109 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-09-12T02:49:15.109 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-09-12T02:49:15.109 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-09-12T02:49:15.110 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-09-12T02:49:15.110 INFO:teuthology.orchestra.run.smithi039.stdout: "log_to_cluster": { 2024-09-12T02:49:15.110 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "log_to_cluster", 2024-09-12T02:49:15.110 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "bool", 2024-09-12T02:49:15.110 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "advanced", 2024-09-12T02:49:15.110 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 1, 2024-09-12T02:49:15.110 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "False", 2024-09-12T02:49:15.110 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-09-12T02:49:15.110 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-09-12T02:49:15.110 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [], 2024-09-12T02:49:15.110 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "", 2024-09-12T02:49:15.110 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-09-12T02:49:15.110 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-09-12T02:49:15.110 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-09-12T02:49:15.111 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-09-12T02:49:15.111 INFO:teuthology.orchestra.run.smithi039.stdout: "log_to_cluster_level": { 2024-09-12T02:49:15.111 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "log_to_cluster_level", 2024-09-12T02:49:15.111 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "str", 2024-09-12T02:49:15.111 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "advanced", 2024-09-12T02:49:15.111 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 1, 2024-09-12T02:49:15.111 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "info", 2024-09-12T02:49:15.111 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-09-12T02:49:15.111 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-09-12T02:49:15.111 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [ 2024-09-12T02:49:15.111 INFO:teuthology.orchestra.run.smithi039.stdout: "", 2024-09-12T02:49:15.111 INFO:teuthology.orchestra.run.smithi039.stdout: "critical", 2024-09-12T02:49:15.111 INFO:teuthology.orchestra.run.smithi039.stdout: "debug", 2024-09-12T02:49:15.112 INFO:teuthology.orchestra.run.smithi039.stdout: "error", 2024-09-12T02:49:15.112 INFO:teuthology.orchestra.run.smithi039.stdout: "info", 2024-09-12T02:49:15.112 INFO:teuthology.orchestra.run.smithi039.stdout: "warning" 2024-09-12T02:49:15.112 INFO:teuthology.orchestra.run.smithi039.stdout: ], 2024-09-12T02:49:15.112 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "", 2024-09-12T02:49:15.112 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-09-12T02:49:15.112 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-09-12T02:49:15.112 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-09-12T02:49:15.112 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-09-12T02:49:15.112 INFO:teuthology.orchestra.run.smithi039.stdout: "log_to_file": { 2024-09-12T02:49:15.112 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "log_to_file", 2024-09-12T02:49:15.112 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "bool", 2024-09-12T02:49:15.112 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "advanced", 2024-09-12T02:49:15.113 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 1, 2024-09-12T02:49:15.113 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "False", 2024-09-12T02:49:15.113 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-09-12T02:49:15.113 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-09-12T02:49:15.113 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [], 2024-09-12T02:49:15.113 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "", 2024-09-12T02:49:15.113 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-09-12T02:49:15.113 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-09-12T02:49:15.113 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-09-12T02:49:15.113 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-09-12T02:49:15.113 INFO:teuthology.orchestra.run.smithi039.stdout: "smtp_destination": { 2024-09-12T02:49:15.113 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "smtp_destination", 2024-09-12T02:49:15.113 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "str", 2024-09-12T02:49:15.114 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "advanced", 2024-09-12T02:49:15.114 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 1, 2024-09-12T02:49:15.114 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "", 2024-09-12T02:49:15.114 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-09-12T02:49:15.114 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-09-12T02:49:15.114 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [], 2024-09-12T02:49:15.114 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "Email address to send alerts to", 2024-09-12T02:49:15.114 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-09-12T02:49:15.114 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-09-12T02:49:15.114 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-09-12T02:49:15.114 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-09-12T02:49:15.114 INFO:teuthology.orchestra.run.smithi039.stdout: "smtp_from_name": { 2024-09-12T02:49:15.114 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "smtp_from_name", 2024-09-12T02:49:15.114 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "str", 2024-09-12T02:49:15.115 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "advanced", 2024-09-12T02:49:15.115 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 1, 2024-09-12T02:49:15.115 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "Ceph", 2024-09-12T02:49:15.115 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-09-12T02:49:15.115 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-09-12T02:49:15.115 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [], 2024-09-12T02:49:15.115 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "Email From: name", 2024-09-12T02:49:15.115 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-09-12T02:49:15.115 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-09-12T02:49:15.115 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-09-12T02:49:15.115 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-09-12T02:49:15.115 INFO:teuthology.orchestra.run.smithi039.stdout: "smtp_host": { 2024-09-12T02:49:15.115 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "smtp_host", 2024-09-12T02:49:15.116 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "str", 2024-09-12T02:49:15.116 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "advanced", 2024-09-12T02:49:15.116 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 1, 2024-09-12T02:49:15.116 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "", 2024-09-12T02:49:15.116 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-09-12T02:49:15.116 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-09-12T02:49:15.116 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [], 2024-09-12T02:49:15.116 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "SMTP server", 2024-09-12T02:49:15.116 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-09-12T02:49:15.116 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-09-12T02:49:15.116 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-09-12T02:49:15.116 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-09-12T02:49:15.116 INFO:teuthology.orchestra.run.smithi039.stdout: "smtp_password": { 2024-09-12T02:49:15.116 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "smtp_password", 2024-09-12T02:49:15.117 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "str", 2024-09-12T02:49:15.117 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "advanced", 2024-09-12T02:49:15.117 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 1, 2024-09-12T02:49:15.117 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "", 2024-09-12T02:49:15.117 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-09-12T02:49:15.117 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-09-12T02:49:15.117 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [], 2024-09-12T02:49:15.117 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "Password to authenticate with", 2024-09-12T02:49:15.117 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-09-12T02:49:15.117 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-09-12T02:49:15.117 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-09-12T02:49:15.117 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-09-12T02:49:15.117 INFO:teuthology.orchestra.run.smithi039.stdout: "smtp_port": { 2024-09-12T02:49:15.118 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "smtp_port", 2024-09-12T02:49:15.118 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "int", 2024-09-12T02:49:15.118 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "advanced", 2024-09-12T02:49:15.118 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 1, 2024-09-12T02:49:15.118 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "465", 2024-09-12T02:49:15.118 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-09-12T02:49:15.118 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-09-12T02:49:15.118 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [], 2024-09-12T02:49:15.118 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "SMTP port", 2024-09-12T02:49:15.118 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-09-12T02:49:15.118 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-09-12T02:49:15.118 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-09-12T02:49:15.118 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-09-12T02:49:15.118 INFO:teuthology.orchestra.run.smithi039.stdout: "smtp_sender": { 2024-09-12T02:49:15.119 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "smtp_sender", 2024-09-12T02:49:15.119 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "str", 2024-09-12T02:49:15.119 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "advanced", 2024-09-12T02:49:15.119 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 1, 2024-09-12T02:49:15.119 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "", 2024-09-12T02:49:15.119 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-09-12T02:49:15.119 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-09-12T02:49:15.119 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [], 2024-09-12T02:49:15.119 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "SMTP envelope sender", 2024-09-12T02:49:15.119 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-09-12T02:49:15.119 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-09-12T02:49:15.119 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-09-12T02:49:15.119 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-09-12T02:49:15.120 INFO:teuthology.orchestra.run.smithi039.stdout: "smtp_ssl": { 2024-09-12T02:49:15.120 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "smtp_ssl", 2024-09-12T02:49:15.120 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "bool", 2024-09-12T02:49:15.120 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "advanced", 2024-09-12T02:49:15.120 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 1, 2024-09-12T02:49:15.120 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "True", 2024-09-12T02:49:15.120 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-09-12T02:49:15.120 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-09-12T02:49:15.120 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [], 2024-09-12T02:49:15.120 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "Use SSL to connect to SMTP server", 2024-09-12T02:49:15.120 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-09-12T02:49:15.120 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-09-12T02:49:15.120 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-09-12T02:49:15.121 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-09-12T02:49:15.121 INFO:teuthology.orchestra.run.smithi039.stdout: "smtp_user": { 2024-09-12T02:49:15.121 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "smtp_user", 2024-09-12T02:49:15.121 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "str", 2024-09-12T02:49:15.121 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "advanced", 2024-09-12T02:49:15.121 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 1, 2024-09-12T02:49:15.121 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "", 2024-09-12T02:49:15.121 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-09-12T02:49:15.121 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-09-12T02:49:15.121 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [], 2024-09-12T02:49:15.121 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "User to authenticate as", 2024-09-12T02:49:15.121 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-09-12T02:49:15.121 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-09-12T02:49:15.121 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-09-12T02:49:15.122 INFO:teuthology.orchestra.run.smithi039.stdout: } 2024-09-12T02:49:15.122 INFO:teuthology.orchestra.run.smithi039.stdout: } 2024-09-12T02:49:15.122 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-09-12T02:49:15.122 INFO:teuthology.orchestra.run.smithi039.stdout: { 2024-09-12T02:49:15.122 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "balancer", 2024-09-12T02:49:15.122 INFO:teuthology.orchestra.run.smithi039.stdout: "can_run": true, 2024-09-12T02:49:15.122 INFO:teuthology.orchestra.run.smithi039.stdout: "error_string": "", 2024-09-12T02:49:15.122 INFO:teuthology.orchestra.run.smithi039.stdout: "module_options": { 2024-09-12T02:49:15.122 INFO:teuthology.orchestra.run.smithi039.stdout: "active": { 2024-09-12T02:49:15.122 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "active", 2024-09-12T02:49:15.122 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "bool", 2024-09-12T02:49:15.122 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "advanced", 2024-09-12T02:49:15.122 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 1, 2024-09-12T02:49:15.122 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "True", 2024-09-12T02:49:15.123 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-09-12T02:49:15.123 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-09-12T02:49:15.123 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [], 2024-09-12T02:49:15.123 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "automatically balance PGs across cluster", 2024-09-12T02:49:15.123 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-09-12T02:49:15.123 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-09-12T02:49:15.123 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-09-12T02:49:15.123 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-09-12T02:49:15.123 INFO:teuthology.orchestra.run.smithi039.stdout: "begin_time": { 2024-09-12T02:49:15.123 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "begin_time", 2024-09-12T02:49:15.123 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "str", 2024-09-12T02:49:15.123 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "advanced", 2024-09-12T02:49:15.123 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 1, 2024-09-12T02:49:15.123 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "0000", 2024-09-12T02:49:15.124 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-09-12T02:49:15.124 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-09-12T02:49:15.124 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [], 2024-09-12T02:49:15.124 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "beginning time of day to automatically balance", 2024-09-12T02:49:15.124 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "This is a time of day in the format HHMM.", 2024-09-12T02:49:15.124 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-09-12T02:49:15.124 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-09-12T02:49:15.124 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-09-12T02:49:15.124 INFO:teuthology.orchestra.run.smithi039.stdout: "begin_weekday": { 2024-09-12T02:49:15.124 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "begin_weekday", 2024-09-12T02:49:15.124 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "uint", 2024-09-12T02:49:15.124 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "advanced", 2024-09-12T02:49:15.124 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 1, 2024-09-12T02:49:15.125 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "0", 2024-09-12T02:49:15.125 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "0", 2024-09-12T02:49:15.125 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "6", 2024-09-12T02:49:15.125 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [], 2024-09-12T02:49:15.125 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "Restrict automatic balancing to this day of the week or later", 2024-09-12T02:49:15.125 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "0 = Sunday, 1 = Monday, etc.", 2024-09-12T02:49:15.125 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-09-12T02:49:15.125 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-09-12T02:49:15.125 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-09-12T02:49:15.125 INFO:teuthology.orchestra.run.smithi039.stdout: "crush_compat_max_iterations": { 2024-09-12T02:49:15.125 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "crush_compat_max_iterations", 2024-09-12T02:49:15.125 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "uint", 2024-09-12T02:49:15.125 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "advanced", 2024-09-12T02:49:15.126 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 1, 2024-09-12T02:49:15.126 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "25", 2024-09-12T02:49:15.126 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "1", 2024-09-12T02:49:15.126 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "250", 2024-09-12T02:49:15.126 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [], 2024-09-12T02:49:15.126 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "maximum number of iterations to attempt optimization", 2024-09-12T02:49:15.126 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-09-12T02:49:15.126 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-09-12T02:49:15.126 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-09-12T02:49:15.126 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-09-12T02:49:15.126 INFO:teuthology.orchestra.run.smithi039.stdout: "crush_compat_metrics": { 2024-09-12T02:49:15.126 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "crush_compat_metrics", 2024-09-12T02:49:15.126 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "str", 2024-09-12T02:49:15.126 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "advanced", 2024-09-12T02:49:15.127 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 1, 2024-09-12T02:49:15.127 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "pgs,objects,bytes", 2024-09-12T02:49:15.127 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-09-12T02:49:15.127 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-09-12T02:49:15.127 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [], 2024-09-12T02:49:15.127 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "metrics with which to calculate OSD utilization", 2024-09-12T02:49:15.127 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "Value is a list of one or more of \"pgs\", \"objects\", or \"bytes\", and indicates which metrics to use to balance utilization.", 2024-09-12T02:49:15.127 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-09-12T02:49:15.127 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-09-12T02:49:15.127 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-09-12T02:49:15.127 INFO:teuthology.orchestra.run.smithi039.stdout: "crush_compat_step": { 2024-09-12T02:49:15.127 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "crush_compat_step", 2024-09-12T02:49:15.127 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "float", 2024-09-12T02:49:15.128 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "advanced", 2024-09-12T02:49:15.128 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 1, 2024-09-12T02:49:15.128 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "0.5", 2024-09-12T02:49:15.128 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "0.001", 2024-09-12T02:49:15.128 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "0.999", 2024-09-12T02:49:15.128 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [], 2024-09-12T02:49:15.128 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "aggressiveness of optimization", 2024-09-12T02:49:15.128 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": ".99 is very aggressive, .01 is less aggressive", 2024-09-12T02:49:15.128 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-09-12T02:49:15.128 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-09-12T02:49:15.128 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-09-12T02:49:15.128 INFO:teuthology.orchestra.run.smithi039.stdout: "end_time": { 2024-09-12T02:49:15.128 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "end_time", 2024-09-12T02:49:15.128 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "str", 2024-09-12T02:49:15.129 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "advanced", 2024-09-12T02:49:15.129 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 1, 2024-09-12T02:49:15.129 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "2359", 2024-09-12T02:49:15.129 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-09-12T02:49:15.129 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-09-12T02:49:15.129 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [], 2024-09-12T02:49:15.129 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "ending time of day to automatically balance", 2024-09-12T02:49:15.129 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "This is a time of day in the format HHMM.", 2024-09-12T02:49:15.129 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-09-12T02:49:15.129 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-09-12T02:49:15.129 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-09-12T02:49:15.129 INFO:teuthology.orchestra.run.smithi039.stdout: "end_weekday": { 2024-09-12T02:49:15.129 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "end_weekday", 2024-09-12T02:49:15.130 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "uint", 2024-09-12T02:49:15.130 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "advanced", 2024-09-12T02:49:15.130 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 1, 2024-09-12T02:49:15.130 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "0", 2024-09-12T02:49:15.130 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "0", 2024-09-12T02:49:15.130 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "6", 2024-09-12T02:49:15.130 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [], 2024-09-12T02:49:15.130 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "Restrict automatic balancing to days of the week earlier than this", 2024-09-12T02:49:15.130 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "0 = Sunday, 1 = Monday, etc.", 2024-09-12T02:49:15.130 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-09-12T02:49:15.130 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-09-12T02:49:15.130 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-09-12T02:49:15.130 INFO:teuthology.orchestra.run.smithi039.stdout: "log_level": { 2024-09-12T02:49:15.131 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "log_level", 2024-09-12T02:49:15.131 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "str", 2024-09-12T02:49:15.131 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "advanced", 2024-09-12T02:49:15.131 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 1, 2024-09-12T02:49:15.131 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "", 2024-09-12T02:49:15.131 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-09-12T02:49:15.131 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-09-12T02:49:15.131 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [ 2024-09-12T02:49:15.131 INFO:teuthology.orchestra.run.smithi039.stdout: "", 2024-09-12T02:49:15.131 INFO:teuthology.orchestra.run.smithi039.stdout: "critical", 2024-09-12T02:49:15.131 INFO:teuthology.orchestra.run.smithi039.stdout: "debug", 2024-09-12T02:49:15.131 INFO:teuthology.orchestra.run.smithi039.stdout: "error", 2024-09-12T02:49:15.131 INFO:teuthology.orchestra.run.smithi039.stdout: "info", 2024-09-12T02:49:15.131 INFO:teuthology.orchestra.run.smithi039.stdout: "warning" 2024-09-12T02:49:15.132 INFO:teuthology.orchestra.run.smithi039.stdout: ], 2024-09-12T02:49:15.132 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "", 2024-09-12T02:49:15.132 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-09-12T02:49:15.132 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-09-12T02:49:15.132 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-09-12T02:49:15.132 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-09-12T02:49:15.132 INFO:teuthology.orchestra.run.smithi039.stdout: "log_to_cluster": { 2024-09-12T02:49:15.132 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "log_to_cluster", 2024-09-12T02:49:15.132 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "bool", 2024-09-12T02:49:15.132 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "advanced", 2024-09-12T02:49:15.132 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 1, 2024-09-12T02:49:15.132 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "False", 2024-09-12T02:49:15.132 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-09-12T02:49:15.132 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-09-12T02:49:15.133 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [], 2024-09-12T02:49:15.133 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "", 2024-09-12T02:49:15.133 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-09-12T02:49:15.133 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-09-12T02:49:15.133 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-09-12T02:49:15.133 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-09-12T02:49:15.133 INFO:teuthology.orchestra.run.smithi039.stdout: "log_to_cluster_level": { 2024-09-12T02:49:15.133 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "log_to_cluster_level", 2024-09-12T02:49:15.133 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "str", 2024-09-12T02:49:15.133 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "advanced", 2024-09-12T02:49:15.133 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 1, 2024-09-12T02:49:15.133 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "info", 2024-09-12T02:49:15.133 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-09-12T02:49:15.134 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-09-12T02:49:15.134 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [ 2024-09-12T02:49:15.134 INFO:teuthology.orchestra.run.smithi039.stdout: "", 2024-09-12T02:49:15.134 INFO:teuthology.orchestra.run.smithi039.stdout: "critical", 2024-09-12T02:49:15.134 INFO:teuthology.orchestra.run.smithi039.stdout: "debug", 2024-09-12T02:49:15.134 INFO:teuthology.orchestra.run.smithi039.stdout: "error", 2024-09-12T02:49:15.134 INFO:teuthology.orchestra.run.smithi039.stdout: "info", 2024-09-12T02:49:15.134 INFO:teuthology.orchestra.run.smithi039.stdout: "warning" 2024-09-12T02:49:15.134 INFO:teuthology.orchestra.run.smithi039.stdout: ], 2024-09-12T02:49:15.134 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "", 2024-09-12T02:49:15.134 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-09-12T02:49:15.134 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-09-12T02:49:15.134 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-09-12T02:49:15.135 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-09-12T02:49:15.135 INFO:teuthology.orchestra.run.smithi039.stdout: "log_to_file": { 2024-09-12T02:49:15.135 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "log_to_file", 2024-09-12T02:49:15.135 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "bool", 2024-09-12T02:49:15.135 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "advanced", 2024-09-12T02:49:15.135 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 1, 2024-09-12T02:49:15.135 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "False", 2024-09-12T02:49:15.135 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-09-12T02:49:15.135 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-09-12T02:49:15.135 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [], 2024-09-12T02:49:15.135 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "", 2024-09-12T02:49:15.135 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-09-12T02:49:15.135 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-09-12T02:49:15.135 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-09-12T02:49:15.136 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-09-12T02:49:15.136 INFO:teuthology.orchestra.run.smithi039.stdout: "min_score": { 2024-09-12T02:49:15.136 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "min_score", 2024-09-12T02:49:15.136 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "float", 2024-09-12T02:49:15.136 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "advanced", 2024-09-12T02:49:15.136 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 1, 2024-09-12T02:49:15.136 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "0", 2024-09-12T02:49:15.136 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-09-12T02:49:15.136 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-09-12T02:49:15.136 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [], 2024-09-12T02:49:15.136 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "minimum score, below which no optimization is attempted", 2024-09-12T02:49:15.136 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-09-12T02:49:15.136 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-09-12T02:49:15.136 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-09-12T02:49:15.137 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-09-12T02:49:15.137 INFO:teuthology.orchestra.run.smithi039.stdout: "mode": { 2024-09-12T02:49:15.137 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "mode", 2024-09-12T02:49:15.137 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "str", 2024-09-12T02:49:15.137 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "advanced", 2024-09-12T02:49:15.137 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 1, 2024-09-12T02:49:15.137 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "upmap", 2024-09-12T02:49:15.137 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-09-12T02:49:15.137 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-09-12T02:49:15.137 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [ 2024-09-12T02:49:15.137 INFO:teuthology.orchestra.run.smithi039.stdout: "crush-compat", 2024-09-12T02:49:15.137 INFO:teuthology.orchestra.run.smithi039.stdout: "none", 2024-09-12T02:49:15.137 INFO:teuthology.orchestra.run.smithi039.stdout: "read", 2024-09-12T02:49:15.137 INFO:teuthology.orchestra.run.smithi039.stdout: "upmap", 2024-09-12T02:49:15.138 INFO:teuthology.orchestra.run.smithi039.stdout: "upmap-read" 2024-09-12T02:49:15.138 INFO:teuthology.orchestra.run.smithi039.stdout: ], 2024-09-12T02:49:15.138 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "Balancer mode", 2024-09-12T02:49:15.138 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-09-12T02:49:15.138 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-09-12T02:49:15.138 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-09-12T02:49:15.138 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-09-12T02:49:15.138 INFO:teuthology.orchestra.run.smithi039.stdout: "pool_ids": { 2024-09-12T02:49:15.138 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "pool_ids", 2024-09-12T02:49:15.138 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "str", 2024-09-12T02:49:15.138 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "advanced", 2024-09-12T02:49:15.138 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 1, 2024-09-12T02:49:15.138 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "", 2024-09-12T02:49:15.138 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-09-12T02:49:15.139 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-09-12T02:49:15.139 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [], 2024-09-12T02:49:15.139 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "pools which the automatic balancing will be limited to", 2024-09-12T02:49:15.139 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-09-12T02:49:15.139 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-09-12T02:49:15.139 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-09-12T02:49:15.139 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-09-12T02:49:15.139 INFO:teuthology.orchestra.run.smithi039.stdout: "sleep_interval": { 2024-09-12T02:49:15.139 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "sleep_interval", 2024-09-12T02:49:15.139 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "secs", 2024-09-12T02:49:15.139 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "advanced", 2024-09-12T02:49:15.139 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 1, 2024-09-12T02:49:15.139 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "60", 2024-09-12T02:49:15.140 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-09-12T02:49:15.140 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-09-12T02:49:15.140 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [], 2024-09-12T02:49:15.140 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "how frequently to wake up and attempt optimization", 2024-09-12T02:49:15.140 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-09-12T02:49:15.140 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-09-12T02:49:15.140 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-09-12T02:49:15.140 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-09-12T02:49:15.140 INFO:teuthology.orchestra.run.smithi039.stdout: "upmap_max_deviation": { 2024-09-12T02:49:15.140 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "upmap_max_deviation", 2024-09-12T02:49:15.140 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "int", 2024-09-12T02:49:15.140 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "advanced", 2024-09-12T02:49:15.140 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 1, 2024-09-12T02:49:15.141 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "5", 2024-09-12T02:49:15.141 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "1", 2024-09-12T02:49:15.141 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-09-12T02:49:15.141 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [], 2024-09-12T02:49:15.141 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "deviation below which no optimization is attempted", 2024-09-12T02:49:15.141 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "If the number of PGs are within this count then no optimization is attempted", 2024-09-12T02:49:15.141 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-09-12T02:49:15.141 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-09-12T02:49:15.141 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-09-12T02:49:15.141 INFO:teuthology.orchestra.run.smithi039.stdout: "upmap_max_optimizations": { 2024-09-12T02:49:15.141 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "upmap_max_optimizations", 2024-09-12T02:49:15.141 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "uint", 2024-09-12T02:49:15.141 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "advanced", 2024-09-12T02:49:15.141 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 1, 2024-09-12T02:49:15.142 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "10", 2024-09-12T02:49:15.142 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-09-12T02:49:15.142 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-09-12T02:49:15.142 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [], 2024-09-12T02:49:15.142 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "maximum upmap optimizations to make per attempt", 2024-09-12T02:49:15.142 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-09-12T02:49:15.142 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-09-12T02:49:15.142 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-09-12T02:49:15.142 INFO:teuthology.orchestra.run.smithi039.stdout: } 2024-09-12T02:49:15.142 INFO:teuthology.orchestra.run.smithi039.stdout: } 2024-09-12T02:49:15.142 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-09-12T02:49:15.142 INFO:teuthology.orchestra.run.smithi039.stdout: { 2024-09-12T02:49:15.142 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "cephadm", 2024-09-12T02:49:15.142 INFO:teuthology.orchestra.run.smithi039.stdout: "can_run": true, 2024-09-12T02:49:15.143 INFO:teuthology.orchestra.run.smithi039.stdout: "error_string": "", 2024-09-12T02:49:15.143 INFO:teuthology.orchestra.run.smithi039.stdout: "module_options": { 2024-09-12T02:49:15.143 INFO:teuthology.orchestra.run.smithi039.stdout: "agent_down_multiplier": { 2024-09-12T02:49:15.143 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "agent_down_multiplier", 2024-09-12T02:49:15.143 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "float", 2024-09-12T02:49:15.143 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "advanced", 2024-09-12T02:49:15.143 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 0, 2024-09-12T02:49:15.143 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "3.0", 2024-09-12T02:49:15.143 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-09-12T02:49:15.143 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-09-12T02:49:15.143 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [], 2024-09-12T02:49:15.143 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "Multiplied by agent refresh rate to calculate how long agent must not report before being marked down", 2024-09-12T02:49:15.143 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-09-12T02:49:15.143 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-09-12T02:49:15.144 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-09-12T02:49:15.144 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-09-12T02:49:15.144 INFO:teuthology.orchestra.run.smithi039.stdout: "agent_refresh_rate": { 2024-09-12T02:49:15.144 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "agent_refresh_rate", 2024-09-12T02:49:15.144 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "secs", 2024-09-12T02:49:15.144 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "advanced", 2024-09-12T02:49:15.144 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 0, 2024-09-12T02:49:15.144 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "20", 2024-09-12T02:49:15.144 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-09-12T02:49:15.144 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-09-12T02:49:15.144 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [], 2024-09-12T02:49:15.144 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "How often agent on each host will try to gather and send metadata", 2024-09-12T02:49:15.144 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-09-12T02:49:15.145 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-09-12T02:49:15.145 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-09-12T02:49:15.145 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-09-12T02:49:15.145 INFO:teuthology.orchestra.run.smithi039.stdout: "agent_starting_port": { 2024-09-12T02:49:15.145 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "agent_starting_port", 2024-09-12T02:49:15.145 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "int", 2024-09-12T02:49:15.145 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "advanced", 2024-09-12T02:49:15.145 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 0, 2024-09-12T02:49:15.145 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "4721", 2024-09-12T02:49:15.145 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-09-12T02:49:15.145 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-09-12T02:49:15.145 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [], 2024-09-12T02:49:15.145 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "First port agent will try to bind to (will also try up to next 1000 subsequent ports if blocked)", 2024-09-12T02:49:15.145 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-09-12T02:49:15.146 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-09-12T02:49:15.146 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-09-12T02:49:15.146 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-09-12T02:49:15.146 INFO:teuthology.orchestra.run.smithi039.stdout: "allow_ptrace": { 2024-09-12T02:49:15.146 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "allow_ptrace", 2024-09-12T02:49:15.146 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "bool", 2024-09-12T02:49:15.146 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "advanced", 2024-09-12T02:49:15.146 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 0, 2024-09-12T02:49:15.146 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "False", 2024-09-12T02:49:15.146 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-09-12T02:49:15.146 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-09-12T02:49:15.146 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [], 2024-09-12T02:49:15.146 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "allow SYS_PTRACE capability on ceph containers", 2024-09-12T02:49:15.146 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "The SYS_PTRACE capability is needed to attach to a process with gdb or strace. Enabling this options can allow debugging daemons that encounter problems at runtime.", 2024-09-12T02:49:15.147 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-09-12T02:49:15.147 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-09-12T02:49:15.147 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-09-12T02:49:15.147 INFO:teuthology.orchestra.run.smithi039.stdout: "autotune_interval": { 2024-09-12T02:49:15.147 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "autotune_interval", 2024-09-12T02:49:15.147 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "secs", 2024-09-12T02:49:15.147 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "advanced", 2024-09-12T02:49:15.147 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 0, 2024-09-12T02:49:15.147 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "600", 2024-09-12T02:49:15.147 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-09-12T02:49:15.147 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-09-12T02:49:15.147 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [], 2024-09-12T02:49:15.147 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "how frequently to autotune daemon memory", 2024-09-12T02:49:15.148 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-09-12T02:49:15.148 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-09-12T02:49:15.148 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-09-12T02:49:15.148 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-09-12T02:49:15.148 INFO:teuthology.orchestra.run.smithi039.stdout: "autotune_memory_target_ratio": { 2024-09-12T02:49:15.148 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "autotune_memory_target_ratio", 2024-09-12T02:49:15.148 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "float", 2024-09-12T02:49:15.148 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "advanced", 2024-09-12T02:49:15.148 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 0, 2024-09-12T02:49:15.148 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "0.7", 2024-09-12T02:49:15.148 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-09-12T02:49:15.148 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-09-12T02:49:15.148 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [], 2024-09-12T02:49:15.149 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "ratio of total system memory to divide amongst autotuned daemons", 2024-09-12T02:49:15.149 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-09-12T02:49:15.149 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-09-12T02:49:15.149 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-09-12T02:49:15.149 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-09-12T02:49:15.149 INFO:teuthology.orchestra.run.smithi039.stdout: "cephadm_log_destination": { 2024-09-12T02:49:15.149 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "cephadm_log_destination", 2024-09-12T02:49:15.149 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "str", 2024-09-12T02:49:15.149 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "advanced", 2024-09-12T02:49:15.149 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 0, 2024-09-12T02:49:15.149 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "", 2024-09-12T02:49:15.149 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-09-12T02:49:15.149 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-09-12T02:49:15.149 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [ 2024-09-12T02:49:15.150 INFO:teuthology.orchestra.run.smithi039.stdout: "file", 2024-09-12T02:49:15.150 INFO:teuthology.orchestra.run.smithi039.stdout: "file,syslog", 2024-09-12T02:49:15.150 INFO:teuthology.orchestra.run.smithi039.stdout: "syslog" 2024-09-12T02:49:15.150 INFO:teuthology.orchestra.run.smithi039.stdout: ], 2024-09-12T02:49:15.150 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "Destination for cephadm command's persistent logging", 2024-09-12T02:49:15.150 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-09-12T02:49:15.150 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-09-12T02:49:15.150 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-09-12T02:49:15.150 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-09-12T02:49:15.150 INFO:teuthology.orchestra.run.smithi039.stdout: "cgroups_split": { 2024-09-12T02:49:15.150 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "cgroups_split", 2024-09-12T02:49:15.150 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "bool", 2024-09-12T02:49:15.150 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "advanced", 2024-09-12T02:49:15.150 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 0, 2024-09-12T02:49:15.151 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "True", 2024-09-12T02:49:15.151 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-09-12T02:49:15.151 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-09-12T02:49:15.151 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [], 2024-09-12T02:49:15.151 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "Pass --cgroups=split when cephadm creates containers (currently podman only)", 2024-09-12T02:49:15.151 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-09-12T02:49:15.151 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-09-12T02:49:15.151 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-09-12T02:49:15.151 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-09-12T02:49:15.151 INFO:teuthology.orchestra.run.smithi039.stdout: "config_checks_enabled": { 2024-09-12T02:49:15.151 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "config_checks_enabled", 2024-09-12T02:49:15.151 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "bool", 2024-09-12T02:49:15.151 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "advanced", 2024-09-12T02:49:15.151 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 0, 2024-09-12T02:49:15.152 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "False", 2024-09-12T02:49:15.152 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-09-12T02:49:15.152 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-09-12T02:49:15.152 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [], 2024-09-12T02:49:15.152 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "Enable or disable the cephadm configuration analysis", 2024-09-12T02:49:15.152 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-09-12T02:49:15.152 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-09-12T02:49:15.152 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-09-12T02:49:15.152 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-09-12T02:49:15.152 INFO:teuthology.orchestra.run.smithi039.stdout: "config_dashboard": { 2024-09-12T02:49:15.152 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "config_dashboard", 2024-09-12T02:49:15.152 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "bool", 2024-09-12T02:49:15.152 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "advanced", 2024-09-12T02:49:15.153 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 0, 2024-09-12T02:49:15.153 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "True", 2024-09-12T02:49:15.153 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-09-12T02:49:15.153 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-09-12T02:49:15.153 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [], 2024-09-12T02:49:15.153 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "manage configs like API endpoints in Dashboard.", 2024-09-12T02:49:15.153 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-09-12T02:49:15.153 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-09-12T02:49:15.153 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-09-12T02:49:15.153 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-09-12T02:49:15.153 INFO:teuthology.orchestra.run.smithi039.stdout: "container_image_alertmanager": { 2024-09-12T02:49:15.153 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "container_image_alertmanager", 2024-09-12T02:49:15.153 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "str", 2024-09-12T02:49:15.153 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "advanced", 2024-09-12T02:49:15.154 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 0, 2024-09-12T02:49:15.154 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "quay.io/prometheus/alertmanager:v0.25.0", 2024-09-12T02:49:15.154 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-09-12T02:49:15.154 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-09-12T02:49:15.154 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [], 2024-09-12T02:49:15.154 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "Prometheus container image", 2024-09-12T02:49:15.154 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-09-12T02:49:15.154 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-09-12T02:49:15.154 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-09-12T02:49:15.154 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-09-12T02:49:15.154 INFO:teuthology.orchestra.run.smithi039.stdout: "container_image_base": { 2024-09-12T02:49:15.154 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "container_image_base", 2024-09-12T02:49:15.154 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "str", 2024-09-12T02:49:15.154 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "advanced", 2024-09-12T02:49:15.155 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 1, 2024-09-12T02:49:15.155 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "quay.io/ceph/ceph", 2024-09-12T02:49:15.155 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-09-12T02:49:15.155 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-09-12T02:49:15.155 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [], 2024-09-12T02:49:15.155 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "Container image name, without the tag", 2024-09-12T02:49:15.155 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-09-12T02:49:15.155 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-09-12T02:49:15.155 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-09-12T02:49:15.155 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-09-12T02:49:15.155 INFO:teuthology.orchestra.run.smithi039.stdout: "container_image_elasticsearch": { 2024-09-12T02:49:15.155 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "container_image_elasticsearch", 2024-09-12T02:49:15.155 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "str", 2024-09-12T02:49:15.156 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "advanced", 2024-09-12T02:49:15.156 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 0, 2024-09-12T02:49:15.156 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "quay.io/omrizeneva/elasticsearch:6.8.23", 2024-09-12T02:49:15.156 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-09-12T02:49:15.156 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-09-12T02:49:15.156 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [], 2024-09-12T02:49:15.156 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "elasticsearch container image", 2024-09-12T02:49:15.156 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-09-12T02:49:15.156 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-09-12T02:49:15.156 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-09-12T02:49:15.156 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-09-12T02:49:15.156 INFO:teuthology.orchestra.run.smithi039.stdout: "container_image_grafana": { 2024-09-12T02:49:15.156 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "container_image_grafana", 2024-09-12T02:49:15.157 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "str", 2024-09-12T02:49:15.157 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "advanced", 2024-09-12T02:49:15.157 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 0, 2024-09-12T02:49:15.157 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "quay.io/ceph/grafana:9.4.12", 2024-09-12T02:49:15.157 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-09-12T02:49:15.157 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-09-12T02:49:15.157 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [], 2024-09-12T02:49:15.157 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "Prometheus container image", 2024-09-12T02:49:15.157 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-09-12T02:49:15.157 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-09-12T02:49:15.157 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-09-12T02:49:15.157 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-09-12T02:49:15.157 INFO:teuthology.orchestra.run.smithi039.stdout: "container_image_haproxy": { 2024-09-12T02:49:15.157 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "container_image_haproxy", 2024-09-12T02:49:15.158 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "str", 2024-09-12T02:49:15.158 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "advanced", 2024-09-12T02:49:15.158 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 0, 2024-09-12T02:49:15.158 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "quay.io/ceph/haproxy:2.3", 2024-09-12T02:49:15.158 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-09-12T02:49:15.158 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-09-12T02:49:15.158 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [], 2024-09-12T02:49:15.158 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "HAproxy container image", 2024-09-12T02:49:15.158 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-09-12T02:49:15.158 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-09-12T02:49:15.158 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-09-12T02:49:15.158 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-09-12T02:49:15.158 INFO:teuthology.orchestra.run.smithi039.stdout: "container_image_jaeger_agent": { 2024-09-12T02:49:15.159 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "container_image_jaeger_agent", 2024-09-12T02:49:15.159 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "str", 2024-09-12T02:49:15.159 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "advanced", 2024-09-12T02:49:15.159 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 0, 2024-09-12T02:49:15.159 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "quay.io/jaegertracing/jaeger-agent:1.29", 2024-09-12T02:49:15.159 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-09-12T02:49:15.159 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-09-12T02:49:15.159 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [], 2024-09-12T02:49:15.159 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "Jaeger agent container image", 2024-09-12T02:49:15.159 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-09-12T02:49:15.159 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-09-12T02:49:15.159 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-09-12T02:49:15.159 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-09-12T02:49:15.160 INFO:teuthology.orchestra.run.smithi039.stdout: "container_image_jaeger_collector": { 2024-09-12T02:49:15.160 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "container_image_jaeger_collector", 2024-09-12T02:49:15.160 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "str", 2024-09-12T02:49:15.160 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "advanced", 2024-09-12T02:49:15.160 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 0, 2024-09-12T02:49:15.160 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "quay.io/jaegertracing/jaeger-collector:1.29", 2024-09-12T02:49:15.160 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-09-12T02:49:15.160 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-09-12T02:49:15.160 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [], 2024-09-12T02:49:15.160 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "Jaeger collector container image", 2024-09-12T02:49:15.160 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-09-12T02:49:15.160 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-09-12T02:49:15.160 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-09-12T02:49:15.161 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-09-12T02:49:15.161 INFO:teuthology.orchestra.run.smithi039.stdout: "container_image_jaeger_query": { 2024-09-12T02:49:15.161 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "container_image_jaeger_query", 2024-09-12T02:49:15.161 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "str", 2024-09-12T02:49:15.161 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "advanced", 2024-09-12T02:49:15.161 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 0, 2024-09-12T02:49:15.161 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "quay.io/jaegertracing/jaeger-query:1.29", 2024-09-12T02:49:15.161 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-09-12T02:49:15.161 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-09-12T02:49:15.161 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [], 2024-09-12T02:49:15.161 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "Jaeger query container image", 2024-09-12T02:49:15.161 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-09-12T02:49:15.161 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-09-12T02:49:15.161 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-09-12T02:49:15.162 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-09-12T02:49:15.162 INFO:teuthology.orchestra.run.smithi039.stdout: "container_image_keepalived": { 2024-09-12T02:49:15.162 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "container_image_keepalived", 2024-09-12T02:49:15.162 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "str", 2024-09-12T02:49:15.162 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "advanced", 2024-09-12T02:49:15.162 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 0, 2024-09-12T02:49:15.162 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "quay.io/ceph/keepalived:2.2.4", 2024-09-12T02:49:15.162 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-09-12T02:49:15.162 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-09-12T02:49:15.162 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [], 2024-09-12T02:49:15.162 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "Keepalived container image", 2024-09-12T02:49:15.162 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-09-12T02:49:15.162 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-09-12T02:49:15.163 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-09-12T02:49:15.163 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-09-12T02:49:15.163 INFO:teuthology.orchestra.run.smithi039.stdout: "container_image_loki": { 2024-09-12T02:49:15.163 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "container_image_loki", 2024-09-12T02:49:15.163 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "str", 2024-09-12T02:49:15.163 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "advanced", 2024-09-12T02:49:15.163 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 0, 2024-09-12T02:49:15.163 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "docker.io/grafana/loki:3.0.0", 2024-09-12T02:49:15.163 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-09-12T02:49:15.163 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-09-12T02:49:15.163 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [], 2024-09-12T02:49:15.163 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "Loki container image", 2024-09-12T02:49:15.163 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-09-12T02:49:15.163 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-09-12T02:49:15.164 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-09-12T02:49:15.164 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-09-12T02:49:15.164 INFO:teuthology.orchestra.run.smithi039.stdout: "container_image_node_exporter": { 2024-09-12T02:49:15.164 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "container_image_node_exporter", 2024-09-12T02:49:15.164 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "str", 2024-09-12T02:49:15.164 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "advanced", 2024-09-12T02:49:15.164 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 0, 2024-09-12T02:49:15.164 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "quay.io/prometheus/node-exporter:v1.5.0", 2024-09-12T02:49:15.164 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-09-12T02:49:15.164 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-09-12T02:49:15.164 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [], 2024-09-12T02:49:15.164 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "Prometheus container image", 2024-09-12T02:49:15.164 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-09-12T02:49:15.165 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-09-12T02:49:15.165 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-09-12T02:49:15.165 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-09-12T02:49:15.165 INFO:teuthology.orchestra.run.smithi039.stdout: "container_image_nvmeof": { 2024-09-12T02:49:15.165 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "container_image_nvmeof", 2024-09-12T02:49:15.165 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "str", 2024-09-12T02:49:15.165 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "advanced", 2024-09-12T02:49:15.165 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 0, 2024-09-12T02:49:15.165 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "quay.io/ceph/nvmeof:1.2.5", 2024-09-12T02:49:15.165 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-09-12T02:49:15.165 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-09-12T02:49:15.165 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [], 2024-09-12T02:49:15.165 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "Nvme-of container image", 2024-09-12T02:49:15.166 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-09-12T02:49:15.166 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-09-12T02:49:15.166 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-09-12T02:49:15.166 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-09-12T02:49:15.166 INFO:teuthology.orchestra.run.smithi039.stdout: "container_image_prometheus": { 2024-09-12T02:49:15.166 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "container_image_prometheus", 2024-09-12T02:49:15.166 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "str", 2024-09-12T02:49:15.166 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "advanced", 2024-09-12T02:49:15.166 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 0, 2024-09-12T02:49:15.166 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "quay.io/prometheus/prometheus:v2.43.0", 2024-09-12T02:49:15.166 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-09-12T02:49:15.166 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-09-12T02:49:15.167 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [], 2024-09-12T02:49:15.167 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "Prometheus container image", 2024-09-12T02:49:15.167 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-09-12T02:49:15.167 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-09-12T02:49:15.167 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-09-12T02:49:15.167 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-09-12T02:49:15.167 INFO:teuthology.orchestra.run.smithi039.stdout: "container_image_promtail": { 2024-09-12T02:49:15.167 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "container_image_promtail", 2024-09-12T02:49:15.167 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "str", 2024-09-12T02:49:15.167 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "advanced", 2024-09-12T02:49:15.167 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 0, 2024-09-12T02:49:15.167 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "docker.io/grafana/promtail:3.0.0", 2024-09-12T02:49:15.167 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-09-12T02:49:15.167 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-09-12T02:49:15.168 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [], 2024-09-12T02:49:15.168 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "Promtail container image", 2024-09-12T02:49:15.168 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-09-12T02:49:15.168 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-09-12T02:49:15.168 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-09-12T02:49:15.168 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-09-12T02:49:15.168 INFO:teuthology.orchestra.run.smithi039.stdout: "container_image_samba": { 2024-09-12T02:49:15.168 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "container_image_samba", 2024-09-12T02:49:15.168 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "str", 2024-09-12T02:49:15.168 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "advanced", 2024-09-12T02:49:15.168 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 0, 2024-09-12T02:49:15.168 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "quay.io/samba.org/samba-server:devbuilds-centos-amd64", 2024-09-12T02:49:15.168 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-09-12T02:49:15.168 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-09-12T02:49:15.169 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [], 2024-09-12T02:49:15.169 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "Samba/SMB container image", 2024-09-12T02:49:15.169 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-09-12T02:49:15.169 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-09-12T02:49:15.169 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-09-12T02:49:15.169 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-09-12T02:49:15.169 INFO:teuthology.orchestra.run.smithi039.stdout: "container_image_snmp_gateway": { 2024-09-12T02:49:15.169 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "container_image_snmp_gateway", 2024-09-12T02:49:15.169 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "str", 2024-09-12T02:49:15.169 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "advanced", 2024-09-12T02:49:15.169 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 0, 2024-09-12T02:49:15.169 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "docker.io/maxwo/snmp-notifier:v1.2.1", 2024-09-12T02:49:15.169 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-09-12T02:49:15.170 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-09-12T02:49:15.170 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [], 2024-09-12T02:49:15.170 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "SNMP Gateway container image", 2024-09-12T02:49:15.170 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-09-12T02:49:15.170 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-09-12T02:49:15.170 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-09-12T02:49:15.170 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-09-12T02:49:15.170 INFO:teuthology.orchestra.run.smithi039.stdout: "container_init": { 2024-09-12T02:49:15.170 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "container_init", 2024-09-12T02:49:15.170 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "bool", 2024-09-12T02:49:15.170 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "advanced", 2024-09-12T02:49:15.170 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 0, 2024-09-12T02:49:15.170 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "True", 2024-09-12T02:49:15.171 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-09-12T02:49:15.171 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-09-12T02:49:15.171 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [], 2024-09-12T02:49:15.171 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "Run podman/docker with `--init`", 2024-09-12T02:49:15.171 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-09-12T02:49:15.171 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-09-12T02:49:15.171 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-09-12T02:49:15.171 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-09-12T02:49:15.171 INFO:teuthology.orchestra.run.smithi039.stdout: "daemon_cache_timeout": { 2024-09-12T02:49:15.171 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "daemon_cache_timeout", 2024-09-12T02:49:15.171 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "secs", 2024-09-12T02:49:15.171 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "advanced", 2024-09-12T02:49:15.171 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 0, 2024-09-12T02:49:15.172 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "600", 2024-09-12T02:49:15.172 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-09-12T02:49:15.172 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-09-12T02:49:15.172 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [], 2024-09-12T02:49:15.172 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "seconds to cache service (daemon) inventory", 2024-09-12T02:49:15.172 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-09-12T02:49:15.172 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-09-12T02:49:15.172 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-09-12T02:49:15.172 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-09-12T02:49:15.172 INFO:teuthology.orchestra.run.smithi039.stdout: "default_cephadm_command_timeout": { 2024-09-12T02:49:15.172 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "default_cephadm_command_timeout", 2024-09-12T02:49:15.172 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "int", 2024-09-12T02:49:15.172 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "advanced", 2024-09-12T02:49:15.173 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 0, 2024-09-12T02:49:15.173 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "900", 2024-09-12T02:49:15.173 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-09-12T02:49:15.173 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-09-12T02:49:15.173 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [], 2024-09-12T02:49:15.173 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "Default timeout applied to cephadm commands run directly on the host (in seconds)", 2024-09-12T02:49:15.173 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-09-12T02:49:15.173 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-09-12T02:49:15.173 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-09-12T02:49:15.173 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-09-12T02:49:15.173 INFO:teuthology.orchestra.run.smithi039.stdout: "default_registry": { 2024-09-12T02:49:15.173 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "default_registry", 2024-09-12T02:49:15.173 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "str", 2024-09-12T02:49:15.173 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "advanced", 2024-09-12T02:49:15.174 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 0, 2024-09-12T02:49:15.174 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "docker.io", 2024-09-12T02:49:15.174 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-09-12T02:49:15.174 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-09-12T02:49:15.174 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [], 2024-09-12T02:49:15.174 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "Search-registry to which we should normalize unqualified image names. This is not the default registry", 2024-09-12T02:49:15.174 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-09-12T02:49:15.174 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-09-12T02:49:15.174 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-09-12T02:49:15.174 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-09-12T02:49:15.174 INFO:teuthology.orchestra.run.smithi039.stdout: "device_cache_timeout": { 2024-09-12T02:49:15.174 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "device_cache_timeout", 2024-09-12T02:49:15.174 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "secs", 2024-09-12T02:49:15.175 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "advanced", 2024-09-12T02:49:15.175 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 0, 2024-09-12T02:49:15.175 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "1800", 2024-09-12T02:49:15.175 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-09-12T02:49:15.175 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-09-12T02:49:15.175 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [], 2024-09-12T02:49:15.175 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "seconds to cache device inventory", 2024-09-12T02:49:15.175 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-09-12T02:49:15.175 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-09-12T02:49:15.175 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-09-12T02:49:15.175 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-09-12T02:49:15.175 INFO:teuthology.orchestra.run.smithi039.stdout: "device_enhanced_scan": { 2024-09-12T02:49:15.175 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "device_enhanced_scan", 2024-09-12T02:49:15.176 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "bool", 2024-09-12T02:49:15.176 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "advanced", 2024-09-12T02:49:15.176 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 0, 2024-09-12T02:49:15.176 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "False", 2024-09-12T02:49:15.176 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-09-12T02:49:15.176 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-09-12T02:49:15.176 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [], 2024-09-12T02:49:15.176 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "Use libstoragemgmt during device scans", 2024-09-12T02:49:15.176 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-09-12T02:49:15.176 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-09-12T02:49:15.176 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-09-12T02:49:15.176 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-09-12T02:49:15.176 INFO:teuthology.orchestra.run.smithi039.stdout: "facts_cache_timeout": { 2024-09-12T02:49:15.176 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "facts_cache_timeout", 2024-09-12T02:49:15.177 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "secs", 2024-09-12T02:49:15.177 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "advanced", 2024-09-12T02:49:15.177 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 0, 2024-09-12T02:49:15.177 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "60", 2024-09-12T02:49:15.177 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-09-12T02:49:15.177 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-09-12T02:49:15.177 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [], 2024-09-12T02:49:15.177 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "seconds to cache host facts data", 2024-09-12T02:49:15.177 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-09-12T02:49:15.177 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-09-12T02:49:15.177 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-09-12T02:49:15.177 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-09-12T02:49:15.177 INFO:teuthology.orchestra.run.smithi039.stdout: "grafana_dashboards_path": { 2024-09-12T02:49:15.178 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "grafana_dashboards_path", 2024-09-12T02:49:15.178 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "str", 2024-09-12T02:49:15.178 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "advanced", 2024-09-12T02:49:15.178 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 0, 2024-09-12T02:49:15.178 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "/etc/grafana/dashboards/ceph-dashboard/", 2024-09-12T02:49:15.178 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-09-12T02:49:15.178 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-09-12T02:49:15.178 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [], 2024-09-12T02:49:15.178 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "location of dashboards to include in grafana deployments", 2024-09-12T02:49:15.178 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-09-12T02:49:15.178 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-09-12T02:49:15.178 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-09-12T02:49:15.178 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-09-12T02:49:15.178 INFO:teuthology.orchestra.run.smithi039.stdout: "host_check_interval": { 2024-09-12T02:49:15.178 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "host_check_interval", 2024-09-12T02:49:15.179 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "secs", 2024-09-12T02:49:15.179 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "advanced", 2024-09-12T02:49:15.179 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 0, 2024-09-12T02:49:15.179 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "600", 2024-09-12T02:49:15.179 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-09-12T02:49:15.179 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-09-12T02:49:15.179 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [], 2024-09-12T02:49:15.179 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "how frequently to perform a host check", 2024-09-12T02:49:15.179 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-09-12T02:49:15.179 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-09-12T02:49:15.179 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-09-12T02:49:15.179 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-09-12T02:49:15.179 INFO:teuthology.orchestra.run.smithi039.stdout: "hw_monitoring": { 2024-09-12T02:49:15.179 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "hw_monitoring", 2024-09-12T02:49:15.180 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "bool", 2024-09-12T02:49:15.180 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "advanced", 2024-09-12T02:49:15.180 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 0, 2024-09-12T02:49:15.180 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "False", 2024-09-12T02:49:15.180 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-09-12T02:49:15.180 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-09-12T02:49:15.180 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [], 2024-09-12T02:49:15.180 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "Deploy hw monitoring daemon on every host.", 2024-09-12T02:49:15.180 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-09-12T02:49:15.180 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-09-12T02:49:15.180 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-09-12T02:49:15.180 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-09-12T02:49:15.180 INFO:teuthology.orchestra.run.smithi039.stdout: "inventory_list_all": { 2024-09-12T02:49:15.181 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "inventory_list_all", 2024-09-12T02:49:15.181 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "bool", 2024-09-12T02:49:15.181 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "advanced", 2024-09-12T02:49:15.181 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 0, 2024-09-12T02:49:15.181 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "False", 2024-09-12T02:49:15.181 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-09-12T02:49:15.181 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-09-12T02:49:15.181 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [], 2024-09-12T02:49:15.181 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "Whether ceph-volume inventory should report more devices (mostly mappers (LVs / mpaths), partitions...)", 2024-09-12T02:49:15.181 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-09-12T02:49:15.181 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-09-12T02:49:15.181 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-09-12T02:49:15.181 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-09-12T02:49:15.181 INFO:teuthology.orchestra.run.smithi039.stdout: "log_level": { 2024-09-12T02:49:15.182 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "log_level", 2024-09-12T02:49:15.182 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "str", 2024-09-12T02:49:15.182 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "advanced", 2024-09-12T02:49:15.182 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 1, 2024-09-12T02:49:15.182 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "", 2024-09-12T02:49:15.182 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-09-12T02:49:15.182 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-09-12T02:49:15.182 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [ 2024-09-12T02:49:15.182 INFO:teuthology.orchestra.run.smithi039.stdout: "", 2024-09-12T02:49:15.182 INFO:teuthology.orchestra.run.smithi039.stdout: "critical", 2024-09-12T02:49:15.182 INFO:teuthology.orchestra.run.smithi039.stdout: "debug", 2024-09-12T02:49:15.182 INFO:teuthology.orchestra.run.smithi039.stdout: "error", 2024-09-12T02:49:15.182 INFO:teuthology.orchestra.run.smithi039.stdout: "info", 2024-09-12T02:49:15.183 INFO:teuthology.orchestra.run.smithi039.stdout: "warning" 2024-09-12T02:49:15.183 INFO:teuthology.orchestra.run.smithi039.stdout: ], 2024-09-12T02:49:15.183 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "", 2024-09-12T02:49:15.183 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-09-12T02:49:15.183 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-09-12T02:49:15.183 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-09-12T02:49:15.183 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-09-12T02:49:15.183 INFO:teuthology.orchestra.run.smithi039.stdout: "log_refresh_metadata": { 2024-09-12T02:49:15.183 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "log_refresh_metadata", 2024-09-12T02:49:15.183 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "bool", 2024-09-12T02:49:15.183 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "advanced", 2024-09-12T02:49:15.183 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 0, 2024-09-12T02:49:15.183 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "False", 2024-09-12T02:49:15.183 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-09-12T02:49:15.184 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-09-12T02:49:15.184 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [], 2024-09-12T02:49:15.184 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "Log all refresh metadata. Includes daemon, device, and host info collected regularly. Only has effect if logging at debug level", 2024-09-12T02:49:15.184 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-09-12T02:49:15.184 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-09-12T02:49:15.184 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-09-12T02:49:15.184 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-09-12T02:49:15.184 INFO:teuthology.orchestra.run.smithi039.stdout: "log_to_cluster": { 2024-09-12T02:49:15.184 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "log_to_cluster", 2024-09-12T02:49:15.184 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "bool", 2024-09-12T02:49:15.184 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "advanced", 2024-09-12T02:49:15.184 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 0, 2024-09-12T02:49:15.184 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "True", 2024-09-12T02:49:15.184 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-09-12T02:49:15.185 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-09-12T02:49:15.185 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [], 2024-09-12T02:49:15.185 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "log to the \"cephadm\" cluster log channel\"", 2024-09-12T02:49:15.185 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-09-12T02:49:15.185 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-09-12T02:49:15.185 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-09-12T02:49:15.185 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-09-12T02:49:15.185 INFO:teuthology.orchestra.run.smithi039.stdout: "log_to_cluster_level": { 2024-09-12T02:49:15.185 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "log_to_cluster_level", 2024-09-12T02:49:15.185 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "str", 2024-09-12T02:49:15.185 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "advanced", 2024-09-12T02:49:15.185 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 1, 2024-09-12T02:49:15.185 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "info", 2024-09-12T02:49:15.186 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-09-12T02:49:15.186 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-09-12T02:49:15.186 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [ 2024-09-12T02:49:15.186 INFO:teuthology.orchestra.run.smithi039.stdout: "", 2024-09-12T02:49:15.186 INFO:teuthology.orchestra.run.smithi039.stdout: "critical", 2024-09-12T02:49:15.186 INFO:teuthology.orchestra.run.smithi039.stdout: "debug", 2024-09-12T02:49:15.186 INFO:teuthology.orchestra.run.smithi039.stdout: "error", 2024-09-12T02:49:15.186 INFO:teuthology.orchestra.run.smithi039.stdout: "info", 2024-09-12T02:49:15.186 INFO:teuthology.orchestra.run.smithi039.stdout: "warning" 2024-09-12T02:49:15.186 INFO:teuthology.orchestra.run.smithi039.stdout: ], 2024-09-12T02:49:15.186 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "", 2024-09-12T02:49:15.186 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-09-12T02:49:15.186 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-09-12T02:49:15.187 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-09-12T02:49:15.187 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-09-12T02:49:15.187 INFO:teuthology.orchestra.run.smithi039.stdout: "log_to_file": { 2024-09-12T02:49:15.187 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "log_to_file", 2024-09-12T02:49:15.187 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "bool", 2024-09-12T02:49:15.187 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "advanced", 2024-09-12T02:49:15.187 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 1, 2024-09-12T02:49:15.187 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "False", 2024-09-12T02:49:15.187 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-09-12T02:49:15.187 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-09-12T02:49:15.187 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [], 2024-09-12T02:49:15.187 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "", 2024-09-12T02:49:15.187 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-09-12T02:49:15.187 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-09-12T02:49:15.188 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-09-12T02:49:15.188 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-09-12T02:49:15.188 INFO:teuthology.orchestra.run.smithi039.stdout: "manage_etc_ceph_ceph_conf": { 2024-09-12T02:49:15.188 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "manage_etc_ceph_ceph_conf", 2024-09-12T02:49:15.188 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "bool", 2024-09-12T02:49:15.188 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "advanced", 2024-09-12T02:49:15.188 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 0, 2024-09-12T02:49:15.188 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "False", 2024-09-12T02:49:15.188 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-09-12T02:49:15.188 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-09-12T02:49:15.188 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [], 2024-09-12T02:49:15.188 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "Manage and own /etc/ceph/ceph.conf on the hosts.", 2024-09-12T02:49:15.188 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-09-12T02:49:15.189 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-09-12T02:49:15.189 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-09-12T02:49:15.189 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-09-12T02:49:15.189 INFO:teuthology.orchestra.run.smithi039.stdout: "manage_etc_ceph_ceph_conf_hosts": { 2024-09-12T02:49:15.189 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "manage_etc_ceph_ceph_conf_hosts", 2024-09-12T02:49:15.189 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "str", 2024-09-12T02:49:15.189 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "advanced", 2024-09-12T02:49:15.189 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 0, 2024-09-12T02:49:15.189 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "*", 2024-09-12T02:49:15.189 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-09-12T02:49:15.189 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-09-12T02:49:15.189 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [], 2024-09-12T02:49:15.189 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "PlacementSpec describing on which hosts to manage /etc/ceph/ceph.conf", 2024-09-12T02:49:15.189 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-09-12T02:49:15.190 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-09-12T02:49:15.190 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-09-12T02:49:15.190 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-09-12T02:49:15.190 INFO:teuthology.orchestra.run.smithi039.stdout: "max_count_per_host": { 2024-09-12T02:49:15.190 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "max_count_per_host", 2024-09-12T02:49:15.190 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "int", 2024-09-12T02:49:15.190 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "advanced", 2024-09-12T02:49:15.190 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 0, 2024-09-12T02:49:15.190 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "10", 2024-09-12T02:49:15.190 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-09-12T02:49:15.190 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-09-12T02:49:15.190 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [], 2024-09-12T02:49:15.190 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "max number of daemons per service per host", 2024-09-12T02:49:15.191 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-09-12T02:49:15.191 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-09-12T02:49:15.191 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-09-12T02:49:15.191 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-09-12T02:49:15.191 INFO:teuthology.orchestra.run.smithi039.stdout: "max_osd_draining_count": { 2024-09-12T02:49:15.191 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "max_osd_draining_count", 2024-09-12T02:49:15.191 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "int", 2024-09-12T02:49:15.191 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "advanced", 2024-09-12T02:49:15.191 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 0, 2024-09-12T02:49:15.191 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "10", 2024-09-12T02:49:15.191 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-09-12T02:49:15.191 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-09-12T02:49:15.191 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [], 2024-09-12T02:49:15.192 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "max number of osds that will be drained simultaneously when osds are removed", 2024-09-12T02:49:15.192 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-09-12T02:49:15.192 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-09-12T02:49:15.192 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-09-12T02:49:15.192 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-09-12T02:49:15.192 INFO:teuthology.orchestra.run.smithi039.stdout: "migration_current": { 2024-09-12T02:49:15.192 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "migration_current", 2024-09-12T02:49:15.192 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "int", 2024-09-12T02:49:15.192 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "advanced", 2024-09-12T02:49:15.192 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 0, 2024-09-12T02:49:15.192 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "", 2024-09-12T02:49:15.192 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-09-12T02:49:15.192 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-09-12T02:49:15.193 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [], 2024-09-12T02:49:15.193 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "internal - do not modify", 2024-09-12T02:49:15.193 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-09-12T02:49:15.193 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-09-12T02:49:15.193 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-09-12T02:49:15.193 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-09-12T02:49:15.193 INFO:teuthology.orchestra.run.smithi039.stdout: "mode": { 2024-09-12T02:49:15.193 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "mode", 2024-09-12T02:49:15.193 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "str", 2024-09-12T02:49:15.193 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "advanced", 2024-09-12T02:49:15.193 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 0, 2024-09-12T02:49:15.193 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "root", 2024-09-12T02:49:15.193 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-09-12T02:49:15.193 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-09-12T02:49:15.194 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [ 2024-09-12T02:49:15.194 INFO:teuthology.orchestra.run.smithi039.stdout: "cephadm-package", 2024-09-12T02:49:15.194 INFO:teuthology.orchestra.run.smithi039.stdout: "root" 2024-09-12T02:49:15.194 INFO:teuthology.orchestra.run.smithi039.stdout: ], 2024-09-12T02:49:15.194 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "mode for remote execution of cephadm", 2024-09-12T02:49:15.194 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-09-12T02:49:15.194 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-09-12T02:49:15.194 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-09-12T02:49:15.194 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-09-12T02:49:15.194 INFO:teuthology.orchestra.run.smithi039.stdout: "oob_default_addr": { 2024-09-12T02:49:15.194 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "oob_default_addr", 2024-09-12T02:49:15.194 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "str", 2024-09-12T02:49:15.194 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "advanced", 2024-09-12T02:49:15.194 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 0, 2024-09-12T02:49:15.195 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "169.254.1.1", 2024-09-12T02:49:15.195 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-09-12T02:49:15.195 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-09-12T02:49:15.195 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [], 2024-09-12T02:49:15.195 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "Default address for RedFish API (oob management).", 2024-09-12T02:49:15.195 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-09-12T02:49:15.195 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-09-12T02:49:15.195 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-09-12T02:49:15.195 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-09-12T02:49:15.195 INFO:teuthology.orchestra.run.smithi039.stdout: "prometheus_alerts_path": { 2024-09-12T02:49:15.195 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "prometheus_alerts_path", 2024-09-12T02:49:15.195 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "str", 2024-09-12T02:49:15.195 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "advanced", 2024-09-12T02:49:15.196 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 0, 2024-09-12T02:49:15.196 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "/etc/prometheus/ceph/ceph_default_alerts.yml", 2024-09-12T02:49:15.196 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-09-12T02:49:15.196 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-09-12T02:49:15.196 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [], 2024-09-12T02:49:15.196 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "location of alerts to include in prometheus deployments", 2024-09-12T02:49:15.196 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-09-12T02:49:15.196 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-09-12T02:49:15.196 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-09-12T02:49:15.196 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-09-12T02:49:15.196 INFO:teuthology.orchestra.run.smithi039.stdout: "registry_insecure": { 2024-09-12T02:49:15.196 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "registry_insecure", 2024-09-12T02:49:15.196 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "bool", 2024-09-12T02:49:15.196 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "advanced", 2024-09-12T02:49:15.197 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 0, 2024-09-12T02:49:15.197 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "False", 2024-09-12T02:49:15.197 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-09-12T02:49:15.197 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-09-12T02:49:15.197 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [], 2024-09-12T02:49:15.197 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "Registry is to be considered insecure (no TLS available). Only for development purposes.", 2024-09-12T02:49:15.197 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-09-12T02:49:15.197 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-09-12T02:49:15.197 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-09-12T02:49:15.197 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-09-12T02:49:15.197 INFO:teuthology.orchestra.run.smithi039.stdout: "registry_password": { 2024-09-12T02:49:15.197 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "registry_password", 2024-09-12T02:49:15.197 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "str", 2024-09-12T02:49:15.198 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "advanced", 2024-09-12T02:49:15.198 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 0, 2024-09-12T02:49:15.198 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "", 2024-09-12T02:49:15.198 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-09-12T02:49:15.198 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-09-12T02:49:15.198 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [], 2024-09-12T02:49:15.198 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "Custom repository password. Only used for logging into a registry.", 2024-09-12T02:49:15.198 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-09-12T02:49:15.198 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-09-12T02:49:15.198 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-09-12T02:49:15.198 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-09-12T02:49:15.198 INFO:teuthology.orchestra.run.smithi039.stdout: "registry_url": { 2024-09-12T02:49:15.198 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "registry_url", 2024-09-12T02:49:15.198 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "str", 2024-09-12T02:49:15.199 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "advanced", 2024-09-12T02:49:15.199 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 0, 2024-09-12T02:49:15.199 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "", 2024-09-12T02:49:15.199 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-09-12T02:49:15.199 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-09-12T02:49:15.199 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [], 2024-09-12T02:49:15.199 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "Registry url for login purposes. This is not the default registry", 2024-09-12T02:49:15.199 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-09-12T02:49:15.199 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-09-12T02:49:15.199 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-09-12T02:49:15.199 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-09-12T02:49:15.199 INFO:teuthology.orchestra.run.smithi039.stdout: "registry_username": { 2024-09-12T02:49:15.199 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "registry_username", 2024-09-12T02:49:15.199 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "str", 2024-09-12T02:49:15.200 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "advanced", 2024-09-12T02:49:15.200 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 0, 2024-09-12T02:49:15.200 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "", 2024-09-12T02:49:15.200 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-09-12T02:49:15.200 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-09-12T02:49:15.200 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [], 2024-09-12T02:49:15.200 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "Custom repository username. Only used for logging into a registry.", 2024-09-12T02:49:15.200 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-09-12T02:49:15.200 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-09-12T02:49:15.200 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-09-12T02:49:15.200 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-09-12T02:49:15.200 INFO:teuthology.orchestra.run.smithi039.stdout: "secure_monitoring_stack": { 2024-09-12T02:49:15.200 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "secure_monitoring_stack", 2024-09-12T02:49:15.201 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "bool", 2024-09-12T02:49:15.201 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "advanced", 2024-09-12T02:49:15.201 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 0, 2024-09-12T02:49:15.201 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "False", 2024-09-12T02:49:15.201 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-09-12T02:49:15.201 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-09-12T02:49:15.201 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [], 2024-09-12T02:49:15.201 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "Enable TLS security for all the monitoring stack daemons", 2024-09-12T02:49:15.201 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-09-12T02:49:15.201 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-09-12T02:49:15.201 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-09-12T02:49:15.201 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-09-12T02:49:15.201 INFO:teuthology.orchestra.run.smithi039.stdout: "service_discovery_port": { 2024-09-12T02:49:15.202 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "service_discovery_port", 2024-09-12T02:49:15.202 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "int", 2024-09-12T02:49:15.202 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "advanced", 2024-09-12T02:49:15.202 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 0, 2024-09-12T02:49:15.202 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "8765", 2024-09-12T02:49:15.202 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-09-12T02:49:15.202 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-09-12T02:49:15.202 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [], 2024-09-12T02:49:15.202 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "cephadm service discovery port", 2024-09-12T02:49:15.202 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-09-12T02:49:15.202 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-09-12T02:49:15.202 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-09-12T02:49:15.202 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-09-12T02:49:15.203 INFO:teuthology.orchestra.run.smithi039.stdout: "ssh_config_file": { 2024-09-12T02:49:15.203 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "ssh_config_file", 2024-09-12T02:49:15.203 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "str", 2024-09-12T02:49:15.203 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "advanced", 2024-09-12T02:49:15.203 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 0, 2024-09-12T02:49:15.203 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "", 2024-09-12T02:49:15.203 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-09-12T02:49:15.203 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-09-12T02:49:15.203 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [], 2024-09-12T02:49:15.203 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "customized SSH config file to connect to managed hosts", 2024-09-12T02:49:15.203 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-09-12T02:49:15.203 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-09-12T02:49:15.203 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-09-12T02:49:15.203 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-09-12T02:49:15.204 INFO:teuthology.orchestra.run.smithi039.stdout: "use_agent": { 2024-09-12T02:49:15.204 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "use_agent", 2024-09-12T02:49:15.204 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "bool", 2024-09-12T02:49:15.204 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "advanced", 2024-09-12T02:49:15.204 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 0, 2024-09-12T02:49:15.204 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "False", 2024-09-12T02:49:15.204 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-09-12T02:49:15.204 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-09-12T02:49:15.204 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [], 2024-09-12T02:49:15.204 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "Use cephadm agent on each host to gather and send metadata", 2024-09-12T02:49:15.204 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-09-12T02:49:15.204 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-09-12T02:49:15.204 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-09-12T02:49:15.204 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-09-12T02:49:15.205 INFO:teuthology.orchestra.run.smithi039.stdout: "use_repo_digest": { 2024-09-12T02:49:15.205 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "use_repo_digest", 2024-09-12T02:49:15.205 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "bool", 2024-09-12T02:49:15.205 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "advanced", 2024-09-12T02:49:15.205 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 0, 2024-09-12T02:49:15.205 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "True", 2024-09-12T02:49:15.205 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-09-12T02:49:15.205 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-09-12T02:49:15.205 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [], 2024-09-12T02:49:15.205 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "Automatically convert image tags to image digest. Make sure all daemons use the same image", 2024-09-12T02:49:15.205 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-09-12T02:49:15.205 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-09-12T02:49:15.205 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-09-12T02:49:15.206 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-09-12T02:49:15.206 INFO:teuthology.orchestra.run.smithi039.stdout: "warn_on_failed_host_check": { 2024-09-12T02:49:15.206 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "warn_on_failed_host_check", 2024-09-12T02:49:15.206 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "bool", 2024-09-12T02:49:15.206 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "advanced", 2024-09-12T02:49:15.206 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 0, 2024-09-12T02:49:15.206 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "True", 2024-09-12T02:49:15.206 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-09-12T02:49:15.206 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-09-12T02:49:15.206 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [], 2024-09-12T02:49:15.206 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "raise a health warning if the host check fails", 2024-09-12T02:49:15.206 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-09-12T02:49:15.206 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-09-12T02:49:15.207 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-09-12T02:49:15.207 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-09-12T02:49:15.207 INFO:teuthology.orchestra.run.smithi039.stdout: "warn_on_stray_daemons": { 2024-09-12T02:49:15.207 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "warn_on_stray_daemons", 2024-09-12T02:49:15.207 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "bool", 2024-09-12T02:49:15.207 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "advanced", 2024-09-12T02:49:15.207 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 0, 2024-09-12T02:49:15.207 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "True", 2024-09-12T02:49:15.207 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-09-12T02:49:15.207 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-09-12T02:49:15.207 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [], 2024-09-12T02:49:15.207 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "raise a health warning if daemons are detected that are not managed by cephadm", 2024-09-12T02:49:15.207 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-09-12T02:49:15.207 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-09-12T02:49:15.208 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-09-12T02:49:15.208 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-09-12T02:49:15.208 INFO:teuthology.orchestra.run.smithi039.stdout: "warn_on_stray_hosts": { 2024-09-12T02:49:15.208 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "warn_on_stray_hosts", 2024-09-12T02:49:15.208 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "bool", 2024-09-12T02:49:15.208 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "advanced", 2024-09-12T02:49:15.208 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 0, 2024-09-12T02:49:15.208 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "True", 2024-09-12T02:49:15.208 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-09-12T02:49:15.208 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-09-12T02:49:15.208 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [], 2024-09-12T02:49:15.208 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "raise a health warning if daemons are detected on a host that is not managed by cephadm", 2024-09-12T02:49:15.208 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-09-12T02:49:15.208 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-09-12T02:49:15.209 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-09-12T02:49:15.209 INFO:teuthology.orchestra.run.smithi039.stdout: } 2024-09-12T02:49:15.209 INFO:teuthology.orchestra.run.smithi039.stdout: } 2024-09-12T02:49:15.209 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-09-12T02:49:15.209 INFO:teuthology.orchestra.run.smithi039.stdout: { 2024-09-12T02:49:15.209 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "crash", 2024-09-12T02:49:15.209 INFO:teuthology.orchestra.run.smithi039.stdout: "can_run": true, 2024-09-12T02:49:15.209 INFO:teuthology.orchestra.run.smithi039.stdout: "error_string": "", 2024-09-12T02:49:15.209 INFO:teuthology.orchestra.run.smithi039.stdout: "module_options": { 2024-09-12T02:49:15.209 INFO:teuthology.orchestra.run.smithi039.stdout: "log_level": { 2024-09-12T02:49:15.209 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "log_level", 2024-09-12T02:49:15.209 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "str", 2024-09-12T02:49:15.209 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "advanced", 2024-09-12T02:49:15.210 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 1, 2024-09-12T02:49:15.210 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "", 2024-09-12T02:49:15.210 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-09-12T02:49:15.210 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-09-12T02:49:15.210 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [ 2024-09-12T02:49:15.210 INFO:teuthology.orchestra.run.smithi039.stdout: "", 2024-09-12T02:49:15.210 INFO:teuthology.orchestra.run.smithi039.stdout: "critical", 2024-09-12T02:49:15.210 INFO:teuthology.orchestra.run.smithi039.stdout: "debug", 2024-09-12T02:49:15.210 INFO:teuthology.orchestra.run.smithi039.stdout: "error", 2024-09-12T02:49:15.210 INFO:teuthology.orchestra.run.smithi039.stdout: "info", 2024-09-12T02:49:15.210 INFO:teuthology.orchestra.run.smithi039.stdout: "warning" 2024-09-12T02:49:15.210 INFO:teuthology.orchestra.run.smithi039.stdout: ], 2024-09-12T02:49:15.210 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "", 2024-09-12T02:49:15.210 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-09-12T02:49:15.211 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-09-12T02:49:15.211 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-09-12T02:49:15.211 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-09-12T02:49:15.211 INFO:teuthology.orchestra.run.smithi039.stdout: "log_to_cluster": { 2024-09-12T02:49:15.211 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "log_to_cluster", 2024-09-12T02:49:15.211 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "bool", 2024-09-12T02:49:15.211 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "advanced", 2024-09-12T02:49:15.211 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 1, 2024-09-12T02:49:15.211 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "False", 2024-09-12T02:49:15.211 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-09-12T02:49:15.211 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-09-12T02:49:15.211 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [], 2024-09-12T02:49:15.211 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "", 2024-09-12T02:49:15.211 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-09-12T02:49:15.212 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-09-12T02:49:15.212 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-09-12T02:49:15.212 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-09-12T02:49:15.212 INFO:teuthology.orchestra.run.smithi039.stdout: "log_to_cluster_level": { 2024-09-12T02:49:15.212 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "log_to_cluster_level", 2024-09-12T02:49:15.212 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "str", 2024-09-12T02:49:15.212 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "advanced", 2024-09-12T02:49:15.212 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 1, 2024-09-12T02:49:15.212 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "info", 2024-09-12T02:49:15.212 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-09-12T02:49:15.212 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-09-12T02:49:15.212 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [ 2024-09-12T02:49:15.212 INFO:teuthology.orchestra.run.smithi039.stdout: "", 2024-09-12T02:49:15.212 INFO:teuthology.orchestra.run.smithi039.stdout: "critical", 2024-09-12T02:49:15.213 INFO:teuthology.orchestra.run.smithi039.stdout: "debug", 2024-09-12T02:49:15.213 INFO:teuthology.orchestra.run.smithi039.stdout: "error", 2024-09-12T02:49:15.213 INFO:teuthology.orchestra.run.smithi039.stdout: "info", 2024-09-12T02:49:15.213 INFO:teuthology.orchestra.run.smithi039.stdout: "warning" 2024-09-12T02:49:15.213 INFO:teuthology.orchestra.run.smithi039.stdout: ], 2024-09-12T02:49:15.213 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "", 2024-09-12T02:49:15.213 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-09-12T02:49:15.213 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-09-12T02:49:15.213 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-09-12T02:49:15.213 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-09-12T02:49:15.213 INFO:teuthology.orchestra.run.smithi039.stdout: "log_to_file": { 2024-09-12T02:49:15.213 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "log_to_file", 2024-09-12T02:49:15.213 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "bool", 2024-09-12T02:49:15.213 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "advanced", 2024-09-12T02:49:15.214 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 1, 2024-09-12T02:49:15.214 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "False", 2024-09-12T02:49:15.214 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-09-12T02:49:15.214 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-09-12T02:49:15.214 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [], 2024-09-12T02:49:15.214 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "", 2024-09-12T02:49:15.214 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-09-12T02:49:15.214 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-09-12T02:49:15.214 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-09-12T02:49:15.214 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-09-12T02:49:15.214 INFO:teuthology.orchestra.run.smithi039.stdout: "retain_interval": { 2024-09-12T02:49:15.214 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "retain_interval", 2024-09-12T02:49:15.214 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "secs", 2024-09-12T02:49:15.214 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "advanced", 2024-09-12T02:49:15.215 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 1, 2024-09-12T02:49:15.215 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "31536000", 2024-09-12T02:49:15.215 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-09-12T02:49:15.215 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-09-12T02:49:15.215 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [], 2024-09-12T02:49:15.215 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "how long to retain crashes before pruning them", 2024-09-12T02:49:15.215 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-09-12T02:49:15.215 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-09-12T02:49:15.215 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-09-12T02:49:15.215 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-09-12T02:49:15.215 INFO:teuthology.orchestra.run.smithi039.stdout: "warn_recent_interval": { 2024-09-12T02:49:15.215 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "warn_recent_interval", 2024-09-12T02:49:15.215 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "secs", 2024-09-12T02:49:15.215 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "advanced", 2024-09-12T02:49:15.215 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 1, 2024-09-12T02:49:15.216 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "1209600", 2024-09-12T02:49:15.216 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-09-12T02:49:15.216 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-09-12T02:49:15.216 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [], 2024-09-12T02:49:15.216 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "time interval in which to warn about recent crashes", 2024-09-12T02:49:15.216 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-09-12T02:49:15.216 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-09-12T02:49:15.216 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-09-12T02:49:15.216 INFO:teuthology.orchestra.run.smithi039.stdout: } 2024-09-12T02:49:15.216 INFO:teuthology.orchestra.run.smithi039.stdout: } 2024-09-12T02:49:15.216 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-09-12T02:49:15.216 INFO:teuthology.orchestra.run.smithi039.stdout: { 2024-09-12T02:49:15.216 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "dashboard", 2024-09-12T02:49:15.217 INFO:teuthology.orchestra.run.smithi039.stdout: "can_run": true, 2024-09-12T02:49:15.217 INFO:teuthology.orchestra.run.smithi039.stdout: "error_string": "", 2024-09-12T02:49:15.217 INFO:teuthology.orchestra.run.smithi039.stdout: "module_options": { 2024-09-12T02:49:15.217 INFO:teuthology.orchestra.run.smithi039.stdout: "ACCOUNT_LOCKOUT_ATTEMPTS": { 2024-09-12T02:49:15.217 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "ACCOUNT_LOCKOUT_ATTEMPTS", 2024-09-12T02:49:15.217 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "int", 2024-09-12T02:49:15.217 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "advanced", 2024-09-12T02:49:15.217 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 0, 2024-09-12T02:49:15.217 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "10", 2024-09-12T02:49:15.217 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-09-12T02:49:15.217 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-09-12T02:49:15.217 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [], 2024-09-12T02:49:15.217 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "", 2024-09-12T02:49:15.217 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-09-12T02:49:15.218 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-09-12T02:49:15.218 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-09-12T02:49:15.218 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-09-12T02:49:15.218 INFO:teuthology.orchestra.run.smithi039.stdout: "ALERTMANAGER_API_HOST": { 2024-09-12T02:49:15.218 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "ALERTMANAGER_API_HOST", 2024-09-12T02:49:15.218 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "str", 2024-09-12T02:49:15.218 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "advanced", 2024-09-12T02:49:15.218 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 0, 2024-09-12T02:49:15.218 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "", 2024-09-12T02:49:15.218 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-09-12T02:49:15.218 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-09-12T02:49:15.218 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [], 2024-09-12T02:49:15.218 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "", 2024-09-12T02:49:15.219 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-09-12T02:49:15.219 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-09-12T02:49:15.219 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-09-12T02:49:15.219 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-09-12T02:49:15.219 INFO:teuthology.orchestra.run.smithi039.stdout: "ALERTMANAGER_API_SSL_VERIFY": { 2024-09-12T02:49:15.219 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "ALERTMANAGER_API_SSL_VERIFY", 2024-09-12T02:49:15.219 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "bool", 2024-09-12T02:49:15.219 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "advanced", 2024-09-12T02:49:15.219 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 0, 2024-09-12T02:49:15.219 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "True", 2024-09-12T02:49:15.219 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-09-12T02:49:15.219 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-09-12T02:49:15.220 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [], 2024-09-12T02:49:15.220 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "", 2024-09-12T02:49:15.220 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-09-12T02:49:15.220 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-09-12T02:49:15.220 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-09-12T02:49:15.220 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-09-12T02:49:15.220 INFO:teuthology.orchestra.run.smithi039.stdout: "AUDIT_API_ENABLED": { 2024-09-12T02:49:15.220 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "AUDIT_API_ENABLED", 2024-09-12T02:49:15.220 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "bool", 2024-09-12T02:49:15.220 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "advanced", 2024-09-12T02:49:15.220 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 0, 2024-09-12T02:49:15.220 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "False", 2024-09-12T02:49:15.221 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-09-12T02:49:15.221 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-09-12T02:49:15.221 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [], 2024-09-12T02:49:15.221 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "", 2024-09-12T02:49:15.221 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-09-12T02:49:15.221 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-09-12T02:49:15.221 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-09-12T02:49:15.221 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-09-12T02:49:15.221 INFO:teuthology.orchestra.run.smithi039.stdout: "AUDIT_API_LOG_PAYLOAD": { 2024-09-12T02:49:15.221 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "AUDIT_API_LOG_PAYLOAD", 2024-09-12T02:49:15.221 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "bool", 2024-09-12T02:49:15.221 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "advanced", 2024-09-12T02:49:15.221 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 0, 2024-09-12T02:49:15.221 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "True", 2024-09-12T02:49:15.222 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-09-12T02:49:15.222 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-09-12T02:49:15.222 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [], 2024-09-12T02:49:15.222 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "", 2024-09-12T02:49:15.222 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-09-12T02:49:15.222 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-09-12T02:49:15.222 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-09-12T02:49:15.222 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-09-12T02:49:15.222 INFO:teuthology.orchestra.run.smithi039.stdout: "ENABLE_BROWSABLE_API": { 2024-09-12T02:49:15.222 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "ENABLE_BROWSABLE_API", 2024-09-12T02:49:15.222 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "bool", 2024-09-12T02:49:15.222 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "advanced", 2024-09-12T02:49:15.222 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 0, 2024-09-12T02:49:15.223 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "True", 2024-09-12T02:49:15.223 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-09-12T02:49:15.223 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-09-12T02:49:15.223 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [], 2024-09-12T02:49:15.223 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "", 2024-09-12T02:49:15.223 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-09-12T02:49:15.223 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-09-12T02:49:15.223 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-09-12T02:49:15.223 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-09-12T02:49:15.223 INFO:teuthology.orchestra.run.smithi039.stdout: "FEATURE_TOGGLE_CEPHFS": { 2024-09-12T02:49:15.223 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "FEATURE_TOGGLE_CEPHFS", 2024-09-12T02:49:15.223 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "bool", 2024-09-12T02:49:15.223 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "advanced", 2024-09-12T02:49:15.223 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 0, 2024-09-12T02:49:15.224 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "True", 2024-09-12T02:49:15.224 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-09-12T02:49:15.224 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-09-12T02:49:15.224 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [], 2024-09-12T02:49:15.224 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "", 2024-09-12T02:49:15.224 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-09-12T02:49:15.224 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-09-12T02:49:15.224 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-09-12T02:49:15.224 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-09-12T02:49:15.224 INFO:teuthology.orchestra.run.smithi039.stdout: "FEATURE_TOGGLE_DASHBOARD": { 2024-09-12T02:49:15.224 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "FEATURE_TOGGLE_DASHBOARD", 2024-09-12T02:49:15.224 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "bool", 2024-09-12T02:49:15.224 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "advanced", 2024-09-12T02:49:15.225 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 0, 2024-09-12T02:49:15.225 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "True", 2024-09-12T02:49:15.225 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-09-12T02:49:15.225 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-09-12T02:49:15.225 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [], 2024-09-12T02:49:15.225 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "", 2024-09-12T02:49:15.225 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-09-12T02:49:15.225 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-09-12T02:49:15.225 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-09-12T02:49:15.225 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-09-12T02:49:15.225 INFO:teuthology.orchestra.run.smithi039.stdout: "FEATURE_TOGGLE_ISCSI": { 2024-09-12T02:49:15.225 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "FEATURE_TOGGLE_ISCSI", 2024-09-12T02:49:15.226 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "bool", 2024-09-12T02:49:15.226 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "advanced", 2024-09-12T02:49:15.226 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 0, 2024-09-12T02:49:15.226 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "True", 2024-09-12T02:49:15.226 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-09-12T02:49:15.226 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-09-12T02:49:15.226 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [], 2024-09-12T02:49:15.226 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "", 2024-09-12T02:49:15.226 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-09-12T02:49:15.226 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-09-12T02:49:15.226 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-09-12T02:49:15.226 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-09-12T02:49:15.226 INFO:teuthology.orchestra.run.smithi039.stdout: "FEATURE_TOGGLE_MIRRORING": { 2024-09-12T02:49:15.227 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "FEATURE_TOGGLE_MIRRORING", 2024-09-12T02:49:15.227 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "bool", 2024-09-12T02:49:15.227 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "advanced", 2024-09-12T02:49:15.227 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 0, 2024-09-12T02:49:15.227 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "True", 2024-09-12T02:49:15.227 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-09-12T02:49:15.227 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-09-12T02:49:15.227 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [], 2024-09-12T02:49:15.227 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "", 2024-09-12T02:49:15.227 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-09-12T02:49:15.227 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-09-12T02:49:15.227 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-09-12T02:49:15.227 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-09-12T02:49:15.227 INFO:teuthology.orchestra.run.smithi039.stdout: "FEATURE_TOGGLE_NFS": { 2024-09-12T02:49:15.228 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "FEATURE_TOGGLE_NFS", 2024-09-12T02:49:15.228 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "bool", 2024-09-12T02:49:15.228 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "advanced", 2024-09-12T02:49:15.228 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 0, 2024-09-12T02:49:15.228 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "True", 2024-09-12T02:49:15.228 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-09-12T02:49:15.228 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-09-12T02:49:15.228 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [], 2024-09-12T02:49:15.228 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "", 2024-09-12T02:49:15.228 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-09-12T02:49:15.228 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-09-12T02:49:15.228 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-09-12T02:49:15.228 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-09-12T02:49:15.228 INFO:teuthology.orchestra.run.smithi039.stdout: "FEATURE_TOGGLE_RBD": { 2024-09-12T02:49:15.229 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "FEATURE_TOGGLE_RBD", 2024-09-12T02:49:15.229 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "bool", 2024-09-12T02:49:15.229 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "advanced", 2024-09-12T02:49:15.229 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 0, 2024-09-12T02:49:15.229 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "True", 2024-09-12T02:49:15.229 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-09-12T02:49:15.229 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-09-12T02:49:15.229 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [], 2024-09-12T02:49:15.229 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "", 2024-09-12T02:49:15.229 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-09-12T02:49:15.229 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-09-12T02:49:15.229 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-09-12T02:49:15.229 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-09-12T02:49:15.229 INFO:teuthology.orchestra.run.smithi039.stdout: "FEATURE_TOGGLE_RGW": { 2024-09-12T02:49:15.230 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "FEATURE_TOGGLE_RGW", 2024-09-12T02:49:15.230 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "bool", 2024-09-12T02:49:15.230 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "advanced", 2024-09-12T02:49:15.230 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 0, 2024-09-12T02:49:15.230 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "True", 2024-09-12T02:49:15.230 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-09-12T02:49:15.230 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-09-12T02:49:15.230 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [], 2024-09-12T02:49:15.230 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "", 2024-09-12T02:49:15.230 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-09-12T02:49:15.230 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-09-12T02:49:15.230 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-09-12T02:49:15.230 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-09-12T02:49:15.230 INFO:teuthology.orchestra.run.smithi039.stdout: "GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE": { 2024-09-12T02:49:15.231 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE", 2024-09-12T02:49:15.231 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "str", 2024-09-12T02:49:15.231 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "advanced", 2024-09-12T02:49:15.231 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 0, 2024-09-12T02:49:15.231 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "", 2024-09-12T02:49:15.231 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-09-12T02:49:15.231 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-09-12T02:49:15.231 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [], 2024-09-12T02:49:15.231 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "", 2024-09-12T02:49:15.231 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-09-12T02:49:15.231 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-09-12T02:49:15.231 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-09-12T02:49:15.231 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-09-12T02:49:15.231 INFO:teuthology.orchestra.run.smithi039.stdout: "GRAFANA_API_PASSWORD": { 2024-09-12T02:49:15.232 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "GRAFANA_API_PASSWORD", 2024-09-12T02:49:15.232 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "str", 2024-09-12T02:49:15.232 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "advanced", 2024-09-12T02:49:15.232 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 0, 2024-09-12T02:49:15.232 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "admin", 2024-09-12T02:49:15.232 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-09-12T02:49:15.232 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-09-12T02:49:15.232 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [], 2024-09-12T02:49:15.232 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "", 2024-09-12T02:49:15.232 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-09-12T02:49:15.232 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-09-12T02:49:15.232 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-09-12T02:49:15.232 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-09-12T02:49:15.232 INFO:teuthology.orchestra.run.smithi039.stdout: "GRAFANA_API_SSL_VERIFY": { 2024-09-12T02:49:15.233 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "GRAFANA_API_SSL_VERIFY", 2024-09-12T02:49:15.233 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "bool", 2024-09-12T02:49:15.233 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "advanced", 2024-09-12T02:49:15.233 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 0, 2024-09-12T02:49:15.233 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "True", 2024-09-12T02:49:15.233 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-09-12T02:49:15.233 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-09-12T02:49:15.233 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [], 2024-09-12T02:49:15.233 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "", 2024-09-12T02:49:15.233 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-09-12T02:49:15.233 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-09-12T02:49:15.233 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-09-12T02:49:15.233 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-09-12T02:49:15.233 INFO:teuthology.orchestra.run.smithi039.stdout: "GRAFANA_API_URL": { 2024-09-12T02:49:15.234 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "GRAFANA_API_URL", 2024-09-12T02:49:15.234 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "str", 2024-09-12T02:49:15.234 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "advanced", 2024-09-12T02:49:15.234 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 0, 2024-09-12T02:49:15.234 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "", 2024-09-12T02:49:15.234 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-09-12T02:49:15.234 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-09-12T02:49:15.234 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [], 2024-09-12T02:49:15.234 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "", 2024-09-12T02:49:15.234 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-09-12T02:49:15.234 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-09-12T02:49:15.234 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-09-12T02:49:15.234 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-09-12T02:49:15.235 INFO:teuthology.orchestra.run.smithi039.stdout: "GRAFANA_API_USERNAME": { 2024-09-12T02:49:15.235 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "GRAFANA_API_USERNAME", 2024-09-12T02:49:15.235 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "str", 2024-09-12T02:49:15.235 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "advanced", 2024-09-12T02:49:15.235 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 0, 2024-09-12T02:49:15.235 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "admin", 2024-09-12T02:49:15.235 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-09-12T02:49:15.235 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-09-12T02:49:15.235 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [], 2024-09-12T02:49:15.235 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "", 2024-09-12T02:49:15.235 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-09-12T02:49:15.235 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-09-12T02:49:15.235 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-09-12T02:49:15.235 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-09-12T02:49:15.236 INFO:teuthology.orchestra.run.smithi039.stdout: "GRAFANA_FRONTEND_API_URL": { 2024-09-12T02:49:15.236 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "GRAFANA_FRONTEND_API_URL", 2024-09-12T02:49:15.236 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "str", 2024-09-12T02:49:15.236 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "advanced", 2024-09-12T02:49:15.236 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 0, 2024-09-12T02:49:15.236 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "", 2024-09-12T02:49:15.236 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-09-12T02:49:15.236 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-09-12T02:49:15.236 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [], 2024-09-12T02:49:15.236 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "", 2024-09-12T02:49:15.236 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-09-12T02:49:15.236 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-09-12T02:49:15.236 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-09-12T02:49:15.237 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-09-12T02:49:15.237 INFO:teuthology.orchestra.run.smithi039.stdout: "GRAFANA_UPDATE_DASHBOARDS": { 2024-09-12T02:49:15.237 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "GRAFANA_UPDATE_DASHBOARDS", 2024-09-12T02:49:15.237 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "bool", 2024-09-12T02:49:15.237 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "advanced", 2024-09-12T02:49:15.237 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 0, 2024-09-12T02:49:15.237 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "False", 2024-09-12T02:49:15.237 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-09-12T02:49:15.237 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-09-12T02:49:15.237 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [], 2024-09-12T02:49:15.237 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "", 2024-09-12T02:49:15.237 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-09-12T02:49:15.237 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-09-12T02:49:15.238 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-09-12T02:49:15.238 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-09-12T02:49:15.238 INFO:teuthology.orchestra.run.smithi039.stdout: "ISCSI_API_SSL_VERIFICATION": { 2024-09-12T02:49:15.238 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "ISCSI_API_SSL_VERIFICATION", 2024-09-12T02:49:15.238 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "bool", 2024-09-12T02:49:15.238 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "advanced", 2024-09-12T02:49:15.238 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 0, 2024-09-12T02:49:15.238 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "True", 2024-09-12T02:49:15.238 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-09-12T02:49:15.238 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-09-12T02:49:15.238 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [], 2024-09-12T02:49:15.238 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "", 2024-09-12T02:49:15.238 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-09-12T02:49:15.238 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-09-12T02:49:15.239 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-09-12T02:49:15.239 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-09-12T02:49:15.239 INFO:teuthology.orchestra.run.smithi039.stdout: "ISSUE_TRACKER_API_KEY": { 2024-09-12T02:49:15.239 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "ISSUE_TRACKER_API_KEY", 2024-09-12T02:49:15.239 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "str", 2024-09-12T02:49:15.239 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "advanced", 2024-09-12T02:49:15.239 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 0, 2024-09-12T02:49:15.239 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "", 2024-09-12T02:49:15.239 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-09-12T02:49:15.239 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-09-12T02:49:15.239 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [], 2024-09-12T02:49:15.239 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "", 2024-09-12T02:49:15.239 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-09-12T02:49:15.240 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-09-12T02:49:15.240 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-09-12T02:49:15.240 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-09-12T02:49:15.240 INFO:teuthology.orchestra.run.smithi039.stdout: "PROMETHEUS_API_HOST": { 2024-09-12T02:49:15.240 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "PROMETHEUS_API_HOST", 2024-09-12T02:49:15.240 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "str", 2024-09-12T02:49:15.240 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "advanced", 2024-09-12T02:49:15.240 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 0, 2024-09-12T02:49:15.240 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "", 2024-09-12T02:49:15.240 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-09-12T02:49:15.240 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-09-12T02:49:15.240 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [], 2024-09-12T02:49:15.240 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "", 2024-09-12T02:49:15.241 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-09-12T02:49:15.241 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-09-12T02:49:15.241 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-09-12T02:49:15.241 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-09-12T02:49:15.241 INFO:teuthology.orchestra.run.smithi039.stdout: "PROMETHEUS_API_SSL_VERIFY": { 2024-09-12T02:49:15.241 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "PROMETHEUS_API_SSL_VERIFY", 2024-09-12T02:49:15.241 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "bool", 2024-09-12T02:49:15.241 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "advanced", 2024-09-12T02:49:15.241 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 0, 2024-09-12T02:49:15.241 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "True", 2024-09-12T02:49:15.241 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-09-12T02:49:15.241 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-09-12T02:49:15.241 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [], 2024-09-12T02:49:15.241 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "", 2024-09-12T02:49:15.242 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-09-12T02:49:15.242 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-09-12T02:49:15.242 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-09-12T02:49:15.242 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-09-12T02:49:15.242 INFO:teuthology.orchestra.run.smithi039.stdout: "PWD_POLICY_CHECK_COMPLEXITY_ENABLED": { 2024-09-12T02:49:15.242 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "PWD_POLICY_CHECK_COMPLEXITY_ENABLED", 2024-09-12T02:49:15.242 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "bool", 2024-09-12T02:49:15.242 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "advanced", 2024-09-12T02:49:15.242 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 0, 2024-09-12T02:49:15.242 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "False", 2024-09-12T02:49:15.242 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-09-12T02:49:15.242 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-09-12T02:49:15.242 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [], 2024-09-12T02:49:15.243 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "", 2024-09-12T02:49:15.243 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-09-12T02:49:15.243 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-09-12T02:49:15.243 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-09-12T02:49:15.243 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-09-12T02:49:15.243 INFO:teuthology.orchestra.run.smithi039.stdout: "PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED": { 2024-09-12T02:49:15.243 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED", 2024-09-12T02:49:15.243 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "bool", 2024-09-12T02:49:15.243 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "advanced", 2024-09-12T02:49:15.243 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 0, 2024-09-12T02:49:15.243 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "False", 2024-09-12T02:49:15.243 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-09-12T02:49:15.243 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-09-12T02:49:15.243 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [], 2024-09-12T02:49:15.244 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "", 2024-09-12T02:49:15.244 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-09-12T02:49:15.244 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-09-12T02:49:15.244 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-09-12T02:49:15.244 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-09-12T02:49:15.244 INFO:teuthology.orchestra.run.smithi039.stdout: "PWD_POLICY_CHECK_LENGTH_ENABLED": { 2024-09-12T02:49:15.244 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "PWD_POLICY_CHECK_LENGTH_ENABLED", 2024-09-12T02:49:15.244 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "bool", 2024-09-12T02:49:15.244 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "advanced", 2024-09-12T02:49:15.244 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 0, 2024-09-12T02:49:15.244 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "True", 2024-09-12T02:49:15.244 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-09-12T02:49:15.244 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-09-12T02:49:15.244 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [], 2024-09-12T02:49:15.245 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "", 2024-09-12T02:49:15.245 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-09-12T02:49:15.245 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-09-12T02:49:15.245 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-09-12T02:49:15.245 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-09-12T02:49:15.245 INFO:teuthology.orchestra.run.smithi039.stdout: "PWD_POLICY_CHECK_OLDPWD_ENABLED": { 2024-09-12T02:49:15.245 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "PWD_POLICY_CHECK_OLDPWD_ENABLED", 2024-09-12T02:49:15.245 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "bool", 2024-09-12T02:49:15.245 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "advanced", 2024-09-12T02:49:15.245 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 0, 2024-09-12T02:49:15.245 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "True", 2024-09-12T02:49:15.245 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-09-12T02:49:15.245 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-09-12T02:49:15.245 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [], 2024-09-12T02:49:15.246 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "", 2024-09-12T02:49:15.246 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-09-12T02:49:15.246 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-09-12T02:49:15.246 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-09-12T02:49:15.246 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-09-12T02:49:15.246 INFO:teuthology.orchestra.run.smithi039.stdout: "PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED": { 2024-09-12T02:49:15.246 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED", 2024-09-12T02:49:15.246 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "bool", 2024-09-12T02:49:15.246 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "advanced", 2024-09-12T02:49:15.246 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 0, 2024-09-12T02:49:15.246 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "False", 2024-09-12T02:49:15.246 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-09-12T02:49:15.246 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-09-12T02:49:15.246 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [], 2024-09-12T02:49:15.247 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "", 2024-09-12T02:49:15.247 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-09-12T02:49:15.247 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-09-12T02:49:15.247 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-09-12T02:49:15.247 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-09-12T02:49:15.247 INFO:teuthology.orchestra.run.smithi039.stdout: "PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED": { 2024-09-12T02:49:15.247 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED", 2024-09-12T02:49:15.247 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "bool", 2024-09-12T02:49:15.247 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "advanced", 2024-09-12T02:49:15.247 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 0, 2024-09-12T02:49:15.247 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "False", 2024-09-12T02:49:15.247 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-09-12T02:49:15.247 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-09-12T02:49:15.247 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [], 2024-09-12T02:49:15.248 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "", 2024-09-12T02:49:15.248 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-09-12T02:49:15.248 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-09-12T02:49:15.248 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-09-12T02:49:15.248 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-09-12T02:49:15.248 INFO:teuthology.orchestra.run.smithi039.stdout: "PWD_POLICY_CHECK_USERNAME_ENABLED": { 2024-09-12T02:49:15.248 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "PWD_POLICY_CHECK_USERNAME_ENABLED", 2024-09-12T02:49:15.248 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "bool", 2024-09-12T02:49:15.248 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "advanced", 2024-09-12T02:49:15.248 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 0, 2024-09-12T02:49:15.248 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "False", 2024-09-12T02:49:15.248 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-09-12T02:49:15.248 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-09-12T02:49:15.248 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [], 2024-09-12T02:49:15.249 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "", 2024-09-12T02:49:15.249 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-09-12T02:49:15.249 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-09-12T02:49:15.249 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-09-12T02:49:15.249 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-09-12T02:49:15.249 INFO:teuthology.orchestra.run.smithi039.stdout: "PWD_POLICY_ENABLED": { 2024-09-12T02:49:15.249 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "PWD_POLICY_ENABLED", 2024-09-12T02:49:15.249 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "bool", 2024-09-12T02:49:15.249 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "advanced", 2024-09-12T02:49:15.249 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 0, 2024-09-12T02:49:15.249 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "True", 2024-09-12T02:49:15.249 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-09-12T02:49:15.249 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-09-12T02:49:15.249 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [], 2024-09-12T02:49:15.250 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "", 2024-09-12T02:49:15.250 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-09-12T02:49:15.250 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-09-12T02:49:15.250 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-09-12T02:49:15.250 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-09-12T02:49:15.250 INFO:teuthology.orchestra.run.smithi039.stdout: "PWD_POLICY_EXCLUSION_LIST": { 2024-09-12T02:49:15.250 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "PWD_POLICY_EXCLUSION_LIST", 2024-09-12T02:49:15.250 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "str", 2024-09-12T02:49:15.250 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "advanced", 2024-09-12T02:49:15.250 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 0, 2024-09-12T02:49:15.250 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "osd,host,dashboard,pool,block,nfs,ceph,monitors,gateway,logs,crush,maps", 2024-09-12T02:49:15.250 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-09-12T02:49:15.250 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-09-12T02:49:15.250 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [], 2024-09-12T02:49:15.251 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "", 2024-09-12T02:49:15.251 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-09-12T02:49:15.251 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-09-12T02:49:15.251 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-09-12T02:49:15.251 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-09-12T02:49:15.251 INFO:teuthology.orchestra.run.smithi039.stdout: "PWD_POLICY_MIN_COMPLEXITY": { 2024-09-12T02:49:15.251 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "PWD_POLICY_MIN_COMPLEXITY", 2024-09-12T02:49:15.251 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "int", 2024-09-12T02:49:15.251 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "advanced", 2024-09-12T02:49:15.251 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 0, 2024-09-12T02:49:15.251 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "10", 2024-09-12T02:49:15.251 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-09-12T02:49:15.251 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-09-12T02:49:15.252 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [], 2024-09-12T02:49:15.252 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "", 2024-09-12T02:49:15.252 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-09-12T02:49:15.252 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-09-12T02:49:15.252 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-09-12T02:49:15.252 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-09-12T02:49:15.252 INFO:teuthology.orchestra.run.smithi039.stdout: "PWD_POLICY_MIN_LENGTH": { 2024-09-12T02:49:15.252 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "PWD_POLICY_MIN_LENGTH", 2024-09-12T02:49:15.252 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "int", 2024-09-12T02:49:15.252 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "advanced", 2024-09-12T02:49:15.252 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 0, 2024-09-12T02:49:15.252 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "8", 2024-09-12T02:49:15.252 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-09-12T02:49:15.252 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-09-12T02:49:15.253 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [], 2024-09-12T02:49:15.253 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "", 2024-09-12T02:49:15.253 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-09-12T02:49:15.253 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-09-12T02:49:15.253 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-09-12T02:49:15.253 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-09-12T02:49:15.253 INFO:teuthology.orchestra.run.smithi039.stdout: "REST_REQUESTS_TIMEOUT": { 2024-09-12T02:49:15.253 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "REST_REQUESTS_TIMEOUT", 2024-09-12T02:49:15.253 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "int", 2024-09-12T02:49:15.253 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "advanced", 2024-09-12T02:49:15.253 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 0, 2024-09-12T02:49:15.253 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "45", 2024-09-12T02:49:15.253 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-09-12T02:49:15.254 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-09-12T02:49:15.254 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [], 2024-09-12T02:49:15.254 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "", 2024-09-12T02:49:15.254 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-09-12T02:49:15.254 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-09-12T02:49:15.254 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-09-12T02:49:15.254 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-09-12T02:49:15.254 INFO:teuthology.orchestra.run.smithi039.stdout: "RGW_API_ACCESS_KEY": { 2024-09-12T02:49:15.254 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "RGW_API_ACCESS_KEY", 2024-09-12T02:49:15.254 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "str", 2024-09-12T02:49:15.254 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "advanced", 2024-09-12T02:49:15.254 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 0, 2024-09-12T02:49:15.254 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "", 2024-09-12T02:49:15.255 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-09-12T02:49:15.255 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-09-12T02:49:15.255 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [], 2024-09-12T02:49:15.255 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "", 2024-09-12T02:49:15.255 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-09-12T02:49:15.255 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-09-12T02:49:15.255 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-09-12T02:49:15.255 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-09-12T02:49:15.255 INFO:teuthology.orchestra.run.smithi039.stdout: "RGW_API_ADMIN_RESOURCE": { 2024-09-12T02:49:15.255 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "RGW_API_ADMIN_RESOURCE", 2024-09-12T02:49:15.255 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "str", 2024-09-12T02:49:15.255 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "advanced", 2024-09-12T02:49:15.256 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 0, 2024-09-12T02:49:15.256 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "admin", 2024-09-12T02:49:15.256 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-09-12T02:49:15.256 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-09-12T02:49:15.256 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [], 2024-09-12T02:49:15.256 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "", 2024-09-12T02:49:15.256 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-09-12T02:49:15.256 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-09-12T02:49:15.256 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-09-12T02:49:15.256 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-09-12T02:49:15.256 INFO:teuthology.orchestra.run.smithi039.stdout: "RGW_API_SECRET_KEY": { 2024-09-12T02:49:15.256 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "RGW_API_SECRET_KEY", 2024-09-12T02:49:15.256 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "str", 2024-09-12T02:49:15.257 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "advanced", 2024-09-12T02:49:15.257 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 0, 2024-09-12T02:49:15.257 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "", 2024-09-12T02:49:15.257 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-09-12T02:49:15.257 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-09-12T02:49:15.257 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [], 2024-09-12T02:49:15.257 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "", 2024-09-12T02:49:15.257 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-09-12T02:49:15.257 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-09-12T02:49:15.257 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-09-12T02:49:15.257 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-09-12T02:49:15.257 INFO:teuthology.orchestra.run.smithi039.stdout: "RGW_API_SSL_VERIFY": { 2024-09-12T02:49:15.257 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "RGW_API_SSL_VERIFY", 2024-09-12T02:49:15.258 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "bool", 2024-09-12T02:49:15.258 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "advanced", 2024-09-12T02:49:15.258 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 0, 2024-09-12T02:49:15.258 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "True", 2024-09-12T02:49:15.258 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-09-12T02:49:15.258 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-09-12T02:49:15.258 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [], 2024-09-12T02:49:15.258 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "", 2024-09-12T02:49:15.258 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-09-12T02:49:15.258 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-09-12T02:49:15.258 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-09-12T02:49:15.258 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-09-12T02:49:15.258 INFO:teuthology.orchestra.run.smithi039.stdout: "USER_PWD_EXPIRATION_SPAN": { 2024-09-12T02:49:15.258 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "USER_PWD_EXPIRATION_SPAN", 2024-09-12T02:49:15.259 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "int", 2024-09-12T02:49:15.259 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "advanced", 2024-09-12T02:49:15.259 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 0, 2024-09-12T02:49:15.259 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "0", 2024-09-12T02:49:15.259 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-09-12T02:49:15.259 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-09-12T02:49:15.259 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [], 2024-09-12T02:49:15.259 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "", 2024-09-12T02:49:15.259 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-09-12T02:49:15.259 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-09-12T02:49:15.259 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-09-12T02:49:15.259 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-09-12T02:49:15.259 INFO:teuthology.orchestra.run.smithi039.stdout: "USER_PWD_EXPIRATION_WARNING_1": { 2024-09-12T02:49:15.260 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "USER_PWD_EXPIRATION_WARNING_1", 2024-09-12T02:49:15.260 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "int", 2024-09-12T02:49:15.260 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "advanced", 2024-09-12T02:49:15.260 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 0, 2024-09-12T02:49:15.260 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "10", 2024-09-12T02:49:15.260 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-09-12T02:49:15.260 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-09-12T02:49:15.260 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [], 2024-09-12T02:49:15.260 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "", 2024-09-12T02:49:15.260 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-09-12T02:49:15.260 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-09-12T02:49:15.260 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-09-12T02:49:15.260 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-09-12T02:49:15.261 INFO:teuthology.orchestra.run.smithi039.stdout: "USER_PWD_EXPIRATION_WARNING_2": { 2024-09-12T02:49:15.261 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "USER_PWD_EXPIRATION_WARNING_2", 2024-09-12T02:49:15.261 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "int", 2024-09-12T02:49:15.261 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "advanced", 2024-09-12T02:49:15.261 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 0, 2024-09-12T02:49:15.261 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "5", 2024-09-12T02:49:15.261 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-09-12T02:49:15.261 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-09-12T02:49:15.261 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [], 2024-09-12T02:49:15.261 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "", 2024-09-12T02:49:15.261 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-09-12T02:49:15.261 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-09-12T02:49:15.261 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-09-12T02:49:15.262 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-09-12T02:49:15.262 INFO:teuthology.orchestra.run.smithi039.stdout: "cross_origin_url": { 2024-09-12T02:49:15.262 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "cross_origin_url", 2024-09-12T02:49:15.262 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "str", 2024-09-12T02:49:15.262 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "advanced", 2024-09-12T02:49:15.262 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 0, 2024-09-12T02:49:15.262 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "", 2024-09-12T02:49:15.262 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-09-12T02:49:15.262 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-09-12T02:49:15.262 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [], 2024-09-12T02:49:15.262 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "", 2024-09-12T02:49:15.262 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-09-12T02:49:15.262 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-09-12T02:49:15.263 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-09-12T02:49:15.263 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-09-12T02:49:15.263 INFO:teuthology.orchestra.run.smithi039.stdout: "crt_file": { 2024-09-12T02:49:15.263 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "crt_file", 2024-09-12T02:49:15.263 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "str", 2024-09-12T02:49:15.263 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "advanced", 2024-09-12T02:49:15.263 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 0, 2024-09-12T02:49:15.263 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "", 2024-09-12T02:49:15.263 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-09-12T02:49:15.263 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-09-12T02:49:15.263 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [], 2024-09-12T02:49:15.263 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "", 2024-09-12T02:49:15.263 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-09-12T02:49:15.264 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-09-12T02:49:15.264 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-09-12T02:49:15.264 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-09-12T02:49:15.264 INFO:teuthology.orchestra.run.smithi039.stdout: "debug": { 2024-09-12T02:49:15.264 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "debug", 2024-09-12T02:49:15.264 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "bool", 2024-09-12T02:49:15.264 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "advanced", 2024-09-12T02:49:15.264 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 0, 2024-09-12T02:49:15.264 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "False", 2024-09-12T02:49:15.264 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-09-12T02:49:15.264 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-09-12T02:49:15.264 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [], 2024-09-12T02:49:15.264 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "Enable/disable debug options", 2024-09-12T02:49:15.265 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-09-12T02:49:15.265 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-09-12T02:49:15.265 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-09-12T02:49:15.265 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-09-12T02:49:15.265 INFO:teuthology.orchestra.run.smithi039.stdout: "jwt_token_ttl": { 2024-09-12T02:49:15.265 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "jwt_token_ttl", 2024-09-12T02:49:15.265 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "int", 2024-09-12T02:49:15.265 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "advanced", 2024-09-12T02:49:15.265 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 0, 2024-09-12T02:49:15.265 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "28800", 2024-09-12T02:49:15.265 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-09-12T02:49:15.265 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-09-12T02:49:15.265 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [], 2024-09-12T02:49:15.265 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "", 2024-09-12T02:49:15.266 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-09-12T02:49:15.266 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-09-12T02:49:15.266 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-09-12T02:49:15.266 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-09-12T02:49:15.266 INFO:teuthology.orchestra.run.smithi039.stdout: "key_file": { 2024-09-12T02:49:15.266 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "key_file", 2024-09-12T02:49:15.266 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "str", 2024-09-12T02:49:15.266 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "advanced", 2024-09-12T02:49:15.266 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 0, 2024-09-12T02:49:15.266 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "", 2024-09-12T02:49:15.266 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-09-12T02:49:15.266 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-09-12T02:49:15.266 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [], 2024-09-12T02:49:15.266 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "", 2024-09-12T02:49:15.267 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-09-12T02:49:15.267 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-09-12T02:49:15.267 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-09-12T02:49:15.267 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-09-12T02:49:15.267 INFO:teuthology.orchestra.run.smithi039.stdout: "log_level": { 2024-09-12T02:49:15.267 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "log_level", 2024-09-12T02:49:15.267 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "str", 2024-09-12T02:49:15.267 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "advanced", 2024-09-12T02:49:15.267 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 1, 2024-09-12T02:49:15.267 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "", 2024-09-12T02:49:15.267 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-09-12T02:49:15.267 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-09-12T02:49:15.267 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [ 2024-09-12T02:49:15.268 INFO:teuthology.orchestra.run.smithi039.stdout: "", 2024-09-12T02:49:15.268 INFO:teuthology.orchestra.run.smithi039.stdout: "critical", 2024-09-12T02:49:15.268 INFO:teuthology.orchestra.run.smithi039.stdout: "debug", 2024-09-12T02:49:15.268 INFO:teuthology.orchestra.run.smithi039.stdout: "error", 2024-09-12T02:49:15.268 INFO:teuthology.orchestra.run.smithi039.stdout: "info", 2024-09-12T02:49:15.268 INFO:teuthology.orchestra.run.smithi039.stdout: "warning" 2024-09-12T02:49:15.268 INFO:teuthology.orchestra.run.smithi039.stdout: ], 2024-09-12T02:49:15.268 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "", 2024-09-12T02:49:15.268 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-09-12T02:49:15.268 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-09-12T02:49:15.268 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-09-12T02:49:15.268 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-09-12T02:49:15.268 INFO:teuthology.orchestra.run.smithi039.stdout: "log_to_cluster": { 2024-09-12T02:49:15.268 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "log_to_cluster", 2024-09-12T02:49:15.269 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "bool", 2024-09-12T02:49:15.269 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "advanced", 2024-09-12T02:49:15.269 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 1, 2024-09-12T02:49:15.269 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "False", 2024-09-12T02:49:15.269 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-09-12T02:49:15.269 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-09-12T02:49:15.269 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [], 2024-09-12T02:49:15.269 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "", 2024-09-12T02:49:15.269 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-09-12T02:49:15.269 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-09-12T02:49:15.269 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-09-12T02:49:15.269 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-09-12T02:49:15.269 INFO:teuthology.orchestra.run.smithi039.stdout: "log_to_cluster_level": { 2024-09-12T02:49:15.270 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "log_to_cluster_level", 2024-09-12T02:49:15.270 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "str", 2024-09-12T02:49:15.270 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "advanced", 2024-09-12T02:49:15.270 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 1, 2024-09-12T02:49:15.270 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "info", 2024-09-12T02:49:15.270 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-09-12T02:49:15.270 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-09-12T02:49:15.270 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [ 2024-09-12T02:49:15.270 INFO:teuthology.orchestra.run.smithi039.stdout: "", 2024-09-12T02:49:15.270 INFO:teuthology.orchestra.run.smithi039.stdout: "critical", 2024-09-12T02:49:15.270 INFO:teuthology.orchestra.run.smithi039.stdout: "debug", 2024-09-12T02:49:15.270 INFO:teuthology.orchestra.run.smithi039.stdout: "error", 2024-09-12T02:49:15.270 INFO:teuthology.orchestra.run.smithi039.stdout: "info", 2024-09-12T02:49:15.270 INFO:teuthology.orchestra.run.smithi039.stdout: "warning" 2024-09-12T02:49:15.271 INFO:teuthology.orchestra.run.smithi039.stdout: ], 2024-09-12T02:49:15.271 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "", 2024-09-12T02:49:15.271 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-09-12T02:49:15.271 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-09-12T02:49:15.271 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-09-12T02:49:15.271 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-09-12T02:49:15.271 INFO:teuthology.orchestra.run.smithi039.stdout: "log_to_file": { 2024-09-12T02:49:15.271 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "log_to_file", 2024-09-12T02:49:15.271 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "bool", 2024-09-12T02:49:15.271 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "advanced", 2024-09-12T02:49:15.271 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 1, 2024-09-12T02:49:15.271 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "False", 2024-09-12T02:49:15.271 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-09-12T02:49:15.271 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-09-12T02:49:15.272 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [], 2024-09-12T02:49:15.272 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "", 2024-09-12T02:49:15.272 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-09-12T02:49:15.272 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-09-12T02:49:15.272 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-09-12T02:49:15.272 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-09-12T02:49:15.272 INFO:teuthology.orchestra.run.smithi039.stdout: "motd": { 2024-09-12T02:49:15.272 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "motd", 2024-09-12T02:49:15.272 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "str", 2024-09-12T02:49:15.272 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "advanced", 2024-09-12T02:49:15.272 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 0, 2024-09-12T02:49:15.272 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "", 2024-09-12T02:49:15.272 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-09-12T02:49:15.273 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-09-12T02:49:15.273 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [], 2024-09-12T02:49:15.273 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "The message of the day", 2024-09-12T02:49:15.273 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-09-12T02:49:15.273 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-09-12T02:49:15.273 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-09-12T02:49:15.273 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-09-12T02:49:15.273 INFO:teuthology.orchestra.run.smithi039.stdout: "redirect_resolve_ip_addr": { 2024-09-12T02:49:15.273 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "redirect_resolve_ip_addr", 2024-09-12T02:49:15.273 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "bool", 2024-09-12T02:49:15.273 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "advanced", 2024-09-12T02:49:15.273 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 0, 2024-09-12T02:49:15.274 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "False", 2024-09-12T02:49:15.274 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-09-12T02:49:15.274 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-09-12T02:49:15.274 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [], 2024-09-12T02:49:15.274 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "", 2024-09-12T02:49:15.274 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-09-12T02:49:15.274 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-09-12T02:49:15.274 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-09-12T02:49:15.274 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-09-12T02:49:15.274 INFO:teuthology.orchestra.run.smithi039.stdout: "server_addr": { 2024-09-12T02:49:15.274 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "server_addr", 2024-09-12T02:49:15.274 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "str", 2024-09-12T02:49:15.274 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "advanced", 2024-09-12T02:49:15.274 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 0, 2024-09-12T02:49:15.275 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "::", 2024-09-12T02:49:15.275 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-09-12T02:49:15.275 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-09-12T02:49:15.275 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [], 2024-09-12T02:49:15.275 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "", 2024-09-12T02:49:15.275 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-09-12T02:49:15.275 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-09-12T02:49:15.275 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-09-12T02:49:15.275 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-09-12T02:49:15.275 INFO:teuthology.orchestra.run.smithi039.stdout: "server_port": { 2024-09-12T02:49:15.275 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "server_port", 2024-09-12T02:49:15.275 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "int", 2024-09-12T02:49:15.275 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "advanced", 2024-09-12T02:49:15.275 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 0, 2024-09-12T02:49:15.276 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "8080", 2024-09-12T02:49:15.276 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-09-12T02:49:15.276 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-09-12T02:49:15.276 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [], 2024-09-12T02:49:15.276 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "", 2024-09-12T02:49:15.276 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-09-12T02:49:15.276 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-09-12T02:49:15.276 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-09-12T02:49:15.276 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-09-12T02:49:15.276 INFO:teuthology.orchestra.run.smithi039.stdout: "ssl": { 2024-09-12T02:49:15.276 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "ssl", 2024-09-12T02:49:15.276 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "bool", 2024-09-12T02:49:15.276 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "advanced", 2024-09-12T02:49:15.277 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 0, 2024-09-12T02:49:15.277 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "True", 2024-09-12T02:49:15.277 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-09-12T02:49:15.277 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-09-12T02:49:15.277 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [], 2024-09-12T02:49:15.277 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "", 2024-09-12T02:49:15.277 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-09-12T02:49:15.277 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-09-12T02:49:15.277 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-09-12T02:49:15.277 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-09-12T02:49:15.277 INFO:teuthology.orchestra.run.smithi039.stdout: "ssl_server_port": { 2024-09-12T02:49:15.277 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "ssl_server_port", 2024-09-12T02:49:15.277 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "int", 2024-09-12T02:49:15.278 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "advanced", 2024-09-12T02:49:15.278 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 0, 2024-09-12T02:49:15.278 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "8443", 2024-09-12T02:49:15.278 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-09-12T02:49:15.278 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-09-12T02:49:15.278 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [], 2024-09-12T02:49:15.278 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "", 2024-09-12T02:49:15.278 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-09-12T02:49:15.278 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-09-12T02:49:15.278 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-09-12T02:49:15.278 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-09-12T02:49:15.278 INFO:teuthology.orchestra.run.smithi039.stdout: "standby_behaviour": { 2024-09-12T02:49:15.278 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "standby_behaviour", 2024-09-12T02:49:15.279 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "str", 2024-09-12T02:49:15.279 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "advanced", 2024-09-12T02:49:15.279 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 0, 2024-09-12T02:49:15.279 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "redirect", 2024-09-12T02:49:15.279 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-09-12T02:49:15.279 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-09-12T02:49:15.279 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [ 2024-09-12T02:49:15.279 INFO:teuthology.orchestra.run.smithi039.stdout: "error", 2024-09-12T02:49:15.279 INFO:teuthology.orchestra.run.smithi039.stdout: "redirect" 2024-09-12T02:49:15.279 INFO:teuthology.orchestra.run.smithi039.stdout: ], 2024-09-12T02:49:15.279 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "", 2024-09-12T02:49:15.279 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-09-12T02:49:15.279 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-09-12T02:49:15.279 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-09-12T02:49:15.280 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-09-12T02:49:15.280 INFO:teuthology.orchestra.run.smithi039.stdout: "standby_error_status_code": { 2024-09-12T02:49:15.280 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "standby_error_status_code", 2024-09-12T02:49:15.280 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "int", 2024-09-12T02:49:15.280 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "advanced", 2024-09-12T02:49:15.280 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 0, 2024-09-12T02:49:15.280 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "500", 2024-09-12T02:49:15.280 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "400", 2024-09-12T02:49:15.280 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "599", 2024-09-12T02:49:15.280 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [], 2024-09-12T02:49:15.280 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "", 2024-09-12T02:49:15.280 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-09-12T02:49:15.280 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-09-12T02:49:15.280 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-09-12T02:49:15.280 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-09-12T02:49:15.281 INFO:teuthology.orchestra.run.smithi039.stdout: "url_prefix": { 2024-09-12T02:49:15.281 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "url_prefix", 2024-09-12T02:49:15.281 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "str", 2024-09-12T02:49:15.281 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "advanced", 2024-09-12T02:49:15.281 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 0, 2024-09-12T02:49:15.281 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "", 2024-09-12T02:49:15.281 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-09-12T02:49:15.281 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-09-12T02:49:15.281 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [], 2024-09-12T02:49:15.281 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "", 2024-09-12T02:49:15.281 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-09-12T02:49:15.281 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-09-12T02:49:15.281 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-09-12T02:49:15.282 INFO:teuthology.orchestra.run.smithi039.stdout: } 2024-09-12T02:49:15.282 INFO:teuthology.orchestra.run.smithi039.stdout: } 2024-09-12T02:49:15.282 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-09-12T02:49:15.282 INFO:teuthology.orchestra.run.smithi039.stdout: { 2024-09-12T02:49:15.282 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "devicehealth", 2024-09-12T02:49:15.282 INFO:teuthology.orchestra.run.smithi039.stdout: "can_run": true, 2024-09-12T02:49:15.282 INFO:teuthology.orchestra.run.smithi039.stdout: "error_string": "", 2024-09-12T02:49:15.282 INFO:teuthology.orchestra.run.smithi039.stdout: "module_options": { 2024-09-12T02:49:15.282 INFO:teuthology.orchestra.run.smithi039.stdout: "enable_monitoring": { 2024-09-12T02:49:15.282 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "enable_monitoring", 2024-09-12T02:49:15.282 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "bool", 2024-09-12T02:49:15.282 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "advanced", 2024-09-12T02:49:15.282 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 1, 2024-09-12T02:49:15.282 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "True", 2024-09-12T02:49:15.283 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-09-12T02:49:15.283 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-09-12T02:49:15.283 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [], 2024-09-12T02:49:15.283 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "monitor device health metrics", 2024-09-12T02:49:15.283 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-09-12T02:49:15.283 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-09-12T02:49:15.283 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-09-12T02:49:15.283 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-09-12T02:49:15.283 INFO:teuthology.orchestra.run.smithi039.stdout: "log_level": { 2024-09-12T02:49:15.283 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "log_level", 2024-09-12T02:49:15.283 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "str", 2024-09-12T02:49:15.283 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "advanced", 2024-09-12T02:49:15.283 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 1, 2024-09-12T02:49:15.283 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "", 2024-09-12T02:49:15.284 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-09-12T02:49:15.284 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-09-12T02:49:15.284 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [ 2024-09-12T02:49:15.284 INFO:teuthology.orchestra.run.smithi039.stdout: "", 2024-09-12T02:49:15.284 INFO:teuthology.orchestra.run.smithi039.stdout: "critical", 2024-09-12T02:49:15.284 INFO:teuthology.orchestra.run.smithi039.stdout: "debug", 2024-09-12T02:49:15.284 INFO:teuthology.orchestra.run.smithi039.stdout: "error", 2024-09-12T02:49:15.284 INFO:teuthology.orchestra.run.smithi039.stdout: "info", 2024-09-12T02:49:15.284 INFO:teuthology.orchestra.run.smithi039.stdout: "warning" 2024-09-12T02:49:15.284 INFO:teuthology.orchestra.run.smithi039.stdout: ], 2024-09-12T02:49:15.284 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "", 2024-09-12T02:49:15.284 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-09-12T02:49:15.284 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-09-12T02:49:15.285 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-09-12T02:49:15.285 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-09-12T02:49:15.285 INFO:teuthology.orchestra.run.smithi039.stdout: "log_to_cluster": { 2024-09-12T02:49:15.285 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "log_to_cluster", 2024-09-12T02:49:15.285 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "bool", 2024-09-12T02:49:15.285 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "advanced", 2024-09-12T02:49:15.285 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 1, 2024-09-12T02:49:15.285 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "False", 2024-09-12T02:49:15.285 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-09-12T02:49:15.285 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-09-12T02:49:15.285 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [], 2024-09-12T02:49:15.285 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "", 2024-09-12T02:49:15.285 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-09-12T02:49:15.286 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-09-12T02:49:15.286 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-09-12T02:49:15.286 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-09-12T02:49:15.286 INFO:teuthology.orchestra.run.smithi039.stdout: "log_to_cluster_level": { 2024-09-12T02:49:15.286 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "log_to_cluster_level", 2024-09-12T02:49:15.286 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "str", 2024-09-12T02:49:15.286 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "advanced", 2024-09-12T02:49:15.286 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 1, 2024-09-12T02:49:15.286 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "info", 2024-09-12T02:49:15.286 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-09-12T02:49:15.286 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-09-12T02:49:15.286 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [ 2024-09-12T02:49:15.286 INFO:teuthology.orchestra.run.smithi039.stdout: "", 2024-09-12T02:49:15.286 INFO:teuthology.orchestra.run.smithi039.stdout: "critical", 2024-09-12T02:49:15.287 INFO:teuthology.orchestra.run.smithi039.stdout: "debug", 2024-09-12T02:49:15.287 INFO:teuthology.orchestra.run.smithi039.stdout: "error", 2024-09-12T02:49:15.287 INFO:teuthology.orchestra.run.smithi039.stdout: "info", 2024-09-12T02:49:15.287 INFO:teuthology.orchestra.run.smithi039.stdout: "warning" 2024-09-12T02:49:15.287 INFO:teuthology.orchestra.run.smithi039.stdout: ], 2024-09-12T02:49:15.287 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "", 2024-09-12T02:49:15.287 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-09-12T02:49:15.287 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-09-12T02:49:15.287 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-09-12T02:49:15.287 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-09-12T02:49:15.287 INFO:teuthology.orchestra.run.smithi039.stdout: "log_to_file": { 2024-09-12T02:49:15.287 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "log_to_file", 2024-09-12T02:49:15.287 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "bool", 2024-09-12T02:49:15.288 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "advanced", 2024-09-12T02:49:15.288 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 1, 2024-09-12T02:49:15.288 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "False", 2024-09-12T02:49:15.288 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-09-12T02:49:15.288 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-09-12T02:49:15.288 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [], 2024-09-12T02:49:15.288 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "", 2024-09-12T02:49:15.288 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-09-12T02:49:15.288 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-09-12T02:49:15.288 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-09-12T02:49:15.288 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-09-12T02:49:15.288 INFO:teuthology.orchestra.run.smithi039.stdout: "mark_out_threshold": { 2024-09-12T02:49:15.288 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "mark_out_threshold", 2024-09-12T02:49:15.289 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "secs", 2024-09-12T02:49:15.289 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "advanced", 2024-09-12T02:49:15.289 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 1, 2024-09-12T02:49:15.289 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "2419200", 2024-09-12T02:49:15.289 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-09-12T02:49:15.289 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-09-12T02:49:15.289 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [], 2024-09-12T02:49:15.289 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "automatically mark OSD if it may fail before this long", 2024-09-12T02:49:15.289 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-09-12T02:49:15.289 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-09-12T02:49:15.289 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-09-12T02:49:15.289 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-09-12T02:49:15.289 INFO:teuthology.orchestra.run.smithi039.stdout: "pool_name": { 2024-09-12T02:49:15.289 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "pool_name", 2024-09-12T02:49:15.290 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "str", 2024-09-12T02:49:15.290 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "advanced", 2024-09-12T02:49:15.290 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 1, 2024-09-12T02:49:15.290 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "device_health_metrics", 2024-09-12T02:49:15.290 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-09-12T02:49:15.290 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-09-12T02:49:15.290 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [], 2024-09-12T02:49:15.290 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "name of pool in which to store device health metrics", 2024-09-12T02:49:15.290 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-09-12T02:49:15.290 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-09-12T02:49:15.290 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-09-12T02:49:15.290 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-09-12T02:49:15.290 INFO:teuthology.orchestra.run.smithi039.stdout: "retention_period": { 2024-09-12T02:49:15.291 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "retention_period", 2024-09-12T02:49:15.291 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "secs", 2024-09-12T02:49:15.291 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "advanced", 2024-09-12T02:49:15.291 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 1, 2024-09-12T02:49:15.291 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "15552000", 2024-09-12T02:49:15.291 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-09-12T02:49:15.291 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-09-12T02:49:15.291 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [], 2024-09-12T02:49:15.291 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "how long to retain device health metrics", 2024-09-12T02:49:15.291 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-09-12T02:49:15.291 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-09-12T02:49:15.291 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-09-12T02:49:15.291 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-09-12T02:49:15.292 INFO:teuthology.orchestra.run.smithi039.stdout: "scrape_frequency": { 2024-09-12T02:49:15.292 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "scrape_frequency", 2024-09-12T02:49:15.292 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "secs", 2024-09-12T02:49:15.292 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "advanced", 2024-09-12T02:49:15.292 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 1, 2024-09-12T02:49:15.292 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "86400", 2024-09-12T02:49:15.292 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-09-12T02:49:15.292 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-09-12T02:49:15.292 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [], 2024-09-12T02:49:15.292 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "how frequently to scrape device health metrics", 2024-09-12T02:49:15.292 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-09-12T02:49:15.292 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-09-12T02:49:15.292 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-09-12T02:49:15.293 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-09-12T02:49:15.293 INFO:teuthology.orchestra.run.smithi039.stdout: "self_heal": { 2024-09-12T02:49:15.293 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "self_heal", 2024-09-12T02:49:15.293 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "bool", 2024-09-12T02:49:15.293 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "advanced", 2024-09-12T02:49:15.293 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 1, 2024-09-12T02:49:15.293 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "True", 2024-09-12T02:49:15.293 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-09-12T02:49:15.293 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-09-12T02:49:15.293 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [], 2024-09-12T02:49:15.293 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "preemptively heal cluster around devices that may fail", 2024-09-12T02:49:15.293 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-09-12T02:49:15.293 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-09-12T02:49:15.293 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-09-12T02:49:15.294 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-09-12T02:49:15.294 INFO:teuthology.orchestra.run.smithi039.stdout: "sleep_interval": { 2024-09-12T02:49:15.294 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "sleep_interval", 2024-09-12T02:49:15.294 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "secs", 2024-09-12T02:49:15.294 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "advanced", 2024-09-12T02:49:15.294 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 1, 2024-09-12T02:49:15.294 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "600", 2024-09-12T02:49:15.294 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-09-12T02:49:15.294 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-09-12T02:49:15.294 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [], 2024-09-12T02:49:15.294 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "how frequently to wake up and check device health", 2024-09-12T02:49:15.294 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-09-12T02:49:15.294 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-09-12T02:49:15.294 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-09-12T02:49:15.295 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-09-12T02:49:15.295 INFO:teuthology.orchestra.run.smithi039.stdout: "warn_threshold": { 2024-09-12T02:49:15.295 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "warn_threshold", 2024-09-12T02:49:15.295 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "secs", 2024-09-12T02:49:15.295 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "advanced", 2024-09-12T02:49:15.295 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 1, 2024-09-12T02:49:15.295 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "7257600", 2024-09-12T02:49:15.295 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-09-12T02:49:15.295 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-09-12T02:49:15.295 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [], 2024-09-12T02:49:15.295 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "raise health warning if OSD may fail before this long", 2024-09-12T02:49:15.295 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-09-12T02:49:15.295 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-09-12T02:49:15.296 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-09-12T02:49:15.296 INFO:teuthology.orchestra.run.smithi039.stdout: } 2024-09-12T02:49:15.296 INFO:teuthology.orchestra.run.smithi039.stdout: } 2024-09-12T02:49:15.296 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-09-12T02:49:15.296 INFO:teuthology.orchestra.run.smithi039.stdout: { 2024-09-12T02:49:15.296 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "diskprediction_local", 2024-09-12T02:49:15.296 INFO:teuthology.orchestra.run.smithi039.stdout: "can_run": true, 2024-09-12T02:49:15.296 INFO:teuthology.orchestra.run.smithi039.stdout: "error_string": "", 2024-09-12T02:49:15.296 INFO:teuthology.orchestra.run.smithi039.stdout: "module_options": { 2024-09-12T02:49:15.296 INFO:teuthology.orchestra.run.smithi039.stdout: "log_level": { 2024-09-12T02:49:15.296 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "log_level", 2024-09-12T02:49:15.296 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "str", 2024-09-12T02:49:15.296 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "advanced", 2024-09-12T02:49:15.297 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 1, 2024-09-12T02:49:15.297 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "", 2024-09-12T02:49:15.297 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-09-12T02:49:15.297 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-09-12T02:49:15.297 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [ 2024-09-12T02:49:15.297 INFO:teuthology.orchestra.run.smithi039.stdout: "", 2024-09-12T02:49:15.297 INFO:teuthology.orchestra.run.smithi039.stdout: "critical", 2024-09-12T02:49:15.297 INFO:teuthology.orchestra.run.smithi039.stdout: "debug", 2024-09-12T02:49:15.297 INFO:teuthology.orchestra.run.smithi039.stdout: "error", 2024-09-12T02:49:15.297 INFO:teuthology.orchestra.run.smithi039.stdout: "info", 2024-09-12T02:49:15.297 INFO:teuthology.orchestra.run.smithi039.stdout: "warning" 2024-09-12T02:49:15.297 INFO:teuthology.orchestra.run.smithi039.stdout: ], 2024-09-12T02:49:15.297 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "", 2024-09-12T02:49:15.297 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-09-12T02:49:15.298 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-09-12T02:49:15.298 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-09-12T02:49:15.298 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-09-12T02:49:15.298 INFO:teuthology.orchestra.run.smithi039.stdout: "log_to_cluster": { 2024-09-12T02:49:15.298 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "log_to_cluster", 2024-09-12T02:49:15.298 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "bool", 2024-09-12T02:49:15.298 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "advanced", 2024-09-12T02:49:15.298 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 1, 2024-09-12T02:49:15.298 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "False", 2024-09-12T02:49:15.298 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-09-12T02:49:15.298 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-09-12T02:49:15.298 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [], 2024-09-12T02:49:15.298 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "", 2024-09-12T02:49:15.298 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-09-12T02:49:15.299 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-09-12T02:49:15.299 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-09-12T02:49:15.299 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-09-12T02:49:15.299 INFO:teuthology.orchestra.run.smithi039.stdout: "log_to_cluster_level": { 2024-09-12T02:49:15.299 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "log_to_cluster_level", 2024-09-12T02:49:15.299 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "str", 2024-09-12T02:49:15.299 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "advanced", 2024-09-12T02:49:15.299 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 1, 2024-09-12T02:49:15.299 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "info", 2024-09-12T02:49:15.299 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-09-12T02:49:15.299 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-09-12T02:49:15.299 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [ 2024-09-12T02:49:15.299 INFO:teuthology.orchestra.run.smithi039.stdout: "", 2024-09-12T02:49:15.299 INFO:teuthology.orchestra.run.smithi039.stdout: "critical", 2024-09-12T02:49:15.300 INFO:teuthology.orchestra.run.smithi039.stdout: "debug", 2024-09-12T02:49:15.300 INFO:teuthology.orchestra.run.smithi039.stdout: "error", 2024-09-12T02:49:15.300 INFO:teuthology.orchestra.run.smithi039.stdout: "info", 2024-09-12T02:49:15.300 INFO:teuthology.orchestra.run.smithi039.stdout: "warning" 2024-09-12T02:49:15.300 INFO:teuthology.orchestra.run.smithi039.stdout: ], 2024-09-12T02:49:15.300 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "", 2024-09-12T02:49:15.300 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-09-12T02:49:15.300 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-09-12T02:49:15.300 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-09-12T02:49:15.300 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-09-12T02:49:15.300 INFO:teuthology.orchestra.run.smithi039.stdout: "log_to_file": { 2024-09-12T02:49:15.300 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "log_to_file", 2024-09-12T02:49:15.300 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "bool", 2024-09-12T02:49:15.301 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "advanced", 2024-09-12T02:49:15.301 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 1, 2024-09-12T02:49:15.301 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "False", 2024-09-12T02:49:15.301 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-09-12T02:49:15.301 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-09-12T02:49:15.301 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [], 2024-09-12T02:49:15.301 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "", 2024-09-12T02:49:15.301 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-09-12T02:49:15.301 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-09-12T02:49:15.301 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-09-12T02:49:15.301 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-09-12T02:49:15.301 INFO:teuthology.orchestra.run.smithi039.stdout: "predict_interval": { 2024-09-12T02:49:15.301 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "predict_interval", 2024-09-12T02:49:15.301 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "str", 2024-09-12T02:49:15.302 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "advanced", 2024-09-12T02:49:15.302 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 0, 2024-09-12T02:49:15.302 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "86400", 2024-09-12T02:49:15.302 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-09-12T02:49:15.302 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-09-12T02:49:15.302 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [], 2024-09-12T02:49:15.302 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "", 2024-09-12T02:49:15.302 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-09-12T02:49:15.302 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-09-12T02:49:15.303 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-09-12T02:49:15.303 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-09-12T02:49:15.303 INFO:teuthology.orchestra.run.smithi039.stdout: "predictor_model": { 2024-09-12T02:49:15.303 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "predictor_model", 2024-09-12T02:49:15.303 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "str", 2024-09-12T02:49:15.303 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "advanced", 2024-09-12T02:49:15.303 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 0, 2024-09-12T02:49:15.303 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "prophetstor", 2024-09-12T02:49:15.303 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-09-12T02:49:15.303 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-09-12T02:49:15.303 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [], 2024-09-12T02:49:15.303 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "", 2024-09-12T02:49:15.303 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-09-12T02:49:15.303 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-09-12T02:49:15.304 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-09-12T02:49:15.304 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-09-12T02:49:15.304 INFO:teuthology.orchestra.run.smithi039.stdout: "sleep_interval": { 2024-09-12T02:49:15.304 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "sleep_interval", 2024-09-12T02:49:15.304 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "str", 2024-09-12T02:49:15.304 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "advanced", 2024-09-12T02:49:15.304 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 0, 2024-09-12T02:49:15.304 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "600", 2024-09-12T02:49:15.304 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-09-12T02:49:15.304 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-09-12T02:49:15.304 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [], 2024-09-12T02:49:15.304 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "", 2024-09-12T02:49:15.304 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-09-12T02:49:15.305 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-09-12T02:49:15.305 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-09-12T02:49:15.305 INFO:teuthology.orchestra.run.smithi039.stdout: } 2024-09-12T02:49:15.305 INFO:teuthology.orchestra.run.smithi039.stdout: } 2024-09-12T02:49:15.305 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-09-12T02:49:15.305 INFO:teuthology.orchestra.run.smithi039.stdout: { 2024-09-12T02:49:15.305 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "influx", 2024-09-12T02:49:15.305 INFO:teuthology.orchestra.run.smithi039.stdout: "can_run": false, 2024-09-12T02:49:15.305 INFO:teuthology.orchestra.run.smithi039.stdout: "error_string": "influxdb python module not found", 2024-09-12T02:49:15.305 INFO:teuthology.orchestra.run.smithi039.stdout: "module_options": { 2024-09-12T02:49:15.305 INFO:teuthology.orchestra.run.smithi039.stdout: "batch_size": { 2024-09-12T02:49:15.305 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "batch_size", 2024-09-12T02:49:15.305 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "int", 2024-09-12T02:49:15.306 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "advanced", 2024-09-12T02:49:15.306 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 0, 2024-09-12T02:49:15.306 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "5000", 2024-09-12T02:49:15.306 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-09-12T02:49:15.306 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-09-12T02:49:15.306 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [], 2024-09-12T02:49:15.306 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "How big batches of data points should be when sending to InfluxDB.", 2024-09-12T02:49:15.306 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-09-12T02:49:15.306 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-09-12T02:49:15.306 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-09-12T02:49:15.306 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-09-12T02:49:15.306 INFO:teuthology.orchestra.run.smithi039.stdout: "database": { 2024-09-12T02:49:15.306 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "database", 2024-09-12T02:49:15.307 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "str", 2024-09-12T02:49:15.307 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "advanced", 2024-09-12T02:49:15.307 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 0, 2024-09-12T02:49:15.307 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "ceph", 2024-09-12T02:49:15.307 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-09-12T02:49:15.307 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-09-12T02:49:15.307 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [], 2024-09-12T02:49:15.307 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "InfluxDB database name. You will need to create this database and grant write privileges to the configured username or the username must have admin privileges to create it.", 2024-09-12T02:49:15.307 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-09-12T02:49:15.307 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-09-12T02:49:15.307 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-09-12T02:49:15.307 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-09-12T02:49:15.307 INFO:teuthology.orchestra.run.smithi039.stdout: "hostname": { 2024-09-12T02:49:15.308 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "hostname", 2024-09-12T02:49:15.308 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "str", 2024-09-12T02:49:15.308 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "advanced", 2024-09-12T02:49:15.308 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 0, 2024-09-12T02:49:15.308 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "", 2024-09-12T02:49:15.308 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-09-12T02:49:15.308 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-09-12T02:49:15.308 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [], 2024-09-12T02:49:15.308 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "InfluxDB server hostname", 2024-09-12T02:49:15.308 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-09-12T02:49:15.308 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-09-12T02:49:15.308 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-09-12T02:49:15.309 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-09-12T02:49:15.309 INFO:teuthology.orchestra.run.smithi039.stdout: "interval": { 2024-09-12T02:49:15.309 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "interval", 2024-09-12T02:49:15.309 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "secs", 2024-09-12T02:49:15.309 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "advanced", 2024-09-12T02:49:15.309 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 0, 2024-09-12T02:49:15.309 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "30", 2024-09-12T02:49:15.309 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "5", 2024-09-12T02:49:15.309 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-09-12T02:49:15.309 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [], 2024-09-12T02:49:15.309 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "Time between reports to InfluxDB. Default 30 seconds.", 2024-09-12T02:49:15.309 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-09-12T02:49:15.309 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-09-12T02:49:15.309 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-09-12T02:49:15.310 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-09-12T02:49:15.310 INFO:teuthology.orchestra.run.smithi039.stdout: "log_level": { 2024-09-12T02:49:15.310 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "log_level", 2024-09-12T02:49:15.310 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "str", 2024-09-12T02:49:15.310 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "advanced", 2024-09-12T02:49:15.310 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 1, 2024-09-12T02:49:15.310 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "", 2024-09-12T02:49:15.310 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-09-12T02:49:15.310 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-09-12T02:49:15.310 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [ 2024-09-12T02:49:15.310 INFO:teuthology.orchestra.run.smithi039.stdout: "", 2024-09-12T02:49:15.310 INFO:teuthology.orchestra.run.smithi039.stdout: "critical", 2024-09-12T02:49:15.310 INFO:teuthology.orchestra.run.smithi039.stdout: "debug", 2024-09-12T02:49:15.311 INFO:teuthology.orchestra.run.smithi039.stdout: "error", 2024-09-12T02:49:15.311 INFO:teuthology.orchestra.run.smithi039.stdout: "info", 2024-09-12T02:49:15.311 INFO:teuthology.orchestra.run.smithi039.stdout: "warning" 2024-09-12T02:49:15.311 INFO:teuthology.orchestra.run.smithi039.stdout: ], 2024-09-12T02:49:15.311 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "", 2024-09-12T02:49:15.311 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-09-12T02:49:15.311 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-09-12T02:49:15.311 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-09-12T02:49:15.311 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-09-12T02:49:15.311 INFO:teuthology.orchestra.run.smithi039.stdout: "log_to_cluster": { 2024-09-12T02:49:15.311 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "log_to_cluster", 2024-09-12T02:49:15.311 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "bool", 2024-09-12T02:49:15.311 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "advanced", 2024-09-12T02:49:15.311 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 1, 2024-09-12T02:49:15.312 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "False", 2024-09-12T02:49:15.312 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-09-12T02:49:15.312 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-09-12T02:49:15.312 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [], 2024-09-12T02:49:15.312 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "", 2024-09-12T02:49:15.312 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-09-12T02:49:15.312 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-09-12T02:49:15.312 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-09-12T02:49:15.312 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-09-12T02:49:15.312 INFO:teuthology.orchestra.run.smithi039.stdout: "log_to_cluster_level": { 2024-09-12T02:49:15.312 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "log_to_cluster_level", 2024-09-12T02:49:15.312 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "str", 2024-09-12T02:49:15.312 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "advanced", 2024-09-12T02:49:15.312 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 1, 2024-09-12T02:49:15.313 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "info", 2024-09-12T02:49:15.313 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-09-12T02:49:15.313 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-09-12T02:49:15.313 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [ 2024-09-12T02:49:15.313 INFO:teuthology.orchestra.run.smithi039.stdout: "", 2024-09-12T02:49:15.313 INFO:teuthology.orchestra.run.smithi039.stdout: "critical", 2024-09-12T02:49:15.313 INFO:teuthology.orchestra.run.smithi039.stdout: "debug", 2024-09-12T02:49:15.313 INFO:teuthology.orchestra.run.smithi039.stdout: "error", 2024-09-12T02:49:15.313 INFO:teuthology.orchestra.run.smithi039.stdout: "info", 2024-09-12T02:49:15.313 INFO:teuthology.orchestra.run.smithi039.stdout: "warning" 2024-09-12T02:49:15.313 INFO:teuthology.orchestra.run.smithi039.stdout: ], 2024-09-12T02:49:15.313 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "", 2024-09-12T02:49:15.313 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-09-12T02:49:15.313 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-09-12T02:49:15.314 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-09-12T02:49:15.314 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-09-12T02:49:15.314 INFO:teuthology.orchestra.run.smithi039.stdout: "log_to_file": { 2024-09-12T02:49:15.314 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "log_to_file", 2024-09-12T02:49:15.314 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "bool", 2024-09-12T02:49:15.314 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "advanced", 2024-09-12T02:49:15.314 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 1, 2024-09-12T02:49:15.314 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "False", 2024-09-12T02:49:15.314 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-09-12T02:49:15.314 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-09-12T02:49:15.314 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [], 2024-09-12T02:49:15.314 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "", 2024-09-12T02:49:15.314 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-09-12T02:49:15.314 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-09-12T02:49:15.315 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-09-12T02:49:15.315 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-09-12T02:49:15.315 INFO:teuthology.orchestra.run.smithi039.stdout: "password": { 2024-09-12T02:49:15.315 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "password", 2024-09-12T02:49:15.315 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "str", 2024-09-12T02:49:15.315 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "advanced", 2024-09-12T02:49:15.315 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 0, 2024-09-12T02:49:15.315 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "", 2024-09-12T02:49:15.315 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-09-12T02:49:15.315 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-09-12T02:49:15.315 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [], 2024-09-12T02:49:15.315 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "password of InfluxDB server user", 2024-09-12T02:49:15.315 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-09-12T02:49:15.315 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-09-12T02:49:15.316 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-09-12T02:49:15.316 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-09-12T02:49:15.316 INFO:teuthology.orchestra.run.smithi039.stdout: "port": { 2024-09-12T02:49:15.316 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "port", 2024-09-12T02:49:15.316 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "int", 2024-09-12T02:49:15.316 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "advanced", 2024-09-12T02:49:15.316 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 0, 2024-09-12T02:49:15.316 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "8086", 2024-09-12T02:49:15.316 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-09-12T02:49:15.316 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-09-12T02:49:15.316 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [], 2024-09-12T02:49:15.316 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "InfluxDB server port", 2024-09-12T02:49:15.316 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-09-12T02:49:15.316 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-09-12T02:49:15.317 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-09-12T02:49:15.317 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-09-12T02:49:15.317 INFO:teuthology.orchestra.run.smithi039.stdout: "ssl": { 2024-09-12T02:49:15.317 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "ssl", 2024-09-12T02:49:15.317 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "str", 2024-09-12T02:49:15.317 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "advanced", 2024-09-12T02:49:15.317 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 0, 2024-09-12T02:49:15.317 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "false", 2024-09-12T02:49:15.317 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-09-12T02:49:15.317 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-09-12T02:49:15.317 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [], 2024-09-12T02:49:15.317 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "Use https connection for InfluxDB server. Use \"true\" or \"false\".", 2024-09-12T02:49:15.317 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-09-12T02:49:15.317 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-09-12T02:49:15.318 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-09-12T02:49:15.318 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-09-12T02:49:15.318 INFO:teuthology.orchestra.run.smithi039.stdout: "threads": { 2024-09-12T02:49:15.318 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "threads", 2024-09-12T02:49:15.318 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "int", 2024-09-12T02:49:15.318 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "advanced", 2024-09-12T02:49:15.318 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 0, 2024-09-12T02:49:15.318 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "5", 2024-09-12T02:49:15.318 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "1", 2024-09-12T02:49:15.318 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "32", 2024-09-12T02:49:15.318 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [], 2024-09-12T02:49:15.318 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "How many worker threads should be spawned for sending data to InfluxDB.", 2024-09-12T02:49:15.318 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-09-12T02:49:15.318 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-09-12T02:49:15.319 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-09-12T02:49:15.319 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-09-12T02:49:15.319 INFO:teuthology.orchestra.run.smithi039.stdout: "username": { 2024-09-12T02:49:15.319 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "username", 2024-09-12T02:49:15.319 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "str", 2024-09-12T02:49:15.319 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "advanced", 2024-09-12T02:49:15.319 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 0, 2024-09-12T02:49:15.319 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "", 2024-09-12T02:49:15.319 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-09-12T02:49:15.319 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-09-12T02:49:15.319 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [], 2024-09-12T02:49:15.319 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "username of InfluxDB server user", 2024-09-12T02:49:15.319 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-09-12T02:49:15.320 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-09-12T02:49:15.320 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-09-12T02:49:15.320 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-09-12T02:49:15.320 INFO:teuthology.orchestra.run.smithi039.stdout: "verify_ssl": { 2024-09-12T02:49:15.320 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "verify_ssl", 2024-09-12T02:49:15.320 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "str", 2024-09-12T02:49:15.320 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "advanced", 2024-09-12T02:49:15.320 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 0, 2024-09-12T02:49:15.320 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "true", 2024-09-12T02:49:15.320 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-09-12T02:49:15.320 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-09-12T02:49:15.320 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [], 2024-09-12T02:49:15.320 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "Verify https cert for InfluxDB server. Use \"true\" or \"false\".", 2024-09-12T02:49:15.321 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-09-12T02:49:15.321 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-09-12T02:49:15.321 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-09-12T02:49:15.321 INFO:teuthology.orchestra.run.smithi039.stdout: } 2024-09-12T02:49:15.321 INFO:teuthology.orchestra.run.smithi039.stdout: } 2024-09-12T02:49:15.321 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-09-12T02:49:15.321 INFO:teuthology.orchestra.run.smithi039.stdout: { 2024-09-12T02:49:15.321 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "insights", 2024-09-12T02:49:15.321 INFO:teuthology.orchestra.run.smithi039.stdout: "can_run": true, 2024-09-12T02:49:15.321 INFO:teuthology.orchestra.run.smithi039.stdout: "error_string": "", 2024-09-12T02:49:15.321 INFO:teuthology.orchestra.run.smithi039.stdout: "module_options": { 2024-09-12T02:49:15.321 INFO:teuthology.orchestra.run.smithi039.stdout: "log_level": { 2024-09-12T02:49:15.321 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "log_level", 2024-09-12T02:49:15.322 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "str", 2024-09-12T02:49:15.322 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "advanced", 2024-09-12T02:49:15.322 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 1, 2024-09-12T02:49:15.322 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "", 2024-09-12T02:49:15.322 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-09-12T02:49:15.322 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-09-12T02:49:15.322 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [ 2024-09-12T02:49:15.322 INFO:teuthology.orchestra.run.smithi039.stdout: "", 2024-09-12T02:49:15.322 INFO:teuthology.orchestra.run.smithi039.stdout: "critical", 2024-09-12T02:49:15.322 INFO:teuthology.orchestra.run.smithi039.stdout: "debug", 2024-09-12T02:49:15.322 INFO:teuthology.orchestra.run.smithi039.stdout: "error", 2024-09-12T02:49:15.322 INFO:teuthology.orchestra.run.smithi039.stdout: "info", 2024-09-12T02:49:15.322 INFO:teuthology.orchestra.run.smithi039.stdout: "warning" 2024-09-12T02:49:15.323 INFO:teuthology.orchestra.run.smithi039.stdout: ], 2024-09-12T02:49:15.323 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "", 2024-09-12T02:49:15.323 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-09-12T02:49:15.323 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-09-12T02:49:15.323 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-09-12T02:49:15.323 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-09-12T02:49:15.323 INFO:teuthology.orchestra.run.smithi039.stdout: "log_to_cluster": { 2024-09-12T02:49:15.323 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "log_to_cluster", 2024-09-12T02:49:15.323 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "bool", 2024-09-12T02:49:15.323 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "advanced", 2024-09-12T02:49:15.323 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 1, 2024-09-12T02:49:15.323 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "False", 2024-09-12T02:49:15.323 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-09-12T02:49:15.324 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-09-12T02:49:15.324 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [], 2024-09-12T02:49:15.324 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "", 2024-09-12T02:49:15.324 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-09-12T02:49:15.324 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-09-12T02:49:15.324 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-09-12T02:49:15.324 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-09-12T02:49:15.324 INFO:teuthology.orchestra.run.smithi039.stdout: "log_to_cluster_level": { 2024-09-12T02:49:15.324 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "log_to_cluster_level", 2024-09-12T02:49:15.324 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "str", 2024-09-12T02:49:15.324 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "advanced", 2024-09-12T02:49:15.324 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 1, 2024-09-12T02:49:15.324 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "info", 2024-09-12T02:49:15.325 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-09-12T02:49:15.325 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-09-12T02:49:15.325 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [ 2024-09-12T02:49:15.325 INFO:teuthology.orchestra.run.smithi039.stdout: "", 2024-09-12T02:49:15.325 INFO:teuthology.orchestra.run.smithi039.stdout: "critical", 2024-09-12T02:49:15.325 INFO:teuthology.orchestra.run.smithi039.stdout: "debug", 2024-09-12T02:49:15.325 INFO:teuthology.orchestra.run.smithi039.stdout: "error", 2024-09-12T02:49:15.325 INFO:teuthology.orchestra.run.smithi039.stdout: "info", 2024-09-12T02:49:15.325 INFO:teuthology.orchestra.run.smithi039.stdout: "warning" 2024-09-12T02:49:15.325 INFO:teuthology.orchestra.run.smithi039.stdout: ], 2024-09-12T02:49:15.325 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "", 2024-09-12T02:49:15.325 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-09-12T02:49:15.326 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-09-12T02:49:15.326 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-09-12T02:49:15.326 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-09-12T02:49:15.326 INFO:teuthology.orchestra.run.smithi039.stdout: "log_to_file": { 2024-09-12T02:49:15.326 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "log_to_file", 2024-09-12T02:49:15.326 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "bool", 2024-09-12T02:49:15.326 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "advanced", 2024-09-12T02:49:15.326 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 1, 2024-09-12T02:49:15.326 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "False", 2024-09-12T02:49:15.326 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-09-12T02:49:15.326 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-09-12T02:49:15.326 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [], 2024-09-12T02:49:15.327 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "", 2024-09-12T02:49:15.327 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-09-12T02:49:15.327 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-09-12T02:49:15.327 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-09-12T02:49:15.327 INFO:teuthology.orchestra.run.smithi039.stdout: } 2024-09-12T02:49:15.327 INFO:teuthology.orchestra.run.smithi039.stdout: } 2024-09-12T02:49:15.327 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-09-12T02:49:15.327 INFO:teuthology.orchestra.run.smithi039.stdout: { 2024-09-12T02:49:15.327 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "iostat", 2024-09-12T02:49:15.327 INFO:teuthology.orchestra.run.smithi039.stdout: "can_run": true, 2024-09-12T02:49:15.327 INFO:teuthology.orchestra.run.smithi039.stdout: "error_string": "", 2024-09-12T02:49:15.327 INFO:teuthology.orchestra.run.smithi039.stdout: "module_options": { 2024-09-12T02:49:15.327 INFO:teuthology.orchestra.run.smithi039.stdout: "log_level": { 2024-09-12T02:49:15.327 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "log_level", 2024-09-12T02:49:15.328 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "str", 2024-09-12T02:49:15.328 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "advanced", 2024-09-12T02:49:15.328 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 1, 2024-09-12T02:49:15.328 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "", 2024-09-12T02:49:15.328 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-09-12T02:49:15.328 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-09-12T02:49:15.328 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [ 2024-09-12T02:49:15.328 INFO:teuthology.orchestra.run.smithi039.stdout: "", 2024-09-12T02:49:15.328 INFO:teuthology.orchestra.run.smithi039.stdout: "critical", 2024-09-12T02:49:15.328 INFO:teuthology.orchestra.run.smithi039.stdout: "debug", 2024-09-12T02:49:15.328 INFO:teuthology.orchestra.run.smithi039.stdout: "error", 2024-09-12T02:49:15.328 INFO:teuthology.orchestra.run.smithi039.stdout: "info", 2024-09-12T02:49:15.328 INFO:teuthology.orchestra.run.smithi039.stdout: "warning" 2024-09-12T02:49:15.329 INFO:teuthology.orchestra.run.smithi039.stdout: ], 2024-09-12T02:49:15.329 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "", 2024-09-12T02:49:15.329 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-09-12T02:49:15.329 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-09-12T02:49:15.329 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-09-12T02:49:15.329 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-09-12T02:49:15.329 INFO:teuthology.orchestra.run.smithi039.stdout: "log_to_cluster": { 2024-09-12T02:49:15.329 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "log_to_cluster", 2024-09-12T02:49:15.329 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "bool", 2024-09-12T02:49:15.329 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "advanced", 2024-09-12T02:49:15.329 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 1, 2024-09-12T02:49:15.329 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "False", 2024-09-12T02:49:15.329 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-09-12T02:49:15.330 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-09-12T02:49:15.330 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [], 2024-09-12T02:49:15.330 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "", 2024-09-12T02:49:15.330 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-09-12T02:49:15.330 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-09-12T02:49:15.330 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-09-12T02:49:15.330 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-09-12T02:49:15.330 INFO:teuthology.orchestra.run.smithi039.stdout: "log_to_cluster_level": { 2024-09-12T02:49:15.330 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "log_to_cluster_level", 2024-09-12T02:49:15.330 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "str", 2024-09-12T02:49:15.330 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "advanced", 2024-09-12T02:49:15.330 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 1, 2024-09-12T02:49:15.330 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "info", 2024-09-12T02:49:15.331 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-09-12T02:49:15.331 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-09-12T02:49:15.331 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [ 2024-09-12T02:49:15.331 INFO:teuthology.orchestra.run.smithi039.stdout: "", 2024-09-12T02:49:15.331 INFO:teuthology.orchestra.run.smithi039.stdout: "critical", 2024-09-12T02:49:15.331 INFO:teuthology.orchestra.run.smithi039.stdout: "debug", 2024-09-12T02:49:15.331 INFO:teuthology.orchestra.run.smithi039.stdout: "error", 2024-09-12T02:49:15.331 INFO:teuthology.orchestra.run.smithi039.stdout: "info", 2024-09-12T02:49:15.331 INFO:teuthology.orchestra.run.smithi039.stdout: "warning" 2024-09-12T02:49:15.331 INFO:teuthology.orchestra.run.smithi039.stdout: ], 2024-09-12T02:49:15.331 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "", 2024-09-12T02:49:15.331 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-09-12T02:49:15.331 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-09-12T02:49:15.331 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-09-12T02:49:15.332 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-09-12T02:49:15.332 INFO:teuthology.orchestra.run.smithi039.stdout: "log_to_file": { 2024-09-12T02:49:15.332 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "log_to_file", 2024-09-12T02:49:15.332 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "bool", 2024-09-12T02:49:15.332 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "advanced", 2024-09-12T02:49:15.332 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 1, 2024-09-12T02:49:15.332 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "False", 2024-09-12T02:49:15.332 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-09-12T02:49:15.332 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-09-12T02:49:15.332 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [], 2024-09-12T02:49:15.332 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "", 2024-09-12T02:49:15.332 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-09-12T02:49:15.333 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-09-12T02:49:15.333 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-09-12T02:49:15.333 INFO:teuthology.orchestra.run.smithi039.stdout: } 2024-09-12T02:49:15.333 INFO:teuthology.orchestra.run.smithi039.stdout: } 2024-09-12T02:49:15.333 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-09-12T02:49:15.333 INFO:teuthology.orchestra.run.smithi039.stdout: { 2024-09-12T02:49:15.333 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "k8sevents", 2024-09-12T02:49:15.333 INFO:teuthology.orchestra.run.smithi039.stdout: "can_run": true, 2024-09-12T02:49:15.333 INFO:teuthology.orchestra.run.smithi039.stdout: "error_string": "", 2024-09-12T02:49:15.333 INFO:teuthology.orchestra.run.smithi039.stdout: "module_options": { 2024-09-12T02:49:15.333 INFO:teuthology.orchestra.run.smithi039.stdout: "ceph_event_retention_days": { 2024-09-12T02:49:15.333 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "ceph_event_retention_days", 2024-09-12T02:49:15.333 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "int", 2024-09-12T02:49:15.334 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "advanced", 2024-09-12T02:49:15.334 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 0, 2024-09-12T02:49:15.334 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "7", 2024-09-12T02:49:15.334 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-09-12T02:49:15.334 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-09-12T02:49:15.334 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [], 2024-09-12T02:49:15.334 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "Days to hold ceph event information within local cache", 2024-09-12T02:49:15.334 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-09-12T02:49:15.334 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-09-12T02:49:15.334 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-09-12T02:49:15.334 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-09-12T02:49:15.334 INFO:teuthology.orchestra.run.smithi039.stdout: "config_check_secs": { 2024-09-12T02:49:15.334 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "config_check_secs", 2024-09-12T02:49:15.334 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "int", 2024-09-12T02:49:15.335 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "advanced", 2024-09-12T02:49:15.335 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 0, 2024-09-12T02:49:15.335 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "10", 2024-09-12T02:49:15.335 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "10", 2024-09-12T02:49:15.335 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-09-12T02:49:15.335 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [], 2024-09-12T02:49:15.335 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "interval (secs) to check for cluster configuration changes", 2024-09-12T02:49:15.335 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-09-12T02:49:15.335 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-09-12T02:49:15.335 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-09-12T02:49:15.335 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-09-12T02:49:15.335 INFO:teuthology.orchestra.run.smithi039.stdout: "log_level": { 2024-09-12T02:49:15.335 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "log_level", 2024-09-12T02:49:15.336 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "str", 2024-09-12T02:49:15.336 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "advanced", 2024-09-12T02:49:15.336 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 1, 2024-09-12T02:49:15.336 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "", 2024-09-12T02:49:15.336 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-09-12T02:49:15.336 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-09-12T02:49:15.336 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [ 2024-09-12T02:49:15.336 INFO:teuthology.orchestra.run.smithi039.stdout: "", 2024-09-12T02:49:15.336 INFO:teuthology.orchestra.run.smithi039.stdout: "critical", 2024-09-12T02:49:15.336 INFO:teuthology.orchestra.run.smithi039.stdout: "debug", 2024-09-12T02:49:15.336 INFO:teuthology.orchestra.run.smithi039.stdout: "error", 2024-09-12T02:49:15.336 INFO:teuthology.orchestra.run.smithi039.stdout: "info", 2024-09-12T02:49:15.336 INFO:teuthology.orchestra.run.smithi039.stdout: "warning" 2024-09-12T02:49:15.337 INFO:teuthology.orchestra.run.smithi039.stdout: ], 2024-09-12T02:49:15.337 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "", 2024-09-12T02:49:15.337 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-09-12T02:49:15.337 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-09-12T02:49:15.337 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-09-12T02:49:15.337 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-09-12T02:49:15.337 INFO:teuthology.orchestra.run.smithi039.stdout: "log_to_cluster": { 2024-09-12T02:49:15.337 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "log_to_cluster", 2024-09-12T02:49:15.337 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "bool", 2024-09-12T02:49:15.337 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "advanced", 2024-09-12T02:49:15.337 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 1, 2024-09-12T02:49:15.337 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "False", 2024-09-12T02:49:15.337 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-09-12T02:49:15.338 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-09-12T02:49:15.338 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [], 2024-09-12T02:49:15.338 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "", 2024-09-12T02:49:15.338 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-09-12T02:49:15.338 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-09-12T02:49:15.338 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-09-12T02:49:15.338 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-09-12T02:49:15.338 INFO:teuthology.orchestra.run.smithi039.stdout: "log_to_cluster_level": { 2024-09-12T02:49:15.338 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "log_to_cluster_level", 2024-09-12T02:49:15.338 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "str", 2024-09-12T02:49:15.338 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "advanced", 2024-09-12T02:49:15.338 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 1, 2024-09-12T02:49:15.338 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "info", 2024-09-12T02:49:15.339 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-09-12T02:49:15.339 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-09-12T02:49:15.339 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [ 2024-09-12T02:49:15.339 INFO:teuthology.orchestra.run.smithi039.stdout: "", 2024-09-12T02:49:15.339 INFO:teuthology.orchestra.run.smithi039.stdout: "critical", 2024-09-12T02:49:15.339 INFO:teuthology.orchestra.run.smithi039.stdout: "debug", 2024-09-12T02:49:15.339 INFO:teuthology.orchestra.run.smithi039.stdout: "error", 2024-09-12T02:49:15.339 INFO:teuthology.orchestra.run.smithi039.stdout: "info", 2024-09-12T02:49:15.339 INFO:teuthology.orchestra.run.smithi039.stdout: "warning" 2024-09-12T02:49:15.339 INFO:teuthology.orchestra.run.smithi039.stdout: ], 2024-09-12T02:49:15.339 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "", 2024-09-12T02:49:15.339 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-09-12T02:49:15.339 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-09-12T02:49:15.339 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-09-12T02:49:15.340 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-09-12T02:49:15.340 INFO:teuthology.orchestra.run.smithi039.stdout: "log_to_file": { 2024-09-12T02:49:15.340 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "log_to_file", 2024-09-12T02:49:15.340 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "bool", 2024-09-12T02:49:15.340 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "advanced", 2024-09-12T02:49:15.340 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 1, 2024-09-12T02:49:15.340 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "False", 2024-09-12T02:49:15.340 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-09-12T02:49:15.340 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-09-12T02:49:15.340 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [], 2024-09-12T02:49:15.340 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "", 2024-09-12T02:49:15.340 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-09-12T02:49:15.340 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-09-12T02:49:15.340 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-09-12T02:49:15.341 INFO:teuthology.orchestra.run.smithi039.stdout: } 2024-09-12T02:49:15.341 INFO:teuthology.orchestra.run.smithi039.stdout: } 2024-09-12T02:49:15.341 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-09-12T02:49:15.341 INFO:teuthology.orchestra.run.smithi039.stdout: { 2024-09-12T02:49:15.341 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "localpool", 2024-09-12T02:49:15.341 INFO:teuthology.orchestra.run.smithi039.stdout: "can_run": true, 2024-09-12T02:49:15.341 INFO:teuthology.orchestra.run.smithi039.stdout: "error_string": "", 2024-09-12T02:49:15.341 INFO:teuthology.orchestra.run.smithi039.stdout: "module_options": { 2024-09-12T02:49:15.341 INFO:teuthology.orchestra.run.smithi039.stdout: "failure_domain": { 2024-09-12T02:49:15.341 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "failure_domain", 2024-09-12T02:49:15.341 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "str", 2024-09-12T02:49:15.341 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "advanced", 2024-09-12T02:49:15.341 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 1, 2024-09-12T02:49:15.342 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "host", 2024-09-12T02:49:15.342 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-09-12T02:49:15.342 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-09-12T02:49:15.342 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [], 2024-09-12T02:49:15.342 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "failure domain for any created local pool", 2024-09-12T02:49:15.342 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "what failure domain we should separate data replicas across.", 2024-09-12T02:49:15.342 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-09-12T02:49:15.342 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-09-12T02:49:15.342 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-09-12T02:49:15.342 INFO:teuthology.orchestra.run.smithi039.stdout: "log_level": { 2024-09-12T02:49:15.342 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "log_level", 2024-09-12T02:49:15.342 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "str", 2024-09-12T02:49:15.342 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "advanced", 2024-09-12T02:49:15.342 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 1, 2024-09-12T02:49:15.343 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "", 2024-09-12T02:49:15.343 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-09-12T02:49:15.343 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-09-12T02:49:15.343 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [ 2024-09-12T02:49:15.343 INFO:teuthology.orchestra.run.smithi039.stdout: "", 2024-09-12T02:49:15.343 INFO:teuthology.orchestra.run.smithi039.stdout: "critical", 2024-09-12T02:49:15.343 INFO:teuthology.orchestra.run.smithi039.stdout: "debug", 2024-09-12T02:49:15.343 INFO:teuthology.orchestra.run.smithi039.stdout: "error", 2024-09-12T02:49:15.343 INFO:teuthology.orchestra.run.smithi039.stdout: "info", 2024-09-12T02:49:15.343 INFO:teuthology.orchestra.run.smithi039.stdout: "warning" 2024-09-12T02:49:15.343 INFO:teuthology.orchestra.run.smithi039.stdout: ], 2024-09-12T02:49:15.343 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "", 2024-09-12T02:49:15.343 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-09-12T02:49:15.344 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-09-12T02:49:15.344 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-09-12T02:49:15.344 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-09-12T02:49:15.344 INFO:teuthology.orchestra.run.smithi039.stdout: "log_to_cluster": { 2024-09-12T02:49:15.344 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "log_to_cluster", 2024-09-12T02:49:15.344 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "bool", 2024-09-12T02:49:15.344 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "advanced", 2024-09-12T02:49:15.344 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 1, 2024-09-12T02:49:15.344 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "False", 2024-09-12T02:49:15.344 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-09-12T02:49:15.344 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-09-12T02:49:15.344 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [], 2024-09-12T02:49:15.344 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "", 2024-09-12T02:49:15.344 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-09-12T02:49:15.345 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-09-12T02:49:15.345 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-09-12T02:49:15.345 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-09-12T02:49:15.345 INFO:teuthology.orchestra.run.smithi039.stdout: "log_to_cluster_level": { 2024-09-12T02:49:15.345 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "log_to_cluster_level", 2024-09-12T02:49:15.345 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "str", 2024-09-12T02:49:15.345 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "advanced", 2024-09-12T02:49:15.345 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 1, 2024-09-12T02:49:15.345 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "info", 2024-09-12T02:49:15.345 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-09-12T02:49:15.345 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-09-12T02:49:15.345 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [ 2024-09-12T02:49:15.345 INFO:teuthology.orchestra.run.smithi039.stdout: "", 2024-09-12T02:49:15.346 INFO:teuthology.orchestra.run.smithi039.stdout: "critical", 2024-09-12T02:49:15.346 INFO:teuthology.orchestra.run.smithi039.stdout: "debug", 2024-09-12T02:49:15.346 INFO:teuthology.orchestra.run.smithi039.stdout: "error", 2024-09-12T02:49:15.346 INFO:teuthology.orchestra.run.smithi039.stdout: "info", 2024-09-12T02:49:15.346 INFO:teuthology.orchestra.run.smithi039.stdout: "warning" 2024-09-12T02:49:15.346 INFO:teuthology.orchestra.run.smithi039.stdout: ], 2024-09-12T02:49:15.346 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "", 2024-09-12T02:49:15.346 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-09-12T02:49:15.346 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-09-12T02:49:15.346 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-09-12T02:49:15.346 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-09-12T02:49:15.346 INFO:teuthology.orchestra.run.smithi039.stdout: "log_to_file": { 2024-09-12T02:49:15.346 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "log_to_file", 2024-09-12T02:49:15.347 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "bool", 2024-09-12T02:49:15.347 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "advanced", 2024-09-12T02:49:15.347 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 1, 2024-09-12T02:49:15.347 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "False", 2024-09-12T02:49:15.347 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-09-12T02:49:15.347 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-09-12T02:49:15.347 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [], 2024-09-12T02:49:15.347 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "", 2024-09-12T02:49:15.347 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-09-12T02:49:15.347 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-09-12T02:49:15.347 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-09-12T02:49:15.347 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-09-12T02:49:15.347 INFO:teuthology.orchestra.run.smithi039.stdout: "min_size": { 2024-09-12T02:49:15.347 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "min_size", 2024-09-12T02:49:15.348 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "int", 2024-09-12T02:49:15.348 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "advanced", 2024-09-12T02:49:15.348 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 1, 2024-09-12T02:49:15.348 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "", 2024-09-12T02:49:15.348 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-09-12T02:49:15.348 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-09-12T02:49:15.348 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [], 2024-09-12T02:49:15.348 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "default min_size for any created local pool", 2024-09-12T02:49:15.348 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "value to set min_size to (unchanged from Ceph's default if this option is not set)", 2024-09-12T02:49:15.348 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-09-12T02:49:15.348 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-09-12T02:49:15.348 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-09-12T02:49:15.348 INFO:teuthology.orchestra.run.smithi039.stdout: "num_rep": { 2024-09-12T02:49:15.349 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "num_rep", 2024-09-12T02:49:15.349 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "int", 2024-09-12T02:49:15.349 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "advanced", 2024-09-12T02:49:15.349 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 1, 2024-09-12T02:49:15.349 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "3", 2024-09-12T02:49:15.349 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-09-12T02:49:15.349 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-09-12T02:49:15.349 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [], 2024-09-12T02:49:15.349 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "default replica count for any created local pool", 2024-09-12T02:49:15.349 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-09-12T02:49:15.349 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-09-12T02:49:15.349 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-09-12T02:49:15.349 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-09-12T02:49:15.349 INFO:teuthology.orchestra.run.smithi039.stdout: "pg_num": { 2024-09-12T02:49:15.350 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "pg_num", 2024-09-12T02:49:15.350 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "int", 2024-09-12T02:49:15.350 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "advanced", 2024-09-12T02:49:15.350 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 1, 2024-09-12T02:49:15.350 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "128", 2024-09-12T02:49:15.350 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-09-12T02:49:15.350 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-09-12T02:49:15.350 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [], 2024-09-12T02:49:15.350 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "default pg_num for any created local pool", 2024-09-12T02:49:15.350 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-09-12T02:49:15.350 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-09-12T02:49:15.350 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-09-12T02:49:15.350 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-09-12T02:49:15.350 INFO:teuthology.orchestra.run.smithi039.stdout: "prefix": { 2024-09-12T02:49:15.351 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "prefix", 2024-09-12T02:49:15.351 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "str", 2024-09-12T02:49:15.351 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "advanced", 2024-09-12T02:49:15.351 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 1, 2024-09-12T02:49:15.351 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "", 2024-09-12T02:49:15.351 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-09-12T02:49:15.351 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-09-12T02:49:15.351 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [], 2024-09-12T02:49:15.351 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "name prefix for any created local pool", 2024-09-12T02:49:15.351 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-09-12T02:49:15.351 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-09-12T02:49:15.351 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-09-12T02:49:15.351 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-09-12T02:49:15.351 INFO:teuthology.orchestra.run.smithi039.stdout: "subtree": { 2024-09-12T02:49:15.352 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "subtree", 2024-09-12T02:49:15.352 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "str", 2024-09-12T02:49:15.352 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "advanced", 2024-09-12T02:49:15.352 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 1, 2024-09-12T02:49:15.352 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "rack", 2024-09-12T02:49:15.352 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-09-12T02:49:15.352 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-09-12T02:49:15.352 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [], 2024-09-12T02:49:15.352 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "CRUSH level for which to create a local pool", 2024-09-12T02:49:15.352 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "which CRUSH subtree type the module should create a pool for.", 2024-09-12T02:49:15.352 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-09-12T02:49:15.352 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-09-12T02:49:15.352 INFO:teuthology.orchestra.run.smithi039.stdout: } 2024-09-12T02:49:15.353 INFO:teuthology.orchestra.run.smithi039.stdout: } 2024-09-12T02:49:15.353 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-09-12T02:49:15.353 INFO:teuthology.orchestra.run.smithi039.stdout: { 2024-09-12T02:49:15.353 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "mds_autoscaler", 2024-09-12T02:49:15.353 INFO:teuthology.orchestra.run.smithi039.stdout: "can_run": true, 2024-09-12T02:49:15.353 INFO:teuthology.orchestra.run.smithi039.stdout: "error_string": "", 2024-09-12T02:49:15.353 INFO:teuthology.orchestra.run.smithi039.stdout: "module_options": { 2024-09-12T02:49:15.353 INFO:teuthology.orchestra.run.smithi039.stdout: "log_level": { 2024-09-12T02:49:15.353 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "log_level", 2024-09-12T02:49:15.353 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "str", 2024-09-12T02:49:15.353 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "advanced", 2024-09-12T02:49:15.353 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 1, 2024-09-12T02:49:15.353 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "", 2024-09-12T02:49:15.353 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-09-12T02:49:15.354 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-09-12T02:49:15.354 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [ 2024-09-12T02:49:15.354 INFO:teuthology.orchestra.run.smithi039.stdout: "", 2024-09-12T02:49:15.354 INFO:teuthology.orchestra.run.smithi039.stdout: "critical", 2024-09-12T02:49:15.354 INFO:teuthology.orchestra.run.smithi039.stdout: "debug", 2024-09-12T02:49:15.354 INFO:teuthology.orchestra.run.smithi039.stdout: "error", 2024-09-12T02:49:15.354 INFO:teuthology.orchestra.run.smithi039.stdout: "info", 2024-09-12T02:49:15.354 INFO:teuthology.orchestra.run.smithi039.stdout: "warning" 2024-09-12T02:49:15.354 INFO:teuthology.orchestra.run.smithi039.stdout: ], 2024-09-12T02:49:15.354 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "", 2024-09-12T02:49:15.354 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-09-12T02:49:15.354 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-09-12T02:49:15.354 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-09-12T02:49:15.355 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-09-12T02:49:15.355 INFO:teuthology.orchestra.run.smithi039.stdout: "log_to_cluster": { 2024-09-12T02:49:15.355 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "log_to_cluster", 2024-09-12T02:49:15.355 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "bool", 2024-09-12T02:49:15.355 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "advanced", 2024-09-12T02:49:15.355 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 1, 2024-09-12T02:49:15.355 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "False", 2024-09-12T02:49:15.355 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-09-12T02:49:15.355 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-09-12T02:49:15.355 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [], 2024-09-12T02:49:15.355 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "", 2024-09-12T02:49:15.355 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-09-12T02:49:15.355 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-09-12T02:49:15.356 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-09-12T02:49:15.356 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-09-12T02:49:15.356 INFO:teuthology.orchestra.run.smithi039.stdout: "log_to_cluster_level": { 2024-09-12T02:49:15.356 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "log_to_cluster_level", 2024-09-12T02:49:15.356 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "str", 2024-09-12T02:49:15.356 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "advanced", 2024-09-12T02:49:15.356 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 1, 2024-09-12T02:49:15.356 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "info", 2024-09-12T02:49:15.356 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-09-12T02:49:15.356 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-09-12T02:49:15.356 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [ 2024-09-12T02:49:15.356 INFO:teuthology.orchestra.run.smithi039.stdout: "", 2024-09-12T02:49:15.356 INFO:teuthology.orchestra.run.smithi039.stdout: "critical", 2024-09-12T02:49:15.357 INFO:teuthology.orchestra.run.smithi039.stdout: "debug", 2024-09-12T02:49:15.357 INFO:teuthology.orchestra.run.smithi039.stdout: "error", 2024-09-12T02:49:15.357 INFO:teuthology.orchestra.run.smithi039.stdout: "info", 2024-09-12T02:49:15.357 INFO:teuthology.orchestra.run.smithi039.stdout: "warning" 2024-09-12T02:49:15.357 INFO:teuthology.orchestra.run.smithi039.stdout: ], 2024-09-12T02:49:15.357 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "", 2024-09-12T02:49:15.357 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-09-12T02:49:15.357 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-09-12T02:49:15.357 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-09-12T02:49:15.357 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-09-12T02:49:15.357 INFO:teuthology.orchestra.run.smithi039.stdout: "log_to_file": { 2024-09-12T02:49:15.357 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "log_to_file", 2024-09-12T02:49:15.357 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "bool", 2024-09-12T02:49:15.357 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "advanced", 2024-09-12T02:49:15.358 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 1, 2024-09-12T02:49:15.358 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "False", 2024-09-12T02:49:15.358 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-09-12T02:49:15.358 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-09-12T02:49:15.358 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [], 2024-09-12T02:49:15.358 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "", 2024-09-12T02:49:15.358 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-09-12T02:49:15.358 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-09-12T02:49:15.358 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-09-12T02:49:15.358 INFO:teuthology.orchestra.run.smithi039.stdout: } 2024-09-12T02:49:15.358 INFO:teuthology.orchestra.run.smithi039.stdout: } 2024-09-12T02:49:15.358 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-09-12T02:49:15.358 INFO:teuthology.orchestra.run.smithi039.stdout: { 2024-09-12T02:49:15.359 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "mirroring", 2024-09-12T02:49:15.359 INFO:teuthology.orchestra.run.smithi039.stdout: "can_run": true, 2024-09-12T02:49:15.359 INFO:teuthology.orchestra.run.smithi039.stdout: "error_string": "", 2024-09-12T02:49:15.359 INFO:teuthology.orchestra.run.smithi039.stdout: "module_options": { 2024-09-12T02:49:15.359 INFO:teuthology.orchestra.run.smithi039.stdout: "log_level": { 2024-09-12T02:49:15.359 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "log_level", 2024-09-12T02:49:15.359 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "str", 2024-09-12T02:49:15.359 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "advanced", 2024-09-12T02:49:15.359 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 1, 2024-09-12T02:49:15.359 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "", 2024-09-12T02:49:15.359 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-09-12T02:49:15.359 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-09-12T02:49:15.360 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [ 2024-09-12T02:49:15.360 INFO:teuthology.orchestra.run.smithi039.stdout: "", 2024-09-12T02:49:15.360 INFO:teuthology.orchestra.run.smithi039.stdout: "critical", 2024-09-12T02:49:15.360 INFO:teuthology.orchestra.run.smithi039.stdout: "debug", 2024-09-12T02:49:15.360 INFO:teuthology.orchestra.run.smithi039.stdout: "error", 2024-09-12T02:49:15.360 INFO:teuthology.orchestra.run.smithi039.stdout: "info", 2024-09-12T02:49:15.360 INFO:teuthology.orchestra.run.smithi039.stdout: "warning" 2024-09-12T02:49:15.360 INFO:teuthology.orchestra.run.smithi039.stdout: ], 2024-09-12T02:49:15.360 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "", 2024-09-12T02:49:15.360 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-09-12T02:49:15.360 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-09-12T02:49:15.360 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-09-12T02:49:15.360 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-09-12T02:49:15.361 INFO:teuthology.orchestra.run.smithi039.stdout: "log_to_cluster": { 2024-09-12T02:49:15.361 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "log_to_cluster", 2024-09-12T02:49:15.361 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "bool", 2024-09-12T02:49:15.361 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "advanced", 2024-09-12T02:49:15.361 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 1, 2024-09-12T02:49:15.361 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "False", 2024-09-12T02:49:15.361 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-09-12T02:49:15.361 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-09-12T02:49:15.361 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [], 2024-09-12T02:49:15.361 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "", 2024-09-12T02:49:15.361 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-09-12T02:49:15.361 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-09-12T02:49:15.361 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-09-12T02:49:15.362 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-09-12T02:49:15.362 INFO:teuthology.orchestra.run.smithi039.stdout: "log_to_cluster_level": { 2024-09-12T02:49:15.362 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "log_to_cluster_level", 2024-09-12T02:49:15.362 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "str", 2024-09-12T02:49:15.362 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "advanced", 2024-09-12T02:49:15.362 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 1, 2024-09-12T02:49:15.362 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "info", 2024-09-12T02:49:15.362 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-09-12T02:49:15.362 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-09-12T02:49:15.362 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [ 2024-09-12T02:49:15.362 INFO:teuthology.orchestra.run.smithi039.stdout: "", 2024-09-12T02:49:15.362 INFO:teuthology.orchestra.run.smithi039.stdout: "critical", 2024-09-12T02:49:15.362 INFO:teuthology.orchestra.run.smithi039.stdout: "debug", 2024-09-12T02:49:15.362 INFO:teuthology.orchestra.run.smithi039.stdout: "error", 2024-09-12T02:49:15.363 INFO:teuthology.orchestra.run.smithi039.stdout: "info", 2024-09-12T02:49:15.363 INFO:teuthology.orchestra.run.smithi039.stdout: "warning" 2024-09-12T02:49:15.363 INFO:teuthology.orchestra.run.smithi039.stdout: ], 2024-09-12T02:49:15.363 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "", 2024-09-12T02:49:15.363 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-09-12T02:49:15.363 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-09-12T02:49:15.363 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-09-12T02:49:15.363 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-09-12T02:49:15.363 INFO:teuthology.orchestra.run.smithi039.stdout: "log_to_file": { 2024-09-12T02:49:15.363 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "log_to_file", 2024-09-12T02:49:15.363 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "bool", 2024-09-12T02:49:15.363 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "advanced", 2024-09-12T02:49:15.363 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 1, 2024-09-12T02:49:15.363 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "False", 2024-09-12T02:49:15.364 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-09-12T02:49:15.364 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-09-12T02:49:15.364 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [], 2024-09-12T02:49:15.364 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "", 2024-09-12T02:49:15.364 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-09-12T02:49:15.364 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-09-12T02:49:15.364 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-09-12T02:49:15.364 INFO:teuthology.orchestra.run.smithi039.stdout: } 2024-09-12T02:49:15.364 INFO:teuthology.orchestra.run.smithi039.stdout: } 2024-09-12T02:49:15.364 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-09-12T02:49:15.364 INFO:teuthology.orchestra.run.smithi039.stdout: { 2024-09-12T02:49:15.364 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "nfs", 2024-09-12T02:49:15.364 INFO:teuthology.orchestra.run.smithi039.stdout: "can_run": true, 2024-09-12T02:49:15.364 INFO:teuthology.orchestra.run.smithi039.stdout: "error_string": "", 2024-09-12T02:49:15.365 INFO:teuthology.orchestra.run.smithi039.stdout: "module_options": { 2024-09-12T02:49:15.365 INFO:teuthology.orchestra.run.smithi039.stdout: "log_level": { 2024-09-12T02:49:15.365 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "log_level", 2024-09-12T02:49:15.365 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "str", 2024-09-12T02:49:15.365 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "advanced", 2024-09-12T02:49:15.365 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 1, 2024-09-12T02:49:15.365 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "", 2024-09-12T02:49:15.365 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-09-12T02:49:15.365 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-09-12T02:49:15.365 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [ 2024-09-12T02:49:15.365 INFO:teuthology.orchestra.run.smithi039.stdout: "", 2024-09-12T02:49:15.365 INFO:teuthology.orchestra.run.smithi039.stdout: "critical", 2024-09-12T02:49:15.365 INFO:teuthology.orchestra.run.smithi039.stdout: "debug", 2024-09-12T02:49:15.366 INFO:teuthology.orchestra.run.smithi039.stdout: "error", 2024-09-12T02:49:15.366 INFO:teuthology.orchestra.run.smithi039.stdout: "info", 2024-09-12T02:49:15.366 INFO:teuthology.orchestra.run.smithi039.stdout: "warning" 2024-09-12T02:49:15.366 INFO:teuthology.orchestra.run.smithi039.stdout: ], 2024-09-12T02:49:15.366 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "", 2024-09-12T02:49:15.366 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-09-12T02:49:15.366 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-09-12T02:49:15.366 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-09-12T02:49:15.366 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-09-12T02:49:15.366 INFO:teuthology.orchestra.run.smithi039.stdout: "log_to_cluster": { 2024-09-12T02:49:15.366 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "log_to_cluster", 2024-09-12T02:49:15.366 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "bool", 2024-09-12T02:49:15.366 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "advanced", 2024-09-12T02:49:15.366 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 1, 2024-09-12T02:49:15.367 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "False", 2024-09-12T02:49:15.367 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-09-12T02:49:15.367 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-09-12T02:49:15.367 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [], 2024-09-12T02:49:15.367 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "", 2024-09-12T02:49:15.367 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-09-12T02:49:15.367 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-09-12T02:49:15.367 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-09-12T02:49:15.367 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-09-12T02:49:15.367 INFO:teuthology.orchestra.run.smithi039.stdout: "log_to_cluster_level": { 2024-09-12T02:49:15.367 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "log_to_cluster_level", 2024-09-12T02:49:15.367 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "str", 2024-09-12T02:49:15.367 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "advanced", 2024-09-12T02:49:15.367 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 1, 2024-09-12T02:49:15.368 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "info", 2024-09-12T02:49:15.368 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-09-12T02:49:15.368 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-09-12T02:49:15.368 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [ 2024-09-12T02:49:15.368 INFO:teuthology.orchestra.run.smithi039.stdout: "", 2024-09-12T02:49:15.368 INFO:teuthology.orchestra.run.smithi039.stdout: "critical", 2024-09-12T02:49:15.368 INFO:teuthology.orchestra.run.smithi039.stdout: "debug", 2024-09-12T02:49:15.368 INFO:teuthology.orchestra.run.smithi039.stdout: "error", 2024-09-12T02:49:15.368 INFO:teuthology.orchestra.run.smithi039.stdout: "info", 2024-09-12T02:49:15.368 INFO:teuthology.orchestra.run.smithi039.stdout: "warning" 2024-09-12T02:49:15.368 INFO:teuthology.orchestra.run.smithi039.stdout: ], 2024-09-12T02:49:15.368 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "", 2024-09-12T02:49:15.368 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-09-12T02:49:15.369 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-09-12T02:49:15.369 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-09-12T02:49:15.369 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-09-12T02:49:15.369 INFO:teuthology.orchestra.run.smithi039.stdout: "log_to_file": { 2024-09-12T02:49:15.369 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "log_to_file", 2024-09-12T02:49:15.369 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "bool", 2024-09-12T02:49:15.369 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "advanced", 2024-09-12T02:49:15.369 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 1, 2024-09-12T02:49:15.369 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "False", 2024-09-12T02:49:15.369 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-09-12T02:49:15.369 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-09-12T02:49:15.369 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [], 2024-09-12T02:49:15.369 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "", 2024-09-12T02:49:15.370 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-09-12T02:49:15.370 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-09-12T02:49:15.370 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-09-12T02:49:15.370 INFO:teuthology.orchestra.run.smithi039.stdout: } 2024-09-12T02:49:15.370 INFO:teuthology.orchestra.run.smithi039.stdout: } 2024-09-12T02:49:15.370 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-09-12T02:49:15.370 INFO:teuthology.orchestra.run.smithi039.stdout: { 2024-09-12T02:49:15.370 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "orchestrator", 2024-09-12T02:49:15.370 INFO:teuthology.orchestra.run.smithi039.stdout: "can_run": true, 2024-09-12T02:49:15.370 INFO:teuthology.orchestra.run.smithi039.stdout: "error_string": "", 2024-09-12T02:49:15.370 INFO:teuthology.orchestra.run.smithi039.stdout: "module_options": { 2024-09-12T02:49:15.370 INFO:teuthology.orchestra.run.smithi039.stdout: "fail_fs": { 2024-09-12T02:49:15.370 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "fail_fs", 2024-09-12T02:49:15.371 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "bool", 2024-09-12T02:49:15.371 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "advanced", 2024-09-12T02:49:15.371 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 0, 2024-09-12T02:49:15.371 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "False", 2024-09-12T02:49:15.371 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-09-12T02:49:15.371 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-09-12T02:49:15.371 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [], 2024-09-12T02:49:15.371 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "Fail filesystem for rapid multi-rank mds upgrade", 2024-09-12T02:49:15.371 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-09-12T02:49:15.371 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-09-12T02:49:15.371 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-09-12T02:49:15.371 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-09-12T02:49:15.371 INFO:teuthology.orchestra.run.smithi039.stdout: "log_level": { 2024-09-12T02:49:15.371 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "log_level", 2024-09-12T02:49:15.372 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "str", 2024-09-12T02:49:15.372 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "advanced", 2024-09-12T02:49:15.372 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 1, 2024-09-12T02:49:15.372 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "", 2024-09-12T02:49:15.372 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-09-12T02:49:15.372 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-09-12T02:49:15.372 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [ 2024-09-12T02:49:15.372 INFO:teuthology.orchestra.run.smithi039.stdout: "", 2024-09-12T02:49:15.372 INFO:teuthology.orchestra.run.smithi039.stdout: "critical", 2024-09-12T02:49:15.372 INFO:teuthology.orchestra.run.smithi039.stdout: "debug", 2024-09-12T02:49:15.372 INFO:teuthology.orchestra.run.smithi039.stdout: "error", 2024-09-12T02:49:15.372 INFO:teuthology.orchestra.run.smithi039.stdout: "info", 2024-09-12T02:49:15.372 INFO:teuthology.orchestra.run.smithi039.stdout: "warning" 2024-09-12T02:49:15.373 INFO:teuthology.orchestra.run.smithi039.stdout: ], 2024-09-12T02:49:15.373 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "", 2024-09-12T02:49:15.373 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-09-12T02:49:15.373 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-09-12T02:49:15.373 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-09-12T02:49:15.373 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-09-12T02:49:15.373 INFO:teuthology.orchestra.run.smithi039.stdout: "log_to_cluster": { 2024-09-12T02:49:15.373 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "log_to_cluster", 2024-09-12T02:49:15.373 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "bool", 2024-09-12T02:49:15.373 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "advanced", 2024-09-12T02:49:15.373 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 1, 2024-09-12T02:49:15.373 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "False", 2024-09-12T02:49:15.373 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-09-12T02:49:15.374 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-09-12T02:49:15.374 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [], 2024-09-12T02:49:15.374 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "", 2024-09-12T02:49:15.374 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-09-12T02:49:15.374 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-09-12T02:49:15.374 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-09-12T02:49:15.374 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-09-12T02:49:15.374 INFO:teuthology.orchestra.run.smithi039.stdout: "log_to_cluster_level": { 2024-09-12T02:49:15.374 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "log_to_cluster_level", 2024-09-12T02:49:15.374 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "str", 2024-09-12T02:49:15.374 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "advanced", 2024-09-12T02:49:15.374 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 1, 2024-09-12T02:49:15.374 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "info", 2024-09-12T02:49:15.375 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-09-12T02:49:15.375 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-09-12T02:49:15.375 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [ 2024-09-12T02:49:15.375 INFO:teuthology.orchestra.run.smithi039.stdout: "", 2024-09-12T02:49:15.375 INFO:teuthology.orchestra.run.smithi039.stdout: "critical", 2024-09-12T02:49:15.375 INFO:teuthology.orchestra.run.smithi039.stdout: "debug", 2024-09-12T02:49:15.375 INFO:teuthology.orchestra.run.smithi039.stdout: "error", 2024-09-12T02:49:15.375 INFO:teuthology.orchestra.run.smithi039.stdout: "info", 2024-09-12T02:49:15.375 INFO:teuthology.orchestra.run.smithi039.stdout: "warning" 2024-09-12T02:49:15.375 INFO:teuthology.orchestra.run.smithi039.stdout: ], 2024-09-12T02:49:15.375 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "", 2024-09-12T02:49:15.375 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-09-12T02:49:15.375 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-09-12T02:49:15.375 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-09-12T02:49:15.376 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-09-12T02:49:15.376 INFO:teuthology.orchestra.run.smithi039.stdout: "log_to_file": { 2024-09-12T02:49:15.376 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "log_to_file", 2024-09-12T02:49:15.376 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "bool", 2024-09-12T02:49:15.376 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "advanced", 2024-09-12T02:49:15.376 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 1, 2024-09-12T02:49:15.376 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "False", 2024-09-12T02:49:15.376 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-09-12T02:49:15.376 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-09-12T02:49:15.376 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [], 2024-09-12T02:49:15.376 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "", 2024-09-12T02:49:15.376 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-09-12T02:49:15.376 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-09-12T02:49:15.377 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-09-12T02:49:15.377 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-09-12T02:49:15.377 INFO:teuthology.orchestra.run.smithi039.stdout: "orchestrator": { 2024-09-12T02:49:15.377 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "orchestrator", 2024-09-12T02:49:15.377 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "str", 2024-09-12T02:49:15.377 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "advanced", 2024-09-12T02:49:15.377 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 1, 2024-09-12T02:49:15.377 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "", 2024-09-12T02:49:15.377 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-09-12T02:49:15.377 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-09-12T02:49:15.377 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [ 2024-09-12T02:49:15.377 INFO:teuthology.orchestra.run.smithi039.stdout: "cephadm", 2024-09-12T02:49:15.377 INFO:teuthology.orchestra.run.smithi039.stdout: "rook", 2024-09-12T02:49:15.378 INFO:teuthology.orchestra.run.smithi039.stdout: "test_orchestrator" 2024-09-12T02:49:15.378 INFO:teuthology.orchestra.run.smithi039.stdout: ], 2024-09-12T02:49:15.378 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "Orchestrator backend", 2024-09-12T02:49:15.378 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-09-12T02:49:15.378 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-09-12T02:49:15.378 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-09-12T02:49:15.378 INFO:teuthology.orchestra.run.smithi039.stdout: } 2024-09-12T02:49:15.378 INFO:teuthology.orchestra.run.smithi039.stdout: } 2024-09-12T02:49:15.378 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-09-12T02:49:15.378 INFO:teuthology.orchestra.run.smithi039.stdout: { 2024-09-12T02:49:15.378 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "osd_perf_query", 2024-09-12T02:49:15.378 INFO:teuthology.orchestra.run.smithi039.stdout: "can_run": true, 2024-09-12T02:49:15.378 INFO:teuthology.orchestra.run.smithi039.stdout: "error_string": "", 2024-09-12T02:49:15.379 INFO:teuthology.orchestra.run.smithi039.stdout: "module_options": { 2024-09-12T02:49:15.379 INFO:teuthology.orchestra.run.smithi039.stdout: "log_level": { 2024-09-12T02:49:15.379 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "log_level", 2024-09-12T02:49:15.379 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "str", 2024-09-12T02:49:15.379 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "advanced", 2024-09-12T02:49:15.379 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 1, 2024-09-12T02:49:15.379 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "", 2024-09-12T02:49:15.379 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-09-12T02:49:15.379 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-09-12T02:49:15.379 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [ 2024-09-12T02:49:15.379 INFO:teuthology.orchestra.run.smithi039.stdout: "", 2024-09-12T02:49:15.379 INFO:teuthology.orchestra.run.smithi039.stdout: "critical", 2024-09-12T02:49:15.379 INFO:teuthology.orchestra.run.smithi039.stdout: "debug", 2024-09-12T02:49:15.379 INFO:teuthology.orchestra.run.smithi039.stdout: "error", 2024-09-12T02:49:15.380 INFO:teuthology.orchestra.run.smithi039.stdout: "info", 2024-09-12T02:49:15.380 INFO:teuthology.orchestra.run.smithi039.stdout: "warning" 2024-09-12T02:49:15.380 INFO:teuthology.orchestra.run.smithi039.stdout: ], 2024-09-12T02:49:15.380 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "", 2024-09-12T02:49:15.380 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-09-12T02:49:15.380 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-09-12T02:49:15.380 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-09-12T02:49:15.380 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-09-12T02:49:15.380 INFO:teuthology.orchestra.run.smithi039.stdout: "log_to_cluster": { 2024-09-12T02:49:15.380 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "log_to_cluster", 2024-09-12T02:49:15.380 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "bool", 2024-09-12T02:49:15.380 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "advanced", 2024-09-12T02:49:15.380 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 1, 2024-09-12T02:49:15.381 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "False", 2024-09-12T02:49:15.381 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-09-12T02:49:15.381 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-09-12T02:49:15.381 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [], 2024-09-12T02:49:15.381 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "", 2024-09-12T02:49:15.381 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-09-12T02:49:15.381 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-09-12T02:49:15.381 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-09-12T02:49:15.381 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-09-12T02:49:15.381 INFO:teuthology.orchestra.run.smithi039.stdout: "log_to_cluster_level": { 2024-09-12T02:49:15.381 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "log_to_cluster_level", 2024-09-12T02:49:15.381 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "str", 2024-09-12T02:49:15.381 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "advanced", 2024-09-12T02:49:15.381 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 1, 2024-09-12T02:49:15.382 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "info", 2024-09-12T02:49:15.382 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-09-12T02:49:15.382 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-09-12T02:49:15.382 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [ 2024-09-12T02:49:15.382 INFO:teuthology.orchestra.run.smithi039.stdout: "", 2024-09-12T02:49:15.382 INFO:teuthology.orchestra.run.smithi039.stdout: "critical", 2024-09-12T02:49:15.382 INFO:teuthology.orchestra.run.smithi039.stdout: "debug", 2024-09-12T02:49:15.382 INFO:teuthology.orchestra.run.smithi039.stdout: "error", 2024-09-12T02:49:15.382 INFO:teuthology.orchestra.run.smithi039.stdout: "info", 2024-09-12T02:49:15.382 INFO:teuthology.orchestra.run.smithi039.stdout: "warning" 2024-09-12T02:49:15.382 INFO:teuthology.orchestra.run.smithi039.stdout: ], 2024-09-12T02:49:15.382 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "", 2024-09-12T02:49:15.382 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-09-12T02:49:15.382 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-09-12T02:49:15.383 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-09-12T02:49:15.383 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-09-12T02:49:15.383 INFO:teuthology.orchestra.run.smithi039.stdout: "log_to_file": { 2024-09-12T02:49:15.383 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "log_to_file", 2024-09-12T02:49:15.383 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "bool", 2024-09-12T02:49:15.383 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "advanced", 2024-09-12T02:49:15.383 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 1, 2024-09-12T02:49:15.383 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "False", 2024-09-12T02:49:15.383 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-09-12T02:49:15.383 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-09-12T02:49:15.383 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [], 2024-09-12T02:49:15.383 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "", 2024-09-12T02:49:15.383 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-09-12T02:49:15.383 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-09-12T02:49:15.384 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-09-12T02:49:15.384 INFO:teuthology.orchestra.run.smithi039.stdout: } 2024-09-12T02:49:15.384 INFO:teuthology.orchestra.run.smithi039.stdout: } 2024-09-12T02:49:15.384 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-09-12T02:49:15.384 INFO:teuthology.orchestra.run.smithi039.stdout: { 2024-09-12T02:49:15.384 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "osd_support", 2024-09-12T02:49:15.384 INFO:teuthology.orchestra.run.smithi039.stdout: "can_run": true, 2024-09-12T02:49:15.384 INFO:teuthology.orchestra.run.smithi039.stdout: "error_string": "", 2024-09-12T02:49:15.384 INFO:teuthology.orchestra.run.smithi039.stdout: "module_options": { 2024-09-12T02:49:15.384 INFO:teuthology.orchestra.run.smithi039.stdout: "log_level": { 2024-09-12T02:49:15.384 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "log_level", 2024-09-12T02:49:15.384 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "str", 2024-09-12T02:49:15.384 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "advanced", 2024-09-12T02:49:15.385 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 1, 2024-09-12T02:49:15.385 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "", 2024-09-12T02:49:15.385 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-09-12T02:49:15.385 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-09-12T02:49:15.385 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [ 2024-09-12T02:49:15.385 INFO:teuthology.orchestra.run.smithi039.stdout: "", 2024-09-12T02:49:15.385 INFO:teuthology.orchestra.run.smithi039.stdout: "critical", 2024-09-12T02:49:15.385 INFO:teuthology.orchestra.run.smithi039.stdout: "debug", 2024-09-12T02:49:15.385 INFO:teuthology.orchestra.run.smithi039.stdout: "error", 2024-09-12T02:49:15.385 INFO:teuthology.orchestra.run.smithi039.stdout: "info", 2024-09-12T02:49:15.385 INFO:teuthology.orchestra.run.smithi039.stdout: "warning" 2024-09-12T02:49:15.385 INFO:teuthology.orchestra.run.smithi039.stdout: ], 2024-09-12T02:49:15.385 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "", 2024-09-12T02:49:15.385 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-09-12T02:49:15.386 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-09-12T02:49:15.386 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-09-12T02:49:15.386 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-09-12T02:49:15.386 INFO:teuthology.orchestra.run.smithi039.stdout: "log_to_cluster": { 2024-09-12T02:49:15.386 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "log_to_cluster", 2024-09-12T02:49:15.386 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "bool", 2024-09-12T02:49:15.386 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "advanced", 2024-09-12T02:49:15.386 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 1, 2024-09-12T02:49:15.386 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "False", 2024-09-12T02:49:15.386 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-09-12T02:49:15.386 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-09-12T02:49:15.386 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [], 2024-09-12T02:49:15.386 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "", 2024-09-12T02:49:15.386 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-09-12T02:49:15.387 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-09-12T02:49:15.387 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-09-12T02:49:15.387 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-09-12T02:49:15.387 INFO:teuthology.orchestra.run.smithi039.stdout: "log_to_cluster_level": { 2024-09-12T02:49:15.387 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "log_to_cluster_level", 2024-09-12T02:49:15.387 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "str", 2024-09-12T02:49:15.387 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "advanced", 2024-09-12T02:49:15.387 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 1, 2024-09-12T02:49:15.387 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "info", 2024-09-12T02:49:15.387 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-09-12T02:49:15.387 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-09-12T02:49:15.387 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [ 2024-09-12T02:49:15.387 INFO:teuthology.orchestra.run.smithi039.stdout: "", 2024-09-12T02:49:15.387 INFO:teuthology.orchestra.run.smithi039.stdout: "critical", 2024-09-12T02:49:15.388 INFO:teuthology.orchestra.run.smithi039.stdout: "debug", 2024-09-12T02:49:15.388 INFO:teuthology.orchestra.run.smithi039.stdout: "error", 2024-09-12T02:49:15.388 INFO:teuthology.orchestra.run.smithi039.stdout: "info", 2024-09-12T02:49:15.388 INFO:teuthology.orchestra.run.smithi039.stdout: "warning" 2024-09-12T02:49:15.388 INFO:teuthology.orchestra.run.smithi039.stdout: ], 2024-09-12T02:49:15.388 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "", 2024-09-12T02:49:15.388 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-09-12T02:49:15.388 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-09-12T02:49:15.388 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-09-12T02:49:15.388 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-09-12T02:49:15.388 INFO:teuthology.orchestra.run.smithi039.stdout: "log_to_file": { 2024-09-12T02:49:15.388 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "log_to_file", 2024-09-12T02:49:15.388 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "bool", 2024-09-12T02:49:15.389 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "advanced", 2024-09-12T02:49:15.389 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 1, 2024-09-12T02:49:15.389 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "False", 2024-09-12T02:49:15.389 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-09-12T02:49:15.389 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-09-12T02:49:15.389 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [], 2024-09-12T02:49:15.389 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "", 2024-09-12T02:49:15.389 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-09-12T02:49:15.389 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-09-12T02:49:15.389 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-09-12T02:49:15.389 INFO:teuthology.orchestra.run.smithi039.stdout: } 2024-09-12T02:49:15.389 INFO:teuthology.orchestra.run.smithi039.stdout: } 2024-09-12T02:49:15.389 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-09-12T02:49:15.389 INFO:teuthology.orchestra.run.smithi039.stdout: { 2024-09-12T02:49:15.390 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "pg_autoscaler", 2024-09-12T02:49:15.390 INFO:teuthology.orchestra.run.smithi039.stdout: "can_run": true, 2024-09-12T02:49:15.390 INFO:teuthology.orchestra.run.smithi039.stdout: "error_string": "", 2024-09-12T02:49:15.390 INFO:teuthology.orchestra.run.smithi039.stdout: "module_options": { 2024-09-12T02:49:15.390 INFO:teuthology.orchestra.run.smithi039.stdout: "log_level": { 2024-09-12T02:49:15.390 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "log_level", 2024-09-12T02:49:15.390 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "str", 2024-09-12T02:49:15.390 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "advanced", 2024-09-12T02:49:15.390 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 1, 2024-09-12T02:49:15.390 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "", 2024-09-12T02:49:15.390 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-09-12T02:49:15.390 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-09-12T02:49:15.390 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [ 2024-09-12T02:49:15.391 INFO:teuthology.orchestra.run.smithi039.stdout: "", 2024-09-12T02:49:15.391 INFO:teuthology.orchestra.run.smithi039.stdout: "critical", 2024-09-12T02:49:15.391 INFO:teuthology.orchestra.run.smithi039.stdout: "debug", 2024-09-12T02:49:15.391 INFO:teuthology.orchestra.run.smithi039.stdout: "error", 2024-09-12T02:49:15.391 INFO:teuthology.orchestra.run.smithi039.stdout: "info", 2024-09-12T02:49:15.391 INFO:teuthology.orchestra.run.smithi039.stdout: "warning" 2024-09-12T02:49:15.391 INFO:teuthology.orchestra.run.smithi039.stdout: ], 2024-09-12T02:49:15.391 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "", 2024-09-12T02:49:15.391 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-09-12T02:49:15.391 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-09-12T02:49:15.391 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-09-12T02:49:15.391 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-09-12T02:49:15.391 INFO:teuthology.orchestra.run.smithi039.stdout: "log_to_cluster": { 2024-09-12T02:49:15.392 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "log_to_cluster", 2024-09-12T02:49:15.392 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "bool", 2024-09-12T02:49:15.392 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "advanced", 2024-09-12T02:49:15.392 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 1, 2024-09-12T02:49:15.392 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "False", 2024-09-12T02:49:15.392 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-09-12T02:49:15.392 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-09-12T02:49:15.392 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [], 2024-09-12T02:49:15.392 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "", 2024-09-12T02:49:15.392 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-09-12T02:49:15.392 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-09-12T02:49:15.392 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-09-12T02:49:15.392 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-09-12T02:49:15.393 INFO:teuthology.orchestra.run.smithi039.stdout: "log_to_cluster_level": { 2024-09-12T02:49:15.393 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "log_to_cluster_level", 2024-09-12T02:49:15.393 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "str", 2024-09-12T02:49:15.393 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "advanced", 2024-09-12T02:49:15.393 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 1, 2024-09-12T02:49:15.393 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "info", 2024-09-12T02:49:15.393 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-09-12T02:49:15.393 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-09-12T02:49:15.393 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [ 2024-09-12T02:49:15.393 INFO:teuthology.orchestra.run.smithi039.stdout: "", 2024-09-12T02:49:15.393 INFO:teuthology.orchestra.run.smithi039.stdout: "critical", 2024-09-12T02:49:15.393 INFO:teuthology.orchestra.run.smithi039.stdout: "debug", 2024-09-12T02:49:15.393 INFO:teuthology.orchestra.run.smithi039.stdout: "error", 2024-09-12T02:49:15.394 INFO:teuthology.orchestra.run.smithi039.stdout: "info", 2024-09-12T02:49:15.394 INFO:teuthology.orchestra.run.smithi039.stdout: "warning" 2024-09-12T02:49:15.394 INFO:teuthology.orchestra.run.smithi039.stdout: ], 2024-09-12T02:49:15.394 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "", 2024-09-12T02:49:15.394 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-09-12T02:49:15.394 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-09-12T02:49:15.394 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-09-12T02:49:15.394 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-09-12T02:49:15.394 INFO:teuthology.orchestra.run.smithi039.stdout: "log_to_file": { 2024-09-12T02:49:15.394 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "log_to_file", 2024-09-12T02:49:15.394 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "bool", 2024-09-12T02:49:15.394 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "advanced", 2024-09-12T02:49:15.394 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 1, 2024-09-12T02:49:15.395 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "False", 2024-09-12T02:49:15.395 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-09-12T02:49:15.395 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-09-12T02:49:15.395 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [], 2024-09-12T02:49:15.395 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "", 2024-09-12T02:49:15.395 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-09-12T02:49:15.395 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-09-12T02:49:15.395 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-09-12T02:49:15.395 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-09-12T02:49:15.395 INFO:teuthology.orchestra.run.smithi039.stdout: "sleep_interval": { 2024-09-12T02:49:15.395 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "sleep_interval", 2024-09-12T02:49:15.395 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "secs", 2024-09-12T02:49:15.395 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "advanced", 2024-09-12T02:49:15.396 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 0, 2024-09-12T02:49:15.396 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "60", 2024-09-12T02:49:15.396 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-09-12T02:49:15.396 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-09-12T02:49:15.396 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [], 2024-09-12T02:49:15.396 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "", 2024-09-12T02:49:15.396 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-09-12T02:49:15.396 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-09-12T02:49:15.396 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-09-12T02:49:15.396 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-09-12T02:49:15.396 INFO:teuthology.orchestra.run.smithi039.stdout: "threshold": { 2024-09-12T02:49:15.396 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "threshold", 2024-09-12T02:49:15.396 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "float", 2024-09-12T02:49:15.397 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "advanced", 2024-09-12T02:49:15.397 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 0, 2024-09-12T02:49:15.397 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "3.0", 2024-09-12T02:49:15.397 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "1.0", 2024-09-12T02:49:15.397 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-09-12T02:49:15.397 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [], 2024-09-12T02:49:15.397 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "scaling threshold", 2024-09-12T02:49:15.397 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "The factor by which the `NEW PG_NUM` must vary from the current`PG_NUM` before being accepted. Cannot be less than 1.0", 2024-09-12T02:49:15.397 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-09-12T02:49:15.397 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-09-12T02:49:15.397 INFO:teuthology.orchestra.run.smithi039.stdout: } 2024-09-12T02:49:15.397 INFO:teuthology.orchestra.run.smithi039.stdout: } 2024-09-12T02:49:15.397 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-09-12T02:49:15.398 INFO:teuthology.orchestra.run.smithi039.stdout: { 2024-09-12T02:49:15.398 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "progress", 2024-09-12T02:49:15.398 INFO:teuthology.orchestra.run.smithi039.stdout: "can_run": true, 2024-09-12T02:49:15.398 INFO:teuthology.orchestra.run.smithi039.stdout: "error_string": "", 2024-09-12T02:49:15.398 INFO:teuthology.orchestra.run.smithi039.stdout: "module_options": { 2024-09-12T02:49:15.398 INFO:teuthology.orchestra.run.smithi039.stdout: "allow_pg_recovery_event": { 2024-09-12T02:49:15.398 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "allow_pg_recovery_event", 2024-09-12T02:49:15.398 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "bool", 2024-09-12T02:49:15.398 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "advanced", 2024-09-12T02:49:15.398 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 1, 2024-09-12T02:49:15.398 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "False", 2024-09-12T02:49:15.398 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-09-12T02:49:15.398 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-09-12T02:49:15.399 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [], 2024-09-12T02:49:15.399 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "allow the module to show pg recovery progress", 2024-09-12T02:49:15.399 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-09-12T02:49:15.399 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-09-12T02:49:15.399 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-09-12T02:49:15.399 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-09-12T02:49:15.399 INFO:teuthology.orchestra.run.smithi039.stdout: "enabled": { 2024-09-12T02:49:15.399 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "enabled", 2024-09-12T02:49:15.399 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "bool", 2024-09-12T02:49:15.399 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "advanced", 2024-09-12T02:49:15.399 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 0, 2024-09-12T02:49:15.399 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "True", 2024-09-12T02:49:15.399 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-09-12T02:49:15.399 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-09-12T02:49:15.400 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [], 2024-09-12T02:49:15.400 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "", 2024-09-12T02:49:15.400 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-09-12T02:49:15.400 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-09-12T02:49:15.400 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-09-12T02:49:15.400 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-09-12T02:49:15.400 INFO:teuthology.orchestra.run.smithi039.stdout: "log_level": { 2024-09-12T02:49:15.400 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "log_level", 2024-09-12T02:49:15.400 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "str", 2024-09-12T02:49:15.400 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "advanced", 2024-09-12T02:49:15.400 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 1, 2024-09-12T02:49:15.400 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "", 2024-09-12T02:49:15.400 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-09-12T02:49:15.401 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-09-12T02:49:15.401 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [ 2024-09-12T02:49:15.401 INFO:teuthology.orchestra.run.smithi039.stdout: "", 2024-09-12T02:49:15.401 INFO:teuthology.orchestra.run.smithi039.stdout: "critical", 2024-09-12T02:49:15.401 INFO:teuthology.orchestra.run.smithi039.stdout: "debug", 2024-09-12T02:49:15.401 INFO:teuthology.orchestra.run.smithi039.stdout: "error", 2024-09-12T02:49:15.401 INFO:teuthology.orchestra.run.smithi039.stdout: "info", 2024-09-12T02:49:15.401 INFO:teuthology.orchestra.run.smithi039.stdout: "warning" 2024-09-12T02:49:15.401 INFO:teuthology.orchestra.run.smithi039.stdout: ], 2024-09-12T02:49:15.401 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "", 2024-09-12T02:49:15.401 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-09-12T02:49:15.401 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-09-12T02:49:15.401 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-09-12T02:49:15.402 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-09-12T02:49:15.402 INFO:teuthology.orchestra.run.smithi039.stdout: "log_to_cluster": { 2024-09-12T02:49:15.402 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "log_to_cluster", 2024-09-12T02:49:15.402 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "bool", 2024-09-12T02:49:15.402 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "advanced", 2024-09-12T02:49:15.402 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 1, 2024-09-12T02:49:15.402 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "False", 2024-09-12T02:49:15.402 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-09-12T02:49:15.402 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-09-12T02:49:15.402 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [], 2024-09-12T02:49:15.402 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "", 2024-09-12T02:49:15.402 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-09-12T02:49:15.402 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-09-12T02:49:15.402 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-09-12T02:49:15.403 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-09-12T02:49:15.403 INFO:teuthology.orchestra.run.smithi039.stdout: "log_to_cluster_level": { 2024-09-12T02:49:15.403 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "log_to_cluster_level", 2024-09-12T02:49:15.403 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "str", 2024-09-12T02:49:15.403 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "advanced", 2024-09-12T02:49:15.403 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 1, 2024-09-12T02:49:15.403 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "info", 2024-09-12T02:49:15.403 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-09-12T02:49:15.403 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-09-12T02:49:15.403 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [ 2024-09-12T02:49:15.403 INFO:teuthology.orchestra.run.smithi039.stdout: "", 2024-09-12T02:49:15.403 INFO:teuthology.orchestra.run.smithi039.stdout: "critical", 2024-09-12T02:49:15.403 INFO:teuthology.orchestra.run.smithi039.stdout: "debug", 2024-09-12T02:49:15.404 INFO:teuthology.orchestra.run.smithi039.stdout: "error", 2024-09-12T02:49:15.404 INFO:teuthology.orchestra.run.smithi039.stdout: "info", 2024-09-12T02:49:15.404 INFO:teuthology.orchestra.run.smithi039.stdout: "warning" 2024-09-12T02:49:15.404 INFO:teuthology.orchestra.run.smithi039.stdout: ], 2024-09-12T02:49:15.404 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "", 2024-09-12T02:49:15.404 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-09-12T02:49:15.404 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-09-12T02:49:15.404 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-09-12T02:49:15.404 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-09-12T02:49:15.404 INFO:teuthology.orchestra.run.smithi039.stdout: "log_to_file": { 2024-09-12T02:49:15.404 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "log_to_file", 2024-09-12T02:49:15.404 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "bool", 2024-09-12T02:49:15.404 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "advanced", 2024-09-12T02:49:15.405 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 1, 2024-09-12T02:49:15.405 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "False", 2024-09-12T02:49:15.405 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-09-12T02:49:15.405 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-09-12T02:49:15.405 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [], 2024-09-12T02:49:15.405 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "", 2024-09-12T02:49:15.405 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-09-12T02:49:15.405 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-09-12T02:49:15.405 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-09-12T02:49:15.405 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-09-12T02:49:15.405 INFO:teuthology.orchestra.run.smithi039.stdout: "max_completed_events": { 2024-09-12T02:49:15.405 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "max_completed_events", 2024-09-12T02:49:15.405 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "int", 2024-09-12T02:49:15.405 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "advanced", 2024-09-12T02:49:15.406 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 1, 2024-09-12T02:49:15.406 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "50", 2024-09-12T02:49:15.406 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-09-12T02:49:15.406 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-09-12T02:49:15.406 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [], 2024-09-12T02:49:15.406 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "number of past completed events to remember", 2024-09-12T02:49:15.406 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-09-12T02:49:15.406 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-09-12T02:49:15.406 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-09-12T02:49:15.406 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-09-12T02:49:15.406 INFO:teuthology.orchestra.run.smithi039.stdout: "sleep_interval": { 2024-09-12T02:49:15.406 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "sleep_interval", 2024-09-12T02:49:15.406 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "secs", 2024-09-12T02:49:15.407 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "advanced", 2024-09-12T02:49:15.407 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 1, 2024-09-12T02:49:15.407 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "5", 2024-09-12T02:49:15.407 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-09-12T02:49:15.407 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-09-12T02:49:15.407 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [], 2024-09-12T02:49:15.407 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "how long the module is going to sleep", 2024-09-12T02:49:15.407 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-09-12T02:49:15.407 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-09-12T02:49:15.407 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-09-12T02:49:15.407 INFO:teuthology.orchestra.run.smithi039.stdout: } 2024-09-12T02:49:15.407 INFO:teuthology.orchestra.run.smithi039.stdout: } 2024-09-12T02:49:15.407 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-09-12T02:49:15.407 INFO:teuthology.orchestra.run.smithi039.stdout: { 2024-09-12T02:49:15.408 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "prometheus", 2024-09-12T02:49:15.408 INFO:teuthology.orchestra.run.smithi039.stdout: "can_run": true, 2024-09-12T02:49:15.408 INFO:teuthology.orchestra.run.smithi039.stdout: "error_string": "", 2024-09-12T02:49:15.408 INFO:teuthology.orchestra.run.smithi039.stdout: "module_options": { 2024-09-12T02:49:15.408 INFO:teuthology.orchestra.run.smithi039.stdout: "cache": { 2024-09-12T02:49:15.408 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "cache", 2024-09-12T02:49:15.408 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "bool", 2024-09-12T02:49:15.408 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "advanced", 2024-09-12T02:49:15.408 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 0, 2024-09-12T02:49:15.408 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "True", 2024-09-12T02:49:15.408 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-09-12T02:49:15.408 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-09-12T02:49:15.408 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [], 2024-09-12T02:49:15.409 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "", 2024-09-12T02:49:15.409 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-09-12T02:49:15.409 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-09-12T02:49:15.409 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-09-12T02:49:15.409 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-09-12T02:49:15.409 INFO:teuthology.orchestra.run.smithi039.stdout: "exclude_perf_counters": { 2024-09-12T02:49:15.409 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "exclude_perf_counters", 2024-09-12T02:49:15.409 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "bool", 2024-09-12T02:49:15.409 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "advanced", 2024-09-12T02:49:15.409 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 1, 2024-09-12T02:49:15.409 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "True", 2024-09-12T02:49:15.409 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-09-12T02:49:15.409 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-09-12T02:49:15.410 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [], 2024-09-12T02:49:15.410 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "Do not include perf-counters in the metrics output", 2024-09-12T02:49:15.410 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "Gathering perf-counters from a single Prometheus exporter can degrade ceph-mgr performance, especially in large clusters. Instead, Ceph-exporter daemons are now used by default for perf-counter gathering. This should only be disabled when no ceph-exporters are deployed.", 2024-09-12T02:49:15.410 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-09-12T02:49:15.410 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-09-12T02:49:15.410 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-09-12T02:49:15.410 INFO:teuthology.orchestra.run.smithi039.stdout: "log_level": { 2024-09-12T02:49:15.410 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "log_level", 2024-09-12T02:49:15.410 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "str", 2024-09-12T02:49:15.410 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "advanced", 2024-09-12T02:49:15.410 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 1, 2024-09-12T02:49:15.410 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "", 2024-09-12T02:49:15.410 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-09-12T02:49:15.411 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-09-12T02:49:15.411 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [ 2024-09-12T02:49:15.411 INFO:teuthology.orchestra.run.smithi039.stdout: "", 2024-09-12T02:49:15.411 INFO:teuthology.orchestra.run.smithi039.stdout: "critical", 2024-09-12T02:49:15.411 INFO:teuthology.orchestra.run.smithi039.stdout: "debug", 2024-09-12T02:49:15.411 INFO:teuthology.orchestra.run.smithi039.stdout: "error", 2024-09-12T02:49:15.411 INFO:teuthology.orchestra.run.smithi039.stdout: "info", 2024-09-12T02:49:15.411 INFO:teuthology.orchestra.run.smithi039.stdout: "warning" 2024-09-12T02:49:15.411 INFO:teuthology.orchestra.run.smithi039.stdout: ], 2024-09-12T02:49:15.411 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "", 2024-09-12T02:49:15.411 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-09-12T02:49:15.411 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-09-12T02:49:15.411 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-09-12T02:49:15.411 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-09-12T02:49:15.412 INFO:teuthology.orchestra.run.smithi039.stdout: "log_to_cluster": { 2024-09-12T02:49:15.412 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "log_to_cluster", 2024-09-12T02:49:15.412 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "bool", 2024-09-12T02:49:15.412 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "advanced", 2024-09-12T02:49:15.412 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 1, 2024-09-12T02:49:15.412 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "False", 2024-09-12T02:49:15.412 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-09-12T02:49:15.412 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-09-12T02:49:15.412 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [], 2024-09-12T02:49:15.412 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "", 2024-09-12T02:49:15.412 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-09-12T02:49:15.412 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-09-12T02:49:15.412 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-09-12T02:49:15.413 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-09-12T02:49:15.413 INFO:teuthology.orchestra.run.smithi039.stdout: "log_to_cluster_level": { 2024-09-12T02:49:15.413 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "log_to_cluster_level", 2024-09-12T02:49:15.413 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "str", 2024-09-12T02:49:15.413 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "advanced", 2024-09-12T02:49:15.413 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 1, 2024-09-12T02:49:15.413 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "info", 2024-09-12T02:49:15.413 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-09-12T02:49:15.413 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-09-12T02:49:15.413 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [ 2024-09-12T02:49:15.413 INFO:teuthology.orchestra.run.smithi039.stdout: "", 2024-09-12T02:49:15.413 INFO:teuthology.orchestra.run.smithi039.stdout: "critical", 2024-09-12T02:49:15.413 INFO:teuthology.orchestra.run.smithi039.stdout: "debug", 2024-09-12T02:49:15.414 INFO:teuthology.orchestra.run.smithi039.stdout: "error", 2024-09-12T02:49:15.414 INFO:teuthology.orchestra.run.smithi039.stdout: "info", 2024-09-12T02:49:15.414 INFO:teuthology.orchestra.run.smithi039.stdout: "warning" 2024-09-12T02:49:15.414 INFO:teuthology.orchestra.run.smithi039.stdout: ], 2024-09-12T02:49:15.414 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "", 2024-09-12T02:49:15.414 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-09-12T02:49:15.414 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-09-12T02:49:15.414 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-09-12T02:49:15.414 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-09-12T02:49:15.414 INFO:teuthology.orchestra.run.smithi039.stdout: "log_to_file": { 2024-09-12T02:49:15.414 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "log_to_file", 2024-09-12T02:49:15.414 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "bool", 2024-09-12T02:49:15.414 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "advanced", 2024-09-12T02:49:15.414 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 1, 2024-09-12T02:49:15.415 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "False", 2024-09-12T02:49:15.415 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-09-12T02:49:15.415 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-09-12T02:49:15.415 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [], 2024-09-12T02:49:15.415 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "", 2024-09-12T02:49:15.415 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-09-12T02:49:15.415 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-09-12T02:49:15.415 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-09-12T02:49:15.415 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-09-12T02:49:15.415 INFO:teuthology.orchestra.run.smithi039.stdout: "rbd_stats_pools": { 2024-09-12T02:49:15.415 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "rbd_stats_pools", 2024-09-12T02:49:15.415 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "str", 2024-09-12T02:49:15.415 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "advanced", 2024-09-12T02:49:15.415 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 0, 2024-09-12T02:49:15.416 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "", 2024-09-12T02:49:15.416 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-09-12T02:49:15.416 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-09-12T02:49:15.416 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [], 2024-09-12T02:49:15.416 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "", 2024-09-12T02:49:15.416 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-09-12T02:49:15.416 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-09-12T02:49:15.416 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-09-12T02:49:15.416 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-09-12T02:49:15.416 INFO:teuthology.orchestra.run.smithi039.stdout: "rbd_stats_pools_refresh_interval": { 2024-09-12T02:49:15.416 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "rbd_stats_pools_refresh_interval", 2024-09-12T02:49:15.416 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "int", 2024-09-12T02:49:15.416 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "advanced", 2024-09-12T02:49:15.417 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 0, 2024-09-12T02:49:15.417 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "300", 2024-09-12T02:49:15.417 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-09-12T02:49:15.417 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-09-12T02:49:15.417 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [], 2024-09-12T02:49:15.417 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "", 2024-09-12T02:49:15.417 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-09-12T02:49:15.417 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-09-12T02:49:15.417 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-09-12T02:49:15.417 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-09-12T02:49:15.417 INFO:teuthology.orchestra.run.smithi039.stdout: "scrape_interval": { 2024-09-12T02:49:15.417 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "scrape_interval", 2024-09-12T02:49:15.417 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "float", 2024-09-12T02:49:15.417 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "advanced", 2024-09-12T02:49:15.418 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 0, 2024-09-12T02:49:15.418 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "15.0", 2024-09-12T02:49:15.418 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-09-12T02:49:15.418 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-09-12T02:49:15.418 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [], 2024-09-12T02:49:15.418 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "", 2024-09-12T02:49:15.418 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-09-12T02:49:15.418 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-09-12T02:49:15.418 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-09-12T02:49:15.418 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-09-12T02:49:15.418 INFO:teuthology.orchestra.run.smithi039.stdout: "server_addr": { 2024-09-12T02:49:15.418 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "server_addr", 2024-09-12T02:49:15.418 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "str", 2024-09-12T02:49:15.418 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "advanced", 2024-09-12T02:49:15.419 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 0, 2024-09-12T02:49:15.419 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "::", 2024-09-12T02:49:15.419 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-09-12T02:49:15.419 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-09-12T02:49:15.419 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [], 2024-09-12T02:49:15.419 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "the IPv4 or IPv6 address on which the module listens for HTTP requests", 2024-09-12T02:49:15.419 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-09-12T02:49:15.419 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-09-12T02:49:15.419 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-09-12T02:49:15.419 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-09-12T02:49:15.419 INFO:teuthology.orchestra.run.smithi039.stdout: "server_port": { 2024-09-12T02:49:15.419 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "server_port", 2024-09-12T02:49:15.419 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "int", 2024-09-12T02:49:15.419 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "advanced", 2024-09-12T02:49:15.420 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 1, 2024-09-12T02:49:15.420 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "9283", 2024-09-12T02:49:15.420 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-09-12T02:49:15.420 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-09-12T02:49:15.420 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [], 2024-09-12T02:49:15.420 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "the port on which the module listens for HTTP requests", 2024-09-12T02:49:15.420 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-09-12T02:49:15.420 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-09-12T02:49:15.420 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-09-12T02:49:15.420 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-09-12T02:49:15.420 INFO:teuthology.orchestra.run.smithi039.stdout: "stale_cache_strategy": { 2024-09-12T02:49:15.420 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "stale_cache_strategy", 2024-09-12T02:49:15.420 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "str", 2024-09-12T02:49:15.421 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "advanced", 2024-09-12T02:49:15.421 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 0, 2024-09-12T02:49:15.421 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "log", 2024-09-12T02:49:15.421 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-09-12T02:49:15.421 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-09-12T02:49:15.421 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [], 2024-09-12T02:49:15.421 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "", 2024-09-12T02:49:15.421 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-09-12T02:49:15.421 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-09-12T02:49:15.421 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-09-12T02:49:15.421 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-09-12T02:49:15.421 INFO:teuthology.orchestra.run.smithi039.stdout: "standby_behaviour": { 2024-09-12T02:49:15.421 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "standby_behaviour", 2024-09-12T02:49:15.421 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "str", 2024-09-12T02:49:15.422 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "advanced", 2024-09-12T02:49:15.422 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 1, 2024-09-12T02:49:15.422 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "default", 2024-09-12T02:49:15.422 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-09-12T02:49:15.422 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-09-12T02:49:15.422 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [ 2024-09-12T02:49:15.422 INFO:teuthology.orchestra.run.smithi039.stdout: "default", 2024-09-12T02:49:15.422 INFO:teuthology.orchestra.run.smithi039.stdout: "error" 2024-09-12T02:49:15.422 INFO:teuthology.orchestra.run.smithi039.stdout: ], 2024-09-12T02:49:15.422 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "", 2024-09-12T02:49:15.422 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-09-12T02:49:15.422 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-09-12T02:49:15.422 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-09-12T02:49:15.422 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-09-12T02:49:15.423 INFO:teuthology.orchestra.run.smithi039.stdout: "standby_error_status_code": { 2024-09-12T02:49:15.423 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "standby_error_status_code", 2024-09-12T02:49:15.423 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "int", 2024-09-12T02:49:15.423 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "advanced", 2024-09-12T02:49:15.423 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 1, 2024-09-12T02:49:15.423 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "500", 2024-09-12T02:49:15.423 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "400", 2024-09-12T02:49:15.423 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "599", 2024-09-12T02:49:15.423 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [], 2024-09-12T02:49:15.423 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "", 2024-09-12T02:49:15.423 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-09-12T02:49:15.423 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-09-12T02:49:15.423 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-09-12T02:49:15.423 INFO:teuthology.orchestra.run.smithi039.stdout: } 2024-09-12T02:49:15.424 INFO:teuthology.orchestra.run.smithi039.stdout: } 2024-09-12T02:49:15.424 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-09-12T02:49:15.424 INFO:teuthology.orchestra.run.smithi039.stdout: { 2024-09-12T02:49:15.424 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "rbd_support", 2024-09-12T02:49:15.424 INFO:teuthology.orchestra.run.smithi039.stdout: "can_run": true, 2024-09-12T02:49:15.424 INFO:teuthology.orchestra.run.smithi039.stdout: "error_string": "", 2024-09-12T02:49:15.424 INFO:teuthology.orchestra.run.smithi039.stdout: "module_options": { 2024-09-12T02:49:15.424 INFO:teuthology.orchestra.run.smithi039.stdout: "log_level": { 2024-09-12T02:49:15.424 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "log_level", 2024-09-12T02:49:15.424 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "str", 2024-09-12T02:49:15.424 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "advanced", 2024-09-12T02:49:15.424 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 1, 2024-09-12T02:49:15.424 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "", 2024-09-12T02:49:15.425 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-09-12T02:49:15.425 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-09-12T02:49:15.425 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [ 2024-09-12T02:49:15.425 INFO:teuthology.orchestra.run.smithi039.stdout: "", 2024-09-12T02:49:15.425 INFO:teuthology.orchestra.run.smithi039.stdout: "critical", 2024-09-12T02:49:15.425 INFO:teuthology.orchestra.run.smithi039.stdout: "debug", 2024-09-12T02:49:15.425 INFO:teuthology.orchestra.run.smithi039.stdout: "error", 2024-09-12T02:49:15.425 INFO:teuthology.orchestra.run.smithi039.stdout: "info", 2024-09-12T02:49:15.425 INFO:teuthology.orchestra.run.smithi039.stdout: "warning" 2024-09-12T02:49:15.425 INFO:teuthology.orchestra.run.smithi039.stdout: ], 2024-09-12T02:49:15.425 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "", 2024-09-12T02:49:15.425 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-09-12T02:49:15.425 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-09-12T02:49:15.426 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-09-12T02:49:15.426 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-09-12T02:49:15.426 INFO:teuthology.orchestra.run.smithi039.stdout: "log_to_cluster": { 2024-09-12T02:49:15.426 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "log_to_cluster", 2024-09-12T02:49:15.426 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "bool", 2024-09-12T02:49:15.426 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "advanced", 2024-09-12T02:49:15.426 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 1, 2024-09-12T02:49:15.426 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "False", 2024-09-12T02:49:15.426 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-09-12T02:49:15.426 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-09-12T02:49:15.426 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [], 2024-09-12T02:49:15.426 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "", 2024-09-12T02:49:15.426 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-09-12T02:49:15.426 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-09-12T02:49:15.427 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-09-12T02:49:15.427 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-09-12T02:49:15.427 INFO:teuthology.orchestra.run.smithi039.stdout: "log_to_cluster_level": { 2024-09-12T02:49:15.427 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "log_to_cluster_level", 2024-09-12T02:49:15.427 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "str", 2024-09-12T02:49:15.427 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "advanced", 2024-09-12T02:49:15.427 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 1, 2024-09-12T02:49:15.427 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "info", 2024-09-12T02:49:15.427 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-09-12T02:49:15.427 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-09-12T02:49:15.427 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [ 2024-09-12T02:49:15.427 INFO:teuthology.orchestra.run.smithi039.stdout: "", 2024-09-12T02:49:15.427 INFO:teuthology.orchestra.run.smithi039.stdout: "critical", 2024-09-12T02:49:15.428 INFO:teuthology.orchestra.run.smithi039.stdout: "debug", 2024-09-12T02:49:15.428 INFO:teuthology.orchestra.run.smithi039.stdout: "error", 2024-09-12T02:49:15.428 INFO:teuthology.orchestra.run.smithi039.stdout: "info", 2024-09-12T02:49:15.428 INFO:teuthology.orchestra.run.smithi039.stdout: "warning" 2024-09-12T02:49:15.428 INFO:teuthology.orchestra.run.smithi039.stdout: ], 2024-09-12T02:49:15.428 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "", 2024-09-12T02:49:15.428 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-09-12T02:49:15.428 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-09-12T02:49:15.428 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-09-12T02:49:15.428 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-09-12T02:49:15.428 INFO:teuthology.orchestra.run.smithi039.stdout: "log_to_file": { 2024-09-12T02:49:15.428 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "log_to_file", 2024-09-12T02:49:15.428 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "bool", 2024-09-12T02:49:15.428 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "advanced", 2024-09-12T02:49:15.429 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 1, 2024-09-12T02:49:15.429 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "False", 2024-09-12T02:49:15.429 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-09-12T02:49:15.429 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-09-12T02:49:15.429 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [], 2024-09-12T02:49:15.429 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "", 2024-09-12T02:49:15.429 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-09-12T02:49:15.429 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-09-12T02:49:15.429 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-09-12T02:49:15.429 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-09-12T02:49:15.429 INFO:teuthology.orchestra.run.smithi039.stdout: "max_concurrent_snap_create": { 2024-09-12T02:49:15.429 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "max_concurrent_snap_create", 2024-09-12T02:49:15.429 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "int", 2024-09-12T02:49:15.430 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "advanced", 2024-09-12T02:49:15.430 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 0, 2024-09-12T02:49:15.430 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "10", 2024-09-12T02:49:15.430 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-09-12T02:49:15.430 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-09-12T02:49:15.430 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [], 2024-09-12T02:49:15.430 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "", 2024-09-12T02:49:15.430 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-09-12T02:49:15.430 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-09-12T02:49:15.430 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-09-12T02:49:15.430 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-09-12T02:49:15.430 INFO:teuthology.orchestra.run.smithi039.stdout: "mirror_snapshot_schedule": { 2024-09-12T02:49:15.430 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "mirror_snapshot_schedule", 2024-09-12T02:49:15.431 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "str", 2024-09-12T02:49:15.431 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "advanced", 2024-09-12T02:49:15.431 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 0, 2024-09-12T02:49:15.431 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "", 2024-09-12T02:49:15.431 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-09-12T02:49:15.431 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-09-12T02:49:15.431 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [], 2024-09-12T02:49:15.431 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "", 2024-09-12T02:49:15.431 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-09-12T02:49:15.431 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-09-12T02:49:15.431 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-09-12T02:49:15.431 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-09-12T02:49:15.431 INFO:teuthology.orchestra.run.smithi039.stdout: "trash_purge_schedule": { 2024-09-12T02:49:15.431 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "trash_purge_schedule", 2024-09-12T02:49:15.432 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "str", 2024-09-12T02:49:15.432 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "advanced", 2024-09-12T02:49:15.432 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 0, 2024-09-12T02:49:15.432 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "", 2024-09-12T02:49:15.432 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-09-12T02:49:15.432 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-09-12T02:49:15.432 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [], 2024-09-12T02:49:15.432 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "", 2024-09-12T02:49:15.432 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-09-12T02:49:15.432 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-09-12T02:49:15.432 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-09-12T02:49:15.432 INFO:teuthology.orchestra.run.smithi039.stdout: } 2024-09-12T02:49:15.432 INFO:teuthology.orchestra.run.smithi039.stdout: } 2024-09-12T02:49:15.433 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-09-12T02:49:15.433 INFO:teuthology.orchestra.run.smithi039.stdout: { 2024-09-12T02:49:15.433 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "restful", 2024-09-12T02:49:15.433 INFO:teuthology.orchestra.run.smithi039.stdout: "can_run": true, 2024-09-12T02:49:15.433 INFO:teuthology.orchestra.run.smithi039.stdout: "error_string": "", 2024-09-12T02:49:15.433 INFO:teuthology.orchestra.run.smithi039.stdout: "module_options": { 2024-09-12T02:49:15.433 INFO:teuthology.orchestra.run.smithi039.stdout: "enable_auth": { 2024-09-12T02:49:15.433 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "enable_auth", 2024-09-12T02:49:15.433 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "bool", 2024-09-12T02:49:15.433 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "advanced", 2024-09-12T02:49:15.433 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 0, 2024-09-12T02:49:15.433 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "True", 2024-09-12T02:49:15.433 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-09-12T02:49:15.433 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-09-12T02:49:15.434 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [], 2024-09-12T02:49:15.434 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "", 2024-09-12T02:49:15.434 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-09-12T02:49:15.434 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-09-12T02:49:15.434 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-09-12T02:49:15.434 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-09-12T02:49:15.434 INFO:teuthology.orchestra.run.smithi039.stdout: "key_file": { 2024-09-12T02:49:15.434 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "key_file", 2024-09-12T02:49:15.434 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "str", 2024-09-12T02:49:15.434 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "advanced", 2024-09-12T02:49:15.434 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 0, 2024-09-12T02:49:15.434 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "", 2024-09-12T02:49:15.434 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-09-12T02:49:15.435 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-09-12T02:49:15.435 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [], 2024-09-12T02:49:15.435 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "", 2024-09-12T02:49:15.435 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-09-12T02:49:15.435 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-09-12T02:49:15.435 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-09-12T02:49:15.435 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-09-12T02:49:15.435 INFO:teuthology.orchestra.run.smithi039.stdout: "log_level": { 2024-09-12T02:49:15.435 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "log_level", 2024-09-12T02:49:15.435 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "str", 2024-09-12T02:49:15.435 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "advanced", 2024-09-12T02:49:15.435 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 1, 2024-09-12T02:49:15.435 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "", 2024-09-12T02:49:15.435 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-09-12T02:49:15.436 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-09-12T02:49:15.436 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [ 2024-09-12T02:49:15.436 INFO:teuthology.orchestra.run.smithi039.stdout: "", 2024-09-12T02:49:15.436 INFO:teuthology.orchestra.run.smithi039.stdout: "critical", 2024-09-12T02:49:15.436 INFO:teuthology.orchestra.run.smithi039.stdout: "debug", 2024-09-12T02:49:15.436 INFO:teuthology.orchestra.run.smithi039.stdout: "error", 2024-09-12T02:49:15.436 INFO:teuthology.orchestra.run.smithi039.stdout: "info", 2024-09-12T02:49:15.436 INFO:teuthology.orchestra.run.smithi039.stdout: "warning" 2024-09-12T02:49:15.436 INFO:teuthology.orchestra.run.smithi039.stdout: ], 2024-09-12T02:49:15.436 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "", 2024-09-12T02:49:15.436 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-09-12T02:49:15.436 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-09-12T02:49:15.436 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-09-12T02:49:15.436 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-09-12T02:49:15.437 INFO:teuthology.orchestra.run.smithi039.stdout: "log_to_cluster": { 2024-09-12T02:49:15.437 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "log_to_cluster", 2024-09-12T02:49:15.437 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "bool", 2024-09-12T02:49:15.437 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "advanced", 2024-09-12T02:49:15.437 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 1, 2024-09-12T02:49:15.437 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "False", 2024-09-12T02:49:15.437 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-09-12T02:49:15.437 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-09-12T02:49:15.437 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [], 2024-09-12T02:49:15.437 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "", 2024-09-12T02:49:15.437 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-09-12T02:49:15.437 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-09-12T02:49:15.437 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-09-12T02:49:15.437 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-09-12T02:49:15.438 INFO:teuthology.orchestra.run.smithi039.stdout: "log_to_cluster_level": { 2024-09-12T02:49:15.438 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "log_to_cluster_level", 2024-09-12T02:49:15.438 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "str", 2024-09-12T02:49:15.438 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "advanced", 2024-09-12T02:49:15.438 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 1, 2024-09-12T02:49:15.438 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "info", 2024-09-12T02:49:15.438 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-09-12T02:49:15.438 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-09-12T02:49:15.438 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [ 2024-09-12T02:49:15.438 INFO:teuthology.orchestra.run.smithi039.stdout: "", 2024-09-12T02:49:15.438 INFO:teuthology.orchestra.run.smithi039.stdout: "critical", 2024-09-12T02:49:15.438 INFO:teuthology.orchestra.run.smithi039.stdout: "debug", 2024-09-12T02:49:15.438 INFO:teuthology.orchestra.run.smithi039.stdout: "error", 2024-09-12T02:49:15.438 INFO:teuthology.orchestra.run.smithi039.stdout: "info", 2024-09-12T02:49:15.439 INFO:teuthology.orchestra.run.smithi039.stdout: "warning" 2024-09-12T02:49:15.439 INFO:teuthology.orchestra.run.smithi039.stdout: ], 2024-09-12T02:49:15.439 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "", 2024-09-12T02:49:15.439 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-09-12T02:49:15.439 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-09-12T02:49:15.439 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-09-12T02:49:15.439 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-09-12T02:49:15.439 INFO:teuthology.orchestra.run.smithi039.stdout: "log_to_file": { 2024-09-12T02:49:15.439 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "log_to_file", 2024-09-12T02:49:15.439 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "bool", 2024-09-12T02:49:15.439 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "advanced", 2024-09-12T02:49:15.439 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 1, 2024-09-12T02:49:15.439 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "False", 2024-09-12T02:49:15.439 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-09-12T02:49:15.440 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-09-12T02:49:15.440 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [], 2024-09-12T02:49:15.440 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "", 2024-09-12T02:49:15.440 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-09-12T02:49:15.440 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-09-12T02:49:15.440 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-09-12T02:49:15.440 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-09-12T02:49:15.440 INFO:teuthology.orchestra.run.smithi039.stdout: "server_addr": { 2024-09-12T02:49:15.440 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "server_addr", 2024-09-12T02:49:15.440 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "str", 2024-09-12T02:49:15.440 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "advanced", 2024-09-12T02:49:15.440 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 0, 2024-09-12T02:49:15.440 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "", 2024-09-12T02:49:15.441 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-09-12T02:49:15.441 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-09-12T02:49:15.441 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [], 2024-09-12T02:49:15.441 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "", 2024-09-12T02:49:15.441 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-09-12T02:49:15.441 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-09-12T02:49:15.441 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-09-12T02:49:15.441 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-09-12T02:49:15.441 INFO:teuthology.orchestra.run.smithi039.stdout: "server_port": { 2024-09-12T02:49:15.441 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "server_port", 2024-09-12T02:49:15.441 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "str", 2024-09-12T02:49:15.441 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "advanced", 2024-09-12T02:49:15.441 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 0, 2024-09-12T02:49:15.441 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "", 2024-09-12T02:49:15.442 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-09-12T02:49:15.442 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-09-12T02:49:15.442 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [], 2024-09-12T02:49:15.442 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "", 2024-09-12T02:49:15.442 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-09-12T02:49:15.442 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-09-12T02:49:15.442 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-09-12T02:49:15.442 INFO:teuthology.orchestra.run.smithi039.stdout: } 2024-09-12T02:49:15.442 INFO:teuthology.orchestra.run.smithi039.stdout: } 2024-09-12T02:49:15.442 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-09-12T02:49:15.442 INFO:teuthology.orchestra.run.smithi039.stdout: { 2024-09-12T02:49:15.442 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "rgw", 2024-09-12T02:49:15.442 INFO:teuthology.orchestra.run.smithi039.stdout: "can_run": true, 2024-09-12T02:49:15.442 INFO:teuthology.orchestra.run.smithi039.stdout: "error_string": "", 2024-09-12T02:49:15.443 INFO:teuthology.orchestra.run.smithi039.stdout: "module_options": { 2024-09-12T02:49:15.443 INFO:teuthology.orchestra.run.smithi039.stdout: "log_level": { 2024-09-12T02:49:15.443 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "log_level", 2024-09-12T02:49:15.443 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "str", 2024-09-12T02:49:15.443 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "advanced", 2024-09-12T02:49:15.443 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 1, 2024-09-12T02:49:15.443 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "", 2024-09-12T02:49:15.443 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-09-12T02:49:15.443 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-09-12T02:49:15.443 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [ 2024-09-12T02:49:15.443 INFO:teuthology.orchestra.run.smithi039.stdout: "", 2024-09-12T02:49:15.443 INFO:teuthology.orchestra.run.smithi039.stdout: "critical", 2024-09-12T02:49:15.443 INFO:teuthology.orchestra.run.smithi039.stdout: "debug", 2024-09-12T02:49:15.444 INFO:teuthology.orchestra.run.smithi039.stdout: "error", 2024-09-12T02:49:15.444 INFO:teuthology.orchestra.run.smithi039.stdout: "info", 2024-09-12T02:49:15.444 INFO:teuthology.orchestra.run.smithi039.stdout: "warning" 2024-09-12T02:49:15.444 INFO:teuthology.orchestra.run.smithi039.stdout: ], 2024-09-12T02:49:15.444 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "", 2024-09-12T02:49:15.444 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-09-12T02:49:15.444 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-09-12T02:49:15.444 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-09-12T02:49:15.444 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-09-12T02:49:15.444 INFO:teuthology.orchestra.run.smithi039.stdout: "log_to_cluster": { 2024-09-12T02:49:15.444 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "log_to_cluster", 2024-09-12T02:49:15.444 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "bool", 2024-09-12T02:49:15.444 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "advanced", 2024-09-12T02:49:15.444 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 1, 2024-09-12T02:49:15.445 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "False", 2024-09-12T02:49:15.445 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-09-12T02:49:15.445 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-09-12T02:49:15.445 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [], 2024-09-12T02:49:15.445 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "", 2024-09-12T02:49:15.445 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-09-12T02:49:15.445 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-09-12T02:49:15.445 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-09-12T02:49:15.445 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-09-12T02:49:15.445 INFO:teuthology.orchestra.run.smithi039.stdout: "log_to_cluster_level": { 2024-09-12T02:49:15.445 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "log_to_cluster_level", 2024-09-12T02:49:15.445 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "str", 2024-09-12T02:49:15.445 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "advanced", 2024-09-12T02:49:15.446 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 1, 2024-09-12T02:49:15.446 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "info", 2024-09-12T02:49:15.446 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-09-12T02:49:15.446 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-09-12T02:49:15.446 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [ 2024-09-12T02:49:15.446 INFO:teuthology.orchestra.run.smithi039.stdout: "", 2024-09-12T02:49:15.446 INFO:teuthology.orchestra.run.smithi039.stdout: "critical", 2024-09-12T02:49:15.446 INFO:teuthology.orchestra.run.smithi039.stdout: "debug", 2024-09-12T02:49:15.446 INFO:teuthology.orchestra.run.smithi039.stdout: "error", 2024-09-12T02:49:15.446 INFO:teuthology.orchestra.run.smithi039.stdout: "info", 2024-09-12T02:49:15.446 INFO:teuthology.orchestra.run.smithi039.stdout: "warning" 2024-09-12T02:49:15.446 INFO:teuthology.orchestra.run.smithi039.stdout: ], 2024-09-12T02:49:15.446 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "", 2024-09-12T02:49:15.446 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-09-12T02:49:15.447 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-09-12T02:49:15.447 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-09-12T02:49:15.447 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-09-12T02:49:15.447 INFO:teuthology.orchestra.run.smithi039.stdout: "log_to_file": { 2024-09-12T02:49:15.447 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "log_to_file", 2024-09-12T02:49:15.447 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "bool", 2024-09-12T02:49:15.447 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "advanced", 2024-09-12T02:49:15.447 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 1, 2024-09-12T02:49:15.447 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "False", 2024-09-12T02:49:15.447 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-09-12T02:49:15.447 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-09-12T02:49:15.447 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [], 2024-09-12T02:49:15.447 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "", 2024-09-12T02:49:15.447 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-09-12T02:49:15.448 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-09-12T02:49:15.448 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-09-12T02:49:15.448 INFO:teuthology.orchestra.run.smithi039.stdout: } 2024-09-12T02:49:15.448 INFO:teuthology.orchestra.run.smithi039.stdout: } 2024-09-12T02:49:15.448 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-09-12T02:49:15.448 INFO:teuthology.orchestra.run.smithi039.stdout: { 2024-09-12T02:49:15.448 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "rook", 2024-09-12T02:49:15.448 INFO:teuthology.orchestra.run.smithi039.stdout: "can_run": true, 2024-09-12T02:49:15.448 INFO:teuthology.orchestra.run.smithi039.stdout: "error_string": "", 2024-09-12T02:49:15.448 INFO:teuthology.orchestra.run.smithi039.stdout: "module_options": { 2024-09-12T02:49:15.448 INFO:teuthology.orchestra.run.smithi039.stdout: "log_level": { 2024-09-12T02:49:15.448 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "log_level", 2024-09-12T02:49:15.448 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "str", 2024-09-12T02:49:15.449 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "advanced", 2024-09-12T02:49:15.449 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 1, 2024-09-12T02:49:15.449 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "", 2024-09-12T02:49:15.449 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-09-12T02:49:15.449 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-09-12T02:49:15.449 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [ 2024-09-12T02:49:15.449 INFO:teuthology.orchestra.run.smithi039.stdout: "", 2024-09-12T02:49:15.449 INFO:teuthology.orchestra.run.smithi039.stdout: "critical", 2024-09-12T02:49:15.449 INFO:teuthology.orchestra.run.smithi039.stdout: "debug", 2024-09-12T02:49:15.449 INFO:teuthology.orchestra.run.smithi039.stdout: "error", 2024-09-12T02:49:15.449 INFO:teuthology.orchestra.run.smithi039.stdout: "info", 2024-09-12T02:49:15.449 INFO:teuthology.orchestra.run.smithi039.stdout: "warning" 2024-09-12T02:49:15.449 INFO:teuthology.orchestra.run.smithi039.stdout: ], 2024-09-12T02:49:15.449 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "", 2024-09-12T02:49:15.450 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-09-12T02:49:15.450 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-09-12T02:49:15.450 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-09-12T02:49:15.450 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-09-12T02:49:15.450 INFO:teuthology.orchestra.run.smithi039.stdout: "log_to_cluster": { 2024-09-12T02:49:15.450 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "log_to_cluster", 2024-09-12T02:49:15.450 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "bool", 2024-09-12T02:49:15.450 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "advanced", 2024-09-12T02:49:15.450 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 1, 2024-09-12T02:49:15.450 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "False", 2024-09-12T02:49:15.450 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-09-12T02:49:15.450 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-09-12T02:49:15.450 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [], 2024-09-12T02:49:15.451 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "", 2024-09-12T02:49:15.451 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-09-12T02:49:15.451 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-09-12T02:49:15.451 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-09-12T02:49:15.451 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-09-12T02:49:15.451 INFO:teuthology.orchestra.run.smithi039.stdout: "log_to_cluster_level": { 2024-09-12T02:49:15.451 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "log_to_cluster_level", 2024-09-12T02:49:15.451 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "str", 2024-09-12T02:49:15.451 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "advanced", 2024-09-12T02:49:15.451 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 1, 2024-09-12T02:49:15.451 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "info", 2024-09-12T02:49:15.451 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-09-12T02:49:15.451 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-09-12T02:49:15.451 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [ 2024-09-12T02:49:15.452 INFO:teuthology.orchestra.run.smithi039.stdout: "", 2024-09-12T02:49:15.452 INFO:teuthology.orchestra.run.smithi039.stdout: "critical", 2024-09-12T02:49:15.452 INFO:teuthology.orchestra.run.smithi039.stdout: "debug", 2024-09-12T02:49:15.452 INFO:teuthology.orchestra.run.smithi039.stdout: "error", 2024-09-12T02:49:15.452 INFO:teuthology.orchestra.run.smithi039.stdout: "info", 2024-09-12T02:49:15.452 INFO:teuthology.orchestra.run.smithi039.stdout: "warning" 2024-09-12T02:49:15.452 INFO:teuthology.orchestra.run.smithi039.stdout: ], 2024-09-12T02:49:15.452 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "", 2024-09-12T02:49:15.452 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-09-12T02:49:15.452 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-09-12T02:49:15.452 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-09-12T02:49:15.452 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-09-12T02:49:15.452 INFO:teuthology.orchestra.run.smithi039.stdout: "log_to_file": { 2024-09-12T02:49:15.452 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "log_to_file", 2024-09-12T02:49:15.453 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "bool", 2024-09-12T02:49:15.453 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "advanced", 2024-09-12T02:49:15.453 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 1, 2024-09-12T02:49:15.453 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "False", 2024-09-12T02:49:15.453 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-09-12T02:49:15.453 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-09-12T02:49:15.453 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [], 2024-09-12T02:49:15.453 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "", 2024-09-12T02:49:15.453 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-09-12T02:49:15.453 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-09-12T02:49:15.453 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-09-12T02:49:15.453 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-09-12T02:49:15.453 INFO:teuthology.orchestra.run.smithi039.stdout: "storage_class": { 2024-09-12T02:49:15.453 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "storage_class", 2024-09-12T02:49:15.454 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "str", 2024-09-12T02:49:15.454 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "advanced", 2024-09-12T02:49:15.454 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 0, 2024-09-12T02:49:15.454 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "local", 2024-09-12T02:49:15.454 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-09-12T02:49:15.454 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-09-12T02:49:15.454 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [], 2024-09-12T02:49:15.454 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "storage class name for LSO-discovered PVs", 2024-09-12T02:49:15.454 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-09-12T02:49:15.454 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-09-12T02:49:15.454 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-09-12T02:49:15.454 INFO:teuthology.orchestra.run.smithi039.stdout: } 2024-09-12T02:49:15.454 INFO:teuthology.orchestra.run.smithi039.stdout: } 2024-09-12T02:49:15.454 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-09-12T02:49:15.455 INFO:teuthology.orchestra.run.smithi039.stdout: { 2024-09-12T02:49:15.455 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "selftest", 2024-09-12T02:49:15.455 INFO:teuthology.orchestra.run.smithi039.stdout: "can_run": true, 2024-09-12T02:49:15.455 INFO:teuthology.orchestra.run.smithi039.stdout: "error_string": "", 2024-09-12T02:49:15.455 INFO:teuthology.orchestra.run.smithi039.stdout: "module_options": { 2024-09-12T02:49:15.455 INFO:teuthology.orchestra.run.smithi039.stdout: "log_level": { 2024-09-12T02:49:15.455 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "log_level", 2024-09-12T02:49:15.455 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "str", 2024-09-12T02:49:15.455 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "advanced", 2024-09-12T02:49:15.455 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 1, 2024-09-12T02:49:15.455 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "", 2024-09-12T02:49:15.455 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-09-12T02:49:15.455 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-09-12T02:49:15.456 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [ 2024-09-12T02:49:15.456 INFO:teuthology.orchestra.run.smithi039.stdout: "", 2024-09-12T02:49:15.456 INFO:teuthology.orchestra.run.smithi039.stdout: "critical", 2024-09-12T02:49:15.456 INFO:teuthology.orchestra.run.smithi039.stdout: "debug", 2024-09-12T02:49:15.456 INFO:teuthology.orchestra.run.smithi039.stdout: "error", 2024-09-12T02:49:15.456 INFO:teuthology.orchestra.run.smithi039.stdout: "info", 2024-09-12T02:49:15.456 INFO:teuthology.orchestra.run.smithi039.stdout: "warning" 2024-09-12T02:49:15.456 INFO:teuthology.orchestra.run.smithi039.stdout: ], 2024-09-12T02:49:15.456 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "", 2024-09-12T02:49:15.456 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-09-12T02:49:15.456 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-09-12T02:49:15.456 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-09-12T02:49:15.456 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-09-12T02:49:15.456 INFO:teuthology.orchestra.run.smithi039.stdout: "log_to_cluster": { 2024-09-12T02:49:15.457 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "log_to_cluster", 2024-09-12T02:49:15.457 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "bool", 2024-09-12T02:49:15.457 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "advanced", 2024-09-12T02:49:15.457 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 1, 2024-09-12T02:49:15.457 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "False", 2024-09-12T02:49:15.457 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-09-12T02:49:15.457 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-09-12T02:49:15.457 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [], 2024-09-12T02:49:15.457 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "", 2024-09-12T02:49:15.457 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-09-12T02:49:15.457 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-09-12T02:49:15.457 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-09-12T02:49:15.457 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-09-12T02:49:15.457 INFO:teuthology.orchestra.run.smithi039.stdout: "log_to_cluster_level": { 2024-09-12T02:49:15.458 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "log_to_cluster_level", 2024-09-12T02:49:15.458 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "str", 2024-09-12T02:49:15.458 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "advanced", 2024-09-12T02:49:15.458 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 1, 2024-09-12T02:49:15.458 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "info", 2024-09-12T02:49:15.458 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-09-12T02:49:15.458 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-09-12T02:49:15.458 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [ 2024-09-12T02:49:15.458 INFO:teuthology.orchestra.run.smithi039.stdout: "", 2024-09-12T02:49:15.458 INFO:teuthology.orchestra.run.smithi039.stdout: "critical", 2024-09-12T02:49:15.458 INFO:teuthology.orchestra.run.smithi039.stdout: "debug", 2024-09-12T02:49:15.458 INFO:teuthology.orchestra.run.smithi039.stdout: "error", 2024-09-12T02:49:15.458 INFO:teuthology.orchestra.run.smithi039.stdout: "info", 2024-09-12T02:49:15.459 INFO:teuthology.orchestra.run.smithi039.stdout: "warning" 2024-09-12T02:49:15.459 INFO:teuthology.orchestra.run.smithi039.stdout: ], 2024-09-12T02:49:15.459 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "", 2024-09-12T02:49:15.459 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-09-12T02:49:15.459 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-09-12T02:49:15.459 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-09-12T02:49:15.459 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-09-12T02:49:15.459 INFO:teuthology.orchestra.run.smithi039.stdout: "log_to_file": { 2024-09-12T02:49:15.459 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "log_to_file", 2024-09-12T02:49:15.459 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "bool", 2024-09-12T02:49:15.459 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "advanced", 2024-09-12T02:49:15.459 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 1, 2024-09-12T02:49:15.459 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "False", 2024-09-12T02:49:15.459 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-09-12T02:49:15.459 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-09-12T02:49:15.460 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [], 2024-09-12T02:49:15.460 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "", 2024-09-12T02:49:15.460 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-09-12T02:49:15.460 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-09-12T02:49:15.460 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-09-12T02:49:15.460 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-09-12T02:49:15.460 INFO:teuthology.orchestra.run.smithi039.stdout: "roption1": { 2024-09-12T02:49:15.460 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "roption1", 2024-09-12T02:49:15.460 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "str", 2024-09-12T02:49:15.460 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "advanced", 2024-09-12T02:49:15.460 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 0, 2024-09-12T02:49:15.460 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "", 2024-09-12T02:49:15.460 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-09-12T02:49:15.461 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-09-12T02:49:15.461 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [], 2024-09-12T02:49:15.461 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "", 2024-09-12T02:49:15.461 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-09-12T02:49:15.461 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-09-12T02:49:15.461 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-09-12T02:49:15.461 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-09-12T02:49:15.461 INFO:teuthology.orchestra.run.smithi039.stdout: "roption2": { 2024-09-12T02:49:15.461 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "roption2", 2024-09-12T02:49:15.461 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "str", 2024-09-12T02:49:15.461 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "advanced", 2024-09-12T02:49:15.461 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 0, 2024-09-12T02:49:15.461 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "xyz", 2024-09-12T02:49:15.462 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-09-12T02:49:15.462 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-09-12T02:49:15.462 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [], 2024-09-12T02:49:15.462 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "", 2024-09-12T02:49:15.462 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-09-12T02:49:15.462 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-09-12T02:49:15.462 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-09-12T02:49:15.462 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-09-12T02:49:15.462 INFO:teuthology.orchestra.run.smithi039.stdout: "rwoption1": { 2024-09-12T02:49:15.462 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "rwoption1", 2024-09-12T02:49:15.462 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "str", 2024-09-12T02:49:15.462 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "advanced", 2024-09-12T02:49:15.462 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 0, 2024-09-12T02:49:15.462 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "", 2024-09-12T02:49:15.463 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-09-12T02:49:15.463 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-09-12T02:49:15.463 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [], 2024-09-12T02:49:15.463 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "", 2024-09-12T02:49:15.463 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-09-12T02:49:15.463 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-09-12T02:49:15.463 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-09-12T02:49:15.463 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-09-12T02:49:15.463 INFO:teuthology.orchestra.run.smithi039.stdout: "rwoption2": { 2024-09-12T02:49:15.463 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "rwoption2", 2024-09-12T02:49:15.463 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "int", 2024-09-12T02:49:15.463 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "advanced", 2024-09-12T02:49:15.463 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 0, 2024-09-12T02:49:15.464 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "", 2024-09-12T02:49:15.464 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-09-12T02:49:15.464 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-09-12T02:49:15.464 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [], 2024-09-12T02:49:15.464 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "", 2024-09-12T02:49:15.464 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-09-12T02:49:15.464 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-09-12T02:49:15.464 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-09-12T02:49:15.464 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-09-12T02:49:15.464 INFO:teuthology.orchestra.run.smithi039.stdout: "rwoption3": { 2024-09-12T02:49:15.464 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "rwoption3", 2024-09-12T02:49:15.464 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "float", 2024-09-12T02:49:15.464 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "advanced", 2024-09-12T02:49:15.464 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 0, 2024-09-12T02:49:15.465 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "", 2024-09-12T02:49:15.465 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-09-12T02:49:15.465 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-09-12T02:49:15.465 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [], 2024-09-12T02:49:15.465 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "", 2024-09-12T02:49:15.465 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-09-12T02:49:15.465 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-09-12T02:49:15.465 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-09-12T02:49:15.465 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-09-12T02:49:15.465 INFO:teuthology.orchestra.run.smithi039.stdout: "rwoption4": { 2024-09-12T02:49:15.465 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "rwoption4", 2024-09-12T02:49:15.465 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "str", 2024-09-12T02:49:15.465 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "advanced", 2024-09-12T02:49:15.465 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 0, 2024-09-12T02:49:15.466 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "", 2024-09-12T02:49:15.466 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-09-12T02:49:15.466 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-09-12T02:49:15.466 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [], 2024-09-12T02:49:15.466 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "", 2024-09-12T02:49:15.466 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-09-12T02:49:15.466 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-09-12T02:49:15.466 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-09-12T02:49:15.466 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-09-12T02:49:15.466 INFO:teuthology.orchestra.run.smithi039.stdout: "rwoption5": { 2024-09-12T02:49:15.466 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "rwoption5", 2024-09-12T02:49:15.466 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "bool", 2024-09-12T02:49:15.466 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "advanced", 2024-09-12T02:49:15.467 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 0, 2024-09-12T02:49:15.467 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "", 2024-09-12T02:49:15.467 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-09-12T02:49:15.467 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-09-12T02:49:15.467 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [], 2024-09-12T02:49:15.467 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "", 2024-09-12T02:49:15.467 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-09-12T02:49:15.467 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-09-12T02:49:15.467 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-09-12T02:49:15.467 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-09-12T02:49:15.467 INFO:teuthology.orchestra.run.smithi039.stdout: "rwoption6": { 2024-09-12T02:49:15.467 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "rwoption6", 2024-09-12T02:49:15.467 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "bool", 2024-09-12T02:49:15.467 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "advanced", 2024-09-12T02:49:15.468 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 0, 2024-09-12T02:49:15.468 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "True", 2024-09-12T02:49:15.468 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-09-12T02:49:15.468 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-09-12T02:49:15.468 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [], 2024-09-12T02:49:15.468 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "", 2024-09-12T02:49:15.468 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-09-12T02:49:15.468 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-09-12T02:49:15.468 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-09-12T02:49:15.468 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-09-12T02:49:15.468 INFO:teuthology.orchestra.run.smithi039.stdout: "rwoption7": { 2024-09-12T02:49:15.468 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "rwoption7", 2024-09-12T02:49:15.468 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "int", 2024-09-12T02:49:15.468 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "advanced", 2024-09-12T02:49:15.469 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 0, 2024-09-12T02:49:15.469 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "", 2024-09-12T02:49:15.469 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "1", 2024-09-12T02:49:15.469 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "42", 2024-09-12T02:49:15.469 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [], 2024-09-12T02:49:15.469 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "", 2024-09-12T02:49:15.469 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-09-12T02:49:15.469 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-09-12T02:49:15.469 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-09-12T02:49:15.469 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-09-12T02:49:15.469 INFO:teuthology.orchestra.run.smithi039.stdout: "testkey": { 2024-09-12T02:49:15.469 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "testkey", 2024-09-12T02:49:15.469 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "str", 2024-09-12T02:49:15.470 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "advanced", 2024-09-12T02:49:15.470 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 0, 2024-09-12T02:49:15.470 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "", 2024-09-12T02:49:15.470 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-09-12T02:49:15.470 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-09-12T02:49:15.470 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [], 2024-09-12T02:49:15.470 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "", 2024-09-12T02:49:15.470 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-09-12T02:49:15.470 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-09-12T02:49:15.470 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-09-12T02:49:15.470 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-09-12T02:49:15.470 INFO:teuthology.orchestra.run.smithi039.stdout: "testlkey": { 2024-09-12T02:49:15.470 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "testlkey", 2024-09-12T02:49:15.470 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "str", 2024-09-12T02:49:15.471 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "advanced", 2024-09-12T02:49:15.471 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 0, 2024-09-12T02:49:15.471 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "", 2024-09-12T02:49:15.471 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-09-12T02:49:15.471 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-09-12T02:49:15.471 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [], 2024-09-12T02:49:15.471 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "", 2024-09-12T02:49:15.471 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-09-12T02:49:15.471 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-09-12T02:49:15.471 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-09-12T02:49:15.471 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-09-12T02:49:15.471 INFO:teuthology.orchestra.run.smithi039.stdout: "testnewline": { 2024-09-12T02:49:15.471 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "testnewline", 2024-09-12T02:49:15.471 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "str", 2024-09-12T02:49:15.472 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "advanced", 2024-09-12T02:49:15.472 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 0, 2024-09-12T02:49:15.472 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "", 2024-09-12T02:49:15.472 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-09-12T02:49:15.472 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-09-12T02:49:15.472 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [], 2024-09-12T02:49:15.472 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "", 2024-09-12T02:49:15.472 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-09-12T02:49:15.472 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-09-12T02:49:15.472 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-09-12T02:49:15.472 INFO:teuthology.orchestra.run.smithi039.stdout: } 2024-09-12T02:49:15.472 INFO:teuthology.orchestra.run.smithi039.stdout: } 2024-09-12T02:49:15.472 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-09-12T02:49:15.472 INFO:teuthology.orchestra.run.smithi039.stdout: { 2024-09-12T02:49:15.473 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "snap_schedule", 2024-09-12T02:49:15.473 INFO:teuthology.orchestra.run.smithi039.stdout: "can_run": true, 2024-09-12T02:49:15.473 INFO:teuthology.orchestra.run.smithi039.stdout: "error_string": "", 2024-09-12T02:49:15.473 INFO:teuthology.orchestra.run.smithi039.stdout: "module_options": { 2024-09-12T02:49:15.473 INFO:teuthology.orchestra.run.smithi039.stdout: "allow_m_granularity": { 2024-09-12T02:49:15.473 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "allow_m_granularity", 2024-09-12T02:49:15.473 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "bool", 2024-09-12T02:49:15.473 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "advanced", 2024-09-12T02:49:15.473 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 1, 2024-09-12T02:49:15.473 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "False", 2024-09-12T02:49:15.473 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-09-12T02:49:15.473 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-09-12T02:49:15.473 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [], 2024-09-12T02:49:15.474 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "allow minute scheduled snapshots", 2024-09-12T02:49:15.474 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-09-12T02:49:15.474 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-09-12T02:49:15.474 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-09-12T02:49:15.474 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-09-12T02:49:15.474 INFO:teuthology.orchestra.run.smithi039.stdout: "dump_on_update": { 2024-09-12T02:49:15.474 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "dump_on_update", 2024-09-12T02:49:15.474 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "bool", 2024-09-12T02:49:15.474 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "advanced", 2024-09-12T02:49:15.474 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 1, 2024-09-12T02:49:15.474 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "False", 2024-09-12T02:49:15.474 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-09-12T02:49:15.474 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-09-12T02:49:15.474 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [], 2024-09-12T02:49:15.475 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "dump database to debug log on update", 2024-09-12T02:49:15.475 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-09-12T02:49:15.475 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-09-12T02:49:15.475 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-09-12T02:49:15.475 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-09-12T02:49:15.475 INFO:teuthology.orchestra.run.smithi039.stdout: "log_level": { 2024-09-12T02:49:15.475 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "log_level", 2024-09-12T02:49:15.475 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "str", 2024-09-12T02:49:15.475 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "advanced", 2024-09-12T02:49:15.475 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 1, 2024-09-12T02:49:15.475 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "", 2024-09-12T02:49:15.475 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-09-12T02:49:15.475 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-09-12T02:49:15.476 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [ 2024-09-12T02:49:15.476 INFO:teuthology.orchestra.run.smithi039.stdout: "", 2024-09-12T02:49:15.476 INFO:teuthology.orchestra.run.smithi039.stdout: "critical", 2024-09-12T02:49:15.476 INFO:teuthology.orchestra.run.smithi039.stdout: "debug", 2024-09-12T02:49:15.476 INFO:teuthology.orchestra.run.smithi039.stdout: "error", 2024-09-12T02:49:15.476 INFO:teuthology.orchestra.run.smithi039.stdout: "info", 2024-09-12T02:49:15.476 INFO:teuthology.orchestra.run.smithi039.stdout: "warning" 2024-09-12T02:49:15.476 INFO:teuthology.orchestra.run.smithi039.stdout: ], 2024-09-12T02:49:15.476 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "", 2024-09-12T02:49:15.476 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-09-12T02:49:15.476 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-09-12T02:49:15.476 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-09-12T02:49:15.476 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-09-12T02:49:15.476 INFO:teuthology.orchestra.run.smithi039.stdout: "log_to_cluster": { 2024-09-12T02:49:15.477 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "log_to_cluster", 2024-09-12T02:49:15.477 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "bool", 2024-09-12T02:49:15.477 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "advanced", 2024-09-12T02:49:15.477 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 1, 2024-09-12T02:49:15.477 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "False", 2024-09-12T02:49:15.477 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-09-12T02:49:15.477 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-09-12T02:49:15.477 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [], 2024-09-12T02:49:15.477 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "", 2024-09-12T02:49:15.477 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-09-12T02:49:15.477 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-09-12T02:49:15.477 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-09-12T02:49:15.477 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-09-12T02:49:15.477 INFO:teuthology.orchestra.run.smithi039.stdout: "log_to_cluster_level": { 2024-09-12T02:49:15.478 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "log_to_cluster_level", 2024-09-12T02:49:15.478 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "str", 2024-09-12T02:49:15.478 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "advanced", 2024-09-12T02:49:15.478 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 1, 2024-09-12T02:49:15.478 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "info", 2024-09-12T02:49:15.478 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-09-12T02:49:15.478 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-09-12T02:49:15.478 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [ 2024-09-12T02:49:15.478 INFO:teuthology.orchestra.run.smithi039.stdout: "", 2024-09-12T02:49:15.478 INFO:teuthology.orchestra.run.smithi039.stdout: "critical", 2024-09-12T02:49:15.478 INFO:teuthology.orchestra.run.smithi039.stdout: "debug", 2024-09-12T02:49:15.478 INFO:teuthology.orchestra.run.smithi039.stdout: "error", 2024-09-12T02:49:15.478 INFO:teuthology.orchestra.run.smithi039.stdout: "info", 2024-09-12T02:49:15.479 INFO:teuthology.orchestra.run.smithi039.stdout: "warning" 2024-09-12T02:49:15.479 INFO:teuthology.orchestra.run.smithi039.stdout: ], 2024-09-12T02:49:15.479 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "", 2024-09-12T02:49:15.479 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-09-12T02:49:15.479 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-09-12T02:49:15.479 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-09-12T02:49:15.479 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-09-12T02:49:15.479 INFO:teuthology.orchestra.run.smithi039.stdout: "log_to_file": { 2024-09-12T02:49:15.479 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "log_to_file", 2024-09-12T02:49:15.479 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "bool", 2024-09-12T02:49:15.479 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "advanced", 2024-09-12T02:49:15.479 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 1, 2024-09-12T02:49:15.479 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "False", 2024-09-12T02:49:15.480 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-09-12T02:49:15.480 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-09-12T02:49:15.480 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [], 2024-09-12T02:49:15.480 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "", 2024-09-12T02:49:15.480 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-09-12T02:49:15.480 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-09-12T02:49:15.480 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-09-12T02:49:15.480 INFO:teuthology.orchestra.run.smithi039.stdout: } 2024-09-12T02:49:15.480 INFO:teuthology.orchestra.run.smithi039.stdout: } 2024-09-12T02:49:15.480 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-09-12T02:49:15.480 INFO:teuthology.orchestra.run.smithi039.stdout: { 2024-09-12T02:49:15.480 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "stats", 2024-09-12T02:49:15.480 INFO:teuthology.orchestra.run.smithi039.stdout: "can_run": true, 2024-09-12T02:49:15.480 INFO:teuthology.orchestra.run.smithi039.stdout: "error_string": "", 2024-09-12T02:49:15.481 INFO:teuthology.orchestra.run.smithi039.stdout: "module_options": { 2024-09-12T02:49:15.481 INFO:teuthology.orchestra.run.smithi039.stdout: "log_level": { 2024-09-12T02:49:15.481 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "log_level", 2024-09-12T02:49:15.481 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "str", 2024-09-12T02:49:15.481 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "advanced", 2024-09-12T02:49:15.481 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 1, 2024-09-12T02:49:15.481 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "", 2024-09-12T02:49:15.481 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-09-12T02:49:15.481 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-09-12T02:49:15.481 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [ 2024-09-12T02:49:15.481 INFO:teuthology.orchestra.run.smithi039.stdout: "", 2024-09-12T02:49:15.481 INFO:teuthology.orchestra.run.smithi039.stdout: "critical", 2024-09-12T02:49:15.481 INFO:teuthology.orchestra.run.smithi039.stdout: "debug", 2024-09-12T02:49:15.482 INFO:teuthology.orchestra.run.smithi039.stdout: "error", 2024-09-12T02:49:15.482 INFO:teuthology.orchestra.run.smithi039.stdout: "info", 2024-09-12T02:49:15.482 INFO:teuthology.orchestra.run.smithi039.stdout: "warning" 2024-09-12T02:49:15.482 INFO:teuthology.orchestra.run.smithi039.stdout: ], 2024-09-12T02:49:15.482 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "", 2024-09-12T02:49:15.482 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-09-12T02:49:15.482 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-09-12T02:49:15.482 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-09-12T02:49:15.482 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-09-12T02:49:15.482 INFO:teuthology.orchestra.run.smithi039.stdout: "log_to_cluster": { 2024-09-12T02:49:15.482 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "log_to_cluster", 2024-09-12T02:49:15.482 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "bool", 2024-09-12T02:49:15.482 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "advanced", 2024-09-12T02:49:15.483 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 1, 2024-09-12T02:49:15.483 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "False", 2024-09-12T02:49:15.483 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-09-12T02:49:15.483 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-09-12T02:49:15.483 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [], 2024-09-12T02:49:15.483 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "", 2024-09-12T02:49:15.483 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-09-12T02:49:15.483 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-09-12T02:49:15.483 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-09-12T02:49:15.483 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-09-12T02:49:15.483 INFO:teuthology.orchestra.run.smithi039.stdout: "log_to_cluster_level": { 2024-09-12T02:49:15.483 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "log_to_cluster_level", 2024-09-12T02:49:15.483 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "str", 2024-09-12T02:49:15.483 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "advanced", 2024-09-12T02:49:15.484 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 1, 2024-09-12T02:49:15.484 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "info", 2024-09-12T02:49:15.484 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-09-12T02:49:15.484 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-09-12T02:49:15.484 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [ 2024-09-12T02:49:15.484 INFO:teuthology.orchestra.run.smithi039.stdout: "", 2024-09-12T02:49:15.484 INFO:teuthology.orchestra.run.smithi039.stdout: "critical", 2024-09-12T02:49:15.484 INFO:teuthology.orchestra.run.smithi039.stdout: "debug", 2024-09-12T02:49:15.484 INFO:teuthology.orchestra.run.smithi039.stdout: "error", 2024-09-12T02:49:15.484 INFO:teuthology.orchestra.run.smithi039.stdout: "info", 2024-09-12T02:49:15.484 INFO:teuthology.orchestra.run.smithi039.stdout: "warning" 2024-09-12T02:49:15.484 INFO:teuthology.orchestra.run.smithi039.stdout: ], 2024-09-12T02:49:15.484 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "", 2024-09-12T02:49:15.485 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-09-12T02:49:15.485 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-09-12T02:49:15.485 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-09-12T02:49:15.485 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-09-12T02:49:15.485 INFO:teuthology.orchestra.run.smithi039.stdout: "log_to_file": { 2024-09-12T02:49:15.485 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "log_to_file", 2024-09-12T02:49:15.485 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "bool", 2024-09-12T02:49:15.485 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "advanced", 2024-09-12T02:49:15.485 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 1, 2024-09-12T02:49:15.485 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "False", 2024-09-12T02:49:15.485 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-09-12T02:49:15.485 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-09-12T02:49:15.485 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [], 2024-09-12T02:49:15.486 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "", 2024-09-12T02:49:15.486 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-09-12T02:49:15.486 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-09-12T02:49:15.486 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-09-12T02:49:15.486 INFO:teuthology.orchestra.run.smithi039.stdout: } 2024-09-12T02:49:15.486 INFO:teuthology.orchestra.run.smithi039.stdout: } 2024-09-12T02:49:15.486 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-09-12T02:49:15.486 INFO:teuthology.orchestra.run.smithi039.stdout: { 2024-09-12T02:49:15.486 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "status", 2024-09-12T02:49:15.486 INFO:teuthology.orchestra.run.smithi039.stdout: "can_run": true, 2024-09-12T02:49:15.486 INFO:teuthology.orchestra.run.smithi039.stdout: "error_string": "", 2024-09-12T02:49:15.486 INFO:teuthology.orchestra.run.smithi039.stdout: "module_options": { 2024-09-12T02:49:15.487 INFO:teuthology.orchestra.run.smithi039.stdout: "log_level": { 2024-09-12T02:49:15.487 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "log_level", 2024-09-12T02:49:15.487 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "str", 2024-09-12T02:49:15.487 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "advanced", 2024-09-12T02:49:15.487 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 1, 2024-09-12T02:49:15.487 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "", 2024-09-12T02:49:15.487 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-09-12T02:49:15.487 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-09-12T02:49:15.487 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [ 2024-09-12T02:49:15.487 INFO:teuthology.orchestra.run.smithi039.stdout: "", 2024-09-12T02:49:15.487 INFO:teuthology.orchestra.run.smithi039.stdout: "critical", 2024-09-12T02:49:15.487 INFO:teuthology.orchestra.run.smithi039.stdout: "debug", 2024-09-12T02:49:15.487 INFO:teuthology.orchestra.run.smithi039.stdout: "error", 2024-09-12T02:49:15.487 INFO:teuthology.orchestra.run.smithi039.stdout: "info", 2024-09-12T02:49:15.488 INFO:teuthology.orchestra.run.smithi039.stdout: "warning" 2024-09-12T02:49:15.488 INFO:teuthology.orchestra.run.smithi039.stdout: ], 2024-09-12T02:49:15.488 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "", 2024-09-12T02:49:15.488 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-09-12T02:49:15.488 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-09-12T02:49:15.488 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-09-12T02:49:15.488 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-09-12T02:49:15.488 INFO:teuthology.orchestra.run.smithi039.stdout: "log_to_cluster": { 2024-09-12T02:49:15.488 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "log_to_cluster", 2024-09-12T02:49:15.488 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "bool", 2024-09-12T02:49:15.488 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "advanced", 2024-09-12T02:49:15.488 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 1, 2024-09-12T02:49:15.488 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "False", 2024-09-12T02:49:15.489 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-09-12T02:49:15.489 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-09-12T02:49:15.489 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [], 2024-09-12T02:49:15.489 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "", 2024-09-12T02:49:15.489 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-09-12T02:49:15.489 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-09-12T02:49:15.489 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-09-12T02:49:15.489 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-09-12T02:49:15.489 INFO:teuthology.orchestra.run.smithi039.stdout: "log_to_cluster_level": { 2024-09-12T02:49:15.489 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "log_to_cluster_level", 2024-09-12T02:49:15.489 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "str", 2024-09-12T02:49:15.489 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "advanced", 2024-09-12T02:49:15.489 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 1, 2024-09-12T02:49:15.490 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "info", 2024-09-12T02:49:15.490 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-09-12T02:49:15.490 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-09-12T02:49:15.490 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [ 2024-09-12T02:49:15.490 INFO:teuthology.orchestra.run.smithi039.stdout: "", 2024-09-12T02:49:15.490 INFO:teuthology.orchestra.run.smithi039.stdout: "critical", 2024-09-12T02:49:15.490 INFO:teuthology.orchestra.run.smithi039.stdout: "debug", 2024-09-12T02:49:15.490 INFO:teuthology.orchestra.run.smithi039.stdout: "error", 2024-09-12T02:49:15.490 INFO:teuthology.orchestra.run.smithi039.stdout: "info", 2024-09-12T02:49:15.490 INFO:teuthology.orchestra.run.smithi039.stdout: "warning" 2024-09-12T02:49:15.490 INFO:teuthology.orchestra.run.smithi039.stdout: ], 2024-09-12T02:49:15.490 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "", 2024-09-12T02:49:15.490 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-09-12T02:49:15.490 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-09-12T02:49:15.491 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-09-12T02:49:15.491 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-09-12T02:49:15.491 INFO:teuthology.orchestra.run.smithi039.stdout: "log_to_file": { 2024-09-12T02:49:15.491 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "log_to_file", 2024-09-12T02:49:15.491 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "bool", 2024-09-12T02:49:15.491 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "advanced", 2024-09-12T02:49:15.491 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 1, 2024-09-12T02:49:15.491 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "False", 2024-09-12T02:49:15.491 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-09-12T02:49:15.491 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-09-12T02:49:15.491 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [], 2024-09-12T02:49:15.491 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "", 2024-09-12T02:49:15.491 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-09-12T02:49:15.491 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-09-12T02:49:15.492 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-09-12T02:49:15.492 INFO:teuthology.orchestra.run.smithi039.stdout: } 2024-09-12T02:49:15.492 INFO:teuthology.orchestra.run.smithi039.stdout: } 2024-09-12T02:49:15.492 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-09-12T02:49:15.492 INFO:teuthology.orchestra.run.smithi039.stdout: { 2024-09-12T02:49:15.492 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "telegraf", 2024-09-12T02:49:15.492 INFO:teuthology.orchestra.run.smithi039.stdout: "can_run": true, 2024-09-12T02:49:15.492 INFO:teuthology.orchestra.run.smithi039.stdout: "error_string": "", 2024-09-12T02:49:15.492 INFO:teuthology.orchestra.run.smithi039.stdout: "module_options": { 2024-09-12T02:49:15.492 INFO:teuthology.orchestra.run.smithi039.stdout: "address": { 2024-09-12T02:49:15.492 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "address", 2024-09-12T02:49:15.492 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "str", 2024-09-12T02:49:15.493 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "advanced", 2024-09-12T02:49:15.493 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 0, 2024-09-12T02:49:15.493 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "unixgram:///tmp/telegraf.sock", 2024-09-12T02:49:15.493 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-09-12T02:49:15.493 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-09-12T02:49:15.493 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [], 2024-09-12T02:49:15.493 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "", 2024-09-12T02:49:15.493 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-09-12T02:49:15.493 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-09-12T02:49:15.493 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-09-12T02:49:15.493 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-09-12T02:49:15.493 INFO:teuthology.orchestra.run.smithi039.stdout: "interval": { 2024-09-12T02:49:15.493 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "interval", 2024-09-12T02:49:15.493 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "secs", 2024-09-12T02:49:15.494 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "advanced", 2024-09-12T02:49:15.494 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 0, 2024-09-12T02:49:15.494 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "15", 2024-09-12T02:49:15.494 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-09-12T02:49:15.494 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-09-12T02:49:15.494 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [], 2024-09-12T02:49:15.494 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "", 2024-09-12T02:49:15.494 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-09-12T02:49:15.494 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-09-12T02:49:15.494 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-09-12T02:49:15.494 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-09-12T02:49:15.494 INFO:teuthology.orchestra.run.smithi039.stdout: "log_level": { 2024-09-12T02:49:15.494 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "log_level", 2024-09-12T02:49:15.494 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "str", 2024-09-12T02:49:15.495 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "advanced", 2024-09-12T02:49:15.495 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 1, 2024-09-12T02:49:15.495 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "", 2024-09-12T02:49:15.495 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-09-12T02:49:15.495 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-09-12T02:49:15.495 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [ 2024-09-12T02:49:15.495 INFO:teuthology.orchestra.run.smithi039.stdout: "", 2024-09-12T02:49:15.495 INFO:teuthology.orchestra.run.smithi039.stdout: "critical", 2024-09-12T02:49:15.495 INFO:teuthology.orchestra.run.smithi039.stdout: "debug", 2024-09-12T02:49:15.495 INFO:teuthology.orchestra.run.smithi039.stdout: "error", 2024-09-12T02:49:15.495 INFO:teuthology.orchestra.run.smithi039.stdout: "info", 2024-09-12T02:49:15.495 INFO:teuthology.orchestra.run.smithi039.stdout: "warning" 2024-09-12T02:49:15.495 INFO:teuthology.orchestra.run.smithi039.stdout: ], 2024-09-12T02:49:15.495 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "", 2024-09-12T02:49:15.496 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-09-12T02:49:15.496 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-09-12T02:49:15.496 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-09-12T02:49:15.496 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-09-12T02:49:15.496 INFO:teuthology.orchestra.run.smithi039.stdout: "log_to_cluster": { 2024-09-12T02:49:15.496 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "log_to_cluster", 2024-09-12T02:49:15.496 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "bool", 2024-09-12T02:49:15.496 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "advanced", 2024-09-12T02:49:15.496 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 1, 2024-09-12T02:49:15.496 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "False", 2024-09-12T02:49:15.496 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-09-12T02:49:15.496 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-09-12T02:49:15.496 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [], 2024-09-12T02:49:15.497 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "", 2024-09-12T02:49:15.497 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-09-12T02:49:15.497 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-09-12T02:49:15.497 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-09-12T02:49:15.497 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-09-12T02:49:15.497 INFO:teuthology.orchestra.run.smithi039.stdout: "log_to_cluster_level": { 2024-09-12T02:49:15.497 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "log_to_cluster_level", 2024-09-12T02:49:15.497 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "str", 2024-09-12T02:49:15.497 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "advanced", 2024-09-12T02:49:15.497 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 1, 2024-09-12T02:49:15.497 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "info", 2024-09-12T02:49:15.497 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-09-12T02:49:15.497 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-09-12T02:49:15.498 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [ 2024-09-12T02:49:15.498 INFO:teuthology.orchestra.run.smithi039.stdout: "", 2024-09-12T02:49:15.498 INFO:teuthology.orchestra.run.smithi039.stdout: "critical", 2024-09-12T02:49:15.498 INFO:teuthology.orchestra.run.smithi039.stdout: "debug", 2024-09-12T02:49:15.498 INFO:teuthology.orchestra.run.smithi039.stdout: "error", 2024-09-12T02:49:15.498 INFO:teuthology.orchestra.run.smithi039.stdout: "info", 2024-09-12T02:49:15.498 INFO:teuthology.orchestra.run.smithi039.stdout: "warning" 2024-09-12T02:49:15.498 INFO:teuthology.orchestra.run.smithi039.stdout: ], 2024-09-12T02:49:15.498 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "", 2024-09-12T02:49:15.498 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-09-12T02:49:15.498 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-09-12T02:49:15.498 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-09-12T02:49:15.498 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-09-12T02:49:15.498 INFO:teuthology.orchestra.run.smithi039.stdout: "log_to_file": { 2024-09-12T02:49:15.499 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "log_to_file", 2024-09-12T02:49:15.499 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "bool", 2024-09-12T02:49:15.499 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "advanced", 2024-09-12T02:49:15.499 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 1, 2024-09-12T02:49:15.499 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "False", 2024-09-12T02:49:15.499 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-09-12T02:49:15.499 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-09-12T02:49:15.499 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [], 2024-09-12T02:49:15.499 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "", 2024-09-12T02:49:15.499 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-09-12T02:49:15.499 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-09-12T02:49:15.499 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-09-12T02:49:15.499 INFO:teuthology.orchestra.run.smithi039.stdout: } 2024-09-12T02:49:15.499 INFO:teuthology.orchestra.run.smithi039.stdout: } 2024-09-12T02:49:15.500 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-09-12T02:49:15.500 INFO:teuthology.orchestra.run.smithi039.stdout: { 2024-09-12T02:49:15.500 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "telemetry", 2024-09-12T02:49:15.500 INFO:teuthology.orchestra.run.smithi039.stdout: "can_run": true, 2024-09-12T02:49:15.500 INFO:teuthology.orchestra.run.smithi039.stdout: "error_string": "", 2024-09-12T02:49:15.500 INFO:teuthology.orchestra.run.smithi039.stdout: "module_options": { 2024-09-12T02:49:15.500 INFO:teuthology.orchestra.run.smithi039.stdout: "channel_basic": { 2024-09-12T02:49:15.500 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "channel_basic", 2024-09-12T02:49:15.500 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "bool", 2024-09-12T02:49:15.500 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "advanced", 2024-09-12T02:49:15.500 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 0, 2024-09-12T02:49:15.500 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "True", 2024-09-12T02:49:15.500 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-09-12T02:49:15.501 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-09-12T02:49:15.501 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [], 2024-09-12T02:49:15.501 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "Share basic cluster information (size, version)", 2024-09-12T02:49:15.501 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-09-12T02:49:15.501 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-09-12T02:49:15.501 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-09-12T02:49:15.501 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-09-12T02:49:15.501 INFO:teuthology.orchestra.run.smithi039.stdout: "channel_crash": { 2024-09-12T02:49:15.501 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "channel_crash", 2024-09-12T02:49:15.501 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "bool", 2024-09-12T02:49:15.501 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "advanced", 2024-09-12T02:49:15.501 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 0, 2024-09-12T02:49:15.501 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "True", 2024-09-12T02:49:15.501 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-09-12T02:49:15.502 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-09-12T02:49:15.502 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [], 2024-09-12T02:49:15.502 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "Share metadata about Ceph daemon crashes (version, stack straces, etc)", 2024-09-12T02:49:15.502 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-09-12T02:49:15.502 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-09-12T02:49:15.502 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-09-12T02:49:15.502 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-09-12T02:49:15.502 INFO:teuthology.orchestra.run.smithi039.stdout: "channel_device": { 2024-09-12T02:49:15.502 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "channel_device", 2024-09-12T02:49:15.502 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "bool", 2024-09-12T02:49:15.502 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "advanced", 2024-09-12T02:49:15.502 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 0, 2024-09-12T02:49:15.502 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "True", 2024-09-12T02:49:15.503 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-09-12T02:49:15.503 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-09-12T02:49:15.503 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [], 2024-09-12T02:49:15.503 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "Share device health metrics (e.g., SMART data, minus potentially identifying info like serial numbers)", 2024-09-12T02:49:15.503 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-09-12T02:49:15.503 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-09-12T02:49:15.503 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-09-12T02:49:15.503 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-09-12T02:49:15.503 INFO:teuthology.orchestra.run.smithi039.stdout: "channel_ident": { 2024-09-12T02:49:15.503 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "channel_ident", 2024-09-12T02:49:15.503 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "bool", 2024-09-12T02:49:15.503 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "advanced", 2024-09-12T02:49:15.503 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 0, 2024-09-12T02:49:15.504 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "False", 2024-09-12T02:49:15.504 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-09-12T02:49:15.504 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-09-12T02:49:15.504 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [], 2024-09-12T02:49:15.504 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "Share a user-provided description and/or contact email for the cluster", 2024-09-12T02:49:15.504 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-09-12T02:49:15.504 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-09-12T02:49:15.504 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-09-12T02:49:15.504 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-09-12T02:49:15.504 INFO:teuthology.orchestra.run.smithi039.stdout: "channel_perf": { 2024-09-12T02:49:15.504 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "channel_perf", 2024-09-12T02:49:15.504 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "bool", 2024-09-12T02:49:15.504 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "advanced", 2024-09-12T02:49:15.505 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 0, 2024-09-12T02:49:15.505 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "False", 2024-09-12T02:49:15.505 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-09-12T02:49:15.505 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-09-12T02:49:15.505 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [], 2024-09-12T02:49:15.505 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "Share various performance metrics of a cluster", 2024-09-12T02:49:15.505 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-09-12T02:49:15.505 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-09-12T02:49:15.505 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-09-12T02:49:15.505 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-09-12T02:49:15.505 INFO:teuthology.orchestra.run.smithi039.stdout: "contact": { 2024-09-12T02:49:15.505 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "contact", 2024-09-12T02:49:15.506 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "str", 2024-09-12T02:49:15.506 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "advanced", 2024-09-12T02:49:15.506 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 0, 2024-09-12T02:49:15.506 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "", 2024-09-12T02:49:15.506 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-09-12T02:49:15.506 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-09-12T02:49:15.506 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [], 2024-09-12T02:49:15.506 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "", 2024-09-12T02:49:15.506 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-09-12T02:49:15.506 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-09-12T02:49:15.506 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-09-12T02:49:15.506 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-09-12T02:49:15.506 INFO:teuthology.orchestra.run.smithi039.stdout: "description": { 2024-09-12T02:49:15.507 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "description", 2024-09-12T02:49:15.507 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "str", 2024-09-12T02:49:15.507 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "advanced", 2024-09-12T02:49:15.507 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 0, 2024-09-12T02:49:15.507 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "", 2024-09-12T02:49:15.507 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-09-12T02:49:15.507 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-09-12T02:49:15.507 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [], 2024-09-12T02:49:15.507 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "", 2024-09-12T02:49:15.507 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-09-12T02:49:15.507 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-09-12T02:49:15.507 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-09-12T02:49:15.507 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-09-12T02:49:15.508 INFO:teuthology.orchestra.run.smithi039.stdout: "device_url": { 2024-09-12T02:49:15.508 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "device_url", 2024-09-12T02:49:15.508 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "str", 2024-09-12T02:49:15.508 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "advanced", 2024-09-12T02:49:15.508 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 0, 2024-09-12T02:49:15.508 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "https://telemetry.ceph.com/device", 2024-09-12T02:49:15.508 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-09-12T02:49:15.508 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-09-12T02:49:15.508 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [], 2024-09-12T02:49:15.508 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "", 2024-09-12T02:49:15.508 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-09-12T02:49:15.508 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-09-12T02:49:15.508 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-09-12T02:49:15.509 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-09-12T02:49:15.509 INFO:teuthology.orchestra.run.smithi039.stdout: "enabled": { 2024-09-12T02:49:15.509 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "enabled", 2024-09-12T02:49:15.509 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "bool", 2024-09-12T02:49:15.509 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "advanced", 2024-09-12T02:49:15.509 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 0, 2024-09-12T02:49:15.509 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "False", 2024-09-12T02:49:15.509 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-09-12T02:49:15.509 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-09-12T02:49:15.509 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [], 2024-09-12T02:49:15.509 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "", 2024-09-12T02:49:15.509 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-09-12T02:49:15.509 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-09-12T02:49:15.509 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-09-12T02:49:15.510 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-09-12T02:49:15.510 INFO:teuthology.orchestra.run.smithi039.stdout: "interval": { 2024-09-12T02:49:15.510 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "interval", 2024-09-12T02:49:15.510 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "int", 2024-09-12T02:49:15.510 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "advanced", 2024-09-12T02:49:15.510 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 0, 2024-09-12T02:49:15.510 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "24", 2024-09-12T02:49:15.510 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "8", 2024-09-12T02:49:15.510 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-09-12T02:49:15.510 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [], 2024-09-12T02:49:15.510 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "", 2024-09-12T02:49:15.510 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-09-12T02:49:15.510 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-09-12T02:49:15.510 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-09-12T02:49:15.511 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-09-12T02:49:15.511 INFO:teuthology.orchestra.run.smithi039.stdout: "last_opt_revision": { 2024-09-12T02:49:15.511 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "last_opt_revision", 2024-09-12T02:49:15.511 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "int", 2024-09-12T02:49:15.511 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "advanced", 2024-09-12T02:49:15.511 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 0, 2024-09-12T02:49:15.511 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "1", 2024-09-12T02:49:15.511 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-09-12T02:49:15.511 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-09-12T02:49:15.511 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [], 2024-09-12T02:49:15.511 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "", 2024-09-12T02:49:15.511 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-09-12T02:49:15.511 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-09-12T02:49:15.512 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-09-12T02:49:15.512 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-09-12T02:49:15.512 INFO:teuthology.orchestra.run.smithi039.stdout: "leaderboard": { 2024-09-12T02:49:15.512 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "leaderboard", 2024-09-12T02:49:15.512 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "bool", 2024-09-12T02:49:15.512 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "advanced", 2024-09-12T02:49:15.512 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 0, 2024-09-12T02:49:15.512 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "False", 2024-09-12T02:49:15.512 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-09-12T02:49:15.512 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-09-12T02:49:15.512 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [], 2024-09-12T02:49:15.512 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "", 2024-09-12T02:49:15.512 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-09-12T02:49:15.512 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-09-12T02:49:15.513 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-09-12T02:49:15.513 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-09-12T02:49:15.513 INFO:teuthology.orchestra.run.smithi039.stdout: "leaderboard_description": { 2024-09-12T02:49:15.513 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "leaderboard_description", 2024-09-12T02:49:15.513 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "str", 2024-09-12T02:49:15.513 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "advanced", 2024-09-12T02:49:15.513 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 0, 2024-09-12T02:49:15.513 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "", 2024-09-12T02:49:15.513 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-09-12T02:49:15.513 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-09-12T02:49:15.513 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [], 2024-09-12T02:49:15.513 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "", 2024-09-12T02:49:15.513 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-09-12T02:49:15.514 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-09-12T02:49:15.514 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-09-12T02:49:15.514 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-09-12T02:49:15.514 INFO:teuthology.orchestra.run.smithi039.stdout: "log_level": { 2024-09-12T02:49:15.514 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "log_level", 2024-09-12T02:49:15.514 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "str", 2024-09-12T02:49:15.514 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "advanced", 2024-09-12T02:49:15.514 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 1, 2024-09-12T02:49:15.514 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "", 2024-09-12T02:49:15.514 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-09-12T02:49:15.514 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-09-12T02:49:15.514 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [ 2024-09-12T02:49:15.514 INFO:teuthology.orchestra.run.smithi039.stdout: "", 2024-09-12T02:49:15.514 INFO:teuthology.orchestra.run.smithi039.stdout: "critical", 2024-09-12T02:49:15.515 INFO:teuthology.orchestra.run.smithi039.stdout: "debug", 2024-09-12T02:49:15.515 INFO:teuthology.orchestra.run.smithi039.stdout: "error", 2024-09-12T02:49:15.515 INFO:teuthology.orchestra.run.smithi039.stdout: "info", 2024-09-12T02:49:15.515 INFO:teuthology.orchestra.run.smithi039.stdout: "warning" 2024-09-12T02:49:15.515 INFO:teuthology.orchestra.run.smithi039.stdout: ], 2024-09-12T02:49:15.515 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "", 2024-09-12T02:49:15.515 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-09-12T02:49:15.515 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-09-12T02:49:15.515 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-09-12T02:49:15.515 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-09-12T02:49:15.515 INFO:teuthology.orchestra.run.smithi039.stdout: "log_to_cluster": { 2024-09-12T02:49:15.515 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "log_to_cluster", 2024-09-12T02:49:15.515 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "bool", 2024-09-12T02:49:15.516 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "advanced", 2024-09-12T02:49:15.516 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 1, 2024-09-12T02:49:15.516 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "False", 2024-09-12T02:49:15.516 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-09-12T02:49:15.516 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-09-12T02:49:15.516 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [], 2024-09-12T02:49:15.516 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "", 2024-09-12T02:49:15.516 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-09-12T02:49:15.516 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-09-12T02:49:15.516 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-09-12T02:49:15.516 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-09-12T02:49:15.516 INFO:teuthology.orchestra.run.smithi039.stdout: "log_to_cluster_level": { 2024-09-12T02:49:15.516 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "log_to_cluster_level", 2024-09-12T02:49:15.516 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "str", 2024-09-12T02:49:15.517 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "advanced", 2024-09-12T02:49:15.517 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 1, 2024-09-12T02:49:15.517 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "info", 2024-09-12T02:49:15.517 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-09-12T02:49:15.517 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-09-12T02:49:15.517 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [ 2024-09-12T02:49:15.517 INFO:teuthology.orchestra.run.smithi039.stdout: "", 2024-09-12T02:49:15.517 INFO:teuthology.orchestra.run.smithi039.stdout: "critical", 2024-09-12T02:49:15.517 INFO:teuthology.orchestra.run.smithi039.stdout: "debug", 2024-09-12T02:49:15.517 INFO:teuthology.orchestra.run.smithi039.stdout: "error", 2024-09-12T02:49:15.517 INFO:teuthology.orchestra.run.smithi039.stdout: "info", 2024-09-12T02:49:15.517 INFO:teuthology.orchestra.run.smithi039.stdout: "warning" 2024-09-12T02:49:15.517 INFO:teuthology.orchestra.run.smithi039.stdout: ], 2024-09-12T02:49:15.518 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "", 2024-09-12T02:49:15.518 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-09-12T02:49:15.518 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-09-12T02:49:15.518 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-09-12T02:49:15.518 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-09-12T02:49:15.518 INFO:teuthology.orchestra.run.smithi039.stdout: "log_to_file": { 2024-09-12T02:49:15.518 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "log_to_file", 2024-09-12T02:49:15.518 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "bool", 2024-09-12T02:49:15.518 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "advanced", 2024-09-12T02:49:15.518 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 1, 2024-09-12T02:49:15.518 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "False", 2024-09-12T02:49:15.518 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-09-12T02:49:15.518 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-09-12T02:49:15.518 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [], 2024-09-12T02:49:15.519 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "", 2024-09-12T02:49:15.519 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-09-12T02:49:15.519 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-09-12T02:49:15.519 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-09-12T02:49:15.519 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-09-12T02:49:15.519 INFO:teuthology.orchestra.run.smithi039.stdout: "organization": { 2024-09-12T02:49:15.519 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "organization", 2024-09-12T02:49:15.519 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "str", 2024-09-12T02:49:15.519 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "advanced", 2024-09-12T02:49:15.519 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 0, 2024-09-12T02:49:15.519 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "", 2024-09-12T02:49:15.519 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-09-12T02:49:15.519 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-09-12T02:49:15.520 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [], 2024-09-12T02:49:15.520 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "", 2024-09-12T02:49:15.520 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-09-12T02:49:15.520 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-09-12T02:49:15.520 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-09-12T02:49:15.520 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-09-12T02:49:15.520 INFO:teuthology.orchestra.run.smithi039.stdout: "proxy": { 2024-09-12T02:49:15.520 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "proxy", 2024-09-12T02:49:15.520 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "str", 2024-09-12T02:49:15.520 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "advanced", 2024-09-12T02:49:15.520 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 0, 2024-09-12T02:49:15.520 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "", 2024-09-12T02:49:15.520 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-09-12T02:49:15.521 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-09-12T02:49:15.521 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [], 2024-09-12T02:49:15.521 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "", 2024-09-12T02:49:15.521 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-09-12T02:49:15.521 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-09-12T02:49:15.521 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-09-12T02:49:15.521 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-09-12T02:49:15.521 INFO:teuthology.orchestra.run.smithi039.stdout: "url": { 2024-09-12T02:49:15.521 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "url", 2024-09-12T02:49:15.521 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "str", 2024-09-12T02:49:15.521 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "advanced", 2024-09-12T02:49:15.521 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 0, 2024-09-12T02:49:15.521 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "https://telemetry.ceph.com/report", 2024-09-12T02:49:15.521 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-09-12T02:49:15.522 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-09-12T02:49:15.522 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [], 2024-09-12T02:49:15.522 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "", 2024-09-12T02:49:15.522 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-09-12T02:49:15.522 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-09-12T02:49:15.522 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-09-12T02:49:15.522 INFO:teuthology.orchestra.run.smithi039.stdout: } 2024-09-12T02:49:15.522 INFO:teuthology.orchestra.run.smithi039.stdout: } 2024-09-12T02:49:15.522 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-09-12T02:49:15.522 INFO:teuthology.orchestra.run.smithi039.stdout: { 2024-09-12T02:49:15.522 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "test_orchestrator", 2024-09-12T02:49:15.522 INFO:teuthology.orchestra.run.smithi039.stdout: "can_run": true, 2024-09-12T02:49:15.522 INFO:teuthology.orchestra.run.smithi039.stdout: "error_string": "", 2024-09-12T02:49:15.522 INFO:teuthology.orchestra.run.smithi039.stdout: "module_options": { 2024-09-12T02:49:15.523 INFO:teuthology.orchestra.run.smithi039.stdout: "log_level": { 2024-09-12T02:49:15.523 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "log_level", 2024-09-12T02:49:15.523 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "str", 2024-09-12T02:49:15.523 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "advanced", 2024-09-12T02:49:15.523 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 1, 2024-09-12T02:49:15.523 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "", 2024-09-12T02:49:15.523 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-09-12T02:49:15.523 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-09-12T02:49:15.523 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [ 2024-09-12T02:49:15.523 INFO:teuthology.orchestra.run.smithi039.stdout: "", 2024-09-12T02:49:15.523 INFO:teuthology.orchestra.run.smithi039.stdout: "critical", 2024-09-12T02:49:15.523 INFO:teuthology.orchestra.run.smithi039.stdout: "debug", 2024-09-12T02:49:15.523 INFO:teuthology.orchestra.run.smithi039.stdout: "error", 2024-09-12T02:49:15.523 INFO:teuthology.orchestra.run.smithi039.stdout: "info", 2024-09-12T02:49:15.524 INFO:teuthology.orchestra.run.smithi039.stdout: "warning" 2024-09-12T02:49:15.524 INFO:teuthology.orchestra.run.smithi039.stdout: ], 2024-09-12T02:49:15.524 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "", 2024-09-12T02:49:15.524 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-09-12T02:49:15.524 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-09-12T02:49:15.524 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-09-12T02:49:15.524 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-09-12T02:49:15.524 INFO:teuthology.orchestra.run.smithi039.stdout: "log_to_cluster": { 2024-09-12T02:49:15.524 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "log_to_cluster", 2024-09-12T02:49:15.524 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "bool", 2024-09-12T02:49:15.524 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "advanced", 2024-09-12T02:49:15.524 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 1, 2024-09-12T02:49:15.524 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "False", 2024-09-12T02:49:15.525 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-09-12T02:49:15.525 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-09-12T02:49:15.525 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [], 2024-09-12T02:49:15.525 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "", 2024-09-12T02:49:15.525 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-09-12T02:49:15.525 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-09-12T02:49:15.525 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-09-12T02:49:15.525 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-09-12T02:49:15.525 INFO:teuthology.orchestra.run.smithi039.stdout: "log_to_cluster_level": { 2024-09-12T02:49:15.525 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "log_to_cluster_level", 2024-09-12T02:49:15.525 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "str", 2024-09-12T02:49:15.525 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "advanced", 2024-09-12T02:49:15.525 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 1, 2024-09-12T02:49:15.525 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "info", 2024-09-12T02:49:15.526 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-09-12T02:49:15.526 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-09-12T02:49:15.526 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [ 2024-09-12T02:49:15.526 INFO:teuthology.orchestra.run.smithi039.stdout: "", 2024-09-12T02:49:15.526 INFO:teuthology.orchestra.run.smithi039.stdout: "critical", 2024-09-12T02:49:15.526 INFO:teuthology.orchestra.run.smithi039.stdout: "debug", 2024-09-12T02:49:15.526 INFO:teuthology.orchestra.run.smithi039.stdout: "error", 2024-09-12T02:49:15.526 INFO:teuthology.orchestra.run.smithi039.stdout: "info", 2024-09-12T02:49:15.526 INFO:teuthology.orchestra.run.smithi039.stdout: "warning" 2024-09-12T02:49:15.526 INFO:teuthology.orchestra.run.smithi039.stdout: ], 2024-09-12T02:49:15.526 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "", 2024-09-12T02:49:15.526 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-09-12T02:49:15.526 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-09-12T02:49:15.526 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-09-12T02:49:15.527 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-09-12T02:49:15.527 INFO:teuthology.orchestra.run.smithi039.stdout: "log_to_file": { 2024-09-12T02:49:15.527 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "log_to_file", 2024-09-12T02:49:15.527 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "bool", 2024-09-12T02:49:15.527 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "advanced", 2024-09-12T02:49:15.527 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 1, 2024-09-12T02:49:15.527 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "False", 2024-09-12T02:49:15.527 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-09-12T02:49:15.527 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-09-12T02:49:15.527 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [], 2024-09-12T02:49:15.527 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "", 2024-09-12T02:49:15.527 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-09-12T02:49:15.527 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-09-12T02:49:15.527 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-09-12T02:49:15.528 INFO:teuthology.orchestra.run.smithi039.stdout: } 2024-09-12T02:49:15.528 INFO:teuthology.orchestra.run.smithi039.stdout: } 2024-09-12T02:49:15.528 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-09-12T02:49:15.528 INFO:teuthology.orchestra.run.smithi039.stdout: { 2024-09-12T02:49:15.528 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "volumes", 2024-09-12T02:49:15.528 INFO:teuthology.orchestra.run.smithi039.stdout: "can_run": true, 2024-09-12T02:49:15.528 INFO:teuthology.orchestra.run.smithi039.stdout: "error_string": "", 2024-09-12T02:49:15.528 INFO:teuthology.orchestra.run.smithi039.stdout: "module_options": { 2024-09-12T02:49:15.528 INFO:teuthology.orchestra.run.smithi039.stdout: "log_level": { 2024-09-12T02:49:15.528 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "log_level", 2024-09-12T02:49:15.528 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "str", 2024-09-12T02:49:15.528 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "advanced", 2024-09-12T02:49:15.528 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 1, 2024-09-12T02:49:15.528 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "", 2024-09-12T02:49:15.529 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-09-12T02:49:15.529 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-09-12T02:49:15.529 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [ 2024-09-12T02:49:15.529 INFO:teuthology.orchestra.run.smithi039.stdout: "", 2024-09-12T02:49:15.529 INFO:teuthology.orchestra.run.smithi039.stdout: "critical", 2024-09-12T02:49:15.529 INFO:teuthology.orchestra.run.smithi039.stdout: "debug", 2024-09-12T02:49:15.529 INFO:teuthology.orchestra.run.smithi039.stdout: "error", 2024-09-12T02:49:15.529 INFO:teuthology.orchestra.run.smithi039.stdout: "info", 2024-09-12T02:49:15.529 INFO:teuthology.orchestra.run.smithi039.stdout: "warning" 2024-09-12T02:49:15.529 INFO:teuthology.orchestra.run.smithi039.stdout: ], 2024-09-12T02:49:15.529 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "", 2024-09-12T02:49:15.529 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-09-12T02:49:15.529 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-09-12T02:49:15.529 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-09-12T02:49:15.530 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-09-12T02:49:15.530 INFO:teuthology.orchestra.run.smithi039.stdout: "log_to_cluster": { 2024-09-12T02:49:15.530 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "log_to_cluster", 2024-09-12T02:49:15.530 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "bool", 2024-09-12T02:49:15.530 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "advanced", 2024-09-12T02:49:15.530 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 1, 2024-09-12T02:49:15.530 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "False", 2024-09-12T02:49:15.530 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-09-12T02:49:15.530 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-09-12T02:49:15.530 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [], 2024-09-12T02:49:15.530 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "", 2024-09-12T02:49:15.530 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-09-12T02:49:15.530 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-09-12T02:49:15.530 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-09-12T02:49:15.531 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-09-12T02:49:15.531 INFO:teuthology.orchestra.run.smithi039.stdout: "log_to_cluster_level": { 2024-09-12T02:49:15.531 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "log_to_cluster_level", 2024-09-12T02:49:15.531 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "str", 2024-09-12T02:49:15.531 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "advanced", 2024-09-12T02:49:15.531 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 1, 2024-09-12T02:49:15.531 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "info", 2024-09-12T02:49:15.531 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-09-12T02:49:15.531 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-09-12T02:49:15.531 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [ 2024-09-12T02:49:15.531 INFO:teuthology.orchestra.run.smithi039.stdout: "", 2024-09-12T02:49:15.531 INFO:teuthology.orchestra.run.smithi039.stdout: "critical", 2024-09-12T02:49:15.531 INFO:teuthology.orchestra.run.smithi039.stdout: "debug", 2024-09-12T02:49:15.531 INFO:teuthology.orchestra.run.smithi039.stdout: "error", 2024-09-12T02:49:15.532 INFO:teuthology.orchestra.run.smithi039.stdout: "info", 2024-09-12T02:49:15.532 INFO:teuthology.orchestra.run.smithi039.stdout: "warning" 2024-09-12T02:49:15.532 INFO:teuthology.orchestra.run.smithi039.stdout: ], 2024-09-12T02:49:15.532 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "", 2024-09-12T02:49:15.532 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-09-12T02:49:15.532 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-09-12T02:49:15.532 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-09-12T02:49:15.532 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-09-12T02:49:15.532 INFO:teuthology.orchestra.run.smithi039.stdout: "log_to_file": { 2024-09-12T02:49:15.532 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "log_to_file", 2024-09-12T02:49:15.532 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "bool", 2024-09-12T02:49:15.532 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "advanced", 2024-09-12T02:49:15.532 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 1, 2024-09-12T02:49:15.533 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "False", 2024-09-12T02:49:15.533 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-09-12T02:49:15.533 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-09-12T02:49:15.533 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [], 2024-09-12T02:49:15.533 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "", 2024-09-12T02:49:15.533 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-09-12T02:49:15.533 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-09-12T02:49:15.533 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-09-12T02:49:15.533 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-09-12T02:49:15.533 INFO:teuthology.orchestra.run.smithi039.stdout: "max_concurrent_clones": { 2024-09-12T02:49:15.533 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "max_concurrent_clones", 2024-09-12T02:49:15.533 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "int", 2024-09-12T02:49:15.533 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "advanced", 2024-09-12T02:49:15.534 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 0, 2024-09-12T02:49:15.534 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "4", 2024-09-12T02:49:15.534 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-09-12T02:49:15.534 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-09-12T02:49:15.534 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [], 2024-09-12T02:49:15.534 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "Number of asynchronous cloner threads", 2024-09-12T02:49:15.534 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-09-12T02:49:15.534 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-09-12T02:49:15.534 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-09-12T02:49:15.534 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-09-12T02:49:15.534 INFO:teuthology.orchestra.run.smithi039.stdout: "periodic_async_work": { 2024-09-12T02:49:15.534 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "periodic_async_work", 2024-09-12T02:49:15.534 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "bool", 2024-09-12T02:49:15.534 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "advanced", 2024-09-12T02:49:15.535 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 0, 2024-09-12T02:49:15.535 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "False", 2024-09-12T02:49:15.535 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-09-12T02:49:15.535 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-09-12T02:49:15.535 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [], 2024-09-12T02:49:15.535 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "Periodically check for async work", 2024-09-12T02:49:15.535 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-09-12T02:49:15.535 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-09-12T02:49:15.535 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-09-12T02:49:15.535 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-09-12T02:49:15.535 INFO:teuthology.orchestra.run.smithi039.stdout: "snapshot_clone_delay": { 2024-09-12T02:49:15.535 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "snapshot_clone_delay", 2024-09-12T02:49:15.535 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "int", 2024-09-12T02:49:15.535 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "advanced", 2024-09-12T02:49:15.536 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 0, 2024-09-12T02:49:15.536 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "0", 2024-09-12T02:49:15.536 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-09-12T02:49:15.536 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-09-12T02:49:15.536 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [], 2024-09-12T02:49:15.536 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "Delay clone begin operation by snapshot_clone_delay seconds", 2024-09-12T02:49:15.536 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-09-12T02:49:15.536 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-09-12T02:49:15.536 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-09-12T02:49:15.536 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-09-12T02:49:15.536 INFO:teuthology.orchestra.run.smithi039.stdout: "snapshot_clone_no_wait": { 2024-09-12T02:49:15.536 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "snapshot_clone_no_wait", 2024-09-12T02:49:15.536 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "bool", 2024-09-12T02:49:15.537 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "advanced", 2024-09-12T02:49:15.537 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 0, 2024-09-12T02:49:15.537 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "True", 2024-09-12T02:49:15.537 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-09-12T02:49:15.537 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-09-12T02:49:15.537 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [], 2024-09-12T02:49:15.537 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "Reject subvolume clone request when cloner threads are busy", 2024-09-12T02:49:15.537 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-09-12T02:49:15.537 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-09-12T02:49:15.537 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-09-12T02:49:15.537 INFO:teuthology.orchestra.run.smithi039.stdout: } 2024-09-12T02:49:15.537 INFO:teuthology.orchestra.run.smithi039.stdout: } 2024-09-12T02:49:15.537 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-09-12T02:49:15.538 INFO:teuthology.orchestra.run.smithi039.stdout: { 2024-09-12T02:49:15.538 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "zabbix", 2024-09-12T02:49:15.538 INFO:teuthology.orchestra.run.smithi039.stdout: "can_run": true, 2024-09-12T02:49:15.538 INFO:teuthology.orchestra.run.smithi039.stdout: "error_string": "", 2024-09-12T02:49:15.538 INFO:teuthology.orchestra.run.smithi039.stdout: "module_options": { 2024-09-12T02:49:15.538 INFO:teuthology.orchestra.run.smithi039.stdout: "discovery_interval": { 2024-09-12T02:49:15.538 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "discovery_interval", 2024-09-12T02:49:15.538 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "uint", 2024-09-12T02:49:15.538 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "advanced", 2024-09-12T02:49:15.538 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 0, 2024-09-12T02:49:15.538 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "100", 2024-09-12T02:49:15.538 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-09-12T02:49:15.538 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-09-12T02:49:15.539 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [], 2024-09-12T02:49:15.539 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "", 2024-09-12T02:49:15.539 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-09-12T02:49:15.539 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-09-12T02:49:15.539 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-09-12T02:49:15.539 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-09-12T02:49:15.539 INFO:teuthology.orchestra.run.smithi039.stdout: "identifier": { 2024-09-12T02:49:15.539 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "identifier", 2024-09-12T02:49:15.539 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "str", 2024-09-12T02:49:15.539 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "advanced", 2024-09-12T02:49:15.539 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 0, 2024-09-12T02:49:15.539 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "", 2024-09-12T02:49:15.539 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-09-12T02:49:15.539 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-09-12T02:49:15.539 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [], 2024-09-12T02:49:15.540 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "", 2024-09-12T02:49:15.540 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-09-12T02:49:15.540 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-09-12T02:49:15.540 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-09-12T02:49:15.540 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-09-12T02:49:15.540 INFO:teuthology.orchestra.run.smithi039.stdout: "interval": { 2024-09-12T02:49:15.540 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "interval", 2024-09-12T02:49:15.540 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "secs", 2024-09-12T02:49:15.540 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "advanced", 2024-09-12T02:49:15.540 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 0, 2024-09-12T02:49:15.540 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "60", 2024-09-12T02:49:15.540 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-09-12T02:49:15.540 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-09-12T02:49:15.541 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [], 2024-09-12T02:49:15.541 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "", 2024-09-12T02:49:15.541 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-09-12T02:49:15.541 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-09-12T02:49:15.541 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-09-12T02:49:15.541 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-09-12T02:49:15.541 INFO:teuthology.orchestra.run.smithi039.stdout: "log_level": { 2024-09-12T02:49:15.541 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "log_level", 2024-09-12T02:49:15.541 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "str", 2024-09-12T02:49:15.541 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "advanced", 2024-09-12T02:49:15.541 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 1, 2024-09-12T02:49:15.541 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "", 2024-09-12T02:49:15.541 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-09-12T02:49:15.541 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-09-12T02:49:15.542 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [ 2024-09-12T02:49:15.542 INFO:teuthology.orchestra.run.smithi039.stdout: "", 2024-09-12T02:49:15.542 INFO:teuthology.orchestra.run.smithi039.stdout: "critical", 2024-09-12T02:49:15.542 INFO:teuthology.orchestra.run.smithi039.stdout: "debug", 2024-09-12T02:49:15.542 INFO:teuthology.orchestra.run.smithi039.stdout: "error", 2024-09-12T02:49:15.542 INFO:teuthology.orchestra.run.smithi039.stdout: "info", 2024-09-12T02:49:15.542 INFO:teuthology.orchestra.run.smithi039.stdout: "warning" 2024-09-12T02:49:15.542 INFO:teuthology.orchestra.run.smithi039.stdout: ], 2024-09-12T02:49:15.542 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "", 2024-09-12T02:49:15.542 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-09-12T02:49:15.542 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-09-12T02:49:15.542 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-09-12T02:49:15.542 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-09-12T02:49:15.542 INFO:teuthology.orchestra.run.smithi039.stdout: "log_to_cluster": { 2024-09-12T02:49:15.543 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "log_to_cluster", 2024-09-12T02:49:15.543 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "bool", 2024-09-12T02:49:15.543 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "advanced", 2024-09-12T02:49:15.543 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 1, 2024-09-12T02:49:15.543 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "False", 2024-09-12T02:49:15.543 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-09-12T02:49:15.543 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-09-12T02:49:15.543 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [], 2024-09-12T02:49:15.543 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "", 2024-09-12T02:49:15.543 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-09-12T02:49:15.543 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-09-12T02:49:15.543 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-09-12T02:49:15.543 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-09-12T02:49:15.544 INFO:teuthology.orchestra.run.smithi039.stdout: "log_to_cluster_level": { 2024-09-12T02:49:15.544 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "log_to_cluster_level", 2024-09-12T02:49:15.544 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "str", 2024-09-12T02:49:15.544 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "advanced", 2024-09-12T02:49:15.544 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 1, 2024-09-12T02:49:15.544 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "info", 2024-09-12T02:49:15.544 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-09-12T02:49:15.544 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-09-12T02:49:15.544 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [ 2024-09-12T02:49:15.544 INFO:teuthology.orchestra.run.smithi039.stdout: "", 2024-09-12T02:49:15.544 INFO:teuthology.orchestra.run.smithi039.stdout: "critical", 2024-09-12T02:49:15.544 INFO:teuthology.orchestra.run.smithi039.stdout: "debug", 2024-09-12T02:49:15.544 INFO:teuthology.orchestra.run.smithi039.stdout: "error", 2024-09-12T02:49:15.544 INFO:teuthology.orchestra.run.smithi039.stdout: "info", 2024-09-12T02:49:15.545 INFO:teuthology.orchestra.run.smithi039.stdout: "warning" 2024-09-12T02:49:15.545 INFO:teuthology.orchestra.run.smithi039.stdout: ], 2024-09-12T02:49:15.545 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "", 2024-09-12T02:49:15.545 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-09-12T02:49:15.545 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-09-12T02:49:15.545 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-09-12T02:49:15.545 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-09-12T02:49:15.545 INFO:teuthology.orchestra.run.smithi039.stdout: "log_to_file": { 2024-09-12T02:49:15.545 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "log_to_file", 2024-09-12T02:49:15.545 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "bool", 2024-09-12T02:49:15.545 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "advanced", 2024-09-12T02:49:15.545 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 1, 2024-09-12T02:49:15.545 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "False", 2024-09-12T02:49:15.545 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-09-12T02:49:15.546 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-09-12T02:49:15.546 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [], 2024-09-12T02:49:15.546 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "", 2024-09-12T02:49:15.546 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-09-12T02:49:15.546 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-09-12T02:49:15.546 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-09-12T02:49:15.546 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-09-12T02:49:15.546 INFO:teuthology.orchestra.run.smithi039.stdout: "zabbix_host": { 2024-09-12T02:49:15.546 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "zabbix_host", 2024-09-12T02:49:15.546 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "str", 2024-09-12T02:49:15.546 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "advanced", 2024-09-12T02:49:15.546 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 0, 2024-09-12T02:49:15.546 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "", 2024-09-12T02:49:15.547 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-09-12T02:49:15.547 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-09-12T02:49:15.547 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [], 2024-09-12T02:49:15.547 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "", 2024-09-12T02:49:15.547 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-09-12T02:49:15.547 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-09-12T02:49:15.547 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-09-12T02:49:15.547 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-09-12T02:49:15.547 INFO:teuthology.orchestra.run.smithi039.stdout: "zabbix_port": { 2024-09-12T02:49:15.547 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "zabbix_port", 2024-09-12T02:49:15.547 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "int", 2024-09-12T02:49:15.547 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "advanced", 2024-09-12T02:49:15.547 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 0, 2024-09-12T02:49:15.547 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "10051", 2024-09-12T02:49:15.548 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-09-12T02:49:15.548 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-09-12T02:49:15.548 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [], 2024-09-12T02:49:15.548 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "", 2024-09-12T02:49:15.548 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-09-12T02:49:15.548 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-09-12T02:49:15.548 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-09-12T02:49:15.548 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-09-12T02:49:15.548 INFO:teuthology.orchestra.run.smithi039.stdout: "zabbix_sender": { 2024-09-12T02:49:15.548 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "zabbix_sender", 2024-09-12T02:49:15.548 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "str", 2024-09-12T02:49:15.548 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "advanced", 2024-09-12T02:49:15.548 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 0, 2024-09-12T02:49:15.549 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "/usr/bin/zabbix_sender", 2024-09-12T02:49:15.549 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-09-12T02:49:15.549 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-09-12T02:49:15.549 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [], 2024-09-12T02:49:15.549 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "", 2024-09-12T02:49:15.549 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-09-12T02:49:15.549 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-09-12T02:49:15.549 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-09-12T02:49:15.549 INFO:teuthology.orchestra.run.smithi039.stdout: } 2024-09-12T02:49:15.549 INFO:teuthology.orchestra.run.smithi039.stdout: } 2024-09-12T02:49:15.549 INFO:teuthology.orchestra.run.smithi039.stdout: } 2024-09-12T02:49:15.549 INFO:teuthology.orchestra.run.smithi039.stdout: ], 2024-09-12T02:49:15.549 INFO:teuthology.orchestra.run.smithi039.stdout: "services": { 2024-09-12T02:49:15.549 INFO:teuthology.orchestra.run.smithi039.stdout: "dashboard": "https://172.21.15.39:8443/" 2024-09-12T02:49:15.550 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-09-12T02:49:15.550 INFO:teuthology.orchestra.run.smithi039.stdout: "always_on_modules": { 2024-09-12T02:49:15.550 INFO:teuthology.orchestra.run.smithi039.stdout: "octopus": [ 2024-09-12T02:49:15.550 INFO:teuthology.orchestra.run.smithi039.stdout: "balancer", 2024-09-12T02:49:15.550 INFO:teuthology.orchestra.run.smithi039.stdout: "crash", 2024-09-12T02:49:15.550 INFO:teuthology.orchestra.run.smithi039.stdout: "devicehealth", 2024-09-12T02:49:15.550 INFO:teuthology.orchestra.run.smithi039.stdout: "orchestrator", 2024-09-12T02:49:15.550 INFO:teuthology.orchestra.run.smithi039.stdout: "pg_autoscaler", 2024-09-12T02:49:15.550 INFO:teuthology.orchestra.run.smithi039.stdout: "progress", 2024-09-12T02:49:15.550 INFO:teuthology.orchestra.run.smithi039.stdout: "rbd_support", 2024-09-12T02:49:15.550 INFO:teuthology.orchestra.run.smithi039.stdout: "status", 2024-09-12T02:49:15.550 INFO:teuthology.orchestra.run.smithi039.stdout: "telemetry", 2024-09-12T02:49:15.550 INFO:teuthology.orchestra.run.smithi039.stdout: "volumes" 2024-09-12T02:49:15.551 INFO:teuthology.orchestra.run.smithi039.stdout: ], 2024-09-12T02:49:15.551 INFO:teuthology.orchestra.run.smithi039.stdout: "pacific": [ 2024-09-12T02:49:15.551 INFO:teuthology.orchestra.run.smithi039.stdout: "balancer", 2024-09-12T02:49:15.551 INFO:teuthology.orchestra.run.smithi039.stdout: "crash", 2024-09-12T02:49:15.551 INFO:teuthology.orchestra.run.smithi039.stdout: "devicehealth", 2024-09-12T02:49:15.551 INFO:teuthology.orchestra.run.smithi039.stdout: "orchestrator", 2024-09-12T02:49:15.551 INFO:teuthology.orchestra.run.smithi039.stdout: "pg_autoscaler", 2024-09-12T02:49:15.551 INFO:teuthology.orchestra.run.smithi039.stdout: "progress", 2024-09-12T02:49:15.551 INFO:teuthology.orchestra.run.smithi039.stdout: "rbd_support", 2024-09-12T02:49:15.551 INFO:teuthology.orchestra.run.smithi039.stdout: "status", 2024-09-12T02:49:15.551 INFO:teuthology.orchestra.run.smithi039.stdout: "telemetry", 2024-09-12T02:49:15.551 INFO:teuthology.orchestra.run.smithi039.stdout: "volumes" 2024-09-12T02:49:15.551 INFO:teuthology.orchestra.run.smithi039.stdout: ], 2024-09-12T02:49:15.551 INFO:teuthology.orchestra.run.smithi039.stdout: "quincy": [ 2024-09-12T02:49:15.552 INFO:teuthology.orchestra.run.smithi039.stdout: "balancer", 2024-09-12T02:49:15.552 INFO:teuthology.orchestra.run.smithi039.stdout: "crash", 2024-09-12T02:49:15.552 INFO:teuthology.orchestra.run.smithi039.stdout: "devicehealth", 2024-09-12T02:49:15.552 INFO:teuthology.orchestra.run.smithi039.stdout: "orchestrator", 2024-09-12T02:49:15.552 INFO:teuthology.orchestra.run.smithi039.stdout: "pg_autoscaler", 2024-09-12T02:49:15.552 INFO:teuthology.orchestra.run.smithi039.stdout: "progress", 2024-09-12T02:49:15.552 INFO:teuthology.orchestra.run.smithi039.stdout: "rbd_support", 2024-09-12T02:49:15.552 INFO:teuthology.orchestra.run.smithi039.stdout: "status", 2024-09-12T02:49:15.552 INFO:teuthology.orchestra.run.smithi039.stdout: "telemetry", 2024-09-12T02:49:15.552 INFO:teuthology.orchestra.run.smithi039.stdout: "volumes" 2024-09-12T02:49:15.552 INFO:teuthology.orchestra.run.smithi039.stdout: ], 2024-09-12T02:49:15.552 INFO:teuthology.orchestra.run.smithi039.stdout: "reef": [ 2024-09-12T02:49:15.552 INFO:teuthology.orchestra.run.smithi039.stdout: "balancer", 2024-09-12T02:49:15.553 INFO:teuthology.orchestra.run.smithi039.stdout: "crash", 2024-09-12T02:49:15.553 INFO:teuthology.orchestra.run.smithi039.stdout: "devicehealth", 2024-09-12T02:49:15.553 INFO:teuthology.orchestra.run.smithi039.stdout: "orchestrator", 2024-09-12T02:49:15.553 INFO:teuthology.orchestra.run.smithi039.stdout: "pg_autoscaler", 2024-09-12T02:49:15.553 INFO:teuthology.orchestra.run.smithi039.stdout: "progress", 2024-09-12T02:49:15.553 INFO:teuthology.orchestra.run.smithi039.stdout: "rbd_support", 2024-09-12T02:49:15.553 INFO:teuthology.orchestra.run.smithi039.stdout: "status", 2024-09-12T02:49:15.553 INFO:teuthology.orchestra.run.smithi039.stdout: "telemetry", 2024-09-12T02:49:15.553 INFO:teuthology.orchestra.run.smithi039.stdout: "volumes" 2024-09-12T02:49:15.553 INFO:teuthology.orchestra.run.smithi039.stdout: ], 2024-09-12T02:49:15.553 INFO:teuthology.orchestra.run.smithi039.stdout: "squid": [ 2024-09-12T02:49:15.553 INFO:teuthology.orchestra.run.smithi039.stdout: "balancer", 2024-09-12T02:49:15.553 INFO:teuthology.orchestra.run.smithi039.stdout: "crash", 2024-09-12T02:49:15.553 INFO:teuthology.orchestra.run.smithi039.stdout: "devicehealth", 2024-09-12T02:49:15.554 INFO:teuthology.orchestra.run.smithi039.stdout: "orchestrator", 2024-09-12T02:49:15.554 INFO:teuthology.orchestra.run.smithi039.stdout: "pg_autoscaler", 2024-09-12T02:49:15.554 INFO:teuthology.orchestra.run.smithi039.stdout: "progress", 2024-09-12T02:49:15.554 INFO:teuthology.orchestra.run.smithi039.stdout: "rbd_support", 2024-09-12T02:49:15.554 INFO:teuthology.orchestra.run.smithi039.stdout: "status", 2024-09-12T02:49:15.554 INFO:teuthology.orchestra.run.smithi039.stdout: "telemetry", 2024-09-12T02:49:15.554 INFO:teuthology.orchestra.run.smithi039.stdout: "volumes" 2024-09-12T02:49:15.554 INFO:teuthology.orchestra.run.smithi039.stdout: ] 2024-09-12T02:49:15.554 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-09-12T02:49:15.554 INFO:teuthology.orchestra.run.smithi039.stdout: "last_failure_osd_epoch": 96, 2024-09-12T02:49:15.554 INFO:teuthology.orchestra.run.smithi039.stdout: "active_clients": [ 2024-09-12T02:49:15.554 INFO:teuthology.orchestra.run.smithi039.stdout: { 2024-09-12T02:49:15.554 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "devicehealth", 2024-09-12T02:49:15.554 INFO:teuthology.orchestra.run.smithi039.stdout: "addrvec": [ 2024-09-12T02:49:15.555 INFO:teuthology.orchestra.run.smithi039.stdout: { 2024-09-12T02:49:15.555 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "v2", 2024-09-12T02:49:15.555 INFO:teuthology.orchestra.run.smithi039.stdout: "addr": "172.21.15.39:0", 2024-09-12T02:49:15.555 INFO:teuthology.orchestra.run.smithi039.stdout: "nonce": 1133726719 2024-09-12T02:49:15.555 INFO:teuthology.orchestra.run.smithi039.stdout: } 2024-09-12T02:49:15.555 INFO:teuthology.orchestra.run.smithi039.stdout: ] 2024-09-12T02:49:15.555 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-09-12T02:49:15.555 INFO:teuthology.orchestra.run.smithi039.stdout: { 2024-09-12T02:49:15.555 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "libcephsqlite", 2024-09-12T02:49:15.555 INFO:teuthology.orchestra.run.smithi039.stdout: "addrvec": [ 2024-09-12T02:49:15.555 INFO:teuthology.orchestra.run.smithi039.stdout: { 2024-09-12T02:49:15.555 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "v2", 2024-09-12T02:49:15.555 INFO:teuthology.orchestra.run.smithi039.stdout: "addr": "172.21.15.39:0", 2024-09-12T02:49:15.556 INFO:teuthology.orchestra.run.smithi039.stdout: "nonce": 3804469813 2024-09-12T02:49:15.556 INFO:teuthology.orchestra.run.smithi039.stdout: } 2024-09-12T02:49:15.556 INFO:teuthology.orchestra.run.smithi039.stdout: ] 2024-09-12T02:49:15.556 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-09-12T02:49:15.556 INFO:teuthology.orchestra.run.smithi039.stdout: { 2024-09-12T02:49:15.556 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "rbd_support", 2024-09-12T02:49:15.556 INFO:teuthology.orchestra.run.smithi039.stdout: "addrvec": [ 2024-09-12T02:49:15.556 INFO:teuthology.orchestra.run.smithi039.stdout: { 2024-09-12T02:49:15.556 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "v2", 2024-09-12T02:49:15.556 INFO:teuthology.orchestra.run.smithi039.stdout: "addr": "172.21.15.39:0", 2024-09-12T02:49:15.556 INFO:teuthology.orchestra.run.smithi039.stdout: "nonce": 815773745 2024-09-12T02:49:15.556 INFO:teuthology.orchestra.run.smithi039.stdout: } 2024-09-12T02:49:15.556 INFO:teuthology.orchestra.run.smithi039.stdout: ] 2024-09-12T02:49:15.556 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-09-12T02:49:15.557 INFO:teuthology.orchestra.run.smithi039.stdout: { 2024-09-12T02:49:15.557 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "snap_schedule", 2024-09-12T02:49:15.557 INFO:teuthology.orchestra.run.smithi039.stdout: "addrvec": [ 2024-09-12T02:49:15.557 INFO:teuthology.orchestra.run.smithi039.stdout: { 2024-09-12T02:49:15.557 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "v2", 2024-09-12T02:49:15.557 INFO:teuthology.orchestra.run.smithi039.stdout: "addr": "172.21.15.39:0", 2024-09-12T02:49:15.557 INFO:teuthology.orchestra.run.smithi039.stdout: "nonce": 2403601023 2024-09-12T02:49:15.557 INFO:teuthology.orchestra.run.smithi039.stdout: } 2024-09-12T02:49:15.557 INFO:teuthology.orchestra.run.smithi039.stdout: ] 2024-09-12T02:49:15.557 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-09-12T02:49:15.557 INFO:teuthology.orchestra.run.smithi039.stdout: { 2024-09-12T02:49:15.557 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "snap_schedule", 2024-09-12T02:49:15.557 INFO:teuthology.orchestra.run.smithi039.stdout: "addrvec": [ 2024-09-12T02:49:15.558 INFO:teuthology.orchestra.run.smithi039.stdout: { 2024-09-12T02:49:15.558 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "v2", 2024-09-12T02:49:15.558 INFO:teuthology.orchestra.run.smithi039.stdout: "addr": "172.21.15.39:0", 2024-09-12T02:49:15.558 INFO:teuthology.orchestra.run.smithi039.stdout: "nonce": 3700280441 2024-09-12T02:49:15.558 INFO:teuthology.orchestra.run.smithi039.stdout: } 2024-09-12T02:49:15.558 INFO:teuthology.orchestra.run.smithi039.stdout: ] 2024-09-12T02:49:15.558 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-09-12T02:49:15.558 INFO:teuthology.orchestra.run.smithi039.stdout: { 2024-09-12T02:49:15.558 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "volumes", 2024-09-12T02:49:15.558 INFO:teuthology.orchestra.run.smithi039.stdout: "addrvec": [ 2024-09-12T02:49:15.558 INFO:teuthology.orchestra.run.smithi039.stdout: { 2024-09-12T02:49:15.558 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "v2", 2024-09-12T02:49:15.558 INFO:teuthology.orchestra.run.smithi039.stdout: "addr": "172.21.15.39:0", 2024-09-12T02:49:15.558 INFO:teuthology.orchestra.run.smithi039.stdout: "nonce": 571334689 2024-09-12T02:49:15.558 INFO:teuthology.orchestra.run.smithi039.stdout: } 2024-09-12T02:49:15.559 INFO:teuthology.orchestra.run.smithi039.stdout: ] 2024-09-12T02:49:15.559 INFO:teuthology.orchestra.run.smithi039.stdout: } 2024-09-12T02:49:15.559 INFO:teuthology.orchestra.run.smithi039.stdout: ] 2024-09-12T02:49:15.559 INFO:teuthology.orchestra.run.smithi039.stdout:} 2024-09-12T02:49:15.560 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 12 02:49:14 smithi172 ceph-mon[35609]: from='client.? 172.21.15.39:0/90102503' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"}]: dispatch 2024-09-12T02:49:15.560 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 12 02:49:14 smithi172 ceph-mon[35609]: from='client.? 172.21.15.39:0/1812803664' entity='client.admin' cmd=[{"prefix": "mgr dump", "format": "json-pretty"}]: dispatch 2024-09-12T02:49:15.560 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 12 02:49:14 smithi172 ceph-mon[35609]: from='mgr.25199 172.21.15.39:0/1270637502' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-12T02:49:15.561 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 12 02:49:14 smithi044 ceph-mon[35411]: from='client.? 172.21.15.39:0/90102503' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"}]: dispatch 2024-09-12T02:49:15.561 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 12 02:49:14 smithi044 ceph-mon[35411]: from='client.? 172.21.15.39:0/1812803664' entity='client.admin' cmd=[{"prefix": "mgr dump", "format": "json-pretty"}]: dispatch 2024-09-12T02:49:15.561 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 12 02:49:14 smithi044 ceph-mon[35411]: from='mgr.25199 172.21.15.39:0/1270637502' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-12T02:49:15.561 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:49:14.178+0000 7fd5db000640 1 -- 172.21.15.39:0/1812803664 >> [v2:172.21.15.39:6800/2187509357,v1:172.21.15.39:6801/2187509357] conn(0x7fd5bc0a2d80 msgr2=0x7fd5bc0a5240 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:49:15.562 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:49:14.178+0000 7fd5db000640 1 --2- 172.21.15.39:0/1812803664 >> [v2:172.21.15.39:6800/2187509357,v1:172.21.15.39:6801/2187509357] conn(0x7fd5bc0a2d80 0x7fd5bc0a5240 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0x7fd5d410ec60 tx=0x7fd5c0005f90 comp rx=0 tx=0).stop 2024-09-12T02:49:15.562 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:49:14.178+0000 7fd5db000640 1 -- 172.21.15.39:0/1812803664 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fd5d4069380 msgr2=0x7fd5d419a3f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:49:15.562 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:49:14.178+0000 7fd5db000640 1 --2- 172.21.15.39:0/1812803664 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fd5d4069380 0x7fd5d419a3f0 secure :-1 s=READY pgs=303 cs=0 l=1 rev1=1 crypto rx=0x7fd5c8005e30 tx=0x7fd5c8003f90 comp rx=0 tx=0).stop 2024-09-12T02:49:15.562 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:49:14.178+0000 7fd5db000640 1 -- 172.21.15.39:0/1812803664 shutdown_connections 2024-09-12T02:49:15.562 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:49:14.178+0000 7fd5db000640 1 --2- 172.21.15.39:0/1812803664 >> [v2:172.21.15.39:6800/2187509357,v1:172.21.15.39:6801/2187509357] conn(0x7fd5bc0a2d80 0x7fd5bc0a5240 unknown :-1 s=CLOSED pgs=51 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:49:15.562 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:49:14.178+0000 7fd5db000640 1 --2- 172.21.15.39:0/1812803664 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fd5d41078f0 0x7fd5d419ecb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:49:15.562 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:49:14.178+0000 7fd5db000640 1 --2- 172.21.15.39:0/1812803664 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fd5d4069d00 0x7fd5d419a930 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:49:15.562 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:49:14.178+0000 7fd5db000640 1 --2- 172.21.15.39:0/1812803664 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fd5d4069380 0x7fd5d419a3f0 unknown :-1 s=CLOSED pgs=303 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:49:15.562 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:49:14.178+0000 7fd5db000640 1 -- 172.21.15.39:0/1812803664 >> 172.21.15.39:0/1812803664 conn(0x7fd5d4076550 msgr2=0x7fd5d40ff6e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:49:15.562 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:49:14.179+0000 7fd5db000640 1 -- 172.21.15.39:0/1812803664 shutdown_connections 2024-09-12T02:49:15.562 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:49:14.179+0000 7fd5db000640 1 -- 172.21.15.39:0/1812803664 wait complete. 2024-09-12T02:49:15.569 DEBUG:tasks.check_counter:Getting stats from a 2024-09-12T02:49:15.569 DEBUG:teuthology.orchestra.run.smithi039:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc shell --fsid 4954ed46-70ae-11ef-bcea-c7b262605968 -- ceph daemon mds.a perf dump 2024-09-12T02:49:15.569 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 02:49:14 smithi039 ceph-mon[30515]: from='client.? 172.21.15.39:0/90102503' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"}]: dispatch 2024-09-12T02:49:15.569 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 02:49:14 smithi039 ceph-mon[30515]: from='client.? 172.21.15.39:0/1812803664' entity='client.admin' cmd=[{"prefix": "mgr dump", "format": "json-pretty"}]: dispatch 2024-09-12T02:49:15.569 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 02:49:14 smithi039 ceph-mon[30515]: from='mgr.25199 172.21.15.39:0/1270637502' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-12T02:49:15.948 INFO:teuthology.orchestra.run.smithi039.stderr:Inferring config /var/lib/ceph/4954ed46-70ae-11ef-bcea-c7b262605968/mon.a/config 2024-09-12T02:49:15.949 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 12 02:49:15 smithi044 ceph-mon[35411]: pgmap v354: 129 pgs: 129 active+clean; 24 MiB data, 485 MiB used, 1.0 TiB / 1.0 TiB avail; 59 KiB/s rd, 54 KiB/s wr, 18 op/s 2024-09-12T02:49:15.949 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 12 02:49:15 smithi044 ceph-mon[35411]: from='mgr.25199 172.21.15.39:0/1270637502' entity='mgr.x' 2024-09-12T02:49:15.949 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 12 02:49:15 smithi044 ceph-mon[35411]: from='mgr.25199 172.21.15.39:0/1270637502' entity='mgr.x' 2024-09-12T02:49:15.949 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 12 02:49:15 smithi044 ceph-mon[35411]: from='mgr.25199 172.21.15.39:0/1270637502' entity='mgr.x' 2024-09-12T02:49:15.949 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 12 02:49:15 smithi044 ceph-mon[35411]: from='mgr.25199 172.21.15.39:0/1270637502' entity='mgr.x' 2024-09-12T02:49:15.949 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 12 02:49:15 smithi044 ceph-mon[35411]: from='mgr.25199 172.21.15.39:0/1270637502' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-12T02:49:15.950 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 12 02:49:15 smithi044 ceph-mon[35411]: from='mgr.25199 172.21.15.39:0/1270637502' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-12T02:49:15.950 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 12 02:49:15 smithi044 ceph-mon[35411]: from='mgr.25199 172.21.15.39:0/1270637502' entity='mgr.x' 2024-09-12T02:49:16.014 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 12 02:49:15 smithi172 ceph-mon[35609]: pgmap v354: 129 pgs: 129 active+clean; 24 MiB data, 485 MiB used, 1.0 TiB / 1.0 TiB avail; 59 KiB/s rd, 54 KiB/s wr, 18 op/s 2024-09-12T02:49:16.014 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 12 02:49:15 smithi172 ceph-mon[35609]: from='mgr.25199 172.21.15.39:0/1270637502' entity='mgr.x' 2024-09-12T02:49:16.014 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 12 02:49:15 smithi172 ceph-mon[35609]: from='mgr.25199 172.21.15.39:0/1270637502' entity='mgr.x' 2024-09-12T02:49:16.014 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 12 02:49:15 smithi172 ceph-mon[35609]: from='mgr.25199 172.21.15.39:0/1270637502' entity='mgr.x' 2024-09-12T02:49:16.014 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 12 02:49:15 smithi172 ceph-mon[35609]: from='mgr.25199 172.21.15.39:0/1270637502' entity='mgr.x' 2024-09-12T02:49:16.014 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 12 02:49:15 smithi172 ceph-mon[35609]: from='mgr.25199 172.21.15.39:0/1270637502' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-12T02:49:16.014 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 12 02:49:15 smithi172 ceph-mon[35609]: from='mgr.25199 172.21.15.39:0/1270637502' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-12T02:49:16.014 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 12 02:49:15 smithi172 ceph-mon[35609]: from='mgr.25199 172.21.15.39:0/1270637502' entity='mgr.x' 2024-09-12T02:49:16.087 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 02:49:15 smithi039 ceph-mon[30515]: pgmap v354: 129 pgs: 129 active+clean; 24 MiB data, 485 MiB used, 1.0 TiB / 1.0 TiB avail; 59 KiB/s rd, 54 KiB/s wr, 18 op/s 2024-09-12T02:49:16.087 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 02:49:15 smithi039 ceph-mon[30515]: from='mgr.25199 172.21.15.39:0/1270637502' entity='mgr.x' 2024-09-12T02:49:16.087 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 02:49:15 smithi039 ceph-mon[30515]: from='mgr.25199 172.21.15.39:0/1270637502' entity='mgr.x' 2024-09-12T02:49:16.087 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 02:49:15 smithi039 ceph-mon[30515]: from='mgr.25199 172.21.15.39:0/1270637502' entity='mgr.x' 2024-09-12T02:49:16.087 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 02:49:15 smithi039 ceph-mon[30515]: from='mgr.25199 172.21.15.39:0/1270637502' entity='mgr.x' 2024-09-12T02:49:16.087 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 02:49:15 smithi039 ceph-mon[30515]: from='mgr.25199 172.21.15.39:0/1270637502' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-12T02:49:16.088 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 02:49:15 smithi039 ceph-mon[30515]: from='mgr.25199 172.21.15.39:0/1270637502' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-12T02:49:16.088 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 02:49:15 smithi039 ceph-mon[30515]: from='mgr.25199 172.21.15.39:0/1270637502' entity='mgr.x' 2024-09-12T02:49:16.620 INFO:teuthology.orchestra.run.smithi039.stdout:{ 2024-09-12T02:49:16.620 INFO:teuthology.orchestra.run.smithi039.stdout: "AsyncMessenger::Worker-0": { 2024-09-12T02:49:16.620 INFO:teuthology.orchestra.run.smithi039.stdout: "msgr_recv_messages": 805, 2024-09-12T02:49:16.620 INFO:teuthology.orchestra.run.smithi039.stdout: "msgr_send_messages": 807, 2024-09-12T02:49:16.620 INFO:teuthology.orchestra.run.smithi039.stdout: "msgr_recv_bytes": 270425, 2024-09-12T02:49:16.620 INFO:teuthology.orchestra.run.smithi039.stdout: "msgr_send_bytes": 255991, 2024-09-12T02:49:16.620 INFO:teuthology.orchestra.run.smithi039.stdout: "msgr_created_connections": 6, 2024-09-12T02:49:16.620 INFO:teuthology.orchestra.run.smithi039.stdout: "msgr_active_connections": 2, 2024-09-12T02:49:16.621 INFO:teuthology.orchestra.run.smithi039.stdout: "msgr_running_total_time": 0.133290379, 2024-09-12T02:49:16.621 INFO:teuthology.orchestra.run.smithi039.stdout: "msgr_running_send_time": 0.063728792, 2024-09-12T02:49:16.621 INFO:teuthology.orchestra.run.smithi039.stdout: "msgr_running_recv_time": 0.026540614, 2024-09-12T02:49:16.621 INFO:teuthology.orchestra.run.smithi039.stdout: "msgr_running_fast_dispatch_time": 0.026820379, 2024-09-12T02:49:16.621 INFO:teuthology.orchestra.run.smithi039.stdout: "msgr_send_messages_queue_lat": { 2024-09-12T02:49:16.621 INFO:teuthology.orchestra.run.smithi039.stdout: "avgcount": 805, 2024-09-12T02:49:16.621 INFO:teuthology.orchestra.run.smithi039.stdout: "sum": 0.063665573, 2024-09-12T02:49:16.621 INFO:teuthology.orchestra.run.smithi039.stdout: "avgtime": 0.000079087 2024-09-12T02:49:16.621 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-09-12T02:49:16.621 INFO:teuthology.orchestra.run.smithi039.stdout: "msgr_handle_ack_lat": { 2024-09-12T02:49:16.621 INFO:teuthology.orchestra.run.smithi039.stdout: "avgcount": 0, 2024-09-12T02:49:16.621 INFO:teuthology.orchestra.run.smithi039.stdout: "sum": 0.000000000, 2024-09-12T02:49:16.621 INFO:teuthology.orchestra.run.smithi039.stdout: "avgtime": 0.000000000 2024-09-12T02:49:16.621 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-09-12T02:49:16.622 INFO:teuthology.orchestra.run.smithi039.stdout: "msgr_recv_encrypted_bytes": 0, 2024-09-12T02:49:16.622 INFO:teuthology.orchestra.run.smithi039.stdout: "msgr_send_encrypted_bytes": 0 2024-09-12T02:49:16.622 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-09-12T02:49:16.622 INFO:teuthology.orchestra.run.smithi039.stdout: "AsyncMessenger::Worker-1": { 2024-09-12T02:49:16.622 INFO:teuthology.orchestra.run.smithi039.stdout: "msgr_recv_messages": 1797, 2024-09-12T02:49:16.622 INFO:teuthology.orchestra.run.smithi039.stdout: "msgr_send_messages": 1783, 2024-09-12T02:49:16.622 INFO:teuthology.orchestra.run.smithi039.stdout: "msgr_recv_bytes": 2158729, 2024-09-12T02:49:16.622 INFO:teuthology.orchestra.run.smithi039.stdout: "msgr_send_bytes": 633329, 2024-09-12T02:49:16.622 INFO:teuthology.orchestra.run.smithi039.stdout: "msgr_created_connections": 4, 2024-09-12T02:49:16.622 INFO:teuthology.orchestra.run.smithi039.stdout: "msgr_active_connections": 3, 2024-09-12T02:49:16.622 INFO:teuthology.orchestra.run.smithi039.stdout: "msgr_running_total_time": 0.203378823, 2024-09-12T02:49:16.622 INFO:teuthology.orchestra.run.smithi039.stdout: "msgr_running_send_time": 0.072887417, 2024-09-12T02:49:16.622 INFO:teuthology.orchestra.run.smithi039.stdout: "msgr_running_recv_time": 0.090190312, 2024-09-12T02:49:16.623 INFO:teuthology.orchestra.run.smithi039.stdout: "msgr_running_fast_dispatch_time": 0.046794591, 2024-09-12T02:49:16.623 INFO:teuthology.orchestra.run.smithi039.stdout: "msgr_send_messages_queue_lat": { 2024-09-12T02:49:16.623 INFO:teuthology.orchestra.run.smithi039.stdout: "avgcount": 1782, 2024-09-12T02:49:16.623 INFO:teuthology.orchestra.run.smithi039.stdout: "sum": 0.092558376, 2024-09-12T02:49:16.623 INFO:teuthology.orchestra.run.smithi039.stdout: "avgtime": 0.000051940 2024-09-12T02:49:16.623 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-09-12T02:49:16.623 INFO:teuthology.orchestra.run.smithi039.stdout: "msgr_handle_ack_lat": { 2024-09-12T02:49:16.623 INFO:teuthology.orchestra.run.smithi039.stdout: "avgcount": 0, 2024-09-12T02:49:16.623 INFO:teuthology.orchestra.run.smithi039.stdout: "sum": 0.000000000, 2024-09-12T02:49:16.623 INFO:teuthology.orchestra.run.smithi039.stdout: "avgtime": 0.000000000 2024-09-12T02:49:16.623 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-09-12T02:49:16.623 INFO:teuthology.orchestra.run.smithi039.stdout: "msgr_recv_encrypted_bytes": 1766880, 2024-09-12T02:49:16.623 INFO:teuthology.orchestra.run.smithi039.stdout: "msgr_send_encrypted_bytes": 146096 2024-09-12T02:49:16.623 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-09-12T02:49:16.624 INFO:teuthology.orchestra.run.smithi039.stdout: "AsyncMessenger::Worker-2": { 2024-09-12T02:49:16.624 INFO:teuthology.orchestra.run.smithi039.stdout: "msgr_recv_messages": 9, 2024-09-12T02:49:16.624 INFO:teuthology.orchestra.run.smithi039.stdout: "msgr_send_messages": 182, 2024-09-12T02:49:16.624 INFO:teuthology.orchestra.run.smithi039.stdout: "msgr_recv_bytes": 4740, 2024-09-12T02:49:16.624 INFO:teuthology.orchestra.run.smithi039.stdout: "msgr_send_bytes": 465429, 2024-09-12T02:49:16.624 INFO:teuthology.orchestra.run.smithi039.stdout: "msgr_created_connections": 7, 2024-09-12T02:49:16.624 INFO:teuthology.orchestra.run.smithi039.stdout: "msgr_active_connections": 5, 2024-09-12T02:49:16.624 INFO:teuthology.orchestra.run.smithi039.stdout: "msgr_running_total_time": 0.025683561, 2024-09-12T02:49:16.624 INFO:teuthology.orchestra.run.smithi039.stdout: "msgr_running_send_time": 0.014523319, 2024-09-12T02:49:16.624 INFO:teuthology.orchestra.run.smithi039.stdout: "msgr_running_recv_time": 0.007637488, 2024-09-12T02:49:16.624 INFO:teuthology.orchestra.run.smithi039.stdout: "msgr_running_fast_dispatch_time": 0.000067869, 2024-09-12T02:49:16.624 INFO:teuthology.orchestra.run.smithi039.stdout: "msgr_send_messages_queue_lat": { 2024-09-12T02:49:16.624 INFO:teuthology.orchestra.run.smithi039.stdout: "avgcount": 180, 2024-09-12T02:49:16.625 INFO:teuthology.orchestra.run.smithi039.stdout: "sum": 0.024535848, 2024-09-12T02:49:16.625 INFO:teuthology.orchestra.run.smithi039.stdout: "avgtime": 0.000136310 2024-09-12T02:49:16.625 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-09-12T02:49:16.625 INFO:teuthology.orchestra.run.smithi039.stdout: "msgr_handle_ack_lat": { 2024-09-12T02:49:16.625 INFO:teuthology.orchestra.run.smithi039.stdout: "avgcount": 0, 2024-09-12T02:49:16.625 INFO:teuthology.orchestra.run.smithi039.stdout: "sum": 0.000000000, 2024-09-12T02:49:16.625 INFO:teuthology.orchestra.run.smithi039.stdout: "avgtime": 0.000000000 2024-09-12T02:49:16.625 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-09-12T02:49:16.625 INFO:teuthology.orchestra.run.smithi039.stdout: "msgr_recv_encrypted_bytes": 3392, 2024-09-12T02:49:16.625 INFO:teuthology.orchestra.run.smithi039.stdout: "msgr_send_encrypted_bytes": 464464 2024-09-12T02:49:16.625 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-09-12T02:49:16.625 INFO:teuthology.orchestra.run.smithi039.stdout: "cct": { 2024-09-12T02:49:16.626 INFO:teuthology.orchestra.run.smithi039.stdout: "total_workers": 1, 2024-09-12T02:49:16.626 INFO:teuthology.orchestra.run.smithi039.stdout: "unhealthy_workers": 0 2024-09-12T02:49:16.626 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-09-12T02:49:16.626 INFO:teuthology.orchestra.run.smithi039.stdout: "finisher-MDSRank": { 2024-09-12T02:49:16.626 INFO:teuthology.orchestra.run.smithi039.stdout: "queue_len": 0, 2024-09-12T02:49:16.626 INFO:teuthology.orchestra.run.smithi039.stdout: "complete_latency": { 2024-09-12T02:49:16.626 INFO:teuthology.orchestra.run.smithi039.stdout: "avgcount": 3944, 2024-09-12T02:49:16.626 INFO:teuthology.orchestra.run.smithi039.stdout: "sum": 0.113435138, 2024-09-12T02:49:16.626 INFO:teuthology.orchestra.run.smithi039.stdout: "avgtime": 0.000028761 2024-09-12T02:49:16.627 INFO:teuthology.orchestra.run.smithi039.stdout: } 2024-09-12T02:49:16.627 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-09-12T02:49:16.627 INFO:teuthology.orchestra.run.smithi039.stdout: "finisher-PurgeQueue": { 2024-09-12T02:49:16.627 INFO:teuthology.orchestra.run.smithi039.stdout: "queue_len": 0, 2024-09-12T02:49:16.627 INFO:teuthology.orchestra.run.smithi039.stdout: "complete_latency": { 2024-09-12T02:49:16.627 INFO:teuthology.orchestra.run.smithi039.stdout: "avgcount": 0, 2024-09-12T02:49:16.627 INFO:teuthology.orchestra.run.smithi039.stdout: "sum": 0.000000000, 2024-09-12T02:49:16.627 INFO:teuthology.orchestra.run.smithi039.stdout: "avgtime": 0.000000000 2024-09-12T02:49:16.627 INFO:teuthology.orchestra.run.smithi039.stdout: } 2024-09-12T02:49:16.627 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-09-12T02:49:16.627 INFO:teuthology.orchestra.run.smithi039.stdout: "mds": { 2024-09-12T02:49:16.627 INFO:teuthology.orchestra.run.smithi039.stdout: "request": 0, 2024-09-12T02:49:16.627 INFO:teuthology.orchestra.run.smithi039.stdout: "reply": 0, 2024-09-12T02:49:16.627 INFO:teuthology.orchestra.run.smithi039.stdout: "reply_latency": { 2024-09-12T02:49:16.628 INFO:teuthology.orchestra.run.smithi039.stdout: "avgcount": 0, 2024-09-12T02:49:16.628 INFO:teuthology.orchestra.run.smithi039.stdout: "sum": 0.000000000, 2024-09-12T02:49:16.628 INFO:teuthology.orchestra.run.smithi039.stdout: "avgtime": 0.000000000 2024-09-12T02:49:16.628 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-09-12T02:49:16.628 INFO:teuthology.orchestra.run.smithi039.stdout: "slow_reply": 0, 2024-09-12T02:49:16.628 INFO:teuthology.orchestra.run.smithi039.stdout: "forward": 0, 2024-09-12T02:49:16.628 INFO:teuthology.orchestra.run.smithi039.stdout: "dir_fetch_complete": 0, 2024-09-12T02:49:16.628 INFO:teuthology.orchestra.run.smithi039.stdout: "dir_fetch_keys": 0, 2024-09-12T02:49:16.628 INFO:teuthology.orchestra.run.smithi039.stdout: "dir_commit": 0, 2024-09-12T02:49:16.628 INFO:teuthology.orchestra.run.smithi039.stdout: "dir_split": 0, 2024-09-12T02:49:16.628 INFO:teuthology.orchestra.run.smithi039.stdout: "dir_merge": 0, 2024-09-12T02:49:16.628 INFO:teuthology.orchestra.run.smithi039.stdout: "inodes": 0, 2024-09-12T02:49:16.628 INFO:teuthology.orchestra.run.smithi039.stdout: "inodes_top": 0, 2024-09-12T02:49:16.629 INFO:teuthology.orchestra.run.smithi039.stdout: "inodes_bottom": 0, 2024-09-12T02:49:16.629 INFO:teuthology.orchestra.run.smithi039.stdout: "inodes_pin_tail": 0, 2024-09-12T02:49:16.629 INFO:teuthology.orchestra.run.smithi039.stdout: "inodes_pinned": 0, 2024-09-12T02:49:16.629 INFO:teuthology.orchestra.run.smithi039.stdout: "inodes_expired": 0, 2024-09-12T02:49:16.629 INFO:teuthology.orchestra.run.smithi039.stdout: "inodes_with_caps": 0, 2024-09-12T02:49:16.629 INFO:teuthology.orchestra.run.smithi039.stdout: "caps": 0, 2024-09-12T02:49:16.629 INFO:teuthology.orchestra.run.smithi039.stdout: "subtrees": 1, 2024-09-12T02:49:16.629 INFO:teuthology.orchestra.run.smithi039.stdout: "traverse": 0, 2024-09-12T02:49:16.629 INFO:teuthology.orchestra.run.smithi039.stdout: "traverse_hit": 0, 2024-09-12T02:49:16.629 INFO:teuthology.orchestra.run.smithi039.stdout: "traverse_forward": 0, 2024-09-12T02:49:16.629 INFO:teuthology.orchestra.run.smithi039.stdout: "traverse_discover": 0, 2024-09-12T02:49:16.629 INFO:teuthology.orchestra.run.smithi039.stdout: "traverse_dir_fetch": 0, 2024-09-12T02:49:16.629 INFO:teuthology.orchestra.run.smithi039.stdout: "traverse_remote_ino": 0, 2024-09-12T02:49:16.629 INFO:teuthology.orchestra.run.smithi039.stdout: "traverse_lock": 0, 2024-09-12T02:49:16.630 INFO:teuthology.orchestra.run.smithi039.stdout: "load_cent": 0, 2024-09-12T02:49:16.630 INFO:teuthology.orchestra.run.smithi039.stdout: "q": 0, 2024-09-12T02:49:16.630 INFO:teuthology.orchestra.run.smithi039.stdout: "exported": 0, 2024-09-12T02:49:16.630 INFO:teuthology.orchestra.run.smithi039.stdout: "exported_inodes": 0, 2024-09-12T02:49:16.630 INFO:teuthology.orchestra.run.smithi039.stdout: "imported": 0, 2024-09-12T02:49:16.630 INFO:teuthology.orchestra.run.smithi039.stdout: "imported_inodes": 0, 2024-09-12T02:49:16.630 INFO:teuthology.orchestra.run.smithi039.stdout: "openino_dir_fetch": 0, 2024-09-12T02:49:16.630 INFO:teuthology.orchestra.run.smithi039.stdout: "openino_backtrace_fetch": 0, 2024-09-12T02:49:16.630 INFO:teuthology.orchestra.run.smithi039.stdout: "openino_peer_discover": 0, 2024-09-12T02:49:16.630 INFO:teuthology.orchestra.run.smithi039.stdout: "root_rfiles": 0, 2024-09-12T02:49:16.630 INFO:teuthology.orchestra.run.smithi039.stdout: "root_rbytes": 0, 2024-09-12T02:49:16.630 INFO:teuthology.orchestra.run.smithi039.stdout: "root_rsnaps": 0, 2024-09-12T02:49:16.630 INFO:teuthology.orchestra.run.smithi039.stdout: "scrub_backtrace_fetch": 0, 2024-09-12T02:49:16.631 INFO:teuthology.orchestra.run.smithi039.stdout: "scrub_set_tag": 0, 2024-09-12T02:49:16.631 INFO:teuthology.orchestra.run.smithi039.stdout: "scrub_backtrace_repaired": 0, 2024-09-12T02:49:16.631 INFO:teuthology.orchestra.run.smithi039.stdout: "scrub_inotable_repaired": 0, 2024-09-12T02:49:16.631 INFO:teuthology.orchestra.run.smithi039.stdout: "scrub_dir_inodes": 0, 2024-09-12T02:49:16.631 INFO:teuthology.orchestra.run.smithi039.stdout: "scrub_dir_base_inodes": 0, 2024-09-12T02:49:16.631 INFO:teuthology.orchestra.run.smithi039.stdout: "scrub_dirfrag_rstats": 0, 2024-09-12T02:49:16.631 INFO:teuthology.orchestra.run.smithi039.stdout: "scrub_file_inodes": 0, 2024-09-12T02:49:16.631 INFO:teuthology.orchestra.run.smithi039.stdout: "handle_inode_file_caps": 0, 2024-09-12T02:49:16.631 INFO:teuthology.orchestra.run.smithi039.stdout: "ceph_cap_op_revoke": 0, 2024-09-12T02:49:16.631 INFO:teuthology.orchestra.run.smithi039.stdout: "ceph_cap_op_grant": 0, 2024-09-12T02:49:16.631 INFO:teuthology.orchestra.run.smithi039.stdout: "ceph_cap_op_trunc": 0, 2024-09-12T02:49:16.631 INFO:teuthology.orchestra.run.smithi039.stdout: "ceph_cap_op_flushsnap_ack": 0, 2024-09-12T02:49:16.631 INFO:teuthology.orchestra.run.smithi039.stdout: "ceph_cap_op_flush_ack": 0, 2024-09-12T02:49:16.632 INFO:teuthology.orchestra.run.smithi039.stdout: "handle_client_caps": 0, 2024-09-12T02:49:16.632 INFO:teuthology.orchestra.run.smithi039.stdout: "handle_client_caps_dirty": 0, 2024-09-12T02:49:16.632 INFO:teuthology.orchestra.run.smithi039.stdout: "handle_client_cap_release": 0, 2024-09-12T02:49:16.632 INFO:teuthology.orchestra.run.smithi039.stdout: "process_request_cap_release": 0 2024-09-12T02:49:16.632 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-09-12T02:49:16.632 INFO:teuthology.orchestra.run.smithi039.stdout: "mds_cache": { 2024-09-12T02:49:16.632 INFO:teuthology.orchestra.run.smithi039.stdout: "dir_update": 0, 2024-09-12T02:49:16.632 INFO:teuthology.orchestra.run.smithi039.stdout: "dir_update_receipt": 0, 2024-09-12T02:49:16.632 INFO:teuthology.orchestra.run.smithi039.stdout: "dir_try_discover": 0, 2024-09-12T02:49:16.632 INFO:teuthology.orchestra.run.smithi039.stdout: "dir_send_discover": 0, 2024-09-12T02:49:16.632 INFO:teuthology.orchestra.run.smithi039.stdout: "dir_handle_discover": 0, 2024-09-12T02:49:16.632 INFO:teuthology.orchestra.run.smithi039.stdout: "num_strays": 0, 2024-09-12T02:49:16.632 INFO:teuthology.orchestra.run.smithi039.stdout: "num_strays_delayed": 0, 2024-09-12T02:49:16.632 INFO:teuthology.orchestra.run.smithi039.stdout: "num_strays_enqueuing": 0, 2024-09-12T02:49:16.633 INFO:teuthology.orchestra.run.smithi039.stdout: "strays_created": 0, 2024-09-12T02:49:16.633 INFO:teuthology.orchestra.run.smithi039.stdout: "strays_enqueued": 0, 2024-09-12T02:49:16.633 INFO:teuthology.orchestra.run.smithi039.stdout: "strays_reintegrated": 0, 2024-09-12T02:49:16.633 INFO:teuthology.orchestra.run.smithi039.stdout: "strays_migrated": 0, 2024-09-12T02:49:16.633 INFO:teuthology.orchestra.run.smithi039.stdout: "num_recovering_processing": 0, 2024-09-12T02:49:16.633 INFO:teuthology.orchestra.run.smithi039.stdout: "num_recovering_enqueued": 0, 2024-09-12T02:49:16.633 INFO:teuthology.orchestra.run.smithi039.stdout: "num_recovering_prioritized": 0, 2024-09-12T02:49:16.633 INFO:teuthology.orchestra.run.smithi039.stdout: "recovery_started": 0, 2024-09-12T02:49:16.633 INFO:teuthology.orchestra.run.smithi039.stdout: "recovery_completed": 0, 2024-09-12T02:49:16.633 INFO:teuthology.orchestra.run.smithi039.stdout: "ireq_quiesce_path": 0, 2024-09-12T02:49:16.633 INFO:teuthology.orchestra.run.smithi039.stdout: "ireq_quiesce_inode": 0, 2024-09-12T02:49:16.633 INFO:teuthology.orchestra.run.smithi039.stdout: "ireq_enqueue_scrub": 0, 2024-09-12T02:49:16.633 INFO:teuthology.orchestra.run.smithi039.stdout: "ireq_exportdir": 0, 2024-09-12T02:49:16.634 INFO:teuthology.orchestra.run.smithi039.stdout: "ireq_flush": 0, 2024-09-12T02:49:16.634 INFO:teuthology.orchestra.run.smithi039.stdout: "ireq_fragmentdir": 0, 2024-09-12T02:49:16.634 INFO:teuthology.orchestra.run.smithi039.stdout: "ireq_fragstats": 0, 2024-09-12T02:49:16.634 INFO:teuthology.orchestra.run.smithi039.stdout: "ireq_inodestats": 0 2024-09-12T02:49:16.634 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-09-12T02:49:16.634 INFO:teuthology.orchestra.run.smithi039.stdout: "mds_log": { 2024-09-12T02:49:16.634 INFO:teuthology.orchestra.run.smithi039.stdout: "evlrg": 0, 2024-09-12T02:49:16.634 INFO:teuthology.orchestra.run.smithi039.stdout: "evadd": 0, 2024-09-12T02:49:16.634 INFO:teuthology.orchestra.run.smithi039.stdout: "evex": 0, 2024-09-12T02:49:16.634 INFO:teuthology.orchestra.run.smithi039.stdout: "evtrm": 0, 2024-09-12T02:49:16.634 INFO:teuthology.orchestra.run.smithi039.stdout: "ev": 7, 2024-09-12T02:49:16.634 INFO:teuthology.orchestra.run.smithi039.stdout: "evexg": 0, 2024-09-12T02:49:16.634 INFO:teuthology.orchestra.run.smithi039.stdout: "evexd": 0, 2024-09-12T02:49:16.634 INFO:teuthology.orchestra.run.smithi039.stdout: "segadd": 0, 2024-09-12T02:49:16.635 INFO:teuthology.orchestra.run.smithi039.stdout: "segex": 0, 2024-09-12T02:49:16.635 INFO:teuthology.orchestra.run.smithi039.stdout: "segtrm": 0, 2024-09-12T02:49:16.635 INFO:teuthology.orchestra.run.smithi039.stdout: "seg": 2, 2024-09-12T02:49:16.635 INFO:teuthology.orchestra.run.smithi039.stdout: "segmjr": 2, 2024-09-12T02:49:16.635 INFO:teuthology.orchestra.run.smithi039.stdout: "segexg": 0, 2024-09-12T02:49:16.635 INFO:teuthology.orchestra.run.smithi039.stdout: "segexd": 0, 2024-09-12T02:49:16.635 INFO:teuthology.orchestra.run.smithi039.stdout: "expos": 4194304, 2024-09-12T02:49:16.635 INFO:teuthology.orchestra.run.smithi039.stdout: "wrpos": 4196353, 2024-09-12T02:49:16.635 INFO:teuthology.orchestra.run.smithi039.stdout: "rdpos": 4196212, 2024-09-12T02:49:16.635 INFO:teuthology.orchestra.run.smithi039.stdout: "jlat": { 2024-09-12T02:49:16.635 INFO:teuthology.orchestra.run.smithi039.stdout: "avgcount": 0, 2024-09-12T02:49:16.635 INFO:teuthology.orchestra.run.smithi039.stdout: "sum": 0.000000000, 2024-09-12T02:49:16.635 INFO:teuthology.orchestra.run.smithi039.stdout: "avgtime": 0.000000000 2024-09-12T02:49:16.635 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-09-12T02:49:16.636 INFO:teuthology.orchestra.run.smithi039.stdout: "replayed": 7 2024-09-12T02:49:16.636 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-09-12T02:49:16.636 INFO:teuthology.orchestra.run.smithi039.stdout: "mds_mem": { 2024-09-12T02:49:16.636 INFO:teuthology.orchestra.run.smithi039.stdout: "ino": 3, 2024-09-12T02:49:16.636 INFO:teuthology.orchestra.run.smithi039.stdout: "ino+": 3, 2024-09-12T02:49:16.636 INFO:teuthology.orchestra.run.smithi039.stdout: "ino-": 0, 2024-09-12T02:49:16.636 INFO:teuthology.orchestra.run.smithi039.stdout: "dir": 1, 2024-09-12T02:49:16.636 INFO:teuthology.orchestra.run.smithi039.stdout: "dir+": 1, 2024-09-12T02:49:16.637 INFO:teuthology.orchestra.run.smithi039.stdout: "dir-": 0, 2024-09-12T02:49:16.637 INFO:teuthology.orchestra.run.smithi039.stdout: "dn": 0, 2024-09-12T02:49:16.637 INFO:teuthology.orchestra.run.smithi039.stdout: "dn+": 0, 2024-09-12T02:49:16.637 INFO:teuthology.orchestra.run.smithi039.stdout: "dn-": 0, 2024-09-12T02:49:16.637 INFO:teuthology.orchestra.run.smithi039.stdout: "cap": 0, 2024-09-12T02:49:16.637 INFO:teuthology.orchestra.run.smithi039.stdout: "cap+": 0, 2024-09-12T02:49:16.637 INFO:teuthology.orchestra.run.smithi039.stdout: "cap-": 0, 2024-09-12T02:49:16.637 INFO:teuthology.orchestra.run.smithi039.stdout: "rss": 48072, 2024-09-12T02:49:16.637 INFO:teuthology.orchestra.run.smithi039.stdout: "heap": 215328 2024-09-12T02:49:16.637 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-09-12T02:49:16.637 INFO:teuthology.orchestra.run.smithi039.stdout: "mds_server": { 2024-09-12T02:49:16.637 INFO:teuthology.orchestra.run.smithi039.stdout: "dispatch_client_request": 0, 2024-09-12T02:49:16.637 INFO:teuthology.orchestra.run.smithi039.stdout: "dispatch_server_request": 0, 2024-09-12T02:49:16.638 INFO:teuthology.orchestra.run.smithi039.stdout: "handle_client_request": 0, 2024-09-12T02:49:16.638 INFO:teuthology.orchestra.run.smithi039.stdout: "handle_client_session": 0, 2024-09-12T02:49:16.638 INFO:teuthology.orchestra.run.smithi039.stdout: "handle_peer_request": 0, 2024-09-12T02:49:16.638 INFO:teuthology.orchestra.run.smithi039.stdout: "req_create_latency": { 2024-09-12T02:49:16.638 INFO:teuthology.orchestra.run.smithi039.stdout: "avgcount": 0, 2024-09-12T02:49:16.638 INFO:teuthology.orchestra.run.smithi039.stdout: "sum": 0.000000000, 2024-09-12T02:49:16.638 INFO:teuthology.orchestra.run.smithi039.stdout: "avgtime": 0.000000000 2024-09-12T02:49:16.638 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-09-12T02:49:16.638 INFO:teuthology.orchestra.run.smithi039.stdout: "req_getattr_latency": { 2024-09-12T02:49:16.638 INFO:teuthology.orchestra.run.smithi039.stdout: "avgcount": 0, 2024-09-12T02:49:16.638 INFO:teuthology.orchestra.run.smithi039.stdout: "sum": 0.000000000, 2024-09-12T02:49:16.638 INFO:teuthology.orchestra.run.smithi039.stdout: "avgtime": 0.000000000 2024-09-12T02:49:16.638 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-09-12T02:49:16.639 INFO:teuthology.orchestra.run.smithi039.stdout: "req_getfilelock_latency": { 2024-09-12T02:49:16.639 INFO:teuthology.orchestra.run.smithi039.stdout: "avgcount": 0, 2024-09-12T02:49:16.639 INFO:teuthology.orchestra.run.smithi039.stdout: "sum": 0.000000000, 2024-09-12T02:49:16.639 INFO:teuthology.orchestra.run.smithi039.stdout: "avgtime": 0.000000000 2024-09-12T02:49:16.639 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-09-12T02:49:16.639 INFO:teuthology.orchestra.run.smithi039.stdout: "req_link_latency": { 2024-09-12T02:49:16.639 INFO:teuthology.orchestra.run.smithi039.stdout: "avgcount": 0, 2024-09-12T02:49:16.639 INFO:teuthology.orchestra.run.smithi039.stdout: "sum": 0.000000000, 2024-09-12T02:49:16.639 INFO:teuthology.orchestra.run.smithi039.stdout: "avgtime": 0.000000000 2024-09-12T02:49:16.639 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-09-12T02:49:16.639 INFO:teuthology.orchestra.run.smithi039.stdout: "req_lookup_latency": { 2024-09-12T02:49:16.639 INFO:teuthology.orchestra.run.smithi039.stdout: "avgcount": 0, 2024-09-12T02:49:16.639 INFO:teuthology.orchestra.run.smithi039.stdout: "sum": 0.000000000, 2024-09-12T02:49:16.639 INFO:teuthology.orchestra.run.smithi039.stdout: "avgtime": 0.000000000 2024-09-12T02:49:16.640 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-09-12T02:49:16.640 INFO:teuthology.orchestra.run.smithi039.stdout: "req_lookuphash_latency": { 2024-09-12T02:49:16.640 INFO:teuthology.orchestra.run.smithi039.stdout: "avgcount": 0, 2024-09-12T02:49:16.640 INFO:teuthology.orchestra.run.smithi039.stdout: "sum": 0.000000000, 2024-09-12T02:49:16.640 INFO:teuthology.orchestra.run.smithi039.stdout: "avgtime": 0.000000000 2024-09-12T02:49:16.640 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-09-12T02:49:16.640 INFO:teuthology.orchestra.run.smithi039.stdout: "req_lookupino_latency": { 2024-09-12T02:49:16.640 INFO:teuthology.orchestra.run.smithi039.stdout: "avgcount": 0, 2024-09-12T02:49:16.640 INFO:teuthology.orchestra.run.smithi039.stdout: "sum": 0.000000000, 2024-09-12T02:49:16.640 INFO:teuthology.orchestra.run.smithi039.stdout: "avgtime": 0.000000000 2024-09-12T02:49:16.640 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-09-12T02:49:16.640 INFO:teuthology.orchestra.run.smithi039.stdout: "req_lookupname_latency": { 2024-09-12T02:49:16.640 INFO:teuthology.orchestra.run.smithi039.stdout: "avgcount": 0, 2024-09-12T02:49:16.641 INFO:teuthology.orchestra.run.smithi039.stdout: "sum": 0.000000000, 2024-09-12T02:49:16.641 INFO:teuthology.orchestra.run.smithi039.stdout: "avgtime": 0.000000000 2024-09-12T02:49:16.641 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-09-12T02:49:16.641 INFO:teuthology.orchestra.run.smithi039.stdout: "req_lookupparent_latency": { 2024-09-12T02:49:16.641 INFO:teuthology.orchestra.run.smithi039.stdout: "avgcount": 0, 2024-09-12T02:49:16.641 INFO:teuthology.orchestra.run.smithi039.stdout: "sum": 0.000000000, 2024-09-12T02:49:16.641 INFO:teuthology.orchestra.run.smithi039.stdout: "avgtime": 0.000000000 2024-09-12T02:49:16.641 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-09-12T02:49:16.641 INFO:teuthology.orchestra.run.smithi039.stdout: "req_lookupsnap_latency": { 2024-09-12T02:49:16.641 INFO:teuthology.orchestra.run.smithi039.stdout: "avgcount": 0, 2024-09-12T02:49:16.641 INFO:teuthology.orchestra.run.smithi039.stdout: "sum": 0.000000000, 2024-09-12T02:49:16.641 INFO:teuthology.orchestra.run.smithi039.stdout: "avgtime": 0.000000000 2024-09-12T02:49:16.641 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-09-12T02:49:16.642 INFO:teuthology.orchestra.run.smithi039.stdout: "req_lssnap_latency": { 2024-09-12T02:49:16.642 INFO:teuthology.orchestra.run.smithi039.stdout: "avgcount": 0, 2024-09-12T02:49:16.642 INFO:teuthology.orchestra.run.smithi039.stdout: "sum": 0.000000000, 2024-09-12T02:49:16.642 INFO:teuthology.orchestra.run.smithi039.stdout: "avgtime": 0.000000000 2024-09-12T02:49:16.642 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-09-12T02:49:16.642 INFO:teuthology.orchestra.run.smithi039.stdout: "req_mkdir_latency": { 2024-09-12T02:49:16.642 INFO:teuthology.orchestra.run.smithi039.stdout: "avgcount": 0, 2024-09-12T02:49:16.643 INFO:teuthology.orchestra.run.smithi039.stdout: "sum": 0.000000000, 2024-09-12T02:49:16.643 INFO:teuthology.orchestra.run.smithi039.stdout: "avgtime": 0.000000000 2024-09-12T02:49:16.643 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-09-12T02:49:16.643 INFO:teuthology.orchestra.run.smithi039.stdout: "req_mknod_latency": { 2024-09-12T02:49:16.643 INFO:teuthology.orchestra.run.smithi039.stdout: "avgcount": 0, 2024-09-12T02:49:16.643 INFO:teuthology.orchestra.run.smithi039.stdout: "sum": 0.000000000, 2024-09-12T02:49:16.643 INFO:teuthology.orchestra.run.smithi039.stdout: "avgtime": 0.000000000 2024-09-12T02:49:16.643 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-09-12T02:49:16.643 INFO:teuthology.orchestra.run.smithi039.stdout: "req_mksnap_latency": { 2024-09-12T02:49:16.643 INFO:teuthology.orchestra.run.smithi039.stdout: "avgcount": 0, 2024-09-12T02:49:16.643 INFO:teuthology.orchestra.run.smithi039.stdout: "sum": 0.000000000, 2024-09-12T02:49:16.644 INFO:teuthology.orchestra.run.smithi039.stdout: "avgtime": 0.000000000 2024-09-12T02:49:16.644 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-09-12T02:49:16.644 INFO:teuthology.orchestra.run.smithi039.stdout: "req_open_latency": { 2024-09-12T02:49:16.644 INFO:teuthology.orchestra.run.smithi039.stdout: "avgcount": 0, 2024-09-12T02:49:16.644 INFO:teuthology.orchestra.run.smithi039.stdout: "sum": 0.000000000, 2024-09-12T02:49:16.644 INFO:teuthology.orchestra.run.smithi039.stdout: "avgtime": 0.000000000 2024-09-12T02:49:16.644 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-09-12T02:49:16.644 INFO:teuthology.orchestra.run.smithi039.stdout: "req_readdir_latency": { 2024-09-12T02:49:16.644 INFO:teuthology.orchestra.run.smithi039.stdout: "avgcount": 0, 2024-09-12T02:49:16.644 INFO:teuthology.orchestra.run.smithi039.stdout: "sum": 0.000000000, 2024-09-12T02:49:16.644 INFO:teuthology.orchestra.run.smithi039.stdout: "avgtime": 0.000000000 2024-09-12T02:49:16.644 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-09-12T02:49:16.645 INFO:teuthology.orchestra.run.smithi039.stdout: "req_rename_latency": { 2024-09-12T02:49:16.645 INFO:teuthology.orchestra.run.smithi039.stdout: "avgcount": 0, 2024-09-12T02:49:16.645 INFO:teuthology.orchestra.run.smithi039.stdout: "sum": 0.000000000, 2024-09-12T02:49:16.645 INFO:teuthology.orchestra.run.smithi039.stdout: "avgtime": 0.000000000 2024-09-12T02:49:16.645 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-09-12T02:49:16.645 INFO:teuthology.orchestra.run.smithi039.stdout: "req_renamesnap_latency": { 2024-09-12T02:49:16.645 INFO:teuthology.orchestra.run.smithi039.stdout: "avgcount": 0, 2024-09-12T02:49:16.645 INFO:teuthology.orchestra.run.smithi039.stdout: "sum": 0.000000000, 2024-09-12T02:49:16.645 INFO:teuthology.orchestra.run.smithi039.stdout: "avgtime": 0.000000000 2024-09-12T02:49:16.645 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-09-12T02:49:16.645 INFO:teuthology.orchestra.run.smithi039.stdout: "req_snapdiff_latency": { 2024-09-12T02:49:16.645 INFO:teuthology.orchestra.run.smithi039.stdout: "avgcount": 0, 2024-09-12T02:49:16.645 INFO:teuthology.orchestra.run.smithi039.stdout: "sum": 0.000000000, 2024-09-12T02:49:16.646 INFO:teuthology.orchestra.run.smithi039.stdout: "avgtime": 0.000000000 2024-09-12T02:49:16.646 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-09-12T02:49:16.646 INFO:teuthology.orchestra.run.smithi039.stdout: "req_rmdir_latency": { 2024-09-12T02:49:16.646 INFO:teuthology.orchestra.run.smithi039.stdout: "avgcount": 0, 2024-09-12T02:49:16.646 INFO:teuthology.orchestra.run.smithi039.stdout: "sum": 0.000000000, 2024-09-12T02:49:16.646 INFO:teuthology.orchestra.run.smithi039.stdout: "avgtime": 0.000000000 2024-09-12T02:49:16.646 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-09-12T02:49:16.646 INFO:teuthology.orchestra.run.smithi039.stdout: "req_rmsnap_latency": { 2024-09-12T02:49:16.646 INFO:teuthology.orchestra.run.smithi039.stdout: "avgcount": 0, 2024-09-12T02:49:16.647 INFO:teuthology.orchestra.run.smithi039.stdout: "sum": 0.000000000, 2024-09-12T02:49:16.647 INFO:teuthology.orchestra.run.smithi039.stdout: "avgtime": 0.000000000 2024-09-12T02:49:16.647 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-09-12T02:49:16.647 INFO:teuthology.orchestra.run.smithi039.stdout: "req_rmxattr_latency": { 2024-09-12T02:49:16.647 INFO:teuthology.orchestra.run.smithi039.stdout: "avgcount": 0, 2024-09-12T02:49:16.647 INFO:teuthology.orchestra.run.smithi039.stdout: "sum": 0.000000000, 2024-09-12T02:49:16.647 INFO:teuthology.orchestra.run.smithi039.stdout: "avgtime": 0.000000000 2024-09-12T02:49:16.647 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-09-12T02:49:16.647 INFO:teuthology.orchestra.run.smithi039.stdout: "req_setattr_latency": { 2024-09-12T02:49:16.647 INFO:teuthology.orchestra.run.smithi039.stdout: "avgcount": 0, 2024-09-12T02:49:16.647 INFO:teuthology.orchestra.run.smithi039.stdout: "sum": 0.000000000, 2024-09-12T02:49:16.647 INFO:teuthology.orchestra.run.smithi039.stdout: "avgtime": 0.000000000 2024-09-12T02:49:16.647 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-09-12T02:49:16.648 INFO:teuthology.orchestra.run.smithi039.stdout: "req_setdirlayout_latency": { 2024-09-12T02:49:16.648 INFO:teuthology.orchestra.run.smithi039.stdout: "avgcount": 0, 2024-09-12T02:49:16.648 INFO:teuthology.orchestra.run.smithi039.stdout: "sum": 0.000000000, 2024-09-12T02:49:16.648 INFO:teuthology.orchestra.run.smithi039.stdout: "avgtime": 0.000000000 2024-09-12T02:49:16.648 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-09-12T02:49:16.648 INFO:teuthology.orchestra.run.smithi039.stdout: "req_setfilelock_latency": { 2024-09-12T02:49:16.648 INFO:teuthology.orchestra.run.smithi039.stdout: "avgcount": 0, 2024-09-12T02:49:16.648 INFO:teuthology.orchestra.run.smithi039.stdout: "sum": 0.000000000, 2024-09-12T02:49:16.648 INFO:teuthology.orchestra.run.smithi039.stdout: "avgtime": 0.000000000 2024-09-12T02:49:16.648 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-09-12T02:49:16.648 INFO:teuthology.orchestra.run.smithi039.stdout: "req_setlayout_latency": { 2024-09-12T02:49:16.648 INFO:teuthology.orchestra.run.smithi039.stdout: "avgcount": 0, 2024-09-12T02:49:16.648 INFO:teuthology.orchestra.run.smithi039.stdout: "sum": 0.000000000, 2024-09-12T02:49:16.649 INFO:teuthology.orchestra.run.smithi039.stdout: "avgtime": 0.000000000 2024-09-12T02:49:16.649 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-09-12T02:49:16.649 INFO:teuthology.orchestra.run.smithi039.stdout: "req_setxattr_latency": { 2024-09-12T02:49:16.649 INFO:teuthology.orchestra.run.smithi039.stdout: "avgcount": 0, 2024-09-12T02:49:16.649 INFO:teuthology.orchestra.run.smithi039.stdout: "sum": 0.000000000, 2024-09-12T02:49:16.649 INFO:teuthology.orchestra.run.smithi039.stdout: "avgtime": 0.000000000 2024-09-12T02:49:16.649 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-09-12T02:49:16.649 INFO:teuthology.orchestra.run.smithi039.stdout: "req_symlink_latency": { 2024-09-12T02:49:16.649 INFO:teuthology.orchestra.run.smithi039.stdout: "avgcount": 0, 2024-09-12T02:49:16.649 INFO:teuthology.orchestra.run.smithi039.stdout: "sum": 0.000000000, 2024-09-12T02:49:16.649 INFO:teuthology.orchestra.run.smithi039.stdout: "avgtime": 0.000000000 2024-09-12T02:49:16.649 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-09-12T02:49:16.649 INFO:teuthology.orchestra.run.smithi039.stdout: "req_unlink_latency": { 2024-09-12T02:49:16.650 INFO:teuthology.orchestra.run.smithi039.stdout: "avgcount": 0, 2024-09-12T02:49:16.650 INFO:teuthology.orchestra.run.smithi039.stdout: "sum": 0.000000000, 2024-09-12T02:49:16.650 INFO:teuthology.orchestra.run.smithi039.stdout: "avgtime": 0.000000000 2024-09-12T02:49:16.650 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-09-12T02:49:16.650 INFO:teuthology.orchestra.run.smithi039.stdout: "cap_revoke_eviction": 0, 2024-09-12T02:49:16.650 INFO:teuthology.orchestra.run.smithi039.stdout: "cap_acquisition_throttle": 0, 2024-09-12T02:49:16.650 INFO:teuthology.orchestra.run.smithi039.stdout: "req_getvxattr_latency": { 2024-09-12T02:49:16.650 INFO:teuthology.orchestra.run.smithi039.stdout: "avgcount": 0, 2024-09-12T02:49:16.650 INFO:teuthology.orchestra.run.smithi039.stdout: "sum": 0.000000000, 2024-09-12T02:49:16.650 INFO:teuthology.orchestra.run.smithi039.stdout: "avgtime": 0.000000000 2024-09-12T02:49:16.651 INFO:teuthology.orchestra.run.smithi039.stdout: } 2024-09-12T02:49:16.651 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-09-12T02:49:16.651 INFO:teuthology.orchestra.run.smithi039.stdout: "mds_sessions": { 2024-09-12T02:49:16.651 INFO:teuthology.orchestra.run.smithi039.stdout: "session_count": 1, 2024-09-12T02:49:16.651 INFO:teuthology.orchestra.run.smithi039.stdout: "session_add": 3, 2024-09-12T02:49:16.651 INFO:teuthology.orchestra.run.smithi039.stdout: "session_remove": 2, 2024-09-12T02:49:16.651 INFO:teuthology.orchestra.run.smithi039.stdout: "sessions_open": 2, 2024-09-12T02:49:16.651 INFO:teuthology.orchestra.run.smithi039.stdout: "sessions_stale": 0, 2024-09-12T02:49:16.651 INFO:teuthology.orchestra.run.smithi039.stdout: "total_load": 0, 2024-09-12T02:49:16.651 INFO:teuthology.orchestra.run.smithi039.stdout: "average_load": 0, 2024-09-12T02:49:16.651 INFO:teuthology.orchestra.run.smithi039.stdout: "avg_session_uptime": 3101, 2024-09-12T02:49:16.651 INFO:teuthology.orchestra.run.smithi039.stdout: "mdthresh_evicted": 0 2024-09-12T02:49:16.651 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-09-12T02:49:16.652 INFO:teuthology.orchestra.run.smithi039.stdout: "mempool": { 2024-09-12T02:49:16.652 INFO:teuthology.orchestra.run.smithi039.stdout: "bloom_filter_bytes": 0, 2024-09-12T02:49:16.652 INFO:teuthology.orchestra.run.smithi039.stdout: "bloom_filter_items": 0, 2024-09-12T02:49:16.652 INFO:teuthology.orchestra.run.smithi039.stdout: "bluestore_alloc_bytes": 0, 2024-09-12T02:49:16.652 INFO:teuthology.orchestra.run.smithi039.stdout: "bluestore_alloc_items": 0, 2024-09-12T02:49:16.652 INFO:teuthology.orchestra.run.smithi039.stdout: "bluestore_cache_data_bytes": 0, 2024-09-12T02:49:16.652 INFO:teuthology.orchestra.run.smithi039.stdout: "bluestore_cache_data_items": 0, 2024-09-12T02:49:16.652 INFO:teuthology.orchestra.run.smithi039.stdout: "bluestore_cache_onode_bytes": 0, 2024-09-12T02:49:16.652 INFO:teuthology.orchestra.run.smithi039.stdout: "bluestore_cache_onode_items": 0, 2024-09-12T02:49:16.652 INFO:teuthology.orchestra.run.smithi039.stdout: "bluestore_cache_meta_bytes": 0, 2024-09-12T02:49:16.652 INFO:teuthology.orchestra.run.smithi039.stdout: "bluestore_cache_meta_items": 0, 2024-09-12T02:49:16.652 INFO:teuthology.orchestra.run.smithi039.stdout: "bluestore_cache_other_bytes": 0, 2024-09-12T02:49:16.652 INFO:teuthology.orchestra.run.smithi039.stdout: "bluestore_cache_other_items": 0, 2024-09-12T02:49:16.652 INFO:teuthology.orchestra.run.smithi039.stdout: "bluestore_cache_buffer_bytes": 0, 2024-09-12T02:49:16.653 INFO:teuthology.orchestra.run.smithi039.stdout: "bluestore_cache_buffer_items": 0, 2024-09-12T02:49:16.653 INFO:teuthology.orchestra.run.smithi039.stdout: "bluestore_extent_bytes": 0, 2024-09-12T02:49:16.653 INFO:teuthology.orchestra.run.smithi039.stdout: "bluestore_extent_items": 0, 2024-09-12T02:49:16.653 INFO:teuthology.orchestra.run.smithi039.stdout: "bluestore_blob_bytes": 0, 2024-09-12T02:49:16.653 INFO:teuthology.orchestra.run.smithi039.stdout: "bluestore_blob_items": 0, 2024-09-12T02:49:16.653 INFO:teuthology.orchestra.run.smithi039.stdout: "bluestore_shared_blob_bytes": 0, 2024-09-12T02:49:16.653 INFO:teuthology.orchestra.run.smithi039.stdout: "bluestore_shared_blob_items": 0, 2024-09-12T02:49:16.653 INFO:teuthology.orchestra.run.smithi039.stdout: "bluestore_inline_bl_bytes": 0, 2024-09-12T02:49:16.653 INFO:teuthology.orchestra.run.smithi039.stdout: "bluestore_inline_bl_items": 0, 2024-09-12T02:49:16.653 INFO:teuthology.orchestra.run.smithi039.stdout: "bluestore_fsck_bytes": 0, 2024-09-12T02:49:16.653 INFO:teuthology.orchestra.run.smithi039.stdout: "bluestore_fsck_items": 0, 2024-09-12T02:49:16.653 INFO:teuthology.orchestra.run.smithi039.stdout: "bluestore_txc_bytes": 0, 2024-09-12T02:49:16.653 INFO:teuthology.orchestra.run.smithi039.stdout: "bluestore_txc_items": 0, 2024-09-12T02:49:16.653 INFO:teuthology.orchestra.run.smithi039.stdout: "bluestore_writing_deferred_bytes": 0, 2024-09-12T02:49:16.654 INFO:teuthology.orchestra.run.smithi039.stdout: "bluestore_writing_deferred_items": 0, 2024-09-12T02:49:16.654 INFO:teuthology.orchestra.run.smithi039.stdout: "bluestore_writing_bytes": 0, 2024-09-12T02:49:16.654 INFO:teuthology.orchestra.run.smithi039.stdout: "bluestore_writing_items": 0, 2024-09-12T02:49:16.654 INFO:teuthology.orchestra.run.smithi039.stdout: "bluefs_bytes": 0, 2024-09-12T02:49:16.654 INFO:teuthology.orchestra.run.smithi039.stdout: "bluefs_items": 0, 2024-09-12T02:49:16.654 INFO:teuthology.orchestra.run.smithi039.stdout: "bluefs_file_reader_bytes": 0, 2024-09-12T02:49:16.654 INFO:teuthology.orchestra.run.smithi039.stdout: "bluefs_file_reader_items": 0, 2024-09-12T02:49:16.654 INFO:teuthology.orchestra.run.smithi039.stdout: "bluefs_file_writer_bytes": 0, 2024-09-12T02:49:16.654 INFO:teuthology.orchestra.run.smithi039.stdout: "bluefs_file_writer_items": 0, 2024-09-12T02:49:16.654 INFO:teuthology.orchestra.run.smithi039.stdout: "buffer_anon_bytes": 199272, 2024-09-12T02:49:16.654 INFO:teuthology.orchestra.run.smithi039.stdout: "buffer_anon_items": 57, 2024-09-12T02:49:16.654 INFO:teuthology.orchestra.run.smithi039.stdout: "buffer_meta_bytes": 0, 2024-09-12T02:49:16.654 INFO:teuthology.orchestra.run.smithi039.stdout: "buffer_meta_items": 0, 2024-09-12T02:49:16.654 INFO:teuthology.orchestra.run.smithi039.stdout: "osd_bytes": 0, 2024-09-12T02:49:16.655 INFO:teuthology.orchestra.run.smithi039.stdout: "osd_items": 0, 2024-09-12T02:49:16.655 INFO:teuthology.orchestra.run.smithi039.stdout: "osd_mapbl_bytes": 0, 2024-09-12T02:49:16.655 INFO:teuthology.orchestra.run.smithi039.stdout: "osd_mapbl_items": 0, 2024-09-12T02:49:16.655 INFO:teuthology.orchestra.run.smithi039.stdout: "osd_pglog_bytes": 0, 2024-09-12T02:49:16.655 INFO:teuthology.orchestra.run.smithi039.stdout: "osd_pglog_items": 0, 2024-09-12T02:49:16.655 INFO:teuthology.orchestra.run.smithi039.stdout: "osdmap_bytes": 9520, 2024-09-12T02:49:16.655 INFO:teuthology.orchestra.run.smithi039.stdout: "osdmap_items": 193, 2024-09-12T02:49:16.655 INFO:teuthology.orchestra.run.smithi039.stdout: "osdmap_mapping_bytes": 0, 2024-09-12T02:49:16.655 INFO:teuthology.orchestra.run.smithi039.stdout: "osdmap_mapping_items": 0, 2024-09-12T02:49:16.655 INFO:teuthology.orchestra.run.smithi039.stdout: "pgmap_bytes": 0, 2024-09-12T02:49:16.655 INFO:teuthology.orchestra.run.smithi039.stdout: "pgmap_items": 0, 2024-09-12T02:49:16.656 INFO:teuthology.orchestra.run.smithi039.stdout: "mds_co_bytes": 8512, 2024-09-12T02:49:16.656 INFO:teuthology.orchestra.run.smithi039.stdout: "mds_co_items": 13, 2024-09-12T02:49:16.656 INFO:teuthology.orchestra.run.smithi039.stdout: "unittest_1_bytes": 0, 2024-09-12T02:49:16.656 INFO:teuthology.orchestra.run.smithi039.stdout: "unittest_1_items": 0, 2024-09-12T02:49:16.656 INFO:teuthology.orchestra.run.smithi039.stdout: "unittest_2_bytes": 0, 2024-09-12T02:49:16.656 INFO:teuthology.orchestra.run.smithi039.stdout: "unittest_2_items": 0 2024-09-12T02:49:16.656 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-09-12T02:49:16.656 INFO:teuthology.orchestra.run.smithi039.stdout: "objecter": { 2024-09-12T02:49:16.656 INFO:teuthology.orchestra.run.smithi039.stdout: "op_active": 0, 2024-09-12T02:49:16.656 INFO:teuthology.orchestra.run.smithi039.stdout: "op_laggy": 0, 2024-09-12T02:49:16.656 INFO:teuthology.orchestra.run.smithi039.stdout: "op_send": 2340, 2024-09-12T02:49:16.656 INFO:teuthology.orchestra.run.smithi039.stdout: "op_send_bytes": 21, 2024-09-12T02:49:16.656 INFO:teuthology.orchestra.run.smithi039.stdout: "op_resend": 3, 2024-09-12T02:49:16.656 INFO:teuthology.orchestra.run.smithi039.stdout: "op_reply": 2340, 2024-09-12T02:49:16.657 INFO:teuthology.orchestra.run.smithi039.stdout: "op_latency": { 2024-09-12T02:49:16.657 INFO:teuthology.orchestra.run.smithi039.stdout: "avgcount": 2340, 2024-09-12T02:49:16.657 INFO:teuthology.orchestra.run.smithi039.stdout: "sum": 1.205976219, 2024-09-12T02:49:16.657 INFO:teuthology.orchestra.run.smithi039.stdout: "avgtime": 0.000515374 2024-09-12T02:49:16.657 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-09-12T02:49:16.657 INFO:teuthology.orchestra.run.smithi039.stdout: "op_inflight": 0, 2024-09-12T02:49:16.657 INFO:teuthology.orchestra.run.smithi039.stdout: "oplen_avg": { 2024-09-12T02:49:16.658 INFO:teuthology.orchestra.run.smithi039.stdout: "avgcount": 2340, 2024-09-12T02:49:16.658 INFO:teuthology.orchestra.run.smithi039.stdout: "sum": 2341 2024-09-12T02:49:16.658 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-09-12T02:49:16.658 INFO:teuthology.orchestra.run.smithi039.stdout: "op": 2340, 2024-09-12T02:49:16.658 INFO:teuthology.orchestra.run.smithi039.stdout: "op_r": 2340, 2024-09-12T02:49:16.658 INFO:teuthology.orchestra.run.smithi039.stdout: "op_w": 0, 2024-09-12T02:49:16.658 INFO:teuthology.orchestra.run.smithi039.stdout: "op_rmw": 0, 2024-09-12T02:49:16.658 INFO:teuthology.orchestra.run.smithi039.stdout: "op_pg": 0, 2024-09-12T02:49:16.658 INFO:teuthology.orchestra.run.smithi039.stdout: "osdop_stat": 1525, 2024-09-12T02:49:16.658 INFO:teuthology.orchestra.run.smithi039.stdout: "osdop_create": 0, 2024-09-12T02:49:16.658 INFO:teuthology.orchestra.run.smithi039.stdout: "osdop_read": 813, 2024-09-12T02:49:16.658 INFO:teuthology.orchestra.run.smithi039.stdout: "osdop_write": 0, 2024-09-12T02:49:16.658 INFO:teuthology.orchestra.run.smithi039.stdout: "osdop_writefull": 0, 2024-09-12T02:49:16.658 INFO:teuthology.orchestra.run.smithi039.stdout: "osdop_writesame": 0, 2024-09-12T02:49:16.659 INFO:teuthology.orchestra.run.smithi039.stdout: "osdop_append": 0, 2024-09-12T02:49:16.659 INFO:teuthology.orchestra.run.smithi039.stdout: "osdop_zero": 0, 2024-09-12T02:49:16.659 INFO:teuthology.orchestra.run.smithi039.stdout: "osdop_truncate": 0, 2024-09-12T02:49:16.659 INFO:teuthology.orchestra.run.smithi039.stdout: "osdop_delete": 0, 2024-09-12T02:49:16.659 INFO:teuthology.orchestra.run.smithi039.stdout: "osdop_mapext": 0, 2024-09-12T02:49:16.659 INFO:teuthology.orchestra.run.smithi039.stdout: "osdop_sparse_read": 0, 2024-09-12T02:49:16.659 INFO:teuthology.orchestra.run.smithi039.stdout: "osdop_clonerange": 0, 2024-09-12T02:49:16.659 INFO:teuthology.orchestra.run.smithi039.stdout: "osdop_getxattr": 1, 2024-09-12T02:49:16.659 INFO:teuthology.orchestra.run.smithi039.stdout: "osdop_setxattr": 0, 2024-09-12T02:49:16.659 INFO:teuthology.orchestra.run.smithi039.stdout: "osdop_cmpxattr": 0, 2024-09-12T02:49:16.659 INFO:teuthology.orchestra.run.smithi039.stdout: "osdop_rmxattr": 0, 2024-09-12T02:49:16.659 INFO:teuthology.orchestra.run.smithi039.stdout: "osdop_resetxattrs": 0, 2024-09-12T02:49:16.659 INFO:teuthology.orchestra.run.smithi039.stdout: "osdop_call": 0, 2024-09-12T02:49:16.659 INFO:teuthology.orchestra.run.smithi039.stdout: "osdop_watch": 0, 2024-09-12T02:49:16.660 INFO:teuthology.orchestra.run.smithi039.stdout: "osdop_notify": 0, 2024-09-12T02:49:16.660 INFO:teuthology.orchestra.run.smithi039.stdout: "osdop_src_cmpxattr": 0, 2024-09-12T02:49:16.660 INFO:teuthology.orchestra.run.smithi039.stdout: "osdop_pgls": 0, 2024-09-12T02:49:16.660 INFO:teuthology.orchestra.run.smithi039.stdout: "osdop_pgls_filter": 0, 2024-09-12T02:49:16.660 INFO:teuthology.orchestra.run.smithi039.stdout: "osdop_other": 0, 2024-09-12T02:49:16.660 INFO:teuthology.orchestra.run.smithi039.stdout: "linger_active": 0, 2024-09-12T02:49:16.660 INFO:teuthology.orchestra.run.smithi039.stdout: "linger_send": 0, 2024-09-12T02:49:16.660 INFO:teuthology.orchestra.run.smithi039.stdout: "linger_resend": 0, 2024-09-12T02:49:16.660 INFO:teuthology.orchestra.run.smithi039.stdout: "linger_ping": 0, 2024-09-12T02:49:16.660 INFO:teuthology.orchestra.run.smithi039.stdout: "poolop_active": 0, 2024-09-12T02:49:16.660 INFO:teuthology.orchestra.run.smithi039.stdout: "poolop_send": 0, 2024-09-12T02:49:16.661 INFO:teuthology.orchestra.run.smithi039.stdout: "poolop_resend": 0, 2024-09-12T02:49:16.661 INFO:teuthology.orchestra.run.smithi039.stdout: "poolstat_active": 0, 2024-09-12T02:49:16.661 INFO:teuthology.orchestra.run.smithi039.stdout: "poolstat_send": 0, 2024-09-12T02:49:16.661 INFO:teuthology.orchestra.run.smithi039.stdout: "poolstat_resend": 0, 2024-09-12T02:49:16.661 INFO:teuthology.orchestra.run.smithi039.stdout: "statfs_active": 0, 2024-09-12T02:49:16.661 INFO:teuthology.orchestra.run.smithi039.stdout: "statfs_send": 0, 2024-09-12T02:49:16.661 INFO:teuthology.orchestra.run.smithi039.stdout: "statfs_resend": 0, 2024-09-12T02:49:16.661 INFO:teuthology.orchestra.run.smithi039.stdout: "command_active": 0, 2024-09-12T02:49:16.661 INFO:teuthology.orchestra.run.smithi039.stdout: "command_send": 0, 2024-09-12T02:49:16.661 INFO:teuthology.orchestra.run.smithi039.stdout: "command_resend": 0, 2024-09-12T02:49:16.661 INFO:teuthology.orchestra.run.smithi039.stdout: "map_epoch": 108, 2024-09-12T02:49:16.661 INFO:teuthology.orchestra.run.smithi039.stdout: "map_full": 0, 2024-09-12T02:49:16.661 INFO:teuthology.orchestra.run.smithi039.stdout: "map_inc": 15, 2024-09-12T02:49:16.662 INFO:teuthology.orchestra.run.smithi039.stdout: "osd_sessions": 6, 2024-09-12T02:49:16.662 INFO:teuthology.orchestra.run.smithi039.stdout: "osd_session_open": 6, 2024-09-12T02:49:16.662 INFO:teuthology.orchestra.run.smithi039.stdout: "osd_session_close": 0, 2024-09-12T02:49:16.662 INFO:teuthology.orchestra.run.smithi039.stdout: "osd_laggy": 0, 2024-09-12T02:49:16.662 INFO:teuthology.orchestra.run.smithi039.stdout: "omap_wr": 0, 2024-09-12T02:49:16.662 INFO:teuthology.orchestra.run.smithi039.stdout: "omap_rd": 2, 2024-09-12T02:49:16.662 INFO:teuthology.orchestra.run.smithi039.stdout: "omap_del": 0 2024-09-12T02:49:16.662 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-09-12T02:49:16.662 INFO:teuthology.orchestra.run.smithi039.stdout: "oft": { 2024-09-12T02:49:16.662 INFO:teuthology.orchestra.run.smithi039.stdout: "omap_total_objs": 0, 2024-09-12T02:49:16.662 INFO:teuthology.orchestra.run.smithi039.stdout: "omap_total_kv_pairs": 0, 2024-09-12T02:49:16.662 INFO:teuthology.orchestra.run.smithi039.stdout: "omap_total_updates": 0, 2024-09-12T02:49:16.662 INFO:teuthology.orchestra.run.smithi039.stdout: "omap_total_removes": 0 2024-09-12T02:49:16.662 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-09-12T02:49:16.662 INFO:teuthology.orchestra.run.smithi039.stdout: "osd-slow-ops": { 2024-09-12T02:49:16.663 INFO:teuthology.orchestra.run.smithi039.stdout: "slow_ops_count": 0 2024-09-12T02:49:16.663 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-09-12T02:49:16.663 INFO:teuthology.orchestra.run.smithi039.stdout: "purge_queue": { 2024-09-12T02:49:16.663 INFO:teuthology.orchestra.run.smithi039.stdout: "pq_executing_ops": 0, 2024-09-12T02:49:16.663 INFO:teuthology.orchestra.run.smithi039.stdout: "pq_executing_ops_high_water": 0, 2024-09-12T02:49:16.663 INFO:teuthology.orchestra.run.smithi039.stdout: "pq_executing": 0, 2024-09-12T02:49:16.663 INFO:teuthology.orchestra.run.smithi039.stdout: "pq_executing_high_water": 0, 2024-09-12T02:49:16.663 INFO:teuthology.orchestra.run.smithi039.stdout: "pq_executed_ops": 0, 2024-09-12T02:49:16.663 INFO:teuthology.orchestra.run.smithi039.stdout: "pq_executed": 0, 2024-09-12T02:49:16.663 INFO:teuthology.orchestra.run.smithi039.stdout: "pq_item_in_journal": 0 2024-09-12T02:49:16.663 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-09-12T02:49:16.663 INFO:teuthology.orchestra.run.smithi039.stdout: "throttle-msgr_dispatch_throttler-mds": { 2024-09-12T02:49:16.663 INFO:teuthology.orchestra.run.smithi039.stdout: "val": 0, 2024-09-12T02:49:16.663 INFO:teuthology.orchestra.run.smithi039.stdout: "max": 104857600, 2024-09-12T02:49:16.664 INFO:teuthology.orchestra.run.smithi039.stdout: "get_started": 0, 2024-09-12T02:49:16.664 INFO:teuthology.orchestra.run.smithi039.stdout: "get": 2607, 2024-09-12T02:49:16.664 INFO:teuthology.orchestra.run.smithi039.stdout: "get_sum": 2182642, 2024-09-12T02:49:16.664 INFO:teuthology.orchestra.run.smithi039.stdout: "get_or_fail_fail": 0, 2024-09-12T02:49:16.664 INFO:teuthology.orchestra.run.smithi039.stdout: "get_or_fail_success": 2607, 2024-09-12T02:49:16.664 INFO:teuthology.orchestra.run.smithi039.stdout: "take": 0, 2024-09-12T02:49:16.664 INFO:teuthology.orchestra.run.smithi039.stdout: "take_sum": 0, 2024-09-12T02:49:16.664 INFO:teuthology.orchestra.run.smithi039.stdout: "put": 2607, 2024-09-12T02:49:16.664 INFO:teuthology.orchestra.run.smithi039.stdout: "put_sum": 2182642, 2024-09-12T02:49:16.664 INFO:teuthology.orchestra.run.smithi039.stdout: "wait": { 2024-09-12T02:49:16.664 INFO:teuthology.orchestra.run.smithi039.stdout: "avgcount": 0, 2024-09-12T02:49:16.664 INFO:teuthology.orchestra.run.smithi039.stdout: "sum": 0.000000000, 2024-09-12T02:49:16.664 INFO:teuthology.orchestra.run.smithi039.stdout: "avgtime": 0.000000000 2024-09-12T02:49:16.665 INFO:teuthology.orchestra.run.smithi039.stdout: } 2024-09-12T02:49:16.665 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-09-12T02:49:16.665 INFO:teuthology.orchestra.run.smithi039.stdout: "throttle-objecter_bytes": { 2024-09-12T02:49:16.665 INFO:teuthology.orchestra.run.smithi039.stdout: "val": 0, 2024-09-12T02:49:16.665 INFO:teuthology.orchestra.run.smithi039.stdout: "max": 104857600, 2024-09-12T02:49:16.665 INFO:teuthology.orchestra.run.smithi039.stdout: "get_started": 0, 2024-09-12T02:49:16.665 INFO:teuthology.orchestra.run.smithi039.stdout: "get": 0, 2024-09-12T02:49:16.665 INFO:teuthology.orchestra.run.smithi039.stdout: "get_sum": 0, 2024-09-12T02:49:16.665 INFO:teuthology.orchestra.run.smithi039.stdout: "get_or_fail_fail": 0, 2024-09-12T02:49:16.665 INFO:teuthology.orchestra.run.smithi039.stdout: "get_or_fail_success": 0, 2024-09-12T02:49:16.665 INFO:teuthology.orchestra.run.smithi039.stdout: "take": 2340, 2024-09-12T02:49:16.665 INFO:teuthology.orchestra.run.smithi039.stdout: "take_sum": 2054, 2024-09-12T02:49:16.665 INFO:teuthology.orchestra.run.smithi039.stdout: "put": 2340, 2024-09-12T02:49:16.665 INFO:teuthology.orchestra.run.smithi039.stdout: "put_sum": 2054, 2024-09-12T02:49:16.666 INFO:teuthology.orchestra.run.smithi039.stdout: "wait": { 2024-09-12T02:49:16.666 INFO:teuthology.orchestra.run.smithi039.stdout: "avgcount": 0, 2024-09-12T02:49:16.666 INFO:teuthology.orchestra.run.smithi039.stdout: "sum": 0.000000000, 2024-09-12T02:49:16.666 INFO:teuthology.orchestra.run.smithi039.stdout: "avgtime": 0.000000000 2024-09-12T02:49:16.666 INFO:teuthology.orchestra.run.smithi039.stdout: } 2024-09-12T02:49:16.666 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-09-12T02:49:16.666 INFO:teuthology.orchestra.run.smithi039.stdout: "throttle-objecter_ops": { 2024-09-12T02:49:16.666 INFO:teuthology.orchestra.run.smithi039.stdout: "val": 0, 2024-09-12T02:49:16.666 INFO:teuthology.orchestra.run.smithi039.stdout: "max": 1024, 2024-09-12T02:49:16.666 INFO:teuthology.orchestra.run.smithi039.stdout: "get_started": 0, 2024-09-12T02:49:16.666 INFO:teuthology.orchestra.run.smithi039.stdout: "get": 0, 2024-09-12T02:49:16.666 INFO:teuthology.orchestra.run.smithi039.stdout: "get_sum": 0, 2024-09-12T02:49:16.666 INFO:teuthology.orchestra.run.smithi039.stdout: "get_or_fail_fail": 0, 2024-09-12T02:49:16.666 INFO:teuthology.orchestra.run.smithi039.stdout: "get_or_fail_success": 0, 2024-09-12T02:49:16.667 INFO:teuthology.orchestra.run.smithi039.stdout: "take": 2340, 2024-09-12T02:49:16.667 INFO:teuthology.orchestra.run.smithi039.stdout: "take_sum": 2340, 2024-09-12T02:49:16.667 INFO:teuthology.orchestra.run.smithi039.stdout: "put": 2340, 2024-09-12T02:49:16.667 INFO:teuthology.orchestra.run.smithi039.stdout: "put_sum": 2340, 2024-09-12T02:49:16.667 INFO:teuthology.orchestra.run.smithi039.stdout: "wait": { 2024-09-12T02:49:16.667 INFO:teuthology.orchestra.run.smithi039.stdout: "avgcount": 0, 2024-09-12T02:49:16.667 INFO:teuthology.orchestra.run.smithi039.stdout: "sum": 0.000000000, 2024-09-12T02:49:16.667 INFO:teuthology.orchestra.run.smithi039.stdout: "avgtime": 0.000000000 2024-09-12T02:49:16.668 INFO:teuthology.orchestra.run.smithi039.stdout: } 2024-09-12T02:49:16.668 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-09-12T02:49:16.668 INFO:teuthology.orchestra.run.smithi039.stdout: "throttle-write_buf_throttle": { 2024-09-12T02:49:16.668 INFO:teuthology.orchestra.run.smithi039.stdout: "val": 0, 2024-09-12T02:49:16.668 INFO:teuthology.orchestra.run.smithi039.stdout: "max": 3758096384, 2024-09-12T02:49:16.668 INFO:teuthology.orchestra.run.smithi039.stdout: "get_started": 0, 2024-09-12T02:49:16.668 INFO:teuthology.orchestra.run.smithi039.stdout: "get": 0, 2024-09-12T02:49:16.668 INFO:teuthology.orchestra.run.smithi039.stdout: "get_sum": 0, 2024-09-12T02:49:16.668 INFO:teuthology.orchestra.run.smithi039.stdout: "get_or_fail_fail": 0, 2024-09-12T02:49:16.668 INFO:teuthology.orchestra.run.smithi039.stdout: "get_or_fail_success": 0, 2024-09-12T02:49:16.668 INFO:teuthology.orchestra.run.smithi039.stdout: "take": 0, 2024-09-12T02:49:16.668 INFO:teuthology.orchestra.run.smithi039.stdout: "take_sum": 0, 2024-09-12T02:49:16.668 INFO:teuthology.orchestra.run.smithi039.stdout: "put": 0, 2024-09-12T02:49:16.669 INFO:teuthology.orchestra.run.smithi039.stdout: "put_sum": 0, 2024-09-12T02:49:16.669 INFO:teuthology.orchestra.run.smithi039.stdout: "wait": { 2024-09-12T02:49:16.669 INFO:teuthology.orchestra.run.smithi039.stdout: "avgcount": 0, 2024-09-12T02:49:16.669 INFO:teuthology.orchestra.run.smithi039.stdout: "sum": 0.000000000, 2024-09-12T02:49:16.669 INFO:teuthology.orchestra.run.smithi039.stdout: "avgtime": 0.000000000 2024-09-12T02:49:16.669 INFO:teuthology.orchestra.run.smithi039.stdout: } 2024-09-12T02:49:16.669 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-09-12T02:49:16.669 INFO:teuthology.orchestra.run.smithi039.stdout: "throttle-write_buf_throttle-0x5562a08b4be0": { 2024-09-12T02:49:16.669 INFO:teuthology.orchestra.run.smithi039.stdout: "val": 0, 2024-09-12T02:49:16.669 INFO:teuthology.orchestra.run.smithi039.stdout: "max": 3758096384, 2024-09-12T02:49:16.669 INFO:teuthology.orchestra.run.smithi039.stdout: "get_started": 0, 2024-09-12T02:49:16.669 INFO:teuthology.orchestra.run.smithi039.stdout: "get": 0, 2024-09-12T02:49:16.669 INFO:teuthology.orchestra.run.smithi039.stdout: "get_sum": 0, 2024-09-12T02:49:16.669 INFO:teuthology.orchestra.run.smithi039.stdout: "get_or_fail_fail": 0, 2024-09-12T02:49:16.670 INFO:teuthology.orchestra.run.smithi039.stdout: "get_or_fail_success": 0, 2024-09-12T02:49:16.670 INFO:teuthology.orchestra.run.smithi039.stdout: "take": 0, 2024-09-12T02:49:16.670 INFO:teuthology.orchestra.run.smithi039.stdout: "take_sum": 0, 2024-09-12T02:49:16.670 INFO:teuthology.orchestra.run.smithi039.stdout: "put": 0, 2024-09-12T02:49:16.670 INFO:teuthology.orchestra.run.smithi039.stdout: "put_sum": 0, 2024-09-12T02:49:16.670 INFO:teuthology.orchestra.run.smithi039.stdout: "wait": { 2024-09-12T02:49:16.670 INFO:teuthology.orchestra.run.smithi039.stdout: "avgcount": 0, 2024-09-12T02:49:16.670 INFO:teuthology.orchestra.run.smithi039.stdout: "sum": 0.000000000, 2024-09-12T02:49:16.670 INFO:teuthology.orchestra.run.smithi039.stdout: "avgtime": 0.000000000 2024-09-12T02:49:16.670 INFO:teuthology.orchestra.run.smithi039.stdout: } 2024-09-12T02:49:16.670 INFO:teuthology.orchestra.run.smithi039.stdout: } 2024-09-12T02:49:16.670 INFO:teuthology.orchestra.run.smithi039.stdout:} 2024-09-12T02:49:17.563 INFO:tasks.check_counter:Daemon mds.a mds.exported=0 2024-09-12T02:49:17.564 INFO:tasks.check_counter:Daemon mds.a mds.imported=0 2024-09-12T02:49:17.564 INFO:tasks.check_counter:Daemon mds.a mds_cache.dir_update=0 2024-09-12T02:49:17.564 INFO:tasks.check_counter:Daemon mds.a mds_cache.dir_update_receipt=0 2024-09-12T02:49:17.564 INFO:tasks.check_counter:Daemon mds.a mds.root_rsnaps=0 2024-09-12T02:49:17.564 INFO:tasks.check_counter:Daemon mds.a mds_server.req_mksnap_latency.avgcount=0 2024-09-12T02:49:17.564 INFO:tasks.check_counter:Daemon mds.a mds_server.req_rmsnap_latency.avgcount=0 2024-09-12T02:49:17.564 DEBUG:tasks.check_counter:Getting stats from d 2024-09-12T02:49:17.564 DEBUG:teuthology.orchestra.run.smithi039:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc shell --fsid 4954ed46-70ae-11ef-bcea-c7b262605968 -- ceph daemon mds.d perf dump 2024-09-12T02:49:17.849 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 02:49:17 smithi039 ceph-mon[30515]: pgmap v355: 129 pgs: 129 active+clean; 24 MiB data, 485 MiB used, 1.0 TiB / 1.0 TiB avail; 59 KiB/s rd, 54 KiB/s wr, 18 op/s 2024-09-12T02:49:17.944 INFO:teuthology.orchestra.run.smithi039.stderr:Inferring config /var/lib/ceph/4954ed46-70ae-11ef-bcea-c7b262605968/mon.a/config 2024-09-12T02:49:17.949 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 12 02:49:17 smithi044 ceph-mon[35411]: pgmap v355: 129 pgs: 129 active+clean; 24 MiB data, 485 MiB used, 1.0 TiB / 1.0 TiB avail; 59 KiB/s rd, 54 KiB/s wr, 18 op/s 2024-09-12T02:49:18.013 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 12 02:49:17 smithi172 ceph-mon[35609]: pgmap v355: 129 pgs: 129 active+clean; 24 MiB data, 485 MiB used, 1.0 TiB / 1.0 TiB avail; 59 KiB/s rd, 54 KiB/s wr, 18 op/s 2024-09-12T02:49:18.588 INFO:teuthology.orchestra.run.smithi039.stdout:{ 2024-09-12T02:49:18.588 INFO:teuthology.orchestra.run.smithi039.stdout: "AsyncMessenger::Worker-0": { 2024-09-12T02:49:18.588 INFO:teuthology.orchestra.run.smithi039.stdout: "msgr_recv_messages": 1082, 2024-09-12T02:49:18.588 INFO:teuthology.orchestra.run.smithi039.stdout: "msgr_send_messages": 1066, 2024-09-12T02:49:18.588 INFO:teuthology.orchestra.run.smithi039.stdout: "msgr_recv_bytes": 2042736, 2024-09-12T02:49:18.588 INFO:teuthology.orchestra.run.smithi039.stdout: "msgr_send_bytes": 406852, 2024-09-12T02:49:18.588 INFO:teuthology.orchestra.run.smithi039.stdout: "msgr_created_connections": 5, 2024-09-12T02:49:18.589 INFO:teuthology.orchestra.run.smithi039.stdout: "msgr_active_connections": 1, 2024-09-12T02:49:18.589 INFO:teuthology.orchestra.run.smithi039.stdout: "msgr_running_total_time": 0.164644304, 2024-09-12T02:49:18.589 INFO:teuthology.orchestra.run.smithi039.stdout: "msgr_running_send_time": 0.058613447, 2024-09-12T02:49:18.589 INFO:teuthology.orchestra.run.smithi039.stdout: "msgr_running_recv_time": 0.087434348, 2024-09-12T02:49:18.589 INFO:teuthology.orchestra.run.smithi039.stdout: "msgr_running_fast_dispatch_time": 0.026119092, 2024-09-12T02:49:18.589 INFO:teuthology.orchestra.run.smithi039.stdout: "msgr_send_messages_queue_lat": { 2024-09-12T02:49:18.589 INFO:teuthology.orchestra.run.smithi039.stdout: "avgcount": 1066, 2024-09-12T02:49:18.589 INFO:teuthology.orchestra.run.smithi039.stdout: "sum": 0.072573706, 2024-09-12T02:49:18.589 INFO:teuthology.orchestra.run.smithi039.stdout: "avgtime": 0.000068080 2024-09-12T02:49:18.589 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-09-12T02:49:18.589 INFO:teuthology.orchestra.run.smithi039.stdout: "msgr_handle_ack_lat": { 2024-09-12T02:49:18.589 INFO:teuthology.orchestra.run.smithi039.stdout: "avgcount": 0, 2024-09-12T02:49:18.589 INFO:teuthology.orchestra.run.smithi039.stdout: "sum": 0.000000000, 2024-09-12T02:49:18.590 INFO:teuthology.orchestra.run.smithi039.stdout: "avgtime": 0.000000000 2024-09-12T02:49:18.590 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-09-12T02:49:18.590 INFO:teuthology.orchestra.run.smithi039.stdout: "msgr_recv_encrypted_bytes": 1771920, 2024-09-12T02:49:18.590 INFO:teuthology.orchestra.run.smithi039.stdout: "msgr_send_encrypted_bytes": 150544 2024-09-12T02:49:18.590 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-09-12T02:49:18.590 INFO:teuthology.orchestra.run.smithi039.stdout: "AsyncMessenger::Worker-1": { 2024-09-12T02:49:18.590 INFO:teuthology.orchestra.run.smithi039.stdout: "msgr_recv_messages": 4, 2024-09-12T02:49:18.590 INFO:teuthology.orchestra.run.smithi039.stdout: "msgr_send_messages": 185, 2024-09-12T02:49:18.590 INFO:teuthology.orchestra.run.smithi039.stdout: "msgr_recv_bytes": 876, 2024-09-12T02:49:18.590 INFO:teuthology.orchestra.run.smithi039.stdout: "msgr_send_bytes": 469002, 2024-09-12T02:49:18.590 INFO:teuthology.orchestra.run.smithi039.stdout: "msgr_created_connections": 6, 2024-09-12T02:49:18.590 INFO:teuthology.orchestra.run.smithi039.stdout: "msgr_active_connections": 4, 2024-09-12T02:49:18.590 INFO:teuthology.orchestra.run.smithi039.stdout: "msgr_running_total_time": 0.021937748, 2024-09-12T02:49:18.591 INFO:teuthology.orchestra.run.smithi039.stdout: "msgr_running_send_time": 0.015226032, 2024-09-12T02:49:18.591 INFO:teuthology.orchestra.run.smithi039.stdout: "msgr_running_recv_time": 0.003064529, 2024-09-12T02:49:18.591 INFO:teuthology.orchestra.run.smithi039.stdout: "msgr_running_fast_dispatch_time": 0.000050957, 2024-09-12T02:49:18.591 INFO:teuthology.orchestra.run.smithi039.stdout: "msgr_send_messages_queue_lat": { 2024-09-12T02:49:18.591 INFO:teuthology.orchestra.run.smithi039.stdout: "avgcount": 182, 2024-09-12T02:49:18.591 INFO:teuthology.orchestra.run.smithi039.stdout: "sum": 0.019591345, 2024-09-12T02:49:18.591 INFO:teuthology.orchestra.run.smithi039.stdout: "avgtime": 0.000107644 2024-09-12T02:49:18.591 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-09-12T02:49:18.591 INFO:teuthology.orchestra.run.smithi039.stdout: "msgr_handle_ack_lat": { 2024-09-12T02:49:18.591 INFO:teuthology.orchestra.run.smithi039.stdout: "avgcount": 0, 2024-09-12T02:49:18.591 INFO:teuthology.orchestra.run.smithi039.stdout: "sum": 0.000000000, 2024-09-12T02:49:18.591 INFO:teuthology.orchestra.run.smithi039.stdout: "avgtime": 0.000000000 2024-09-12T02:49:18.591 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-09-12T02:49:18.591 INFO:teuthology.orchestra.run.smithi039.stdout: "msgr_recv_encrypted_bytes": 320, 2024-09-12T02:49:18.592 INFO:teuthology.orchestra.run.smithi039.stdout: "msgr_send_encrypted_bytes": 468304 2024-09-12T02:49:18.592 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-09-12T02:49:18.592 INFO:teuthology.orchestra.run.smithi039.stdout: "AsyncMessenger::Worker-2": { 2024-09-12T02:49:18.592 INFO:teuthology.orchestra.run.smithi039.stdout: "msgr_recv_messages": 1494, 2024-09-12T02:49:18.592 INFO:teuthology.orchestra.run.smithi039.stdout: "msgr_send_messages": 1496, 2024-09-12T02:49:18.592 INFO:teuthology.orchestra.run.smithi039.stdout: "msgr_recv_bytes": 382891, 2024-09-12T02:49:18.592 INFO:teuthology.orchestra.run.smithi039.stdout: "msgr_send_bytes": 475099, 2024-09-12T02:49:18.592 INFO:teuthology.orchestra.run.smithi039.stdout: "msgr_created_connections": 4, 2024-09-12T02:49:18.592 INFO:teuthology.orchestra.run.smithi039.stdout: "msgr_active_connections": 3, 2024-09-12T02:49:18.592 INFO:teuthology.orchestra.run.smithi039.stdout: "msgr_running_total_time": 0.130671090, 2024-09-12T02:49:18.592 INFO:teuthology.orchestra.run.smithi039.stdout: "msgr_running_send_time": 0.038117019, 2024-09-12T02:49:18.592 INFO:teuthology.orchestra.run.smithi039.stdout: "msgr_running_recv_time": 0.037890940, 2024-09-12T02:49:18.592 INFO:teuthology.orchestra.run.smithi039.stdout: "msgr_running_fast_dispatch_time": 0.044835557, 2024-09-12T02:49:18.592 INFO:teuthology.orchestra.run.smithi039.stdout: "msgr_send_messages_queue_lat": { 2024-09-12T02:49:18.593 INFO:teuthology.orchestra.run.smithi039.stdout: "avgcount": 1494, 2024-09-12T02:49:18.593 INFO:teuthology.orchestra.run.smithi039.stdout: "sum": 0.062966542, 2024-09-12T02:49:18.593 INFO:teuthology.orchestra.run.smithi039.stdout: "avgtime": 0.000042146 2024-09-12T02:49:18.593 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-09-12T02:49:18.593 INFO:teuthology.orchestra.run.smithi039.stdout: "msgr_handle_ack_lat": { 2024-09-12T02:49:18.593 INFO:teuthology.orchestra.run.smithi039.stdout: "avgcount": 0, 2024-09-12T02:49:18.593 INFO:teuthology.orchestra.run.smithi039.stdout: "sum": 0.000000000, 2024-09-12T02:49:18.593 INFO:teuthology.orchestra.run.smithi039.stdout: "avgtime": 0.000000000 2024-09-12T02:49:18.594 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-09-12T02:49:18.594 INFO:teuthology.orchestra.run.smithi039.stdout: "msgr_recv_encrypted_bytes": 0, 2024-09-12T02:49:18.594 INFO:teuthology.orchestra.run.smithi039.stdout: "msgr_send_encrypted_bytes": 0 2024-09-12T02:49:18.594 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-09-12T02:49:18.594 INFO:teuthology.orchestra.run.smithi039.stdout: "cct": { 2024-09-12T02:49:18.594 INFO:teuthology.orchestra.run.smithi039.stdout: "total_workers": 1, 2024-09-12T02:49:18.594 INFO:teuthology.orchestra.run.smithi039.stdout: "unhealthy_workers": 0 2024-09-12T02:49:18.594 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-09-12T02:49:18.594 INFO:teuthology.orchestra.run.smithi039.stdout: "finisher-MDSRank": { 2024-09-12T02:49:18.594 INFO:teuthology.orchestra.run.smithi039.stdout: "queue_len": 0, 2024-09-12T02:49:18.594 INFO:teuthology.orchestra.run.smithi039.stdout: "complete_latency": { 2024-09-12T02:49:18.594 INFO:teuthology.orchestra.run.smithi039.stdout: "avgcount": 3903, 2024-09-12T02:49:18.594 INFO:teuthology.orchestra.run.smithi039.stdout: "sum": 0.102288948, 2024-09-12T02:49:18.595 INFO:teuthology.orchestra.run.smithi039.stdout: "avgtime": 0.000026207 2024-09-12T02:49:18.595 INFO:teuthology.orchestra.run.smithi039.stdout: } 2024-09-12T02:49:18.595 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-09-12T02:49:18.595 INFO:teuthology.orchestra.run.smithi039.stdout: "finisher-PurgeQueue": { 2024-09-12T02:49:18.595 INFO:teuthology.orchestra.run.smithi039.stdout: "queue_len": 0, 2024-09-12T02:49:18.595 INFO:teuthology.orchestra.run.smithi039.stdout: "complete_latency": { 2024-09-12T02:49:18.595 INFO:teuthology.orchestra.run.smithi039.stdout: "avgcount": 0, 2024-09-12T02:49:18.595 INFO:teuthology.orchestra.run.smithi039.stdout: "sum": 0.000000000, 2024-09-12T02:49:18.595 INFO:teuthology.orchestra.run.smithi039.stdout: "avgtime": 0.000000000 2024-09-12T02:49:18.595 INFO:teuthology.orchestra.run.smithi039.stdout: } 2024-09-12T02:49:18.595 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-09-12T02:49:18.595 INFO:teuthology.orchestra.run.smithi039.stdout: "mds": { 2024-09-12T02:49:18.595 INFO:teuthology.orchestra.run.smithi039.stdout: "request": 0, 2024-09-12T02:49:18.595 INFO:teuthology.orchestra.run.smithi039.stdout: "reply": 0, 2024-09-12T02:49:18.596 INFO:teuthology.orchestra.run.smithi039.stdout: "reply_latency": { 2024-09-12T02:49:18.596 INFO:teuthology.orchestra.run.smithi039.stdout: "avgcount": 0, 2024-09-12T02:49:18.596 INFO:teuthology.orchestra.run.smithi039.stdout: "sum": 0.000000000, 2024-09-12T02:49:18.596 INFO:teuthology.orchestra.run.smithi039.stdout: "avgtime": 0.000000000 2024-09-12T02:49:18.596 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-09-12T02:49:18.596 INFO:teuthology.orchestra.run.smithi039.stdout: "slow_reply": 0, 2024-09-12T02:49:18.596 INFO:teuthology.orchestra.run.smithi039.stdout: "forward": 0, 2024-09-12T02:49:18.596 INFO:teuthology.orchestra.run.smithi039.stdout: "dir_fetch_complete": 0, 2024-09-12T02:49:18.596 INFO:teuthology.orchestra.run.smithi039.stdout: "dir_fetch_keys": 0, 2024-09-12T02:49:18.596 INFO:teuthology.orchestra.run.smithi039.stdout: "dir_commit": 0, 2024-09-12T02:49:18.596 INFO:teuthology.orchestra.run.smithi039.stdout: "dir_split": 0, 2024-09-12T02:49:18.596 INFO:teuthology.orchestra.run.smithi039.stdout: "dir_merge": 0, 2024-09-12T02:49:18.596 INFO:teuthology.orchestra.run.smithi039.stdout: "inodes": 0, 2024-09-12T02:49:18.597 INFO:teuthology.orchestra.run.smithi039.stdout: "inodes_top": 0, 2024-09-12T02:49:18.597 INFO:teuthology.orchestra.run.smithi039.stdout: "inodes_bottom": 0, 2024-09-12T02:49:18.597 INFO:teuthology.orchestra.run.smithi039.stdout: "inodes_pin_tail": 0, 2024-09-12T02:49:18.597 INFO:teuthology.orchestra.run.smithi039.stdout: "inodes_pinned": 0, 2024-09-12T02:49:18.597 INFO:teuthology.orchestra.run.smithi039.stdout: "inodes_expired": 0, 2024-09-12T02:49:18.597 INFO:teuthology.orchestra.run.smithi039.stdout: "inodes_with_caps": 0, 2024-09-12T02:49:18.597 INFO:teuthology.orchestra.run.smithi039.stdout: "caps": 0, 2024-09-12T02:49:18.597 INFO:teuthology.orchestra.run.smithi039.stdout: "subtrees": 1, 2024-09-12T02:49:18.597 INFO:teuthology.orchestra.run.smithi039.stdout: "traverse": 0, 2024-09-12T02:49:18.597 INFO:teuthology.orchestra.run.smithi039.stdout: "traverse_hit": 0, 2024-09-12T02:49:18.597 INFO:teuthology.orchestra.run.smithi039.stdout: "traverse_forward": 0, 2024-09-12T02:49:18.597 INFO:teuthology.orchestra.run.smithi039.stdout: "traverse_discover": 0, 2024-09-12T02:49:18.597 INFO:teuthology.orchestra.run.smithi039.stdout: "traverse_dir_fetch": 0, 2024-09-12T02:49:18.598 INFO:teuthology.orchestra.run.smithi039.stdout: "traverse_remote_ino": 0, 2024-09-12T02:49:18.598 INFO:teuthology.orchestra.run.smithi039.stdout: "traverse_lock": 0, 2024-09-12T02:49:18.598 INFO:teuthology.orchestra.run.smithi039.stdout: "load_cent": 0, 2024-09-12T02:49:18.598 INFO:teuthology.orchestra.run.smithi039.stdout: "q": 0, 2024-09-12T02:49:18.598 INFO:teuthology.orchestra.run.smithi039.stdout: "exported": 0, 2024-09-12T02:49:18.598 INFO:teuthology.orchestra.run.smithi039.stdout: "exported_inodes": 0, 2024-09-12T02:49:18.598 INFO:teuthology.orchestra.run.smithi039.stdout: "imported": 0, 2024-09-12T02:49:18.598 INFO:teuthology.orchestra.run.smithi039.stdout: "imported_inodes": 0, 2024-09-12T02:49:18.598 INFO:teuthology.orchestra.run.smithi039.stdout: "openino_dir_fetch": 0, 2024-09-12T02:49:18.598 INFO:teuthology.orchestra.run.smithi039.stdout: "openino_backtrace_fetch": 0, 2024-09-12T02:49:18.598 INFO:teuthology.orchestra.run.smithi039.stdout: "openino_peer_discover": 0, 2024-09-12T02:49:18.598 INFO:teuthology.orchestra.run.smithi039.stdout: "root_rfiles": 0, 2024-09-12T02:49:18.598 INFO:teuthology.orchestra.run.smithi039.stdout: "root_rbytes": 0, 2024-09-12T02:49:18.598 INFO:teuthology.orchestra.run.smithi039.stdout: "root_rsnaps": 0, 2024-09-12T02:49:18.598 INFO:teuthology.orchestra.run.smithi039.stdout: "scrub_backtrace_fetch": 0, 2024-09-12T02:49:18.599 INFO:teuthology.orchestra.run.smithi039.stdout: "scrub_set_tag": 0, 2024-09-12T02:49:18.599 INFO:teuthology.orchestra.run.smithi039.stdout: "scrub_backtrace_repaired": 0, 2024-09-12T02:49:18.599 INFO:teuthology.orchestra.run.smithi039.stdout: "scrub_inotable_repaired": 0, 2024-09-12T02:49:18.599 INFO:teuthology.orchestra.run.smithi039.stdout: "scrub_dir_inodes": 0, 2024-09-12T02:49:18.599 INFO:teuthology.orchestra.run.smithi039.stdout: "scrub_dir_base_inodes": 0, 2024-09-12T02:49:18.599 INFO:teuthology.orchestra.run.smithi039.stdout: "scrub_dirfrag_rstats": 0, 2024-09-12T02:49:18.599 INFO:teuthology.orchestra.run.smithi039.stdout: "scrub_file_inodes": 0, 2024-09-12T02:49:18.599 INFO:teuthology.orchestra.run.smithi039.stdout: "handle_inode_file_caps": 0, 2024-09-12T02:49:18.599 INFO:teuthology.orchestra.run.smithi039.stdout: "ceph_cap_op_revoke": 0, 2024-09-12T02:49:18.599 INFO:teuthology.orchestra.run.smithi039.stdout: "ceph_cap_op_grant": 0, 2024-09-12T02:49:18.599 INFO:teuthology.orchestra.run.smithi039.stdout: "ceph_cap_op_trunc": 0, 2024-09-12T02:49:18.599 INFO:teuthology.orchestra.run.smithi039.stdout: "ceph_cap_op_flushsnap_ack": 0, 2024-09-12T02:49:18.599 INFO:teuthology.orchestra.run.smithi039.stdout: "ceph_cap_op_flush_ack": 0, 2024-09-12T02:49:18.600 INFO:teuthology.orchestra.run.smithi039.stdout: "handle_client_caps": 0, 2024-09-12T02:49:18.600 INFO:teuthology.orchestra.run.smithi039.stdout: "handle_client_caps_dirty": 0, 2024-09-12T02:49:18.600 INFO:teuthology.orchestra.run.smithi039.stdout: "handle_client_cap_release": 0, 2024-09-12T02:49:18.600 INFO:teuthology.orchestra.run.smithi039.stdout: "process_request_cap_release": 0 2024-09-12T02:49:18.600 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-09-12T02:49:18.600 INFO:teuthology.orchestra.run.smithi039.stdout: "mds_cache": { 2024-09-12T02:49:18.600 INFO:teuthology.orchestra.run.smithi039.stdout: "dir_update": 0, 2024-09-12T02:49:18.600 INFO:teuthology.orchestra.run.smithi039.stdout: "dir_update_receipt": 0, 2024-09-12T02:49:18.600 INFO:teuthology.orchestra.run.smithi039.stdout: "dir_try_discover": 0, 2024-09-12T02:49:18.600 INFO:teuthology.orchestra.run.smithi039.stdout: "dir_send_discover": 0, 2024-09-12T02:49:18.600 INFO:teuthology.orchestra.run.smithi039.stdout: "dir_handle_discover": 0, 2024-09-12T02:49:18.600 INFO:teuthology.orchestra.run.smithi039.stdout: "num_strays": 0, 2024-09-12T02:49:18.600 INFO:teuthology.orchestra.run.smithi039.stdout: "num_strays_delayed": 0, 2024-09-12T02:49:18.600 INFO:teuthology.orchestra.run.smithi039.stdout: "num_strays_enqueuing": 0, 2024-09-12T02:49:18.601 INFO:teuthology.orchestra.run.smithi039.stdout: "strays_created": 0, 2024-09-12T02:49:18.601 INFO:teuthology.orchestra.run.smithi039.stdout: "strays_enqueued": 0, 2024-09-12T02:49:18.601 INFO:teuthology.orchestra.run.smithi039.stdout: "strays_reintegrated": 0, 2024-09-12T02:49:18.601 INFO:teuthology.orchestra.run.smithi039.stdout: "strays_migrated": 0, 2024-09-12T02:49:18.601 INFO:teuthology.orchestra.run.smithi039.stdout: "num_recovering_processing": 0, 2024-09-12T02:49:18.601 INFO:teuthology.orchestra.run.smithi039.stdout: "num_recovering_enqueued": 0, 2024-09-12T02:49:18.601 INFO:teuthology.orchestra.run.smithi039.stdout: "num_recovering_prioritized": 0, 2024-09-12T02:49:18.601 INFO:teuthology.orchestra.run.smithi039.stdout: "recovery_started": 0, 2024-09-12T02:49:18.601 INFO:teuthology.orchestra.run.smithi039.stdout: "recovery_completed": 0, 2024-09-12T02:49:18.601 INFO:teuthology.orchestra.run.smithi039.stdout: "ireq_quiesce_path": 0, 2024-09-12T02:49:18.601 INFO:teuthology.orchestra.run.smithi039.stdout: "ireq_quiesce_inode": 0, 2024-09-12T02:49:18.601 INFO:teuthology.orchestra.run.smithi039.stdout: "ireq_enqueue_scrub": 0, 2024-09-12T02:49:18.602 INFO:teuthology.orchestra.run.smithi039.stdout: "ireq_exportdir": 0, 2024-09-12T02:49:18.602 INFO:teuthology.orchestra.run.smithi039.stdout: "ireq_flush": 0, 2024-09-12T02:49:18.602 INFO:teuthology.orchestra.run.smithi039.stdout: "ireq_fragmentdir": 0, 2024-09-12T02:49:18.602 INFO:teuthology.orchestra.run.smithi039.stdout: "ireq_fragstats": 0, 2024-09-12T02:49:18.602 INFO:teuthology.orchestra.run.smithi039.stdout: "ireq_inodestats": 0 2024-09-12T02:49:18.602 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-09-12T02:49:18.602 INFO:teuthology.orchestra.run.smithi039.stdout: "mds_log": { 2024-09-12T02:49:18.602 INFO:teuthology.orchestra.run.smithi039.stdout: "evlrg": 0, 2024-09-12T02:49:18.602 INFO:teuthology.orchestra.run.smithi039.stdout: "evadd": 0, 2024-09-12T02:49:18.602 INFO:teuthology.orchestra.run.smithi039.stdout: "evex": 0, 2024-09-12T02:49:18.603 INFO:teuthology.orchestra.run.smithi039.stdout: "evtrm": 0, 2024-09-12T02:49:18.603 INFO:teuthology.orchestra.run.smithi039.stdout: "ev": 6, 2024-09-12T02:49:18.603 INFO:teuthology.orchestra.run.smithi039.stdout: "evexg": 0, 2024-09-12T02:49:18.603 INFO:teuthology.orchestra.run.smithi039.stdout: "evexd": 0, 2024-09-12T02:49:18.603 INFO:teuthology.orchestra.run.smithi039.stdout: "segadd": 0, 2024-09-12T02:49:18.603 INFO:teuthology.orchestra.run.smithi039.stdout: "segex": 0, 2024-09-12T02:49:18.603 INFO:teuthology.orchestra.run.smithi039.stdout: "segtrm": 0, 2024-09-12T02:49:18.603 INFO:teuthology.orchestra.run.smithi039.stdout: "seg": 2, 2024-09-12T02:49:18.603 INFO:teuthology.orchestra.run.smithi039.stdout: "segmjr": 2, 2024-09-12T02:49:18.603 INFO:teuthology.orchestra.run.smithi039.stdout: "segexg": 0, 2024-09-12T02:49:18.603 INFO:teuthology.orchestra.run.smithi039.stdout: "segexd": 0, 2024-09-12T02:49:18.603 INFO:teuthology.orchestra.run.smithi039.stdout: "expos": 4194304, 2024-09-12T02:49:18.603 INFO:teuthology.orchestra.run.smithi039.stdout: "wrpos": 4196130, 2024-09-12T02:49:18.604 INFO:teuthology.orchestra.run.smithi039.stdout: "rdpos": 4195989, 2024-09-12T02:49:18.604 INFO:teuthology.orchestra.run.smithi039.stdout: "jlat": { 2024-09-12T02:49:18.604 INFO:teuthology.orchestra.run.smithi039.stdout: "avgcount": 0, 2024-09-12T02:49:18.604 INFO:teuthology.orchestra.run.smithi039.stdout: "sum": 0.000000000, 2024-09-12T02:49:18.604 INFO:teuthology.orchestra.run.smithi039.stdout: "avgtime": 0.000000000 2024-09-12T02:49:18.604 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-09-12T02:49:18.604 INFO:teuthology.orchestra.run.smithi039.stdout: "replayed": 6 2024-09-12T02:49:18.604 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-09-12T02:49:18.604 INFO:teuthology.orchestra.run.smithi039.stdout: "mds_mem": { 2024-09-12T02:49:18.605 INFO:teuthology.orchestra.run.smithi039.stdout: "ino": 3, 2024-09-12T02:49:18.605 INFO:teuthology.orchestra.run.smithi039.stdout: "ino+": 3, 2024-09-12T02:49:18.605 INFO:teuthology.orchestra.run.smithi039.stdout: "ino-": 0, 2024-09-12T02:49:18.605 INFO:teuthology.orchestra.run.smithi039.stdout: "dir": 1, 2024-09-12T02:49:18.605 INFO:teuthology.orchestra.run.smithi039.stdout: "dir+": 1, 2024-09-12T02:49:18.605 INFO:teuthology.orchestra.run.smithi039.stdout: "dir-": 0, 2024-09-12T02:49:18.605 INFO:teuthology.orchestra.run.smithi039.stdout: "dn": 0, 2024-09-12T02:49:18.605 INFO:teuthology.orchestra.run.smithi039.stdout: "dn+": 0, 2024-09-12T02:49:18.605 INFO:teuthology.orchestra.run.smithi039.stdout: "dn-": 0, 2024-09-12T02:49:18.605 INFO:teuthology.orchestra.run.smithi039.stdout: "cap": 0, 2024-09-12T02:49:18.605 INFO:teuthology.orchestra.run.smithi039.stdout: "cap+": 0, 2024-09-12T02:49:18.605 INFO:teuthology.orchestra.run.smithi039.stdout: "cap-": 0, 2024-09-12T02:49:18.605 INFO:teuthology.orchestra.run.smithi039.stdout: "rss": 47096, 2024-09-12T02:49:18.605 INFO:teuthology.orchestra.run.smithi039.stdout: "heap": 215328 2024-09-12T02:49:18.606 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-09-12T02:49:18.606 INFO:teuthology.orchestra.run.smithi039.stdout: "mds_server": { 2024-09-12T02:49:18.606 INFO:teuthology.orchestra.run.smithi039.stdout: "dispatch_client_request": 0, 2024-09-12T02:49:18.606 INFO:teuthology.orchestra.run.smithi039.stdout: "dispatch_server_request": 0, 2024-09-12T02:49:18.606 INFO:teuthology.orchestra.run.smithi039.stdout: "handle_client_request": 0, 2024-09-12T02:49:18.606 INFO:teuthology.orchestra.run.smithi039.stdout: "handle_client_session": 0, 2024-09-12T02:49:18.606 INFO:teuthology.orchestra.run.smithi039.stdout: "handle_peer_request": 0, 2024-09-12T02:49:18.606 INFO:teuthology.orchestra.run.smithi039.stdout: "req_create_latency": { 2024-09-12T02:49:18.606 INFO:teuthology.orchestra.run.smithi039.stdout: "avgcount": 0, 2024-09-12T02:49:18.606 INFO:teuthology.orchestra.run.smithi039.stdout: "sum": 0.000000000, 2024-09-12T02:49:18.606 INFO:teuthology.orchestra.run.smithi039.stdout: "avgtime": 0.000000000 2024-09-12T02:49:18.606 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-09-12T02:49:18.606 INFO:teuthology.orchestra.run.smithi039.stdout: "req_getattr_latency": { 2024-09-12T02:49:18.606 INFO:teuthology.orchestra.run.smithi039.stdout: "avgcount": 0, 2024-09-12T02:49:18.606 INFO:teuthology.orchestra.run.smithi039.stdout: "sum": 0.000000000, 2024-09-12T02:49:18.607 INFO:teuthology.orchestra.run.smithi039.stdout: "avgtime": 0.000000000 2024-09-12T02:49:18.607 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-09-12T02:49:18.607 INFO:teuthology.orchestra.run.smithi039.stdout: "req_getfilelock_latency": { 2024-09-12T02:49:18.607 INFO:teuthology.orchestra.run.smithi039.stdout: "avgcount": 0, 2024-09-12T02:49:18.607 INFO:teuthology.orchestra.run.smithi039.stdout: "sum": 0.000000000, 2024-09-12T02:49:18.607 INFO:teuthology.orchestra.run.smithi039.stdout: "avgtime": 0.000000000 2024-09-12T02:49:18.607 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-09-12T02:49:18.607 INFO:teuthology.orchestra.run.smithi039.stdout: "req_link_latency": { 2024-09-12T02:49:18.607 INFO:teuthology.orchestra.run.smithi039.stdout: "avgcount": 0, 2024-09-12T02:49:18.607 INFO:teuthology.orchestra.run.smithi039.stdout: "sum": 0.000000000, 2024-09-12T02:49:18.607 INFO:teuthology.orchestra.run.smithi039.stdout: "avgtime": 0.000000000 2024-09-12T02:49:18.607 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-09-12T02:49:18.607 INFO:teuthology.orchestra.run.smithi039.stdout: "req_lookup_latency": { 2024-09-12T02:49:18.607 INFO:teuthology.orchestra.run.smithi039.stdout: "avgcount": 0, 2024-09-12T02:49:18.608 INFO:teuthology.orchestra.run.smithi039.stdout: "sum": 0.000000000, 2024-09-12T02:49:18.608 INFO:teuthology.orchestra.run.smithi039.stdout: "avgtime": 0.000000000 2024-09-12T02:49:18.608 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-09-12T02:49:18.608 INFO:teuthology.orchestra.run.smithi039.stdout: "req_lookuphash_latency": { 2024-09-12T02:49:18.608 INFO:teuthology.orchestra.run.smithi039.stdout: "avgcount": 0, 2024-09-12T02:49:18.608 INFO:teuthology.orchestra.run.smithi039.stdout: "sum": 0.000000000, 2024-09-12T02:49:18.608 INFO:teuthology.orchestra.run.smithi039.stdout: "avgtime": 0.000000000 2024-09-12T02:49:18.608 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-09-12T02:49:18.608 INFO:teuthology.orchestra.run.smithi039.stdout: "req_lookupino_latency": { 2024-09-12T02:49:18.608 INFO:teuthology.orchestra.run.smithi039.stdout: "avgcount": 0, 2024-09-12T02:49:18.608 INFO:teuthology.orchestra.run.smithi039.stdout: "sum": 0.000000000, 2024-09-12T02:49:18.608 INFO:teuthology.orchestra.run.smithi039.stdout: "avgtime": 0.000000000 2024-09-12T02:49:18.608 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-09-12T02:49:18.608 INFO:teuthology.orchestra.run.smithi039.stdout: "req_lookupname_latency": { 2024-09-12T02:49:18.608 INFO:teuthology.orchestra.run.smithi039.stdout: "avgcount": 0, 2024-09-12T02:49:18.609 INFO:teuthology.orchestra.run.smithi039.stdout: "sum": 0.000000000, 2024-09-12T02:49:18.609 INFO:teuthology.orchestra.run.smithi039.stdout: "avgtime": 0.000000000 2024-09-12T02:49:18.609 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-09-12T02:49:18.609 INFO:teuthology.orchestra.run.smithi039.stdout: "req_lookupparent_latency": { 2024-09-12T02:49:18.609 INFO:teuthology.orchestra.run.smithi039.stdout: "avgcount": 0, 2024-09-12T02:49:18.609 INFO:teuthology.orchestra.run.smithi039.stdout: "sum": 0.000000000, 2024-09-12T02:49:18.609 INFO:teuthology.orchestra.run.smithi039.stdout: "avgtime": 0.000000000 2024-09-12T02:49:18.609 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-09-12T02:49:18.609 INFO:teuthology.orchestra.run.smithi039.stdout: "req_lookupsnap_latency": { 2024-09-12T02:49:18.609 INFO:teuthology.orchestra.run.smithi039.stdout: "avgcount": 0, 2024-09-12T02:49:18.609 INFO:teuthology.orchestra.run.smithi039.stdout: "sum": 0.000000000, 2024-09-12T02:49:18.609 INFO:teuthology.orchestra.run.smithi039.stdout: "avgtime": 0.000000000 2024-09-12T02:49:18.609 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-09-12T02:49:18.609 INFO:teuthology.orchestra.run.smithi039.stdout: "req_lssnap_latency": { 2024-09-12T02:49:18.610 INFO:teuthology.orchestra.run.smithi039.stdout: "avgcount": 0, 2024-09-12T02:49:18.610 INFO:teuthology.orchestra.run.smithi039.stdout: "sum": 0.000000000, 2024-09-12T02:49:18.610 INFO:teuthology.orchestra.run.smithi039.stdout: "avgtime": 0.000000000 2024-09-12T02:49:18.610 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-09-12T02:49:18.610 INFO:teuthology.orchestra.run.smithi039.stdout: "req_mkdir_latency": { 2024-09-12T02:49:18.610 INFO:teuthology.orchestra.run.smithi039.stdout: "avgcount": 0, 2024-09-12T02:49:18.611 INFO:teuthology.orchestra.run.smithi039.stdout: "sum": 0.000000000, 2024-09-12T02:49:18.611 INFO:teuthology.orchestra.run.smithi039.stdout: "avgtime": 0.000000000 2024-09-12T02:49:18.611 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-09-12T02:49:18.611 INFO:teuthology.orchestra.run.smithi039.stdout: "req_mknod_latency": { 2024-09-12T02:49:18.611 INFO:teuthology.orchestra.run.smithi039.stdout: "avgcount": 0, 2024-09-12T02:49:18.612 INFO:teuthology.orchestra.run.smithi039.stdout: "sum": 0.000000000, 2024-09-12T02:49:18.612 INFO:teuthology.orchestra.run.smithi039.stdout: "avgtime": 0.000000000 2024-09-12T02:49:18.612 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-09-12T02:49:18.612 INFO:teuthology.orchestra.run.smithi039.stdout: "req_mksnap_latency": { 2024-09-12T02:49:18.612 INFO:teuthology.orchestra.run.smithi039.stdout: "avgcount": 0, 2024-09-12T02:49:18.612 INFO:teuthology.orchestra.run.smithi039.stdout: "sum": 0.000000000, 2024-09-12T02:49:18.612 INFO:teuthology.orchestra.run.smithi039.stdout: "avgtime": 0.000000000 2024-09-12T02:49:18.612 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-09-12T02:49:18.612 INFO:teuthology.orchestra.run.smithi039.stdout: "req_open_latency": { 2024-09-12T02:49:18.612 INFO:teuthology.orchestra.run.smithi039.stdout: "avgcount": 0, 2024-09-12T02:49:18.612 INFO:teuthology.orchestra.run.smithi039.stdout: "sum": 0.000000000, 2024-09-12T02:49:18.612 INFO:teuthology.orchestra.run.smithi039.stdout: "avgtime": 0.000000000 2024-09-12T02:49:18.612 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-09-12T02:49:18.612 INFO:teuthology.orchestra.run.smithi039.stdout: "req_readdir_latency": { 2024-09-12T02:49:18.613 INFO:teuthology.orchestra.run.smithi039.stdout: "avgcount": 0, 2024-09-12T02:49:18.613 INFO:teuthology.orchestra.run.smithi039.stdout: "sum": 0.000000000, 2024-09-12T02:49:18.613 INFO:teuthology.orchestra.run.smithi039.stdout: "avgtime": 0.000000000 2024-09-12T02:49:18.613 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-09-12T02:49:18.613 INFO:teuthology.orchestra.run.smithi039.stdout: "req_rename_latency": { 2024-09-12T02:49:18.613 INFO:teuthology.orchestra.run.smithi039.stdout: "avgcount": 0, 2024-09-12T02:49:18.613 INFO:teuthology.orchestra.run.smithi039.stdout: "sum": 0.000000000, 2024-09-12T02:49:18.613 INFO:teuthology.orchestra.run.smithi039.stdout: "avgtime": 0.000000000 2024-09-12T02:49:18.613 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-09-12T02:49:18.613 INFO:teuthology.orchestra.run.smithi039.stdout: "req_renamesnap_latency": { 2024-09-12T02:49:18.614 INFO:teuthology.orchestra.run.smithi039.stdout: "avgcount": 0, 2024-09-12T02:49:18.614 INFO:teuthology.orchestra.run.smithi039.stdout: "sum": 0.000000000, 2024-09-12T02:49:18.614 INFO:teuthology.orchestra.run.smithi039.stdout: "avgtime": 0.000000000 2024-09-12T02:49:18.614 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-09-12T02:49:18.614 INFO:teuthology.orchestra.run.smithi039.stdout: "req_snapdiff_latency": { 2024-09-12T02:49:18.614 INFO:teuthology.orchestra.run.smithi039.stdout: "avgcount": 0, 2024-09-12T02:49:18.614 INFO:teuthology.orchestra.run.smithi039.stdout: "sum": 0.000000000, 2024-09-12T02:49:18.614 INFO:teuthology.orchestra.run.smithi039.stdout: "avgtime": 0.000000000 2024-09-12T02:49:18.615 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-09-12T02:49:18.615 INFO:teuthology.orchestra.run.smithi039.stdout: "req_rmdir_latency": { 2024-09-12T02:49:18.615 INFO:teuthology.orchestra.run.smithi039.stdout: "avgcount": 0, 2024-09-12T02:49:18.615 INFO:teuthology.orchestra.run.smithi039.stdout: "sum": 0.000000000, 2024-09-12T02:49:18.615 INFO:teuthology.orchestra.run.smithi039.stdout: "avgtime": 0.000000000 2024-09-12T02:49:18.615 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-09-12T02:49:18.615 INFO:teuthology.orchestra.run.smithi039.stdout: "req_rmsnap_latency": { 2024-09-12T02:49:18.615 INFO:teuthology.orchestra.run.smithi039.stdout: "avgcount": 0, 2024-09-12T02:49:18.615 INFO:teuthology.orchestra.run.smithi039.stdout: "sum": 0.000000000, 2024-09-12T02:49:18.615 INFO:teuthology.orchestra.run.smithi039.stdout: "avgtime": 0.000000000 2024-09-12T02:49:18.615 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-09-12T02:49:18.615 INFO:teuthology.orchestra.run.smithi039.stdout: "req_rmxattr_latency": { 2024-09-12T02:49:18.615 INFO:teuthology.orchestra.run.smithi039.stdout: "avgcount": 0, 2024-09-12T02:49:18.615 INFO:teuthology.orchestra.run.smithi039.stdout: "sum": 0.000000000, 2024-09-12T02:49:18.616 INFO:teuthology.orchestra.run.smithi039.stdout: "avgtime": 0.000000000 2024-09-12T02:49:18.616 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-09-12T02:49:18.616 INFO:teuthology.orchestra.run.smithi039.stdout: "req_setattr_latency": { 2024-09-12T02:49:18.616 INFO:teuthology.orchestra.run.smithi039.stdout: "avgcount": 0, 2024-09-12T02:49:18.616 INFO:teuthology.orchestra.run.smithi039.stdout: "sum": 0.000000000, 2024-09-12T02:49:18.616 INFO:teuthology.orchestra.run.smithi039.stdout: "avgtime": 0.000000000 2024-09-12T02:49:18.616 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-09-12T02:49:18.616 INFO:teuthology.orchestra.run.smithi039.stdout: "req_setdirlayout_latency": { 2024-09-12T02:49:18.616 INFO:teuthology.orchestra.run.smithi039.stdout: "avgcount": 0, 2024-09-12T02:49:18.617 INFO:teuthology.orchestra.run.smithi039.stdout: "sum": 0.000000000, 2024-09-12T02:49:18.617 INFO:teuthology.orchestra.run.smithi039.stdout: "avgtime": 0.000000000 2024-09-12T02:49:18.617 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-09-12T02:49:18.617 INFO:teuthology.orchestra.run.smithi039.stdout: "req_setfilelock_latency": { 2024-09-12T02:49:18.617 INFO:teuthology.orchestra.run.smithi039.stdout: "avgcount": 0, 2024-09-12T02:49:18.617 INFO:teuthology.orchestra.run.smithi039.stdout: "sum": 0.000000000, 2024-09-12T02:49:18.617 INFO:teuthology.orchestra.run.smithi039.stdout: "avgtime": 0.000000000 2024-09-12T02:49:18.617 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-09-12T02:49:18.617 INFO:teuthology.orchestra.run.smithi039.stdout: "req_setlayout_latency": { 2024-09-12T02:49:18.617 INFO:teuthology.orchestra.run.smithi039.stdout: "avgcount": 0, 2024-09-12T02:49:18.617 INFO:teuthology.orchestra.run.smithi039.stdout: "sum": 0.000000000, 2024-09-12T02:49:18.617 INFO:teuthology.orchestra.run.smithi039.stdout: "avgtime": 0.000000000 2024-09-12T02:49:18.617 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-09-12T02:49:18.617 INFO:teuthology.orchestra.run.smithi039.stdout: "req_setxattr_latency": { 2024-09-12T02:49:18.618 INFO:teuthology.orchestra.run.smithi039.stdout: "avgcount": 0, 2024-09-12T02:49:18.618 INFO:teuthology.orchestra.run.smithi039.stdout: "sum": 0.000000000, 2024-09-12T02:49:18.618 INFO:teuthology.orchestra.run.smithi039.stdout: "avgtime": 0.000000000 2024-09-12T02:49:18.618 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-09-12T02:49:18.618 INFO:teuthology.orchestra.run.smithi039.stdout: "req_symlink_latency": { 2024-09-12T02:49:18.618 INFO:teuthology.orchestra.run.smithi039.stdout: "avgcount": 0, 2024-09-12T02:49:18.618 INFO:teuthology.orchestra.run.smithi039.stdout: "sum": 0.000000000, 2024-09-12T02:49:18.618 INFO:teuthology.orchestra.run.smithi039.stdout: "avgtime": 0.000000000 2024-09-12T02:49:18.618 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-09-12T02:49:18.618 INFO:teuthology.orchestra.run.smithi039.stdout: "req_unlink_latency": { 2024-09-12T02:49:18.618 INFO:teuthology.orchestra.run.smithi039.stdout: "avgcount": 0, 2024-09-12T02:49:18.618 INFO:teuthology.orchestra.run.smithi039.stdout: "sum": 0.000000000, 2024-09-12T02:49:18.618 INFO:teuthology.orchestra.run.smithi039.stdout: "avgtime": 0.000000000 2024-09-12T02:49:18.618 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-09-12T02:49:18.619 INFO:teuthology.orchestra.run.smithi039.stdout: "cap_revoke_eviction": 0, 2024-09-12T02:49:18.619 INFO:teuthology.orchestra.run.smithi039.stdout: "cap_acquisition_throttle": 0, 2024-09-12T02:49:18.619 INFO:teuthology.orchestra.run.smithi039.stdout: "req_getvxattr_latency": { 2024-09-12T02:49:18.619 INFO:teuthology.orchestra.run.smithi039.stdout: "avgcount": 0, 2024-09-12T02:49:18.619 INFO:teuthology.orchestra.run.smithi039.stdout: "sum": 0.000000000, 2024-09-12T02:49:18.619 INFO:teuthology.orchestra.run.smithi039.stdout: "avgtime": 0.000000000 2024-09-12T02:49:18.619 INFO:teuthology.orchestra.run.smithi039.stdout: } 2024-09-12T02:49:18.619 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-09-12T02:49:18.619 INFO:teuthology.orchestra.run.smithi039.stdout: "mds_sessions": { 2024-09-12T02:49:18.619 INFO:teuthology.orchestra.run.smithi039.stdout: "session_count": 2, 2024-09-12T02:49:18.620 INFO:teuthology.orchestra.run.smithi039.stdout: "session_add": 3, 2024-09-12T02:49:18.620 INFO:teuthology.orchestra.run.smithi039.stdout: "session_remove": 1, 2024-09-12T02:49:18.620 INFO:teuthology.orchestra.run.smithi039.stdout: "sessions_open": 3, 2024-09-12T02:49:18.620 INFO:teuthology.orchestra.run.smithi039.stdout: "sessions_stale": 0, 2024-09-12T02:49:18.620 INFO:teuthology.orchestra.run.smithi039.stdout: "total_load": 0, 2024-09-12T02:49:18.620 INFO:teuthology.orchestra.run.smithi039.stdout: "average_load": 0, 2024-09-12T02:49:18.620 INFO:teuthology.orchestra.run.smithi039.stdout: "avg_session_uptime": 2499, 2024-09-12T02:49:18.620 INFO:teuthology.orchestra.run.smithi039.stdout: "mdthresh_evicted": 0 2024-09-12T02:49:18.620 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-09-12T02:49:18.620 INFO:teuthology.orchestra.run.smithi039.stdout: "mempool": { 2024-09-12T02:49:18.621 INFO:teuthology.orchestra.run.smithi039.stdout: "bloom_filter_bytes": 0, 2024-09-12T02:49:18.621 INFO:teuthology.orchestra.run.smithi039.stdout: "bloom_filter_items": 0, 2024-09-12T02:49:18.621 INFO:teuthology.orchestra.run.smithi039.stdout: "bluestore_alloc_bytes": 0, 2024-09-12T02:49:18.621 INFO:teuthology.orchestra.run.smithi039.stdout: "bluestore_alloc_items": 0, 2024-09-12T02:49:18.621 INFO:teuthology.orchestra.run.smithi039.stdout: "bluestore_cache_data_bytes": 0, 2024-09-12T02:49:18.621 INFO:teuthology.orchestra.run.smithi039.stdout: "bluestore_cache_data_items": 0, 2024-09-12T02:49:18.621 INFO:teuthology.orchestra.run.smithi039.stdout: "bluestore_cache_onode_bytes": 0, 2024-09-12T02:49:18.621 INFO:teuthology.orchestra.run.smithi039.stdout: "bluestore_cache_onode_items": 0, 2024-09-12T02:49:18.621 INFO:teuthology.orchestra.run.smithi039.stdout: "bluestore_cache_meta_bytes": 0, 2024-09-12T02:49:18.621 INFO:teuthology.orchestra.run.smithi039.stdout: "bluestore_cache_meta_items": 0, 2024-09-12T02:49:18.621 INFO:teuthology.orchestra.run.smithi039.stdout: "bluestore_cache_other_bytes": 0, 2024-09-12T02:49:18.621 INFO:teuthology.orchestra.run.smithi039.stdout: "bluestore_cache_other_items": 0, 2024-09-12T02:49:18.622 INFO:teuthology.orchestra.run.smithi039.stdout: "bluestore_cache_buffer_bytes": 0, 2024-09-12T02:49:18.622 INFO:teuthology.orchestra.run.smithi039.stdout: "bluestore_cache_buffer_items": 0, 2024-09-12T02:49:18.622 INFO:teuthology.orchestra.run.smithi039.stdout: "bluestore_extent_bytes": 0, 2024-09-12T02:49:18.622 INFO:teuthology.orchestra.run.smithi039.stdout: "bluestore_extent_items": 0, 2024-09-12T02:49:18.622 INFO:teuthology.orchestra.run.smithi039.stdout: "bluestore_blob_bytes": 0, 2024-09-12T02:49:18.622 INFO:teuthology.orchestra.run.smithi039.stdout: "bluestore_blob_items": 0, 2024-09-12T02:49:18.622 INFO:teuthology.orchestra.run.smithi039.stdout: "bluestore_shared_blob_bytes": 0, 2024-09-12T02:49:18.622 INFO:teuthology.orchestra.run.smithi039.stdout: "bluestore_shared_blob_items": 0, 2024-09-12T02:49:18.622 INFO:teuthology.orchestra.run.smithi039.stdout: "bluestore_inline_bl_bytes": 0, 2024-09-12T02:49:18.622 INFO:teuthology.orchestra.run.smithi039.stdout: "bluestore_inline_bl_items": 0, 2024-09-12T02:49:18.622 INFO:teuthology.orchestra.run.smithi039.stdout: "bluestore_fsck_bytes": 0, 2024-09-12T02:49:18.622 INFO:teuthology.orchestra.run.smithi039.stdout: "bluestore_fsck_items": 0, 2024-09-12T02:49:18.622 INFO:teuthology.orchestra.run.smithi039.stdout: "bluestore_txc_bytes": 0, 2024-09-12T02:49:18.622 INFO:teuthology.orchestra.run.smithi039.stdout: "bluestore_txc_items": 0, 2024-09-12T02:49:18.623 INFO:teuthology.orchestra.run.smithi039.stdout: "bluestore_writing_deferred_bytes": 0, 2024-09-12T02:49:18.623 INFO:teuthology.orchestra.run.smithi039.stdout: "bluestore_writing_deferred_items": 0, 2024-09-12T02:49:18.623 INFO:teuthology.orchestra.run.smithi039.stdout: "bluestore_writing_bytes": 0, 2024-09-12T02:49:18.623 INFO:teuthology.orchestra.run.smithi039.stdout: "bluestore_writing_items": 0, 2024-09-12T02:49:18.623 INFO:teuthology.orchestra.run.smithi039.stdout: "bluefs_bytes": 0, 2024-09-12T02:49:18.623 INFO:teuthology.orchestra.run.smithi039.stdout: "bluefs_items": 0, 2024-09-12T02:49:18.623 INFO:teuthology.orchestra.run.smithi039.stdout: "bluefs_file_reader_bytes": 0, 2024-09-12T02:49:18.623 INFO:teuthology.orchestra.run.smithi039.stdout: "bluefs_file_reader_items": 0, 2024-09-12T02:49:18.623 INFO:teuthology.orchestra.run.smithi039.stdout: "bluefs_file_writer_bytes": 0, 2024-09-12T02:49:18.623 INFO:teuthology.orchestra.run.smithi039.stdout: "bluefs_file_writer_items": 0, 2024-09-12T02:49:18.623 INFO:teuthology.orchestra.run.smithi039.stdout: "buffer_anon_bytes": 183112, 2024-09-12T02:49:18.623 INFO:teuthology.orchestra.run.smithi039.stdout: "buffer_anon_items": 49, 2024-09-12T02:49:18.623 INFO:teuthology.orchestra.run.smithi039.stdout: "buffer_meta_bytes": 0, 2024-09-12T02:49:18.623 INFO:teuthology.orchestra.run.smithi039.stdout: "buffer_meta_items": 0, 2024-09-12T02:49:18.624 INFO:teuthology.orchestra.run.smithi039.stdout: "osd_bytes": 0, 2024-09-12T02:49:18.624 INFO:teuthology.orchestra.run.smithi039.stdout: "osd_items": 0, 2024-09-12T02:49:18.624 INFO:teuthology.orchestra.run.smithi039.stdout: "osd_mapbl_bytes": 0, 2024-09-12T02:49:18.624 INFO:teuthology.orchestra.run.smithi039.stdout: "osd_mapbl_items": 0, 2024-09-12T02:49:18.624 INFO:teuthology.orchestra.run.smithi039.stdout: "osd_pglog_bytes": 0, 2024-09-12T02:49:18.624 INFO:teuthology.orchestra.run.smithi039.stdout: "osd_pglog_items": 0, 2024-09-12T02:49:18.624 INFO:teuthology.orchestra.run.smithi039.stdout: "osdmap_bytes": 9520, 2024-09-12T02:49:18.624 INFO:teuthology.orchestra.run.smithi039.stdout: "osdmap_items": 193, 2024-09-12T02:49:18.624 INFO:teuthology.orchestra.run.smithi039.stdout: "osdmap_mapping_bytes": 0, 2024-09-12T02:49:18.625 INFO:teuthology.orchestra.run.smithi039.stdout: "osdmap_mapping_items": 0, 2024-09-12T02:49:18.625 INFO:teuthology.orchestra.run.smithi039.stdout: "pgmap_bytes": 0, 2024-09-12T02:49:18.625 INFO:teuthology.orchestra.run.smithi039.stdout: "pgmap_items": 0, 2024-09-12T02:49:18.625 INFO:teuthology.orchestra.run.smithi039.stdout: "mds_co_bytes": 8512, 2024-09-12T02:49:18.625 INFO:teuthology.orchestra.run.smithi039.stdout: "mds_co_items": 13, 2024-09-12T02:49:18.625 INFO:teuthology.orchestra.run.smithi039.stdout: "unittest_1_bytes": 0, 2024-09-12T02:49:18.625 INFO:teuthology.orchestra.run.smithi039.stdout: "unittest_1_items": 0, 2024-09-12T02:49:18.625 INFO:teuthology.orchestra.run.smithi039.stdout: "unittest_2_bytes": 0, 2024-09-12T02:49:18.625 INFO:teuthology.orchestra.run.smithi039.stdout: "unittest_2_items": 0 2024-09-12T02:49:18.625 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-09-12T02:49:18.625 INFO:teuthology.orchestra.run.smithi039.stdout: "objecter": { 2024-09-12T02:49:18.625 INFO:teuthology.orchestra.run.smithi039.stdout: "op_active": 0, 2024-09-12T02:49:18.626 INFO:teuthology.orchestra.run.smithi039.stdout: "op_laggy": 0, 2024-09-12T02:49:18.626 INFO:teuthology.orchestra.run.smithi039.stdout: "op_send": 2302, 2024-09-12T02:49:18.626 INFO:teuthology.orchestra.run.smithi039.stdout: "op_send_bytes": 21, 2024-09-12T02:49:18.626 INFO:teuthology.orchestra.run.smithi039.stdout: "op_resend": 3, 2024-09-12T02:49:18.626 INFO:teuthology.orchestra.run.smithi039.stdout: "op_reply": 2302, 2024-09-12T02:49:18.626 INFO:teuthology.orchestra.run.smithi039.stdout: "op_latency": { 2024-09-12T02:49:18.626 INFO:teuthology.orchestra.run.smithi039.stdout: "avgcount": 2302, 2024-09-12T02:49:18.626 INFO:teuthology.orchestra.run.smithi039.stdout: "sum": 1.348973394, 2024-09-12T02:49:18.626 INFO:teuthology.orchestra.run.smithi039.stdout: "avgtime": 0.000586000 2024-09-12T02:49:18.626 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-09-12T02:49:18.626 INFO:teuthology.orchestra.run.smithi039.stdout: "op_inflight": 0, 2024-09-12T02:49:18.626 INFO:teuthology.orchestra.run.smithi039.stdout: "oplen_avg": { 2024-09-12T02:49:18.627 INFO:teuthology.orchestra.run.smithi039.stdout: "avgcount": 2302, 2024-09-12T02:49:18.627 INFO:teuthology.orchestra.run.smithi039.stdout: "sum": 2303 2024-09-12T02:49:18.627 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-09-12T02:49:18.627 INFO:teuthology.orchestra.run.smithi039.stdout: "op": 2302, 2024-09-12T02:49:18.627 INFO:teuthology.orchestra.run.smithi039.stdout: "op_r": 2302, 2024-09-12T02:49:18.627 INFO:teuthology.orchestra.run.smithi039.stdout: "op_w": 0, 2024-09-12T02:49:18.627 INFO:teuthology.orchestra.run.smithi039.stdout: "op_rmw": 0, 2024-09-12T02:49:18.627 INFO:teuthology.orchestra.run.smithi039.stdout: "op_pg": 0, 2024-09-12T02:49:18.627 INFO:teuthology.orchestra.run.smithi039.stdout: "osdop_stat": 1487, 2024-09-12T02:49:18.627 INFO:teuthology.orchestra.run.smithi039.stdout: "osdop_create": 0, 2024-09-12T02:49:18.628 INFO:teuthology.orchestra.run.smithi039.stdout: "osdop_read": 813, 2024-09-12T02:49:18.628 INFO:teuthology.orchestra.run.smithi039.stdout: "osdop_write": 0, 2024-09-12T02:49:18.628 INFO:teuthology.orchestra.run.smithi039.stdout: "osdop_writefull": 0, 2024-09-12T02:49:18.628 INFO:teuthology.orchestra.run.smithi039.stdout: "osdop_writesame": 0, 2024-09-12T02:49:18.628 INFO:teuthology.orchestra.run.smithi039.stdout: "osdop_append": 0, 2024-09-12T02:49:18.628 INFO:teuthology.orchestra.run.smithi039.stdout: "osdop_zero": 0, 2024-09-12T02:49:18.628 INFO:teuthology.orchestra.run.smithi039.stdout: "osdop_truncate": 0, 2024-09-12T02:49:18.628 INFO:teuthology.orchestra.run.smithi039.stdout: "osdop_delete": 0, 2024-09-12T02:49:18.628 INFO:teuthology.orchestra.run.smithi039.stdout: "osdop_mapext": 0, 2024-09-12T02:49:18.628 INFO:teuthology.orchestra.run.smithi039.stdout: "osdop_sparse_read": 0, 2024-09-12T02:49:18.628 INFO:teuthology.orchestra.run.smithi039.stdout: "osdop_clonerange": 0, 2024-09-12T02:49:18.628 INFO:teuthology.orchestra.run.smithi039.stdout: "osdop_getxattr": 1, 2024-09-12T02:49:18.628 INFO:teuthology.orchestra.run.smithi039.stdout: "osdop_setxattr": 0, 2024-09-12T02:49:18.628 INFO:teuthology.orchestra.run.smithi039.stdout: "osdop_cmpxattr": 0, 2024-09-12T02:49:18.629 INFO:teuthology.orchestra.run.smithi039.stdout: "osdop_rmxattr": 0, 2024-09-12T02:49:18.629 INFO:teuthology.orchestra.run.smithi039.stdout: "osdop_resetxattrs": 0, 2024-09-12T02:49:18.629 INFO:teuthology.orchestra.run.smithi039.stdout: "osdop_call": 0, 2024-09-12T02:49:18.629 INFO:teuthology.orchestra.run.smithi039.stdout: "osdop_watch": 0, 2024-09-12T02:49:18.629 INFO:teuthology.orchestra.run.smithi039.stdout: "osdop_notify": 0, 2024-09-12T02:49:18.629 INFO:teuthology.orchestra.run.smithi039.stdout: "osdop_src_cmpxattr": 0, 2024-09-12T02:49:18.629 INFO:teuthology.orchestra.run.smithi039.stdout: "osdop_pgls": 0, 2024-09-12T02:49:18.629 INFO:teuthology.orchestra.run.smithi039.stdout: "osdop_pgls_filter": 0, 2024-09-12T02:49:18.629 INFO:teuthology.orchestra.run.smithi039.stdout: "osdop_other": 0, 2024-09-12T02:49:18.629 INFO:teuthology.orchestra.run.smithi039.stdout: "linger_active": 0, 2024-09-12T02:49:18.629 INFO:teuthology.orchestra.run.smithi039.stdout: "linger_send": 0, 2024-09-12T02:49:18.629 INFO:teuthology.orchestra.run.smithi039.stdout: "linger_resend": 0, 2024-09-12T02:49:18.629 INFO:teuthology.orchestra.run.smithi039.stdout: "linger_ping": 0, 2024-09-12T02:49:18.629 INFO:teuthology.orchestra.run.smithi039.stdout: "poolop_active": 0, 2024-09-12T02:49:18.630 INFO:teuthology.orchestra.run.smithi039.stdout: "poolop_send": 0, 2024-09-12T02:49:18.630 INFO:teuthology.orchestra.run.smithi039.stdout: "poolop_resend": 0, 2024-09-12T02:49:18.630 INFO:teuthology.orchestra.run.smithi039.stdout: "poolstat_active": 0, 2024-09-12T02:49:18.630 INFO:teuthology.orchestra.run.smithi039.stdout: "poolstat_send": 0, 2024-09-12T02:49:18.630 INFO:teuthology.orchestra.run.smithi039.stdout: "poolstat_resend": 0, 2024-09-12T02:49:18.630 INFO:teuthology.orchestra.run.smithi039.stdout: "statfs_active": 0, 2024-09-12T02:49:18.630 INFO:teuthology.orchestra.run.smithi039.stdout: "statfs_send": 0, 2024-09-12T02:49:18.630 INFO:teuthology.orchestra.run.smithi039.stdout: "statfs_resend": 0, 2024-09-12T02:49:18.630 INFO:teuthology.orchestra.run.smithi039.stdout: "command_active": 0, 2024-09-12T02:49:18.630 INFO:teuthology.orchestra.run.smithi039.stdout: "command_send": 0, 2024-09-12T02:49:18.630 INFO:teuthology.orchestra.run.smithi039.stdout: "command_resend": 0, 2024-09-12T02:49:18.630 INFO:teuthology.orchestra.run.smithi039.stdout: "map_epoch": 108, 2024-09-12T02:49:18.630 INFO:teuthology.orchestra.run.smithi039.stdout: "map_full": 0, 2024-09-12T02:49:18.630 INFO:teuthology.orchestra.run.smithi039.stdout: "map_inc": 15, 2024-09-12T02:49:18.631 INFO:teuthology.orchestra.run.smithi039.stdout: "osd_sessions": 4, 2024-09-12T02:49:18.631 INFO:teuthology.orchestra.run.smithi039.stdout: "osd_session_open": 4, 2024-09-12T02:49:18.631 INFO:teuthology.orchestra.run.smithi039.stdout: "osd_session_close": 0, 2024-09-12T02:49:18.631 INFO:teuthology.orchestra.run.smithi039.stdout: "osd_laggy": 0, 2024-09-12T02:49:18.631 INFO:teuthology.orchestra.run.smithi039.stdout: "omap_wr": 0, 2024-09-12T02:49:18.631 INFO:teuthology.orchestra.run.smithi039.stdout: "omap_rd": 2, 2024-09-12T02:49:18.631 INFO:teuthology.orchestra.run.smithi039.stdout: "omap_del": 0 2024-09-12T02:49:18.631 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-09-12T02:49:18.631 INFO:teuthology.orchestra.run.smithi039.stdout: "oft": { 2024-09-12T02:49:18.631 INFO:teuthology.orchestra.run.smithi039.stdout: "omap_total_objs": 0, 2024-09-12T02:49:18.631 INFO:teuthology.orchestra.run.smithi039.stdout: "omap_total_kv_pairs": 0, 2024-09-12T02:49:18.631 INFO:teuthology.orchestra.run.smithi039.stdout: "omap_total_updates": 0, 2024-09-12T02:49:18.631 INFO:teuthology.orchestra.run.smithi039.stdout: "omap_total_removes": 0 2024-09-12T02:49:18.631 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-09-12T02:49:18.632 INFO:teuthology.orchestra.run.smithi039.stdout: "osd-slow-ops": { 2024-09-12T02:49:18.632 INFO:teuthology.orchestra.run.smithi039.stdout: "slow_ops_count": 0 2024-09-12T02:49:18.632 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-09-12T02:49:18.632 INFO:teuthology.orchestra.run.smithi039.stdout: "purge_queue": { 2024-09-12T02:49:18.632 INFO:teuthology.orchestra.run.smithi039.stdout: "pq_executing_ops": 0, 2024-09-12T02:49:18.632 INFO:teuthology.orchestra.run.smithi039.stdout: "pq_executing_ops_high_water": 0, 2024-09-12T02:49:18.632 INFO:teuthology.orchestra.run.smithi039.stdout: "pq_executing": 0, 2024-09-12T02:49:18.632 INFO:teuthology.orchestra.run.smithi039.stdout: "pq_executing_high_water": 0, 2024-09-12T02:49:18.632 INFO:teuthology.orchestra.run.smithi039.stdout: "pq_executed_ops": 0, 2024-09-12T02:49:18.632 INFO:teuthology.orchestra.run.smithi039.stdout: "pq_executed": 0, 2024-09-12T02:49:18.632 INFO:teuthology.orchestra.run.smithi039.stdout: "pq_item_in_journal": 0 2024-09-12T02:49:18.632 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-09-12T02:49:18.632 INFO:teuthology.orchestra.run.smithi039.stdout: "throttle-msgr_dispatch_throttler-mds": { 2024-09-12T02:49:18.633 INFO:teuthology.orchestra.run.smithi039.stdout: "val": 0, 2024-09-12T02:49:18.633 INFO:teuthology.orchestra.run.smithi039.stdout: "max": 104857600, 2024-09-12T02:49:18.633 INFO:teuthology.orchestra.run.smithi039.stdout: "get_started": 0, 2024-09-12T02:49:18.633 INFO:teuthology.orchestra.run.smithi039.stdout: "get": 2576, 2024-09-12T02:49:18.633 INFO:teuthology.orchestra.run.smithi039.stdout: "get_sum": 2177677, 2024-09-12T02:49:18.633 INFO:teuthology.orchestra.run.smithi039.stdout: "get_or_fail_fail": 0, 2024-09-12T02:49:18.633 INFO:teuthology.orchestra.run.smithi039.stdout: "get_or_fail_success": 2576, 2024-09-12T02:49:18.633 INFO:teuthology.orchestra.run.smithi039.stdout: "take": 0, 2024-09-12T02:49:18.633 INFO:teuthology.orchestra.run.smithi039.stdout: "take_sum": 0, 2024-09-12T02:49:18.633 INFO:teuthology.orchestra.run.smithi039.stdout: "put": 2576, 2024-09-12T02:49:18.633 INFO:teuthology.orchestra.run.smithi039.stdout: "put_sum": 2177677, 2024-09-12T02:49:18.633 INFO:teuthology.orchestra.run.smithi039.stdout: "wait": { 2024-09-12T02:49:18.633 INFO:teuthology.orchestra.run.smithi039.stdout: "avgcount": 0, 2024-09-12T02:49:18.633 INFO:teuthology.orchestra.run.smithi039.stdout: "sum": 0.000000000, 2024-09-12T02:49:18.634 INFO:teuthology.orchestra.run.smithi039.stdout: "avgtime": 0.000000000 2024-09-12T02:49:18.634 INFO:teuthology.orchestra.run.smithi039.stdout: } 2024-09-12T02:49:18.634 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-09-12T02:49:18.634 INFO:teuthology.orchestra.run.smithi039.stdout: "throttle-objecter_bytes": { 2024-09-12T02:49:18.634 INFO:teuthology.orchestra.run.smithi039.stdout: "val": 0, 2024-09-12T02:49:18.634 INFO:teuthology.orchestra.run.smithi039.stdout: "max": 104857600, 2024-09-12T02:49:18.634 INFO:teuthology.orchestra.run.smithi039.stdout: "get_started": 0, 2024-09-12T02:49:18.634 INFO:teuthology.orchestra.run.smithi039.stdout: "get": 0, 2024-09-12T02:49:18.634 INFO:teuthology.orchestra.run.smithi039.stdout: "get_sum": 0, 2024-09-12T02:49:18.634 INFO:teuthology.orchestra.run.smithi039.stdout: "get_or_fail_fail": 0, 2024-09-12T02:49:18.634 INFO:teuthology.orchestra.run.smithi039.stdout: "get_or_fail_success": 0, 2024-09-12T02:49:18.634 INFO:teuthology.orchestra.run.smithi039.stdout: "take": 2302, 2024-09-12T02:49:18.634 INFO:teuthology.orchestra.run.smithi039.stdout: "take_sum": 1831, 2024-09-12T02:49:18.634 INFO:teuthology.orchestra.run.smithi039.stdout: "put": 2302, 2024-09-12T02:49:18.635 INFO:teuthology.orchestra.run.smithi039.stdout: "put_sum": 1831, 2024-09-12T02:49:18.635 INFO:teuthology.orchestra.run.smithi039.stdout: "wait": { 2024-09-12T02:49:18.635 INFO:teuthology.orchestra.run.smithi039.stdout: "avgcount": 0, 2024-09-12T02:49:18.635 INFO:teuthology.orchestra.run.smithi039.stdout: "sum": 0.000000000, 2024-09-12T02:49:18.635 INFO:teuthology.orchestra.run.smithi039.stdout: "avgtime": 0.000000000 2024-09-12T02:49:18.635 INFO:teuthology.orchestra.run.smithi039.stdout: } 2024-09-12T02:49:18.635 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-09-12T02:49:18.635 INFO:teuthology.orchestra.run.smithi039.stdout: "throttle-objecter_ops": { 2024-09-12T02:49:18.635 INFO:teuthology.orchestra.run.smithi039.stdout: "val": 0, 2024-09-12T02:49:18.636 INFO:teuthology.orchestra.run.smithi039.stdout: "max": 1024, 2024-09-12T02:49:18.636 INFO:teuthology.orchestra.run.smithi039.stdout: "get_started": 0, 2024-09-12T02:49:18.636 INFO:teuthology.orchestra.run.smithi039.stdout: "get": 0, 2024-09-12T02:49:18.636 INFO:teuthology.orchestra.run.smithi039.stdout: "get_sum": 0, 2024-09-12T02:49:18.636 INFO:teuthology.orchestra.run.smithi039.stdout: "get_or_fail_fail": 0, 2024-09-12T02:49:18.636 INFO:teuthology.orchestra.run.smithi039.stdout: "get_or_fail_success": 0, 2024-09-12T02:49:18.636 INFO:teuthology.orchestra.run.smithi039.stdout: "take": 2302, 2024-09-12T02:49:18.636 INFO:teuthology.orchestra.run.smithi039.stdout: "take_sum": 2302, 2024-09-12T02:49:18.636 INFO:teuthology.orchestra.run.smithi039.stdout: "put": 2302, 2024-09-12T02:49:18.636 INFO:teuthology.orchestra.run.smithi039.stdout: "put_sum": 2302, 2024-09-12T02:49:18.636 INFO:teuthology.orchestra.run.smithi039.stdout: "wait": { 2024-09-12T02:49:18.636 INFO:teuthology.orchestra.run.smithi039.stdout: "avgcount": 0, 2024-09-12T02:49:18.636 INFO:teuthology.orchestra.run.smithi039.stdout: "sum": 0.000000000, 2024-09-12T02:49:18.636 INFO:teuthology.orchestra.run.smithi039.stdout: "avgtime": 0.000000000 2024-09-12T02:49:18.637 INFO:teuthology.orchestra.run.smithi039.stdout: } 2024-09-12T02:49:18.637 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-09-12T02:49:18.637 INFO:teuthology.orchestra.run.smithi039.stdout: "throttle-write_buf_throttle": { 2024-09-12T02:49:18.637 INFO:teuthology.orchestra.run.smithi039.stdout: "val": 0, 2024-09-12T02:49:18.637 INFO:teuthology.orchestra.run.smithi039.stdout: "max": 3758096384, 2024-09-12T02:49:18.637 INFO:teuthology.orchestra.run.smithi039.stdout: "get_started": 0, 2024-09-12T02:49:18.637 INFO:teuthology.orchestra.run.smithi039.stdout: "get": 0, 2024-09-12T02:49:18.637 INFO:teuthology.orchestra.run.smithi039.stdout: "get_sum": 0, 2024-09-12T02:49:18.637 INFO:teuthology.orchestra.run.smithi039.stdout: "get_or_fail_fail": 0, 2024-09-12T02:49:18.637 INFO:teuthology.orchestra.run.smithi039.stdout: "get_or_fail_success": 0, 2024-09-12T02:49:18.637 INFO:teuthology.orchestra.run.smithi039.stdout: "take": 0, 2024-09-12T02:49:18.637 INFO:teuthology.orchestra.run.smithi039.stdout: "take_sum": 0, 2024-09-12T02:49:18.637 INFO:teuthology.orchestra.run.smithi039.stdout: "put": 0, 2024-09-12T02:49:18.637 INFO:teuthology.orchestra.run.smithi039.stdout: "put_sum": 0, 2024-09-12T02:49:18.638 INFO:teuthology.orchestra.run.smithi039.stdout: "wait": { 2024-09-12T02:49:18.638 INFO:teuthology.orchestra.run.smithi039.stdout: "avgcount": 0, 2024-09-12T02:49:18.638 INFO:teuthology.orchestra.run.smithi039.stdout: "sum": 0.000000000, 2024-09-12T02:49:18.638 INFO:teuthology.orchestra.run.smithi039.stdout: "avgtime": 0.000000000 2024-09-12T02:49:18.638 INFO:teuthology.orchestra.run.smithi039.stdout: } 2024-09-12T02:49:18.638 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-09-12T02:49:18.638 INFO:teuthology.orchestra.run.smithi039.stdout: "throttle-write_buf_throttle-0x5568e40f2be0": { 2024-09-12T02:49:18.638 INFO:teuthology.orchestra.run.smithi039.stdout: "val": 0, 2024-09-12T02:49:18.638 INFO:teuthology.orchestra.run.smithi039.stdout: "max": 3758096384, 2024-09-12T02:49:18.638 INFO:teuthology.orchestra.run.smithi039.stdout: "get_started": 0, 2024-09-12T02:49:18.638 INFO:teuthology.orchestra.run.smithi039.stdout: "get": 0, 2024-09-12T02:49:18.639 INFO:teuthology.orchestra.run.smithi039.stdout: "get_sum": 0, 2024-09-12T02:49:18.639 INFO:teuthology.orchestra.run.smithi039.stdout: "get_or_fail_fail": 0, 2024-09-12T02:49:18.639 INFO:teuthology.orchestra.run.smithi039.stdout: "get_or_fail_success": 0, 2024-09-12T02:49:18.639 INFO:teuthology.orchestra.run.smithi039.stdout: "take": 0, 2024-09-12T02:49:18.639 INFO:teuthology.orchestra.run.smithi039.stdout: "take_sum": 0, 2024-09-12T02:49:18.639 INFO:teuthology.orchestra.run.smithi039.stdout: "put": 0, 2024-09-12T02:49:18.639 INFO:teuthology.orchestra.run.smithi039.stdout: "put_sum": 0, 2024-09-12T02:49:18.639 INFO:teuthology.orchestra.run.smithi039.stdout: "wait": { 2024-09-12T02:49:18.639 INFO:teuthology.orchestra.run.smithi039.stdout: "avgcount": 0, 2024-09-12T02:49:18.639 INFO:teuthology.orchestra.run.smithi039.stdout: "sum": 0.000000000, 2024-09-12T02:49:18.639 INFO:teuthology.orchestra.run.smithi039.stdout: "avgtime": 0.000000000 2024-09-12T02:49:18.639 INFO:teuthology.orchestra.run.smithi039.stdout: } 2024-09-12T02:49:18.639 INFO:teuthology.orchestra.run.smithi039.stdout: } 2024-09-12T02:49:18.639 INFO:teuthology.orchestra.run.smithi039.stdout:} 2024-09-12T02:49:19.424 INFO:tasks.check_counter:Daemon mds.d mds.exported=0 2024-09-12T02:49:19.424 INFO:tasks.check_counter:Daemon mds.d mds.imported=0 2024-09-12T02:49:19.424 INFO:tasks.check_counter:Daemon mds.d mds_cache.dir_update=0 2024-09-12T02:49:19.424 INFO:tasks.check_counter:Daemon mds.d mds_cache.dir_update_receipt=0 2024-09-12T02:49:19.425 INFO:tasks.check_counter:Daemon mds.d mds.root_rsnaps=0 2024-09-12T02:49:19.425 INFO:tasks.check_counter:Daemon mds.d mds_server.req_mksnap_latency.avgcount=0 2024-09-12T02:49:19.425 INFO:tasks.check_counter:Daemon mds.d mds_server.req_rmsnap_latency.avgcount=0 2024-09-12T02:49:19.425 DEBUG:tasks.check_counter:Getting stats from g 2024-09-12T02:49:19.425 DEBUG:teuthology.orchestra.run.smithi039:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc shell --fsid 4954ed46-70ae-11ef-bcea-c7b262605968 -- ceph daemon mds.g perf dump 2024-09-12T02:49:19.803 INFO:teuthology.orchestra.run.smithi039.stderr:Inferring config /var/lib/ceph/4954ed46-70ae-11ef-bcea-c7b262605968/mon.a/config 2024-09-12T02:49:19.948 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 12 02:49:19 smithi044 ceph-mon[35411]: pgmap v356: 129 pgs: 129 active+clean; 24 MiB data, 490 MiB used, 1.0 TiB / 1.0 TiB avail; 32 KiB/s rd, 26 KiB/s wr, 15 op/s 2024-09-12T02:49:19.983 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 02:49:19 smithi039 ceph-mon[30515]: pgmap v356: 129 pgs: 129 active+clean; 24 MiB data, 490 MiB used, 1.0 TiB / 1.0 TiB avail; 32 KiB/s rd, 26 KiB/s wr, 15 op/s 2024-09-12T02:49:20.013 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 12 02:49:19 smithi172 ceph-mon[35609]: pgmap v356: 129 pgs: 129 active+clean; 24 MiB data, 490 MiB used, 1.0 TiB / 1.0 TiB avail; 32 KiB/s rd, 26 KiB/s wr, 15 op/s 2024-09-12T02:49:20.442 INFO:teuthology.orchestra.run.smithi039.stdout:{ 2024-09-12T02:49:20.442 INFO:teuthology.orchestra.run.smithi039.stdout: "AsyncMessenger::Worker-0": { 2024-09-12T02:49:20.443 INFO:teuthology.orchestra.run.smithi039.stdout: "msgr_recv_messages": 0, 2024-09-12T02:49:20.443 INFO:teuthology.orchestra.run.smithi039.stdout: "msgr_send_messages": 2, 2024-09-12T02:49:20.443 INFO:teuthology.orchestra.run.smithi039.stdout: "msgr_recv_bytes": 0, 2024-09-12T02:49:20.443 INFO:teuthology.orchestra.run.smithi039.stdout: "msgr_send_bytes": 0, 2024-09-12T02:49:20.443 INFO:teuthology.orchestra.run.smithi039.stdout: "msgr_created_connections": 4, 2024-09-12T02:49:20.443 INFO:teuthology.orchestra.run.smithi039.stdout: "msgr_active_connections": 0, 2024-09-12T02:49:20.443 INFO:teuthology.orchestra.run.smithi039.stdout: "msgr_running_total_time": 0.003595676, 2024-09-12T02:49:20.443 INFO:teuthology.orchestra.run.smithi039.stdout: "msgr_running_send_time": 0.000000000, 2024-09-12T02:49:20.443 INFO:teuthology.orchestra.run.smithi039.stdout: "msgr_running_recv_time": 0.000537026, 2024-09-12T02:49:20.443 INFO:teuthology.orchestra.run.smithi039.stdout: "msgr_running_fast_dispatch_time": 0.000000000, 2024-09-12T02:49:20.443 INFO:teuthology.orchestra.run.smithi039.stdout: "msgr_send_messages_queue_lat": { 2024-09-12T02:49:20.444 INFO:teuthology.orchestra.run.smithi039.stdout: "avgcount": 0, 2024-09-12T02:49:20.444 INFO:teuthology.orchestra.run.smithi039.stdout: "sum": 0.000000000, 2024-09-12T02:49:20.444 INFO:teuthology.orchestra.run.smithi039.stdout: "avgtime": 0.000000000 2024-09-12T02:49:20.444 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-09-12T02:49:20.444 INFO:teuthology.orchestra.run.smithi039.stdout: "msgr_handle_ack_lat": { 2024-09-12T02:49:20.444 INFO:teuthology.orchestra.run.smithi039.stdout: "avgcount": 0, 2024-09-12T02:49:20.445 INFO:teuthology.orchestra.run.smithi039.stdout: "sum": 0.000000000, 2024-09-12T02:49:20.445 INFO:teuthology.orchestra.run.smithi039.stdout: "avgtime": 0.000000000 2024-09-12T02:49:20.445 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-09-12T02:49:20.445 INFO:teuthology.orchestra.run.smithi039.stdout: "msgr_recv_encrypted_bytes": 0, 2024-09-12T02:49:20.445 INFO:teuthology.orchestra.run.smithi039.stdout: "msgr_send_encrypted_bytes": 0 2024-09-12T02:49:20.445 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-09-12T02:49:20.445 INFO:teuthology.orchestra.run.smithi039.stdout: "AsyncMessenger::Worker-1": { 2024-09-12T02:49:20.445 INFO:teuthology.orchestra.run.smithi039.stdout: "msgr_recv_messages": 250, 2024-09-12T02:49:20.445 INFO:teuthology.orchestra.run.smithi039.stdout: "msgr_send_messages": 236, 2024-09-12T02:49:20.445 INFO:teuthology.orchestra.run.smithi039.stdout: "msgr_recv_bytes": 1728352, 2024-09-12T02:49:20.446 INFO:teuthology.orchestra.run.smithi039.stdout: "msgr_send_bytes": 144512, 2024-09-12T02:49:20.446 INFO:teuthology.orchestra.run.smithi039.stdout: "msgr_created_connections": 2, 2024-09-12T02:49:20.446 INFO:teuthology.orchestra.run.smithi039.stdout: "msgr_active_connections": 1, 2024-09-12T02:49:20.446 INFO:teuthology.orchestra.run.smithi039.stdout: "msgr_running_total_time": 0.061477508, 2024-09-12T02:49:20.446 INFO:teuthology.orchestra.run.smithi039.stdout: "msgr_running_send_time": 0.025227218, 2024-09-12T02:49:20.446 INFO:teuthology.orchestra.run.smithi039.stdout: "msgr_running_recv_time": 0.051498023, 2024-09-12T02:49:20.446 INFO:teuthology.orchestra.run.smithi039.stdout: "msgr_running_fast_dispatch_time": 0.000000000, 2024-09-12T02:49:20.446 INFO:teuthology.orchestra.run.smithi039.stdout: "msgr_send_messages_queue_lat": { 2024-09-12T02:49:20.446 INFO:teuthology.orchestra.run.smithi039.stdout: "avgcount": 236, 2024-09-12T02:49:20.447 INFO:teuthology.orchestra.run.smithi039.stdout: "sum": 0.025532703, 2024-09-12T02:49:20.447 INFO:teuthology.orchestra.run.smithi039.stdout: "avgtime": 0.000108189 2024-09-12T02:49:20.447 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-09-12T02:49:20.447 INFO:teuthology.orchestra.run.smithi039.stdout: "msgr_handle_ack_lat": { 2024-09-12T02:49:20.447 INFO:teuthology.orchestra.run.smithi039.stdout: "avgcount": 0, 2024-09-12T02:49:20.447 INFO:teuthology.orchestra.run.smithi039.stdout: "sum": 0.000000000, 2024-09-12T02:49:20.447 INFO:teuthology.orchestra.run.smithi039.stdout: "avgtime": 0.000000000 2024-09-12T02:49:20.447 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-09-12T02:49:20.448 INFO:teuthology.orchestra.run.smithi039.stdout: "msgr_recv_encrypted_bytes": 1728352, 2024-09-12T02:49:20.448 INFO:teuthology.orchestra.run.smithi039.stdout: "msgr_send_encrypted_bytes": 144512 2024-09-12T02:49:20.448 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-09-12T02:49:20.448 INFO:teuthology.orchestra.run.smithi039.stdout: "AsyncMessenger::Worker-2": { 2024-09-12T02:49:20.448 INFO:teuthology.orchestra.run.smithi039.stdout: "msgr_recv_messages": 2, 2024-09-12T02:49:20.448 INFO:teuthology.orchestra.run.smithi039.stdout: "msgr_send_messages": 179, 2024-09-12T02:49:20.448 INFO:teuthology.orchestra.run.smithi039.stdout: "msgr_recv_bytes": 320, 2024-09-12T02:49:20.448 INFO:teuthology.orchestra.run.smithi039.stdout: "msgr_send_bytes": 188864, 2024-09-12T02:49:20.448 INFO:teuthology.orchestra.run.smithi039.stdout: "msgr_created_connections": 5, 2024-09-12T02:49:20.448 INFO:teuthology.orchestra.run.smithi039.stdout: "msgr_active_connections": 3, 2024-09-12T02:49:20.448 INFO:teuthology.orchestra.run.smithi039.stdout: "msgr_running_total_time": 0.022912243, 2024-09-12T02:49:20.448 INFO:teuthology.orchestra.run.smithi039.stdout: "msgr_running_send_time": 0.016135800, 2024-09-12T02:49:20.448 INFO:teuthology.orchestra.run.smithi039.stdout: "msgr_running_recv_time": 0.002683660, 2024-09-12T02:49:20.449 INFO:teuthology.orchestra.run.smithi039.stdout: "msgr_running_fast_dispatch_time": 0.000000000, 2024-09-12T02:49:20.449 INFO:teuthology.orchestra.run.smithi039.stdout: "msgr_send_messages_queue_lat": { 2024-09-12T02:49:20.449 INFO:teuthology.orchestra.run.smithi039.stdout: "avgcount": 176, 2024-09-12T02:49:20.449 INFO:teuthology.orchestra.run.smithi039.stdout: "sum": 0.025574323, 2024-09-12T02:49:20.449 INFO:teuthology.orchestra.run.smithi039.stdout: "avgtime": 0.000145308 2024-09-12T02:49:20.449 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-09-12T02:49:20.449 INFO:teuthology.orchestra.run.smithi039.stdout: "msgr_handle_ack_lat": { 2024-09-12T02:49:20.449 INFO:teuthology.orchestra.run.smithi039.stdout: "avgcount": 0, 2024-09-12T02:49:20.449 INFO:teuthology.orchestra.run.smithi039.stdout: "sum": 0.000000000, 2024-09-12T02:49:20.449 INFO:teuthology.orchestra.run.smithi039.stdout: "avgtime": 0.000000000 2024-09-12T02:49:20.449 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-09-12T02:49:20.449 INFO:teuthology.orchestra.run.smithi039.stdout: "msgr_recv_encrypted_bytes": 320, 2024-09-12T02:49:20.449 INFO:teuthology.orchestra.run.smithi039.stdout: "msgr_send_encrypted_bytes": 188864 2024-09-12T02:49:20.450 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-09-12T02:49:20.450 INFO:teuthology.orchestra.run.smithi039.stdout: "cct": { 2024-09-12T02:49:20.450 INFO:teuthology.orchestra.run.smithi039.stdout: "total_workers": 0, 2024-09-12T02:49:20.450 INFO:teuthology.orchestra.run.smithi039.stdout: "unhealthy_workers": 0 2024-09-12T02:49:20.450 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-09-12T02:49:20.450 INFO:teuthology.orchestra.run.smithi039.stdout: "mempool": { 2024-09-12T02:49:20.450 INFO:teuthology.orchestra.run.smithi039.stdout: "bloom_filter_bytes": 0, 2024-09-12T02:49:20.450 INFO:teuthology.orchestra.run.smithi039.stdout: "bloom_filter_items": 0, 2024-09-12T02:49:20.450 INFO:teuthology.orchestra.run.smithi039.stdout: "bluestore_alloc_bytes": 0, 2024-09-12T02:49:20.450 INFO:teuthology.orchestra.run.smithi039.stdout: "bluestore_alloc_items": 0, 2024-09-12T02:49:20.450 INFO:teuthology.orchestra.run.smithi039.stdout: "bluestore_cache_data_bytes": 0, 2024-09-12T02:49:20.451 INFO:teuthology.orchestra.run.smithi039.stdout: "bluestore_cache_data_items": 0, 2024-09-12T02:49:20.451 INFO:teuthology.orchestra.run.smithi039.stdout: "bluestore_cache_onode_bytes": 0, 2024-09-12T02:49:20.451 INFO:teuthology.orchestra.run.smithi039.stdout: "bluestore_cache_onode_items": 0, 2024-09-12T02:49:20.451 INFO:teuthology.orchestra.run.smithi039.stdout: "bluestore_cache_meta_bytes": 0, 2024-09-12T02:49:20.451 INFO:teuthology.orchestra.run.smithi039.stdout: "bluestore_cache_meta_items": 0, 2024-09-12T02:49:20.451 INFO:teuthology.orchestra.run.smithi039.stdout: "bluestore_cache_other_bytes": 0, 2024-09-12T02:49:20.451 INFO:teuthology.orchestra.run.smithi039.stdout: "bluestore_cache_other_items": 0, 2024-09-12T02:49:20.451 INFO:teuthology.orchestra.run.smithi039.stdout: "bluestore_cache_buffer_bytes": 0, 2024-09-12T02:49:20.451 INFO:teuthology.orchestra.run.smithi039.stdout: "bluestore_cache_buffer_items": 0, 2024-09-12T02:49:20.451 INFO:teuthology.orchestra.run.smithi039.stdout: "bluestore_extent_bytes": 0, 2024-09-12T02:49:20.451 INFO:teuthology.orchestra.run.smithi039.stdout: "bluestore_extent_items": 0, 2024-09-12T02:49:20.451 INFO:teuthology.orchestra.run.smithi039.stdout: "bluestore_blob_bytes": 0, 2024-09-12T02:49:20.451 INFO:teuthology.orchestra.run.smithi039.stdout: "bluestore_blob_items": 0, 2024-09-12T02:49:20.451 INFO:teuthology.orchestra.run.smithi039.stdout: "bluestore_shared_blob_bytes": 0, 2024-09-12T02:49:20.451 INFO:teuthology.orchestra.run.smithi039.stdout: "bluestore_shared_blob_items": 0, 2024-09-12T02:49:20.452 INFO:teuthology.orchestra.run.smithi039.stdout: "bluestore_inline_bl_bytes": 0, 2024-09-12T02:49:20.452 INFO:teuthology.orchestra.run.smithi039.stdout: "bluestore_inline_bl_items": 0, 2024-09-12T02:49:20.452 INFO:teuthology.orchestra.run.smithi039.stdout: "bluestore_fsck_bytes": 0, 2024-09-12T02:49:20.452 INFO:teuthology.orchestra.run.smithi039.stdout: "bluestore_fsck_items": 0, 2024-09-12T02:49:20.452 INFO:teuthology.orchestra.run.smithi039.stdout: "bluestore_txc_bytes": 0, 2024-09-12T02:49:20.452 INFO:teuthology.orchestra.run.smithi039.stdout: "bluestore_txc_items": 0, 2024-09-12T02:49:20.452 INFO:teuthology.orchestra.run.smithi039.stdout: "bluestore_writing_deferred_bytes": 0, 2024-09-12T02:49:20.452 INFO:teuthology.orchestra.run.smithi039.stdout: "bluestore_writing_deferred_items": 0, 2024-09-12T02:49:20.452 INFO:teuthology.orchestra.run.smithi039.stdout: "bluestore_writing_bytes": 0, 2024-09-12T02:49:20.452 INFO:teuthology.orchestra.run.smithi039.stdout: "bluestore_writing_items": 0, 2024-09-12T02:49:20.452 INFO:teuthology.orchestra.run.smithi039.stdout: "bluefs_bytes": 0, 2024-09-12T02:49:20.452 INFO:teuthology.orchestra.run.smithi039.stdout: "bluefs_items": 0, 2024-09-12T02:49:20.453 INFO:teuthology.orchestra.run.smithi039.stdout: "bluefs_file_reader_bytes": 0, 2024-09-12T02:49:20.453 INFO:teuthology.orchestra.run.smithi039.stdout: "bluefs_file_reader_items": 0, 2024-09-12T02:49:20.453 INFO:teuthology.orchestra.run.smithi039.stdout: "bluefs_file_writer_bytes": 0, 2024-09-12T02:49:20.453 INFO:teuthology.orchestra.run.smithi039.stdout: "bluefs_file_writer_items": 0, 2024-09-12T02:49:20.453 INFO:teuthology.orchestra.run.smithi039.stdout: "buffer_anon_bytes": 148714, 2024-09-12T02:49:20.453 INFO:teuthology.orchestra.run.smithi039.stdout: "buffer_anon_items": 30, 2024-09-12T02:49:20.453 INFO:teuthology.orchestra.run.smithi039.stdout: "buffer_meta_bytes": 0, 2024-09-12T02:49:20.453 INFO:teuthology.orchestra.run.smithi039.stdout: "buffer_meta_items": 0, 2024-09-12T02:49:20.453 INFO:teuthology.orchestra.run.smithi039.stdout: "osd_bytes": 0, 2024-09-12T02:49:20.453 INFO:teuthology.orchestra.run.smithi039.stdout: "osd_items": 0, 2024-09-12T02:49:20.453 INFO:teuthology.orchestra.run.smithi039.stdout: "osd_mapbl_bytes": 0, 2024-09-12T02:49:20.453 INFO:teuthology.orchestra.run.smithi039.stdout: "osd_mapbl_items": 0, 2024-09-12T02:49:20.453 INFO:teuthology.orchestra.run.smithi039.stdout: "osd_pglog_bytes": 0, 2024-09-12T02:49:20.454 INFO:teuthology.orchestra.run.smithi039.stdout: "osd_pglog_items": 0, 2024-09-12T02:49:20.454 INFO:teuthology.orchestra.run.smithi039.stdout: "osdmap_bytes": 0, 2024-09-12T02:49:20.454 INFO:teuthology.orchestra.run.smithi039.stdout: "osdmap_items": 0, 2024-09-12T02:49:20.454 INFO:teuthology.orchestra.run.smithi039.stdout: "osdmap_mapping_bytes": 0, 2024-09-12T02:49:20.454 INFO:teuthology.orchestra.run.smithi039.stdout: "osdmap_mapping_items": 0, 2024-09-12T02:49:20.454 INFO:teuthology.orchestra.run.smithi039.stdout: "pgmap_bytes": 0, 2024-09-12T02:49:20.454 INFO:teuthology.orchestra.run.smithi039.stdout: "pgmap_items": 0, 2024-09-12T02:49:20.454 INFO:teuthology.orchestra.run.smithi039.stdout: "mds_co_bytes": 928, 2024-09-12T02:49:20.454 INFO:teuthology.orchestra.run.smithi039.stdout: "mds_co_items": 2, 2024-09-12T02:49:20.454 INFO:teuthology.orchestra.run.smithi039.stdout: "unittest_1_bytes": 0, 2024-09-12T02:49:20.454 INFO:teuthology.orchestra.run.smithi039.stdout: "unittest_1_items": 0, 2024-09-12T02:49:20.454 INFO:teuthology.orchestra.run.smithi039.stdout: "unittest_2_bytes": 0, 2024-09-12T02:49:20.455 INFO:teuthology.orchestra.run.smithi039.stdout: "unittest_2_items": 0 2024-09-12T02:49:20.455 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-09-12T02:49:20.455 INFO:teuthology.orchestra.run.smithi039.stdout: "throttle-msgr_dispatch_throttler-mds": { 2024-09-12T02:49:20.455 INFO:teuthology.orchestra.run.smithi039.stdout: "val": 0, 2024-09-12T02:49:20.455 INFO:teuthology.orchestra.run.smithi039.stdout: "max": 104857600, 2024-09-12T02:49:20.455 INFO:teuthology.orchestra.run.smithi039.stdout: "get_started": 0, 2024-09-12T02:49:20.456 INFO:teuthology.orchestra.run.smithi039.stdout: "get": 248, 2024-09-12T02:49:20.456 INFO:teuthology.orchestra.run.smithi039.stdout: "get_sum": 1690603, 2024-09-12T02:49:20.456 INFO:teuthology.orchestra.run.smithi039.stdout: "get_or_fail_fail": 0, 2024-09-12T02:49:20.456 INFO:teuthology.orchestra.run.smithi039.stdout: "get_or_fail_success": 248, 2024-09-12T02:49:20.456 INFO:teuthology.orchestra.run.smithi039.stdout: "take": 0, 2024-09-12T02:49:20.456 INFO:teuthology.orchestra.run.smithi039.stdout: "take_sum": 0, 2024-09-12T02:49:20.457 INFO:teuthology.orchestra.run.smithi039.stdout: "put": 248, 2024-09-12T02:49:20.457 INFO:teuthology.orchestra.run.smithi039.stdout: "put_sum": 1690603, 2024-09-12T02:49:20.457 INFO:teuthology.orchestra.run.smithi039.stdout: "wait": { 2024-09-12T02:49:20.457 INFO:teuthology.orchestra.run.smithi039.stdout: "avgcount": 0, 2024-09-12T02:49:20.457 INFO:teuthology.orchestra.run.smithi039.stdout: "sum": 0.000000000, 2024-09-12T02:49:20.458 INFO:teuthology.orchestra.run.smithi039.stdout: "avgtime": 0.000000000 2024-09-12T02:49:20.458 INFO:teuthology.orchestra.run.smithi039.stdout: } 2024-09-12T02:49:20.458 INFO:teuthology.orchestra.run.smithi039.stdout: } 2024-09-12T02:49:20.458 INFO:teuthology.orchestra.run.smithi039.stdout:} 2024-09-12T02:49:21.161 WARNING:tasks.check_counter:Counter 'mds.exported' not found on daemon mds.g 2024-09-12T02:49:21.161 WARNING:tasks.check_counter:Counter 'mds.imported' not found on daemon mds.g 2024-09-12T02:49:21.162 WARNING:tasks.check_counter:Counter 'mds_cache.dir_update' not found on daemon mds.g 2024-09-12T02:49:21.162 WARNING:tasks.check_counter:Counter 'mds_cache.dir_update_receipt' not found on daemon mds.g 2024-09-12T02:49:21.162 WARNING:tasks.check_counter:Counter 'mds.root_rsnaps' not found on daemon mds.g 2024-09-12T02:49:21.162 WARNING:tasks.check_counter:Counter 'mds_server.req_mksnap_latency.avgcount' not found on daemon mds.g 2024-09-12T02:49:21.162 WARNING:tasks.check_counter:Counter 'mds_server.req_rmsnap_latency.avgcount' not found on daemon mds.g 2024-09-12T02:49:21.162 DEBUG:tasks.check_counter:Getting stats from j 2024-09-12T02:49:21.162 DEBUG:teuthology.orchestra.run.smithi039:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc shell --fsid 4954ed46-70ae-11ef-bcea-c7b262605968 -- ceph daemon mds.j perf dump 2024-09-12T02:49:21.538 INFO:teuthology.orchestra.run.smithi039.stderr:Inferring config /var/lib/ceph/4954ed46-70ae-11ef-bcea-c7b262605968/mon.a/config 2024-09-12T02:49:22.013 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 12 02:49:21 smithi172 ceph-mon[35609]: pgmap v357: 129 pgs: 129 active+clean; 24 MiB data, 490 MiB used, 1.0 TiB / 1.0 TiB avail; 32 KiB/s rd, 26 KiB/s wr, 15 op/s 2024-09-12T02:49:22.099 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 02:49:21 smithi039 ceph-mon[30515]: pgmap v357: 129 pgs: 129 active+clean; 24 MiB data, 490 MiB used, 1.0 TiB / 1.0 TiB avail; 32 KiB/s rd, 26 KiB/s wr, 15 op/s 2024-09-12T02:49:22.198 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 12 02:49:21 smithi044 ceph-mon[35411]: pgmap v357: 129 pgs: 129 active+clean; 24 MiB data, 490 MiB used, 1.0 TiB / 1.0 TiB avail; 32 KiB/s rd, 26 KiB/s wr, 15 op/s 2024-09-12T02:49:22.316 INFO:teuthology.orchestra.run.smithi039.stdout:{ 2024-09-12T02:49:22.316 INFO:teuthology.orchestra.run.smithi039.stdout: "AsyncMessenger::Worker-0": { 2024-09-12T02:49:22.317 INFO:teuthology.orchestra.run.smithi039.stdout: "msgr_recv_messages": 0, 2024-09-12T02:49:22.317 INFO:teuthology.orchestra.run.smithi039.stdout: "msgr_send_messages": 2, 2024-09-12T02:49:22.317 INFO:teuthology.orchestra.run.smithi039.stdout: "msgr_recv_bytes": 0, 2024-09-12T02:49:22.317 INFO:teuthology.orchestra.run.smithi039.stdout: "msgr_send_bytes": 0, 2024-09-12T02:49:22.317 INFO:teuthology.orchestra.run.smithi039.stdout: "msgr_created_connections": 4, 2024-09-12T02:49:22.317 INFO:teuthology.orchestra.run.smithi039.stdout: "msgr_active_connections": 0, 2024-09-12T02:49:22.317 INFO:teuthology.orchestra.run.smithi039.stdout: "msgr_running_total_time": 0.003521207, 2024-09-12T02:49:22.317 INFO:teuthology.orchestra.run.smithi039.stdout: "msgr_running_send_time": 0.000000000, 2024-09-12T02:49:22.317 INFO:teuthology.orchestra.run.smithi039.stdout: "msgr_running_recv_time": 0.000749134, 2024-09-12T02:49:22.317 INFO:teuthology.orchestra.run.smithi039.stdout: "msgr_running_fast_dispatch_time": 0.000000000, 2024-09-12T02:49:22.318 INFO:teuthology.orchestra.run.smithi039.stdout: "msgr_send_messages_queue_lat": { 2024-09-12T02:49:22.318 INFO:teuthology.orchestra.run.smithi039.stdout: "avgcount": 0, 2024-09-12T02:49:22.318 INFO:teuthology.orchestra.run.smithi039.stdout: "sum": 0.000000000, 2024-09-12T02:49:22.318 INFO:teuthology.orchestra.run.smithi039.stdout: "avgtime": 0.000000000 2024-09-12T02:49:22.318 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-09-12T02:49:22.318 INFO:teuthology.orchestra.run.smithi039.stdout: "msgr_handle_ack_lat": { 2024-09-12T02:49:22.318 INFO:teuthology.orchestra.run.smithi039.stdout: "avgcount": 0, 2024-09-12T02:49:22.318 INFO:teuthology.orchestra.run.smithi039.stdout: "sum": 0.000000000, 2024-09-12T02:49:22.318 INFO:teuthology.orchestra.run.smithi039.stdout: "avgtime": 0.000000000 2024-09-12T02:49:22.318 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-09-12T02:49:22.318 INFO:teuthology.orchestra.run.smithi039.stdout: "msgr_recv_encrypted_bytes": 0, 2024-09-12T02:49:22.318 INFO:teuthology.orchestra.run.smithi039.stdout: "msgr_send_encrypted_bytes": 0 2024-09-12T02:49:22.318 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-09-12T02:49:22.319 INFO:teuthology.orchestra.run.smithi039.stdout: "AsyncMessenger::Worker-1": { 2024-09-12T02:49:22.319 INFO:teuthology.orchestra.run.smithi039.stdout: "msgr_recv_messages": 252, 2024-09-12T02:49:22.319 INFO:teuthology.orchestra.run.smithi039.stdout: "msgr_send_messages": 240, 2024-09-12T02:49:22.319 INFO:teuthology.orchestra.run.smithi039.stdout: "msgr_recv_bytes": 1726912, 2024-09-12T02:49:22.319 INFO:teuthology.orchestra.run.smithi039.stdout: "msgr_send_bytes": 147904, 2024-09-12T02:49:22.319 INFO:teuthology.orchestra.run.smithi039.stdout: "msgr_created_connections": 2, 2024-09-12T02:49:22.319 INFO:teuthology.orchestra.run.smithi039.stdout: "msgr_active_connections": 1, 2024-09-12T02:49:22.319 INFO:teuthology.orchestra.run.smithi039.stdout: "msgr_running_total_time": 0.061373838, 2024-09-12T02:49:22.319 INFO:teuthology.orchestra.run.smithi039.stdout: "msgr_running_send_time": 0.026664260, 2024-09-12T02:49:22.319 INFO:teuthology.orchestra.run.smithi039.stdout: "msgr_running_recv_time": 0.049872219, 2024-09-12T02:49:22.319 INFO:teuthology.orchestra.run.smithi039.stdout: "msgr_running_fast_dispatch_time": 0.000000000, 2024-09-12T02:49:22.319 INFO:teuthology.orchestra.run.smithi039.stdout: "msgr_send_messages_queue_lat": { 2024-09-12T02:49:22.320 INFO:teuthology.orchestra.run.smithi039.stdout: "avgcount": 239, 2024-09-12T02:49:22.320 INFO:teuthology.orchestra.run.smithi039.stdout: "sum": 0.020039367, 2024-09-12T02:49:22.320 INFO:teuthology.orchestra.run.smithi039.stdout: "avgtime": 0.000083846 2024-09-12T02:49:22.320 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-09-12T02:49:22.320 INFO:teuthology.orchestra.run.smithi039.stdout: "msgr_handle_ack_lat": { 2024-09-12T02:49:22.320 INFO:teuthology.orchestra.run.smithi039.stdout: "avgcount": 0, 2024-09-12T02:49:22.320 INFO:teuthology.orchestra.run.smithi039.stdout: "sum": 0.000000000, 2024-09-12T02:49:22.320 INFO:teuthology.orchestra.run.smithi039.stdout: "avgtime": 0.000000000 2024-09-12T02:49:22.320 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-09-12T02:49:22.320 INFO:teuthology.orchestra.run.smithi039.stdout: "msgr_recv_encrypted_bytes": 1726912, 2024-09-12T02:49:22.320 INFO:teuthology.orchestra.run.smithi039.stdout: "msgr_send_encrypted_bytes": 147904 2024-09-12T02:49:22.320 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-09-12T02:49:22.320 INFO:teuthology.orchestra.run.smithi039.stdout: "AsyncMessenger::Worker-2": { 2024-09-12T02:49:22.321 INFO:teuthology.orchestra.run.smithi039.stdout: "msgr_recv_messages": 6, 2024-09-12T02:49:22.321 INFO:teuthology.orchestra.run.smithi039.stdout: "msgr_send_messages": 186, 2024-09-12T02:49:22.321 INFO:teuthology.orchestra.run.smithi039.stdout: "msgr_recv_bytes": 3392, 2024-09-12T02:49:22.321 INFO:teuthology.orchestra.run.smithi039.stdout: "msgr_send_bytes": 190192, 2024-09-12T02:49:22.321 INFO:teuthology.orchestra.run.smithi039.stdout: "msgr_created_connections": 5, 2024-09-12T02:49:22.321 INFO:teuthology.orchestra.run.smithi039.stdout: "msgr_active_connections": 3, 2024-09-12T02:49:22.322 INFO:teuthology.orchestra.run.smithi039.stdout: "msgr_running_total_time": 0.025760002, 2024-09-12T02:49:22.322 INFO:teuthology.orchestra.run.smithi039.stdout: "msgr_running_send_time": 0.016795613, 2024-09-12T02:49:22.322 INFO:teuthology.orchestra.run.smithi039.stdout: "msgr_running_recv_time": 0.005398239, 2024-09-12T02:49:22.322 INFO:teuthology.orchestra.run.smithi039.stdout: "msgr_running_fast_dispatch_time": 0.000000000, 2024-09-12T02:49:22.322 INFO:teuthology.orchestra.run.smithi039.stdout: "msgr_send_messages_queue_lat": { 2024-09-12T02:49:22.322 INFO:teuthology.orchestra.run.smithi039.stdout: "avgcount": 184, 2024-09-12T02:49:22.322 INFO:teuthology.orchestra.run.smithi039.stdout: "sum": 0.030005633, 2024-09-12T02:49:22.322 INFO:teuthology.orchestra.run.smithi039.stdout: "avgtime": 0.000163074 2024-09-12T02:49:22.322 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-09-12T02:49:22.322 INFO:teuthology.orchestra.run.smithi039.stdout: "msgr_handle_ack_lat": { 2024-09-12T02:49:22.322 INFO:teuthology.orchestra.run.smithi039.stdout: "avgcount": 0, 2024-09-12T02:49:22.322 INFO:teuthology.orchestra.run.smithi039.stdout: "sum": 0.000000000, 2024-09-12T02:49:22.322 INFO:teuthology.orchestra.run.smithi039.stdout: "avgtime": 0.000000000 2024-09-12T02:49:22.322 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-09-12T02:49:22.323 INFO:teuthology.orchestra.run.smithi039.stdout: "msgr_recv_encrypted_bytes": 3392, 2024-09-12T02:49:22.323 INFO:teuthology.orchestra.run.smithi039.stdout: "msgr_send_encrypted_bytes": 190192 2024-09-12T02:49:22.323 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-09-12T02:49:22.323 INFO:teuthology.orchestra.run.smithi039.stdout: "cct": { 2024-09-12T02:49:22.323 INFO:teuthology.orchestra.run.smithi039.stdout: "total_workers": 0, 2024-09-12T02:49:22.324 INFO:teuthology.orchestra.run.smithi039.stdout: "unhealthy_workers": 0 2024-09-12T02:49:22.324 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-09-12T02:49:22.324 INFO:teuthology.orchestra.run.smithi039.stdout: "mempool": { 2024-09-12T02:49:22.324 INFO:teuthology.orchestra.run.smithi039.stdout: "bloom_filter_bytes": 0, 2024-09-12T02:49:22.324 INFO:teuthology.orchestra.run.smithi039.stdout: "bloom_filter_items": 0, 2024-09-12T02:49:22.324 INFO:teuthology.orchestra.run.smithi039.stdout: "bluestore_alloc_bytes": 0, 2024-09-12T02:49:22.324 INFO:teuthology.orchestra.run.smithi039.stdout: "bluestore_alloc_items": 0, 2024-09-12T02:49:22.324 INFO:teuthology.orchestra.run.smithi039.stdout: "bluestore_cache_data_bytes": 0, 2024-09-12T02:49:22.324 INFO:teuthology.orchestra.run.smithi039.stdout: "bluestore_cache_data_items": 0, 2024-09-12T02:49:22.324 INFO:teuthology.orchestra.run.smithi039.stdout: "bluestore_cache_onode_bytes": 0, 2024-09-12T02:49:22.324 INFO:teuthology.orchestra.run.smithi039.stdout: "bluestore_cache_onode_items": 0, 2024-09-12T02:49:22.324 INFO:teuthology.orchestra.run.smithi039.stdout: "bluestore_cache_meta_bytes": 0, 2024-09-12T02:49:22.324 INFO:teuthology.orchestra.run.smithi039.stdout: "bluestore_cache_meta_items": 0, 2024-09-12T02:49:22.324 INFO:teuthology.orchestra.run.smithi039.stdout: "bluestore_cache_other_bytes": 0, 2024-09-12T02:49:22.325 INFO:teuthology.orchestra.run.smithi039.stdout: "bluestore_cache_other_items": 0, 2024-09-12T02:49:22.325 INFO:teuthology.orchestra.run.smithi039.stdout: "bluestore_cache_buffer_bytes": 0, 2024-09-12T02:49:22.325 INFO:teuthology.orchestra.run.smithi039.stdout: "bluestore_cache_buffer_items": 0, 2024-09-12T02:49:22.325 INFO:teuthology.orchestra.run.smithi039.stdout: "bluestore_extent_bytes": 0, 2024-09-12T02:49:22.325 INFO:teuthology.orchestra.run.smithi039.stdout: "bluestore_extent_items": 0, 2024-09-12T02:49:22.325 INFO:teuthology.orchestra.run.smithi039.stdout: "bluestore_blob_bytes": 0, 2024-09-12T02:49:22.325 INFO:teuthology.orchestra.run.smithi039.stdout: "bluestore_blob_items": 0, 2024-09-12T02:49:22.325 INFO:teuthology.orchestra.run.smithi039.stdout: "bluestore_shared_blob_bytes": 0, 2024-09-12T02:49:22.325 INFO:teuthology.orchestra.run.smithi039.stdout: "bluestore_shared_blob_items": 0, 2024-09-12T02:49:22.325 INFO:teuthology.orchestra.run.smithi039.stdout: "bluestore_inline_bl_bytes": 0, 2024-09-12T02:49:22.325 INFO:teuthology.orchestra.run.smithi039.stdout: "bluestore_inline_bl_items": 0, 2024-09-12T02:49:22.325 INFO:teuthology.orchestra.run.smithi039.stdout: "bluestore_fsck_bytes": 0, 2024-09-12T02:49:22.325 INFO:teuthology.orchestra.run.smithi039.stdout: "bluestore_fsck_items": 0, 2024-09-12T02:49:22.325 INFO:teuthology.orchestra.run.smithi039.stdout: "bluestore_txc_bytes": 0, 2024-09-12T02:49:22.326 INFO:teuthology.orchestra.run.smithi039.stdout: "bluestore_txc_items": 0, 2024-09-12T02:49:22.326 INFO:teuthology.orchestra.run.smithi039.stdout: "bluestore_writing_deferred_bytes": 0, 2024-09-12T02:49:22.326 INFO:teuthology.orchestra.run.smithi039.stdout: "bluestore_writing_deferred_items": 0, 2024-09-12T02:49:22.326 INFO:teuthology.orchestra.run.smithi039.stdout: "bluestore_writing_bytes": 0, 2024-09-12T02:49:22.326 INFO:teuthology.orchestra.run.smithi039.stdout: "bluestore_writing_items": 0, 2024-09-12T02:49:22.326 INFO:teuthology.orchestra.run.smithi039.stdout: "bluefs_bytes": 0, 2024-09-12T02:49:22.326 INFO:teuthology.orchestra.run.smithi039.stdout: "bluefs_items": 0, 2024-09-12T02:49:22.326 INFO:teuthology.orchestra.run.smithi039.stdout: "bluefs_file_reader_bytes": 0, 2024-09-12T02:49:22.326 INFO:teuthology.orchestra.run.smithi039.stdout: "bluefs_file_reader_items": 0, 2024-09-12T02:49:22.326 INFO:teuthology.orchestra.run.smithi039.stdout: "bluefs_file_writer_bytes": 0, 2024-09-12T02:49:22.326 INFO:teuthology.orchestra.run.smithi039.stdout: "bluefs_file_writer_items": 0, 2024-09-12T02:49:22.326 INFO:teuthology.orchestra.run.smithi039.stdout: "buffer_anon_bytes": 148714, 2024-09-12T02:49:22.326 INFO:teuthology.orchestra.run.smithi039.stdout: "buffer_anon_items": 30, 2024-09-12T02:49:22.326 INFO:teuthology.orchestra.run.smithi039.stdout: "buffer_meta_bytes": 0, 2024-09-12T02:49:22.326 INFO:teuthology.orchestra.run.smithi039.stdout: "buffer_meta_items": 0, 2024-09-12T02:49:22.327 INFO:teuthology.orchestra.run.smithi039.stdout: "osd_bytes": 0, 2024-09-12T02:49:22.327 INFO:teuthology.orchestra.run.smithi039.stdout: "osd_items": 0, 2024-09-12T02:49:22.327 INFO:teuthology.orchestra.run.smithi039.stdout: "osd_mapbl_bytes": 0, 2024-09-12T02:49:22.327 INFO:teuthology.orchestra.run.smithi039.stdout: "osd_mapbl_items": 0, 2024-09-12T02:49:22.327 INFO:teuthology.orchestra.run.smithi039.stdout: "osd_pglog_bytes": 0, 2024-09-12T02:49:22.327 INFO:teuthology.orchestra.run.smithi039.stdout: "osd_pglog_items": 0, 2024-09-12T02:49:22.327 INFO:teuthology.orchestra.run.smithi039.stdout: "osdmap_bytes": 0, 2024-09-12T02:49:22.327 INFO:teuthology.orchestra.run.smithi039.stdout: "osdmap_items": 0, 2024-09-12T02:49:22.327 INFO:teuthology.orchestra.run.smithi039.stdout: "osdmap_mapping_bytes": 0, 2024-09-12T02:49:22.327 INFO:teuthology.orchestra.run.smithi039.stdout: "osdmap_mapping_items": 0, 2024-09-12T02:49:22.327 INFO:teuthology.orchestra.run.smithi039.stdout: "pgmap_bytes": 0, 2024-09-12T02:49:22.327 INFO:teuthology.orchestra.run.smithi039.stdout: "pgmap_items": 0, 2024-09-12T02:49:22.328 INFO:teuthology.orchestra.run.smithi039.stdout: "mds_co_bytes": 928, 2024-09-12T02:49:22.328 INFO:teuthology.orchestra.run.smithi039.stdout: "mds_co_items": 2, 2024-09-12T02:49:22.328 INFO:teuthology.orchestra.run.smithi039.stdout: "unittest_1_bytes": 0, 2024-09-12T02:49:22.328 INFO:teuthology.orchestra.run.smithi039.stdout: "unittest_1_items": 0, 2024-09-12T02:49:22.328 INFO:teuthology.orchestra.run.smithi039.stdout: "unittest_2_bytes": 0, 2024-09-12T02:49:22.328 INFO:teuthology.orchestra.run.smithi039.stdout: "unittest_2_items": 0 2024-09-12T02:49:22.328 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-09-12T02:49:22.328 INFO:teuthology.orchestra.run.smithi039.stdout: "throttle-msgr_dispatch_throttler-mds": { 2024-09-12T02:49:22.328 INFO:teuthology.orchestra.run.smithi039.stdout: "val": 0, 2024-09-12T02:49:22.328 INFO:teuthology.orchestra.run.smithi039.stdout: "max": 104857600, 2024-09-12T02:49:22.328 INFO:teuthology.orchestra.run.smithi039.stdout: "get_started": 0, 2024-09-12T02:49:22.328 INFO:teuthology.orchestra.run.smithi039.stdout: "get": 254, 2024-09-12T02:49:22.328 INFO:teuthology.orchestra.run.smithi039.stdout: "get_sum": 1691383, 2024-09-12T02:49:22.328 INFO:teuthology.orchestra.run.smithi039.stdout: "get_or_fail_fail": 0, 2024-09-12T02:49:22.329 INFO:teuthology.orchestra.run.smithi039.stdout: "get_or_fail_success": 254, 2024-09-12T02:49:22.329 INFO:teuthology.orchestra.run.smithi039.stdout: "take": 0, 2024-09-12T02:49:22.329 INFO:teuthology.orchestra.run.smithi039.stdout: "take_sum": 0, 2024-09-12T02:49:22.329 INFO:teuthology.orchestra.run.smithi039.stdout: "put": 254, 2024-09-12T02:49:22.329 INFO:teuthology.orchestra.run.smithi039.stdout: "put_sum": 1691383, 2024-09-12T02:49:22.329 INFO:teuthology.orchestra.run.smithi039.stdout: "wait": { 2024-09-12T02:49:22.329 INFO:teuthology.orchestra.run.smithi039.stdout: "avgcount": 0, 2024-09-12T02:49:22.329 INFO:teuthology.orchestra.run.smithi039.stdout: "sum": 0.000000000, 2024-09-12T02:49:22.329 INFO:teuthology.orchestra.run.smithi039.stdout: "avgtime": 0.000000000 2024-09-12T02:49:22.329 INFO:teuthology.orchestra.run.smithi039.stdout: } 2024-09-12T02:49:22.329 INFO:teuthology.orchestra.run.smithi039.stdout: } 2024-09-12T02:49:22.329 INFO:teuthology.orchestra.run.smithi039.stdout:} 2024-09-12T02:49:23.096 WARNING:tasks.check_counter:Counter 'mds.exported' not found on daemon mds.j 2024-09-12T02:49:23.096 WARNING:tasks.check_counter:Counter 'mds.imported' not found on daemon mds.j 2024-09-12T02:49:23.096 WARNING:tasks.check_counter:Counter 'mds_cache.dir_update' not found on daemon mds.j 2024-09-12T02:49:23.096 WARNING:tasks.check_counter:Counter 'mds_cache.dir_update_receipt' not found on daemon mds.j 2024-09-12T02:49:23.096 WARNING:tasks.check_counter:Counter 'mds.root_rsnaps' not found on daemon mds.j 2024-09-12T02:49:23.096 WARNING:tasks.check_counter:Counter 'mds_server.req_mksnap_latency.avgcount' not found on daemon mds.j 2024-09-12T02:49:23.096 WARNING:tasks.check_counter:Counter 'mds_server.req_rmsnap_latency.avgcount' not found on daemon mds.j 2024-09-12T02:49:23.097 DEBUG:tasks.check_counter:Getting stats from b 2024-09-12T02:49:23.097 DEBUG:teuthology.orchestra.run.smithi044:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc shell --fsid 4954ed46-70ae-11ef-bcea-c7b262605968 -- ceph daemon mds.b perf dump 2024-09-12T02:49:23.362 INFO:teuthology.orchestra.run.smithi044.stderr:Inferring config /var/lib/ceph/4954ed46-70ae-11ef-bcea-c7b262605968/mon.b/config 2024-09-12T02:49:23.782 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 12 02:49:23 smithi044 ceph-mon[35411]: pgmap v358: 129 pgs: 129 active+clean; 24 MiB data, 490 MiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 11 KiB/s wr, 11 op/s 2024-09-12T02:49:23.891 INFO:teuthology.orchestra.run.smithi044.stdout:{ 2024-09-12T02:49:23.891 INFO:teuthology.orchestra.run.smithi044.stdout: "AsyncMessenger::Worker-0": { 2024-09-12T02:49:23.891 INFO:teuthology.orchestra.run.smithi044.stdout: "msgr_recv_messages": 3091, 2024-09-12T02:49:23.891 INFO:teuthology.orchestra.run.smithi044.stdout: "msgr_send_messages": 3211, 2024-09-12T02:49:23.892 INFO:teuthology.orchestra.run.smithi044.stdout: "msgr_recv_bytes": 1006544, 2024-09-12T02:49:23.892 INFO:teuthology.orchestra.run.smithi044.stdout: "msgr_send_bytes": 13991891, 2024-09-12T02:49:23.892 INFO:teuthology.orchestra.run.smithi044.stdout: "msgr_created_connections": 18, 2024-09-12T02:49:23.892 INFO:teuthology.orchestra.run.smithi044.stdout: "msgr_active_connections": 6, 2024-09-12T02:49:23.892 INFO:teuthology.orchestra.run.smithi044.stdout: "msgr_running_total_time": 0.300560774, 2024-09-12T02:49:23.892 INFO:teuthology.orchestra.run.smithi044.stdout: "msgr_running_send_time": 0.117484882, 2024-09-12T02:49:23.892 INFO:teuthology.orchestra.run.smithi044.stdout: "msgr_running_recv_time": 0.110392665, 2024-09-12T02:49:23.892 INFO:teuthology.orchestra.run.smithi044.stdout: "msgr_running_fast_dispatch_time": 0.065992776, 2024-09-12T02:49:23.892 INFO:teuthology.orchestra.run.smithi044.stdout: "msgr_send_messages_queue_lat": { 2024-09-12T02:49:23.893 INFO:teuthology.orchestra.run.smithi044.stdout: "avgcount": 3209, 2024-09-12T02:49:23.893 INFO:teuthology.orchestra.run.smithi044.stdout: "sum": 0.440485828, 2024-09-12T02:49:23.893 INFO:teuthology.orchestra.run.smithi044.stdout: "avgtime": 0.000137265 2024-09-12T02:49:23.893 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-09-12T02:49:23.893 INFO:teuthology.orchestra.run.smithi044.stdout: "msgr_handle_ack_lat": { 2024-09-12T02:49:23.893 INFO:teuthology.orchestra.run.smithi044.stdout: "avgcount": 1636, 2024-09-12T02:49:23.893 INFO:teuthology.orchestra.run.smithi044.stdout: "sum": 0.000495426, 2024-09-12T02:49:23.893 INFO:teuthology.orchestra.run.smithi044.stdout: "avgtime": 0.000000302 2024-09-12T02:49:23.893 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-09-12T02:49:23.893 INFO:teuthology.orchestra.run.smithi044.stdout: "msgr_recv_encrypted_bytes": 99424, 2024-09-12T02:49:23.893 INFO:teuthology.orchestra.run.smithi044.stdout: "msgr_send_encrypted_bytes": 371600 2024-09-12T02:49:23.893 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-09-12T02:49:23.893 INFO:teuthology.orchestra.run.smithi044.stdout: "AsyncMessenger::Worker-1": { 2024-09-12T02:49:23.894 INFO:teuthology.orchestra.run.smithi044.stdout: "msgr_recv_messages": 3544, 2024-09-12T02:49:23.894 INFO:teuthology.orchestra.run.smithi044.stdout: "msgr_send_messages": 5386, 2024-09-12T02:49:23.894 INFO:teuthology.orchestra.run.smithi044.stdout: "msgr_recv_bytes": 1213183, 2024-09-12T02:49:23.894 INFO:teuthology.orchestra.run.smithi044.stdout: "msgr_send_bytes": 9178627, 2024-09-12T02:49:23.894 INFO:teuthology.orchestra.run.smithi044.stdout: "msgr_created_connections": 12, 2024-09-12T02:49:23.894 INFO:teuthology.orchestra.run.smithi044.stdout: "msgr_active_connections": 7, 2024-09-12T02:49:23.894 INFO:teuthology.orchestra.run.smithi044.stdout: "msgr_running_total_time": 0.384263801, 2024-09-12T02:49:23.894 INFO:teuthology.orchestra.run.smithi044.stdout: "msgr_running_send_time": 0.149283462, 2024-09-12T02:49:23.894 INFO:teuthology.orchestra.run.smithi044.stdout: "msgr_running_recv_time": 0.183894067, 2024-09-12T02:49:23.894 INFO:teuthology.orchestra.run.smithi044.stdout: "msgr_running_fast_dispatch_time": 0.062961265, 2024-09-12T02:49:23.894 INFO:teuthology.orchestra.run.smithi044.stdout: "msgr_send_messages_queue_lat": { 2024-09-12T02:49:23.894 INFO:teuthology.orchestra.run.smithi044.stdout: "avgcount": 5384, 2024-09-12T02:49:23.895 INFO:teuthology.orchestra.run.smithi044.stdout: "sum": 0.342977084, 2024-09-12T02:49:23.895 INFO:teuthology.orchestra.run.smithi044.stdout: "avgtime": 0.000063703 2024-09-12T02:49:23.895 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-09-12T02:49:23.895 INFO:teuthology.orchestra.run.smithi044.stdout: "msgr_handle_ack_lat": { 2024-09-12T02:49:23.895 INFO:teuthology.orchestra.run.smithi044.stdout: "avgcount": 4407, 2024-09-12T02:49:23.895 INFO:teuthology.orchestra.run.smithi044.stdout: "sum": 0.001550748, 2024-09-12T02:49:23.895 INFO:teuthology.orchestra.run.smithi044.stdout: "avgtime": 0.000000351 2024-09-12T02:49:23.895 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-09-12T02:49:23.895 INFO:teuthology.orchestra.run.smithi044.stdout: "msgr_recv_encrypted_bytes": 43632, 2024-09-12T02:49:23.895 INFO:teuthology.orchestra.run.smithi044.stdout: "msgr_send_encrypted_bytes": 153504 2024-09-12T02:49:23.895 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-09-12T02:49:23.895 INFO:teuthology.orchestra.run.smithi044.stdout: "AsyncMessenger::Worker-2": { 2024-09-12T02:49:23.895 INFO:teuthology.orchestra.run.smithi044.stdout: "msgr_recv_messages": 2990, 2024-09-12T02:49:23.896 INFO:teuthology.orchestra.run.smithi044.stdout: "msgr_send_messages": 2500, 2024-09-12T02:49:23.896 INFO:teuthology.orchestra.run.smithi044.stdout: "msgr_recv_bytes": 2941049, 2024-09-12T02:49:23.896 INFO:teuthology.orchestra.run.smithi044.stdout: "msgr_send_bytes": 5124596, 2024-09-12T02:49:23.896 INFO:teuthology.orchestra.run.smithi044.stdout: "msgr_created_connections": 13, 2024-09-12T02:49:23.896 INFO:teuthology.orchestra.run.smithi044.stdout: "msgr_active_connections": 8, 2024-09-12T02:49:23.896 INFO:teuthology.orchestra.run.smithi044.stdout: "msgr_running_total_time": 0.351382169, 2024-09-12T02:49:23.896 INFO:teuthology.orchestra.run.smithi044.stdout: "msgr_running_send_time": 0.134727249, 2024-09-12T02:49:23.896 INFO:teuthology.orchestra.run.smithi044.stdout: "msgr_running_recv_time": 0.197971228, 2024-09-12T02:49:23.896 INFO:teuthology.orchestra.run.smithi044.stdout: "msgr_running_fast_dispatch_time": 0.055541030, 2024-09-12T02:49:23.896 INFO:teuthology.orchestra.run.smithi044.stdout: "msgr_send_messages_queue_lat": { 2024-09-12T02:49:23.896 INFO:teuthology.orchestra.run.smithi044.stdout: "avgcount": 2499, 2024-09-12T02:49:23.896 INFO:teuthology.orchestra.run.smithi044.stdout: "sum": 0.390883157, 2024-09-12T02:49:23.897 INFO:teuthology.orchestra.run.smithi044.stdout: "avgtime": 0.000156415 2024-09-12T02:49:23.897 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-09-12T02:49:23.897 INFO:teuthology.orchestra.run.smithi044.stdout: "msgr_handle_ack_lat": { 2024-09-12T02:49:23.897 INFO:teuthology.orchestra.run.smithi044.stdout: "avgcount": 3831, 2024-09-12T02:49:23.897 INFO:teuthology.orchestra.run.smithi044.stdout: "sum": 0.000851387, 2024-09-12T02:49:23.897 INFO:teuthology.orchestra.run.smithi044.stdout: "avgtime": 0.000000222 2024-09-12T02:49:23.897 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-09-12T02:49:23.897 INFO:teuthology.orchestra.run.smithi044.stdout: "msgr_recv_encrypted_bytes": 2210720, 2024-09-12T02:49:23.897 INFO:teuthology.orchestra.run.smithi044.stdout: "msgr_send_encrypted_bytes": 267104 2024-09-12T02:49:23.897 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-09-12T02:49:23.898 INFO:teuthology.orchestra.run.smithi044.stdout: "cct": { 2024-09-12T02:49:23.898 INFO:teuthology.orchestra.run.smithi044.stdout: "total_workers": 1, 2024-09-12T02:49:23.898 INFO:teuthology.orchestra.run.smithi044.stdout: "unhealthy_workers": 0 2024-09-12T02:49:23.898 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-09-12T02:49:23.898 INFO:teuthology.orchestra.run.smithi044.stdout: "finisher-MDSRank": { 2024-09-12T02:49:23.898 INFO:teuthology.orchestra.run.smithi044.stdout: "queue_len": 0, 2024-09-12T02:49:23.898 INFO:teuthology.orchestra.run.smithi044.stdout: "complete_latency": { 2024-09-12T02:49:23.898 INFO:teuthology.orchestra.run.smithi044.stdout: "avgcount": 5066, 2024-09-12T02:49:23.898 INFO:teuthology.orchestra.run.smithi044.stdout: "sum": 1.385167890, 2024-09-12T02:49:23.898 INFO:teuthology.orchestra.run.smithi044.stdout: "avgtime": 0.000273424 2024-09-12T02:49:23.899 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-09-12T02:49:23.899 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-09-12T02:49:23.899 INFO:teuthology.orchestra.run.smithi044.stdout: "finisher-PurgeQueue": { 2024-09-12T02:49:23.899 INFO:teuthology.orchestra.run.smithi044.stdout: "queue_len": 0, 2024-09-12T02:49:23.899 INFO:teuthology.orchestra.run.smithi044.stdout: "complete_latency": { 2024-09-12T02:49:23.899 INFO:teuthology.orchestra.run.smithi044.stdout: "avgcount": 2, 2024-09-12T02:49:23.899 INFO:teuthology.orchestra.run.smithi044.stdout: "sum": 0.000013066, 2024-09-12T02:49:23.899 INFO:teuthology.orchestra.run.smithi044.stdout: "avgtime": 0.000006533 2024-09-12T02:49:23.899 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-09-12T02:49:23.899 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-09-12T02:49:23.900 INFO:teuthology.orchestra.run.smithi044.stdout: "mds": { 2024-09-12T02:49:23.900 INFO:teuthology.orchestra.run.smithi044.stdout: "request": 799, 2024-09-12T02:49:23.900 INFO:teuthology.orchestra.run.smithi044.stdout: "reply": 799, 2024-09-12T02:49:23.900 INFO:teuthology.orchestra.run.smithi044.stdout: "reply_latency": { 2024-09-12T02:49:23.900 INFO:teuthology.orchestra.run.smithi044.stdout: "avgcount": 799, 2024-09-12T02:49:23.900 INFO:teuthology.orchestra.run.smithi044.stdout: "sum": 3.355492636, 2024-09-12T02:49:23.900 INFO:teuthology.orchestra.run.smithi044.stdout: "avgtime": 0.004199615 2024-09-12T02:49:23.900 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-09-12T02:49:23.900 INFO:teuthology.orchestra.run.smithi044.stdout: "slow_reply": 0, 2024-09-12T02:49:23.900 INFO:teuthology.orchestra.run.smithi044.stdout: "forward": 0, 2024-09-12T02:49:23.901 INFO:teuthology.orchestra.run.smithi044.stdout: "dir_fetch_complete": 0, 2024-09-12T02:49:23.901 INFO:teuthology.orchestra.run.smithi044.stdout: "dir_fetch_keys": 0, 2024-09-12T02:49:23.901 INFO:teuthology.orchestra.run.smithi044.stdout: "dir_commit": 12, 2024-09-12T02:49:23.901 INFO:teuthology.orchestra.run.smithi044.stdout: "dir_split": 0, 2024-09-12T02:49:23.901 INFO:teuthology.orchestra.run.smithi044.stdout: "dir_merge": 0, 2024-09-12T02:49:23.901 INFO:teuthology.orchestra.run.smithi044.stdout: "inodes": 43, 2024-09-12T02:49:23.901 INFO:teuthology.orchestra.run.smithi044.stdout: "inodes_top": 2, 2024-09-12T02:49:23.901 INFO:teuthology.orchestra.run.smithi044.stdout: "inodes_bottom": 41, 2024-09-12T02:49:23.901 INFO:teuthology.orchestra.run.smithi044.stdout: "inodes_pin_tail": 0, 2024-09-12T02:49:23.901 INFO:teuthology.orchestra.run.smithi044.stdout: "inodes_pinned": 40, 2024-09-12T02:49:23.901 INFO:teuthology.orchestra.run.smithi044.stdout: "inodes_expired": 0, 2024-09-12T02:49:23.901 INFO:teuthology.orchestra.run.smithi044.stdout: "inodes_with_caps": 3, 2024-09-12T02:49:23.902 INFO:teuthology.orchestra.run.smithi044.stdout: "caps": 3, 2024-09-12T02:49:23.902 INFO:teuthology.orchestra.run.smithi044.stdout: "subtrees": 2, 2024-09-12T02:49:23.902 INFO:teuthology.orchestra.run.smithi044.stdout: "traverse": 856, 2024-09-12T02:49:23.902 INFO:teuthology.orchestra.run.smithi044.stdout: "traverse_hit": 843, 2024-09-12T02:49:23.902 INFO:teuthology.orchestra.run.smithi044.stdout: "traverse_forward": 0, 2024-09-12T02:49:23.902 INFO:teuthology.orchestra.run.smithi044.stdout: "traverse_discover": 0, 2024-09-12T02:49:23.902 INFO:teuthology.orchestra.run.smithi044.stdout: "traverse_dir_fetch": 0, 2024-09-12T02:49:23.902 INFO:teuthology.orchestra.run.smithi044.stdout: "traverse_remote_ino": 0, 2024-09-12T02:49:23.902 INFO:teuthology.orchestra.run.smithi044.stdout: "traverse_lock": 0, 2024-09-12T02:49:23.902 INFO:teuthology.orchestra.run.smithi044.stdout: "load_cent": 0, 2024-09-12T02:49:23.902 INFO:teuthology.orchestra.run.smithi044.stdout: "q": 0, 2024-09-12T02:49:23.902 INFO:teuthology.orchestra.run.smithi044.stdout: "exported": 0, 2024-09-12T02:49:23.902 INFO:teuthology.orchestra.run.smithi044.stdout: "exported_inodes": 0, 2024-09-12T02:49:23.902 INFO:teuthology.orchestra.run.smithi044.stdout: "imported": 0, 2024-09-12T02:49:23.903 INFO:teuthology.orchestra.run.smithi044.stdout: "imported_inodes": 0, 2024-09-12T02:49:23.903 INFO:teuthology.orchestra.run.smithi044.stdout: "openino_dir_fetch": 0, 2024-09-12T02:49:23.903 INFO:teuthology.orchestra.run.smithi044.stdout: "openino_backtrace_fetch": 0, 2024-09-12T02:49:23.903 INFO:teuthology.orchestra.run.smithi044.stdout: "openino_peer_discover": 0, 2024-09-12T02:49:23.903 INFO:teuthology.orchestra.run.smithi044.stdout: "root_rfiles": 4, 2024-09-12T02:49:23.903 INFO:teuthology.orchestra.run.smithi044.stdout: "root_rbytes": 234, 2024-09-12T02:49:23.903 INFO:teuthology.orchestra.run.smithi044.stdout: "root_rsnaps": 6, 2024-09-12T02:49:23.903 INFO:teuthology.orchestra.run.smithi044.stdout: "scrub_backtrace_fetch": 0, 2024-09-12T02:49:23.903 INFO:teuthology.orchestra.run.smithi044.stdout: "scrub_set_tag": 0, 2024-09-12T02:49:23.903 INFO:teuthology.orchestra.run.smithi044.stdout: "scrub_backtrace_repaired": 0, 2024-09-12T02:49:23.903 INFO:teuthology.orchestra.run.smithi044.stdout: "scrub_inotable_repaired": 0, 2024-09-12T02:49:23.903 INFO:teuthology.orchestra.run.smithi044.stdout: "scrub_dir_inodes": 0, 2024-09-12T02:49:23.903 INFO:teuthology.orchestra.run.smithi044.stdout: "scrub_dir_base_inodes": 0, 2024-09-12T02:49:23.904 INFO:teuthology.orchestra.run.smithi044.stdout: "scrub_dirfrag_rstats": 0, 2024-09-12T02:49:23.904 INFO:teuthology.orchestra.run.smithi044.stdout: "scrub_file_inodes": 0, 2024-09-12T02:49:23.904 INFO:teuthology.orchestra.run.smithi044.stdout: "handle_inode_file_caps": 0, 2024-09-12T02:49:23.904 INFO:teuthology.orchestra.run.smithi044.stdout: "ceph_cap_op_revoke": 616, 2024-09-12T02:49:23.904 INFO:teuthology.orchestra.run.smithi044.stdout: "ceph_cap_op_grant": 612, 2024-09-12T02:49:23.904 INFO:teuthology.orchestra.run.smithi044.stdout: "ceph_cap_op_trunc": 599, 2024-09-12T02:49:23.904 INFO:teuthology.orchestra.run.smithi044.stdout: "ceph_cap_op_flushsnap_ack": 0, 2024-09-12T02:49:23.904 INFO:teuthology.orchestra.run.smithi044.stdout: "ceph_cap_op_flush_ack": 0, 2024-09-12T02:49:23.904 INFO:teuthology.orchestra.run.smithi044.stdout: "handle_client_caps": 719, 2024-09-12T02:49:23.904 INFO:teuthology.orchestra.run.smithi044.stdout: "handle_client_caps_dirty": 697, 2024-09-12T02:49:23.904 INFO:teuthology.orchestra.run.smithi044.stdout: "handle_client_cap_release": 1, 2024-09-12T02:49:23.905 INFO:teuthology.orchestra.run.smithi044.stdout: "process_request_cap_release": 622 2024-09-12T02:49:23.905 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-09-12T02:49:23.905 INFO:teuthology.orchestra.run.smithi044.stdout: "mds_cache": { 2024-09-12T02:49:23.905 INFO:teuthology.orchestra.run.smithi044.stdout: "dir_update": 15, 2024-09-12T02:49:23.905 INFO:teuthology.orchestra.run.smithi044.stdout: "dir_update_receipt": 0, 2024-09-12T02:49:23.905 INFO:teuthology.orchestra.run.smithi044.stdout: "dir_try_discover": 0, 2024-09-12T02:49:23.905 INFO:teuthology.orchestra.run.smithi044.stdout: "dir_send_discover": 0, 2024-09-12T02:49:23.905 INFO:teuthology.orchestra.run.smithi044.stdout: "dir_handle_discover": 32, 2024-09-12T02:49:23.905 INFO:teuthology.orchestra.run.smithi044.stdout: "num_strays": 3, 2024-09-12T02:49:23.905 INFO:teuthology.orchestra.run.smithi044.stdout: "num_strays_delayed": 0, 2024-09-12T02:49:23.905 INFO:teuthology.orchestra.run.smithi044.stdout: "num_strays_enqueuing": 0, 2024-09-12T02:49:23.905 INFO:teuthology.orchestra.run.smithi044.stdout: "strays_created": 3, 2024-09-12T02:49:23.905 INFO:teuthology.orchestra.run.smithi044.stdout: "strays_enqueued": 0, 2024-09-12T02:49:23.906 INFO:teuthology.orchestra.run.smithi044.stdout: "strays_reintegrated": 0, 2024-09-12T02:49:23.906 INFO:teuthology.orchestra.run.smithi044.stdout: "strays_migrated": 0, 2024-09-12T02:49:23.906 INFO:teuthology.orchestra.run.smithi044.stdout: "num_recovering_processing": 0, 2024-09-12T02:49:23.906 INFO:teuthology.orchestra.run.smithi044.stdout: "num_recovering_enqueued": 0, 2024-09-12T02:49:23.906 INFO:teuthology.orchestra.run.smithi044.stdout: "num_recovering_prioritized": 0, 2024-09-12T02:49:23.906 INFO:teuthology.orchestra.run.smithi044.stdout: "recovery_started": 0, 2024-09-12T02:49:23.906 INFO:teuthology.orchestra.run.smithi044.stdout: "recovery_completed": 0, 2024-09-12T02:49:23.906 INFO:teuthology.orchestra.run.smithi044.stdout: "ireq_quiesce_path": 0, 2024-09-12T02:49:23.906 INFO:teuthology.orchestra.run.smithi044.stdout: "ireq_quiesce_inode": 0, 2024-09-12T02:49:23.906 INFO:teuthology.orchestra.run.smithi044.stdout: "ireq_enqueue_scrub": 0, 2024-09-12T02:49:23.906 INFO:teuthology.orchestra.run.smithi044.stdout: "ireq_exportdir": 0, 2024-09-12T02:49:23.906 INFO:teuthology.orchestra.run.smithi044.stdout: "ireq_flush": 0, 2024-09-12T02:49:23.906 INFO:teuthology.orchestra.run.smithi044.stdout: "ireq_fragmentdir": 0, 2024-09-12T02:49:23.907 INFO:teuthology.orchestra.run.smithi044.stdout: "ireq_fragstats": 0, 2024-09-12T02:49:23.907 INFO:teuthology.orchestra.run.smithi044.stdout: "ireq_inodestats": 0 2024-09-12T02:49:23.907 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-09-12T02:49:23.907 INFO:teuthology.orchestra.run.smithi044.stdout: "mds_log": { 2024-09-12T02:49:23.907 INFO:teuthology.orchestra.run.smithi044.stdout: "evlrg": 0, 2024-09-12T02:49:23.907 INFO:teuthology.orchestra.run.smithi044.stdout: "evadd": 2302, 2024-09-12T02:49:23.907 INFO:teuthology.orchestra.run.smithi044.stdout: "evex": 0, 2024-09-12T02:49:23.907 INFO:teuthology.orchestra.run.smithi044.stdout: "evtrm": 0, 2024-09-12T02:49:23.907 INFO:teuthology.orchestra.run.smithi044.stdout: "ev": 2302, 2024-09-12T02:49:23.907 INFO:teuthology.orchestra.run.smithi044.stdout: "evexg": 0, 2024-09-12T02:49:23.907 INFO:teuthology.orchestra.run.smithi044.stdout: "evexd": 0, 2024-09-12T02:49:23.907 INFO:teuthology.orchestra.run.smithi044.stdout: "segadd": 7, 2024-09-12T02:49:23.908 INFO:teuthology.orchestra.run.smithi044.stdout: "segex": 0, 2024-09-12T02:49:23.908 INFO:teuthology.orchestra.run.smithi044.stdout: "segtrm": 0, 2024-09-12T02:49:23.908 INFO:teuthology.orchestra.run.smithi044.stdout: "seg": 7, 2024-09-12T02:49:23.908 INFO:teuthology.orchestra.run.smithi044.stdout: "segmjr": 2, 2024-09-12T02:49:23.908 INFO:teuthology.orchestra.run.smithi044.stdout: "segexg": 0, 2024-09-12T02:49:23.908 INFO:teuthology.orchestra.run.smithi044.stdout: "segexd": 0, 2024-09-12T02:49:23.908 INFO:teuthology.orchestra.run.smithi044.stdout: "expos": 4194304, 2024-09-12T02:49:23.908 INFO:teuthology.orchestra.run.smithi044.stdout: "wrpos": 28214315, 2024-09-12T02:49:23.908 INFO:teuthology.orchestra.run.smithi044.stdout: "rdpos": 0, 2024-09-12T02:49:23.908 INFO:teuthology.orchestra.run.smithi044.stdout: "jlat": { 2024-09-12T02:49:23.908 INFO:teuthology.orchestra.run.smithi044.stdout: "avgcount": 2233, 2024-09-12T02:49:23.908 INFO:teuthology.orchestra.run.smithi044.stdout: "sum": 4.744849632, 2024-09-12T02:49:23.908 INFO:teuthology.orchestra.run.smithi044.stdout: "avgtime": 0.002124876 2024-09-12T02:49:23.909 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-09-12T02:49:23.909 INFO:teuthology.orchestra.run.smithi044.stdout: "replayed": 0 2024-09-12T02:49:23.909 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-09-12T02:49:23.909 INFO:teuthology.orchestra.run.smithi044.stdout: "mds_mem": { 2024-09-12T02:49:23.909 INFO:teuthology.orchestra.run.smithi044.stdout: "ino": 36, 2024-09-12T02:49:23.909 INFO:teuthology.orchestra.run.smithi044.stdout: "ino+": 36, 2024-09-12T02:49:23.909 INFO:teuthology.orchestra.run.smithi044.stdout: "ino-": 0, 2024-09-12T02:49:23.909 INFO:teuthology.orchestra.run.smithi044.stdout: "dir": 20, 2024-09-12T02:49:23.909 INFO:teuthology.orchestra.run.smithi044.stdout: "dir+": 20, 2024-09-12T02:49:23.909 INFO:teuthology.orchestra.run.smithi044.stdout: "dir-": 0, 2024-09-12T02:49:23.909 INFO:teuthology.orchestra.run.smithi044.stdout: "dn": 43, 2024-09-12T02:49:23.909 INFO:teuthology.orchestra.run.smithi044.stdout: "dn+": 43, 2024-09-12T02:49:23.909 INFO:teuthology.orchestra.run.smithi044.stdout: "dn-": 0, 2024-09-12T02:49:23.909 INFO:teuthology.orchestra.run.smithi044.stdout: "cap": 3, 2024-09-12T02:49:23.910 INFO:teuthology.orchestra.run.smithi044.stdout: "cap+": 22, 2024-09-12T02:49:23.910 INFO:teuthology.orchestra.run.smithi044.stdout: "cap-": 19, 2024-09-12T02:49:23.910 INFO:teuthology.orchestra.run.smithi044.stdout: "rss": 55776, 2024-09-12T02:49:23.910 INFO:teuthology.orchestra.run.smithi044.stdout: "heap": 231712 2024-09-12T02:49:23.910 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-09-12T02:49:23.910 INFO:teuthology.orchestra.run.smithi044.stdout: "mds_server": { 2024-09-12T02:49:23.910 INFO:teuthology.orchestra.run.smithi044.stdout: "dispatch_client_request": 2058, 2024-09-12T02:49:23.910 INFO:teuthology.orchestra.run.smithi044.stdout: "dispatch_server_request": 1, 2024-09-12T02:49:23.910 INFO:teuthology.orchestra.run.smithi044.stdout: "handle_client_request": 799, 2024-09-12T02:49:23.910 INFO:teuthology.orchestra.run.smithi044.stdout: "handle_client_session": 40, 2024-09-12T02:49:23.910 INFO:teuthology.orchestra.run.smithi044.stdout: "handle_peer_request": 2, 2024-09-12T02:49:23.910 INFO:teuthology.orchestra.run.smithi044.stdout: "req_create_latency": { 2024-09-12T02:49:23.911 INFO:teuthology.orchestra.run.smithi044.stdout: "avgcount": 5, 2024-09-12T02:49:23.911 INFO:teuthology.orchestra.run.smithi044.stdout: "sum": 0.003253678, 2024-09-12T02:49:23.911 INFO:teuthology.orchestra.run.smithi044.stdout: "avgtime": 0.000650735 2024-09-12T02:49:23.911 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-09-12T02:49:23.911 INFO:teuthology.orchestra.run.smithi044.stdout: "req_getattr_latency": { 2024-09-12T02:49:23.911 INFO:teuthology.orchestra.run.smithi044.stdout: "avgcount": 133, 2024-09-12T02:49:23.911 INFO:teuthology.orchestra.run.smithi044.stdout: "sum": 0.025697405, 2024-09-12T02:49:23.911 INFO:teuthology.orchestra.run.smithi044.stdout: "avgtime": 0.000193213 2024-09-12T02:49:23.911 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-09-12T02:49:23.911 INFO:teuthology.orchestra.run.smithi044.stdout: "req_getfilelock_latency": { 2024-09-12T02:49:23.911 INFO:teuthology.orchestra.run.smithi044.stdout: "avgcount": 0, 2024-09-12T02:49:23.912 INFO:teuthology.orchestra.run.smithi044.stdout: "sum": 0.000000000, 2024-09-12T02:49:23.912 INFO:teuthology.orchestra.run.smithi044.stdout: "avgtime": 0.000000000 2024-09-12T02:49:23.912 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-09-12T02:49:23.912 INFO:teuthology.orchestra.run.smithi044.stdout: "req_link_latency": { 2024-09-12T02:49:23.912 INFO:teuthology.orchestra.run.smithi044.stdout: "avgcount": 0, 2024-09-12T02:49:23.912 INFO:teuthology.orchestra.run.smithi044.stdout: "sum": 0.000000000, 2024-09-12T02:49:23.912 INFO:teuthology.orchestra.run.smithi044.stdout: "avgtime": 0.000000000 2024-09-12T02:49:23.912 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-09-12T02:49:23.912 INFO:teuthology.orchestra.run.smithi044.stdout: "req_lookup_latency": { 2024-09-12T02:49:23.912 INFO:teuthology.orchestra.run.smithi044.stdout: "avgcount": 5, 2024-09-12T02:49:23.912 INFO:teuthology.orchestra.run.smithi044.stdout: "sum": 0.000982301, 2024-09-12T02:49:23.912 INFO:teuthology.orchestra.run.smithi044.stdout: "avgtime": 0.000196460 2024-09-12T02:49:23.913 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-09-12T02:49:23.913 INFO:teuthology.orchestra.run.smithi044.stdout: "req_lookuphash_latency": { 2024-09-12T02:49:23.913 INFO:teuthology.orchestra.run.smithi044.stdout: "avgcount": 0, 2024-09-12T02:49:23.913 INFO:teuthology.orchestra.run.smithi044.stdout: "sum": 0.000000000, 2024-09-12T02:49:23.913 INFO:teuthology.orchestra.run.smithi044.stdout: "avgtime": 0.000000000 2024-09-12T02:49:23.913 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-09-12T02:49:23.913 INFO:teuthology.orchestra.run.smithi044.stdout: "req_lookupino_latency": { 2024-09-12T02:49:23.913 INFO:teuthology.orchestra.run.smithi044.stdout: "avgcount": 0, 2024-09-12T02:49:23.913 INFO:teuthology.orchestra.run.smithi044.stdout: "sum": 0.000000000, 2024-09-12T02:49:23.913 INFO:teuthology.orchestra.run.smithi044.stdout: "avgtime": 0.000000000 2024-09-12T02:49:23.913 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-09-12T02:49:23.913 INFO:teuthology.orchestra.run.smithi044.stdout: "req_lookupname_latency": { 2024-09-12T02:49:23.914 INFO:teuthology.orchestra.run.smithi044.stdout: "avgcount": 0, 2024-09-12T02:49:23.914 INFO:teuthology.orchestra.run.smithi044.stdout: "sum": 0.000000000, 2024-09-12T02:49:23.914 INFO:teuthology.orchestra.run.smithi044.stdout: "avgtime": 0.000000000 2024-09-12T02:49:23.914 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-09-12T02:49:23.914 INFO:teuthology.orchestra.run.smithi044.stdout: "req_lookupparent_latency": { 2024-09-12T02:49:23.914 INFO:teuthology.orchestra.run.smithi044.stdout: "avgcount": 0, 2024-09-12T02:49:23.914 INFO:teuthology.orchestra.run.smithi044.stdout: "sum": 0.000000000, 2024-09-12T02:49:23.914 INFO:teuthology.orchestra.run.smithi044.stdout: "avgtime": 0.000000000 2024-09-12T02:49:23.914 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-09-12T02:49:23.914 INFO:teuthology.orchestra.run.smithi044.stdout: "req_lookupsnap_latency": { 2024-09-12T02:49:23.914 INFO:teuthology.orchestra.run.smithi044.stdout: "avgcount": 0, 2024-09-12T02:49:23.914 INFO:teuthology.orchestra.run.smithi044.stdout: "sum": 0.000000000, 2024-09-12T02:49:23.914 INFO:teuthology.orchestra.run.smithi044.stdout: "avgtime": 0.000000000 2024-09-12T02:49:23.915 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-09-12T02:49:23.915 INFO:teuthology.orchestra.run.smithi044.stdout: "req_lssnap_latency": { 2024-09-12T02:49:23.915 INFO:teuthology.orchestra.run.smithi044.stdout: "avgcount": 12, 2024-09-12T02:49:23.915 INFO:teuthology.orchestra.run.smithi044.stdout: "sum": 0.001930314, 2024-09-12T02:49:23.915 INFO:teuthology.orchestra.run.smithi044.stdout: "avgtime": 0.000160859 2024-09-12T02:49:23.915 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-09-12T02:49:23.915 INFO:teuthology.orchestra.run.smithi044.stdout: "req_mkdir_latency": { 2024-09-12T02:49:23.915 INFO:teuthology.orchestra.run.smithi044.stdout: "avgcount": 8, 2024-09-12T02:49:23.915 INFO:teuthology.orchestra.run.smithi044.stdout: "sum": 0.012651698, 2024-09-12T02:49:23.915 INFO:teuthology.orchestra.run.smithi044.stdout: "avgtime": 0.001581462 2024-09-12T02:49:23.915 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-09-12T02:49:23.916 INFO:teuthology.orchestra.run.smithi044.stdout: "req_mknod_latency": { 2024-09-12T02:49:23.916 INFO:teuthology.orchestra.run.smithi044.stdout: "avgcount": 0, 2024-09-12T02:49:23.916 INFO:teuthology.orchestra.run.smithi044.stdout: "sum": 0.000000000, 2024-09-12T02:49:23.916 INFO:teuthology.orchestra.run.smithi044.stdout: "avgtime": 0.000000000 2024-09-12T02:49:23.916 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-09-12T02:49:23.916 INFO:teuthology.orchestra.run.smithi044.stdout: "req_mksnap_latency": { 2024-09-12T02:49:23.916 INFO:teuthology.orchestra.run.smithi044.stdout: "avgcount": 12, 2024-09-12T02:49:23.916 INFO:teuthology.orchestra.run.smithi044.stdout: "sum": 0.060445625, 2024-09-12T02:49:23.916 INFO:teuthology.orchestra.run.smithi044.stdout: "avgtime": 0.005037135 2024-09-12T02:49:23.916 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-09-12T02:49:23.917 INFO:teuthology.orchestra.run.smithi044.stdout: "req_open_latency": { 2024-09-12T02:49:23.917 INFO:teuthology.orchestra.run.smithi044.stdout: "avgcount": 1, 2024-09-12T02:49:23.917 INFO:teuthology.orchestra.run.smithi044.stdout: "sum": 0.000272664, 2024-09-12T02:49:23.917 INFO:teuthology.orchestra.run.smithi044.stdout: "avgtime": 0.000272664 2024-09-12T02:49:23.917 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-09-12T02:49:23.917 INFO:teuthology.orchestra.run.smithi044.stdout: "req_readdir_latency": { 2024-09-12T02:49:23.917 INFO:teuthology.orchestra.run.smithi044.stdout: "avgcount": 2, 2024-09-12T02:49:23.917 INFO:teuthology.orchestra.run.smithi044.stdout: "sum": 0.004450217, 2024-09-12T02:49:23.917 INFO:teuthology.orchestra.run.smithi044.stdout: "avgtime": 0.002225108 2024-09-12T02:49:23.917 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-09-12T02:49:23.917 INFO:teuthology.orchestra.run.smithi044.stdout: "req_rename_latency": { 2024-09-12T02:49:23.917 INFO:teuthology.orchestra.run.smithi044.stdout: "avgcount": 2, 2024-09-12T02:49:23.918 INFO:teuthology.orchestra.run.smithi044.stdout: "sum": 0.002013682, 2024-09-12T02:49:23.918 INFO:teuthology.orchestra.run.smithi044.stdout: "avgtime": 0.001006841 2024-09-12T02:49:23.918 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-09-12T02:49:23.918 INFO:teuthology.orchestra.run.smithi044.stdout: "req_renamesnap_latency": { 2024-09-12T02:49:23.918 INFO:teuthology.orchestra.run.smithi044.stdout: "avgcount": 0, 2024-09-12T02:49:23.918 INFO:teuthology.orchestra.run.smithi044.stdout: "sum": 0.000000000, 2024-09-12T02:49:23.918 INFO:teuthology.orchestra.run.smithi044.stdout: "avgtime": 0.000000000 2024-09-12T02:49:23.918 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-09-12T02:49:23.918 INFO:teuthology.orchestra.run.smithi044.stdout: "req_snapdiff_latency": { 2024-09-12T02:49:23.918 INFO:teuthology.orchestra.run.smithi044.stdout: "avgcount": 0, 2024-09-12T02:49:23.918 INFO:teuthology.orchestra.run.smithi044.stdout: "sum": 0.000000000, 2024-09-12T02:49:23.918 INFO:teuthology.orchestra.run.smithi044.stdout: "avgtime": 0.000000000 2024-09-12T02:49:23.919 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-09-12T02:49:23.919 INFO:teuthology.orchestra.run.smithi044.stdout: "req_rmdir_latency": { 2024-09-12T02:49:23.919 INFO:teuthology.orchestra.run.smithi044.stdout: "avgcount": 2, 2024-09-12T02:49:23.919 INFO:teuthology.orchestra.run.smithi044.stdout: "sum": 0.012598364, 2024-09-12T02:49:23.919 INFO:teuthology.orchestra.run.smithi044.stdout: "avgtime": 0.006299182 2024-09-12T02:49:23.919 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-09-12T02:49:23.919 INFO:teuthology.orchestra.run.smithi044.stdout: "req_rmsnap_latency": { 2024-09-12T02:49:23.919 INFO:teuthology.orchestra.run.smithi044.stdout: "avgcount": 6, 2024-09-12T02:49:23.919 INFO:teuthology.orchestra.run.smithi044.stdout: "sum": 0.028159870, 2024-09-12T02:49:23.919 INFO:teuthology.orchestra.run.smithi044.stdout: "avgtime": 0.004693311 2024-09-12T02:49:23.919 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-09-12T02:49:23.919 INFO:teuthology.orchestra.run.smithi044.stdout: "req_rmxattr_latency": { 2024-09-12T02:49:23.920 INFO:teuthology.orchestra.run.smithi044.stdout: "avgcount": 0, 2024-09-12T02:49:23.920 INFO:teuthology.orchestra.run.smithi044.stdout: "sum": 0.000000000, 2024-09-12T02:49:23.920 INFO:teuthology.orchestra.run.smithi044.stdout: "avgtime": 0.000000000 2024-09-12T02:49:23.920 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-09-12T02:49:23.920 INFO:teuthology.orchestra.run.smithi044.stdout: "req_setattr_latency": { 2024-09-12T02:49:23.920 INFO:teuthology.orchestra.run.smithi044.stdout: "avgcount": 601, 2024-09-12T02:49:23.920 INFO:teuthology.orchestra.run.smithi044.stdout: "sum": 3.179320840, 2024-09-12T02:49:23.920 INFO:teuthology.orchestra.run.smithi044.stdout: "avgtime": 0.005290051 2024-09-12T02:49:23.920 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-09-12T02:49:23.920 INFO:teuthology.orchestra.run.smithi044.stdout: "req_setdirlayout_latency": { 2024-09-12T02:49:23.920 INFO:teuthology.orchestra.run.smithi044.stdout: "avgcount": 0, 2024-09-12T02:49:23.920 INFO:teuthology.orchestra.run.smithi044.stdout: "sum": 0.000000000, 2024-09-12T02:49:23.920 INFO:teuthology.orchestra.run.smithi044.stdout: "avgtime": 0.000000000 2024-09-12T02:49:23.921 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-09-12T02:49:23.921 INFO:teuthology.orchestra.run.smithi044.stdout: "req_setfilelock_latency": { 2024-09-12T02:49:23.921 INFO:teuthology.orchestra.run.smithi044.stdout: "avgcount": 0, 2024-09-12T02:49:23.921 INFO:teuthology.orchestra.run.smithi044.stdout: "sum": 0.000000000, 2024-09-12T02:49:23.921 INFO:teuthology.orchestra.run.smithi044.stdout: "avgtime": 0.000000000 2024-09-12T02:49:23.921 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-09-12T02:49:23.921 INFO:teuthology.orchestra.run.smithi044.stdout: "req_setlayout_latency": { 2024-09-12T02:49:23.921 INFO:teuthology.orchestra.run.smithi044.stdout: "avgcount": 0, 2024-09-12T02:49:23.921 INFO:teuthology.orchestra.run.smithi044.stdout: "sum": 0.000000000, 2024-09-12T02:49:23.921 INFO:teuthology.orchestra.run.smithi044.stdout: "avgtime": 0.000000000 2024-09-12T02:49:23.921 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-09-12T02:49:23.921 INFO:teuthology.orchestra.run.smithi044.stdout: "req_setxattr_latency": { 2024-09-12T02:49:23.921 INFO:teuthology.orchestra.run.smithi044.stdout: "avgcount": 9, 2024-09-12T02:49:23.922 INFO:teuthology.orchestra.run.smithi044.stdout: "sum": 0.021769668, 2024-09-12T02:49:23.922 INFO:teuthology.orchestra.run.smithi044.stdout: "avgtime": 0.002418852 2024-09-12T02:49:23.922 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-09-12T02:49:23.922 INFO:teuthology.orchestra.run.smithi044.stdout: "req_symlink_latency": { 2024-09-12T02:49:23.922 INFO:teuthology.orchestra.run.smithi044.stdout: "avgcount": 0, 2024-09-12T02:49:23.922 INFO:teuthology.orchestra.run.smithi044.stdout: "sum": 0.000000000, 2024-09-12T02:49:23.922 INFO:teuthology.orchestra.run.smithi044.stdout: "avgtime": 0.000000000 2024-09-12T02:49:23.922 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-09-12T02:49:23.922 INFO:teuthology.orchestra.run.smithi044.stdout: "req_unlink_latency": { 2024-09-12T02:49:23.922 INFO:teuthology.orchestra.run.smithi044.stdout: "avgcount": 1, 2024-09-12T02:49:23.922 INFO:teuthology.orchestra.run.smithi044.stdout: "sum": 0.001946310, 2024-09-12T02:49:23.922 INFO:teuthology.orchestra.run.smithi044.stdout: "avgtime": 0.001946310 2024-09-12T02:49:23.922 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-09-12T02:49:23.922 INFO:teuthology.orchestra.run.smithi044.stdout: "cap_revoke_eviction": 0, 2024-09-12T02:49:23.923 INFO:teuthology.orchestra.run.smithi044.stdout: "cap_acquisition_throttle": 0, 2024-09-12T02:49:23.923 INFO:teuthology.orchestra.run.smithi044.stdout: "req_getvxattr_latency": { 2024-09-12T02:49:23.923 INFO:teuthology.orchestra.run.smithi044.stdout: "avgcount": 0, 2024-09-12T02:49:23.923 INFO:teuthology.orchestra.run.smithi044.stdout: "sum": 0.000000000, 2024-09-12T02:49:23.923 INFO:teuthology.orchestra.run.smithi044.stdout: "avgtime": 0.000000000 2024-09-12T02:49:23.923 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-09-12T02:49:23.923 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-09-12T02:49:23.923 INFO:teuthology.orchestra.run.smithi044.stdout: "mds_sessions": { 2024-09-12T02:49:23.923 INFO:teuthology.orchestra.run.smithi044.stdout: "session_count": 2, 2024-09-12T02:49:23.923 INFO:teuthology.orchestra.run.smithi044.stdout: "session_add": 7, 2024-09-12T02:49:23.923 INFO:teuthology.orchestra.run.smithi044.stdout: "session_remove": 5, 2024-09-12T02:49:23.923 INFO:teuthology.orchestra.run.smithi044.stdout: "sessions_open": 2, 2024-09-12T02:49:23.923 INFO:teuthology.orchestra.run.smithi044.stdout: "sessions_stale": 0, 2024-09-12T02:49:23.924 INFO:teuthology.orchestra.run.smithi044.stdout: "total_load": 113, 2024-09-12T02:49:23.924 INFO:teuthology.orchestra.run.smithi044.stdout: "average_load": 56, 2024-09-12T02:49:23.924 INFO:teuthology.orchestra.run.smithi044.stdout: "avg_session_uptime": 684, 2024-09-12T02:49:23.924 INFO:teuthology.orchestra.run.smithi044.stdout: "mdthresh_evicted": 0 2024-09-12T02:49:23.924 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-09-12T02:49:23.924 INFO:teuthology.orchestra.run.smithi044.stdout: "mempool": { 2024-09-12T02:49:23.924 INFO:teuthology.orchestra.run.smithi044.stdout: "bloom_filter_bytes": 0, 2024-09-12T02:49:23.924 INFO:teuthology.orchestra.run.smithi044.stdout: "bloom_filter_items": 0, 2024-09-12T02:49:23.924 INFO:teuthology.orchestra.run.smithi044.stdout: "bluestore_alloc_bytes": 0, 2024-09-12T02:49:23.924 INFO:teuthology.orchestra.run.smithi044.stdout: "bluestore_alloc_items": 0, 2024-09-12T02:49:23.924 INFO:teuthology.orchestra.run.smithi044.stdout: "bluestore_cache_data_bytes": 0, 2024-09-12T02:49:23.924 INFO:teuthology.orchestra.run.smithi044.stdout: "bluestore_cache_data_items": 0, 2024-09-12T02:49:23.925 INFO:teuthology.orchestra.run.smithi044.stdout: "bluestore_cache_onode_bytes": 0, 2024-09-12T02:49:23.925 INFO:teuthology.orchestra.run.smithi044.stdout: "bluestore_cache_onode_items": 0, 2024-09-12T02:49:23.925 INFO:teuthology.orchestra.run.smithi044.stdout: "bluestore_cache_meta_bytes": 0, 2024-09-12T02:49:23.925 INFO:teuthology.orchestra.run.smithi044.stdout: "bluestore_cache_meta_items": 0, 2024-09-12T02:49:23.925 INFO:teuthology.orchestra.run.smithi044.stdout: "bluestore_cache_other_bytes": 0, 2024-09-12T02:49:23.925 INFO:teuthology.orchestra.run.smithi044.stdout: "bluestore_cache_other_items": 0, 2024-09-12T02:49:23.925 INFO:teuthology.orchestra.run.smithi044.stdout: "bluestore_cache_buffer_bytes": 0, 2024-09-12T02:49:23.925 INFO:teuthology.orchestra.run.smithi044.stdout: "bluestore_cache_buffer_items": 0, 2024-09-12T02:49:23.925 INFO:teuthology.orchestra.run.smithi044.stdout: "bluestore_extent_bytes": 0, 2024-09-12T02:49:23.926 INFO:teuthology.orchestra.run.smithi044.stdout: "bluestore_extent_items": 0, 2024-09-12T02:49:23.926 INFO:teuthology.orchestra.run.smithi044.stdout: "bluestore_blob_bytes": 0, 2024-09-12T02:49:23.926 INFO:teuthology.orchestra.run.smithi044.stdout: "bluestore_blob_items": 0, 2024-09-12T02:49:23.926 INFO:teuthology.orchestra.run.smithi044.stdout: "bluestore_shared_blob_bytes": 0, 2024-09-12T02:49:23.926 INFO:teuthology.orchestra.run.smithi044.stdout: "bluestore_shared_blob_items": 0, 2024-09-12T02:49:23.926 INFO:teuthology.orchestra.run.smithi044.stdout: "bluestore_inline_bl_bytes": 0, 2024-09-12T02:49:23.926 INFO:teuthology.orchestra.run.smithi044.stdout: "bluestore_inline_bl_items": 0, 2024-09-12T02:49:23.926 INFO:teuthology.orchestra.run.smithi044.stdout: "bluestore_fsck_bytes": 0, 2024-09-12T02:49:23.926 INFO:teuthology.orchestra.run.smithi044.stdout: "bluestore_fsck_items": 0, 2024-09-12T02:49:23.926 INFO:teuthology.orchestra.run.smithi044.stdout: "bluestore_txc_bytes": 0, 2024-09-12T02:49:23.926 INFO:teuthology.orchestra.run.smithi044.stdout: "bluestore_txc_items": 0, 2024-09-12T02:49:23.926 INFO:teuthology.orchestra.run.smithi044.stdout: "bluestore_writing_deferred_bytes": 0, 2024-09-12T02:49:23.926 INFO:teuthology.orchestra.run.smithi044.stdout: "bluestore_writing_deferred_items": 0, 2024-09-12T02:49:23.927 INFO:teuthology.orchestra.run.smithi044.stdout: "bluestore_writing_bytes": 0, 2024-09-12T02:49:23.927 INFO:teuthology.orchestra.run.smithi044.stdout: "bluestore_writing_items": 0, 2024-09-12T02:49:23.927 INFO:teuthology.orchestra.run.smithi044.stdout: "bluefs_bytes": 0, 2024-09-12T02:49:23.927 INFO:teuthology.orchestra.run.smithi044.stdout: "bluefs_items": 0, 2024-09-12T02:49:23.927 INFO:teuthology.orchestra.run.smithi044.stdout: "bluefs_file_reader_bytes": 0, 2024-09-12T02:49:23.927 INFO:teuthology.orchestra.run.smithi044.stdout: "bluefs_file_reader_items": 0, 2024-09-12T02:49:23.927 INFO:teuthology.orchestra.run.smithi044.stdout: "bluefs_file_writer_bytes": 0, 2024-09-12T02:49:23.927 INFO:teuthology.orchestra.run.smithi044.stdout: "bluefs_file_writer_items": 0, 2024-09-12T02:49:23.927 INFO:teuthology.orchestra.run.smithi044.stdout: "buffer_anon_bytes": 332879, 2024-09-12T02:49:23.927 INFO:teuthology.orchestra.run.smithi044.stdout: "buffer_anon_items": 136, 2024-09-12T02:49:23.927 INFO:teuthology.orchestra.run.smithi044.stdout: "buffer_meta_bytes": 0, 2024-09-12T02:49:23.928 INFO:teuthology.orchestra.run.smithi044.stdout: "buffer_meta_items": 0, 2024-09-12T02:49:23.928 INFO:teuthology.orchestra.run.smithi044.stdout: "osd_bytes": 0, 2024-09-12T02:49:23.928 INFO:teuthology.orchestra.run.smithi044.stdout: "osd_items": 0, 2024-09-12T02:49:23.928 INFO:teuthology.orchestra.run.smithi044.stdout: "osd_mapbl_bytes": 0, 2024-09-12T02:49:23.928 INFO:teuthology.orchestra.run.smithi044.stdout: "osd_mapbl_items": 0, 2024-09-12T02:49:23.928 INFO:teuthology.orchestra.run.smithi044.stdout: "osd_pglog_bytes": 0, 2024-09-12T02:49:23.928 INFO:teuthology.orchestra.run.smithi044.stdout: "osd_pglog_items": 0, 2024-09-12T02:49:23.928 INFO:teuthology.orchestra.run.smithi044.stdout: "osdmap_bytes": 9520, 2024-09-12T02:49:23.928 INFO:teuthology.orchestra.run.smithi044.stdout: "osdmap_items": 193, 2024-09-12T02:49:23.928 INFO:teuthology.orchestra.run.smithi044.stdout: "osdmap_mapping_bytes": 0, 2024-09-12T02:49:23.928 INFO:teuthology.orchestra.run.smithi044.stdout: "osdmap_mapping_items": 0, 2024-09-12T02:49:23.929 INFO:teuthology.orchestra.run.smithi044.stdout: "pgmap_bytes": 0, 2024-09-12T02:49:23.929 INFO:teuthology.orchestra.run.smithi044.stdout: "pgmap_items": 0, 2024-09-12T02:49:23.929 INFO:teuthology.orchestra.run.smithi044.stdout: "mds_co_bytes": 196648, 2024-09-12T02:49:23.929 INFO:teuthology.orchestra.run.smithi044.stdout: "mds_co_items": 1506, 2024-09-12T02:49:23.929 INFO:teuthology.orchestra.run.smithi044.stdout: "unittest_1_bytes": 0, 2024-09-12T02:49:23.929 INFO:teuthology.orchestra.run.smithi044.stdout: "unittest_1_items": 0, 2024-09-12T02:49:23.929 INFO:teuthology.orchestra.run.smithi044.stdout: "unittest_2_bytes": 0, 2024-09-12T02:49:23.929 INFO:teuthology.orchestra.run.smithi044.stdout: "unittest_2_items": 0 2024-09-12T02:49:23.929 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-09-12T02:49:23.929 INFO:teuthology.orchestra.run.smithi044.stdout: "objecter": { 2024-09-12T02:49:23.929 INFO:teuthology.orchestra.run.smithi044.stdout: "op_active": 0, 2024-09-12T02:49:23.929 INFO:teuthology.orchestra.run.smithi044.stdout: "op_laggy": 0, 2024-09-12T02:49:23.929 INFO:teuthology.orchestra.run.smithi044.stdout: "op_send": 3449, 2024-09-12T02:49:23.930 INFO:teuthology.orchestra.run.smithi044.stdout: "op_send_bytes": 24039232, 2024-09-12T02:49:23.930 INFO:teuthology.orchestra.run.smithi044.stdout: "op_resend": 37, 2024-09-12T02:49:23.930 INFO:teuthology.orchestra.run.smithi044.stdout: "op_reply": 3449, 2024-09-12T02:49:23.930 INFO:teuthology.orchestra.run.smithi044.stdout: "op_latency": { 2024-09-12T02:49:23.930 INFO:teuthology.orchestra.run.smithi044.stdout: "avgcount": 3449, 2024-09-12T02:49:23.930 INFO:teuthology.orchestra.run.smithi044.stdout: "sum": 24.528611339, 2024-09-12T02:49:23.930 INFO:teuthology.orchestra.run.smithi044.stdout: "avgtime": 0.007111803 2024-09-12T02:49:23.930 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-09-12T02:49:23.930 INFO:teuthology.orchestra.run.smithi044.stdout: "op_inflight": 0, 2024-09-12T02:49:23.930 INFO:teuthology.orchestra.run.smithi044.stdout: "oplen_avg": { 2024-09-12T02:49:23.931 INFO:teuthology.orchestra.run.smithi044.stdout: "avgcount": 3449, 2024-09-12T02:49:23.931 INFO:teuthology.orchestra.run.smithi044.stdout: "sum": 3494 2024-09-12T02:49:23.931 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-09-12T02:49:23.931 INFO:teuthology.orchestra.run.smithi044.stdout: "op": 3449, 2024-09-12T02:49:23.931 INFO:teuthology.orchestra.run.smithi044.stdout: "op_r": 0, 2024-09-12T02:49:23.931 INFO:teuthology.orchestra.run.smithi044.stdout: "op_w": 3449, 2024-09-12T02:49:23.931 INFO:teuthology.orchestra.run.smithi044.stdout: "op_rmw": 0, 2024-09-12T02:49:23.931 INFO:teuthology.orchestra.run.smithi044.stdout: "op_pg": 0, 2024-09-12T02:49:23.931 INFO:teuthology.orchestra.run.smithi044.stdout: "osdop_stat": 0, 2024-09-12T02:49:23.931 INFO:teuthology.orchestra.run.smithi044.stdout: "osdop_create": 11, 2024-09-12T02:49:23.931 INFO:teuthology.orchestra.run.smithi044.stdout: "osdop_read": 0, 2024-09-12T02:49:23.931 INFO:teuthology.orchestra.run.smithi044.stdout: "osdop_write": 2233, 2024-09-12T02:49:23.932 INFO:teuthology.orchestra.run.smithi044.stdout: "osdop_writefull": 55, 2024-09-12T02:49:23.932 INFO:teuthology.orchestra.run.smithi044.stdout: "osdop_writesame": 0, 2024-09-12T02:49:23.932 INFO:teuthology.orchestra.run.smithi044.stdout: "osdop_append": 0, 2024-09-12T02:49:23.932 INFO:teuthology.orchestra.run.smithi044.stdout: "osdop_zero": 0, 2024-09-12T02:49:23.932 INFO:teuthology.orchestra.run.smithi044.stdout: "osdop_truncate": 0, 2024-09-12T02:49:23.932 INFO:teuthology.orchestra.run.smithi044.stdout: "osdop_delete": 511, 2024-09-12T02:49:23.932 INFO:teuthology.orchestra.run.smithi044.stdout: "osdop_mapext": 0, 2024-09-12T02:49:23.932 INFO:teuthology.orchestra.run.smithi044.stdout: "osdop_sparse_read": 0, 2024-09-12T02:49:23.932 INFO:teuthology.orchestra.run.smithi044.stdout: "osdop_clonerange": 0, 2024-09-12T02:49:23.932 INFO:teuthology.orchestra.run.smithi044.stdout: "osdop_getxattr": 0, 2024-09-12T02:49:23.932 INFO:teuthology.orchestra.run.smithi044.stdout: "osdop_setxattr": 22, 2024-09-12T02:49:23.933 INFO:teuthology.orchestra.run.smithi044.stdout: "osdop_cmpxattr": 0, 2024-09-12T02:49:23.933 INFO:teuthology.orchestra.run.smithi044.stdout: "osdop_rmxattr": 0, 2024-09-12T02:49:23.933 INFO:teuthology.orchestra.run.smithi044.stdout: "osdop_resetxattrs": 0, 2024-09-12T02:49:23.933 INFO:teuthology.orchestra.run.smithi044.stdout: "osdop_call": 0, 2024-09-12T02:49:23.933 INFO:teuthology.orchestra.run.smithi044.stdout: "osdop_watch": 0, 2024-09-12T02:49:23.933 INFO:teuthology.orchestra.run.smithi044.stdout: "osdop_notify": 0, 2024-09-12T02:49:23.933 INFO:teuthology.orchestra.run.smithi044.stdout: "osdop_src_cmpxattr": 0, 2024-09-12T02:49:23.933 INFO:teuthology.orchestra.run.smithi044.stdout: "osdop_pgls": 0, 2024-09-12T02:49:23.933 INFO:teuthology.orchestra.run.smithi044.stdout: "osdop_pgls_filter": 0, 2024-09-12T02:49:23.933 INFO:teuthology.orchestra.run.smithi044.stdout: "osdop_other": 599, 2024-09-12T02:49:23.934 INFO:teuthology.orchestra.run.smithi044.stdout: "linger_active": 0, 2024-09-12T02:49:23.934 INFO:teuthology.orchestra.run.smithi044.stdout: "linger_send": 0, 2024-09-12T02:49:23.934 INFO:teuthology.orchestra.run.smithi044.stdout: "linger_resend": 0, 2024-09-12T02:49:23.934 INFO:teuthology.orchestra.run.smithi044.stdout: "linger_ping": 0, 2024-09-12T02:49:23.934 INFO:teuthology.orchestra.run.smithi044.stdout: "poolop_active": 0, 2024-09-12T02:49:23.934 INFO:teuthology.orchestra.run.smithi044.stdout: "poolop_send": 0, 2024-09-12T02:49:23.934 INFO:teuthology.orchestra.run.smithi044.stdout: "poolop_resend": 0, 2024-09-12T02:49:23.934 INFO:teuthology.orchestra.run.smithi044.stdout: "poolstat_active": 0, 2024-09-12T02:49:23.934 INFO:teuthology.orchestra.run.smithi044.stdout: "poolstat_send": 0, 2024-09-12T02:49:23.934 INFO:teuthology.orchestra.run.smithi044.stdout: "poolstat_resend": 0, 2024-09-12T02:49:23.934 INFO:teuthology.orchestra.run.smithi044.stdout: "statfs_active": 0, 2024-09-12T02:49:23.935 INFO:teuthology.orchestra.run.smithi044.stdout: "statfs_send": 0, 2024-09-12T02:49:23.935 INFO:teuthology.orchestra.run.smithi044.stdout: "statfs_resend": 0, 2024-09-12T02:49:23.935 INFO:teuthology.orchestra.run.smithi044.stdout: "command_active": 0, 2024-09-12T02:49:23.935 INFO:teuthology.orchestra.run.smithi044.stdout: "command_send": 0, 2024-09-12T02:49:23.935 INFO:teuthology.orchestra.run.smithi044.stdout: "command_resend": 0, 2024-09-12T02:49:23.935 INFO:teuthology.orchestra.run.smithi044.stdout: "map_epoch": 108, 2024-09-12T02:49:23.935 INFO:teuthology.orchestra.run.smithi044.stdout: "map_full": 0, 2024-09-12T02:49:23.935 INFO:teuthology.orchestra.run.smithi044.stdout: "map_inc": 24, 2024-09-12T02:49:23.935 INFO:teuthology.orchestra.run.smithi044.stdout: "osd_sessions": 12, 2024-09-12T02:49:23.935 INFO:teuthology.orchestra.run.smithi044.stdout: "osd_session_open": 12, 2024-09-12T02:49:23.936 INFO:teuthology.orchestra.run.smithi044.stdout: "osd_session_close": 0, 2024-09-12T02:49:23.936 INFO:teuthology.orchestra.run.smithi044.stdout: "osd_laggy": 0, 2024-09-12T02:49:23.936 INFO:teuthology.orchestra.run.smithi044.stdout: "omap_wr": 56, 2024-09-12T02:49:23.936 INFO:teuthology.orchestra.run.smithi044.stdout: "omap_rd": 0, 2024-09-12T02:49:23.936 INFO:teuthology.orchestra.run.smithi044.stdout: "omap_del": 7 2024-09-12T02:49:23.936 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-09-12T02:49:23.936 INFO:teuthology.orchestra.run.smithi044.stdout: "oft": { 2024-09-12T02:49:23.936 INFO:teuthology.orchestra.run.smithi044.stdout: "omap_total_objs": 1, 2024-09-12T02:49:23.936 INFO:teuthology.orchestra.run.smithi044.stdout: "omap_total_kv_pairs": 0, 2024-09-12T02:49:23.936 INFO:teuthology.orchestra.run.smithi044.stdout: "omap_total_updates": 0, 2024-09-12T02:49:23.936 INFO:teuthology.orchestra.run.smithi044.stdout: "omap_total_removes": 0 2024-09-12T02:49:23.936 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-09-12T02:49:23.936 INFO:teuthology.orchestra.run.smithi044.stdout: "osd-slow-ops": { 2024-09-12T02:49:23.936 INFO:teuthology.orchestra.run.smithi044.stdout: "slow_ops_count": 0 2024-09-12T02:49:23.937 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-09-12T02:49:23.937 INFO:teuthology.orchestra.run.smithi044.stdout: "purge_queue": { 2024-09-12T02:49:23.937 INFO:teuthology.orchestra.run.smithi044.stdout: "pq_executing_ops": 0, 2024-09-12T02:49:23.937 INFO:teuthology.orchestra.run.smithi044.stdout: "pq_executing_ops_high_water": 0, 2024-09-12T02:49:23.937 INFO:teuthology.orchestra.run.smithi044.stdout: "pq_executing": 0, 2024-09-12T02:49:23.937 INFO:teuthology.orchestra.run.smithi044.stdout: "pq_executing_high_water": 0, 2024-09-12T02:49:23.937 INFO:teuthology.orchestra.run.smithi044.stdout: "pq_executed_ops": 0, 2024-09-12T02:49:23.937 INFO:teuthology.orchestra.run.smithi044.stdout: "pq_executed": 0, 2024-09-12T02:49:23.937 INFO:teuthology.orchestra.run.smithi044.stdout: "pq_item_in_journal": 0 2024-09-12T02:49:23.937 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-09-12T02:49:23.937 INFO:teuthology.orchestra.run.smithi044.stdout: "throttle-msgr_dispatch_throttler-mds": { 2024-09-12T02:49:23.937 INFO:teuthology.orchestra.run.smithi044.stdout: "val": 0, 2024-09-12T02:49:23.937 INFO:teuthology.orchestra.run.smithi044.stdout: "max": 104857600, 2024-09-12T02:49:23.938 INFO:teuthology.orchestra.run.smithi044.stdout: "get_started": 0, 2024-09-12T02:49:23.938 INFO:teuthology.orchestra.run.smithi044.stdout: "get": 9621, 2024-09-12T02:49:23.938 INFO:teuthology.orchestra.run.smithi044.stdout: "get_sum": 4250761, 2024-09-12T02:49:23.938 INFO:teuthology.orchestra.run.smithi044.stdout: "get_or_fail_fail": 0, 2024-09-12T02:49:23.938 INFO:teuthology.orchestra.run.smithi044.stdout: "get_or_fail_success": 9621, 2024-09-12T02:49:23.938 INFO:teuthology.orchestra.run.smithi044.stdout: "take": 0, 2024-09-12T02:49:23.938 INFO:teuthology.orchestra.run.smithi044.stdout: "take_sum": 0, 2024-09-12T02:49:23.938 INFO:teuthology.orchestra.run.smithi044.stdout: "put": 9621, 2024-09-12T02:49:23.938 INFO:teuthology.orchestra.run.smithi044.stdout: "put_sum": 4250761, 2024-09-12T02:49:23.938 INFO:teuthology.orchestra.run.smithi044.stdout: "wait": { 2024-09-12T02:49:23.938 INFO:teuthology.orchestra.run.smithi044.stdout: "avgcount": 0, 2024-09-12T02:49:23.938 INFO:teuthology.orchestra.run.smithi044.stdout: "sum": 0.000000000, 2024-09-12T02:49:23.938 INFO:teuthology.orchestra.run.smithi044.stdout: "avgtime": 0.000000000 2024-09-12T02:49:23.938 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-09-12T02:49:23.939 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-09-12T02:49:23.939 INFO:teuthology.orchestra.run.smithi044.stdout: "throttle-objecter_bytes": { 2024-09-12T02:49:23.939 INFO:teuthology.orchestra.run.smithi044.stdout: "val": 0, 2024-09-12T02:49:23.939 INFO:teuthology.orchestra.run.smithi044.stdout: "max": 104857600, 2024-09-12T02:49:23.939 INFO:teuthology.orchestra.run.smithi044.stdout: "get_started": 0, 2024-09-12T02:49:23.939 INFO:teuthology.orchestra.run.smithi044.stdout: "get": 0, 2024-09-12T02:49:23.939 INFO:teuthology.orchestra.run.smithi044.stdout: "get_sum": 0, 2024-09-12T02:49:23.939 INFO:teuthology.orchestra.run.smithi044.stdout: "get_or_fail_fail": 0, 2024-09-12T02:49:23.939 INFO:teuthology.orchestra.run.smithi044.stdout: "get_or_fail_success": 0, 2024-09-12T02:49:23.939 INFO:teuthology.orchestra.run.smithi044.stdout: "take": 3449, 2024-09-12T02:49:23.940 INFO:teuthology.orchestra.run.smithi044.stdout: "take_sum": 24039232, 2024-09-12T02:49:23.940 INFO:teuthology.orchestra.run.smithi044.stdout: "put": 3449, 2024-09-12T02:49:23.940 INFO:teuthology.orchestra.run.smithi044.stdout: "put_sum": 24039232, 2024-09-12T02:49:23.940 INFO:teuthology.orchestra.run.smithi044.stdout: "wait": { 2024-09-12T02:49:23.940 INFO:teuthology.orchestra.run.smithi044.stdout: "avgcount": 0, 2024-09-12T02:49:23.941 INFO:teuthology.orchestra.run.smithi044.stdout: "sum": 0.000000000, 2024-09-12T02:49:23.941 INFO:teuthology.orchestra.run.smithi044.stdout: "avgtime": 0.000000000 2024-09-12T02:49:23.941 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-09-12T02:49:23.941 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-09-12T02:49:23.941 INFO:teuthology.orchestra.run.smithi044.stdout: "throttle-objecter_ops": { 2024-09-12T02:49:23.941 INFO:teuthology.orchestra.run.smithi044.stdout: "val": 0, 2024-09-12T02:49:23.941 INFO:teuthology.orchestra.run.smithi044.stdout: "max": 1024, 2024-09-12T02:49:23.941 INFO:teuthology.orchestra.run.smithi044.stdout: "get_started": 0, 2024-09-12T02:49:23.941 INFO:teuthology.orchestra.run.smithi044.stdout: "get": 0, 2024-09-12T02:49:23.941 INFO:teuthology.orchestra.run.smithi044.stdout: "get_sum": 0, 2024-09-12T02:49:23.941 INFO:teuthology.orchestra.run.smithi044.stdout: "get_or_fail_fail": 0, 2024-09-12T02:49:23.941 INFO:teuthology.orchestra.run.smithi044.stdout: "get_or_fail_success": 0, 2024-09-12T02:49:23.942 INFO:teuthology.orchestra.run.smithi044.stdout: "take": 3449, 2024-09-12T02:49:23.942 INFO:teuthology.orchestra.run.smithi044.stdout: "take_sum": 3449, 2024-09-12T02:49:23.942 INFO:teuthology.orchestra.run.smithi044.stdout: "put": 3449, 2024-09-12T02:49:23.942 INFO:teuthology.orchestra.run.smithi044.stdout: "put_sum": 3449, 2024-09-12T02:49:23.942 INFO:teuthology.orchestra.run.smithi044.stdout: "wait": { 2024-09-12T02:49:23.942 INFO:teuthology.orchestra.run.smithi044.stdout: "avgcount": 0, 2024-09-12T02:49:23.942 INFO:teuthology.orchestra.run.smithi044.stdout: "sum": 0.000000000, 2024-09-12T02:49:23.942 INFO:teuthology.orchestra.run.smithi044.stdout: "avgtime": 0.000000000 2024-09-12T02:49:23.942 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-09-12T02:49:23.942 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-09-12T02:49:23.942 INFO:teuthology.orchestra.run.smithi044.stdout: "throttle-write_buf_throttle": { 2024-09-12T02:49:23.943 INFO:teuthology.orchestra.run.smithi044.stdout: "val": 0, 2024-09-12T02:49:23.943 INFO:teuthology.orchestra.run.smithi044.stdout: "max": 3758096384, 2024-09-12T02:49:23.943 INFO:teuthology.orchestra.run.smithi044.stdout: "get_started": 0, 2024-09-12T02:49:23.943 INFO:teuthology.orchestra.run.smithi044.stdout: "get": 0, 2024-09-12T02:49:23.943 INFO:teuthology.orchestra.run.smithi044.stdout: "get_sum": 0, 2024-09-12T02:49:23.943 INFO:teuthology.orchestra.run.smithi044.stdout: "get_or_fail_fail": 0, 2024-09-12T02:49:23.943 INFO:teuthology.orchestra.run.smithi044.stdout: "get_or_fail_success": 0, 2024-09-12T02:49:23.943 INFO:teuthology.orchestra.run.smithi044.stdout: "take": 0, 2024-09-12T02:49:23.943 INFO:teuthology.orchestra.run.smithi044.stdout: "take_sum": 0, 2024-09-12T02:49:23.943 INFO:teuthology.orchestra.run.smithi044.stdout: "put": 0, 2024-09-12T02:49:23.943 INFO:teuthology.orchestra.run.smithi044.stdout: "put_sum": 0, 2024-09-12T02:49:23.943 INFO:teuthology.orchestra.run.smithi044.stdout: "wait": { 2024-09-12T02:49:23.943 INFO:teuthology.orchestra.run.smithi044.stdout: "avgcount": 0, 2024-09-12T02:49:23.943 INFO:teuthology.orchestra.run.smithi044.stdout: "sum": 0.000000000, 2024-09-12T02:49:23.944 INFO:teuthology.orchestra.run.smithi044.stdout: "avgtime": 0.000000000 2024-09-12T02:49:23.944 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-09-12T02:49:23.944 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-09-12T02:49:23.944 INFO:teuthology.orchestra.run.smithi044.stdout: "throttle-write_buf_throttle-0x55df84c08960": { 2024-09-12T02:49:23.944 INFO:teuthology.orchestra.run.smithi044.stdout: "val": 0, 2024-09-12T02:49:23.944 INFO:teuthology.orchestra.run.smithi044.stdout: "max": 3758096384, 2024-09-12T02:49:23.944 INFO:teuthology.orchestra.run.smithi044.stdout: "get_started": 0, 2024-09-12T02:49:23.944 INFO:teuthology.orchestra.run.smithi044.stdout: "get": 2302, 2024-09-12T02:49:23.944 INFO:teuthology.orchestra.run.smithi044.stdout: "get_sum": 24020011, 2024-09-12T02:49:23.944 INFO:teuthology.orchestra.run.smithi044.stdout: "get_or_fail_fail": 0, 2024-09-12T02:49:23.944 INFO:teuthology.orchestra.run.smithi044.stdout: "get_or_fail_success": 2302, 2024-09-12T02:49:23.945 INFO:teuthology.orchestra.run.smithi044.stdout: "take": 0, 2024-09-12T02:49:23.945 INFO:teuthology.orchestra.run.smithi044.stdout: "take_sum": 0, 2024-09-12T02:49:23.945 INFO:teuthology.orchestra.run.smithi044.stdout: "put": 2233, 2024-09-12T02:49:23.945 INFO:teuthology.orchestra.run.smithi044.stdout: "put_sum": 24020011, 2024-09-12T02:49:23.945 INFO:teuthology.orchestra.run.smithi044.stdout: "wait": { 2024-09-12T02:49:23.945 INFO:teuthology.orchestra.run.smithi044.stdout: "avgcount": 0, 2024-09-12T02:49:23.945 INFO:teuthology.orchestra.run.smithi044.stdout: "sum": 0.000000000, 2024-09-12T02:49:23.945 INFO:teuthology.orchestra.run.smithi044.stdout: "avgtime": 0.000000000 2024-09-12T02:49:23.945 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-09-12T02:49:23.945 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-09-12T02:49:23.945 INFO:teuthology.orchestra.run.smithi044.stdout:} 2024-09-12T02:49:24.013 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 12 02:49:23 smithi172 ceph-mon[35609]: pgmap v358: 129 pgs: 129 active+clean; 24 MiB data, 490 MiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 11 KiB/s wr, 11 op/s 2024-09-12T02:49:24.101 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 02:49:23 smithi039 ceph-mon[30515]: pgmap v358: 129 pgs: 129 active+clean; 24 MiB data, 490 MiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 11 KiB/s wr, 11 op/s 2024-09-12T02:49:24.944 INFO:tasks.check_counter:Daemon mds.b mds.exported=0 2024-09-12T02:49:24.945 INFO:tasks.check_counter:Daemon mds.b mds.imported=0 2024-09-12T02:49:24.945 INFO:tasks.check_counter:Daemon mds.b mds_cache.dir_update=15 2024-09-12T02:49:24.945 INFO:tasks.check_counter:Daemon mds.b mds_cache.dir_update_receipt=0 2024-09-12T02:49:24.945 INFO:tasks.check_counter:Daemon mds.b mds.root_rsnaps=6 2024-09-12T02:49:24.945 INFO:tasks.check_counter:Daemon mds.b mds_server.req_mksnap_latency.avgcount=12 2024-09-12T02:49:24.945 INFO:tasks.check_counter:Daemon mds.b mds_server.req_rmsnap_latency.avgcount=6 2024-09-12T02:49:24.945 DEBUG:tasks.check_counter:Getting stats from e 2024-09-12T02:49:24.945 DEBUG:teuthology.orchestra.run.smithi044:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc shell --fsid 4954ed46-70ae-11ef-bcea-c7b262605968 -- ceph daemon mds.e perf dump 2024-09-12T02:49:25.200 INFO:teuthology.orchestra.run.smithi044.stderr:Inferring config /var/lib/ceph/4954ed46-70ae-11ef-bcea-c7b262605968/mon.b/config 2024-09-12T02:49:25.701 INFO:teuthology.orchestra.run.smithi044.stdout:{ 2024-09-12T02:49:25.701 INFO:teuthology.orchestra.run.smithi044.stdout: "AsyncMessenger::Worker-0": { 2024-09-12T02:49:25.701 INFO:teuthology.orchestra.run.smithi044.stdout: "msgr_recv_messages": 1910, 2024-09-12T02:49:25.701 INFO:teuthology.orchestra.run.smithi044.stdout: "msgr_send_messages": 1896, 2024-09-12T02:49:25.701 INFO:teuthology.orchestra.run.smithi044.stdout: "msgr_recv_bytes": 10641642, 2024-09-12T02:49:25.701 INFO:teuthology.orchestra.run.smithi044.stdout: "msgr_send_bytes": 671148, 2024-09-12T02:49:25.701 INFO:teuthology.orchestra.run.smithi044.stdout: "msgr_created_connections": 5, 2024-09-12T02:49:25.701 INFO:teuthology.orchestra.run.smithi044.stdout: "msgr_active_connections": 1, 2024-09-12T02:49:25.702 INFO:teuthology.orchestra.run.smithi044.stdout: "msgr_running_total_time": 0.205633321, 2024-09-12T02:49:25.702 INFO:teuthology.orchestra.run.smithi044.stdout: "msgr_running_send_time": 0.078828509, 2024-09-12T02:49:25.702 INFO:teuthology.orchestra.run.smithi044.stdout: "msgr_running_recv_time": 0.086090786, 2024-09-12T02:49:25.702 INFO:teuthology.orchestra.run.smithi044.stdout: "msgr_running_fast_dispatch_time": 0.041483760, 2024-09-12T02:49:25.702 INFO:teuthology.orchestra.run.smithi044.stdout: "msgr_send_messages_queue_lat": { 2024-09-12T02:49:25.702 INFO:teuthology.orchestra.run.smithi044.stdout: "avgcount": 1895, 2024-09-12T02:49:25.702 INFO:teuthology.orchestra.run.smithi044.stdout: "sum": 0.077935203, 2024-09-12T02:49:25.702 INFO:teuthology.orchestra.run.smithi044.stdout: "avgtime": 0.000041126 2024-09-12T02:49:25.702 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-09-12T02:49:25.702 INFO:teuthology.orchestra.run.smithi044.stdout: "msgr_handle_ack_lat": { 2024-09-12T02:49:25.702 INFO:teuthology.orchestra.run.smithi044.stdout: "avgcount": 0, 2024-09-12T02:49:25.702 INFO:teuthology.orchestra.run.smithi044.stdout: "sum": 0.000000000, 2024-09-12T02:49:25.702 INFO:teuthology.orchestra.run.smithi044.stdout: "avgtime": 0.000000000 2024-09-12T02:49:25.703 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-09-12T02:49:25.703 INFO:teuthology.orchestra.run.smithi044.stdout: "msgr_recv_encrypted_bytes": 1769280, 2024-09-12T02:49:25.703 INFO:teuthology.orchestra.run.smithi044.stdout: "msgr_send_encrypted_bytes": 150896 2024-09-12T02:49:25.703 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-09-12T02:49:25.703 INFO:teuthology.orchestra.run.smithi044.stdout: "AsyncMessenger::Worker-1": { 2024-09-12T02:49:25.703 INFO:teuthology.orchestra.run.smithi044.stdout: "msgr_recv_messages": 634, 2024-09-12T02:49:25.703 INFO:teuthology.orchestra.run.smithi044.stdout: "msgr_send_messages": 813, 2024-09-12T02:49:25.703 INFO:teuthology.orchestra.run.smithi044.stdout: "msgr_recv_bytes": 8550200, 2024-09-12T02:49:25.703 INFO:teuthology.orchestra.run.smithi044.stdout: "msgr_send_bytes": 668522, 2024-09-12T02:49:25.703 INFO:teuthology.orchestra.run.smithi044.stdout: "msgr_created_connections": 7, 2024-09-12T02:49:25.703 INFO:teuthology.orchestra.run.smithi044.stdout: "msgr_active_connections": 5, 2024-09-12T02:49:25.703 INFO:teuthology.orchestra.run.smithi044.stdout: "msgr_running_total_time": 0.071658142, 2024-09-12T02:49:25.703 INFO:teuthology.orchestra.run.smithi044.stdout: "msgr_running_send_time": 0.020322330, 2024-09-12T02:49:25.704 INFO:teuthology.orchestra.run.smithi044.stdout: "msgr_running_recv_time": 0.027164704, 2024-09-12T02:49:25.704 INFO:teuthology.orchestra.run.smithi044.stdout: "msgr_running_fast_dispatch_time": 0.018119294, 2024-09-12T02:49:25.704 INFO:teuthology.orchestra.run.smithi044.stdout: "msgr_send_messages_queue_lat": { 2024-09-12T02:49:25.704 INFO:teuthology.orchestra.run.smithi044.stdout: "avgcount": 811, 2024-09-12T02:49:25.704 INFO:teuthology.orchestra.run.smithi044.stdout: "sum": 0.042166336, 2024-09-12T02:49:25.704 INFO:teuthology.orchestra.run.smithi044.stdout: "avgtime": 0.000051993 2024-09-12T02:49:25.704 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-09-12T02:49:25.704 INFO:teuthology.orchestra.run.smithi044.stdout: "msgr_handle_ack_lat": { 2024-09-12T02:49:25.704 INFO:teuthology.orchestra.run.smithi044.stdout: "avgcount": 0, 2024-09-12T02:49:25.704 INFO:teuthology.orchestra.run.smithi044.stdout: "sum": 0.000000000, 2024-09-12T02:49:25.704 INFO:teuthology.orchestra.run.smithi044.stdout: "avgtime": 0.000000000 2024-09-12T02:49:25.704 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-09-12T02:49:25.704 INFO:teuthology.orchestra.run.smithi044.stdout: "msgr_recv_encrypted_bytes": 3392, 2024-09-12T02:49:25.705 INFO:teuthology.orchestra.run.smithi044.stdout: "msgr_send_encrypted_bytes": 468752 2024-09-12T02:49:25.705 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-09-12T02:49:25.705 INFO:teuthology.orchestra.run.smithi044.stdout: "AsyncMessenger::Worker-2": { 2024-09-12T02:49:25.705 INFO:teuthology.orchestra.run.smithi044.stdout: "msgr_recv_messages": 807, 2024-09-12T02:49:25.705 INFO:teuthology.orchestra.run.smithi044.stdout: "msgr_send_messages": 809, 2024-09-12T02:49:25.705 INFO:teuthology.orchestra.run.smithi044.stdout: "msgr_recv_bytes": 7444351, 2024-09-12T02:49:25.705 INFO:teuthology.orchestra.run.smithi044.stdout: "msgr_send_bytes": 256633, 2024-09-12T02:49:25.705 INFO:teuthology.orchestra.run.smithi044.stdout: "msgr_created_connections": 5, 2024-09-12T02:49:25.705 INFO:teuthology.orchestra.run.smithi044.stdout: "msgr_active_connections": 4, 2024-09-12T02:49:25.705 INFO:teuthology.orchestra.run.smithi044.stdout: "msgr_running_total_time": 0.077936031, 2024-09-12T02:49:25.705 INFO:teuthology.orchestra.run.smithi044.stdout: "msgr_running_send_time": 0.019274669, 2024-09-12T02:49:25.705 INFO:teuthology.orchestra.run.smithi044.stdout: "msgr_running_recv_time": 0.027858579, 2024-09-12T02:49:25.705 INFO:teuthology.orchestra.run.smithi044.stdout: "msgr_running_fast_dispatch_time": 0.024519415, 2024-09-12T02:49:25.705 INFO:teuthology.orchestra.run.smithi044.stdout: "msgr_send_messages_queue_lat": { 2024-09-12T02:49:25.706 INFO:teuthology.orchestra.run.smithi044.stdout: "avgcount": 807, 2024-09-12T02:49:25.706 INFO:teuthology.orchestra.run.smithi044.stdout: "sum": 0.025865557, 2024-09-12T02:49:25.706 INFO:teuthology.orchestra.run.smithi044.stdout: "avgtime": 0.000032051 2024-09-12T02:49:25.706 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-09-12T02:49:25.706 INFO:teuthology.orchestra.run.smithi044.stdout: "msgr_handle_ack_lat": { 2024-09-12T02:49:25.706 INFO:teuthology.orchestra.run.smithi044.stdout: "avgcount": 0, 2024-09-12T02:49:25.706 INFO:teuthology.orchestra.run.smithi044.stdout: "sum": 0.000000000, 2024-09-12T02:49:25.706 INFO:teuthology.orchestra.run.smithi044.stdout: "avgtime": 0.000000000 2024-09-12T02:49:25.706 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-09-12T02:49:25.706 INFO:teuthology.orchestra.run.smithi044.stdout: "msgr_recv_encrypted_bytes": 0, 2024-09-12T02:49:25.706 INFO:teuthology.orchestra.run.smithi044.stdout: "msgr_send_encrypted_bytes": 0 2024-09-12T02:49:25.706 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-09-12T02:49:25.706 INFO:teuthology.orchestra.run.smithi044.stdout: "cct": { 2024-09-12T02:49:25.707 INFO:teuthology.orchestra.run.smithi044.stdout: "total_workers": 1, 2024-09-12T02:49:25.707 INFO:teuthology.orchestra.run.smithi044.stdout: "unhealthy_workers": 0 2024-09-12T02:49:25.707 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-09-12T02:49:25.707 INFO:teuthology.orchestra.run.smithi044.stdout: "finisher-MDSRank": { 2024-09-12T02:49:25.707 INFO:teuthology.orchestra.run.smithi044.stdout: "queue_len": 0, 2024-09-12T02:49:25.707 INFO:teuthology.orchestra.run.smithi044.stdout: "complete_latency": { 2024-09-12T02:49:25.707 INFO:teuthology.orchestra.run.smithi044.stdout: "avgcount": 5264, 2024-09-12T02:49:25.707 INFO:teuthology.orchestra.run.smithi044.stdout: "sum": 0.126044336, 2024-09-12T02:49:25.707 INFO:teuthology.orchestra.run.smithi044.stdout: "avgtime": 0.000023944 2024-09-12T02:49:25.707 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-09-12T02:49:25.707 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-09-12T02:49:25.707 INFO:teuthology.orchestra.run.smithi044.stdout: "finisher-PurgeQueue": { 2024-09-12T02:49:25.707 INFO:teuthology.orchestra.run.smithi044.stdout: "queue_len": 0, 2024-09-12T02:49:25.707 INFO:teuthology.orchestra.run.smithi044.stdout: "complete_latency": { 2024-09-12T02:49:25.708 INFO:teuthology.orchestra.run.smithi044.stdout: "avgcount": 0, 2024-09-12T02:49:25.708 INFO:teuthology.orchestra.run.smithi044.stdout: "sum": 0.000000000, 2024-09-12T02:49:25.708 INFO:teuthology.orchestra.run.smithi044.stdout: "avgtime": 0.000000000 2024-09-12T02:49:25.708 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-09-12T02:49:25.708 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-09-12T02:49:25.708 INFO:teuthology.orchestra.run.smithi044.stdout: "mds": { 2024-09-12T02:49:25.708 INFO:teuthology.orchestra.run.smithi044.stdout: "request": 0, 2024-09-12T02:49:25.708 INFO:teuthology.orchestra.run.smithi044.stdout: "reply": 0, 2024-09-12T02:49:25.708 INFO:teuthology.orchestra.run.smithi044.stdout: "reply_latency": { 2024-09-12T02:49:25.709 INFO:teuthology.orchestra.run.smithi044.stdout: "avgcount": 0, 2024-09-12T02:49:25.709 INFO:teuthology.orchestra.run.smithi044.stdout: "sum": 0.000000000, 2024-09-12T02:49:25.709 INFO:teuthology.orchestra.run.smithi044.stdout: "avgtime": 0.000000000 2024-09-12T02:49:25.709 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-09-12T02:49:25.709 INFO:teuthology.orchestra.run.smithi044.stdout: "slow_reply": 0, 2024-09-12T02:49:25.709 INFO:teuthology.orchestra.run.smithi044.stdout: "forward": 0, 2024-09-12T02:49:25.709 INFO:teuthology.orchestra.run.smithi044.stdout: "dir_fetch_complete": 0, 2024-09-12T02:49:25.709 INFO:teuthology.orchestra.run.smithi044.stdout: "dir_fetch_keys": 0, 2024-09-12T02:49:25.709 INFO:teuthology.orchestra.run.smithi044.stdout: "dir_commit": 0, 2024-09-12T02:49:25.709 INFO:teuthology.orchestra.run.smithi044.stdout: "dir_split": 0, 2024-09-12T02:49:25.709 INFO:teuthology.orchestra.run.smithi044.stdout: "dir_merge": 0, 2024-09-12T02:49:25.709 INFO:teuthology.orchestra.run.smithi044.stdout: "inodes": 31, 2024-09-12T02:49:25.709 INFO:teuthology.orchestra.run.smithi044.stdout: "inodes_top": 0, 2024-09-12T02:49:25.709 INFO:teuthology.orchestra.run.smithi044.stdout: "inodes_bottom": 31, 2024-09-12T02:49:25.710 INFO:teuthology.orchestra.run.smithi044.stdout: "inodes_pin_tail": 0, 2024-09-12T02:49:25.710 INFO:teuthology.orchestra.run.smithi044.stdout: "inodes_pinned": 31, 2024-09-12T02:49:25.710 INFO:teuthology.orchestra.run.smithi044.stdout: "inodes_expired": 0, 2024-09-12T02:49:25.710 INFO:teuthology.orchestra.run.smithi044.stdout: "inodes_with_caps": 0, 2024-09-12T02:49:25.710 INFO:teuthology.orchestra.run.smithi044.stdout: "caps": 0, 2024-09-12T02:49:25.710 INFO:teuthology.orchestra.run.smithi044.stdout: "subtrees": 2, 2024-09-12T02:49:25.710 INFO:teuthology.orchestra.run.smithi044.stdout: "traverse": 0, 2024-09-12T02:49:25.710 INFO:teuthology.orchestra.run.smithi044.stdout: "traverse_hit": 0, 2024-09-12T02:49:25.710 INFO:teuthology.orchestra.run.smithi044.stdout: "traverse_forward": 0, 2024-09-12T02:49:25.710 INFO:teuthology.orchestra.run.smithi044.stdout: "traverse_discover": 0, 2024-09-12T02:49:25.710 INFO:teuthology.orchestra.run.smithi044.stdout: "traverse_dir_fetch": 0, 2024-09-12T02:49:25.710 INFO:teuthology.orchestra.run.smithi044.stdout: "traverse_remote_ino": 0, 2024-09-12T02:49:25.710 INFO:teuthology.orchestra.run.smithi044.stdout: "traverse_lock": 0, 2024-09-12T02:49:25.710 INFO:teuthology.orchestra.run.smithi044.stdout: "load_cent": 0, 2024-09-12T02:49:25.711 INFO:teuthology.orchestra.run.smithi044.stdout: "q": 0, 2024-09-12T02:49:25.711 INFO:teuthology.orchestra.run.smithi044.stdout: "exported": 0, 2024-09-12T02:49:25.711 INFO:teuthology.orchestra.run.smithi044.stdout: "exported_inodes": 0, 2024-09-12T02:49:25.711 INFO:teuthology.orchestra.run.smithi044.stdout: "imported": 0, 2024-09-12T02:49:25.711 INFO:teuthology.orchestra.run.smithi044.stdout: "imported_inodes": 0, 2024-09-12T02:49:25.711 INFO:teuthology.orchestra.run.smithi044.stdout: "openino_dir_fetch": 0, 2024-09-12T02:49:25.711 INFO:teuthology.orchestra.run.smithi044.stdout: "openino_backtrace_fetch": 0, 2024-09-12T02:49:25.711 INFO:teuthology.orchestra.run.smithi044.stdout: "openino_peer_discover": 0, 2024-09-12T02:49:25.711 INFO:teuthology.orchestra.run.smithi044.stdout: "root_rfiles": 4, 2024-09-12T02:49:25.711 INFO:teuthology.orchestra.run.smithi044.stdout: "root_rbytes": 234, 2024-09-12T02:49:25.711 INFO:teuthology.orchestra.run.smithi044.stdout: "root_rsnaps": 6, 2024-09-12T02:49:25.711 INFO:teuthology.orchestra.run.smithi044.stdout: "scrub_backtrace_fetch": 0, 2024-09-12T02:49:25.711 INFO:teuthology.orchestra.run.smithi044.stdout: "scrub_set_tag": 0, 2024-09-12T02:49:25.711 INFO:teuthology.orchestra.run.smithi044.stdout: "scrub_backtrace_repaired": 0, 2024-09-12T02:49:25.712 INFO:teuthology.orchestra.run.smithi044.stdout: "scrub_inotable_repaired": 0, 2024-09-12T02:49:25.712 INFO:teuthology.orchestra.run.smithi044.stdout: "scrub_dir_inodes": 0, 2024-09-12T02:49:25.712 INFO:teuthology.orchestra.run.smithi044.stdout: "scrub_dir_base_inodes": 0, 2024-09-12T02:49:25.712 INFO:teuthology.orchestra.run.smithi044.stdout: "scrub_dirfrag_rstats": 0, 2024-09-12T02:49:25.712 INFO:teuthology.orchestra.run.smithi044.stdout: "scrub_file_inodes": 0, 2024-09-12T02:49:25.712 INFO:teuthology.orchestra.run.smithi044.stdout: "handle_inode_file_caps": 0, 2024-09-12T02:49:25.712 INFO:teuthology.orchestra.run.smithi044.stdout: "ceph_cap_op_revoke": 0, 2024-09-12T02:49:25.712 INFO:teuthology.orchestra.run.smithi044.stdout: "ceph_cap_op_grant": 0, 2024-09-12T02:49:25.712 INFO:teuthology.orchestra.run.smithi044.stdout: "ceph_cap_op_trunc": 0, 2024-09-12T02:49:25.712 INFO:teuthology.orchestra.run.smithi044.stdout: "ceph_cap_op_flushsnap_ack": 0, 2024-09-12T02:49:25.712 INFO:teuthology.orchestra.run.smithi044.stdout: "ceph_cap_op_flush_ack": 0, 2024-09-12T02:49:25.712 INFO:teuthology.orchestra.run.smithi044.stdout: "handle_client_caps": 0, 2024-09-12T02:49:25.712 INFO:teuthology.orchestra.run.smithi044.stdout: "handle_client_caps_dirty": 0, 2024-09-12T02:49:25.712 INFO:teuthology.orchestra.run.smithi044.stdout: "handle_client_cap_release": 0, 2024-09-12T02:49:25.713 INFO:teuthology.orchestra.run.smithi044.stdout: "process_request_cap_release": 0 2024-09-12T02:49:25.713 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-09-12T02:49:25.713 INFO:teuthology.orchestra.run.smithi044.stdout: "mds_cache": { 2024-09-12T02:49:25.713 INFO:teuthology.orchestra.run.smithi044.stdout: "dir_update": 0, 2024-09-12T02:49:25.713 INFO:teuthology.orchestra.run.smithi044.stdout: "dir_update_receipt": 0, 2024-09-12T02:49:25.713 INFO:teuthology.orchestra.run.smithi044.stdout: "dir_try_discover": 0, 2024-09-12T02:49:25.713 INFO:teuthology.orchestra.run.smithi044.stdout: "dir_send_discover": 0, 2024-09-12T02:49:25.713 INFO:teuthology.orchestra.run.smithi044.stdout: "dir_handle_discover": 0, 2024-09-12T02:49:25.713 INFO:teuthology.orchestra.run.smithi044.stdout: "num_strays": 0, 2024-09-12T02:49:25.713 INFO:teuthology.orchestra.run.smithi044.stdout: "num_strays_delayed": 0, 2024-09-12T02:49:25.713 INFO:teuthology.orchestra.run.smithi044.stdout: "num_strays_enqueuing": 0, 2024-09-12T02:49:25.713 INFO:teuthology.orchestra.run.smithi044.stdout: "strays_created": 0, 2024-09-12T02:49:25.713 INFO:teuthology.orchestra.run.smithi044.stdout: "strays_enqueued": 0, 2024-09-12T02:49:25.713 INFO:teuthology.orchestra.run.smithi044.stdout: "strays_reintegrated": 0, 2024-09-12T02:49:25.714 INFO:teuthology.orchestra.run.smithi044.stdout: "strays_migrated": 0, 2024-09-12T02:49:25.714 INFO:teuthology.orchestra.run.smithi044.stdout: "num_recovering_processing": 0, 2024-09-12T02:49:25.714 INFO:teuthology.orchestra.run.smithi044.stdout: "num_recovering_enqueued": 0, 2024-09-12T02:49:25.714 INFO:teuthology.orchestra.run.smithi044.stdout: "num_recovering_prioritized": 0, 2024-09-12T02:49:25.714 INFO:teuthology.orchestra.run.smithi044.stdout: "recovery_started": 0, 2024-09-12T02:49:25.714 INFO:teuthology.orchestra.run.smithi044.stdout: "recovery_completed": 0, 2024-09-12T02:49:25.714 INFO:teuthology.orchestra.run.smithi044.stdout: "ireq_quiesce_path": 0, 2024-09-12T02:49:25.714 INFO:teuthology.orchestra.run.smithi044.stdout: "ireq_quiesce_inode": 0, 2024-09-12T02:49:25.714 INFO:teuthology.orchestra.run.smithi044.stdout: "ireq_enqueue_scrub": 0, 2024-09-12T02:49:25.714 INFO:teuthology.orchestra.run.smithi044.stdout: "ireq_exportdir": 0, 2024-09-12T02:49:25.714 INFO:teuthology.orchestra.run.smithi044.stdout: "ireq_flush": 0, 2024-09-12T02:49:25.714 INFO:teuthology.orchestra.run.smithi044.stdout: "ireq_fragmentdir": 0, 2024-09-12T02:49:25.714 INFO:teuthology.orchestra.run.smithi044.stdout: "ireq_fragstats": 0, 2024-09-12T02:49:25.714 INFO:teuthology.orchestra.run.smithi044.stdout: "ireq_inodestats": 0 2024-09-12T02:49:25.715 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-09-12T02:49:25.715 INFO:teuthology.orchestra.run.smithi044.stdout: "mds_log": { 2024-09-12T02:49:25.715 INFO:teuthology.orchestra.run.smithi044.stdout: "evlrg": 0, 2024-09-12T02:49:25.715 INFO:teuthology.orchestra.run.smithi044.stdout: "evadd": 0, 2024-09-12T02:49:25.715 INFO:teuthology.orchestra.run.smithi044.stdout: "evex": 0, 2024-09-12T02:49:25.715 INFO:teuthology.orchestra.run.smithi044.stdout: "evtrm": 0, 2024-09-12T02:49:25.715 INFO:teuthology.orchestra.run.smithi044.stdout: "ev": 2302, 2024-09-12T02:49:25.715 INFO:teuthology.orchestra.run.smithi044.stdout: "evexg": 0, 2024-09-12T02:49:25.715 INFO:teuthology.orchestra.run.smithi044.stdout: "evexd": 0, 2024-09-12T02:49:25.715 INFO:teuthology.orchestra.run.smithi044.stdout: "segadd": 0, 2024-09-12T02:49:25.715 INFO:teuthology.orchestra.run.smithi044.stdout: "segex": 0, 2024-09-12T02:49:25.715 INFO:teuthology.orchestra.run.smithi044.stdout: "segtrm": 0, 2024-09-12T02:49:25.715 INFO:teuthology.orchestra.run.smithi044.stdout: "seg": 7, 2024-09-12T02:49:25.715 INFO:teuthology.orchestra.run.smithi044.stdout: "segmjr": 2, 2024-09-12T02:49:25.716 INFO:teuthology.orchestra.run.smithi044.stdout: "segexg": 0, 2024-09-12T02:49:25.716 INFO:teuthology.orchestra.run.smithi044.stdout: "segexd": 0, 2024-09-12T02:49:25.716 INFO:teuthology.orchestra.run.smithi044.stdout: "expos": 4194304, 2024-09-12T02:49:25.716 INFO:teuthology.orchestra.run.smithi044.stdout: "wrpos": 28214315, 2024-09-12T02:49:25.716 INFO:teuthology.orchestra.run.smithi044.stdout: "rdpos": 28200707, 2024-09-12T02:49:25.716 INFO:teuthology.orchestra.run.smithi044.stdout: "jlat": { 2024-09-12T02:49:25.716 INFO:teuthology.orchestra.run.smithi044.stdout: "avgcount": 0, 2024-09-12T02:49:25.716 INFO:teuthology.orchestra.run.smithi044.stdout: "sum": 0.000000000, 2024-09-12T02:49:25.716 INFO:teuthology.orchestra.run.smithi044.stdout: "avgtime": 0.000000000 2024-09-12T02:49:25.716 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-09-12T02:49:25.716 INFO:teuthology.orchestra.run.smithi044.stdout: "replayed": 2302 2024-09-12T02:49:25.716 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-09-12T02:49:25.716 INFO:teuthology.orchestra.run.smithi044.stdout: "mds_mem": { 2024-09-12T02:49:25.716 INFO:teuthology.orchestra.run.smithi044.stdout: "ino": 27, 2024-09-12T02:49:25.717 INFO:teuthology.orchestra.run.smithi044.stdout: "ino+": 27, 2024-09-12T02:49:25.717 INFO:teuthology.orchestra.run.smithi044.stdout: "ino-": 0, 2024-09-12T02:49:25.717 INFO:teuthology.orchestra.run.smithi044.stdout: "dir": 11, 2024-09-12T02:49:25.717 INFO:teuthology.orchestra.run.smithi044.stdout: "dir+": 11, 2024-09-12T02:49:25.717 INFO:teuthology.orchestra.run.smithi044.stdout: "dir-": 0, 2024-09-12T02:49:25.717 INFO:teuthology.orchestra.run.smithi044.stdout: "dn": 31, 2024-09-12T02:49:25.717 INFO:teuthology.orchestra.run.smithi044.stdout: "dn+": 31, 2024-09-12T02:49:25.717 INFO:teuthology.orchestra.run.smithi044.stdout: "dn-": 0, 2024-09-12T02:49:25.717 INFO:teuthology.orchestra.run.smithi044.stdout: "cap": 0, 2024-09-12T02:49:25.717 INFO:teuthology.orchestra.run.smithi044.stdout: "cap+": 0, 2024-09-12T02:49:25.717 INFO:teuthology.orchestra.run.smithi044.stdout: "cap-": 0, 2024-09-12T02:49:25.717 INFO:teuthology.orchestra.run.smithi044.stdout: "rss": 52036, 2024-09-12T02:49:25.717 INFO:teuthology.orchestra.run.smithi044.stdout: "heap": 215328 2024-09-12T02:49:25.718 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-09-12T02:49:25.718 INFO:teuthology.orchestra.run.smithi044.stdout: "mds_server": { 2024-09-12T02:49:25.718 INFO:teuthology.orchestra.run.smithi044.stdout: "dispatch_client_request": 0, 2024-09-12T02:49:25.718 INFO:teuthology.orchestra.run.smithi044.stdout: "dispatch_server_request": 0, 2024-09-12T02:49:25.718 INFO:teuthology.orchestra.run.smithi044.stdout: "handle_client_request": 0, 2024-09-12T02:49:25.718 INFO:teuthology.orchestra.run.smithi044.stdout: "handle_client_session": 0, 2024-09-12T02:49:25.718 INFO:teuthology.orchestra.run.smithi044.stdout: "handle_peer_request": 0, 2024-09-12T02:49:25.718 INFO:teuthology.orchestra.run.smithi044.stdout: "req_create_latency": { 2024-09-12T02:49:25.718 INFO:teuthology.orchestra.run.smithi044.stdout: "avgcount": 0, 2024-09-12T02:49:25.718 INFO:teuthology.orchestra.run.smithi044.stdout: "sum": 0.000000000, 2024-09-12T02:49:25.718 INFO:teuthology.orchestra.run.smithi044.stdout: "avgtime": 0.000000000 2024-09-12T02:49:25.718 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-09-12T02:49:25.718 INFO:teuthology.orchestra.run.smithi044.stdout: "req_getattr_latency": { 2024-09-12T02:49:25.718 INFO:teuthology.orchestra.run.smithi044.stdout: "avgcount": 0, 2024-09-12T02:49:25.719 INFO:teuthology.orchestra.run.smithi044.stdout: "sum": 0.000000000, 2024-09-12T02:49:25.719 INFO:teuthology.orchestra.run.smithi044.stdout: "avgtime": 0.000000000 2024-09-12T02:49:25.719 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-09-12T02:49:25.719 INFO:teuthology.orchestra.run.smithi044.stdout: "req_getfilelock_latency": { 2024-09-12T02:49:25.719 INFO:teuthology.orchestra.run.smithi044.stdout: "avgcount": 0, 2024-09-12T02:49:25.719 INFO:teuthology.orchestra.run.smithi044.stdout: "sum": 0.000000000, 2024-09-12T02:49:25.719 INFO:teuthology.orchestra.run.smithi044.stdout: "avgtime": 0.000000000 2024-09-12T02:49:25.719 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-09-12T02:49:25.719 INFO:teuthology.orchestra.run.smithi044.stdout: "req_link_latency": { 2024-09-12T02:49:25.719 INFO:teuthology.orchestra.run.smithi044.stdout: "avgcount": 0, 2024-09-12T02:49:25.719 INFO:teuthology.orchestra.run.smithi044.stdout: "sum": 0.000000000, 2024-09-12T02:49:25.719 INFO:teuthology.orchestra.run.smithi044.stdout: "avgtime": 0.000000000 2024-09-12T02:49:25.719 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-09-12T02:49:25.719 INFO:teuthology.orchestra.run.smithi044.stdout: "req_lookup_latency": { 2024-09-12T02:49:25.719 INFO:teuthology.orchestra.run.smithi044.stdout: "avgcount": 0, 2024-09-12T02:49:25.720 INFO:teuthology.orchestra.run.smithi044.stdout: "sum": 0.000000000, 2024-09-12T02:49:25.720 INFO:teuthology.orchestra.run.smithi044.stdout: "avgtime": 0.000000000 2024-09-12T02:49:25.720 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-09-12T02:49:25.720 INFO:teuthology.orchestra.run.smithi044.stdout: "req_lookuphash_latency": { 2024-09-12T02:49:25.720 INFO:teuthology.orchestra.run.smithi044.stdout: "avgcount": 0, 2024-09-12T02:49:25.720 INFO:teuthology.orchestra.run.smithi044.stdout: "sum": 0.000000000, 2024-09-12T02:49:25.720 INFO:teuthology.orchestra.run.smithi044.stdout: "avgtime": 0.000000000 2024-09-12T02:49:25.720 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-09-12T02:49:25.720 INFO:teuthology.orchestra.run.smithi044.stdout: "req_lookupino_latency": { 2024-09-12T02:49:25.720 INFO:teuthology.orchestra.run.smithi044.stdout: "avgcount": 0, 2024-09-12T02:49:25.720 INFO:teuthology.orchestra.run.smithi044.stdout: "sum": 0.000000000, 2024-09-12T02:49:25.720 INFO:teuthology.orchestra.run.smithi044.stdout: "avgtime": 0.000000000 2024-09-12T02:49:25.720 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-09-12T02:49:25.721 INFO:teuthology.orchestra.run.smithi044.stdout: "req_lookupname_latency": { 2024-09-12T02:49:25.721 INFO:teuthology.orchestra.run.smithi044.stdout: "avgcount": 0, 2024-09-12T02:49:25.721 INFO:teuthology.orchestra.run.smithi044.stdout: "sum": 0.000000000, 2024-09-12T02:49:25.721 INFO:teuthology.orchestra.run.smithi044.stdout: "avgtime": 0.000000000 2024-09-12T02:49:25.721 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-09-12T02:49:25.721 INFO:teuthology.orchestra.run.smithi044.stdout: "req_lookupparent_latency": { 2024-09-12T02:49:25.721 INFO:teuthology.orchestra.run.smithi044.stdout: "avgcount": 0, 2024-09-12T02:49:25.721 INFO:teuthology.orchestra.run.smithi044.stdout: "sum": 0.000000000, 2024-09-12T02:49:25.721 INFO:teuthology.orchestra.run.smithi044.stdout: "avgtime": 0.000000000 2024-09-12T02:49:25.725 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-09-12T02:49:25.725 INFO:teuthology.orchestra.run.smithi044.stdout: "req_lookupsnap_latency": { 2024-09-12T02:49:25.726 INFO:teuthology.orchestra.run.smithi044.stdout: "avgcount": 0, 2024-09-12T02:49:25.726 INFO:teuthology.orchestra.run.smithi044.stdout: "sum": 0.000000000, 2024-09-12T02:49:25.726 INFO:teuthology.orchestra.run.smithi044.stdout: "avgtime": 0.000000000 2024-09-12T02:49:25.726 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-09-12T02:49:25.726 INFO:teuthology.orchestra.run.smithi044.stdout: "req_lssnap_latency": { 2024-09-12T02:49:25.727 INFO:teuthology.orchestra.run.smithi044.stdout: "avgcount": 0, 2024-09-12T02:49:25.727 INFO:teuthology.orchestra.run.smithi044.stdout: "sum": 0.000000000, 2024-09-12T02:49:25.727 INFO:teuthology.orchestra.run.smithi044.stdout: "avgtime": 0.000000000 2024-09-12T02:49:25.727 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-09-12T02:49:25.727 INFO:teuthology.orchestra.run.smithi044.stdout: "req_mkdir_latency": { 2024-09-12T02:49:25.729 INFO:teuthology.orchestra.run.smithi044.stdout: "avgcount": 0, 2024-09-12T02:49:25.729 INFO:teuthology.orchestra.run.smithi044.stdout: "sum": 0.000000000, 2024-09-12T02:49:25.729 INFO:teuthology.orchestra.run.smithi044.stdout: "avgtime": 0.000000000 2024-09-12T02:49:25.729 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-09-12T02:49:25.729 INFO:teuthology.orchestra.run.smithi044.stdout: "req_mknod_latency": { 2024-09-12T02:49:25.730 INFO:teuthology.orchestra.run.smithi044.stdout: "avgcount": 0, 2024-09-12T02:49:25.730 INFO:teuthology.orchestra.run.smithi044.stdout: "sum": 0.000000000, 2024-09-12T02:49:25.730 INFO:teuthology.orchestra.run.smithi044.stdout: "avgtime": 0.000000000 2024-09-12T02:49:25.730 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-09-12T02:49:25.730 INFO:teuthology.orchestra.run.smithi044.stdout: "req_mksnap_latency": { 2024-09-12T02:49:25.730 INFO:teuthology.orchestra.run.smithi044.stdout: "avgcount": 0, 2024-09-12T02:49:25.731 INFO:teuthology.orchestra.run.smithi044.stdout: "sum": 0.000000000, 2024-09-12T02:49:25.731 INFO:teuthology.orchestra.run.smithi044.stdout: "avgtime": 0.000000000 2024-09-12T02:49:25.731 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-09-12T02:49:25.731 INFO:teuthology.orchestra.run.smithi044.stdout: "req_open_latency": { 2024-09-12T02:49:25.731 INFO:teuthology.orchestra.run.smithi044.stdout: "avgcount": 0, 2024-09-12T02:49:25.732 INFO:teuthology.orchestra.run.smithi044.stdout: "sum": 0.000000000, 2024-09-12T02:49:25.732 INFO:teuthology.orchestra.run.smithi044.stdout: "avgtime": 0.000000000 2024-09-12T02:49:25.732 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-09-12T02:49:25.732 INFO:teuthology.orchestra.run.smithi044.stdout: "req_readdir_latency": { 2024-09-12T02:49:25.732 INFO:teuthology.orchestra.run.smithi044.stdout: "avgcount": 0, 2024-09-12T02:49:25.732 INFO:teuthology.orchestra.run.smithi044.stdout: "sum": 0.000000000, 2024-09-12T02:49:25.733 INFO:teuthology.orchestra.run.smithi044.stdout: "avgtime": 0.000000000 2024-09-12T02:49:25.733 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-09-12T02:49:25.733 INFO:teuthology.orchestra.run.smithi044.stdout: "req_rename_latency": { 2024-09-12T02:49:25.733 INFO:teuthology.orchestra.run.smithi044.stdout: "avgcount": 0, 2024-09-12T02:49:25.733 INFO:teuthology.orchestra.run.smithi044.stdout: "sum": 0.000000000, 2024-09-12T02:49:25.734 INFO:teuthology.orchestra.run.smithi044.stdout: "avgtime": 0.000000000 2024-09-12T02:49:25.734 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-09-12T02:49:25.734 INFO:teuthology.orchestra.run.smithi044.stdout: "req_renamesnap_latency": { 2024-09-12T02:49:25.734 INFO:teuthology.orchestra.run.smithi044.stdout: "avgcount": 0, 2024-09-12T02:49:25.734 INFO:teuthology.orchestra.run.smithi044.stdout: "sum": 0.000000000, 2024-09-12T02:49:25.734 INFO:teuthology.orchestra.run.smithi044.stdout: "avgtime": 0.000000000 2024-09-12T02:49:25.735 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-09-12T02:49:25.735 INFO:teuthology.orchestra.run.smithi044.stdout: "req_snapdiff_latency": { 2024-09-12T02:49:25.735 INFO:teuthology.orchestra.run.smithi044.stdout: "avgcount": 0, 2024-09-12T02:49:25.735 INFO:teuthology.orchestra.run.smithi044.stdout: "sum": 0.000000000, 2024-09-12T02:49:25.735 INFO:teuthology.orchestra.run.smithi044.stdout: "avgtime": 0.000000000 2024-09-12T02:49:25.735 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-09-12T02:49:25.736 INFO:teuthology.orchestra.run.smithi044.stdout: "req_rmdir_latency": { 2024-09-12T02:49:25.736 INFO:teuthology.orchestra.run.smithi044.stdout: "avgcount": 0, 2024-09-12T02:49:25.736 INFO:teuthology.orchestra.run.smithi044.stdout: "sum": 0.000000000, 2024-09-12T02:49:25.736 INFO:teuthology.orchestra.run.smithi044.stdout: "avgtime": 0.000000000 2024-09-12T02:49:25.736 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-09-12T02:49:25.737 INFO:teuthology.orchestra.run.smithi044.stdout: "req_rmsnap_latency": { 2024-09-12T02:49:25.737 INFO:teuthology.orchestra.run.smithi044.stdout: "avgcount": 0, 2024-09-12T02:49:25.737 INFO:teuthology.orchestra.run.smithi044.stdout: "sum": 0.000000000, 2024-09-12T02:49:25.737 INFO:teuthology.orchestra.run.smithi044.stdout: "avgtime": 0.000000000 2024-09-12T02:49:25.737 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-09-12T02:49:25.737 INFO:teuthology.orchestra.run.smithi044.stdout: "req_rmxattr_latency": { 2024-09-12T02:49:25.738 INFO:teuthology.orchestra.run.smithi044.stdout: "avgcount": 0, 2024-09-12T02:49:25.738 INFO:teuthology.orchestra.run.smithi044.stdout: "sum": 0.000000000, 2024-09-12T02:49:25.738 INFO:teuthology.orchestra.run.smithi044.stdout: "avgtime": 0.000000000 2024-09-12T02:49:25.738 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-09-12T02:49:25.738 INFO:teuthology.orchestra.run.smithi044.stdout: "req_setattr_latency": { 2024-09-12T02:49:25.738 INFO:teuthology.orchestra.run.smithi044.stdout: "avgcount": 0, 2024-09-12T02:49:25.739 INFO:teuthology.orchestra.run.smithi044.stdout: "sum": 0.000000000, 2024-09-12T02:49:25.739 INFO:teuthology.orchestra.run.smithi044.stdout: "avgtime": 0.000000000 2024-09-12T02:49:25.739 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-09-12T02:49:25.739 INFO:teuthology.orchestra.run.smithi044.stdout: "req_setdirlayout_latency": { 2024-09-12T02:49:25.739 INFO:teuthology.orchestra.run.smithi044.stdout: "avgcount": 0, 2024-09-12T02:49:25.739 INFO:teuthology.orchestra.run.smithi044.stdout: "sum": 0.000000000, 2024-09-12T02:49:25.739 INFO:teuthology.orchestra.run.smithi044.stdout: "avgtime": 0.000000000 2024-09-12T02:49:25.739 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-09-12T02:49:25.739 INFO:teuthology.orchestra.run.smithi044.stdout: "req_setfilelock_latency": { 2024-09-12T02:49:25.739 INFO:teuthology.orchestra.run.smithi044.stdout: "avgcount": 0, 2024-09-12T02:49:25.739 INFO:teuthology.orchestra.run.smithi044.stdout: "sum": 0.000000000, 2024-09-12T02:49:25.739 INFO:teuthology.orchestra.run.smithi044.stdout: "avgtime": 0.000000000 2024-09-12T02:49:25.739 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-09-12T02:49:25.740 INFO:teuthology.orchestra.run.smithi044.stdout: "req_setlayout_latency": { 2024-09-12T02:49:25.740 INFO:teuthology.orchestra.run.smithi044.stdout: "avgcount": 0, 2024-09-12T02:49:25.740 INFO:teuthology.orchestra.run.smithi044.stdout: "sum": 0.000000000, 2024-09-12T02:49:25.740 INFO:teuthology.orchestra.run.smithi044.stdout: "avgtime": 0.000000000 2024-09-12T02:49:25.740 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-09-12T02:49:25.740 INFO:teuthology.orchestra.run.smithi044.stdout: "req_setxattr_latency": { 2024-09-12T02:49:25.740 INFO:teuthology.orchestra.run.smithi044.stdout: "avgcount": 0, 2024-09-12T02:49:25.740 INFO:teuthology.orchestra.run.smithi044.stdout: "sum": 0.000000000, 2024-09-12T02:49:25.740 INFO:teuthology.orchestra.run.smithi044.stdout: "avgtime": 0.000000000 2024-09-12T02:49:25.740 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-09-12T02:49:25.740 INFO:teuthology.orchestra.run.smithi044.stdout: "req_symlink_latency": { 2024-09-12T02:49:25.740 INFO:teuthology.orchestra.run.smithi044.stdout: "avgcount": 0, 2024-09-12T02:49:25.740 INFO:teuthology.orchestra.run.smithi044.stdout: "sum": 0.000000000, 2024-09-12T02:49:25.740 INFO:teuthology.orchestra.run.smithi044.stdout: "avgtime": 0.000000000 2024-09-12T02:49:25.741 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-09-12T02:49:25.741 INFO:teuthology.orchestra.run.smithi044.stdout: "req_unlink_latency": { 2024-09-12T02:49:25.741 INFO:teuthology.orchestra.run.smithi044.stdout: "avgcount": 0, 2024-09-12T02:49:25.741 INFO:teuthology.orchestra.run.smithi044.stdout: "sum": 0.000000000, 2024-09-12T02:49:25.741 INFO:teuthology.orchestra.run.smithi044.stdout: "avgtime": 0.000000000 2024-09-12T02:49:25.741 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-09-12T02:49:25.741 INFO:teuthology.orchestra.run.smithi044.stdout: "cap_revoke_eviction": 0, 2024-09-12T02:49:25.741 INFO:teuthology.orchestra.run.smithi044.stdout: "cap_acquisition_throttle": 0, 2024-09-12T02:49:25.741 INFO:teuthology.orchestra.run.smithi044.stdout: "req_getvxattr_latency": { 2024-09-12T02:49:25.741 INFO:teuthology.orchestra.run.smithi044.stdout: "avgcount": 0, 2024-09-12T02:49:25.741 INFO:teuthology.orchestra.run.smithi044.stdout: "sum": 0.000000000, 2024-09-12T02:49:25.741 INFO:teuthology.orchestra.run.smithi044.stdout: "avgtime": 0.000000000 2024-09-12T02:49:25.741 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-09-12T02:49:25.741 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-09-12T02:49:25.742 INFO:teuthology.orchestra.run.smithi044.stdout: "mds_sessions": { 2024-09-12T02:49:25.742 INFO:teuthology.orchestra.run.smithi044.stdout: "session_count": 2, 2024-09-12T02:49:25.742 INFO:teuthology.orchestra.run.smithi044.stdout: "session_add": 7, 2024-09-12T02:49:25.742 INFO:teuthology.orchestra.run.smithi044.stdout: "session_remove": 5, 2024-09-12T02:49:25.742 INFO:teuthology.orchestra.run.smithi044.stdout: "sessions_open": 5, 2024-09-12T02:49:25.742 INFO:teuthology.orchestra.run.smithi044.stdout: "sessions_stale": 0, 2024-09-12T02:49:25.742 INFO:teuthology.orchestra.run.smithi044.stdout: "total_load": 0, 2024-09-12T02:49:25.742 INFO:teuthology.orchestra.run.smithi044.stdout: "average_load": 0, 2024-09-12T02:49:25.742 INFO:teuthology.orchestra.run.smithi044.stdout: "avg_session_uptime": 4518, 2024-09-12T02:49:25.742 INFO:teuthology.orchestra.run.smithi044.stdout: "mdthresh_evicted": 0 2024-09-12T02:49:25.742 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-09-12T02:49:25.742 INFO:teuthology.orchestra.run.smithi044.stdout: "mempool": { 2024-09-12T02:49:25.742 INFO:teuthology.orchestra.run.smithi044.stdout: "bloom_filter_bytes": 0, 2024-09-12T02:49:25.742 INFO:teuthology.orchestra.run.smithi044.stdout: "bloom_filter_items": 0, 2024-09-12T02:49:25.743 INFO:teuthology.orchestra.run.smithi044.stdout: "bluestore_alloc_bytes": 0, 2024-09-12T02:49:25.743 INFO:teuthology.orchestra.run.smithi044.stdout: "bluestore_alloc_items": 0, 2024-09-12T02:49:25.743 INFO:teuthology.orchestra.run.smithi044.stdout: "bluestore_cache_data_bytes": 0, 2024-09-12T02:49:25.743 INFO:teuthology.orchestra.run.smithi044.stdout: "bluestore_cache_data_items": 0, 2024-09-12T02:49:25.743 INFO:teuthology.orchestra.run.smithi044.stdout: "bluestore_cache_onode_bytes": 0, 2024-09-12T02:49:25.743 INFO:teuthology.orchestra.run.smithi044.stdout: "bluestore_cache_onode_items": 0, 2024-09-12T02:49:25.743 INFO:teuthology.orchestra.run.smithi044.stdout: "bluestore_cache_meta_bytes": 0, 2024-09-12T02:49:25.743 INFO:teuthology.orchestra.run.smithi044.stdout: "bluestore_cache_meta_items": 0, 2024-09-12T02:49:25.743 INFO:teuthology.orchestra.run.smithi044.stdout: "bluestore_cache_other_bytes": 0, 2024-09-12T02:49:25.743 INFO:teuthology.orchestra.run.smithi044.stdout: "bluestore_cache_other_items": 0, 2024-09-12T02:49:25.743 INFO:teuthology.orchestra.run.smithi044.stdout: "bluestore_cache_buffer_bytes": 0, 2024-09-12T02:49:25.743 INFO:teuthology.orchestra.run.smithi044.stdout: "bluestore_cache_buffer_items": 0, 2024-09-12T02:49:25.743 INFO:teuthology.orchestra.run.smithi044.stdout: "bluestore_extent_bytes": 0, 2024-09-12T02:49:25.743 INFO:teuthology.orchestra.run.smithi044.stdout: "bluestore_extent_items": 0, 2024-09-12T02:49:25.744 INFO:teuthology.orchestra.run.smithi044.stdout: "bluestore_blob_bytes": 0, 2024-09-12T02:49:25.744 INFO:teuthology.orchestra.run.smithi044.stdout: "bluestore_blob_items": 0, 2024-09-12T02:49:25.744 INFO:teuthology.orchestra.run.smithi044.stdout: "bluestore_shared_blob_bytes": 0, 2024-09-12T02:49:25.744 INFO:teuthology.orchestra.run.smithi044.stdout: "bluestore_shared_blob_items": 0, 2024-09-12T02:49:25.744 INFO:teuthology.orchestra.run.smithi044.stdout: "bluestore_inline_bl_bytes": 0, 2024-09-12T02:49:25.744 INFO:teuthology.orchestra.run.smithi044.stdout: "bluestore_inline_bl_items": 0, 2024-09-12T02:49:25.744 INFO:teuthology.orchestra.run.smithi044.stdout: "bluestore_fsck_bytes": 0, 2024-09-12T02:49:25.744 INFO:teuthology.orchestra.run.smithi044.stdout: "bluestore_fsck_items": 0, 2024-09-12T02:49:25.744 INFO:teuthology.orchestra.run.smithi044.stdout: "bluestore_txc_bytes": 0, 2024-09-12T02:49:25.744 INFO:teuthology.orchestra.run.smithi044.stdout: "bluestore_txc_items": 0, 2024-09-12T02:49:25.744 INFO:teuthology.orchestra.run.smithi044.stdout: "bluestore_writing_deferred_bytes": 0, 2024-09-12T02:49:25.744 INFO:teuthology.orchestra.run.smithi044.stdout: "bluestore_writing_deferred_items": 0, 2024-09-12T02:49:25.744 INFO:teuthology.orchestra.run.smithi044.stdout: "bluestore_writing_bytes": 0, 2024-09-12T02:49:25.745 INFO:teuthology.orchestra.run.smithi044.stdout: "bluestore_writing_items": 0, 2024-09-12T02:49:25.745 INFO:teuthology.orchestra.run.smithi044.stdout: "bluefs_bytes": 0, 2024-09-12T02:49:25.745 INFO:teuthology.orchestra.run.smithi044.stdout: "bluefs_items": 0, 2024-09-12T02:49:25.745 INFO:teuthology.orchestra.run.smithi044.stdout: "bluefs_file_reader_bytes": 0, 2024-09-12T02:49:25.745 INFO:teuthology.orchestra.run.smithi044.stdout: "bluefs_file_reader_items": 0, 2024-09-12T02:49:25.745 INFO:teuthology.orchestra.run.smithi044.stdout: "bluefs_file_writer_bytes": 0, 2024-09-12T02:49:25.745 INFO:teuthology.orchestra.run.smithi044.stdout: "bluefs_file_writer_items": 0, 2024-09-12T02:49:25.745 INFO:teuthology.orchestra.run.smithi044.stdout: "buffer_anon_bytes": 199516, 2024-09-12T02:49:25.745 INFO:teuthology.orchestra.run.smithi044.stdout: "buffer_anon_items": 91, 2024-09-12T02:49:25.745 INFO:teuthology.orchestra.run.smithi044.stdout: "buffer_meta_bytes": 0, 2024-09-12T02:49:25.745 INFO:teuthology.orchestra.run.smithi044.stdout: "buffer_meta_items": 0, 2024-09-12T02:49:25.745 INFO:teuthology.orchestra.run.smithi044.stdout: "osd_bytes": 0, 2024-09-12T02:49:25.745 INFO:teuthology.orchestra.run.smithi044.stdout: "osd_items": 0, 2024-09-12T02:49:25.745 INFO:teuthology.orchestra.run.smithi044.stdout: "osd_mapbl_bytes": 0, 2024-09-12T02:49:25.746 INFO:teuthology.orchestra.run.smithi044.stdout: "osd_mapbl_items": 0, 2024-09-12T02:49:25.746 INFO:teuthology.orchestra.run.smithi044.stdout: "osd_pglog_bytes": 0, 2024-09-12T02:49:25.746 INFO:teuthology.orchestra.run.smithi044.stdout: "osd_pglog_items": 0, 2024-09-12T02:49:25.746 INFO:teuthology.orchestra.run.smithi044.stdout: "osdmap_bytes": 9520, 2024-09-12T02:49:25.746 INFO:teuthology.orchestra.run.smithi044.stdout: "osdmap_items": 193, 2024-09-12T02:49:25.746 INFO:teuthology.orchestra.run.smithi044.stdout: "osdmap_mapping_bytes": 0, 2024-09-12T02:49:25.746 INFO:teuthology.orchestra.run.smithi044.stdout: "osdmap_mapping_items": 0, 2024-09-12T02:49:25.746 INFO:teuthology.orchestra.run.smithi044.stdout: "pgmap_bytes": 0, 2024-09-12T02:49:25.746 INFO:teuthology.orchestra.run.smithi044.stdout: "pgmap_items": 0, 2024-09-12T02:49:25.746 INFO:teuthology.orchestra.run.smithi044.stdout: "mds_co_bytes": 158859, 2024-09-12T02:49:25.746 INFO:teuthology.orchestra.run.smithi044.stdout: "mds_co_items": 1305, 2024-09-12T02:49:25.746 INFO:teuthology.orchestra.run.smithi044.stdout: "unittest_1_bytes": 0, 2024-09-12T02:49:25.746 INFO:teuthology.orchestra.run.smithi044.stdout: "unittest_1_items": 0, 2024-09-12T02:49:25.746 INFO:teuthology.orchestra.run.smithi044.stdout: "unittest_2_bytes": 0, 2024-09-12T02:49:25.747 INFO:teuthology.orchestra.run.smithi044.stdout: "unittest_2_items": 0 2024-09-12T02:49:25.747 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-09-12T02:49:25.747 INFO:teuthology.orchestra.run.smithi044.stdout: "objecter": { 2024-09-12T02:49:25.747 INFO:teuthology.orchestra.run.smithi044.stdout: "op_active": 0, 2024-09-12T02:49:25.747 INFO:teuthology.orchestra.run.smithi044.stdout: "op_laggy": 0, 2024-09-12T02:49:25.747 INFO:teuthology.orchestra.run.smithi044.stdout: "op_send": 3071, 2024-09-12T02:49:25.747 INFO:teuthology.orchestra.run.smithi044.stdout: "op_send_bytes": 26, 2024-09-12T02:49:25.747 INFO:teuthology.orchestra.run.smithi044.stdout: "op_resend": 4, 2024-09-12T02:49:25.747 INFO:teuthology.orchestra.run.smithi044.stdout: "op_reply": 3071, 2024-09-12T02:49:25.747 INFO:teuthology.orchestra.run.smithi044.stdout: "op_latency": { 2024-09-12T02:49:25.747 INFO:teuthology.orchestra.run.smithi044.stdout: "avgcount": 3071, 2024-09-12T02:49:25.747 INFO:teuthology.orchestra.run.smithi044.stdout: "sum": 1.510975919, 2024-09-12T02:49:25.747 INFO:teuthology.orchestra.run.smithi044.stdout: "avgtime": 0.000492014 2024-09-12T02:49:25.747 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-09-12T02:49:25.748 INFO:teuthology.orchestra.run.smithi044.stdout: "op_inflight": 0, 2024-09-12T02:49:25.748 INFO:teuthology.orchestra.run.smithi044.stdout: "oplen_avg": { 2024-09-12T02:49:25.748 INFO:teuthology.orchestra.run.smithi044.stdout: "avgcount": 3071, 2024-09-12T02:49:25.748 INFO:teuthology.orchestra.run.smithi044.stdout: "sum": 3072 2024-09-12T02:49:25.748 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-09-12T02:49:25.748 INFO:teuthology.orchestra.run.smithi044.stdout: "op": 3071, 2024-09-12T02:49:25.748 INFO:teuthology.orchestra.run.smithi044.stdout: "op_r": 3071, 2024-09-12T02:49:25.748 INFO:teuthology.orchestra.run.smithi044.stdout: "op_w": 0, 2024-09-12T02:49:25.748 INFO:teuthology.orchestra.run.smithi044.stdout: "op_rmw": 0, 2024-09-12T02:49:25.748 INFO:teuthology.orchestra.run.smithi044.stdout: "op_pg": 0, 2024-09-12T02:49:25.748 INFO:teuthology.orchestra.run.smithi044.stdout: "osdop_stat": 1624, 2024-09-12T02:49:25.748 INFO:teuthology.orchestra.run.smithi044.stdout: "osdop_create": 0, 2024-09-12T02:49:25.748 INFO:teuthology.orchestra.run.smithi044.stdout: "osdop_read": 1444, 2024-09-12T02:49:25.749 INFO:teuthology.orchestra.run.smithi044.stdout: "osdop_write": 0, 2024-09-12T02:49:25.749 INFO:teuthology.orchestra.run.smithi044.stdout: "osdop_writefull": 0, 2024-09-12T02:49:25.749 INFO:teuthology.orchestra.run.smithi044.stdout: "osdop_writesame": 0, 2024-09-12T02:49:25.749 INFO:teuthology.orchestra.run.smithi044.stdout: "osdop_append": 0, 2024-09-12T02:49:25.749 INFO:teuthology.orchestra.run.smithi044.stdout: "osdop_zero": 0, 2024-09-12T02:49:25.749 INFO:teuthology.orchestra.run.smithi044.stdout: "osdop_truncate": 0, 2024-09-12T02:49:25.749 INFO:teuthology.orchestra.run.smithi044.stdout: "osdop_delete": 0, 2024-09-12T02:49:25.749 INFO:teuthology.orchestra.run.smithi044.stdout: "osdop_mapext": 0, 2024-09-12T02:49:25.749 INFO:teuthology.orchestra.run.smithi044.stdout: "osdop_sparse_read": 0, 2024-09-12T02:49:25.749 INFO:teuthology.orchestra.run.smithi044.stdout: "osdop_clonerange": 0, 2024-09-12T02:49:25.749 INFO:teuthology.orchestra.run.smithi044.stdout: "osdop_getxattr": 2, 2024-09-12T02:49:25.749 INFO:teuthology.orchestra.run.smithi044.stdout: "osdop_setxattr": 0, 2024-09-12T02:49:25.749 INFO:teuthology.orchestra.run.smithi044.stdout: "osdop_cmpxattr": 0, 2024-09-12T02:49:25.749 INFO:teuthology.orchestra.run.smithi044.stdout: "osdop_rmxattr": 0, 2024-09-12T02:49:25.750 INFO:teuthology.orchestra.run.smithi044.stdout: "osdop_resetxattrs": 0, 2024-09-12T02:49:25.750 INFO:teuthology.orchestra.run.smithi044.stdout: "osdop_call": 0, 2024-09-12T02:49:25.750 INFO:teuthology.orchestra.run.smithi044.stdout: "osdop_watch": 0, 2024-09-12T02:49:25.750 INFO:teuthology.orchestra.run.smithi044.stdout: "osdop_notify": 0, 2024-09-12T02:49:25.750 INFO:teuthology.orchestra.run.smithi044.stdout: "osdop_src_cmpxattr": 0, 2024-09-12T02:49:25.750 INFO:teuthology.orchestra.run.smithi044.stdout: "osdop_pgls": 0, 2024-09-12T02:49:25.750 INFO:teuthology.orchestra.run.smithi044.stdout: "osdop_pgls_filter": 0, 2024-09-12T02:49:25.750 INFO:teuthology.orchestra.run.smithi044.stdout: "osdop_other": 0, 2024-09-12T02:49:25.750 INFO:teuthology.orchestra.run.smithi044.stdout: "linger_active": 0, 2024-09-12T02:49:25.750 INFO:teuthology.orchestra.run.smithi044.stdout: "linger_send": 0, 2024-09-12T02:49:25.750 INFO:teuthology.orchestra.run.smithi044.stdout: "linger_resend": 0, 2024-09-12T02:49:25.750 INFO:teuthology.orchestra.run.smithi044.stdout: "linger_ping": 0, 2024-09-12T02:49:25.750 INFO:teuthology.orchestra.run.smithi044.stdout: "poolop_active": 0, 2024-09-12T02:49:25.750 INFO:teuthology.orchestra.run.smithi044.stdout: "poolop_send": 0, 2024-09-12T02:49:25.750 INFO:teuthology.orchestra.run.smithi044.stdout: "poolop_resend": 0, 2024-09-12T02:49:25.751 INFO:teuthology.orchestra.run.smithi044.stdout: "poolstat_active": 0, 2024-09-12T02:49:25.751 INFO:teuthology.orchestra.run.smithi044.stdout: "poolstat_send": 0, 2024-09-12T02:49:25.751 INFO:teuthology.orchestra.run.smithi044.stdout: "poolstat_resend": 0, 2024-09-12T02:49:25.751 INFO:teuthology.orchestra.run.smithi044.stdout: "statfs_active": 0, 2024-09-12T02:49:25.751 INFO:teuthology.orchestra.run.smithi044.stdout: "statfs_send": 0, 2024-09-12T02:49:25.751 INFO:teuthology.orchestra.run.smithi044.stdout: "statfs_resend": 0, 2024-09-12T02:49:25.751 INFO:teuthology.orchestra.run.smithi044.stdout: "command_active": 0, 2024-09-12T02:49:25.751 INFO:teuthology.orchestra.run.smithi044.stdout: "command_send": 0, 2024-09-12T02:49:25.751 INFO:teuthology.orchestra.run.smithi044.stdout: "command_resend": 0, 2024-09-12T02:49:25.751 INFO:teuthology.orchestra.run.smithi044.stdout: "map_epoch": 108, 2024-09-12T02:49:25.751 INFO:teuthology.orchestra.run.smithi044.stdout: "map_full": 0, 2024-09-12T02:49:25.751 INFO:teuthology.orchestra.run.smithi044.stdout: "map_inc": 15, 2024-09-12T02:49:25.751 INFO:teuthology.orchestra.run.smithi044.stdout: "osd_sessions": 6, 2024-09-12T02:49:25.751 INFO:teuthology.orchestra.run.smithi044.stdout: "osd_session_open": 6, 2024-09-12T02:49:25.752 INFO:teuthology.orchestra.run.smithi044.stdout: "osd_session_close": 0, 2024-09-12T02:49:25.752 INFO:teuthology.orchestra.run.smithi044.stdout: "osd_laggy": 0, 2024-09-12T02:49:25.752 INFO:teuthology.orchestra.run.smithi044.stdout: "omap_wr": 0, 2024-09-12T02:49:25.752 INFO:teuthology.orchestra.run.smithi044.stdout: "omap_rd": 2, 2024-09-12T02:49:25.752 INFO:teuthology.orchestra.run.smithi044.stdout: "omap_del": 0 2024-09-12T02:49:25.752 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-09-12T02:49:25.752 INFO:teuthology.orchestra.run.smithi044.stdout: "oft": { 2024-09-12T02:49:25.752 INFO:teuthology.orchestra.run.smithi044.stdout: "omap_total_objs": 0, 2024-09-12T02:49:25.752 INFO:teuthology.orchestra.run.smithi044.stdout: "omap_total_kv_pairs": 0, 2024-09-12T02:49:25.752 INFO:teuthology.orchestra.run.smithi044.stdout: "omap_total_updates": 0, 2024-09-12T02:49:25.752 INFO:teuthology.orchestra.run.smithi044.stdout: "omap_total_removes": 0 2024-09-12T02:49:25.752 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-09-12T02:49:25.752 INFO:teuthology.orchestra.run.smithi044.stdout: "osd-slow-ops": { 2024-09-12T02:49:25.753 INFO:teuthology.orchestra.run.smithi044.stdout: "slow_ops_count": 0 2024-09-12T02:49:25.753 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-09-12T02:49:25.753 INFO:teuthology.orchestra.run.smithi044.stdout: "purge_queue": { 2024-09-12T02:49:25.753 INFO:teuthology.orchestra.run.smithi044.stdout: "pq_executing_ops": 0, 2024-09-12T02:49:25.753 INFO:teuthology.orchestra.run.smithi044.stdout: "pq_executing_ops_high_water": 0, 2024-09-12T02:49:25.753 INFO:teuthology.orchestra.run.smithi044.stdout: "pq_executing": 0, 2024-09-12T02:49:25.753 INFO:teuthology.orchestra.run.smithi044.stdout: "pq_executing_high_water": 0, 2024-09-12T02:49:25.753 INFO:teuthology.orchestra.run.smithi044.stdout: "pq_executed_ops": 0, 2024-09-12T02:49:25.753 INFO:teuthology.orchestra.run.smithi044.stdout: "pq_executed": 0, 2024-09-12T02:49:25.753 INFO:teuthology.orchestra.run.smithi044.stdout: "pq_item_in_journal": 0 2024-09-12T02:49:25.753 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-09-12T02:49:25.753 INFO:teuthology.orchestra.run.smithi044.stdout: "throttle-msgr_dispatch_throttler-mds": { 2024-09-12T02:49:25.753 INFO:teuthology.orchestra.run.smithi044.stdout: "val": 0, 2024-09-12T02:49:25.753 INFO:teuthology.orchestra.run.smithi044.stdout: "max": 104857600, 2024-09-12T02:49:25.754 INFO:teuthology.orchestra.run.smithi044.stdout: "get_started": 0, 2024-09-12T02:49:25.754 INFO:teuthology.orchestra.run.smithi044.stdout: "get": 3347, 2024-09-12T02:49:25.754 INFO:teuthology.orchestra.run.smithi044.stdout: "get_sum": 26317879, 2024-09-12T02:49:25.754 INFO:teuthology.orchestra.run.smithi044.stdout: "get_or_fail_fail": 0, 2024-09-12T02:49:25.754 INFO:teuthology.orchestra.run.smithi044.stdout: "get_or_fail_success": 3347, 2024-09-12T02:49:25.754 INFO:teuthology.orchestra.run.smithi044.stdout: "take": 0, 2024-09-12T02:49:25.754 INFO:teuthology.orchestra.run.smithi044.stdout: "take_sum": 0, 2024-09-12T02:49:25.754 INFO:teuthology.orchestra.run.smithi044.stdout: "put": 3347, 2024-09-12T02:49:25.754 INFO:teuthology.orchestra.run.smithi044.stdout: "put_sum": 26317879, 2024-09-12T02:49:25.754 INFO:teuthology.orchestra.run.smithi044.stdout: "wait": { 2024-09-12T02:49:25.754 INFO:teuthology.orchestra.run.smithi044.stdout: "avgcount": 0, 2024-09-12T02:49:25.754 INFO:teuthology.orchestra.run.smithi044.stdout: "sum": 0.000000000, 2024-09-12T02:49:25.754 INFO:teuthology.orchestra.run.smithi044.stdout: "avgtime": 0.000000000 2024-09-12T02:49:25.754 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-09-12T02:49:25.755 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-09-12T02:49:25.755 INFO:teuthology.orchestra.run.smithi044.stdout: "throttle-objecter_bytes": { 2024-09-12T02:49:25.755 INFO:teuthology.orchestra.run.smithi044.stdout: "val": 0, 2024-09-12T02:49:25.755 INFO:teuthology.orchestra.run.smithi044.stdout: "max": 104857600, 2024-09-12T02:49:25.755 INFO:teuthology.orchestra.run.smithi044.stdout: "get_started": 0, 2024-09-12T02:49:25.755 INFO:teuthology.orchestra.run.smithi044.stdout: "get": 0, 2024-09-12T02:49:25.755 INFO:teuthology.orchestra.run.smithi044.stdout: "get_sum": 0, 2024-09-12T02:49:25.755 INFO:teuthology.orchestra.run.smithi044.stdout: "get_or_fail_fail": 0, 2024-09-12T02:49:25.755 INFO:teuthology.orchestra.run.smithi044.stdout: "get_or_fail_success": 0, 2024-09-12T02:49:25.755 INFO:teuthology.orchestra.run.smithi044.stdout: "take": 3071, 2024-09-12T02:49:25.755 INFO:teuthology.orchestra.run.smithi044.stdout: "take_sum": 24020021, 2024-09-12T02:49:25.755 INFO:teuthology.orchestra.run.smithi044.stdout: "put": 3071, 2024-09-12T02:49:25.755 INFO:teuthology.orchestra.run.smithi044.stdout: "put_sum": 24020021, 2024-09-12T02:49:25.755 INFO:teuthology.orchestra.run.smithi044.stdout: "wait": { 2024-09-12T02:49:25.756 INFO:teuthology.orchestra.run.smithi044.stdout: "avgcount": 0, 2024-09-12T02:49:25.756 INFO:teuthology.orchestra.run.smithi044.stdout: "sum": 0.000000000, 2024-09-12T02:49:25.756 INFO:teuthology.orchestra.run.smithi044.stdout: "avgtime": 0.000000000 2024-09-12T02:49:25.756 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-09-12T02:49:25.756 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-09-12T02:49:25.756 INFO:teuthology.orchestra.run.smithi044.stdout: "throttle-objecter_ops": { 2024-09-12T02:49:25.756 INFO:teuthology.orchestra.run.smithi044.stdout: "val": 0, 2024-09-12T02:49:25.756 INFO:teuthology.orchestra.run.smithi044.stdout: "max": 1024, 2024-09-12T02:49:25.756 INFO:teuthology.orchestra.run.smithi044.stdout: "get_started": 0, 2024-09-12T02:49:25.756 INFO:teuthology.orchestra.run.smithi044.stdout: "get": 0, 2024-09-12T02:49:25.756 INFO:teuthology.orchestra.run.smithi044.stdout: "get_sum": 0, 2024-09-12T02:49:25.756 INFO:teuthology.orchestra.run.smithi044.stdout: "get_or_fail_fail": 0, 2024-09-12T02:49:25.756 INFO:teuthology.orchestra.run.smithi044.stdout: "get_or_fail_success": 0, 2024-09-12T02:49:25.756 INFO:teuthology.orchestra.run.smithi044.stdout: "take": 3071, 2024-09-12T02:49:25.757 INFO:teuthology.orchestra.run.smithi044.stdout: "take_sum": 3071, 2024-09-12T02:49:25.757 INFO:teuthology.orchestra.run.smithi044.stdout: "put": 3071, 2024-09-12T02:49:25.757 INFO:teuthology.orchestra.run.smithi044.stdout: "put_sum": 3071, 2024-09-12T02:49:25.757 INFO:teuthology.orchestra.run.smithi044.stdout: "wait": { 2024-09-12T02:49:25.757 INFO:teuthology.orchestra.run.smithi044.stdout: "avgcount": 0, 2024-09-12T02:49:25.757 INFO:teuthology.orchestra.run.smithi044.stdout: "sum": 0.000000000, 2024-09-12T02:49:25.757 INFO:teuthology.orchestra.run.smithi044.stdout: "avgtime": 0.000000000 2024-09-12T02:49:25.757 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-09-12T02:49:25.757 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-09-12T02:49:25.757 INFO:teuthology.orchestra.run.smithi044.stdout: "throttle-write_buf_throttle": { 2024-09-12T02:49:25.757 INFO:teuthology.orchestra.run.smithi044.stdout: "val": 0, 2024-09-12T02:49:25.757 INFO:teuthology.orchestra.run.smithi044.stdout: "max": 3758096384, 2024-09-12T02:49:25.757 INFO:teuthology.orchestra.run.smithi044.stdout: "get_started": 0, 2024-09-12T02:49:25.757 INFO:teuthology.orchestra.run.smithi044.stdout: "get": 0, 2024-09-12T02:49:25.758 INFO:teuthology.orchestra.run.smithi044.stdout: "get_sum": 0, 2024-09-12T02:49:25.758 INFO:teuthology.orchestra.run.smithi044.stdout: "get_or_fail_fail": 0, 2024-09-12T02:49:25.758 INFO:teuthology.orchestra.run.smithi044.stdout: "get_or_fail_success": 0, 2024-09-12T02:49:25.758 INFO:teuthology.orchestra.run.smithi044.stdout: "take": 0, 2024-09-12T02:49:25.758 INFO:teuthology.orchestra.run.smithi044.stdout: "take_sum": 0, 2024-09-12T02:49:25.758 INFO:teuthology.orchestra.run.smithi044.stdout: "put": 0, 2024-09-12T02:49:25.758 INFO:teuthology.orchestra.run.smithi044.stdout: "put_sum": 0, 2024-09-12T02:49:25.758 INFO:teuthology.orchestra.run.smithi044.stdout: "wait": { 2024-09-12T02:49:25.758 INFO:teuthology.orchestra.run.smithi044.stdout: "avgcount": 0, 2024-09-12T02:49:25.758 INFO:teuthology.orchestra.run.smithi044.stdout: "sum": 0.000000000, 2024-09-12T02:49:25.758 INFO:teuthology.orchestra.run.smithi044.stdout: "avgtime": 0.000000000 2024-09-12T02:49:25.758 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-09-12T02:49:25.758 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-09-12T02:49:25.758 INFO:teuthology.orchestra.run.smithi044.stdout: "throttle-write_buf_throttle-0x56207f580b40": { 2024-09-12T02:49:25.759 INFO:teuthology.orchestra.run.smithi044.stdout: "val": 0, 2024-09-12T02:49:25.759 INFO:teuthology.orchestra.run.smithi044.stdout: "max": 3758096384, 2024-09-12T02:49:25.759 INFO:teuthology.orchestra.run.smithi044.stdout: "get_started": 0, 2024-09-12T02:49:25.759 INFO:teuthology.orchestra.run.smithi044.stdout: "get": 0, 2024-09-12T02:49:25.759 INFO:teuthology.orchestra.run.smithi044.stdout: "get_sum": 0, 2024-09-12T02:49:25.759 INFO:teuthology.orchestra.run.smithi044.stdout: "get_or_fail_fail": 0, 2024-09-12T02:49:25.759 INFO:teuthology.orchestra.run.smithi044.stdout: "get_or_fail_success": 0, 2024-09-12T02:49:25.759 INFO:teuthology.orchestra.run.smithi044.stdout: "take": 0, 2024-09-12T02:49:25.759 INFO:teuthology.orchestra.run.smithi044.stdout: "take_sum": 0, 2024-09-12T02:49:25.759 INFO:teuthology.orchestra.run.smithi044.stdout: "put": 0, 2024-09-12T02:49:25.759 INFO:teuthology.orchestra.run.smithi044.stdout: "put_sum": 0, 2024-09-12T02:49:25.759 INFO:teuthology.orchestra.run.smithi044.stdout: "wait": { 2024-09-12T02:49:25.759 INFO:teuthology.orchestra.run.smithi044.stdout: "avgcount": 0, 2024-09-12T02:49:25.759 INFO:teuthology.orchestra.run.smithi044.stdout: "sum": 0.000000000, 2024-09-12T02:49:25.760 INFO:teuthology.orchestra.run.smithi044.stdout: "avgtime": 0.000000000 2024-09-12T02:49:25.760 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-09-12T02:49:25.760 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-09-12T02:49:25.760 INFO:teuthology.orchestra.run.smithi044.stdout:} 2024-09-12T02:49:26.013 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 12 02:49:25 smithi172 ceph-mon[35609]: pgmap v359: 129 pgs: 129 active+clean; 24 MiB data, 490 MiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 9.0 KiB/s wr, 9 op/s 2024-09-12T02:49:26.100 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 02:49:25 smithi039 ceph-mon[30515]: pgmap v359: 129 pgs: 129 active+clean; 24 MiB data, 490 MiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 9.0 KiB/s wr, 9 op/s 2024-09-12T02:49:26.151 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 12 02:49:25 smithi044 ceph-mon[35411]: pgmap v359: 129 pgs: 129 active+clean; 24 MiB data, 490 MiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 9.0 KiB/s wr, 9 op/s 2024-09-12T02:49:26.482 INFO:tasks.check_counter:Daemon mds.e mds.exported=0 2024-09-12T02:49:26.482 INFO:tasks.check_counter:Daemon mds.e mds.imported=0 2024-09-12T02:49:26.482 INFO:tasks.check_counter:Daemon mds.e mds_cache.dir_update=0 2024-09-12T02:49:26.482 INFO:tasks.check_counter:Daemon mds.e mds_cache.dir_update_receipt=0 2024-09-12T02:49:26.483 INFO:tasks.check_counter:Daemon mds.e mds.root_rsnaps=6 2024-09-12T02:49:26.483 INFO:tasks.check_counter:Daemon mds.e mds_server.req_mksnap_latency.avgcount=0 2024-09-12T02:49:26.483 INFO:tasks.check_counter:Daemon mds.e mds_server.req_rmsnap_latency.avgcount=0 2024-09-12T02:49:26.483 DEBUG:tasks.check_counter:Getting stats from h 2024-09-12T02:49:26.483 DEBUG:teuthology.orchestra.run.smithi044:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc shell --fsid 4954ed46-70ae-11ef-bcea-c7b262605968 -- ceph daemon mds.h perf dump 2024-09-12T02:49:26.738 INFO:teuthology.orchestra.run.smithi044.stderr:Inferring config /var/lib/ceph/4954ed46-70ae-11ef-bcea-c7b262605968/mon.b/config 2024-09-12T02:49:27.286 INFO:teuthology.orchestra.run.smithi044.stdout:{ 2024-09-12T02:49:27.286 INFO:teuthology.orchestra.run.smithi044.stdout: "AsyncMessenger::Worker-0": { 2024-09-12T02:49:27.286 INFO:teuthology.orchestra.run.smithi044.stdout: "msgr_recv_messages": 800, 2024-09-12T02:49:27.286 INFO:teuthology.orchestra.run.smithi044.stdout: "msgr_send_messages": 668, 2024-09-12T02:49:27.286 INFO:teuthology.orchestra.run.smithi044.stdout: "msgr_recv_bytes": 251250, 2024-09-12T02:49:27.286 INFO:teuthology.orchestra.run.smithi044.stdout: "msgr_send_bytes": 273517, 2024-09-12T02:49:27.287 INFO:teuthology.orchestra.run.smithi044.stdout: "msgr_created_connections": 8, 2024-09-12T02:49:27.287 INFO:teuthology.orchestra.run.smithi044.stdout: "msgr_active_connections": 3, 2024-09-12T02:49:27.287 INFO:teuthology.orchestra.run.smithi044.stdout: "msgr_running_total_time": 0.087759638, 2024-09-12T02:49:27.287 INFO:teuthology.orchestra.run.smithi044.stdout: "msgr_running_send_time": 0.039816436, 2024-09-12T02:49:27.287 INFO:teuthology.orchestra.run.smithi044.stdout: "msgr_running_recv_time": 0.045557037, 2024-09-12T02:49:27.287 INFO:teuthology.orchestra.run.smithi044.stdout: "msgr_running_fast_dispatch_time": 0.005052871, 2024-09-12T02:49:27.287 INFO:teuthology.orchestra.run.smithi044.stdout: "msgr_send_messages_queue_lat": { 2024-09-12T02:49:27.287 INFO:teuthology.orchestra.run.smithi044.stdout: "avgcount": 667, 2024-09-12T02:49:27.287 INFO:teuthology.orchestra.run.smithi044.stdout: "sum": 0.050928630, 2024-09-12T02:49:27.287 INFO:teuthology.orchestra.run.smithi044.stdout: "avgtime": 0.000076354 2024-09-12T02:49:27.287 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-09-12T02:49:27.287 INFO:teuthology.orchestra.run.smithi044.stdout: "msgr_handle_ack_lat": { 2024-09-12T02:49:27.287 INFO:teuthology.orchestra.run.smithi044.stdout: "avgcount": 1392, 2024-09-12T02:49:27.288 INFO:teuthology.orchestra.run.smithi044.stdout: "sum": 0.000334012, 2024-09-12T02:49:27.288 INFO:teuthology.orchestra.run.smithi044.stdout: "avgtime": 0.000000239 2024-09-12T02:49:27.288 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-09-12T02:49:27.288 INFO:teuthology.orchestra.run.smithi044.stdout: "msgr_recv_encrypted_bytes": 3072, 2024-09-12T02:49:27.288 INFO:teuthology.orchestra.run.smithi044.stdout: "msgr_send_encrypted_bytes": 448 2024-09-12T02:49:27.288 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-09-12T02:49:27.288 INFO:teuthology.orchestra.run.smithi044.stdout: "AsyncMessenger::Worker-1": { 2024-09-12T02:49:27.288 INFO:teuthology.orchestra.run.smithi044.stdout: "msgr_recv_messages": 321, 2024-09-12T02:49:27.288 INFO:teuthology.orchestra.run.smithi044.stdout: "msgr_send_messages": 306, 2024-09-12T02:49:27.288 INFO:teuthology.orchestra.run.smithi044.stdout: "msgr_recv_bytes": 1788291, 2024-09-12T02:49:27.288 INFO:teuthology.orchestra.run.smithi044.stdout: "msgr_send_bytes": 186095, 2024-09-12T02:49:27.288 INFO:teuthology.orchestra.run.smithi044.stdout: "msgr_created_connections": 10, 2024-09-12T02:49:27.289 INFO:teuthology.orchestra.run.smithi044.stdout: "msgr_active_connections": 3, 2024-09-12T02:49:27.289 INFO:teuthology.orchestra.run.smithi044.stdout: "msgr_running_total_time": 0.055017208, 2024-09-12T02:49:27.289 INFO:teuthology.orchestra.run.smithi044.stdout: "msgr_running_send_time": 0.018903168, 2024-09-12T02:49:27.289 INFO:teuthology.orchestra.run.smithi044.stdout: "msgr_running_recv_time": 0.051359489, 2024-09-12T02:49:27.289 INFO:teuthology.orchestra.run.smithi044.stdout: "msgr_running_fast_dispatch_time": 0.000269274, 2024-09-12T02:49:27.289 INFO:teuthology.orchestra.run.smithi044.stdout: "msgr_send_messages_queue_lat": { 2024-09-12T02:49:27.289 INFO:teuthology.orchestra.run.smithi044.stdout: "avgcount": 305, 2024-09-12T02:49:27.289 INFO:teuthology.orchestra.run.smithi044.stdout: "sum": 0.034990619, 2024-09-12T02:49:27.289 INFO:teuthology.orchestra.run.smithi044.stdout: "avgtime": 0.000114723 2024-09-12T02:49:27.289 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-09-12T02:49:27.289 INFO:teuthology.orchestra.run.smithi044.stdout: "msgr_handle_ack_lat": { 2024-09-12T02:49:27.289 INFO:teuthology.orchestra.run.smithi044.stdout: "avgcount": 18, 2024-09-12T02:49:27.289 INFO:teuthology.orchestra.run.smithi044.stdout: "sum": 0.000002578, 2024-09-12T02:49:27.290 INFO:teuthology.orchestra.run.smithi044.stdout: "avgtime": 0.000000143 2024-09-12T02:49:27.290 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-09-12T02:49:27.290 INFO:teuthology.orchestra.run.smithi044.stdout: "msgr_recv_encrypted_bytes": 1784960, 2024-09-12T02:49:27.290 INFO:teuthology.orchestra.run.smithi044.stdout: "msgr_send_encrypted_bytes": 156048 2024-09-12T02:49:27.290 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-09-12T02:49:27.290 INFO:teuthology.orchestra.run.smithi044.stdout: "AsyncMessenger::Worker-2": { 2024-09-12T02:49:27.290 INFO:teuthology.orchestra.run.smithi044.stdout: "msgr_recv_messages": 20, 2024-09-12T02:49:27.290 INFO:teuthology.orchestra.run.smithi044.stdout: "msgr_send_messages": 219, 2024-09-12T02:49:27.290 INFO:teuthology.orchestra.run.smithi044.stdout: "msgr_recv_bytes": 4188, 2024-09-12T02:49:27.290 INFO:teuthology.orchestra.run.smithi044.stdout: "msgr_send_bytes": 511531, 2024-09-12T02:49:27.290 INFO:teuthology.orchestra.run.smithi044.stdout: "msgr_created_connections": 11, 2024-09-12T02:49:27.290 INFO:teuthology.orchestra.run.smithi044.stdout: "msgr_active_connections": 5, 2024-09-12T02:49:27.291 INFO:teuthology.orchestra.run.smithi044.stdout: "msgr_running_total_time": 0.017006676, 2024-09-12T02:49:27.291 INFO:teuthology.orchestra.run.smithi044.stdout: "msgr_running_send_time": 0.009094235, 2024-09-12T02:49:27.291 INFO:teuthology.orchestra.run.smithi044.stdout: "msgr_running_recv_time": 0.005540821, 2024-09-12T02:49:27.291 INFO:teuthology.orchestra.run.smithi044.stdout: "msgr_running_fast_dispatch_time": 0.000156272, 2024-09-12T02:49:27.291 INFO:teuthology.orchestra.run.smithi044.stdout: "msgr_send_messages_queue_lat": { 2024-09-12T02:49:27.291 INFO:teuthology.orchestra.run.smithi044.stdout: "avgcount": 216, 2024-09-12T02:49:27.291 INFO:teuthology.orchestra.run.smithi044.stdout: "sum": 0.035306296, 2024-09-12T02:49:27.291 INFO:teuthology.orchestra.run.smithi044.stdout: "avgtime": 0.000163455 2024-09-12T02:49:27.291 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-09-12T02:49:27.291 INFO:teuthology.orchestra.run.smithi044.stdout: "msgr_handle_ack_lat": { 2024-09-12T02:49:27.291 INFO:teuthology.orchestra.run.smithi044.stdout: "avgcount": 38, 2024-09-12T02:49:27.291 INFO:teuthology.orchestra.run.smithi044.stdout: "sum": 0.000009921, 2024-09-12T02:49:27.292 INFO:teuthology.orchestra.run.smithi044.stdout: "avgtime": 0.000000261 2024-09-12T02:49:27.292 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-09-12T02:49:27.292 INFO:teuthology.orchestra.run.smithi044.stdout: "msgr_recv_encrypted_bytes": 2048, 2024-09-12T02:49:27.292 INFO:teuthology.orchestra.run.smithi044.stdout: "msgr_send_encrypted_bytes": 477968 2024-09-12T02:49:27.292 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-09-12T02:49:27.292 INFO:teuthology.orchestra.run.smithi044.stdout: "cct": { 2024-09-12T02:49:27.292 INFO:teuthology.orchestra.run.smithi044.stdout: "total_workers": 1, 2024-09-12T02:49:27.292 INFO:teuthology.orchestra.run.smithi044.stdout: "unhealthy_workers": 0 2024-09-12T02:49:27.292 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-09-12T02:49:27.292 INFO:teuthology.orchestra.run.smithi044.stdout: "finisher-MDSRank": { 2024-09-12T02:49:27.292 INFO:teuthology.orchestra.run.smithi044.stdout: "queue_len": 0, 2024-09-12T02:49:27.293 INFO:teuthology.orchestra.run.smithi044.stdout: "complete_latency": { 2024-09-12T02:49:27.293 INFO:teuthology.orchestra.run.smithi044.stdout: "avgcount": 53, 2024-09-12T02:49:27.293 INFO:teuthology.orchestra.run.smithi044.stdout: "sum": 0.001648346, 2024-09-12T02:49:27.293 INFO:teuthology.orchestra.run.smithi044.stdout: "avgtime": 0.000031100 2024-09-12T02:49:27.293 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-09-12T02:49:27.293 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-09-12T02:49:27.293 INFO:teuthology.orchestra.run.smithi044.stdout: "finisher-PurgeQueue": { 2024-09-12T02:49:27.293 INFO:teuthology.orchestra.run.smithi044.stdout: "queue_len": 0, 2024-09-12T02:49:27.293 INFO:teuthology.orchestra.run.smithi044.stdout: "complete_latency": { 2024-09-12T02:49:27.293 INFO:teuthology.orchestra.run.smithi044.stdout: "avgcount": 2, 2024-09-12T02:49:27.293 INFO:teuthology.orchestra.run.smithi044.stdout: "sum": 0.000012003, 2024-09-12T02:49:27.293 INFO:teuthology.orchestra.run.smithi044.stdout: "avgtime": 0.000006001 2024-09-12T02:49:27.294 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-09-12T02:49:27.294 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-09-12T02:49:27.294 INFO:teuthology.orchestra.run.smithi044.stdout: "mds": { 2024-09-12T02:49:27.294 INFO:teuthology.orchestra.run.smithi044.stdout: "request": 0, 2024-09-12T02:49:27.294 INFO:teuthology.orchestra.run.smithi044.stdout: "reply": 0, 2024-09-12T02:49:27.294 INFO:teuthology.orchestra.run.smithi044.stdout: "reply_latency": { 2024-09-12T02:49:27.294 INFO:teuthology.orchestra.run.smithi044.stdout: "avgcount": 0, 2024-09-12T02:49:27.294 INFO:teuthology.orchestra.run.smithi044.stdout: "sum": 0.000000000, 2024-09-12T02:49:27.294 INFO:teuthology.orchestra.run.smithi044.stdout: "avgtime": 0.000000000 2024-09-12T02:49:27.294 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-09-12T02:49:27.294 INFO:teuthology.orchestra.run.smithi044.stdout: "slow_reply": 0, 2024-09-12T02:49:27.294 INFO:teuthology.orchestra.run.smithi044.stdout: "forward": 0, 2024-09-12T02:49:27.294 INFO:teuthology.orchestra.run.smithi044.stdout: "dir_fetch_complete": 0, 2024-09-12T02:49:27.294 INFO:teuthology.orchestra.run.smithi044.stdout: "dir_fetch_keys": 0, 2024-09-12T02:49:27.295 INFO:teuthology.orchestra.run.smithi044.stdout: "dir_commit": 11, 2024-09-12T02:49:27.295 INFO:teuthology.orchestra.run.smithi044.stdout: "dir_split": 0, 2024-09-12T02:49:27.295 INFO:teuthology.orchestra.run.smithi044.stdout: "dir_merge": 0, 2024-09-12T02:49:27.295 INFO:teuthology.orchestra.run.smithi044.stdout: "inodes": 16, 2024-09-12T02:49:27.295 INFO:teuthology.orchestra.run.smithi044.stdout: "inodes_top": 0, 2024-09-12T02:49:27.295 INFO:teuthology.orchestra.run.smithi044.stdout: "inodes_bottom": 16, 2024-09-12T02:49:27.295 INFO:teuthology.orchestra.run.smithi044.stdout: "inodes_pin_tail": 0, 2024-09-12T02:49:27.295 INFO:teuthology.orchestra.run.smithi044.stdout: "inodes_pinned": 13, 2024-09-12T02:49:27.295 INFO:teuthology.orchestra.run.smithi044.stdout: "inodes_expired": 4, 2024-09-12T02:49:27.295 INFO:teuthology.orchestra.run.smithi044.stdout: "inodes_with_caps": 0, 2024-09-12T02:49:27.295 INFO:teuthology.orchestra.run.smithi044.stdout: "caps": 0, 2024-09-12T02:49:27.295 INFO:teuthology.orchestra.run.smithi044.stdout: "subtrees": 3, 2024-09-12T02:49:27.295 INFO:teuthology.orchestra.run.smithi044.stdout: "traverse": 7, 2024-09-12T02:49:27.295 INFO:teuthology.orchestra.run.smithi044.stdout: "traverse_hit": 4, 2024-09-12T02:49:27.296 INFO:teuthology.orchestra.run.smithi044.stdout: "traverse_forward": 0, 2024-09-12T02:49:27.296 INFO:teuthology.orchestra.run.smithi044.stdout: "traverse_discover": 3, 2024-09-12T02:49:27.296 INFO:teuthology.orchestra.run.smithi044.stdout: "traverse_dir_fetch": 0, 2024-09-12T02:49:27.296 INFO:teuthology.orchestra.run.smithi044.stdout: "traverse_remote_ino": 0, 2024-09-12T02:49:27.296 INFO:teuthology.orchestra.run.smithi044.stdout: "traverse_lock": 0, 2024-09-12T02:49:27.296 INFO:teuthology.orchestra.run.smithi044.stdout: "load_cent": 0, 2024-09-12T02:49:27.296 INFO:teuthology.orchestra.run.smithi044.stdout: "q": 0, 2024-09-12T02:49:27.296 INFO:teuthology.orchestra.run.smithi044.stdout: "exported": 0, 2024-09-12T02:49:27.296 INFO:teuthology.orchestra.run.smithi044.stdout: "exported_inodes": 0, 2024-09-12T02:49:27.296 INFO:teuthology.orchestra.run.smithi044.stdout: "imported": 0, 2024-09-12T02:49:27.296 INFO:teuthology.orchestra.run.smithi044.stdout: "imported_inodes": 0, 2024-09-12T02:49:27.296 INFO:teuthology.orchestra.run.smithi044.stdout: "openino_dir_fetch": 0, 2024-09-12T02:49:27.296 INFO:teuthology.orchestra.run.smithi044.stdout: "openino_backtrace_fetch": 0, 2024-09-12T02:49:27.296 INFO:teuthology.orchestra.run.smithi044.stdout: "openino_peer_discover": 0, 2024-09-12T02:49:27.297 INFO:teuthology.orchestra.run.smithi044.stdout: "root_rfiles": 4, 2024-09-12T02:49:27.297 INFO:teuthology.orchestra.run.smithi044.stdout: "root_rbytes": 234, 2024-09-12T02:49:27.297 INFO:teuthology.orchestra.run.smithi044.stdout: "root_rsnaps": 6, 2024-09-12T02:49:27.297 INFO:teuthology.orchestra.run.smithi044.stdout: "scrub_backtrace_fetch": 0, 2024-09-12T02:49:27.297 INFO:teuthology.orchestra.run.smithi044.stdout: "scrub_set_tag": 0, 2024-09-12T02:49:27.297 INFO:teuthology.orchestra.run.smithi044.stdout: "scrub_backtrace_repaired": 0, 2024-09-12T02:49:27.297 INFO:teuthology.orchestra.run.smithi044.stdout: "scrub_inotable_repaired": 0, 2024-09-12T02:49:27.297 INFO:teuthology.orchestra.run.smithi044.stdout: "scrub_dir_inodes": 0, 2024-09-12T02:49:27.297 INFO:teuthology.orchestra.run.smithi044.stdout: "scrub_dir_base_inodes": 0, 2024-09-12T02:49:27.297 INFO:teuthology.orchestra.run.smithi044.stdout: "scrub_dirfrag_rstats": 0, 2024-09-12T02:49:27.297 INFO:teuthology.orchestra.run.smithi044.stdout: "scrub_file_inodes": 0, 2024-09-12T02:49:27.297 INFO:teuthology.orchestra.run.smithi044.stdout: "handle_inode_file_caps": 0, 2024-09-12T02:49:27.297 INFO:teuthology.orchestra.run.smithi044.stdout: "ceph_cap_op_revoke": 0, 2024-09-12T02:49:27.297 INFO:teuthology.orchestra.run.smithi044.stdout: "ceph_cap_op_grant": 0, 2024-09-12T02:49:27.298 INFO:teuthology.orchestra.run.smithi044.stdout: "ceph_cap_op_trunc": 0, 2024-09-12T02:49:27.298 INFO:teuthology.orchestra.run.smithi044.stdout: "ceph_cap_op_flushsnap_ack": 0, 2024-09-12T02:49:27.298 INFO:teuthology.orchestra.run.smithi044.stdout: "ceph_cap_op_flush_ack": 0, 2024-09-12T02:49:27.298 INFO:teuthology.orchestra.run.smithi044.stdout: "handle_client_caps": 0, 2024-09-12T02:49:27.298 INFO:teuthology.orchestra.run.smithi044.stdout: "handle_client_caps_dirty": 0, 2024-09-12T02:49:27.298 INFO:teuthology.orchestra.run.smithi044.stdout: "handle_client_cap_release": 0, 2024-09-12T02:49:27.298 INFO:teuthology.orchestra.run.smithi044.stdout: "process_request_cap_release": 0 2024-09-12T02:49:27.298 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-09-12T02:49:27.298 INFO:teuthology.orchestra.run.smithi044.stdout: "mds_cache": { 2024-09-12T02:49:27.298 INFO:teuthology.orchestra.run.smithi044.stdout: "dir_update": 0, 2024-09-12T02:49:27.298 INFO:teuthology.orchestra.run.smithi044.stdout: "dir_update_receipt": 11, 2024-09-12T02:49:27.298 INFO:teuthology.orchestra.run.smithi044.stdout: "dir_try_discover": 7, 2024-09-12T02:49:27.298 INFO:teuthology.orchestra.run.smithi044.stdout: "dir_send_discover": 8, 2024-09-12T02:49:27.298 INFO:teuthology.orchestra.run.smithi044.stdout: "dir_handle_discover": 0, 2024-09-12T02:49:27.299 INFO:teuthology.orchestra.run.smithi044.stdout: "num_strays": 0, 2024-09-12T02:49:27.299 INFO:teuthology.orchestra.run.smithi044.stdout: "num_strays_delayed": 0, 2024-09-12T02:49:27.299 INFO:teuthology.orchestra.run.smithi044.stdout: "num_strays_enqueuing": 0, 2024-09-12T02:49:27.299 INFO:teuthology.orchestra.run.smithi044.stdout: "strays_created": 0, 2024-09-12T02:49:27.299 INFO:teuthology.orchestra.run.smithi044.stdout: "strays_enqueued": 0, 2024-09-12T02:49:27.299 INFO:teuthology.orchestra.run.smithi044.stdout: "strays_reintegrated": 0, 2024-09-12T02:49:27.299 INFO:teuthology.orchestra.run.smithi044.stdout: "strays_migrated": 0, 2024-09-12T02:49:27.299 INFO:teuthology.orchestra.run.smithi044.stdout: "num_recovering_processing": 0, 2024-09-12T02:49:27.299 INFO:teuthology.orchestra.run.smithi044.stdout: "num_recovering_enqueued": 0, 2024-09-12T02:49:27.299 INFO:teuthology.orchestra.run.smithi044.stdout: "num_recovering_prioritized": 0, 2024-09-12T02:49:27.299 INFO:teuthology.orchestra.run.smithi044.stdout: "recovery_started": 0, 2024-09-12T02:49:27.299 INFO:teuthology.orchestra.run.smithi044.stdout: "recovery_completed": 0, 2024-09-12T02:49:27.299 INFO:teuthology.orchestra.run.smithi044.stdout: "ireq_quiesce_path": 0, 2024-09-12T02:49:27.299 INFO:teuthology.orchestra.run.smithi044.stdout: "ireq_quiesce_inode": 0, 2024-09-12T02:49:27.299 INFO:teuthology.orchestra.run.smithi044.stdout: "ireq_enqueue_scrub": 0, 2024-09-12T02:49:27.300 INFO:teuthology.orchestra.run.smithi044.stdout: "ireq_exportdir": 0, 2024-09-12T02:49:27.300 INFO:teuthology.orchestra.run.smithi044.stdout: "ireq_flush": 0, 2024-09-12T02:49:27.300 INFO:teuthology.orchestra.run.smithi044.stdout: "ireq_fragmentdir": 0, 2024-09-12T02:49:27.300 INFO:teuthology.orchestra.run.smithi044.stdout: "ireq_fragstats": 0, 2024-09-12T02:49:27.300 INFO:teuthology.orchestra.run.smithi044.stdout: "ireq_inodestats": 0 2024-09-12T02:49:27.300 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-09-12T02:49:27.300 INFO:teuthology.orchestra.run.smithi044.stdout: "mds_log": { 2024-09-12T02:49:27.300 INFO:teuthology.orchestra.run.smithi044.stdout: "evlrg": 0, 2024-09-12T02:49:27.300 INFO:teuthology.orchestra.run.smithi044.stdout: "evadd": 7, 2024-09-12T02:49:27.300 INFO:teuthology.orchestra.run.smithi044.stdout: "evex": 0, 2024-09-12T02:49:27.300 INFO:teuthology.orchestra.run.smithi044.stdout: "evtrm": 0, 2024-09-12T02:49:27.300 INFO:teuthology.orchestra.run.smithi044.stdout: "ev": 7, 2024-09-12T02:49:27.300 INFO:teuthology.orchestra.run.smithi044.stdout: "evexg": 0, 2024-09-12T02:49:27.300 INFO:teuthology.orchestra.run.smithi044.stdout: "evexd": 0, 2024-09-12T02:49:27.301 INFO:teuthology.orchestra.run.smithi044.stdout: "segadd": 2, 2024-09-12T02:49:27.301 INFO:teuthology.orchestra.run.smithi044.stdout: "segex": 0, 2024-09-12T02:49:27.301 INFO:teuthology.orchestra.run.smithi044.stdout: "segtrm": 0, 2024-09-12T02:49:27.301 INFO:teuthology.orchestra.run.smithi044.stdout: "seg": 2, 2024-09-12T02:49:27.301 INFO:teuthology.orchestra.run.smithi044.stdout: "segmjr": 2, 2024-09-12T02:49:27.301 INFO:teuthology.orchestra.run.smithi044.stdout: "segexg": 0, 2024-09-12T02:49:27.301 INFO:teuthology.orchestra.run.smithi044.stdout: "segexd": 0, 2024-09-12T02:49:27.301 INFO:teuthology.orchestra.run.smithi044.stdout: "expos": 4194304, 2024-09-12T02:49:27.301 INFO:teuthology.orchestra.run.smithi044.stdout: "wrpos": 4196353, 2024-09-12T02:49:27.301 INFO:teuthology.orchestra.run.smithi044.stdout: "rdpos": 0, 2024-09-12T02:49:27.301 INFO:teuthology.orchestra.run.smithi044.stdout: "jlat": { 2024-09-12T02:49:27.301 INFO:teuthology.orchestra.run.smithi044.stdout: "avgcount": 6, 2024-09-12T02:49:27.301 INFO:teuthology.orchestra.run.smithi044.stdout: "sum": 0.011519373, 2024-09-12T02:49:27.301 INFO:teuthology.orchestra.run.smithi044.stdout: "avgtime": 0.001919895 2024-09-12T02:49:27.302 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-09-12T02:49:27.302 INFO:teuthology.orchestra.run.smithi044.stdout: "replayed": 0 2024-09-12T02:49:27.302 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-09-12T02:49:27.302 INFO:teuthology.orchestra.run.smithi044.stdout: "mds_mem": { 2024-09-12T02:49:27.302 INFO:teuthology.orchestra.run.smithi044.stdout: "ino": 20, 2024-09-12T02:49:27.302 INFO:teuthology.orchestra.run.smithi044.stdout: "ino+": 22, 2024-09-12T02:49:27.302 INFO:teuthology.orchestra.run.smithi044.stdout: "ino-": 2, 2024-09-12T02:49:27.302 INFO:teuthology.orchestra.run.smithi044.stdout: "dir": 19, 2024-09-12T02:49:27.302 INFO:teuthology.orchestra.run.smithi044.stdout: "dir+": 23, 2024-09-12T02:49:27.302 INFO:teuthology.orchestra.run.smithi044.stdout: "dir-": 4, 2024-09-12T02:49:27.302 INFO:teuthology.orchestra.run.smithi044.stdout: "dn": 16, 2024-09-12T02:49:27.302 INFO:teuthology.orchestra.run.smithi044.stdout: "dn+": 20, 2024-09-12T02:49:27.302 INFO:teuthology.orchestra.run.smithi044.stdout: "dn-": 4, 2024-09-12T02:49:27.302 INFO:teuthology.orchestra.run.smithi044.stdout: "cap": 0, 2024-09-12T02:49:27.303 INFO:teuthology.orchestra.run.smithi044.stdout: "cap+": 0, 2024-09-12T02:49:27.303 INFO:teuthology.orchestra.run.smithi044.stdout: "cap-": 0, 2024-09-12T02:49:27.303 INFO:teuthology.orchestra.run.smithi044.stdout: "rss": 49812, 2024-09-12T02:49:27.303 INFO:teuthology.orchestra.run.smithi044.stdout: "heap": 223520 2024-09-12T02:49:27.303 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-09-12T02:49:27.303 INFO:teuthology.orchestra.run.smithi044.stdout: "mds_server": { 2024-09-12T02:49:27.303 INFO:teuthology.orchestra.run.smithi044.stdout: "dispatch_client_request": 0, 2024-09-12T02:49:27.303 INFO:teuthology.orchestra.run.smithi044.stdout: "dispatch_server_request": 0, 2024-09-12T02:49:27.303 INFO:teuthology.orchestra.run.smithi044.stdout: "handle_client_request": 0, 2024-09-12T02:49:27.303 INFO:teuthology.orchestra.run.smithi044.stdout: "handle_client_session": 17, 2024-09-12T02:49:27.303 INFO:teuthology.orchestra.run.smithi044.stdout: "handle_peer_request": 0, 2024-09-12T02:49:27.303 INFO:teuthology.orchestra.run.smithi044.stdout: "req_create_latency": { 2024-09-12T02:49:27.303 INFO:teuthology.orchestra.run.smithi044.stdout: "avgcount": 0, 2024-09-12T02:49:27.303 INFO:teuthology.orchestra.run.smithi044.stdout: "sum": 0.000000000, 2024-09-12T02:49:27.303 INFO:teuthology.orchestra.run.smithi044.stdout: "avgtime": 0.000000000 2024-09-12T02:49:27.304 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-09-12T02:49:27.304 INFO:teuthology.orchestra.run.smithi044.stdout: "req_getattr_latency": { 2024-09-12T02:49:27.304 INFO:teuthology.orchestra.run.smithi044.stdout: "avgcount": 0, 2024-09-12T02:49:27.304 INFO:teuthology.orchestra.run.smithi044.stdout: "sum": 0.000000000, 2024-09-12T02:49:27.304 INFO:teuthology.orchestra.run.smithi044.stdout: "avgtime": 0.000000000 2024-09-12T02:49:27.304 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-09-12T02:49:27.304 INFO:teuthology.orchestra.run.smithi044.stdout: "req_getfilelock_latency": { 2024-09-12T02:49:27.304 INFO:teuthology.orchestra.run.smithi044.stdout: "avgcount": 0, 2024-09-12T02:49:27.304 INFO:teuthology.orchestra.run.smithi044.stdout: "sum": 0.000000000, 2024-09-12T02:49:27.304 INFO:teuthology.orchestra.run.smithi044.stdout: "avgtime": 0.000000000 2024-09-12T02:49:27.304 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-09-12T02:49:27.304 INFO:teuthology.orchestra.run.smithi044.stdout: "req_link_latency": { 2024-09-12T02:49:27.304 INFO:teuthology.orchestra.run.smithi044.stdout: "avgcount": 0, 2024-09-12T02:49:27.304 INFO:teuthology.orchestra.run.smithi044.stdout: "sum": 0.000000000, 2024-09-12T02:49:27.305 INFO:teuthology.orchestra.run.smithi044.stdout: "avgtime": 0.000000000 2024-09-12T02:49:27.305 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-09-12T02:49:27.305 INFO:teuthology.orchestra.run.smithi044.stdout: "req_lookup_latency": { 2024-09-12T02:49:27.305 INFO:teuthology.orchestra.run.smithi044.stdout: "avgcount": 0, 2024-09-12T02:49:27.305 INFO:teuthology.orchestra.run.smithi044.stdout: "sum": 0.000000000, 2024-09-12T02:49:27.305 INFO:teuthology.orchestra.run.smithi044.stdout: "avgtime": 0.000000000 2024-09-12T02:49:27.305 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-09-12T02:49:27.305 INFO:teuthology.orchestra.run.smithi044.stdout: "req_lookuphash_latency": { 2024-09-12T02:49:27.305 INFO:teuthology.orchestra.run.smithi044.stdout: "avgcount": 0, 2024-09-12T02:49:27.305 INFO:teuthology.orchestra.run.smithi044.stdout: "sum": 0.000000000, 2024-09-12T02:49:27.305 INFO:teuthology.orchestra.run.smithi044.stdout: "avgtime": 0.000000000 2024-09-12T02:49:27.305 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-09-12T02:49:27.305 INFO:teuthology.orchestra.run.smithi044.stdout: "req_lookupino_latency": { 2024-09-12T02:49:27.305 INFO:teuthology.orchestra.run.smithi044.stdout: "avgcount": 0, 2024-09-12T02:49:27.305 INFO:teuthology.orchestra.run.smithi044.stdout: "sum": 0.000000000, 2024-09-12T02:49:27.306 INFO:teuthology.orchestra.run.smithi044.stdout: "avgtime": 0.000000000 2024-09-12T02:49:27.306 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-09-12T02:49:27.306 INFO:teuthology.orchestra.run.smithi044.stdout: "req_lookupname_latency": { 2024-09-12T02:49:27.306 INFO:teuthology.orchestra.run.smithi044.stdout: "avgcount": 0, 2024-09-12T02:49:27.306 INFO:teuthology.orchestra.run.smithi044.stdout: "sum": 0.000000000, 2024-09-12T02:49:27.306 INFO:teuthology.orchestra.run.smithi044.stdout: "avgtime": 0.000000000 2024-09-12T02:49:27.306 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-09-12T02:49:27.306 INFO:teuthology.orchestra.run.smithi044.stdout: "req_lookupparent_latency": { 2024-09-12T02:49:27.306 INFO:teuthology.orchestra.run.smithi044.stdout: "avgcount": 0, 2024-09-12T02:49:27.306 INFO:teuthology.orchestra.run.smithi044.stdout: "sum": 0.000000000, 2024-09-12T02:49:27.306 INFO:teuthology.orchestra.run.smithi044.stdout: "avgtime": 0.000000000 2024-09-12T02:49:27.306 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-09-12T02:49:27.306 INFO:teuthology.orchestra.run.smithi044.stdout: "req_lookupsnap_latency": { 2024-09-12T02:49:27.307 INFO:teuthology.orchestra.run.smithi044.stdout: "avgcount": 0, 2024-09-12T02:49:27.307 INFO:teuthology.orchestra.run.smithi044.stdout: "sum": 0.000000000, 2024-09-12T02:49:27.307 INFO:teuthology.orchestra.run.smithi044.stdout: "avgtime": 0.000000000 2024-09-12T02:49:27.307 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-09-12T02:49:27.307 INFO:teuthology.orchestra.run.smithi044.stdout: "req_lssnap_latency": { 2024-09-12T02:49:27.307 INFO:teuthology.orchestra.run.smithi044.stdout: "avgcount": 0, 2024-09-12T02:49:27.307 INFO:teuthology.orchestra.run.smithi044.stdout: "sum": 0.000000000, 2024-09-12T02:49:27.307 INFO:teuthology.orchestra.run.smithi044.stdout: "avgtime": 0.000000000 2024-09-12T02:49:27.307 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-09-12T02:49:27.307 INFO:teuthology.orchestra.run.smithi044.stdout: "req_mkdir_latency": { 2024-09-12T02:49:27.307 INFO:teuthology.orchestra.run.smithi044.stdout: "avgcount": 0, 2024-09-12T02:49:27.308 INFO:teuthology.orchestra.run.smithi044.stdout: "sum": 0.000000000, 2024-09-12T02:49:27.308 INFO:teuthology.orchestra.run.smithi044.stdout: "avgtime": 0.000000000 2024-09-12T02:49:27.308 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-09-12T02:49:27.308 INFO:teuthology.orchestra.run.smithi044.stdout: "req_mknod_latency": { 2024-09-12T02:49:27.308 INFO:teuthology.orchestra.run.smithi044.stdout: "avgcount": 0, 2024-09-12T02:49:27.308 INFO:teuthology.orchestra.run.smithi044.stdout: "sum": 0.000000000, 2024-09-12T02:49:27.308 INFO:teuthology.orchestra.run.smithi044.stdout: "avgtime": 0.000000000 2024-09-12T02:49:27.309 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-09-12T02:49:27.309 INFO:teuthology.orchestra.run.smithi044.stdout: "req_mksnap_latency": { 2024-09-12T02:49:27.309 INFO:teuthology.orchestra.run.smithi044.stdout: "avgcount": 0, 2024-09-12T02:49:27.309 INFO:teuthology.orchestra.run.smithi044.stdout: "sum": 0.000000000, 2024-09-12T02:49:27.309 INFO:teuthology.orchestra.run.smithi044.stdout: "avgtime": 0.000000000 2024-09-12T02:49:27.309 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-09-12T02:49:27.309 INFO:teuthology.orchestra.run.smithi044.stdout: "req_open_latency": { 2024-09-12T02:49:27.309 INFO:teuthology.orchestra.run.smithi044.stdout: "avgcount": 0, 2024-09-12T02:49:27.309 INFO:teuthology.orchestra.run.smithi044.stdout: "sum": 0.000000000, 2024-09-12T02:49:27.309 INFO:teuthology.orchestra.run.smithi044.stdout: "avgtime": 0.000000000 2024-09-12T02:49:27.309 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-09-12T02:49:27.309 INFO:teuthology.orchestra.run.smithi044.stdout: "req_readdir_latency": { 2024-09-12T02:49:27.309 INFO:teuthology.orchestra.run.smithi044.stdout: "avgcount": 0, 2024-09-12T02:49:27.310 INFO:teuthology.orchestra.run.smithi044.stdout: "sum": 0.000000000, 2024-09-12T02:49:27.310 INFO:teuthology.orchestra.run.smithi044.stdout: "avgtime": 0.000000000 2024-09-12T02:49:27.310 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-09-12T02:49:27.310 INFO:teuthology.orchestra.run.smithi044.stdout: "req_rename_latency": { 2024-09-12T02:49:27.310 INFO:teuthology.orchestra.run.smithi044.stdout: "avgcount": 0, 2024-09-12T02:49:27.310 INFO:teuthology.orchestra.run.smithi044.stdout: "sum": 0.000000000, 2024-09-12T02:49:27.310 INFO:teuthology.orchestra.run.smithi044.stdout: "avgtime": 0.000000000 2024-09-12T02:49:27.310 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-09-12T02:49:27.310 INFO:teuthology.orchestra.run.smithi044.stdout: "req_renamesnap_latency": { 2024-09-12T02:49:27.310 INFO:teuthology.orchestra.run.smithi044.stdout: "avgcount": 0, 2024-09-12T02:49:27.310 INFO:teuthology.orchestra.run.smithi044.stdout: "sum": 0.000000000, 2024-09-12T02:49:27.310 INFO:teuthology.orchestra.run.smithi044.stdout: "avgtime": 0.000000000 2024-09-12T02:49:27.310 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-09-12T02:49:27.310 INFO:teuthology.orchestra.run.smithi044.stdout: "req_snapdiff_latency": { 2024-09-12T02:49:27.311 INFO:teuthology.orchestra.run.smithi044.stdout: "avgcount": 0, 2024-09-12T02:49:27.311 INFO:teuthology.orchestra.run.smithi044.stdout: "sum": 0.000000000, 2024-09-12T02:49:27.311 INFO:teuthology.orchestra.run.smithi044.stdout: "avgtime": 0.000000000 2024-09-12T02:49:27.311 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-09-12T02:49:27.311 INFO:teuthology.orchestra.run.smithi044.stdout: "req_rmdir_latency": { 2024-09-12T02:49:27.311 INFO:teuthology.orchestra.run.smithi044.stdout: "avgcount": 0, 2024-09-12T02:49:27.311 INFO:teuthology.orchestra.run.smithi044.stdout: "sum": 0.000000000, 2024-09-12T02:49:27.311 INFO:teuthology.orchestra.run.smithi044.stdout: "avgtime": 0.000000000 2024-09-12T02:49:27.311 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-09-12T02:49:27.311 INFO:teuthology.orchestra.run.smithi044.stdout: "req_rmsnap_latency": { 2024-09-12T02:49:27.311 INFO:teuthology.orchestra.run.smithi044.stdout: "avgcount": 0, 2024-09-12T02:49:27.311 INFO:teuthology.orchestra.run.smithi044.stdout: "sum": 0.000000000, 2024-09-12T02:49:27.311 INFO:teuthology.orchestra.run.smithi044.stdout: "avgtime": 0.000000000 2024-09-12T02:49:27.311 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-09-12T02:49:27.312 INFO:teuthology.orchestra.run.smithi044.stdout: "req_rmxattr_latency": { 2024-09-12T02:49:27.312 INFO:teuthology.orchestra.run.smithi044.stdout: "avgcount": 0, 2024-09-12T02:49:27.312 INFO:teuthology.orchestra.run.smithi044.stdout: "sum": 0.000000000, 2024-09-12T02:49:27.312 INFO:teuthology.orchestra.run.smithi044.stdout: "avgtime": 0.000000000 2024-09-12T02:49:27.312 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-09-12T02:49:27.312 INFO:teuthology.orchestra.run.smithi044.stdout: "req_setattr_latency": { 2024-09-12T02:49:27.312 INFO:teuthology.orchestra.run.smithi044.stdout: "avgcount": 0, 2024-09-12T02:49:27.312 INFO:teuthology.orchestra.run.smithi044.stdout: "sum": 0.000000000, 2024-09-12T02:49:27.312 INFO:teuthology.orchestra.run.smithi044.stdout: "avgtime": 0.000000000 2024-09-12T02:49:27.312 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-09-12T02:49:27.312 INFO:teuthology.orchestra.run.smithi044.stdout: "req_setdirlayout_latency": { 2024-09-12T02:49:27.312 INFO:teuthology.orchestra.run.smithi044.stdout: "avgcount": 0, 2024-09-12T02:49:27.312 INFO:teuthology.orchestra.run.smithi044.stdout: "sum": 0.000000000, 2024-09-12T02:49:27.313 INFO:teuthology.orchestra.run.smithi044.stdout: "avgtime": 0.000000000 2024-09-12T02:49:27.313 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-09-12T02:49:27.313 INFO:teuthology.orchestra.run.smithi044.stdout: "req_setfilelock_latency": { 2024-09-12T02:49:27.313 INFO:teuthology.orchestra.run.smithi044.stdout: "avgcount": 0, 2024-09-12T02:49:27.313 INFO:teuthology.orchestra.run.smithi044.stdout: "sum": 0.000000000, 2024-09-12T02:49:27.313 INFO:teuthology.orchestra.run.smithi044.stdout: "avgtime": 0.000000000 2024-09-12T02:49:27.313 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-09-12T02:49:27.313 INFO:teuthology.orchestra.run.smithi044.stdout: "req_setlayout_latency": { 2024-09-12T02:49:27.313 INFO:teuthology.orchestra.run.smithi044.stdout: "avgcount": 0, 2024-09-12T02:49:27.313 INFO:teuthology.orchestra.run.smithi044.stdout: "sum": 0.000000000, 2024-09-12T02:49:27.313 INFO:teuthology.orchestra.run.smithi044.stdout: "avgtime": 0.000000000 2024-09-12T02:49:27.313 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-09-12T02:49:27.313 INFO:teuthology.orchestra.run.smithi044.stdout: "req_setxattr_latency": { 2024-09-12T02:49:27.314 INFO:teuthology.orchestra.run.smithi044.stdout: "avgcount": 0, 2024-09-12T02:49:27.314 INFO:teuthology.orchestra.run.smithi044.stdout: "sum": 0.000000000, 2024-09-12T02:49:27.314 INFO:teuthology.orchestra.run.smithi044.stdout: "avgtime": 0.000000000 2024-09-12T02:49:27.314 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-09-12T02:49:27.314 INFO:teuthology.orchestra.run.smithi044.stdout: "req_symlink_latency": { 2024-09-12T02:49:27.314 INFO:teuthology.orchestra.run.smithi044.stdout: "avgcount": 0, 2024-09-12T02:49:27.314 INFO:teuthology.orchestra.run.smithi044.stdout: "sum": 0.000000000, 2024-09-12T02:49:27.314 INFO:teuthology.orchestra.run.smithi044.stdout: "avgtime": 0.000000000 2024-09-12T02:49:27.314 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-09-12T02:49:27.314 INFO:teuthology.orchestra.run.smithi044.stdout: "req_unlink_latency": { 2024-09-12T02:49:27.314 INFO:teuthology.orchestra.run.smithi044.stdout: "avgcount": 0, 2024-09-12T02:49:27.314 INFO:teuthology.orchestra.run.smithi044.stdout: "sum": 0.000000000, 2024-09-12T02:49:27.314 INFO:teuthology.orchestra.run.smithi044.stdout: "avgtime": 0.000000000 2024-09-12T02:49:27.315 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-09-12T02:49:27.315 INFO:teuthology.orchestra.run.smithi044.stdout: "cap_revoke_eviction": 0, 2024-09-12T02:49:27.315 INFO:teuthology.orchestra.run.smithi044.stdout: "cap_acquisition_throttle": 0, 2024-09-12T02:49:27.315 INFO:teuthology.orchestra.run.smithi044.stdout: "req_getvxattr_latency": { 2024-09-12T02:49:27.315 INFO:teuthology.orchestra.run.smithi044.stdout: "avgcount": 0, 2024-09-12T02:49:27.315 INFO:teuthology.orchestra.run.smithi044.stdout: "sum": 0.000000000, 2024-09-12T02:49:27.315 INFO:teuthology.orchestra.run.smithi044.stdout: "avgtime": 0.000000000 2024-09-12T02:49:27.315 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-09-12T02:49:27.315 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-09-12T02:49:27.315 INFO:teuthology.orchestra.run.smithi044.stdout: "mds_sessions": { 2024-09-12T02:49:27.315 INFO:teuthology.orchestra.run.smithi044.stdout: "session_count": 1, 2024-09-12T02:49:27.315 INFO:teuthology.orchestra.run.smithi044.stdout: "session_add": 3, 2024-09-12T02:49:27.315 INFO:teuthology.orchestra.run.smithi044.stdout: "session_remove": 2, 2024-09-12T02:49:27.315 INFO:teuthology.orchestra.run.smithi044.stdout: "sessions_open": 1, 2024-09-12T02:49:27.316 INFO:teuthology.orchestra.run.smithi044.stdout: "sessions_stale": 0, 2024-09-12T02:49:27.316 INFO:teuthology.orchestra.run.smithi044.stdout: "total_load": 0, 2024-09-12T02:49:27.316 INFO:teuthology.orchestra.run.smithi044.stdout: "average_load": 0, 2024-09-12T02:49:27.316 INFO:teuthology.orchestra.run.smithi044.stdout: "avg_session_uptime": 683, 2024-09-12T02:49:27.316 INFO:teuthology.orchestra.run.smithi044.stdout: "mdthresh_evicted": 0 2024-09-12T02:49:27.316 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-09-12T02:49:27.316 INFO:teuthology.orchestra.run.smithi044.stdout: "mempool": { 2024-09-12T02:49:27.316 INFO:teuthology.orchestra.run.smithi044.stdout: "bloom_filter_bytes": 0, 2024-09-12T02:49:27.316 INFO:teuthology.orchestra.run.smithi044.stdout: "bloom_filter_items": 0, 2024-09-12T02:49:27.316 INFO:teuthology.orchestra.run.smithi044.stdout: "bluestore_alloc_bytes": 0, 2024-09-12T02:49:27.316 INFO:teuthology.orchestra.run.smithi044.stdout: "bluestore_alloc_items": 0, 2024-09-12T02:49:27.316 INFO:teuthology.orchestra.run.smithi044.stdout: "bluestore_cache_data_bytes": 0, 2024-09-12T02:49:27.316 INFO:teuthology.orchestra.run.smithi044.stdout: "bluestore_cache_data_items": 0, 2024-09-12T02:49:27.317 INFO:teuthology.orchestra.run.smithi044.stdout: "bluestore_cache_onode_bytes": 0, 2024-09-12T02:49:27.317 INFO:teuthology.orchestra.run.smithi044.stdout: "bluestore_cache_onode_items": 0, 2024-09-12T02:49:27.317 INFO:teuthology.orchestra.run.smithi044.stdout: "bluestore_cache_meta_bytes": 0, 2024-09-12T02:49:27.317 INFO:teuthology.orchestra.run.smithi044.stdout: "bluestore_cache_meta_items": 0, 2024-09-12T02:49:27.317 INFO:teuthology.orchestra.run.smithi044.stdout: "bluestore_cache_other_bytes": 0, 2024-09-12T02:49:27.317 INFO:teuthology.orchestra.run.smithi044.stdout: "bluestore_cache_other_items": 0, 2024-09-12T02:49:27.317 INFO:teuthology.orchestra.run.smithi044.stdout: "bluestore_cache_buffer_bytes": 0, 2024-09-12T02:49:27.317 INFO:teuthology.orchestra.run.smithi044.stdout: "bluestore_cache_buffer_items": 0, 2024-09-12T02:49:27.317 INFO:teuthology.orchestra.run.smithi044.stdout: "bluestore_extent_bytes": 0, 2024-09-12T02:49:27.317 INFO:teuthology.orchestra.run.smithi044.stdout: "bluestore_extent_items": 0, 2024-09-12T02:49:27.317 INFO:teuthology.orchestra.run.smithi044.stdout: "bluestore_blob_bytes": 0, 2024-09-12T02:49:27.317 INFO:teuthology.orchestra.run.smithi044.stdout: "bluestore_blob_items": 0, 2024-09-12T02:49:27.317 INFO:teuthology.orchestra.run.smithi044.stdout: "bluestore_shared_blob_bytes": 0, 2024-09-12T02:49:27.318 INFO:teuthology.orchestra.run.smithi044.stdout: "bluestore_shared_blob_items": 0, 2024-09-12T02:49:27.318 INFO:teuthology.orchestra.run.smithi044.stdout: "bluestore_inline_bl_bytes": 0, 2024-09-12T02:49:27.318 INFO:teuthology.orchestra.run.smithi044.stdout: "bluestore_inline_bl_items": 0, 2024-09-12T02:49:27.318 INFO:teuthology.orchestra.run.smithi044.stdout: "bluestore_fsck_bytes": 0, 2024-09-12T02:49:27.318 INFO:teuthology.orchestra.run.smithi044.stdout: "bluestore_fsck_items": 0, 2024-09-12T02:49:27.318 INFO:teuthology.orchestra.run.smithi044.stdout: "bluestore_txc_bytes": 0, 2024-09-12T02:49:27.318 INFO:teuthology.orchestra.run.smithi044.stdout: "bluestore_txc_items": 0, 2024-09-12T02:49:27.318 INFO:teuthology.orchestra.run.smithi044.stdout: "bluestore_writing_deferred_bytes": 0, 2024-09-12T02:49:27.318 INFO:teuthology.orchestra.run.smithi044.stdout: "bluestore_writing_deferred_items": 0, 2024-09-12T02:49:27.318 INFO:teuthology.orchestra.run.smithi044.stdout: "bluestore_writing_bytes": 0, 2024-09-12T02:49:27.318 INFO:teuthology.orchestra.run.smithi044.stdout: "bluestore_writing_items": 0, 2024-09-12T02:49:27.318 INFO:teuthology.orchestra.run.smithi044.stdout: "bluefs_bytes": 0, 2024-09-12T02:49:27.318 INFO:teuthology.orchestra.run.smithi044.stdout: "bluefs_items": 0, 2024-09-12T02:49:27.318 INFO:teuthology.orchestra.run.smithi044.stdout: "bluefs_file_reader_bytes": 0, 2024-09-12T02:49:27.319 INFO:teuthology.orchestra.run.smithi044.stdout: "bluefs_file_reader_items": 0, 2024-09-12T02:49:27.319 INFO:teuthology.orchestra.run.smithi044.stdout: "bluefs_file_writer_bytes": 0, 2024-09-12T02:49:27.319 INFO:teuthology.orchestra.run.smithi044.stdout: "bluefs_file_writer_items": 0, 2024-09-12T02:49:27.319 INFO:teuthology.orchestra.run.smithi044.stdout: "buffer_anon_bytes": 246759, 2024-09-12T02:49:27.319 INFO:teuthology.orchestra.run.smithi044.stdout: "buffer_anon_items": 77, 2024-09-12T02:49:27.319 INFO:teuthology.orchestra.run.smithi044.stdout: "buffer_meta_bytes": 0, 2024-09-12T02:49:27.319 INFO:teuthology.orchestra.run.smithi044.stdout: "buffer_meta_items": 0, 2024-09-12T02:49:27.319 INFO:teuthology.orchestra.run.smithi044.stdout: "osd_bytes": 0, 2024-09-12T02:49:27.319 INFO:teuthology.orchestra.run.smithi044.stdout: "osd_items": 0, 2024-09-12T02:49:27.319 INFO:teuthology.orchestra.run.smithi044.stdout: "osd_mapbl_bytes": 0, 2024-09-12T02:49:27.319 INFO:teuthology.orchestra.run.smithi044.stdout: "osd_mapbl_items": 0, 2024-09-12T02:49:27.319 INFO:teuthology.orchestra.run.smithi044.stdout: "osd_pglog_bytes": 0, 2024-09-12T02:49:27.319 INFO:teuthology.orchestra.run.smithi044.stdout: "osd_pglog_items": 0, 2024-09-12T02:49:27.319 INFO:teuthology.orchestra.run.smithi044.stdout: "osdmap_bytes": 9520, 2024-09-12T02:49:27.319 INFO:teuthology.orchestra.run.smithi044.stdout: "osdmap_items": 193, 2024-09-12T02:49:27.320 INFO:teuthology.orchestra.run.smithi044.stdout: "osdmap_mapping_bytes": 0, 2024-09-12T02:49:27.320 INFO:teuthology.orchestra.run.smithi044.stdout: "osdmap_mapping_items": 0, 2024-09-12T02:49:27.320 INFO:teuthology.orchestra.run.smithi044.stdout: "pgmap_bytes": 0, 2024-09-12T02:49:27.320 INFO:teuthology.orchestra.run.smithi044.stdout: "pgmap_items": 0, 2024-09-12T02:49:27.320 INFO:teuthology.orchestra.run.smithi044.stdout: "mds_co_bytes": 90773, 2024-09-12T02:49:27.320 INFO:teuthology.orchestra.run.smithi044.stdout: "mds_co_items": 335, 2024-09-12T02:49:27.320 INFO:teuthology.orchestra.run.smithi044.stdout: "unittest_1_bytes": 0, 2024-09-12T02:49:27.320 INFO:teuthology.orchestra.run.smithi044.stdout: "unittest_1_items": 0, 2024-09-12T02:49:27.320 INFO:teuthology.orchestra.run.smithi044.stdout: "unittest_2_bytes": 0, 2024-09-12T02:49:27.320 INFO:teuthology.orchestra.run.smithi044.stdout: "unittest_2_items": 0 2024-09-12T02:49:27.320 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-09-12T02:49:27.320 INFO:teuthology.orchestra.run.smithi044.stdout: "objecter": { 2024-09-12T02:49:27.320 INFO:teuthology.orchestra.run.smithi044.stdout: "op_active": 0, 2024-09-12T02:49:27.320 INFO:teuthology.orchestra.run.smithi044.stdout: "op_laggy": 0, 2024-09-12T02:49:27.321 INFO:teuthology.orchestra.run.smithi044.stdout: "op_send": 43, 2024-09-12T02:49:27.321 INFO:teuthology.orchestra.run.smithi044.stdout: "op_send_bytes": 12441, 2024-09-12T02:49:27.321 INFO:teuthology.orchestra.run.smithi044.stdout: "op_resend": 28, 2024-09-12T02:49:27.321 INFO:teuthology.orchestra.run.smithi044.stdout: "op_reply": 43, 2024-09-12T02:49:27.321 INFO:teuthology.orchestra.run.smithi044.stdout: "op_latency": { 2024-09-12T02:49:27.321 INFO:teuthology.orchestra.run.smithi044.stdout: "avgcount": 43, 2024-09-12T02:49:27.321 INFO:teuthology.orchestra.run.smithi044.stdout: "sum": 0.228996363, 2024-09-12T02:49:27.321 INFO:teuthology.orchestra.run.smithi044.stdout: "avgtime": 0.005325496 2024-09-12T02:49:27.321 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-09-12T02:49:27.321 INFO:teuthology.orchestra.run.smithi044.stdout: "op_inflight": 0, 2024-09-12T02:49:27.321 INFO:teuthology.orchestra.run.smithi044.stdout: "oplen_avg": { 2024-09-12T02:49:27.321 INFO:teuthology.orchestra.run.smithi044.stdout: "avgcount": 43, 2024-09-12T02:49:27.321 INFO:teuthology.orchestra.run.smithi044.stdout: "sum": 65 2024-09-12T02:49:27.321 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-09-12T02:49:27.322 INFO:teuthology.orchestra.run.smithi044.stdout: "op": 43, 2024-09-12T02:49:27.322 INFO:teuthology.orchestra.run.smithi044.stdout: "op_r": 0, 2024-09-12T02:49:27.322 INFO:teuthology.orchestra.run.smithi044.stdout: "op_w": 43, 2024-09-12T02:49:27.322 INFO:teuthology.orchestra.run.smithi044.stdout: "op_rmw": 0, 2024-09-12T02:49:27.322 INFO:teuthology.orchestra.run.smithi044.stdout: "op_pg": 0, 2024-09-12T02:49:27.322 INFO:teuthology.orchestra.run.smithi044.stdout: "osdop_stat": 0, 2024-09-12T02:49:27.322 INFO:teuthology.orchestra.run.smithi044.stdout: "osdop_create": 10, 2024-09-12T02:49:27.322 INFO:teuthology.orchestra.run.smithi044.stdout: "osdop_read": 0, 2024-09-12T02:49:27.322 INFO:teuthology.orchestra.run.smithi044.stdout: "osdop_write": 6, 2024-09-12T02:49:27.322 INFO:teuthology.orchestra.run.smithi044.stdout: "osdop_writefull": 8, 2024-09-12T02:49:27.322 INFO:teuthology.orchestra.run.smithi044.stdout: "osdop_writesame": 0, 2024-09-12T02:49:27.322 INFO:teuthology.orchestra.run.smithi044.stdout: "osdop_append": 0, 2024-09-12T02:49:27.322 INFO:teuthology.orchestra.run.smithi044.stdout: "osdop_zero": 0, 2024-09-12T02:49:27.322 INFO:teuthology.orchestra.run.smithi044.stdout: "osdop_truncate": 0, 2024-09-12T02:49:27.322 INFO:teuthology.orchestra.run.smithi044.stdout: "osdop_delete": 6, 2024-09-12T02:49:27.323 INFO:teuthology.orchestra.run.smithi044.stdout: "osdop_mapext": 0, 2024-09-12T02:49:27.323 INFO:teuthology.orchestra.run.smithi044.stdout: "osdop_sparse_read": 0, 2024-09-12T02:49:27.323 INFO:teuthology.orchestra.run.smithi044.stdout: "osdop_clonerange": 0, 2024-09-12T02:49:27.323 INFO:teuthology.orchestra.run.smithi044.stdout: "osdop_getxattr": 0, 2024-09-12T02:49:27.323 INFO:teuthology.orchestra.run.smithi044.stdout: "osdop_setxattr": 20, 2024-09-12T02:49:27.323 INFO:teuthology.orchestra.run.smithi044.stdout: "osdop_cmpxattr": 0, 2024-09-12T02:49:27.323 INFO:teuthology.orchestra.run.smithi044.stdout: "osdop_rmxattr": 0, 2024-09-12T02:49:27.323 INFO:teuthology.orchestra.run.smithi044.stdout: "osdop_resetxattrs": 0, 2024-09-12T02:49:27.323 INFO:teuthology.orchestra.run.smithi044.stdout: "osdop_call": 0, 2024-09-12T02:49:27.323 INFO:teuthology.orchestra.run.smithi044.stdout: "osdop_watch": 0, 2024-09-12T02:49:27.323 INFO:teuthology.orchestra.run.smithi044.stdout: "osdop_notify": 0, 2024-09-12T02:49:27.323 INFO:teuthology.orchestra.run.smithi044.stdout: "osdop_src_cmpxattr": 0, 2024-09-12T02:49:27.323 INFO:teuthology.orchestra.run.smithi044.stdout: "osdop_pgls": 0, 2024-09-12T02:49:27.323 INFO:teuthology.orchestra.run.smithi044.stdout: "osdop_pgls_filter": 0, 2024-09-12T02:49:27.324 INFO:teuthology.orchestra.run.smithi044.stdout: "osdop_other": 0, 2024-09-12T02:49:27.324 INFO:teuthology.orchestra.run.smithi044.stdout: "linger_active": 0, 2024-09-12T02:49:27.324 INFO:teuthology.orchestra.run.smithi044.stdout: "linger_send": 0, 2024-09-12T02:49:27.324 INFO:teuthology.orchestra.run.smithi044.stdout: "linger_resend": 0, 2024-09-12T02:49:27.324 INFO:teuthology.orchestra.run.smithi044.stdout: "linger_ping": 0, 2024-09-12T02:49:27.324 INFO:teuthology.orchestra.run.smithi044.stdout: "poolop_active": 0, 2024-09-12T02:49:27.324 INFO:teuthology.orchestra.run.smithi044.stdout: "poolop_send": 0, 2024-09-12T02:49:27.324 INFO:teuthology.orchestra.run.smithi044.stdout: "poolop_resend": 0, 2024-09-12T02:49:27.324 INFO:teuthology.orchestra.run.smithi044.stdout: "poolstat_active": 0, 2024-09-12T02:49:27.324 INFO:teuthology.orchestra.run.smithi044.stdout: "poolstat_send": 0, 2024-09-12T02:49:27.324 INFO:teuthology.orchestra.run.smithi044.stdout: "poolstat_resend": 0, 2024-09-12T02:49:27.324 INFO:teuthology.orchestra.run.smithi044.stdout: "statfs_active": 0, 2024-09-12T02:49:27.324 INFO:teuthology.orchestra.run.smithi044.stdout: "statfs_send": 0, 2024-09-12T02:49:27.324 INFO:teuthology.orchestra.run.smithi044.stdout: "statfs_resend": 0, 2024-09-12T02:49:27.325 INFO:teuthology.orchestra.run.smithi044.stdout: "command_active": 0, 2024-09-12T02:49:27.325 INFO:teuthology.orchestra.run.smithi044.stdout: "command_send": 0, 2024-09-12T02:49:27.325 INFO:teuthology.orchestra.run.smithi044.stdout: "command_resend": 0, 2024-09-12T02:49:27.325 INFO:teuthology.orchestra.run.smithi044.stdout: "map_epoch": 108, 2024-09-12T02:49:27.325 INFO:teuthology.orchestra.run.smithi044.stdout: "map_full": 0, 2024-09-12T02:49:27.325 INFO:teuthology.orchestra.run.smithi044.stdout: "map_inc": 15, 2024-09-12T02:49:27.325 INFO:teuthology.orchestra.run.smithi044.stdout: "osd_sessions": 9, 2024-09-12T02:49:27.325 INFO:teuthology.orchestra.run.smithi044.stdout: "osd_session_open": 9, 2024-09-12T02:49:27.325 INFO:teuthology.orchestra.run.smithi044.stdout: "osd_session_close": 0, 2024-09-12T02:49:27.325 INFO:teuthology.orchestra.run.smithi044.stdout: "osd_laggy": 0, 2024-09-12T02:49:27.325 INFO:teuthology.orchestra.run.smithi044.stdout: "omap_wr": 14, 2024-09-12T02:49:27.325 INFO:teuthology.orchestra.run.smithi044.stdout: "omap_rd": 0, 2024-09-12T02:49:27.326 INFO:teuthology.orchestra.run.smithi044.stdout: "omap_del": 1 2024-09-12T02:49:27.326 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-09-12T02:49:27.326 INFO:teuthology.orchestra.run.smithi044.stdout: "oft": { 2024-09-12T02:49:27.326 INFO:teuthology.orchestra.run.smithi044.stdout: "omap_total_objs": 1, 2024-09-12T02:49:27.326 INFO:teuthology.orchestra.run.smithi044.stdout: "omap_total_kv_pairs": 0, 2024-09-12T02:49:27.326 INFO:teuthology.orchestra.run.smithi044.stdout: "omap_total_updates": 0, 2024-09-12T02:49:27.326 INFO:teuthology.orchestra.run.smithi044.stdout: "omap_total_removes": 0 2024-09-12T02:49:27.326 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-09-12T02:49:27.326 INFO:teuthology.orchestra.run.smithi044.stdout: "osd-slow-ops": { 2024-09-12T02:49:27.326 INFO:teuthology.orchestra.run.smithi044.stdout: "slow_ops_count": 0 2024-09-12T02:49:27.326 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-09-12T02:49:27.326 INFO:teuthology.orchestra.run.smithi044.stdout: "purge_queue": { 2024-09-12T02:49:27.326 INFO:teuthology.orchestra.run.smithi044.stdout: "pq_executing_ops": 0, 2024-09-12T02:49:27.327 INFO:teuthology.orchestra.run.smithi044.stdout: "pq_executing_ops_high_water": 0, 2024-09-12T02:49:27.327 INFO:teuthology.orchestra.run.smithi044.stdout: "pq_executing": 0, 2024-09-12T02:49:27.327 INFO:teuthology.orchestra.run.smithi044.stdout: "pq_executing_high_water": 0, 2024-09-12T02:49:27.327 INFO:teuthology.orchestra.run.smithi044.stdout: "pq_executed_ops": 0, 2024-09-12T02:49:27.327 INFO:teuthology.orchestra.run.smithi044.stdout: "pq_executed": 0, 2024-09-12T02:49:27.327 INFO:teuthology.orchestra.run.smithi044.stdout: "pq_item_in_journal": 0 2024-09-12T02:49:27.327 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-09-12T02:49:27.327 INFO:teuthology.orchestra.run.smithi044.stdout: "throttle-msgr_dispatch_throttler-mds": { 2024-09-12T02:49:27.327 INFO:teuthology.orchestra.run.smithi044.stdout: "val": 0, 2024-09-12T02:49:27.327 INFO:teuthology.orchestra.run.smithi044.stdout: "max": 104857600, 2024-09-12T02:49:27.327 INFO:teuthology.orchestra.run.smithi044.stdout: "get_started": 0, 2024-09-12T02:49:27.327 INFO:teuthology.orchestra.run.smithi044.stdout: "get": 1137, 2024-09-12T02:49:27.327 INFO:teuthology.orchestra.run.smithi044.stdout: "get_sum": 1922415, 2024-09-12T02:49:27.327 INFO:teuthology.orchestra.run.smithi044.stdout: "get_or_fail_fail": 0, 2024-09-12T02:49:27.327 INFO:teuthology.orchestra.run.smithi044.stdout: "get_or_fail_success": 1137, 2024-09-12T02:49:27.327 INFO:teuthology.orchestra.run.smithi044.stdout: "take": 0, 2024-09-12T02:49:27.328 INFO:teuthology.orchestra.run.smithi044.stdout: "take_sum": 0, 2024-09-12T02:49:27.328 INFO:teuthology.orchestra.run.smithi044.stdout: "put": 1137, 2024-09-12T02:49:27.328 INFO:teuthology.orchestra.run.smithi044.stdout: "put_sum": 1922415, 2024-09-12T02:49:27.328 INFO:teuthology.orchestra.run.smithi044.stdout: "wait": { 2024-09-12T02:49:27.328 INFO:teuthology.orchestra.run.smithi044.stdout: "avgcount": 0, 2024-09-12T02:49:27.328 INFO:teuthology.orchestra.run.smithi044.stdout: "sum": 0.000000000, 2024-09-12T02:49:27.328 INFO:teuthology.orchestra.run.smithi044.stdout: "avgtime": 0.000000000 2024-09-12T02:49:27.328 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-09-12T02:49:27.328 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-09-12T02:49:27.328 INFO:teuthology.orchestra.run.smithi044.stdout: "throttle-objecter_bytes": { 2024-09-12T02:49:27.328 INFO:teuthology.orchestra.run.smithi044.stdout: "val": 0, 2024-09-12T02:49:27.328 INFO:teuthology.orchestra.run.smithi044.stdout: "max": 104857600, 2024-09-12T02:49:27.328 INFO:teuthology.orchestra.run.smithi044.stdout: "get_started": 0, 2024-09-12T02:49:27.328 INFO:teuthology.orchestra.run.smithi044.stdout: "get": 0, 2024-09-12T02:49:27.328 INFO:teuthology.orchestra.run.smithi044.stdout: "get_sum": 0, 2024-09-12T02:49:27.329 INFO:teuthology.orchestra.run.smithi044.stdout: "get_or_fail_fail": 0, 2024-09-12T02:49:27.329 INFO:teuthology.orchestra.run.smithi044.stdout: "get_or_fail_success": 0, 2024-09-12T02:49:27.329 INFO:teuthology.orchestra.run.smithi044.stdout: "take": 43, 2024-09-12T02:49:27.329 INFO:teuthology.orchestra.run.smithi044.stdout: "take_sum": 12441, 2024-09-12T02:49:27.329 INFO:teuthology.orchestra.run.smithi044.stdout: "put": 43, 2024-09-12T02:49:27.329 INFO:teuthology.orchestra.run.smithi044.stdout: "put_sum": 12441, 2024-09-12T02:49:27.329 INFO:teuthology.orchestra.run.smithi044.stdout: "wait": { 2024-09-12T02:49:27.329 INFO:teuthology.orchestra.run.smithi044.stdout: "avgcount": 0, 2024-09-12T02:49:27.329 INFO:teuthology.orchestra.run.smithi044.stdout: "sum": 0.000000000, 2024-09-12T02:49:27.329 INFO:teuthology.orchestra.run.smithi044.stdout: "avgtime": 0.000000000 2024-09-12T02:49:27.329 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-09-12T02:49:27.329 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-09-12T02:49:27.329 INFO:teuthology.orchestra.run.smithi044.stdout: "throttle-objecter_ops": { 2024-09-12T02:49:27.329 INFO:teuthology.orchestra.run.smithi044.stdout: "val": 0, 2024-09-12T02:49:27.330 INFO:teuthology.orchestra.run.smithi044.stdout: "max": 1024, 2024-09-12T02:49:27.330 INFO:teuthology.orchestra.run.smithi044.stdout: "get_started": 0, 2024-09-12T02:49:27.330 INFO:teuthology.orchestra.run.smithi044.stdout: "get": 0, 2024-09-12T02:49:27.330 INFO:teuthology.orchestra.run.smithi044.stdout: "get_sum": 0, 2024-09-12T02:49:27.330 INFO:teuthology.orchestra.run.smithi044.stdout: "get_or_fail_fail": 0, 2024-09-12T02:49:27.330 INFO:teuthology.orchestra.run.smithi044.stdout: "get_or_fail_success": 0, 2024-09-12T02:49:27.330 INFO:teuthology.orchestra.run.smithi044.stdout: "take": 43, 2024-09-12T02:49:27.330 INFO:teuthology.orchestra.run.smithi044.stdout: "take_sum": 43, 2024-09-12T02:49:27.330 INFO:teuthology.orchestra.run.smithi044.stdout: "put": 43, 2024-09-12T02:49:27.330 INFO:teuthology.orchestra.run.smithi044.stdout: "put_sum": 43, 2024-09-12T02:49:27.330 INFO:teuthology.orchestra.run.smithi044.stdout: "wait": { 2024-09-12T02:49:27.330 INFO:teuthology.orchestra.run.smithi044.stdout: "avgcount": 0, 2024-09-12T02:49:27.330 INFO:teuthology.orchestra.run.smithi044.stdout: "sum": 0.000000000, 2024-09-12T02:49:27.331 INFO:teuthology.orchestra.run.smithi044.stdout: "avgtime": 0.000000000 2024-09-12T02:49:27.331 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-09-12T02:49:27.331 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-09-12T02:49:27.331 INFO:teuthology.orchestra.run.smithi044.stdout: "throttle-write_buf_throttle": { 2024-09-12T02:49:27.331 INFO:teuthology.orchestra.run.smithi044.stdout: "val": 0, 2024-09-12T02:49:27.331 INFO:teuthology.orchestra.run.smithi044.stdout: "max": 3758096384, 2024-09-12T02:49:27.331 INFO:teuthology.orchestra.run.smithi044.stdout: "get_started": 0, 2024-09-12T02:49:27.331 INFO:teuthology.orchestra.run.smithi044.stdout: "get": 0, 2024-09-12T02:49:27.331 INFO:teuthology.orchestra.run.smithi044.stdout: "get_sum": 0, 2024-09-12T02:49:27.331 INFO:teuthology.orchestra.run.smithi044.stdout: "get_or_fail_fail": 0, 2024-09-12T02:49:27.331 INFO:teuthology.orchestra.run.smithi044.stdout: "get_or_fail_success": 0, 2024-09-12T02:49:27.331 INFO:teuthology.orchestra.run.smithi044.stdout: "take": 0, 2024-09-12T02:49:27.331 INFO:teuthology.orchestra.run.smithi044.stdout: "take_sum": 0, 2024-09-12T02:49:27.331 INFO:teuthology.orchestra.run.smithi044.stdout: "put": 0, 2024-09-12T02:49:27.332 INFO:teuthology.orchestra.run.smithi044.stdout: "put_sum": 0, 2024-09-12T02:49:27.332 INFO:teuthology.orchestra.run.smithi044.stdout: "wait": { 2024-09-12T02:49:27.332 INFO:teuthology.orchestra.run.smithi044.stdout: "avgcount": 0, 2024-09-12T02:49:27.332 INFO:teuthology.orchestra.run.smithi044.stdout: "sum": 0.000000000, 2024-09-12T02:49:27.332 INFO:teuthology.orchestra.run.smithi044.stdout: "avgtime": 0.000000000 2024-09-12T02:49:27.332 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-09-12T02:49:27.332 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-09-12T02:49:27.332 INFO:teuthology.orchestra.run.smithi044.stdout: "throttle-write_buf_throttle-0x559ac1816960": { 2024-09-12T02:49:27.332 INFO:teuthology.orchestra.run.smithi044.stdout: "val": 0, 2024-09-12T02:49:27.332 INFO:teuthology.orchestra.run.smithi044.stdout: "max": 3758096384, 2024-09-12T02:49:27.332 INFO:teuthology.orchestra.run.smithi044.stdout: "get_started": 0, 2024-09-12T02:49:27.332 INFO:teuthology.orchestra.run.smithi044.stdout: "get": 7, 2024-09-12T02:49:27.332 INFO:teuthology.orchestra.run.smithi044.stdout: "get_sum": 2049, 2024-09-12T02:49:27.333 INFO:teuthology.orchestra.run.smithi044.stdout: "get_or_fail_fail": 0, 2024-09-12T02:49:27.333 INFO:teuthology.orchestra.run.smithi044.stdout: "get_or_fail_success": 7, 2024-09-12T02:49:27.333 INFO:teuthology.orchestra.run.smithi044.stdout: "take": 0, 2024-09-12T02:49:27.333 INFO:teuthology.orchestra.run.smithi044.stdout: "take_sum": 0, 2024-09-12T02:49:27.333 INFO:teuthology.orchestra.run.smithi044.stdout: "put": 6, 2024-09-12T02:49:27.333 INFO:teuthology.orchestra.run.smithi044.stdout: "put_sum": 2049, 2024-09-12T02:49:27.333 INFO:teuthology.orchestra.run.smithi044.stdout: "wait": { 2024-09-12T02:49:27.333 INFO:teuthology.orchestra.run.smithi044.stdout: "avgcount": 0, 2024-09-12T02:49:27.333 INFO:teuthology.orchestra.run.smithi044.stdout: "sum": 0.000000000, 2024-09-12T02:49:27.333 INFO:teuthology.orchestra.run.smithi044.stdout: "avgtime": 0.000000000 2024-09-12T02:49:27.333 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-09-12T02:49:27.333 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-09-12T02:49:27.333 INFO:teuthology.orchestra.run.smithi044.stdout:} 2024-09-12T02:49:27.995 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 12 02:49:27 smithi044 ceph-mon[35411]: pgmap v360: 129 pgs: 129 active+clean; 24 MiB data, 490 MiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 9.0 KiB/s wr, 9 op/s 2024-09-12T02:49:28.013 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 12 02:49:27 smithi172 ceph-mon[35609]: pgmap v360: 129 pgs: 129 active+clean; 24 MiB data, 490 MiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 9.0 KiB/s wr, 9 op/s 2024-09-12T02:49:28.023 INFO:tasks.check_counter:Daemon mds.h mds.exported=0 2024-09-12T02:49:28.023 INFO:tasks.check_counter:Daemon mds.h mds.imported=0 2024-09-12T02:49:28.023 INFO:tasks.check_counter:Daemon mds.h mds_cache.dir_update=0 2024-09-12T02:49:28.023 INFO:tasks.check_counter:Daemon mds.h mds_cache.dir_update_receipt=11 2024-09-12T02:49:28.024 INFO:tasks.check_counter:Daemon mds.h mds.root_rsnaps=6 2024-09-12T02:49:28.024 INFO:tasks.check_counter:Daemon mds.h mds_server.req_mksnap_latency.avgcount=0 2024-09-12T02:49:28.024 INFO:tasks.check_counter:Daemon mds.h mds_server.req_rmsnap_latency.avgcount=0 2024-09-12T02:49:28.024 DEBUG:tasks.check_counter:Getting stats from k 2024-09-12T02:49:28.024 DEBUG:teuthology.orchestra.run.smithi044:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc shell --fsid 4954ed46-70ae-11ef-bcea-c7b262605968 -- ceph daemon mds.k perf dump 2024-09-12T02:49:28.099 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 02:49:27 smithi039 ceph-mon[30515]: pgmap v360: 129 pgs: 129 active+clean; 24 MiB data, 490 MiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 9.0 KiB/s wr, 9 op/s 2024-09-12T02:49:28.276 INFO:teuthology.orchestra.run.smithi044.stderr:Inferring config /var/lib/ceph/4954ed46-70ae-11ef-bcea-c7b262605968/mon.b/config 2024-09-12T02:49:28.854 INFO:teuthology.orchestra.run.smithi044.stdout:{ 2024-09-12T02:49:28.854 INFO:teuthology.orchestra.run.smithi044.stdout: "AsyncMessenger::Worker-0": { 2024-09-12T02:49:28.854 INFO:teuthology.orchestra.run.smithi044.stdout: "msgr_recv_messages": 1094, 2024-09-12T02:49:28.854 INFO:teuthology.orchestra.run.smithi044.stdout: "msgr_send_messages": 1080, 2024-09-12T02:49:28.854 INFO:teuthology.orchestra.run.smithi044.stdout: "msgr_recv_bytes": 2045280, 2024-09-12T02:49:28.854 INFO:teuthology.orchestra.run.smithi044.stdout: "msgr_send_bytes": 413120, 2024-09-12T02:49:28.854 INFO:teuthology.orchestra.run.smithi044.stdout: "msgr_created_connections": 5, 2024-09-12T02:49:28.854 INFO:teuthology.orchestra.run.smithi044.stdout: "msgr_active_connections": 1, 2024-09-12T02:49:28.854 INFO:teuthology.orchestra.run.smithi044.stdout: "msgr_running_total_time": 0.144393047, 2024-09-12T02:49:28.855 INFO:teuthology.orchestra.run.smithi044.stdout: "msgr_running_send_time": 0.056741822, 2024-09-12T02:49:28.855 INFO:teuthology.orchestra.run.smithi044.stdout: "msgr_running_recv_time": 0.070215374, 2024-09-12T02:49:28.855 INFO:teuthology.orchestra.run.smithi044.stdout: "msgr_running_fast_dispatch_time": 0.023875727, 2024-09-12T02:49:28.855 INFO:teuthology.orchestra.run.smithi044.stdout: "msgr_send_messages_queue_lat": { 2024-09-12T02:49:28.855 INFO:teuthology.orchestra.run.smithi044.stdout: "avgcount": 1079, 2024-09-12T02:49:28.855 INFO:teuthology.orchestra.run.smithi044.stdout: "sum": 0.061825632, 2024-09-12T02:49:28.855 INFO:teuthology.orchestra.run.smithi044.stdout: "avgtime": 0.000057299 2024-09-12T02:49:28.855 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-09-12T02:49:28.855 INFO:teuthology.orchestra.run.smithi044.stdout: "msgr_handle_ack_lat": { 2024-09-12T02:49:28.855 INFO:teuthology.orchestra.run.smithi044.stdout: "avgcount": 0, 2024-09-12T02:49:28.855 INFO:teuthology.orchestra.run.smithi044.stdout: "sum": 0.000000000, 2024-09-12T02:49:28.856 INFO:teuthology.orchestra.run.smithi044.stdout: "avgtime": 0.000000000 2024-09-12T02:49:28.856 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-09-12T02:49:28.856 INFO:teuthology.orchestra.run.smithi044.stdout: "msgr_recv_encrypted_bytes": 1771104, 2024-09-12T02:49:28.856 INFO:teuthology.orchestra.run.smithi044.stdout: "msgr_send_encrypted_bytes": 153632 2024-09-12T02:49:28.856 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-09-12T02:49:28.856 INFO:teuthology.orchestra.run.smithi044.stdout: "AsyncMessenger::Worker-1": { 2024-09-12T02:49:28.856 INFO:teuthology.orchestra.run.smithi044.stdout: "msgr_recv_messages": 9, 2024-09-12T02:49:28.856 INFO:teuthology.orchestra.run.smithi044.stdout: "msgr_send_messages": 191, 2024-09-12T02:49:28.856 INFO:teuthology.orchestra.run.smithi044.stdout: "msgr_recv_bytes": 4782, 2024-09-12T02:49:28.856 INFO:teuthology.orchestra.run.smithi044.stdout: "msgr_send_bytes": 471918, 2024-09-12T02:49:28.856 INFO:teuthology.orchestra.run.smithi044.stdout: "msgr_created_connections": 7, 2024-09-12T02:49:28.857 INFO:teuthology.orchestra.run.smithi044.stdout: "msgr_active_connections": 5, 2024-09-12T02:49:28.857 INFO:teuthology.orchestra.run.smithi044.stdout: "msgr_running_total_time": 0.014029543, 2024-09-12T02:49:28.857 INFO:teuthology.orchestra.run.smithi044.stdout: "msgr_running_send_time": 0.007634645, 2024-09-12T02:49:28.857 INFO:teuthology.orchestra.run.smithi044.stdout: "msgr_running_recv_time": 0.004047567, 2024-09-12T02:49:28.857 INFO:teuthology.orchestra.run.smithi044.stdout: "msgr_running_fast_dispatch_time": 0.000067685, 2024-09-12T02:49:28.857 INFO:teuthology.orchestra.run.smithi044.stdout: "msgr_send_messages_queue_lat": { 2024-09-12T02:49:28.857 INFO:teuthology.orchestra.run.smithi044.stdout: "avgcount": 189, 2024-09-12T02:49:28.857 INFO:teuthology.orchestra.run.smithi044.stdout: "sum": 0.028010459, 2024-09-12T02:49:28.857 INFO:teuthology.orchestra.run.smithi044.stdout: "avgtime": 0.000148203 2024-09-12T02:49:28.857 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-09-12T02:49:28.857 INFO:teuthology.orchestra.run.smithi044.stdout: "msgr_handle_ack_lat": { 2024-09-12T02:49:28.858 INFO:teuthology.orchestra.run.smithi044.stdout: "avgcount": 0, 2024-09-12T02:49:28.858 INFO:teuthology.orchestra.run.smithi044.stdout: "sum": 0.000000000, 2024-09-12T02:49:28.858 INFO:teuthology.orchestra.run.smithi044.stdout: "avgtime": 0.000000000 2024-09-12T02:49:28.858 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-09-12T02:49:28.858 INFO:teuthology.orchestra.run.smithi044.stdout: "msgr_recv_encrypted_bytes": 3392, 2024-09-12T02:49:28.858 INFO:teuthology.orchestra.run.smithi044.stdout: "msgr_send_encrypted_bytes": 470896 2024-09-12T02:49:28.858 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-09-12T02:49:28.858 INFO:teuthology.orchestra.run.smithi044.stdout: "AsyncMessenger::Worker-2": { 2024-09-12T02:49:28.858 INFO:teuthology.orchestra.run.smithi044.stdout: "msgr_recv_messages": 1557, 2024-09-12T02:49:28.858 INFO:teuthology.orchestra.run.smithi044.stdout: "msgr_send_messages": 1559, 2024-09-12T02:49:28.858 INFO:teuthology.orchestra.run.smithi044.stdout: "msgr_recv_bytes": 398184, 2024-09-12T02:49:28.859 INFO:teuthology.orchestra.run.smithi044.stdout: "msgr_send_bytes": 495127, 2024-09-12T02:49:28.859 INFO:teuthology.orchestra.run.smithi044.stdout: "msgr_created_connections": 5, 2024-09-12T02:49:28.859 INFO:teuthology.orchestra.run.smithi044.stdout: "msgr_active_connections": 4, 2024-09-12T02:49:28.859 INFO:teuthology.orchestra.run.smithi044.stdout: "msgr_running_total_time": 0.103172458, 2024-09-12T02:49:28.859 INFO:teuthology.orchestra.run.smithi044.stdout: "msgr_running_send_time": 0.028175469, 2024-09-12T02:49:28.859 INFO:teuthology.orchestra.run.smithi044.stdout: "msgr_running_recv_time": 0.027852382, 2024-09-12T02:49:28.860 INFO:teuthology.orchestra.run.smithi044.stdout: "msgr_running_fast_dispatch_time": 0.039325394, 2024-09-12T02:49:28.860 INFO:teuthology.orchestra.run.smithi044.stdout: "msgr_send_messages_queue_lat": { 2024-09-12T02:49:28.860 INFO:teuthology.orchestra.run.smithi044.stdout: "avgcount": 1557, 2024-09-12T02:49:28.860 INFO:teuthology.orchestra.run.smithi044.stdout: "sum": 0.051276594, 2024-09-12T02:49:28.860 INFO:teuthology.orchestra.run.smithi044.stdout: "avgtime": 0.000032932 2024-09-12T02:49:28.860 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-09-12T02:49:28.860 INFO:teuthology.orchestra.run.smithi044.stdout: "msgr_handle_ack_lat": { 2024-09-12T02:49:28.860 INFO:teuthology.orchestra.run.smithi044.stdout: "avgcount": 0, 2024-09-12T02:49:28.860 INFO:teuthology.orchestra.run.smithi044.stdout: "sum": 0.000000000, 2024-09-12T02:49:28.860 INFO:teuthology.orchestra.run.smithi044.stdout: "avgtime": 0.000000000 2024-09-12T02:49:28.861 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-09-12T02:49:28.861 INFO:teuthology.orchestra.run.smithi044.stdout: "msgr_recv_encrypted_bytes": 0, 2024-09-12T02:49:28.861 INFO:teuthology.orchestra.run.smithi044.stdout: "msgr_send_encrypted_bytes": 0 2024-09-12T02:49:28.861 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-09-12T02:49:28.861 INFO:teuthology.orchestra.run.smithi044.stdout: "cct": { 2024-09-12T02:49:28.861 INFO:teuthology.orchestra.run.smithi044.stdout: "total_workers": 1, 2024-09-12T02:49:28.861 INFO:teuthology.orchestra.run.smithi044.stdout: "unhealthy_workers": 0 2024-09-12T02:49:28.861 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-09-12T02:49:28.861 INFO:teuthology.orchestra.run.smithi044.stdout: "finisher-MDSRank": { 2024-09-12T02:49:28.861 INFO:teuthology.orchestra.run.smithi044.stdout: "queue_len": 0, 2024-09-12T02:49:28.861 INFO:teuthology.orchestra.run.smithi044.stdout: "complete_latency": { 2024-09-12T02:49:28.862 INFO:teuthology.orchestra.run.smithi044.stdout: "avgcount": 3924, 2024-09-12T02:49:28.862 INFO:teuthology.orchestra.run.smithi044.stdout: "sum": 0.099255163, 2024-09-12T02:49:28.862 INFO:teuthology.orchestra.run.smithi044.stdout: "avgtime": 0.000025294 2024-09-12T02:49:28.862 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-09-12T02:49:28.862 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-09-12T02:49:28.862 INFO:teuthology.orchestra.run.smithi044.stdout: "finisher-PurgeQueue": { 2024-09-12T02:49:28.862 INFO:teuthology.orchestra.run.smithi044.stdout: "queue_len": 0, 2024-09-12T02:49:28.862 INFO:teuthology.orchestra.run.smithi044.stdout: "complete_latency": { 2024-09-12T02:49:28.862 INFO:teuthology.orchestra.run.smithi044.stdout: "avgcount": 0, 2024-09-12T02:49:28.862 INFO:teuthology.orchestra.run.smithi044.stdout: "sum": 0.000000000, 2024-09-12T02:49:28.862 INFO:teuthology.orchestra.run.smithi044.stdout: "avgtime": 0.000000000 2024-09-12T02:49:28.863 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-09-12T02:49:28.863 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-09-12T02:49:28.863 INFO:teuthology.orchestra.run.smithi044.stdout: "mds": { 2024-09-12T02:49:28.863 INFO:teuthology.orchestra.run.smithi044.stdout: "request": 0, 2024-09-12T02:49:28.863 INFO:teuthology.orchestra.run.smithi044.stdout: "reply": 0, 2024-09-12T02:49:28.863 INFO:teuthology.orchestra.run.smithi044.stdout: "reply_latency": { 2024-09-12T02:49:28.863 INFO:teuthology.orchestra.run.smithi044.stdout: "avgcount": 0, 2024-09-12T02:49:28.863 INFO:teuthology.orchestra.run.smithi044.stdout: "sum": 0.000000000, 2024-09-12T02:49:28.863 INFO:teuthology.orchestra.run.smithi044.stdout: "avgtime": 0.000000000 2024-09-12T02:49:28.864 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-09-12T02:49:28.864 INFO:teuthology.orchestra.run.smithi044.stdout: "slow_reply": 0, 2024-09-12T02:49:28.864 INFO:teuthology.orchestra.run.smithi044.stdout: "forward": 0, 2024-09-12T02:49:28.864 INFO:teuthology.orchestra.run.smithi044.stdout: "dir_fetch_complete": 0, 2024-09-12T02:49:28.864 INFO:teuthology.orchestra.run.smithi044.stdout: "dir_fetch_keys": 0, 2024-09-12T02:49:28.864 INFO:teuthology.orchestra.run.smithi044.stdout: "dir_commit": 0, 2024-09-12T02:49:28.864 INFO:teuthology.orchestra.run.smithi044.stdout: "dir_split": 0, 2024-09-12T02:49:28.864 INFO:teuthology.orchestra.run.smithi044.stdout: "dir_merge": 0, 2024-09-12T02:49:28.864 INFO:teuthology.orchestra.run.smithi044.stdout: "inodes": 0, 2024-09-12T02:49:28.864 INFO:teuthology.orchestra.run.smithi044.stdout: "inodes_top": 0, 2024-09-12T02:49:28.865 INFO:teuthology.orchestra.run.smithi044.stdout: "inodes_bottom": 0, 2024-09-12T02:49:28.865 INFO:teuthology.orchestra.run.smithi044.stdout: "inodes_pin_tail": 0, 2024-09-12T02:49:28.865 INFO:teuthology.orchestra.run.smithi044.stdout: "inodes_pinned": 0, 2024-09-12T02:49:28.865 INFO:teuthology.orchestra.run.smithi044.stdout: "inodes_expired": 0, 2024-09-12T02:49:28.865 INFO:teuthology.orchestra.run.smithi044.stdout: "inodes_with_caps": 0, 2024-09-12T02:49:28.865 INFO:teuthology.orchestra.run.smithi044.stdout: "caps": 0, 2024-09-12T02:49:28.865 INFO:teuthology.orchestra.run.smithi044.stdout: "subtrees": 1, 2024-09-12T02:49:28.865 INFO:teuthology.orchestra.run.smithi044.stdout: "traverse": 0, 2024-09-12T02:49:28.865 INFO:teuthology.orchestra.run.smithi044.stdout: "traverse_hit": 0, 2024-09-12T02:49:28.865 INFO:teuthology.orchestra.run.smithi044.stdout: "traverse_forward": 0, 2024-09-12T02:49:28.865 INFO:teuthology.orchestra.run.smithi044.stdout: "traverse_discover": 0, 2024-09-12T02:49:28.866 INFO:teuthology.orchestra.run.smithi044.stdout: "traverse_dir_fetch": 0, 2024-09-12T02:49:28.866 INFO:teuthology.orchestra.run.smithi044.stdout: "traverse_remote_ino": 0, 2024-09-12T02:49:28.866 INFO:teuthology.orchestra.run.smithi044.stdout: "traverse_lock": 0, 2024-09-12T02:49:28.866 INFO:teuthology.orchestra.run.smithi044.stdout: "load_cent": 0, 2024-09-12T02:49:28.866 INFO:teuthology.orchestra.run.smithi044.stdout: "q": 0, 2024-09-12T02:49:28.866 INFO:teuthology.orchestra.run.smithi044.stdout: "exported": 0, 2024-09-12T02:49:28.866 INFO:teuthology.orchestra.run.smithi044.stdout: "exported_inodes": 0, 2024-09-12T02:49:28.866 INFO:teuthology.orchestra.run.smithi044.stdout: "imported": 0, 2024-09-12T02:49:28.866 INFO:teuthology.orchestra.run.smithi044.stdout: "imported_inodes": 0, 2024-09-12T02:49:28.866 INFO:teuthology.orchestra.run.smithi044.stdout: "openino_dir_fetch": 0, 2024-09-12T02:49:28.866 INFO:teuthology.orchestra.run.smithi044.stdout: "openino_backtrace_fetch": 0, 2024-09-12T02:49:28.867 INFO:teuthology.orchestra.run.smithi044.stdout: "openino_peer_discover": 0, 2024-09-12T02:49:28.867 INFO:teuthology.orchestra.run.smithi044.stdout: "root_rfiles": 0, 2024-09-12T02:49:28.867 INFO:teuthology.orchestra.run.smithi044.stdout: "root_rbytes": 0, 2024-09-12T02:49:28.867 INFO:teuthology.orchestra.run.smithi044.stdout: "root_rsnaps": 0, 2024-09-12T02:49:28.867 INFO:teuthology.orchestra.run.smithi044.stdout: "scrub_backtrace_fetch": 0, 2024-09-12T02:49:28.867 INFO:teuthology.orchestra.run.smithi044.stdout: "scrub_set_tag": 0, 2024-09-12T02:49:28.867 INFO:teuthology.orchestra.run.smithi044.stdout: "scrub_backtrace_repaired": 0, 2024-09-12T02:49:28.867 INFO:teuthology.orchestra.run.smithi044.stdout: "scrub_inotable_repaired": 0, 2024-09-12T02:49:28.867 INFO:teuthology.orchestra.run.smithi044.stdout: "scrub_dir_inodes": 0, 2024-09-12T02:49:28.867 INFO:teuthology.orchestra.run.smithi044.stdout: "scrub_dir_base_inodes": 0, 2024-09-12T02:49:28.867 INFO:teuthology.orchestra.run.smithi044.stdout: "scrub_dirfrag_rstats": 0, 2024-09-12T02:49:28.868 INFO:teuthology.orchestra.run.smithi044.stdout: "scrub_file_inodes": 0, 2024-09-12T02:49:28.868 INFO:teuthology.orchestra.run.smithi044.stdout: "handle_inode_file_caps": 0, 2024-09-12T02:49:28.868 INFO:teuthology.orchestra.run.smithi044.stdout: "ceph_cap_op_revoke": 0, 2024-09-12T02:49:28.868 INFO:teuthology.orchestra.run.smithi044.stdout: "ceph_cap_op_grant": 0, 2024-09-12T02:49:28.868 INFO:teuthology.orchestra.run.smithi044.stdout: "ceph_cap_op_trunc": 0, 2024-09-12T02:49:28.868 INFO:teuthology.orchestra.run.smithi044.stdout: "ceph_cap_op_flushsnap_ack": 0, 2024-09-12T02:49:28.868 INFO:teuthology.orchestra.run.smithi044.stdout: "ceph_cap_op_flush_ack": 0, 2024-09-12T02:49:28.868 INFO:teuthology.orchestra.run.smithi044.stdout: "handle_client_caps": 0, 2024-09-12T02:49:28.869 INFO:teuthology.orchestra.run.smithi044.stdout: "handle_client_caps_dirty": 0, 2024-09-12T02:49:28.869 INFO:teuthology.orchestra.run.smithi044.stdout: "handle_client_cap_release": 0, 2024-09-12T02:49:28.869 INFO:teuthology.orchestra.run.smithi044.stdout: "process_request_cap_release": 0 2024-09-12T02:49:28.869 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-09-12T02:49:28.869 INFO:teuthology.orchestra.run.smithi044.stdout: "mds_cache": { 2024-09-12T02:49:28.869 INFO:teuthology.orchestra.run.smithi044.stdout: "dir_update": 0, 2024-09-12T02:49:28.869 INFO:teuthology.orchestra.run.smithi044.stdout: "dir_update_receipt": 0, 2024-09-12T02:49:28.869 INFO:teuthology.orchestra.run.smithi044.stdout: "dir_try_discover": 0, 2024-09-12T02:49:28.869 INFO:teuthology.orchestra.run.smithi044.stdout: "dir_send_discover": 0, 2024-09-12T02:49:28.869 INFO:teuthology.orchestra.run.smithi044.stdout: "dir_handle_discover": 0, 2024-09-12T02:49:28.869 INFO:teuthology.orchestra.run.smithi044.stdout: "num_strays": 0, 2024-09-12T02:49:28.870 INFO:teuthology.orchestra.run.smithi044.stdout: "num_strays_delayed": 0, 2024-09-12T02:49:28.870 INFO:teuthology.orchestra.run.smithi044.stdout: "num_strays_enqueuing": 0, 2024-09-12T02:49:28.870 INFO:teuthology.orchestra.run.smithi044.stdout: "strays_created": 0, 2024-09-12T02:49:28.870 INFO:teuthology.orchestra.run.smithi044.stdout: "strays_enqueued": 0, 2024-09-12T02:49:28.870 INFO:teuthology.orchestra.run.smithi044.stdout: "strays_reintegrated": 0, 2024-09-12T02:49:28.870 INFO:teuthology.orchestra.run.smithi044.stdout: "strays_migrated": 0, 2024-09-12T02:49:28.870 INFO:teuthology.orchestra.run.smithi044.stdout: "num_recovering_processing": 0, 2024-09-12T02:49:28.870 INFO:teuthology.orchestra.run.smithi044.stdout: "num_recovering_enqueued": 0, 2024-09-12T02:49:28.870 INFO:teuthology.orchestra.run.smithi044.stdout: "num_recovering_prioritized": 0, 2024-09-12T02:49:28.870 INFO:teuthology.orchestra.run.smithi044.stdout: "recovery_started": 0, 2024-09-12T02:49:28.870 INFO:teuthology.orchestra.run.smithi044.stdout: "recovery_completed": 0, 2024-09-12T02:49:28.870 INFO:teuthology.orchestra.run.smithi044.stdout: "ireq_quiesce_path": 0, 2024-09-12T02:49:28.871 INFO:teuthology.orchestra.run.smithi044.stdout: "ireq_quiesce_inode": 0, 2024-09-12T02:49:28.871 INFO:teuthology.orchestra.run.smithi044.stdout: "ireq_enqueue_scrub": 0, 2024-09-12T02:49:28.871 INFO:teuthology.orchestra.run.smithi044.stdout: "ireq_exportdir": 0, 2024-09-12T02:49:28.871 INFO:teuthology.orchestra.run.smithi044.stdout: "ireq_flush": 0, 2024-09-12T02:49:28.871 INFO:teuthology.orchestra.run.smithi044.stdout: "ireq_fragmentdir": 0, 2024-09-12T02:49:28.871 INFO:teuthology.orchestra.run.smithi044.stdout: "ireq_fragstats": 0, 2024-09-12T02:49:28.871 INFO:teuthology.orchestra.run.smithi044.stdout: "ireq_inodestats": 0 2024-09-12T02:49:28.871 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-09-12T02:49:28.871 INFO:teuthology.orchestra.run.smithi044.stdout: "mds_log": { 2024-09-12T02:49:28.871 INFO:teuthology.orchestra.run.smithi044.stdout: "evlrg": 0, 2024-09-12T02:49:28.871 INFO:teuthology.orchestra.run.smithi044.stdout: "evadd": 0, 2024-09-12T02:49:28.871 INFO:teuthology.orchestra.run.smithi044.stdout: "evex": 0, 2024-09-12T02:49:28.871 INFO:teuthology.orchestra.run.smithi044.stdout: "evtrm": 0, 2024-09-12T02:49:28.872 INFO:teuthology.orchestra.run.smithi044.stdout: "ev": 7, 2024-09-12T02:49:28.872 INFO:teuthology.orchestra.run.smithi044.stdout: "evexg": 0, 2024-09-12T02:49:28.872 INFO:teuthology.orchestra.run.smithi044.stdout: "evexd": 0, 2024-09-12T02:49:28.872 INFO:teuthology.orchestra.run.smithi044.stdout: "segadd": 0, 2024-09-12T02:49:28.872 INFO:teuthology.orchestra.run.smithi044.stdout: "segex": 0, 2024-09-12T02:49:28.872 INFO:teuthology.orchestra.run.smithi044.stdout: "segtrm": 0, 2024-09-12T02:49:28.872 INFO:teuthology.orchestra.run.smithi044.stdout: "seg": 2, 2024-09-12T02:49:28.872 INFO:teuthology.orchestra.run.smithi044.stdout: "segmjr": 2, 2024-09-12T02:49:28.872 INFO:teuthology.orchestra.run.smithi044.stdout: "segexg": 0, 2024-09-12T02:49:28.872 INFO:teuthology.orchestra.run.smithi044.stdout: "segexd": 0, 2024-09-12T02:49:28.872 INFO:teuthology.orchestra.run.smithi044.stdout: "expos": 4194304, 2024-09-12T02:49:28.872 INFO:teuthology.orchestra.run.smithi044.stdout: "wrpos": 4196353, 2024-09-12T02:49:28.873 INFO:teuthology.orchestra.run.smithi044.stdout: "rdpos": 4196212, 2024-09-12T02:49:28.873 INFO:teuthology.orchestra.run.smithi044.stdout: "jlat": { 2024-09-12T02:49:28.873 INFO:teuthology.orchestra.run.smithi044.stdout: "avgcount": 0, 2024-09-12T02:49:28.873 INFO:teuthology.orchestra.run.smithi044.stdout: "sum": 0.000000000, 2024-09-12T02:49:28.873 INFO:teuthology.orchestra.run.smithi044.stdout: "avgtime": 0.000000000 2024-09-12T02:49:28.873 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-09-12T02:49:28.873 INFO:teuthology.orchestra.run.smithi044.stdout: "replayed": 7 2024-09-12T02:49:28.873 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-09-12T02:49:28.873 INFO:teuthology.orchestra.run.smithi044.stdout: "mds_mem": { 2024-09-12T02:49:28.873 INFO:teuthology.orchestra.run.smithi044.stdout: "ino": 3, 2024-09-12T02:49:28.874 INFO:teuthology.orchestra.run.smithi044.stdout: "ino+": 3, 2024-09-12T02:49:28.874 INFO:teuthology.orchestra.run.smithi044.stdout: "ino-": 0, 2024-09-12T02:49:28.874 INFO:teuthology.orchestra.run.smithi044.stdout: "dir": 1, 2024-09-12T02:49:28.874 INFO:teuthology.orchestra.run.smithi044.stdout: "dir+": 1, 2024-09-12T02:49:28.874 INFO:teuthology.orchestra.run.smithi044.stdout: "dir-": 0, 2024-09-12T02:49:28.874 INFO:teuthology.orchestra.run.smithi044.stdout: "dn": 0, 2024-09-12T02:49:28.874 INFO:teuthology.orchestra.run.smithi044.stdout: "dn+": 0, 2024-09-12T02:49:28.874 INFO:teuthology.orchestra.run.smithi044.stdout: "dn-": 0, 2024-09-12T02:49:28.874 INFO:teuthology.orchestra.run.smithi044.stdout: "cap": 0, 2024-09-12T02:49:28.875 INFO:teuthology.orchestra.run.smithi044.stdout: "cap+": 0, 2024-09-12T02:49:28.875 INFO:teuthology.orchestra.run.smithi044.stdout: "cap-": 0, 2024-09-12T02:49:28.875 INFO:teuthology.orchestra.run.smithi044.stdout: "rss": 49072, 2024-09-12T02:49:28.875 INFO:teuthology.orchestra.run.smithi044.stdout: "heap": 215328 2024-09-12T02:49:28.875 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-09-12T02:49:28.875 INFO:teuthology.orchestra.run.smithi044.stdout: "mds_server": { 2024-09-12T02:49:28.875 INFO:teuthology.orchestra.run.smithi044.stdout: "dispatch_client_request": 0, 2024-09-12T02:49:28.875 INFO:teuthology.orchestra.run.smithi044.stdout: "dispatch_server_request": 0, 2024-09-12T02:49:28.875 INFO:teuthology.orchestra.run.smithi044.stdout: "handle_client_request": 0, 2024-09-12T02:49:28.875 INFO:teuthology.orchestra.run.smithi044.stdout: "handle_client_session": 0, 2024-09-12T02:49:28.875 INFO:teuthology.orchestra.run.smithi044.stdout: "handle_peer_request": 0, 2024-09-12T02:49:28.876 INFO:teuthology.orchestra.run.smithi044.stdout: "req_create_latency": { 2024-09-12T02:49:28.876 INFO:teuthology.orchestra.run.smithi044.stdout: "avgcount": 0, 2024-09-12T02:49:28.876 INFO:teuthology.orchestra.run.smithi044.stdout: "sum": 0.000000000, 2024-09-12T02:49:28.876 INFO:teuthology.orchestra.run.smithi044.stdout: "avgtime": 0.000000000 2024-09-12T02:49:28.876 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-09-12T02:49:28.876 INFO:teuthology.orchestra.run.smithi044.stdout: "req_getattr_latency": { 2024-09-12T02:49:28.876 INFO:teuthology.orchestra.run.smithi044.stdout: "avgcount": 0, 2024-09-12T02:49:28.876 INFO:teuthology.orchestra.run.smithi044.stdout: "sum": 0.000000000, 2024-09-12T02:49:28.876 INFO:teuthology.orchestra.run.smithi044.stdout: "avgtime": 0.000000000 2024-09-12T02:49:28.876 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-09-12T02:49:28.876 INFO:teuthology.orchestra.run.smithi044.stdout: "req_getfilelock_latency": { 2024-09-12T02:49:28.877 INFO:teuthology.orchestra.run.smithi044.stdout: "avgcount": 0, 2024-09-12T02:49:28.877 INFO:teuthology.orchestra.run.smithi044.stdout: "sum": 0.000000000, 2024-09-12T02:49:28.877 INFO:teuthology.orchestra.run.smithi044.stdout: "avgtime": 0.000000000 2024-09-12T02:49:28.877 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-09-12T02:49:28.877 INFO:teuthology.orchestra.run.smithi044.stdout: "req_link_latency": { 2024-09-12T02:49:28.877 INFO:teuthology.orchestra.run.smithi044.stdout: "avgcount": 0, 2024-09-12T02:49:28.877 INFO:teuthology.orchestra.run.smithi044.stdout: "sum": 0.000000000, 2024-09-12T02:49:28.877 INFO:teuthology.orchestra.run.smithi044.stdout: "avgtime": 0.000000000 2024-09-12T02:49:28.877 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-09-12T02:49:28.877 INFO:teuthology.orchestra.run.smithi044.stdout: "req_lookup_latency": { 2024-09-12T02:49:28.877 INFO:teuthology.orchestra.run.smithi044.stdout: "avgcount": 0, 2024-09-12T02:49:28.877 INFO:teuthology.orchestra.run.smithi044.stdout: "sum": 0.000000000, 2024-09-12T02:49:28.878 INFO:teuthology.orchestra.run.smithi044.stdout: "avgtime": 0.000000000 2024-09-12T02:49:28.878 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-09-12T02:49:28.878 INFO:teuthology.orchestra.run.smithi044.stdout: "req_lookuphash_latency": { 2024-09-12T02:49:28.878 INFO:teuthology.orchestra.run.smithi044.stdout: "avgcount": 0, 2024-09-12T02:49:28.878 INFO:teuthology.orchestra.run.smithi044.stdout: "sum": 0.000000000, 2024-09-12T02:49:28.878 INFO:teuthology.orchestra.run.smithi044.stdout: "avgtime": 0.000000000 2024-09-12T02:49:28.878 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-09-12T02:49:28.878 INFO:teuthology.orchestra.run.smithi044.stdout: "req_lookupino_latency": { 2024-09-12T02:49:28.878 INFO:teuthology.orchestra.run.smithi044.stdout: "avgcount": 0, 2024-09-12T02:49:28.878 INFO:teuthology.orchestra.run.smithi044.stdout: "sum": 0.000000000, 2024-09-12T02:49:28.878 INFO:teuthology.orchestra.run.smithi044.stdout: "avgtime": 0.000000000 2024-09-12T02:49:28.879 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-09-12T02:49:28.879 INFO:teuthology.orchestra.run.smithi044.stdout: "req_lookupname_latency": { 2024-09-12T02:49:28.879 INFO:teuthology.orchestra.run.smithi044.stdout: "avgcount": 0, 2024-09-12T02:49:28.879 INFO:teuthology.orchestra.run.smithi044.stdout: "sum": 0.000000000, 2024-09-12T02:49:28.879 INFO:teuthology.orchestra.run.smithi044.stdout: "avgtime": 0.000000000 2024-09-12T02:49:28.879 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-09-12T02:49:28.879 INFO:teuthology.orchestra.run.smithi044.stdout: "req_lookupparent_latency": { 2024-09-12T02:49:28.879 INFO:teuthology.orchestra.run.smithi044.stdout: "avgcount": 0, 2024-09-12T02:49:28.879 INFO:teuthology.orchestra.run.smithi044.stdout: "sum": 0.000000000, 2024-09-12T02:49:28.880 INFO:teuthology.orchestra.run.smithi044.stdout: "avgtime": 0.000000000 2024-09-12T02:49:28.880 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-09-12T02:49:28.880 INFO:teuthology.orchestra.run.smithi044.stdout: "req_lookupsnap_latency": { 2024-09-12T02:49:28.880 INFO:teuthology.orchestra.run.smithi044.stdout: "avgcount": 0, 2024-09-12T02:49:28.880 INFO:teuthology.orchestra.run.smithi044.stdout: "sum": 0.000000000, 2024-09-12T02:49:28.880 INFO:teuthology.orchestra.run.smithi044.stdout: "avgtime": 0.000000000 2024-09-12T02:49:28.880 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-09-12T02:49:28.880 INFO:teuthology.orchestra.run.smithi044.stdout: "req_lssnap_latency": { 2024-09-12T02:49:28.880 INFO:teuthology.orchestra.run.smithi044.stdout: "avgcount": 0, 2024-09-12T02:49:28.880 INFO:teuthology.orchestra.run.smithi044.stdout: "sum": 0.000000000, 2024-09-12T02:49:28.881 INFO:teuthology.orchestra.run.smithi044.stdout: "avgtime": 0.000000000 2024-09-12T02:49:28.881 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-09-12T02:49:28.881 INFO:teuthology.orchestra.run.smithi044.stdout: "req_mkdir_latency": { 2024-09-12T02:49:28.881 INFO:teuthology.orchestra.run.smithi044.stdout: "avgcount": 0, 2024-09-12T02:49:28.882 INFO:teuthology.orchestra.run.smithi044.stdout: "sum": 0.000000000, 2024-09-12T02:49:28.882 INFO:teuthology.orchestra.run.smithi044.stdout: "avgtime": 0.000000000 2024-09-12T02:49:28.882 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-09-12T02:49:28.882 INFO:teuthology.orchestra.run.smithi044.stdout: "req_mknod_latency": { 2024-09-12T02:49:28.882 INFO:teuthology.orchestra.run.smithi044.stdout: "avgcount": 0, 2024-09-12T02:49:28.882 INFO:teuthology.orchestra.run.smithi044.stdout: "sum": 0.000000000, 2024-09-12T02:49:28.882 INFO:teuthology.orchestra.run.smithi044.stdout: "avgtime": 0.000000000 2024-09-12T02:49:28.882 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-09-12T02:49:28.882 INFO:teuthology.orchestra.run.smithi044.stdout: "req_mksnap_latency": { 2024-09-12T02:49:28.882 INFO:teuthology.orchestra.run.smithi044.stdout: "avgcount": 0, 2024-09-12T02:49:28.882 INFO:teuthology.orchestra.run.smithi044.stdout: "sum": 0.000000000, 2024-09-12T02:49:28.883 INFO:teuthology.orchestra.run.smithi044.stdout: "avgtime": 0.000000000 2024-09-12T02:49:28.883 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-09-12T02:49:28.883 INFO:teuthology.orchestra.run.smithi044.stdout: "req_open_latency": { 2024-09-12T02:49:28.883 INFO:teuthology.orchestra.run.smithi044.stdout: "avgcount": 0, 2024-09-12T02:49:28.883 INFO:teuthology.orchestra.run.smithi044.stdout: "sum": 0.000000000, 2024-09-12T02:49:28.883 INFO:teuthology.orchestra.run.smithi044.stdout: "avgtime": 0.000000000 2024-09-12T02:49:28.883 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-09-12T02:49:28.883 INFO:teuthology.orchestra.run.smithi044.stdout: "req_readdir_latency": { 2024-09-12T02:49:28.883 INFO:teuthology.orchestra.run.smithi044.stdout: "avgcount": 0, 2024-09-12T02:49:28.883 INFO:teuthology.orchestra.run.smithi044.stdout: "sum": 0.000000000, 2024-09-12T02:49:28.883 INFO:teuthology.orchestra.run.smithi044.stdout: "avgtime": 0.000000000 2024-09-12T02:49:28.884 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-09-12T02:49:28.884 INFO:teuthology.orchestra.run.smithi044.stdout: "req_rename_latency": { 2024-09-12T02:49:28.884 INFO:teuthology.orchestra.run.smithi044.stdout: "avgcount": 0, 2024-09-12T02:49:28.884 INFO:teuthology.orchestra.run.smithi044.stdout: "sum": 0.000000000, 2024-09-12T02:49:28.884 INFO:teuthology.orchestra.run.smithi044.stdout: "avgtime": 0.000000000 2024-09-12T02:49:28.884 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-09-12T02:49:28.884 INFO:teuthology.orchestra.run.smithi044.stdout: "req_renamesnap_latency": { 2024-09-12T02:49:28.884 INFO:teuthology.orchestra.run.smithi044.stdout: "avgcount": 0, 2024-09-12T02:49:28.884 INFO:teuthology.orchestra.run.smithi044.stdout: "sum": 0.000000000, 2024-09-12T02:49:28.885 INFO:teuthology.orchestra.run.smithi044.stdout: "avgtime": 0.000000000 2024-09-12T02:49:28.885 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-09-12T02:49:28.885 INFO:teuthology.orchestra.run.smithi044.stdout: "req_snapdiff_latency": { 2024-09-12T02:49:28.885 INFO:teuthology.orchestra.run.smithi044.stdout: "avgcount": 0, 2024-09-12T02:49:28.885 INFO:teuthology.orchestra.run.smithi044.stdout: "sum": 0.000000000, 2024-09-12T02:49:28.885 INFO:teuthology.orchestra.run.smithi044.stdout: "avgtime": 0.000000000 2024-09-12T02:49:28.885 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-09-12T02:49:28.885 INFO:teuthology.orchestra.run.smithi044.stdout: "req_rmdir_latency": { 2024-09-12T02:49:28.886 INFO:teuthology.orchestra.run.smithi044.stdout: "avgcount": 0, 2024-09-12T02:49:28.886 INFO:teuthology.orchestra.run.smithi044.stdout: "sum": 0.000000000, 2024-09-12T02:49:28.886 INFO:teuthology.orchestra.run.smithi044.stdout: "avgtime": 0.000000000 2024-09-12T02:49:28.886 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-09-12T02:49:28.886 INFO:teuthology.orchestra.run.smithi044.stdout: "req_rmsnap_latency": { 2024-09-12T02:49:28.886 INFO:teuthology.orchestra.run.smithi044.stdout: "avgcount": 0, 2024-09-12T02:49:28.886 INFO:teuthology.orchestra.run.smithi044.stdout: "sum": 0.000000000, 2024-09-12T02:49:28.886 INFO:teuthology.orchestra.run.smithi044.stdout: "avgtime": 0.000000000 2024-09-12T02:49:28.886 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-09-12T02:49:28.886 INFO:teuthology.orchestra.run.smithi044.stdout: "req_rmxattr_latency": { 2024-09-12T02:49:28.887 INFO:teuthology.orchestra.run.smithi044.stdout: "avgcount": 0, 2024-09-12T02:49:28.887 INFO:teuthology.orchestra.run.smithi044.stdout: "sum": 0.000000000, 2024-09-12T02:49:28.887 INFO:teuthology.orchestra.run.smithi044.stdout: "avgtime": 0.000000000 2024-09-12T02:49:28.887 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-09-12T02:49:28.887 INFO:teuthology.orchestra.run.smithi044.stdout: "req_setattr_latency": { 2024-09-12T02:49:28.887 INFO:teuthology.orchestra.run.smithi044.stdout: "avgcount": 0, 2024-09-12T02:49:28.887 INFO:teuthology.orchestra.run.smithi044.stdout: "sum": 0.000000000, 2024-09-12T02:49:28.887 INFO:teuthology.orchestra.run.smithi044.stdout: "avgtime": 0.000000000 2024-09-12T02:49:28.887 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-09-12T02:49:28.888 INFO:teuthology.orchestra.run.smithi044.stdout: "req_setdirlayout_latency": { 2024-09-12T02:49:28.888 INFO:teuthology.orchestra.run.smithi044.stdout: "avgcount": 0, 2024-09-12T02:49:28.888 INFO:teuthology.orchestra.run.smithi044.stdout: "sum": 0.000000000, 2024-09-12T02:49:28.888 INFO:teuthology.orchestra.run.smithi044.stdout: "avgtime": 0.000000000 2024-09-12T02:49:28.888 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-09-12T02:49:28.888 INFO:teuthology.orchestra.run.smithi044.stdout: "req_setfilelock_latency": { 2024-09-12T02:49:28.888 INFO:teuthology.orchestra.run.smithi044.stdout: "avgcount": 0, 2024-09-12T02:49:28.888 INFO:teuthology.orchestra.run.smithi044.stdout: "sum": 0.000000000, 2024-09-12T02:49:28.888 INFO:teuthology.orchestra.run.smithi044.stdout: "avgtime": 0.000000000 2024-09-12T02:49:28.888 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-09-12T02:49:28.889 INFO:teuthology.orchestra.run.smithi044.stdout: "req_setlayout_latency": { 2024-09-12T02:49:28.889 INFO:teuthology.orchestra.run.smithi044.stdout: "avgcount": 0, 2024-09-12T02:49:28.889 INFO:teuthology.orchestra.run.smithi044.stdout: "sum": 0.000000000, 2024-09-12T02:49:28.889 INFO:teuthology.orchestra.run.smithi044.stdout: "avgtime": 0.000000000 2024-09-12T02:49:28.889 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-09-12T02:49:28.889 INFO:teuthology.orchestra.run.smithi044.stdout: "req_setxattr_latency": { 2024-09-12T02:49:28.889 INFO:teuthology.orchestra.run.smithi044.stdout: "avgcount": 0, 2024-09-12T02:49:28.889 INFO:teuthology.orchestra.run.smithi044.stdout: "sum": 0.000000000, 2024-09-12T02:49:28.889 INFO:teuthology.orchestra.run.smithi044.stdout: "avgtime": 0.000000000 2024-09-12T02:49:28.890 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-09-12T02:49:28.890 INFO:teuthology.orchestra.run.smithi044.stdout: "req_symlink_latency": { 2024-09-12T02:49:28.890 INFO:teuthology.orchestra.run.smithi044.stdout: "avgcount": 0, 2024-09-12T02:49:28.890 INFO:teuthology.orchestra.run.smithi044.stdout: "sum": 0.000000000, 2024-09-12T02:49:28.890 INFO:teuthology.orchestra.run.smithi044.stdout: "avgtime": 0.000000000 2024-09-12T02:49:28.890 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-09-12T02:49:28.890 INFO:teuthology.orchestra.run.smithi044.stdout: "req_unlink_latency": { 2024-09-12T02:49:28.890 INFO:teuthology.orchestra.run.smithi044.stdout: "avgcount": 0, 2024-09-12T02:49:28.890 INFO:teuthology.orchestra.run.smithi044.stdout: "sum": 0.000000000, 2024-09-12T02:49:28.890 INFO:teuthology.orchestra.run.smithi044.stdout: "avgtime": 0.000000000 2024-09-12T02:49:28.891 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-09-12T02:49:28.891 INFO:teuthology.orchestra.run.smithi044.stdout: "cap_revoke_eviction": 0, 2024-09-12T02:49:28.891 INFO:teuthology.orchestra.run.smithi044.stdout: "cap_acquisition_throttle": 0, 2024-09-12T02:49:28.891 INFO:teuthology.orchestra.run.smithi044.stdout: "req_getvxattr_latency": { 2024-09-12T02:49:28.891 INFO:teuthology.orchestra.run.smithi044.stdout: "avgcount": 0, 2024-09-12T02:49:28.891 INFO:teuthology.orchestra.run.smithi044.stdout: "sum": 0.000000000, 2024-09-12T02:49:28.891 INFO:teuthology.orchestra.run.smithi044.stdout: "avgtime": 0.000000000 2024-09-12T02:49:28.891 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-09-12T02:49:28.891 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-09-12T02:49:28.891 INFO:teuthology.orchestra.run.smithi044.stdout: "mds_sessions": { 2024-09-12T02:49:28.892 INFO:teuthology.orchestra.run.smithi044.stdout: "session_count": 1, 2024-09-12T02:49:28.892 INFO:teuthology.orchestra.run.smithi044.stdout: "session_add": 3, 2024-09-12T02:49:28.892 INFO:teuthology.orchestra.run.smithi044.stdout: "session_remove": 2, 2024-09-12T02:49:28.892 INFO:teuthology.orchestra.run.smithi044.stdout: "sessions_open": 2, 2024-09-12T02:49:28.892 INFO:teuthology.orchestra.run.smithi044.stdout: "sessions_stale": 0, 2024-09-12T02:49:28.892 INFO:teuthology.orchestra.run.smithi044.stdout: "total_load": 0, 2024-09-12T02:49:28.892 INFO:teuthology.orchestra.run.smithi044.stdout: "average_load": 0, 2024-09-12T02:49:28.892 INFO:teuthology.orchestra.run.smithi044.stdout: "avg_session_uptime": 3756, 2024-09-12T02:49:28.892 INFO:teuthology.orchestra.run.smithi044.stdout: "mdthresh_evicted": 0 2024-09-12T02:49:28.892 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-09-12T02:49:28.893 INFO:teuthology.orchestra.run.smithi044.stdout: "mempool": { 2024-09-12T02:49:28.893 INFO:teuthology.orchestra.run.smithi044.stdout: "bloom_filter_bytes": 0, 2024-09-12T02:49:28.893 INFO:teuthology.orchestra.run.smithi044.stdout: "bloom_filter_items": 0, 2024-09-12T02:49:28.893 INFO:teuthology.orchestra.run.smithi044.stdout: "bluestore_alloc_bytes": 0, 2024-09-12T02:49:28.893 INFO:teuthology.orchestra.run.smithi044.stdout: "bluestore_alloc_items": 0, 2024-09-12T02:49:28.893 INFO:teuthology.orchestra.run.smithi044.stdout: "bluestore_cache_data_bytes": 0, 2024-09-12T02:49:28.893 INFO:teuthology.orchestra.run.smithi044.stdout: "bluestore_cache_data_items": 0, 2024-09-12T02:49:28.894 INFO:teuthology.orchestra.run.smithi044.stdout: "bluestore_cache_onode_bytes": 0, 2024-09-12T02:49:28.894 INFO:teuthology.orchestra.run.smithi044.stdout: "bluestore_cache_onode_items": 0, 2024-09-12T02:49:28.894 INFO:teuthology.orchestra.run.smithi044.stdout: "bluestore_cache_meta_bytes": 0, 2024-09-12T02:49:28.894 INFO:teuthology.orchestra.run.smithi044.stdout: "bluestore_cache_meta_items": 0, 2024-09-12T02:49:28.894 INFO:teuthology.orchestra.run.smithi044.stdout: "bluestore_cache_other_bytes": 0, 2024-09-12T02:49:28.894 INFO:teuthology.orchestra.run.smithi044.stdout: "bluestore_cache_other_items": 0, 2024-09-12T02:49:28.894 INFO:teuthology.orchestra.run.smithi044.stdout: "bluestore_cache_buffer_bytes": 0, 2024-09-12T02:49:28.894 INFO:teuthology.orchestra.run.smithi044.stdout: "bluestore_cache_buffer_items": 0, 2024-09-12T02:49:28.894 INFO:teuthology.orchestra.run.smithi044.stdout: "bluestore_extent_bytes": 0, 2024-09-12T02:49:28.894 INFO:teuthology.orchestra.run.smithi044.stdout: "bluestore_extent_items": 0, 2024-09-12T02:49:28.894 INFO:teuthology.orchestra.run.smithi044.stdout: "bluestore_blob_bytes": 0, 2024-09-12T02:49:28.895 INFO:teuthology.orchestra.run.smithi044.stdout: "bluestore_blob_items": 0, 2024-09-12T02:49:28.895 INFO:teuthology.orchestra.run.smithi044.stdout: "bluestore_shared_blob_bytes": 0, 2024-09-12T02:49:28.895 INFO:teuthology.orchestra.run.smithi044.stdout: "bluestore_shared_blob_items": 0, 2024-09-12T02:49:28.895 INFO:teuthology.orchestra.run.smithi044.stdout: "bluestore_inline_bl_bytes": 0, 2024-09-12T02:49:28.895 INFO:teuthology.orchestra.run.smithi044.stdout: "bluestore_inline_bl_items": 0, 2024-09-12T02:49:28.895 INFO:teuthology.orchestra.run.smithi044.stdout: "bluestore_fsck_bytes": 0, 2024-09-12T02:49:28.895 INFO:teuthology.orchestra.run.smithi044.stdout: "bluestore_fsck_items": 0, 2024-09-12T02:49:28.895 INFO:teuthology.orchestra.run.smithi044.stdout: "bluestore_txc_bytes": 0, 2024-09-12T02:49:28.895 INFO:teuthology.orchestra.run.smithi044.stdout: "bluestore_txc_items": 0, 2024-09-12T02:49:28.895 INFO:teuthology.orchestra.run.smithi044.stdout: "bluestore_writing_deferred_bytes": 0, 2024-09-12T02:49:28.895 INFO:teuthology.orchestra.run.smithi044.stdout: "bluestore_writing_deferred_items": 0, 2024-09-12T02:49:28.896 INFO:teuthology.orchestra.run.smithi044.stdout: "bluestore_writing_bytes": 0, 2024-09-12T02:49:28.896 INFO:teuthology.orchestra.run.smithi044.stdout: "bluestore_writing_items": 0, 2024-09-12T02:49:28.896 INFO:teuthology.orchestra.run.smithi044.stdout: "bluefs_bytes": 0, 2024-09-12T02:49:28.896 INFO:teuthology.orchestra.run.smithi044.stdout: "bluefs_items": 0, 2024-09-12T02:49:28.896 INFO:teuthology.orchestra.run.smithi044.stdout: "bluefs_file_reader_bytes": 0, 2024-09-12T02:49:28.896 INFO:teuthology.orchestra.run.smithi044.stdout: "bluefs_file_reader_items": 0, 2024-09-12T02:49:28.896 INFO:teuthology.orchestra.run.smithi044.stdout: "bluefs_file_writer_bytes": 0, 2024-09-12T02:49:28.896 INFO:teuthology.orchestra.run.smithi044.stdout: "bluefs_file_writer_items": 0, 2024-09-12T02:49:28.896 INFO:teuthology.orchestra.run.smithi044.stdout: "buffer_anon_bytes": 198241, 2024-09-12T02:49:28.896 INFO:teuthology.orchestra.run.smithi044.stdout: "buffer_anon_items": 56, 2024-09-12T02:49:28.896 INFO:teuthology.orchestra.run.smithi044.stdout: "buffer_meta_bytes": 0, 2024-09-12T02:49:28.897 INFO:teuthology.orchestra.run.smithi044.stdout: "buffer_meta_items": 0, 2024-09-12T02:49:28.897 INFO:teuthology.orchestra.run.smithi044.stdout: "osd_bytes": 0, 2024-09-12T02:49:28.897 INFO:teuthology.orchestra.run.smithi044.stdout: "osd_items": 0, 2024-09-12T02:49:28.897 INFO:teuthology.orchestra.run.smithi044.stdout: "osd_mapbl_bytes": 0, 2024-09-12T02:49:28.897 INFO:teuthology.orchestra.run.smithi044.stdout: "osd_mapbl_items": 0, 2024-09-12T02:49:28.897 INFO:teuthology.orchestra.run.smithi044.stdout: "osd_pglog_bytes": 0, 2024-09-12T02:49:28.897 INFO:teuthology.orchestra.run.smithi044.stdout: "osd_pglog_items": 0, 2024-09-12T02:49:28.897 INFO:teuthology.orchestra.run.smithi044.stdout: "osdmap_bytes": 9520, 2024-09-12T02:49:28.897 INFO:teuthology.orchestra.run.smithi044.stdout: "osdmap_items": 193, 2024-09-12T02:49:28.897 INFO:teuthology.orchestra.run.smithi044.stdout: "osdmap_mapping_bytes": 0, 2024-09-12T02:49:28.898 INFO:teuthology.orchestra.run.smithi044.stdout: "osdmap_mapping_items": 0, 2024-09-12T02:49:28.898 INFO:teuthology.orchestra.run.smithi044.stdout: "pgmap_bytes": 0, 2024-09-12T02:49:28.898 INFO:teuthology.orchestra.run.smithi044.stdout: "pgmap_items": 0, 2024-09-12T02:49:28.898 INFO:teuthology.orchestra.run.smithi044.stdout: "mds_co_bytes": 8512, 2024-09-12T02:49:28.898 INFO:teuthology.orchestra.run.smithi044.stdout: "mds_co_items": 13, 2024-09-12T02:49:28.898 INFO:teuthology.orchestra.run.smithi044.stdout: "unittest_1_bytes": 0, 2024-09-12T02:49:28.898 INFO:teuthology.orchestra.run.smithi044.stdout: "unittest_1_items": 0, 2024-09-12T02:49:28.898 INFO:teuthology.orchestra.run.smithi044.stdout: "unittest_2_bytes": 0, 2024-09-12T02:49:28.898 INFO:teuthology.orchestra.run.smithi044.stdout: "unittest_2_items": 0 2024-09-12T02:49:28.898 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-09-12T02:49:28.898 INFO:teuthology.orchestra.run.smithi044.stdout: "objecter": { 2024-09-12T02:49:28.899 INFO:teuthology.orchestra.run.smithi044.stdout: "op_active": 0, 2024-09-12T02:49:28.899 INFO:teuthology.orchestra.run.smithi044.stdout: "op_laggy": 0, 2024-09-12T02:49:28.899 INFO:teuthology.orchestra.run.smithi044.stdout: "op_send": 2376, 2024-09-12T02:49:28.899 INFO:teuthology.orchestra.run.smithi044.stdout: "op_send_bytes": 21, 2024-09-12T02:49:28.899 INFO:teuthology.orchestra.run.smithi044.stdout: "op_resend": 3, 2024-09-12T02:49:28.899 INFO:teuthology.orchestra.run.smithi044.stdout: "op_reply": 2376, 2024-09-12T02:49:28.899 INFO:teuthology.orchestra.run.smithi044.stdout: "op_latency": { 2024-09-12T02:49:28.899 INFO:teuthology.orchestra.run.smithi044.stdout: "avgcount": 2376, 2024-09-12T02:49:28.899 INFO:teuthology.orchestra.run.smithi044.stdout: "sum": 1.250980055, 2024-09-12T02:49:28.899 INFO:teuthology.orchestra.run.smithi044.stdout: "avgtime": 0.000526506 2024-09-12T02:49:28.899 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-09-12T02:49:28.900 INFO:teuthology.orchestra.run.smithi044.stdout: "op_inflight": 0, 2024-09-12T02:49:28.900 INFO:teuthology.orchestra.run.smithi044.stdout: "oplen_avg": { 2024-09-12T02:49:28.900 INFO:teuthology.orchestra.run.smithi044.stdout: "avgcount": 2376, 2024-09-12T02:49:28.900 INFO:teuthology.orchestra.run.smithi044.stdout: "sum": 2377 2024-09-12T02:49:28.900 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-09-12T02:49:28.900 INFO:teuthology.orchestra.run.smithi044.stdout: "op": 2376, 2024-09-12T02:49:28.900 INFO:teuthology.orchestra.run.smithi044.stdout: "op_r": 2376, 2024-09-12T02:49:28.900 INFO:teuthology.orchestra.run.smithi044.stdout: "op_w": 0, 2024-09-12T02:49:28.900 INFO:teuthology.orchestra.run.smithi044.stdout: "op_rmw": 0, 2024-09-12T02:49:28.900 INFO:teuthology.orchestra.run.smithi044.stdout: "op_pg": 0, 2024-09-12T02:49:28.900 INFO:teuthology.orchestra.run.smithi044.stdout: "osdop_stat": 1549, 2024-09-12T02:49:28.901 INFO:teuthology.orchestra.run.smithi044.stdout: "osdop_create": 0, 2024-09-12T02:49:28.901 INFO:teuthology.orchestra.run.smithi044.stdout: "osdop_read": 825, 2024-09-12T02:49:28.901 INFO:teuthology.orchestra.run.smithi044.stdout: "osdop_write": 0, 2024-09-12T02:49:28.901 INFO:teuthology.orchestra.run.smithi044.stdout: "osdop_writefull": 0, 2024-09-12T02:49:28.901 INFO:teuthology.orchestra.run.smithi044.stdout: "osdop_writesame": 0, 2024-09-12T02:49:28.901 INFO:teuthology.orchestra.run.smithi044.stdout: "osdop_append": 0, 2024-09-12T02:49:28.901 INFO:teuthology.orchestra.run.smithi044.stdout: "osdop_zero": 0, 2024-09-12T02:49:28.901 INFO:teuthology.orchestra.run.smithi044.stdout: "osdop_truncate": 0, 2024-09-12T02:49:28.901 INFO:teuthology.orchestra.run.smithi044.stdout: "osdop_delete": 0, 2024-09-12T02:49:28.901 INFO:teuthology.orchestra.run.smithi044.stdout: "osdop_mapext": 0, 2024-09-12T02:49:28.901 INFO:teuthology.orchestra.run.smithi044.stdout: "osdop_sparse_read": 0, 2024-09-12T02:49:28.902 INFO:teuthology.orchestra.run.smithi044.stdout: "osdop_clonerange": 0, 2024-09-12T02:49:28.902 INFO:teuthology.orchestra.run.smithi044.stdout: "osdop_getxattr": 1, 2024-09-12T02:49:28.902 INFO:teuthology.orchestra.run.smithi044.stdout: "osdop_setxattr": 0, 2024-09-12T02:49:28.902 INFO:teuthology.orchestra.run.smithi044.stdout: "osdop_cmpxattr": 0, 2024-09-12T02:49:28.902 INFO:teuthology.orchestra.run.smithi044.stdout: "osdop_rmxattr": 0, 2024-09-12T02:49:28.902 INFO:teuthology.orchestra.run.smithi044.stdout: "osdop_resetxattrs": 0, 2024-09-12T02:49:28.902 INFO:teuthology.orchestra.run.smithi044.stdout: "osdop_call": 0, 2024-09-12T02:49:28.902 INFO:teuthology.orchestra.run.smithi044.stdout: "osdop_watch": 0, 2024-09-12T02:49:28.903 INFO:teuthology.orchestra.run.smithi044.stdout: "osdop_notify": 0, 2024-09-12T02:49:28.903 INFO:teuthology.orchestra.run.smithi044.stdout: "osdop_src_cmpxattr": 0, 2024-09-12T02:49:28.903 INFO:teuthology.orchestra.run.smithi044.stdout: "osdop_pgls": 0, 2024-09-12T02:49:28.903 INFO:teuthology.orchestra.run.smithi044.stdout: "osdop_pgls_filter": 0, 2024-09-12T02:49:28.903 INFO:teuthology.orchestra.run.smithi044.stdout: "osdop_other": 0, 2024-09-12T02:49:28.903 INFO:teuthology.orchestra.run.smithi044.stdout: "linger_active": 0, 2024-09-12T02:49:28.903 INFO:teuthology.orchestra.run.smithi044.stdout: "linger_send": 0, 2024-09-12T02:49:28.903 INFO:teuthology.orchestra.run.smithi044.stdout: "linger_resend": 0, 2024-09-12T02:49:28.903 INFO:teuthology.orchestra.run.smithi044.stdout: "linger_ping": 0, 2024-09-12T02:49:28.903 INFO:teuthology.orchestra.run.smithi044.stdout: "poolop_active": 0, 2024-09-12T02:49:28.903 INFO:teuthology.orchestra.run.smithi044.stdout: "poolop_send": 0, 2024-09-12T02:49:28.904 INFO:teuthology.orchestra.run.smithi044.stdout: "poolop_resend": 0, 2024-09-12T02:49:28.904 INFO:teuthology.orchestra.run.smithi044.stdout: "poolstat_active": 0, 2024-09-12T02:49:28.904 INFO:teuthology.orchestra.run.smithi044.stdout: "poolstat_send": 0, 2024-09-12T02:49:28.904 INFO:teuthology.orchestra.run.smithi044.stdout: "poolstat_resend": 0, 2024-09-12T02:49:28.904 INFO:teuthology.orchestra.run.smithi044.stdout: "statfs_active": 0, 2024-09-12T02:49:28.904 INFO:teuthology.orchestra.run.smithi044.stdout: "statfs_send": 0, 2024-09-12T02:49:28.904 INFO:teuthology.orchestra.run.smithi044.stdout: "statfs_resend": 0, 2024-09-12T02:49:28.904 INFO:teuthology.orchestra.run.smithi044.stdout: "command_active": 0, 2024-09-12T02:49:28.904 INFO:teuthology.orchestra.run.smithi044.stdout: "command_send": 0, 2024-09-12T02:49:28.904 INFO:teuthology.orchestra.run.smithi044.stdout: "command_resend": 0, 2024-09-12T02:49:28.904 INFO:teuthology.orchestra.run.smithi044.stdout: "map_epoch": 108, 2024-09-12T02:49:28.905 INFO:teuthology.orchestra.run.smithi044.stdout: "map_full": 0, 2024-09-12T02:49:28.905 INFO:teuthology.orchestra.run.smithi044.stdout: "map_inc": 15, 2024-09-12T02:49:28.905 INFO:teuthology.orchestra.run.smithi044.stdout: "osd_sessions": 6, 2024-09-12T02:49:28.905 INFO:teuthology.orchestra.run.smithi044.stdout: "osd_session_open": 6, 2024-09-12T02:49:28.905 INFO:teuthology.orchestra.run.smithi044.stdout: "osd_session_close": 0, 2024-09-12T02:49:28.905 INFO:teuthology.orchestra.run.smithi044.stdout: "osd_laggy": 0, 2024-09-12T02:49:28.905 INFO:teuthology.orchestra.run.smithi044.stdout: "omap_wr": 0, 2024-09-12T02:49:28.905 INFO:teuthology.orchestra.run.smithi044.stdout: "omap_rd": 2, 2024-09-12T02:49:28.905 INFO:teuthology.orchestra.run.smithi044.stdout: "omap_del": 0 2024-09-12T02:49:28.905 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-09-12T02:49:28.905 INFO:teuthology.orchestra.run.smithi044.stdout: "oft": { 2024-09-12T02:49:28.906 INFO:teuthology.orchestra.run.smithi044.stdout: "omap_total_objs": 0, 2024-09-12T02:49:28.906 INFO:teuthology.orchestra.run.smithi044.stdout: "omap_total_kv_pairs": 0, 2024-09-12T02:49:28.906 INFO:teuthology.orchestra.run.smithi044.stdout: "omap_total_updates": 0, 2024-09-12T02:49:28.906 INFO:teuthology.orchestra.run.smithi044.stdout: "omap_total_removes": 0 2024-09-12T02:49:28.906 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-09-12T02:49:28.906 INFO:teuthology.orchestra.run.smithi044.stdout: "osd-slow-ops": { 2024-09-12T02:49:28.906 INFO:teuthology.orchestra.run.smithi044.stdout: "slow_ops_count": 0 2024-09-12T02:49:28.906 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-09-12T02:49:28.906 INFO:teuthology.orchestra.run.smithi044.stdout: "purge_queue": { 2024-09-12T02:49:28.906 INFO:teuthology.orchestra.run.smithi044.stdout: "pq_executing_ops": 0, 2024-09-12T02:49:28.906 INFO:teuthology.orchestra.run.smithi044.stdout: "pq_executing_ops_high_water": 0, 2024-09-12T02:49:28.906 INFO:teuthology.orchestra.run.smithi044.stdout: "pq_executing": 0, 2024-09-12T02:49:28.907 INFO:teuthology.orchestra.run.smithi044.stdout: "pq_executing_high_water": 0, 2024-09-12T02:49:28.907 INFO:teuthology.orchestra.run.smithi044.stdout: "pq_executed_ops": 0, 2024-09-12T02:49:28.907 INFO:teuthology.orchestra.run.smithi044.stdout: "pq_executed": 0, 2024-09-12T02:49:28.907 INFO:teuthology.orchestra.run.smithi044.stdout: "pq_item_in_journal": 0 2024-09-12T02:49:28.907 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-09-12T02:49:28.907 INFO:teuthology.orchestra.run.smithi044.stdout: "throttle-msgr_dispatch_throttler-mds": { 2024-09-12T02:49:28.907 INFO:teuthology.orchestra.run.smithi044.stdout: "val": 0, 2024-09-12T02:49:28.907 INFO:teuthology.orchestra.run.smithi044.stdout: "max": 104857600, 2024-09-12T02:49:28.907 INFO:teuthology.orchestra.run.smithi044.stdout: "get_started": 0, 2024-09-12T02:49:28.907 INFO:teuthology.orchestra.run.smithi044.stdout: "get": 2656, 2024-09-12T02:49:28.907 INFO:teuthology.orchestra.run.smithi044.stdout: "get_sum": 2191921, 2024-09-12T02:49:28.907 INFO:teuthology.orchestra.run.smithi044.stdout: "get_or_fail_fail": 0, 2024-09-12T02:49:28.908 INFO:teuthology.orchestra.run.smithi044.stdout: "get_or_fail_success": 2656, 2024-09-12T02:49:28.908 INFO:teuthology.orchestra.run.smithi044.stdout: "take": 0, 2024-09-12T02:49:28.908 INFO:teuthology.orchestra.run.smithi044.stdout: "take_sum": 0, 2024-09-12T02:49:28.908 INFO:teuthology.orchestra.run.smithi044.stdout: "put": 2656, 2024-09-12T02:49:28.908 INFO:teuthology.orchestra.run.smithi044.stdout: "put_sum": 2191921, 2024-09-12T02:49:28.908 INFO:teuthology.orchestra.run.smithi044.stdout: "wait": { 2024-09-12T02:49:28.908 INFO:teuthology.orchestra.run.smithi044.stdout: "avgcount": 0, 2024-09-12T02:49:28.908 INFO:teuthology.orchestra.run.smithi044.stdout: "sum": 0.000000000, 2024-09-12T02:49:28.908 INFO:teuthology.orchestra.run.smithi044.stdout: "avgtime": 0.000000000 2024-09-12T02:49:28.908 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-09-12T02:49:28.908 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-09-12T02:49:28.909 INFO:teuthology.orchestra.run.smithi044.stdout: "throttle-objecter_bytes": { 2024-09-12T02:49:28.909 INFO:teuthology.orchestra.run.smithi044.stdout: "val": 0, 2024-09-12T02:49:28.909 INFO:teuthology.orchestra.run.smithi044.stdout: "max": 104857600, 2024-09-12T02:49:28.909 INFO:teuthology.orchestra.run.smithi044.stdout: "get_started": 0, 2024-09-12T02:49:28.909 INFO:teuthology.orchestra.run.smithi044.stdout: "get": 0, 2024-09-12T02:49:28.909 INFO:teuthology.orchestra.run.smithi044.stdout: "get_sum": 0, 2024-09-12T02:49:28.909 INFO:teuthology.orchestra.run.smithi044.stdout: "get_or_fail_fail": 0, 2024-09-12T02:49:28.909 INFO:teuthology.orchestra.run.smithi044.stdout: "get_or_fail_success": 0, 2024-09-12T02:49:28.909 INFO:teuthology.orchestra.run.smithi044.stdout: "take": 2376, 2024-09-12T02:49:28.909 INFO:teuthology.orchestra.run.smithi044.stdout: "take_sum": 2054, 2024-09-12T02:49:28.909 INFO:teuthology.orchestra.run.smithi044.stdout: "put": 2376, 2024-09-12T02:49:28.910 INFO:teuthology.orchestra.run.smithi044.stdout: "put_sum": 2054, 2024-09-12T02:49:28.910 INFO:teuthology.orchestra.run.smithi044.stdout: "wait": { 2024-09-12T02:49:28.910 INFO:teuthology.orchestra.run.smithi044.stdout: "avgcount": 0, 2024-09-12T02:49:28.910 INFO:teuthology.orchestra.run.smithi044.stdout: "sum": 0.000000000, 2024-09-12T02:49:28.910 INFO:teuthology.orchestra.run.smithi044.stdout: "avgtime": 0.000000000 2024-09-12T02:49:28.910 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-09-12T02:49:28.910 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-09-12T02:49:28.910 INFO:teuthology.orchestra.run.smithi044.stdout: "throttle-objecter_ops": { 2024-09-12T02:49:28.910 INFO:teuthology.orchestra.run.smithi044.stdout: "val": 0, 2024-09-12T02:49:28.910 INFO:teuthology.orchestra.run.smithi044.stdout: "max": 1024, 2024-09-12T02:49:28.910 INFO:teuthology.orchestra.run.smithi044.stdout: "get_started": 0, 2024-09-12T02:49:28.911 INFO:teuthology.orchestra.run.smithi044.stdout: "get": 0, 2024-09-12T02:49:28.911 INFO:teuthology.orchestra.run.smithi044.stdout: "get_sum": 0, 2024-09-12T02:49:28.911 INFO:teuthology.orchestra.run.smithi044.stdout: "get_or_fail_fail": 0, 2024-09-12T02:49:28.911 INFO:teuthology.orchestra.run.smithi044.stdout: "get_or_fail_success": 0, 2024-09-12T02:49:28.911 INFO:teuthology.orchestra.run.smithi044.stdout: "take": 2376, 2024-09-12T02:49:28.911 INFO:teuthology.orchestra.run.smithi044.stdout: "take_sum": 2376, 2024-09-12T02:49:28.911 INFO:teuthology.orchestra.run.smithi044.stdout: "put": 2376, 2024-09-12T02:49:28.911 INFO:teuthology.orchestra.run.smithi044.stdout: "put_sum": 2376, 2024-09-12T02:49:28.911 INFO:teuthology.orchestra.run.smithi044.stdout: "wait": { 2024-09-12T02:49:28.911 INFO:teuthology.orchestra.run.smithi044.stdout: "avgcount": 0, 2024-09-12T02:49:28.911 INFO:teuthology.orchestra.run.smithi044.stdout: "sum": 0.000000000, 2024-09-12T02:49:28.911 INFO:teuthology.orchestra.run.smithi044.stdout: "avgtime": 0.000000000 2024-09-12T02:49:28.912 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-09-12T02:49:28.912 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-09-12T02:49:28.912 INFO:teuthology.orchestra.run.smithi044.stdout: "throttle-write_buf_throttle": { 2024-09-12T02:49:28.912 INFO:teuthology.orchestra.run.smithi044.stdout: "val": 0, 2024-09-12T02:49:28.912 INFO:teuthology.orchestra.run.smithi044.stdout: "max": 3758096384, 2024-09-12T02:49:28.912 INFO:teuthology.orchestra.run.smithi044.stdout: "get_started": 0, 2024-09-12T02:49:28.912 INFO:teuthology.orchestra.run.smithi044.stdout: "get": 0, 2024-09-12T02:49:28.912 INFO:teuthology.orchestra.run.smithi044.stdout: "get_sum": 0, 2024-09-12T02:49:28.912 INFO:teuthology.orchestra.run.smithi044.stdout: "get_or_fail_fail": 0, 2024-09-12T02:49:28.912 INFO:teuthology.orchestra.run.smithi044.stdout: "get_or_fail_success": 0, 2024-09-12T02:49:28.912 INFO:teuthology.orchestra.run.smithi044.stdout: "take": 0, 2024-09-12T02:49:28.912 INFO:teuthology.orchestra.run.smithi044.stdout: "take_sum": 0, 2024-09-12T02:49:28.913 INFO:teuthology.orchestra.run.smithi044.stdout: "put": 0, 2024-09-12T02:49:28.913 INFO:teuthology.orchestra.run.smithi044.stdout: "put_sum": 0, 2024-09-12T02:49:28.913 INFO:teuthology.orchestra.run.smithi044.stdout: "wait": { 2024-09-12T02:49:28.913 INFO:teuthology.orchestra.run.smithi044.stdout: "avgcount": 0, 2024-09-12T02:49:28.913 INFO:teuthology.orchestra.run.smithi044.stdout: "sum": 0.000000000, 2024-09-12T02:49:28.913 INFO:teuthology.orchestra.run.smithi044.stdout: "avgtime": 0.000000000 2024-09-12T02:49:28.913 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-09-12T02:49:28.913 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-09-12T02:49:28.913 INFO:teuthology.orchestra.run.smithi044.stdout: "throttle-write_buf_throttle-0x560c49558b40": { 2024-09-12T02:49:28.913 INFO:teuthology.orchestra.run.smithi044.stdout: "val": 0, 2024-09-12T02:49:28.913 INFO:teuthology.orchestra.run.smithi044.stdout: "max": 3758096384, 2024-09-12T02:49:28.914 INFO:teuthology.orchestra.run.smithi044.stdout: "get_started": 0, 2024-09-12T02:49:28.914 INFO:teuthology.orchestra.run.smithi044.stdout: "get": 0, 2024-09-12T02:49:28.914 INFO:teuthology.orchestra.run.smithi044.stdout: "get_sum": 0, 2024-09-12T02:49:28.914 INFO:teuthology.orchestra.run.smithi044.stdout: "get_or_fail_fail": 0, 2024-09-12T02:49:28.914 INFO:teuthology.orchestra.run.smithi044.stdout: "get_or_fail_success": 0, 2024-09-12T02:49:28.914 INFO:teuthology.orchestra.run.smithi044.stdout: "take": 0, 2024-09-12T02:49:28.914 INFO:teuthology.orchestra.run.smithi044.stdout: "take_sum": 0, 2024-09-12T02:49:28.914 INFO:teuthology.orchestra.run.smithi044.stdout: "put": 0, 2024-09-12T02:49:28.914 INFO:teuthology.orchestra.run.smithi044.stdout: "put_sum": 0, 2024-09-12T02:49:28.914 INFO:teuthology.orchestra.run.smithi044.stdout: "wait": { 2024-09-12T02:49:28.914 INFO:teuthology.orchestra.run.smithi044.stdout: "avgcount": 0, 2024-09-12T02:49:28.914 INFO:teuthology.orchestra.run.smithi044.stdout: "sum": 0.000000000, 2024-09-12T02:49:28.915 INFO:teuthology.orchestra.run.smithi044.stdout: "avgtime": 0.000000000 2024-09-12T02:49:28.915 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-09-12T02:49:28.915 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-09-12T02:49:28.915 INFO:teuthology.orchestra.run.smithi044.stdout:} 2024-09-12T02:49:29.703 INFO:tasks.check_counter:Daemon mds.k mds.exported=0 2024-09-12T02:49:29.703 INFO:tasks.check_counter:Daemon mds.k mds.imported=0 2024-09-12T02:49:29.703 INFO:tasks.check_counter:Daemon mds.k mds_cache.dir_update=0 2024-09-12T02:49:29.703 INFO:tasks.check_counter:Daemon mds.k mds_cache.dir_update_receipt=0 2024-09-12T02:49:29.703 INFO:tasks.check_counter:Daemon mds.k mds.root_rsnaps=0 2024-09-12T02:49:29.703 INFO:tasks.check_counter:Daemon mds.k mds_server.req_mksnap_latency.avgcount=0 2024-09-12T02:49:29.703 INFO:tasks.check_counter:Daemon mds.k mds_server.req_rmsnap_latency.avgcount=0 2024-09-12T02:49:29.703 DEBUG:tasks.check_counter:Getting stats from c 2024-09-12T02:49:29.704 DEBUG:teuthology.orchestra.run.smithi172:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc shell --fsid 4954ed46-70ae-11ef-bcea-c7b262605968 -- ceph daemon mds.c perf dump 2024-09-12T02:49:29.948 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 12 02:49:29 smithi044 ceph-mon[35411]: pgmap v361: 129 pgs: 129 active+clean; 24 MiB data, 494 MiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 11 KiB/s wr, 13 op/s 2024-09-12T02:49:29.964 INFO:teuthology.orchestra.run.smithi172.stderr:Inferring config /var/lib/ceph/4954ed46-70ae-11ef-bcea-c7b262605968/mon.c/config 2024-09-12T02:49:30.013 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 12 02:49:29 smithi172 ceph-mon[35609]: pgmap v361: 129 pgs: 129 active+clean; 24 MiB data, 494 MiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 11 KiB/s wr, 13 op/s 2024-09-12T02:49:30.100 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 02:49:29 smithi039 ceph-mon[30515]: pgmap v361: 129 pgs: 129 active+clean; 24 MiB data, 494 MiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 11 KiB/s wr, 13 op/s 2024-09-12T02:49:30.429 INFO:teuthology.orchestra.run.smithi172.stdout:{ 2024-09-12T02:49:30.429 INFO:teuthology.orchestra.run.smithi172.stdout: "AsyncMessenger::Worker-0": { 2024-09-12T02:49:30.429 INFO:teuthology.orchestra.run.smithi172.stdout: "msgr_recv_messages": 793, 2024-09-12T02:49:30.429 INFO:teuthology.orchestra.run.smithi172.stdout: "msgr_send_messages": 659, 2024-09-12T02:49:30.429 INFO:teuthology.orchestra.run.smithi172.stdout: "msgr_recv_bytes": 246365, 2024-09-12T02:49:30.429 INFO:teuthology.orchestra.run.smithi172.stdout: "msgr_send_bytes": 368238, 2024-09-12T02:49:30.429 INFO:teuthology.orchestra.run.smithi172.stdout: "msgr_created_connections": 8, 2024-09-12T02:49:30.429 INFO:teuthology.orchestra.run.smithi172.stdout: "msgr_active_connections": 3, 2024-09-12T02:49:30.429 INFO:teuthology.orchestra.run.smithi172.stdout: "msgr_running_total_time": 0.076697096, 2024-09-12T02:49:30.429 INFO:teuthology.orchestra.run.smithi172.stdout: "msgr_running_send_time": 0.030154619, 2024-09-12T02:49:30.429 INFO:teuthology.orchestra.run.smithi172.stdout: "msgr_running_recv_time": 0.044439429, 2024-09-12T02:49:30.430 INFO:teuthology.orchestra.run.smithi172.stdout: "msgr_running_fast_dispatch_time": 0.005622399, 2024-09-12T02:49:30.430 INFO:teuthology.orchestra.run.smithi172.stdout: "msgr_send_messages_queue_lat": { 2024-09-12T02:49:30.430 INFO:teuthology.orchestra.run.smithi172.stdout: "avgcount": 657, 2024-09-12T02:49:30.430 INFO:teuthology.orchestra.run.smithi172.stdout: "sum": 0.040689719, 2024-09-12T02:49:30.430 INFO:teuthology.orchestra.run.smithi172.stdout: "avgtime": 0.000061932 2024-09-12T02:49:30.430 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-09-12T02:49:30.430 INFO:teuthology.orchestra.run.smithi172.stdout: "msgr_handle_ack_lat": { 2024-09-12T02:49:30.430 INFO:teuthology.orchestra.run.smithi172.stdout: "avgcount": 1406, 2024-09-12T02:49:30.430 INFO:teuthology.orchestra.run.smithi172.stdout: "sum": 0.000351109, 2024-09-12T02:49:30.430 INFO:teuthology.orchestra.run.smithi172.stdout: "avgtime": 0.000000249 2024-09-12T02:49:30.430 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-09-12T02:49:30.430 INFO:teuthology.orchestra.run.smithi172.stdout: "msgr_recv_encrypted_bytes": 0, 2024-09-12T02:49:30.430 INFO:teuthology.orchestra.run.smithi172.stdout: "msgr_send_encrypted_bytes": 0 2024-09-12T02:49:30.430 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-09-12T02:49:30.431 INFO:teuthology.orchestra.run.smithi172.stdout: "AsyncMessenger::Worker-1": { 2024-09-12T02:49:30.431 INFO:teuthology.orchestra.run.smithi172.stdout: "msgr_recv_messages": 343, 2024-09-12T02:49:30.431 INFO:teuthology.orchestra.run.smithi172.stdout: "msgr_send_messages": 357, 2024-09-12T02:49:30.431 INFO:teuthology.orchestra.run.smithi172.stdout: "msgr_recv_bytes": 1800930, 2024-09-12T02:49:30.431 INFO:teuthology.orchestra.run.smithi172.stdout: "msgr_send_bytes": 195872, 2024-09-12T02:49:30.431 INFO:teuthology.orchestra.run.smithi172.stdout: "msgr_created_connections": 9, 2024-09-12T02:49:30.431 INFO:teuthology.orchestra.run.smithi172.stdout: "msgr_active_connections": 7, 2024-09-12T02:49:30.431 INFO:teuthology.orchestra.run.smithi172.stdout: "msgr_running_total_time": 0.062890596, 2024-09-12T02:49:30.431 INFO:teuthology.orchestra.run.smithi172.stdout: "msgr_running_send_time": 0.022402838, 2024-09-12T02:49:30.431 INFO:teuthology.orchestra.run.smithi172.stdout: "msgr_running_recv_time": 0.058762088, 2024-09-12T02:49:30.431 INFO:teuthology.orchestra.run.smithi172.stdout: "msgr_running_fast_dispatch_time": 0.000263490, 2024-09-12T02:49:30.431 INFO:teuthology.orchestra.run.smithi172.stdout: "msgr_send_messages_queue_lat": { 2024-09-12T02:49:30.431 INFO:teuthology.orchestra.run.smithi172.stdout: "avgcount": 357, 2024-09-12T02:49:30.432 INFO:teuthology.orchestra.run.smithi172.stdout: "sum": 0.033417483, 2024-09-12T02:49:30.432 INFO:teuthology.orchestra.run.smithi172.stdout: "avgtime": 0.000093606 2024-09-12T02:49:30.432 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-09-12T02:49:30.432 INFO:teuthology.orchestra.run.smithi172.stdout: "msgr_handle_ack_lat": { 2024-09-12T02:49:30.432 INFO:teuthology.orchestra.run.smithi172.stdout: "avgcount": 49, 2024-09-12T02:49:30.432 INFO:teuthology.orchestra.run.smithi172.stdout: "sum": 0.000025736, 2024-09-12T02:49:30.432 INFO:teuthology.orchestra.run.smithi172.stdout: "avgtime": 0.000000525 2024-09-12T02:49:30.432 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-09-12T02:49:30.432 INFO:teuthology.orchestra.run.smithi172.stdout: "msgr_recv_encrypted_bytes": 1794320, 2024-09-12T02:49:30.432 INFO:teuthology.orchestra.run.smithi172.stdout: "msgr_send_encrypted_bytes": 158064 2024-09-12T02:49:30.432 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-09-12T02:49:30.432 INFO:teuthology.orchestra.run.smithi172.stdout: "AsyncMessenger::Worker-2": { 2024-09-12T02:49:30.432 INFO:teuthology.orchestra.run.smithi172.stdout: "msgr_recv_messages": 29, 2024-09-12T02:49:30.432 INFO:teuthology.orchestra.run.smithi172.stdout: "msgr_send_messages": 228, 2024-09-12T02:49:30.433 INFO:teuthology.orchestra.run.smithi172.stdout: "msgr_recv_bytes": 6526, 2024-09-12T02:49:30.433 INFO:teuthology.orchestra.run.smithi172.stdout: "msgr_send_bytes": 510990, 2024-09-12T02:49:30.433 INFO:teuthology.orchestra.run.smithi172.stdout: "msgr_created_connections": 11, 2024-09-12T02:49:30.433 INFO:teuthology.orchestra.run.smithi172.stdout: "msgr_active_connections": 6, 2024-09-12T02:49:30.433 INFO:teuthology.orchestra.run.smithi172.stdout: "msgr_running_total_time": 0.017248219, 2024-09-12T02:49:30.433 INFO:teuthology.orchestra.run.smithi172.stdout: "msgr_running_send_time": 0.009000570, 2024-09-12T02:49:30.433 INFO:teuthology.orchestra.run.smithi172.stdout: "msgr_running_recv_time": 0.005349259, 2024-09-12T02:49:30.433 INFO:teuthology.orchestra.run.smithi172.stdout: "msgr_running_fast_dispatch_time": 0.000764810, 2024-09-12T02:49:30.433 INFO:teuthology.orchestra.run.smithi172.stdout: "msgr_send_messages_queue_lat": { 2024-09-12T02:49:30.433 INFO:teuthology.orchestra.run.smithi172.stdout: "avgcount": 225, 2024-09-12T02:49:30.433 INFO:teuthology.orchestra.run.smithi172.stdout: "sum": 0.041564515, 2024-09-12T02:49:30.433 INFO:teuthology.orchestra.run.smithi172.stdout: "avgtime": 0.000184731 2024-09-12T02:49:30.433 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-09-12T02:49:30.434 INFO:teuthology.orchestra.run.smithi172.stdout: "msgr_handle_ack_lat": { 2024-09-12T02:49:30.434 INFO:teuthology.orchestra.run.smithi172.stdout: "avgcount": 38, 2024-09-12T02:49:30.434 INFO:teuthology.orchestra.run.smithi172.stdout: "sum": 0.000008705, 2024-09-12T02:49:30.434 INFO:teuthology.orchestra.run.smithi172.stdout: "avgtime": 0.000000229 2024-09-12T02:49:30.434 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-09-12T02:49:30.434 INFO:teuthology.orchestra.run.smithi172.stdout: "msgr_recv_encrypted_bytes": 2048, 2024-09-12T02:49:30.434 INFO:teuthology.orchestra.run.smithi172.stdout: "msgr_send_encrypted_bytes": 477968 2024-09-12T02:49:30.434 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-09-12T02:49:30.434 INFO:teuthology.orchestra.run.smithi172.stdout: "cct": { 2024-09-12T02:49:30.434 INFO:teuthology.orchestra.run.smithi172.stdout: "total_workers": 1, 2024-09-12T02:49:30.434 INFO:teuthology.orchestra.run.smithi172.stdout: "unhealthy_workers": 0 2024-09-12T02:49:30.434 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-09-12T02:49:30.434 INFO:teuthology.orchestra.run.smithi172.stdout: "finisher-MDSRank": { 2024-09-12T02:49:30.435 INFO:teuthology.orchestra.run.smithi172.stdout: "queue_len": 0, 2024-09-12T02:49:30.435 INFO:teuthology.orchestra.run.smithi172.stdout: "complete_latency": { 2024-09-12T02:49:30.435 INFO:teuthology.orchestra.run.smithi172.stdout: "avgcount": 54, 2024-09-12T02:49:30.435 INFO:teuthology.orchestra.run.smithi172.stdout: "sum": 0.001782155, 2024-09-12T02:49:30.435 INFO:teuthology.orchestra.run.smithi172.stdout: "avgtime": 0.000033002 2024-09-12T02:49:30.435 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-09-12T02:49:30.435 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-09-12T02:49:30.435 INFO:teuthology.orchestra.run.smithi172.stdout: "finisher-PurgeQueue": { 2024-09-12T02:49:30.435 INFO:teuthology.orchestra.run.smithi172.stdout: "queue_len": 0, 2024-09-12T02:49:30.435 INFO:teuthology.orchestra.run.smithi172.stdout: "complete_latency": { 2024-09-12T02:49:30.435 INFO:teuthology.orchestra.run.smithi172.stdout: "avgcount": 2, 2024-09-12T02:49:30.435 INFO:teuthology.orchestra.run.smithi172.stdout: "sum": 0.000019800, 2024-09-12T02:49:30.435 INFO:teuthology.orchestra.run.smithi172.stdout: "avgtime": 0.000009900 2024-09-12T02:49:30.436 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-09-12T02:49:30.436 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-09-12T02:49:30.436 INFO:teuthology.orchestra.run.smithi172.stdout: "mds": { 2024-09-12T02:49:30.436 INFO:teuthology.orchestra.run.smithi172.stdout: "request": 4, 2024-09-12T02:49:30.436 INFO:teuthology.orchestra.run.smithi172.stdout: "reply": 2, 2024-09-12T02:49:30.436 INFO:teuthology.orchestra.run.smithi172.stdout: "reply_latency": { 2024-09-12T02:49:30.436 INFO:teuthology.orchestra.run.smithi172.stdout: "avgcount": 2, 2024-09-12T02:49:30.436 INFO:teuthology.orchestra.run.smithi172.stdout: "sum": 0.000294331, 2024-09-12T02:49:30.436 INFO:teuthology.orchestra.run.smithi172.stdout: "avgtime": 0.000147165 2024-09-12T02:49:30.436 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-09-12T02:49:30.436 INFO:teuthology.orchestra.run.smithi172.stdout: "slow_reply": 0, 2024-09-12T02:49:30.436 INFO:teuthology.orchestra.run.smithi172.stdout: "forward": 2, 2024-09-12T02:49:30.436 INFO:teuthology.orchestra.run.smithi172.stdout: "dir_fetch_complete": 0, 2024-09-12T02:49:30.437 INFO:teuthology.orchestra.run.smithi172.stdout: "dir_fetch_keys": 0, 2024-09-12T02:49:30.437 INFO:teuthology.orchestra.run.smithi172.stdout: "dir_commit": 11, 2024-09-12T02:49:30.437 INFO:teuthology.orchestra.run.smithi172.stdout: "dir_split": 0, 2024-09-12T02:49:30.437 INFO:teuthology.orchestra.run.smithi172.stdout: "dir_merge": 0, 2024-09-12T02:49:30.437 INFO:teuthology.orchestra.run.smithi172.stdout: "inodes": 16, 2024-09-12T02:49:30.437 INFO:teuthology.orchestra.run.smithi172.stdout: "inodes_top": 0, 2024-09-12T02:49:30.437 INFO:teuthology.orchestra.run.smithi172.stdout: "inodes_bottom": 16, 2024-09-12T02:49:30.437 INFO:teuthology.orchestra.run.smithi172.stdout: "inodes_pin_tail": 0, 2024-09-12T02:49:30.437 INFO:teuthology.orchestra.run.smithi172.stdout: "inodes_pinned": 13, 2024-09-12T02:49:30.437 INFO:teuthology.orchestra.run.smithi172.stdout: "inodes_expired": 4, 2024-09-12T02:49:30.437 INFO:teuthology.orchestra.run.smithi172.stdout: "inodes_with_caps": 1, 2024-09-12T02:49:30.437 INFO:teuthology.orchestra.run.smithi172.stdout: "caps": 1, 2024-09-12T02:49:30.437 INFO:teuthology.orchestra.run.smithi172.stdout: "subtrees": 3, 2024-09-12T02:49:30.438 INFO:teuthology.orchestra.run.smithi172.stdout: "traverse": 11, 2024-09-12T02:49:30.438 INFO:teuthology.orchestra.run.smithi172.stdout: "traverse_hit": 5, 2024-09-12T02:49:30.438 INFO:teuthology.orchestra.run.smithi172.stdout: "traverse_forward": 1, 2024-09-12T02:49:30.438 INFO:teuthology.orchestra.run.smithi172.stdout: "traverse_discover": 4, 2024-09-12T02:49:30.438 INFO:teuthology.orchestra.run.smithi172.stdout: "traverse_dir_fetch": 0, 2024-09-12T02:49:30.438 INFO:teuthology.orchestra.run.smithi172.stdout: "traverse_remote_ino": 0, 2024-09-12T02:49:30.438 INFO:teuthology.orchestra.run.smithi172.stdout: "traverse_lock": 0, 2024-09-12T02:49:30.438 INFO:teuthology.orchestra.run.smithi172.stdout: "load_cent": 0, 2024-09-12T02:49:30.438 INFO:teuthology.orchestra.run.smithi172.stdout: "q": 0, 2024-09-12T02:49:30.438 INFO:teuthology.orchestra.run.smithi172.stdout: "exported": 0, 2024-09-12T02:49:30.438 INFO:teuthology.orchestra.run.smithi172.stdout: "exported_inodes": 0, 2024-09-12T02:49:30.438 INFO:teuthology.orchestra.run.smithi172.stdout: "imported": 0, 2024-09-12T02:49:30.438 INFO:teuthology.orchestra.run.smithi172.stdout: "imported_inodes": 0, 2024-09-12T02:49:30.438 INFO:teuthology.orchestra.run.smithi172.stdout: "openino_dir_fetch": 0, 2024-09-12T02:49:30.439 INFO:teuthology.orchestra.run.smithi172.stdout: "openino_backtrace_fetch": 0, 2024-09-12T02:49:30.439 INFO:teuthology.orchestra.run.smithi172.stdout: "openino_peer_discover": 0, 2024-09-12T02:49:30.439 INFO:teuthology.orchestra.run.smithi172.stdout: "root_rfiles": 4, 2024-09-12T02:49:30.439 INFO:teuthology.orchestra.run.smithi172.stdout: "root_rbytes": 234, 2024-09-12T02:49:30.439 INFO:teuthology.orchestra.run.smithi172.stdout: "root_rsnaps": 6, 2024-09-12T02:49:30.439 INFO:teuthology.orchestra.run.smithi172.stdout: "scrub_backtrace_fetch": 0, 2024-09-12T02:49:30.439 INFO:teuthology.orchestra.run.smithi172.stdout: "scrub_set_tag": 0, 2024-09-12T02:49:30.439 INFO:teuthology.orchestra.run.smithi172.stdout: "scrub_backtrace_repaired": 0, 2024-09-12T02:49:30.439 INFO:teuthology.orchestra.run.smithi172.stdout: "scrub_inotable_repaired": 0, 2024-09-12T02:49:30.439 INFO:teuthology.orchestra.run.smithi172.stdout: "scrub_dir_inodes": 0, 2024-09-12T02:49:30.439 INFO:teuthology.orchestra.run.smithi172.stdout: "scrub_dir_base_inodes": 0, 2024-09-12T02:49:30.439 INFO:teuthology.orchestra.run.smithi172.stdout: "scrub_dirfrag_rstats": 0, 2024-09-12T02:49:30.439 INFO:teuthology.orchestra.run.smithi172.stdout: "scrub_file_inodes": 0, 2024-09-12T02:49:30.439 INFO:teuthology.orchestra.run.smithi172.stdout: "handle_inode_file_caps": 0, 2024-09-12T02:49:30.440 INFO:teuthology.orchestra.run.smithi172.stdout: "ceph_cap_op_revoke": 0, 2024-09-12T02:49:30.440 INFO:teuthology.orchestra.run.smithi172.stdout: "ceph_cap_op_grant": 0, 2024-09-12T02:49:30.440 INFO:teuthology.orchestra.run.smithi172.stdout: "ceph_cap_op_trunc": 0, 2024-09-12T02:49:30.440 INFO:teuthology.orchestra.run.smithi172.stdout: "ceph_cap_op_flushsnap_ack": 0, 2024-09-12T02:49:30.440 INFO:teuthology.orchestra.run.smithi172.stdout: "ceph_cap_op_flush_ack": 0, 2024-09-12T02:49:30.440 INFO:teuthology.orchestra.run.smithi172.stdout: "handle_client_caps": 0, 2024-09-12T02:49:30.440 INFO:teuthology.orchestra.run.smithi172.stdout: "handle_client_caps_dirty": 0, 2024-09-12T02:49:30.440 INFO:teuthology.orchestra.run.smithi172.stdout: "handle_client_cap_release": 0, 2024-09-12T02:49:30.440 INFO:teuthology.orchestra.run.smithi172.stdout: "process_request_cap_release": 1 2024-09-12T02:49:30.440 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-09-12T02:49:30.440 INFO:teuthology.orchestra.run.smithi172.stdout: "mds_cache": { 2024-09-12T02:49:30.440 INFO:teuthology.orchestra.run.smithi172.stdout: "dir_update": 0, 2024-09-12T02:49:30.440 INFO:teuthology.orchestra.run.smithi172.stdout: "dir_update_receipt": 9, 2024-09-12T02:49:30.440 INFO:teuthology.orchestra.run.smithi172.stdout: "dir_try_discover": 6, 2024-09-12T02:49:30.441 INFO:teuthology.orchestra.run.smithi172.stdout: "dir_send_discover": 8, 2024-09-12T02:49:30.441 INFO:teuthology.orchestra.run.smithi172.stdout: "dir_handle_discover": 0, 2024-09-12T02:49:30.441 INFO:teuthology.orchestra.run.smithi172.stdout: "num_strays": 0, 2024-09-12T02:49:30.441 INFO:teuthology.orchestra.run.smithi172.stdout: "num_strays_delayed": 0, 2024-09-12T02:49:30.441 INFO:teuthology.orchestra.run.smithi172.stdout: "num_strays_enqueuing": 0, 2024-09-12T02:49:30.441 INFO:teuthology.orchestra.run.smithi172.stdout: "strays_created": 0, 2024-09-12T02:49:30.441 INFO:teuthology.orchestra.run.smithi172.stdout: "strays_enqueued": 0, 2024-09-12T02:49:30.441 INFO:teuthology.orchestra.run.smithi172.stdout: "strays_reintegrated": 0, 2024-09-12T02:49:30.441 INFO:teuthology.orchestra.run.smithi172.stdout: "strays_migrated": 0, 2024-09-12T02:49:30.441 INFO:teuthology.orchestra.run.smithi172.stdout: "num_recovering_processing": 0, 2024-09-12T02:49:30.441 INFO:teuthology.orchestra.run.smithi172.stdout: "num_recovering_enqueued": 0, 2024-09-12T02:49:30.441 INFO:teuthology.orchestra.run.smithi172.stdout: "num_recovering_prioritized": 0, 2024-09-12T02:49:30.441 INFO:teuthology.orchestra.run.smithi172.stdout: "recovery_started": 0, 2024-09-12T02:49:30.441 INFO:teuthology.orchestra.run.smithi172.stdout: "recovery_completed": 0, 2024-09-12T02:49:30.442 INFO:teuthology.orchestra.run.smithi172.stdout: "ireq_quiesce_path": 0, 2024-09-12T02:49:30.442 INFO:teuthology.orchestra.run.smithi172.stdout: "ireq_quiesce_inode": 0, 2024-09-12T02:49:30.442 INFO:teuthology.orchestra.run.smithi172.stdout: "ireq_enqueue_scrub": 0, 2024-09-12T02:49:30.442 INFO:teuthology.orchestra.run.smithi172.stdout: "ireq_exportdir": 0, 2024-09-12T02:49:30.442 INFO:teuthology.orchestra.run.smithi172.stdout: "ireq_flush": 0, 2024-09-12T02:49:30.442 INFO:teuthology.orchestra.run.smithi172.stdout: "ireq_fragmentdir": 0, 2024-09-12T02:49:30.442 INFO:teuthology.orchestra.run.smithi172.stdout: "ireq_fragstats": 0, 2024-09-12T02:49:30.442 INFO:teuthology.orchestra.run.smithi172.stdout: "ireq_inodestats": 0 2024-09-12T02:49:30.442 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-09-12T02:49:30.442 INFO:teuthology.orchestra.run.smithi172.stdout: "mds_log": { 2024-09-12T02:49:30.442 INFO:teuthology.orchestra.run.smithi172.stdout: "evlrg": 0, 2024-09-12T02:49:30.442 INFO:teuthology.orchestra.run.smithi172.stdout: "evadd": 6, 2024-09-12T02:49:30.442 INFO:teuthology.orchestra.run.smithi172.stdout: "evex": 0, 2024-09-12T02:49:30.442 INFO:teuthology.orchestra.run.smithi172.stdout: "evtrm": 0, 2024-09-12T02:49:30.443 INFO:teuthology.orchestra.run.smithi172.stdout: "ev": 6, 2024-09-12T02:49:30.443 INFO:teuthology.orchestra.run.smithi172.stdout: "evexg": 0, 2024-09-12T02:49:30.443 INFO:teuthology.orchestra.run.smithi172.stdout: "evexd": 0, 2024-09-12T02:49:30.443 INFO:teuthology.orchestra.run.smithi172.stdout: "segadd": 2, 2024-09-12T02:49:30.443 INFO:teuthology.orchestra.run.smithi172.stdout: "segex": 0, 2024-09-12T02:49:30.443 INFO:teuthology.orchestra.run.smithi172.stdout: "segtrm": 0, 2024-09-12T02:49:30.443 INFO:teuthology.orchestra.run.smithi172.stdout: "seg": 2, 2024-09-12T02:49:30.443 INFO:teuthology.orchestra.run.smithi172.stdout: "segmjr": 2, 2024-09-12T02:49:30.443 INFO:teuthology.orchestra.run.smithi172.stdout: "segexg": 0, 2024-09-12T02:49:30.443 INFO:teuthology.orchestra.run.smithi172.stdout: "segexd": 0, 2024-09-12T02:49:30.443 INFO:teuthology.orchestra.run.smithi172.stdout: "expos": 4194304, 2024-09-12T02:49:30.443 INFO:teuthology.orchestra.run.smithi172.stdout: "wrpos": 4196130, 2024-09-12T02:49:30.443 INFO:teuthology.orchestra.run.smithi172.stdout: "rdpos": 0, 2024-09-12T02:49:30.444 INFO:teuthology.orchestra.run.smithi172.stdout: "jlat": { 2024-09-12T02:49:30.444 INFO:teuthology.orchestra.run.smithi172.stdout: "avgcount": 5, 2024-09-12T02:49:30.444 INFO:teuthology.orchestra.run.smithi172.stdout: "sum": 0.032998372, 2024-09-12T02:49:30.444 INFO:teuthology.orchestra.run.smithi172.stdout: "avgtime": 0.006599674 2024-09-12T02:49:30.444 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-09-12T02:49:30.444 INFO:teuthology.orchestra.run.smithi172.stdout: "replayed": 0 2024-09-12T02:49:30.444 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-09-12T02:49:30.444 INFO:teuthology.orchestra.run.smithi172.stdout: "mds_mem": { 2024-09-12T02:49:30.444 INFO:teuthology.orchestra.run.smithi172.stdout: "ino": 20, 2024-09-12T02:49:30.444 INFO:teuthology.orchestra.run.smithi172.stdout: "ino+": 22, 2024-09-12T02:49:30.444 INFO:teuthology.orchestra.run.smithi172.stdout: "ino-": 2, 2024-09-12T02:49:30.444 INFO:teuthology.orchestra.run.smithi172.stdout: "dir": 19, 2024-09-12T02:49:30.444 INFO:teuthology.orchestra.run.smithi172.stdout: "dir+": 22, 2024-09-12T02:49:30.445 INFO:teuthology.orchestra.run.smithi172.stdout: "dir-": 3, 2024-09-12T02:49:30.445 INFO:teuthology.orchestra.run.smithi172.stdout: "dn": 16, 2024-09-12T02:49:30.445 INFO:teuthology.orchestra.run.smithi172.stdout: "dn+": 20, 2024-09-12T02:49:30.445 INFO:teuthology.orchestra.run.smithi172.stdout: "dn-": 4, 2024-09-12T02:49:30.445 INFO:teuthology.orchestra.run.smithi172.stdout: "cap": 1, 2024-09-12T02:49:30.445 INFO:teuthology.orchestra.run.smithi172.stdout: "cap+": 2, 2024-09-12T02:49:30.445 INFO:teuthology.orchestra.run.smithi172.stdout: "cap-": 1, 2024-09-12T02:49:30.445 INFO:teuthology.orchestra.run.smithi172.stdout: "rss": 50032, 2024-09-12T02:49:30.445 INFO:teuthology.orchestra.run.smithi172.stdout: "heap": 223520 2024-09-12T02:49:30.445 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-09-12T02:49:30.446 INFO:teuthology.orchestra.run.smithi172.stdout: "mds_server": { 2024-09-12T02:49:30.446 INFO:teuthology.orchestra.run.smithi172.stdout: "dispatch_client_request": 5, 2024-09-12T02:49:30.446 INFO:teuthology.orchestra.run.smithi172.stdout: "dispatch_server_request": 0, 2024-09-12T02:49:30.446 INFO:teuthology.orchestra.run.smithi172.stdout: "handle_client_request": 4, 2024-09-12T02:49:30.446 INFO:teuthology.orchestra.run.smithi172.stdout: "handle_client_session": 23, 2024-09-12T02:49:30.446 INFO:teuthology.orchestra.run.smithi172.stdout: "handle_peer_request": 0, 2024-09-12T02:49:30.446 INFO:teuthology.orchestra.run.smithi172.stdout: "req_create_latency": { 2024-09-12T02:49:30.446 INFO:teuthology.orchestra.run.smithi172.stdout: "avgcount": 0, 2024-09-12T02:49:30.446 INFO:teuthology.orchestra.run.smithi172.stdout: "sum": 0.000000000, 2024-09-12T02:49:30.446 INFO:teuthology.orchestra.run.smithi172.stdout: "avgtime": 0.000000000 2024-09-12T02:49:30.446 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-09-12T02:49:30.446 INFO:teuthology.orchestra.run.smithi172.stdout: "req_getattr_latency": { 2024-09-12T02:49:30.446 INFO:teuthology.orchestra.run.smithi172.stdout: "avgcount": 1, 2024-09-12T02:49:30.447 INFO:teuthology.orchestra.run.smithi172.stdout: "sum": 0.000185533, 2024-09-12T02:49:30.447 INFO:teuthology.orchestra.run.smithi172.stdout: "avgtime": 0.000185533 2024-09-12T02:49:30.447 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-09-12T02:49:30.447 INFO:teuthology.orchestra.run.smithi172.stdout: "req_getfilelock_latency": { 2024-09-12T02:49:30.447 INFO:teuthology.orchestra.run.smithi172.stdout: "avgcount": 0, 2024-09-12T02:49:30.447 INFO:teuthology.orchestra.run.smithi172.stdout: "sum": 0.000000000, 2024-09-12T02:49:30.447 INFO:teuthology.orchestra.run.smithi172.stdout: "avgtime": 0.000000000 2024-09-12T02:49:30.447 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-09-12T02:49:30.447 INFO:teuthology.orchestra.run.smithi172.stdout: "req_link_latency": { 2024-09-12T02:49:30.447 INFO:teuthology.orchestra.run.smithi172.stdout: "avgcount": 0, 2024-09-12T02:49:30.447 INFO:teuthology.orchestra.run.smithi172.stdout: "sum": 0.000000000, 2024-09-12T02:49:30.447 INFO:teuthology.orchestra.run.smithi172.stdout: "avgtime": 0.000000000 2024-09-12T02:49:30.447 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-09-12T02:49:30.447 INFO:teuthology.orchestra.run.smithi172.stdout: "req_lookup_latency": { 2024-09-12T02:49:30.448 INFO:teuthology.orchestra.run.smithi172.stdout: "avgcount": 0, 2024-09-12T02:49:30.448 INFO:teuthology.orchestra.run.smithi172.stdout: "sum": 0.000000000, 2024-09-12T02:49:30.448 INFO:teuthology.orchestra.run.smithi172.stdout: "avgtime": 0.000000000 2024-09-12T02:49:30.448 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-09-12T02:49:30.448 INFO:teuthology.orchestra.run.smithi172.stdout: "req_lookuphash_latency": { 2024-09-12T02:49:30.448 INFO:teuthology.orchestra.run.smithi172.stdout: "avgcount": 0, 2024-09-12T02:49:30.448 INFO:teuthology.orchestra.run.smithi172.stdout: "sum": 0.000000000, 2024-09-12T02:49:30.448 INFO:teuthology.orchestra.run.smithi172.stdout: "avgtime": 0.000000000 2024-09-12T02:49:30.448 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-09-12T02:49:30.448 INFO:teuthology.orchestra.run.smithi172.stdout: "req_lookupino_latency": { 2024-09-12T02:49:30.448 INFO:teuthology.orchestra.run.smithi172.stdout: "avgcount": 1, 2024-09-12T02:49:30.448 INFO:teuthology.orchestra.run.smithi172.stdout: "sum": 0.000108798, 2024-09-12T02:49:30.448 INFO:teuthology.orchestra.run.smithi172.stdout: "avgtime": 0.000108798 2024-09-12T02:49:30.448 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-09-12T02:49:30.449 INFO:teuthology.orchestra.run.smithi172.stdout: "req_lookupname_latency": { 2024-09-12T02:49:30.449 INFO:teuthology.orchestra.run.smithi172.stdout: "avgcount": 0, 2024-09-12T02:49:30.449 INFO:teuthology.orchestra.run.smithi172.stdout: "sum": 0.000000000, 2024-09-12T02:49:30.449 INFO:teuthology.orchestra.run.smithi172.stdout: "avgtime": 0.000000000 2024-09-12T02:49:30.449 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-09-12T02:49:30.449 INFO:teuthology.orchestra.run.smithi172.stdout: "req_lookupparent_latency": { 2024-09-12T02:49:30.449 INFO:teuthology.orchestra.run.smithi172.stdout: "avgcount": 0, 2024-09-12T02:49:30.449 INFO:teuthology.orchestra.run.smithi172.stdout: "sum": 0.000000000, 2024-09-12T02:49:30.449 INFO:teuthology.orchestra.run.smithi172.stdout: "avgtime": 0.000000000 2024-09-12T02:49:30.449 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-09-12T02:49:30.449 INFO:teuthology.orchestra.run.smithi172.stdout: "req_lookupsnap_latency": { 2024-09-12T02:49:30.449 INFO:teuthology.orchestra.run.smithi172.stdout: "avgcount": 0, 2024-09-12T02:49:30.449 INFO:teuthology.orchestra.run.smithi172.stdout: "sum": 0.000000000, 2024-09-12T02:49:30.449 INFO:teuthology.orchestra.run.smithi172.stdout: "avgtime": 0.000000000 2024-09-12T02:49:30.450 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-09-12T02:49:30.450 INFO:teuthology.orchestra.run.smithi172.stdout: "req_lssnap_latency": { 2024-09-12T02:49:30.450 INFO:teuthology.orchestra.run.smithi172.stdout: "avgcount": 0, 2024-09-12T02:49:30.450 INFO:teuthology.orchestra.run.smithi172.stdout: "sum": 0.000000000, 2024-09-12T02:49:30.450 INFO:teuthology.orchestra.run.smithi172.stdout: "avgtime": 0.000000000 2024-09-12T02:49:30.450 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-09-12T02:49:30.450 INFO:teuthology.orchestra.run.smithi172.stdout: "req_mkdir_latency": { 2024-09-12T02:49:30.450 INFO:teuthology.orchestra.run.smithi172.stdout: "avgcount": 0, 2024-09-12T02:49:30.451 INFO:teuthology.orchestra.run.smithi172.stdout: "sum": 0.000000000, 2024-09-12T02:49:30.451 INFO:teuthology.orchestra.run.smithi172.stdout: "avgtime": 0.000000000 2024-09-12T02:49:30.451 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-09-12T02:49:30.451 INFO:teuthology.orchestra.run.smithi172.stdout: "req_mknod_latency": { 2024-09-12T02:49:30.451 INFO:teuthology.orchestra.run.smithi172.stdout: "avgcount": 0, 2024-09-12T02:49:30.451 INFO:teuthology.orchestra.run.smithi172.stdout: "sum": 0.000000000, 2024-09-12T02:49:30.451 INFO:teuthology.orchestra.run.smithi172.stdout: "avgtime": 0.000000000 2024-09-12T02:49:30.451 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-09-12T02:49:30.451 INFO:teuthology.orchestra.run.smithi172.stdout: "req_mksnap_latency": { 2024-09-12T02:49:30.451 INFO:teuthology.orchestra.run.smithi172.stdout: "avgcount": 0, 2024-09-12T02:49:30.451 INFO:teuthology.orchestra.run.smithi172.stdout: "sum": 0.000000000, 2024-09-12T02:49:30.452 INFO:teuthology.orchestra.run.smithi172.stdout: "avgtime": 0.000000000 2024-09-12T02:49:30.452 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-09-12T02:49:30.452 INFO:teuthology.orchestra.run.smithi172.stdout: "req_open_latency": { 2024-09-12T02:49:30.452 INFO:teuthology.orchestra.run.smithi172.stdout: "avgcount": 0, 2024-09-12T02:49:30.452 INFO:teuthology.orchestra.run.smithi172.stdout: "sum": 0.000000000, 2024-09-12T02:49:30.452 INFO:teuthology.orchestra.run.smithi172.stdout: "avgtime": 0.000000000 2024-09-12T02:49:30.452 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-09-12T02:49:30.452 INFO:teuthology.orchestra.run.smithi172.stdout: "req_readdir_latency": { 2024-09-12T02:49:30.452 INFO:teuthology.orchestra.run.smithi172.stdout: "avgcount": 0, 2024-09-12T02:49:30.452 INFO:teuthology.orchestra.run.smithi172.stdout: "sum": 0.000000000, 2024-09-12T02:49:30.452 INFO:teuthology.orchestra.run.smithi172.stdout: "avgtime": 0.000000000 2024-09-12T02:49:30.452 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-09-12T02:49:30.452 INFO:teuthology.orchestra.run.smithi172.stdout: "req_rename_latency": { 2024-09-12T02:49:30.453 INFO:teuthology.orchestra.run.smithi172.stdout: "avgcount": 0, 2024-09-12T02:49:30.453 INFO:teuthology.orchestra.run.smithi172.stdout: "sum": 0.000000000, 2024-09-12T02:49:30.453 INFO:teuthology.orchestra.run.smithi172.stdout: "avgtime": 0.000000000 2024-09-12T02:49:30.453 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-09-12T02:49:30.453 INFO:teuthology.orchestra.run.smithi172.stdout: "req_renamesnap_latency": { 2024-09-12T02:49:30.453 INFO:teuthology.orchestra.run.smithi172.stdout: "avgcount": 0, 2024-09-12T02:49:30.453 INFO:teuthology.orchestra.run.smithi172.stdout: "sum": 0.000000000, 2024-09-12T02:49:30.453 INFO:teuthology.orchestra.run.smithi172.stdout: "avgtime": 0.000000000 2024-09-12T02:49:30.453 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-09-12T02:49:30.453 INFO:teuthology.orchestra.run.smithi172.stdout: "req_snapdiff_latency": { 2024-09-12T02:49:30.453 INFO:teuthology.orchestra.run.smithi172.stdout: "avgcount": 0, 2024-09-12T02:49:30.453 INFO:teuthology.orchestra.run.smithi172.stdout: "sum": 0.000000000, 2024-09-12T02:49:30.453 INFO:teuthology.orchestra.run.smithi172.stdout: "avgtime": 0.000000000 2024-09-12T02:49:30.453 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-09-12T02:49:30.454 INFO:teuthology.orchestra.run.smithi172.stdout: "req_rmdir_latency": { 2024-09-12T02:49:30.454 INFO:teuthology.orchestra.run.smithi172.stdout: "avgcount": 0, 2024-09-12T02:49:30.454 INFO:teuthology.orchestra.run.smithi172.stdout: "sum": 0.000000000, 2024-09-12T02:49:30.454 INFO:teuthology.orchestra.run.smithi172.stdout: "avgtime": 0.000000000 2024-09-12T02:49:30.454 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-09-12T02:49:30.454 INFO:teuthology.orchestra.run.smithi172.stdout: "req_rmsnap_latency": { 2024-09-12T02:49:30.454 INFO:teuthology.orchestra.run.smithi172.stdout: "avgcount": 0, 2024-09-12T02:49:30.454 INFO:teuthology.orchestra.run.smithi172.stdout: "sum": 0.000000000, 2024-09-12T02:49:30.454 INFO:teuthology.orchestra.run.smithi172.stdout: "avgtime": 0.000000000 2024-09-12T02:49:30.454 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-09-12T02:49:30.454 INFO:teuthology.orchestra.run.smithi172.stdout: "req_rmxattr_latency": { 2024-09-12T02:49:30.454 INFO:teuthology.orchestra.run.smithi172.stdout: "avgcount": 0, 2024-09-12T02:49:30.454 INFO:teuthology.orchestra.run.smithi172.stdout: "sum": 0.000000000, 2024-09-12T02:49:30.455 INFO:teuthology.orchestra.run.smithi172.stdout: "avgtime": 0.000000000 2024-09-12T02:49:30.455 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-09-12T02:49:30.455 INFO:teuthology.orchestra.run.smithi172.stdout: "req_setattr_latency": { 2024-09-12T02:49:30.455 INFO:teuthology.orchestra.run.smithi172.stdout: "avgcount": 0, 2024-09-12T02:49:30.455 INFO:teuthology.orchestra.run.smithi172.stdout: "sum": 0.000000000, 2024-09-12T02:49:30.455 INFO:teuthology.orchestra.run.smithi172.stdout: "avgtime": 0.000000000 2024-09-12T02:49:30.455 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-09-12T02:49:30.455 INFO:teuthology.orchestra.run.smithi172.stdout: "req_setdirlayout_latency": { 2024-09-12T02:49:30.455 INFO:teuthology.orchestra.run.smithi172.stdout: "avgcount": 0, 2024-09-12T02:49:30.455 INFO:teuthology.orchestra.run.smithi172.stdout: "sum": 0.000000000, 2024-09-12T02:49:30.455 INFO:teuthology.orchestra.run.smithi172.stdout: "avgtime": 0.000000000 2024-09-12T02:49:30.455 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-09-12T02:49:30.455 INFO:teuthology.orchestra.run.smithi172.stdout: "req_setfilelock_latency": { 2024-09-12T02:49:30.455 INFO:teuthology.orchestra.run.smithi172.stdout: "avgcount": 0, 2024-09-12T02:49:30.456 INFO:teuthology.orchestra.run.smithi172.stdout: "sum": 0.000000000, 2024-09-12T02:49:30.456 INFO:teuthology.orchestra.run.smithi172.stdout: "avgtime": 0.000000000 2024-09-12T02:49:30.456 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-09-12T02:49:30.456 INFO:teuthology.orchestra.run.smithi172.stdout: "req_setlayout_latency": { 2024-09-12T02:49:30.456 INFO:teuthology.orchestra.run.smithi172.stdout: "avgcount": 0, 2024-09-12T02:49:30.456 INFO:teuthology.orchestra.run.smithi172.stdout: "sum": 0.000000000, 2024-09-12T02:49:30.456 INFO:teuthology.orchestra.run.smithi172.stdout: "avgtime": 0.000000000 2024-09-12T02:49:30.456 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-09-12T02:49:30.456 INFO:teuthology.orchestra.run.smithi172.stdout: "req_setxattr_latency": { 2024-09-12T02:49:30.456 INFO:teuthology.orchestra.run.smithi172.stdout: "avgcount": 0, 2024-09-12T02:49:30.456 INFO:teuthology.orchestra.run.smithi172.stdout: "sum": 0.000000000, 2024-09-12T02:49:30.456 INFO:teuthology.orchestra.run.smithi172.stdout: "avgtime": 0.000000000 2024-09-12T02:49:30.456 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-09-12T02:49:30.456 INFO:teuthology.orchestra.run.smithi172.stdout: "req_symlink_latency": { 2024-09-12T02:49:30.457 INFO:teuthology.orchestra.run.smithi172.stdout: "avgcount": 0, 2024-09-12T02:49:30.457 INFO:teuthology.orchestra.run.smithi172.stdout: "sum": 0.000000000, 2024-09-12T02:49:30.457 INFO:teuthology.orchestra.run.smithi172.stdout: "avgtime": 0.000000000 2024-09-12T02:49:30.457 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-09-12T02:49:30.457 INFO:teuthology.orchestra.run.smithi172.stdout: "req_unlink_latency": { 2024-09-12T02:49:30.457 INFO:teuthology.orchestra.run.smithi172.stdout: "avgcount": 0, 2024-09-12T02:49:30.457 INFO:teuthology.orchestra.run.smithi172.stdout: "sum": 0.000000000, 2024-09-12T02:49:30.457 INFO:teuthology.orchestra.run.smithi172.stdout: "avgtime": 0.000000000 2024-09-12T02:49:30.457 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-09-12T02:49:30.457 INFO:teuthology.orchestra.run.smithi172.stdout: "cap_revoke_eviction": 0, 2024-09-12T02:49:30.457 INFO:teuthology.orchestra.run.smithi172.stdout: "cap_acquisition_throttle": 0, 2024-09-12T02:49:30.457 INFO:teuthology.orchestra.run.smithi172.stdout: "req_getvxattr_latency": { 2024-09-12T02:49:30.457 INFO:teuthology.orchestra.run.smithi172.stdout: "avgcount": 0, 2024-09-12T02:49:30.457 INFO:teuthology.orchestra.run.smithi172.stdout: "sum": 0.000000000, 2024-09-12T02:49:30.458 INFO:teuthology.orchestra.run.smithi172.stdout: "avgtime": 0.000000000 2024-09-12T02:49:30.458 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-09-12T02:49:30.458 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-09-12T02:49:30.458 INFO:teuthology.orchestra.run.smithi172.stdout: "mds_sessions": { 2024-09-12T02:49:30.458 INFO:teuthology.orchestra.run.smithi172.stdout: "session_count": 2, 2024-09-12T02:49:30.458 INFO:teuthology.orchestra.run.smithi172.stdout: "session_add": 3, 2024-09-12T02:49:30.458 INFO:teuthology.orchestra.run.smithi172.stdout: "session_remove": 1, 2024-09-12T02:49:30.458 INFO:teuthology.orchestra.run.smithi172.stdout: "sessions_open": 2, 2024-09-12T02:49:30.458 INFO:teuthology.orchestra.run.smithi172.stdout: "sessions_stale": 0, 2024-09-12T02:49:30.458 INFO:teuthology.orchestra.run.smithi172.stdout: "total_load": 1, 2024-09-12T02:49:30.458 INFO:teuthology.orchestra.run.smithi172.stdout: "average_load": 0, 2024-09-12T02:49:30.458 INFO:teuthology.orchestra.run.smithi172.stdout: "avg_session_uptime": 689, 2024-09-12T02:49:30.458 INFO:teuthology.orchestra.run.smithi172.stdout: "mdthresh_evicted": 0 2024-09-12T02:49:30.459 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-09-12T02:49:30.459 INFO:teuthology.orchestra.run.smithi172.stdout: "mempool": { 2024-09-12T02:49:30.459 INFO:teuthology.orchestra.run.smithi172.stdout: "bloom_filter_bytes": 0, 2024-09-12T02:49:30.459 INFO:teuthology.orchestra.run.smithi172.stdout: "bloom_filter_items": 0, 2024-09-12T02:49:30.459 INFO:teuthology.orchestra.run.smithi172.stdout: "bluestore_alloc_bytes": 0, 2024-09-12T02:49:30.459 INFO:teuthology.orchestra.run.smithi172.stdout: "bluestore_alloc_items": 0, 2024-09-12T02:49:30.459 INFO:teuthology.orchestra.run.smithi172.stdout: "bluestore_cache_data_bytes": 0, 2024-09-12T02:49:30.459 INFO:teuthology.orchestra.run.smithi172.stdout: "bluestore_cache_data_items": 0, 2024-09-12T02:49:30.459 INFO:teuthology.orchestra.run.smithi172.stdout: "bluestore_cache_onode_bytes": 0, 2024-09-12T02:49:30.459 INFO:teuthology.orchestra.run.smithi172.stdout: "bluestore_cache_onode_items": 0, 2024-09-12T02:49:30.459 INFO:teuthology.orchestra.run.smithi172.stdout: "bluestore_cache_meta_bytes": 0, 2024-09-12T02:49:30.459 INFO:teuthology.orchestra.run.smithi172.stdout: "bluestore_cache_meta_items": 0, 2024-09-12T02:49:30.459 INFO:teuthology.orchestra.run.smithi172.stdout: "bluestore_cache_other_bytes": 0, 2024-09-12T02:49:30.459 INFO:teuthology.orchestra.run.smithi172.stdout: "bluestore_cache_other_items": 0, 2024-09-12T02:49:30.460 INFO:teuthology.orchestra.run.smithi172.stdout: "bluestore_cache_buffer_bytes": 0, 2024-09-12T02:49:30.460 INFO:teuthology.orchestra.run.smithi172.stdout: "bluestore_cache_buffer_items": 0, 2024-09-12T02:49:30.460 INFO:teuthology.orchestra.run.smithi172.stdout: "bluestore_extent_bytes": 0, 2024-09-12T02:49:30.460 INFO:teuthology.orchestra.run.smithi172.stdout: "bluestore_extent_items": 0, 2024-09-12T02:49:30.460 INFO:teuthology.orchestra.run.smithi172.stdout: "bluestore_blob_bytes": 0, 2024-09-12T02:49:30.460 INFO:teuthology.orchestra.run.smithi172.stdout: "bluestore_blob_items": 0, 2024-09-12T02:49:30.460 INFO:teuthology.orchestra.run.smithi172.stdout: "bluestore_shared_blob_bytes": 0, 2024-09-12T02:49:30.460 INFO:teuthology.orchestra.run.smithi172.stdout: "bluestore_shared_blob_items": 0, 2024-09-12T02:49:30.460 INFO:teuthology.orchestra.run.smithi172.stdout: "bluestore_inline_bl_bytes": 0, 2024-09-12T02:49:30.460 INFO:teuthology.orchestra.run.smithi172.stdout: "bluestore_inline_bl_items": 0, 2024-09-12T02:49:30.460 INFO:teuthology.orchestra.run.smithi172.stdout: "bluestore_fsck_bytes": 0, 2024-09-12T02:49:30.460 INFO:teuthology.orchestra.run.smithi172.stdout: "bluestore_fsck_items": 0, 2024-09-12T02:49:30.460 INFO:teuthology.orchestra.run.smithi172.stdout: "bluestore_txc_bytes": 0, 2024-09-12T02:49:30.460 INFO:teuthology.orchestra.run.smithi172.stdout: "bluestore_txc_items": 0, 2024-09-12T02:49:30.461 INFO:teuthology.orchestra.run.smithi172.stdout: "bluestore_writing_deferred_bytes": 0, 2024-09-12T02:49:30.461 INFO:teuthology.orchestra.run.smithi172.stdout: "bluestore_writing_deferred_items": 0, 2024-09-12T02:49:30.461 INFO:teuthology.orchestra.run.smithi172.stdout: "bluestore_writing_bytes": 0, 2024-09-12T02:49:30.461 INFO:teuthology.orchestra.run.smithi172.stdout: "bluestore_writing_items": 0, 2024-09-12T02:49:30.461 INFO:teuthology.orchestra.run.smithi172.stdout: "bluefs_bytes": 0, 2024-09-12T02:49:30.461 INFO:teuthology.orchestra.run.smithi172.stdout: "bluefs_items": 0, 2024-09-12T02:49:30.461 INFO:teuthology.orchestra.run.smithi172.stdout: "bluefs_file_reader_bytes": 0, 2024-09-12T02:49:30.461 INFO:teuthology.orchestra.run.smithi172.stdout: "bluefs_file_reader_items": 0, 2024-09-12T02:49:30.461 INFO:teuthology.orchestra.run.smithi172.stdout: "bluefs_file_writer_bytes": 0, 2024-09-12T02:49:30.461 INFO:teuthology.orchestra.run.smithi172.stdout: "bluefs_file_writer_items": 0, 2024-09-12T02:49:30.461 INFO:teuthology.orchestra.run.smithi172.stdout: "buffer_anon_bytes": 264483, 2024-09-12T02:49:30.461 INFO:teuthology.orchestra.run.smithi172.stdout: "buffer_anon_items": 95, 2024-09-12T02:49:30.461 INFO:teuthology.orchestra.run.smithi172.stdout: "buffer_meta_bytes": 0, 2024-09-12T02:49:30.461 INFO:teuthology.orchestra.run.smithi172.stdout: "buffer_meta_items": 0, 2024-09-12T02:49:30.462 INFO:teuthology.orchestra.run.smithi172.stdout: "osd_bytes": 0, 2024-09-12T02:49:30.462 INFO:teuthology.orchestra.run.smithi172.stdout: "osd_items": 0, 2024-09-12T02:49:30.462 INFO:teuthology.orchestra.run.smithi172.stdout: "osd_mapbl_bytes": 0, 2024-09-12T02:49:30.462 INFO:teuthology.orchestra.run.smithi172.stdout: "osd_mapbl_items": 0, 2024-09-12T02:49:30.462 INFO:teuthology.orchestra.run.smithi172.stdout: "osd_pglog_bytes": 0, 2024-09-12T02:49:30.462 INFO:teuthology.orchestra.run.smithi172.stdout: "osd_pglog_items": 0, 2024-09-12T02:49:30.462 INFO:teuthology.orchestra.run.smithi172.stdout: "osdmap_bytes": 9520, 2024-09-12T02:49:30.462 INFO:teuthology.orchestra.run.smithi172.stdout: "osdmap_items": 193, 2024-09-12T02:49:30.462 INFO:teuthology.orchestra.run.smithi172.stdout: "osdmap_mapping_bytes": 0, 2024-09-12T02:49:30.462 INFO:teuthology.orchestra.run.smithi172.stdout: "osdmap_mapping_items": 0, 2024-09-12T02:49:30.462 INFO:teuthology.orchestra.run.smithi172.stdout: "pgmap_bytes": 0, 2024-09-12T02:49:30.462 INFO:teuthology.orchestra.run.smithi172.stdout: "pgmap_items": 0, 2024-09-12T02:49:30.462 INFO:teuthology.orchestra.run.smithi172.stdout: "mds_co_bytes": 91205, 2024-09-12T02:49:30.463 INFO:teuthology.orchestra.run.smithi172.stdout: "mds_co_items": 345, 2024-09-12T02:49:30.463 INFO:teuthology.orchestra.run.smithi172.stdout: "unittest_1_bytes": 0, 2024-09-12T02:49:30.463 INFO:teuthology.orchestra.run.smithi172.stdout: "unittest_1_items": 0, 2024-09-12T02:49:30.463 INFO:teuthology.orchestra.run.smithi172.stdout: "unittest_2_bytes": 0, 2024-09-12T02:49:30.463 INFO:teuthology.orchestra.run.smithi172.stdout: "unittest_2_items": 0 2024-09-12T02:49:30.463 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-09-12T02:49:30.463 INFO:teuthology.orchestra.run.smithi172.stdout: "objecter": { 2024-09-12T02:49:30.463 INFO:teuthology.orchestra.run.smithi172.stdout: "op_active": 0, 2024-09-12T02:49:30.463 INFO:teuthology.orchestra.run.smithi172.stdout: "op_laggy": 0, 2024-09-12T02:49:30.463 INFO:teuthology.orchestra.run.smithi172.stdout: "op_send": 42, 2024-09-12T02:49:30.463 INFO:teuthology.orchestra.run.smithi172.stdout: "op_send_bytes": 12339, 2024-09-12T02:49:30.463 INFO:teuthology.orchestra.run.smithi172.stdout: "op_resend": 33, 2024-09-12T02:49:30.463 INFO:teuthology.orchestra.run.smithi172.stdout: "op_reply": 42, 2024-09-12T02:49:30.463 INFO:teuthology.orchestra.run.smithi172.stdout: "op_latency": { 2024-09-12T02:49:30.463 INFO:teuthology.orchestra.run.smithi172.stdout: "avgcount": 42, 2024-09-12T02:49:30.464 INFO:teuthology.orchestra.run.smithi172.stdout: "sum": 0.280993035, 2024-09-12T02:49:30.464 INFO:teuthology.orchestra.run.smithi172.stdout: "avgtime": 0.006690310 2024-09-12T02:49:30.464 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-09-12T02:49:30.464 INFO:teuthology.orchestra.run.smithi172.stdout: "op_inflight": 0, 2024-09-12T02:49:30.464 INFO:teuthology.orchestra.run.smithi172.stdout: "oplen_avg": { 2024-09-12T02:49:30.464 INFO:teuthology.orchestra.run.smithi172.stdout: "avgcount": 42, 2024-09-12T02:49:30.464 INFO:teuthology.orchestra.run.smithi172.stdout: "sum": 65 2024-09-12T02:49:30.464 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-09-12T02:49:30.464 INFO:teuthology.orchestra.run.smithi172.stdout: "op": 42, 2024-09-12T02:49:30.464 INFO:teuthology.orchestra.run.smithi172.stdout: "op_r": 0, 2024-09-12T02:49:30.464 INFO:teuthology.orchestra.run.smithi172.stdout: "op_w": 42, 2024-09-12T02:49:30.464 INFO:teuthology.orchestra.run.smithi172.stdout: "op_rmw": 0, 2024-09-12T02:49:30.464 INFO:teuthology.orchestra.run.smithi172.stdout: "op_pg": 0, 2024-09-12T02:49:30.465 INFO:teuthology.orchestra.run.smithi172.stdout: "osdop_stat": 0, 2024-09-12T02:49:30.465 INFO:teuthology.orchestra.run.smithi172.stdout: "osdop_create": 10, 2024-09-12T02:49:30.465 INFO:teuthology.orchestra.run.smithi172.stdout: "osdop_read": 0, 2024-09-12T02:49:30.465 INFO:teuthology.orchestra.run.smithi172.stdout: "osdop_write": 5, 2024-09-12T02:49:30.465 INFO:teuthology.orchestra.run.smithi172.stdout: "osdop_writefull": 7, 2024-09-12T02:49:30.465 INFO:teuthology.orchestra.run.smithi172.stdout: "osdop_writesame": 0, 2024-09-12T02:49:30.465 INFO:teuthology.orchestra.run.smithi172.stdout: "osdop_append": 0, 2024-09-12T02:49:30.465 INFO:teuthology.orchestra.run.smithi172.stdout: "osdop_zero": 0, 2024-09-12T02:49:30.465 INFO:teuthology.orchestra.run.smithi172.stdout: "osdop_truncate": 0, 2024-09-12T02:49:30.465 INFO:teuthology.orchestra.run.smithi172.stdout: "osdop_delete": 6, 2024-09-12T02:49:30.465 INFO:teuthology.orchestra.run.smithi172.stdout: "osdop_mapext": 0, 2024-09-12T02:49:30.465 INFO:teuthology.orchestra.run.smithi172.stdout: "osdop_sparse_read": 0, 2024-09-12T02:49:30.465 INFO:teuthology.orchestra.run.smithi172.stdout: "osdop_clonerange": 0, 2024-09-12T02:49:30.465 INFO:teuthology.orchestra.run.smithi172.stdout: "osdop_getxattr": 0, 2024-09-12T02:49:30.466 INFO:teuthology.orchestra.run.smithi172.stdout: "osdop_setxattr": 20, 2024-09-12T02:49:30.466 INFO:teuthology.orchestra.run.smithi172.stdout: "osdop_cmpxattr": 0, 2024-09-12T02:49:30.466 INFO:teuthology.orchestra.run.smithi172.stdout: "osdop_rmxattr": 0, 2024-09-12T02:49:30.466 INFO:teuthology.orchestra.run.smithi172.stdout: "osdop_resetxattrs": 0, 2024-09-12T02:49:30.466 INFO:teuthology.orchestra.run.smithi172.stdout: "osdop_call": 0, 2024-09-12T02:49:30.466 INFO:teuthology.orchestra.run.smithi172.stdout: "osdop_watch": 0, 2024-09-12T02:49:30.466 INFO:teuthology.orchestra.run.smithi172.stdout: "osdop_notify": 0, 2024-09-12T02:49:30.466 INFO:teuthology.orchestra.run.smithi172.stdout: "osdop_src_cmpxattr": 0, 2024-09-12T02:49:30.466 INFO:teuthology.orchestra.run.smithi172.stdout: "osdop_pgls": 0, 2024-09-12T02:49:30.466 INFO:teuthology.orchestra.run.smithi172.stdout: "osdop_pgls_filter": 0, 2024-09-12T02:49:30.466 INFO:teuthology.orchestra.run.smithi172.stdout: "osdop_other": 0, 2024-09-12T02:49:30.466 INFO:teuthology.orchestra.run.smithi172.stdout: "linger_active": 0, 2024-09-12T02:49:30.466 INFO:teuthology.orchestra.run.smithi172.stdout: "linger_send": 0, 2024-09-12T02:49:30.466 INFO:teuthology.orchestra.run.smithi172.stdout: "linger_resend": 0, 2024-09-12T02:49:30.467 INFO:teuthology.orchestra.run.smithi172.stdout: "linger_ping": 0, 2024-09-12T02:49:30.467 INFO:teuthology.orchestra.run.smithi172.stdout: "poolop_active": 0, 2024-09-12T02:49:30.467 INFO:teuthology.orchestra.run.smithi172.stdout: "poolop_send": 0, 2024-09-12T02:49:30.467 INFO:teuthology.orchestra.run.smithi172.stdout: "poolop_resend": 0, 2024-09-12T02:49:30.467 INFO:teuthology.orchestra.run.smithi172.stdout: "poolstat_active": 0, 2024-09-12T02:49:30.467 INFO:teuthology.orchestra.run.smithi172.stdout: "poolstat_send": 0, 2024-09-12T02:49:30.467 INFO:teuthology.orchestra.run.smithi172.stdout: "poolstat_resend": 0, 2024-09-12T02:49:30.467 INFO:teuthology.orchestra.run.smithi172.stdout: "statfs_active": 0, 2024-09-12T02:49:30.467 INFO:teuthology.orchestra.run.smithi172.stdout: "statfs_send": 0, 2024-09-12T02:49:30.467 INFO:teuthology.orchestra.run.smithi172.stdout: "statfs_resend": 0, 2024-09-12T02:49:30.467 INFO:teuthology.orchestra.run.smithi172.stdout: "command_active": 0, 2024-09-12T02:49:30.467 INFO:teuthology.orchestra.run.smithi172.stdout: "command_send": 0, 2024-09-12T02:49:30.467 INFO:teuthology.orchestra.run.smithi172.stdout: "command_resend": 0, 2024-09-12T02:49:30.467 INFO:teuthology.orchestra.run.smithi172.stdout: "map_epoch": 108, 2024-09-12T02:49:30.467 INFO:teuthology.orchestra.run.smithi172.stdout: "map_full": 0, 2024-09-12T02:49:30.468 INFO:teuthology.orchestra.run.smithi172.stdout: "map_inc": 15, 2024-09-12T02:49:30.468 INFO:teuthology.orchestra.run.smithi172.stdout: "osd_sessions": 9, 2024-09-12T02:49:30.468 INFO:teuthology.orchestra.run.smithi172.stdout: "osd_session_open": 9, 2024-09-12T02:49:30.468 INFO:teuthology.orchestra.run.smithi172.stdout: "osd_session_close": 0, 2024-09-12T02:49:30.468 INFO:teuthology.orchestra.run.smithi172.stdout: "osd_laggy": 0, 2024-09-12T02:49:30.468 INFO:teuthology.orchestra.run.smithi172.stdout: "omap_wr": 16, 2024-09-12T02:49:30.468 INFO:teuthology.orchestra.run.smithi172.stdout: "omap_rd": 0, 2024-09-12T02:49:30.468 INFO:teuthology.orchestra.run.smithi172.stdout: "omap_del": 1 2024-09-12T02:49:30.468 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-09-12T02:49:30.468 INFO:teuthology.orchestra.run.smithi172.stdout: "oft": { 2024-09-12T02:49:30.468 INFO:teuthology.orchestra.run.smithi172.stdout: "omap_total_objs": 1, 2024-09-12T02:49:30.468 INFO:teuthology.orchestra.run.smithi172.stdout: "omap_total_kv_pairs": 0, 2024-09-12T02:49:30.468 INFO:teuthology.orchestra.run.smithi172.stdout: "omap_total_updates": 0, 2024-09-12T02:49:30.469 INFO:teuthology.orchestra.run.smithi172.stdout: "omap_total_removes": 0 2024-09-12T02:49:30.469 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-09-12T02:49:30.469 INFO:teuthology.orchestra.run.smithi172.stdout: "osd-slow-ops": { 2024-09-12T02:49:30.469 INFO:teuthology.orchestra.run.smithi172.stdout: "slow_ops_count": 0 2024-09-12T02:49:30.469 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-09-12T02:49:30.469 INFO:teuthology.orchestra.run.smithi172.stdout: "purge_queue": { 2024-09-12T02:49:30.469 INFO:teuthology.orchestra.run.smithi172.stdout: "pq_executing_ops": 0, 2024-09-12T02:49:30.469 INFO:teuthology.orchestra.run.smithi172.stdout: "pq_executing_ops_high_water": 0, 2024-09-12T02:49:30.469 INFO:teuthology.orchestra.run.smithi172.stdout: "pq_executing": 0, 2024-09-12T02:49:30.469 INFO:teuthology.orchestra.run.smithi172.stdout: "pq_executing_high_water": 0, 2024-09-12T02:49:30.469 INFO:teuthology.orchestra.run.smithi172.stdout: "pq_executed_ops": 0, 2024-09-12T02:49:30.469 INFO:teuthology.orchestra.run.smithi172.stdout: "pq_executed": 0, 2024-09-12T02:49:30.469 INFO:teuthology.orchestra.run.smithi172.stdout: "pq_item_in_journal": 0 2024-09-12T02:49:30.469 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-09-12T02:49:30.469 INFO:teuthology.orchestra.run.smithi172.stdout: "throttle-msgr_dispatch_throttler-mds": { 2024-09-12T02:49:30.470 INFO:teuthology.orchestra.run.smithi172.stdout: "val": 0, 2024-09-12T02:49:30.470 INFO:teuthology.orchestra.run.smithi172.stdout: "max": 104857600, 2024-09-12T02:49:30.470 INFO:teuthology.orchestra.run.smithi172.stdout: "get_started": 0, 2024-09-12T02:49:30.470 INFO:teuthology.orchestra.run.smithi172.stdout: "get": 1161, 2024-09-12T02:49:30.470 INFO:teuthology.orchestra.run.smithi172.stdout: "get_sum": 1930190, 2024-09-12T02:49:30.470 INFO:teuthology.orchestra.run.smithi172.stdout: "get_or_fail_fail": 0, 2024-09-12T02:49:30.470 INFO:teuthology.orchestra.run.smithi172.stdout: "get_or_fail_success": 1161, 2024-09-12T02:49:30.470 INFO:teuthology.orchestra.run.smithi172.stdout: "take": 0, 2024-09-12T02:49:30.470 INFO:teuthology.orchestra.run.smithi172.stdout: "take_sum": 0, 2024-09-12T02:49:30.470 INFO:teuthology.orchestra.run.smithi172.stdout: "put": 1161, 2024-09-12T02:49:30.470 INFO:teuthology.orchestra.run.smithi172.stdout: "put_sum": 1930190, 2024-09-12T02:49:30.470 INFO:teuthology.orchestra.run.smithi172.stdout: "wait": { 2024-09-12T02:49:30.470 INFO:teuthology.orchestra.run.smithi172.stdout: "avgcount": 0, 2024-09-12T02:49:30.470 INFO:teuthology.orchestra.run.smithi172.stdout: "sum": 0.000000000, 2024-09-12T02:49:30.471 INFO:teuthology.orchestra.run.smithi172.stdout: "avgtime": 0.000000000 2024-09-12T02:49:30.471 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-09-12T02:49:30.471 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-09-12T02:49:30.471 INFO:teuthology.orchestra.run.smithi172.stdout: "throttle-objecter_bytes": { 2024-09-12T02:49:30.471 INFO:teuthology.orchestra.run.smithi172.stdout: "val": 0, 2024-09-12T02:49:30.471 INFO:teuthology.orchestra.run.smithi172.stdout: "max": 104857600, 2024-09-12T02:49:30.471 INFO:teuthology.orchestra.run.smithi172.stdout: "get_started": 0, 2024-09-12T02:49:30.471 INFO:teuthology.orchestra.run.smithi172.stdout: "get": 0, 2024-09-12T02:49:30.471 INFO:teuthology.orchestra.run.smithi172.stdout: "get_sum": 0, 2024-09-12T02:49:30.471 INFO:teuthology.orchestra.run.smithi172.stdout: "get_or_fail_fail": 0, 2024-09-12T02:49:30.471 INFO:teuthology.orchestra.run.smithi172.stdout: "get_or_fail_success": 0, 2024-09-12T02:49:30.471 INFO:teuthology.orchestra.run.smithi172.stdout: "take": 42, 2024-09-12T02:49:30.471 INFO:teuthology.orchestra.run.smithi172.stdout: "take_sum": 12339, 2024-09-12T02:49:30.471 INFO:teuthology.orchestra.run.smithi172.stdout: "put": 42, 2024-09-12T02:49:30.472 INFO:teuthology.orchestra.run.smithi172.stdout: "put_sum": 12339, 2024-09-12T02:49:30.472 INFO:teuthology.orchestra.run.smithi172.stdout: "wait": { 2024-09-12T02:49:30.472 INFO:teuthology.orchestra.run.smithi172.stdout: "avgcount": 0, 2024-09-12T02:49:30.472 INFO:teuthology.orchestra.run.smithi172.stdout: "sum": 0.000000000, 2024-09-12T02:49:30.472 INFO:teuthology.orchestra.run.smithi172.stdout: "avgtime": 0.000000000 2024-09-12T02:49:30.472 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-09-12T02:49:30.472 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-09-12T02:49:30.472 INFO:teuthology.orchestra.run.smithi172.stdout: "throttle-objecter_ops": { 2024-09-12T02:49:30.472 INFO:teuthology.orchestra.run.smithi172.stdout: "val": 0, 2024-09-12T02:49:30.472 INFO:teuthology.orchestra.run.smithi172.stdout: "max": 1024, 2024-09-12T02:49:30.472 INFO:teuthology.orchestra.run.smithi172.stdout: "get_started": 0, 2024-09-12T02:49:30.472 INFO:teuthology.orchestra.run.smithi172.stdout: "get": 0, 2024-09-12T02:49:30.472 INFO:teuthology.orchestra.run.smithi172.stdout: "get_sum": 0, 2024-09-12T02:49:30.472 INFO:teuthology.orchestra.run.smithi172.stdout: "get_or_fail_fail": 0, 2024-09-12T02:49:30.473 INFO:teuthology.orchestra.run.smithi172.stdout: "get_or_fail_success": 0, 2024-09-12T02:49:30.473 INFO:teuthology.orchestra.run.smithi172.stdout: "take": 42, 2024-09-12T02:49:30.473 INFO:teuthology.orchestra.run.smithi172.stdout: "take_sum": 42, 2024-09-12T02:49:30.473 INFO:teuthology.orchestra.run.smithi172.stdout: "put": 42, 2024-09-12T02:49:30.473 INFO:teuthology.orchestra.run.smithi172.stdout: "put_sum": 42, 2024-09-12T02:49:30.473 INFO:teuthology.orchestra.run.smithi172.stdout: "wait": { 2024-09-12T02:49:30.473 INFO:teuthology.orchestra.run.smithi172.stdout: "avgcount": 0, 2024-09-12T02:49:30.473 INFO:teuthology.orchestra.run.smithi172.stdout: "sum": 0.000000000, 2024-09-12T02:49:30.473 INFO:teuthology.orchestra.run.smithi172.stdout: "avgtime": 0.000000000 2024-09-12T02:49:30.473 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-09-12T02:49:30.473 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-09-12T02:49:30.473 INFO:teuthology.orchestra.run.smithi172.stdout: "throttle-write_buf_throttle": { 2024-09-12T02:49:30.473 INFO:teuthology.orchestra.run.smithi172.stdout: "val": 0, 2024-09-12T02:49:30.473 INFO:teuthology.orchestra.run.smithi172.stdout: "max": 3758096384, 2024-09-12T02:49:30.474 INFO:teuthology.orchestra.run.smithi172.stdout: "get_started": 0, 2024-09-12T02:49:30.474 INFO:teuthology.orchestra.run.smithi172.stdout: "get": 0, 2024-09-12T02:49:30.474 INFO:teuthology.orchestra.run.smithi172.stdout: "get_sum": 0, 2024-09-12T02:49:30.474 INFO:teuthology.orchestra.run.smithi172.stdout: "get_or_fail_fail": 0, 2024-09-12T02:49:30.474 INFO:teuthology.orchestra.run.smithi172.stdout: "get_or_fail_success": 0, 2024-09-12T02:49:30.474 INFO:teuthology.orchestra.run.smithi172.stdout: "take": 0, 2024-09-12T02:49:30.474 INFO:teuthology.orchestra.run.smithi172.stdout: "take_sum": 0, 2024-09-12T02:49:30.474 INFO:teuthology.orchestra.run.smithi172.stdout: "put": 0, 2024-09-12T02:49:30.474 INFO:teuthology.orchestra.run.smithi172.stdout: "put_sum": 0, 2024-09-12T02:49:30.474 INFO:teuthology.orchestra.run.smithi172.stdout: "wait": { 2024-09-12T02:49:30.474 INFO:teuthology.orchestra.run.smithi172.stdout: "avgcount": 0, 2024-09-12T02:49:30.474 INFO:teuthology.orchestra.run.smithi172.stdout: "sum": 0.000000000, 2024-09-12T02:49:30.474 INFO:teuthology.orchestra.run.smithi172.stdout: "avgtime": 0.000000000 2024-09-12T02:49:30.474 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-09-12T02:49:30.475 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-09-12T02:49:30.475 INFO:teuthology.orchestra.run.smithi172.stdout: "throttle-write_buf_throttle-0x561c6f2bc960": { 2024-09-12T02:49:30.475 INFO:teuthology.orchestra.run.smithi172.stdout: "val": 0, 2024-09-12T02:49:30.475 INFO:teuthology.orchestra.run.smithi172.stdout: "max": 3758096384, 2024-09-12T02:49:30.475 INFO:teuthology.orchestra.run.smithi172.stdout: "get_started": 0, 2024-09-12T02:49:30.475 INFO:teuthology.orchestra.run.smithi172.stdout: "get": 6, 2024-09-12T02:49:30.475 INFO:teuthology.orchestra.run.smithi172.stdout: "get_sum": 1826, 2024-09-12T02:49:30.475 INFO:teuthology.orchestra.run.smithi172.stdout: "get_or_fail_fail": 0, 2024-09-12T02:49:30.475 INFO:teuthology.orchestra.run.smithi172.stdout: "get_or_fail_success": 6, 2024-09-12T02:49:30.475 INFO:teuthology.orchestra.run.smithi172.stdout: "take": 0, 2024-09-12T02:49:30.475 INFO:teuthology.orchestra.run.smithi172.stdout: "take_sum": 0, 2024-09-12T02:49:30.475 INFO:teuthology.orchestra.run.smithi172.stdout: "put": 5, 2024-09-12T02:49:30.475 INFO:teuthology.orchestra.run.smithi172.stdout: "put_sum": 1826, 2024-09-12T02:49:30.475 INFO:teuthology.orchestra.run.smithi172.stdout: "wait": { 2024-09-12T02:49:30.476 INFO:teuthology.orchestra.run.smithi172.stdout: "avgcount": 0, 2024-09-12T02:49:30.476 INFO:teuthology.orchestra.run.smithi172.stdout: "sum": 0.000000000, 2024-09-12T02:49:30.476 INFO:teuthology.orchestra.run.smithi172.stdout: "avgtime": 0.000000000 2024-09-12T02:49:30.476 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-09-12T02:49:30.476 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-09-12T02:49:30.476 INFO:teuthology.orchestra.run.smithi172.stdout:} 2024-09-12T02:49:31.544 INFO:tasks.check_counter:Daemon mds.c mds.exported=0 2024-09-12T02:49:31.545 INFO:tasks.check_counter:Daemon mds.c mds.imported=0 2024-09-12T02:49:31.545 INFO:tasks.check_counter:Daemon mds.c mds_cache.dir_update=0 2024-09-12T02:49:31.545 INFO:tasks.check_counter:Daemon mds.c mds_cache.dir_update_receipt=9 2024-09-12T02:49:31.545 INFO:tasks.check_counter:Daemon mds.c mds.root_rsnaps=6 2024-09-12T02:49:31.545 INFO:tasks.check_counter:Daemon mds.c mds_server.req_mksnap_latency.avgcount=0 2024-09-12T02:49:31.545 INFO:tasks.check_counter:Daemon mds.c mds_server.req_rmsnap_latency.avgcount=0 2024-09-12T02:49:31.545 DEBUG:tasks.check_counter:Getting stats from f 2024-09-12T02:49:31.545 DEBUG:teuthology.orchestra.run.smithi172:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc shell --fsid 4954ed46-70ae-11ef-bcea-c7b262605968 -- ceph daemon mds.f perf dump 2024-09-12T02:49:31.798 INFO:teuthology.orchestra.run.smithi172.stderr:Inferring config /var/lib/ceph/4954ed46-70ae-11ef-bcea-c7b262605968/mon.c/config 2024-09-12T02:49:31.918 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 12 02:49:31 smithi172 ceph-mon[35609]: pgmap v362: 129 pgs: 129 active+clean; 24 MiB data, 494 MiB used, 1.0 TiB / 1.0 TiB avail; 8.4 KiB/s rd, 4.4 KiB/s wr, 8 op/s 2024-09-12T02:49:32.099 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 02:49:31 smithi039 ceph-mon[30515]: pgmap v362: 129 pgs: 129 active+clean; 24 MiB data, 494 MiB used, 1.0 TiB / 1.0 TiB avail; 8.4 KiB/s rd, 4.4 KiB/s wr, 8 op/s 2024-09-12T02:49:32.198 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 12 02:49:31 smithi044 ceph-mon[35411]: pgmap v362: 129 pgs: 129 active+clean; 24 MiB data, 494 MiB used, 1.0 TiB / 1.0 TiB avail; 8.4 KiB/s rd, 4.4 KiB/s wr, 8 op/s 2024-09-12T02:49:32.324 INFO:teuthology.orchestra.run.smithi172.stdout:{ 2024-09-12T02:49:32.324 INFO:teuthology.orchestra.run.smithi172.stdout: "AsyncMessenger::Worker-0": { 2024-09-12T02:49:32.324 INFO:teuthology.orchestra.run.smithi172.stdout: "msgr_recv_messages": 36, 2024-09-12T02:49:32.324 INFO:teuthology.orchestra.run.smithi172.stdout: "msgr_send_messages": 74, 2024-09-12T02:49:32.324 INFO:teuthology.orchestra.run.smithi172.stdout: "msgr_recv_bytes": 8754, 2024-09-12T02:49:32.325 INFO:teuthology.orchestra.run.smithi172.stdout: "msgr_send_bytes": 48142, 2024-09-12T02:49:32.325 INFO:teuthology.orchestra.run.smithi172.stdout: "msgr_created_connections": 11, 2024-09-12T02:49:32.325 INFO:teuthology.orchestra.run.smithi172.stdout: "msgr_active_connections": 4, 2024-09-12T02:49:32.325 INFO:teuthology.orchestra.run.smithi172.stdout: "msgr_running_total_time": 0.009055289, 2024-09-12T02:49:32.325 INFO:teuthology.orchestra.run.smithi172.stdout: "msgr_running_send_time": 0.001920984, 2024-09-12T02:49:32.325 INFO:teuthology.orchestra.run.smithi172.stdout: "msgr_running_recv_time": 0.004583844, 2024-09-12T02:49:32.325 INFO:teuthology.orchestra.run.smithi172.stdout: "msgr_running_fast_dispatch_time": 0.000710046, 2024-09-12T02:49:32.325 INFO:teuthology.orchestra.run.smithi172.stdout: "msgr_send_messages_queue_lat": { 2024-09-12T02:49:32.326 INFO:teuthology.orchestra.run.smithi172.stdout: "avgcount": 72, 2024-09-12T02:49:32.326 INFO:teuthology.orchestra.run.smithi172.stdout: "sum": 0.015487016, 2024-09-12T02:49:32.326 INFO:teuthology.orchestra.run.smithi172.stdout: "avgtime": 0.000215097 2024-09-12T02:49:32.326 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-09-12T02:49:32.326 INFO:teuthology.orchestra.run.smithi172.stdout: "msgr_handle_ack_lat": { 2024-09-12T02:49:32.326 INFO:teuthology.orchestra.run.smithi172.stdout: "avgcount": 62, 2024-09-12T02:49:32.326 INFO:teuthology.orchestra.run.smithi172.stdout: "sum": 0.000021784, 2024-09-12T02:49:32.326 INFO:teuthology.orchestra.run.smithi172.stdout: "avgtime": 0.000000351 2024-09-12T02:49:32.327 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-09-12T02:49:32.327 INFO:teuthology.orchestra.run.smithi172.stdout: "msgr_recv_encrypted_bytes": 3296, 2024-09-12T02:49:32.327 INFO:teuthology.orchestra.run.smithi172.stdout: "msgr_send_encrypted_bytes": 13312 2024-09-12T02:49:32.327 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-09-12T02:49:32.327 INFO:teuthology.orchestra.run.smithi172.stdout: "AsyncMessenger::Worker-1": { 2024-09-12T02:49:32.327 INFO:teuthology.orchestra.run.smithi172.stdout: "msgr_recv_messages": 1089, 2024-09-12T02:49:32.327 INFO:teuthology.orchestra.run.smithi172.stdout: "msgr_send_messages": 943, 2024-09-12T02:49:32.328 INFO:teuthology.orchestra.run.smithi172.stdout: "msgr_recv_bytes": 2026672, 2024-09-12T02:49:32.328 INFO:teuthology.orchestra.run.smithi172.stdout: "msgr_send_bytes": 425697, 2024-09-12T02:49:32.328 INFO:teuthology.orchestra.run.smithi172.stdout: "msgr_created_connections": 6, 2024-09-12T02:49:32.328 INFO:teuthology.orchestra.run.smithi172.stdout: "msgr_active_connections": 5, 2024-09-12T02:49:32.328 INFO:teuthology.orchestra.run.smithi172.stdout: "msgr_running_total_time": 0.122018873, 2024-09-12T02:49:32.328 INFO:teuthology.orchestra.run.smithi172.stdout: "msgr_running_send_time": 0.046925913, 2024-09-12T02:49:32.328 INFO:teuthology.orchestra.run.smithi172.stdout: "msgr_running_recv_time": 0.093047928, 2024-09-12T02:49:32.328 INFO:teuthology.orchestra.run.smithi172.stdout: "msgr_running_fast_dispatch_time": 0.005452138, 2024-09-12T02:49:32.329 INFO:teuthology.orchestra.run.smithi172.stdout: "msgr_send_messages_queue_lat": { 2024-09-12T02:49:32.329 INFO:teuthology.orchestra.run.smithi172.stdout: "avgcount": 942, 2024-09-12T02:49:32.329 INFO:teuthology.orchestra.run.smithi172.stdout: "sum": 0.062850425, 2024-09-12T02:49:32.329 INFO:teuthology.orchestra.run.smithi172.stdout: "avgtime": 0.000066720 2024-09-12T02:49:32.329 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-09-12T02:49:32.329 INFO:teuthology.orchestra.run.smithi172.stdout: "msgr_handle_ack_lat": { 2024-09-12T02:49:32.329 INFO:teuthology.orchestra.run.smithi172.stdout: "avgcount": 1404, 2024-09-12T02:49:32.329 INFO:teuthology.orchestra.run.smithi172.stdout: "sum": 0.000313405, 2024-09-12T02:49:32.329 INFO:teuthology.orchestra.run.smithi172.stdout: "avgtime": 0.000000223 2024-09-12T02:49:32.330 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-09-12T02:49:32.330 INFO:teuthology.orchestra.run.smithi172.stdout: "msgr_recv_encrypted_bytes": 1778288, 2024-09-12T02:49:32.330 INFO:teuthology.orchestra.run.smithi172.stdout: "msgr_send_encrypted_bytes": 156816 2024-09-12T02:49:32.330 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-09-12T02:49:32.330 INFO:teuthology.orchestra.run.smithi172.stdout: "AsyncMessenger::Worker-2": { 2024-09-12T02:49:32.330 INFO:teuthology.orchestra.run.smithi172.stdout: "msgr_recv_messages": 35, 2024-09-12T02:49:32.330 INFO:teuthology.orchestra.run.smithi172.stdout: "msgr_send_messages": 220, 2024-09-12T02:49:32.330 INFO:teuthology.orchestra.run.smithi172.stdout: "msgr_recv_bytes": 10881, 2024-09-12T02:49:32.331 INFO:teuthology.orchestra.run.smithi172.stdout: "msgr_send_bytes": 510637, 2024-09-12T02:49:32.331 INFO:teuthology.orchestra.run.smithi172.stdout: "msgr_created_connections": 13, 2024-09-12T02:49:32.331 INFO:teuthology.orchestra.run.smithi172.stdout: "msgr_active_connections": 3, 2024-09-12T02:49:32.331 INFO:teuthology.orchestra.run.smithi172.stdout: "msgr_running_total_time": 0.019444979, 2024-09-12T02:49:32.331 INFO:teuthology.orchestra.run.smithi172.stdout: "msgr_running_send_time": 0.009187414, 2024-09-12T02:49:32.331 INFO:teuthology.orchestra.run.smithi172.stdout: "msgr_running_recv_time": 0.007683270, 2024-09-12T02:49:32.331 INFO:teuthology.orchestra.run.smithi172.stdout: "msgr_running_fast_dispatch_time": 0.000450249, 2024-09-12T02:49:32.331 INFO:teuthology.orchestra.run.smithi172.stdout: "msgr_send_messages_queue_lat": { 2024-09-12T02:49:32.332 INFO:teuthology.orchestra.run.smithi172.stdout: "avgcount": 218, 2024-09-12T02:49:32.332 INFO:teuthology.orchestra.run.smithi172.stdout: "sum": 0.050395191, 2024-09-12T02:49:32.332 INFO:teuthology.orchestra.run.smithi172.stdout: "avgtime": 0.000231170 2024-09-12T02:49:32.332 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-09-12T02:49:32.332 INFO:teuthology.orchestra.run.smithi172.stdout: "msgr_handle_ack_lat": { 2024-09-12T02:49:32.332 INFO:teuthology.orchestra.run.smithi172.stdout: "avgcount": 25, 2024-09-12T02:49:32.332 INFO:teuthology.orchestra.run.smithi172.stdout: "sum": 0.000004012, 2024-09-12T02:49:32.332 INFO:teuthology.orchestra.run.smithi172.stdout: "avgtime": 0.000000160 2024-09-12T02:49:32.332 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-09-12T02:49:32.333 INFO:teuthology.orchestra.run.smithi172.stdout: "msgr_recv_encrypted_bytes": 6176, 2024-09-12T02:49:32.333 INFO:teuthology.orchestra.run.smithi172.stdout: "msgr_send_encrypted_bytes": 478032 2024-09-12T02:49:32.333 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-09-12T02:49:32.333 INFO:teuthology.orchestra.run.smithi172.stdout: "cct": { 2024-09-12T02:49:32.333 INFO:teuthology.orchestra.run.smithi172.stdout: "total_workers": 1, 2024-09-12T02:49:32.333 INFO:teuthology.orchestra.run.smithi172.stdout: "unhealthy_workers": 0 2024-09-12T02:49:32.333 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-09-12T02:49:32.333 INFO:teuthology.orchestra.run.smithi172.stdout: "finisher-MDSRank": { 2024-09-12T02:49:32.334 INFO:teuthology.orchestra.run.smithi172.stdout: "queue_len": 0, 2024-09-12T02:49:32.334 INFO:teuthology.orchestra.run.smithi172.stdout: "complete_latency": { 2024-09-12T02:49:32.334 INFO:teuthology.orchestra.run.smithi172.stdout: "avgcount": 54, 2024-09-12T02:49:32.334 INFO:teuthology.orchestra.run.smithi172.stdout: "sum": 0.001693557, 2024-09-12T02:49:32.334 INFO:teuthology.orchestra.run.smithi172.stdout: "avgtime": 0.000031362 2024-09-12T02:49:32.334 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-09-12T02:49:32.334 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-09-12T02:49:32.334 INFO:teuthology.orchestra.run.smithi172.stdout: "finisher-PurgeQueue": { 2024-09-12T02:49:32.335 INFO:teuthology.orchestra.run.smithi172.stdout: "queue_len": 0, 2024-09-12T02:49:32.335 INFO:teuthology.orchestra.run.smithi172.stdout: "complete_latency": { 2024-09-12T02:49:32.335 INFO:teuthology.orchestra.run.smithi172.stdout: "avgcount": 2, 2024-09-12T02:49:32.335 INFO:teuthology.orchestra.run.smithi172.stdout: "sum": 0.000009230, 2024-09-12T02:49:32.335 INFO:teuthology.orchestra.run.smithi172.stdout: "avgtime": 0.000004615 2024-09-12T02:49:32.335 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-09-12T02:49:32.335 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-09-12T02:49:32.335 INFO:teuthology.orchestra.run.smithi172.stdout: "mds": { 2024-09-12T02:49:32.335 INFO:teuthology.orchestra.run.smithi172.stdout: "request": 8, 2024-09-12T02:49:32.335 INFO:teuthology.orchestra.run.smithi172.stdout: "reply": 5, 2024-09-12T02:49:32.335 INFO:teuthology.orchestra.run.smithi172.stdout: "reply_latency": { 2024-09-12T02:49:32.335 INFO:teuthology.orchestra.run.smithi172.stdout: "avgcount": 5, 2024-09-12T02:49:32.335 INFO:teuthology.orchestra.run.smithi172.stdout: "sum": 0.002497949, 2024-09-12T02:49:32.336 INFO:teuthology.orchestra.run.smithi172.stdout: "avgtime": 0.000499589 2024-09-12T02:49:32.336 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-09-12T02:49:32.336 INFO:teuthology.orchestra.run.smithi172.stdout: "slow_reply": 0, 2024-09-12T02:49:32.336 INFO:teuthology.orchestra.run.smithi172.stdout: "forward": 3, 2024-09-12T02:49:32.336 INFO:teuthology.orchestra.run.smithi172.stdout: "dir_fetch_complete": 0, 2024-09-12T02:49:32.336 INFO:teuthology.orchestra.run.smithi172.stdout: "dir_fetch_keys": 0, 2024-09-12T02:49:32.336 INFO:teuthology.orchestra.run.smithi172.stdout: "dir_commit": 11, 2024-09-12T02:49:32.336 INFO:teuthology.orchestra.run.smithi172.stdout: "dir_split": 0, 2024-09-12T02:49:32.336 INFO:teuthology.orchestra.run.smithi172.stdout: "dir_merge": 0, 2024-09-12T02:49:32.336 INFO:teuthology.orchestra.run.smithi172.stdout: "inodes": 16, 2024-09-12T02:49:32.336 INFO:teuthology.orchestra.run.smithi172.stdout: "inodes_top": 0, 2024-09-12T02:49:32.337 INFO:teuthology.orchestra.run.smithi172.stdout: "inodes_bottom": 16, 2024-09-12T02:49:32.337 INFO:teuthology.orchestra.run.smithi172.stdout: "inodes_pin_tail": 0, 2024-09-12T02:49:32.337 INFO:teuthology.orchestra.run.smithi172.stdout: "inodes_pinned": 13, 2024-09-12T02:49:32.337 INFO:teuthology.orchestra.run.smithi172.stdout: "inodes_expired": 4, 2024-09-12T02:49:32.337 INFO:teuthology.orchestra.run.smithi172.stdout: "inodes_with_caps": 1, 2024-09-12T02:49:32.337 INFO:teuthology.orchestra.run.smithi172.stdout: "caps": 1, 2024-09-12T02:49:32.337 INFO:teuthology.orchestra.run.smithi172.stdout: "subtrees": 3, 2024-09-12T02:49:32.337 INFO:teuthology.orchestra.run.smithi172.stdout: "traverse": 19, 2024-09-12T02:49:32.337 INFO:teuthology.orchestra.run.smithi172.stdout: "traverse_hit": 14, 2024-09-12T02:49:32.337 INFO:teuthology.orchestra.run.smithi172.stdout: "traverse_forward": 1, 2024-09-12T02:49:32.337 INFO:teuthology.orchestra.run.smithi172.stdout: "traverse_discover": 3, 2024-09-12T02:49:32.339 INFO:teuthology.orchestra.run.smithi172.stdout: "traverse_dir_fetch": 0, 2024-09-12T02:49:32.339 INFO:teuthology.orchestra.run.smithi172.stdout: "traverse_remote_ino": 0, 2024-09-12T02:49:32.339 INFO:teuthology.orchestra.run.smithi172.stdout: "traverse_lock": 0, 2024-09-12T02:49:32.339 INFO:teuthology.orchestra.run.smithi172.stdout: "load_cent": 0, 2024-09-12T02:49:32.339 INFO:teuthology.orchestra.run.smithi172.stdout: "q": 0, 2024-09-12T02:49:32.340 INFO:teuthology.orchestra.run.smithi172.stdout: "exported": 0, 2024-09-12T02:49:32.340 INFO:teuthology.orchestra.run.smithi172.stdout: "exported_inodes": 0, 2024-09-12T02:49:32.340 INFO:teuthology.orchestra.run.smithi172.stdout: "imported": 0, 2024-09-12T02:49:32.340 INFO:teuthology.orchestra.run.smithi172.stdout: "imported_inodes": 0, 2024-09-12T02:49:32.340 INFO:teuthology.orchestra.run.smithi172.stdout: "openino_dir_fetch": 0, 2024-09-12T02:49:32.340 INFO:teuthology.orchestra.run.smithi172.stdout: "openino_backtrace_fetch": 0, 2024-09-12T02:49:32.340 INFO:teuthology.orchestra.run.smithi172.stdout: "openino_peer_discover": 0, 2024-09-12T02:49:32.340 INFO:teuthology.orchestra.run.smithi172.stdout: "root_rfiles": 4, 2024-09-12T02:49:32.340 INFO:teuthology.orchestra.run.smithi172.stdout: "root_rbytes": 234, 2024-09-12T02:49:32.340 INFO:teuthology.orchestra.run.smithi172.stdout: "root_rsnaps": 6, 2024-09-12T02:49:32.340 INFO:teuthology.orchestra.run.smithi172.stdout: "scrub_backtrace_fetch": 0, 2024-09-12T02:49:32.340 INFO:teuthology.orchestra.run.smithi172.stdout: "scrub_set_tag": 0, 2024-09-12T02:49:32.340 INFO:teuthology.orchestra.run.smithi172.stdout: "scrub_backtrace_repaired": 0, 2024-09-12T02:49:32.341 INFO:teuthology.orchestra.run.smithi172.stdout: "scrub_inotable_repaired": 0, 2024-09-12T02:49:32.341 INFO:teuthology.orchestra.run.smithi172.stdout: "scrub_dir_inodes": 0, 2024-09-12T02:49:32.341 INFO:teuthology.orchestra.run.smithi172.stdout: "scrub_dir_base_inodes": 0, 2024-09-12T02:49:32.341 INFO:teuthology.orchestra.run.smithi172.stdout: "scrub_dirfrag_rstats": 0, 2024-09-12T02:49:32.341 INFO:teuthology.orchestra.run.smithi172.stdout: "scrub_file_inodes": 0, 2024-09-12T02:49:32.341 INFO:teuthology.orchestra.run.smithi172.stdout: "handle_inode_file_caps": 0, 2024-09-12T02:49:32.341 INFO:teuthology.orchestra.run.smithi172.stdout: "ceph_cap_op_revoke": 0, 2024-09-12T02:49:32.341 INFO:teuthology.orchestra.run.smithi172.stdout: "ceph_cap_op_grant": 0, 2024-09-12T02:49:32.341 INFO:teuthology.orchestra.run.smithi172.stdout: "ceph_cap_op_trunc": 0, 2024-09-12T02:49:32.341 INFO:teuthology.orchestra.run.smithi172.stdout: "ceph_cap_op_flushsnap_ack": 0, 2024-09-12T02:49:32.341 INFO:teuthology.orchestra.run.smithi172.stdout: "ceph_cap_op_flush_ack": 0, 2024-09-12T02:49:32.341 INFO:teuthology.orchestra.run.smithi172.stdout: "handle_client_caps": 0, 2024-09-12T02:49:32.341 INFO:teuthology.orchestra.run.smithi172.stdout: "handle_client_caps_dirty": 0, 2024-09-12T02:49:32.342 INFO:teuthology.orchestra.run.smithi172.stdout: "handle_client_cap_release": 0, 2024-09-12T02:49:32.342 INFO:teuthology.orchestra.run.smithi172.stdout: "process_request_cap_release": 0 2024-09-12T02:49:32.342 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-09-12T02:49:32.342 INFO:teuthology.orchestra.run.smithi172.stdout: "mds_cache": { 2024-09-12T02:49:32.342 INFO:teuthology.orchestra.run.smithi172.stdout: "dir_update": 0, 2024-09-12T02:49:32.342 INFO:teuthology.orchestra.run.smithi172.stdout: "dir_update_receipt": 11, 2024-09-12T02:49:32.342 INFO:teuthology.orchestra.run.smithi172.stdout: "dir_try_discover": 7, 2024-09-12T02:49:32.342 INFO:teuthology.orchestra.run.smithi172.stdout: "dir_send_discover": 8, 2024-09-12T02:49:32.342 INFO:teuthology.orchestra.run.smithi172.stdout: "dir_handle_discover": 0, 2024-09-12T02:49:32.342 INFO:teuthology.orchestra.run.smithi172.stdout: "num_strays": 0, 2024-09-12T02:49:32.343 INFO:teuthology.orchestra.run.smithi172.stdout: "num_strays_delayed": 0, 2024-09-12T02:49:32.343 INFO:teuthology.orchestra.run.smithi172.stdout: "num_strays_enqueuing": 0, 2024-09-12T02:49:32.343 INFO:teuthology.orchestra.run.smithi172.stdout: "strays_created": 0, 2024-09-12T02:49:32.343 INFO:teuthology.orchestra.run.smithi172.stdout: "strays_enqueued": 0, 2024-09-12T02:49:32.343 INFO:teuthology.orchestra.run.smithi172.stdout: "strays_reintegrated": 0, 2024-09-12T02:49:32.343 INFO:teuthology.orchestra.run.smithi172.stdout: "strays_migrated": 0, 2024-09-12T02:49:32.343 INFO:teuthology.orchestra.run.smithi172.stdout: "num_recovering_processing": 0, 2024-09-12T02:49:32.343 INFO:teuthology.orchestra.run.smithi172.stdout: "num_recovering_enqueued": 0, 2024-09-12T02:49:32.343 INFO:teuthology.orchestra.run.smithi172.stdout: "num_recovering_prioritized": 0, 2024-09-12T02:49:32.343 INFO:teuthology.orchestra.run.smithi172.stdout: "recovery_started": 0, 2024-09-12T02:49:32.343 INFO:teuthology.orchestra.run.smithi172.stdout: "recovery_completed": 0, 2024-09-12T02:49:32.343 INFO:teuthology.orchestra.run.smithi172.stdout: "ireq_quiesce_path": 0, 2024-09-12T02:49:32.343 INFO:teuthology.orchestra.run.smithi172.stdout: "ireq_quiesce_inode": 0, 2024-09-12T02:49:32.343 INFO:teuthology.orchestra.run.smithi172.stdout: "ireq_enqueue_scrub": 0, 2024-09-12T02:49:32.344 INFO:teuthology.orchestra.run.smithi172.stdout: "ireq_exportdir": 0, 2024-09-12T02:49:32.344 INFO:teuthology.orchestra.run.smithi172.stdout: "ireq_flush": 0, 2024-09-12T02:49:32.344 INFO:teuthology.orchestra.run.smithi172.stdout: "ireq_fragmentdir": 0, 2024-09-12T02:49:32.344 INFO:teuthology.orchestra.run.smithi172.stdout: "ireq_fragstats": 0, 2024-09-12T02:49:32.344 INFO:teuthology.orchestra.run.smithi172.stdout: "ireq_inodestats": 0 2024-09-12T02:49:32.344 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-09-12T02:49:32.344 INFO:teuthology.orchestra.run.smithi172.stdout: "mds_log": { 2024-09-12T02:49:32.344 INFO:teuthology.orchestra.run.smithi172.stdout: "evlrg": 0, 2024-09-12T02:49:32.344 INFO:teuthology.orchestra.run.smithi172.stdout: "evadd": 7, 2024-09-12T02:49:32.344 INFO:teuthology.orchestra.run.smithi172.stdout: "evex": 0, 2024-09-12T02:49:32.344 INFO:teuthology.orchestra.run.smithi172.stdout: "evtrm": 0, 2024-09-12T02:49:32.344 INFO:teuthology.orchestra.run.smithi172.stdout: "ev": 7, 2024-09-12T02:49:32.344 INFO:teuthology.orchestra.run.smithi172.stdout: "evexg": 0, 2024-09-12T02:49:32.344 INFO:teuthology.orchestra.run.smithi172.stdout: "evexd": 0, 2024-09-12T02:49:32.345 INFO:teuthology.orchestra.run.smithi172.stdout: "segadd": 2, 2024-09-12T02:49:32.345 INFO:teuthology.orchestra.run.smithi172.stdout: "segex": 0, 2024-09-12T02:49:32.345 INFO:teuthology.orchestra.run.smithi172.stdout: "segtrm": 0, 2024-09-12T02:49:32.345 INFO:teuthology.orchestra.run.smithi172.stdout: "seg": 2, 2024-09-12T02:49:32.345 INFO:teuthology.orchestra.run.smithi172.stdout: "segmjr": 2, 2024-09-12T02:49:32.345 INFO:teuthology.orchestra.run.smithi172.stdout: "segexg": 0, 2024-09-12T02:49:32.345 INFO:teuthology.orchestra.run.smithi172.stdout: "segexd": 0, 2024-09-12T02:49:32.345 INFO:teuthology.orchestra.run.smithi172.stdout: "expos": 4194304, 2024-09-12T02:49:32.345 INFO:teuthology.orchestra.run.smithi172.stdout: "wrpos": 4196353, 2024-09-12T02:49:32.345 INFO:teuthology.orchestra.run.smithi172.stdout: "rdpos": 0, 2024-09-12T02:49:32.345 INFO:teuthology.orchestra.run.smithi172.stdout: "jlat": { 2024-09-12T02:49:32.345 INFO:teuthology.orchestra.run.smithi172.stdout: "avgcount": 6, 2024-09-12T02:49:32.345 INFO:teuthology.orchestra.run.smithi172.stdout: "sum": 0.012735595, 2024-09-12T02:49:32.346 INFO:teuthology.orchestra.run.smithi172.stdout: "avgtime": 0.002122599 2024-09-12T02:49:32.346 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-09-12T02:49:32.346 INFO:teuthology.orchestra.run.smithi172.stdout: "replayed": 0 2024-09-12T02:49:32.346 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-09-12T02:49:32.346 INFO:teuthology.orchestra.run.smithi172.stdout: "mds_mem": { 2024-09-12T02:49:32.346 INFO:teuthology.orchestra.run.smithi172.stdout: "ino": 20, 2024-09-12T02:49:32.346 INFO:teuthology.orchestra.run.smithi172.stdout: "ino+": 22, 2024-09-12T02:49:32.346 INFO:teuthology.orchestra.run.smithi172.stdout: "ino-": 2, 2024-09-12T02:49:32.346 INFO:teuthology.orchestra.run.smithi172.stdout: "dir": 19, 2024-09-12T02:49:32.346 INFO:teuthology.orchestra.run.smithi172.stdout: "dir+": 23, 2024-09-12T02:49:32.346 INFO:teuthology.orchestra.run.smithi172.stdout: "dir-": 4, 2024-09-12T02:49:32.346 INFO:teuthology.orchestra.run.smithi172.stdout: "dn": 16, 2024-09-12T02:49:32.346 INFO:teuthology.orchestra.run.smithi172.stdout: "dn+": 20, 2024-09-12T02:49:32.346 INFO:teuthology.orchestra.run.smithi172.stdout: "dn-": 4, 2024-09-12T02:49:32.347 INFO:teuthology.orchestra.run.smithi172.stdout: "cap": 1, 2024-09-12T02:49:32.347 INFO:teuthology.orchestra.run.smithi172.stdout: "cap+": 3, 2024-09-12T02:49:32.347 INFO:teuthology.orchestra.run.smithi172.stdout: "cap-": 2, 2024-09-12T02:49:32.347 INFO:teuthology.orchestra.run.smithi172.stdout: "rss": 49968, 2024-09-12T02:49:32.347 INFO:teuthology.orchestra.run.smithi172.stdout: "heap": 223520 2024-09-12T02:49:32.347 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-09-12T02:49:32.347 INFO:teuthology.orchestra.run.smithi172.stdout: "mds_server": { 2024-09-12T02:49:32.347 INFO:teuthology.orchestra.run.smithi172.stdout: "dispatch_client_request": 11, 2024-09-12T02:49:32.347 INFO:teuthology.orchestra.run.smithi172.stdout: "dispatch_server_request": 0, 2024-09-12T02:49:32.347 INFO:teuthology.orchestra.run.smithi172.stdout: "handle_client_request": 8, 2024-09-12T02:49:32.347 INFO:teuthology.orchestra.run.smithi172.stdout: "handle_client_session": 17, 2024-09-12T02:49:32.347 INFO:teuthology.orchestra.run.smithi172.stdout: "handle_peer_request": 1, 2024-09-12T02:49:32.347 INFO:teuthology.orchestra.run.smithi172.stdout: "req_create_latency": { 2024-09-12T02:49:32.347 INFO:teuthology.orchestra.run.smithi172.stdout: "avgcount": 0, 2024-09-12T02:49:32.348 INFO:teuthology.orchestra.run.smithi172.stdout: "sum": 0.000000000, 2024-09-12T02:49:32.348 INFO:teuthology.orchestra.run.smithi172.stdout: "avgtime": 0.000000000 2024-09-12T02:49:32.348 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-09-12T02:49:32.348 INFO:teuthology.orchestra.run.smithi172.stdout: "req_getattr_latency": { 2024-09-12T02:49:32.348 INFO:teuthology.orchestra.run.smithi172.stdout: "avgcount": 4, 2024-09-12T02:49:32.348 INFO:teuthology.orchestra.run.smithi172.stdout: "sum": 0.002349038, 2024-09-12T02:49:32.348 INFO:teuthology.orchestra.run.smithi172.stdout: "avgtime": 0.000587259 2024-09-12T02:49:32.348 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-09-12T02:49:32.348 INFO:teuthology.orchestra.run.smithi172.stdout: "req_getfilelock_latency": { 2024-09-12T02:49:32.348 INFO:teuthology.orchestra.run.smithi172.stdout: "avgcount": 0, 2024-09-12T02:49:32.348 INFO:teuthology.orchestra.run.smithi172.stdout: "sum": 0.000000000, 2024-09-12T02:49:32.348 INFO:teuthology.orchestra.run.smithi172.stdout: "avgtime": 0.000000000 2024-09-12T02:49:32.349 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-09-12T02:49:32.349 INFO:teuthology.orchestra.run.smithi172.stdout: "req_link_latency": { 2024-09-12T02:49:32.349 INFO:teuthology.orchestra.run.smithi172.stdout: "avgcount": 0, 2024-09-12T02:49:32.349 INFO:teuthology.orchestra.run.smithi172.stdout: "sum": 0.000000000, 2024-09-12T02:49:32.350 INFO:teuthology.orchestra.run.smithi172.stdout: "avgtime": 0.000000000 2024-09-12T02:49:32.350 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-09-12T02:49:32.350 INFO:teuthology.orchestra.run.smithi172.stdout: "req_lookup_latency": { 2024-09-12T02:49:32.350 INFO:teuthology.orchestra.run.smithi172.stdout: "avgcount": 1, 2024-09-12T02:49:32.350 INFO:teuthology.orchestra.run.smithi172.stdout: "sum": 0.000148911, 2024-09-12T02:49:32.350 INFO:teuthology.orchestra.run.smithi172.stdout: "avgtime": 0.000148911 2024-09-12T02:49:32.351 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-09-12T02:49:32.351 INFO:teuthology.orchestra.run.smithi172.stdout: "req_lookuphash_latency": { 2024-09-12T02:49:32.351 INFO:teuthology.orchestra.run.smithi172.stdout: "avgcount": 0, 2024-09-12T02:49:32.351 INFO:teuthology.orchestra.run.smithi172.stdout: "sum": 0.000000000, 2024-09-12T02:49:32.351 INFO:teuthology.orchestra.run.smithi172.stdout: "avgtime": 0.000000000 2024-09-12T02:49:32.351 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-09-12T02:49:32.351 INFO:teuthology.orchestra.run.smithi172.stdout: "req_lookupino_latency": { 2024-09-12T02:49:32.352 INFO:teuthology.orchestra.run.smithi172.stdout: "avgcount": 0, 2024-09-12T02:49:32.352 INFO:teuthology.orchestra.run.smithi172.stdout: "sum": 0.000000000, 2024-09-12T02:49:32.352 INFO:teuthology.orchestra.run.smithi172.stdout: "avgtime": 0.000000000 2024-09-12T02:49:32.352 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-09-12T02:49:32.352 INFO:teuthology.orchestra.run.smithi172.stdout: "req_lookupname_latency": { 2024-09-12T02:49:32.353 INFO:teuthology.orchestra.run.smithi172.stdout: "avgcount": 0, 2024-09-12T02:49:32.353 INFO:teuthology.orchestra.run.smithi172.stdout: "sum": 0.000000000, 2024-09-12T02:49:32.353 INFO:teuthology.orchestra.run.smithi172.stdout: "avgtime": 0.000000000 2024-09-12T02:49:32.353 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-09-12T02:49:32.353 INFO:teuthology.orchestra.run.smithi172.stdout: "req_lookupparent_latency": { 2024-09-12T02:49:32.353 INFO:teuthology.orchestra.run.smithi172.stdout: "avgcount": 0, 2024-09-12T02:49:32.353 INFO:teuthology.orchestra.run.smithi172.stdout: "sum": 0.000000000, 2024-09-12T02:49:32.354 INFO:teuthology.orchestra.run.smithi172.stdout: "avgtime": 0.000000000 2024-09-12T02:49:32.354 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-09-12T02:49:32.354 INFO:teuthology.orchestra.run.smithi172.stdout: "req_lookupsnap_latency": { 2024-09-12T02:49:32.354 INFO:teuthology.orchestra.run.smithi172.stdout: "avgcount": 0, 2024-09-12T02:49:32.354 INFO:teuthology.orchestra.run.smithi172.stdout: "sum": 0.000000000, 2024-09-12T02:49:32.354 INFO:teuthology.orchestra.run.smithi172.stdout: "avgtime": 0.000000000 2024-09-12T02:49:32.355 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-09-12T02:49:32.355 INFO:teuthology.orchestra.run.smithi172.stdout: "req_lssnap_latency": { 2024-09-12T02:49:32.355 INFO:teuthology.orchestra.run.smithi172.stdout: "avgcount": 0, 2024-09-12T02:49:32.355 INFO:teuthology.orchestra.run.smithi172.stdout: "sum": 0.000000000, 2024-09-12T02:49:32.355 INFO:teuthology.orchestra.run.smithi172.stdout: "avgtime": 0.000000000 2024-09-12T02:49:32.355 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-09-12T02:49:32.356 INFO:teuthology.orchestra.run.smithi172.stdout: "req_mkdir_latency": { 2024-09-12T02:49:32.356 INFO:teuthology.orchestra.run.smithi172.stdout: "avgcount": 0, 2024-09-12T02:49:32.357 INFO:teuthology.orchestra.run.smithi172.stdout: "sum": 0.000000000, 2024-09-12T02:49:32.357 INFO:teuthology.orchestra.run.smithi172.stdout: "avgtime": 0.000000000 2024-09-12T02:49:32.357 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-09-12T02:49:32.357 INFO:teuthology.orchestra.run.smithi172.stdout: "req_mknod_latency": { 2024-09-12T02:49:32.358 INFO:teuthology.orchestra.run.smithi172.stdout: "avgcount": 0, 2024-09-12T02:49:32.358 INFO:teuthology.orchestra.run.smithi172.stdout: "sum": 0.000000000, 2024-09-12T02:49:32.358 INFO:teuthology.orchestra.run.smithi172.stdout: "avgtime": 0.000000000 2024-09-12T02:49:32.358 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-09-12T02:49:32.358 INFO:teuthology.orchestra.run.smithi172.stdout: "req_mksnap_latency": { 2024-09-12T02:49:32.358 INFO:teuthology.orchestra.run.smithi172.stdout: "avgcount": 0, 2024-09-12T02:49:32.359 INFO:teuthology.orchestra.run.smithi172.stdout: "sum": 0.000000000, 2024-09-12T02:49:32.359 INFO:teuthology.orchestra.run.smithi172.stdout: "avgtime": 0.000000000 2024-09-12T02:49:32.359 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-09-12T02:49:32.359 INFO:teuthology.orchestra.run.smithi172.stdout: "req_open_latency": { 2024-09-12T02:49:32.359 INFO:teuthology.orchestra.run.smithi172.stdout: "avgcount": 0, 2024-09-12T02:49:32.359 INFO:teuthology.orchestra.run.smithi172.stdout: "sum": 0.000000000, 2024-09-12T02:49:32.360 INFO:teuthology.orchestra.run.smithi172.stdout: "avgtime": 0.000000000 2024-09-12T02:49:32.360 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-09-12T02:49:32.360 INFO:teuthology.orchestra.run.smithi172.stdout: "req_readdir_latency": { 2024-09-12T02:49:32.360 INFO:teuthology.orchestra.run.smithi172.stdout: "avgcount": 0, 2024-09-12T02:49:32.360 INFO:teuthology.orchestra.run.smithi172.stdout: "sum": 0.000000000, 2024-09-12T02:49:32.360 INFO:teuthology.orchestra.run.smithi172.stdout: "avgtime": 0.000000000 2024-09-12T02:49:32.361 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-09-12T02:49:32.361 INFO:teuthology.orchestra.run.smithi172.stdout: "req_rename_latency": { 2024-09-12T02:49:32.361 INFO:teuthology.orchestra.run.smithi172.stdout: "avgcount": 0, 2024-09-12T02:49:32.361 INFO:teuthology.orchestra.run.smithi172.stdout: "sum": 0.000000000, 2024-09-12T02:49:32.361 INFO:teuthology.orchestra.run.smithi172.stdout: "avgtime": 0.000000000 2024-09-12T02:49:32.362 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-09-12T02:49:32.362 INFO:teuthology.orchestra.run.smithi172.stdout: "req_renamesnap_latency": { 2024-09-12T02:49:32.362 INFO:teuthology.orchestra.run.smithi172.stdout: "avgcount": 0, 2024-09-12T02:49:32.362 INFO:teuthology.orchestra.run.smithi172.stdout: "sum": 0.000000000, 2024-09-12T02:49:32.362 INFO:teuthology.orchestra.run.smithi172.stdout: "avgtime": 0.000000000 2024-09-12T02:49:32.362 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-09-12T02:49:32.363 INFO:teuthology.orchestra.run.smithi172.stdout: "req_snapdiff_latency": { 2024-09-12T02:49:32.363 INFO:teuthology.orchestra.run.smithi172.stdout: "avgcount": 0, 2024-09-12T02:49:32.363 INFO:teuthology.orchestra.run.smithi172.stdout: "sum": 0.000000000, 2024-09-12T02:49:32.363 INFO:teuthology.orchestra.run.smithi172.stdout: "avgtime": 0.000000000 2024-09-12T02:49:32.363 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-09-12T02:49:32.363 INFO:teuthology.orchestra.run.smithi172.stdout: "req_rmdir_latency": { 2024-09-12T02:49:32.364 INFO:teuthology.orchestra.run.smithi172.stdout: "avgcount": 0, 2024-09-12T02:49:32.364 INFO:teuthology.orchestra.run.smithi172.stdout: "sum": 0.000000000, 2024-09-12T02:49:32.364 INFO:teuthology.orchestra.run.smithi172.stdout: "avgtime": 0.000000000 2024-09-12T02:49:32.364 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-09-12T02:49:32.364 INFO:teuthology.orchestra.run.smithi172.stdout: "req_rmsnap_latency": { 2024-09-12T02:49:32.364 INFO:teuthology.orchestra.run.smithi172.stdout: "avgcount": 0, 2024-09-12T02:49:32.365 INFO:teuthology.orchestra.run.smithi172.stdout: "sum": 0.000000000, 2024-09-12T02:49:32.365 INFO:teuthology.orchestra.run.smithi172.stdout: "avgtime": 0.000000000 2024-09-12T02:49:32.365 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-09-12T02:49:32.365 INFO:teuthology.orchestra.run.smithi172.stdout: "req_rmxattr_latency": { 2024-09-12T02:49:32.365 INFO:teuthology.orchestra.run.smithi172.stdout: "avgcount": 0, 2024-09-12T02:49:32.365 INFO:teuthology.orchestra.run.smithi172.stdout: "sum": 0.000000000, 2024-09-12T02:49:32.365 INFO:teuthology.orchestra.run.smithi172.stdout: "avgtime": 0.000000000 2024-09-12T02:49:32.366 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-09-12T02:49:32.366 INFO:teuthology.orchestra.run.smithi172.stdout: "req_setattr_latency": { 2024-09-12T02:49:32.366 INFO:teuthology.orchestra.run.smithi172.stdout: "avgcount": 0, 2024-09-12T02:49:32.366 INFO:teuthology.orchestra.run.smithi172.stdout: "sum": 0.000000000, 2024-09-12T02:49:32.366 INFO:teuthology.orchestra.run.smithi172.stdout: "avgtime": 0.000000000 2024-09-12T02:49:32.366 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-09-12T02:49:32.367 INFO:teuthology.orchestra.run.smithi172.stdout: "req_setdirlayout_latency": { 2024-09-12T02:49:32.367 INFO:teuthology.orchestra.run.smithi172.stdout: "avgcount": 0, 2024-09-12T02:49:32.367 INFO:teuthology.orchestra.run.smithi172.stdout: "sum": 0.000000000, 2024-09-12T02:49:32.367 INFO:teuthology.orchestra.run.smithi172.stdout: "avgtime": 0.000000000 2024-09-12T02:49:32.367 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-09-12T02:49:32.367 INFO:teuthology.orchestra.run.smithi172.stdout: "req_setfilelock_latency": { 2024-09-12T02:49:32.367 INFO:teuthology.orchestra.run.smithi172.stdout: "avgcount": 0, 2024-09-12T02:49:32.367 INFO:teuthology.orchestra.run.smithi172.stdout: "sum": 0.000000000, 2024-09-12T02:49:32.368 INFO:teuthology.orchestra.run.smithi172.stdout: "avgtime": 0.000000000 2024-09-12T02:49:32.368 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-09-12T02:49:32.368 INFO:teuthology.orchestra.run.smithi172.stdout: "req_setlayout_latency": { 2024-09-12T02:49:32.368 INFO:teuthology.orchestra.run.smithi172.stdout: "avgcount": 0, 2024-09-12T02:49:32.368 INFO:teuthology.orchestra.run.smithi172.stdout: "sum": 0.000000000, 2024-09-12T02:49:32.368 INFO:teuthology.orchestra.run.smithi172.stdout: "avgtime": 0.000000000 2024-09-12T02:49:32.368 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-09-12T02:49:32.368 INFO:teuthology.orchestra.run.smithi172.stdout: "req_setxattr_latency": { 2024-09-12T02:49:32.368 INFO:teuthology.orchestra.run.smithi172.stdout: "avgcount": 0, 2024-09-12T02:49:32.368 INFO:teuthology.orchestra.run.smithi172.stdout: "sum": 0.000000000, 2024-09-12T02:49:32.368 INFO:teuthology.orchestra.run.smithi172.stdout: "avgtime": 0.000000000 2024-09-12T02:49:32.368 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-09-12T02:49:32.368 INFO:teuthology.orchestra.run.smithi172.stdout: "req_symlink_latency": { 2024-09-12T02:49:32.369 INFO:teuthology.orchestra.run.smithi172.stdout: "avgcount": 0, 2024-09-12T02:49:32.369 INFO:teuthology.orchestra.run.smithi172.stdout: "sum": 0.000000000, 2024-09-12T02:49:32.369 INFO:teuthology.orchestra.run.smithi172.stdout: "avgtime": 0.000000000 2024-09-12T02:49:32.369 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-09-12T02:49:32.369 INFO:teuthology.orchestra.run.smithi172.stdout: "req_unlink_latency": { 2024-09-12T02:49:32.369 INFO:teuthology.orchestra.run.smithi172.stdout: "avgcount": 0, 2024-09-12T02:49:32.369 INFO:teuthology.orchestra.run.smithi172.stdout: "sum": 0.000000000, 2024-09-12T02:49:32.369 INFO:teuthology.orchestra.run.smithi172.stdout: "avgtime": 0.000000000 2024-09-12T02:49:32.369 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-09-12T02:49:32.369 INFO:teuthology.orchestra.run.smithi172.stdout: "cap_revoke_eviction": 0, 2024-09-12T02:49:32.369 INFO:teuthology.orchestra.run.smithi172.stdout: "cap_acquisition_throttle": 0, 2024-09-12T02:49:32.369 INFO:teuthology.orchestra.run.smithi172.stdout: "req_getvxattr_latency": { 2024-09-12T02:49:32.369 INFO:teuthology.orchestra.run.smithi172.stdout: "avgcount": 0, 2024-09-12T02:49:32.369 INFO:teuthology.orchestra.run.smithi172.stdout: "sum": 0.000000000, 2024-09-12T02:49:32.370 INFO:teuthology.orchestra.run.smithi172.stdout: "avgtime": 0.000000000 2024-09-12T02:49:32.370 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-09-12T02:49:32.370 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-09-12T02:49:32.370 INFO:teuthology.orchestra.run.smithi172.stdout: "mds_sessions": { 2024-09-12T02:49:32.370 INFO:teuthology.orchestra.run.smithi172.stdout: "session_count": 1, 2024-09-12T02:49:32.370 INFO:teuthology.orchestra.run.smithi172.stdout: "session_add": 3, 2024-09-12T02:49:32.370 INFO:teuthology.orchestra.run.smithi172.stdout: "session_remove": 2, 2024-09-12T02:49:32.370 INFO:teuthology.orchestra.run.smithi172.stdout: "sessions_open": 1, 2024-09-12T02:49:32.370 INFO:teuthology.orchestra.run.smithi172.stdout: "sessions_stale": 0, 2024-09-12T02:49:32.370 INFO:teuthology.orchestra.run.smithi172.stdout: "total_load": 4, 2024-09-12T02:49:32.370 INFO:teuthology.orchestra.run.smithi172.stdout: "average_load": 2, 2024-09-12T02:49:32.370 INFO:teuthology.orchestra.run.smithi172.stdout: "avg_session_uptime": 688, 2024-09-12T02:49:32.370 INFO:teuthology.orchestra.run.smithi172.stdout: "mdthresh_evicted": 0 2024-09-12T02:49:32.370 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-09-12T02:49:32.371 INFO:teuthology.orchestra.run.smithi172.stdout: "mempool": { 2024-09-12T02:49:32.371 INFO:teuthology.orchestra.run.smithi172.stdout: "bloom_filter_bytes": 0, 2024-09-12T02:49:32.371 INFO:teuthology.orchestra.run.smithi172.stdout: "bloom_filter_items": 0, 2024-09-12T02:49:32.371 INFO:teuthology.orchestra.run.smithi172.stdout: "bluestore_alloc_bytes": 0, 2024-09-12T02:49:32.371 INFO:teuthology.orchestra.run.smithi172.stdout: "bluestore_alloc_items": 0, 2024-09-12T02:49:32.371 INFO:teuthology.orchestra.run.smithi172.stdout: "bluestore_cache_data_bytes": 0, 2024-09-12T02:49:32.371 INFO:teuthology.orchestra.run.smithi172.stdout: "bluestore_cache_data_items": 0, 2024-09-12T02:49:32.371 INFO:teuthology.orchestra.run.smithi172.stdout: "bluestore_cache_onode_bytes": 0, 2024-09-12T02:49:32.371 INFO:teuthology.orchestra.run.smithi172.stdout: "bluestore_cache_onode_items": 0, 2024-09-12T02:49:32.371 INFO:teuthology.orchestra.run.smithi172.stdout: "bluestore_cache_meta_bytes": 0, 2024-09-12T02:49:32.371 INFO:teuthology.orchestra.run.smithi172.stdout: "bluestore_cache_meta_items": 0, 2024-09-12T02:49:32.371 INFO:teuthology.orchestra.run.smithi172.stdout: "bluestore_cache_other_bytes": 0, 2024-09-12T02:49:32.371 INFO:teuthology.orchestra.run.smithi172.stdout: "bluestore_cache_other_items": 0, 2024-09-12T02:49:32.371 INFO:teuthology.orchestra.run.smithi172.stdout: "bluestore_cache_buffer_bytes": 0, 2024-09-12T02:49:32.372 INFO:teuthology.orchestra.run.smithi172.stdout: "bluestore_cache_buffer_items": 0, 2024-09-12T02:49:32.372 INFO:teuthology.orchestra.run.smithi172.stdout: "bluestore_extent_bytes": 0, 2024-09-12T02:49:32.372 INFO:teuthology.orchestra.run.smithi172.stdout: "bluestore_extent_items": 0, 2024-09-12T02:49:32.372 INFO:teuthology.orchestra.run.smithi172.stdout: "bluestore_blob_bytes": 0, 2024-09-12T02:49:32.372 INFO:teuthology.orchestra.run.smithi172.stdout: "bluestore_blob_items": 0, 2024-09-12T02:49:32.372 INFO:teuthology.orchestra.run.smithi172.stdout: "bluestore_shared_blob_bytes": 0, 2024-09-12T02:49:32.372 INFO:teuthology.orchestra.run.smithi172.stdout: "bluestore_shared_blob_items": 0, 2024-09-12T02:49:32.372 INFO:teuthology.orchestra.run.smithi172.stdout: "bluestore_inline_bl_bytes": 0, 2024-09-12T02:49:32.372 INFO:teuthology.orchestra.run.smithi172.stdout: "bluestore_inline_bl_items": 0, 2024-09-12T02:49:32.372 INFO:teuthology.orchestra.run.smithi172.stdout: "bluestore_fsck_bytes": 0, 2024-09-12T02:49:32.372 INFO:teuthology.orchestra.run.smithi172.stdout: "bluestore_fsck_items": 0, 2024-09-12T02:49:32.372 INFO:teuthology.orchestra.run.smithi172.stdout: "bluestore_txc_bytes": 0, 2024-09-12T02:49:32.372 INFO:teuthology.orchestra.run.smithi172.stdout: "bluestore_txc_items": 0, 2024-09-12T02:49:32.373 INFO:teuthology.orchestra.run.smithi172.stdout: "bluestore_writing_deferred_bytes": 0, 2024-09-12T02:49:32.373 INFO:teuthology.orchestra.run.smithi172.stdout: "bluestore_writing_deferred_items": 0, 2024-09-12T02:49:32.373 INFO:teuthology.orchestra.run.smithi172.stdout: "bluestore_writing_bytes": 0, 2024-09-12T02:49:32.373 INFO:teuthology.orchestra.run.smithi172.stdout: "bluestore_writing_items": 0, 2024-09-12T02:49:32.373 INFO:teuthology.orchestra.run.smithi172.stdout: "bluefs_bytes": 0, 2024-09-12T02:49:32.373 INFO:teuthology.orchestra.run.smithi172.stdout: "bluefs_items": 0, 2024-09-12T02:49:32.373 INFO:teuthology.orchestra.run.smithi172.stdout: "bluefs_file_reader_bytes": 0, 2024-09-12T02:49:32.373 INFO:teuthology.orchestra.run.smithi172.stdout: "bluefs_file_reader_items": 0, 2024-09-12T02:49:32.373 INFO:teuthology.orchestra.run.smithi172.stdout: "bluefs_file_writer_bytes": 0, 2024-09-12T02:49:32.373 INFO:teuthology.orchestra.run.smithi172.stdout: "bluefs_file_writer_items": 0, 2024-09-12T02:49:32.373 INFO:teuthology.orchestra.run.smithi172.stdout: "buffer_anon_bytes": 264535, 2024-09-12T02:49:32.373 INFO:teuthology.orchestra.run.smithi172.stdout: "buffer_anon_items": 94, 2024-09-12T02:49:32.373 INFO:teuthology.orchestra.run.smithi172.stdout: "buffer_meta_bytes": 88, 2024-09-12T02:49:32.374 INFO:teuthology.orchestra.run.smithi172.stdout: "buffer_meta_items": 1, 2024-09-12T02:49:32.374 INFO:teuthology.orchestra.run.smithi172.stdout: "osd_bytes": 0, 2024-09-12T02:49:32.374 INFO:teuthology.orchestra.run.smithi172.stdout: "osd_items": 0, 2024-09-12T02:49:32.374 INFO:teuthology.orchestra.run.smithi172.stdout: "osd_mapbl_bytes": 0, 2024-09-12T02:49:32.374 INFO:teuthology.orchestra.run.smithi172.stdout: "osd_mapbl_items": 0, 2024-09-12T02:49:32.374 INFO:teuthology.orchestra.run.smithi172.stdout: "osd_pglog_bytes": 0, 2024-09-12T02:49:32.374 INFO:teuthology.orchestra.run.smithi172.stdout: "osd_pglog_items": 0, 2024-09-12T02:49:32.374 INFO:teuthology.orchestra.run.smithi172.stdout: "osdmap_bytes": 9520, 2024-09-12T02:49:32.374 INFO:teuthology.orchestra.run.smithi172.stdout: "osdmap_items": 193, 2024-09-12T02:49:32.374 INFO:teuthology.orchestra.run.smithi172.stdout: "osdmap_mapping_bytes": 0, 2024-09-12T02:49:32.374 INFO:teuthology.orchestra.run.smithi172.stdout: "osdmap_mapping_items": 0, 2024-09-12T02:49:32.375 INFO:teuthology.orchestra.run.smithi172.stdout: "pgmap_bytes": 0, 2024-09-12T02:49:32.375 INFO:teuthology.orchestra.run.smithi172.stdout: "pgmap_items": 0, 2024-09-12T02:49:32.375 INFO:teuthology.orchestra.run.smithi172.stdout: "mds_co_bytes": 91205, 2024-09-12T02:49:32.375 INFO:teuthology.orchestra.run.smithi172.stdout: "mds_co_items": 345, 2024-09-12T02:49:32.375 INFO:teuthology.orchestra.run.smithi172.stdout: "unittest_1_bytes": 0, 2024-09-12T02:49:32.375 INFO:teuthology.orchestra.run.smithi172.stdout: "unittest_1_items": 0, 2024-09-12T02:49:32.375 INFO:teuthology.orchestra.run.smithi172.stdout: "unittest_2_bytes": 0, 2024-09-12T02:49:32.375 INFO:teuthology.orchestra.run.smithi172.stdout: "unittest_2_items": 0 2024-09-12T02:49:32.375 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-09-12T02:49:32.375 INFO:teuthology.orchestra.run.smithi172.stdout: "objecter": { 2024-09-12T02:49:32.375 INFO:teuthology.orchestra.run.smithi172.stdout: "op_active": 0, 2024-09-12T02:49:32.376 INFO:teuthology.orchestra.run.smithi172.stdout: "op_laggy": 0, 2024-09-12T02:49:32.376 INFO:teuthology.orchestra.run.smithi172.stdout: "op_send": 45, 2024-09-12T02:49:32.376 INFO:teuthology.orchestra.run.smithi172.stdout: "op_send_bytes": 12586, 2024-09-12T02:49:32.376 INFO:teuthology.orchestra.run.smithi172.stdout: "op_resend": 33, 2024-09-12T02:49:32.376 INFO:teuthology.orchestra.run.smithi172.stdout: "op_reply": 45, 2024-09-12T02:49:32.376 INFO:teuthology.orchestra.run.smithi172.stdout: "op_latency": { 2024-09-12T02:49:32.376 INFO:teuthology.orchestra.run.smithi172.stdout: "avgcount": 45, 2024-09-12T02:49:32.376 INFO:teuthology.orchestra.run.smithi172.stdout: "sum": 0.238994086, 2024-09-12T02:49:32.376 INFO:teuthology.orchestra.run.smithi172.stdout: "avgtime": 0.005310979 2024-09-12T02:49:32.376 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-09-12T02:49:32.376 INFO:teuthology.orchestra.run.smithi172.stdout: "op_inflight": 0, 2024-09-12T02:49:32.376 INFO:teuthology.orchestra.run.smithi172.stdout: "oplen_avg": { 2024-09-12T02:49:32.376 INFO:teuthology.orchestra.run.smithi172.stdout: "avgcount": 45, 2024-09-12T02:49:32.377 INFO:teuthology.orchestra.run.smithi172.stdout: "sum": 69 2024-09-12T02:49:32.377 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-09-12T02:49:32.377 INFO:teuthology.orchestra.run.smithi172.stdout: "op": 45, 2024-09-12T02:49:32.377 INFO:teuthology.orchestra.run.smithi172.stdout: "op_r": 0, 2024-09-12T02:49:32.377 INFO:teuthology.orchestra.run.smithi172.stdout: "op_w": 45, 2024-09-12T02:49:32.377 INFO:teuthology.orchestra.run.smithi172.stdout: "op_rmw": 0, 2024-09-12T02:49:32.377 INFO:teuthology.orchestra.run.smithi172.stdout: "op_pg": 0, 2024-09-12T02:49:32.377 INFO:teuthology.orchestra.run.smithi172.stdout: "osdop_stat": 0, 2024-09-12T02:49:32.377 INFO:teuthology.orchestra.run.smithi172.stdout: "osdop_create": 10, 2024-09-12T02:49:32.378 INFO:teuthology.orchestra.run.smithi172.stdout: "osdop_read": 0, 2024-09-12T02:49:32.378 INFO:teuthology.orchestra.run.smithi172.stdout: "osdop_write": 6, 2024-09-12T02:49:32.378 INFO:teuthology.orchestra.run.smithi172.stdout: "osdop_writefull": 8, 2024-09-12T02:49:32.378 INFO:teuthology.orchestra.run.smithi172.stdout: "osdop_writesame": 0, 2024-09-12T02:49:32.378 INFO:teuthology.orchestra.run.smithi172.stdout: "osdop_append": 0, 2024-09-12T02:49:32.378 INFO:teuthology.orchestra.run.smithi172.stdout: "osdop_zero": 0, 2024-09-12T02:49:32.378 INFO:teuthology.orchestra.run.smithi172.stdout: "osdop_truncate": 0, 2024-09-12T02:49:32.378 INFO:teuthology.orchestra.run.smithi172.stdout: "osdop_delete": 6, 2024-09-12T02:49:32.378 INFO:teuthology.orchestra.run.smithi172.stdout: "osdop_mapext": 0, 2024-09-12T02:49:32.378 INFO:teuthology.orchestra.run.smithi172.stdout: "osdop_sparse_read": 0, 2024-09-12T02:49:32.378 INFO:teuthology.orchestra.run.smithi172.stdout: "osdop_clonerange": 0, 2024-09-12T02:49:32.378 INFO:teuthology.orchestra.run.smithi172.stdout: "osdop_getxattr": 0, 2024-09-12T02:49:32.378 INFO:teuthology.orchestra.run.smithi172.stdout: "osdop_setxattr": 20, 2024-09-12T02:49:32.378 INFO:teuthology.orchestra.run.smithi172.stdout: "osdop_cmpxattr": 0, 2024-09-12T02:49:32.379 INFO:teuthology.orchestra.run.smithi172.stdout: "osdop_rmxattr": 0, 2024-09-12T02:49:32.379 INFO:teuthology.orchestra.run.smithi172.stdout: "osdop_resetxattrs": 0, 2024-09-12T02:49:32.379 INFO:teuthology.orchestra.run.smithi172.stdout: "osdop_call": 0, 2024-09-12T02:49:32.379 INFO:teuthology.orchestra.run.smithi172.stdout: "osdop_watch": 0, 2024-09-12T02:49:32.379 INFO:teuthology.orchestra.run.smithi172.stdout: "osdop_notify": 0, 2024-09-12T02:49:32.379 INFO:teuthology.orchestra.run.smithi172.stdout: "osdop_src_cmpxattr": 0, 2024-09-12T02:49:32.379 INFO:teuthology.orchestra.run.smithi172.stdout: "osdop_pgls": 0, 2024-09-12T02:49:32.379 INFO:teuthology.orchestra.run.smithi172.stdout: "osdop_pgls_filter": 0, 2024-09-12T02:49:32.379 INFO:teuthology.orchestra.run.smithi172.stdout: "osdop_other": 0, 2024-09-12T02:49:32.379 INFO:teuthology.orchestra.run.smithi172.stdout: "linger_active": 0, 2024-09-12T02:49:32.379 INFO:teuthology.orchestra.run.smithi172.stdout: "linger_send": 0, 2024-09-12T02:49:32.379 INFO:teuthology.orchestra.run.smithi172.stdout: "linger_resend": 0, 2024-09-12T02:49:32.379 INFO:teuthology.orchestra.run.smithi172.stdout: "linger_ping": 0, 2024-09-12T02:49:32.379 INFO:teuthology.orchestra.run.smithi172.stdout: "poolop_active": 0, 2024-09-12T02:49:32.380 INFO:teuthology.orchestra.run.smithi172.stdout: "poolop_send": 0, 2024-09-12T02:49:32.380 INFO:teuthology.orchestra.run.smithi172.stdout: "poolop_resend": 0, 2024-09-12T02:49:32.380 INFO:teuthology.orchestra.run.smithi172.stdout: "poolstat_active": 0, 2024-09-12T02:49:32.380 INFO:teuthology.orchestra.run.smithi172.stdout: "poolstat_send": 0, 2024-09-12T02:49:32.380 INFO:teuthology.orchestra.run.smithi172.stdout: "poolstat_resend": 0, 2024-09-12T02:49:32.380 INFO:teuthology.orchestra.run.smithi172.stdout: "statfs_active": 0, 2024-09-12T02:49:32.380 INFO:teuthology.orchestra.run.smithi172.stdout: "statfs_send": 0, 2024-09-12T02:49:32.380 INFO:teuthology.orchestra.run.smithi172.stdout: "statfs_resend": 0, 2024-09-12T02:49:32.380 INFO:teuthology.orchestra.run.smithi172.stdout: "command_active": 0, 2024-09-12T02:49:32.380 INFO:teuthology.orchestra.run.smithi172.stdout: "command_send": 0, 2024-09-12T02:49:32.380 INFO:teuthology.orchestra.run.smithi172.stdout: "command_resend": 0, 2024-09-12T02:49:32.380 INFO:teuthology.orchestra.run.smithi172.stdout: "map_epoch": 108, 2024-09-12T02:49:32.381 INFO:teuthology.orchestra.run.smithi172.stdout: "map_full": 0, 2024-09-12T02:49:32.381 INFO:teuthology.orchestra.run.smithi172.stdout: "map_inc": 15, 2024-09-12T02:49:32.381 INFO:teuthology.orchestra.run.smithi172.stdout: "osd_sessions": 10, 2024-09-12T02:49:32.381 INFO:teuthology.orchestra.run.smithi172.stdout: "osd_session_open": 10, 2024-09-12T02:49:32.381 INFO:teuthology.orchestra.run.smithi172.stdout: "osd_session_close": 0, 2024-09-12T02:49:32.381 INFO:teuthology.orchestra.run.smithi172.stdout: "osd_laggy": 0, 2024-09-12T02:49:32.381 INFO:teuthology.orchestra.run.smithi172.stdout: "omap_wr": 17, 2024-09-12T02:49:32.381 INFO:teuthology.orchestra.run.smithi172.stdout: "omap_rd": 0, 2024-09-12T02:49:32.381 INFO:teuthology.orchestra.run.smithi172.stdout: "omap_del": 2 2024-09-12T02:49:32.382 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-09-12T02:49:32.382 INFO:teuthology.orchestra.run.smithi172.stdout: "oft": { 2024-09-12T02:49:32.382 INFO:teuthology.orchestra.run.smithi172.stdout: "omap_total_objs": 1, 2024-09-12T02:49:32.382 INFO:teuthology.orchestra.run.smithi172.stdout: "omap_total_kv_pairs": 0, 2024-09-12T02:49:32.382 INFO:teuthology.orchestra.run.smithi172.stdout: "omap_total_updates": 0, 2024-09-12T02:49:32.382 INFO:teuthology.orchestra.run.smithi172.stdout: "omap_total_removes": 0 2024-09-12T02:49:32.382 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-09-12T02:49:32.382 INFO:teuthology.orchestra.run.smithi172.stdout: "osd-slow-ops": { 2024-09-12T02:49:32.382 INFO:teuthology.orchestra.run.smithi172.stdout: "slow_ops_count": 0 2024-09-12T02:49:32.382 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-09-12T02:49:32.382 INFO:teuthology.orchestra.run.smithi172.stdout: "purge_queue": { 2024-09-12T02:49:32.382 INFO:teuthology.orchestra.run.smithi172.stdout: "pq_executing_ops": 0, 2024-09-12T02:49:32.382 INFO:teuthology.orchestra.run.smithi172.stdout: "pq_executing_ops_high_water": 0, 2024-09-12T02:49:32.383 INFO:teuthology.orchestra.run.smithi172.stdout: "pq_executing": 0, 2024-09-12T02:49:32.383 INFO:teuthology.orchestra.run.smithi172.stdout: "pq_executing_high_water": 0, 2024-09-12T02:49:32.383 INFO:teuthology.orchestra.run.smithi172.stdout: "pq_executed_ops": 0, 2024-09-12T02:49:32.383 INFO:teuthology.orchestra.run.smithi172.stdout: "pq_executed": 0, 2024-09-12T02:49:32.383 INFO:teuthology.orchestra.run.smithi172.stdout: "pq_item_in_journal": 0 2024-09-12T02:49:32.383 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-09-12T02:49:32.383 INFO:teuthology.orchestra.run.smithi172.stdout: "throttle-msgr_dispatch_throttler-mds": { 2024-09-12T02:49:32.383 INFO:teuthology.orchestra.run.smithi172.stdout: "val": 0, 2024-09-12T02:49:32.383 INFO:teuthology.orchestra.run.smithi172.stdout: "max": 104857600, 2024-09-12T02:49:32.383 INFO:teuthology.orchestra.run.smithi172.stdout: "get_started": 0, 2024-09-12T02:49:32.383 INFO:teuthology.orchestra.run.smithi172.stdout: "get": 1156, 2024-09-12T02:49:32.383 INFO:teuthology.orchestra.run.smithi172.stdout: "get_sum": 1922611, 2024-09-12T02:49:32.383 INFO:teuthology.orchestra.run.smithi172.stdout: "get_or_fail_fail": 0, 2024-09-12T02:49:32.384 INFO:teuthology.orchestra.run.smithi172.stdout: "get_or_fail_success": 1156, 2024-09-12T02:49:32.384 INFO:teuthology.orchestra.run.smithi172.stdout: "take": 0, 2024-09-12T02:49:32.384 INFO:teuthology.orchestra.run.smithi172.stdout: "take_sum": 0, 2024-09-12T02:49:32.384 INFO:teuthology.orchestra.run.smithi172.stdout: "put": 1156, 2024-09-12T02:49:32.384 INFO:teuthology.orchestra.run.smithi172.stdout: "put_sum": 1922611, 2024-09-12T02:49:32.384 INFO:teuthology.orchestra.run.smithi172.stdout: "wait": { 2024-09-12T02:49:32.384 INFO:teuthology.orchestra.run.smithi172.stdout: "avgcount": 0, 2024-09-12T02:49:32.384 INFO:teuthology.orchestra.run.smithi172.stdout: "sum": 0.000000000, 2024-09-12T02:49:32.384 INFO:teuthology.orchestra.run.smithi172.stdout: "avgtime": 0.000000000 2024-09-12T02:49:32.384 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-09-12T02:49:32.385 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-09-12T02:49:32.385 INFO:teuthology.orchestra.run.smithi172.stdout: "throttle-objecter_bytes": { 2024-09-12T02:49:32.385 INFO:teuthology.orchestra.run.smithi172.stdout: "val": 0, 2024-09-12T02:49:32.385 INFO:teuthology.orchestra.run.smithi172.stdout: "max": 104857600, 2024-09-12T02:49:32.385 INFO:teuthology.orchestra.run.smithi172.stdout: "get_started": 0, 2024-09-12T02:49:32.385 INFO:teuthology.orchestra.run.smithi172.stdout: "get": 0, 2024-09-12T02:49:32.386 INFO:teuthology.orchestra.run.smithi172.stdout: "get_sum": 0, 2024-09-12T02:49:32.386 INFO:teuthology.orchestra.run.smithi172.stdout: "get_or_fail_fail": 0, 2024-09-12T02:49:32.386 INFO:teuthology.orchestra.run.smithi172.stdout: "get_or_fail_success": 0, 2024-09-12T02:49:32.386 INFO:teuthology.orchestra.run.smithi172.stdout: "take": 45, 2024-09-12T02:49:32.386 INFO:teuthology.orchestra.run.smithi172.stdout: "take_sum": 12586, 2024-09-12T02:49:32.386 INFO:teuthology.orchestra.run.smithi172.stdout: "put": 45, 2024-09-12T02:49:32.387 INFO:teuthology.orchestra.run.smithi172.stdout: "put_sum": 12586, 2024-09-12T02:49:32.387 INFO:teuthology.orchestra.run.smithi172.stdout: "wait": { 2024-09-12T02:49:32.387 INFO:teuthology.orchestra.run.smithi172.stdout: "avgcount": 0, 2024-09-12T02:49:32.387 INFO:teuthology.orchestra.run.smithi172.stdout: "sum": 0.000000000, 2024-09-12T02:49:32.387 INFO:teuthology.orchestra.run.smithi172.stdout: "avgtime": 0.000000000 2024-09-12T02:49:32.387 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-09-12T02:49:32.388 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-09-12T02:49:32.388 INFO:teuthology.orchestra.run.smithi172.stdout: "throttle-objecter_ops": { 2024-09-12T02:49:32.388 INFO:teuthology.orchestra.run.smithi172.stdout: "val": 0, 2024-09-12T02:49:32.388 INFO:teuthology.orchestra.run.smithi172.stdout: "max": 1024, 2024-09-12T02:49:32.388 INFO:teuthology.orchestra.run.smithi172.stdout: "get_started": 0, 2024-09-12T02:49:32.388 INFO:teuthology.orchestra.run.smithi172.stdout: "get": 0, 2024-09-12T02:49:32.389 INFO:teuthology.orchestra.run.smithi172.stdout: "get_sum": 0, 2024-09-12T02:49:32.389 INFO:teuthology.orchestra.run.smithi172.stdout: "get_or_fail_fail": 0, 2024-09-12T02:49:32.389 INFO:teuthology.orchestra.run.smithi172.stdout: "get_or_fail_success": 0, 2024-09-12T02:49:32.389 INFO:teuthology.orchestra.run.smithi172.stdout: "take": 45, 2024-09-12T02:49:32.389 INFO:teuthology.orchestra.run.smithi172.stdout: "take_sum": 45, 2024-09-12T02:49:32.389 INFO:teuthology.orchestra.run.smithi172.stdout: "put": 45, 2024-09-12T02:49:32.389 INFO:teuthology.orchestra.run.smithi172.stdout: "put_sum": 45, 2024-09-12T02:49:32.390 INFO:teuthology.orchestra.run.smithi172.stdout: "wait": { 2024-09-12T02:49:32.390 INFO:teuthology.orchestra.run.smithi172.stdout: "avgcount": 0, 2024-09-12T02:49:32.390 INFO:teuthology.orchestra.run.smithi172.stdout: "sum": 0.000000000, 2024-09-12T02:49:32.390 INFO:teuthology.orchestra.run.smithi172.stdout: "avgtime": 0.000000000 2024-09-12T02:49:32.390 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-09-12T02:49:32.390 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-09-12T02:49:32.390 INFO:teuthology.orchestra.run.smithi172.stdout: "throttle-write_buf_throttle": { 2024-09-12T02:49:32.391 INFO:teuthology.orchestra.run.smithi172.stdout: "val": 0, 2024-09-12T02:49:32.391 INFO:teuthology.orchestra.run.smithi172.stdout: "max": 3758096384, 2024-09-12T02:49:32.391 INFO:teuthology.orchestra.run.smithi172.stdout: "get_started": 0, 2024-09-12T02:49:32.391 INFO:teuthology.orchestra.run.smithi172.stdout: "get": 0, 2024-09-12T02:49:32.391 INFO:teuthology.orchestra.run.smithi172.stdout: "get_sum": 0, 2024-09-12T02:49:32.391 INFO:teuthology.orchestra.run.smithi172.stdout: "get_or_fail_fail": 0, 2024-09-12T02:49:32.392 INFO:teuthology.orchestra.run.smithi172.stdout: "get_or_fail_success": 0, 2024-09-12T02:49:32.392 INFO:teuthology.orchestra.run.smithi172.stdout: "take": 0, 2024-09-12T02:49:32.392 INFO:teuthology.orchestra.run.smithi172.stdout: "take_sum": 0, 2024-09-12T02:49:32.392 INFO:teuthology.orchestra.run.smithi172.stdout: "put": 0, 2024-09-12T02:49:32.393 INFO:teuthology.orchestra.run.smithi172.stdout: "put_sum": 0, 2024-09-12T02:49:32.393 INFO:teuthology.orchestra.run.smithi172.stdout: "wait": { 2024-09-12T02:49:32.393 INFO:teuthology.orchestra.run.smithi172.stdout: "avgcount": 0, 2024-09-12T02:49:32.393 INFO:teuthology.orchestra.run.smithi172.stdout: "sum": 0.000000000, 2024-09-12T02:49:32.393 INFO:teuthology.orchestra.run.smithi172.stdout: "avgtime": 0.000000000 2024-09-12T02:49:32.393 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-09-12T02:49:32.393 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-09-12T02:49:32.394 INFO:teuthology.orchestra.run.smithi172.stdout: "throttle-write_buf_throttle-0x55cf1666c960": { 2024-09-12T02:49:32.394 INFO:teuthology.orchestra.run.smithi172.stdout: "val": 0, 2024-09-12T02:49:32.394 INFO:teuthology.orchestra.run.smithi172.stdout: "max": 3758096384, 2024-09-12T02:49:32.394 INFO:teuthology.orchestra.run.smithi172.stdout: "get_started": 0, 2024-09-12T02:49:32.394 INFO:teuthology.orchestra.run.smithi172.stdout: "get": 7, 2024-09-12T02:49:32.394 INFO:teuthology.orchestra.run.smithi172.stdout: "get_sum": 2049, 2024-09-12T02:49:32.395 INFO:teuthology.orchestra.run.smithi172.stdout: "get_or_fail_fail": 0, 2024-09-12T02:49:32.395 INFO:teuthology.orchestra.run.smithi172.stdout: "get_or_fail_success": 7, 2024-09-12T02:49:32.395 INFO:teuthology.orchestra.run.smithi172.stdout: "take": 0, 2024-09-12T02:49:32.395 INFO:teuthology.orchestra.run.smithi172.stdout: "take_sum": 0, 2024-09-12T02:49:32.395 INFO:teuthology.orchestra.run.smithi172.stdout: "put": 6, 2024-09-12T02:49:32.395 INFO:teuthology.orchestra.run.smithi172.stdout: "put_sum": 2049, 2024-09-12T02:49:32.395 INFO:teuthology.orchestra.run.smithi172.stdout: "wait": { 2024-09-12T02:49:32.396 INFO:teuthology.orchestra.run.smithi172.stdout: "avgcount": 0, 2024-09-12T02:49:32.396 INFO:teuthology.orchestra.run.smithi172.stdout: "sum": 0.000000000, 2024-09-12T02:49:32.396 INFO:teuthology.orchestra.run.smithi172.stdout: "avgtime": 0.000000000 2024-09-12T02:49:32.396 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-09-12T02:49:32.396 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-09-12T02:49:32.396 INFO:teuthology.orchestra.run.smithi172.stdout:} 2024-09-12T02:49:33.052 INFO:tasks.check_counter:Daemon mds.f mds.exported=0 2024-09-12T02:49:33.053 INFO:tasks.check_counter:Daemon mds.f mds.imported=0 2024-09-12T02:49:33.053 INFO:tasks.check_counter:Daemon mds.f mds_cache.dir_update=0 2024-09-12T02:49:33.053 INFO:tasks.check_counter:Daemon mds.f mds_cache.dir_update_receipt=11 2024-09-12T02:49:33.053 INFO:tasks.check_counter:Daemon mds.f mds.root_rsnaps=6 2024-09-12T02:49:33.053 INFO:tasks.check_counter:Daemon mds.f mds_server.req_mksnap_latency.avgcount=0 2024-09-12T02:49:33.053 INFO:tasks.check_counter:Daemon mds.f mds_server.req_rmsnap_latency.avgcount=0 2024-09-12T02:49:33.053 DEBUG:tasks.check_counter:Getting stats from i 2024-09-12T02:49:33.053 DEBUG:teuthology.orchestra.run.smithi172:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc shell --fsid 4954ed46-70ae-11ef-bcea-c7b262605968 -- ceph daemon mds.i perf dump 2024-09-12T02:49:33.302 INFO:teuthology.orchestra.run.smithi172.stderr:Inferring config /var/lib/ceph/4954ed46-70ae-11ef-bcea-c7b262605968/mon.c/config 2024-09-12T02:49:33.825 INFO:teuthology.orchestra.run.smithi172.stdout:{ 2024-09-12T02:49:33.825 INFO:teuthology.orchestra.run.smithi172.stdout: "AsyncMessenger::Worker-0": { 2024-09-12T02:49:33.825 INFO:teuthology.orchestra.run.smithi172.stdout: "msgr_recv_messages": 327, 2024-09-12T02:49:33.825 INFO:teuthology.orchestra.run.smithi172.stdout: "msgr_send_messages": 324, 2024-09-12T02:49:33.825 INFO:teuthology.orchestra.run.smithi172.stdout: "msgr_recv_bytes": 1797331, 2024-09-12T02:49:33.825 INFO:teuthology.orchestra.run.smithi172.stdout: "msgr_send_bytes": 171027, 2024-09-12T02:49:33.825 INFO:teuthology.orchestra.run.smithi172.stdout: "msgr_created_connections": 8, 2024-09-12T02:49:33.825 INFO:teuthology.orchestra.run.smithi172.stdout: "msgr_active_connections": 4, 2024-09-12T02:49:33.825 INFO:teuthology.orchestra.run.smithi172.stdout: "msgr_running_total_time": 0.054526930, 2024-09-12T02:49:33.825 INFO:teuthology.orchestra.run.smithi172.stdout: "msgr_running_send_time": 0.019623950, 2024-09-12T02:49:33.826 INFO:teuthology.orchestra.run.smithi172.stdout: "msgr_running_recv_time": 0.052137834, 2024-09-12T02:49:33.826 INFO:teuthology.orchestra.run.smithi172.stdout: "msgr_running_fast_dispatch_time": 0.000238974, 2024-09-12T02:49:33.826 INFO:teuthology.orchestra.run.smithi172.stdout: "msgr_send_messages_queue_lat": { 2024-09-12T02:49:33.826 INFO:teuthology.orchestra.run.smithi172.stdout: "avgcount": 323, 2024-09-12T02:49:33.826 INFO:teuthology.orchestra.run.smithi172.stdout: "sum": 0.024748490, 2024-09-12T02:49:33.826 INFO:teuthology.orchestra.run.smithi172.stdout: "avgtime": 0.000076620 2024-09-12T02:49:33.826 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-09-12T02:49:33.826 INFO:teuthology.orchestra.run.smithi172.stdout: "msgr_handle_ack_lat": { 2024-09-12T02:49:33.826 INFO:teuthology.orchestra.run.smithi172.stdout: "avgcount": 36, 2024-09-12T02:49:33.826 INFO:teuthology.orchestra.run.smithi172.stdout: "sum": 0.000008505, 2024-09-12T02:49:33.826 INFO:teuthology.orchestra.run.smithi172.stdout: "avgtime": 0.000000236 2024-09-12T02:49:33.826 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-09-12T02:49:33.826 INFO:teuthology.orchestra.run.smithi172.stdout: "msgr_recv_encrypted_bytes": 1795104, 2024-09-12T02:49:33.827 INFO:teuthology.orchestra.run.smithi172.stdout: "msgr_send_encrypted_bytes": 161968 2024-09-12T02:49:33.827 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-09-12T02:49:33.827 INFO:teuthology.orchestra.run.smithi172.stdout: "AsyncMessenger::Worker-1": { 2024-09-12T02:49:33.827 INFO:teuthology.orchestra.run.smithi172.stdout: "msgr_recv_messages": 811, 2024-09-12T02:49:33.827 INFO:teuthology.orchestra.run.smithi172.stdout: "msgr_send_messages": 893, 2024-09-12T02:49:33.827 INFO:teuthology.orchestra.run.smithi172.stdout: "msgr_recv_bytes": 250225, 2024-09-12T02:49:33.827 INFO:teuthology.orchestra.run.smithi172.stdout: "msgr_send_bytes": 849168, 2024-09-12T02:49:33.827 INFO:teuthology.orchestra.run.smithi172.stdout: "msgr_created_connections": 10, 2024-09-12T02:49:33.827 INFO:teuthology.orchestra.run.smithi172.stdout: "msgr_active_connections": 7, 2024-09-12T02:49:33.827 INFO:teuthology.orchestra.run.smithi172.stdout: "msgr_running_total_time": 0.095415822, 2024-09-12T02:49:33.827 INFO:teuthology.orchestra.run.smithi172.stdout: "msgr_running_send_time": 0.041065581, 2024-09-12T02:49:33.827 INFO:teuthology.orchestra.run.smithi172.stdout: "msgr_running_recv_time": 0.051249069, 2024-09-12T02:49:33.827 INFO:teuthology.orchestra.run.smithi172.stdout: "msgr_running_fast_dispatch_time": 0.005827312, 2024-09-12T02:49:33.828 INFO:teuthology.orchestra.run.smithi172.stdout: "msgr_send_messages_queue_lat": { 2024-09-12T02:49:33.828 INFO:teuthology.orchestra.run.smithi172.stdout: "avgcount": 890, 2024-09-12T02:49:33.828 INFO:teuthology.orchestra.run.smithi172.stdout: "sum": 0.068112133, 2024-09-12T02:49:33.828 INFO:teuthology.orchestra.run.smithi172.stdout: "avgtime": 0.000076530 2024-09-12T02:49:33.828 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-09-12T02:49:33.828 INFO:teuthology.orchestra.run.smithi172.stdout: "msgr_handle_ack_lat": { 2024-09-12T02:49:33.828 INFO:teuthology.orchestra.run.smithi172.stdout: "avgcount": 1438, 2024-09-12T02:49:33.828 INFO:teuthology.orchestra.run.smithi172.stdout: "sum": 0.000329264, 2024-09-12T02:49:33.828 INFO:teuthology.orchestra.run.smithi172.stdout: "avgtime": 0.000000228 2024-09-12T02:49:33.828 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-09-12T02:49:33.828 INFO:teuthology.orchestra.run.smithi172.stdout: "msgr_recv_encrypted_bytes": 320, 2024-09-12T02:49:33.828 INFO:teuthology.orchestra.run.smithi172.stdout: "msgr_send_encrypted_bytes": 473152 2024-09-12T02:49:33.828 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-09-12T02:49:33.828 INFO:teuthology.orchestra.run.smithi172.stdout: "AsyncMessenger::Worker-2": { 2024-09-12T02:49:33.829 INFO:teuthology.orchestra.run.smithi172.stdout: "msgr_recv_messages": 26, 2024-09-12T02:49:33.829 INFO:teuthology.orchestra.run.smithi172.stdout: "msgr_send_messages": 28, 2024-09-12T02:49:33.829 INFO:teuthology.orchestra.run.smithi172.stdout: "msgr_recv_bytes": 8436, 2024-09-12T02:49:33.829 INFO:teuthology.orchestra.run.smithi172.stdout: "msgr_send_bytes": 58049, 2024-09-12T02:49:33.829 INFO:teuthology.orchestra.run.smithi172.stdout: "msgr_created_connections": 12, 2024-09-12T02:49:33.829 INFO:teuthology.orchestra.run.smithi172.stdout: "msgr_active_connections": 6, 2024-09-12T02:49:33.829 INFO:teuthology.orchestra.run.smithi172.stdout: "msgr_running_total_time": 0.006843477, 2024-09-12T02:49:33.829 INFO:teuthology.orchestra.run.smithi172.stdout: "msgr_running_send_time": 0.000504201, 2024-09-12T02:49:33.829 INFO:teuthology.orchestra.run.smithi172.stdout: "msgr_running_recv_time": 0.005852334, 2024-09-12T02:49:33.829 INFO:teuthology.orchestra.run.smithi172.stdout: "msgr_running_fast_dispatch_time": 0.000298261, 2024-09-12T02:49:33.829 INFO:teuthology.orchestra.run.smithi172.stdout: "msgr_send_messages_queue_lat": { 2024-09-12T02:49:33.829 INFO:teuthology.orchestra.run.smithi172.stdout: "avgcount": 27, 2024-09-12T02:49:33.829 INFO:teuthology.orchestra.run.smithi172.stdout: "sum": 0.017744593, 2024-09-12T02:49:33.830 INFO:teuthology.orchestra.run.smithi172.stdout: "avgtime": 0.000657207 2024-09-12T02:49:33.830 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-09-12T02:49:33.830 INFO:teuthology.orchestra.run.smithi172.stdout: "msgr_handle_ack_lat": { 2024-09-12T02:49:33.830 INFO:teuthology.orchestra.run.smithi172.stdout: "avgcount": 13, 2024-09-12T02:49:33.830 INFO:teuthology.orchestra.run.smithi172.stdout: "sum": 0.000001679, 2024-09-12T02:49:33.830 INFO:teuthology.orchestra.run.smithi172.stdout: "avgtime": 0.000000129 2024-09-12T02:49:33.830 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-09-12T02:49:33.830 INFO:teuthology.orchestra.run.smithi172.stdout: "msgr_recv_encrypted_bytes": 4000, 2024-09-12T02:49:33.830 INFO:teuthology.orchestra.run.smithi172.stdout: "msgr_send_encrypted_bytes": 1664 2024-09-12T02:49:33.830 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-09-12T02:49:33.830 INFO:teuthology.orchestra.run.smithi172.stdout: "cct": { 2024-09-12T02:49:33.830 INFO:teuthology.orchestra.run.smithi172.stdout: "total_workers": 1, 2024-09-12T02:49:33.830 INFO:teuthology.orchestra.run.smithi172.stdout: "unhealthy_workers": 0 2024-09-12T02:49:33.831 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-09-12T02:49:33.831 INFO:teuthology.orchestra.run.smithi172.stdout: "finisher-MDSRank": { 2024-09-12T02:49:33.831 INFO:teuthology.orchestra.run.smithi172.stdout: "queue_len": 0, 2024-09-12T02:49:33.831 INFO:teuthology.orchestra.run.smithi172.stdout: "complete_latency": { 2024-09-12T02:49:33.831 INFO:teuthology.orchestra.run.smithi172.stdout: "avgcount": 48, 2024-09-12T02:49:33.831 INFO:teuthology.orchestra.run.smithi172.stdout: "sum": 0.001745878, 2024-09-12T02:49:33.831 INFO:teuthology.orchestra.run.smithi172.stdout: "avgtime": 0.000036372 2024-09-12T02:49:33.831 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-09-12T02:49:33.831 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-09-12T02:49:33.831 INFO:teuthology.orchestra.run.smithi172.stdout: "finisher-PurgeQueue": { 2024-09-12T02:49:33.831 INFO:teuthology.orchestra.run.smithi172.stdout: "queue_len": 0, 2024-09-12T02:49:33.831 INFO:teuthology.orchestra.run.smithi172.stdout: "complete_latency": { 2024-09-12T02:49:33.831 INFO:teuthology.orchestra.run.smithi172.stdout: "avgcount": 2, 2024-09-12T02:49:33.831 INFO:teuthology.orchestra.run.smithi172.stdout: "sum": 0.000014960, 2024-09-12T02:49:33.832 INFO:teuthology.orchestra.run.smithi172.stdout: "avgtime": 0.000007480 2024-09-12T02:49:33.832 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-09-12T02:49:33.832 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-09-12T02:49:33.832 INFO:teuthology.orchestra.run.smithi172.stdout: "mds": { 2024-09-12T02:49:33.832 INFO:teuthology.orchestra.run.smithi172.stdout: "request": 1, 2024-09-12T02:49:33.832 INFO:teuthology.orchestra.run.smithi172.stdout: "reply": 1, 2024-09-12T02:49:33.832 INFO:teuthology.orchestra.run.smithi172.stdout: "reply_latency": { 2024-09-12T02:49:33.832 INFO:teuthology.orchestra.run.smithi172.stdout: "avgcount": 1, 2024-09-12T02:49:33.832 INFO:teuthology.orchestra.run.smithi172.stdout: "sum": 0.000085219, 2024-09-12T02:49:33.832 INFO:teuthology.orchestra.run.smithi172.stdout: "avgtime": 0.000085219 2024-09-12T02:49:33.832 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-09-12T02:49:33.832 INFO:teuthology.orchestra.run.smithi172.stdout: "slow_reply": 0, 2024-09-12T02:49:33.832 INFO:teuthology.orchestra.run.smithi172.stdout: "forward": 0, 2024-09-12T02:49:33.832 INFO:teuthology.orchestra.run.smithi172.stdout: "dir_fetch_complete": 0, 2024-09-12T02:49:33.833 INFO:teuthology.orchestra.run.smithi172.stdout: "dir_fetch_keys": 0, 2024-09-12T02:49:33.833 INFO:teuthology.orchestra.run.smithi172.stdout: "dir_commit": 11, 2024-09-12T02:49:33.833 INFO:teuthology.orchestra.run.smithi172.stdout: "dir_split": 0, 2024-09-12T02:49:33.833 INFO:teuthology.orchestra.run.smithi172.stdout: "dir_merge": 0, 2024-09-12T02:49:33.833 INFO:teuthology.orchestra.run.smithi172.stdout: "inodes": 16, 2024-09-12T02:49:33.833 INFO:teuthology.orchestra.run.smithi172.stdout: "inodes_top": 0, 2024-09-12T02:49:33.833 INFO:teuthology.orchestra.run.smithi172.stdout: "inodes_bottom": 16, 2024-09-12T02:49:33.833 INFO:teuthology.orchestra.run.smithi172.stdout: "inodes_pin_tail": 0, 2024-09-12T02:49:33.833 INFO:teuthology.orchestra.run.smithi172.stdout: "inodes_pinned": 13, 2024-09-12T02:49:33.833 INFO:teuthology.orchestra.run.smithi172.stdout: "inodes_expired": 4, 2024-09-12T02:49:33.833 INFO:teuthology.orchestra.run.smithi172.stdout: "inodes_with_caps": 1, 2024-09-12T02:49:33.833 INFO:teuthology.orchestra.run.smithi172.stdout: "caps": 1, 2024-09-12T02:49:33.833 INFO:teuthology.orchestra.run.smithi172.stdout: "subtrees": 3, 2024-09-12T02:49:33.834 INFO:teuthology.orchestra.run.smithi172.stdout: "traverse": 7, 2024-09-12T02:49:33.834 INFO:teuthology.orchestra.run.smithi172.stdout: "traverse_hit": 4, 2024-09-12T02:49:33.834 INFO:teuthology.orchestra.run.smithi172.stdout: "traverse_forward": 0, 2024-09-12T02:49:33.834 INFO:teuthology.orchestra.run.smithi172.stdout: "traverse_discover": 3, 2024-09-12T02:49:33.834 INFO:teuthology.orchestra.run.smithi172.stdout: "traverse_dir_fetch": 0, 2024-09-12T02:49:33.834 INFO:teuthology.orchestra.run.smithi172.stdout: "traverse_remote_ino": 0, 2024-09-12T02:49:33.834 INFO:teuthology.orchestra.run.smithi172.stdout: "traverse_lock": 0, 2024-09-12T02:49:33.834 INFO:teuthology.orchestra.run.smithi172.stdout: "load_cent": 0, 2024-09-12T02:49:33.834 INFO:teuthology.orchestra.run.smithi172.stdout: "q": 0, 2024-09-12T02:49:33.834 INFO:teuthology.orchestra.run.smithi172.stdout: "exported": 0, 2024-09-12T02:49:33.834 INFO:teuthology.orchestra.run.smithi172.stdout: "exported_inodes": 0, 2024-09-12T02:49:33.834 INFO:teuthology.orchestra.run.smithi172.stdout: "imported": 0, 2024-09-12T02:49:33.834 INFO:teuthology.orchestra.run.smithi172.stdout: "imported_inodes": 0, 2024-09-12T02:49:33.835 INFO:teuthology.orchestra.run.smithi172.stdout: "openino_dir_fetch": 0, 2024-09-12T02:49:33.835 INFO:teuthology.orchestra.run.smithi172.stdout: "openino_backtrace_fetch": 0, 2024-09-12T02:49:33.835 INFO:teuthology.orchestra.run.smithi172.stdout: "openino_peer_discover": 0, 2024-09-12T02:49:33.835 INFO:teuthology.orchestra.run.smithi172.stdout: "root_rfiles": 4, 2024-09-12T02:49:33.835 INFO:teuthology.orchestra.run.smithi172.stdout: "root_rbytes": 234, 2024-09-12T02:49:33.835 INFO:teuthology.orchestra.run.smithi172.stdout: "root_rsnaps": 6, 2024-09-12T02:49:33.835 INFO:teuthology.orchestra.run.smithi172.stdout: "scrub_backtrace_fetch": 0, 2024-09-12T02:49:33.835 INFO:teuthology.orchestra.run.smithi172.stdout: "scrub_set_tag": 0, 2024-09-12T02:49:33.835 INFO:teuthology.orchestra.run.smithi172.stdout: "scrub_backtrace_repaired": 0, 2024-09-12T02:49:33.835 INFO:teuthology.orchestra.run.smithi172.stdout: "scrub_inotable_repaired": 0, 2024-09-12T02:49:33.835 INFO:teuthology.orchestra.run.smithi172.stdout: "scrub_dir_inodes": 0, 2024-09-12T02:49:33.835 INFO:teuthology.orchestra.run.smithi172.stdout: "scrub_dir_base_inodes": 0, 2024-09-12T02:49:33.835 INFO:teuthology.orchestra.run.smithi172.stdout: "scrub_dirfrag_rstats": 0, 2024-09-12T02:49:33.835 INFO:teuthology.orchestra.run.smithi172.stdout: "scrub_file_inodes": 0, 2024-09-12T02:49:33.836 INFO:teuthology.orchestra.run.smithi172.stdout: "handle_inode_file_caps": 0, 2024-09-12T02:49:33.836 INFO:teuthology.orchestra.run.smithi172.stdout: "ceph_cap_op_revoke": 0, 2024-09-12T02:49:33.836 INFO:teuthology.orchestra.run.smithi172.stdout: "ceph_cap_op_grant": 0, 2024-09-12T02:49:33.836 INFO:teuthology.orchestra.run.smithi172.stdout: "ceph_cap_op_trunc": 0, 2024-09-12T02:49:33.836 INFO:teuthology.orchestra.run.smithi172.stdout: "ceph_cap_op_flushsnap_ack": 0, 2024-09-12T02:49:33.836 INFO:teuthology.orchestra.run.smithi172.stdout: "ceph_cap_op_flush_ack": 0, 2024-09-12T02:49:33.836 INFO:teuthology.orchestra.run.smithi172.stdout: "handle_client_caps": 0, 2024-09-12T02:49:33.836 INFO:teuthology.orchestra.run.smithi172.stdout: "handle_client_caps_dirty": 0, 2024-09-12T02:49:33.836 INFO:teuthology.orchestra.run.smithi172.stdout: "handle_client_cap_release": 0, 2024-09-12T02:49:33.836 INFO:teuthology.orchestra.run.smithi172.stdout: "process_request_cap_release": 0 2024-09-12T02:49:33.836 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-09-12T02:49:33.836 INFO:teuthology.orchestra.run.smithi172.stdout: "mds_cache": { 2024-09-12T02:49:33.836 INFO:teuthology.orchestra.run.smithi172.stdout: "dir_update": 0, 2024-09-12T02:49:33.836 INFO:teuthology.orchestra.run.smithi172.stdout: "dir_update_receipt": 11, 2024-09-12T02:49:33.837 INFO:teuthology.orchestra.run.smithi172.stdout: "dir_try_discover": 7, 2024-09-12T02:49:33.837 INFO:teuthology.orchestra.run.smithi172.stdout: "dir_send_discover": 8, 2024-09-12T02:49:33.837 INFO:teuthology.orchestra.run.smithi172.stdout: "dir_handle_discover": 0, 2024-09-12T02:49:33.837 INFO:teuthology.orchestra.run.smithi172.stdout: "num_strays": 0, 2024-09-12T02:49:33.837 INFO:teuthology.orchestra.run.smithi172.stdout: "num_strays_delayed": 0, 2024-09-12T02:49:33.837 INFO:teuthology.orchestra.run.smithi172.stdout: "num_strays_enqueuing": 0, 2024-09-12T02:49:33.837 INFO:teuthology.orchestra.run.smithi172.stdout: "strays_created": 0, 2024-09-12T02:49:33.837 INFO:teuthology.orchestra.run.smithi172.stdout: "strays_enqueued": 0, 2024-09-12T02:49:33.837 INFO:teuthology.orchestra.run.smithi172.stdout: "strays_reintegrated": 0, 2024-09-12T02:49:33.837 INFO:teuthology.orchestra.run.smithi172.stdout: "strays_migrated": 0, 2024-09-12T02:49:33.837 INFO:teuthology.orchestra.run.smithi172.stdout: "num_recovering_processing": 0, 2024-09-12T02:49:33.837 INFO:teuthology.orchestra.run.smithi172.stdout: "num_recovering_enqueued": 0, 2024-09-12T02:49:33.837 INFO:teuthology.orchestra.run.smithi172.stdout: "num_recovering_prioritized": 0, 2024-09-12T02:49:33.837 INFO:teuthology.orchestra.run.smithi172.stdout: "recovery_started": 0, 2024-09-12T02:49:33.838 INFO:teuthology.orchestra.run.smithi172.stdout: "recovery_completed": 0, 2024-09-12T02:49:33.838 INFO:teuthology.orchestra.run.smithi172.stdout: "ireq_quiesce_path": 0, 2024-09-12T02:49:33.838 INFO:teuthology.orchestra.run.smithi172.stdout: "ireq_quiesce_inode": 0, 2024-09-12T02:49:33.838 INFO:teuthology.orchestra.run.smithi172.stdout: "ireq_enqueue_scrub": 0, 2024-09-12T02:49:33.838 INFO:teuthology.orchestra.run.smithi172.stdout: "ireq_exportdir": 0, 2024-09-12T02:49:33.838 INFO:teuthology.orchestra.run.smithi172.stdout: "ireq_flush": 0, 2024-09-12T02:49:33.838 INFO:teuthology.orchestra.run.smithi172.stdout: "ireq_fragmentdir": 0, 2024-09-12T02:49:33.838 INFO:teuthology.orchestra.run.smithi172.stdout: "ireq_fragstats": 0, 2024-09-12T02:49:33.838 INFO:teuthology.orchestra.run.smithi172.stdout: "ireq_inodestats": 0 2024-09-12T02:49:33.838 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-09-12T02:49:33.838 INFO:teuthology.orchestra.run.smithi172.stdout: "mds_log": { 2024-09-12T02:49:33.838 INFO:teuthology.orchestra.run.smithi172.stdout: "evlrg": 0, 2024-09-12T02:49:33.838 INFO:teuthology.orchestra.run.smithi172.stdout: "evadd": 6, 2024-09-12T02:49:33.838 INFO:teuthology.orchestra.run.smithi172.stdout: "evex": 0, 2024-09-12T02:49:33.839 INFO:teuthology.orchestra.run.smithi172.stdout: "evtrm": 0, 2024-09-12T02:49:33.839 INFO:teuthology.orchestra.run.smithi172.stdout: "ev": 6, 2024-09-12T02:49:33.839 INFO:teuthology.orchestra.run.smithi172.stdout: "evexg": 0, 2024-09-12T02:49:33.839 INFO:teuthology.orchestra.run.smithi172.stdout: "evexd": 0, 2024-09-12T02:49:33.839 INFO:teuthology.orchestra.run.smithi172.stdout: "segadd": 2, 2024-09-12T02:49:33.839 INFO:teuthology.orchestra.run.smithi172.stdout: "segex": 0, 2024-09-12T02:49:33.839 INFO:teuthology.orchestra.run.smithi172.stdout: "segtrm": 0, 2024-09-12T02:49:33.839 INFO:teuthology.orchestra.run.smithi172.stdout: "seg": 2, 2024-09-12T02:49:33.839 INFO:teuthology.orchestra.run.smithi172.stdout: "segmjr": 2, 2024-09-12T02:49:33.839 INFO:teuthology.orchestra.run.smithi172.stdout: "segexg": 0, 2024-09-12T02:49:33.839 INFO:teuthology.orchestra.run.smithi172.stdout: "segexd": 0, 2024-09-12T02:49:33.839 INFO:teuthology.orchestra.run.smithi172.stdout: "expos": 4194304, 2024-09-12T02:49:33.839 INFO:teuthology.orchestra.run.smithi172.stdout: "wrpos": 4196130, 2024-09-12T02:49:33.839 INFO:teuthology.orchestra.run.smithi172.stdout: "rdpos": 0, 2024-09-12T02:49:33.839 INFO:teuthology.orchestra.run.smithi172.stdout: "jlat": { 2024-09-12T02:49:33.840 INFO:teuthology.orchestra.run.smithi172.stdout: "avgcount": 5, 2024-09-12T02:49:33.840 INFO:teuthology.orchestra.run.smithi172.stdout: "sum": 0.007875234, 2024-09-12T02:49:33.840 INFO:teuthology.orchestra.run.smithi172.stdout: "avgtime": 0.001575046 2024-09-12T02:49:33.840 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-09-12T02:49:33.840 INFO:teuthology.orchestra.run.smithi172.stdout: "replayed": 0 2024-09-12T02:49:33.840 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-09-12T02:49:33.840 INFO:teuthology.orchestra.run.smithi172.stdout: "mds_mem": { 2024-09-12T02:49:33.840 INFO:teuthology.orchestra.run.smithi172.stdout: "ino": 20, 2024-09-12T02:49:33.840 INFO:teuthology.orchestra.run.smithi172.stdout: "ino+": 22, 2024-09-12T02:49:33.840 INFO:teuthology.orchestra.run.smithi172.stdout: "ino-": 2, 2024-09-12T02:49:33.840 INFO:teuthology.orchestra.run.smithi172.stdout: "dir": 19, 2024-09-12T02:49:33.840 INFO:teuthology.orchestra.run.smithi172.stdout: "dir+": 23, 2024-09-12T02:49:33.840 INFO:teuthology.orchestra.run.smithi172.stdout: "dir-": 4, 2024-09-12T02:49:33.840 INFO:teuthology.orchestra.run.smithi172.stdout: "dn": 16, 2024-09-12T02:49:33.840 INFO:teuthology.orchestra.run.smithi172.stdout: "dn+": 20, 2024-09-12T02:49:33.841 INFO:teuthology.orchestra.run.smithi172.stdout: "dn-": 4, 2024-09-12T02:49:33.841 INFO:teuthology.orchestra.run.smithi172.stdout: "cap": 1, 2024-09-12T02:49:33.841 INFO:teuthology.orchestra.run.smithi172.stdout: "cap+": 1, 2024-09-12T02:49:33.841 INFO:teuthology.orchestra.run.smithi172.stdout: "cap-": 0, 2024-09-12T02:49:33.841 INFO:teuthology.orchestra.run.smithi172.stdout: "rss": 49456, 2024-09-12T02:49:33.841 INFO:teuthology.orchestra.run.smithi172.stdout: "heap": 223520 2024-09-12T02:49:33.841 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-09-12T02:49:33.841 INFO:teuthology.orchestra.run.smithi172.stdout: "mds_server": { 2024-09-12T02:49:33.841 INFO:teuthology.orchestra.run.smithi172.stdout: "dispatch_client_request": 1, 2024-09-12T02:49:33.841 INFO:teuthology.orchestra.run.smithi172.stdout: "dispatch_server_request": 0, 2024-09-12T02:49:33.841 INFO:teuthology.orchestra.run.smithi172.stdout: "handle_client_request": 1, 2024-09-12T02:49:33.841 INFO:teuthology.orchestra.run.smithi172.stdout: "handle_client_session": 23, 2024-09-12T02:49:33.841 INFO:teuthology.orchestra.run.smithi172.stdout: "handle_peer_request": 0, 2024-09-12T02:49:33.841 INFO:teuthology.orchestra.run.smithi172.stdout: "req_create_latency": { 2024-09-12T02:49:33.842 INFO:teuthology.orchestra.run.smithi172.stdout: "avgcount": 0, 2024-09-12T02:49:33.842 INFO:teuthology.orchestra.run.smithi172.stdout: "sum": 0.000000000, 2024-09-12T02:49:33.842 INFO:teuthology.orchestra.run.smithi172.stdout: "avgtime": 0.000000000 2024-09-12T02:49:33.842 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-09-12T02:49:33.842 INFO:teuthology.orchestra.run.smithi172.stdout: "req_getattr_latency": { 2024-09-12T02:49:33.842 INFO:teuthology.orchestra.run.smithi172.stdout: "avgcount": 0, 2024-09-12T02:49:33.842 INFO:teuthology.orchestra.run.smithi172.stdout: "sum": 0.000000000, 2024-09-12T02:49:33.842 INFO:teuthology.orchestra.run.smithi172.stdout: "avgtime": 0.000000000 2024-09-12T02:49:33.842 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-09-12T02:49:33.842 INFO:teuthology.orchestra.run.smithi172.stdout: "req_getfilelock_latency": { 2024-09-12T02:49:33.842 INFO:teuthology.orchestra.run.smithi172.stdout: "avgcount": 0, 2024-09-12T02:49:33.842 INFO:teuthology.orchestra.run.smithi172.stdout: "sum": 0.000000000, 2024-09-12T02:49:33.842 INFO:teuthology.orchestra.run.smithi172.stdout: "avgtime": 0.000000000 2024-09-12T02:49:33.842 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-09-12T02:49:33.842 INFO:teuthology.orchestra.run.smithi172.stdout: "req_link_latency": { 2024-09-12T02:49:33.843 INFO:teuthology.orchestra.run.smithi172.stdout: "avgcount": 0, 2024-09-12T02:49:33.843 INFO:teuthology.orchestra.run.smithi172.stdout: "sum": 0.000000000, 2024-09-12T02:49:33.843 INFO:teuthology.orchestra.run.smithi172.stdout: "avgtime": 0.000000000 2024-09-12T02:49:33.843 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-09-12T02:49:33.843 INFO:teuthology.orchestra.run.smithi172.stdout: "req_lookup_latency": { 2024-09-12T02:49:33.843 INFO:teuthology.orchestra.run.smithi172.stdout: "avgcount": 0, 2024-09-12T02:49:33.843 INFO:teuthology.orchestra.run.smithi172.stdout: "sum": 0.000000000, 2024-09-12T02:49:33.843 INFO:teuthology.orchestra.run.smithi172.stdout: "avgtime": 0.000000000 2024-09-12T02:49:33.843 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-09-12T02:49:33.843 INFO:teuthology.orchestra.run.smithi172.stdout: "req_lookuphash_latency": { 2024-09-12T02:49:33.843 INFO:teuthology.orchestra.run.smithi172.stdout: "avgcount": 0, 2024-09-12T02:49:33.843 INFO:teuthology.orchestra.run.smithi172.stdout: "sum": 0.000000000, 2024-09-12T02:49:33.843 INFO:teuthology.orchestra.run.smithi172.stdout: "avgtime": 0.000000000 2024-09-12T02:49:33.843 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-09-12T02:49:33.844 INFO:teuthology.orchestra.run.smithi172.stdout: "req_lookupino_latency": { 2024-09-12T02:49:33.844 INFO:teuthology.orchestra.run.smithi172.stdout: "avgcount": 1, 2024-09-12T02:49:33.844 INFO:teuthology.orchestra.run.smithi172.stdout: "sum": 0.000085219, 2024-09-12T02:49:33.844 INFO:teuthology.orchestra.run.smithi172.stdout: "avgtime": 0.000085219 2024-09-12T02:49:33.844 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-09-12T02:49:33.844 INFO:teuthology.orchestra.run.smithi172.stdout: "req_lookupname_latency": { 2024-09-12T02:49:33.844 INFO:teuthology.orchestra.run.smithi172.stdout: "avgcount": 0, 2024-09-12T02:49:33.844 INFO:teuthology.orchestra.run.smithi172.stdout: "sum": 0.000000000, 2024-09-12T02:49:33.844 INFO:teuthology.orchestra.run.smithi172.stdout: "avgtime": 0.000000000 2024-09-12T02:49:33.844 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-09-12T02:49:33.844 INFO:teuthology.orchestra.run.smithi172.stdout: "req_lookupparent_latency": { 2024-09-12T02:49:33.844 INFO:teuthology.orchestra.run.smithi172.stdout: "avgcount": 0, 2024-09-12T02:49:33.844 INFO:teuthology.orchestra.run.smithi172.stdout: "sum": 0.000000000, 2024-09-12T02:49:33.844 INFO:teuthology.orchestra.run.smithi172.stdout: "avgtime": 0.000000000 2024-09-12T02:49:33.845 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-09-12T02:49:33.845 INFO:teuthology.orchestra.run.smithi172.stdout: "req_lookupsnap_latency": { 2024-09-12T02:49:33.845 INFO:teuthology.orchestra.run.smithi172.stdout: "avgcount": 0, 2024-09-12T02:49:33.845 INFO:teuthology.orchestra.run.smithi172.stdout: "sum": 0.000000000, 2024-09-12T02:49:33.845 INFO:teuthology.orchestra.run.smithi172.stdout: "avgtime": 0.000000000 2024-09-12T02:49:33.845 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-09-12T02:49:33.845 INFO:teuthology.orchestra.run.smithi172.stdout: "req_lssnap_latency": { 2024-09-12T02:49:33.845 INFO:teuthology.orchestra.run.smithi172.stdout: "avgcount": 0, 2024-09-12T02:49:33.845 INFO:teuthology.orchestra.run.smithi172.stdout: "sum": 0.000000000, 2024-09-12T02:49:33.845 INFO:teuthology.orchestra.run.smithi172.stdout: "avgtime": 0.000000000 2024-09-12T02:49:33.845 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-09-12T02:49:33.845 INFO:teuthology.orchestra.run.smithi172.stdout: "req_mkdir_latency": { 2024-09-12T02:49:33.845 INFO:teuthology.orchestra.run.smithi172.stdout: "avgcount": 0, 2024-09-12T02:49:33.846 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 12 02:49:33 smithi172 ceph-mon[35609]: pgmap v363: 129 pgs: 129 active+clean; 24 MiB data, 494 MiB used, 1.0 TiB / 1.0 TiB avail; 10 KiB/s rd, 4.4 KiB/s wr, 13 op/s 2024-09-12T02:49:33.846 INFO:teuthology.orchestra.run.smithi172.stdout: "sum": 0.000000000, 2024-09-12T02:49:33.846 INFO:teuthology.orchestra.run.smithi172.stdout: "avgtime": 0.000000000 2024-09-12T02:49:33.846 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-09-12T02:49:33.846 INFO:teuthology.orchestra.run.smithi172.stdout: "req_mknod_latency": { 2024-09-12T02:49:33.847 INFO:teuthology.orchestra.run.smithi172.stdout: "avgcount": 0, 2024-09-12T02:49:33.847 INFO:teuthology.orchestra.run.smithi172.stdout: "sum": 0.000000000, 2024-09-12T02:49:33.847 INFO:teuthology.orchestra.run.smithi172.stdout: "avgtime": 0.000000000 2024-09-12T02:49:33.847 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-09-12T02:49:33.847 INFO:teuthology.orchestra.run.smithi172.stdout: "req_mksnap_latency": { 2024-09-12T02:49:33.847 INFO:teuthology.orchestra.run.smithi172.stdout: "avgcount": 0, 2024-09-12T02:49:33.847 INFO:teuthology.orchestra.run.smithi172.stdout: "sum": 0.000000000, 2024-09-12T02:49:33.847 INFO:teuthology.orchestra.run.smithi172.stdout: "avgtime": 0.000000000 2024-09-12T02:49:33.847 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-09-12T02:49:33.847 INFO:teuthology.orchestra.run.smithi172.stdout: "req_open_latency": { 2024-09-12T02:49:33.847 INFO:teuthology.orchestra.run.smithi172.stdout: "avgcount": 0, 2024-09-12T02:49:33.847 INFO:teuthology.orchestra.run.smithi172.stdout: "sum": 0.000000000, 2024-09-12T02:49:33.847 INFO:teuthology.orchestra.run.smithi172.stdout: "avgtime": 0.000000000 2024-09-12T02:49:33.847 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-09-12T02:49:33.848 INFO:teuthology.orchestra.run.smithi172.stdout: "req_readdir_latency": { 2024-09-12T02:49:33.848 INFO:teuthology.orchestra.run.smithi172.stdout: "avgcount": 0, 2024-09-12T02:49:33.848 INFO:teuthology.orchestra.run.smithi172.stdout: "sum": 0.000000000, 2024-09-12T02:49:33.848 INFO:teuthology.orchestra.run.smithi172.stdout: "avgtime": 0.000000000 2024-09-12T02:49:33.848 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-09-12T02:49:33.848 INFO:teuthology.orchestra.run.smithi172.stdout: "req_rename_latency": { 2024-09-12T02:49:33.848 INFO:teuthology.orchestra.run.smithi172.stdout: "avgcount": 0, 2024-09-12T02:49:33.848 INFO:teuthology.orchestra.run.smithi172.stdout: "sum": 0.000000000, 2024-09-12T02:49:33.848 INFO:teuthology.orchestra.run.smithi172.stdout: "avgtime": 0.000000000 2024-09-12T02:49:33.848 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-09-12T02:49:33.848 INFO:teuthology.orchestra.run.smithi172.stdout: "req_renamesnap_latency": { 2024-09-12T02:49:33.848 INFO:teuthology.orchestra.run.smithi172.stdout: "avgcount": 0, 2024-09-12T02:49:33.848 INFO:teuthology.orchestra.run.smithi172.stdout: "sum": 0.000000000, 2024-09-12T02:49:33.848 INFO:teuthology.orchestra.run.smithi172.stdout: "avgtime": 0.000000000 2024-09-12T02:49:33.849 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-09-12T02:49:33.849 INFO:teuthology.orchestra.run.smithi172.stdout: "req_snapdiff_latency": { 2024-09-12T02:49:33.849 INFO:teuthology.orchestra.run.smithi172.stdout: "avgcount": 0, 2024-09-12T02:49:33.849 INFO:teuthology.orchestra.run.smithi172.stdout: "sum": 0.000000000, 2024-09-12T02:49:33.849 INFO:teuthology.orchestra.run.smithi172.stdout: "avgtime": 0.000000000 2024-09-12T02:49:33.849 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-09-12T02:49:33.849 INFO:teuthology.orchestra.run.smithi172.stdout: "req_rmdir_latency": { 2024-09-12T02:49:33.849 INFO:teuthology.orchestra.run.smithi172.stdout: "avgcount": 0, 2024-09-12T02:49:33.849 INFO:teuthology.orchestra.run.smithi172.stdout: "sum": 0.000000000, 2024-09-12T02:49:33.849 INFO:teuthology.orchestra.run.smithi172.stdout: "avgtime": 0.000000000 2024-09-12T02:49:33.849 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-09-12T02:49:33.849 INFO:teuthology.orchestra.run.smithi172.stdout: "req_rmsnap_latency": { 2024-09-12T02:49:33.849 INFO:teuthology.orchestra.run.smithi172.stdout: "avgcount": 0, 2024-09-12T02:49:33.850 INFO:teuthology.orchestra.run.smithi172.stdout: "sum": 0.000000000, 2024-09-12T02:49:33.850 INFO:teuthology.orchestra.run.smithi172.stdout: "avgtime": 0.000000000 2024-09-12T02:49:33.850 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-09-12T02:49:33.850 INFO:teuthology.orchestra.run.smithi172.stdout: "req_rmxattr_latency": { 2024-09-12T02:49:33.850 INFO:teuthology.orchestra.run.smithi172.stdout: "avgcount": 0, 2024-09-12T02:49:33.850 INFO:teuthology.orchestra.run.smithi172.stdout: "sum": 0.000000000, 2024-09-12T02:49:33.850 INFO:teuthology.orchestra.run.smithi172.stdout: "avgtime": 0.000000000 2024-09-12T02:49:33.850 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-09-12T02:49:33.850 INFO:teuthology.orchestra.run.smithi172.stdout: "req_setattr_latency": { 2024-09-12T02:49:33.850 INFO:teuthology.orchestra.run.smithi172.stdout: "avgcount": 0, 2024-09-12T02:49:33.850 INFO:teuthology.orchestra.run.smithi172.stdout: "sum": 0.000000000, 2024-09-12T02:49:33.850 INFO:teuthology.orchestra.run.smithi172.stdout: "avgtime": 0.000000000 2024-09-12T02:49:33.850 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-09-12T02:49:33.850 INFO:teuthology.orchestra.run.smithi172.stdout: "req_setdirlayout_latency": { 2024-09-12T02:49:33.851 INFO:teuthology.orchestra.run.smithi172.stdout: "avgcount": 0, 2024-09-12T02:49:33.851 INFO:teuthology.orchestra.run.smithi172.stdout: "sum": 0.000000000, 2024-09-12T02:49:33.851 INFO:teuthology.orchestra.run.smithi172.stdout: "avgtime": 0.000000000 2024-09-12T02:49:33.851 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-09-12T02:49:33.851 INFO:teuthology.orchestra.run.smithi172.stdout: "req_setfilelock_latency": { 2024-09-12T02:49:33.851 INFO:teuthology.orchestra.run.smithi172.stdout: "avgcount": 0, 2024-09-12T02:49:33.851 INFO:teuthology.orchestra.run.smithi172.stdout: "sum": 0.000000000, 2024-09-12T02:49:33.851 INFO:teuthology.orchestra.run.smithi172.stdout: "avgtime": 0.000000000 2024-09-12T02:49:33.851 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-09-12T02:49:33.851 INFO:teuthology.orchestra.run.smithi172.stdout: "req_setlayout_latency": { 2024-09-12T02:49:33.851 INFO:teuthology.orchestra.run.smithi172.stdout: "avgcount": 0, 2024-09-12T02:49:33.851 INFO:teuthology.orchestra.run.smithi172.stdout: "sum": 0.000000000, 2024-09-12T02:49:33.851 INFO:teuthology.orchestra.run.smithi172.stdout: "avgtime": 0.000000000 2024-09-12T02:49:33.852 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-09-12T02:49:33.852 INFO:teuthology.orchestra.run.smithi172.stdout: "req_setxattr_latency": { 2024-09-12T02:49:33.852 INFO:teuthology.orchestra.run.smithi172.stdout: "avgcount": 0, 2024-09-12T02:49:33.852 INFO:teuthology.orchestra.run.smithi172.stdout: "sum": 0.000000000, 2024-09-12T02:49:33.852 INFO:teuthology.orchestra.run.smithi172.stdout: "avgtime": 0.000000000 2024-09-12T02:49:33.852 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-09-12T02:49:33.852 INFO:teuthology.orchestra.run.smithi172.stdout: "req_symlink_latency": { 2024-09-12T02:49:33.852 INFO:teuthology.orchestra.run.smithi172.stdout: "avgcount": 0, 2024-09-12T02:49:33.852 INFO:teuthology.orchestra.run.smithi172.stdout: "sum": 0.000000000, 2024-09-12T02:49:33.852 INFO:teuthology.orchestra.run.smithi172.stdout: "avgtime": 0.000000000 2024-09-12T02:49:33.852 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-09-12T02:49:33.852 INFO:teuthology.orchestra.run.smithi172.stdout: "req_unlink_latency": { 2024-09-12T02:49:33.852 INFO:teuthology.orchestra.run.smithi172.stdout: "avgcount": 0, 2024-09-12T02:49:33.853 INFO:teuthology.orchestra.run.smithi172.stdout: "sum": 0.000000000, 2024-09-12T02:49:33.853 INFO:teuthology.orchestra.run.smithi172.stdout: "avgtime": 0.000000000 2024-09-12T02:49:33.853 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-09-12T02:49:33.853 INFO:teuthology.orchestra.run.smithi172.stdout: "cap_revoke_eviction": 0, 2024-09-12T02:49:33.853 INFO:teuthology.orchestra.run.smithi172.stdout: "cap_acquisition_throttle": 0, 2024-09-12T02:49:33.853 INFO:teuthology.orchestra.run.smithi172.stdout: "req_getvxattr_latency": { 2024-09-12T02:49:33.853 INFO:teuthology.orchestra.run.smithi172.stdout: "avgcount": 0, 2024-09-12T02:49:33.853 INFO:teuthology.orchestra.run.smithi172.stdout: "sum": 0.000000000, 2024-09-12T02:49:33.853 INFO:teuthology.orchestra.run.smithi172.stdout: "avgtime": 0.000000000 2024-09-12T02:49:33.853 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-09-12T02:49:33.853 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-09-12T02:49:33.853 INFO:teuthology.orchestra.run.smithi172.stdout: "mds_sessions": { 2024-09-12T02:49:33.853 INFO:teuthology.orchestra.run.smithi172.stdout: "session_count": 2, 2024-09-12T02:49:33.854 INFO:teuthology.orchestra.run.smithi172.stdout: "session_add": 3, 2024-09-12T02:49:33.854 INFO:teuthology.orchestra.run.smithi172.stdout: "session_remove": 1, 2024-09-12T02:49:33.854 INFO:teuthology.orchestra.run.smithi172.stdout: "sessions_open": 2, 2024-09-12T02:49:33.854 INFO:teuthology.orchestra.run.smithi172.stdout: "sessions_stale": 0, 2024-09-12T02:49:33.854 INFO:teuthology.orchestra.run.smithi172.stdout: "total_load": 1, 2024-09-12T02:49:33.854 INFO:teuthology.orchestra.run.smithi172.stdout: "average_load": 0, 2024-09-12T02:49:33.854 INFO:teuthology.orchestra.run.smithi172.stdout: "avg_session_uptime": 691, 2024-09-12T02:49:33.854 INFO:teuthology.orchestra.run.smithi172.stdout: "mdthresh_evicted": 0 2024-09-12T02:49:33.854 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-09-12T02:49:33.854 INFO:teuthology.orchestra.run.smithi172.stdout: "mempool": { 2024-09-12T02:49:33.854 INFO:teuthology.orchestra.run.smithi172.stdout: "bloom_filter_bytes": 0, 2024-09-12T02:49:33.854 INFO:teuthology.orchestra.run.smithi172.stdout: "bloom_filter_items": 0, 2024-09-12T02:49:33.854 INFO:teuthology.orchestra.run.smithi172.stdout: "bluestore_alloc_bytes": 0, 2024-09-12T02:49:33.855 INFO:teuthology.orchestra.run.smithi172.stdout: "bluestore_alloc_items": 0, 2024-09-12T02:49:33.855 INFO:teuthology.orchestra.run.smithi172.stdout: "bluestore_cache_data_bytes": 0, 2024-09-12T02:49:33.855 INFO:teuthology.orchestra.run.smithi172.stdout: "bluestore_cache_data_items": 0, 2024-09-12T02:49:33.855 INFO:teuthology.orchestra.run.smithi172.stdout: "bluestore_cache_onode_bytes": 0, 2024-09-12T02:49:33.855 INFO:teuthology.orchestra.run.smithi172.stdout: "bluestore_cache_onode_items": 0, 2024-09-12T02:49:33.855 INFO:teuthology.orchestra.run.smithi172.stdout: "bluestore_cache_meta_bytes": 0, 2024-09-12T02:49:33.855 INFO:teuthology.orchestra.run.smithi172.stdout: "bluestore_cache_meta_items": 0, 2024-09-12T02:49:33.855 INFO:teuthology.orchestra.run.smithi172.stdout: "bluestore_cache_other_bytes": 0, 2024-09-12T02:49:33.855 INFO:teuthology.orchestra.run.smithi172.stdout: "bluestore_cache_other_items": 0, 2024-09-12T02:49:33.855 INFO:teuthology.orchestra.run.smithi172.stdout: "bluestore_cache_buffer_bytes": 0, 2024-09-12T02:49:33.855 INFO:teuthology.orchestra.run.smithi172.stdout: "bluestore_cache_buffer_items": 0, 2024-09-12T02:49:33.855 INFO:teuthology.orchestra.run.smithi172.stdout: "bluestore_extent_bytes": 0, 2024-09-12T02:49:33.855 INFO:teuthology.orchestra.run.smithi172.stdout: "bluestore_extent_items": 0, 2024-09-12T02:49:33.855 INFO:teuthology.orchestra.run.smithi172.stdout: "bluestore_blob_bytes": 0, 2024-09-12T02:49:33.855 INFO:teuthology.orchestra.run.smithi172.stdout: "bluestore_blob_items": 0, 2024-09-12T02:49:33.856 INFO:teuthology.orchestra.run.smithi172.stdout: "bluestore_shared_blob_bytes": 0, 2024-09-12T02:49:33.856 INFO:teuthology.orchestra.run.smithi172.stdout: "bluestore_shared_blob_items": 0, 2024-09-12T02:49:33.856 INFO:teuthology.orchestra.run.smithi172.stdout: "bluestore_inline_bl_bytes": 0, 2024-09-12T02:49:33.856 INFO:teuthology.orchestra.run.smithi172.stdout: "bluestore_inline_bl_items": 0, 2024-09-12T02:49:33.856 INFO:teuthology.orchestra.run.smithi172.stdout: "bluestore_fsck_bytes": 0, 2024-09-12T02:49:33.856 INFO:teuthology.orchestra.run.smithi172.stdout: "bluestore_fsck_items": 0, 2024-09-12T02:49:33.856 INFO:teuthology.orchestra.run.smithi172.stdout: "bluestore_txc_bytes": 0, 2024-09-12T02:49:33.856 INFO:teuthology.orchestra.run.smithi172.stdout: "bluestore_txc_items": 0, 2024-09-12T02:49:33.856 INFO:teuthology.orchestra.run.smithi172.stdout: "bluestore_writing_deferred_bytes": 0, 2024-09-12T02:49:33.856 INFO:teuthology.orchestra.run.smithi172.stdout: "bluestore_writing_deferred_items": 0, 2024-09-12T02:49:33.856 INFO:teuthology.orchestra.run.smithi172.stdout: "bluestore_writing_bytes": 0, 2024-09-12T02:49:33.856 INFO:teuthology.orchestra.run.smithi172.stdout: "bluestore_writing_items": 0, 2024-09-12T02:49:33.856 INFO:teuthology.orchestra.run.smithi172.stdout: "bluefs_bytes": 0, 2024-09-12T02:49:33.857 INFO:teuthology.orchestra.run.smithi172.stdout: "bluefs_items": 0, 2024-09-12T02:49:33.857 INFO:teuthology.orchestra.run.smithi172.stdout: "bluefs_file_reader_bytes": 0, 2024-09-12T02:49:33.857 INFO:teuthology.orchestra.run.smithi172.stdout: "bluefs_file_reader_items": 0, 2024-09-12T02:49:33.857 INFO:teuthology.orchestra.run.smithi172.stdout: "bluefs_file_writer_bytes": 0, 2024-09-12T02:49:33.857 INFO:teuthology.orchestra.run.smithi172.stdout: "bluefs_file_writer_items": 0, 2024-09-12T02:49:33.857 INFO:teuthology.orchestra.run.smithi172.stdout: "buffer_anon_bytes": 263839, 2024-09-12T02:49:33.857 INFO:teuthology.orchestra.run.smithi172.stdout: "buffer_anon_items": 94, 2024-09-12T02:49:33.857 INFO:teuthology.orchestra.run.smithi172.stdout: "buffer_meta_bytes": 0, 2024-09-12T02:49:33.857 INFO:teuthology.orchestra.run.smithi172.stdout: "buffer_meta_items": 0, 2024-09-12T02:49:33.857 INFO:teuthology.orchestra.run.smithi172.stdout: "osd_bytes": 0, 2024-09-12T02:49:33.857 INFO:teuthology.orchestra.run.smithi172.stdout: "osd_items": 0, 2024-09-12T02:49:33.857 INFO:teuthology.orchestra.run.smithi172.stdout: "osd_mapbl_bytes": 0, 2024-09-12T02:49:33.857 INFO:teuthology.orchestra.run.smithi172.stdout: "osd_mapbl_items": 0, 2024-09-12T02:49:33.857 INFO:teuthology.orchestra.run.smithi172.stdout: "osd_pglog_bytes": 0, 2024-09-12T02:49:33.858 INFO:teuthology.orchestra.run.smithi172.stdout: "osd_pglog_items": 0, 2024-09-12T02:49:33.858 INFO:teuthology.orchestra.run.smithi172.stdout: "osdmap_bytes": 9520, 2024-09-12T02:49:33.858 INFO:teuthology.orchestra.run.smithi172.stdout: "osdmap_items": 193, 2024-09-12T02:49:33.858 INFO:teuthology.orchestra.run.smithi172.stdout: "osdmap_mapping_bytes": 0, 2024-09-12T02:49:33.858 INFO:teuthology.orchestra.run.smithi172.stdout: "osdmap_mapping_items": 0, 2024-09-12T02:49:33.858 INFO:teuthology.orchestra.run.smithi172.stdout: "pgmap_bytes": 0, 2024-09-12T02:49:33.858 INFO:teuthology.orchestra.run.smithi172.stdout: "pgmap_items": 0, 2024-09-12T02:49:33.858 INFO:teuthology.orchestra.run.smithi172.stdout: "mds_co_bytes": 91149, 2024-09-12T02:49:33.858 INFO:teuthology.orchestra.run.smithi172.stdout: "mds_co_items": 338, 2024-09-12T02:49:33.858 INFO:teuthology.orchestra.run.smithi172.stdout: "unittest_1_bytes": 0, 2024-09-12T02:49:33.858 INFO:teuthology.orchestra.run.smithi172.stdout: "unittest_1_items": 0, 2024-09-12T02:49:33.858 INFO:teuthology.orchestra.run.smithi172.stdout: "unittest_2_bytes": 0, 2024-09-12T02:49:33.858 INFO:teuthology.orchestra.run.smithi172.stdout: "unittest_2_items": 0 2024-09-12T02:49:33.858 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-09-12T02:49:33.859 INFO:teuthology.orchestra.run.smithi172.stdout: "objecter": { 2024-09-12T02:49:33.859 INFO:teuthology.orchestra.run.smithi172.stdout: "op_active": 0, 2024-09-12T02:49:33.859 INFO:teuthology.orchestra.run.smithi172.stdout: "op_laggy": 0, 2024-09-12T02:49:33.859 INFO:teuthology.orchestra.run.smithi172.stdout: "op_send": 41, 2024-09-12T02:49:33.859 INFO:teuthology.orchestra.run.smithi172.stdout: "op_send_bytes": 12128, 2024-09-12T02:49:33.859 INFO:teuthology.orchestra.run.smithi172.stdout: "op_resend": 33, 2024-09-12T02:49:33.859 INFO:teuthology.orchestra.run.smithi172.stdout: "op_reply": 41, 2024-09-12T02:49:33.859 INFO:teuthology.orchestra.run.smithi172.stdout: "op_latency": { 2024-09-12T02:49:33.859 INFO:teuthology.orchestra.run.smithi172.stdout: "avgcount": 41, 2024-09-12T02:49:33.859 INFO:teuthology.orchestra.run.smithi172.stdout: "sum": 0.237994107, 2024-09-12T02:49:33.859 INFO:teuthology.orchestra.run.smithi172.stdout: "avgtime": 0.005804734 2024-09-12T02:49:33.859 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-09-12T02:49:33.859 INFO:teuthology.orchestra.run.smithi172.stdout: "op_inflight": 0, 2024-09-12T02:49:33.860 INFO:teuthology.orchestra.run.smithi172.stdout: "oplen_avg": { 2024-09-12T02:49:33.860 INFO:teuthology.orchestra.run.smithi172.stdout: "avgcount": 41, 2024-09-12T02:49:33.860 INFO:teuthology.orchestra.run.smithi172.stdout: "sum": 63 2024-09-12T02:49:33.860 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-09-12T02:49:33.860 INFO:teuthology.orchestra.run.smithi172.stdout: "op": 41, 2024-09-12T02:49:33.860 INFO:teuthology.orchestra.run.smithi172.stdout: "op_r": 0, 2024-09-12T02:49:33.860 INFO:teuthology.orchestra.run.smithi172.stdout: "op_w": 41, 2024-09-12T02:49:33.860 INFO:teuthology.orchestra.run.smithi172.stdout: "op_rmw": 0, 2024-09-12T02:49:33.860 INFO:teuthology.orchestra.run.smithi172.stdout: "op_pg": 0, 2024-09-12T02:49:33.860 INFO:teuthology.orchestra.run.smithi172.stdout: "osdop_stat": 0, 2024-09-12T02:49:33.860 INFO:teuthology.orchestra.run.smithi172.stdout: "osdop_create": 10, 2024-09-12T02:49:33.860 INFO:teuthology.orchestra.run.smithi172.stdout: "osdop_read": 0, 2024-09-12T02:49:33.860 INFO:teuthology.orchestra.run.smithi172.stdout: "osdop_write": 5, 2024-09-12T02:49:33.861 INFO:teuthology.orchestra.run.smithi172.stdout: "osdop_writefull": 7, 2024-09-12T02:49:33.861 INFO:teuthology.orchestra.run.smithi172.stdout: "osdop_writesame": 0, 2024-09-12T02:49:33.861 INFO:teuthology.orchestra.run.smithi172.stdout: "osdop_append": 0, 2024-09-12T02:49:33.861 INFO:teuthology.orchestra.run.smithi172.stdout: "osdop_zero": 0, 2024-09-12T02:49:33.861 INFO:teuthology.orchestra.run.smithi172.stdout: "osdop_truncate": 0, 2024-09-12T02:49:33.861 INFO:teuthology.orchestra.run.smithi172.stdout: "osdop_delete": 6, 2024-09-12T02:49:33.861 INFO:teuthology.orchestra.run.smithi172.stdout: "osdop_mapext": 0, 2024-09-12T02:49:33.861 INFO:teuthology.orchestra.run.smithi172.stdout: "osdop_sparse_read": 0, 2024-09-12T02:49:33.861 INFO:teuthology.orchestra.run.smithi172.stdout: "osdop_clonerange": 0, 2024-09-12T02:49:33.861 INFO:teuthology.orchestra.run.smithi172.stdout: "osdop_getxattr": 0, 2024-09-12T02:49:33.861 INFO:teuthology.orchestra.run.smithi172.stdout: "osdop_setxattr": 20, 2024-09-12T02:49:33.861 INFO:teuthology.orchestra.run.smithi172.stdout: "osdop_cmpxattr": 0, 2024-09-12T02:49:33.861 INFO:teuthology.orchestra.run.smithi172.stdout: "osdop_rmxattr": 0, 2024-09-12T02:49:33.861 INFO:teuthology.orchestra.run.smithi172.stdout: "osdop_resetxattrs": 0, 2024-09-12T02:49:33.862 INFO:teuthology.orchestra.run.smithi172.stdout: "osdop_call": 0, 2024-09-12T02:49:33.862 INFO:teuthology.orchestra.run.smithi172.stdout: "osdop_watch": 0, 2024-09-12T02:49:33.862 INFO:teuthology.orchestra.run.smithi172.stdout: "osdop_notify": 0, 2024-09-12T02:49:33.862 INFO:teuthology.orchestra.run.smithi172.stdout: "osdop_src_cmpxattr": 0, 2024-09-12T02:49:33.862 INFO:teuthology.orchestra.run.smithi172.stdout: "osdop_pgls": 0, 2024-09-12T02:49:33.862 INFO:teuthology.orchestra.run.smithi172.stdout: "osdop_pgls_filter": 0, 2024-09-12T02:49:33.862 INFO:teuthology.orchestra.run.smithi172.stdout: "osdop_other": 0, 2024-09-12T02:49:33.862 INFO:teuthology.orchestra.run.smithi172.stdout: "linger_active": 0, 2024-09-12T02:49:33.862 INFO:teuthology.orchestra.run.smithi172.stdout: "linger_send": 0, 2024-09-12T02:49:33.862 INFO:teuthology.orchestra.run.smithi172.stdout: "linger_resend": 0, 2024-09-12T02:49:33.862 INFO:teuthology.orchestra.run.smithi172.stdout: "linger_ping": 0, 2024-09-12T02:49:33.862 INFO:teuthology.orchestra.run.smithi172.stdout: "poolop_active": 0, 2024-09-12T02:49:33.862 INFO:teuthology.orchestra.run.smithi172.stdout: "poolop_send": 0, 2024-09-12T02:49:33.862 INFO:teuthology.orchestra.run.smithi172.stdout: "poolop_resend": 0, 2024-09-12T02:49:33.862 INFO:teuthology.orchestra.run.smithi172.stdout: "poolstat_active": 0, 2024-09-12T02:49:33.863 INFO:teuthology.orchestra.run.smithi172.stdout: "poolstat_send": 0, 2024-09-12T02:49:33.863 INFO:teuthology.orchestra.run.smithi172.stdout: "poolstat_resend": 0, 2024-09-12T02:49:33.863 INFO:teuthology.orchestra.run.smithi172.stdout: "statfs_active": 0, 2024-09-12T02:49:33.863 INFO:teuthology.orchestra.run.smithi172.stdout: "statfs_send": 0, 2024-09-12T02:49:33.863 INFO:teuthology.orchestra.run.smithi172.stdout: "statfs_resend": 0, 2024-09-12T02:49:33.863 INFO:teuthology.orchestra.run.smithi172.stdout: "command_active": 0, 2024-09-12T02:49:33.863 INFO:teuthology.orchestra.run.smithi172.stdout: "command_send": 0, 2024-09-12T02:49:33.863 INFO:teuthology.orchestra.run.smithi172.stdout: "command_resend": 0, 2024-09-12T02:49:33.863 INFO:teuthology.orchestra.run.smithi172.stdout: "map_epoch": 108, 2024-09-12T02:49:33.863 INFO:teuthology.orchestra.run.smithi172.stdout: "map_full": 0, 2024-09-12T02:49:33.863 INFO:teuthology.orchestra.run.smithi172.stdout: "map_inc": 15, 2024-09-12T02:49:33.863 INFO:teuthology.orchestra.run.smithi172.stdout: "osd_sessions": 10, 2024-09-12T02:49:33.863 INFO:teuthology.orchestra.run.smithi172.stdout: "osd_session_open": 10, 2024-09-12T02:49:33.863 INFO:teuthology.orchestra.run.smithi172.stdout: "osd_session_close": 0, 2024-09-12T02:49:33.864 INFO:teuthology.orchestra.run.smithi172.stdout: "osd_laggy": 0, 2024-09-12T02:49:33.864 INFO:teuthology.orchestra.run.smithi172.stdout: "omap_wr": 14, 2024-09-12T02:49:33.864 INFO:teuthology.orchestra.run.smithi172.stdout: "omap_rd": 0, 2024-09-12T02:49:33.864 INFO:teuthology.orchestra.run.smithi172.stdout: "omap_del": 1 2024-09-12T02:49:33.864 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-09-12T02:49:33.864 INFO:teuthology.orchestra.run.smithi172.stdout: "oft": { 2024-09-12T02:49:33.864 INFO:teuthology.orchestra.run.smithi172.stdout: "omap_total_objs": 1, 2024-09-12T02:49:33.864 INFO:teuthology.orchestra.run.smithi172.stdout: "omap_total_kv_pairs": 0, 2024-09-12T02:49:33.864 INFO:teuthology.orchestra.run.smithi172.stdout: "omap_total_updates": 0, 2024-09-12T02:49:33.864 INFO:teuthology.orchestra.run.smithi172.stdout: "omap_total_removes": 0 2024-09-12T02:49:33.864 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-09-12T02:49:33.864 INFO:teuthology.orchestra.run.smithi172.stdout: "osd-slow-ops": { 2024-09-12T02:49:33.864 INFO:teuthology.orchestra.run.smithi172.stdout: "slow_ops_count": 0 2024-09-12T02:49:33.864 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-09-12T02:49:33.864 INFO:teuthology.orchestra.run.smithi172.stdout: "purge_queue": { 2024-09-12T02:49:33.865 INFO:teuthology.orchestra.run.smithi172.stdout: "pq_executing_ops": 0, 2024-09-12T02:49:33.865 INFO:teuthology.orchestra.run.smithi172.stdout: "pq_executing_ops_high_water": 0, 2024-09-12T02:49:33.865 INFO:teuthology.orchestra.run.smithi172.stdout: "pq_executing": 0, 2024-09-12T02:49:33.865 INFO:teuthology.orchestra.run.smithi172.stdout: "pq_executing_high_water": 0, 2024-09-12T02:49:33.865 INFO:teuthology.orchestra.run.smithi172.stdout: "pq_executed_ops": 0, 2024-09-12T02:49:33.865 INFO:teuthology.orchestra.run.smithi172.stdout: "pq_executed": 0, 2024-09-12T02:49:33.865 INFO:teuthology.orchestra.run.smithi172.stdout: "pq_item_in_journal": 0 2024-09-12T02:49:33.865 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-09-12T02:49:33.865 INFO:teuthology.orchestra.run.smithi172.stdout: "throttle-msgr_dispatch_throttler-mds": { 2024-09-12T02:49:33.865 INFO:teuthology.orchestra.run.smithi172.stdout: "val": 0, 2024-09-12T02:49:33.865 INFO:teuthology.orchestra.run.smithi172.stdout: "max": 104857600, 2024-09-12T02:49:33.865 INFO:teuthology.orchestra.run.smithi172.stdout: "get_started": 0, 2024-09-12T02:49:33.865 INFO:teuthology.orchestra.run.smithi172.stdout: "get": 1160, 2024-09-12T02:49:33.866 INFO:teuthology.orchestra.run.smithi172.stdout: "get_sum": 1932486, 2024-09-12T02:49:33.866 INFO:teuthology.orchestra.run.smithi172.stdout: "get_or_fail_fail": 0, 2024-09-12T02:49:33.866 INFO:teuthology.orchestra.run.smithi172.stdout: "get_or_fail_success": 1160, 2024-09-12T02:49:33.866 INFO:teuthology.orchestra.run.smithi172.stdout: "take": 0, 2024-09-12T02:49:33.866 INFO:teuthology.orchestra.run.smithi172.stdout: "take_sum": 0, 2024-09-12T02:49:33.866 INFO:teuthology.orchestra.run.smithi172.stdout: "put": 1160, 2024-09-12T02:49:33.866 INFO:teuthology.orchestra.run.smithi172.stdout: "put_sum": 1932486, 2024-09-12T02:49:33.866 INFO:teuthology.orchestra.run.smithi172.stdout: "wait": { 2024-09-12T02:49:33.866 INFO:teuthology.orchestra.run.smithi172.stdout: "avgcount": 0, 2024-09-12T02:49:33.866 INFO:teuthology.orchestra.run.smithi172.stdout: "sum": 0.000000000, 2024-09-12T02:49:33.866 INFO:teuthology.orchestra.run.smithi172.stdout: "avgtime": 0.000000000 2024-09-12T02:49:33.866 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-09-12T02:49:33.866 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-09-12T02:49:33.866 INFO:teuthology.orchestra.run.smithi172.stdout: "throttle-objecter_bytes": { 2024-09-12T02:49:33.866 INFO:teuthology.orchestra.run.smithi172.stdout: "val": 0, 2024-09-12T02:49:33.866 INFO:teuthology.orchestra.run.smithi172.stdout: "max": 104857600, 2024-09-12T02:49:33.867 INFO:teuthology.orchestra.run.smithi172.stdout: "get_started": 0, 2024-09-12T02:49:33.867 INFO:teuthology.orchestra.run.smithi172.stdout: "get": 0, 2024-09-12T02:49:33.867 INFO:teuthology.orchestra.run.smithi172.stdout: "get_sum": 0, 2024-09-12T02:49:33.867 INFO:teuthology.orchestra.run.smithi172.stdout: "get_or_fail_fail": 0, 2024-09-12T02:49:33.867 INFO:teuthology.orchestra.run.smithi172.stdout: "get_or_fail_success": 0, 2024-09-12T02:49:33.867 INFO:teuthology.orchestra.run.smithi172.stdout: "take": 41, 2024-09-12T02:49:33.867 INFO:teuthology.orchestra.run.smithi172.stdout: "take_sum": 12128, 2024-09-12T02:49:33.867 INFO:teuthology.orchestra.run.smithi172.stdout: "put": 41, 2024-09-12T02:49:33.867 INFO:teuthology.orchestra.run.smithi172.stdout: "put_sum": 12128, 2024-09-12T02:49:33.867 INFO:teuthology.orchestra.run.smithi172.stdout: "wait": { 2024-09-12T02:49:33.867 INFO:teuthology.orchestra.run.smithi172.stdout: "avgcount": 0, 2024-09-12T02:49:33.867 INFO:teuthology.orchestra.run.smithi172.stdout: "sum": 0.000000000, 2024-09-12T02:49:33.867 INFO:teuthology.orchestra.run.smithi172.stdout: "avgtime": 0.000000000 2024-09-12T02:49:33.867 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-09-12T02:49:33.868 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-09-12T02:49:33.868 INFO:teuthology.orchestra.run.smithi172.stdout: "throttle-objecter_ops": { 2024-09-12T02:49:33.868 INFO:teuthology.orchestra.run.smithi172.stdout: "val": 0, 2024-09-12T02:49:33.868 INFO:teuthology.orchestra.run.smithi172.stdout: "max": 1024, 2024-09-12T02:49:33.868 INFO:teuthology.orchestra.run.smithi172.stdout: "get_started": 0, 2024-09-12T02:49:33.868 INFO:teuthology.orchestra.run.smithi172.stdout: "get": 0, 2024-09-12T02:49:33.868 INFO:teuthology.orchestra.run.smithi172.stdout: "get_sum": 0, 2024-09-12T02:49:33.868 INFO:teuthology.orchestra.run.smithi172.stdout: "get_or_fail_fail": 0, 2024-09-12T02:49:33.868 INFO:teuthology.orchestra.run.smithi172.stdout: "get_or_fail_success": 0, 2024-09-12T02:49:33.868 INFO:teuthology.orchestra.run.smithi172.stdout: "take": 41, 2024-09-12T02:49:33.868 INFO:teuthology.orchestra.run.smithi172.stdout: "take_sum": 41, 2024-09-12T02:49:33.868 INFO:teuthology.orchestra.run.smithi172.stdout: "put": 41, 2024-09-12T02:49:33.868 INFO:teuthology.orchestra.run.smithi172.stdout: "put_sum": 41, 2024-09-12T02:49:33.868 INFO:teuthology.orchestra.run.smithi172.stdout: "wait": { 2024-09-12T02:49:33.869 INFO:teuthology.orchestra.run.smithi172.stdout: "avgcount": 0, 2024-09-12T02:49:33.869 INFO:teuthology.orchestra.run.smithi172.stdout: "sum": 0.000000000, 2024-09-12T02:49:33.869 INFO:teuthology.orchestra.run.smithi172.stdout: "avgtime": 0.000000000 2024-09-12T02:49:33.869 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-09-12T02:49:33.869 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-09-12T02:49:33.869 INFO:teuthology.orchestra.run.smithi172.stdout: "throttle-write_buf_throttle": { 2024-09-12T02:49:33.869 INFO:teuthology.orchestra.run.smithi172.stdout: "val": 0, 2024-09-12T02:49:33.869 INFO:teuthology.orchestra.run.smithi172.stdout: "max": 3758096384, 2024-09-12T02:49:33.869 INFO:teuthology.orchestra.run.smithi172.stdout: "get_started": 0, 2024-09-12T02:49:33.869 INFO:teuthology.orchestra.run.smithi172.stdout: "get": 0, 2024-09-12T02:49:33.869 INFO:teuthology.orchestra.run.smithi172.stdout: "get_sum": 0, 2024-09-12T02:49:33.869 INFO:teuthology.orchestra.run.smithi172.stdout: "get_or_fail_fail": 0, 2024-09-12T02:49:33.869 INFO:teuthology.orchestra.run.smithi172.stdout: "get_or_fail_success": 0, 2024-09-12T02:49:33.869 INFO:teuthology.orchestra.run.smithi172.stdout: "take": 0, 2024-09-12T02:49:33.870 INFO:teuthology.orchestra.run.smithi172.stdout: "take_sum": 0, 2024-09-12T02:49:33.870 INFO:teuthology.orchestra.run.smithi172.stdout: "put": 0, 2024-09-12T02:49:33.870 INFO:teuthology.orchestra.run.smithi172.stdout: "put_sum": 0, 2024-09-12T02:49:33.870 INFO:teuthology.orchestra.run.smithi172.stdout: "wait": { 2024-09-12T02:49:33.870 INFO:teuthology.orchestra.run.smithi172.stdout: "avgcount": 0, 2024-09-12T02:49:33.870 INFO:teuthology.orchestra.run.smithi172.stdout: "sum": 0.000000000, 2024-09-12T02:49:33.870 INFO:teuthology.orchestra.run.smithi172.stdout: "avgtime": 0.000000000 2024-09-12T02:49:33.870 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-09-12T02:49:33.870 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-09-12T02:49:33.870 INFO:teuthology.orchestra.run.smithi172.stdout: "throttle-write_buf_throttle-0x55dc29c98960": { 2024-09-12T02:49:33.870 INFO:teuthology.orchestra.run.smithi172.stdout: "val": 0, 2024-09-12T02:49:33.870 INFO:teuthology.orchestra.run.smithi172.stdout: "max": 3758096384, 2024-09-12T02:49:33.870 INFO:teuthology.orchestra.run.smithi172.stdout: "get_started": 0, 2024-09-12T02:49:33.870 INFO:teuthology.orchestra.run.smithi172.stdout: "get": 6, 2024-09-12T02:49:33.871 INFO:teuthology.orchestra.run.smithi172.stdout: "get_sum": 1826, 2024-09-12T02:49:33.871 INFO:teuthology.orchestra.run.smithi172.stdout: "get_or_fail_fail": 0, 2024-09-12T02:49:33.871 INFO:teuthology.orchestra.run.smithi172.stdout: "get_or_fail_success": 6, 2024-09-12T02:49:33.871 INFO:teuthology.orchestra.run.smithi172.stdout: "take": 0, 2024-09-12T02:49:33.871 INFO:teuthology.orchestra.run.smithi172.stdout: "take_sum": 0, 2024-09-12T02:49:33.871 INFO:teuthology.orchestra.run.smithi172.stdout: "put": 5, 2024-09-12T02:49:33.871 INFO:teuthology.orchestra.run.smithi172.stdout: "put_sum": 1826, 2024-09-12T02:49:33.871 INFO:teuthology.orchestra.run.smithi172.stdout: "wait": { 2024-09-12T02:49:33.871 INFO:teuthology.orchestra.run.smithi172.stdout: "avgcount": 0, 2024-09-12T02:49:33.871 INFO:teuthology.orchestra.run.smithi172.stdout: "sum": 0.000000000, 2024-09-12T02:49:33.871 INFO:teuthology.orchestra.run.smithi172.stdout: "avgtime": 0.000000000 2024-09-12T02:49:33.871 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-09-12T02:49:33.871 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-09-12T02:49:33.871 INFO:teuthology.orchestra.run.smithi172.stdout:} 2024-09-12T02:49:34.001 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 12 02:49:33 smithi044 ceph-mon[35411]: pgmap v363: 129 pgs: 129 active+clean; 24 MiB data, 494 MiB used, 1.0 TiB / 1.0 TiB avail; 10 KiB/s rd, 4.4 KiB/s wr, 13 op/s 2024-09-12T02:49:34.099 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 02:49:33 smithi039 ceph-mon[30515]: pgmap v363: 129 pgs: 129 active+clean; 24 MiB data, 494 MiB used, 1.0 TiB / 1.0 TiB avail; 10 KiB/s rd, 4.4 KiB/s wr, 13 op/s 2024-09-12T02:49:34.612 INFO:tasks.check_counter:Daemon mds.i mds.exported=0 2024-09-12T02:49:34.612 INFO:tasks.check_counter:Daemon mds.i mds.imported=0 2024-09-12T02:49:34.612 INFO:tasks.check_counter:Daemon mds.i mds_cache.dir_update=0 2024-09-12T02:49:34.612 INFO:tasks.check_counter:Daemon mds.i mds_cache.dir_update_receipt=11 2024-09-12T02:49:34.613 INFO:tasks.check_counter:Daemon mds.i mds.root_rsnaps=6 2024-09-12T02:49:34.613 INFO:tasks.check_counter:Daemon mds.i mds_server.req_mksnap_latency.avgcount=0 2024-09-12T02:49:34.613 INFO:tasks.check_counter:Daemon mds.i mds_server.req_rmsnap_latency.avgcount=0 2024-09-12T02:49:34.613 DEBUG:tasks.check_counter:Getting stats from l 2024-09-12T02:49:34.613 DEBUG:teuthology.orchestra.run.smithi172:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc shell --fsid 4954ed46-70ae-11ef-bcea-c7b262605968 -- ceph daemon mds.l perf dump 2024-09-12T02:49:34.859 INFO:teuthology.orchestra.run.smithi172.stderr:Inferring config /var/lib/ceph/4954ed46-70ae-11ef-bcea-c7b262605968/mon.c/config 2024-09-12T02:49:35.391 INFO:teuthology.orchestra.run.smithi172.stdout:{ 2024-09-12T02:49:35.391 INFO:teuthology.orchestra.run.smithi172.stdout: "AsyncMessenger::Worker-0": { 2024-09-12T02:49:35.392 INFO:teuthology.orchestra.run.smithi172.stdout: "msgr_recv_messages": 835, 2024-09-12T02:49:35.392 INFO:teuthology.orchestra.run.smithi172.stdout: "msgr_send_messages": 835, 2024-09-12T02:49:35.392 INFO:teuthology.orchestra.run.smithi172.stdout: "msgr_recv_bytes": 222591, 2024-09-12T02:49:35.392 INFO:teuthology.orchestra.run.smithi172.stdout: "msgr_send_bytes": 264769, 2024-09-12T02:49:35.392 INFO:teuthology.orchestra.run.smithi172.stdout: "msgr_created_connections": 6, 2024-09-12T02:49:35.392 INFO:teuthology.orchestra.run.smithi172.stdout: "msgr_active_connections": 2, 2024-09-12T02:49:35.392 INFO:teuthology.orchestra.run.smithi172.stdout: "msgr_running_total_time": 0.079750494, 2024-09-12T02:49:35.392 INFO:teuthology.orchestra.run.smithi172.stdout: "msgr_running_send_time": 0.026215400, 2024-09-12T02:49:35.392 INFO:teuthology.orchestra.run.smithi172.stdout: "msgr_running_recv_time": 0.022360779, 2024-09-12T02:49:35.392 INFO:teuthology.orchestra.run.smithi172.stdout: "msgr_running_fast_dispatch_time": 0.022414679, 2024-09-12T02:49:35.392 INFO:teuthology.orchestra.run.smithi172.stdout: "msgr_send_messages_queue_lat": { 2024-09-12T02:49:35.393 INFO:teuthology.orchestra.run.smithi172.stdout: "avgcount": 834, 2024-09-12T02:49:35.393 INFO:teuthology.orchestra.run.smithi172.stdout: "sum": 0.039557247, 2024-09-12T02:49:35.393 INFO:teuthology.orchestra.run.smithi172.stdout: "avgtime": 0.000047430 2024-09-12T02:49:35.393 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-09-12T02:49:35.393 INFO:teuthology.orchestra.run.smithi172.stdout: "msgr_handle_ack_lat": { 2024-09-12T02:49:35.393 INFO:teuthology.orchestra.run.smithi172.stdout: "avgcount": 0, 2024-09-12T02:49:35.393 INFO:teuthology.orchestra.run.smithi172.stdout: "sum": 0.000000000, 2024-09-12T02:49:35.393 INFO:teuthology.orchestra.run.smithi172.stdout: "avgtime": 0.000000000 2024-09-12T02:49:35.393 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-09-12T02:49:35.393 INFO:teuthology.orchestra.run.smithi172.stdout: "msgr_recv_encrypted_bytes": 3072, 2024-09-12T02:49:35.393 INFO:teuthology.orchestra.run.smithi172.stdout: "msgr_send_encrypted_bytes": 448 2024-09-12T02:49:35.393 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-09-12T02:49:35.393 INFO:teuthology.orchestra.run.smithi172.stdout: "AsyncMessenger::Worker-1": { 2024-09-12T02:49:35.394 INFO:teuthology.orchestra.run.smithi172.stdout: "msgr_recv_messages": 282, 2024-09-12T02:49:35.394 INFO:teuthology.orchestra.run.smithi172.stdout: "msgr_send_messages": 268, 2024-09-12T02:49:35.394 INFO:teuthology.orchestra.run.smithi172.stdout: "msgr_recv_bytes": 1772750, 2024-09-12T02:49:35.394 INFO:teuthology.orchestra.run.smithi172.stdout: "msgr_send_bytes": 155554, 2024-09-12T02:49:35.394 INFO:teuthology.orchestra.run.smithi172.stdout: "msgr_created_connections": 4, 2024-09-12T02:49:35.394 INFO:teuthology.orchestra.run.smithi172.stdout: "msgr_active_connections": 3, 2024-09-12T02:49:35.394 INFO:teuthology.orchestra.run.smithi172.stdout: "msgr_running_total_time": 0.050581217, 2024-09-12T02:49:35.394 INFO:teuthology.orchestra.run.smithi172.stdout: "msgr_running_send_time": 0.017301275, 2024-09-12T02:49:35.394 INFO:teuthology.orchestra.run.smithi172.stdout: "msgr_running_recv_time": 0.050243889, 2024-09-12T02:49:35.394 INFO:teuthology.orchestra.run.smithi172.stdout: "msgr_running_fast_dispatch_time": 0.000055737, 2024-09-12T02:49:35.394 INFO:teuthology.orchestra.run.smithi172.stdout: "msgr_send_messages_queue_lat": { 2024-09-12T02:49:35.394 INFO:teuthology.orchestra.run.smithi172.stdout: "avgcount": 267, 2024-09-12T02:49:35.394 INFO:teuthology.orchestra.run.smithi172.stdout: "sum": 0.016216101, 2024-09-12T02:49:35.395 INFO:teuthology.orchestra.run.smithi172.stdout: "avgtime": 0.000060734 2024-09-12T02:49:35.395 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-09-12T02:49:35.395 INFO:teuthology.orchestra.run.smithi172.stdout: "msgr_handle_ack_lat": { 2024-09-12T02:49:35.395 INFO:teuthology.orchestra.run.smithi172.stdout: "avgcount": 0, 2024-09-12T02:49:35.395 INFO:teuthology.orchestra.run.smithi172.stdout: "sum": 0.000000000, 2024-09-12T02:49:35.395 INFO:teuthology.orchestra.run.smithi172.stdout: "avgtime": 0.000000000 2024-09-12T02:49:35.395 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-09-12T02:49:35.395 INFO:teuthology.orchestra.run.smithi172.stdout: "msgr_recv_encrypted_bytes": 1771648, 2024-09-12T02:49:35.395 INFO:teuthology.orchestra.run.smithi172.stdout: "msgr_send_encrypted_bytes": 154912 2024-09-12T02:49:35.395 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-09-12T02:49:35.395 INFO:teuthology.orchestra.run.smithi172.stdout: "AsyncMessenger::Worker-2": { 2024-09-12T02:49:35.395 INFO:teuthology.orchestra.run.smithi172.stdout: "msgr_recv_messages": 1565, 2024-09-12T02:49:35.395 INFO:teuthology.orchestra.run.smithi172.stdout: "msgr_send_messages": 1751, 2024-09-12T02:49:35.395 INFO:teuthology.orchestra.run.smithi172.stdout: "msgr_recv_bytes": 458888, 2024-09-12T02:49:35.396 INFO:teuthology.orchestra.run.smithi172.stdout: "msgr_send_bytes": 971066, 2024-09-12T02:49:35.396 INFO:teuthology.orchestra.run.smithi172.stdout: "msgr_created_connections": 7, 2024-09-12T02:49:35.396 INFO:teuthology.orchestra.run.smithi172.stdout: "msgr_active_connections": 5, 2024-09-12T02:49:35.396 INFO:teuthology.orchestra.run.smithi172.stdout: "msgr_running_total_time": 0.182008556, 2024-09-12T02:49:35.396 INFO:teuthology.orchestra.run.smithi172.stdout: "msgr_running_send_time": 0.058325984, 2024-09-12T02:49:35.396 INFO:teuthology.orchestra.run.smithi172.stdout: "msgr_running_recv_time": 0.045309027, 2024-09-12T02:49:35.396 INFO:teuthology.orchestra.run.smithi172.stdout: "msgr_running_fast_dispatch_time": 0.061374034, 2024-09-12T02:49:35.396 INFO:teuthology.orchestra.run.smithi172.stdout: "msgr_send_messages_queue_lat": { 2024-09-12T02:49:35.396 INFO:teuthology.orchestra.run.smithi172.stdout: "avgcount": 1748, 2024-09-12T02:49:35.396 INFO:teuthology.orchestra.run.smithi172.stdout: "sum": 0.083934282, 2024-09-12T02:49:35.396 INFO:teuthology.orchestra.run.smithi172.stdout: "avgtime": 0.000048017 2024-09-12T02:49:35.396 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-09-12T02:49:35.396 INFO:teuthology.orchestra.run.smithi172.stdout: "msgr_handle_ack_lat": { 2024-09-12T02:49:35.397 INFO:teuthology.orchestra.run.smithi172.stdout: "avgcount": 0, 2024-09-12T02:49:35.397 INFO:teuthology.orchestra.run.smithi172.stdout: "sum": 0.000000000, 2024-09-12T02:49:35.397 INFO:teuthology.orchestra.run.smithi172.stdout: "avgtime": 0.000000000 2024-09-12T02:49:35.397 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-09-12T02:49:35.397 INFO:teuthology.orchestra.run.smithi172.stdout: "msgr_recv_encrypted_bytes": 320, 2024-09-12T02:49:35.397 INFO:teuthology.orchestra.run.smithi172.stdout: "msgr_send_encrypted_bytes": 474032 2024-09-12T02:49:35.397 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-09-12T02:49:35.397 INFO:teuthology.orchestra.run.smithi172.stdout: "cct": { 2024-09-12T02:49:35.397 INFO:teuthology.orchestra.run.smithi172.stdout: "total_workers": 1, 2024-09-12T02:49:35.397 INFO:teuthology.orchestra.run.smithi172.stdout: "unhealthy_workers": 0 2024-09-12T02:49:35.397 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-09-12T02:49:35.397 INFO:teuthology.orchestra.run.smithi172.stdout: "finisher-MDSRank": { 2024-09-12T02:49:35.398 INFO:teuthology.orchestra.run.smithi172.stdout: "queue_len": 0, 2024-09-12T02:49:35.398 INFO:teuthology.orchestra.run.smithi172.stdout: "complete_latency": { 2024-09-12T02:49:35.398 INFO:teuthology.orchestra.run.smithi172.stdout: "avgcount": 3928, 2024-09-12T02:49:35.398 INFO:teuthology.orchestra.run.smithi172.stdout: "sum": 0.125923013, 2024-09-12T02:49:35.398 INFO:teuthology.orchestra.run.smithi172.stdout: "avgtime": 0.000032057 2024-09-12T02:49:35.398 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-09-12T02:49:35.398 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-09-12T02:49:35.398 INFO:teuthology.orchestra.run.smithi172.stdout: "finisher-PurgeQueue": { 2024-09-12T02:49:35.398 INFO:teuthology.orchestra.run.smithi172.stdout: "queue_len": 0, 2024-09-12T02:49:35.398 INFO:teuthology.orchestra.run.smithi172.stdout: "complete_latency": { 2024-09-12T02:49:35.398 INFO:teuthology.orchestra.run.smithi172.stdout: "avgcount": 0, 2024-09-12T02:49:35.398 INFO:teuthology.orchestra.run.smithi172.stdout: "sum": 0.000000000, 2024-09-12T02:49:35.398 INFO:teuthology.orchestra.run.smithi172.stdout: "avgtime": 0.000000000 2024-09-12T02:49:35.399 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-09-12T02:49:35.399 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-09-12T02:49:35.399 INFO:teuthology.orchestra.run.smithi172.stdout: "mds": { 2024-09-12T02:49:35.399 INFO:teuthology.orchestra.run.smithi172.stdout: "request": 0, 2024-09-12T02:49:35.399 INFO:teuthology.orchestra.run.smithi172.stdout: "reply": 0, 2024-09-12T02:49:35.399 INFO:teuthology.orchestra.run.smithi172.stdout: "reply_latency": { 2024-09-12T02:49:35.399 INFO:teuthology.orchestra.run.smithi172.stdout: "avgcount": 0, 2024-09-12T02:49:35.399 INFO:teuthology.orchestra.run.smithi172.stdout: "sum": 0.000000000, 2024-09-12T02:49:35.399 INFO:teuthology.orchestra.run.smithi172.stdout: "avgtime": 0.000000000 2024-09-12T02:49:35.399 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-09-12T02:49:35.399 INFO:teuthology.orchestra.run.smithi172.stdout: "slow_reply": 0, 2024-09-12T02:49:35.399 INFO:teuthology.orchestra.run.smithi172.stdout: "forward": 0, 2024-09-12T02:49:35.399 INFO:teuthology.orchestra.run.smithi172.stdout: "dir_fetch_complete": 0, 2024-09-12T02:49:35.400 INFO:teuthology.orchestra.run.smithi172.stdout: "dir_fetch_keys": 0, 2024-09-12T02:49:35.400 INFO:teuthology.orchestra.run.smithi172.stdout: "dir_commit": 0, 2024-09-12T02:49:35.400 INFO:teuthology.orchestra.run.smithi172.stdout: "dir_split": 0, 2024-09-12T02:49:35.400 INFO:teuthology.orchestra.run.smithi172.stdout: "dir_merge": 0, 2024-09-12T02:49:35.400 INFO:teuthology.orchestra.run.smithi172.stdout: "inodes": 0, 2024-09-12T02:49:35.400 INFO:teuthology.orchestra.run.smithi172.stdout: "inodes_top": 0, 2024-09-12T02:49:35.400 INFO:teuthology.orchestra.run.smithi172.stdout: "inodes_bottom": 0, 2024-09-12T02:49:35.400 INFO:teuthology.orchestra.run.smithi172.stdout: "inodes_pin_tail": 0, 2024-09-12T02:49:35.400 INFO:teuthology.orchestra.run.smithi172.stdout: "inodes_pinned": 0, 2024-09-12T02:49:35.400 INFO:teuthology.orchestra.run.smithi172.stdout: "inodes_expired": 0, 2024-09-12T02:49:35.400 INFO:teuthology.orchestra.run.smithi172.stdout: "inodes_with_caps": 0, 2024-09-12T02:49:35.400 INFO:teuthology.orchestra.run.smithi172.stdout: "caps": 0, 2024-09-12T02:49:35.400 INFO:teuthology.orchestra.run.smithi172.stdout: "subtrees": 1, 2024-09-12T02:49:35.400 INFO:teuthology.orchestra.run.smithi172.stdout: "traverse": 0, 2024-09-12T02:49:35.401 INFO:teuthology.orchestra.run.smithi172.stdout: "traverse_hit": 0, 2024-09-12T02:49:35.401 INFO:teuthology.orchestra.run.smithi172.stdout: "traverse_forward": 0, 2024-09-12T02:49:35.401 INFO:teuthology.orchestra.run.smithi172.stdout: "traverse_discover": 0, 2024-09-12T02:49:35.401 INFO:teuthology.orchestra.run.smithi172.stdout: "traverse_dir_fetch": 0, 2024-09-12T02:49:35.401 INFO:teuthology.orchestra.run.smithi172.stdout: "traverse_remote_ino": 0, 2024-09-12T02:49:35.401 INFO:teuthology.orchestra.run.smithi172.stdout: "traverse_lock": 0, 2024-09-12T02:49:35.401 INFO:teuthology.orchestra.run.smithi172.stdout: "load_cent": 0, 2024-09-12T02:49:35.401 INFO:teuthology.orchestra.run.smithi172.stdout: "q": 0, 2024-09-12T02:49:35.401 INFO:teuthology.orchestra.run.smithi172.stdout: "exported": 0, 2024-09-12T02:49:35.401 INFO:teuthology.orchestra.run.smithi172.stdout: "exported_inodes": 0, 2024-09-12T02:49:35.401 INFO:teuthology.orchestra.run.smithi172.stdout: "imported": 0, 2024-09-12T02:49:35.401 INFO:teuthology.orchestra.run.smithi172.stdout: "imported_inodes": 0, 2024-09-12T02:49:35.401 INFO:teuthology.orchestra.run.smithi172.stdout: "openino_dir_fetch": 0, 2024-09-12T02:49:35.402 INFO:teuthology.orchestra.run.smithi172.stdout: "openino_backtrace_fetch": 0, 2024-09-12T02:49:35.402 INFO:teuthology.orchestra.run.smithi172.stdout: "openino_peer_discover": 0, 2024-09-12T02:49:35.402 INFO:teuthology.orchestra.run.smithi172.stdout: "root_rfiles": 0, 2024-09-12T02:49:35.402 INFO:teuthology.orchestra.run.smithi172.stdout: "root_rbytes": 0, 2024-09-12T02:49:35.402 INFO:teuthology.orchestra.run.smithi172.stdout: "root_rsnaps": 0, 2024-09-12T02:49:35.402 INFO:teuthology.orchestra.run.smithi172.stdout: "scrub_backtrace_fetch": 0, 2024-09-12T02:49:35.402 INFO:teuthology.orchestra.run.smithi172.stdout: "scrub_set_tag": 0, 2024-09-12T02:49:35.402 INFO:teuthology.orchestra.run.smithi172.stdout: "scrub_backtrace_repaired": 0, 2024-09-12T02:49:35.402 INFO:teuthology.orchestra.run.smithi172.stdout: "scrub_inotable_repaired": 0, 2024-09-12T02:49:35.402 INFO:teuthology.orchestra.run.smithi172.stdout: "scrub_dir_inodes": 0, 2024-09-12T02:49:35.402 INFO:teuthology.orchestra.run.smithi172.stdout: "scrub_dir_base_inodes": 0, 2024-09-12T02:49:35.402 INFO:teuthology.orchestra.run.smithi172.stdout: "scrub_dirfrag_rstats": 0, 2024-09-12T02:49:35.402 INFO:teuthology.orchestra.run.smithi172.stdout: "scrub_file_inodes": 0, 2024-09-12T02:49:35.402 INFO:teuthology.orchestra.run.smithi172.stdout: "handle_inode_file_caps": 0, 2024-09-12T02:49:35.403 INFO:teuthology.orchestra.run.smithi172.stdout: "ceph_cap_op_revoke": 0, 2024-09-12T02:49:35.403 INFO:teuthology.orchestra.run.smithi172.stdout: "ceph_cap_op_grant": 0, 2024-09-12T02:49:35.403 INFO:teuthology.orchestra.run.smithi172.stdout: "ceph_cap_op_trunc": 0, 2024-09-12T02:49:35.403 INFO:teuthology.orchestra.run.smithi172.stdout: "ceph_cap_op_flushsnap_ack": 0, 2024-09-12T02:49:35.403 INFO:teuthology.orchestra.run.smithi172.stdout: "ceph_cap_op_flush_ack": 0, 2024-09-12T02:49:35.403 INFO:teuthology.orchestra.run.smithi172.stdout: "handle_client_caps": 0, 2024-09-12T02:49:35.403 INFO:teuthology.orchestra.run.smithi172.stdout: "handle_client_caps_dirty": 0, 2024-09-12T02:49:35.403 INFO:teuthology.orchestra.run.smithi172.stdout: "handle_client_cap_release": 0, 2024-09-12T02:49:35.403 INFO:teuthology.orchestra.run.smithi172.stdout: "process_request_cap_release": 0 2024-09-12T02:49:35.403 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-09-12T02:49:35.404 INFO:teuthology.orchestra.run.smithi172.stdout: "mds_cache": { 2024-09-12T02:49:35.404 INFO:teuthology.orchestra.run.smithi172.stdout: "dir_update": 0, 2024-09-12T02:49:35.404 INFO:teuthology.orchestra.run.smithi172.stdout: "dir_update_receipt": 0, 2024-09-12T02:49:35.404 INFO:teuthology.orchestra.run.smithi172.stdout: "dir_try_discover": 0, 2024-09-12T02:49:35.404 INFO:teuthology.orchestra.run.smithi172.stdout: "dir_send_discover": 0, 2024-09-12T02:49:35.404 INFO:teuthology.orchestra.run.smithi172.stdout: "dir_handle_discover": 0, 2024-09-12T02:49:35.404 INFO:teuthology.orchestra.run.smithi172.stdout: "num_strays": 0, 2024-09-12T02:49:35.404 INFO:teuthology.orchestra.run.smithi172.stdout: "num_strays_delayed": 0, 2024-09-12T02:49:35.404 INFO:teuthology.orchestra.run.smithi172.stdout: "num_strays_enqueuing": 0, 2024-09-12T02:49:35.404 INFO:teuthology.orchestra.run.smithi172.stdout: "strays_created": 0, 2024-09-12T02:49:35.404 INFO:teuthology.orchestra.run.smithi172.stdout: "strays_enqueued": 0, 2024-09-12T02:49:35.404 INFO:teuthology.orchestra.run.smithi172.stdout: "strays_reintegrated": 0, 2024-09-12T02:49:35.404 INFO:teuthology.orchestra.run.smithi172.stdout: "strays_migrated": 0, 2024-09-12T02:49:35.405 INFO:teuthology.orchestra.run.smithi172.stdout: "num_recovering_processing": 0, 2024-09-12T02:49:35.405 INFO:teuthology.orchestra.run.smithi172.stdout: "num_recovering_enqueued": 0, 2024-09-12T02:49:35.405 INFO:teuthology.orchestra.run.smithi172.stdout: "num_recovering_prioritized": 0, 2024-09-12T02:49:35.405 INFO:teuthology.orchestra.run.smithi172.stdout: "recovery_started": 0, 2024-09-12T02:49:35.405 INFO:teuthology.orchestra.run.smithi172.stdout: "recovery_completed": 0, 2024-09-12T02:49:35.405 INFO:teuthology.orchestra.run.smithi172.stdout: "ireq_quiesce_path": 0, 2024-09-12T02:49:35.405 INFO:teuthology.orchestra.run.smithi172.stdout: "ireq_quiesce_inode": 0, 2024-09-12T02:49:35.405 INFO:teuthology.orchestra.run.smithi172.stdout: "ireq_enqueue_scrub": 0, 2024-09-12T02:49:35.405 INFO:teuthology.orchestra.run.smithi172.stdout: "ireq_exportdir": 0, 2024-09-12T02:49:35.405 INFO:teuthology.orchestra.run.smithi172.stdout: "ireq_flush": 0, 2024-09-12T02:49:35.405 INFO:teuthology.orchestra.run.smithi172.stdout: "ireq_fragmentdir": 0, 2024-09-12T02:49:35.405 INFO:teuthology.orchestra.run.smithi172.stdout: "ireq_fragstats": 0, 2024-09-12T02:49:35.405 INFO:teuthology.orchestra.run.smithi172.stdout: "ireq_inodestats": 0 2024-09-12T02:49:35.406 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-09-12T02:49:35.406 INFO:teuthology.orchestra.run.smithi172.stdout: "mds_log": { 2024-09-12T02:49:35.406 INFO:teuthology.orchestra.run.smithi172.stdout: "evlrg": 0, 2024-09-12T02:49:35.406 INFO:teuthology.orchestra.run.smithi172.stdout: "evadd": 0, 2024-09-12T02:49:35.406 INFO:teuthology.orchestra.run.smithi172.stdout: "evex": 0, 2024-09-12T02:49:35.406 INFO:teuthology.orchestra.run.smithi172.stdout: "evtrm": 0, 2024-09-12T02:49:35.406 INFO:teuthology.orchestra.run.smithi172.stdout: "ev": 6, 2024-09-12T02:49:35.406 INFO:teuthology.orchestra.run.smithi172.stdout: "evexg": 0, 2024-09-12T02:49:35.406 INFO:teuthology.orchestra.run.smithi172.stdout: "evexd": 0, 2024-09-12T02:49:35.406 INFO:teuthology.orchestra.run.smithi172.stdout: "segadd": 0, 2024-09-12T02:49:35.406 INFO:teuthology.orchestra.run.smithi172.stdout: "segex": 0, 2024-09-12T02:49:35.406 INFO:teuthology.orchestra.run.smithi172.stdout: "segtrm": 0, 2024-09-12T02:49:35.406 INFO:teuthology.orchestra.run.smithi172.stdout: "seg": 2, 2024-09-12T02:49:35.407 INFO:teuthology.orchestra.run.smithi172.stdout: "segmjr": 2, 2024-09-12T02:49:35.407 INFO:teuthology.orchestra.run.smithi172.stdout: "segexg": 0, 2024-09-12T02:49:35.407 INFO:teuthology.orchestra.run.smithi172.stdout: "segexd": 0, 2024-09-12T02:49:35.407 INFO:teuthology.orchestra.run.smithi172.stdout: "expos": 4194304, 2024-09-12T02:49:35.407 INFO:teuthology.orchestra.run.smithi172.stdout: "wrpos": 4196130, 2024-09-12T02:49:35.407 INFO:teuthology.orchestra.run.smithi172.stdout: "rdpos": 4195737, 2024-09-12T02:49:35.407 INFO:teuthology.orchestra.run.smithi172.stdout: "jlat": { 2024-09-12T02:49:35.407 INFO:teuthology.orchestra.run.smithi172.stdout: "avgcount": 0, 2024-09-12T02:49:35.407 INFO:teuthology.orchestra.run.smithi172.stdout: "sum": 0.000000000, 2024-09-12T02:49:35.407 INFO:teuthology.orchestra.run.smithi172.stdout: "avgtime": 0.000000000 2024-09-12T02:49:35.407 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-09-12T02:49:35.407 INFO:teuthology.orchestra.run.smithi172.stdout: "replayed": 6 2024-09-12T02:49:35.407 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-09-12T02:49:35.407 INFO:teuthology.orchestra.run.smithi172.stdout: "mds_mem": { 2024-09-12T02:49:35.408 INFO:teuthology.orchestra.run.smithi172.stdout: "ino": 3, 2024-09-12T02:49:35.408 INFO:teuthology.orchestra.run.smithi172.stdout: "ino+": 3, 2024-09-12T02:49:35.408 INFO:teuthology.orchestra.run.smithi172.stdout: "ino-": 0, 2024-09-12T02:49:35.408 INFO:teuthology.orchestra.run.smithi172.stdout: "dir": 1, 2024-09-12T02:49:35.408 INFO:teuthology.orchestra.run.smithi172.stdout: "dir+": 1, 2024-09-12T02:49:35.408 INFO:teuthology.orchestra.run.smithi172.stdout: "dir-": 0, 2024-09-12T02:49:35.408 INFO:teuthology.orchestra.run.smithi172.stdout: "dn": 0, 2024-09-12T02:49:35.408 INFO:teuthology.orchestra.run.smithi172.stdout: "dn+": 0, 2024-09-12T02:49:35.408 INFO:teuthology.orchestra.run.smithi172.stdout: "dn-": 0, 2024-09-12T02:49:35.408 INFO:teuthology.orchestra.run.smithi172.stdout: "cap": 0, 2024-09-12T02:49:35.408 INFO:teuthology.orchestra.run.smithi172.stdout: "cap+": 0, 2024-09-12T02:49:35.408 INFO:teuthology.orchestra.run.smithi172.stdout: "cap-": 0, 2024-09-12T02:49:35.408 INFO:teuthology.orchestra.run.smithi172.stdout: "rss": 50988, 2024-09-12T02:49:35.409 INFO:teuthology.orchestra.run.smithi172.stdout: "heap": 215328 2024-09-12T02:49:35.409 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-09-12T02:49:35.409 INFO:teuthology.orchestra.run.smithi172.stdout: "mds_server": { 2024-09-12T02:49:35.409 INFO:teuthology.orchestra.run.smithi172.stdout: "dispatch_client_request": 0, 2024-09-12T02:49:35.409 INFO:teuthology.orchestra.run.smithi172.stdout: "dispatch_server_request": 0, 2024-09-12T02:49:35.409 INFO:teuthology.orchestra.run.smithi172.stdout: "handle_client_request": 0, 2024-09-12T02:49:35.409 INFO:teuthology.orchestra.run.smithi172.stdout: "handle_client_session": 0, 2024-09-12T02:49:35.409 INFO:teuthology.orchestra.run.smithi172.stdout: "handle_peer_request": 0, 2024-09-12T02:49:35.409 INFO:teuthology.orchestra.run.smithi172.stdout: "req_create_latency": { 2024-09-12T02:49:35.409 INFO:teuthology.orchestra.run.smithi172.stdout: "avgcount": 0, 2024-09-12T02:49:35.409 INFO:teuthology.orchestra.run.smithi172.stdout: "sum": 0.000000000, 2024-09-12T02:49:35.409 INFO:teuthology.orchestra.run.smithi172.stdout: "avgtime": 0.000000000 2024-09-12T02:49:35.410 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-09-12T02:49:35.410 INFO:teuthology.orchestra.run.smithi172.stdout: "req_getattr_latency": { 2024-09-12T02:49:35.410 INFO:teuthology.orchestra.run.smithi172.stdout: "avgcount": 0, 2024-09-12T02:49:35.410 INFO:teuthology.orchestra.run.smithi172.stdout: "sum": 0.000000000, 2024-09-12T02:49:35.410 INFO:teuthology.orchestra.run.smithi172.stdout: "avgtime": 0.000000000 2024-09-12T02:49:35.410 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-09-12T02:49:35.410 INFO:teuthology.orchestra.run.smithi172.stdout: "req_getfilelock_latency": { 2024-09-12T02:49:35.410 INFO:teuthology.orchestra.run.smithi172.stdout: "avgcount": 0, 2024-09-12T02:49:35.410 INFO:teuthology.orchestra.run.smithi172.stdout: "sum": 0.000000000, 2024-09-12T02:49:35.410 INFO:teuthology.orchestra.run.smithi172.stdout: "avgtime": 0.000000000 2024-09-12T02:49:35.410 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-09-12T02:49:35.410 INFO:teuthology.orchestra.run.smithi172.stdout: "req_link_latency": { 2024-09-12T02:49:35.410 INFO:teuthology.orchestra.run.smithi172.stdout: "avgcount": 0, 2024-09-12T02:49:35.410 INFO:teuthology.orchestra.run.smithi172.stdout: "sum": 0.000000000, 2024-09-12T02:49:35.411 INFO:teuthology.orchestra.run.smithi172.stdout: "avgtime": 0.000000000 2024-09-12T02:49:35.411 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-09-12T02:49:35.411 INFO:teuthology.orchestra.run.smithi172.stdout: "req_lookup_latency": { 2024-09-12T02:49:35.411 INFO:teuthology.orchestra.run.smithi172.stdout: "avgcount": 0, 2024-09-12T02:49:35.411 INFO:teuthology.orchestra.run.smithi172.stdout: "sum": 0.000000000, 2024-09-12T02:49:35.411 INFO:teuthology.orchestra.run.smithi172.stdout: "avgtime": 0.000000000 2024-09-12T02:49:35.411 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-09-12T02:49:35.411 INFO:teuthology.orchestra.run.smithi172.stdout: "req_lookuphash_latency": { 2024-09-12T02:49:35.411 INFO:teuthology.orchestra.run.smithi172.stdout: "avgcount": 0, 2024-09-12T02:49:35.411 INFO:teuthology.orchestra.run.smithi172.stdout: "sum": 0.000000000, 2024-09-12T02:49:35.411 INFO:teuthology.orchestra.run.smithi172.stdout: "avgtime": 0.000000000 2024-09-12T02:49:35.411 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-09-12T02:49:35.411 INFO:teuthology.orchestra.run.smithi172.stdout: "req_lookupino_latency": { 2024-09-12T02:49:35.412 INFO:teuthology.orchestra.run.smithi172.stdout: "avgcount": 0, 2024-09-12T02:49:35.412 INFO:teuthology.orchestra.run.smithi172.stdout: "sum": 0.000000000, 2024-09-12T02:49:35.412 INFO:teuthology.orchestra.run.smithi172.stdout: "avgtime": 0.000000000 2024-09-12T02:49:35.412 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-09-12T02:49:35.412 INFO:teuthology.orchestra.run.smithi172.stdout: "req_lookupname_latency": { 2024-09-12T02:49:35.412 INFO:teuthology.orchestra.run.smithi172.stdout: "avgcount": 0, 2024-09-12T02:49:35.412 INFO:teuthology.orchestra.run.smithi172.stdout: "sum": 0.000000000, 2024-09-12T02:49:35.412 INFO:teuthology.orchestra.run.smithi172.stdout: "avgtime": 0.000000000 2024-09-12T02:49:35.412 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-09-12T02:49:35.412 INFO:teuthology.orchestra.run.smithi172.stdout: "req_lookupparent_latency": { 2024-09-12T02:49:35.412 INFO:teuthology.orchestra.run.smithi172.stdout: "avgcount": 0, 2024-09-12T02:49:35.412 INFO:teuthology.orchestra.run.smithi172.stdout: "sum": 0.000000000, 2024-09-12T02:49:35.413 INFO:teuthology.orchestra.run.smithi172.stdout: "avgtime": 0.000000000 2024-09-12T02:49:35.413 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-09-12T02:49:35.413 INFO:teuthology.orchestra.run.smithi172.stdout: "req_lookupsnap_latency": { 2024-09-12T02:49:35.413 INFO:teuthology.orchestra.run.smithi172.stdout: "avgcount": 0, 2024-09-12T02:49:35.413 INFO:teuthology.orchestra.run.smithi172.stdout: "sum": 0.000000000, 2024-09-12T02:49:35.413 INFO:teuthology.orchestra.run.smithi172.stdout: "avgtime": 0.000000000 2024-09-12T02:49:35.413 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-09-12T02:49:35.413 INFO:teuthology.orchestra.run.smithi172.stdout: "req_lssnap_latency": { 2024-09-12T02:49:35.413 INFO:teuthology.orchestra.run.smithi172.stdout: "avgcount": 0, 2024-09-12T02:49:35.413 INFO:teuthology.orchestra.run.smithi172.stdout: "sum": 0.000000000, 2024-09-12T02:49:35.413 INFO:teuthology.orchestra.run.smithi172.stdout: "avgtime": 0.000000000 2024-09-12T02:49:35.413 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-09-12T02:49:35.413 INFO:teuthology.orchestra.run.smithi172.stdout: "req_mkdir_latency": { 2024-09-12T02:49:35.413 INFO:teuthology.orchestra.run.smithi172.stdout: "avgcount": 0, 2024-09-12T02:49:35.414 INFO:teuthology.orchestra.run.smithi172.stdout: "sum": 0.000000000, 2024-09-12T02:49:35.414 INFO:teuthology.orchestra.run.smithi172.stdout: "avgtime": 0.000000000 2024-09-12T02:49:35.414 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-09-12T02:49:35.415 INFO:teuthology.orchestra.run.smithi172.stdout: "req_mknod_latency": { 2024-09-12T02:49:35.415 INFO:teuthology.orchestra.run.smithi172.stdout: "avgcount": 0, 2024-09-12T02:49:35.415 INFO:teuthology.orchestra.run.smithi172.stdout: "sum": 0.000000000, 2024-09-12T02:49:35.415 INFO:teuthology.orchestra.run.smithi172.stdout: "avgtime": 0.000000000 2024-09-12T02:49:35.415 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-09-12T02:49:35.415 INFO:teuthology.orchestra.run.smithi172.stdout: "req_mksnap_latency": { 2024-09-12T02:49:35.415 INFO:teuthology.orchestra.run.smithi172.stdout: "avgcount": 0, 2024-09-12T02:49:35.415 INFO:teuthology.orchestra.run.smithi172.stdout: "sum": 0.000000000, 2024-09-12T02:49:35.415 INFO:teuthology.orchestra.run.smithi172.stdout: "avgtime": 0.000000000 2024-09-12T02:49:35.415 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-09-12T02:49:35.415 INFO:teuthology.orchestra.run.smithi172.stdout: "req_open_latency": { 2024-09-12T02:49:35.415 INFO:teuthology.orchestra.run.smithi172.stdout: "avgcount": 0, 2024-09-12T02:49:35.415 INFO:teuthology.orchestra.run.smithi172.stdout: "sum": 0.000000000, 2024-09-12T02:49:35.416 INFO:teuthology.orchestra.run.smithi172.stdout: "avgtime": 0.000000000 2024-09-12T02:49:35.416 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-09-12T02:49:35.416 INFO:teuthology.orchestra.run.smithi172.stdout: "req_readdir_latency": { 2024-09-12T02:49:35.416 INFO:teuthology.orchestra.run.smithi172.stdout: "avgcount": 0, 2024-09-12T02:49:35.416 INFO:teuthology.orchestra.run.smithi172.stdout: "sum": 0.000000000, 2024-09-12T02:49:35.416 INFO:teuthology.orchestra.run.smithi172.stdout: "avgtime": 0.000000000 2024-09-12T02:49:35.416 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-09-12T02:49:35.416 INFO:teuthology.orchestra.run.smithi172.stdout: "req_rename_latency": { 2024-09-12T02:49:35.416 INFO:teuthology.orchestra.run.smithi172.stdout: "avgcount": 0, 2024-09-12T02:49:35.416 INFO:teuthology.orchestra.run.smithi172.stdout: "sum": 0.000000000, 2024-09-12T02:49:35.416 INFO:teuthology.orchestra.run.smithi172.stdout: "avgtime": 0.000000000 2024-09-12T02:49:35.416 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-09-12T02:49:35.416 INFO:teuthology.orchestra.run.smithi172.stdout: "req_renamesnap_latency": { 2024-09-12T02:49:35.417 INFO:teuthology.orchestra.run.smithi172.stdout: "avgcount": 0, 2024-09-12T02:49:35.417 INFO:teuthology.orchestra.run.smithi172.stdout: "sum": 0.000000000, 2024-09-12T02:49:35.417 INFO:teuthology.orchestra.run.smithi172.stdout: "avgtime": 0.000000000 2024-09-12T02:49:35.417 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-09-12T02:49:35.417 INFO:teuthology.orchestra.run.smithi172.stdout: "req_snapdiff_latency": { 2024-09-12T02:49:35.417 INFO:teuthology.orchestra.run.smithi172.stdout: "avgcount": 0, 2024-09-12T02:49:35.417 INFO:teuthology.orchestra.run.smithi172.stdout: "sum": 0.000000000, 2024-09-12T02:49:35.417 INFO:teuthology.orchestra.run.smithi172.stdout: "avgtime": 0.000000000 2024-09-12T02:49:35.417 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-09-12T02:49:35.417 INFO:teuthology.orchestra.run.smithi172.stdout: "req_rmdir_latency": { 2024-09-12T02:49:35.417 INFO:teuthology.orchestra.run.smithi172.stdout: "avgcount": 0, 2024-09-12T02:49:35.417 INFO:teuthology.orchestra.run.smithi172.stdout: "sum": 0.000000000, 2024-09-12T02:49:35.418 INFO:teuthology.orchestra.run.smithi172.stdout: "avgtime": 0.000000000 2024-09-12T02:49:35.418 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-09-12T02:49:35.418 INFO:teuthology.orchestra.run.smithi172.stdout: "req_rmsnap_latency": { 2024-09-12T02:49:35.418 INFO:teuthology.orchestra.run.smithi172.stdout: "avgcount": 0, 2024-09-12T02:49:35.418 INFO:teuthology.orchestra.run.smithi172.stdout: "sum": 0.000000000, 2024-09-12T02:49:35.418 INFO:teuthology.orchestra.run.smithi172.stdout: "avgtime": 0.000000000 2024-09-12T02:49:35.418 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-09-12T02:49:35.418 INFO:teuthology.orchestra.run.smithi172.stdout: "req_rmxattr_latency": { 2024-09-12T02:49:35.418 INFO:teuthology.orchestra.run.smithi172.stdout: "avgcount": 0, 2024-09-12T02:49:35.418 INFO:teuthology.orchestra.run.smithi172.stdout: "sum": 0.000000000, 2024-09-12T02:49:35.418 INFO:teuthology.orchestra.run.smithi172.stdout: "avgtime": 0.000000000 2024-09-12T02:49:35.418 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-09-12T02:49:35.418 INFO:teuthology.orchestra.run.smithi172.stdout: "req_setattr_latency": { 2024-09-12T02:49:35.419 INFO:teuthology.orchestra.run.smithi172.stdout: "avgcount": 0, 2024-09-12T02:49:35.419 INFO:teuthology.orchestra.run.smithi172.stdout: "sum": 0.000000000, 2024-09-12T02:49:35.419 INFO:teuthology.orchestra.run.smithi172.stdout: "avgtime": 0.000000000 2024-09-12T02:49:35.419 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-09-12T02:49:35.419 INFO:teuthology.orchestra.run.smithi172.stdout: "req_setdirlayout_latency": { 2024-09-12T02:49:35.419 INFO:teuthology.orchestra.run.smithi172.stdout: "avgcount": 0, 2024-09-12T02:49:35.419 INFO:teuthology.orchestra.run.smithi172.stdout: "sum": 0.000000000, 2024-09-12T02:49:35.419 INFO:teuthology.orchestra.run.smithi172.stdout: "avgtime": 0.000000000 2024-09-12T02:49:35.419 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-09-12T02:49:35.419 INFO:teuthology.orchestra.run.smithi172.stdout: "req_setfilelock_latency": { 2024-09-12T02:49:35.419 INFO:teuthology.orchestra.run.smithi172.stdout: "avgcount": 0, 2024-09-12T02:49:35.419 INFO:teuthology.orchestra.run.smithi172.stdout: "sum": 0.000000000, 2024-09-12T02:49:35.420 INFO:teuthology.orchestra.run.smithi172.stdout: "avgtime": 0.000000000 2024-09-12T02:49:35.420 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-09-12T02:49:35.420 INFO:teuthology.orchestra.run.smithi172.stdout: "req_setlayout_latency": { 2024-09-12T02:49:35.420 INFO:teuthology.orchestra.run.smithi172.stdout: "avgcount": 0, 2024-09-12T02:49:35.420 INFO:teuthology.orchestra.run.smithi172.stdout: "sum": 0.000000000, 2024-09-12T02:49:35.420 INFO:teuthology.orchestra.run.smithi172.stdout: "avgtime": 0.000000000 2024-09-12T02:49:35.420 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-09-12T02:49:35.420 INFO:teuthology.orchestra.run.smithi172.stdout: "req_setxattr_latency": { 2024-09-12T02:49:35.420 INFO:teuthology.orchestra.run.smithi172.stdout: "avgcount": 0, 2024-09-12T02:49:35.420 INFO:teuthology.orchestra.run.smithi172.stdout: "sum": 0.000000000, 2024-09-12T02:49:35.420 INFO:teuthology.orchestra.run.smithi172.stdout: "avgtime": 0.000000000 2024-09-12T02:49:35.420 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-09-12T02:49:35.420 INFO:teuthology.orchestra.run.smithi172.stdout: "req_symlink_latency": { 2024-09-12T02:49:35.421 INFO:teuthology.orchestra.run.smithi172.stdout: "avgcount": 0, 2024-09-12T02:49:35.421 INFO:teuthology.orchestra.run.smithi172.stdout: "sum": 0.000000000, 2024-09-12T02:49:35.421 INFO:teuthology.orchestra.run.smithi172.stdout: "avgtime": 0.000000000 2024-09-12T02:49:35.421 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-09-12T02:49:35.421 INFO:teuthology.orchestra.run.smithi172.stdout: "req_unlink_latency": { 2024-09-12T02:49:35.421 INFO:teuthology.orchestra.run.smithi172.stdout: "avgcount": 0, 2024-09-12T02:49:35.421 INFO:teuthology.orchestra.run.smithi172.stdout: "sum": 0.000000000, 2024-09-12T02:49:35.421 INFO:teuthology.orchestra.run.smithi172.stdout: "avgtime": 0.000000000 2024-09-12T02:49:35.421 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-09-12T02:49:35.421 INFO:teuthology.orchestra.run.smithi172.stdout: "cap_revoke_eviction": 0, 2024-09-12T02:49:35.421 INFO:teuthology.orchestra.run.smithi172.stdout: "cap_acquisition_throttle": 0, 2024-09-12T02:49:35.421 INFO:teuthology.orchestra.run.smithi172.stdout: "req_getvxattr_latency": { 2024-09-12T02:49:35.421 INFO:teuthology.orchestra.run.smithi172.stdout: "avgcount": 0, 2024-09-12T02:49:35.421 INFO:teuthology.orchestra.run.smithi172.stdout: "sum": 0.000000000, 2024-09-12T02:49:35.422 INFO:teuthology.orchestra.run.smithi172.stdout: "avgtime": 0.000000000 2024-09-12T02:49:35.422 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-09-12T02:49:35.422 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-09-12T02:49:35.422 INFO:teuthology.orchestra.run.smithi172.stdout: "mds_sessions": { 2024-09-12T02:49:35.422 INFO:teuthology.orchestra.run.smithi172.stdout: "session_count": 2, 2024-09-12T02:49:35.422 INFO:teuthology.orchestra.run.smithi172.stdout: "session_add": 3, 2024-09-12T02:49:35.422 INFO:teuthology.orchestra.run.smithi172.stdout: "session_remove": 1, 2024-09-12T02:49:35.422 INFO:teuthology.orchestra.run.smithi172.stdout: "sessions_open": 2, 2024-09-12T02:49:35.422 INFO:teuthology.orchestra.run.smithi172.stdout: "sessions_stale": 0, 2024-09-12T02:49:35.422 INFO:teuthology.orchestra.run.smithi172.stdout: "total_load": 0, 2024-09-12T02:49:35.422 INFO:teuthology.orchestra.run.smithi172.stdout: "average_load": 0, 2024-09-12T02:49:35.422 INFO:teuthology.orchestra.run.smithi172.stdout: "avg_session_uptime": 2199, 2024-09-12T02:49:35.422 INFO:teuthology.orchestra.run.smithi172.stdout: "mdthresh_evicted": 0 2024-09-12T02:49:35.423 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-09-12T02:49:35.423 INFO:teuthology.orchestra.run.smithi172.stdout: "mempool": { 2024-09-12T02:49:35.423 INFO:teuthology.orchestra.run.smithi172.stdout: "bloom_filter_bytes": 0, 2024-09-12T02:49:35.423 INFO:teuthology.orchestra.run.smithi172.stdout: "bloom_filter_items": 0, 2024-09-12T02:49:35.423 INFO:teuthology.orchestra.run.smithi172.stdout: "bluestore_alloc_bytes": 0, 2024-09-12T02:49:35.423 INFO:teuthology.orchestra.run.smithi172.stdout: "bluestore_alloc_items": 0, 2024-09-12T02:49:35.423 INFO:teuthology.orchestra.run.smithi172.stdout: "bluestore_cache_data_bytes": 0, 2024-09-12T02:49:35.423 INFO:teuthology.orchestra.run.smithi172.stdout: "bluestore_cache_data_items": 0, 2024-09-12T02:49:35.423 INFO:teuthology.orchestra.run.smithi172.stdout: "bluestore_cache_onode_bytes": 0, 2024-09-12T02:49:35.423 INFO:teuthology.orchestra.run.smithi172.stdout: "bluestore_cache_onode_items": 0, 2024-09-12T02:49:35.423 INFO:teuthology.orchestra.run.smithi172.stdout: "bluestore_cache_meta_bytes": 0, 2024-09-12T02:49:35.423 INFO:teuthology.orchestra.run.smithi172.stdout: "bluestore_cache_meta_items": 0, 2024-09-12T02:49:35.423 INFO:teuthology.orchestra.run.smithi172.stdout: "bluestore_cache_other_bytes": 0, 2024-09-12T02:49:35.424 INFO:teuthology.orchestra.run.smithi172.stdout: "bluestore_cache_other_items": 0, 2024-09-12T02:49:35.424 INFO:teuthology.orchestra.run.smithi172.stdout: "bluestore_cache_buffer_bytes": 0, 2024-09-12T02:49:35.424 INFO:teuthology.orchestra.run.smithi172.stdout: "bluestore_cache_buffer_items": 0, 2024-09-12T02:49:35.424 INFO:teuthology.orchestra.run.smithi172.stdout: "bluestore_extent_bytes": 0, 2024-09-12T02:49:35.424 INFO:teuthology.orchestra.run.smithi172.stdout: "bluestore_extent_items": 0, 2024-09-12T02:49:35.424 INFO:teuthology.orchestra.run.smithi172.stdout: "bluestore_blob_bytes": 0, 2024-09-12T02:49:35.424 INFO:teuthology.orchestra.run.smithi172.stdout: "bluestore_blob_items": 0, 2024-09-12T02:49:35.424 INFO:teuthology.orchestra.run.smithi172.stdout: "bluestore_shared_blob_bytes": 0, 2024-09-12T02:49:35.424 INFO:teuthology.orchestra.run.smithi172.stdout: "bluestore_shared_blob_items": 0, 2024-09-12T02:49:35.424 INFO:teuthology.orchestra.run.smithi172.stdout: "bluestore_inline_bl_bytes": 0, 2024-09-12T02:49:35.424 INFO:teuthology.orchestra.run.smithi172.stdout: "bluestore_inline_bl_items": 0, 2024-09-12T02:49:35.424 INFO:teuthology.orchestra.run.smithi172.stdout: "bluestore_fsck_bytes": 0, 2024-09-12T02:49:35.424 INFO:teuthology.orchestra.run.smithi172.stdout: "bluestore_fsck_items": 0, 2024-09-12T02:49:35.425 INFO:teuthology.orchestra.run.smithi172.stdout: "bluestore_txc_bytes": 0, 2024-09-12T02:49:35.425 INFO:teuthology.orchestra.run.smithi172.stdout: "bluestore_txc_items": 0, 2024-09-12T02:49:35.425 INFO:teuthology.orchestra.run.smithi172.stdout: "bluestore_writing_deferred_bytes": 0, 2024-09-12T02:49:35.425 INFO:teuthology.orchestra.run.smithi172.stdout: "bluestore_writing_deferred_items": 0, 2024-09-12T02:49:35.425 INFO:teuthology.orchestra.run.smithi172.stdout: "bluestore_writing_bytes": 0, 2024-09-12T02:49:35.425 INFO:teuthology.orchestra.run.smithi172.stdout: "bluestore_writing_items": 0, 2024-09-12T02:49:35.425 INFO:teuthology.orchestra.run.smithi172.stdout: "bluefs_bytes": 0, 2024-09-12T02:49:35.425 INFO:teuthology.orchestra.run.smithi172.stdout: "bluefs_items": 0, 2024-09-12T02:49:35.425 INFO:teuthology.orchestra.run.smithi172.stdout: "bluefs_file_reader_bytes": 0, 2024-09-12T02:49:35.425 INFO:teuthology.orchestra.run.smithi172.stdout: "bluefs_file_reader_items": 0, 2024-09-12T02:49:35.425 INFO:teuthology.orchestra.run.smithi172.stdout: "bluefs_file_writer_bytes": 0, 2024-09-12T02:49:35.425 INFO:teuthology.orchestra.run.smithi172.stdout: "bluefs_file_writer_items": 0, 2024-09-12T02:49:35.425 INFO:teuthology.orchestra.run.smithi172.stdout: "buffer_anon_bytes": 198258, 2024-09-12T02:49:35.426 INFO:teuthology.orchestra.run.smithi172.stdout: "buffer_anon_items": 57, 2024-09-12T02:49:35.426 INFO:teuthology.orchestra.run.smithi172.stdout: "buffer_meta_bytes": 0, 2024-09-12T02:49:35.426 INFO:teuthology.orchestra.run.smithi172.stdout: "buffer_meta_items": 0, 2024-09-12T02:49:35.426 INFO:teuthology.orchestra.run.smithi172.stdout: "osd_bytes": 0, 2024-09-12T02:49:35.426 INFO:teuthology.orchestra.run.smithi172.stdout: "osd_items": 0, 2024-09-12T02:49:35.426 INFO:teuthology.orchestra.run.smithi172.stdout: "osd_mapbl_bytes": 0, 2024-09-12T02:49:35.426 INFO:teuthology.orchestra.run.smithi172.stdout: "osd_mapbl_items": 0, 2024-09-12T02:49:35.426 INFO:teuthology.orchestra.run.smithi172.stdout: "osd_pglog_bytes": 0, 2024-09-12T02:49:35.426 INFO:teuthology.orchestra.run.smithi172.stdout: "osd_pglog_items": 0, 2024-09-12T02:49:35.426 INFO:teuthology.orchestra.run.smithi172.stdout: "osdmap_bytes": 9520, 2024-09-12T02:49:35.426 INFO:teuthology.orchestra.run.smithi172.stdout: "osdmap_items": 193, 2024-09-12T02:49:35.426 INFO:teuthology.orchestra.run.smithi172.stdout: "osdmap_mapping_bytes": 0, 2024-09-12T02:49:35.426 INFO:teuthology.orchestra.run.smithi172.stdout: "osdmap_mapping_items": 0, 2024-09-12T02:49:35.426 INFO:teuthology.orchestra.run.smithi172.stdout: "pgmap_bytes": 0, 2024-09-12T02:49:35.427 INFO:teuthology.orchestra.run.smithi172.stdout: "pgmap_items": 0, 2024-09-12T02:49:35.427 INFO:teuthology.orchestra.run.smithi172.stdout: "mds_co_bytes": 8512, 2024-09-12T02:49:35.427 INFO:teuthology.orchestra.run.smithi172.stdout: "mds_co_items": 13, 2024-09-12T02:49:35.427 INFO:teuthology.orchestra.run.smithi172.stdout: "unittest_1_bytes": 0, 2024-09-12T02:49:35.427 INFO:teuthology.orchestra.run.smithi172.stdout: "unittest_1_items": 0, 2024-09-12T02:49:35.427 INFO:teuthology.orchestra.run.smithi172.stdout: "unittest_2_bytes": 0, 2024-09-12T02:49:35.427 INFO:teuthology.orchestra.run.smithi172.stdout: "unittest_2_items": 0 2024-09-12T02:49:35.427 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-09-12T02:49:35.427 INFO:teuthology.orchestra.run.smithi172.stdout: "objecter": { 2024-09-12T02:49:35.427 INFO:teuthology.orchestra.run.smithi172.stdout: "op_active": 0, 2024-09-12T02:49:35.427 INFO:teuthology.orchestra.run.smithi172.stdout: "op_laggy": 0, 2024-09-12T02:49:35.427 INFO:teuthology.orchestra.run.smithi172.stdout: "op_send": 2396, 2024-09-12T02:49:35.428 INFO:teuthology.orchestra.run.smithi172.stdout: "op_send_bytes": 21, 2024-09-12T02:49:35.428 INFO:teuthology.orchestra.run.smithi172.stdout: "op_resend": 3, 2024-09-12T02:49:35.428 INFO:teuthology.orchestra.run.smithi172.stdout: "op_reply": 2396, 2024-09-12T02:49:35.428 INFO:teuthology.orchestra.run.smithi172.stdout: "op_latency": { 2024-09-12T02:49:35.428 INFO:teuthology.orchestra.run.smithi172.stdout: "avgcount": 2396, 2024-09-12T02:49:35.428 INFO:teuthology.orchestra.run.smithi172.stdout: "sum": 1.330967135, 2024-09-12T02:49:35.428 INFO:teuthology.orchestra.run.smithi172.stdout: "avgtime": 0.000555495 2024-09-12T02:49:35.428 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-09-12T02:49:35.428 INFO:teuthology.orchestra.run.smithi172.stdout: "op_inflight": 0, 2024-09-12T02:49:35.428 INFO:teuthology.orchestra.run.smithi172.stdout: "oplen_avg": { 2024-09-12T02:49:35.428 INFO:teuthology.orchestra.run.smithi172.stdout: "avgcount": 2396, 2024-09-12T02:49:35.428 INFO:teuthology.orchestra.run.smithi172.stdout: "sum": 2397 2024-09-12T02:49:35.428 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-09-12T02:49:35.429 INFO:teuthology.orchestra.run.smithi172.stdout: "op": 2396, 2024-09-12T02:49:35.429 INFO:teuthology.orchestra.run.smithi172.stdout: "op_r": 2396, 2024-09-12T02:49:35.429 INFO:teuthology.orchestra.run.smithi172.stdout: "op_w": 0, 2024-09-12T02:49:35.429 INFO:teuthology.orchestra.run.smithi172.stdout: "op_rmw": 0, 2024-09-12T02:49:35.429 INFO:teuthology.orchestra.run.smithi172.stdout: "op_pg": 0, 2024-09-12T02:49:35.429 INFO:teuthology.orchestra.run.smithi172.stdout: "osdop_stat": 1563, 2024-09-12T02:49:35.429 INFO:teuthology.orchestra.run.smithi172.stdout: "osdop_create": 0, 2024-09-12T02:49:35.429 INFO:teuthology.orchestra.run.smithi172.stdout: "osdop_read": 831, 2024-09-12T02:49:35.429 INFO:teuthology.orchestra.run.smithi172.stdout: "osdop_write": 0, 2024-09-12T02:49:35.429 INFO:teuthology.orchestra.run.smithi172.stdout: "osdop_writefull": 0, 2024-09-12T02:49:35.429 INFO:teuthology.orchestra.run.smithi172.stdout: "osdop_writesame": 0, 2024-09-12T02:49:35.429 INFO:teuthology.orchestra.run.smithi172.stdout: "osdop_append": 0, 2024-09-12T02:49:35.430 INFO:teuthology.orchestra.run.smithi172.stdout: "osdop_zero": 0, 2024-09-12T02:49:35.430 INFO:teuthology.orchestra.run.smithi172.stdout: "osdop_truncate": 0, 2024-09-12T02:49:35.430 INFO:teuthology.orchestra.run.smithi172.stdout: "osdop_delete": 0, 2024-09-12T02:49:35.430 INFO:teuthology.orchestra.run.smithi172.stdout: "osdop_mapext": 0, 2024-09-12T02:49:35.430 INFO:teuthology.orchestra.run.smithi172.stdout: "osdop_sparse_read": 0, 2024-09-12T02:49:35.430 INFO:teuthology.orchestra.run.smithi172.stdout: "osdop_clonerange": 0, 2024-09-12T02:49:35.430 INFO:teuthology.orchestra.run.smithi172.stdout: "osdop_getxattr": 1, 2024-09-12T02:49:35.430 INFO:teuthology.orchestra.run.smithi172.stdout: "osdop_setxattr": 0, 2024-09-12T02:49:35.430 INFO:teuthology.orchestra.run.smithi172.stdout: "osdop_cmpxattr": 0, 2024-09-12T02:49:35.430 INFO:teuthology.orchestra.run.smithi172.stdout: "osdop_rmxattr": 0, 2024-09-12T02:49:35.430 INFO:teuthology.orchestra.run.smithi172.stdout: "osdop_resetxattrs": 0, 2024-09-12T02:49:35.430 INFO:teuthology.orchestra.run.smithi172.stdout: "osdop_call": 0, 2024-09-12T02:49:35.430 INFO:teuthology.orchestra.run.smithi172.stdout: "osdop_watch": 0, 2024-09-12T02:49:35.431 INFO:teuthology.orchestra.run.smithi172.stdout: "osdop_notify": 0, 2024-09-12T02:49:35.431 INFO:teuthology.orchestra.run.smithi172.stdout: "osdop_src_cmpxattr": 0, 2024-09-12T02:49:35.431 INFO:teuthology.orchestra.run.smithi172.stdout: "osdop_pgls": 0, 2024-09-12T02:49:35.431 INFO:teuthology.orchestra.run.smithi172.stdout: "osdop_pgls_filter": 0, 2024-09-12T02:49:35.431 INFO:teuthology.orchestra.run.smithi172.stdout: "osdop_other": 0, 2024-09-12T02:49:35.431 INFO:teuthology.orchestra.run.smithi172.stdout: "linger_active": 0, 2024-09-12T02:49:35.431 INFO:teuthology.orchestra.run.smithi172.stdout: "linger_send": 0, 2024-09-12T02:49:35.431 INFO:teuthology.orchestra.run.smithi172.stdout: "linger_resend": 0, 2024-09-12T02:49:35.431 INFO:teuthology.orchestra.run.smithi172.stdout: "linger_ping": 0, 2024-09-12T02:49:35.431 INFO:teuthology.orchestra.run.smithi172.stdout: "poolop_active": 0, 2024-09-12T02:49:35.431 INFO:teuthology.orchestra.run.smithi172.stdout: "poolop_send": 0, 2024-09-12T02:49:35.431 INFO:teuthology.orchestra.run.smithi172.stdout: "poolop_resend": 0, 2024-09-12T02:49:35.432 INFO:teuthology.orchestra.run.smithi172.stdout: "poolstat_active": 0, 2024-09-12T02:49:35.432 INFO:teuthology.orchestra.run.smithi172.stdout: "poolstat_send": 0, 2024-09-12T02:49:35.432 INFO:teuthology.orchestra.run.smithi172.stdout: "poolstat_resend": 0, 2024-09-12T02:49:35.432 INFO:teuthology.orchestra.run.smithi172.stdout: "statfs_active": 0, 2024-09-12T02:49:35.432 INFO:teuthology.orchestra.run.smithi172.stdout: "statfs_send": 0, 2024-09-12T02:49:35.432 INFO:teuthology.orchestra.run.smithi172.stdout: "statfs_resend": 0, 2024-09-12T02:49:35.432 INFO:teuthology.orchestra.run.smithi172.stdout: "command_active": 0, 2024-09-12T02:49:35.432 INFO:teuthology.orchestra.run.smithi172.stdout: "command_send": 0, 2024-09-12T02:49:35.432 INFO:teuthology.orchestra.run.smithi172.stdout: "command_resend": 0, 2024-09-12T02:49:35.432 INFO:teuthology.orchestra.run.smithi172.stdout: "map_epoch": 108, 2024-09-12T02:49:35.432 INFO:teuthology.orchestra.run.smithi172.stdout: "map_full": 0, 2024-09-12T02:49:35.432 INFO:teuthology.orchestra.run.smithi172.stdout: "map_inc": 15, 2024-09-12T02:49:35.432 INFO:teuthology.orchestra.run.smithi172.stdout: "osd_sessions": 6, 2024-09-12T02:49:35.433 INFO:teuthology.orchestra.run.smithi172.stdout: "osd_session_open": 6, 2024-09-12T02:49:35.433 INFO:teuthology.orchestra.run.smithi172.stdout: "osd_session_close": 0, 2024-09-12T02:49:35.433 INFO:teuthology.orchestra.run.smithi172.stdout: "osd_laggy": 0, 2024-09-12T02:49:35.433 INFO:teuthology.orchestra.run.smithi172.stdout: "omap_wr": 0, 2024-09-12T02:49:35.433 INFO:teuthology.orchestra.run.smithi172.stdout: "omap_rd": 2, 2024-09-12T02:49:35.433 INFO:teuthology.orchestra.run.smithi172.stdout: "omap_del": 0 2024-09-12T02:49:35.433 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-09-12T02:49:35.433 INFO:teuthology.orchestra.run.smithi172.stdout: "oft": { 2024-09-12T02:49:35.433 INFO:teuthology.orchestra.run.smithi172.stdout: "omap_total_objs": 0, 2024-09-12T02:49:35.433 INFO:teuthology.orchestra.run.smithi172.stdout: "omap_total_kv_pairs": 0, 2024-09-12T02:49:35.433 INFO:teuthology.orchestra.run.smithi172.stdout: "omap_total_updates": 0, 2024-09-12T02:49:35.433 INFO:teuthology.orchestra.run.smithi172.stdout: "omap_total_removes": 0 2024-09-12T02:49:35.433 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-09-12T02:49:35.434 INFO:teuthology.orchestra.run.smithi172.stdout: "osd-slow-ops": { 2024-09-12T02:49:35.434 INFO:teuthology.orchestra.run.smithi172.stdout: "slow_ops_count": 0 2024-09-12T02:49:35.434 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-09-12T02:49:35.434 INFO:teuthology.orchestra.run.smithi172.stdout: "purge_queue": { 2024-09-12T02:49:35.434 INFO:teuthology.orchestra.run.smithi172.stdout: "pq_executing_ops": 0, 2024-09-12T02:49:35.434 INFO:teuthology.orchestra.run.smithi172.stdout: "pq_executing_ops_high_water": 0, 2024-09-12T02:49:35.434 INFO:teuthology.orchestra.run.smithi172.stdout: "pq_executing": 0, 2024-09-12T02:49:35.434 INFO:teuthology.orchestra.run.smithi172.stdout: "pq_executing_high_water": 0, 2024-09-12T02:49:35.434 INFO:teuthology.orchestra.run.smithi172.stdout: "pq_executed_ops": 0, 2024-09-12T02:49:35.434 INFO:teuthology.orchestra.run.smithi172.stdout: "pq_executed": 0, 2024-09-12T02:49:35.434 INFO:teuthology.orchestra.run.smithi172.stdout: "pq_item_in_journal": 0 2024-09-12T02:49:35.434 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-09-12T02:49:35.434 INFO:teuthology.orchestra.run.smithi172.stdout: "throttle-msgr_dispatch_throttler-mds": { 2024-09-12T02:49:35.435 INFO:teuthology.orchestra.run.smithi172.stdout: "val": 0, 2024-09-12T02:49:35.435 INFO:teuthology.orchestra.run.smithi172.stdout: "max": 104857600, 2024-09-12T02:49:35.435 INFO:teuthology.orchestra.run.smithi172.stdout: "get_started": 0, 2024-09-12T02:49:35.435 INFO:teuthology.orchestra.run.smithi172.stdout: "get": 2678, 2024-09-12T02:49:35.435 INFO:teuthology.orchestra.run.smithi172.stdout: "get_sum": 2195820, 2024-09-12T02:49:35.435 INFO:teuthology.orchestra.run.smithi172.stdout: "get_or_fail_fail": 0, 2024-09-12T02:49:35.435 INFO:teuthology.orchestra.run.smithi172.stdout: "get_or_fail_success": 2678, 2024-09-12T02:49:35.435 INFO:teuthology.orchestra.run.smithi172.stdout: "take": 0, 2024-09-12T02:49:35.435 INFO:teuthology.orchestra.run.smithi172.stdout: "take_sum": 0, 2024-09-12T02:49:35.435 INFO:teuthology.orchestra.run.smithi172.stdout: "put": 2678, 2024-09-12T02:49:35.435 INFO:teuthology.orchestra.run.smithi172.stdout: "put_sum": 2195820, 2024-09-12T02:49:35.435 INFO:teuthology.orchestra.run.smithi172.stdout: "wait": { 2024-09-12T02:49:35.435 INFO:teuthology.orchestra.run.smithi172.stdout: "avgcount": 0, 2024-09-12T02:49:35.435 INFO:teuthology.orchestra.run.smithi172.stdout: "sum": 0.000000000, 2024-09-12T02:49:35.436 INFO:teuthology.orchestra.run.smithi172.stdout: "avgtime": 0.000000000 2024-09-12T02:49:35.436 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-09-12T02:49:35.436 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-09-12T02:49:35.436 INFO:teuthology.orchestra.run.smithi172.stdout: "throttle-objecter_bytes": { 2024-09-12T02:49:35.436 INFO:teuthology.orchestra.run.smithi172.stdout: "val": 0, 2024-09-12T02:49:35.436 INFO:teuthology.orchestra.run.smithi172.stdout: "max": 104857600, 2024-09-12T02:49:35.436 INFO:teuthology.orchestra.run.smithi172.stdout: "get_started": 0, 2024-09-12T02:49:35.436 INFO:teuthology.orchestra.run.smithi172.stdout: "get": 0, 2024-09-12T02:49:35.436 INFO:teuthology.orchestra.run.smithi172.stdout: "get_sum": 0, 2024-09-12T02:49:35.436 INFO:teuthology.orchestra.run.smithi172.stdout: "get_or_fail_fail": 0, 2024-09-12T02:49:35.436 INFO:teuthology.orchestra.run.smithi172.stdout: "get_or_fail_success": 0, 2024-09-12T02:49:35.436 INFO:teuthology.orchestra.run.smithi172.stdout: "take": 2396, 2024-09-12T02:49:35.436 INFO:teuthology.orchestra.run.smithi172.stdout: "take_sum": 1831, 2024-09-12T02:49:35.437 INFO:teuthology.orchestra.run.smithi172.stdout: "put": 2396, 2024-09-12T02:49:35.437 INFO:teuthology.orchestra.run.smithi172.stdout: "put_sum": 1831, 2024-09-12T02:49:35.437 INFO:teuthology.orchestra.run.smithi172.stdout: "wait": { 2024-09-12T02:49:35.437 INFO:teuthology.orchestra.run.smithi172.stdout: "avgcount": 0, 2024-09-12T02:49:35.437 INFO:teuthology.orchestra.run.smithi172.stdout: "sum": 0.000000000, 2024-09-12T02:49:35.437 INFO:teuthology.orchestra.run.smithi172.stdout: "avgtime": 0.000000000 2024-09-12T02:49:35.437 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-09-12T02:49:35.437 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-09-12T02:49:35.437 INFO:teuthology.orchestra.run.smithi172.stdout: "throttle-objecter_ops": { 2024-09-12T02:49:35.437 INFO:teuthology.orchestra.run.smithi172.stdout: "val": 0, 2024-09-12T02:49:35.437 INFO:teuthology.orchestra.run.smithi172.stdout: "max": 1024, 2024-09-12T02:49:35.437 INFO:teuthology.orchestra.run.smithi172.stdout: "get_started": 0, 2024-09-12T02:49:35.437 INFO:teuthology.orchestra.run.smithi172.stdout: "get": 0, 2024-09-12T02:49:35.438 INFO:teuthology.orchestra.run.smithi172.stdout: "get_sum": 0, 2024-09-12T02:49:35.438 INFO:teuthology.orchestra.run.smithi172.stdout: "get_or_fail_fail": 0, 2024-09-12T02:49:35.438 INFO:teuthology.orchestra.run.smithi172.stdout: "get_or_fail_success": 0, 2024-09-12T02:49:35.438 INFO:teuthology.orchestra.run.smithi172.stdout: "take": 2396, 2024-09-12T02:49:35.438 INFO:teuthology.orchestra.run.smithi172.stdout: "take_sum": 2396, 2024-09-12T02:49:35.438 INFO:teuthology.orchestra.run.smithi172.stdout: "put": 2396, 2024-09-12T02:49:35.438 INFO:teuthology.orchestra.run.smithi172.stdout: "put_sum": 2396, 2024-09-12T02:49:35.438 INFO:teuthology.orchestra.run.smithi172.stdout: "wait": { 2024-09-12T02:49:35.438 INFO:teuthology.orchestra.run.smithi172.stdout: "avgcount": 0, 2024-09-12T02:49:35.438 INFO:teuthology.orchestra.run.smithi172.stdout: "sum": 0.000000000, 2024-09-12T02:49:35.438 INFO:teuthology.orchestra.run.smithi172.stdout: "avgtime": 0.000000000 2024-09-12T02:49:35.438 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-09-12T02:49:35.438 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-09-12T02:49:35.438 INFO:teuthology.orchestra.run.smithi172.stdout: "throttle-write_buf_throttle": { 2024-09-12T02:49:35.439 INFO:teuthology.orchestra.run.smithi172.stdout: "val": 0, 2024-09-12T02:49:35.439 INFO:teuthology.orchestra.run.smithi172.stdout: "max": 3758096384, 2024-09-12T02:49:35.439 INFO:teuthology.orchestra.run.smithi172.stdout: "get_started": 0, 2024-09-12T02:49:35.439 INFO:teuthology.orchestra.run.smithi172.stdout: "get": 0, 2024-09-12T02:49:35.439 INFO:teuthology.orchestra.run.smithi172.stdout: "get_sum": 0, 2024-09-12T02:49:35.439 INFO:teuthology.orchestra.run.smithi172.stdout: "get_or_fail_fail": 0, 2024-09-12T02:49:35.439 INFO:teuthology.orchestra.run.smithi172.stdout: "get_or_fail_success": 0, 2024-09-12T02:49:35.439 INFO:teuthology.orchestra.run.smithi172.stdout: "take": 0, 2024-09-12T02:49:35.439 INFO:teuthology.orchestra.run.smithi172.stdout: "take_sum": 0, 2024-09-12T02:49:35.439 INFO:teuthology.orchestra.run.smithi172.stdout: "put": 0, 2024-09-12T02:49:35.439 INFO:teuthology.orchestra.run.smithi172.stdout: "put_sum": 0, 2024-09-12T02:49:35.439 INFO:teuthology.orchestra.run.smithi172.stdout: "wait": { 2024-09-12T02:49:35.439 INFO:teuthology.orchestra.run.smithi172.stdout: "avgcount": 0, 2024-09-12T02:49:35.439 INFO:teuthology.orchestra.run.smithi172.stdout: "sum": 0.000000000, 2024-09-12T02:49:35.440 INFO:teuthology.orchestra.run.smithi172.stdout: "avgtime": 0.000000000 2024-09-12T02:49:35.440 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-09-12T02:49:35.440 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-09-12T02:49:35.440 INFO:teuthology.orchestra.run.smithi172.stdout: "throttle-write_buf_throttle-0x55980656cb40": { 2024-09-12T02:49:35.440 INFO:teuthology.orchestra.run.smithi172.stdout: "val": 0, 2024-09-12T02:49:35.440 INFO:teuthology.orchestra.run.smithi172.stdout: "max": 3758096384, 2024-09-12T02:49:35.440 INFO:teuthology.orchestra.run.smithi172.stdout: "get_started": 0, 2024-09-12T02:49:35.440 INFO:teuthology.orchestra.run.smithi172.stdout: "get": 0, 2024-09-12T02:49:35.440 INFO:teuthology.orchestra.run.smithi172.stdout: "get_sum": 0, 2024-09-12T02:49:35.440 INFO:teuthology.orchestra.run.smithi172.stdout: "get_or_fail_fail": 0, 2024-09-12T02:49:35.440 INFO:teuthology.orchestra.run.smithi172.stdout: "get_or_fail_success": 0, 2024-09-12T02:49:35.440 INFO:teuthology.orchestra.run.smithi172.stdout: "take": 0, 2024-09-12T02:49:35.440 INFO:teuthology.orchestra.run.smithi172.stdout: "take_sum": 0, 2024-09-12T02:49:35.440 INFO:teuthology.orchestra.run.smithi172.stdout: "put": 0, 2024-09-12T02:49:35.441 INFO:teuthology.orchestra.run.smithi172.stdout: "put_sum": 0, 2024-09-12T02:49:35.441 INFO:teuthology.orchestra.run.smithi172.stdout: "wait": { 2024-09-12T02:49:35.441 INFO:teuthology.orchestra.run.smithi172.stdout: "avgcount": 0, 2024-09-12T02:49:35.441 INFO:teuthology.orchestra.run.smithi172.stdout: "sum": 0.000000000, 2024-09-12T02:49:35.441 INFO:teuthology.orchestra.run.smithi172.stdout: "avgtime": 0.000000000 2024-09-12T02:49:35.441 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-09-12T02:49:35.441 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-09-12T02:49:35.441 INFO:teuthology.orchestra.run.smithi172.stdout:} 2024-09-12T02:49:36.013 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 12 02:49:35 smithi172 ceph-mon[35609]: pgmap v364: 129 pgs: 129 active+clean; 24 MiB data, 494 MiB used, 1.0 TiB / 1.0 TiB avail; 5.7 KiB/s rd, 1.7 KiB/s wr, 8 op/s 2024-09-12T02:49:36.099 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 02:49:35 smithi039 ceph-mon[30515]: pgmap v364: 129 pgs: 129 active+clean; 24 MiB data, 494 MiB used, 1.0 TiB / 1.0 TiB avail; 5.7 KiB/s rd, 1.7 KiB/s wr, 8 op/s 2024-09-12T02:49:36.198 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 12 02:49:35 smithi044 ceph-mon[35411]: pgmap v364: 129 pgs: 129 active+clean; 24 MiB data, 494 MiB used, 1.0 TiB / 1.0 TiB avail; 5.7 KiB/s rd, 1.7 KiB/s wr, 8 op/s 2024-09-12T02:49:36.361 INFO:tasks.check_counter:Daemon mds.l mds.exported=0 2024-09-12T02:49:36.361 INFO:tasks.check_counter:Daemon mds.l mds.imported=0 2024-09-12T02:49:36.361 INFO:tasks.check_counter:Daemon mds.l mds_cache.dir_update=0 2024-09-12T02:49:36.361 INFO:tasks.check_counter:Daemon mds.l mds_cache.dir_update_receipt=0 2024-09-12T02:49:36.361 INFO:tasks.check_counter:Daemon mds.l mds.root_rsnaps=0 2024-09-12T02:49:36.361 INFO:tasks.check_counter:Daemon mds.l mds_server.req_mksnap_latency.avgcount=0 2024-09-12T02:49:36.361 INFO:tasks.check_counter:Daemon mds.l mds_server.req_rmsnap_latency.avgcount=0 2024-09-12T02:49:36.361 DEBUG:teuthology.run_tasks:Unwinding manager kclient 2024-09-12T02:49:36.372 INFO:tasks.kclient:Unmounting kernel clients... 2024-09-12T02:49:36.372 DEBUG:teuthology.orchestra.run.smithi039:> set -ex 2024-09-12T02:49:36.372 DEBUG:teuthology.orchestra.run.smithi039:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-12T02:49:36.415 DEBUG:teuthology.orchestra.run.smithi039:> set -ex 2024-09-12T02:49:36.415 DEBUG:teuthology.orchestra.run.smithi039:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-12T02:49:36.496 DEBUG:teuthology.orchestra.run.smithi039:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc shell --fsid 4954ed46-70ae-11ef-bcea-c7b262605968 -- ceph osd blocklist ls 2024-09-12T02:49:36.928 INFO:teuthology.orchestra.run.smithi039.stderr:Inferring config /var/lib/ceph/4954ed46-70ae-11ef-bcea-c7b262605968/mon.a/config 2024-09-12T02:49:37.685 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:49:37.683+0000 7fef5f800640 1 -- 172.21.15.39:0/915730095 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fef58109140 msgr2=0x7fef58110cc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:49:37.685 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:49:37.683+0000 7fef5f800640 1 --2- 172.21.15.39:0/915730095 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fef58109140 0x7fef58110cc0 secure :-1 s=READY pgs=304 cs=0 l=1 rev1=1 crypto rx=0x7fef50009ca0 tx=0x7fef5002a8c0 comp rx=0 tx=0).stop 2024-09-12T02:49:37.685 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:49:37.684+0000 7fef5f800640 1 -- 172.21.15.39:0/915730095 shutdown_connections 2024-09-12T02:49:37.685 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:49:37.684+0000 7fef5f800640 1 --2- 172.21.15.39:0/915730095 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fef58109140 0x7fef58110cc0 unknown :-1 s=CLOSED pgs=304 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:49:37.685 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:49:37.684+0000 7fef5f800640 1 --2- 172.21.15.39:0/915730095 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fef581049c0 0x7fef58108a10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:49:37.686 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:49:37.684+0000 7fef5f800640 1 --2- 172.21.15.39:0/915730095 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fef58104010 0x7fef581043f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:49:37.686 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:49:37.684+0000 7fef5f800640 1 -- 172.21.15.39:0/915730095 >> 172.21.15.39:0/915730095 conn(0x7fef580ffa50 msgr2=0x7fef58101e70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:49:37.686 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:49:37.684+0000 7fef5f800640 1 -- 172.21.15.39:0/915730095 shutdown_connections 2024-09-12T02:49:37.686 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:49:37.684+0000 7fef5f800640 1 -- 172.21.15.39:0/915730095 wait complete. 2024-09-12T02:49:37.686 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:49:37.685+0000 7fef5f800640 1 Processor -- start 2024-09-12T02:49:37.686 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:49:37.685+0000 7fef5f800640 1 -- start start 2024-09-12T02:49:37.687 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:49:37.686+0000 7fef5f800640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fef58104010 0x7fef5819a6e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:49:37.687 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:49:37.686+0000 7fef5f800640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fef581049c0 0x7fef5819ac20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:49:37.687 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:49:37.686+0000 7fef5f800640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fef58109140 0x7fef5819efb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:49:37.687 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:49:37.686+0000 7fef5f800640 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 -- 0x7fef581141c0 con 0x7fef581049c0 2024-09-12T02:49:37.687 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:49:37.686+0000 7fef5f800640 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x7fef58114040 con 0x7fef58109140 2024-09-12T02:49:37.687 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:49:37.686+0000 7fef5f800640 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7fef58114340 con 0x7fef58104010 2024-09-12T02:49:37.687 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:49:37.686+0000 7fef5ce00640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fef58104010 0x7fef5819a6e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:49:37.687 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:49:37.686+0000 7fef5ce00640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fef58104010 0x7fef5819a6e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.172:3300/0 says I am v2:172.21.15.39:45748/0 (socket says 172.21.15.39:45748) 2024-09-12T02:49:37.688 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:49:37.686+0000 7fef5ce00640 1 -- 172.21.15.39:0/3646720958 learned_addr learned my addr 172.21.15.39:0/3646720958 (peer_addr_for_me v2:172.21.15.39:0/0) 2024-09-12T02:49:37.688 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:49:37.686+0000 7fef57e00640 1 --2- 172.21.15.39:0/3646720958 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fef581049c0 0x7fef5819ac20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:49:37.688 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:49:37.686+0000 7fef5d800640 1 --2- 172.21.15.39:0/3646720958 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fef58109140 0x7fef5819efb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:49:37.688 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:49:37.687+0000 7fef5ce00640 1 -- 172.21.15.39:0/3646720958 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fef58109140 msgr2=0x7fef5819efb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:49:37.689 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:49:37.687+0000 7fef5ce00640 1 --2- 172.21.15.39:0/3646720958 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fef58109140 0x7fef5819efb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:49:37.689 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:49:37.687+0000 7fef5ce00640 1 -- 172.21.15.39:0/3646720958 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fef581049c0 msgr2=0x7fef5819ac20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:49:37.689 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:49:37.687+0000 7fef5ce00640 1 --2- 172.21.15.39:0/3646720958 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fef581049c0 0x7fef5819ac20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:49:37.689 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:49:37.687+0000 7fef5ce00640 1 -- 172.21.15.39:0/3646720958 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fef5819f690 con 0x7fef58104010 2024-09-12T02:49:37.689 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:49:37.687+0000 7fef5d800640 1 --2- 172.21.15.39:0/3646720958 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fef58109140 0x7fef5819efb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-12T02:49:37.689 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:49:37.687+0000 7fef5ce00640 1 --2- 172.21.15.39:0/3646720958 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fef58104010 0x7fef5819a6e0 secure :-1 s=READY pgs=124 cs=0 l=1 rev1=1 crypto rx=0x7fef4c00e9f0 tx=0x7fef4c00edf0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:49:37.689 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:49:37.688+0000 7fef55600640 1 -- 172.21.15.39:0/3646720958 <== mon.1 v2:172.21.15.172:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fef4c00cd80 con 0x7fef58104010 2024-09-12T02:49:37.689 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:49:37.688+0000 7fef55600640 1 -- 172.21.15.39:0/3646720958 <== mon.1 v2:172.21.15.172:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fef4c005500 con 0x7fef58104010 2024-09-12T02:49:37.689 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:49:37.688+0000 7fef5f800640 1 -- 172.21.15.39:0/3646720958 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fef5819f980 con 0x7fef58104010 2024-09-12T02:49:37.689 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:49:37.688+0000 7fef55600640 1 -- 172.21.15.39:0/3646720958 <== mon.1 v2:172.21.15.172:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fef4c010690 con 0x7fef58104010 2024-09-12T02:49:37.689 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:49:37.688+0000 7fef5f800640 1 -- 172.21.15.39:0/3646720958 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fef581a7260 con 0x7fef58104010 2024-09-12T02:49:37.690 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:49:37.689+0000 7fef5f800640 1 -- 172.21.15.39:0/3646720958 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fef581043f0 con 0x7fef58104010 2024-09-12T02:49:37.693 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:49:37.692+0000 7fef55600640 1 -- 172.21.15.39:0/3646720958 <== mon.1 v2:172.21.15.172:3300/0 4 ==== mgrmap(e 27) ==== 137964+0+0 (secure 0 0 0) 0x7fef4c0046c0 con 0x7fef58104010 2024-09-12T02:49:37.696 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:49:37.694+0000 7fef55600640 1 --2- 172.21.15.39:0/3646720958 >> [v2:172.21.15.39:6800/2187509357,v1:172.21.15.39:6801/2187509357] conn(0x7fef400a2d70 0x7fef400a5230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:49:37.696 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:49:37.694+0000 7fef55600640 1 -- 172.21.15.39:0/3646720958 <== mon.1 v2:172.21.15.172:3300/0 5 ==== osd_map(108..108 src has 1..108) ==== 9475+0+0 (secure 0 0 0) 0x7fef4c0cfb90 con 0x7fef58104010 2024-09-12T02:49:37.696 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:49:37.694+0000 7fef57e00640 1 --2- 172.21.15.39:0/3646720958 >> [v2:172.21.15.39:6800/2187509357,v1:172.21.15.39:6801/2187509357] conn(0x7fef400a2d70 0x7fef400a5230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:49:37.696 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:49:37.695+0000 7fef57e00640 1 --2- 172.21.15.39:0/3646720958 >> [v2:172.21.15.39:6800/2187509357,v1:172.21.15.39:6801/2187509357] conn(0x7fef400a2d70 0x7fef400a5230 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7fef5810aab0 tx=0x7fef44005f90 comp rx=0 tx=0).ready entity=mgr.25199 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:49:37.698 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:49:37.698+0000 7fef55600640 1 -- 172.21.15.39:0/3646720958 <== mon.1 v2:172.21.15.172:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7fef4c09c3f0 con 0x7fef58104010 2024-09-12T02:49:37.899 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:49:37.898+0000 7fef5f800640 1 -- 172.21.15.39:0/3646720958 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) -- 0x7fef5819ba40 con 0x7fef58104010 2024-09-12T02:49:37.899 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:49:37.899+0000 7fef55600640 1 -- 172.21.15.39:0/3646720958 <== mon.1 v2:172.21.15.172:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 16 entries v108) ==== 81+0+945 (secure 0 0 0) 0x7fef4c09bcf0 con 0x7fef58104010 2024-09-12T02:49:37.900 INFO:teuthology.orchestra.run.smithi039.stdout:172.21.15.39:0/684883181 2024-09-13T02:37:55.928405+0000 2024-09-12T02:49:37.900 INFO:teuthology.orchestra.run.smithi039.stdout:172.21.15.39:6801/1725006999 2024-09-13T02:37:55.928405+0000 2024-09-12T02:49:37.900 INFO:teuthology.orchestra.run.smithi039.stdout:172.21.15.39:6800/1074685700 2024-09-13T02:27:16.531986+0000 2024-09-12T02:49:37.900 INFO:teuthology.orchestra.run.smithi039.stdout:172.21.15.39:6801/3152613618 2024-09-13T02:27:44.717224+0000 2024-09-12T02:49:37.900 INFO:teuthology.orchestra.run.smithi039.stdout:172.21.15.39:0/1147479345 2024-09-13T02:37:55.928405+0000 2024-09-12T02:49:37.900 INFO:teuthology.orchestra.run.smithi039.stdout:172.21.15.39:6801/1074685700 2024-09-13T02:27:16.531986+0000 2024-09-12T02:49:37.900 INFO:teuthology.orchestra.run.smithi039.stdout:172.21.15.39:6800/1725006999 2024-09-13T02:37:55.928405+0000 2024-09-12T02:49:37.900 INFO:teuthology.orchestra.run.smithi039.stdout:172.21.15.39:0/4167553412 2024-09-13T02:37:55.928405+0000 2024-09-12T02:49:37.900 INFO:teuthology.orchestra.run.smithi039.stdout:172.21.15.39:0/4075322467 2024-09-13T02:27:16.531986+0000 2024-09-12T02:49:37.900 INFO:teuthology.orchestra.run.smithi039.stdout:172.21.15.39:0/2827440002 2024-09-13T02:27:16.531986+0000 2024-09-12T02:49:37.900 INFO:teuthology.orchestra.run.smithi039.stdout:172.21.15.39:0/2913347539 2024-09-13T02:27:16.531986+0000 2024-09-12T02:49:37.901 INFO:teuthology.orchestra.run.smithi039.stdout:172.21.15.39:0/1527429435 2024-09-13T02:27:44.717224+0000 2024-09-12T02:49:37.901 INFO:teuthology.orchestra.run.smithi039.stdout:172.21.15.39:0/1941318538 2024-09-13T02:27:44.717224+0000 2024-09-12T02:49:37.901 INFO:teuthology.orchestra.run.smithi039.stdout:172.21.15.39:0/2301206766 2024-09-13T02:27:44.717224+0000 2024-09-12T02:49:37.901 INFO:teuthology.orchestra.run.smithi039.stdout:172.21.15.39:6800/3152613618 2024-09-13T02:27:44.717224+0000 2024-09-12T02:49:37.901 INFO:teuthology.orchestra.run.smithi039.stdout:172.21.15.39:0/4180631617 2024-09-13T02:37:55.928405+0000 2024-09-12T02:49:37.901 INFO:teuthology.orchestra.run.smithi039.stderr:listed 16 entries 2024-09-12T02:49:37.902 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:49:37.901+0000 7fef5f800640 1 -- 172.21.15.39:0/3646720958 >> [v2:172.21.15.39:6800/2187509357,v1:172.21.15.39:6801/2187509357] conn(0x7fef400a2d70 msgr2=0x7fef400a5230 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:49:37.902 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:49:37.901+0000 7fef5f800640 1 --2- 172.21.15.39:0/3646720958 >> [v2:172.21.15.39:6800/2187509357,v1:172.21.15.39:6801/2187509357] conn(0x7fef400a2d70 0x7fef400a5230 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7fef5810aab0 tx=0x7fef44005f90 comp rx=0 tx=0).stop 2024-09-12T02:49:37.902 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:49:37.901+0000 7fef5f800640 1 -- 172.21.15.39:0/3646720958 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fef58104010 msgr2=0x7fef5819a6e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:49:37.902 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:49:37.901+0000 7fef5f800640 1 --2- 172.21.15.39:0/3646720958 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fef58104010 0x7fef5819a6e0 secure :-1 s=READY pgs=124 cs=0 l=1 rev1=1 crypto rx=0x7fef4c00e9f0 tx=0x7fef4c00edf0 comp rx=0 tx=0).stop 2024-09-12T02:49:37.902 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:49:37.901+0000 7fef5f800640 1 -- 172.21.15.39:0/3646720958 shutdown_connections 2024-09-12T02:49:37.902 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:49:37.901+0000 7fef5f800640 1 --2- 172.21.15.39:0/3646720958 >> [v2:172.21.15.39:6800/2187509357,v1:172.21.15.39:6801/2187509357] conn(0x7fef400a2d70 0x7fef400a5230 unknown :-1 s=CLOSED pgs=52 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:49:37.903 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:49:37.901+0000 7fef5f800640 1 --2- 172.21.15.39:0/3646720958 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fef58109140 0x7fef5819efb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:49:37.903 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:49:37.901+0000 7fef5f800640 1 --2- 172.21.15.39:0/3646720958 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fef581049c0 0x7fef5819ac20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:49:37.903 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:49:37.901+0000 7fef5f800640 1 --2- 172.21.15.39:0/3646720958 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fef58104010 0x7fef5819a6e0 unknown :-1 s=CLOSED pgs=124 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:49:37.903 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:49:37.901+0000 7fef5f800640 1 -- 172.21.15.39:0/3646720958 >> 172.21.15.39:0/3646720958 conn(0x7fef580ffa50 msgr2=0x7fef58100d60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:49:37.903 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:49:37.901+0000 7fef5f800640 1 -- 172.21.15.39:0/3646720958 shutdown_connections 2024-09-12T02:49:37.903 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:49:37.901+0000 7fef5f800640 1 -- 172.21.15.39:0/3646720958 wait complete. 2024-09-12T02:49:38.013 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 12 02:49:37 smithi172 ceph-mon[35609]: pgmap v365: 129 pgs: 129 active+clean; 24 MiB data, 494 MiB used, 1.0 TiB / 1.0 TiB avail; 5.7 KiB/s rd, 1.7 KiB/s wr, 8 op/s 2024-09-12T02:49:38.022 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 02:49:37 smithi039 ceph-mon[30515]: pgmap v365: 129 pgs: 129 active+clean; 24 MiB data, 494 MiB used, 1.0 TiB / 1.0 TiB avail; 5.7 KiB/s rd, 1.7 KiB/s wr, 8 op/s 2024-09-12T02:49:38.198 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 12 02:49:37 smithi044 ceph-mon[35411]: pgmap v365: 129 pgs: 129 active+clean; 24 MiB data, 494 MiB used, 1.0 TiB / 1.0 TiB avail; 5.7 KiB/s rd, 1.7 KiB/s wr, 8 op/s 2024-09-12T02:49:38.684 DEBUG:tasks.cephfs.kernel_mount:Unmounting client client.0... 2024-09-12T02:49:38.685 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-12T02:49:38.685 DEBUG:teuthology.orchestra.run.smithi039:> sudo umount /home/ubuntu/cephtest/mnt.0 2024-09-12T02:49:38.771 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi039.front.sepia.ceph.com 2024-09-12T02:49:38.771 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-12T02:49:38.771 DEBUG:teuthology.orchestra.run.smithi039:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.0) 2024-09-12T02:49:38.826 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-12T02:49:38.827 DEBUG:teuthology.orchestra.run.smithi039:> ip netns list 2024-09-12T02:49:38.862 INFO:teuthology.orchestra.run.smithi039.stdout:ceph-ns--home-ubuntu-cephtest-mnt.0 (id: 0) 2024-09-12T02:49:38.863 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-12T02:49:38.863 DEBUG:teuthology.orchestra.run.smithi039:> sudo ip netns delete ceph-ns--home-ubuntu-cephtest-mnt.0 2024-09-12T02:49:38.935 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 02:49:38 smithi039 ceph-mon[30515]: from='client.? 172.21.15.39:0/3646720958' entity='client.admin' cmd=[{"prefix": "osd blocklist ls"}]: dispatch 2024-09-12T02:49:38.962 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-12T02:49:38.962 DEBUG:teuthology.orchestra.run.smithi039:> sudo ip link delete ceph-brx 2024-09-12T02:49:39.198 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 12 02:49:38 smithi044 ceph-mon[35411]: from='client.? 172.21.15.39:0/3646720958' entity='client.admin' cmd=[{"prefix": "osd blocklist ls"}]: dispatch 2024-09-12T02:49:39.263 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 12 02:49:38 smithi172 ceph-mon[35609]: from='client.? 172.21.15.39:0/3646720958' entity='client.admin' cmd=[{"prefix": "osd blocklist ls"}]: dispatch 2024-09-12T02:49:39.312 DEBUG:teuthology.run_tasks:Unwinding manager cephadm 2024-09-12T02:49:39.322 INFO:tasks.cephadm:Teardown begin 2024-09-12T02:49:39.322 INFO:tasks.cephfs.filesystem:Destroying file system cephfs and related pools 2024-09-12T02:49:39.323 DEBUG:teuthology.orchestra.run.smithi039:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc shell --fsid 4954ed46-70ae-11ef-bcea-c7b262605968 -- ceph fs dump --format=json 2024-09-12T02:49:39.709 INFO:teuthology.orchestra.run.smithi039.stderr:Inferring config /var/lib/ceph/4954ed46-70ae-11ef-bcea-c7b262605968/mon.a/config 2024-09-12T02:49:40.032 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 02:49:39 smithi039 ceph-mon[30515]: pgmap v366: 129 pgs: 129 active+clean; 24 MiB data, 494 MiB used, 1.0 TiB / 1.0 TiB avail; 8.7 KiB/s rd, 2.7 KiB/s wr, 13 op/s 2024-09-12T02:49:40.198 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 12 02:49:39 smithi044 ceph-mon[35411]: pgmap v366: 129 pgs: 129 active+clean; 24 MiB data, 494 MiB used, 1.0 TiB / 1.0 TiB avail; 8.7 KiB/s rd, 2.7 KiB/s wr, 13 op/s 2024-09-12T02:49:40.263 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 12 02:49:39 smithi172 ceph-mon[35609]: pgmap v366: 129 pgs: 129 active+clean; 24 MiB data, 494 MiB used, 1.0 TiB / 1.0 TiB avail; 8.7 KiB/s rd, 2.7 KiB/s wr, 13 op/s 2024-09-12T02:49:40.332 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:49:40.330+0000 7f5677200640 1 -- 172.21.15.39:0/2667062408 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f5670106f10 msgr2=0x7f567010ea90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:49:40.332 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:49:40.330+0000 7f5677200640 1 --2- 172.21.15.39:0/2667062408 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f5670106f10 0x7f567010ea90 secure :-1 s=READY pgs=305 cs=0 l=1 rev1=1 crypto rx=0x7f5668009ca0 tx=0x7f566802a8c0 comp rx=0 tx=0).stop 2024-09-12T02:49:40.333 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:49:40.331+0000 7f5677200640 1 -- 172.21.15.39:0/2667062408 shutdown_connections 2024-09-12T02:49:40.333 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:49:40.331+0000 7f5677200640 1 --2- 172.21.15.39:0/2667062408 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f5670106f10 0x7f567010ea90 unknown :-1 s=CLOSED pgs=305 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:49:40.333 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:49:40.331+0000 7f5677200640 1 --2- 172.21.15.39:0/2667062408 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f5670102790 0x7f56701067e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:49:40.333 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:49:40.331+0000 7f5677200640 1 --2- 172.21.15.39:0/2667062408 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f5670101de0 0x7f56701021c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:49:40.333 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:49:40.331+0000 7f5677200640 1 -- 172.21.15.39:0/2667062408 >> 172.21.15.39:0/2667062408 conn(0x7f56700fd8c0 msgr2=0x7f56700ffce0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:49:40.333 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:49:40.331+0000 7f5677200640 1 -- 172.21.15.39:0/2667062408 shutdown_connections 2024-09-12T02:49:40.333 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:49:40.331+0000 7f5677200640 1 -- 172.21.15.39:0/2667062408 wait complete. 2024-09-12T02:49:40.333 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:49:40.332+0000 7f5677200640 1 Processor -- start 2024-09-12T02:49:40.335 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:49:40.332+0000 7f5677200640 1 -- start start 2024-09-12T02:49:40.335 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:49:40.332+0000 7f5677200640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f5670101de0 0x7f56700744f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:49:40.335 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:49:40.332+0000 7f5677200640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f5670102790 0x7f5670074a30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:49:40.335 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:49:40.332+0000 7f5677200640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f5670106f10 0x7f5670074f70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:49:40.335 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:49:40.332+0000 7f5677200640 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 -- 0x7f5670111fc0 con 0x7f5670106f10 2024-09-12T02:49:40.335 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:49:40.332+0000 7f5677200640 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x7f5670111e40 con 0x7f5670102790 2024-09-12T02:49:40.335 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:49:40.332+0000 7f5677200640 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7f5670112140 con 0x7f5670101de0 2024-09-12T02:49:40.335 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:49:40.333+0000 7f566fe00640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f5670101de0 0x7f56700744f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:49:40.335 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:49:40.333+0000 7f566f400640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f5670102790 0x7f5670074a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:49:40.335 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:49:40.333+0000 7f566fe00640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f5670101de0 0x7f56700744f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.172:3300/0 says I am v2:172.21.15.39:52978/0 (socket says 172.21.15.39:52978) 2024-09-12T02:49:40.335 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:49:40.333+0000 7f566fe00640 1 -- 172.21.15.39:0/3960572307 learned_addr learned my addr 172.21.15.39:0/3960572307 (peer_addr_for_me v2:172.21.15.39:0/0) 2024-09-12T02:49:40.335 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:49:40.333+0000 7f5675200640 1 --2- 172.21.15.39:0/3960572307 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f5670106f10 0x7f5670074f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:49:40.336 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:49:40.333+0000 7f566fe00640 1 -- 172.21.15.39:0/3960572307 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f5670102790 msgr2=0x7f5670074a30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:49:40.336 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:49:40.333+0000 7f566fe00640 1 --2- 172.21.15.39:0/3960572307 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f5670102790 0x7f5670074a30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:49:40.336 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:49:40.333+0000 7f566fe00640 1 -- 172.21.15.39:0/3960572307 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f5670106f10 msgr2=0x7f5670074f70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:49:40.336 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:49:40.333+0000 7f566fe00640 1 --2- 172.21.15.39:0/3960572307 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f5670106f10 0x7f5670074f70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:49:40.336 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:49:40.333+0000 7f566fe00640 1 -- 172.21.15.39:0/3960572307 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f56701a68e0 con 0x7f5670101de0 2024-09-12T02:49:40.336 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:49:40.334+0000 7f566fe00640 1 --2- 172.21.15.39:0/3960572307 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f5670101de0 0x7f56700744f0 secure :-1 s=READY pgs=125 cs=0 l=1 rev1=1 crypto rx=0x7f566000e9f0 tx=0x7f566000edf0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:49:40.336 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:49:40.334+0000 7f566cc00640 1 -- 172.21.15.39:0/3960572307 <== mon.1 v2:172.21.15.172:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f566000cd80 con 0x7f5670101de0 2024-09-12T02:49:40.336 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:49:40.334+0000 7f566cc00640 1 -- 172.21.15.39:0/3960572307 <== mon.1 v2:172.21.15.172:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f5660005500 con 0x7f5670101de0 2024-09-12T02:49:40.336 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:49:40.334+0000 7f5677200640 1 -- 172.21.15.39:0/3960572307 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f56701a6bd0 con 0x7f5670101de0 2024-09-12T02:49:40.336 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:49:40.334+0000 7f566cc00640 1 -- 172.21.15.39:0/3960572307 <== mon.1 v2:172.21.15.172:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5660010690 con 0x7f5670101de0 2024-09-12T02:49:40.336 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:49:40.334+0000 7f5677200640 1 -- 172.21.15.39:0/3960572307 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f56701a70c0 con 0x7f5670101de0 2024-09-12T02:49:40.337 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:49:40.335+0000 7f5677200640 1 -- 172.21.15.39:0/3960572307 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f56701021c0 con 0x7f5670101de0 2024-09-12T02:49:40.338 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:49:40.337+0000 7f566cc00640 1 -- 172.21.15.39:0/3960572307 <== mon.1 v2:172.21.15.172:3300/0 4 ==== mgrmap(e 27) ==== 137964+0+0 (secure 0 0 0) 0x7f56600046c0 con 0x7f5670101de0 2024-09-12T02:49:40.339 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:49:40.338+0000 7f566cc00640 1 --2- 172.21.15.39:0/3960572307 >> [v2:172.21.15.39:6800/2187509357,v1:172.21.15.39:6801/2187509357] conn(0x7f56540a2cf0 0x7f56540a51b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:49:40.339 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:49:40.339+0000 7f566cc00640 1 -- 172.21.15.39:0/3960572307 <== mon.1 v2:172.21.15.172:3300/0 5 ==== osd_map(108..108 src has 1..108) ==== 9475+0+0 (secure 0 0 0) 0x7f56600cfc90 con 0x7f5670101de0 2024-09-12T02:49:40.339 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:49:40.339+0000 7f566f400640 1 --2- 172.21.15.39:0/3960572307 >> [v2:172.21.15.39:6800/2187509357,v1:172.21.15.39:6801/2187509357] conn(0x7f56540a2cf0 0x7f56540a51b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:49:40.340 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:49:40.339+0000 7f566f400640 1 --2- 172.21.15.39:0/3960572307 >> [v2:172.21.15.39:6800/2187509357,v1:172.21.15.39:6801/2187509357] conn(0x7f56540a2cf0 0x7f56540a51b0 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7f5670075f80 tx=0x7f565c005f90 comp rx=0 tx=0).ready entity=mgr.25199 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:49:40.343 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:49:40.343+0000 7f566cc00640 1 -- 172.21.15.39:0/3960572307 <== mon.1 v2:172.21.15.172:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7f566009c490 con 0x7f5670101de0 2024-09-12T02:49:40.564 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:49:40.564+0000 7f5677200640 1 -- 172.21.15.39:0/3960572307 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f5670109bc0 con 0x7f5670101de0 2024-09-12T02:49:40.566 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:49:40.565+0000 7f566cc00640 1 -- 172.21.15.39:0/3960572307 <== mon.1 v2:172.21.15.172:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 29 v29) ==== 94+0+11975 (secure 0 0 0) 0x7f566009bd90 con 0x7f5670101de0 2024-09-12T02:49:40.566 INFO:teuthology.orchestra.run.smithi039.stdout: 2024-09-12T02:49:40.566 INFO:teuthology.orchestra.run.smithi039.stdout:{"epoch":29,"btime":"2024-09-12T02:37:56:505454+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14451,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.39:6835/2325642381","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6834","nonce":2325642381},{"type":"v1","addr":"172.21.15.39:6835","nonce":2325642381}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14511,"name":"g","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.39:6839/936905514","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6838","nonce":936905514},{"type":"v1","addr":"172.21.15.39:6839","nonce":936905514}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":11}],"filesystems":[{"mdsmap":{"epoch":29,"flags":50,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-09-12T02:35:03.522182+0000","modified":"2024-09-12T02:37:55.520344+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":5,"in":[0,1,2,3,4],"up":{"mds_0":24515,"mds_1":24499,"mds_2":24484,"mds_3":24482,"mds_4":24472},"failed":[],"damaged":[],"stopped":[],"info":{"gid_14523":{"gid":14523,"name":"a","rank":4,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.39:6841/2829712180","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6840","nonce":2829712180},{"type":"v1","addr":"172.21.15.39:6841","nonce":2829712180}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24422":{"gid":24422,"name":"k","rank":3,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.44:6833/2359724364","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6832","nonce":2359724364},{"type":"v1","addr":"172.21.15.44:6833","nonce":2359724364}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24430":{"gid":24430,"name":"l","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.172:6833/3232434105","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6832","nonce":3232434105},{"type":"v1","addr":"172.21.15.172:6833","nonce":3232434105}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24446":{"gid":24446,"name":"d","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.39:6837/2743237008","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6836","nonce":2743237008},{"type":"v1","addr":"172.21.15.39:6837","nonce":2743237008}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24458":{"gid":24458,"name":"e","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.44:6835/4063842354","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6834","nonce":4063842354},{"type":"v1","addr":"172.21.15.44:6835","nonce":4063842354}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24472":{"gid":24472,"name":"f","rank":4,"incarnation":26,"state":"up:active","state_seq":21,"addr":"172.21.15.172:6835/3274676014","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6834","nonce":3274676014},{"type":"v1","addr":"172.21.15.172:6835","nonce":3274676014}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24482":{"gid":24482,"name":"h","rank":3,"incarnation":24,"state":"up:active","state_seq":19,"addr":"172.21.15.44:6837/1501493978","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6836","nonce":1501493978},{"type":"v1","addr":"172.21.15.44:6837","nonce":1501493978}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24484":{"gid":24484,"name":"c","rank":2,"incarnation":22,"state":"up:active","state_seq":20,"addr":"172.21.15.172:6837/493506747","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6836","nonce":493506747},{"type":"v1","addr":"172.21.15.172:6837","nonce":493506747}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24499":{"gid":24499,"name":"i","rank":1,"incarnation":20,"state":"up:active","state_seq":18,"addr":"172.21.15.172:6839/3742537097","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6838","nonce":3742537097},{"type":"v1","addr":"172.21.15.172:6839","nonce":3742537097}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24515":{"gid":24515,"name":"b","rank":0,"incarnation":14,"state":"up:active","state_seq":5,"addr":"172.21.15.44:6839/2556532723","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6838","nonce":2556532723},{"type":"v1","addr":"172.21.15.44:6839","nonce":2556532723}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":24515,"qdb_cluster":[24472,24482,24484,24499,24515]},"id":1}]} 2024-09-12T02:49:40.567 INFO:teuthology.orchestra.run.smithi039.stderr:dumped fsmap epoch 29 2024-09-12T02:49:40.568 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:49:40.567+0000 7f5677200640 1 -- 172.21.15.39:0/3960572307 >> [v2:172.21.15.39:6800/2187509357,v1:172.21.15.39:6801/2187509357] conn(0x7f56540a2cf0 msgr2=0x7f56540a51b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:49:40.568 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:49:40.567+0000 7f5677200640 1 --2- 172.21.15.39:0/3960572307 >> [v2:172.21.15.39:6800/2187509357,v1:172.21.15.39:6801/2187509357] conn(0x7f56540a2cf0 0x7f56540a51b0 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7f5670075f80 tx=0x7f565c005f90 comp rx=0 tx=0).stop 2024-09-12T02:49:40.568 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:49:40.567+0000 7f5677200640 1 -- 172.21.15.39:0/3960572307 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f5670101de0 msgr2=0x7f56700744f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:49:40.569 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:49:40.567+0000 7f5677200640 1 --2- 172.21.15.39:0/3960572307 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f5670101de0 0x7f56700744f0 secure :-1 s=READY pgs=125 cs=0 l=1 rev1=1 crypto rx=0x7f566000e9f0 tx=0x7f566000edf0 comp rx=0 tx=0).stop 2024-09-12T02:49:40.569 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:49:40.567+0000 7f5677200640 1 -- 172.21.15.39:0/3960572307 shutdown_connections 2024-09-12T02:49:40.569 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:49:40.567+0000 7f5677200640 1 --2- 172.21.15.39:0/3960572307 >> [v2:172.21.15.39:6800/2187509357,v1:172.21.15.39:6801/2187509357] conn(0x7f56540a2cf0 0x7f56540a51b0 unknown :-1 s=CLOSED pgs=53 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:49:40.569 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:49:40.568+0000 7f5677200640 1 --2- 172.21.15.39:0/3960572307 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f5670106f10 0x7f5670074f70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:49:40.569 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:49:40.568+0000 7f5677200640 1 --2- 172.21.15.39:0/3960572307 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f5670102790 0x7f5670074a30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:49:40.569 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:49:40.568+0000 7f5677200640 1 --2- 172.21.15.39:0/3960572307 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f5670101de0 0x7f56700744f0 unknown :-1 s=CLOSED pgs=125 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:49:40.569 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:49:40.568+0000 7f5677200640 1 -- 172.21.15.39:0/3960572307 >> 172.21.15.39:0/3960572307 conn(0x7f56700fd8c0 msgr2=0x7f56700feb60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:49:40.569 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:49:40.568+0000 7f5677200640 1 -- 172.21.15.39:0/3960572307 shutdown_connections 2024-09-12T02:49:40.569 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:49:40.568+0000 7f5677200640 1 -- 172.21.15.39:0/3960572307 wait complete. 2024-09-12T02:49:40.849 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 02:49:40 smithi039 ceph-mon[30515]: from='client.? 172.21.15.39:0/3960572307' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-12T02:49:41.170 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 12 02:49:40 smithi172 ceph-mon[35609]: from='client.? 172.21.15.39:0/3960572307' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-12T02:49:41.198 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 12 02:49:40 smithi044 ceph-mon[35411]: from='client.? 172.21.15.39:0/3960572307' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-12T02:49:41.350 DEBUG:teuthology.orchestra.run.smithi039:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc shell --fsid 4954ed46-70ae-11ef-bcea-c7b262605968 -- ceph fs dump --format=json 2024-09-12T02:49:41.731 INFO:teuthology.orchestra.run.smithi039.stderr:Inferring config /var/lib/ceph/4954ed46-70ae-11ef-bcea-c7b262605968/mon.a/config 2024-09-12T02:49:42.013 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 12 02:49:41 smithi172 ceph-mon[35609]: pgmap v367: 129 pgs: 129 active+clean; 24 MiB data, 494 MiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 1023 B/s wr, 8 op/s 2024-09-12T02:49:42.035 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 02:49:41 smithi039 ceph-mon[30515]: pgmap v367: 129 pgs: 129 active+clean; 24 MiB data, 494 MiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 1023 B/s wr, 8 op/s 2024-09-12T02:49:42.198 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 12 02:49:41 smithi044 ceph-mon[35411]: pgmap v367: 129 pgs: 129 active+clean; 24 MiB data, 494 MiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 1023 B/s wr, 8 op/s 2024-09-12T02:49:42.348 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:49:42.346+0000 7f070be00640 1 -- 172.21.15.39:0/3639425165 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f070c1019c0 msgr2=0x7f070c101e20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:49:42.348 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:49:42.346+0000 7f070be00640 1 --2- 172.21.15.39:0/3639425165 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f070c1019c0 0x7f070c101e20 secure :-1 s=READY pgs=306 cs=0 l=1 rev1=1 crypto rx=0x7f06f8009930 tx=0x7f06f802a420 comp rx=0 tx=0).stop 2024-09-12T02:49:42.348 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:49:42.347+0000 7f070be00640 1 -- 172.21.15.39:0/3639425165 shutdown_connections 2024-09-12T02:49:42.348 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:49:42.347+0000 7f070be00640 1 --2- 172.21.15.39:0/3639425165 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f070c102360 0x7f070c10e890 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:49:42.348 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:49:42.347+0000 7f070be00640 1 --2- 172.21.15.39:0/3639425165 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f070c1019c0 0x7f070c101e20 unknown :-1 s=CLOSED pgs=306 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:49:42.349 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:49:42.347+0000 7f070be00640 1 --2- 172.21.15.39:0/3639425165 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f070c1079c0 0x7f070c107da0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:49:42.349 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:49:42.347+0000 7f070be00640 1 -- 172.21.15.39:0/3639425165 >> 172.21.15.39:0/3639425165 conn(0x7f070c0fd740 msgr2=0x7f070c0ffb60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:49:42.349 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:49:42.347+0000 7f070be00640 1 -- 172.21.15.39:0/3639425165 shutdown_connections 2024-09-12T02:49:42.349 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:49:42.347+0000 7f070be00640 1 -- 172.21.15.39:0/3639425165 wait complete. 2024-09-12T02:49:42.349 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:49:42.348+0000 7f070be00640 1 Processor -- start 2024-09-12T02:49:42.349 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:49:42.348+0000 7f070be00640 1 -- start start 2024-09-12T02:49:42.350 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:49:42.349+0000 7f070be00640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f070c1019c0 0x7f070c198370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:49:42.350 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:49:42.349+0000 7f070be00640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f070c102360 0x7f070c1988b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:49:42.350 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:49:42.349+0000 7f070be00640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f070c1079c0 0x7f070c19cc40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:49:42.350 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:49:42.349+0000 7f070be00640 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 -- 0x7f070c111e10 con 0x7f070c1019c0 2024-09-12T02:49:42.350 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:49:42.349+0000 7f070be00640 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x7f070c111c90 con 0x7f070c102360 2024-09-12T02:49:42.350 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:49:42.349+0000 7f070be00640 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7f070c111f90 con 0x7f070c1079c0 2024-09-12T02:49:42.351 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:49:42.349+0000 7f070a000640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f070c102360 0x7f070c1988b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:49:42.351 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:49:42.349+0000 7f070aa00640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f070c1019c0 0x7f070c198370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:49:42.351 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:49:42.349+0000 7f070a000640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f070c102360 0x7f070c1988b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.39:53456/0 (socket says 172.21.15.39:53456) 2024-09-12T02:49:42.351 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:49:42.349+0000 7f070a000640 1 -- 172.21.15.39:0/676139127 learned_addr learned my addr 172.21.15.39:0/676139127 (peer_addr_for_me v2:172.21.15.39:0/0) 2024-09-12T02:49:42.351 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:49:42.349+0000 7f070b400640 1 --2- 172.21.15.39:0/676139127 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f070c1079c0 0x7f070c19cc40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:49:42.351 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:49:42.350+0000 7f070a000640 1 -- 172.21.15.39:0/676139127 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f070c1079c0 msgr2=0x7f070c19cc40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:49:42.351 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:49:42.350+0000 7f070a000640 1 --2- 172.21.15.39:0/676139127 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f070c1079c0 0x7f070c19cc40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:49:42.351 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:49:42.350+0000 7f070a000640 1 -- 172.21.15.39:0/676139127 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f070c1019c0 msgr2=0x7f070c198370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:49:42.352 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:49:42.350+0000 7f070a000640 1 --2- 172.21.15.39:0/676139127 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f070c1019c0 0x7f070c198370 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:49:42.352 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:49:42.350+0000 7f070a000640 1 -- 172.21.15.39:0/676139127 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f070c19d320 con 0x7f070c102360 2024-09-12T02:49:42.352 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:49:42.350+0000 7f070aa00640 1 --2- 172.21.15.39:0/676139127 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f070c1019c0 0x7f070c198370 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-12T02:49:42.352 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:49:42.350+0000 7f070a000640 1 --2- 172.21.15.39:0/676139127 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f070c102360 0x7f070c1988b0 secure :-1 s=READY pgs=149 cs=0 l=1 rev1=1 crypto rx=0x7f06f802a940 tx=0x7f06f8003b20 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:49:42.352 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:49:42.351+0000 7f0703400640 1 -- 172.21.15.39:0/676139127 <== mon.2 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f06f803f070 con 0x7f070c102360 2024-09-12T02:49:42.352 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:49:42.351+0000 7f070be00640 1 -- 172.21.15.39:0/676139127 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f070c19d5b0 con 0x7f070c102360 2024-09-12T02:49:42.353 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:49:42.351+0000 7f0703400640 1 -- 172.21.15.39:0/676139127 <== mon.2 v2:172.21.15.44:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f06f8031c90 con 0x7f070c102360 2024-09-12T02:49:42.353 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:49:42.351+0000 7f0703400640 1 -- 172.21.15.39:0/676139127 <== mon.2 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f06f8035030 con 0x7f070c102360 2024-09-12T02:49:42.353 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:49:42.351+0000 7f070be00640 1 -- 172.21.15.39:0/676139127 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f070c1a4ef0 con 0x7f070c102360 2024-09-12T02:49:42.353 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:49:42.352+0000 7f070be00640 1 -- 172.21.15.39:0/676139127 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f070c101e20 con 0x7f070c102360 2024-09-12T02:49:42.356 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:49:42.355+0000 7f0703400640 1 -- 172.21.15.39:0/676139127 <== mon.2 v2:172.21.15.44:3300/0 4 ==== mgrmap(e 27) ==== 137964+0+0 (secure 0 0 0) 0x7f06f8042070 con 0x7f070c102360 2024-09-12T02:49:42.357 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:49:42.356+0000 7f0703400640 1 --2- 172.21.15.39:0/676139127 >> [v2:172.21.15.39:6800/2187509357,v1:172.21.15.39:6801/2187509357] conn(0x7f06f00a2cf0 0x7f06f00a51b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:49:42.358 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:49:42.356+0000 7f0703400640 1 -- 172.21.15.39:0/676139127 <== mon.2 v2:172.21.15.44:3300/0 5 ==== osd_map(108..108 src has 1..108) ==== 9475+0+0 (secure 0 0 0) 0x7f06f80f01f0 con 0x7f070c102360 2024-09-12T02:49:42.358 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:49:42.356+0000 7f070aa00640 1 --2- 172.21.15.39:0/676139127 >> [v2:172.21.15.39:6800/2187509357,v1:172.21.15.39:6801/2187509357] conn(0x7f06f00a2cf0 0x7f06f00a51b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:49:42.358 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:49:42.357+0000 7f070aa00640 1 --2- 172.21.15.39:0/676139127 >> [v2:172.21.15.39:6800/2187509357,v1:172.21.15.39:6801/2187509357] conn(0x7f06f00a2cf0 0x7f06f00a51b0 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7f06fc009f40 tx=0x7f06fc005f90 comp rx=0 tx=0).ready entity=mgr.25199 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:49:42.359 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:49:42.358+0000 7f0703400640 1 -- 172.21.15.39:0/676139127 <== mon.2 v2:172.21.15.44:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7f06f80bc3a0 con 0x7f070c102360 2024-09-12T02:49:42.587 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:49:42.586+0000 7f070be00640 1 -- 172.21.15.39:0/676139127 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f070c1996d0 con 0x7f070c102360 2024-09-12T02:49:42.588 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:49:42.587+0000 7f0703400640 1 -- 172.21.15.39:0/676139127 <== mon.2 v2:172.21.15.44:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 29 v29) ==== 94+0+11975 (secure 0 0 0) 0x7f070c1996d0 con 0x7f070c102360 2024-09-12T02:49:42.588 INFO:teuthology.orchestra.run.smithi039.stdout: 2024-09-12T02:49:42.589 INFO:teuthology.orchestra.run.smithi039.stdout:{"epoch":29,"btime":"2024-09-12T02:37:56:505454+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14451,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.39:6835/2325642381","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6834","nonce":2325642381},{"type":"v1","addr":"172.21.15.39:6835","nonce":2325642381}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14511,"name":"g","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.39:6839/936905514","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6838","nonce":936905514},{"type":"v1","addr":"172.21.15.39:6839","nonce":936905514}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":11}],"filesystems":[{"mdsmap":{"epoch":29,"flags":50,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-09-12T02:35:03.522182+0000","modified":"2024-09-12T02:37:55.520344+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":5,"in":[0,1,2,3,4],"up":{"mds_0":24515,"mds_1":24499,"mds_2":24484,"mds_3":24482,"mds_4":24472},"failed":[],"damaged":[],"stopped":[],"info":{"gid_14523":{"gid":14523,"name":"a","rank":4,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.39:6841/2829712180","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6840","nonce":2829712180},{"type":"v1","addr":"172.21.15.39:6841","nonce":2829712180}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24422":{"gid":24422,"name":"k","rank":3,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.44:6833/2359724364","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6832","nonce":2359724364},{"type":"v1","addr":"172.21.15.44:6833","nonce":2359724364}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24430":{"gid":24430,"name":"l","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.172:6833/3232434105","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6832","nonce":3232434105},{"type":"v1","addr":"172.21.15.172:6833","nonce":3232434105}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24446":{"gid":24446,"name":"d","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.39:6837/2743237008","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6836","nonce":2743237008},{"type":"v1","addr":"172.21.15.39:6837","nonce":2743237008}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24458":{"gid":24458,"name":"e","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.44:6835/4063842354","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6834","nonce":4063842354},{"type":"v1","addr":"172.21.15.44:6835","nonce":4063842354}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24472":{"gid":24472,"name":"f","rank":4,"incarnation":26,"state":"up:active","state_seq":21,"addr":"172.21.15.172:6835/3274676014","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6834","nonce":3274676014},{"type":"v1","addr":"172.21.15.172:6835","nonce":3274676014}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24482":{"gid":24482,"name":"h","rank":3,"incarnation":24,"state":"up:active","state_seq":19,"addr":"172.21.15.44:6837/1501493978","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6836","nonce":1501493978},{"type":"v1","addr":"172.21.15.44:6837","nonce":1501493978}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24484":{"gid":24484,"name":"c","rank":2,"incarnation":22,"state":"up:active","state_seq":20,"addr":"172.21.15.172:6837/493506747","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6836","nonce":493506747},{"type":"v1","addr":"172.21.15.172:6837","nonce":493506747}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24499":{"gid":24499,"name":"i","rank":1,"incarnation":20,"state":"up:active","state_seq":18,"addr":"172.21.15.172:6839/3742537097","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6838","nonce":3742537097},{"type":"v1","addr":"172.21.15.172:6839","nonce":3742537097}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24515":{"gid":24515,"name":"b","rank":0,"incarnation":14,"state":"up:active","state_seq":5,"addr":"172.21.15.44:6839/2556532723","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6838","nonce":2556532723},{"type":"v1","addr":"172.21.15.44:6839","nonce":2556532723}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":24515,"qdb_cluster":[24472,24482,24484,24499,24515]},"id":1}]} 2024-09-12T02:49:42.589 INFO:teuthology.orchestra.run.smithi039.stderr:dumped fsmap epoch 29 2024-09-12T02:49:42.590 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:49:42.589+0000 7f070be00640 1 -- 172.21.15.39:0/676139127 >> [v2:172.21.15.39:6800/2187509357,v1:172.21.15.39:6801/2187509357] conn(0x7f06f00a2cf0 msgr2=0x7f06f00a51b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:49:42.590 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:49:42.589+0000 7f070be00640 1 --2- 172.21.15.39:0/676139127 >> [v2:172.21.15.39:6800/2187509357,v1:172.21.15.39:6801/2187509357] conn(0x7f06f00a2cf0 0x7f06f00a51b0 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7f06fc009f40 tx=0x7f06fc005f90 comp rx=0 tx=0).stop 2024-09-12T02:49:42.590 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:49:42.589+0000 7f070be00640 1 -- 172.21.15.39:0/676139127 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f070c102360 msgr2=0x7f070c1988b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:49:42.590 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:49:42.589+0000 7f070be00640 1 --2- 172.21.15.39:0/676139127 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f070c102360 0x7f070c1988b0 secure :-1 s=READY pgs=149 cs=0 l=1 rev1=1 crypto rx=0x7f06f802a940 tx=0x7f06f8003b20 comp rx=0 tx=0).stop 2024-09-12T02:49:42.591 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:49:42.589+0000 7f070be00640 1 -- 172.21.15.39:0/676139127 shutdown_connections 2024-09-12T02:49:42.591 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:49:42.589+0000 7f070be00640 1 --2- 172.21.15.39:0/676139127 >> [v2:172.21.15.39:6800/2187509357,v1:172.21.15.39:6801/2187509357] conn(0x7f06f00a2cf0 0x7f06f00a51b0 unknown :-1 s=CLOSED pgs=54 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:49:42.591 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:49:42.589+0000 7f070be00640 1 --2- 172.21.15.39:0/676139127 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f070c1079c0 0x7f070c19cc40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:49:42.591 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:49:42.589+0000 7f070be00640 1 --2- 172.21.15.39:0/676139127 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f070c102360 0x7f070c1988b0 unknown :-1 s=CLOSED pgs=149 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:49:42.591 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:49:42.589+0000 7f070be00640 1 --2- 172.21.15.39:0/676139127 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f070c1019c0 0x7f070c198370 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:49:42.591 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:49:42.589+0000 7f070be00640 1 -- 172.21.15.39:0/676139127 >> 172.21.15.39:0/676139127 conn(0x7f070c0fd740 msgr2=0x7f070c0fe050 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:49:42.592 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:49:42.590+0000 7f070be00640 1 -- 172.21.15.39:0/676139127 shutdown_connections 2024-09-12T02:49:42.592 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:49:42.590+0000 7f070be00640 1 -- 172.21.15.39:0/676139127 wait complete. 2024-09-12T02:49:42.972 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 02:49:42 smithi039 ceph-mon[30515]: from='client.? 172.21.15.39:0/676139127' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-12T02:49:43.198 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 12 02:49:42 smithi044 ceph-mon[35411]: from='client.? 172.21.15.39:0/676139127' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-12T02:49:43.263 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 12 02:49:42 smithi172 ceph-mon[35609]: from='client.? 172.21.15.39:0/676139127' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-12T02:49:43.342 DEBUG:teuthology.orchestra.run.smithi039:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc shell --fsid 4954ed46-70ae-11ef-bcea-c7b262605968 -- ceph osd dump --format=json 2024-09-12T02:49:43.725 INFO:teuthology.orchestra.run.smithi039.stderr:Inferring config /var/lib/ceph/4954ed46-70ae-11ef-bcea-c7b262605968/mon.a/config 2024-09-12T02:49:44.058 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 12 02:49:43 smithi044 ceph-mon[35411]: pgmap v368: 129 pgs: 129 active+clean; 24 MiB data, 494 MiB used, 1.0 TiB / 1.0 TiB avail; 7.8 KiB/s rd, 2.2 KiB/s wr, 14 op/s 2024-09-12T02:49:44.058 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 02:49:43 smithi039 ceph-mon[30515]: pgmap v368: 129 pgs: 129 active+clean; 24 MiB data, 494 MiB used, 1.0 TiB / 1.0 TiB avail; 7.8 KiB/s rd, 2.2 KiB/s wr, 14 op/s 2024-09-12T02:49:44.263 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 12 02:49:43 smithi172 ceph-mon[35609]: pgmap v368: 129 pgs: 129 active+clean; 24 MiB data, 494 MiB used, 1.0 TiB / 1.0 TiB avail; 7.8 KiB/s rd, 2.2 KiB/s wr, 14 op/s 2024-09-12T02:49:44.307 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:49:44.302+0000 7efda2800640 1 -- 172.21.15.39:0/1541625955 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7efd9c074eb0 msgr2=0x7efd9c112650 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:49:44.307 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:49:44.302+0000 7efda2800640 1 --2- 172.21.15.39:0/1541625955 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7efd9c074eb0 0x7efd9c112650 secure :-1 s=READY pgs=150 cs=0 l=1 rev1=1 crypto rx=0x7efd88009860 tx=0x7efd8802a3d0 comp rx=0 tx=0).stop 2024-09-12T02:49:44.307 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:49:44.302+0000 7efda2800640 1 -- 172.21.15.39:0/1541625955 shutdown_connections 2024-09-12T02:49:44.307 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:49:44.302+0000 7efda2800640 1 --2- 172.21.15.39:0/1541625955 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7efd9c112b90 0x7efd9c114f80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:49:44.308 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:49:44.302+0000 7efda2800640 1 --2- 172.21.15.39:0/1541625955 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7efd9c074eb0 0x7efd9c112650 unknown :-1 s=CLOSED pgs=150 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:49:44.308 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:49:44.302+0000 7efda2800640 1 --2- 172.21.15.39:0/1541625955 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7efd9c074590 0x7efd9c074970 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:49:44.308 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:49:44.302+0000 7efda2800640 1 -- 172.21.15.39:0/1541625955 >> 172.21.15.39:0/1541625955 conn(0x7efd9c0fd8c0 msgr2=0x7efd9c0ffce0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:49:44.308 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:49:44.303+0000 7efda2800640 1 -- 172.21.15.39:0/1541625955 shutdown_connections 2024-09-12T02:49:44.308 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:49:44.303+0000 7efda2800640 1 -- 172.21.15.39:0/1541625955 wait complete. 2024-09-12T02:49:44.308 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:49:44.304+0000 7efda2800640 1 Processor -- start 2024-09-12T02:49:44.308 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:49:44.304+0000 7efda2800640 1 -- start start 2024-09-12T02:49:44.308 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:49:44.304+0000 7efda2800640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7efd9c074590 0x7efd9c19eb20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:49:44.308 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:49:44.304+0000 7efda2800640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7efd9c074eb0 0x7efd9c19f060 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:49:44.308 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:49:44.305+0000 7efda2800640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7efd9c112b90 0x7efd9c1a3420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:49:44.309 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:49:44.305+0000 7efda2800640 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 -- 0x7efd9c118590 con 0x7efd9c074eb0 2024-09-12T02:49:44.309 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:49:44.305+0000 7efda2800640 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x7efd9c118410 con 0x7efd9c074590 2024-09-12T02:49:44.309 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:49:44.305+0000 7efda2800640 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7efd9c118710 con 0x7efd9c112b90 2024-09-12T02:49:44.309 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:49:44.305+0000 7efd9b400640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7efd9c074590 0x7efd9c19eb20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:49:44.309 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:49:44.305+0000 7efd9aa00640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7efd9c074eb0 0x7efd9c19f060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:49:44.309 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:49:44.305+0000 7efd9b400640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7efd9c074590 0x7efd9c19eb20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.39:53478/0 (socket says 172.21.15.39:53478) 2024-09-12T02:49:44.309 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:49:44.305+0000 7efd9b400640 1 -- 172.21.15.39:0/2357767327 learned_addr learned my addr 172.21.15.39:0/2357767327 (peer_addr_for_me v2:172.21.15.39:0/0) 2024-09-12T02:49:44.309 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:49:44.305+0000 7efd9be00640 1 --2- 172.21.15.39:0/2357767327 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7efd9c112b90 0x7efd9c1a3420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:49:44.309 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:49:44.305+0000 7efd9b400640 1 -- 172.21.15.39:0/2357767327 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7efd9c112b90 msgr2=0x7efd9c1a3420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:49:44.309 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:49:44.305+0000 7efd9b400640 1 --2- 172.21.15.39:0/2357767327 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7efd9c112b90 0x7efd9c1a3420 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:49:44.310 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:49:44.305+0000 7efd9b400640 1 -- 172.21.15.39:0/2357767327 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7efd9c074eb0 msgr2=0x7efd9c19f060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:49:44.310 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:49:44.305+0000 7efd9b400640 1 --2- 172.21.15.39:0/2357767327 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7efd9c074eb0 0x7efd9c19f060 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:49:44.310 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:49:44.305+0000 7efd9b400640 1 -- 172.21.15.39:0/2357767327 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7efd9c1a3b50 con 0x7efd9c074590 2024-09-12T02:49:44.310 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:49:44.306+0000 7efd9b400640 1 --2- 172.21.15.39:0/2357767327 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7efd9c074590 0x7efd9c19eb20 secure :-1 s=READY pgs=151 cs=0 l=1 rev1=1 crypto rx=0x7efd8c00e9c0 tx=0x7efd8c00ee80 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:49:44.310 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:49:44.306+0000 7efd93e00640 1 -- 172.21.15.39:0/2357767327 <== mon.2 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efd8c00ccc0 con 0x7efd9c074590 2024-09-12T02:49:44.310 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:49:44.306+0000 7efd93e00640 1 -- 172.21.15.39:0/2357767327 <== mon.2 v2:172.21.15.44:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7efd8c005500 con 0x7efd9c074590 2024-09-12T02:49:44.310 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:49:44.306+0000 7efda2800640 1 -- 172.21.15.39:0/2357767327 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7efd9c1a3e40 con 0x7efd9c074590 2024-09-12T02:49:44.310 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:49:44.306+0000 7efd93e00640 1 -- 172.21.15.39:0/2357767327 <== mon.2 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efd8c010430 con 0x7efd9c074590 2024-09-12T02:49:44.310 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:49:44.306+0000 7efda2800640 1 -- 172.21.15.39:0/2357767327 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7efd9c1ab6d0 con 0x7efd9c074590 2024-09-12T02:49:44.311 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:49:44.307+0000 7efda2800640 1 -- 172.21.15.39:0/2357767327 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7efd9c074970 con 0x7efd9c074590 2024-09-12T02:49:44.311 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:49:44.309+0000 7efd93e00640 1 -- 172.21.15.39:0/2357767327 <== mon.2 v2:172.21.15.44:3300/0 4 ==== mgrmap(e 27) ==== 137964+0+0 (secure 0 0 0) 0x7efd8c0046c0 con 0x7efd9c074590 2024-09-12T02:49:44.312 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:49:44.311+0000 7efd93e00640 1 --2- 172.21.15.39:0/2357767327 >> [v2:172.21.15.39:6800/2187509357,v1:172.21.15.39:6801/2187509357] conn(0x7efd800a2cf0 0x7efd800a51b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:49:44.312 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:49:44.311+0000 7efd93e00640 1 -- 172.21.15.39:0/2357767327 <== mon.2 v2:172.21.15.44:3300/0 5 ==== osd_map(108..108 src has 1..108) ==== 9475+0+0 (secure 0 0 0) 0x7efd8c0cfb40 con 0x7efd9c074590 2024-09-12T02:49:44.312 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:49:44.312+0000 7efd9aa00640 1 --2- 172.21.15.39:0/2357767327 >> [v2:172.21.15.39:6800/2187509357,v1:172.21.15.39:6801/2187509357] conn(0x7efd800a2cf0 0x7efd800a51b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:49:44.313 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:49:44.312+0000 7efd9aa00640 1 --2- 172.21.15.39:0/2357767327 >> [v2:172.21.15.39:6800/2187509357,v1:172.21.15.39:6801/2187509357] conn(0x7efd800a2cf0 0x7efd800a51b0 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7efd9c1a0100 tx=0x7efd88005c90 comp rx=0 tx=0).ready entity=mgr.25199 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:49:44.315 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:49:44.315+0000 7efd93e00640 1 -- 172.21.15.39:0/2357767327 <== mon.2 v2:172.21.15.44:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7efd8c09c340 con 0x7efd9c074590 2024-09-12T02:49:44.502 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:49:44.501+0000 7efda2800640 1 -- 172.21.15.39:0/2357767327 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7efd9c105030 con 0x7efd9c074590 2024-09-12T02:49:44.504 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:49:44.503+0000 7efd93e00640 1 -- 172.21.15.39:0/2357767327 <== mon.2 v2:172.21.15.44:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v108) ==== 74+0+25333 (secure 0 0 0) 0x7efd8c09bc40 con 0x7efd9c074590 2024-09-12T02:49:44.505 INFO:teuthology.orchestra.run.smithi039.stdout: 2024-09-12T02:49:44.505 INFO:teuthology.orchestra.run.smithi039.stdout:{"epoch":108,"fsid":"4954ed46-70ae-11ef-bcea-c7b262605968","created":"2024-09-12T02:26:43.086467+0000","modified":"2024-09-12T02:49:12.175417+0000","last_up_change":"2024-09-12T02:34:08.626341+0000","last_in_change":"2024-09-12T02:33:45.553591+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":27,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":12,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-12T02:30:09.347905+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":12,"score_stable":12,"optimal_score":0.25,"raw_score_acting":3,"raw_score_stable":3,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-09-12T02:34:58.580872+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"84","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.8799999952316284,"score_stable":1.8799999952316284,"optimal_score":1,"raw_score_acting":1.8799999952316284,"raw_score_stable":1.8799999952316284,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-09-12T02:35:01.469805+0000","flags":8193,"flags_names":"hashpspool,selfmanaged_snaps","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"107","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":19,"snap_epoch":107,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2024-09-12T02:35:11.088109+0000","flags":8197,"flags_names":"hashpspool,ec_overwrites,selfmanaged_snaps","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"107","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":19,"snap_epoch":107,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"c967b48e-8a39-4797-871b-8b1b83d9472f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":87,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6802","nonce":2437586899},{"type":"v1","addr":"172.21.15.39:6803","nonce":2437586899}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6804","nonce":2437586899},{"type":"v1","addr":"172.21.15.39:6805","nonce":2437586899}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6808","nonce":2437586899},{"type":"v1","addr":"172.21.15.39:6809","nonce":2437586899}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6806","nonce":2437586899},{"type":"v1","addr":"172.21.15.39:6807","nonce":2437586899}]},"public_addr":"172.21.15.39:6803/2437586899","cluster_addr":"172.21.15.39:6805/2437586899","heartbeat_back_addr":"172.21.15.39:6809/2437586899","heartbeat_front_addr":"172.21.15.39:6807/2437586899","state":["exists","up"]},{"osd":1,"uuid":"30e1e4f4-1d50-4003-8978-cb183dca7fbb","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":87,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6800","nonce":2349287000},{"type":"v1","addr":"172.21.15.44:6801","nonce":2349287000}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6802","nonce":2349287000},{"type":"v1","addr":"172.21.15.44:6803","nonce":2349287000}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6806","nonce":2349287000},{"type":"v1","addr":"172.21.15.44:6807","nonce":2349287000}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6804","nonce":2349287000},{"type":"v1","addr":"172.21.15.44:6805","nonce":2349287000}]},"public_addr":"172.21.15.44:6801/2349287000","cluster_addr":"172.21.15.44:6803/2349287000","heartbeat_back_addr":"172.21.15.44:6807/2349287000","heartbeat_front_addr":"172.21.15.44:6805/2349287000","state":["exists","up"]},{"osd":2,"uuid":"a758803f-8668-4fc8-9417-b8d080cd9a7c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":18,"up_thru":94,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6800","nonce":1176898232},{"type":"v1","addr":"172.21.15.172:6801","nonce":1176898232}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6802","nonce":1176898232},{"type":"v1","addr":"172.21.15.172:6803","nonce":1176898232}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6806","nonce":1176898232},{"type":"v1","addr":"172.21.15.172:6807","nonce":1176898232}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6804","nonce":1176898232},{"type":"v1","addr":"172.21.15.172:6805","nonce":1176898232}]},"public_addr":"172.21.15.172:6801/1176898232","cluster_addr":"172.21.15.172:6803/1176898232","heartbeat_back_addr":"172.21.15.172:6807/1176898232","heartbeat_front_addr":"172.21.15.172:6805/1176898232","state":["exists","up"]},{"osd":3,"uuid":"8b256567-7efe-429c-bc4c-80e93228f139","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":26,"up_thru":87,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6810","nonce":2013565859},{"type":"v1","addr":"172.21.15.39:6811","nonce":2013565859}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6812","nonce":2013565859},{"type":"v1","addr":"172.21.15.39:6813","nonce":2013565859}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6816","nonce":2013565859},{"type":"v1","addr":"172.21.15.39:6817","nonce":2013565859}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6814","nonce":2013565859},{"type":"v1","addr":"172.21.15.39:6815","nonce":2013565859}]},"public_addr":"172.21.15.39:6811/2013565859","cluster_addr":"172.21.15.39:6813/2013565859","heartbeat_back_addr":"172.21.15.39:6817/2013565859","heartbeat_front_addr":"172.21.15.39:6815/2013565859","state":["exists","up"]},{"osd":4,"uuid":"e86b6756-e2b3-49fe-9b87-1a2b015bb17a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":33,"up_thru":87,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6808","nonce":3663639110},{"type":"v1","addr":"172.21.15.44:6809","nonce":3663639110}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6810","nonce":3663639110},{"type":"v1","addr":"172.21.15.44:6811","nonce":3663639110}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6814","nonce":3663639110},{"type":"v1","addr":"172.21.15.44:6815","nonce":3663639110}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6812","nonce":3663639110},{"type":"v1","addr":"172.21.15.44:6813","nonce":3663639110}]},"public_addr":"172.21.15.44:6809/3663639110","cluster_addr":"172.21.15.44:6811/3663639110","heartbeat_back_addr":"172.21.15.44:6815/3663639110","heartbeat_front_addr":"172.21.15.44:6813/3663639110","state":["exists","up"]},{"osd":5,"uuid":"9c907c92-b323-48e7-99ad-ec9756d26312","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":38,"up_thru":92,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6808","nonce":998885347},{"type":"v1","addr":"172.21.15.172:6809","nonce":998885347}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6810","nonce":998885347},{"type":"v1","addr":"172.21.15.172:6811","nonce":998885347}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6814","nonce":998885347},{"type":"v1","addr":"172.21.15.172:6815","nonce":998885347}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6812","nonce":998885347},{"type":"v1","addr":"172.21.15.172:6813","nonce":998885347}]},"public_addr":"172.21.15.172:6809/998885347","cluster_addr":"172.21.15.172:6811/998885347","heartbeat_back_addr":"172.21.15.172:6815/998885347","heartbeat_front_addr":"172.21.15.172:6813/998885347","state":["exists","up"]},{"osd":6,"uuid":"1fcb9bb2-6f4b-4d97-a401-aeb6a9706613","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":45,"up_thru":92,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6818","nonce":2569059542},{"type":"v1","addr":"172.21.15.39:6819","nonce":2569059542}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6820","nonce":2569059542},{"type":"v1","addr":"172.21.15.39:6821","nonce":2569059542}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6824","nonce":2569059542},{"type":"v1","addr":"172.21.15.39:6825","nonce":2569059542}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6822","nonce":2569059542},{"type":"v1","addr":"172.21.15.39:6823","nonce":2569059542}]},"public_addr":"172.21.15.39:6819/2569059542","cluster_addr":"172.21.15.39:6821/2569059542","heartbeat_back_addr":"172.21.15.39:6825/2569059542","heartbeat_front_addr":"172.21.15.39:6823/2569059542","state":["exists","up"]},{"osd":7,"uuid":"59e0caf9-8ce5-4161-8875-84862eba743e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":50,"up_thru":87,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6816","nonce":709635079},{"type":"v1","addr":"172.21.15.44:6817","nonce":709635079}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6818","nonce":709635079},{"type":"v1","addr":"172.21.15.44:6819","nonce":709635079}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6822","nonce":709635079},{"type":"v1","addr":"172.21.15.44:6823","nonce":709635079}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6820","nonce":709635079},{"type":"v1","addr":"172.21.15.44:6821","nonce":709635079}]},"public_addr":"172.21.15.44:6817/709635079","cluster_addr":"172.21.15.44:6819/709635079","heartbeat_back_addr":"172.21.15.44:6823/709635079","heartbeat_front_addr":"172.21.15.44:6821/709635079","state":["exists","up"]},{"osd":8,"uuid":"2f6fb5c7-86cc-43eb-bdfb-45a69316937e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":57,"up_thru":94,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6816","nonce":1162792895},{"type":"v1","addr":"172.21.15.172:6817","nonce":1162792895}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6818","nonce":1162792895},{"type":"v1","addr":"172.21.15.172:6819","nonce":1162792895}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6822","nonce":1162792895},{"type":"v1","addr":"172.21.15.172:6823","nonce":1162792895}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6820","nonce":1162792895},{"type":"v1","addr":"172.21.15.172:6821","nonce":1162792895}]},"public_addr":"172.21.15.172:6817/1162792895","cluster_addr":"172.21.15.172:6819/1162792895","heartbeat_back_addr":"172.21.15.172:6823/1162792895","heartbeat_front_addr":"172.21.15.172:6821/1162792895","state":["exists","up"]},{"osd":9,"uuid":"87e5dd9e-8191-4db6-83fa-cfff7c31e17e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":65,"up_thru":92,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6826","nonce":945860346},{"type":"v1","addr":"172.21.15.39:6827","nonce":945860346}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6828","nonce":945860346},{"type":"v1","addr":"172.21.15.39:6829","nonce":945860346}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6832","nonce":945860346},{"type":"v1","addr":"172.21.15.39:6833","nonce":945860346}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6830","nonce":945860346},{"type":"v1","addr":"172.21.15.39:6831","nonce":945860346}]},"public_addr":"172.21.15.39:6827/945860346","cluster_addr":"172.21.15.39:6829/945860346","heartbeat_back_addr":"172.21.15.39:6833/945860346","heartbeat_front_addr":"172.21.15.39:6831/945860346","state":["exists","up"]},{"osd":10,"uuid":"b55d8a00-850f-4910-a5bf-97d9ed545be7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":70,"up_thru":81,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6824","nonce":3899352344},{"type":"v1","addr":"172.21.15.44:6825","nonce":3899352344}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6826","nonce":3899352344},{"type":"v1","addr":"172.21.15.44:6827","nonce":3899352344}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6830","nonce":3899352344},{"type":"v1","addr":"172.21.15.44:6831","nonce":3899352344}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6828","nonce":3899352344},{"type":"v1","addr":"172.21.15.44:6829","nonce":3899352344}]},"public_addr":"172.21.15.44:6825/3899352344","cluster_addr":"172.21.15.44:6827/3899352344","heartbeat_back_addr":"172.21.15.44:6831/3899352344","heartbeat_front_addr":"172.21.15.44:6829/3899352344","state":["exists","up"]},{"osd":11,"uuid":"20cf5df1-5a80-4272-acc0-919c6a1da55a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":77,"up_thru":92,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6824","nonce":3627635035},{"type":"v1","addr":"172.21.15.172:6825","nonce":3627635035}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6826","nonce":3627635035},{"type":"v1","addr":"172.21.15.172:6827","nonce":3627635035}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6830","nonce":3627635035},{"type":"v1","addr":"172.21.15.172:6831","nonce":3627635035}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6828","nonce":3627635035},{"type":"v1","addr":"172.21.15.172:6829","nonce":3627635035}]},"public_addr":"172.21.15.172:6825/3627635035","cluster_addr":"172.21.15.172:6827/3627635035","heartbeat_back_addr":"172.21.15.172:6831/3627635035","heartbeat_front_addr":"172.21.15.172:6829/3627635035","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T02:29:15.367468+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T02:29:41.518207+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T02:30:06.004371+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T02:30:34.793371+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T02:31:00.878517+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T02:31:26.675956+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T02:31:55.950748+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T02:32:22.824017+0000","dead_epoch":0},{"osd":8,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T02:32:46.775880+0000","dead_epoch":0},{"osd":9,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T02:33:16.420347+0000","dead_epoch":0},{"osd":10,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T02:33:42.185837+0000","dead_epoch":0},{"osd":11,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T02:34:07.312555+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"2.0","mappings":[{"from":7,"to":11}]},{"pgid":"2.b","mappings":[{"from":2,"to":1}]},{"pgid":"2.10","mappings":[{"from":8,"to":11}]},{"pgid":"2.1b","mappings":[{"from":2,"to":4}]},{"pgid":"3.11","mappings":[{"from":4,"to":8}]},{"pgid":"3.24","mappings":[{"from":4,"to":9}]},{"pgid":"3.33","mappings":[{"from":5,"to":9}]},{"pgid":"3.34","mappings":[{"from":4,"to":9}]},{"pgid":"4.2","mappings":[{"from":9,"to":1}]},{"pgid":"4.6","mappings":[{"from":9,"to":11},{"from":5,"to":8}]},{"pgid":"4.19","mappings":[{"from":9,"to":8}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.39:0/684883181":"2024-09-13T02:37:55.928405+0000","172.21.15.39:6801/1725006999":"2024-09-13T02:37:55.928405+0000","172.21.15.39:6800/1074685700":"2024-09-13T02:27:16.531986+0000","172.21.15.39:6801/3152613618":"2024-09-13T02:27:44.717224+0000","172.21.15.39:0/1147479345":"2024-09-13T02:37:55.928405+0000","172.21.15.39:6801/1074685700":"2024-09-13T02:27:16.531986+0000","172.21.15.39:6800/1725006999":"2024-09-13T02:37:55.928405+0000","172.21.15.39:0/4167553412":"2024-09-13T02:37:55.928405+0000","172.21.15.39:0/4075322467":"2024-09-13T02:27:16.531986+0000","172.21.15.39:0/2827440002":"2024-09-13T02:27:16.531986+0000","172.21.15.39:0/2913347539":"2024-09-13T02:27:16.531986+0000","172.21.15.39:0/1527429435":"2024-09-13T02:27:44.717224+0000","172.21.15.39:0/1941318538":"2024-09-13T02:27:44.717224+0000","172.21.15.39:0/2301206766":"2024-09-13T02:27:44.717224+0000","172.21.15.39:6800/3152613618":"2024-09-13T02:27:44.717224+0000","172.21.15.39:0/4180631617":"2024-09-13T02:37:55.928405+0000"},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[{"pool":3,"snaps":[{"begin":7,"length":1},{"begin":19,"length":1}]},{"pool":4,"snaps":[{"begin":7,"length":1},{"begin":19,"length":1}]}],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-12T02:49:44.507 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:49:44.506+0000 7efda2800640 1 -- 172.21.15.39:0/2357767327 >> [v2:172.21.15.39:6800/2187509357,v1:172.21.15.39:6801/2187509357] conn(0x7efd800a2cf0 msgr2=0x7efd800a51b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:49:44.507 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:49:44.506+0000 7efda2800640 1 --2- 172.21.15.39:0/2357767327 >> [v2:172.21.15.39:6800/2187509357,v1:172.21.15.39:6801/2187509357] conn(0x7efd800a2cf0 0x7efd800a51b0 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7efd9c1a0100 tx=0x7efd88005c90 comp rx=0 tx=0).stop 2024-09-12T02:49:44.507 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:49:44.506+0000 7efda2800640 1 -- 172.21.15.39:0/2357767327 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7efd9c074590 msgr2=0x7efd9c19eb20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:49:44.507 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:49:44.506+0000 7efda2800640 1 --2- 172.21.15.39:0/2357767327 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7efd9c074590 0x7efd9c19eb20 secure :-1 s=READY pgs=151 cs=0 l=1 rev1=1 crypto rx=0x7efd8c00e9c0 tx=0x7efd8c00ee80 comp rx=0 tx=0).stop 2024-09-12T02:49:44.508 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:49:44.506+0000 7efda2800640 1 -- 172.21.15.39:0/2357767327 shutdown_connections 2024-09-12T02:49:44.508 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:49:44.506+0000 7efda2800640 1 --2- 172.21.15.39:0/2357767327 >> [v2:172.21.15.39:6800/2187509357,v1:172.21.15.39:6801/2187509357] conn(0x7efd800a2cf0 0x7efd800a51b0 unknown :-1 s=CLOSED pgs=55 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:49:44.508 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:49:44.506+0000 7efda2800640 1 --2- 172.21.15.39:0/2357767327 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7efd9c112b90 0x7efd9c1a3420 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:49:44.508 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:49:44.506+0000 7efda2800640 1 --2- 172.21.15.39:0/2357767327 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7efd9c074eb0 0x7efd9c19f060 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:49:44.508 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:49:44.506+0000 7efda2800640 1 --2- 172.21.15.39:0/2357767327 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7efd9c074590 0x7efd9c19eb20 unknown :-1 s=CLOSED pgs=151 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:49:44.508 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:49:44.506+0000 7efda2800640 1 -- 172.21.15.39:0/2357767327 >> 172.21.15.39:0/2357767327 conn(0x7efd9c0fd8c0 msgr2=0x7efd9c0ff050 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:49:44.508 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:49:44.506+0000 7efda2800640 1 -- 172.21.15.39:0/2357767327 shutdown_connections 2024-09-12T02:49:44.508 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:49:44.506+0000 7efda2800640 1 -- 172.21.15.39:0/2357767327 wait complete. 2024-09-12T02:49:44.909 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 02:49:44 smithi039 ceph-mon[30515]: from='client.? 172.21.15.39:0/2357767327' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-09-12T02:49:45.198 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 12 02:49:44 smithi044 ceph-mon[35411]: from='client.? 172.21.15.39:0/2357767327' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-09-12T02:49:45.263 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 12 02:49:44 smithi172 ceph-mon[35609]: from='client.? 172.21.15.39:0/2357767327' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-09-12T02:49:45.282 DEBUG:teuthology.orchestra.run.smithi039:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc shell --fsid 4954ed46-70ae-11ef-bcea-c7b262605968 -- ceph fs fail cephfs 2024-09-12T02:49:45.659 INFO:teuthology.orchestra.run.smithi039.stderr:Inferring config /var/lib/ceph/4954ed46-70ae-11ef-bcea-c7b262605968/mon.a/config 2024-09-12T02:49:46.099 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 02:49:45 smithi039 ceph-mon[30515]: pgmap v369: 129 pgs: 129 active+clean; 24 MiB data, 494 MiB used, 1.0 TiB / 1.0 TiB avail; 5.7 KiB/s rd, 2.2 KiB/s wr, 10 op/s 2024-09-12T02:49:46.198 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 12 02:49:45 smithi044 ceph-mon[35411]: pgmap v369: 129 pgs: 129 active+clean; 24 MiB data, 494 MiB used, 1.0 TiB / 1.0 TiB avail; 5.7 KiB/s rd, 2.2 KiB/s wr, 10 op/s 2024-09-12T02:49:46.262 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:49:46.261+0000 7f363de00640 1 -- 172.21.15.39:0/3665492615 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f363810e280 msgr2=0x7f3638110670 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:49:46.262 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:49:46.261+0000 7f363de00640 1 --2- 172.21.15.39:0/3665492615 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f363810e280 0x7f3638110670 secure :-1 s=READY pgs=307 cs=0 l=1 rev1=1 crypto rx=0x7f3630009ca0 tx=0x7f363002a950 comp rx=0 tx=0).stop 2024-09-12T02:49:46.263 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:49:46.261+0000 7f363de00640 1 -- 172.21.15.39:0/3665492615 shutdown_connections 2024-09-12T02:49:46.263 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:49:46.261+0000 7f363de00640 1 --2- 172.21.15.39:0/3665492615 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f363810e280 0x7f3638110670 unknown :-1 s=CLOSED pgs=307 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:49:46.263 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:49:46.261+0000 7f363de00640 1 --2- 172.21.15.39:0/3665492615 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f3638074e30 0x7f363810dd40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:49:46.263 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:49:46.261+0000 7f363de00640 1 --2- 172.21.15.39:0/3665492615 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f3638074510 0x7f36380748f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:49:46.263 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:49:46.261+0000 7f363de00640 1 -- 172.21.15.39:0/3665492615 >> 172.21.15.39:0/3665492615 conn(0x7f36380fd6e0 msgr2=0x7f36380ffb00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:49:46.263 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:49:46.262+0000 7f363de00640 1 -- 172.21.15.39:0/3665492615 shutdown_connections 2024-09-12T02:49:46.263 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:49:46.262+0000 7f363de00640 1 -- 172.21.15.39:0/3665492615 wait complete. 2024-09-12T02:49:46.264 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 12 02:49:45 smithi172 ceph-mon[35609]: pgmap v369: 129 pgs: 129 active+clean; 24 MiB data, 494 MiB used, 1.0 TiB / 1.0 TiB avail; 5.7 KiB/s rd, 2.2 KiB/s wr, 10 op/s 2024-09-12T02:49:46.265 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:49:46.262+0000 7f363de00640 1 Processor -- start 2024-09-12T02:49:46.265 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:49:46.263+0000 7f363de00640 1 -- start start 2024-09-12T02:49:46.265 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:49:46.263+0000 7f363de00640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f3638074510 0x7f363819a460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:49:46.265 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:49:46.263+0000 7f363de00640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f3638074e30 0x7f363819a9a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:49:46.266 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:49:46.263+0000 7f363de00640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f363810e280 0x7f363819ed30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:49:46.266 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:49:46.263+0000 7f363de00640 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 -- 0x7f3638113f70 con 0x7f3638074e30 2024-09-12T02:49:46.266 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:49:46.263+0000 7f363de00640 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x7f3638113df0 con 0x7f3638074510 2024-09-12T02:49:46.266 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:49:46.263+0000 7f363de00640 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7f36381140f0 con 0x7f363810e280 2024-09-12T02:49:46.266 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:49:46.263+0000 7f363d400640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f363810e280 0x7f363819ed30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:49:46.266 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:49:46.263+0000 7f3637e00640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f3638074e30 0x7f363819a9a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:49:46.266 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:49:46.263+0000 7f363d400640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f363810e280 0x7f363819ed30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.172:3300/0 says I am v2:172.21.15.39:53042/0 (socket says 172.21.15.39:53042) 2024-09-12T02:49:46.266 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:49:46.263+0000 7f363d400640 1 -- 172.21.15.39:0/726211542 learned_addr learned my addr 172.21.15.39:0/726211542 (peer_addr_for_me v2:172.21.15.39:0/0) 2024-09-12T02:49:46.266 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:49:46.263+0000 7f363ca00640 1 --2- 172.21.15.39:0/726211542 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f3638074510 0x7f363819a460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:49:46.266 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:49:46.264+0000 7f363d400640 1 -- 172.21.15.39:0/726211542 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f3638074510 msgr2=0x7f363819a460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:49:46.266 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:49:46.264+0000 7f363d400640 1 --2- 172.21.15.39:0/726211542 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f3638074510 0x7f363819a460 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:49:46.266 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:49:46.264+0000 7f363d400640 1 -- 172.21.15.39:0/726211542 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f3638074e30 msgr2=0x7f363819a9a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:49:46.266 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:49:46.264+0000 7f363d400640 1 --2- 172.21.15.39:0/726211542 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f3638074e30 0x7f363819a9a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:49:46.266 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:49:46.264+0000 7f363d400640 1 -- 172.21.15.39:0/726211542 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f363819f410 con 0x7f363810e280 2024-09-12T02:49:46.267 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:49:46.264+0000 7f363d400640 1 --2- 172.21.15.39:0/726211542 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f363810e280 0x7f363819ed30 secure :-1 s=READY pgs=126 cs=0 l=1 rev1=1 crypto rx=0x7f3630004af0 tx=0x7f363002f5b0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:49:46.267 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:49:46.264+0000 7f3635600640 1 -- 172.21.15.39:0/726211542 <== mon.1 v2:172.21.15.172:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3630034040 con 0x7f363810e280 2024-09-12T02:49:46.267 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:49:46.264+0000 7f363de00640 1 -- 172.21.15.39:0/726211542 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f363819f6a0 con 0x7f363810e280 2024-09-12T02:49:46.267 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:49:46.265+0000 7f3635600640 1 -- 172.21.15.39:0/726211542 <== mon.1 v2:172.21.15.172:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f3630030920 con 0x7f363810e280 2024-09-12T02:49:46.267 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:49:46.265+0000 7f3635600640 1 -- 172.21.15.39:0/726211542 <== mon.1 v2:172.21.15.172:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3630004780 con 0x7f363810e280 2024-09-12T02:49:46.267 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:49:46.265+0000 7f363de00640 1 -- 172.21.15.39:0/726211542 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f36381a6fe0 con 0x7f363810e280 2024-09-12T02:49:46.267 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:49:46.266+0000 7f363de00640 1 -- 172.21.15.39:0/726211542 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f36380748f0 con 0x7f363810e280 2024-09-12T02:49:46.268 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:49:46.268+0000 7f3635600640 1 -- 172.21.15.39:0/726211542 <== mon.1 v2:172.21.15.172:3300/0 4 ==== mgrmap(e 27) ==== 137964+0+0 (secure 0 0 0) 0x7f3630037020 con 0x7f363810e280 2024-09-12T02:49:46.270 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:49:46.269+0000 7f3635600640 1 --2- 172.21.15.39:0/726211542 >> [v2:172.21.15.39:6800/2187509357,v1:172.21.15.39:6801/2187509357] conn(0x7f36200a2cf0 0x7f36200a51b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:49:46.270 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:49:46.269+0000 7f3635600640 1 -- 172.21.15.39:0/726211542 <== mon.1 v2:172.21.15.172:3300/0 5 ==== osd_map(108..108 src has 1..108) ==== 9475+0+0 (secure 0 0 0) 0x7f36300f0560 con 0x7f363810e280 2024-09-12T02:49:46.270 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:49:46.269+0000 7f363ca00640 1 --2- 172.21.15.39:0/726211542 >> [v2:172.21.15.39:6800/2187509357,v1:172.21.15.39:6801/2187509357] conn(0x7f36200a2cf0 0x7f36200a51b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:49:46.270 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:49:46.270+0000 7f363ca00640 1 --2- 172.21.15.39:0/726211542 >> [v2:172.21.15.39:6800/2187509357,v1:172.21.15.39:6801/2187509357] conn(0x7f36200a2cf0 0x7f36200a51b0 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x7f362c005fd0 tx=0x7f362c005850 comp rx=0 tx=0).ready entity=mgr.25199 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:49:46.271 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:49:46.271+0000 7f3635600640 1 -- 172.21.15.39:0/726211542 <== mon.1 v2:172.21.15.172:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7f36300bced0 con 0x7f363810e280 2024-09-12T02:49:46.494 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:49:46.493+0000 7f363de00640 1 -- 172.21.15.39:0/726211542 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_command({"prefix": "fs fail", "fs_name": "cephfs"} v 0) -- 0x7f3638109400 con 0x7f363810e280 2024-09-12T02:49:46.505 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:49:46.504+0000 7f3635600640 1 -- 172.21.15.39:0/726211542 <== mon.1 v2:172.21.15.172:3300/0 7 ==== mon_command_ack([{"prefix": "fs fail", "fs_name": "cephfs"}]=0 cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. v30) ==== 161+0+0 (secure 0 0 0) 0x7f36300bc7d0 con 0x7f363810e280 2024-09-12T02:49:46.505 INFO:teuthology.orchestra.run.smithi039.stderr:cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. 2024-09-12T02:49:46.507 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:49:46.506+0000 7f363de00640 1 -- 172.21.15.39:0/726211542 >> [v2:172.21.15.39:6800/2187509357,v1:172.21.15.39:6801/2187509357] conn(0x7f36200a2cf0 msgr2=0x7f36200a51b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:49:46.507 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:49:46.506+0000 7f363de00640 1 --2- 172.21.15.39:0/726211542 >> [v2:172.21.15.39:6800/2187509357,v1:172.21.15.39:6801/2187509357] conn(0x7f36200a2cf0 0x7f36200a51b0 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x7f362c005fd0 tx=0x7f362c005850 comp rx=0 tx=0).stop 2024-09-12T02:49:46.507 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:49:46.506+0000 7f363de00640 1 -- 172.21.15.39:0/726211542 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f363810e280 msgr2=0x7f363819ed30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:49:46.507 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:49:46.506+0000 7f363de00640 1 --2- 172.21.15.39:0/726211542 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f363810e280 0x7f363819ed30 secure :-1 s=READY pgs=126 cs=0 l=1 rev1=1 crypto rx=0x7f3630004af0 tx=0x7f363002f5b0 comp rx=0 tx=0).stop 2024-09-12T02:49:46.507 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:49:46.506+0000 7f363de00640 1 -- 172.21.15.39:0/726211542 shutdown_connections 2024-09-12T02:49:46.507 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:49:46.506+0000 7f363de00640 1 --2- 172.21.15.39:0/726211542 >> [v2:172.21.15.39:6800/2187509357,v1:172.21.15.39:6801/2187509357] conn(0x7f36200a2cf0 0x7f36200a51b0 unknown :-1 s=CLOSED pgs=56 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:49:46.507 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:49:46.506+0000 7f363de00640 1 --2- 172.21.15.39:0/726211542 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f363810e280 0x7f363819ed30 unknown :-1 s=CLOSED pgs=126 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:49:46.508 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:49:46.506+0000 7f363de00640 1 --2- 172.21.15.39:0/726211542 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f3638074e30 0x7f363819a9a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:49:46.508 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:49:46.506+0000 7f363de00640 1 --2- 172.21.15.39:0/726211542 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f3638074510 0x7f363819a460 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:49:46.508 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:49:46.506+0000 7f363de00640 1 -- 172.21.15.39:0/726211542 >> 172.21.15.39:0/726211542 conn(0x7f36380fd6e0 msgr2=0x7f36380fee10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:49:46.508 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:49:46.506+0000 7f363de00640 1 -- 172.21.15.39:0/726211542 shutdown_connections 2024-09-12T02:49:46.508 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:49:46.506+0000 7f363de00640 1 -- 172.21.15.39:0/726211542 wait complete. 2024-09-12T02:49:46.802 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 02:49:46 smithi039 ceph-4954ed46-70ae-11ef-bcea-c7b262605968-mon-a[30511]: 2024-09-12T02:49:46.495+0000 7ff1a5200640 -1 log_channel(cluster) log [ERR] : Health check failed: 1 filesystem is offline (MDS_ALL_DOWN) 2024-09-12T02:49:46.803 INFO:journalctl@ceph.mds.d.smithi039.stdout:Sep 12 02:49:46 smithi039 ceph-4954ed46-70ae-11ef-bcea-c7b262605968-mds-d[69556]: ignoring --setuser ceph since I am not root 2024-09-12T02:49:46.803 INFO:journalctl@ceph.mds.d.smithi039.stdout:Sep 12 02:49:46 smithi039 ceph-4954ed46-70ae-11ef-bcea-c7b262605968-mds-d[69556]: ignoring --setgroup ceph since I am not root 2024-09-12T02:49:46.803 INFO:journalctl@ceph.mds.d.smithi039.stdout:Sep 12 02:49:46 smithi039 ceph-mds[69560]: -- 172.21.15.39:0/1585314961 <== mon.2 v2:172.21.15.44:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 194+0+0 (secure 0 0 0) 0x55714353f860 con 0x55714351d000 2024-09-12T02:49:46.803 INFO:journalctl@ceph.mds.d.smithi039.stdout:Sep 12 02:49:46 smithi039 ceph-4954ed46-70ae-11ef-bcea-c7b262605968-mds-d[69556]: starting mds.d at 2024-09-12T02:49:46.803 INFO:journalctl@ceph.mds.a.smithi039.stdout:Sep 12 02:49:46 smithi039 ceph-4954ed46-70ae-11ef-bcea-c7b262605968-mds-a[70722]: ignoring --setuser ceph since I am not root 2024-09-12T02:49:46.803 INFO:journalctl@ceph.mds.a.smithi039.stdout:Sep 12 02:49:46 smithi039 ceph-4954ed46-70ae-11ef-bcea-c7b262605968-mds-a[70722]: ignoring --setgroup ceph since I am not root 2024-09-12T02:49:46.803 INFO:journalctl@ceph.mds.a.smithi039.stdout:Sep 12 02:49:46 smithi039 ceph-mds[70726]: -- 172.21.15.39:0/3460951084 <== mon.1 v2:172.21.15.172:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 194+0+0 (secure 0 0 0) 0x55aa99ea9c20 con 0x55aa99e86800 2024-09-12T02:49:46.803 INFO:journalctl@ceph.mds.a.smithi039.stdout:Sep 12 02:49:46 smithi039 ceph-4954ed46-70ae-11ef-bcea-c7b262605968-mds-a[70722]: starting mds.a at 2024-09-12T02:49:46.804 INFO:journalctl@ceph.mds.f.smithi172.stdout:Sep 12 02:49:46 smithi172 ceph-4954ed46-70ae-11ef-bcea-c7b262605968-mds-f[65921]: ignoring --setuser ceph since I am not root 2024-09-12T02:49:46.804 INFO:journalctl@ceph.mds.f.smithi172.stdout:Sep 12 02:49:46 smithi172 ceph-4954ed46-70ae-11ef-bcea-c7b262605968-mds-f[65921]: ignoring --setgroup ceph since I am not root 2024-09-12T02:49:46.804 INFO:journalctl@ceph.mds.f.smithi172.stdout:Sep 12 02:49:46 smithi172 ceph-mds[65925]: -- 172.21.15.172:0/3539718517 <== mon.1 v2:172.21.15.172:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 194+0+0 (secure 0 0 0) 0x5575e4a89860 con 0x5575e4a67000 2024-09-12T02:49:46.804 INFO:journalctl@ceph.mds.f.smithi172.stdout:Sep 12 02:49:46 smithi172 ceph-4954ed46-70ae-11ef-bcea-c7b262605968-mds-f[65921]: starting mds.f at 2024-09-12T02:49:46.805 INFO:journalctl@ceph.mds.b.smithi044.stdout:Sep 12 02:49:46 smithi044 ceph-4954ed46-70ae-11ef-bcea-c7b262605968-mds-b[65334]: ignoring --setuser ceph since I am not root 2024-09-12T02:49:46.805 INFO:journalctl@ceph.mds.b.smithi044.stdout:Sep 12 02:49:46 smithi044 ceph-4954ed46-70ae-11ef-bcea-c7b262605968-mds-b[65334]: ignoring --setgroup ceph since I am not root 2024-09-12T02:49:46.805 INFO:journalctl@ceph.mds.b.smithi044.stdout:Sep 12 02:49:46 smithi044 ceph-mds[65338]: -- 172.21.15.44:0/576792127 <== mon.2 v2:172.21.15.44:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 194+0+0 (secure 0 0 0) 0x557d12967860 con 0x557d12944800 2024-09-12T02:49:46.805 INFO:journalctl@ceph.mds.b.smithi044.stdout:Sep 12 02:49:46 smithi044 ceph-4954ed46-70ae-11ef-bcea-c7b262605968-mds-b[65334]: starting mds.b at 2024-09-12T02:49:46.805 INFO:journalctl@ceph.mds.l.smithi172.stdout:Sep 12 02:49:46 smithi172 ceph-4954ed46-70ae-11ef-bcea-c7b262605968-mds-l[65622]: ignoring --setuser ceph since I am not root 2024-09-12T02:49:46.805 INFO:journalctl@ceph.mds.l.smithi172.stdout:Sep 12 02:49:46 smithi172 ceph-4954ed46-70ae-11ef-bcea-c7b262605968-mds-l[65622]: ignoring --setgroup ceph since I am not root 2024-09-12T02:49:46.805 INFO:journalctl@ceph.mds.l.smithi172.stdout:Sep 12 02:49:46 smithi172 ceph-mds[65626]: -- 172.21.15.172:0/2815191572 <== mon.1 v2:172.21.15.172:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 194+0+0 (secure 0 0 0) 0x56261e413860 con 0x56261e3f1400 2024-09-12T02:49:46.805 INFO:journalctl@ceph.mds.l.smithi172.stdout:Sep 12 02:49:46 smithi172 ceph-4954ed46-70ae-11ef-bcea-c7b262605968-mds-l[65622]: starting mds.l at 2024-09-12T02:49:46.806 INFO:journalctl@ceph.mds.k.smithi044.stdout:Sep 12 02:49:46 smithi044 ceph-4954ed46-70ae-11ef-bcea-c7b262605968-mds-k[64414]: ignoring --setuser ceph since I am not root 2024-09-12T02:49:46.806 INFO:journalctl@ceph.mds.k.smithi044.stdout:Sep 12 02:49:46 smithi044 ceph-4954ed46-70ae-11ef-bcea-c7b262605968-mds-k[64414]: ignoring --setgroup ceph since I am not root 2024-09-12T02:49:46.806 INFO:journalctl@ceph.mds.k.smithi044.stdout:Sep 12 02:49:46 smithi044 ceph-mds[64418]: -- 172.21.15.44:0/2286031155 <== mon.1 v2:172.21.15.172:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 194+0+0 (secure 0 0 0) 0x55746d647c20 con 0x55746d625400 2024-09-12T02:49:46.806 INFO:journalctl@ceph.mds.k.smithi044.stdout:Sep 12 02:49:46 smithi044 ceph-4954ed46-70ae-11ef-bcea-c7b262605968-mds-k[64414]: starting mds.k at 2024-09-12T02:49:46.806 INFO:journalctl@ceph.mds.i.smithi172.stdout:Sep 12 02:49:46 smithi172 ceph-4954ed46-70ae-11ef-bcea-c7b262605968-mds-i[66523]: ignoring --setuser ceph since I am not root 2024-09-12T02:49:46.806 INFO:journalctl@ceph.mds.i.smithi172.stdout:Sep 12 02:49:46 smithi172 ceph-4954ed46-70ae-11ef-bcea-c7b262605968-mds-i[66523]: ignoring --setgroup ceph since I am not root 2024-09-12T02:49:46.806 INFO:journalctl@ceph.mds.i.smithi172.stdout:Sep 12 02:49:46 smithi172 ceph-mds[66527]: -- 172.21.15.172:0/2227730464 <== mon.1 v2:172.21.15.172:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 194+0+0 (secure 0 0 0) 0x55bc1a117860 con 0x55bc1a0f4800 2024-09-12T02:49:46.806 INFO:journalctl@ceph.mds.i.smithi172.stdout:Sep 12 02:49:46 smithi172 ceph-4954ed46-70ae-11ef-bcea-c7b262605968-mds-i[66523]: starting mds.i at 2024-09-12T02:49:46.807 INFO:journalctl@ceph.mds.h.smithi044.stdout:Sep 12 02:49:46 smithi044 ceph-4954ed46-70ae-11ef-bcea-c7b262605968-mds-h[65035]: ignoring --setuser ceph since I am not root 2024-09-12T02:49:46.807 INFO:journalctl@ceph.mds.h.smithi044.stdout:Sep 12 02:49:46 smithi044 ceph-4954ed46-70ae-11ef-bcea-c7b262605968-mds-h[65035]: ignoring --setgroup ceph since I am not root 2024-09-12T02:49:46.807 INFO:journalctl@ceph.mds.h.smithi044.stdout:Sep 12 02:49:46 smithi044 ceph-mds[65039]: -- 172.21.15.44:0/733402569 <== mon.1 v2:172.21.15.172:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x564c54e26680 con 0x564c54dfa800 2024-09-12T02:49:46.807 INFO:journalctl@ceph.mds.h.smithi044.stdout:Sep 12 02:49:46 smithi044 ceph-mds[65039]: -- 172.21.15.44:0/733402569 <== mon.1 v2:172.21.15.172:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 194+0+0 (secure 0 0 0) 0x564c54e1d860 con 0x564c54dfa800 2024-09-12T02:49:46.807 INFO:journalctl@ceph.mds.h.smithi044.stdout:Sep 12 02:49:46 smithi044 ceph-4954ed46-70ae-11ef-bcea-c7b262605968-mds-h[65035]: starting mds.h at 2024-09-12T02:49:46.807 INFO:journalctl@ceph.mds.c.smithi172.stdout:Sep 12 02:49:46 smithi172 ceph-4954ed46-70ae-11ef-bcea-c7b262605968-mds-c[66220]: ignoring --setuser ceph since I am not root 2024-09-12T02:49:46.807 INFO:journalctl@ceph.mds.c.smithi172.stdout:Sep 12 02:49:46 smithi172 ceph-4954ed46-70ae-11ef-bcea-c7b262605968-mds-c[66220]: ignoring --setgroup ceph since I am not root 2024-09-12T02:49:46.807 INFO:journalctl@ceph.mds.c.smithi172.stdout:Sep 12 02:49:46 smithi172 ceph-mds[66224]: -- 172.21.15.172:0/2374655836 <== mon.1 v2:172.21.15.172:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 194+0+0 (secure 0 0 0) 0x564f94c13860 con 0x564f94bf0800 2024-09-12T02:49:46.807 INFO:journalctl@ceph.mds.c.smithi172.stdout:Sep 12 02:49:46 smithi172 ceph-4954ed46-70ae-11ef-bcea-c7b262605968-mds-c[66220]: starting mds.c at 2024-09-12T02:49:46.808 INFO:journalctl@ceph.mds.e.smithi044.stdout:Sep 12 02:49:46 smithi044 ceph-4954ed46-70ae-11ef-bcea-c7b262605968-mds-e[64730]: ignoring --setuser ceph since I am not root 2024-09-12T02:49:46.808 INFO:journalctl@ceph.mds.e.smithi044.stdout:Sep 12 02:49:46 smithi044 ceph-4954ed46-70ae-11ef-bcea-c7b262605968-mds-e[64730]: ignoring --setgroup ceph since I am not root 2024-09-12T02:49:46.808 INFO:journalctl@ceph.mds.e.smithi044.stdout:Sep 12 02:49:46 smithi044 ceph-mds[64734]: -- 172.21.15.44:0/3037305832 <== mon.2 v2:172.21.15.44:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 194+0+0 (secure 0 0 0) 0x55e4c7f45860 con 0x55e4c7f22800 2024-09-12T02:49:46.808 INFO:journalctl@ceph.mds.e.smithi044.stdout:Sep 12 02:49:46 smithi044 ceph-4954ed46-70ae-11ef-bcea-c7b262605968-mds-e[64730]: starting mds.e at 2024-09-12T02:49:47.100 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 02:49:46 smithi039 ceph-mon[30515]: from='client.? 172.21.15.39:0/726211542' entity='client.admin' cmd=[{"prefix": "fs fail", "fs_name": "cephfs"}]: dispatch 2024-09-12T02:49:47.100 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 02:49:46 smithi039 ceph-mon[30515]: from='client.? ' entity='client.admin' cmd=[{"prefix": "fs fail", "fs_name": "cephfs"}]: dispatch 2024-09-12T02:49:47.100 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 02:49:46 smithi039 ceph-mon[30515]: Health check failed: 1 filesystem is degraded (FS_DEGRADED) 2024-09-12T02:49:47.100 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 02:49:46 smithi039 ceph-mon[30515]: Health check failed: 1 filesystem is offline (MDS_ALL_DOWN) 2024-09-12T02:49:47.101 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 02:49:46 smithi039 ceph-mon[30515]: from='client.? ' entity='client.admin' cmd='[{"prefix": "fs fail", "fs_name": "cephfs"}]': finished 2024-09-12T02:49:47.101 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 02:49:46 smithi039 ceph-mon[30515]: osdmap e109: 12 total, 12 up, 12 in 2024-09-12T02:49:47.101 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 02:49:46 smithi039 ceph-mon[30515]: fsmap cephfs:0/5 2 up:standby, 5 failed 2024-09-12T02:49:47.199 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 12 02:49:46 smithi044 ceph-mon[35411]: from='client.? 172.21.15.39:0/726211542' entity='client.admin' cmd=[{"prefix": "fs fail", "fs_name": "cephfs"}]: dispatch 2024-09-12T02:49:47.199 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 12 02:49:46 smithi044 ceph-mon[35411]: from='client.? ' entity='client.admin' cmd=[{"prefix": "fs fail", "fs_name": "cephfs"}]: dispatch 2024-09-12T02:49:47.199 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 12 02:49:46 smithi044 ceph-mon[35411]: Health check failed: 1 filesystem is degraded (FS_DEGRADED) 2024-09-12T02:49:47.199 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 12 02:49:46 smithi044 ceph-mon[35411]: Health check failed: 1 filesystem is offline (MDS_ALL_DOWN) 2024-09-12T02:49:47.199 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 12 02:49:46 smithi044 ceph-mon[35411]: from='client.? ' entity='client.admin' cmd='[{"prefix": "fs fail", "fs_name": "cephfs"}]': finished 2024-09-12T02:49:47.199 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 12 02:49:46 smithi044 ceph-mon[35411]: osdmap e109: 12 total, 12 up, 12 in 2024-09-12T02:49:47.199 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 12 02:49:46 smithi044 ceph-mon[35411]: fsmap cephfs:0/5 2 up:standby, 5 failed 2024-09-12T02:49:47.263 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 12 02:49:46 smithi172 ceph-mon[35609]: from='client.? 172.21.15.39:0/726211542' entity='client.admin' cmd=[{"prefix": "fs fail", "fs_name": "cephfs"}]: dispatch 2024-09-12T02:49:47.263 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 12 02:49:46 smithi172 ceph-mon[35609]: from='client.? ' entity='client.admin' cmd=[{"prefix": "fs fail", "fs_name": "cephfs"}]: dispatch 2024-09-12T02:49:47.264 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 12 02:49:46 smithi172 ceph-mon[35609]: Health check failed: 1 filesystem is degraded (FS_DEGRADED) 2024-09-12T02:49:47.264 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 12 02:49:46 smithi172 ceph-mon[35609]: Health check failed: 1 filesystem is offline (MDS_ALL_DOWN) 2024-09-12T02:49:47.264 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 12 02:49:46 smithi172 ceph-mon[35609]: from='client.? ' entity='client.admin' cmd='[{"prefix": "fs fail", "fs_name": "cephfs"}]': finished 2024-09-12T02:49:47.264 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 12 02:49:46 smithi172 ceph-mon[35609]: osdmap e109: 12 total, 12 up, 12 in 2024-09-12T02:49:47.264 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 12 02:49:46 smithi172 ceph-mon[35609]: fsmap cephfs:0/5 2 up:standby, 5 failed 2024-09-12T02:49:47.288 DEBUG:teuthology.orchestra.run.smithi039:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc shell --fsid 4954ed46-70ae-11ef-bcea-c7b262605968 -- ceph fs rm cephfs --yes-i-really-mean-it 2024-09-12T02:49:47.671 INFO:teuthology.orchestra.run.smithi039.stderr:Inferring config /var/lib/ceph/4954ed46-70ae-11ef-bcea-c7b262605968/mon.a/config 2024-09-12T02:49:48.089 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 02:49:47 smithi039 ceph-mon[30515]: pgmap v370: 129 pgs: 129 active+clean; 24 MiB data, 494 MiB used, 1.0 TiB / 1.0 TiB avail; 5.7 KiB/s rd, 2.2 KiB/s wr, 10 op/s 2024-09-12T02:49:48.089 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 02:49:47 smithi039 ceph-mon[30515]: mds.? [v2:172.21.15.172:6832/2541397375,v1:172.21.15.172:6833/2541397375] up:boot 2024-09-12T02:49:48.089 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 02:49:47 smithi039 ceph-mon[30515]: mds.? [v2:172.21.15.44:6832/236224065,v1:172.21.15.44:6835/236224065] up:boot 2024-09-12T02:49:48.089 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 02:49:47 smithi039 ceph-mon[30515]: mds.? [v2:172.21.15.44:6833/340747318,v1:172.21.15.44:6836/340747318] up:boot 2024-09-12T02:49:48.089 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 02:49:47 smithi039 ceph-mon[30515]: mds.? [v2:172.21.15.44:6834/1130430027,v1:172.21.15.44:6838/1130430027] up:boot 2024-09-12T02:49:48.089 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 02:49:47 smithi039 ceph-mon[30515]: mds.? [v2:172.21.15.44:6837/870461679,v1:172.21.15.44:6839/870461679] up:boot 2024-09-12T02:49:48.089 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 02:49:47 smithi039 ceph-mon[30515]: mds.? [v2:172.21.15.172:6834/2907267127,v1:172.21.15.172:6835/2907267127] up:boot 2024-09-12T02:49:48.089 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 02:49:47 smithi039 ceph-mon[30515]: mds.? [v2:172.21.15.172:6836/1100724587,v1:172.21.15.172:6837/1100724587] up:boot 2024-09-12T02:49:48.089 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 02:49:47 smithi039 ceph-mon[30515]: mds.? [v2:172.21.15.172:6838/3228097905,v1:172.21.15.172:6839/3228097905] up:boot 2024-09-12T02:49:48.089 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 02:49:47 smithi039 ceph-mon[30515]: mds.? [v2:172.21.15.39:6836/2155101557,v1:172.21.15.39:6837/2155101557] up:boot 2024-09-12T02:49:48.089 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 02:49:47 smithi039 ceph-mon[30515]: mds.? [v2:172.21.15.39:6840/1798269204,v1:172.21.15.39:6841/1798269204] up:boot 2024-09-12T02:49:48.090 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 02:49:47 smithi039 ceph-mon[30515]: fsmap cephfs:0/5 12 up:standby, 5 failed 2024-09-12T02:49:48.090 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 02:49:47 smithi039 ceph-mon[30515]: from='mgr.25199 172.21.15.39:0/1270637502' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "d"}]: dispatch 2024-09-12T02:49:48.090 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 02:49:47 smithi039 ceph-mon[30515]: from='mgr.25199 172.21.15.39:0/1270637502' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "a"}]: dispatch 2024-09-12T02:49:48.090 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 02:49:47 smithi039 ceph-mon[30515]: from='mgr.25199 172.21.15.39:0/1270637502' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "f"}]: dispatch 2024-09-12T02:49:48.090 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 02:49:47 smithi039 ceph-mon[30515]: from='mgr.25199 172.21.15.39:0/1270637502' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "k"}]: dispatch 2024-09-12T02:49:48.090 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 02:49:47 smithi039 ceph-mon[30515]: from='mgr.25199 172.21.15.39:0/1270637502' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "h"}]: dispatch 2024-09-12T02:49:48.090 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 02:49:47 smithi039 ceph-mon[30515]: from='mgr.25199 172.21.15.39:0/1270637502' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "e"}]: dispatch 2024-09-12T02:49:48.090 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 02:49:47 smithi039 ceph-mon[30515]: from='mgr.25199 172.21.15.39:0/1270637502' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "b"}]: dispatch 2024-09-12T02:49:48.090 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 02:49:47 smithi039 ceph-mon[30515]: from='mgr.25199 172.21.15.39:0/1270637502' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "c"}]: dispatch 2024-09-12T02:49:48.090 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 02:49:47 smithi039 ceph-mon[30515]: from='mgr.25199 172.21.15.39:0/1270637502' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "l"}]: dispatch 2024-09-12T02:49:48.090 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 02:49:47 smithi039 ceph-mon[30515]: from='mgr.25199 172.21.15.39:0/1270637502' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "i"}]: dispatch 2024-09-12T02:49:48.199 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 12 02:49:47 smithi044 ceph-mon[35411]: pgmap v370: 129 pgs: 129 active+clean; 24 MiB data, 494 MiB used, 1.0 TiB / 1.0 TiB avail; 5.7 KiB/s rd, 2.2 KiB/s wr, 10 op/s 2024-09-12T02:49:48.199 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 12 02:49:47 smithi044 ceph-mon[35411]: mds.? [v2:172.21.15.172:6832/2541397375,v1:172.21.15.172:6833/2541397375] up:boot 2024-09-12T02:49:48.199 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 12 02:49:47 smithi044 ceph-mon[35411]: mds.? [v2:172.21.15.44:6832/236224065,v1:172.21.15.44:6835/236224065] up:boot 2024-09-12T02:49:48.199 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 12 02:49:47 smithi044 ceph-mon[35411]: mds.? [v2:172.21.15.44:6833/340747318,v1:172.21.15.44:6836/340747318] up:boot 2024-09-12T02:49:48.199 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 12 02:49:47 smithi044 ceph-mon[35411]: mds.? [v2:172.21.15.44:6834/1130430027,v1:172.21.15.44:6838/1130430027] up:boot 2024-09-12T02:49:48.199 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 12 02:49:47 smithi044 ceph-mon[35411]: mds.? [v2:172.21.15.44:6837/870461679,v1:172.21.15.44:6839/870461679] up:boot 2024-09-12T02:49:48.199 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 12 02:49:47 smithi044 ceph-mon[35411]: mds.? [v2:172.21.15.172:6834/2907267127,v1:172.21.15.172:6835/2907267127] up:boot 2024-09-12T02:49:48.199 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 12 02:49:47 smithi044 ceph-mon[35411]: mds.? [v2:172.21.15.172:6836/1100724587,v1:172.21.15.172:6837/1100724587] up:boot 2024-09-12T02:49:48.199 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 12 02:49:47 smithi044 ceph-mon[35411]: mds.? [v2:172.21.15.172:6838/3228097905,v1:172.21.15.172:6839/3228097905] up:boot 2024-09-12T02:49:48.199 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 12 02:49:47 smithi044 ceph-mon[35411]: mds.? [v2:172.21.15.39:6836/2155101557,v1:172.21.15.39:6837/2155101557] up:boot 2024-09-12T02:49:48.199 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 12 02:49:47 smithi044 ceph-mon[35411]: mds.? [v2:172.21.15.39:6840/1798269204,v1:172.21.15.39:6841/1798269204] up:boot 2024-09-12T02:49:48.200 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 12 02:49:47 smithi044 ceph-mon[35411]: fsmap cephfs:0/5 12 up:standby, 5 failed 2024-09-12T02:49:48.200 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 12 02:49:47 smithi044 ceph-mon[35411]: from='mgr.25199 172.21.15.39:0/1270637502' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "d"}]: dispatch 2024-09-12T02:49:48.200 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 12 02:49:47 smithi044 ceph-mon[35411]: from='mgr.25199 172.21.15.39:0/1270637502' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "a"}]: dispatch 2024-09-12T02:49:48.200 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 12 02:49:47 smithi044 ceph-mon[35411]: from='mgr.25199 172.21.15.39:0/1270637502' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "f"}]: dispatch 2024-09-12T02:49:48.200 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 12 02:49:47 smithi044 ceph-mon[35411]: from='mgr.25199 172.21.15.39:0/1270637502' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "k"}]: dispatch 2024-09-12T02:49:48.200 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 12 02:49:47 smithi044 ceph-mon[35411]: from='mgr.25199 172.21.15.39:0/1270637502' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "h"}]: dispatch 2024-09-12T02:49:48.200 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 12 02:49:47 smithi044 ceph-mon[35411]: from='mgr.25199 172.21.15.39:0/1270637502' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "e"}]: dispatch 2024-09-12T02:49:48.200 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 12 02:49:47 smithi044 ceph-mon[35411]: from='mgr.25199 172.21.15.39:0/1270637502' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "b"}]: dispatch 2024-09-12T02:49:48.200 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 12 02:49:47 smithi044 ceph-mon[35411]: from='mgr.25199 172.21.15.39:0/1270637502' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "c"}]: dispatch 2024-09-12T02:49:48.200 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 12 02:49:47 smithi044 ceph-mon[35411]: from='mgr.25199 172.21.15.39:0/1270637502' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "l"}]: dispatch 2024-09-12T02:49:48.200 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 12 02:49:47 smithi044 ceph-mon[35411]: from='mgr.25199 172.21.15.39:0/1270637502' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "i"}]: dispatch 2024-09-12T02:49:48.221 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:49:48.207+0000 7f4362600640 1 -- 172.21.15.39:0/4286011448 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f435c074f40 msgr2=0x7f435c10de80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:49:48.221 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:49:48.207+0000 7f4362600640 1 --2- 172.21.15.39:0/4286011448 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f435c074f40 0x7f435c10de80 secure :-1 s=READY pgs=156 cs=0 l=1 rev1=1 crypto rx=0x7f4344009900 tx=0x7f434402a480 comp rx=0 tx=0).stop 2024-09-12T02:49:48.222 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:49:48.207+0000 7f4362600640 1 -- 172.21.15.39:0/4286011448 shutdown_connections 2024-09-12T02:49:48.222 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:49:48.207+0000 7f4362600640 1 --2- 172.21.15.39:0/4286011448 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f435c10e3c0 0x7f435c110810 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:49:48.222 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:49:48.207+0000 7f4362600640 1 --2- 172.21.15.39:0/4286011448 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f435c074f40 0x7f435c10de80 unknown :-1 s=CLOSED pgs=156 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:49:48.222 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:49:48.207+0000 7f4362600640 1 --2- 172.21.15.39:0/4286011448 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f435c074620 0x7f435c074a00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:49:48.222 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:49:48.207+0000 7f4362600640 1 -- 172.21.15.39:0/4286011448 >> 172.21.15.39:0/4286011448 conn(0x7f435c0fd8c0 msgr2=0x7f435c0ffce0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:49:48.222 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:49:48.207+0000 7f4362600640 1 -- 172.21.15.39:0/4286011448 shutdown_connections 2024-09-12T02:49:48.222 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:49:48.207+0000 7f4362600640 1 -- 172.21.15.39:0/4286011448 wait complete. 2024-09-12T02:49:48.223 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:49:48.208+0000 7f4362600640 1 Processor -- start 2024-09-12T02:49:48.223 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:49:48.208+0000 7f4362600640 1 -- start start 2024-09-12T02:49:48.223 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:49:48.209+0000 7f4362600640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f435c074620 0x7f435c1a03e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:49:48.223 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:49:48.209+0000 7f4362600640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f435c074f40 0x7f435c1a0920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:49:48.223 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:49:48.209+0000 7f4362600640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f435c10e3c0 0x7f435c19a5a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:49:48.223 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:49:48.209+0000 7f4362600640 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 -- 0x7f435c114160 con 0x7f435c10e3c0 2024-09-12T02:49:48.223 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:49:48.209+0000 7f4362600640 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x7f435c113fe0 con 0x7f435c074f40 2024-09-12T02:49:48.223 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:49:48.209+0000 7f4362600640 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7f435c1142e0 con 0x7f435c074620 2024-09-12T02:49:48.223 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:49:48.209+0000 7f435be00640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f435c10e3c0 0x7f435c19a5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:49:48.223 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:49:48.209+0000 7f4353e00640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f435c074f40 0x7f435c1a0920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:49:48.223 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:49:48.209+0000 7f435b400640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f435c074620 0x7f435c1a03e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:49:48.223 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:49:48.209+0000 7f4353e00640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f435c074f40 0x7f435c1a0920 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.39:48680/0 (socket says 172.21.15.39:48680) 2024-09-12T02:49:48.223 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:49:48.209+0000 7f4353e00640 1 -- 172.21.15.39:0/2309016536 learned_addr learned my addr 172.21.15.39:0/2309016536 (peer_addr_for_me v2:172.21.15.39:0/0) 2024-09-12T02:49:48.224 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:49:48.209+0000 7f435be00640 1 -- 172.21.15.39:0/2309016536 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f435c074620 msgr2=0x7f435c1a03e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:49:48.224 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:49:48.209+0000 7f435be00640 1 --2- 172.21.15.39:0/2309016536 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f435c074620 0x7f435c1a03e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:49:48.224 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:49:48.210+0000 7f435be00640 1 -- 172.21.15.39:0/2309016536 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f435c074f40 msgr2=0x7f435c1a0920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:49:48.224 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:49:48.210+0000 7f435be00640 1 --2- 172.21.15.39:0/2309016536 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f435c074f40 0x7f435c1a0920 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:49:48.224 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:49:48.210+0000 7f435be00640 1 -- 172.21.15.39:0/2309016536 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f435c19acd0 con 0x7f435c10e3c0 2024-09-12T02:49:48.224 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:49:48.210+0000 7f4353e00640 1 --2- 172.21.15.39:0/2309016536 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f435c074f40 0x7f435c1a0920 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-12T02:49:48.224 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:49:48.210+0000 7f435be00640 1 --2- 172.21.15.39:0/2309016536 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f435c10e3c0 0x7f435c19a5a0 secure :-1 s=READY pgs=310 cs=0 l=1 rev1=1 crypto rx=0x7f435400ec50 tx=0x7f435400c6a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:49:48.224 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:49:48.210+0000 7f4358c00640 1 -- 172.21.15.39:0/2309016536 <== mon.0 v2:172.21.15.39:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4354003b70 con 0x7f435c10e3c0 2024-09-12T02:49:48.224 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:49:48.210+0000 7f4362600640 1 -- 172.21.15.39:0/2309016536 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f435c19afc0 con 0x7f435c10e3c0 2024-09-12T02:49:48.224 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:49:48.210+0000 7f4358c00640 1 -- 172.21.15.39:0/2309016536 <== mon.0 v2:172.21.15.39:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f4354003d10 con 0x7f435c10e3c0 2024-09-12T02:49:48.224 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:49:48.210+0000 7f4358c00640 1 -- 172.21.15.39:0/2309016536 <== mon.0 v2:172.21.15.39:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4354010890 con 0x7f435c10e3c0 2024-09-12T02:49:48.224 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:49:48.210+0000 7f4362600640 1 -- 172.21.15.39:0/2309016536 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f435c1a72b0 con 0x7f435c10e3c0 2024-09-12T02:49:48.224 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:49:48.211+0000 7f4362600640 1 -- 172.21.15.39:0/2309016536 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f435c074a00 con 0x7f435c10e3c0 2024-09-12T02:49:48.224 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:49:48.214+0000 7f4358c00640 1 -- 172.21.15.39:0/2309016536 <== mon.0 v2:172.21.15.39:3300/0 4 ==== mgrmap(e 27) ==== 137964+0+0 (secure 0 0 0) 0x7f4354003fc0 con 0x7f435c10e3c0 2024-09-12T02:49:48.225 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:49:48.216+0000 7f4358c00640 1 --2- 172.21.15.39:0/2309016536 >> [v2:172.21.15.39:6800/2187509357,v1:172.21.15.39:6801/2187509357] conn(0x7f43400a2cf0 0x7f43400a51b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:49:48.225 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:49:48.216+0000 7f4358c00640 1 -- 172.21.15.39:0/2309016536 <== mon.0 v2:172.21.15.39:3300/0 5 ==== osd_map(109..109 src has 1..109) ==== 9817+0+0 (secure 0 0 0) 0x7f43540cff00 con 0x7f435c10e3c0 2024-09-12T02:49:48.225 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:49:48.216+0000 7f435b400640 1 --2- 172.21.15.39:0/2309016536 >> [v2:172.21.15.39:6800/2187509357,v1:172.21.15.39:6801/2187509357] conn(0x7f43400a2cf0 0x7f43400a51b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:49:48.225 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:49:48.216+0000 7f435b400640 1 --2- 172.21.15.39:0/2309016536 >> [v2:172.21.15.39:6800/2187509357,v1:172.21.15.39:6801/2187509357] conn(0x7f43400a2cf0 0x7f43400a51b0 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7f434c009bd0 tx=0x7f434c005f90 comp rx=0 tx=0).ready entity=mgr.25199 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:49:48.225 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:49:48.220+0000 7f4358c00640 1 -- 172.21.15.39:0/2309016536 <== mon.0 v2:172.21.15.39:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7f435409c5b0 con 0x7f435c10e3c0 2024-09-12T02:49:48.264 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 12 02:49:47 smithi172 ceph-mon[35609]: pgmap v370: 129 pgs: 129 active+clean; 24 MiB data, 494 MiB used, 1.0 TiB / 1.0 TiB avail; 5.7 KiB/s rd, 2.2 KiB/s wr, 10 op/s 2024-09-12T02:49:48.264 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 12 02:49:47 smithi172 ceph-mon[35609]: mds.? [v2:172.21.15.172:6832/2541397375,v1:172.21.15.172:6833/2541397375] up:boot 2024-09-12T02:49:48.264 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 12 02:49:47 smithi172 ceph-mon[35609]: mds.? [v2:172.21.15.44:6832/236224065,v1:172.21.15.44:6835/236224065] up:boot 2024-09-12T02:49:48.264 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 12 02:49:47 smithi172 ceph-mon[35609]: mds.? [v2:172.21.15.44:6833/340747318,v1:172.21.15.44:6836/340747318] up:boot 2024-09-12T02:49:48.264 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 12 02:49:47 smithi172 ceph-mon[35609]: mds.? [v2:172.21.15.44:6834/1130430027,v1:172.21.15.44:6838/1130430027] up:boot 2024-09-12T02:49:48.264 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 12 02:49:47 smithi172 ceph-mon[35609]: mds.? [v2:172.21.15.44:6837/870461679,v1:172.21.15.44:6839/870461679] up:boot 2024-09-12T02:49:48.264 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 12 02:49:47 smithi172 ceph-mon[35609]: mds.? [v2:172.21.15.172:6834/2907267127,v1:172.21.15.172:6835/2907267127] up:boot 2024-09-12T02:49:48.264 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 12 02:49:47 smithi172 ceph-mon[35609]: mds.? [v2:172.21.15.172:6836/1100724587,v1:172.21.15.172:6837/1100724587] up:boot 2024-09-12T02:49:48.264 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 12 02:49:47 smithi172 ceph-mon[35609]: mds.? [v2:172.21.15.172:6838/3228097905,v1:172.21.15.172:6839/3228097905] up:boot 2024-09-12T02:49:48.264 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 12 02:49:47 smithi172 ceph-mon[35609]: mds.? [v2:172.21.15.39:6836/2155101557,v1:172.21.15.39:6837/2155101557] up:boot 2024-09-12T02:49:48.265 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 12 02:49:47 smithi172 ceph-mon[35609]: mds.? [v2:172.21.15.39:6840/1798269204,v1:172.21.15.39:6841/1798269204] up:boot 2024-09-12T02:49:48.265 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 12 02:49:47 smithi172 ceph-mon[35609]: fsmap cephfs:0/5 12 up:standby, 5 failed 2024-09-12T02:49:48.265 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 12 02:49:47 smithi172 ceph-mon[35609]: from='mgr.25199 172.21.15.39:0/1270637502' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "d"}]: dispatch 2024-09-12T02:49:48.265 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 12 02:49:47 smithi172 ceph-mon[35609]: from='mgr.25199 172.21.15.39:0/1270637502' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "a"}]: dispatch 2024-09-12T02:49:48.265 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 12 02:49:47 smithi172 ceph-mon[35609]: from='mgr.25199 172.21.15.39:0/1270637502' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "f"}]: dispatch 2024-09-12T02:49:48.265 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 12 02:49:47 smithi172 ceph-mon[35609]: from='mgr.25199 172.21.15.39:0/1270637502' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "k"}]: dispatch 2024-09-12T02:49:48.265 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 12 02:49:47 smithi172 ceph-mon[35609]: from='mgr.25199 172.21.15.39:0/1270637502' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "h"}]: dispatch 2024-09-12T02:49:48.265 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 12 02:49:47 smithi172 ceph-mon[35609]: from='mgr.25199 172.21.15.39:0/1270637502' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "e"}]: dispatch 2024-09-12T02:49:48.265 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 12 02:49:47 smithi172 ceph-mon[35609]: from='mgr.25199 172.21.15.39:0/1270637502' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "b"}]: dispatch 2024-09-12T02:49:48.265 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 12 02:49:47 smithi172 ceph-mon[35609]: from='mgr.25199 172.21.15.39:0/1270637502' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "c"}]: dispatch 2024-09-12T02:49:48.265 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 12 02:49:47 smithi172 ceph-mon[35609]: from='mgr.25199 172.21.15.39:0/1270637502' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "l"}]: dispatch 2024-09-12T02:49:48.265 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 12 02:49:47 smithi172 ceph-mon[35609]: from='mgr.25199 172.21.15.39:0/1270637502' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "i"}]: dispatch 2024-09-12T02:49:48.446 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:49:48.445+0000 7f4362600640 1 -- 172.21.15.39:0/2309016536 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_command({"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true} v 0) -- 0x7f435c109570 con 0x7f435c10e3c0 2024-09-12T02:49:48.822 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:49:48.820+0000 7f4358c00640 1 -- 172.21.15.39:0/2309016536 <== mon.0 v2:172.21.15.39:3300/0 7 ==== mon_command_ack([{"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true}]=0 v32) ==== 104+0+0 (secure 0 0 0) 0x7f435409beb0 con 0x7f435c10e3c0 2024-09-12T02:49:48.824 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:49:48.823+0000 7f4362600640 1 -- 172.21.15.39:0/2309016536 >> [v2:172.21.15.39:6800/2187509357,v1:172.21.15.39:6801/2187509357] conn(0x7f43400a2cf0 msgr2=0x7f43400a51b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:49:48.824 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:49:48.823+0000 7f4362600640 1 --2- 172.21.15.39:0/2309016536 >> [v2:172.21.15.39:6800/2187509357,v1:172.21.15.39:6801/2187509357] conn(0x7f43400a2cf0 0x7f43400a51b0 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7f434c009bd0 tx=0x7f434c005f90 comp rx=0 tx=0).stop 2024-09-12T02:49:48.824 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:49:48.823+0000 7f4362600640 1 -- 172.21.15.39:0/2309016536 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f435c10e3c0 msgr2=0x7f435c19a5a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:49:48.824 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:49:48.823+0000 7f4362600640 1 --2- 172.21.15.39:0/2309016536 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f435c10e3c0 0x7f435c19a5a0 secure :-1 s=READY pgs=310 cs=0 l=1 rev1=1 crypto rx=0x7f435400ec50 tx=0x7f435400c6a0 comp rx=0 tx=0).stop 2024-09-12T02:49:48.825 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:49:48.823+0000 7f4362600640 1 -- 172.21.15.39:0/2309016536 shutdown_connections 2024-09-12T02:49:48.825 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:49:48.823+0000 7f4362600640 1 --2- 172.21.15.39:0/2309016536 >> [v2:172.21.15.39:6800/2187509357,v1:172.21.15.39:6801/2187509357] conn(0x7f43400a2cf0 0x7f43400a51b0 unknown :-1 s=CLOSED pgs=67 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:49:48.825 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:49:48.823+0000 7f4362600640 1 --2- 172.21.15.39:0/2309016536 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f435c10e3c0 0x7f435c19a5a0 unknown :-1 s=CLOSED pgs=310 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:49:48.825 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:49:48.823+0000 7f4362600640 1 --2- 172.21.15.39:0/2309016536 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f435c074f40 0x7f435c1a0920 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:49:48.825 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:49:48.823+0000 7f4362600640 1 --2- 172.21.15.39:0/2309016536 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f435c074620 0x7f435c1a03e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:49:48.825 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:49:48.823+0000 7f4362600640 1 -- 172.21.15.39:0/2309016536 >> 172.21.15.39:0/2309016536 conn(0x7f435c0fd8c0 msgr2=0x7f435c0ff0f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:49:48.825 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:49:48.824+0000 7f4362600640 1 -- 172.21.15.39:0/2309016536 shutdown_connections 2024-09-12T02:49:48.825 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:49:48.824+0000 7f4362600640 1 -- 172.21.15.39:0/2309016536 wait complete. 2024-09-12T02:49:49.099 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 02:49:48 smithi039 ceph-mon[30515]: from='client.? 172.21.15.39:0/2309016536' entity='client.admin' cmd=[{"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true}]: dispatch 2024-09-12T02:49:49.198 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 12 02:49:48 smithi044 ceph-mon[35411]: from='client.? 172.21.15.39:0/2309016536' entity='client.admin' cmd=[{"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true}]: dispatch 2024-09-12T02:49:49.263 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 12 02:49:48 smithi172 ceph-mon[35609]: from='client.? 172.21.15.39:0/2309016536' entity='client.admin' cmd=[{"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true}]: dispatch 2024-09-12T02:49:49.625 DEBUG:teuthology.orchestra.run.smithi039:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc shell --fsid 4954ed46-70ae-11ef-bcea-c7b262605968 -- ceph osd pool rm cephfs_metadata cephfs_metadata --yes-i-really-really-mean-it 2024-09-12T02:49:49.850 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 02:49:49 smithi039 ceph-mon[30515]: pgmap v372: 129 pgs: 129 active+clean; 24 MiB data, 494 MiB used, 1.0 TiB / 1.0 TiB avail; 5.7 KiB/s rd, 1.5 KiB/s wr, 11 op/s 2024-09-12T02:49:49.850 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 02:49:49 smithi039 ceph-mon[30515]: Health check cleared: FS_DEGRADED (was: 1 filesystem is degraded) 2024-09-12T02:49:49.850 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 02:49:49 smithi039 ceph-mon[30515]: Health check cleared: MDS_ALL_DOWN (was: 1 filesystem is offline) 2024-09-12T02:49:49.850 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 02:49:49 smithi039 ceph-mon[30515]: Cluster is now healthy 2024-09-12T02:49:49.850 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 02:49:49 smithi039 ceph-mon[30515]: from='client.? 172.21.15.39:0/2309016536' entity='client.admin' cmd='[{"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true}]': finished 2024-09-12T02:49:49.851 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 02:49:49 smithi039 ceph-mon[30515]: fsmap 12 up:standby 2024-09-12T02:49:50.007 INFO:teuthology.orchestra.run.smithi039.stderr:Inferring config /var/lib/ceph/4954ed46-70ae-11ef-bcea-c7b262605968/mon.a/config 2024-09-12T02:49:50.199 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 12 02:49:49 smithi044 ceph-mon[35411]: pgmap v372: 129 pgs: 129 active+clean; 24 MiB data, 494 MiB used, 1.0 TiB / 1.0 TiB avail; 5.7 KiB/s rd, 1.5 KiB/s wr, 11 op/s 2024-09-12T02:49:50.199 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 12 02:49:49 smithi044 ceph-mon[35411]: Health check cleared: FS_DEGRADED (was: 1 filesystem is degraded) 2024-09-12T02:49:50.199 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 12 02:49:49 smithi044 ceph-mon[35411]: Health check cleared: MDS_ALL_DOWN (was: 1 filesystem is offline) 2024-09-12T02:49:50.199 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 12 02:49:49 smithi044 ceph-mon[35411]: Cluster is now healthy 2024-09-12T02:49:50.199 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 12 02:49:49 smithi044 ceph-mon[35411]: from='client.? 172.21.15.39:0/2309016536' entity='client.admin' cmd='[{"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true}]': finished 2024-09-12T02:49:50.199 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 12 02:49:49 smithi044 ceph-mon[35411]: fsmap 12 up:standby 2024-09-12T02:49:50.264 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 12 02:49:49 smithi172 ceph-mon[35609]: pgmap v372: 129 pgs: 129 active+clean; 24 MiB data, 494 MiB used, 1.0 TiB / 1.0 TiB avail; 5.7 KiB/s rd, 1.5 KiB/s wr, 11 op/s 2024-09-12T02:49:50.264 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 12 02:49:49 smithi172 ceph-mon[35609]: Health check cleared: FS_DEGRADED (was: 1 filesystem is degraded) 2024-09-12T02:49:50.264 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 12 02:49:49 smithi172 ceph-mon[35609]: Health check cleared: MDS_ALL_DOWN (was: 1 filesystem is offline) 2024-09-12T02:49:50.264 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 12 02:49:49 smithi172 ceph-mon[35609]: Cluster is now healthy 2024-09-12T02:49:50.264 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 12 02:49:49 smithi172 ceph-mon[35609]: from='client.? 172.21.15.39:0/2309016536' entity='client.admin' cmd='[{"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true}]': finished 2024-09-12T02:49:50.264 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 12 02:49:49 smithi172 ceph-mon[35609]: fsmap 12 up:standby 2024-09-12T02:49:50.618 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:49:50.617+0000 7f6d44000640 1 -- 172.21.15.39:0/92469920 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f6d3c104010 msgr2=0x7f6d3c1043f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:49:50.618 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:49:50.617+0000 7f6d44000640 1 --2- 172.21.15.39:0/92469920 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f6d3c104010 0x7f6d3c1043f0 secure :-1 s=READY pgs=157 cs=0 l=1 rev1=1 crypto rx=0x7f6d30009900 tx=0x7f6d3002a3f0 comp rx=0 tx=0).stop 2024-09-12T02:49:50.618 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:49:50.617+0000 7f6d44000640 1 -- 172.21.15.39:0/92469920 shutdown_connections 2024-09-12T02:49:50.618 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:49:50.617+0000 7f6d44000640 1 --2- 172.21.15.39:0/92469920 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f6d3c109140 0x7f6d3c110cc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:49:50.618 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:49:50.617+0000 7f6d44000640 1 --2- 172.21.15.39:0/92469920 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f6d3c1049c0 0x7f6d3c108a10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:49:50.618 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:49:50.617+0000 7f6d44000640 1 --2- 172.21.15.39:0/92469920 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f6d3c104010 0x7f6d3c1043f0 unknown :-1 s=CLOSED pgs=157 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:49:50.618 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:49:50.617+0000 7f6d44000640 1 -- 172.21.15.39:0/92469920 >> 172.21.15.39:0/92469920 conn(0x7f6d3c0ffa50 msgr2=0x7f6d3c101e70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:49:50.619 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:49:50.617+0000 7f6d44000640 1 -- 172.21.15.39:0/92469920 shutdown_connections 2024-09-12T02:49:50.619 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:49:50.617+0000 7f6d44000640 1 -- 172.21.15.39:0/92469920 wait complete. 2024-09-12T02:49:50.619 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:49:50.618+0000 7f6d44000640 1 Processor -- start 2024-09-12T02:49:50.620 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:49:50.618+0000 7f6d44000640 1 -- start start 2024-09-12T02:49:50.620 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:49:50.619+0000 7f6d44000640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f6d3c104010 0x7f6d3c19a630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:49:50.620 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:49:50.619+0000 7f6d44000640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f6d3c1049c0 0x7f6d3c19ab70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:49:50.620 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:49:50.619+0000 7f6d44000640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f6d3c109140 0x7f6d3c19ef00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:49:50.620 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:49:50.619+0000 7f6d44000640 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 -- 0x7f6d3c114170 con 0x7f6d3c109140 2024-09-12T02:49:50.620 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:49:50.619+0000 7f6d44000640 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x7f6d3c113ff0 con 0x7f6d3c104010 2024-09-12T02:49:50.620 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:49:50.619+0000 7f6d44000640 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7f6d3c1142f0 con 0x7f6d3c1049c0 2024-09-12T02:49:50.620 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:49:50.619+0000 7f6d41600640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f6d3c104010 0x7f6d3c19a630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:49:50.620 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:49:50.619+0000 7f6d41600640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f6d3c104010 0x7f6d3c19a630 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.39:48702/0 (socket says 172.21.15.39:48702) 2024-09-12T02:49:50.620 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:49:50.619+0000 7f6d41600640 1 -- 172.21.15.39:0/1018729072 learned_addr learned my addr 172.21.15.39:0/1018729072 (peer_addr_for_me v2:172.21.15.39:0/0) 2024-09-12T02:49:50.620 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:49:50.619+0000 7f6d42000640 1 --2- 172.21.15.39:0/1018729072 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f6d3c109140 0x7f6d3c19ef00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:49:50.620 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:49:50.619+0000 7f6d40c00640 1 --2- 172.21.15.39:0/1018729072 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f6d3c1049c0 0x7f6d3c19ab70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:49:50.621 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:49:50.619+0000 7f6d41600640 1 -- 172.21.15.39:0/1018729072 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f6d3c1049c0 msgr2=0x7f6d3c19ab70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:49:50.621 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:49:50.619+0000 7f6d41600640 1 --2- 172.21.15.39:0/1018729072 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f6d3c1049c0 0x7f6d3c19ab70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:49:50.621 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:49:50.619+0000 7f6d41600640 1 -- 172.21.15.39:0/1018729072 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f6d3c109140 msgr2=0x7f6d3c19ef00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:49:50.621 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:49:50.619+0000 7f6d41600640 1 --2- 172.21.15.39:0/1018729072 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f6d3c109140 0x7f6d3c19ef00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:49:50.622 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:49:50.619+0000 7f6d41600640 1 -- 172.21.15.39:0/1018729072 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6d3c19f5e0 con 0x7f6d3c104010 2024-09-12T02:49:50.622 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:49:50.620+0000 7f6d41600640 1 --2- 172.21.15.39:0/1018729072 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f6d3c104010 0x7f6d3c19a630 secure :-1 s=READY pgs=158 cs=0 l=1 rev1=1 crypto rx=0x7f6d30006010 tx=0x7f6d30004040 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:49:50.622 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:49:50.620+0000 7f6d3a000640 1 -- 172.21.15.39:0/1018729072 <== mon.2 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6d3003f030 con 0x7f6d3c104010 2024-09-12T02:49:50.622 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:49:50.620+0000 7f6d3a000640 1 -- 172.21.15.39:0/1018729072 <== mon.2 v2:172.21.15.44:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f6d30004440 con 0x7f6d3c104010 2024-09-12T02:49:50.622 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:49:50.620+0000 7f6d44000640 1 -- 172.21.15.39:0/1018729072 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f6d3c19f870 con 0x7f6d3c104010 2024-09-12T02:49:50.622 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:49:50.620+0000 7f6d3a000640 1 -- 172.21.15.39:0/1018729072 <== mon.2 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6d30035070 con 0x7f6d3c104010 2024-09-12T02:49:50.622 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:49:50.620+0000 7f6d44000640 1 -- 172.21.15.39:0/1018729072 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f6d3c1a71b0 con 0x7f6d3c104010 2024-09-12T02:49:50.622 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:49:50.621+0000 7f6d44000640 1 -- 172.21.15.39:0/1018729072 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f6d3c1054f0 con 0x7f6d3c104010 2024-09-12T02:49:50.624 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:49:50.623+0000 7f6d3a000640 1 -- 172.21.15.39:0/1018729072 <== mon.2 v2:172.21.15.44:3300/0 4 ==== mgrmap(e 27) ==== 137964+0+0 (secure 0 0 0) 0x7f6d30042030 con 0x7f6d3c104010 2024-09-12T02:49:50.625 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:49:50.625+0000 7f6d3a000640 1 --2- 172.21.15.39:0/1018729072 >> [v2:172.21.15.39:6800/2187509357,v1:172.21.15.39:6801/2187509357] conn(0x7f6d240a2cf0 0x7f6d240a51b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:49:50.626 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:49:50.625+0000 7f6d3a000640 1 -- 172.21.15.39:0/1018729072 <== mon.2 v2:172.21.15.44:3300/0 5 ==== osd_map(109..109 src has 1..109) ==== 9817+0+0 (secure 0 0 0) 0x7f6d300eff40 con 0x7f6d3c104010 2024-09-12T02:49:50.626 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:49:50.625+0000 7f6d40c00640 1 --2- 172.21.15.39:0/1018729072 >> [v2:172.21.15.39:6800/2187509357,v1:172.21.15.39:6801/2187509357] conn(0x7f6d240a2cf0 0x7f6d240a51b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:49:50.626 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:49:50.626+0000 7f6d40c00640 1 --2- 172.21.15.39:0/1018729072 >> [v2:172.21.15.39:6800/2187509357,v1:172.21.15.39:6801/2187509357] conn(0x7f6d240a2cf0 0x7f6d240a51b0 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7f6d280095f0 tx=0x7f6d28005f90 comp rx=0 tx=0).ready entity=mgr.25199 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:49:50.628 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:49:50.627+0000 7f6d3a000640 1 -- 172.21.15.39:0/1018729072 <== mon.2 v2:172.21.15.44:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7f6d300bbfa0 con 0x7f6d3c104010 2024-09-12T02:49:50.813 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:49:50.813+0000 7f6d44000640 1 -- 172.21.15.39:0/1018729072 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true} v 0) -- 0x7f6d3c1043f0 con 0x7f6d3c104010 2024-09-12T02:49:50.838 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:49:50.837+0000 7f6d3a000640 1 -- 172.21.15.39:0/1018729072 <== mon.2 v2:172.21.15.44:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_metadata' removed v110) ==== 181+0+0 (secure 0 0 0) 0x7f6d300c02a0 con 0x7f6d3c104010 2024-09-12T02:49:50.838 INFO:teuthology.orchestra.run.smithi039.stderr:pool 'cephfs_metadata' removed 2024-09-12T02:49:50.843 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:49:50.842+0000 7f6d44000640 1 -- 172.21.15.39:0/1018729072 >> [v2:172.21.15.39:6800/2187509357,v1:172.21.15.39:6801/2187509357] conn(0x7f6d240a2cf0 msgr2=0x7f6d240a51b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:49:50.843 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:49:50.842+0000 7f6d44000640 1 --2- 172.21.15.39:0/1018729072 >> [v2:172.21.15.39:6800/2187509357,v1:172.21.15.39:6801/2187509357] conn(0x7f6d240a2cf0 0x7f6d240a51b0 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7f6d280095f0 tx=0x7f6d28005f90 comp rx=0 tx=0).stop 2024-09-12T02:49:50.843 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:49:50.842+0000 7f6d44000640 1 -- 172.21.15.39:0/1018729072 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f6d3c104010 msgr2=0x7f6d3c19a630 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:49:50.843 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:49:50.842+0000 7f6d44000640 1 --2- 172.21.15.39:0/1018729072 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f6d3c104010 0x7f6d3c19a630 secure :-1 s=READY pgs=158 cs=0 l=1 rev1=1 crypto rx=0x7f6d30006010 tx=0x7f6d30004040 comp rx=0 tx=0).stop 2024-09-12T02:49:50.844 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:49:50.843+0000 7f6d44000640 1 -- 172.21.15.39:0/1018729072 shutdown_connections 2024-09-12T02:49:50.844 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:49:50.843+0000 7f6d44000640 1 --2- 172.21.15.39:0/1018729072 >> [v2:172.21.15.39:6800/2187509357,v1:172.21.15.39:6801/2187509357] conn(0x7f6d240a2cf0 0x7f6d240a51b0 unknown :-1 s=CLOSED pgs=68 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:49:50.844 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:49:50.843+0000 7f6d44000640 1 --2- 172.21.15.39:0/1018729072 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f6d3c109140 0x7f6d3c19ef00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:49:50.844 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:49:50.843+0000 7f6d44000640 1 --2- 172.21.15.39:0/1018729072 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f6d3c1049c0 0x7f6d3c19ab70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:49:50.844 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:49:50.843+0000 7f6d44000640 1 --2- 172.21.15.39:0/1018729072 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f6d3c104010 0x7f6d3c19a630 unknown :-1 s=CLOSED pgs=158 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:49:50.844 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:49:50.843+0000 7f6d44000640 1 -- 172.21.15.39:0/1018729072 >> 172.21.15.39:0/1018729072 conn(0x7f6d3c0ffa50 msgr2=0x7f6d3c100eb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:49:50.844 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:49:50.843+0000 7f6d44000640 1 -- 172.21.15.39:0/1018729072 shutdown_connections 2024-09-12T02:49:50.845 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:49:50.843+0000 7f6d44000640 1 -- 172.21.15.39:0/1018729072 wait complete. 2024-09-12T02:49:51.099 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 02:49:50 smithi039 ceph-mon[30515]: from='client.? 172.21.15.39:0/1018729072' entity='client.admin' cmd=[{"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true}]: dispatch 2024-09-12T02:49:51.100 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 02:49:50 smithi039 ceph-mon[30515]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true}]: dispatch 2024-09-12T02:49:51.198 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 12 02:49:50 smithi044 ceph-mon[35411]: from='client.? 172.21.15.39:0/1018729072' entity='client.admin' cmd=[{"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true}]: dispatch 2024-09-12T02:49:51.198 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 12 02:49:50 smithi044 ceph-mon[35411]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true}]: dispatch 2024-09-12T02:49:51.263 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 12 02:49:50 smithi172 ceph-mon[35609]: from='client.? 172.21.15.39:0/1018729072' entity='client.admin' cmd=[{"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true}]: dispatch 2024-09-12T02:49:51.263 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 12 02:49:50 smithi172 ceph-mon[35609]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true}]: dispatch 2024-09-12T02:49:51.615 DEBUG:teuthology.orchestra.run.smithi039:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc shell --fsid 4954ed46-70ae-11ef-bcea-c7b262605968 -- ceph osd pool rm cephfs_data cephfs_data --yes-i-really-really-mean-it 2024-09-12T02:49:51.996 INFO:teuthology.orchestra.run.smithi039.stderr:Inferring config /var/lib/ceph/4954ed46-70ae-11ef-bcea-c7b262605968/mon.a/config 2024-09-12T02:49:52.102 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 02:49:51 smithi039 ceph-mon[30515]: pgmap v373: 129 pgs: 129 active+clean; 24 MiB data, 494 MiB used, 1.0 TiB / 1.0 TiB avail; 5.7 KiB/s rd, 1.5 KiB/s wr, 11 op/s 2024-09-12T02:49:52.102 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 02:49:51 smithi039 ceph-mon[30515]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true}]': finished 2024-09-12T02:49:52.102 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 02:49:51 smithi039 ceph-mon[30515]: osdmap e110: 12 total, 12 up, 12 in 2024-09-12T02:49:52.198 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 12 02:49:51 smithi044 ceph-mon[35411]: pgmap v373: 129 pgs: 129 active+clean; 24 MiB data, 494 MiB used, 1.0 TiB / 1.0 TiB avail; 5.7 KiB/s rd, 1.5 KiB/s wr, 11 op/s 2024-09-12T02:49:52.199 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 12 02:49:51 smithi044 ceph-mon[35411]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true}]': finished 2024-09-12T02:49:52.199 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 12 02:49:51 smithi044 ceph-mon[35411]: osdmap e110: 12 total, 12 up, 12 in 2024-09-12T02:49:52.263 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 12 02:49:51 smithi172 ceph-mon[35609]: pgmap v373: 129 pgs: 129 active+clean; 24 MiB data, 494 MiB used, 1.0 TiB / 1.0 TiB avail; 5.7 KiB/s rd, 1.5 KiB/s wr, 11 op/s 2024-09-12T02:49:52.264 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 12 02:49:51 smithi172 ceph-mon[35609]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true}]': finished 2024-09-12T02:49:52.264 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 12 02:49:51 smithi172 ceph-mon[35609]: osdmap e110: 12 total, 12 up, 12 in 2024-09-12T02:49:52.580 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:49:52.578+0000 7ff989000640 1 -- 172.21.15.39:0/3858047767 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7ff984074eb0 msgr2=0x7ff984112650 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:49:52.580 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:49:52.578+0000 7ff989000640 1 --2- 172.21.15.39:0/3858047767 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7ff984074eb0 0x7ff984112650 secure :-1 s=READY pgs=311 cs=0 l=1 rev1=1 crypto rx=0x7ff96c009900 tx=0x7ff96c02a480 comp rx=0 tx=0).stop 2024-09-12T02:49:52.580 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:49:52.578+0000 7ff989000640 1 -- 172.21.15.39:0/3858047767 shutdown_connections 2024-09-12T02:49:52.580 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:49:52.578+0000 7ff989000640 1 --2- 172.21.15.39:0/3858047767 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7ff984112b90 0x7ff984114f80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:49:52.580 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:49:52.578+0000 7ff989000640 1 --2- 172.21.15.39:0/3858047767 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7ff984074eb0 0x7ff984112650 unknown :-1 s=CLOSED pgs=311 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:49:52.580 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:49:52.578+0000 7ff989000640 1 --2- 172.21.15.39:0/3858047767 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7ff984074590 0x7ff984074970 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:49:52.580 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:49:52.578+0000 7ff989000640 1 -- 172.21.15.39:0/3858047767 >> 172.21.15.39:0/3858047767 conn(0x7ff9840fd8c0 msgr2=0x7ff9840ffce0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:49:52.580 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:49:52.579+0000 7ff989000640 1 -- 172.21.15.39:0/3858047767 shutdown_connections 2024-09-12T02:49:52.581 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:49:52.579+0000 7ff989000640 1 -- 172.21.15.39:0/3858047767 wait complete. 2024-09-12T02:49:52.582 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:49:52.580+0000 7ff989000640 1 Processor -- start 2024-09-12T02:49:52.582 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:49:52.580+0000 7ff989000640 1 -- start start 2024-09-12T02:49:52.582 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:49:52.580+0000 7ff989000640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7ff984074590 0x7ff9841a4740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:49:52.582 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:49:52.580+0000 7ff989000640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7ff984074eb0 0x7ff9841a4c80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:49:52.582 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:49:52.580+0000 7ff989000640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7ff984112b90 0x7ff98419e900 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:49:52.582 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:49:52.580+0000 7ff989000640 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 -- 0x7ff9841185b0 con 0x7ff984074eb0 2024-09-12T02:49:52.582 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:49:52.580+0000 7ff989000640 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x7ff984118430 con 0x7ff984074590 2024-09-12T02:49:52.582 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:49:52.580+0000 7ff989000640 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7ff984118730 con 0x7ff984112b90 2024-09-12T02:49:52.582 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:49:52.580+0000 7ff97be00640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7ff984074eb0 0x7ff9841a4c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:49:52.583 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:49:52.581+0000 7ff97be00640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7ff984074eb0 0x7ff9841a4c80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.39:3300/0 says I am v2:172.21.15.39:35486/0 (socket says 172.21.15.39:35486) 2024-09-12T02:49:52.583 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:49:52.581+0000 7ff981e00640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7ff984074590 0x7ff9841a4740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:49:52.583 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:49:52.581+0000 7ff97be00640 1 -- 172.21.15.39:0/2159170667 learned_addr learned my addr 172.21.15.39:0/2159170667 (peer_addr_for_me v2:172.21.15.39:0/0) 2024-09-12T02:49:52.583 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:49:52.581+0000 7ff982800640 1 --2- 172.21.15.39:0/2159170667 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7ff984112b90 0x7ff98419e900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:49:52.583 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:49:52.581+0000 7ff981e00640 1 -- 172.21.15.39:0/2159170667 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7ff984112b90 msgr2=0x7ff98419e900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:49:52.583 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:49:52.581+0000 7ff981e00640 1 --2- 172.21.15.39:0/2159170667 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7ff984112b90 0x7ff98419e900 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:49:52.583 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:49:52.581+0000 7ff981e00640 1 -- 172.21.15.39:0/2159170667 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7ff984074eb0 msgr2=0x7ff9841a4c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:49:52.583 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:49:52.581+0000 7ff981e00640 1 --2- 172.21.15.39:0/2159170667 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7ff984074eb0 0x7ff9841a4c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:49:52.583 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:49:52.581+0000 7ff981e00640 1 -- 172.21.15.39:0/2159170667 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff98419f030 con 0x7ff984074590 2024-09-12T02:49:52.583 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:49:52.581+0000 7ff97be00640 1 --2- 172.21.15.39:0/2159170667 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7ff984074eb0 0x7ff9841a4c80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-12T02:49:52.583 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:49:52.581+0000 7ff981e00640 1 --2- 172.21.15.39:0/2159170667 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7ff984074590 0x7ff9841a4740 secure :-1 s=READY pgs=159 cs=0 l=1 rev1=1 crypto rx=0x7ff97400e9f0 tx=0x7ff97400eeb0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:49:52.584 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:49:52.582+0000 7ff97aa00640 1 -- 172.21.15.39:0/2159170667 <== mon.2 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff97400ccc0 con 0x7ff984074590 2024-09-12T02:49:52.584 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:49:52.582+0000 7ff989000640 1 -- 172.21.15.39:0/2159170667 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff98419f320 con 0x7ff984074590 2024-09-12T02:49:52.584 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:49:52.582+0000 7ff989000640 1 -- 172.21.15.39:0/2159170667 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff9841ab610 con 0x7ff984074590 2024-09-12T02:49:52.584 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:49:52.582+0000 7ff97aa00640 1 -- 172.21.15.39:0/2159170667 <== mon.2 v2:172.21.15.44:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7ff974005020 con 0x7ff984074590 2024-09-12T02:49:52.584 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:49:52.582+0000 7ff97aa00640 1 -- 172.21.15.39:0/2159170667 <== mon.2 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff97401c070 con 0x7ff984074590 2024-09-12T02:49:52.584 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:49:52.583+0000 7ff989000640 1 -- 172.21.15.39:0/2159170667 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ff960005290 con 0x7ff984074590 2024-09-12T02:49:52.585 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:49:52.585+0000 7ff97aa00640 1 -- 172.21.15.39:0/2159170667 <== mon.2 v2:172.21.15.44:3300/0 4 ==== mgrmap(e 27) ==== 137964+0+0 (secure 0 0 0) 0x7ff974004a00 con 0x7ff984074590 2024-09-12T02:49:52.587 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:49:52.586+0000 7ff97aa00640 1 --2- 172.21.15.39:0/2159170667 >> [v2:172.21.15.39:6800/2187509357,v1:172.21.15.39:6801/2187509357] conn(0x7ff9680a2cf0 0x7ff9680a51b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:49:52.587 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:49:52.587+0000 7ff97aa00640 1 -- 172.21.15.39:0/2159170667 <== mon.2 v2:172.21.15.44:3300/0 5 ==== osd_map(110..110 src has 1..110) ==== 9263+0+0 (secure 0 0 0) 0x7ff9740cf5a0 con 0x7ff984074590 2024-09-12T02:49:52.587 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:49:52.587+0000 7ff97be00640 1 --2- 172.21.15.39:0/2159170667 >> [v2:172.21.15.39:6800/2187509357,v1:172.21.15.39:6801/2187509357] conn(0x7ff9680a2cf0 0x7ff9680a51b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:49:52.588 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:49:52.587+0000 7ff97be00640 1 --2- 172.21.15.39:0/2159170667 >> [v2:172.21.15.39:6800/2187509357,v1:172.21.15.39:6801/2187509357] conn(0x7ff9680a2cf0 0x7ff9680a51b0 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7ff9840fff30 tx=0x7ff96c0046c0 comp rx=0 tx=0).ready entity=mgr.25199 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:49:52.591 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:49:52.590+0000 7ff97aa00640 1 -- 172.21.15.39:0/2159170667 <== mon.2 v2:172.21.15.44:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7ff97409bee0 con 0x7ff984074590 2024-09-12T02:49:52.780 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:49:52.779+0000 7ff989000640 1 -- 172.21.15.39:0/2159170667 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true} v 0) -- 0x7ff960005580 con 0x7ff984074590 2024-09-12T02:49:52.847 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:49:52.846+0000 7ff97aa00640 1 -- 172.21.15.39:0/2159170667 <== mon.2 v2:172.21.15.44:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_data' removed v111) ==== 169+0+0 (secure 0 0 0) 0x7ff97409b7e0 con 0x7ff984074590 2024-09-12T02:49:52.847 INFO:teuthology.orchestra.run.smithi039.stderr:pool 'cephfs_data' removed 2024-09-12T02:49:52.852 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:49:52.850+0000 7ff989000640 1 -- 172.21.15.39:0/2159170667 >> [v2:172.21.15.39:6800/2187509357,v1:172.21.15.39:6801/2187509357] conn(0x7ff9680a2cf0 msgr2=0x7ff9680a51b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:49:52.852 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:49:52.850+0000 7ff989000640 1 --2- 172.21.15.39:0/2159170667 >> [v2:172.21.15.39:6800/2187509357,v1:172.21.15.39:6801/2187509357] conn(0x7ff9680a2cf0 0x7ff9680a51b0 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7ff9840fff30 tx=0x7ff96c0046c0 comp rx=0 tx=0).stop 2024-09-12T02:49:52.852 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:49:52.850+0000 7ff989000640 1 -- 172.21.15.39:0/2159170667 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7ff984074590 msgr2=0x7ff9841a4740 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:49:52.852 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:49:52.850+0000 7ff989000640 1 --2- 172.21.15.39:0/2159170667 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7ff984074590 0x7ff9841a4740 secure :-1 s=READY pgs=159 cs=0 l=1 rev1=1 crypto rx=0x7ff97400e9f0 tx=0x7ff97400eeb0 comp rx=0 tx=0).stop 2024-09-12T02:49:52.852 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:49:52.850+0000 7ff989000640 1 -- 172.21.15.39:0/2159170667 shutdown_connections 2024-09-12T02:49:52.852 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:49:52.850+0000 7ff989000640 1 --2- 172.21.15.39:0/2159170667 >> [v2:172.21.15.39:6800/2187509357,v1:172.21.15.39:6801/2187509357] conn(0x7ff9680a2cf0 0x7ff9680a51b0 unknown :-1 s=CLOSED pgs=69 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:49:52.852 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:49:52.850+0000 7ff989000640 1 --2- 172.21.15.39:0/2159170667 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7ff984112b90 0x7ff98419e900 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:49:52.853 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:49:52.850+0000 7ff989000640 1 --2- 172.21.15.39:0/2159170667 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7ff984074eb0 0x7ff9841a4c80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:49:52.853 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:49:52.850+0000 7ff989000640 1 --2- 172.21.15.39:0/2159170667 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7ff984074590 0x7ff9841a4740 unknown :-1 s=CLOSED pgs=159 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:49:52.853 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:49:52.850+0000 7ff989000640 1 -- 172.21.15.39:0/2159170667 >> 172.21.15.39:0/2159170667 conn(0x7ff9840fd8c0 msgr2=0x7ff9840ff080 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:49:52.853 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:49:52.851+0000 7ff989000640 1 -- 172.21.15.39:0/2159170667 shutdown_connections 2024-09-12T02:49:52.853 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:49:52.851+0000 7ff989000640 1 -- 172.21.15.39:0/2159170667 wait complete. 2024-09-12T02:49:53.099 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 02:49:52 smithi039 ceph-mon[30515]: from='client.? 172.21.15.39:0/2159170667' entity='client.admin' cmd=[{"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true}]: dispatch 2024-09-12T02:49:53.100 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 02:49:52 smithi039 ceph-mon[30515]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true}]: dispatch 2024-09-12T02:49:53.198 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 12 02:49:52 smithi044 ceph-mon[35411]: from='client.? 172.21.15.39:0/2159170667' entity='client.admin' cmd=[{"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true}]: dispatch 2024-09-12T02:49:53.198 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 12 02:49:52 smithi044 ceph-mon[35411]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true}]: dispatch 2024-09-12T02:49:53.263 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 12 02:49:52 smithi172 ceph-mon[35609]: from='client.? 172.21.15.39:0/2159170667' entity='client.admin' cmd=[{"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true}]: dispatch 2024-09-12T02:49:53.264 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 12 02:49:52 smithi172 ceph-mon[35609]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true}]: dispatch 2024-09-12T02:49:53.595 DEBUG:teuthology.orchestra.run.smithi039:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc shell --fsid 4954ed46-70ae-11ef-bcea-c7b262605968 -- ceph osd pool rm cephfs_data_ec cephfs_data_ec --yes-i-really-really-mean-it 2024-09-12T02:49:53.978 INFO:teuthology.orchestra.run.smithi039.stderr:Inferring config /var/lib/ceph/4954ed46-70ae-11ef-bcea-c7b262605968/mon.a/config 2024-09-12T02:49:54.099 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 02:49:53 smithi039 ceph-mon[30515]: pgmap v375: 97 pgs: 97 active+clean; 577 KiB data, 427 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-12T02:49:54.100 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 02:49:53 smithi039 ceph-mon[30515]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true}]': finished 2024-09-12T02:49:54.100 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 02:49:53 smithi039 ceph-mon[30515]: osdmap e111: 12 total, 12 up, 12 in 2024-09-12T02:49:54.198 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 12 02:49:53 smithi044 ceph-mon[35411]: pgmap v375: 97 pgs: 97 active+clean; 577 KiB data, 427 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-12T02:49:54.199 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 12 02:49:53 smithi044 ceph-mon[35411]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true}]': finished 2024-09-12T02:49:54.199 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 12 02:49:53 smithi044 ceph-mon[35411]: osdmap e111: 12 total, 12 up, 12 in 2024-09-12T02:49:54.263 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 12 02:49:53 smithi172 ceph-mon[35609]: pgmap v375: 97 pgs: 97 active+clean; 577 KiB data, 427 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-12T02:49:54.264 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 12 02:49:53 smithi172 ceph-mon[35609]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true}]': finished 2024-09-12T02:49:54.264 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 12 02:49:53 smithi172 ceph-mon[35609]: osdmap e111: 12 total, 12 up, 12 in 2024-09-12T02:49:54.619 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:49:54.586+0000 7f5920a00640 1 -- 172.21.15.39:0/3656470889 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f591c10e450 msgr2=0x7f591c110840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:49:54.619 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:49:54.586+0000 7f5920a00640 1 --2- 172.21.15.39:0/3656470889 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f591c10e450 0x7f591c110840 secure :-1 s=READY pgs=312 cs=0 l=1 rev1=1 crypto rx=0x7f5914009860 tx=0x7f591402a3d0 comp rx=0 tx=0).stop 2024-09-12T02:49:54.619 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:49:54.586+0000 7f5920a00640 1 -- 172.21.15.39:0/3656470889 shutdown_connections 2024-09-12T02:49:54.619 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:49:54.586+0000 7f5920a00640 1 --2- 172.21.15.39:0/3656470889 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f591c10e450 0x7f591c110840 unknown :-1 s=CLOSED pgs=312 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:49:54.619 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:49:54.586+0000 7f5920a00640 1 --2- 172.21.15.39:0/3656470889 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f591c074e30 0x7f591c10df10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:49:54.619 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:49:54.586+0000 7f5920a00640 1 --2- 172.21.15.39:0/3656470889 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f591c074510 0x7f591c0748f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:49:54.620 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:49:54.586+0000 7f5920a00640 1 -- 172.21.15.39:0/3656470889 >> 172.21.15.39:0/3656470889 conn(0x7f591c0fd8b0 msgr2=0x7f591c0ffcd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:49:54.620 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:49:54.586+0000 7f5920a00640 1 -- 172.21.15.39:0/3656470889 shutdown_connections 2024-09-12T02:49:54.620 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:49:54.586+0000 7f5920a00640 1 -- 172.21.15.39:0/3656470889 wait complete. 2024-09-12T02:49:54.620 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:49:54.587+0000 7f5920a00640 1 Processor -- start 2024-09-12T02:49:54.620 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:49:54.587+0000 7f5920a00640 1 -- start start 2024-09-12T02:49:54.620 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:49:54.587+0000 7f5920a00640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f591c074510 0x7f591c19a600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:49:54.620 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:49:54.587+0000 7f5920a00640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f591c074e30 0x7f591c19ab40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:49:54.620 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:49:54.587+0000 7f5920a00640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f591c10e450 0x7f591c19eed0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:49:54.620 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:49:54.587+0000 7f5920a00640 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 -- 0x7f591c114160 con 0x7f591c074510 2024-09-12T02:49:54.620 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:49:54.587+0000 7f5920a00640 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x7f591c113fe0 con 0x7f591c10e450 2024-09-12T02:49:54.620 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:49:54.587+0000 7f5920a00640 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7f591c1142e0 con 0x7f591c074e30 2024-09-12T02:49:54.621 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:49:54.588+0000 7f5919e00640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f591c074510 0x7f591c19a600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:49:54.621 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:49:54.588+0000 7f5911400640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f591c074e30 0x7f591c19ab40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:49:54.621 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:49:54.588+0000 7f5919e00640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f591c074510 0x7f591c19a600 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.39:3300/0 says I am v2:172.21.15.39:35512/0 (socket says 172.21.15.39:35512) 2024-09-12T02:49:54.621 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:49:54.588+0000 7f5919e00640 1 -- 172.21.15.39:0/241249838 learned_addr learned my addr 172.21.15.39:0/241249838 (peer_addr_for_me v2:172.21.15.39:0/0) 2024-09-12T02:49:54.621 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:49:54.588+0000 7f591a800640 1 --2- 172.21.15.39:0/241249838 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f591c10e450 0x7f591c19eed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:49:54.621 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:49:54.588+0000 7f5919e00640 1 -- 172.21.15.39:0/241249838 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f591c074e30 msgr2=0x7f591c19ab40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:49:54.621 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:49:54.588+0000 7f5919e00640 1 --2- 172.21.15.39:0/241249838 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f591c074e30 0x7f591c19ab40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:49:54.621 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:49:54.588+0000 7f5919e00640 1 -- 172.21.15.39:0/241249838 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f591c10e450 msgr2=0x7f591c19eed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:49:54.621 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:49:54.588+0000 7f5919e00640 1 --2- 172.21.15.39:0/241249838 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f591c10e450 0x7f591c19eed0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:49:54.621 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:49:54.588+0000 7f5919e00640 1 -- 172.21.15.39:0/241249838 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f591c19f5b0 con 0x7f591c074510 2024-09-12T02:49:54.621 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:49:54.588+0000 7f5919e00640 1 --2- 172.21.15.39:0/241249838 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f591c074510 0x7f591c19a600 secure :-1 s=READY pgs=313 cs=0 l=1 rev1=1 crypto rx=0x7f590c00c420 tx=0x7f590c009f90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:49:54.622 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:49:54.589+0000 7f5913400640 1 -- 172.21.15.39:0/241249838 <== mon.0 v2:172.21.15.39:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f590c003970 con 0x7f591c074510 2024-09-12T02:49:54.622 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:49:54.589+0000 7f5913400640 1 -- 172.21.15.39:0/241249838 <== mon.0 v2:172.21.15.39:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f590c004020 con 0x7f591c074510 2024-09-12T02:49:54.622 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:49:54.589+0000 7f5920a00640 1 -- 172.21.15.39:0/241249838 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f591c19f8a0 con 0x7f591c074510 2024-09-12T02:49:54.622 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:49:54.589+0000 7f5913400640 1 -- 172.21.15.39:0/241249838 <== mon.0 v2:172.21.15.39:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f590c00bad0 con 0x7f591c074510 2024-09-12T02:49:54.622 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:49:54.589+0000 7f5920a00640 1 -- 172.21.15.39:0/241249838 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f591c1a7180 con 0x7f591c074510 2024-09-12T02:49:54.622 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:49:54.590+0000 7f5920a00640 1 -- 172.21.15.39:0/241249838 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f591c0748f0 con 0x7f591c074510 2024-09-12T02:49:54.622 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:49:54.592+0000 7f5913400640 1 -- 172.21.15.39:0/241249838 <== mon.0 v2:172.21.15.39:3300/0 4 ==== mgrmap(e 27) ==== 137964+0+0 (secure 0 0 0) 0x7f590c01d020 con 0x7f591c074510 2024-09-12T02:49:54.622 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:49:54.594+0000 7f5913400640 1 --2- 172.21.15.39:0/241249838 >> [v2:172.21.15.39:6800/2187509357,v1:172.21.15.39:6801/2187509357] conn(0x7f59000a2cf0 0x7f59000a51b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:49:54.622 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:49:54.594+0000 7f5913400640 1 -- 172.21.15.39:0/241249838 <== mon.0 v2:172.21.15.39:3300/0 5 ==== osd_map(111..111 src has 1..111) ==== 8733+0+0 (secure 0 0 0) 0x7f590c0cf3d0 con 0x7f591c074510 2024-09-12T02:49:54.622 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:49:54.594+0000 7f5911400640 1 --2- 172.21.15.39:0/241249838 >> [v2:172.21.15.39:6800/2187509357,v1:172.21.15.39:6801/2187509357] conn(0x7f59000a2cf0 0x7f59000a51b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:49:54.622 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:49:54.595+0000 7f5911400640 1 --2- 172.21.15.39:0/241249838 >> [v2:172.21.15.39:6800/2187509357,v1:172.21.15.39:6801/2187509357] conn(0x7f59000a2cf0 0x7f59000a51b0 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7f591c10f770 tx=0x7f590400b410 comp rx=0 tx=0).ready entity=mgr.25199 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:49:54.622 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:49:54.598+0000 7f5913400640 1 -- 172.21.15.39:0/241249838 <== mon.0 v2:172.21.15.39:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7f590c09bec0 con 0x7f591c074510 2024-09-12T02:49:54.787 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:49:54.786+0000 7f5920a00640 1 -- 172.21.15.39:0/241249838 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_data_ec", "pool2": "cephfs_data_ec", "yes_i_really_really_mean_it": true} v 0) -- 0x7f591c1a7420 con 0x7f591c074510 2024-09-12T02:49:54.857 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:49:54.856+0000 7f5913400640 1 -- 172.21.15.39:0/241249838 <== mon.0 v2:172.21.15.39:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_data_ec", "pool2": "cephfs_data_ec", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_data_ec' removed v112) ==== 178+0+0 (secure 0 0 0) 0x7f590c09b7c0 con 0x7f591c074510 2024-09-12T02:49:54.858 INFO:teuthology.orchestra.run.smithi039.stderr:pool 'cephfs_data_ec' removed 2024-09-12T02:49:54.860 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:49:54.859+0000 7f5920a00640 1 -- 172.21.15.39:0/241249838 >> [v2:172.21.15.39:6800/2187509357,v1:172.21.15.39:6801/2187509357] conn(0x7f59000a2cf0 msgr2=0x7f59000a51b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:49:54.860 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:49:54.859+0000 7f5920a00640 1 --2- 172.21.15.39:0/241249838 >> [v2:172.21.15.39:6800/2187509357,v1:172.21.15.39:6801/2187509357] conn(0x7f59000a2cf0 0x7f59000a51b0 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7f591c10f770 tx=0x7f590400b410 comp rx=0 tx=0).stop 2024-09-12T02:49:54.860 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:49:54.859+0000 7f5920a00640 1 -- 172.21.15.39:0/241249838 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f591c074510 msgr2=0x7f591c19a600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:49:54.860 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:49:54.859+0000 7f5920a00640 1 --2- 172.21.15.39:0/241249838 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f591c074510 0x7f591c19a600 secure :-1 s=READY pgs=313 cs=0 l=1 rev1=1 crypto rx=0x7f590c00c420 tx=0x7f590c009f90 comp rx=0 tx=0).stop 2024-09-12T02:49:54.860 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:49:54.859+0000 7f5920a00640 1 -- 172.21.15.39:0/241249838 shutdown_connections 2024-09-12T02:49:54.860 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:49:54.859+0000 7f5920a00640 1 --2- 172.21.15.39:0/241249838 >> [v2:172.21.15.39:6800/2187509357,v1:172.21.15.39:6801/2187509357] conn(0x7f59000a2cf0 0x7f59000a51b0 unknown :-1 s=CLOSED pgs=70 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:49:54.860 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:49:54.859+0000 7f5920a00640 1 --2- 172.21.15.39:0/241249838 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f591c10e450 0x7f591c19eed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:49:54.860 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:49:54.859+0000 7f5920a00640 1 --2- 172.21.15.39:0/241249838 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f591c074e30 0x7f591c19ab40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:49:54.860 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:49:54.859+0000 7f5920a00640 1 --2- 172.21.15.39:0/241249838 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f591c074510 0x7f591c19a600 unknown :-1 s=CLOSED pgs=313 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:49:54.860 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:49:54.859+0000 7f5920a00640 1 -- 172.21.15.39:0/241249838 >> 172.21.15.39:0/241249838 conn(0x7f591c0fd8b0 msgr2=0x7f591c0fe4b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:49:54.860 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:49:54.859+0000 7f5920a00640 1 -- 172.21.15.39:0/241249838 shutdown_connections 2024-09-12T02:49:54.861 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-12T02:49:54.859+0000 7f5920a00640 1 -- 172.21.15.39:0/241249838 wait complete. 2024-09-12T02:49:55.099 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 02:49:54 smithi039 ceph-mon[30515]: from='client.? 172.21.15.39:0/241249838' entity='client.admin' cmd=[{"prefix": "osd pool rm", "pool": "cephfs_data_ec", "pool2": "cephfs_data_ec", "yes_i_really_really_mean_it": true}]: dispatch 2024-09-12T02:49:55.165 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 12 02:49:54 smithi172 ceph-mon[35609]: from='client.? 172.21.15.39:0/241249838' entity='client.admin' cmd=[{"prefix": "osd pool rm", "pool": "cephfs_data_ec", "pool2": "cephfs_data_ec", "yes_i_really_really_mean_it": true}]: dispatch 2024-09-12T02:49:55.198 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 12 02:49:54 smithi044 ceph-mon[35411]: from='client.? 172.21.15.39:0/241249838' entity='client.admin' cmd=[{"prefix": "osd pool rm", "pool": "cephfs_data_ec", "pool2": "cephfs_data_ec", "yes_i_really_really_mean_it": true}]: dispatch 2024-09-12T02:49:55.641 DEBUG:teuthology.orchestra.run.smithi039:> sudo rm -f /etc/ceph/ceph.conf /etc/ceph/ceph.client.admin.keyring 2024-09-12T02:49:55.698 DEBUG:teuthology.orchestra.run.smithi044:> sudo rm -f /etc/ceph/ceph.conf /etc/ceph/ceph.client.admin.keyring 2024-09-12T02:49:55.732 DEBUG:teuthology.orchestra.run.smithi172:> sudo rm -f /etc/ceph/ceph.conf /etc/ceph/ceph.client.admin.keyring 2024-09-12T02:49:55.768 INFO:tasks.cephadm:Cleaning up testdir ceph.* files... 2024-09-12T02:49:55.768 DEBUG:teuthology.orchestra.run.smithi039:> rm -f /home/ubuntu/cephtest/seed.ceph.conf /home/ubuntu/cephtest/ceph.pub 2024-09-12T02:49:55.804 DEBUG:teuthology.orchestra.run.smithi044:> rm -f /home/ubuntu/cephtest/seed.ceph.conf /home/ubuntu/cephtest/ceph.pub 2024-09-12T02:49:55.822 DEBUG:teuthology.orchestra.run.smithi172:> rm -f /home/ubuntu/cephtest/seed.ceph.conf /home/ubuntu/cephtest/ceph.pub 2024-09-12T02:49:55.838 INFO:tasks.cephadm:Stopping all daemons... 2024-09-12T02:49:55.839 INFO:tasks.cephadm.mon.a:Stopping mon.a... 2024-09-12T02:49:55.839 DEBUG:teuthology.orchestra.run.smithi039:> sudo systemctl stop ceph-4954ed46-70ae-11ef-bcea-c7b262605968@mon.a 2024-09-12T02:49:56.013 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 12 02:49:55 smithi172 ceph-mon[35609]: pgmap v377: 33 pgs: 33 active+clean; 577 KiB data, 427 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-12T02:49:56.013 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 12 02:49:55 smithi172 ceph-mon[35609]: from='client.? 172.21.15.39:0/241249838' entity='client.admin' cmd='[{"prefix": "osd pool rm", "pool": "cephfs_data_ec", "pool2": "cephfs_data_ec", "yes_i_really_really_mean_it": true}]': finished 2024-09-12T02:49:56.014 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 12 02:49:55 smithi172 ceph-mon[35609]: osdmap e112: 12 total, 12 up, 12 in 2024-09-12T02:49:56.198 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 12 02:49:55 smithi044 ceph-mon[35411]: pgmap v377: 33 pgs: 33 active+clean; 577 KiB data, 427 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-12T02:49:56.199 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 12 02:49:55 smithi044 ceph-mon[35411]: from='client.? 172.21.15.39:0/241249838' entity='client.admin' cmd='[{"prefix": "osd pool rm", "pool": "cephfs_data_ec", "pool2": "cephfs_data_ec", "yes_i_really_really_mean_it": true}]': finished 2024-09-12T02:49:56.199 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 12 02:49:55 smithi044 ceph-mon[35411]: osdmap e112: 12 total, 12 up, 12 in 2024-09-12T02:49:56.272 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 02:49:55 smithi039 ceph-mon[30515]: pgmap v377: 33 pgs: 33 active+clean; 577 KiB data, 427 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-12T02:49:56.272 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 02:49:55 smithi039 ceph-mon[30515]: from='client.? 172.21.15.39:0/241249838' entity='client.admin' cmd='[{"prefix": "osd pool rm", "pool": "cephfs_data_ec", "pool2": "cephfs_data_ec", "yes_i_really_really_mean_it": true}]': finished 2024-09-12T02:49:56.273 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 02:49:55 smithi039 ceph-mon[30515]: osdmap e112: 12 total, 12 up, 12 in 2024-09-12T02:49:56.273 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 02:49:55 smithi039 systemd[1]: Stopping Ceph mon.a for 4954ed46-70ae-11ef-bcea-c7b262605968... 2024-09-12T02:49:56.599 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 02:49:56 smithi039 ceph-4954ed46-70ae-11ef-bcea-c7b262605968-mon-a[30511]: 2024-09-12T02:49:56.270+0000 7ff1ac000640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-mon -n mon.a -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false --default-mon-cluster-log-to-file=false --default-mon-cluster-log-to-journald=true --default-mon-cluster-log-to-stderr=false (PID: 1) UID: 0 2024-09-12T02:49:56.600 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 02:49:56 smithi039 ceph-4954ed46-70ae-11ef-bcea-c7b262605968-mon-a[30511]: 2024-09-12T02:49:56.270+0000 7ff1ac000640 -1 mon.a@0(leader) e3 *** Got Signal Terminated *** 2024-09-12T02:49:56.600 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 02:49:56 smithi039 podman[90343]: 2024-09-12 02:49:56.312564607 +0000 UTC m=+0.176954140 container died aa6e01b76020ab1785ea97ec82bd174a8c7eaf3009a8decf95b4d521220b1f61 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc, name=ceph-4954ed46-70ae-11ef-bcea-c7b262605968-mon-a, ceph=True, GIT_REPO=git@github.com:ceph/ceph-container.git, maintainer=Guillaume Abrioux , org.label-schema.vendor=CentOS, RELEASE=squid-b53b6d3, io.buildah.version=1.37.2, CEPH_POINT_RELEASE=, org.label-schema.name=CentOS Stream 9 Base Image, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, GIT_CLEAN=True, GIT_BRANCH=HEAD, org.label-schema.license=GPLv2, org.label-schema.build-date=20240731, org.label-schema.schema-version=1.0) 2024-09-12T02:49:56.998 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 02:49:56 smithi039 podman[90343]: 2024-09-12 02:49:56.751085382 +0000 UTC m=+0.615474915 container cleanup aa6e01b76020ab1785ea97ec82bd174a8c7eaf3009a8decf95b4d521220b1f61 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc, name=ceph-4954ed46-70ae-11ef-bcea-c7b262605968-mon-a, org.label-schema.schema-version=1.0, maintainer=Guillaume Abrioux , CEPH_POINT_RELEASE=, org.label-schema.name=CentOS Stream 9 Base Image, RELEASE=squid-b53b6d3, ceph=True, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.build-date=20240731, GIT_CLEAN=True, GIT_BRANCH=HEAD, org.label-schema.license=GPLv2, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, io.buildah.version=1.37.2, org.label-schema.vendor=CentOS) 2024-09-12T02:49:56.999 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 02:49:56 smithi039 bash[90343]: ceph-4954ed46-70ae-11ef-bcea-c7b262605968-mon-a 2024-09-12T02:49:57.277 INFO:journalctl@ceph.mon.a.smithi039.stdout:Sep 12 02:49:56 smithi039 podman[90355]: 2024-09-12 02:49:56.998675502 +0000 UTC m=+0.682274296 container remove aa6e01b76020ab1785ea97ec82bd174a8c7eaf3009a8decf95b4d521220b1f61 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc, name=ceph-4954ed46-70ae-11ef-bcea-c7b262605968-mon-a, GIT_REPO=git@github.com:ceph/ceph-container.git, RELEASE=squid-b53b6d3, GIT_CLEAN=True, maintainer=Guillaume Abrioux , org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.schema-version=1.0, org.label-schema.vendor=CentOS, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.license=GPLv2, CEPH_POINT_RELEASE=, org.label-schema.build-date=20240731, GIT_BRANCH=HEAD, io.buildah.version=1.37.2, ceph=True) 2024-09-12T02:49:57.295 DEBUG:teuthology.orchestra.run.smithi039:> sudo pkill -f 'journalctl -f -n 0 -u ceph-4954ed46-70ae-11ef-bcea-c7b262605968@mon.a.service' 2024-09-12T02:49:57.380 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-09-12T02:49:57.381 INFO:tasks.cephadm.mon.a:Stopped mon.a 2024-09-12T02:49:57.381 INFO:tasks.cephadm.mon.c:Stopping mon.b... 2024-09-12T02:49:57.381 DEBUG:teuthology.orchestra.run.smithi044:> sudo systemctl stop ceph-4954ed46-70ae-11ef-bcea-c7b262605968@mon.b 2024-09-12T02:49:57.699 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 12 02:49:57 smithi044 systemd[1]: Stopping Ceph mon.b for 4954ed46-70ae-11ef-bcea-c7b262605968... 2024-09-12T02:49:58.199 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 12 02:49:57 smithi044 ceph-4954ed46-70ae-11ef-bcea-c7b262605968-mon-b[35407]: 2024-09-12T02:49:57.726+0000 7fe25058e640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-mon -n mon.b -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false --default-mon-cluster-log-to-file=false --default-mon-cluster-log-to-journald=true --default-mon-cluster-log-to-stderr=false (PID: 1) UID: 0 2024-09-12T02:49:58.199 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 12 02:49:57 smithi044 ceph-4954ed46-70ae-11ef-bcea-c7b262605968-mon-b[35407]: 2024-09-12T02:49:57.726+0000 7fe25058e640 -1 mon.b@2(peon) e3 *** Got Signal Terminated *** 2024-09-12T02:49:58.199 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 12 02:49:57 smithi044 podman[71719]: 2024-09-12 02:49:57.932332081 +0000 UTC m=+0.351370340 container died 41838f02b634abb688a9fb1f3a8a15bb75d3f2d8da7c345ab802229c9adb2389 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:3be30d720e37ec4df7f667e60f22b4d221c4ce7b408e68b90f9ac10220535e66, name=ceph-4954ed46-70ae-11ef-bcea-c7b262605968-mon-b, GIT_CLEAN=True, org.label-schema.build-date=20240731, GIT_BRANCH=HEAD, ceph=True, RELEASE=squid-b53b6d3, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.license=GPLv2, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.vendor=CentOS, GIT_REPO=git@github.com:ceph/ceph-container.git, CEPH_POINT_RELEASE=, io.buildah.version=1.37.2, maintainer=Guillaume Abrioux , org.label-schema.schema-version=1.0) 2024-09-12T02:49:58.671 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 12 02:49:58 smithi044 podman[71719]: 2024-09-12 02:49:58.411519107 +0000 UTC m=+0.830557366 container cleanup 41838f02b634abb688a9fb1f3a8a15bb75d3f2d8da7c345ab802229c9adb2389 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:3be30d720e37ec4df7f667e60f22b4d221c4ce7b408e68b90f9ac10220535e66, name=ceph-4954ed46-70ae-11ef-bcea-c7b262605968-mon-b, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, GIT_REPO=git@github.com:ceph/ceph-container.git, CEPH_POINT_RELEASE=, RELEASE=squid-b53b6d3, org.label-schema.build-date=20240731, GIT_BRANCH=HEAD, ceph=True, GIT_CLEAN=True, io.buildah.version=1.37.2, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.schema-version=1.0, maintainer=Guillaume Abrioux , org.label-schema.license=GPLv2, org.label-schema.vendor=CentOS) 2024-09-12T02:49:58.671 INFO:journalctl@ceph.mon.b.smithi044.stdout:Sep 12 02:49:58 smithi044 bash[71719]: ceph-4954ed46-70ae-11ef-bcea-c7b262605968-mon-b 2024-09-12T02:49:58.845 DEBUG:teuthology.orchestra.run.smithi044:> sudo pkill -f 'journalctl -f -n 0 -u ceph-4954ed46-70ae-11ef-bcea-c7b262605968@mon.b.service' 2024-09-12T02:49:58.887 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-09-12T02:49:58.887 INFO:tasks.cephadm.mon.c:Stopped mon.b 2024-09-12T02:49:58.887 INFO:tasks.cephadm.mon.c:Stopping mon.c... 2024-09-12T02:49:58.888 DEBUG:teuthology.orchestra.run.smithi172:> sudo systemctl stop ceph-4954ed46-70ae-11ef-bcea-c7b262605968@mon.c 2024-09-12T02:49:59.217 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 12 02:49:58 smithi172 systemd[1]: Stopping Ceph mon.c for 4954ed46-70ae-11ef-bcea-c7b262605968... 2024-09-12T02:49:59.513 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 12 02:49:59 smithi172 ceph-4954ed46-70ae-11ef-bcea-c7b262605968-mon-c[35605]: 2024-09-12T02:49:59.216+0000 7f465c8f7640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-mon -n mon.c -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false --default-mon-cluster-log-to-file=false --default-mon-cluster-log-to-journald=true --default-mon-cluster-log-to-stderr=false (PID: 1) UID: 0 2024-09-12T02:49:59.514 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 12 02:49:59 smithi172 ceph-4954ed46-70ae-11ef-bcea-c7b262605968-mon-c[35605]: 2024-09-12T02:49:59.216+0000 7f465c8f7640 -1 mon.c@1(peon) e3 *** Got Signal Terminated *** 2024-09-12T02:49:59.514 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 12 02:49:59 smithi172 podman[72309]: 2024-09-12 02:49:59.339535907 +0000 UTC m=+0.248759064 container died d652d920a68131c82cc8981f2e3c21867791ae6f87554cb9b7e48df69d048395 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:3be30d720e37ec4df7f667e60f22b4d221c4ce7b408e68b90f9ac10220535e66, name=ceph-4954ed46-70ae-11ef-bcea-c7b262605968-mon-c, ceph=True, org.label-schema.vendor=CentOS, RELEASE=squid-b53b6d3, CEPH_POINT_RELEASE=, GIT_CLEAN=True, io.buildah.version=1.37.2, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.build-date=20240731, org.label-schema.license=GPLv2, org.label-schema.schema-version=1.0, org.label-schema.name=CentOS Stream 9 Base Image, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_BRANCH=HEAD, maintainer=Guillaume Abrioux ) 2024-09-12T02:50:00.002 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 12 02:49:59 smithi172 podman[72309]: 2024-09-12 02:49:59.683970574 +0000 UTC m=+0.593193731 container cleanup d652d920a68131c82cc8981f2e3c21867791ae6f87554cb9b7e48df69d048395 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:3be30d720e37ec4df7f667e60f22b4d221c4ce7b408e68b90f9ac10220535e66, name=ceph-4954ed46-70ae-11ef-bcea-c7b262605968-mon-c, RELEASE=squid-b53b6d3, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.license=GPLv2, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.schema-version=1.0, org.label-schema.vendor=CentOS, CEPH_POINT_RELEASE=, GIT_BRANCH=HEAD, org.label-schema.build-date=20240731, maintainer=Guillaume Abrioux , GIT_CLEAN=True, ceph=True, io.buildah.version=1.37.2) 2024-09-12T02:50:00.003 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 12 02:49:59 smithi172 bash[72309]: ceph-4954ed46-70ae-11ef-bcea-c7b262605968-mon-c 2024-09-12T02:50:00.126 DEBUG:teuthology.orchestra.run.smithi172:> sudo pkill -f 'journalctl -f -n 0 -u ceph-4954ed46-70ae-11ef-bcea-c7b262605968@mon.c.service' 2024-09-12T02:50:00.175 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-09-12T02:50:00.175 INFO:tasks.cephadm.mon.c:Stopped mon.c 2024-09-12T02:50:00.175 INFO:tasks.cephadm.mgr.x:Stopping mgr.x... 2024-09-12T02:50:00.176 DEBUG:teuthology.orchestra.run.smithi039:> sudo systemctl stop ceph-4954ed46-70ae-11ef-bcea-c7b262605968@mgr.x 2024-09-12T02:50:00.599 INFO:journalctl@ceph.mgr.x.smithi039.stdout:Sep 12 02:50:00 smithi039 systemd[1]: Stopping Ceph mgr.x for 4954ed46-70ae-11ef-bcea-c7b262605968... 2024-09-12T02:50:00.600 INFO:journalctl@ceph.mgr.x.smithi039.stdout:Sep 12 02:50:00 smithi039 ceph-4954ed46-70ae-11ef-bcea-c7b262605968-mgr-x[30736]: 2024-09-12T02:50:00.313+0000 7fba18e00640 -1 client.15240: SimpleRADOSStriper: lock: snap_db_v0.db: lock failed: (2) No such file or directory 2024-09-12T02:50:01.015 INFO:journalctl@ceph.mgr.x.smithi039.stdout:Sep 12 02:50:00 smithi039 ceph-4954ed46-70ae-11ef-bcea-c7b262605968-mgr-x[30736]: 2024-09-12T02:50:00.608+0000 7fbaeb400640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-mgr -n mgr.x -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-09-12T02:50:01.015 INFO:journalctl@ceph.mgr.x.smithi039.stdout:Sep 12 02:50:00 smithi039 ceph-4954ed46-70ae-11ef-bcea-c7b262605968-mgr-x[30736]: 2024-09-12T02:50:00.608+0000 7fbaeb400640 -1 mgr handle_mgr_signal *** Got signal Terminated *** 2024-09-12T02:50:01.015 INFO:journalctl@ceph.mgr.x.smithi039.stdout:Sep 12 02:50:00 smithi039 podman[90468]: 2024-09-12 02:50:00.692242592 +0000 UTC m=+0.225965466 container died 3e91a1d13a6a4a2fd71d7e803e4a5d774aa3752b5d25b32347c1cb6d848abef9 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc, name=ceph-4954ed46-70ae-11ef-bcea-c7b262605968-mgr-x, org.label-schema.schema-version=1.0, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.vendor=CentOS, GIT_BRANCH=HEAD, RELEASE=squid-b53b6d3, CEPH_POINT_RELEASE=, org.label-schema.license=GPLv2, maintainer=Guillaume Abrioux , org.label-schema.build-date=20240731, GIT_CLEAN=True, io.buildah.version=1.37.2, org.label-schema.name=CentOS Stream 9 Base Image, ceph=True, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7) 2024-09-12T02:50:01.349 INFO:journalctl@ceph.mgr.x.smithi039.stdout:Sep 12 02:50:01 smithi039 podman[90468]: 2024-09-12 02:50:01.180502371 +0000 UTC m=+0.714225243 container cleanup 3e91a1d13a6a4a2fd71d7e803e4a5d774aa3752b5d25b32347c1cb6d848abef9 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc, name=ceph-4954ed46-70ae-11ef-bcea-c7b262605968-mgr-x, RELEASE=squid-b53b6d3, org.label-schema.vendor=CentOS, GIT_REPO=git@github.com:ceph/ceph-container.git, ceph=True, GIT_BRANCH=HEAD, org.label-schema.schema-version=1.0, GIT_CLEAN=True, maintainer=Guillaume Abrioux , org.label-schema.build-date=20240731, io.buildah.version=1.37.2, org.label-schema.name=CentOS Stream 9 Base Image, CEPH_POINT_RELEASE=, org.label-schema.license=GPLv2, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7) 2024-09-12T02:50:01.350 INFO:journalctl@ceph.mgr.x.smithi039.stdout:Sep 12 02:50:01 smithi039 bash[90468]: ceph-4954ed46-70ae-11ef-bcea-c7b262605968-mgr-x 2024-09-12T02:50:01.668 INFO:journalctl@ceph.mgr.x.smithi039.stdout:Sep 12 02:50:01 smithi039 podman[90479]: 2024-09-12 02:50:01.415288546 +0000 UTC m=+0.709044925 container remove 3e91a1d13a6a4a2fd71d7e803e4a5d774aa3752b5d25b32347c1cb6d848abef9 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc, name=ceph-4954ed46-70ae-11ef-bcea-c7b262605968-mgr-x, org.label-schema.build-date=20240731, GIT_REPO=git@github.com:ceph/ceph-container.git, RELEASE=squid-b53b6d3, ceph=True, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.schema-version=1.0, io.buildah.version=1.37.2, GIT_BRANCH=HEAD, org.label-schema.vendor=CentOS, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.license=GPLv2, CEPH_POINT_RELEASE=, maintainer=Guillaume Abrioux , GIT_CLEAN=True) 2024-09-12T02:50:01.676 DEBUG:teuthology.orchestra.run.smithi039:> sudo pkill -f 'journalctl -f -n 0 -u ceph-4954ed46-70ae-11ef-bcea-c7b262605968@mgr.x.service' 2024-09-12T02:50:01.750 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-09-12T02:50:01.750 INFO:tasks.cephadm.mgr.x:Stopped mgr.x 2024-09-12T02:50:01.750 INFO:tasks.cephadm.mgr.y:Stopping mgr.y... 2024-09-12T02:50:01.750 DEBUG:teuthology.orchestra.run.smithi044:> sudo systemctl stop ceph-4954ed46-70ae-11ef-bcea-c7b262605968@mgr.y 2024-09-12T02:50:02.121 INFO:journalctl@ceph.mgr.y.smithi044.stdout:Sep 12 02:50:01 smithi044 systemd[1]: Stopping Ceph mgr.y for 4954ed46-70ae-11ef-bcea-c7b262605968... 2024-09-12T02:50:02.400 INFO:journalctl@ceph.mgr.y.smithi044.stdout:Sep 12 02:50:02 smithi044 podman[71843]: 2024-09-12 02:50:02.120811555 +0000 UTC m=+0.165518393 container died 3fe9c80a9d1e9c5535ef736bb93d8ddc78f3c7f03cca581594b3036d77fac138 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:3be30d720e37ec4df7f667e60f22b4d221c4ce7b408e68b90f9ac10220535e66, name=ceph-4954ed46-70ae-11ef-bcea-c7b262605968-mgr-y, ceph=True, org.label-schema.vendor=CentOS, org.label-schema.build-date=20240731, GIT_BRANCH=HEAD, RELEASE=squid-b53b6d3, maintainer=Guillaume Abrioux , org.label-schema.license=GPLv2, org.label-schema.name=CentOS Stream 9 Base Image, CEPH_POINT_RELEASE=, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.schema-version=1.0, io.buildah.version=1.37.2, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_CLEAN=True) 2024-09-12T02:50:02.698 INFO:journalctl@ceph.mgr.y.smithi044.stdout:Sep 12 02:50:02 smithi044 podman[71843]: 2024-09-12 02:50:02.500625767 +0000 UTC m=+0.545332606 container cleanup 3fe9c80a9d1e9c5535ef736bb93d8ddc78f3c7f03cca581594b3036d77fac138 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:3be30d720e37ec4df7f667e60f22b4d221c4ce7b408e68b90f9ac10220535e66, name=ceph-4954ed46-70ae-11ef-bcea-c7b262605968-mgr-y, org.label-schema.build-date=20240731, GIT_BRANCH=HEAD, CEPH_POINT_RELEASE=, io.buildah.version=1.37.2, maintainer=Guillaume Abrioux , GIT_CLEAN=True, org.label-schema.license=GPLv2, RELEASE=squid-b53b6d3, org.label-schema.vendor=CentOS, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.schema-version=1.0, ceph=True) 2024-09-12T02:50:02.699 INFO:journalctl@ceph.mgr.y.smithi044.stdout:Sep 12 02:50:02 smithi044 bash[71843]: ceph-4954ed46-70ae-11ef-bcea-c7b262605968-mgr-y 2024-09-12T02:50:02.979 DEBUG:teuthology.orchestra.run.smithi044:> sudo pkill -f 'journalctl -f -n 0 -u ceph-4954ed46-70ae-11ef-bcea-c7b262605968@mgr.y.service' 2024-09-12T02:50:03.014 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-09-12T02:50:03.014 INFO:tasks.cephadm.mgr.y:Stopped mgr.y 2024-09-12T02:50:03.014 INFO:tasks.cephadm.mgr.z:Stopping mgr.z... 2024-09-12T02:50:03.014 DEBUG:teuthology.orchestra.run.smithi172:> sudo systemctl stop ceph-4954ed46-70ae-11ef-bcea-c7b262605968@mgr.z 2024-09-12T02:50:03.352 INFO:journalctl@ceph.mgr.z.smithi172.stdout:Sep 12 02:50:03 smithi172 systemd[1]: Stopping Ceph mgr.z for 4954ed46-70ae-11ef-bcea-c7b262605968... 2024-09-12T02:50:03.641 INFO:journalctl@ceph.mgr.z.smithi172.stdout:Sep 12 02:50:03 smithi172 podman[72434]: 2024-09-12 02:50:03.351753629 +0000 UTC m=+0.142162633 container died 650e5692e1e13bc86368c20dc0358c9ba5fec6c78e04c987ed7fc3a6cce4ba75 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:3be30d720e37ec4df7f667e60f22b4d221c4ce7b408e68b90f9ac10220535e66, name=ceph-4954ed46-70ae-11ef-bcea-c7b262605968-mgr-z, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.build-date=20240731, maintainer=Guillaume Abrioux , org.label-schema.schema-version=1.0, RELEASE=squid-b53b6d3, ceph=True, org.label-schema.license=GPLv2, org.label-schema.name=CentOS Stream 9 Base Image, GIT_REPO=git@github.com:ceph/ceph-container.git, io.buildah.version=1.37.2, GIT_CLEAN=True, org.label-schema.vendor=CentOS, CEPH_POINT_RELEASE=, GIT_BRANCH=HEAD) 2024-09-12T02:50:03.949 INFO:journalctl@ceph.mgr.z.smithi172.stdout:Sep 12 02:50:03 smithi172 podman[72434]: 2024-09-12 02:50:03.739765525 +0000 UTC m=+0.530174520 container cleanup 650e5692e1e13bc86368c20dc0358c9ba5fec6c78e04c987ed7fc3a6cce4ba75 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:3be30d720e37ec4df7f667e60f22b4d221c4ce7b408e68b90f9ac10220535e66, name=ceph-4954ed46-70ae-11ef-bcea-c7b262605968-mgr-z, CEPH_POINT_RELEASE=, GIT_CLEAN=True, org.label-schema.vendor=CentOS, org.label-schema.schema-version=1.0, maintainer=Guillaume Abrioux , GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.name=CentOS Stream 9 Base Image, io.buildah.version=1.37.2, GIT_BRANCH=HEAD, RELEASE=squid-b53b6d3, GIT_REPO=git@github.com:ceph/ceph-container.git, ceph=True, org.label-schema.license=GPLv2, org.label-schema.build-date=20240731) 2024-09-12T02:50:03.949 INFO:journalctl@ceph.mgr.z.smithi172.stdout:Sep 12 02:50:03 smithi172 bash[72434]: ceph-4954ed46-70ae-11ef-bcea-c7b262605968-mgr-z 2024-09-12T02:50:04.174 DEBUG:teuthology.orchestra.run.smithi172:> sudo pkill -f 'journalctl -f -n 0 -u ceph-4954ed46-70ae-11ef-bcea-c7b262605968@mgr.z.service' 2024-09-12T02:50:04.209 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-09-12T02:50:04.210 INFO:tasks.cephadm.mgr.z:Stopped mgr.z 2024-09-12T02:50:04.210 INFO:tasks.cephadm.osd.0:Stopping osd.0... 2024-09-12T02:50:04.210 DEBUG:teuthology.orchestra.run.smithi039:> sudo systemctl stop ceph-4954ed46-70ae-11ef-bcea-c7b262605968@osd.0 2024-09-12T02:50:04.599 INFO:journalctl@ceph.osd.0.smithi039.stdout:Sep 12 02:50:04 smithi039 systemd[1]: Stopping Ceph osd.0 for 4954ed46-70ae-11ef-bcea-c7b262605968... 2024-09-12T02:50:05.099 INFO:journalctl@ceph.osd.0.smithi039.stdout:Sep 12 02:50:04 smithi039 ceph-4954ed46-70ae-11ef-bcea-c7b262605968-osd-0[44095]: 2024-09-12T02:50:04.651+0000 7fac9f000640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-osd -n osd.0 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-09-12T02:50:05.100 INFO:journalctl@ceph.osd.0.smithi039.stdout:Sep 12 02:50:04 smithi039 ceph-4954ed46-70ae-11ef-bcea-c7b262605968-osd-0[44095]: 2024-09-12T02:50:04.651+0000 7fac9f000640 -1 osd.0 112 *** Got signal Terminated *** 2024-09-12T02:50:05.100 INFO:journalctl@ceph.osd.0.smithi039.stdout:Sep 12 02:50:04 smithi039 ceph-4954ed46-70ae-11ef-bcea-c7b262605968-osd-0[44095]: 2024-09-12T02:50:04.651+0000 7fac9f000640 -1 osd.0 112 *** Immediate shutdown (osd_fast_shutdown=true) *** 2024-09-12T02:50:10.489 INFO:journalctl@ceph.osd.0.smithi039.stdout:Sep 12 02:50:10 smithi039 podman[90590]: 2024-09-12 02:50:10.171787302 +0000 UTC m=+5.672025458 container died b108ae4a0fad0b30630dd4e64503d69b59c7f6eaf6990c203410fd3bc3e19323 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:3be30d720e37ec4df7f667e60f22b4d221c4ce7b408e68b90f9ac10220535e66, name=ceph-4954ed46-70ae-11ef-bcea-c7b262605968-osd-0, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.license=GPLv2, RELEASE=squid-b53b6d3, org.label-schema.build-date=20240731, CEPH_POINT_RELEASE=, GIT_BRANCH=HEAD, GIT_CLEAN=True, org.label-schema.name=CentOS Stream 9 Base Image, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.vendor=CentOS, io.buildah.version=1.37.2, ceph=True, org.label-schema.schema-version=1.0, maintainer=Guillaume Abrioux ) 2024-09-12T02:50:10.822 INFO:journalctl@ceph.osd.0.smithi039.stdout:Sep 12 02:50:10 smithi039 podman[90590]: 2024-09-12 02:50:10.603428474 +0000 UTC m=+6.103666629 container cleanup b108ae4a0fad0b30630dd4e64503d69b59c7f6eaf6990c203410fd3bc3e19323 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:3be30d720e37ec4df7f667e60f22b4d221c4ce7b408e68b90f9ac10220535e66, name=ceph-4954ed46-70ae-11ef-bcea-c7b262605968-osd-0, RELEASE=squid-b53b6d3, CEPH_POINT_RELEASE=, io.buildah.version=1.37.2, GIT_BRANCH=HEAD, org.label-schema.schema-version=1.0, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_CLEAN=True, org.label-schema.name=CentOS Stream 9 Base Image, maintainer=Guillaume Abrioux , org.label-schema.vendor=CentOS, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, ceph=True, org.label-schema.license=GPLv2, org.label-schema.build-date=20240731) 2024-09-12T02:50:10.822 INFO:journalctl@ceph.osd.0.smithi039.stdout:Sep 12 02:50:10 smithi039 bash[90590]: ceph-4954ed46-70ae-11ef-bcea-c7b262605968-osd-0 2024-09-12T02:50:11.099 INFO:journalctl@ceph.osd.0.smithi039.stdout:Sep 12 02:50:10 smithi039 podman[90605]: 2024-09-12 02:50:10.821717121 +0000 UTC m=+0.643053730 container remove b108ae4a0fad0b30630dd4e64503d69b59c7f6eaf6990c203410fd3bc3e19323 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:3be30d720e37ec4df7f667e60f22b4d221c4ce7b408e68b90f9ac10220535e66, name=ceph-4954ed46-70ae-11ef-bcea-c7b262605968-osd-0, GIT_REPO=git@github.com:ceph/ceph-container.git, CEPH_POINT_RELEASE=, io.buildah.version=1.37.2, org.label-schema.license=GPLv2, RELEASE=squid-b53b6d3, maintainer=Guillaume Abrioux , GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.vendor=CentOS, GIT_CLEAN=True, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.schema-version=1.0, GIT_BRANCH=HEAD, ceph=True, org.label-schema.build-date=20240731) 2024-09-12T02:50:11.667 INFO:journalctl@ceph.osd.0.smithi039.stdout:Sep 12 02:50:11 smithi039 podman[90696]: 2024-09-12 02:50:11.286897008 +0000 UTC m=+0.027542042 image pull 54467abc55f864c4f73dfaf9c6ac3bb3e87b773123d5badaf790bee57321d594 quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:3be30d720e37ec4df7f667e60f22b4d221c4ce7b408e68b90f9ac10220535e66 2024-09-12T02:50:11.667 INFO:journalctl@ceph.osd.0.smithi039.stdout:Sep 12 02:50:11 smithi039 podman[90696]: 2024-09-12 02:50:11.414227781 +0000 UTC m=+0.154872814 container create d40c92d45c1f8ad3f07167b3ce098e21f9255888bcc004e8ced9f172d4b46770 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:3be30d720e37ec4df7f667e60f22b4d221c4ce7b408e68b90f9ac10220535e66, name=ceph-4954ed46-70ae-11ef-bcea-c7b262605968-osd-0-deactivate, RELEASE=squid-b53b6d3, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, io.buildah.version=1.37.2, org.label-schema.name=CentOS Stream 9 Base Image, GIT_CLEAN=True, GIT_REPO=git@github.com:ceph/ceph-container.git, ceph=True, maintainer=Guillaume Abrioux , org.label-schema.schema-version=1.0, CEPH_POINT_RELEASE=, org.label-schema.license=GPLv2, org.label-schema.vendor=CentOS, GIT_BRANCH=HEAD, org.label-schema.build-date=20240731) 2024-09-12T02:50:11.932 INFO:journalctl@ceph.osd.0.smithi039.stdout:Sep 12 02:50:11 smithi039 podman[90696]: 2024-09-12 02:50:11.666972045 +0000 UTC m=+0.407617079 container init d40c92d45c1f8ad3f07167b3ce098e21f9255888bcc004e8ced9f172d4b46770 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:3be30d720e37ec4df7f667e60f22b4d221c4ce7b408e68b90f9ac10220535e66, name=ceph-4954ed46-70ae-11ef-bcea-c7b262605968-osd-0-deactivate, RELEASE=squid-b53b6d3, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.build-date=20240731, maintainer=Guillaume Abrioux , org.label-schema.vendor=CentOS, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.license=GPLv2, GIT_CLEAN=True, GIT_BRANCH=HEAD, ceph=True, org.label-schema.schema-version=1.0, io.buildah.version=1.37.2, CEPH_POINT_RELEASE=) 2024-09-12T02:50:11.932 INFO:journalctl@ceph.osd.0.smithi039.stdout:Sep 12 02:50:11 smithi039 podman[90696]: 2024-09-12 02:50:11.673766678 +0000 UTC m=+0.414411725 container start d40c92d45c1f8ad3f07167b3ce098e21f9255888bcc004e8ced9f172d4b46770 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:3be30d720e37ec4df7f667e60f22b4d221c4ce7b408e68b90f9ac10220535e66, name=ceph-4954ed46-70ae-11ef-bcea-c7b262605968-osd-0-deactivate, ceph=True, GIT_REPO=git@github.com:ceph/ceph-container.git, CEPH_POINT_RELEASE=, io.buildah.version=1.37.2, GIT_BRANCH=HEAD, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.vendor=CentOS, org.label-schema.schema-version=1.0, RELEASE=squid-b53b6d3, maintainer=Guillaume Abrioux , org.label-schema.license=GPLv2, GIT_CLEAN=True, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.build-date=20240731) 2024-09-12T02:50:11.932 INFO:journalctl@ceph.osd.0.smithi039.stdout:Sep 12 02:50:11 smithi039 podman[90696]: 2024-09-12 02:50:11.766982127 +0000 UTC m=+0.507627162 container attach d40c92d45c1f8ad3f07167b3ce098e21f9255888bcc004e8ced9f172d4b46770 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:3be30d720e37ec4df7f667e60f22b4d221c4ce7b408e68b90f9ac10220535e66, name=ceph-4954ed46-70ae-11ef-bcea-c7b262605968-osd-0-deactivate, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, CEPH_POINT_RELEASE=, org.label-schema.license=GPLv2, GIT_CLEAN=True, GIT_BRANCH=HEAD, org.label-schema.vendor=CentOS, org.label-schema.schema-version=1.0, io.buildah.version=1.37.2, org.label-schema.name=CentOS Stream 9 Base Image, ceph=True, RELEASE=squid-b53b6d3, org.label-schema.build-date=20240731, maintainer=Guillaume Abrioux ) 2024-09-12T02:50:12.303 INFO:journalctl@ceph.osd.0.smithi039.stdout:Sep 12 02:50:11 smithi039 podman[90696]: 2024-09-12 02:50:11.931699889 +0000 UTC m=+0.672344933 container died d40c92d45c1f8ad3f07167b3ce098e21f9255888bcc004e8ced9f172d4b46770 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:3be30d720e37ec4df7f667e60f22b4d221c4ce7b408e68b90f9ac10220535e66, name=ceph-4954ed46-70ae-11ef-bcea-c7b262605968-osd-0-deactivate, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.vendor=CentOS, org.label-schema.license=GPLv2, GIT_BRANCH=HEAD, maintainer=Guillaume Abrioux , io.buildah.version=1.37.2, org.label-schema.name=CentOS Stream 9 Base Image, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.schema-version=1.0, org.label-schema.build-date=20240731, GIT_CLEAN=True, RELEASE=squid-b53b6d3, CEPH_POINT_RELEASE=, ceph=True) 2024-09-12T02:50:12.678 DEBUG:teuthology.orchestra.run.smithi039:> sudo pkill -f 'journalctl -f -n 0 -u ceph-4954ed46-70ae-11ef-bcea-c7b262605968@osd.0.service' 2024-09-12T02:50:12.759 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-09-12T02:50:12.759 INFO:tasks.cephadm.osd.0:Stopped osd.0 2024-09-12T02:50:12.759 INFO:tasks.cephadm.osd.1:Stopping osd.1... 2024-09-12T02:50:12.760 DEBUG:teuthology.orchestra.run.smithi044:> sudo systemctl stop ceph-4954ed46-70ae-11ef-bcea-c7b262605968@osd.1 2024-09-12T02:50:12.948 INFO:journalctl@ceph.osd.1.smithi044.stdout:Sep 12 02:50:12 smithi044 systemd[1]: Stopping Ceph osd.1 for 4954ed46-70ae-11ef-bcea-c7b262605968... 2024-09-12T02:50:13.448 INFO:journalctl@ceph.osd.1.smithi044.stdout:Sep 12 02:50:13 smithi044 ceph-4954ed46-70ae-11ef-bcea-c7b262605968-osd-1[39876]: 2024-09-12T02:50:13.088+0000 7f99e4f65640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-osd -n osd.1 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-09-12T02:50:13.449 INFO:journalctl@ceph.osd.1.smithi044.stdout:Sep 12 02:50:13 smithi044 ceph-4954ed46-70ae-11ef-bcea-c7b262605968-osd-1[39876]: 2024-09-12T02:50:13.088+0000 7f99e4f65640 -1 osd.1 112 *** Got signal Terminated *** 2024-09-12T02:50:13.449 INFO:journalctl@ceph.osd.1.smithi044.stdout:Sep 12 02:50:13 smithi044 ceph-4954ed46-70ae-11ef-bcea-c7b262605968-osd-1[39876]: 2024-09-12T02:50:13.088+0000 7f99e4f65640 -1 osd.1 112 *** Immediate shutdown (osd_fast_shutdown=true) *** 2024-09-12T02:50:18.774 INFO:journalctl@ceph.osd.1.smithi044.stdout:Sep 12 02:50:18 smithi044 podman[71975]: 2024-09-12 02:50:18.470127597 +0000 UTC m=+5.501946070 container died d4a646ebe6d2479eb4c8809e80fd0239689f004cfbc32239ed96f4ffe6662eaa (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:3be30d720e37ec4df7f667e60f22b4d221c4ce7b408e68b90f9ac10220535e66, name=ceph-4954ed46-70ae-11ef-bcea-c7b262605968-osd-1, org.label-schema.vendor=CentOS, io.buildah.version=1.37.2, org.label-schema.schema-version=1.0, GIT_CLEAN=True, org.label-schema.license=GPLv2, GIT_BRANCH=HEAD, org.label-schema.build-date=20240731, org.label-schema.name=CentOS Stream 9 Base Image, ceph=True, RELEASE=squid-b53b6d3, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, maintainer=Guillaume Abrioux , CEPH_POINT_RELEASE=) 2024-09-12T02:50:19.280 INFO:journalctl@ceph.osd.1.smithi044.stdout:Sep 12 02:50:18 smithi044 podman[71975]: 2024-09-12 02:50:18.856334429 +0000 UTC m=+5.888152890 container cleanup d4a646ebe6d2479eb4c8809e80fd0239689f004cfbc32239ed96f4ffe6662eaa (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:3be30d720e37ec4df7f667e60f22b4d221c4ce7b408e68b90f9ac10220535e66, name=ceph-4954ed46-70ae-11ef-bcea-c7b262605968-osd-1, org.label-schema.license=GPLv2, CEPH_POINT_RELEASE=, maintainer=Guillaume Abrioux , GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.build-date=20240731, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.schema-version=1.0, org.label-schema.vendor=CentOS, io.buildah.version=1.37.2, RELEASE=squid-b53b6d3, ceph=True, GIT_BRANCH=HEAD, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_CLEAN=True) 2024-09-12T02:50:19.280 INFO:journalctl@ceph.osd.1.smithi044.stdout:Sep 12 02:50:18 smithi044 bash[71975]: ceph-4954ed46-70ae-11ef-bcea-c7b262605968-osd-1 2024-09-12T02:50:19.632 INFO:journalctl@ceph.osd.1.smithi044.stdout:Sep 12 02:50:19 smithi044 podman[71993]: 2024-09-12 02:50:19.249562877 +0000 UTC m=+0.775492172 container remove d4a646ebe6d2479eb4c8809e80fd0239689f004cfbc32239ed96f4ffe6662eaa (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:3be30d720e37ec4df7f667e60f22b4d221c4ce7b408e68b90f9ac10220535e66, name=ceph-4954ed46-70ae-11ef-bcea-c7b262605968-osd-1, maintainer=Guillaume Abrioux , RELEASE=squid-b53b6d3, org.label-schema.schema-version=1.0, org.label-schema.build-date=20240731, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_BRANCH=HEAD, org.label-schema.license=GPLv2, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, ceph=True, io.buildah.version=1.37.2, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.vendor=CentOS, GIT_CLEAN=True, CEPH_POINT_RELEASE=) 2024-09-12T02:50:19.936 INFO:journalctl@ceph.osd.1.smithi044.stdout:Sep 12 02:50:19 smithi044 podman[72083]: 2024-09-12 02:50:19.534749828 +0000 UTC m=+0.015439544 image pull 54467abc55f864c4f73dfaf9c6ac3bb3e87b773123d5badaf790bee57321d594 quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:3be30d720e37ec4df7f667e60f22b4d221c4ce7b408e68b90f9ac10220535e66 2024-09-12T02:50:19.937 INFO:journalctl@ceph.osd.1.smithi044.stdout:Sep 12 02:50:19 smithi044 podman[72083]: 2024-09-12 02:50:19.650917077 +0000 UTC m=+0.131606777 container create 905034cafaba7bef1f25bddc2e0876f150f77a50108da93bb8783632435e6a1c (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:3be30d720e37ec4df7f667e60f22b4d221c4ce7b408e68b90f9ac10220535e66, name=ceph-4954ed46-70ae-11ef-bcea-c7b262605968-osd-1-deactivate, org.label-schema.build-date=20240731, CEPH_POINT_RELEASE=, org.label-schema.vendor=CentOS, maintainer=Guillaume Abrioux , io.buildah.version=1.37.2, RELEASE=squid-b53b6d3, org.label-schema.schema-version=1.0, org.label-schema.license=GPLv2, ceph=True, GIT_CLEAN=True, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_BRANCH=HEAD, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.name=CentOS Stream 9 Base Image) 2024-09-12T02:50:19.937 INFO:journalctl@ceph.osd.1.smithi044.stdout:Sep 12 02:50:19 smithi044 podman[72083]: 2024-09-12 02:50:19.936832221 +0000 UTC m=+0.417521930 container init 905034cafaba7bef1f25bddc2e0876f150f77a50108da93bb8783632435e6a1c (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:3be30d720e37ec4df7f667e60f22b4d221c4ce7b408e68b90f9ac10220535e66, name=ceph-4954ed46-70ae-11ef-bcea-c7b262605968-osd-1-deactivate, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.license=GPLv2, io.buildah.version=1.37.2, maintainer=Guillaume Abrioux , GIT_CLEAN=True, org.label-schema.build-date=20240731, GIT_BRANCH=HEAD, org.label-schema.vendor=CentOS, org.label-schema.schema-version=1.0, RELEASE=squid-b53b6d3, GIT_REPO=git@github.com:ceph/ceph-container.git, ceph=True, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, CEPH_POINT_RELEASE=) 2024-09-12T02:50:20.199 INFO:journalctl@ceph.osd.1.smithi044.stdout:Sep 12 02:50:19 smithi044 podman[72083]: 2024-09-12 02:50:19.940229247 +0000 UTC m=+0.420918952 container start 905034cafaba7bef1f25bddc2e0876f150f77a50108da93bb8783632435e6a1c (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:3be30d720e37ec4df7f667e60f22b4d221c4ce7b408e68b90f9ac10220535e66, name=ceph-4954ed46-70ae-11ef-bcea-c7b262605968-osd-1-deactivate, maintainer=Guillaume Abrioux , org.label-schema.schema-version=1.0, GIT_CLEAN=True, RELEASE=squid-b53b6d3, org.label-schema.name=CentOS Stream 9 Base Image, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_BRANCH=HEAD, org.label-schema.license=GPLv2, org.label-schema.build-date=20240731, CEPH_POINT_RELEASE=, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.vendor=CentOS, ceph=True, io.buildah.version=1.37.2) 2024-09-12T02:50:20.199 INFO:journalctl@ceph.osd.1.smithi044.stdout:Sep 12 02:50:20 smithi044 podman[72083]: 2024-09-12 02:50:20.045499186 +0000 UTC m=+0.526188894 container attach 905034cafaba7bef1f25bddc2e0876f150f77a50108da93bb8783632435e6a1c (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:3be30d720e37ec4df7f667e60f22b4d221c4ce7b408e68b90f9ac10220535e66, name=ceph-4954ed46-70ae-11ef-bcea-c7b262605968-osd-1-deactivate, org.label-schema.build-date=20240731, maintainer=Guillaume Abrioux , ceph=True, GIT_CLEAN=True, RELEASE=squid-b53b6d3, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_BRANCH=HEAD, io.buildah.version=1.37.2, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.schema-version=1.0, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, CEPH_POINT_RELEASE=, org.label-schema.vendor=CentOS, org.label-schema.license=GPLv2) 2024-09-12T02:50:20.199 INFO:journalctl@ceph.osd.1.smithi044.stdout:Sep 12 02:50:20 smithi044 podman[72083]: 2024-09-12 02:50:20.138668978 +0000 UTC m=+0.619358685 container died 905034cafaba7bef1f25bddc2e0876f150f77a50108da93bb8783632435e6a1c (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:3be30d720e37ec4df7f667e60f22b4d221c4ce7b408e68b90f9ac10220535e66, name=ceph-4954ed46-70ae-11ef-bcea-c7b262605968-osd-1-deactivate, GIT_BRANCH=HEAD, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.name=CentOS Stream 9 Base Image, maintainer=Guillaume Abrioux , GIT_CLEAN=True, org.label-schema.schema-version=1.0, org.label-schema.build-date=20240731, org.label-schema.license=GPLv2, ceph=True, io.buildah.version=1.37.2, org.label-schema.vendor=CentOS, RELEASE=squid-b53b6d3, CEPH_POINT_RELEASE=) 2024-09-12T02:50:20.735 DEBUG:teuthology.orchestra.run.smithi044:> sudo pkill -f 'journalctl -f -n 0 -u ceph-4954ed46-70ae-11ef-bcea-c7b262605968@osd.1.service' 2024-09-12T02:50:20.775 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-09-12T02:50:20.776 INFO:tasks.cephadm.osd.1:Stopped osd.1 2024-09-12T02:50:20.776 INFO:tasks.cephadm.osd.2:Stopping osd.2... 2024-09-12T02:50:20.776 DEBUG:teuthology.orchestra.run.smithi172:> sudo systemctl stop ceph-4954ed46-70ae-11ef-bcea-c7b262605968@osd.2 2024-09-12T02:50:21.069 INFO:journalctl@ceph.osd.2.smithi172.stdout:Sep 12 02:50:20 smithi172 systemd[1]: Stopping Ceph osd.2 for 4954ed46-70ae-11ef-bcea-c7b262605968... 2024-09-12T02:50:21.513 INFO:journalctl@ceph.osd.2.smithi172.stdout:Sep 12 02:50:21 smithi172 ceph-4954ed46-70ae-11ef-bcea-c7b262605968-osd-2[40621]: 2024-09-12T02:50:21.067+0000 7f04c0f16640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-osd -n osd.2 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-09-12T02:50:21.513 INFO:journalctl@ceph.osd.2.smithi172.stdout:Sep 12 02:50:21 smithi172 ceph-4954ed46-70ae-11ef-bcea-c7b262605968-osd-2[40621]: 2024-09-12T02:50:21.067+0000 7f04c0f16640 -1 osd.2 112 *** Got signal Terminated *** 2024-09-12T02:50:21.514 INFO:journalctl@ceph.osd.2.smithi172.stdout:Sep 12 02:50:21 smithi172 ceph-4954ed46-70ae-11ef-bcea-c7b262605968-osd-2[40621]: 2024-09-12T02:50:21.067+0000 7f04c0f16640 -1 osd.2 112 *** Immediate shutdown (osd_fast_shutdown=true) *** 2024-09-12T02:50:26.686 INFO:journalctl@ceph.osd.2.smithi172.stdout:Sep 12 02:50:26 smithi172 podman[72561]: 2024-09-12 02:50:26.397462781 +0000 UTC m=+5.424654701 container died 3a7c026a60e6479871cb0671f658b112cb170feaa30cf7941d06e28399810c8d (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:3be30d720e37ec4df7f667e60f22b4d221c4ce7b408e68b90f9ac10220535e66, name=ceph-4954ed46-70ae-11ef-bcea-c7b262605968-osd-2, CEPH_POINT_RELEASE=, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.build-date=20240731, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.schema-version=1.0, ceph=True, GIT_CLEAN=True, org.label-schema.license=GPLv2, GIT_REPO=git@github.com:ceph/ceph-container.git, io.buildah.version=1.37.2, RELEASE=squid-b53b6d3, maintainer=Guillaume Abrioux , GIT_BRANCH=HEAD, org.label-schema.vendor=CentOS) 2024-09-12T02:50:27.013 INFO:journalctl@ceph.osd.2.smithi172.stdout:Sep 12 02:50:26 smithi172 podman[72561]: 2024-09-12 02:50:26.776767561 +0000 UTC m=+5.803959481 container cleanup 3a7c026a60e6479871cb0671f658b112cb170feaa30cf7941d06e28399810c8d (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:3be30d720e37ec4df7f667e60f22b4d221c4ce7b408e68b90f9ac10220535e66, name=ceph-4954ed46-70ae-11ef-bcea-c7b262605968-osd-2, maintainer=Guillaume Abrioux , GIT_CLEAN=True, org.label-schema.name=CentOS Stream 9 Base Image, RELEASE=squid-b53b6d3, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_BRANCH=HEAD, ceph=True, org.label-schema.build-date=20240731, io.buildah.version=1.37.2, org.label-schema.vendor=CentOS, org.label-schema.schema-version=1.0, CEPH_POINT_RELEASE=, org.label-schema.license=GPLv2, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7) 2024-09-12T02:50:27.014 INFO:journalctl@ceph.osd.2.smithi172.stdout:Sep 12 02:50:26 smithi172 bash[72561]: ceph-4954ed46-70ae-11ef-bcea-c7b262605968-osd-2 2024-09-12T02:50:27.394 INFO:journalctl@ceph.osd.2.smithi172.stdout:Sep 12 02:50:27 smithi172 podman[72576]: 2024-09-12 02:50:27.044917338 +0000 UTC m=+0.649258053 container remove 3a7c026a60e6479871cb0671f658b112cb170feaa30cf7941d06e28399810c8d (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:3be30d720e37ec4df7f667e60f22b4d221c4ce7b408e68b90f9ac10220535e66, name=ceph-4954ed46-70ae-11ef-bcea-c7b262605968-osd-2, org.label-schema.name=CentOS Stream 9 Base Image, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.build-date=20240731, io.buildah.version=1.37.2, maintainer=Guillaume Abrioux , org.label-schema.license=GPLv2, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_BRANCH=HEAD, GIT_CLEAN=True, org.label-schema.vendor=CentOS, CEPH_POINT_RELEASE=, org.label-schema.schema-version=1.0, RELEASE=squid-b53b6d3, ceph=True) 2024-09-12T02:50:27.707 INFO:journalctl@ceph.osd.2.smithi172.stdout:Sep 12 02:50:27 smithi172 podman[72666]: 2024-09-12 02:50:27.297401897 +0000 UTC m=+0.015838952 image pull 54467abc55f864c4f73dfaf9c6ac3bb3e87b773123d5badaf790bee57321d594 quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:3be30d720e37ec4df7f667e60f22b4d221c4ce7b408e68b90f9ac10220535e66 2024-09-12T02:50:27.707 INFO:journalctl@ceph.osd.2.smithi172.stdout:Sep 12 02:50:27 smithi172 podman[72666]: 2024-09-12 02:50:27.403921171 +0000 UTC m=+0.122358225 container create 90eabfa4dc61999444279dabe5e394c1a455937d87222822f5fd35302d5a52e3 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:3be30d720e37ec4df7f667e60f22b4d221c4ce7b408e68b90f9ac10220535e66, name=ceph-4954ed46-70ae-11ef-bcea-c7b262605968-osd-2-deactivate, maintainer=Guillaume Abrioux , GIT_CLEAN=True, ceph=True, CEPH_POINT_RELEASE=, org.label-schema.license=GPLv2, RELEASE=squid-b53b6d3, org.label-schema.schema-version=1.0, io.buildah.version=1.37.2, GIT_BRANCH=HEAD, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.vendor=CentOS, org.label-schema.name=CentOS Stream 9 Base Image, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.build-date=20240731) 2024-09-12T02:50:27.707 INFO:journalctl@ceph.osd.2.smithi172.stdout:Sep 12 02:50:27 smithi172 podman[72666]: 2024-09-12 02:50:27.707059348 +0000 UTC m=+0.425496404 container init 90eabfa4dc61999444279dabe5e394c1a455937d87222822f5fd35302d5a52e3 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:3be30d720e37ec4df7f667e60f22b4d221c4ce7b408e68b90f9ac10220535e66, name=ceph-4954ed46-70ae-11ef-bcea-c7b262605968-osd-2-deactivate, maintainer=Guillaume Abrioux , org.label-schema.license=GPLv2, CEPH_POINT_RELEASE=, org.label-schema.schema-version=1.0, ceph=True, org.label-schema.build-date=20240731, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, RELEASE=squid-b53b6d3, org.label-schema.name=CentOS Stream 9 Base Image, io.buildah.version=1.37.2, org.label-schema.vendor=CentOS, GIT_CLEAN=True, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_BRANCH=HEAD) 2024-09-12T02:50:28.013 INFO:journalctl@ceph.osd.2.smithi172.stdout:Sep 12 02:50:27 smithi172 podman[72666]: 2024-09-12 02:50:27.710653433 +0000 UTC m=+0.429090494 container start 90eabfa4dc61999444279dabe5e394c1a455937d87222822f5fd35302d5a52e3 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:3be30d720e37ec4df7f667e60f22b4d221c4ce7b408e68b90f9ac10220535e66, name=ceph-4954ed46-70ae-11ef-bcea-c7b262605968-osd-2-deactivate, org.label-schema.vendor=CentOS, org.label-schema.schema-version=1.0, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.license=GPLv2, GIT_CLEAN=True, RELEASE=squid-b53b6d3, CEPH_POINT_RELEASE=, maintainer=Guillaume Abrioux , ceph=True, io.buildah.version=1.37.2, GIT_BRANCH=HEAD, org.label-schema.build-date=20240731, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7) 2024-09-12T02:50:28.014 INFO:journalctl@ceph.osd.2.smithi172.stdout:Sep 12 02:50:27 smithi172 podman[72666]: 2024-09-12 02:50:27.807195017 +0000 UTC m=+0.525632084 container attach 90eabfa4dc61999444279dabe5e394c1a455937d87222822f5fd35302d5a52e3 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:3be30d720e37ec4df7f667e60f22b4d221c4ce7b408e68b90f9ac10220535e66, name=ceph-4954ed46-70ae-11ef-bcea-c7b262605968-osd-2-deactivate, maintainer=Guillaume Abrioux , ceph=True, org.label-schema.name=CentOS Stream 9 Base Image, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, CEPH_POINT_RELEASE=, org.label-schema.schema-version=1.0, org.label-schema.license=GPLv2, GIT_BRANCH=HEAD, GIT_CLEAN=True, RELEASE=squid-b53b6d3, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.vendor=CentOS, io.buildah.version=1.37.2, org.label-schema.build-date=20240731) 2024-09-12T02:50:28.014 INFO:journalctl@ceph.osd.2.smithi172.stdout:Sep 12 02:50:27 smithi172 podman[72666]: 2024-09-12 02:50:27.897607596 +0000 UTC m=+0.616044658 container died 90eabfa4dc61999444279dabe5e394c1a455937d87222822f5fd35302d5a52e3 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:3be30d720e37ec4df7f667e60f22b4d221c4ce7b408e68b90f9ac10220535e66, name=ceph-4954ed46-70ae-11ef-bcea-c7b262605968-osd-2-deactivate, org.label-schema.build-date=20240731, CEPH_POINT_RELEASE=, GIT_CLEAN=True, org.label-schema.schema-version=1.0, ceph=True, org.label-schema.name=CentOS Stream 9 Base Image, maintainer=Guillaume Abrioux , RELEASE=squid-b53b6d3, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, io.buildah.version=1.37.2, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.vendor=CentOS, org.label-schema.license=GPLv2, GIT_BRANCH=HEAD) 2024-09-12T02:50:28.471 DEBUG:teuthology.orchestra.run.smithi172:> sudo pkill -f 'journalctl -f -n 0 -u ceph-4954ed46-70ae-11ef-bcea-c7b262605968@osd.2.service' 2024-09-12T02:50:28.512 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-09-12T02:50:28.513 INFO:tasks.cephadm.osd.2:Stopped osd.2 2024-09-12T02:50:28.513 INFO:tasks.cephadm.osd.3:Stopping osd.3... 2024-09-12T02:50:28.513 DEBUG:teuthology.orchestra.run.smithi039:> sudo systemctl stop ceph-4954ed46-70ae-11ef-bcea-c7b262605968@osd.3 2024-09-12T02:50:28.850 INFO:journalctl@ceph.osd.3.smithi039.stdout:Sep 12 02:50:28 smithi039 systemd[1]: Stopping Ceph osd.3 for 4954ed46-70ae-11ef-bcea-c7b262605968... 2024-09-12T02:50:29.352 INFO:journalctl@ceph.osd.3.smithi039.stdout:Sep 12 02:50:28 smithi039 ceph-4954ed46-70ae-11ef-bcea-c7b262605968-osd-3[50671]: 2024-09-12T02:50:28.950+0000 7f7eca400640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-osd -n osd.3 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-09-12T02:50:29.352 INFO:journalctl@ceph.osd.3.smithi039.stdout:Sep 12 02:50:28 smithi039 ceph-4954ed46-70ae-11ef-bcea-c7b262605968-osd-3[50671]: 2024-09-12T02:50:28.950+0000 7f7eca400640 -1 osd.3 112 *** Got signal Terminated *** 2024-09-12T02:50:29.352 INFO:journalctl@ceph.osd.3.smithi039.stdout:Sep 12 02:50:28 smithi039 ceph-4954ed46-70ae-11ef-bcea-c7b262605968-osd-3[50671]: 2024-09-12T02:50:28.950+0000 7f7eca400640 -1 osd.3 112 *** Immediate shutdown (osd_fast_shutdown=true) *** 2024-09-12T02:50:31.948 INFO:journalctl@ceph.osd.10.smithi044.stdout:Sep 12 02:50:31 smithi044 ceph-4954ed46-70ae-11ef-bcea-c7b262605968-osd-10[59969]: 2024-09-12T02:50:31.677+0000 7faa46dc6640 -1 osd.10 112 heartbeat_check: no reply from 172.21.15.39:6806 osd.0 since back 2024-09-12T02:50:05.367150+0000 front 2024-09-12T02:50:05.367381+0000 (oldest deadline 2024-09-12T02:50:31.267058+0000) 2024-09-12T02:50:33.198 INFO:journalctl@ceph.osd.10.smithi044.stdout:Sep 12 02:50:32 smithi044 ceph-4954ed46-70ae-11ef-bcea-c7b262605968-osd-10[59969]: 2024-09-12T02:50:32.712+0000 7faa46dc6640 -1 osd.10 112 heartbeat_check: no reply from 172.21.15.39:6806 osd.0 since back 2024-09-12T02:50:05.367150+0000 front 2024-09-12T02:50:05.367381+0000 (oldest deadline 2024-09-12T02:50:31.267058+0000) 2024-09-12T02:50:33.849 INFO:journalctl@ceph.osd.3.smithi039.stdout:Sep 12 02:50:33 smithi039 ceph-4954ed46-70ae-11ef-bcea-c7b262605968-osd-3[50671]: 2024-09-12T02:50:33.404+0000 7f7ec0e00640 -1 osd.3 112 heartbeat_check: no reply from 172.21.15.39:6806 osd.0 since back 2024-09-12T02:50:08.943126+0000 front 2024-09-12T02:50:08.943093+0000 (oldest deadline 2024-09-12T02:50:32.443265+0000) 2024-09-12T02:50:33.948 INFO:journalctl@ceph.osd.10.smithi044.stdout:Sep 12 02:50:33 smithi044 ceph-4954ed46-70ae-11ef-bcea-c7b262605968-osd-10[59969]: 2024-09-12T02:50:33.677+0000 7faa46dc6640 -1 osd.10 112 heartbeat_check: no reply from 172.21.15.39:6806 osd.0 since back 2024-09-12T02:50:05.367150+0000 front 2024-09-12T02:50:05.367381+0000 (oldest deadline 2024-09-12T02:50:31.267058+0000) 2024-09-12T02:50:34.783 INFO:journalctl@ceph.osd.3.smithi039.stdout:Sep 12 02:50:34 smithi039 podman[90812]: 2024-09-12 02:50:34.477618976 +0000 UTC m=+5.656966200 container died 37956a8e817dbb0032f0159bf6d9e60ddd958877a227fd1b3992b4ea56c7557b (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:3be30d720e37ec4df7f667e60f22b4d221c4ce7b408e68b90f9ac10220535e66, name=ceph-4954ed46-70ae-11ef-bcea-c7b262605968-osd-3, maintainer=Guillaume Abrioux , org.label-schema.build-date=20240731, org.label-schema.license=GPLv2, GIT_BRANCH=HEAD, org.label-schema.name=CentOS Stream 9 Base Image, ceph=True, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, RELEASE=squid-b53b6d3, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.schema-version=1.0, org.label-schema.vendor=CentOS, GIT_CLEAN=True, io.buildah.version=1.37.2, CEPH_POINT_RELEASE=) 2024-09-12T02:50:34.948 INFO:journalctl@ceph.osd.10.smithi044.stdout:Sep 12 02:50:34 smithi044 ceph-4954ed46-70ae-11ef-bcea-c7b262605968-osd-10[59969]: 2024-09-12T02:50:34.663+0000 7faa46dc6640 -1 osd.10 112 heartbeat_check: no reply from 172.21.15.39:6806 osd.0 since back 2024-09-12T02:50:05.367150+0000 front 2024-09-12T02:50:05.367381+0000 (oldest deadline 2024-09-12T02:50:31.267058+0000) 2024-09-12T02:50:35.100 INFO:journalctl@ceph.osd.9.smithi039.stdout:Sep 12 02:50:34 smithi039 ceph-4954ed46-70ae-11ef-bcea-c7b262605968-osd-9[63678]: 2024-09-12T02:50:34.963+0000 7f6d17a00640 -1 osd.9 112 heartbeat_check: no reply from 172.21.15.39:6806 osd.0 since back 2024-09-12T02:50:08.761527+0000 front 2024-09-12T02:50:08.761556+0000 (oldest deadline 2024-09-12T02:50:34.061510+0000) 2024-09-12T02:50:35.100 INFO:journalctl@ceph.osd.3.smithi039.stdout:Sep 12 02:50:34 smithi039 podman[90812]: 2024-09-12 02:50:34.898325883 +0000 UTC m=+6.077673105 container cleanup 37956a8e817dbb0032f0159bf6d9e60ddd958877a227fd1b3992b4ea56c7557b (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:3be30d720e37ec4df7f667e60f22b4d221c4ce7b408e68b90f9ac10220535e66, name=ceph-4954ed46-70ae-11ef-bcea-c7b262605968-osd-3, org.label-schema.license=GPLv2, org.label-schema.name=CentOS Stream 9 Base Image, io.buildah.version=1.37.2, org.label-schema.schema-version=1.0, CEPH_POINT_RELEASE=, maintainer=Guillaume Abrioux , org.label-schema.build-date=20240731, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.vendor=CentOS, ceph=True, GIT_BRANCH=HEAD, GIT_CLEAN=True, RELEASE=squid-b53b6d3) 2024-09-12T02:50:35.100 INFO:journalctl@ceph.osd.3.smithi039.stdout:Sep 12 02:50:34 smithi039 bash[90812]: ceph-4954ed46-70ae-11ef-bcea-c7b262605968-osd-3 2024-09-12T02:50:35.599 INFO:journalctl@ceph.osd.3.smithi039.stdout:Sep 12 02:50:35 smithi039 podman[90829]: 2024-09-12 02:50:35.316876227 +0000 UTC m=+0.824975339 container remove 37956a8e817dbb0032f0159bf6d9e60ddd958877a227fd1b3992b4ea56c7557b (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:3be30d720e37ec4df7f667e60f22b4d221c4ce7b408e68b90f9ac10220535e66, name=ceph-4954ed46-70ae-11ef-bcea-c7b262605968-osd-3, CEPH_POINT_RELEASE=, org.label-schema.license=GPLv2, org.label-schema.vendor=CentOS, GIT_REPO=git@github.com:ceph/ceph-container.git, RELEASE=squid-b53b6d3, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, GIT_CLEAN=True, GIT_BRANCH=HEAD, maintainer=Guillaume Abrioux , org.label-schema.schema-version=1.0, io.buildah.version=1.37.2, org.label-schema.name=CentOS Stream 9 Base Image, ceph=True, org.label-schema.build-date=20240731) 2024-09-12T02:50:35.764 INFO:journalctl@ceph.osd.11.smithi172.stdout:Sep 12 02:50:35 smithi172 ceph-4954ed46-70ae-11ef-bcea-c7b262605968-osd-11[61129]: 2024-09-12T02:50:35.422+0000 7ff146fac640 -1 osd.11 112 heartbeat_check: no reply from 172.21.15.39:6806 osd.0 since back 2024-09-12T02:50:09.449223+0000 front 2024-09-12T02:50:09.449210+0000 (oldest deadline 2024-09-12T02:50:34.748980+0000) 2024-09-12T02:50:35.948 INFO:journalctl@ceph.osd.10.smithi044.stdout:Sep 12 02:50:35 smithi044 ceph-4954ed46-70ae-11ef-bcea-c7b262605968-osd-10[59969]: 2024-09-12T02:50:35.616+0000 7faa46dc6640 -1 osd.10 112 heartbeat_check: no reply from 172.21.15.39:6806 osd.0 since back 2024-09-12T02:50:05.367150+0000 front 2024-09-12T02:50:05.367381+0000 (oldest deadline 2024-09-12T02:50:31.267058+0000) 2024-09-12T02:50:36.187 INFO:journalctl@ceph.osd.9.smithi039.stdout:Sep 12 02:50:35 smithi039 ceph-4954ed46-70ae-11ef-bcea-c7b262605968-osd-9[63678]: 2024-09-12T02:50:35.957+0000 7f6d17a00640 -1 osd.9 112 heartbeat_check: no reply from 172.21.15.39:6806 osd.0 since back 2024-09-12T02:50:08.761527+0000 front 2024-09-12T02:50:08.761556+0000 (oldest deadline 2024-09-12T02:50:34.061510+0000) 2024-09-12T02:50:36.187 INFO:journalctl@ceph.osd.3.smithi039.stdout:Sep 12 02:50:35 smithi039 podman[90912]: 2024-09-12 02:50:35.83249534 +0000 UTC m=+0.028186103 image pull 54467abc55f864c4f73dfaf9c6ac3bb3e87b773123d5badaf790bee57321d594 quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:3be30d720e37ec4df7f667e60f22b4d221c4ce7b408e68b90f9ac10220535e66 2024-09-12T02:50:36.187 INFO:journalctl@ceph.osd.3.smithi039.stdout:Sep 12 02:50:35 smithi039 podman[90912]: 2024-09-12 02:50:35.934198375 +0000 UTC m=+0.129889114 container create eee976feb08e27c5e88dc0ffe1a388f05b79e7245c8f39e960c3ce5de1391ea2 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:3be30d720e37ec4df7f667e60f22b4d221c4ce7b408e68b90f9ac10220535e66, name=ceph-4954ed46-70ae-11ef-bcea-c7b262605968-osd-3-deactivate, org.label-schema.schema-version=1.0, GIT_CLEAN=True, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.name=CentOS Stream 9 Base Image, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.vendor=CentOS, CEPH_POINT_RELEASE=, RELEASE=squid-b53b6d3, org.label-schema.license=GPLv2, GIT_BRANCH=HEAD, org.label-schema.build-date=20240731, ceph=True, io.buildah.version=1.37.2, maintainer=Guillaume Abrioux ) 2024-09-12T02:50:36.187 INFO:journalctl@ceph.osd.3.smithi039.stdout:Sep 12 02:50:36 smithi039 podman[90912]: 2024-09-12 02:50:36.186879949 +0000 UTC m=+0.382570690 container init eee976feb08e27c5e88dc0ffe1a388f05b79e7245c8f39e960c3ce5de1391ea2 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:3be30d720e37ec4df7f667e60f22b4d221c4ce7b408e68b90f9ac10220535e66, name=ceph-4954ed46-70ae-11ef-bcea-c7b262605968-osd-3-deactivate, org.label-schema.build-date=20240731, org.label-schema.schema-version=1.0, ceph=True, GIT_BRANCH=HEAD, io.buildah.version=1.37.2, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.vendor=CentOS, CEPH_POINT_RELEASE=, maintainer=Guillaume Abrioux , org.label-schema.name=CentOS Stream 9 Base Image, GIT_CLEAN=True, RELEASE=squid-b53b6d3, org.label-schema.license=GPLv2, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7) 2024-09-12T02:50:36.463 INFO:journalctl@ceph.osd.3.smithi039.stdout:Sep 12 02:50:36 smithi039 podman[90912]: 2024-09-12 02:50:36.194481651 +0000 UTC m=+0.390172388 container start eee976feb08e27c5e88dc0ffe1a388f05b79e7245c8f39e960c3ce5de1391ea2 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:3be30d720e37ec4df7f667e60f22b4d221c4ce7b408e68b90f9ac10220535e66, name=ceph-4954ed46-70ae-11ef-bcea-c7b262605968-osd-3-deactivate, org.label-schema.build-date=20240731, org.label-schema.schema-version=1.0, ceph=True, maintainer=Guillaume Abrioux , GIT_BRANCH=HEAD, org.label-schema.vendor=CentOS, CEPH_POINT_RELEASE=, RELEASE=squid-b53b6d3, GIT_CLEAN=True, GIT_REPO=git@github.com:ceph/ceph-container.git, io.buildah.version=1.37.2, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.license=GPLv2, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7) 2024-09-12T02:50:36.463 INFO:journalctl@ceph.osd.3.smithi039.stdout:Sep 12 02:50:36 smithi039 podman[90912]: 2024-09-12 02:50:36.270040059 +0000 UTC m=+0.465730810 container attach eee976feb08e27c5e88dc0ffe1a388f05b79e7245c8f39e960c3ce5de1391ea2 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:3be30d720e37ec4df7f667e60f22b4d221c4ce7b408e68b90f9ac10220535e66, name=ceph-4954ed46-70ae-11ef-bcea-c7b262605968-osd-3-deactivate, GIT_CLEAN=True, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, GIT_REPO=git@github.com:ceph/ceph-container.git, maintainer=Guillaume Abrioux , GIT_BRANCH=HEAD, org.label-schema.vendor=CentOS, org.label-schema.build-date=20240731, org.label-schema.license=GPLv2, ceph=True, io.buildah.version=1.37.2, CEPH_POINT_RELEASE=, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.schema-version=1.0, RELEASE=squid-b53b6d3) 2024-09-12T02:50:36.734 INFO:journalctl@ceph.osd.3.smithi039.stdout:Sep 12 02:50:36 smithi039 podman[90912]: 2024-09-12 02:50:36.463945722 +0000 UTC m=+0.659636474 container died eee976feb08e27c5e88dc0ffe1a388f05b79e7245c8f39e960c3ce5de1391ea2 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:3be30d720e37ec4df7f667e60f22b4d221c4ce7b408e68b90f9ac10220535e66, name=ceph-4954ed46-70ae-11ef-bcea-c7b262605968-osd-3-deactivate, org.label-schema.schema-version=1.0, GIT_CLEAN=True, ceph=True, org.label-schema.vendor=CentOS, CEPH_POINT_RELEASE=, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.license=GPLv2, io.buildah.version=1.37.2, maintainer=Guillaume Abrioux , GIT_BRANCH=HEAD, GIT_REPO=git@github.com:ceph/ceph-container.git, RELEASE=squid-b53b6d3, org.label-schema.build-date=20240731, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7) 2024-09-12T02:50:36.763 INFO:journalctl@ceph.osd.11.smithi172.stdout:Sep 12 02:50:36 smithi172 ceph-4954ed46-70ae-11ef-bcea-c7b262605968-osd-11[61129]: 2024-09-12T02:50:36.412+0000 7ff146fac640 -1 osd.11 112 heartbeat_check: no reply from 172.21.15.39:6806 osd.0 since back 2024-09-12T02:50:09.449223+0000 front 2024-09-12T02:50:09.449210+0000 (oldest deadline 2024-09-12T02:50:34.748980+0000) 2024-09-12T02:50:36.948 INFO:journalctl@ceph.osd.10.smithi044.stdout:Sep 12 02:50:36 smithi044 ceph-4954ed46-70ae-11ef-bcea-c7b262605968-osd-10[59969]: 2024-09-12T02:50:36.620+0000 7faa46dc6640 -1 osd.10 112 heartbeat_check: no reply from 172.21.15.39:6806 osd.0 since back 2024-09-12T02:50:05.367150+0000 front 2024-09-12T02:50:05.367381+0000 (oldest deadline 2024-09-12T02:50:31.267058+0000) 2024-09-12T02:50:37.164 DEBUG:teuthology.orchestra.run.smithi039:> sudo pkill -f 'journalctl -f -n 0 -u ceph-4954ed46-70ae-11ef-bcea-c7b262605968@osd.3.service' 2024-09-12T02:50:37.241 INFO:journalctl@ceph.osd.9.smithi039.stdout:Sep 12 02:50:36 smithi039 ceph-4954ed46-70ae-11ef-bcea-c7b262605968-osd-9[63678]: 2024-09-12T02:50:36.989+0000 7f6d17a00640 -1 osd.9 112 heartbeat_check: no reply from 172.21.15.39:6806 osd.0 since back 2024-09-12T02:50:08.761527+0000 front 2024-09-12T02:50:08.761556+0000 (oldest deadline 2024-09-12T02:50:34.061510+0000) 2024-09-12T02:50:37.243 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-09-12T02:50:37.243 INFO:tasks.cephadm.osd.3:Stopped osd.3 2024-09-12T02:50:37.244 INFO:tasks.cephadm.osd.4:Stopping osd.4... 2024-09-12T02:50:37.244 DEBUG:teuthology.orchestra.run.smithi044:> sudo systemctl stop ceph-4954ed46-70ae-11ef-bcea-c7b262605968@osd.4 2024-09-12T02:50:37.263 INFO:journalctl@ceph.osd.5.smithi172.stdout:Sep 12 02:50:36 smithi172 ceph-4954ed46-70ae-11ef-bcea-c7b262605968-osd-5[47211]: 2024-09-12T02:50:36.794+0000 7ff97f71d640 -1 osd.5 112 heartbeat_check: no reply from 172.21.15.39:6806 osd.0 since back 2024-09-12T02:50:07.164412+0000 front 2024-09-12T02:50:07.164434+0000 (oldest deadline 2024-09-12T02:50:35.964745+0000) 2024-09-12T02:50:37.578 INFO:journalctl@ceph.osd.4.smithi044.stdout:Sep 12 02:50:37 smithi044 systemd[1]: Stopping Ceph osd.4 for 4954ed46-70ae-11ef-bcea-c7b262605968... 2024-09-12T02:50:37.763 INFO:journalctl@ceph.osd.11.smithi172.stdout:Sep 12 02:50:37 smithi172 ceph-4954ed46-70ae-11ef-bcea-c7b262605968-osd-11[61129]: 2024-09-12T02:50:37.444+0000 7ff146fac640 -1 osd.11 112 heartbeat_check: no reply from 172.21.15.39:6806 osd.0 since back 2024-09-12T02:50:09.449223+0000 front 2024-09-12T02:50:09.449210+0000 (oldest deadline 2024-09-12T02:50:34.748980+0000) 2024-09-12T02:50:37.948 INFO:journalctl@ceph.osd.4.smithi044.stdout:Sep 12 02:50:37 smithi044 ceph-4954ed46-70ae-11ef-bcea-c7b262605968-osd-4[46474]: 2024-09-12T02:50:37.577+0000 7f760d909640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-osd -n osd.4 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-09-12T02:50:37.949 INFO:journalctl@ceph.osd.4.smithi044.stdout:Sep 12 02:50:37 smithi044 ceph-4954ed46-70ae-11ef-bcea-c7b262605968-osd-4[46474]: 2024-09-12T02:50:37.577+0000 7f760d909640 -1 osd.4 112 *** Got signal Terminated *** 2024-09-12T02:50:37.949 INFO:journalctl@ceph.osd.4.smithi044.stdout:Sep 12 02:50:37 smithi044 ceph-4954ed46-70ae-11ef-bcea-c7b262605968-osd-4[46474]: 2024-09-12T02:50:37.577+0000 7f760d909640 -1 osd.4 112 *** Immediate shutdown (osd_fast_shutdown=true) *** 2024-09-12T02:50:37.949 INFO:journalctl@ceph.osd.10.smithi044.stdout:Sep 12 02:50:37 smithi044 ceph-4954ed46-70ae-11ef-bcea-c7b262605968-osd-10[59969]: 2024-09-12T02:50:37.593+0000 7faa46dc6640 -1 osd.10 112 heartbeat_check: no reply from 172.21.15.39:6806 osd.0 since back 2024-09-12T02:50:05.367150+0000 front 2024-09-12T02:50:05.367381+0000 (oldest deadline 2024-09-12T02:50:31.267058+0000) 2024-09-12T02:50:38.263 INFO:journalctl@ceph.osd.5.smithi172.stdout:Sep 12 02:50:37 smithi172 ceph-4954ed46-70ae-11ef-bcea-c7b262605968-osd-5[47211]: 2024-09-12T02:50:37.811+0000 7ff97f71d640 -1 osd.5 112 heartbeat_check: no reply from 172.21.15.39:6806 osd.0 since back 2024-09-12T02:50:07.164412+0000 front 2024-09-12T02:50:07.164434+0000 (oldest deadline 2024-09-12T02:50:35.964745+0000) 2024-09-12T02:50:38.350 INFO:journalctl@ceph.osd.9.smithi039.stdout:Sep 12 02:50:38 smithi039 ceph-4954ed46-70ae-11ef-bcea-c7b262605968-osd-9[63678]: 2024-09-12T02:50:38.022+0000 7f6d17a00640 -1 osd.9 112 heartbeat_check: no reply from 172.21.15.39:6806 osd.0 since back 2024-09-12T02:50:08.761527+0000 front 2024-09-12T02:50:08.761556+0000 (oldest deadline 2024-09-12T02:50:34.061510+0000) 2024-09-12T02:50:38.763 INFO:journalctl@ceph.osd.11.smithi172.stdout:Sep 12 02:50:38 smithi172 ceph-4954ed46-70ae-11ef-bcea-c7b262605968-osd-11[61129]: 2024-09-12T02:50:38.414+0000 7ff146fac640 -1 osd.11 112 heartbeat_check: no reply from 172.21.15.39:6806 osd.0 since back 2024-09-12T02:50:09.449223+0000 front 2024-09-12T02:50:09.449210+0000 (oldest deadline 2024-09-12T02:50:34.748980+0000) 2024-09-12T02:50:38.948 INFO:journalctl@ceph.osd.10.smithi044.stdout:Sep 12 02:50:38 smithi044 ceph-4954ed46-70ae-11ef-bcea-c7b262605968-osd-10[59969]: 2024-09-12T02:50:38.620+0000 7faa46dc6640 -1 osd.10 112 heartbeat_check: no reply from 172.21.15.39:6806 osd.0 since back 2024-09-12T02:50:05.367150+0000 front 2024-09-12T02:50:05.367381+0000 (oldest deadline 2024-09-12T02:50:31.267058+0000) 2024-09-12T02:50:39.194 INFO:journalctl@ceph.osd.5.smithi172.stdout:Sep 12 02:50:38 smithi172 ceph-4954ed46-70ae-11ef-bcea-c7b262605968-osd-5[47211]: 2024-09-12T02:50:38.814+0000 7ff97f71d640 -1 osd.5 112 heartbeat_check: no reply from 172.21.15.39:6806 osd.0 since back 2024-09-12T02:50:07.164412+0000 front 2024-09-12T02:50:07.164434+0000 (oldest deadline 2024-09-12T02:50:35.964745+0000) 2024-09-12T02:50:39.350 INFO:journalctl@ceph.osd.9.smithi039.stdout:Sep 12 02:50:39 smithi039 ceph-4954ed46-70ae-11ef-bcea-c7b262605968-osd-9[63678]: 2024-09-12T02:50:39.011+0000 7f6d17a00640 -1 osd.9 112 heartbeat_check: no reply from 172.21.15.39:6806 osd.0 since back 2024-09-12T02:50:08.761527+0000 front 2024-09-12T02:50:08.761556+0000 (oldest deadline 2024-09-12T02:50:34.061510+0000) 2024-09-12T02:50:39.350 INFO:journalctl@ceph.osd.9.smithi039.stdout:Sep 12 02:50:39 smithi039 ceph-4954ed46-70ae-11ef-bcea-c7b262605968-osd-9[63678]: 2024-09-12T02:50:39.011+0000 7f6d17a00640 -1 osd.9 112 heartbeat_check: no reply from 172.21.15.44:6804 osd.1 since back 2024-09-12T02:50:14.062055+0000 front 2024-09-12T02:50:14.062119+0000 (oldest deadline 2024-09-12T02:50:38.761988+0000) 2024-09-12T02:50:39.513 INFO:journalctl@ceph.osd.11.smithi172.stdout:Sep 12 02:50:39 smithi172 ceph-4954ed46-70ae-11ef-bcea-c7b262605968-osd-11[61129]: 2024-09-12T02:50:39.387+0000 7ff146fac640 -1 osd.11 112 heartbeat_check: no reply from 172.21.15.39:6806 osd.0 since back 2024-09-12T02:50:09.449223+0000 front 2024-09-12T02:50:09.449210+0000 (oldest deadline 2024-09-12T02:50:34.748980+0000) 2024-09-12T02:50:39.948 INFO:journalctl@ceph.osd.10.smithi044.stdout:Sep 12 02:50:39 smithi044 ceph-4954ed46-70ae-11ef-bcea-c7b262605968-osd-10[59969]: 2024-09-12T02:50:39.577+0000 7faa46dc6640 -1 osd.10 112 heartbeat_check: no reply from 172.21.15.39:6806 osd.0 since back 2024-09-12T02:50:05.367150+0000 front 2024-09-12T02:50:05.367381+0000 (oldest deadline 2024-09-12T02:50:31.267058+0000) 2024-09-12T02:50:40.263 INFO:journalctl@ceph.osd.5.smithi172.stdout:Sep 12 02:50:39 smithi172 ceph-4954ed46-70ae-11ef-bcea-c7b262605968-osd-5[47211]: 2024-09-12T02:50:39.771+0000 7ff97f71d640 -1 osd.5 112 heartbeat_check: no reply from 172.21.15.39:6806 osd.0 since back 2024-09-12T02:50:07.164412+0000 front 2024-09-12T02:50:07.164434+0000 (oldest deadline 2024-09-12T02:50:35.964745+0000) 2024-09-12T02:50:40.350 INFO:journalctl@ceph.osd.9.smithi039.stdout:Sep 12 02:50:40 smithi039 ceph-4954ed46-70ae-11ef-bcea-c7b262605968-osd-9[63678]: 2024-09-12T02:50:40.032+0000 7f6d17a00640 -1 osd.9 112 heartbeat_check: no reply from 172.21.15.39:6806 osd.0 since back 2024-09-12T02:50:08.761527+0000 front 2024-09-12T02:50:08.761556+0000 (oldest deadline 2024-09-12T02:50:34.061510+0000) 2024-09-12T02:50:40.350 INFO:journalctl@ceph.osd.9.smithi039.stdout:Sep 12 02:50:40 smithi039 ceph-4954ed46-70ae-11ef-bcea-c7b262605968-osd-9[63678]: 2024-09-12T02:50:40.032+0000 7f6d17a00640 -1 osd.9 112 heartbeat_check: no reply from 172.21.15.44:6804 osd.1 since back 2024-09-12T02:50:14.062055+0000 front 2024-09-12T02:50:14.062119+0000 (oldest deadline 2024-09-12T02:50:38.761988+0000) 2024-09-12T02:50:40.763 INFO:journalctl@ceph.osd.11.smithi172.stdout:Sep 12 02:50:40 smithi172 ceph-4954ed46-70ae-11ef-bcea-c7b262605968-osd-11[61129]: 2024-09-12T02:50:40.372+0000 7ff146fac640 -1 osd.11 112 heartbeat_check: no reply from 172.21.15.39:6806 osd.0 since back 2024-09-12T02:50:09.449223+0000 front 2024-09-12T02:50:09.449210+0000 (oldest deadline 2024-09-12T02:50:34.748980+0000) 2024-09-12T02:50:40.948 INFO:journalctl@ceph.osd.10.smithi044.stdout:Sep 12 02:50:40 smithi044 ceph-4954ed46-70ae-11ef-bcea-c7b262605968-osd-10[59969]: 2024-09-12T02:50:40.560+0000 7faa46dc6640 -1 osd.10 112 heartbeat_check: no reply from 172.21.15.39:6806 osd.0 since back 2024-09-12T02:50:05.367150+0000 front 2024-09-12T02:50:05.367381+0000 (oldest deadline 2024-09-12T02:50:31.267058+0000) 2024-09-12T02:50:40.949 INFO:journalctl@ceph.osd.10.smithi044.stdout:Sep 12 02:50:40 smithi044 ceph-4954ed46-70ae-11ef-bcea-c7b262605968-osd-10[59969]: 2024-09-12T02:50:40.560+0000 7faa46dc6640 -1 osd.10 112 heartbeat_check: no reply from 172.21.15.44:6804 osd.1 since back 2024-09-12T02:50:17.969767+0000 front 2024-09-12T02:50:17.969892+0000 (oldest deadline 2024-09-12T02:50:40.270033+0000) 2024-09-12T02:50:41.263 INFO:journalctl@ceph.osd.5.smithi172.stdout:Sep 12 02:50:40 smithi172 ceph-4954ed46-70ae-11ef-bcea-c7b262605968-osd-5[47211]: 2024-09-12T02:50:40.810+0000 7ff97f71d640 -1 osd.5 112 heartbeat_check: no reply from 172.21.15.39:6806 osd.0 since back 2024-09-12T02:50:07.164412+0000 front 2024-09-12T02:50:07.164434+0000 (oldest deadline 2024-09-12T02:50:35.964745+0000) 2024-09-12T02:50:41.264 INFO:journalctl@ceph.osd.5.smithi172.stdout:Sep 12 02:50:40 smithi172 ceph-4954ed46-70ae-11ef-bcea-c7b262605968-osd-5[47211]: 2024-09-12T02:50:40.810+0000 7ff97f71d640 -1 osd.5 112 heartbeat_check: no reply from 172.21.15.44:6804 osd.1 since back 2024-09-12T02:50:15.965404+0000 front 2024-09-12T02:50:15.965243+0000 (oldest deadline 2024-09-12T02:50:40.065203+0000) 2024-09-12T02:50:41.349 INFO:journalctl@ceph.osd.9.smithi039.stdout:Sep 12 02:50:41 smithi039 ceph-4954ed46-70ae-11ef-bcea-c7b262605968-osd-9[63678]: 2024-09-12T02:50:41.061+0000 7f6d17a00640 -1 osd.9 112 heartbeat_check: no reply from 172.21.15.39:6806 osd.0 since back 2024-09-12T02:50:08.761527+0000 front 2024-09-12T02:50:08.761556+0000 (oldest deadline 2024-09-12T02:50:34.061510+0000) 2024-09-12T02:50:41.350 INFO:journalctl@ceph.osd.9.smithi039.stdout:Sep 12 02:50:41 smithi039 ceph-4954ed46-70ae-11ef-bcea-c7b262605968-osd-9[63678]: 2024-09-12T02:50:41.061+0000 7f6d17a00640 -1 osd.9 112 heartbeat_check: no reply from 172.21.15.44:6804 osd.1 since back 2024-09-12T02:50:14.062055+0000 front 2024-09-12T02:50:14.062119+0000 (oldest deadline 2024-09-12T02:50:38.761988+0000) 2024-09-12T02:50:41.763 INFO:journalctl@ceph.osd.11.smithi172.stdout:Sep 12 02:50:41 smithi172 ceph-4954ed46-70ae-11ef-bcea-c7b262605968-osd-11[61129]: 2024-09-12T02:50:41.354+0000 7ff146fac640 -1 osd.11 112 heartbeat_check: no reply from 172.21.15.39:6806 osd.0 since back 2024-09-12T02:50:09.449223+0000 front 2024-09-12T02:50:09.449210+0000 (oldest deadline 2024-09-12T02:50:34.748980+0000) 2024-09-12T02:50:41.764 INFO:journalctl@ceph.osd.8.smithi172.stdout:Sep 12 02:50:41 smithi172 ceph-4954ed46-70ae-11ef-bcea-c7b262605968-osd-8[54149]: 2024-09-12T02:50:41.449+0000 7f07cfc64640 -1 osd.8 112 heartbeat_check: no reply from 172.21.15.44:6804 osd.1 since back 2024-09-12T02:50:15.561581+0000 front 2024-09-12T02:50:15.561700+0000 (oldest deadline 2024-09-12T02:50:41.362274+0000) 2024-09-12T02:50:41.850 INFO:journalctl@ceph.osd.4.smithi044.stdout:Sep 12 02:50:41 smithi044 ceph-4954ed46-70ae-11ef-bcea-c7b262605968-osd-4[46474]: 2024-09-12T02:50:41.771+0000 7f7605f17640 -1 osd.4 112 heartbeat_check: no reply from 172.21.15.44:6804 osd.1 since back 2024-09-12T02:50:14.997746+0000 front 2024-09-12T02:50:14.997781+0000 (oldest deadline 2024-09-12T02:50:40.897957+0000) 2024-09-12T02:50:41.850 INFO:journalctl@ceph.osd.7.smithi044.stdout:Sep 12 02:50:41 smithi044 ceph-4954ed46-70ae-11ef-bcea-c7b262605968-osd-7[52975]: 2024-09-12T02:50:41.755+0000 7fa72d8ab640 -1 osd.7 112 heartbeat_check: no reply from 172.21.15.44:6804 osd.1 since back 2024-09-12T02:50:16.881229+0000 front 2024-09-12T02:50:16.881275+0000 (oldest deadline 2024-09-12T02:50:41.581336+0000) 2024-09-12T02:50:41.850 INFO:journalctl@ceph.osd.10.smithi044.stdout:Sep 12 02:50:41 smithi044 ceph-4954ed46-70ae-11ef-bcea-c7b262605968-osd-10[59969]: 2024-09-12T02:50:41.583+0000 7faa46dc6640 -1 osd.10 112 heartbeat_check: no reply from 172.21.15.39:6806 osd.0 since back 2024-09-12T02:50:05.367150+0000 front 2024-09-12T02:50:05.367381+0000 (oldest deadline 2024-09-12T02:50:31.267058+0000) 2024-09-12T02:50:41.850 INFO:journalctl@ceph.osd.10.smithi044.stdout:Sep 12 02:50:41 smithi044 ceph-4954ed46-70ae-11ef-bcea-c7b262605968-osd-10[59969]: 2024-09-12T02:50:41.583+0000 7faa46dc6640 -1 osd.10 112 heartbeat_check: no reply from 172.21.15.44:6804 osd.1 since back 2024-09-12T02:50:17.969767+0000 front 2024-09-12T02:50:17.969892+0000 (oldest deadline 2024-09-12T02:50:40.270033+0000) 2024-09-12T02:50:42.263 INFO:journalctl@ceph.osd.5.smithi172.stdout:Sep 12 02:50:41 smithi172 ceph-4954ed46-70ae-11ef-bcea-c7b262605968-osd-5[47211]: 2024-09-12T02:50:41.815+0000 7ff97f71d640 -1 osd.5 112 heartbeat_check: no reply from 172.21.15.39:6806 osd.0 since back 2024-09-12T02:50:07.164412+0000 front 2024-09-12T02:50:07.164434+0000 (oldest deadline 2024-09-12T02:50:35.964745+0000) 2024-09-12T02:50:42.264 INFO:journalctl@ceph.osd.5.smithi172.stdout:Sep 12 02:50:41 smithi172 ceph-4954ed46-70ae-11ef-bcea-c7b262605968-osd-5[47211]: 2024-09-12T02:50:41.815+0000 7ff97f71d640 -1 osd.5 112 heartbeat_check: no reply from 172.21.15.44:6804 osd.1 since back 2024-09-12T02:50:15.965404+0000 front 2024-09-12T02:50:15.965243+0000 (oldest deadline 2024-09-12T02:50:40.065203+0000) 2024-09-12T02:50:42.349 INFO:journalctl@ceph.osd.9.smithi039.stdout:Sep 12 02:50:42 smithi039 ceph-4954ed46-70ae-11ef-bcea-c7b262605968-osd-9[63678]: 2024-09-12T02:50:42.044+0000 7f6d17a00640 -1 osd.9 112 heartbeat_check: no reply from 172.21.15.39:6806 osd.0 since back 2024-09-12T02:50:08.761527+0000 front 2024-09-12T02:50:08.761556+0000 (oldest deadline 2024-09-12T02:50:34.061510+0000) 2024-09-12T02:50:42.350 INFO:journalctl@ceph.osd.9.smithi039.stdout:Sep 12 02:50:42 smithi039 ceph-4954ed46-70ae-11ef-bcea-c7b262605968-osd-9[63678]: 2024-09-12T02:50:42.044+0000 7f6d17a00640 -1 osd.9 112 heartbeat_check: no reply from 172.21.15.44:6804 osd.1 since back 2024-09-12T02:50:14.062055+0000 front 2024-09-12T02:50:14.062119+0000 (oldest deadline 2024-09-12T02:50:38.761988+0000) 2024-09-12T02:50:42.763 INFO:journalctl@ceph.osd.8.smithi172.stdout:Sep 12 02:50:42 smithi172 ceph-4954ed46-70ae-11ef-bcea-c7b262605968-osd-8[54149]: 2024-09-12T02:50:42.439+0000 7f07cfc64640 -1 osd.8 112 heartbeat_check: no reply from 172.21.15.44:6804 osd.1 since back 2024-09-12T02:50:15.561581+0000 front 2024-09-12T02:50:15.561700+0000 (oldest deadline 2024-09-12T02:50:41.362274+0000) 2024-09-12T02:50:42.764 INFO:journalctl@ceph.osd.11.smithi172.stdout:Sep 12 02:50:42 smithi172 ceph-4954ed46-70ae-11ef-bcea-c7b262605968-osd-11[61129]: 2024-09-12T02:50:42.386+0000 7ff146fac640 -1 osd.11 112 heartbeat_check: no reply from 172.21.15.39:6806 osd.0 since back 2024-09-12T02:50:09.449223+0000 front 2024-09-12T02:50:09.449210+0000 (oldest deadline 2024-09-12T02:50:34.748980+0000) 2024-09-12T02:50:42.948 INFO:journalctl@ceph.osd.7.smithi044.stdout:Sep 12 02:50:42 smithi044 ceph-4954ed46-70ae-11ef-bcea-c7b262605968-osd-7[52975]: 2024-09-12T02:50:42.777+0000 7fa72d8ab640 -1 osd.7 112 heartbeat_check: no reply from 172.21.15.44:6804 osd.1 since back 2024-09-12T02:50:16.881229+0000 front 2024-09-12T02:50:16.881275+0000 (oldest deadline 2024-09-12T02:50:41.581336+0000) 2024-09-12T02:50:42.949 INFO:journalctl@ceph.osd.10.smithi044.stdout:Sep 12 02:50:42 smithi044 ceph-4954ed46-70ae-11ef-bcea-c7b262605968-osd-10[59969]: 2024-09-12T02:50:42.621+0000 7faa46dc6640 -1 osd.10 112 heartbeat_check: no reply from 172.21.15.39:6806 osd.0 since back 2024-09-12T02:50:05.367150+0000 front 2024-09-12T02:50:05.367381+0000 (oldest deadline 2024-09-12T02:50:31.267058+0000) 2024-09-12T02:50:42.949 INFO:journalctl@ceph.osd.10.smithi044.stdout:Sep 12 02:50:42 smithi044 ceph-4954ed46-70ae-11ef-bcea-c7b262605968-osd-10[59969]: 2024-09-12T02:50:42.621+0000 7faa46dc6640 -1 osd.10 112 heartbeat_check: no reply from 172.21.15.44:6804 osd.1 since back 2024-09-12T02:50:17.969767+0000 front 2024-09-12T02:50:17.969892+0000 (oldest deadline 2024-09-12T02:50:40.270033+0000) 2024-09-12T02:50:43.100 INFO:journalctl@ceph.osd.9.smithi039.stdout:Sep 12 02:50:43 smithi039 ceph-4954ed46-70ae-11ef-bcea-c7b262605968-osd-9[63678]: 2024-09-12T02:50:43.052+0000 7f6d17a00640 -1 osd.9 112 heartbeat_check: no reply from 172.21.15.39:6806 osd.0 since back 2024-09-12T02:50:08.761527+0000 front 2024-09-12T02:50:08.761556+0000 (oldest deadline 2024-09-12T02:50:34.061510+0000) 2024-09-12T02:50:43.100 INFO:journalctl@ceph.osd.9.smithi039.stdout:Sep 12 02:50:43 smithi039 ceph-4954ed46-70ae-11ef-bcea-c7b262605968-osd-9[63678]: 2024-09-12T02:50:43.052+0000 7f6d17a00640 -1 osd.9 112 heartbeat_check: no reply from 172.21.15.44:6804 osd.1 since back 2024-09-12T02:50:14.062055+0000 front 2024-09-12T02:50:14.062119+0000 (oldest deadline 2024-09-12T02:50:38.761988+0000) 2024-09-12T02:50:43.101 INFO:journalctl@ceph.osd.6.smithi039.stdout:Sep 12 02:50:42 smithi039 ceph-4954ed46-70ae-11ef-bcea-c7b262605968-osd-6[57154]: 2024-09-12T02:50:42.804+0000 7fd24d600640 -1 osd.6 112 heartbeat_check: no reply from 172.21.15.44:6804 osd.1 since back 2024-09-12T02:50:16.719479+0000 front 2024-09-12T02:50:16.719575+0000 (oldest deadline 2024-09-12T02:50:42.619403+0000) 2024-09-12T02:50:43.263 INFO:journalctl@ceph.osd.5.smithi172.stdout:Sep 12 02:50:42 smithi172 ceph-4954ed46-70ae-11ef-bcea-c7b262605968-osd-5[47211]: 2024-09-12T02:50:42.774+0000 7ff97f71d640 -1 osd.5 112 heartbeat_check: no reply from 172.21.15.39:6806 osd.0 since back 2024-09-12T02:50:07.164412+0000 front 2024-09-12T02:50:07.164434+0000 (oldest deadline 2024-09-12T02:50:35.964745+0000) 2024-09-12T02:50:43.264 INFO:journalctl@ceph.osd.5.smithi172.stdout:Sep 12 02:50:42 smithi172 ceph-4954ed46-70ae-11ef-bcea-c7b262605968-osd-5[47211]: 2024-09-12T02:50:42.774+0000 7ff97f71d640 -1 osd.5 112 heartbeat_check: no reply from 172.21.15.44:6804 osd.1 since back 2024-09-12T02:50:15.965404+0000 front 2024-09-12T02:50:15.965243+0000 (oldest deadline 2024-09-12T02:50:40.065203+0000) 2024-09-12T02:50:43.312 INFO:journalctl@ceph.osd.4.smithi044.stdout:Sep 12 02:50:43 smithi044 podman[72188]: 2024-09-12 02:50:43.015885386 +0000 UTC m=+5.576970683 container died 170c6c067d69b25485917a818125a96154774d05aa79ffe682b59c381dda0523 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:3be30d720e37ec4df7f667e60f22b4d221c4ce7b408e68b90f9ac10220535e66, name=ceph-4954ed46-70ae-11ef-bcea-c7b262605968-osd-4, GIT_CLEAN=True, org.label-schema.schema-version=1.0, GIT_BRANCH=HEAD, ceph=True, org.label-schema.license=GPLv2, org.label-schema.name=CentOS Stream 9 Base Image, CEPH_POINT_RELEASE=, org.label-schema.vendor=CentOS, GIT_REPO=git@github.com:ceph/ceph-container.git, RELEASE=squid-b53b6d3, org.label-schema.build-date=20240731, maintainer=Guillaume Abrioux , GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, io.buildah.version=1.37.2) 2024-09-12T02:50:43.588 INFO:journalctl@ceph.osd.4.smithi044.stdout:Sep 12 02:50:43 smithi044 podman[72188]: 2024-09-12 02:50:43.394898027 +0000 UTC m=+5.955983323 container cleanup 170c6c067d69b25485917a818125a96154774d05aa79ffe682b59c381dda0523 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:3be30d720e37ec4df7f667e60f22b4d221c4ce7b408e68b90f9ac10220535e66, name=ceph-4954ed46-70ae-11ef-bcea-c7b262605968-osd-4, ceph=True, org.label-schema.vendor=CentOS, RELEASE=squid-b53b6d3, CEPH_POINT_RELEASE=, org.label-schema.license=GPLv2, GIT_CLEAN=True, org.label-schema.build-date=20240731, GIT_BRANCH=HEAD, GIT_REPO=git@github.com:ceph/ceph-container.git, io.buildah.version=1.37.2, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.name=CentOS Stream 9 Base Image, maintainer=Guillaume Abrioux , org.label-schema.schema-version=1.0) 2024-09-12T02:50:43.588 INFO:journalctl@ceph.osd.4.smithi044.stdout:Sep 12 02:50:43 smithi044 bash[72188]: ceph-4954ed46-70ae-11ef-bcea-c7b262605968-osd-4 2024-09-12T02:50:43.764 INFO:journalctl@ceph.osd.8.smithi172.stdout:Sep 12 02:50:43 smithi172 ceph-4954ed46-70ae-11ef-bcea-c7b262605968-osd-8[54149]: 2024-09-12T02:50:43.416+0000 7f07cfc64640 -1 osd.8 112 heartbeat_check: no reply from 172.21.15.44:6804 osd.1 since back 2024-09-12T02:50:15.561581+0000 front 2024-09-12T02:50:15.561700+0000 (oldest deadline 2024-09-12T02:50:41.362274+0000) 2024-09-12T02:50:43.764 INFO:journalctl@ceph.osd.11.smithi172.stdout:Sep 12 02:50:43 smithi172 ceph-4954ed46-70ae-11ef-bcea-c7b262605968-osd-11[61129]: 2024-09-12T02:50:43.397+0000 7ff146fac640 -1 osd.11 112 heartbeat_check: no reply from 172.21.15.39:6806 osd.0 since back 2024-09-12T02:50:09.449223+0000 front 2024-09-12T02:50:09.449210+0000 (oldest deadline 2024-09-12T02:50:34.748980+0000) 2024-09-12T02:50:43.764 INFO:journalctl@ceph.osd.11.smithi172.stdout:Sep 12 02:50:43 smithi172 ceph-4954ed46-70ae-11ef-bcea-c7b262605968-osd-11[61129]: 2024-09-12T02:50:43.397+0000 7ff146fac640 -1 osd.11 112 heartbeat_check: no reply from 172.21.15.44:6804 osd.1 since back 2024-09-12T02:50:14.749696+0000 front 2024-09-12T02:50:14.749454+0000 (oldest deadline 2024-09-12T02:50:42.950102+0000) 2024-09-12T02:50:43.949 INFO:journalctl@ceph.osd.4.smithi044.stdout:Sep 12 02:50:43 smithi044 podman[72203]: 2024-09-12 02:50:43.671452251 +0000 UTC m=+0.653240607 container remove 170c6c067d69b25485917a818125a96154774d05aa79ffe682b59c381dda0523 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:3be30d720e37ec4df7f667e60f22b4d221c4ce7b408e68b90f9ac10220535e66, name=ceph-4954ed46-70ae-11ef-bcea-c7b262605968-osd-4, maintainer=Guillaume Abrioux , org.label-schema.schema-version=1.0, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.vendor=CentOS, GIT_CLEAN=True, RELEASE=squid-b53b6d3, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, GIT_BRANCH=HEAD, ceph=True, org.label-schema.build-date=20240731, CEPH_POINT_RELEASE=, GIT_REPO=git@github.com:ceph/ceph-container.git, io.buildah.version=1.37.2, org.label-schema.license=GPLv2) 2024-09-12T02:50:43.949 INFO:journalctl@ceph.osd.7.smithi044.stdout:Sep 12 02:50:43 smithi044 ceph-4954ed46-70ae-11ef-bcea-c7b262605968-osd-7[52975]: 2024-09-12T02:50:43.792+0000 7fa72d8ab640 -1 osd.7 112 heartbeat_check: no reply from 172.21.15.44:6804 osd.1 since back 2024-09-12T02:50:16.881229+0000 front 2024-09-12T02:50:16.881275+0000 (oldest deadline 2024-09-12T02:50:41.581336+0000) 2024-09-12T02:50:43.949 INFO:journalctl@ceph.osd.10.smithi044.stdout:Sep 12 02:50:43 smithi044 ceph-4954ed46-70ae-11ef-bcea-c7b262605968-osd-10[59969]: 2024-09-12T02:50:43.587+0000 7faa46dc6640 -1 osd.10 112 heartbeat_check: no reply from 172.21.15.39:6806 osd.0 since back 2024-09-12T02:50:05.367150+0000 front 2024-09-12T02:50:05.367381+0000 (oldest deadline 2024-09-12T02:50:31.267058+0000) 2024-09-12T02:50:43.949 INFO:journalctl@ceph.osd.10.smithi044.stdout:Sep 12 02:50:43 smithi044 ceph-4954ed46-70ae-11ef-bcea-c7b262605968-osd-10[59969]: 2024-09-12T02:50:43.587+0000 7faa46dc6640 -1 osd.10 112 heartbeat_check: no reply from 172.21.15.44:6804 osd.1 since back 2024-09-12T02:50:17.969767+0000 front 2024-09-12T02:50:17.969892+0000 (oldest deadline 2024-09-12T02:50:40.270033+0000) 2024-09-12T02:50:44.100 INFO:journalctl@ceph.osd.6.smithi039.stdout:Sep 12 02:50:43 smithi039 ceph-4954ed46-70ae-11ef-bcea-c7b262605968-osd-6[57154]: 2024-09-12T02:50:43.846+0000 7fd24d600640 -1 osd.6 112 heartbeat_check: no reply from 172.21.15.44:6804 osd.1 since back 2024-09-12T02:50:16.719479+0000 front 2024-09-12T02:50:16.719575+0000 (oldest deadline 2024-09-12T02:50:42.619403+0000) 2024-09-12T02:50:44.100 INFO:journalctl@ceph.osd.9.smithi039.stdout:Sep 12 02:50:44 smithi039 ceph-4954ed46-70ae-11ef-bcea-c7b262605968-osd-9[63678]: 2024-09-12T02:50:44.042+0000 7f6d17a00640 -1 osd.9 112 heartbeat_check: no reply from 172.21.15.39:6806 osd.0 since back 2024-09-12T02:50:08.761527+0000 front 2024-09-12T02:50:08.761556+0000 (oldest deadline 2024-09-12T02:50:34.061510+0000) 2024-09-12T02:50:44.100 INFO:journalctl@ceph.osd.9.smithi039.stdout:Sep 12 02:50:44 smithi039 ceph-4954ed46-70ae-11ef-bcea-c7b262605968-osd-9[63678]: 2024-09-12T02:50:44.042+0000 7f6d17a00640 -1 osd.9 112 heartbeat_check: no reply from 172.21.15.44:6804 osd.1 since back 2024-09-12T02:50:14.062055+0000 front 2024-09-12T02:50:14.062119+0000 (oldest deadline 2024-09-12T02:50:38.761988+0000) 2024-09-12T02:50:44.241 INFO:journalctl@ceph.osd.4.smithi044.stdout:Sep 12 02:50:43 smithi044 podman[72291]: 2024-09-12 02:50:43.886282463 +0000 UTC m=+0.015956472 image pull 54467abc55f864c4f73dfaf9c6ac3bb3e87b773123d5badaf790bee57321d594 quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:3be30d720e37ec4df7f667e60f22b4d221c4ce7b408e68b90f9ac10220535e66 2024-09-12T02:50:44.241 INFO:journalctl@ceph.osd.4.smithi044.stdout:Sep 12 02:50:44 smithi044 podman[72291]: 2024-09-12 02:50:44.005723056 +0000 UTC m=+0.135397094 container create 22c6ae2124897a876b28830719f7ed3e780a833946be4343d619f4861d76af9a (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:3be30d720e37ec4df7f667e60f22b4d221c4ce7b408e68b90f9ac10220535e66, name=ceph-4954ed46-70ae-11ef-bcea-c7b262605968-osd-4-deactivate, GIT_BRANCH=HEAD, CEPH_POINT_RELEASE=, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.vendor=CentOS, GIT_CLEAN=True, maintainer=Guillaume Abrioux , org.label-schema.schema-version=1.0, RELEASE=squid-b53b6d3, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.build-date=20240731, io.buildah.version=1.37.2, org.label-schema.license=GPLv2, ceph=True) 2024-09-12T02:50:44.263 INFO:journalctl@ceph.osd.5.smithi172.stdout:Sep 12 02:50:43 smithi172 ceph-4954ed46-70ae-11ef-bcea-c7b262605968-osd-5[47211]: 2024-09-12T02:50:43.806+0000 7ff97f71d640 -1 osd.5 112 heartbeat_check: no reply from 172.21.15.39:6806 osd.0 since back 2024-09-12T02:50:07.164412+0000 front 2024-09-12T02:50:07.164434+0000 (oldest deadline 2024-09-12T02:50:35.964745+0000) 2024-09-12T02:50:44.264 INFO:journalctl@ceph.osd.5.smithi172.stdout:Sep 12 02:50:43 smithi172 ceph-4954ed46-70ae-11ef-bcea-c7b262605968-osd-5[47211]: 2024-09-12T02:50:43.806+0000 7ff97f71d640 -1 osd.5 112 heartbeat_check: no reply from 172.21.15.44:6804 osd.1 since back 2024-09-12T02:50:15.965404+0000 front 2024-09-12T02:50:15.965243+0000 (oldest deadline 2024-09-12T02:50:40.065203+0000) 2024-09-12T02:50:44.608 INFO:journalctl@ceph.osd.4.smithi044.stdout:Sep 12 02:50:44 smithi044 podman[72291]: 2024-09-12 02:50:44.241666347 +0000 UTC m=+0.371340343 container init 22c6ae2124897a876b28830719f7ed3e780a833946be4343d619f4861d76af9a (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:3be30d720e37ec4df7f667e60f22b4d221c4ce7b408e68b90f9ac10220535e66, name=ceph-4954ed46-70ae-11ef-bcea-c7b262605968-osd-4-deactivate, GIT_BRANCH=HEAD, GIT_CLEAN=True, maintainer=Guillaume Abrioux , org.label-schema.schema-version=1.0, RELEASE=squid-b53b6d3, io.buildah.version=1.37.2, ceph=True, org.label-schema.build-date=20240731, CEPH_POINT_RELEASE=, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.license=GPLv2, org.label-schema.vendor=CentOS, org.label-schema.name=CentOS Stream 9 Base Image) 2024-09-12T02:50:44.608 INFO:journalctl@ceph.osd.4.smithi044.stdout:Sep 12 02:50:44 smithi044 podman[72291]: 2024-09-12 02:50:44.244993433 +0000 UTC m=+0.374667434 container start 22c6ae2124897a876b28830719f7ed3e780a833946be4343d619f4861d76af9a (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:3be30d720e37ec4df7f667e60f22b4d221c4ce7b408e68b90f9ac10220535e66, name=ceph-4954ed46-70ae-11ef-bcea-c7b262605968-osd-4-deactivate, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.license=GPLv2, ceph=True, org.label-schema.name=CentOS Stream 9 Base Image, RELEASE=squid-b53b6d3, io.buildah.version=1.37.2, org.label-schema.vendor=CentOS, GIT_BRANCH=HEAD, maintainer=Guillaume Abrioux , org.label-schema.schema-version=1.0, CEPH_POINT_RELEASE=, org.label-schema.build-date=20240731, GIT_CLEAN=True) 2024-09-12T02:50:44.608 INFO:journalctl@ceph.osd.4.smithi044.stdout:Sep 12 02:50:44 smithi044 podman[72291]: 2024-09-12 02:50:44.341891752 +0000 UTC m=+0.471565749 container attach 22c6ae2124897a876b28830719f7ed3e780a833946be4343d619f4861d76af9a (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:3be30d720e37ec4df7f667e60f22b4d221c4ce7b408e68b90f9ac10220535e66, name=ceph-4954ed46-70ae-11ef-bcea-c7b262605968-osd-4-deactivate, io.buildah.version=1.37.2, GIT_REPO=git@github.com:ceph/ceph-container.git, ceph=True, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.vendor=CentOS, org.label-schema.schema-version=1.0, org.label-schema.name=CentOS Stream 9 Base Image, maintainer=Guillaume Abrioux , CEPH_POINT_RELEASE=, GIT_BRANCH=HEAD, org.label-schema.build-date=20240731, RELEASE=squid-b53b6d3, GIT_CLEAN=True, org.label-schema.license=GPLv2) 2024-09-12T02:50:44.608 INFO:journalctl@ceph.osd.4.smithi044.stdout:Sep 12 02:50:44 smithi044 podman[72291]: 2024-09-12 02:50:44.433525182 +0000 UTC m=+0.563199187 container died 22c6ae2124897a876b28830719f7ed3e780a833946be4343d619f4861d76af9a (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:3be30d720e37ec4df7f667e60f22b4d221c4ce7b408e68b90f9ac10220535e66, name=ceph-4954ed46-70ae-11ef-bcea-c7b262605968-osd-4-deactivate, org.label-schema.license=GPLv2, ceph=True, maintainer=Guillaume Abrioux , CEPH_POINT_RELEASE=, io.buildah.version=1.37.2, org.label-schema.name=CentOS Stream 9 Base Image, RELEASE=squid-b53b6d3, org.label-schema.vendor=CentOS, GIT_CLEAN=True, org.label-schema.schema-version=1.0, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_BRANCH=HEAD, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.build-date=20240731) 2024-09-12T02:50:44.763 INFO:journalctl@ceph.osd.8.smithi172.stdout:Sep 12 02:50:44 smithi172 ceph-4954ed46-70ae-11ef-bcea-c7b262605968-osd-8[54149]: 2024-09-12T02:50:44.375+0000 7f07cfc64640 -1 osd.8 112 heartbeat_check: no reply from 172.21.15.44:6804 osd.1 since back 2024-09-12T02:50:15.561581+0000 front 2024-09-12T02:50:15.561700+0000 (oldest deadline 2024-09-12T02:50:41.362274+0000) 2024-09-12T02:50:44.764 INFO:journalctl@ceph.osd.11.smithi172.stdout:Sep 12 02:50:44 smithi172 ceph-4954ed46-70ae-11ef-bcea-c7b262605968-osd-11[61129]: 2024-09-12T02:50:44.401+0000 7ff146fac640 -1 osd.11 112 heartbeat_check: no reply from 172.21.15.39:6806 osd.0 since back 2024-09-12T02:50:09.449223+0000 front 2024-09-12T02:50:09.449210+0000 (oldest deadline 2024-09-12T02:50:34.748980+0000) 2024-09-12T02:50:44.764 INFO:journalctl@ceph.osd.11.smithi172.stdout:Sep 12 02:50:44 smithi172 ceph-4954ed46-70ae-11ef-bcea-c7b262605968-osd-11[61129]: 2024-09-12T02:50:44.401+0000 7ff146fac640 -1 osd.11 112 heartbeat_check: no reply from 172.21.15.44:6804 osd.1 since back 2024-09-12T02:50:14.749696+0000 front 2024-09-12T02:50:14.749454+0000 (oldest deadline 2024-09-12T02:50:42.950102+0000) 2024-09-12T02:50:44.949 INFO:journalctl@ceph.osd.7.smithi044.stdout:Sep 12 02:50:44 smithi044 ceph-4954ed46-70ae-11ef-bcea-c7b262605968-osd-7[52975]: 2024-09-12T02:50:44.809+0000 7fa72d8ab640 -1 osd.7 112 heartbeat_check: no reply from 172.21.15.44:6804 osd.1 since back 2024-09-12T02:50:16.881229+0000 front 2024-09-12T02:50:16.881275+0000 (oldest deadline 2024-09-12T02:50:41.581336+0000) 2024-09-12T02:50:44.949 INFO:journalctl@ceph.osd.10.smithi044.stdout:Sep 12 02:50:44 smithi044 ceph-4954ed46-70ae-11ef-bcea-c7b262605968-osd-10[59969]: 2024-09-12T02:50:44.607+0000 7faa46dc6640 -1 osd.10 112 heartbeat_check: no reply from 172.21.15.39:6806 osd.0 since back 2024-09-12T02:50:05.367150+0000 front 2024-09-12T02:50:05.367381+0000 (oldest deadline 2024-09-12T02:50:31.267058+0000) 2024-09-12T02:50:44.949 INFO:journalctl@ceph.osd.10.smithi044.stdout:Sep 12 02:50:44 smithi044 ceph-4954ed46-70ae-11ef-bcea-c7b262605968-osd-10[59969]: 2024-09-12T02:50:44.607+0000 7faa46dc6640 -1 osd.10 112 heartbeat_check: no reply from 172.21.15.44:6804 osd.1 since back 2024-09-12T02:50:17.969767+0000 front 2024-09-12T02:50:17.969892+0000 (oldest deadline 2024-09-12T02:50:40.270033+0000) 2024-09-12T02:50:45.140 DEBUG:teuthology.orchestra.run.smithi044:> sudo pkill -f 'journalctl -f -n 0 -u ceph-4954ed46-70ae-11ef-bcea-c7b262605968@osd.4.service' 2024-09-12T02:50:45.183 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-09-12T02:50:45.184 INFO:tasks.cephadm.osd.4:Stopped osd.4 2024-09-12T02:50:45.185 INFO:tasks.cephadm.osd.5:Stopping osd.5... 2024-09-12T02:50:45.185 DEBUG:teuthology.orchestra.run.smithi172:> sudo systemctl stop ceph-4954ed46-70ae-11ef-bcea-c7b262605968@osd.5 2024-09-12T02:50:45.213 INFO:journalctl@ceph.osd.5.smithi172.stdout:Sep 12 02:50:44 smithi172 ceph-4954ed46-70ae-11ef-bcea-c7b262605968-osd-5[47211]: 2024-09-12T02:50:44.767+0000 7ff97f71d640 -1 osd.5 112 heartbeat_check: no reply from 172.21.15.39:6806 osd.0 since back 2024-09-12T02:50:07.164412+0000 front 2024-09-12T02:50:07.164434+0000 (oldest deadline 2024-09-12T02:50:35.964745+0000) 2024-09-12T02:50:45.213 INFO:journalctl@ceph.osd.5.smithi172.stdout:Sep 12 02:50:44 smithi172 ceph-4954ed46-70ae-11ef-bcea-c7b262605968-osd-5[47211]: 2024-09-12T02:50:44.767+0000 7ff97f71d640 -1 osd.5 112 heartbeat_check: no reply from 172.21.15.44:6804 osd.1 since back 2024-09-12T02:50:15.965404+0000 front 2024-09-12T02:50:15.965243+0000 (oldest deadline 2024-09-12T02:50:40.065203+0000) 2024-09-12T02:50:45.350 INFO:journalctl@ceph.osd.6.smithi039.stdout:Sep 12 02:50:44 smithi039 ceph-4954ed46-70ae-11ef-bcea-c7b262605968-osd-6[57154]: 2024-09-12T02:50:44.871+0000 7fd24d600640 -1 osd.6 112 heartbeat_check: no reply from 172.21.15.44:6804 osd.1 since back 2024-09-12T02:50:16.719479+0000 front 2024-09-12T02:50:16.719575+0000 (oldest deadline 2024-09-12T02:50:42.619403+0000) 2024-09-12T02:50:45.350 INFO:journalctl@ceph.osd.9.smithi039.stdout:Sep 12 02:50:45 smithi039 ceph-4954ed46-70ae-11ef-bcea-c7b262605968-osd-9[63678]: 2024-09-12T02:50:45.041+0000 7f6d17a00640 -1 osd.9 112 heartbeat_check: no reply from 172.21.15.39:6806 osd.0 since back 2024-09-12T02:50:08.761527+0000 front 2024-09-12T02:50:08.761556+0000 (oldest deadline 2024-09-12T02:50:34.061510+0000) 2024-09-12T02:50:45.350 INFO:journalctl@ceph.osd.9.smithi039.stdout:Sep 12 02:50:45 smithi039 ceph-4954ed46-70ae-11ef-bcea-c7b262605968-osd-9[63678]: 2024-09-12T02:50:45.041+0000 7f6d17a00640 -1 osd.9 112 heartbeat_check: no reply from 172.21.15.44:6804 osd.1 since back 2024-09-12T02:50:14.062055+0000 front 2024-09-12T02:50:14.062119+0000 (oldest deadline 2024-09-12T02:50:38.761988+0000) 2024-09-12T02:50:45.497 INFO:journalctl@ceph.osd.5.smithi172.stdout:Sep 12 02:50:45 smithi172 systemd[1]: Stopping Ceph osd.5 for 4954ed46-70ae-11ef-bcea-c7b262605968... 2024-09-12T02:50:45.497 INFO:journalctl@ceph.osd.8.smithi172.stdout:Sep 12 02:50:45 smithi172 ceph-4954ed46-70ae-11ef-bcea-c7b262605968-osd-8[54149]: 2024-09-12T02:50:45.338+0000 7f07cfc64640 -1 osd.8 112 heartbeat_check: no reply from 172.21.15.44:6804 osd.1 since back 2024-09-12T02:50:15.561581+0000 front 2024-09-12T02:50:15.561700+0000 (oldest deadline 2024-09-12T02:50:41.362274+0000) 2024-09-12T02:50:45.498 INFO:journalctl@ceph.osd.11.smithi172.stdout:Sep 12 02:50:45 smithi172 ceph-4954ed46-70ae-11ef-bcea-c7b262605968-osd-11[61129]: 2024-09-12T02:50:45.371+0000 7ff146fac640 -1 osd.11 112 heartbeat_check: no reply from 172.21.15.39:6806 osd.0 since back 2024-09-12T02:50:09.449223+0000 front 2024-09-12T02:50:09.449210+0000 (oldest deadline 2024-09-12T02:50:34.748980+0000) 2024-09-12T02:50:45.498 INFO:journalctl@ceph.osd.11.smithi172.stdout:Sep 12 02:50:45 smithi172 ceph-4954ed46-70ae-11ef-bcea-c7b262605968-osd-11[61129]: 2024-09-12T02:50:45.371+0000 7ff146fac640 -1 osd.11 112 heartbeat_check: no reply from 172.21.15.44:6804 osd.1 since back 2024-09-12T02:50:14.749696+0000 front 2024-09-12T02:50:14.749454+0000 (oldest deadline 2024-09-12T02:50:42.950102+0000) 2024-09-12T02:50:45.763 INFO:journalctl@ceph.osd.5.smithi172.stdout:Sep 12 02:50:45 smithi172 ceph-4954ed46-70ae-11ef-bcea-c7b262605968-osd-5[47211]: 2024-09-12T02:50:45.496+0000 7ff983107640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-osd -n osd.5 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-09-12T02:50:45.763 INFO:journalctl@ceph.osd.5.smithi172.stdout:Sep 12 02:50:45 smithi172 ceph-4954ed46-70ae-11ef-bcea-c7b262605968-osd-5[47211]: 2024-09-12T02:50:45.496+0000 7ff983107640 -1 osd.5 112 *** Got signal Terminated *** 2024-09-12T02:50:45.764 INFO:journalctl@ceph.osd.5.smithi172.stdout:Sep 12 02:50:45 smithi172 ceph-4954ed46-70ae-11ef-bcea-c7b262605968-osd-5[47211]: 2024-09-12T02:50:45.496+0000 7ff983107640 -1 osd.5 112 *** Immediate shutdown (osd_fast_shutdown=true) *** 2024-09-12T02:50:45.948 INFO:journalctl@ceph.osd.7.smithi044.stdout:Sep 12 02:50:45 smithi044 ceph-4954ed46-70ae-11ef-bcea-c7b262605968-osd-7[52975]: 2024-09-12T02:50:45.802+0000 7fa72d8ab640 -1 osd.7 112 heartbeat_check: no reply from 172.21.15.44:6804 osd.1 since back 2024-09-12T02:50:16.881229+0000 front 2024-09-12T02:50:16.881275+0000 (oldest deadline 2024-09-12T02:50:41.581336+0000) 2024-09-12T02:50:45.949 INFO:journalctl@ceph.osd.10.smithi044.stdout:Sep 12 02:50:45 smithi044 ceph-4954ed46-70ae-11ef-bcea-c7b262605968-osd-10[59969]: 2024-09-12T02:50:45.634+0000 7faa46dc6640 -1 osd.10 112 heartbeat_check: no reply from 172.21.15.39:6806 osd.0 since back 2024-09-12T02:50:05.367150+0000 front 2024-09-12T02:50:05.367381+0000 (oldest deadline 2024-09-12T02:50:31.267058+0000) 2024-09-12T02:50:45.949 INFO:journalctl@ceph.osd.10.smithi044.stdout:Sep 12 02:50:45 smithi044 ceph-4954ed46-70ae-11ef-bcea-c7b262605968-osd-10[59969]: 2024-09-12T02:50:45.634+0000 7faa46dc6640 -1 osd.10 112 heartbeat_check: no reply from 172.21.15.44:6804 osd.1 since back 2024-09-12T02:50:17.969767+0000 front 2024-09-12T02:50:17.969892+0000 (oldest deadline 2024-09-12T02:50:40.270033+0000) 2024-09-12T02:50:46.263 INFO:journalctl@ceph.osd.5.smithi172.stdout:Sep 12 02:50:45 smithi172 ceph-4954ed46-70ae-11ef-bcea-c7b262605968-osd-5[47211]: 2024-09-12T02:50:45.782+0000 7ff97f71d640 -1 osd.5 112 heartbeat_check: no reply from 172.21.15.39:6806 osd.0 since back 2024-09-12T02:50:07.164412+0000 front 2024-09-12T02:50:07.164434+0000 (oldest deadline 2024-09-12T02:50:35.964745+0000) 2024-09-12T02:50:46.264 INFO:journalctl@ceph.osd.5.smithi172.stdout:Sep 12 02:50:45 smithi172 ceph-4954ed46-70ae-11ef-bcea-c7b262605968-osd-5[47211]: 2024-09-12T02:50:45.782+0000 7ff97f71d640 -1 osd.5 112 heartbeat_check: no reply from 172.21.15.44:6804 osd.1 since back 2024-09-12T02:50:15.965404+0000 front 2024-09-12T02:50:15.965243+0000 (oldest deadline 2024-09-12T02:50:40.065203+0000) 2024-09-12T02:50:46.349 INFO:journalctl@ceph.osd.6.smithi039.stdout:Sep 12 02:50:45 smithi039 ceph-4954ed46-70ae-11ef-bcea-c7b262605968-osd-6[57154]: 2024-09-12T02:50:45.855+0000 7fd24d600640 -1 osd.6 112 heartbeat_check: no reply from 172.21.15.44:6804 osd.1 since back 2024-09-12T02:50:16.719479+0000 front 2024-09-12T02:50:16.719575+0000 (oldest deadline 2024-09-12T02:50:42.619403+0000) 2024-09-12T02:50:46.350 INFO:journalctl@ceph.osd.9.smithi039.stdout:Sep 12 02:50:46 smithi039 ceph-4954ed46-70ae-11ef-bcea-c7b262605968-osd-9[63678]: 2024-09-12T02:50:46.029+0000 7f6d17a00640 -1 osd.9 112 heartbeat_check: no reply from 172.21.15.39:6806 osd.0 since back 2024-09-12T02:50:08.761527+0000 front 2024-09-12T02:50:08.761556+0000 (oldest deadline 2024-09-12T02:50:34.061510+0000) 2024-09-12T02:50:46.350 INFO:journalctl@ceph.osd.9.smithi039.stdout:Sep 12 02:50:46 smithi039 ceph-4954ed46-70ae-11ef-bcea-c7b262605968-osd-9[63678]: 2024-09-12T02:50:46.029+0000 7f6d17a00640 -1 osd.9 112 heartbeat_check: no reply from 172.21.15.44:6804 osd.1 since back 2024-09-12T02:50:14.062055+0000 front 2024-09-12T02:50:14.062119+0000 (oldest deadline 2024-09-12T02:50:38.761988+0000) 2024-09-12T02:50:46.763 INFO:journalctl@ceph.osd.11.smithi172.stdout:Sep 12 02:50:46 smithi172 ceph-4954ed46-70ae-11ef-bcea-c7b262605968-osd-11[61129]: 2024-09-12T02:50:46.332+0000 7ff146fac640 -1 osd.11 112 heartbeat_check: no reply from 172.21.15.39:6806 osd.0 since back 2024-09-12T02:50:09.449223+0000 front 2024-09-12T02:50:09.449210+0000 (oldest deadline 2024-09-12T02:50:34.748980+0000) 2024-09-12T02:50:46.763 INFO:journalctl@ceph.osd.11.smithi172.stdout:Sep 12 02:50:46 smithi172 ceph-4954ed46-70ae-11ef-bcea-c7b262605968-osd-11[61129]: 2024-09-12T02:50:46.332+0000 7ff146fac640 -1 osd.11 112 heartbeat_check: no reply from 172.21.15.44:6804 osd.1 since back 2024-09-12T02:50:14.749696+0000 front 2024-09-12T02:50:14.749454+0000 (oldest deadline 2024-09-12T02:50:42.950102+0000) 2024-09-12T02:50:46.764 INFO:journalctl@ceph.osd.8.smithi172.stdout:Sep 12 02:50:46 smithi172 ceph-4954ed46-70ae-11ef-bcea-c7b262605968-osd-8[54149]: 2024-09-12T02:50:46.293+0000 7f07cfc64640 -1 osd.8 112 heartbeat_check: no reply from 172.21.15.44:6804 osd.1 since back 2024-09-12T02:50:15.561581+0000 front 2024-09-12T02:50:15.561700+0000 (oldest deadline 2024-09-12T02:50:41.362274+0000) 2024-09-12T02:50:46.949 INFO:journalctl@ceph.osd.7.smithi044.stdout:Sep 12 02:50:46 smithi044 ceph-4954ed46-70ae-11ef-bcea-c7b262605968-osd-7[52975]: 2024-09-12T02:50:46.783+0000 7fa72d8ab640 -1 osd.7 112 heartbeat_check: no reply from 172.21.15.44:6804 osd.1 since back 2024-09-12T02:50:16.881229+0000 front 2024-09-12T02:50:16.881275+0000 (oldest deadline 2024-09-12T02:50:41.581336+0000) 2024-09-12T02:50:46.949 INFO:journalctl@ceph.osd.7.smithi044.stdout:Sep 12 02:50:46 smithi044 ceph-4954ed46-70ae-11ef-bcea-c7b262605968-osd-7[52975]: 2024-09-12T02:50:46.783+0000 7fa72d8ab640 -1 osd.7 112 heartbeat_check: no reply from 172.21.15.172:6804 osd.2 since back 2024-09-12T02:50:25.682202+0000 front 2024-09-12T02:50:25.682302+0000 (oldest deadline 2024-09-12T02:50:46.782200+0000) 2024-09-12T02:50:46.949 INFO:journalctl@ceph.osd.10.smithi044.stdout:Sep 12 02:50:46 smithi044 ceph-4954ed46-70ae-11ef-bcea-c7b262605968-osd-10[59969]: 2024-09-12T02:50:46.684+0000 7faa46dc6640 -1 osd.10 112 heartbeat_check: no reply from 172.21.15.39:6806 osd.0 since back 2024-09-12T02:50:05.367150+0000 front 2024-09-12T02:50:05.367381+0000 (oldest deadline 2024-09-12T02:50:31.267058+0000) 2024-09-12T02:50:46.949 INFO:journalctl@ceph.osd.10.smithi044.stdout:Sep 12 02:50:46 smithi044 ceph-4954ed46-70ae-11ef-bcea-c7b262605968-osd-10[59969]: 2024-09-12T02:50:46.684+0000 7faa46dc6640 -1 osd.10 112 heartbeat_check: no reply from 172.21.15.44:6804 osd.1 since back 2024-09-12T02:50:17.969767+0000 front 2024-09-12T02:50:17.969892+0000 (oldest deadline 2024-09-12T02:50:40.270033+0000) 2024-09-12T02:50:47.263 INFO:journalctl@ceph.osd.5.smithi172.stdout:Sep 12 02:50:46 smithi172 ceph-4954ed46-70ae-11ef-bcea-c7b262605968-osd-5[47211]: 2024-09-12T02:50:46.770+0000 7ff97f71d640 -1 osd.5 112 heartbeat_check: no reply from 172.21.15.39:6806 osd.0 since back 2024-09-12T02:50:07.164412+0000 front 2024-09-12T02:50:07.164434+0000 (oldest deadline 2024-09-12T02:50:35.964745+0000) 2024-09-12T02:50:47.263 INFO:journalctl@ceph.osd.5.smithi172.stdout:Sep 12 02:50:46 smithi172 ceph-4954ed46-70ae-11ef-bcea-c7b262605968-osd-5[47211]: 2024-09-12T02:50:46.770+0000 7ff97f71d640 -1 osd.5 112 heartbeat_check: no reply from 172.21.15.44:6804 osd.1 since back 2024-09-12T02:50:15.965404+0000 front 2024-09-12T02:50:15.965243+0000 (oldest deadline 2024-09-12T02:50:40.065203+0000) 2024-09-12T02:50:47.349 INFO:journalctl@ceph.osd.6.smithi039.stdout:Sep 12 02:50:46 smithi039 ceph-4954ed46-70ae-11ef-bcea-c7b262605968-osd-6[57154]: 2024-09-12T02:50:46.878+0000 7fd24d600640 -1 osd.6 112 heartbeat_check: no reply from 172.21.15.44:6804 osd.1 since back 2024-09-12T02:50:16.719479+0000 front 2024-09-12T02:50:16.719575+0000 (oldest deadline 2024-09-12T02:50:42.619403+0000) 2024-09-12T02:50:47.350 INFO:journalctl@ceph.osd.9.smithi039.stdout:Sep 12 02:50:47 smithi039 ceph-4954ed46-70ae-11ef-bcea-c7b262605968-osd-9[63678]: 2024-09-12T02:50:47.058+0000 7f6d17a00640 -1 osd.9 112 heartbeat_check: no reply from 172.21.15.39:6806 osd.0 since back 2024-09-12T02:50:08.761527+0000 front 2024-09-12T02:50:08.761556+0000 (oldest deadline 2024-09-12T02:50:34.061510+0000) 2024-09-12T02:50:47.350 INFO:journalctl@ceph.osd.9.smithi039.stdout:Sep 12 02:50:47 smithi039 ceph-4954ed46-70ae-11ef-bcea-c7b262605968-osd-9[63678]: 2024-09-12T02:50:47.058+0000 7f6d17a00640 -1 osd.9 112 heartbeat_check: no reply from 172.21.15.44:6804 osd.1 since back 2024-09-12T02:50:14.062055+0000 front 2024-09-12T02:50:14.062119+0000 (oldest deadline 2024-09-12T02:50:38.761988+0000) 2024-09-12T02:50:47.763 INFO:journalctl@ceph.osd.8.smithi172.stdout:Sep 12 02:50:47 smithi172 ceph-4954ed46-70ae-11ef-bcea-c7b262605968-osd-8[54149]: 2024-09-12T02:50:47.343+0000 7f07cfc64640 -1 osd.8 112 heartbeat_check: no reply from 172.21.15.44:6804 osd.1 since back 2024-09-12T02:50:15.561581+0000 front 2024-09-12T02:50:15.561700+0000 (oldest deadline 2024-09-12T02:50:41.362274+0000) 2024-09-12T02:50:47.764 INFO:journalctl@ceph.osd.11.smithi172.stdout:Sep 12 02:50:47 smithi172 ceph-4954ed46-70ae-11ef-bcea-c7b262605968-osd-11[61129]: 2024-09-12T02:50:47.361+0000 7ff146fac640 -1 osd.11 112 heartbeat_check: no reply from 172.21.15.39:6806 osd.0 since back 2024-09-12T02:50:09.449223+0000 front 2024-09-12T02:50:09.449210+0000 (oldest deadline 2024-09-12T02:50:34.748980+0000) 2024-09-12T02:50:47.764 INFO:journalctl@ceph.osd.11.smithi172.stdout:Sep 12 02:50:47 smithi172 ceph-4954ed46-70ae-11ef-bcea-c7b262605968-osd-11[61129]: 2024-09-12T02:50:47.361+0000 7ff146fac640 -1 osd.11 112 heartbeat_check: no reply from 172.21.15.44:6804 osd.1 since back 2024-09-12T02:50:14.749696+0000 front 2024-09-12T02:50:14.749454+0000 (oldest deadline 2024-09-12T02:50:42.950102+0000) 2024-09-12T02:50:48.198 INFO:journalctl@ceph.osd.7.smithi044.stdout:Sep 12 02:50:47 smithi044 ceph-4954ed46-70ae-11ef-bcea-c7b262605968-osd-7[52975]: 2024-09-12T02:50:47.781+0000 7fa72d8ab640 -1 osd.7 112 heartbeat_check: no reply from 172.21.15.44:6804 osd.1 since back 2024-09-12T02:50:16.881229+0000 front 2024-09-12T02:50:16.881275+0000 (oldest deadline 2024-09-12T02:50:41.581336+0000) 2024-09-12T02:50:48.199 INFO:journalctl@ceph.osd.7.smithi044.stdout:Sep 12 02:50:47 smithi044 ceph-4954ed46-70ae-11ef-bcea-c7b262605968-osd-7[52975]: 2024-09-12T02:50:47.781+0000 7fa72d8ab640 -1 osd.7 112 heartbeat_check: no reply from 172.21.15.172:6804 osd.2 since back 2024-09-12T02:50:25.682202+0000 front 2024-09-12T02:50:25.682302+0000 (oldest deadline 2024-09-12T02:50:46.782200+0000) 2024-09-12T02:50:48.199 INFO:journalctl@ceph.osd.10.smithi044.stdout:Sep 12 02:50:47 smithi044 ceph-4954ed46-70ae-11ef-bcea-c7b262605968-osd-10[59969]: 2024-09-12T02:50:47.725+0000 7faa46dc6640 -1 osd.10 112 heartbeat_check: no reply from 172.21.15.39:6806 osd.0 since back 2024-09-12T02:50:05.367150+0000 front 2024-09-12T02:50:05.367381+0000 (oldest deadline 2024-09-12T02:50:31.267058+0000) 2024-09-12T02:50:48.199 INFO:journalctl@ceph.osd.10.smithi044.stdout:Sep 12 02:50:47 smithi044 ceph-4954ed46-70ae-11ef-bcea-c7b262605968-osd-10[59969]: 2024-09-12T02:50:47.725+0000 7faa46dc6640 -1 osd.10 112 heartbeat_check: no reply from 172.21.15.44:6804 osd.1 since back 2024-09-12T02:50:17.969767+0000 front 2024-09-12T02:50:17.969892+0000 (oldest deadline 2024-09-12T02:50:40.270033+0000) 2024-09-12T02:50:48.199 INFO:journalctl@ceph.osd.10.smithi044.stdout:Sep 12 02:50:47 smithi044 ceph-4954ed46-70ae-11ef-bcea-c7b262605968-osd-10[59969]: 2024-09-12T02:50:47.725+0000 7faa46dc6640 -1 osd.10 112 heartbeat_check: no reply from 172.21.15.172:6804 osd.2 since back 2024-09-12T02:50:25.972029+0000 front 2024-09-12T02:50:25.972168+0000 (oldest deadline 2024-09-12T02:50:47.671992+0000) 2024-09-12T02:50:48.263 INFO:journalctl@ceph.osd.5.smithi172.stdout:Sep 12 02:50:47 smithi172 ceph-4954ed46-70ae-11ef-bcea-c7b262605968-osd-5[47211]: 2024-09-12T02:50:47.802+0000 7ff97f71d640 -1 osd.5 112 heartbeat_check: no reply from 172.21.15.39:6806 osd.0 since back 2024-09-12T02:50:07.164412+0000 front 2024-09-12T02:50:07.164434+0000 (oldest deadline 2024-09-12T02:50:35.964745+0000) 2024-09-12T02:50:48.264 INFO:journalctl@ceph.osd.5.smithi172.stdout:Sep 12 02:50:47 smithi172 ceph-4954ed46-70ae-11ef-bcea-c7b262605968-osd-5[47211]: 2024-09-12T02:50:47.802+0000 7ff97f71d640 -1 osd.5 112 heartbeat_check: no reply from 172.21.15.44:6804 osd.1 since back 2024-09-12T02:50:15.965404+0000 front 2024-09-12T02:50:15.965243+0000 (oldest deadline 2024-09-12T02:50:40.065203+0000) 2024-09-12T02:50:48.349 INFO:journalctl@ceph.osd.6.smithi039.stdout:Sep 12 02:50:47 smithi039 ceph-4954ed46-70ae-11ef-bcea-c7b262605968-osd-6[57154]: 2024-09-12T02:50:47.891+0000 7fd24d600640 -1 osd.6 112 heartbeat_check: no reply from 172.21.15.44:6804 osd.1 since back 2024-09-12T02:50:16.719479+0000 front 2024-09-12T02:50:16.719575+0000 (oldest deadline 2024-09-12T02:50:42.619403+0000) 2024-09-12T02:50:48.350 INFO:journalctl@ceph.osd.6.smithi039.stdout:Sep 12 02:50:47 smithi039 ceph-4954ed46-70ae-11ef-bcea-c7b262605968-osd-6[57154]: 2024-09-12T02:50:47.891+0000 7fd24d600640 -1 osd.6 112 heartbeat_check: no reply from 172.21.15.172:6804 osd.2 since back 2024-09-12T02:50:26.021392+0000 front 2024-09-12T02:50:26.021171+0000 (oldest deadline 2024-09-12T02:50:47.720855+0000) 2024-09-12T02:50:48.350 INFO:journalctl@ceph.osd.9.smithi039.stdout:Sep 12 02:50:48 smithi039 ceph-4954ed46-70ae-11ef-bcea-c7b262605968-osd-9[63678]: 2024-09-12T02:50:48.077+0000 7f6d17a00640 -1 osd.9 112 heartbeat_check: no reply from 172.21.15.39:6806 osd.0 since back 2024-09-12T02:50:08.761527+0000 front 2024-09-12T02:50:08.761556+0000 (oldest deadline 2024-09-12T02:50:34.061510+0000) 2024-09-12T02:50:48.350 INFO:journalctl@ceph.osd.9.smithi039.stdout:Sep 12 02:50:48 smithi039 ceph-4954ed46-70ae-11ef-bcea-c7b262605968-osd-9[63678]: 2024-09-12T02:50:48.077+0000 7f6d17a00640 -1 osd.9 112 heartbeat_check: no reply from 172.21.15.44:6804 osd.1 since back 2024-09-12T02:50:14.062055+0000 front 2024-09-12T02:50:14.062119+0000 (oldest deadline 2024-09-12T02:50:38.761988+0000) 2024-09-12T02:50:48.763 INFO:journalctl@ceph.osd.8.smithi172.stdout:Sep 12 02:50:48 smithi172 ceph-4954ed46-70ae-11ef-bcea-c7b262605968-osd-8[54149]: 2024-09-12T02:50:48.345+0000 7f07cfc64640 -1 osd.8 112 heartbeat_check: no reply from 172.21.15.44:6804 osd.1 since back 2024-09-12T02:50:15.561581+0000 front 2024-09-12T02:50:15.561700+0000 (oldest deadline 2024-09-12T02:50:41.362274+0000) 2024-09-12T02:50:48.764 INFO:journalctl@ceph.osd.11.smithi172.stdout:Sep 12 02:50:48 smithi172 ceph-4954ed46-70ae-11ef-bcea-c7b262605968-osd-11[61129]: 2024-09-12T02:50:48.345+0000 7ff146fac640 -1 osd.11 112 heartbeat_check: no reply from 172.21.15.39:6806 osd.0 since back 2024-09-12T02:50:09.449223+0000 front 2024-09-12T02:50:09.449210+0000 (oldest deadline 2024-09-12T02:50:34.748980+0000) 2024-09-12T02:50:48.764 INFO:journalctl@ceph.osd.11.smithi172.stdout:Sep 12 02:50:48 smithi172 ceph-4954ed46-70ae-11ef-bcea-c7b262605968-osd-11[61129]: 2024-09-12T02:50:48.345+0000 7ff146fac640 -1 osd.11 112 heartbeat_check: no reply from 172.21.15.44:6804 osd.1 since back 2024-09-12T02:50:14.749696+0000 front 2024-09-12T02:50:14.749454+0000 (oldest deadline 2024-09-12T02:50:42.950102+0000) 2024-09-12T02:50:49.198 INFO:journalctl@ceph.osd.7.smithi044.stdout:Sep 12 02:50:48 smithi044 ceph-4954ed46-70ae-11ef-bcea-c7b262605968-osd-7[52975]: 2024-09-12T02:50:48.761+0000 7fa72d8ab640 -1 osd.7 112 heartbeat_check: no reply from 172.21.15.44:6804 osd.1 since back 2024-09-12T02:50:16.881229+0000 front 2024-09-12T02:50:16.881275+0000 (oldest deadline 2024-09-12T02:50:41.581336+0000) 2024-09-12T02:50:49.199 INFO:journalctl@ceph.osd.7.smithi044.stdout:Sep 12 02:50:48 smithi044 ceph-4954ed46-70ae-11ef-bcea-c7b262605968-osd-7[52975]: 2024-09-12T02:50:48.761+0000 7fa72d8ab640 -1 osd.7 112 heartbeat_check: no reply from 172.21.15.172:6804 osd.2 since back 2024-09-12T02:50:25.682202+0000 front 2024-09-12T02:50:25.682302+0000 (oldest deadline 2024-09-12T02:50:46.782200+0000) 2024-09-12T02:50:49.199 INFO:journalctl@ceph.osd.10.smithi044.stdout:Sep 12 02:50:48 smithi044 ceph-4954ed46-70ae-11ef-bcea-c7b262605968-osd-10[59969]: 2024-09-12T02:50:48.712+0000 7faa46dc6640 -1 osd.10 112 heartbeat_check: no reply from 172.21.15.39:6806 osd.0 since back 2024-09-12T02:50:05.367150+0000 front 2024-09-12T02:50:05.367381+0000 (oldest deadline 2024-09-12T02:50:31.267058+0000) 2024-09-12T02:50:49.199 INFO:journalctl@ceph.osd.10.smithi044.stdout:Sep 12 02:50:48 smithi044 ceph-4954ed46-70ae-11ef-bcea-c7b262605968-osd-10[59969]: 2024-09-12T02:50:48.712+0000 7faa46dc6640 -1 osd.10 112 heartbeat_check: no reply from 172.21.15.44:6804 osd.1 since back 2024-09-12T02:50:17.969767+0000 front 2024-09-12T02:50:17.969892+0000 (oldest deadline 2024-09-12T02:50:40.270033+0000) 2024-09-12T02:50:49.199 INFO:journalctl@ceph.osd.10.smithi044.stdout:Sep 12 02:50:48 smithi044 ceph-4954ed46-70ae-11ef-bcea-c7b262605968-osd-10[59969]: 2024-09-12T02:50:48.712+0000 7faa46dc6640 -1 osd.10 112 heartbeat_check: no reply from 172.21.15.172:6804 osd.2 since back 2024-09-12T02:50:25.972029+0000 front 2024-09-12T02:50:25.972168+0000 (oldest deadline 2024-09-12T02:50:47.671992+0000) 2024-09-12T02:50:49.263 INFO:journalctl@ceph.osd.5.smithi172.stdout:Sep 12 02:50:48 smithi172 ceph-4954ed46-70ae-11ef-bcea-c7b262605968-osd-5[47211]: 2024-09-12T02:50:48.774+0000 7ff97f71d640 -1 osd.5 112 heartbeat_check: no reply from 172.21.15.39:6806 osd.0 since back 2024-09-12T02:50:07.164412+0000 front 2024-09-12T02:50:07.164434+0000 (oldest deadline 2024-09-12T02:50:35.964745+0000) 2024-09-12T02:50:49.264 INFO:journalctl@ceph.osd.5.smithi172.stdout:Sep 12 02:50:48 smithi172 ceph-4954ed46-70ae-11ef-bcea-c7b262605968-osd-5[47211]: 2024-09-12T02:50:48.774+0000 7ff97f71d640 -1 osd.5 112 heartbeat_check: no reply from 172.21.15.44:6804 osd.1 since back 2024-09-12T02:50:15.965404+0000 front 2024-09-12T02:50:15.965243+0000 (oldest deadline 2024-09-12T02:50:40.065203+0000) 2024-09-12T02:50:49.264 INFO:journalctl@ceph.osd.5.smithi172.stdout:Sep 12 02:50:48 smithi172 ceph-4954ed46-70ae-11ef-bcea-c7b262605968-osd-5[47211]: 2024-09-12T02:50:48.774+0000 7ff97f71d640 -1 osd.5 112 heartbeat_check: no reply from 172.21.15.172:6804 osd.2 since back 2024-09-12T02:50:24.766031+0000 front 2024-09-12T02:50:24.765987+0000 (oldest deadline 2024-09-12T02:50:48.265979+0000) 2024-09-12T02:50:49.350 INFO:journalctl@ceph.osd.6.smithi039.stdout:Sep 12 02:50:48 smithi039 ceph-4954ed46-70ae-11ef-bcea-c7b262605968-osd-6[57154]: 2024-09-12T02:50:48.910+0000 7fd24d600640 -1 osd.6 112 heartbeat_check: no reply from 172.21.15.44:6804 osd.1 since back 2024-09-12T02:50:16.719479+0000 front 2024-09-12T02:50:16.719575+0000 (oldest deadline 2024-09-12T02:50:42.619403+0000) 2024-09-12T02:50:49.350 INFO:journalctl@ceph.osd.6.smithi039.stdout:Sep 12 02:50:48 smithi039 ceph-4954ed46-70ae-11ef-bcea-c7b262605968-osd-6[57154]: 2024-09-12T02:50:48.910+0000 7fd24d600640 -1 osd.6 112 heartbeat_check: no reply from 172.21.15.172:6804 osd.2 since back 2024-09-12T02:50:26.021392+0000 front 2024-09-12T02:50:26.021171+0000 (oldest deadline 2024-09-12T02:50:47.720855+0000) 2024-09-12T02:50:49.350 INFO:journalctl@ceph.osd.9.smithi039.stdout:Sep 12 02:50:49 smithi039 ceph-4954ed46-70ae-11ef-bcea-c7b262605968-osd-9[63678]: 2024-09-12T02:50:49.068+0000 7f6d17a00640 -1 osd.9 112 heartbeat_check: no reply from 172.21.15.39:6806 osd.0 since back 2024-09-12T02:50:08.761527+0000 front 2024-09-12T02:50:08.761556+0000 (oldest deadline 2024-09-12T02:50:34.061510+0000) 2024-09-12T02:50:49.350 INFO:journalctl@ceph.osd.9.smithi039.stdout:Sep 12 02:50:49 smithi039 ceph-4954ed46-70ae-11ef-bcea-c7b262605968-osd-9[63678]: 2024-09-12T02:50:49.068+0000 7f6d17a00640 -1 osd.9 112 heartbeat_check: no reply from 172.21.15.44:6804 osd.1 since back 2024-09-12T02:50:14.062055+0000 front 2024-09-12T02:50:14.062119+0000 (oldest deadline 2024-09-12T02:50:38.761988+0000) 2024-09-12T02:50:49.350 INFO:journalctl@ceph.osd.9.smithi039.stdout:Sep 12 02:50:49 smithi039 ceph-4954ed46-70ae-11ef-bcea-c7b262605968-osd-9[63678]: 2024-09-12T02:50:49.068+0000 7f6d17a00640 -1 osd.9 112 heartbeat_check: no reply from 172.21.15.172:6804 osd.2 since back 2024-09-12T02:50:24.663318+0000 front 2024-09-12T02:50:24.663548+0000 (oldest deadline 2024-09-12T02:50:48.763108+0000) 2024-09-12T02:50:49.760 INFO:journalctl@ceph.osd.8.smithi172.stdout:Sep 12 02:50:49 smithi172 ceph-4954ed46-70ae-11ef-bcea-c7b262605968-osd-8[54149]: 2024-09-12T02:50:49.298+0000 7f07cfc64640 -1 osd.8 112 heartbeat_check: no reply from 172.21.15.44:6804 osd.1 since back 2024-09-12T02:50:15.561581+0000 front 2024-09-12T02:50:15.561700+0000 (oldest deadline 2024-09-12T02:50:41.362274+0000) 2024-09-12T02:50:49.761 INFO:journalctl@ceph.osd.11.smithi172.stdout:Sep 12 02:50:49 smithi172 ceph-4954ed46-70ae-11ef-bcea-c7b262605968-osd-11[61129]: 2024-09-12T02:50:49.377+0000 7ff146fac640 -1 osd.11 112 heartbeat_check: no reply from 172.21.15.39:6806 osd.0 since back 2024-09-12T02:50:09.449223+0000 front 2024-09-12T02:50:09.449210+0000 (oldest deadline 2024-09-12T02:50:34.748980+0000) 2024-09-12T02:50:49.761 INFO:journalctl@ceph.osd.11.smithi172.stdout:Sep 12 02:50:49 smithi172 ceph-4954ed46-70ae-11ef-bcea-c7b262605968-osd-11[61129]: 2024-09-12T02:50:49.377+0000 7ff146fac640 -1 osd.11 112 heartbeat_check: no reply from 172.21.15.44:6804 osd.1 since back 2024-09-12T02:50:14.749696+0000 front 2024-09-12T02:50:14.749454+0000 (oldest deadline 2024-09-12T02:50:42.950102+0000) 2024-09-12T02:50:49.761 INFO:journalctl@ceph.osd.11.smithi172.stdout:Sep 12 02:50:49 smithi172 ceph-4954ed46-70ae-11ef-bcea-c7b262605968-osd-11[61129]: 2024-09-12T02:50:49.377+0000 7ff146fac640 -1 osd.11 112 heartbeat_check: no reply from 172.21.15.172:6804 osd.2 since back 2024-09-12T02:50:22.950505+0000 front 2024-09-12T02:50:22.950558+0000 (oldest deadline 2024-09-12T02:50:48.850680+0000) 2024-09-12T02:50:49.948 INFO:journalctl@ceph.osd.7.smithi044.stdout:Sep 12 02:50:49 smithi044 ceph-4954ed46-70ae-11ef-bcea-c7b262605968-osd-7[52975]: 2024-09-12T02:50:49.740+0000 7fa72d8ab640 -1 osd.7 112 heartbeat_check: no reply from 172.21.15.44:6804 osd.1 since back 2024-09-12T02:50:16.881229+0000 front 2024-09-12T02:50:16.881275+0000 (oldest deadline 2024-09-12T02:50:41.581336+0000) 2024-09-12T02:50:49.949 INFO:journalctl@ceph.osd.7.smithi044.stdout:Sep 12 02:50:49 smithi044 ceph-4954ed46-70ae-11ef-bcea-c7b262605968-osd-7[52975]: 2024-09-12T02:50:49.740+0000 7fa72d8ab640 -1 osd.7 112 heartbeat_check: no reply from 172.21.15.172:6804 osd.2 since back 2024-09-12T02:50:25.682202+0000 front 2024-09-12T02:50:25.682302+0000 (oldest deadline 2024-09-12T02:50:46.782200+0000) 2024-09-12T02:50:49.949 INFO:journalctl@ceph.osd.10.smithi044.stdout:Sep 12 02:50:49 smithi044 ceph-4954ed46-70ae-11ef-bcea-c7b262605968-osd-10[59969]: 2024-09-12T02:50:49.663+0000 7faa46dc6640 -1 osd.10 112 heartbeat_check: no reply from 172.21.15.39:6806 osd.0 since back 2024-09-12T02:50:05.367150+0000 front 2024-09-12T02:50:05.367381+0000 (oldest deadline 2024-09-12T02:50:31.267058+0000) 2024-09-12T02:50:49.949 INFO:journalctl@ceph.osd.10.smithi044.stdout:Sep 12 02:50:49 smithi044 ceph-4954ed46-70ae-11ef-bcea-c7b262605968-osd-10[59969]: 2024-09-12T02:50:49.663+0000 7faa46dc6640 -1 osd.10 112 heartbeat_check: no reply from 172.21.15.44:6804 osd.1 since back 2024-09-12T02:50:17.969767+0000 front 2024-09-12T02:50:17.969892+0000 (oldest deadline 2024-09-12T02:50:40.270033+0000) 2024-09-12T02:50:49.949 INFO:journalctl@ceph.osd.10.smithi044.stdout:Sep 12 02:50:49 smithi044 ceph-4954ed46-70ae-11ef-bcea-c7b262605968-osd-10[59969]: 2024-09-12T02:50:49.663+0000 7faa46dc6640 -1 osd.10 112 heartbeat_check: no reply from 172.21.15.172:6804 osd.2 since back 2024-09-12T02:50:25.972029+0000 front 2024-09-12T02:50:25.972168+0000 (oldest deadline 2024-09-12T02:50:47.671992+0000) 2024-09-12T02:50:50.013 INFO:journalctl@ceph.osd.5.smithi172.stdout:Sep 12 02:50:49 smithi172 ceph-4954ed46-70ae-11ef-bcea-c7b262605968-osd-5[47211]: 2024-09-12T02:50:49.759+0000 7ff97f71d640 -1 osd.5 112 heartbeat_check: no reply from 172.21.15.39:6806 osd.0 since back 2024-09-12T02:50:07.164412+0000 front 2024-09-12T02:50:07.164434+0000 (oldest deadline 2024-09-12T02:50:35.964745+0000) 2024-09-12T02:50:50.014 INFO:journalctl@ceph.osd.5.smithi172.stdout:Sep 12 02:50:49 smithi172 ceph-4954ed46-70ae-11ef-bcea-c7b262605968-osd-5[47211]: 2024-09-12T02:50:49.759+0000 7ff97f71d640 -1 osd.5 112 heartbeat_check: no reply from 172.21.15.44:6804 osd.1 since back 2024-09-12T02:50:15.965404+0000 front 2024-09-12T02:50:15.965243+0000 (oldest deadline 2024-09-12T02:50:40.065203+0000) 2024-09-12T02:50:50.014 INFO:journalctl@ceph.osd.5.smithi172.stdout:Sep 12 02:50:49 smithi172 ceph-4954ed46-70ae-11ef-bcea-c7b262605968-osd-5[47211]: 2024-09-12T02:50:49.759+0000 7ff97f71d640 -1 osd.5 112 heartbeat_check: no reply from 172.21.15.172:6804 osd.2 since back 2024-09-12T02:50:24.766031+0000 front 2024-09-12T02:50:24.765987+0000 (oldest deadline 2024-09-12T02:50:48.265979+0000) 2024-09-12T02:50:50.350 INFO:journalctl@ceph.osd.6.smithi039.stdout:Sep 12 02:50:49 smithi039 ceph-4954ed46-70ae-11ef-bcea-c7b262605968-osd-6[57154]: 2024-09-12T02:50:49.956+0000 7fd24d600640 -1 osd.6 112 heartbeat_check: no reply from 172.21.15.44:6804 osd.1 since back 2024-09-12T02:50:16.719479+0000 front 2024-09-12T02:50:16.719575+0000 (oldest deadline 2024-09-12T02:50:42.619403+0000) 2024-09-12T02:50:50.350 INFO:journalctl@ceph.osd.6.smithi039.stdout:Sep 12 02:50:49 smithi039 ceph-4954ed46-70ae-11ef-bcea-c7b262605968-osd-6[57154]: 2024-09-12T02:50:49.956+0000 7fd24d600640 -1 osd.6 112 heartbeat_check: no reply from 172.21.15.172:6804 osd.2 since back 2024-09-12T02:50:26.021392+0000 front 2024-09-12T02:50:26.021171+0000 (oldest deadline 2024-09-12T02:50:47.720855+0000) 2024-09-12T02:50:50.350 INFO:journalctl@ceph.osd.9.smithi039.stdout:Sep 12 02:50:50 smithi039 ceph-4954ed46-70ae-11ef-bcea-c7b262605968-osd-9[63678]: 2024-09-12T02:50:50.078+0000 7f6d17a00640 -1 osd.9 112 heartbeat_check: no reply from 172.21.15.39:6806 osd.0 since back 2024-09-12T02:50:08.761527+0000 front 2024-09-12T02:50:08.761556+0000 (oldest deadline 2024-09-12T02:50:34.061510+0000) 2024-09-12T02:50:50.350 INFO:journalctl@ceph.osd.9.smithi039.stdout:Sep 12 02:50:50 smithi039 ceph-4954ed46-70ae-11ef-bcea-c7b262605968-osd-9[63678]: 2024-09-12T02:50:50.078+0000 7f6d17a00640 -1 osd.9 112 heartbeat_check: no reply from 172.21.15.44:6804 osd.1 since back 2024-09-12T02:50:14.062055+0000 front 2024-09-12T02:50:14.062119+0000 (oldest deadline 2024-09-12T02:50:38.761988+0000) 2024-09-12T02:50:50.350 INFO:journalctl@ceph.osd.9.smithi039.stdout:Sep 12 02:50:50 smithi039 ceph-4954ed46-70ae-11ef-bcea-c7b262605968-osd-9[63678]: 2024-09-12T02:50:50.078+0000 7f6d17a00640 -1 osd.9 112 heartbeat_check: no reply from 172.21.15.172:6804 osd.2 since back 2024-09-12T02:50:24.663318+0000 front 2024-09-12T02:50:24.663548+0000 (oldest deadline 2024-09-12T02:50:48.763108+0000) 2024-09-12T02:50:50.763 INFO:journalctl@ceph.osd.8.smithi172.stdout:Sep 12 02:50:50 smithi172 ceph-4954ed46-70ae-11ef-bcea-c7b262605968-osd-8[54149]: 2024-09-12T02:50:50.291+0000 7f07cfc64640 -1 osd.8 112 heartbeat_check: no reply from 172.21.15.44:6804 osd.1 since back 2024-09-12T02:50:15.561581+0000 front 2024-09-12T02:50:15.561700+0000 (oldest deadline 2024-09-12T02:50:41.362274+0000) 2024-09-12T02:50:50.764 INFO:journalctl@ceph.osd.8.smithi172.stdout:Sep 12 02:50:50 smithi172 ceph-4954ed46-70ae-11ef-bcea-c7b262605968-osd-8[54149]: 2024-09-12T02:50:50.291+0000 7f07cfc64640 -1 osd.8 112 heartbeat_check: no reply from 172.21.15.172:6804 osd.2 since back 2024-09-12T02:50:26.063273+0000 front 2024-09-12T02:50:26.063310+0000 (oldest deadline 2024-09-12T02:50:49.563398+0000) 2024-09-12T02:50:50.764 INFO:journalctl@ceph.osd.11.smithi172.stdout:Sep 12 02:50:50 smithi172 ceph-4954ed46-70ae-11ef-bcea-c7b262605968-osd-11[61129]: 2024-09-12T02:50:50.341+0000 7ff146fac640 -1 osd.11 112 heartbeat_check: no reply from 172.21.15.39:6806 osd.0 since back 2024-09-12T02:50:09.449223+0000 front 2024-09-12T02:50:09.449210+0000 (oldest deadline 2024-09-12T02:50:34.748980+0000) 2024-09-12T02:50:50.764 INFO:journalctl@ceph.osd.11.smithi172.stdout:Sep 12 02:50:50 smithi172 ceph-4954ed46-70ae-11ef-bcea-c7b262605968-osd-11[61129]: 2024-09-12T02:50:50.341+0000 7ff146fac640 -1 osd.11 112 heartbeat_check: no reply from 172.21.15.44:6804 osd.1 since back 2024-09-12T02:50:14.749696+0000 front 2024-09-12T02:50:14.749454+0000 (oldest deadline 2024-09-12T02:50:42.950102+0000) 2024-09-12T02:50:50.764 INFO:journalctl@ceph.osd.11.smithi172.stdout:Sep 12 02:50:50 smithi172 ceph-4954ed46-70ae-11ef-bcea-c7b262605968-osd-11[61129]: 2024-09-12T02:50:50.341+0000 7ff146fac640 -1 osd.11 112 heartbeat_check: no reply from 172.21.15.172:6804 osd.2 since back 2024-09-12T02:50:22.950505+0000 front 2024-09-12T02:50:22.950558+0000 (oldest deadline 2024-09-12T02:50:48.850680+0000) 2024-09-12T02:50:50.949 INFO:journalctl@ceph.osd.7.smithi044.stdout:Sep 12 02:50:50 smithi044 ceph-4954ed46-70ae-11ef-bcea-c7b262605968-osd-7[52975]: 2024-09-12T02:50:50.732+0000 7fa72d8ab640 -1 osd.7 112 heartbeat_check: no reply from 172.21.15.44:6804 osd.1 since back 2024-09-12T02:50:16.881229+0000 front 2024-09-12T02:50:16.881275+0000 (oldest deadline 2024-09-12T02:50:41.581336+0000) 2024-09-12T02:50:50.949 INFO:journalctl@ceph.osd.7.smithi044.stdout:Sep 12 02:50:50 smithi044 ceph-4954ed46-70ae-11ef-bcea-c7b262605968-osd-7[52975]: 2024-09-12T02:50:50.732+0000 7fa72d8ab640 -1 osd.7 112 heartbeat_check: no reply from 172.21.15.172:6804 osd.2 since back 2024-09-12T02:50:25.682202+0000 front 2024-09-12T02:50:25.682302+0000 (oldest deadline 2024-09-12T02:50:46.782200+0000) 2024-09-12T02:50:50.949 INFO:journalctl@ceph.osd.10.smithi044.stdout:Sep 12 02:50:50 smithi044 ceph-4954ed46-70ae-11ef-bcea-c7b262605968-osd-10[59969]: 2024-09-12T02:50:50.651+0000 7faa46dc6640 -1 osd.10 112 heartbeat_check: no reply from 172.21.15.39:6806 osd.0 since back 2024-09-12T02:50:05.367150+0000 front 2024-09-12T02:50:05.367381+0000 (oldest deadline 2024-09-12T02:50:31.267058+0000) 2024-09-12T02:50:50.949 INFO:journalctl@ceph.osd.10.smithi044.stdout:Sep 12 02:50:50 smithi044 ceph-4954ed46-70ae-11ef-bcea-c7b262605968-osd-10[59969]: 2024-09-12T02:50:50.651+0000 7faa46dc6640 -1 osd.10 112 heartbeat_check: no reply from 172.21.15.44:6804 osd.1 since back 2024-09-12T02:50:17.969767+0000 front 2024-09-12T02:50:17.969892+0000 (oldest deadline 2024-09-12T02:50:40.270033+0000) 2024-09-12T02:50:50.949 INFO:journalctl@ceph.osd.10.smithi044.stdout:Sep 12 02:50:50 smithi044 ceph-4954ed46-70ae-11ef-bcea-c7b262605968-osd-10[59969]: 2024-09-12T02:50:50.651+0000 7faa46dc6640 -1 osd.10 112 heartbeat_check: no reply from 172.21.15.172:6804 osd.2 since back 2024-09-12T02:50:25.972029+0000 front 2024-09-12T02:50:25.972168+0000 (oldest deadline 2024-09-12T02:50:47.671992+0000) 2024-09-12T02:50:51.165 INFO:journalctl@ceph.osd.5.smithi172.stdout:Sep 12 02:50:50 smithi172 podman[72781]: 2024-09-12 02:50:50.886119571 +0000 UTC m=+5.493117897 container died 8834aaa6db4c969cd8ac2e4dfebce811a22056c1627d032da60e8a19e2e75ba1 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:3be30d720e37ec4df7f667e60f22b4d221c4ce7b408e68b90f9ac10220535e66, name=ceph-4954ed46-70ae-11ef-bcea-c7b262605968-osd-5, org.label-schema.schema-version=1.0, org.label-schema.name=CentOS Stream 9 Base Image, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, ceph=True, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.license=GPLv2, io.buildah.version=1.37.2, CEPH_POINT_RELEASE=, GIT_BRANCH=HEAD, org.label-schema.vendor=CentOS, GIT_CLEAN=True, RELEASE=squid-b53b6d3, maintainer=Guillaume Abrioux , org.label-schema.build-date=20240731) 2024-09-12T02:50:51.315 INFO:journalctl@ceph.osd.6.smithi039.stdout:Sep 12 02:50:50 smithi039 ceph-4954ed46-70ae-11ef-bcea-c7b262605968-osd-6[57154]: 2024-09-12T02:50:50.937+0000 7fd24d600640 -1 osd.6 112 heartbeat_check: no reply from 172.21.15.44:6804 osd.1 since back 2024-09-12T02:50:16.719479+0000 front 2024-09-12T02:50:16.719575+0000 (oldest deadline 2024-09-12T02:50:42.619403+0000) 2024-09-12T02:50:51.315 INFO:journalctl@ceph.osd.6.smithi039.stdout:Sep 12 02:50:50 smithi039 ceph-4954ed46-70ae-11ef-bcea-c7b262605968-osd-6[57154]: 2024-09-12T02:50:50.937+0000 7fd24d600640 -1 osd.6 112 heartbeat_check: no reply from 172.21.15.172:6804 osd.2 since back 2024-09-12T02:50:26.021392+0000 front 2024-09-12T02:50:26.021171+0000 (oldest deadline 2024-09-12T02:50:47.720855+0000) 2024-09-12T02:50:51.315 INFO:journalctl@ceph.osd.9.smithi039.stdout:Sep 12 02:50:51 smithi039 ceph-4954ed46-70ae-11ef-bcea-c7b262605968-osd-9[63678]: 2024-09-12T02:50:51.126+0000 7f6d17a00640 -1 osd.9 112 heartbeat_check: no reply from 172.21.15.39:6806 osd.0 since back 2024-09-12T02:50:08.761527+0000 front 2024-09-12T02:50:08.761556+0000 (oldest deadline 2024-09-12T02:50:34.061510+0000) 2024-09-12T02:50:51.315 INFO:journalctl@ceph.osd.9.smithi039.stdout:Sep 12 02:50:51 smithi039 ceph-4954ed46-70ae-11ef-bcea-c7b262605968-osd-9[63678]: 2024-09-12T02:50:51.126+0000 7f6d17a00640 -1 osd.9 112 heartbeat_check: no reply from 172.21.15.44:6804 osd.1 since back 2024-09-12T02:50:14.062055+0000 front 2024-09-12T02:50:14.062119+0000 (oldest deadline 2024-09-12T02:50:38.761988+0000) 2024-09-12T02:50:51.315 INFO:journalctl@ceph.osd.9.smithi039.stdout:Sep 12 02:50:51 smithi039 ceph-4954ed46-70ae-11ef-bcea-c7b262605968-osd-9[63678]: 2024-09-12T02:50:51.126+0000 7f6d17a00640 -1 osd.9 112 heartbeat_check: no reply from 172.21.15.172:6804 osd.2 since back 2024-09-12T02:50:24.663318+0000 front 2024-09-12T02:50:24.663548+0000 (oldest deadline 2024-09-12T02:50:48.763108+0000) 2024-09-12T02:50:51.513 INFO:journalctl@ceph.osd.5.smithi172.stdout:Sep 12 02:50:51 smithi172 podman[72781]: 2024-09-12 02:50:51.255126039 +0000 UTC m=+5.862124356 container cleanup 8834aaa6db4c969cd8ac2e4dfebce811a22056c1627d032da60e8a19e2e75ba1 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:3be30d720e37ec4df7f667e60f22b4d221c4ce7b408e68b90f9ac10220535e66, name=ceph-4954ed46-70ae-11ef-bcea-c7b262605968-osd-5, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, ceph=True, RELEASE=squid-b53b6d3, io.buildah.version=1.37.2, GIT_BRANCH=HEAD, maintainer=Guillaume Abrioux , org.label-schema.build-date=20240731, CEPH_POINT_RELEASE=, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.vendor=CentOS, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.schema-version=1.0, GIT_CLEAN=True, org.label-schema.license=GPLv2) 2024-09-12T02:50:51.514 INFO:journalctl@ceph.osd.5.smithi172.stdout:Sep 12 02:50:51 smithi172 bash[72781]: ceph-4954ed46-70ae-11ef-bcea-c7b262605968-osd-5 2024-09-12T02:50:51.514 INFO:journalctl@ceph.osd.8.smithi172.stdout:Sep 12 02:50:51 smithi172 ceph-4954ed46-70ae-11ef-bcea-c7b262605968-osd-8[54149]: 2024-09-12T02:50:51.252+0000 7f07cfc64640 -1 osd.8 112 heartbeat_check: no reply from 172.21.15.44:6804 osd.1 since back 2024-09-12T02:50:15.561581+0000 front 2024-09-12T02:50:15.561700+0000 (oldest deadline 2024-09-12T02:50:41.362274+0000) 2024-09-12T02:50:51.514 INFO:journalctl@ceph.osd.8.smithi172.stdout:Sep 12 02:50:51 smithi172 ceph-4954ed46-70ae-11ef-bcea-c7b262605968-osd-8[54149]: 2024-09-12T02:50:51.252+0000 7f07cfc64640 -1 osd.8 112 heartbeat_check: no reply from 172.21.15.172:6804 osd.2 since back 2024-09-12T02:50:26.063273+0000 front 2024-09-12T02:50:26.063310+0000 (oldest deadline 2024-09-12T02:50:49.563398+0000) 2024-09-12T02:50:51.514 INFO:journalctl@ceph.osd.11.smithi172.stdout:Sep 12 02:50:51 smithi172 ceph-4954ed46-70ae-11ef-bcea-c7b262605968-osd-11[61129]: 2024-09-12T02:50:51.389+0000 7ff146fac640 -1 osd.11 112 heartbeat_check: no reply from 172.21.15.39:6806 osd.0 since back 2024-09-12T02:50:09.449223+0000 front 2024-09-12T02:50:09.449210+0000 (oldest deadline 2024-09-12T02:50:34.748980+0000) 2024-09-12T02:50:51.514 INFO:journalctl@ceph.osd.11.smithi172.stdout:Sep 12 02:50:51 smithi172 ceph-4954ed46-70ae-11ef-bcea-c7b262605968-osd-11[61129]: 2024-09-12T02:50:51.389+0000 7ff146fac640 -1 osd.11 112 heartbeat_check: no reply from 172.21.15.44:6804 osd.1 since back 2024-09-12T02:50:14.749696+0000 front 2024-09-12T02:50:14.749454+0000 (oldest deadline 2024-09-12T02:50:42.950102+0000) 2024-09-12T02:50:51.515 INFO:journalctl@ceph.osd.11.smithi172.stdout:Sep 12 02:50:51 smithi172 ceph-4954ed46-70ae-11ef-bcea-c7b262605968-osd-11[61129]: 2024-09-12T02:50:51.389+0000 7ff146fac640 -1 osd.11 112 heartbeat_check: no reply from 172.21.15.172:6804 osd.2 since back 2024-09-12T02:50:22.950505+0000 front 2024-09-12T02:50:22.950558+0000 (oldest deadline 2024-09-12T02:50:48.850680+0000) 2024-09-12T02:50:51.868 INFO:journalctl@ceph.osd.5.smithi172.stdout:Sep 12 02:50:51 smithi172 podman[72797]: 2024-09-12 02:50:51.514700542 +0000 UTC m=+0.626595082 container remove 8834aaa6db4c969cd8ac2e4dfebce811a22056c1627d032da60e8a19e2e75ba1 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:3be30d720e37ec4df7f667e60f22b4d221c4ce7b408e68b90f9ac10220535e66, name=ceph-4954ed46-70ae-11ef-bcea-c7b262605968-osd-5, GIT_REPO=git@github.com:ceph/ceph-container.git, io.buildah.version=1.37.2, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.build-date=20240731, org.label-schema.vendor=CentOS, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, ceph=True, CEPH_POINT_RELEASE=, GIT_BRANCH=HEAD, RELEASE=squid-b53b6d3, GIT_CLEAN=True, org.label-schema.license=GPLv2, org.label-schema.schema-version=1.0, maintainer=Guillaume Abrioux ) 2024-09-12T02:50:51.948 INFO:journalctl@ceph.osd.7.smithi044.stdout:Sep 12 02:50:51 smithi044 ceph-4954ed46-70ae-11ef-bcea-c7b262605968-osd-7[52975]: 2024-09-12T02:50:51.722+0000 7fa72d8ab640 -1 osd.7 112 heartbeat_check: no reply from 172.21.15.44:6804 osd.1 since back 2024-09-12T02:50:16.881229+0000 front 2024-09-12T02:50:16.881275+0000 (oldest deadline 2024-09-12T02:50:41.581336+0000) 2024-09-12T02:50:51.949 INFO:journalctl@ceph.osd.7.smithi044.stdout:Sep 12 02:50:51 smithi044 ceph-4954ed46-70ae-11ef-bcea-c7b262605968-osd-7[52975]: 2024-09-12T02:50:51.722+0000 7fa72d8ab640 -1 osd.7 112 heartbeat_check: no reply from 172.21.15.172:6804 osd.2 since back 2024-09-12T02:50:25.682202+0000 front 2024-09-12T02:50:25.682302+0000 (oldest deadline 2024-09-12T02:50:46.782200+0000) 2024-09-12T02:50:51.949 INFO:journalctl@ceph.osd.10.smithi044.stdout:Sep 12 02:50:51 smithi044 ceph-4954ed46-70ae-11ef-bcea-c7b262605968-osd-10[59969]: 2024-09-12T02:50:51.625+0000 7faa46dc6640 -1 osd.10 112 heartbeat_check: no reply from 172.21.15.39:6806 osd.0 since back 2024-09-12T02:50:05.367150+0000 front 2024-09-12T02:50:05.367381+0000 (oldest deadline 2024-09-12T02:50:31.267058+0000) 2024-09-12T02:50:51.949 INFO:journalctl@ceph.osd.10.smithi044.stdout:Sep 12 02:50:51 smithi044 ceph-4954ed46-70ae-11ef-bcea-c7b262605968-osd-10[59969]: 2024-09-12T02:50:51.625+0000 7faa46dc6640 -1 osd.10 112 heartbeat_check: no reply from 172.21.15.44:6804 osd.1 since back 2024-09-12T02:50:17.969767+0000 front 2024-09-12T02:50:17.969892+0000 (oldest deadline 2024-09-12T02:50:40.270033+0000) 2024-09-12T02:50:51.949 INFO:journalctl@ceph.osd.10.smithi044.stdout:Sep 12 02:50:51 smithi044 ceph-4954ed46-70ae-11ef-bcea-c7b262605968-osd-10[59969]: 2024-09-12T02:50:51.625+0000 7faa46dc6640 -1 osd.10 112 heartbeat_check: no reply from 172.21.15.172:6804 osd.2 since back 2024-09-12T02:50:25.972029+0000 front 2024-09-12T02:50:25.972168+0000 (oldest deadline 2024-09-12T02:50:47.671992+0000) 2024-09-12T02:50:52.178 INFO:journalctl@ceph.osd.5.smithi172.stdout:Sep 12 02:50:51 smithi172 podman[72887]: 2024-09-12 02:50:51.770917186 +0000 UTC m=+0.016286776 image pull 54467abc55f864c4f73dfaf9c6ac3bb3e87b773123d5badaf790bee57321d594 quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:3be30d720e37ec4df7f667e60f22b4d221c4ce7b408e68b90f9ac10220535e66 2024-09-12T02:50:52.178 INFO:journalctl@ceph.osd.5.smithi172.stdout:Sep 12 02:50:51 smithi172 podman[72887]: 2024-09-12 02:50:51.874162174 +0000 UTC m=+0.119531749 container create fecb241c689610e0bf0c0bcbbd07718c2cb633c37af63b836205a91da0a55783 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:3be30d720e37ec4df7f667e60f22b4d221c4ce7b408e68b90f9ac10220535e66, name=ceph-4954ed46-70ae-11ef-bcea-c7b262605968-osd-5-deactivate, maintainer=Guillaume Abrioux , org.label-schema.build-date=20240731, org.label-schema.vendor=CentOS, ceph=True, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.schema-version=1.0, RELEASE=squid-b53b6d3, CEPH_POINT_RELEASE=, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.license=GPLv2, io.buildah.version=1.37.2, GIT_BRANCH=HEAD, org.label-schema.name=CentOS Stream 9 Base Image, GIT_CLEAN=True) 2024-09-12T02:50:52.179 INFO:journalctl@ceph.osd.5.smithi172.stdout:Sep 12 02:50:52 smithi172 podman[72887]: 2024-09-12 02:50:52.101767586 +0000 UTC m=+0.347137172 container init fecb241c689610e0bf0c0bcbbd07718c2cb633c37af63b836205a91da0a55783 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:3be30d720e37ec4df7f667e60f22b4d221c4ce7b408e68b90f9ac10220535e66, name=ceph-4954ed46-70ae-11ef-bcea-c7b262605968-osd-5-deactivate, org.label-schema.vendor=CentOS, CEPH_POINT_RELEASE=, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.schema-version=1.0, GIT_BRANCH=HEAD, org.label-schema.license=GPLv2, GIT_CLEAN=True, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, GIT_REPO=git@github.com:ceph/ceph-container.git, io.buildah.version=1.37.2, ceph=True, RELEASE=squid-b53b6d3, maintainer=Guillaume Abrioux , org.label-schema.build-date=20240731) 2024-09-12T02:50:52.179 INFO:journalctl@ceph.osd.5.smithi172.stdout:Sep 12 02:50:52 smithi172 podman[72887]: 2024-09-12 02:50:52.105252384 +0000 UTC m=+0.350621960 container start fecb241c689610e0bf0c0bcbbd07718c2cb633c37af63b836205a91da0a55783 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:3be30d720e37ec4df7f667e60f22b4d221c4ce7b408e68b90f9ac10220535e66, name=ceph-4954ed46-70ae-11ef-bcea-c7b262605968-osd-5-deactivate, io.buildah.version=1.37.2, CEPH_POINT_RELEASE=, ceph=True, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.schema-version=1.0, org.label-schema.build-date=20240731, GIT_BRANCH=HEAD, RELEASE=squid-b53b6d3, org.label-schema.license=GPLv2, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, GIT_CLEAN=True, maintainer=Guillaume Abrioux , GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.vendor=CentOS) 2024-09-12T02:50:52.179 INFO:journalctl@ceph.osd.5.smithi172.stdout:Sep 12 02:50:52 smithi172 podman[72887]: 2024-09-12 02:50:52.178661312 +0000 UTC m=+0.424030888 container attach fecb241c689610e0bf0c0bcbbd07718c2cb633c37af63b836205a91da0a55783 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:3be30d720e37ec4df7f667e60f22b4d221c4ce7b408e68b90f9ac10220535e66, name=ceph-4954ed46-70ae-11ef-bcea-c7b262605968-osd-5-deactivate, org.label-schema.vendor=CentOS, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.schema-version=1.0, GIT_CLEAN=True, org.label-schema.build-date=20240731, ceph=True, CEPH_POINT_RELEASE=, GIT_BRANCH=HEAD, org.label-schema.license=GPLv2, io.buildah.version=1.37.2, org.label-schema.name=CentOS Stream 9 Base Image, RELEASE=squid-b53b6d3, GIT_REPO=git@github.com:ceph/ceph-container.git, maintainer=Guillaume Abrioux ) 2024-09-12T02:50:52.350 INFO:journalctl@ceph.osd.6.smithi039.stdout:Sep 12 02:50:51 smithi039 ceph-4954ed46-70ae-11ef-bcea-c7b262605968-osd-6[57154]: 2024-09-12T02:50:51.941+0000 7fd24d600640 -1 osd.6 112 heartbeat_check: no reply from 172.21.15.44:6804 osd.1 since back 2024-09-12T02:50:16.719479+0000 front 2024-09-12T02:50:16.719575+0000 (oldest deadline 2024-09-12T02:50:42.619403+0000) 2024-09-12T02:50:52.350 INFO:journalctl@ceph.osd.6.smithi039.stdout:Sep 12 02:50:51 smithi039 ceph-4954ed46-70ae-11ef-bcea-c7b262605968-osd-6[57154]: 2024-09-12T02:50:51.941+0000 7fd24d600640 -1 osd.6 112 heartbeat_check: no reply from 172.21.15.172:6804 osd.2 since back 2024-09-12T02:50:26.021392+0000 front 2024-09-12T02:50:26.021171+0000 (oldest deadline 2024-09-12T02:50:47.720855+0000) 2024-09-12T02:50:52.350 INFO:journalctl@ceph.osd.9.smithi039.stdout:Sep 12 02:50:52 smithi039 ceph-4954ed46-70ae-11ef-bcea-c7b262605968-osd-9[63678]: 2024-09-12T02:50:52.137+0000 7f6d17a00640 -1 osd.9 112 heartbeat_check: no reply from 172.21.15.39:6806 osd.0 since back 2024-09-12T02:50:08.761527+0000 front 2024-09-12T02:50:08.761556+0000 (oldest deadline 2024-09-12T02:50:34.061510+0000) 2024-09-12T02:50:52.350 INFO:journalctl@ceph.osd.9.smithi039.stdout:Sep 12 02:50:52 smithi039 ceph-4954ed46-70ae-11ef-bcea-c7b262605968-osd-9[63678]: 2024-09-12T02:50:52.137+0000 7f6d17a00640 -1 osd.9 112 heartbeat_check: no reply from 172.21.15.44:6804 osd.1 since back 2024-09-12T02:50:14.062055+0000 front 2024-09-12T02:50:14.062119+0000 (oldest deadline 2024-09-12T02:50:38.761988+0000) 2024-09-12T02:50:52.350 INFO:journalctl@ceph.osd.9.smithi039.stdout:Sep 12 02:50:52 smithi039 ceph-4954ed46-70ae-11ef-bcea-c7b262605968-osd-9[63678]: 2024-09-12T02:50:52.137+0000 7f6d17a00640 -1 osd.9 112 heartbeat_check: no reply from 172.21.15.172:6804 osd.2 since back 2024-09-12T02:50:24.663318+0000 front 2024-09-12T02:50:24.663548+0000 (oldest deadline 2024-09-12T02:50:48.763108+0000) 2024-09-12T02:50:52.514 INFO:journalctl@ceph.osd.5.smithi172.stdout:Sep 12 02:50:52 smithi172 podman[72887]: 2024-09-12 02:50:52.302332018 +0000 UTC m=+0.547701597 container died fecb241c689610e0bf0c0bcbbd07718c2cb633c37af63b836205a91da0a55783 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:3be30d720e37ec4df7f667e60f22b4d221c4ce7b408e68b90f9ac10220535e66, name=ceph-4954ed46-70ae-11ef-bcea-c7b262605968-osd-5-deactivate, CEPH_POINT_RELEASE=, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_BRANCH=HEAD, maintainer=Guillaume Abrioux , org.label-schema.build-date=20240731, org.label-schema.vendor=CentOS, ceph=True, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.license=GPLv2, GIT_CLEAN=True, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, RELEASE=squid-b53b6d3, org.label-schema.schema-version=1.0, io.buildah.version=1.37.2) 2024-09-12T02:50:52.514 INFO:journalctl@ceph.osd.8.smithi172.stdout:Sep 12 02:50:52 smithi172 ceph-4954ed46-70ae-11ef-bcea-c7b262605968-osd-8[54149]: 2024-09-12T02:50:52.288+0000 7f07cfc64640 -1 osd.8 112 heartbeat_check: no reply from 172.21.15.44:6804 osd.1 since back 2024-09-12T02:50:15.561581+0000 front 2024-09-12T02:50:15.561700+0000 (oldest deadline 2024-09-12T02:50:41.362274+0000) 2024-09-12T02:50:52.515 INFO:journalctl@ceph.osd.8.smithi172.stdout:Sep 12 02:50:52 smithi172 ceph-4954ed46-70ae-11ef-bcea-c7b262605968-osd-8[54149]: 2024-09-12T02:50:52.288+0000 7f07cfc64640 -1 osd.8 112 heartbeat_check: no reply from 172.21.15.172:6804 osd.2 since back 2024-09-12T02:50:26.063273+0000 front 2024-09-12T02:50:26.063310+0000 (oldest deadline 2024-09-12T02:50:49.563398+0000) 2024-09-12T02:50:52.515 INFO:journalctl@ceph.osd.11.smithi172.stdout:Sep 12 02:50:52 smithi172 ceph-4954ed46-70ae-11ef-bcea-c7b262605968-osd-11[61129]: 2024-09-12T02:50:52.351+0000 7ff146fac640 -1 osd.11 112 heartbeat_check: no reply from 172.21.15.39:6806 osd.0 since back 2024-09-12T02:50:09.449223+0000 front 2024-09-12T02:50:09.449210+0000 (oldest deadline 2024-09-12T02:50:34.748980+0000) 2024-09-12T02:50:52.515 INFO:journalctl@ceph.osd.11.smithi172.stdout:Sep 12 02:50:52 smithi172 ceph-4954ed46-70ae-11ef-bcea-c7b262605968-osd-11[61129]: 2024-09-12T02:50:52.351+0000 7ff146fac640 -1 osd.11 112 heartbeat_check: no reply from 172.21.15.44:6804 osd.1 since back 2024-09-12T02:50:14.749696+0000 front 2024-09-12T02:50:14.749454+0000 (oldest deadline 2024-09-12T02:50:42.950102+0000) 2024-09-12T02:50:52.515 INFO:journalctl@ceph.osd.11.smithi172.stdout:Sep 12 02:50:52 smithi172 ceph-4954ed46-70ae-11ef-bcea-c7b262605968-osd-11[61129]: 2024-09-12T02:50:52.351+0000 7ff146fac640 -1 osd.11 112 heartbeat_check: no reply from 172.21.15.172:6804 osd.2 since back 2024-09-12T02:50:22.950505+0000 front 2024-09-12T02:50:22.950558+0000 (oldest deadline 2024-09-12T02:50:48.850680+0000) 2024-09-12T02:50:52.903 DEBUG:teuthology.orchestra.run.smithi172:> sudo pkill -f 'journalctl -f -n 0 -u ceph-4954ed46-70ae-11ef-bcea-c7b262605968@osd.5.service' 2024-09-12T02:50:52.949 INFO:journalctl@ceph.osd.7.smithi044.stdout:Sep 12 02:50:52 smithi044 ceph-4954ed46-70ae-11ef-bcea-c7b262605968-osd-7[52975]: 2024-09-12T02:50:52.717+0000 7fa72d8ab640 -1 osd.7 112 heartbeat_check: no reply from 172.21.15.44:6804 osd.1 since back 2024-09-12T02:50:16.881229+0000 front 2024-09-12T02:50:16.881275+0000 (oldest deadline 2024-09-12T02:50:41.581336+0000) 2024-09-12T02:50:52.949 INFO:journalctl@ceph.osd.7.smithi044.stdout:Sep 12 02:50:52 smithi044 ceph-4954ed46-70ae-11ef-bcea-c7b262605968-osd-7[52975]: 2024-09-12T02:50:52.717+0000 7fa72d8ab640 -1 osd.7 112 heartbeat_check: no reply from 172.21.15.172:6804 osd.2 since back 2024-09-12T02:50:25.682202+0000 front 2024-09-12T02:50:25.682302+0000 (oldest deadline 2024-09-12T02:50:46.782200+0000) 2024-09-12T02:50:52.949 INFO:journalctl@ceph.osd.10.smithi044.stdout:Sep 12 02:50:52 smithi044 ceph-4954ed46-70ae-11ef-bcea-c7b262605968-osd-10[59969]: 2024-09-12T02:50:52.613+0000 7faa46dc6640 -1 osd.10 112 heartbeat_check: no reply from 172.21.15.39:6806 osd.0 since back 2024-09-12T02:50:05.367150+0000 front 2024-09-12T02:50:05.367381+0000 (oldest deadline 2024-09-12T02:50:31.267058+0000) 2024-09-12T02:50:52.949 INFO:journalctl@ceph.osd.10.smithi044.stdout:Sep 12 02:50:52 smithi044 ceph-4954ed46-70ae-11ef-bcea-c7b262605968-osd-10[59969]: 2024-09-12T02:50:52.613+0000 7faa46dc6640 -1 osd.10 112 heartbeat_check: no reply from 172.21.15.44:6804 osd.1 since back 2024-09-12T02:50:17.969767+0000 front 2024-09-12T02:50:17.969892+0000 (oldest deadline 2024-09-12T02:50:40.270033+0000) 2024-09-12T02:50:52.949 INFO:journalctl@ceph.osd.10.smithi044.stdout:Sep 12 02:50:52 smithi044 ceph-4954ed46-70ae-11ef-bcea-c7b262605968-osd-10[59969]: 2024-09-12T02:50:52.613+0000 7faa46dc6640 -1 osd.10 112 heartbeat_check: no reply from 172.21.15.172:6804 osd.2 since back 2024-09-12T02:50:25.972029+0000 front 2024-09-12T02:50:25.972168+0000 (oldest deadline 2024-09-12T02:50:47.671992+0000) 2024-09-12T02:50:52.983 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-09-12T02:50:52.983 INFO:tasks.cephadm.osd.5:Stopped osd.5 2024-09-12T02:50:52.983 INFO:tasks.cephadm.osd.6:Stopping osd.6... 2024-09-12T02:50:52.984 DEBUG:teuthology.orchestra.run.smithi039:> sudo systemctl stop ceph-4954ed46-70ae-11ef-bcea-c7b262605968@osd.6 2024-09-12T02:50:53.350 INFO:journalctl@ceph.osd.6.smithi039.stdout:Sep 12 02:50:52 smithi039 ceph-4954ed46-70ae-11ef-bcea-c7b262605968-osd-6[57154]: 2024-09-12T02:50:52.959+0000 7fd24d600640 -1 osd.6 112 heartbeat_check: no reply from 172.21.15.44:6804 osd.1 since back 2024-09-12T02:50:16.719479+0000 front 2024-09-12T02:50:16.719575+0000 (oldest deadline 2024-09-12T02:50:42.619403+0000) 2024-09-12T02:50:53.350 INFO:journalctl@ceph.osd.6.smithi039.stdout:Sep 12 02:50:52 smithi039 ceph-4954ed46-70ae-11ef-bcea-c7b262605968-osd-6[57154]: 2024-09-12T02:50:52.959+0000 7fd24d600640 -1 osd.6 112 heartbeat_check: no reply from 172.21.15.172:6804 osd.2 since back 2024-09-12T02:50:26.021392+0000 front 2024-09-12T02:50:26.021171+0000 (oldest deadline 2024-09-12T02:50:47.720855+0000) 2024-09-12T02:50:53.350 INFO:journalctl@ceph.osd.6.smithi039.stdout:Sep 12 02:50:53 smithi039 systemd[1]: Stopping Ceph osd.6 for 4954ed46-70ae-11ef-bcea-c7b262605968... 2024-09-12T02:50:53.350 INFO:journalctl@ceph.osd.9.smithi039.stdout:Sep 12 02:50:53 smithi039 ceph-4954ed46-70ae-11ef-bcea-c7b262605968-osd-9[63678]: 2024-09-12T02:50:53.175+0000 7f6d17a00640 -1 osd.9 112 heartbeat_check: no reply from 172.21.15.39:6806 osd.0 since back 2024-09-12T02:50:08.761527+0000 front 2024-09-12T02:50:08.761556+0000 (oldest deadline 2024-09-12T02:50:34.061510+0000) 2024-09-12T02:50:53.350 INFO:journalctl@ceph.osd.9.smithi039.stdout:Sep 12 02:50:53 smithi039 ceph-4954ed46-70ae-11ef-bcea-c7b262605968-osd-9[63678]: 2024-09-12T02:50:53.175+0000 7f6d17a00640 -1 osd.9 112 heartbeat_check: no reply from 172.21.15.44:6804 osd.1 since back 2024-09-12T02:50:14.062055+0000 front 2024-09-12T02:50:14.062119+0000 (oldest deadline 2024-09-12T02:50:38.761988+0000) 2024-09-12T02:50:53.350 INFO:journalctl@ceph.osd.9.smithi039.stdout:Sep 12 02:50:53 smithi039 ceph-4954ed46-70ae-11ef-bcea-c7b262605968-osd-9[63678]: 2024-09-12T02:50:53.175+0000 7f6d17a00640 -1 osd.9 112 heartbeat_check: no reply from 172.21.15.172:6804 osd.2 since back 2024-09-12T02:50:24.663318+0000 front 2024-09-12T02:50:24.663548+0000 (oldest deadline 2024-09-12T02:50:48.763108+0000) 2024-09-12T02:50:53.764 INFO:journalctl@ceph.osd.8.smithi172.stdout:Sep 12 02:50:53 smithi172 ceph-4954ed46-70ae-11ef-bcea-c7b262605968-osd-8[54149]: 2024-09-12T02:50:53.327+0000 7f07cfc64640 -1 osd.8 112 heartbeat_check: no reply from 172.21.15.44:6804 osd.1 since back 2024-09-12T02:50:15.561581+0000 front 2024-09-12T02:50:15.561700+0000 (oldest deadline 2024-09-12T02:50:41.362274+0000) 2024-09-12T02:50:53.764 INFO:journalctl@ceph.osd.8.smithi172.stdout:Sep 12 02:50:53 smithi172 ceph-4954ed46-70ae-11ef-bcea-c7b262605968-osd-8[54149]: 2024-09-12T02:50:53.327+0000 7f07cfc64640 -1 osd.8 112 heartbeat_check: no reply from 172.21.15.172:6804 osd.2 since back 2024-09-12T02:50:26.063273+0000 front 2024-09-12T02:50:26.063310+0000 (oldest deadline 2024-09-12T02:50:49.563398+0000) 2024-09-12T02:50:53.764 INFO:journalctl@ceph.osd.11.smithi172.stdout:Sep 12 02:50:53 smithi172 ceph-4954ed46-70ae-11ef-bcea-c7b262605968-osd-11[61129]: 2024-09-12T02:50:53.344+0000 7ff146fac640 -1 osd.11 112 heartbeat_check: no reply from 172.21.15.39:6806 osd.0 since back 2024-09-12T02:50:09.449223+0000 front 2024-09-12T02:50:09.449210+0000 (oldest deadline 2024-09-12T02:50:34.748980+0000) 2024-09-12T02:50:53.765 INFO:journalctl@ceph.osd.11.smithi172.stdout:Sep 12 02:50:53 smithi172 ceph-4954ed46-70ae-11ef-bcea-c7b262605968-osd-11[61129]: 2024-09-12T02:50:53.344+0000 7ff146fac640 -1 osd.11 112 heartbeat_check: no reply from 172.21.15.44:6804 osd.1 since back 2024-09-12T02:50:14.749696+0000 front 2024-09-12T02:50:14.749454+0000 (oldest deadline 2024-09-12T02:50:42.950102+0000) 2024-09-12T02:50:53.765 INFO:journalctl@ceph.osd.11.smithi172.stdout:Sep 12 02:50:53 smithi172 ceph-4954ed46-70ae-11ef-bcea-c7b262605968-osd-11[61129]: 2024-09-12T02:50:53.344+0000 7ff146fac640 -1 osd.11 112 heartbeat_check: no reply from 172.21.15.172:6804 osd.2 since back 2024-09-12T02:50:22.950505+0000 front 2024-09-12T02:50:22.950558+0000 (oldest deadline 2024-09-12T02:50:48.850680+0000) 2024-09-12T02:50:53.850 INFO:journalctl@ceph.osd.6.smithi039.stdout:Sep 12 02:50:53 smithi039 ceph-4954ed46-70ae-11ef-bcea-c7b262605968-osd-6[57154]: 2024-09-12T02:50:53.396+0000 7fd251c00640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-osd -n osd.6 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-09-12T02:50:53.850 INFO:journalctl@ceph.osd.6.smithi039.stdout:Sep 12 02:50:53 smithi039 ceph-4954ed46-70ae-11ef-bcea-c7b262605968-osd-6[57154]: 2024-09-12T02:50:53.396+0000 7fd251c00640 -1 osd.6 112 *** Got signal Terminated *** 2024-09-12T02:50:53.850 INFO:journalctl@ceph.osd.6.smithi039.stdout:Sep 12 02:50:53 smithi039 ceph-4954ed46-70ae-11ef-bcea-c7b262605968-osd-6[57154]: 2024-09-12T02:50:53.396+0000 7fd251c00640 -1 osd.6 112 *** Immediate shutdown (osd_fast_shutdown=true) *** 2024-09-12T02:50:53.949 INFO:journalctl@ceph.osd.7.smithi044.stdout:Sep 12 02:50:53 smithi044 ceph-4954ed46-70ae-11ef-bcea-c7b262605968-osd-7[52975]: 2024-09-12T02:50:53.679+0000 7fa72d8ab640 -1 osd.7 112 heartbeat_check: no reply from 172.21.15.44:6804 osd.1 since back 2024-09-12T02:50:16.881229+0000 front 2024-09-12T02:50:16.881275+0000 (oldest deadline 2024-09-12T02:50:41.581336+0000) 2024-09-12T02:50:53.949 INFO:journalctl@ceph.osd.7.smithi044.stdout:Sep 12 02:50:53 smithi044 ceph-4954ed46-70ae-11ef-bcea-c7b262605968-osd-7[52975]: 2024-09-12T02:50:53.679+0000 7fa72d8ab640 -1 osd.7 112 heartbeat_check: no reply from 172.21.15.172:6804 osd.2 since back 2024-09-12T02:50:25.682202+0000 front 2024-09-12T02:50:25.682302+0000 (oldest deadline 2024-09-12T02:50:46.782200+0000) 2024-09-12T02:50:53.949 INFO:journalctl@ceph.osd.10.smithi044.stdout:Sep 12 02:50:53 smithi044 ceph-4954ed46-70ae-11ef-bcea-c7b262605968-osd-10[59969]: 2024-09-12T02:50:53.653+0000 7faa46dc6640 -1 osd.10 112 heartbeat_check: no reply from 172.21.15.39:6806 osd.0 since back 2024-09-12T02:50:05.367150+0000 front 2024-09-12T02:50:05.367381+0000 (oldest deadline 2024-09-12T02:50:31.267058+0000) 2024-09-12T02:50:53.949 INFO:journalctl@ceph.osd.10.smithi044.stdout:Sep 12 02:50:53 smithi044 ceph-4954ed46-70ae-11ef-bcea-c7b262605968-osd-10[59969]: 2024-09-12T02:50:53.653+0000 7faa46dc6640 -1 osd.10 112 heartbeat_check: no reply from 172.21.15.44:6804 osd.1 since back 2024-09-12T02:50:17.969767+0000 front 2024-09-12T02:50:17.969892+0000 (oldest deadline 2024-09-12T02:50:40.270033+0000) 2024-09-12T02:50:53.950 INFO:journalctl@ceph.osd.10.smithi044.stdout:Sep 12 02:50:53 smithi044 ceph-4954ed46-70ae-11ef-bcea-c7b262605968-osd-10[59969]: 2024-09-12T02:50:53.653+0000 7faa46dc6640 -1 osd.10 112 heartbeat_check: no reply from 172.21.15.172:6804 osd.2 since back 2024-09-12T02:50:25.972029+0000 front 2024-09-12T02:50:25.972168+0000 (oldest deadline 2024-09-12T02:50:47.671992+0000) 2024-09-12T02:50:54.171 INFO:journalctl@ceph.osd.6.smithi039.stdout:Sep 12 02:50:53 smithi039 ceph-4954ed46-70ae-11ef-bcea-c7b262605968-osd-6[57154]: 2024-09-12T02:50:53.915+0000 7fd24d600640 -1 osd.6 112 heartbeat_check: no reply from 172.21.15.44:6804 osd.1 since back 2024-09-12T02:50:16.719479+0000 front 2024-09-12T02:50:16.719575+0000 (oldest deadline 2024-09-12T02:50:42.619403+0000) 2024-09-12T02:50:54.171 INFO:journalctl@ceph.osd.6.smithi039.stdout:Sep 12 02:50:53 smithi039 ceph-4954ed46-70ae-11ef-bcea-c7b262605968-osd-6[57154]: 2024-09-12T02:50:53.915+0000 7fd24d600640 -1 osd.6 112 heartbeat_check: no reply from 172.21.15.172:6804 osd.2 since back 2024-09-12T02:50:26.021392+0000 front 2024-09-12T02:50:26.021171+0000 (oldest deadline 2024-09-12T02:50:47.720855+0000) 2024-09-12T02:50:54.599 INFO:journalctl@ceph.osd.9.smithi039.stdout:Sep 12 02:50:54 smithi039 ceph-4954ed46-70ae-11ef-bcea-c7b262605968-osd-9[63678]: 2024-09-12T02:50:54.170+0000 7f6d17a00640 -1 osd.9 112 heartbeat_check: no reply from 172.21.15.39:6806 osd.0 since back 2024-09-12T02:50:08.761527+0000 front 2024-09-12T02:50:08.761556+0000 (oldest deadline 2024-09-12T02:50:34.061510+0000) 2024-09-12T02:50:54.599 INFO:journalctl@ceph.osd.9.smithi039.stdout:Sep 12 02:50:54 smithi039 ceph-4954ed46-70ae-11ef-bcea-c7b262605968-osd-9[63678]: 2024-09-12T02:50:54.170+0000 7f6d17a00640 -1 osd.9 112 heartbeat_check: no reply from 172.21.15.44:6804 osd.1 since back 2024-09-12T02:50:14.062055+0000 front 2024-09-12T02:50:14.062119+0000 (oldest deadline 2024-09-12T02:50:38.761988+0000) 2024-09-12T02:50:54.600 INFO:journalctl@ceph.osd.9.smithi039.stdout:Sep 12 02:50:54 smithi039 ceph-4954ed46-70ae-11ef-bcea-c7b262605968-osd-9[63678]: 2024-09-12T02:50:54.170+0000 7f6d17a00640 -1 osd.9 112 heartbeat_check: no reply from 172.21.15.172:6804 osd.2 since back 2024-09-12T02:50:24.663318+0000 front 2024-09-12T02:50:24.663548+0000 (oldest deadline 2024-09-12T02:50:48.763108+0000) 2024-09-12T02:50:54.763 INFO:journalctl@ceph.osd.8.smithi172.stdout:Sep 12 02:50:54 smithi172 ceph-4954ed46-70ae-11ef-bcea-c7b262605968-osd-8[54149]: 2024-09-12T02:50:54.305+0000 7f07cfc64640 -1 osd.8 112 heartbeat_check: no reply from 172.21.15.44:6804 osd.1 since back 2024-09-12T02:50:15.561581+0000 front 2024-09-12T02:50:15.561700+0000 (oldest deadline 2024-09-12T02:50:41.362274+0000) 2024-09-12T02:50:54.763 INFO:journalctl@ceph.osd.8.smithi172.stdout:Sep 12 02:50:54 smithi172 ceph-4954ed46-70ae-11ef-bcea-c7b262605968-osd-8[54149]: 2024-09-12T02:50:54.305+0000 7f07cfc64640 -1 osd.8 112 heartbeat_check: no reply from 172.21.15.172:6804 osd.2 since back 2024-09-12T02:50:26.063273+0000 front 2024-09-12T02:50:26.063310+0000 (oldest deadline 2024-09-12T02:50:49.563398+0000) 2024-09-12T02:50:54.764 INFO:journalctl@ceph.osd.11.smithi172.stdout:Sep 12 02:50:54 smithi172 ceph-4954ed46-70ae-11ef-bcea-c7b262605968-osd-11[61129]: 2024-09-12T02:50:54.376+0000 7ff146fac640 -1 osd.11 112 heartbeat_check: no reply from 172.21.15.39:6806 osd.0 since back 2024-09-12T02:50:09.449223+0000 front 2024-09-12T02:50:09.449210+0000 (oldest deadline 2024-09-12T02:50:34.748980+0000) 2024-09-12T02:50:54.764 INFO:journalctl@ceph.osd.11.smithi172.stdout:Sep 12 02:50:54 smithi172 ceph-4954ed46-70ae-11ef-bcea-c7b262605968-osd-11[61129]: 2024-09-12T02:50:54.376+0000 7ff146fac640 -1 osd.11 112 heartbeat_check: no reply from 172.21.15.44:6804 osd.1 since back 2024-09-12T02:50:14.749696+0000 front 2024-09-12T02:50:14.749454+0000 (oldest deadline 2024-09-12T02:50:42.950102+0000) 2024-09-12T02:50:54.764 INFO:journalctl@ceph.osd.11.smithi172.stdout:Sep 12 02:50:54 smithi172 ceph-4954ed46-70ae-11ef-bcea-c7b262605968-osd-11[61129]: 2024-09-12T02:50:54.376+0000 7ff146fac640 -1 osd.11 112 heartbeat_check: no reply from 172.21.15.172:6804 osd.2 since back 2024-09-12T02:50:22.950505+0000 front 2024-09-12T02:50:22.950558+0000 (oldest deadline 2024-09-12T02:50:48.850680+0000) 2024-09-12T02:50:54.951 INFO:journalctl@ceph.osd.7.smithi044.stdout:Sep 12 02:50:54 smithi044 ceph-4954ed46-70ae-11ef-bcea-c7b262605968-osd-7[52975]: 2024-09-12T02:50:54.638+0000 7fa72d8ab640 -1 osd.7 112 heartbeat_check: no reply from 172.21.15.44:6804 osd.1 since back 2024-09-12T02:50:16.881229+0000 front 2024-09-12T02:50:16.881275+0000 (oldest deadline 2024-09-12T02:50:41.581336+0000) 2024-09-12T02:50:54.952 INFO:journalctl@ceph.osd.7.smithi044.stdout:Sep 12 02:50:54 smithi044 ceph-4954ed46-70ae-11ef-bcea-c7b262605968-osd-7[52975]: 2024-09-12T02:50:54.638+0000 7fa72d8ab640 -1 osd.7 112 heartbeat_check: no reply from 172.21.15.172:6804 osd.2 since back 2024-09-12T02:50:25.682202+0000 front 2024-09-12T02:50:25.682302+0000 (oldest deadline 2024-09-12T02:50:46.782200+0000) 2024-09-12T02:50:54.953 INFO:journalctl@ceph.osd.10.smithi044.stdout:Sep 12 02:50:54 smithi044 ceph-4954ed46-70ae-11ef-bcea-c7b262605968-osd-10[59969]: 2024-09-12T02:50:54.661+0000 7faa46dc6640 -1 osd.10 112 heartbeat_check: no reply from 172.21.15.39:6806 osd.0 since back 2024-09-12T02:50:05.367150+0000 front 2024-09-12T02:50:05.367381+0000 (oldest deadline 2024-09-12T02:50:31.267058+0000) 2024-09-12T02:50:54.953 INFO:journalctl@ceph.osd.10.smithi044.stdout:Sep 12 02:50:54 smithi044 ceph-4954ed46-70ae-11ef-bcea-c7b262605968-osd-10[59969]: 2024-09-12T02:50:54.661+0000 7faa46dc6640 -1 osd.10 112 heartbeat_check: no reply from 172.21.15.44:6804 osd.1 since back 2024-09-12T02:50:17.969767+0000 front 2024-09-12T02:50:17.969892+0000 (oldest deadline 2024-09-12T02:50:40.270033+0000) 2024-09-12T02:50:54.953 INFO:journalctl@ceph.osd.10.smithi044.stdout:Sep 12 02:50:54 smithi044 ceph-4954ed46-70ae-11ef-bcea-c7b262605968-osd-10[59969]: 2024-09-12T02:50:54.661+0000 7faa46dc6640 -1 osd.10 112 heartbeat_check: no reply from 172.21.15.172:6804 osd.2 since back 2024-09-12T02:50:25.972029+0000 front 2024-09-12T02:50:25.972168+0000 (oldest deadline 2024-09-12T02:50:47.671992+0000) 2024-09-12T02:50:55.350 INFO:journalctl@ceph.osd.6.smithi039.stdout:Sep 12 02:50:54 smithi039 ceph-4954ed46-70ae-11ef-bcea-c7b262605968-osd-6[57154]: 2024-09-12T02:50:54.920+0000 7fd24d600640 -1 osd.6 112 heartbeat_check: no reply from 172.21.15.44:6804 osd.1 since back 2024-09-12T02:50:16.719479+0000 front 2024-09-12T02:50:16.719575+0000 (oldest deadline 2024-09-12T02:50:42.619403+0000) 2024-09-12T02:50:55.350 INFO:journalctl@ceph.osd.6.smithi039.stdout:Sep 12 02:50:54 smithi039 ceph-4954ed46-70ae-11ef-bcea-c7b262605968-osd-6[57154]: 2024-09-12T02:50:54.920+0000 7fd24d600640 -1 osd.6 112 heartbeat_check: no reply from 172.21.15.172:6804 osd.2 since back 2024-09-12T02:50:26.021392+0000 front 2024-09-12T02:50:26.021171+0000 (oldest deadline 2024-09-12T02:50:47.720855+0000) 2024-09-12T02:50:55.350 INFO:journalctl@ceph.osd.9.smithi039.stdout:Sep 12 02:50:55 smithi039 ceph-4954ed46-70ae-11ef-bcea-c7b262605968-osd-9[63678]: 2024-09-12T02:50:55.151+0000 7f6d17a00640 -1 osd.9 112 heartbeat_check: no reply from 172.21.15.39:6806 osd.0 since back 2024-09-12T02:50:08.761527+0000 front 2024-09-12T02:50:08.761556+0000 (oldest deadline 2024-09-12T02:50:34.061510+0000) 2024-09-12T02:50:55.350 INFO:journalctl@ceph.osd.9.smithi039.stdout:Sep 12 02:50:55 smithi039 ceph-4954ed46-70ae-11ef-bcea-c7b262605968-osd-9[63678]: 2024-09-12T02:50:55.151+0000 7f6d17a00640 -1 osd.9 112 heartbeat_check: no reply from 172.21.15.44:6804 osd.1 since back 2024-09-12T02:50:14.062055+0000 front 2024-09-12T02:50:14.062119+0000 (oldest deadline 2024-09-12T02:50:38.761988+0000) 2024-09-12T02:50:55.350 INFO:journalctl@ceph.osd.9.smithi039.stdout:Sep 12 02:50:55 smithi039 ceph-4954ed46-70ae-11ef-bcea-c7b262605968-osd-9[63678]: 2024-09-12T02:50:55.151+0000 7f6d17a00640 -1 osd.9 112 heartbeat_check: no reply from 172.21.15.172:6804 osd.2 since back 2024-09-12T02:50:24.663318+0000 front 2024-09-12T02:50:24.663548+0000 (oldest deadline 2024-09-12T02:50:48.763108+0000) 2024-09-12T02:50:55.763 INFO:journalctl@ceph.osd.8.smithi172.stdout:Sep 12 02:50:55 smithi172 ceph-4954ed46-70ae-11ef-bcea-c7b262605968-osd-8[54149]: 2024-09-12T02:50:55.284+0000 7f07cfc64640 -1 osd.8 112 heartbeat_check: no reply from 172.21.15.44:6804 osd.1 since back 2024-09-12T02:50:15.561581+0000 front 2024-09-12T02:50:15.561700+0000 (oldest deadline 2024-09-12T02:50:41.362274+0000) 2024-09-12T02:50:55.764 INFO:journalctl@ceph.osd.8.smithi172.stdout:Sep 12 02:50:55 smithi172 ceph-4954ed46-70ae-11ef-bcea-c7b262605968-osd-8[54149]: 2024-09-12T02:50:55.284+0000 7f07cfc64640 -1 osd.8 112 heartbeat_check: no reply from 172.21.15.172:6804 osd.2 since back 2024-09-12T02:50:26.063273+0000 front 2024-09-12T02:50:26.063310+0000 (oldest deadline 2024-09-12T02:50:49.563398+0000) 2024-09-12T02:50:55.764 INFO:journalctl@ceph.osd.11.smithi172.stdout:Sep 12 02:50:55 smithi172 ceph-4954ed46-70ae-11ef-bcea-c7b262605968-osd-11[61129]: 2024-09-12T02:50:55.341+0000 7ff146fac640 -1 osd.11 112 heartbeat_check: no reply from 172.21.15.39:6806 osd.0 since back 2024-09-12T02:50:09.449223+0000 front 2024-09-12T02:50:09.449210+0000 (oldest deadline 2024-09-12T02:50:34.748980+0000) 2024-09-12T02:50:55.764 INFO:journalctl@ceph.osd.11.smithi172.stdout:Sep 12 02:50:55 smithi172 ceph-4954ed46-70ae-11ef-bcea-c7b262605968-osd-11[61129]: 2024-09-12T02:50:55.341+0000 7ff146fac640 -1 osd.11 112 heartbeat_check: no reply from 172.21.15.44:6804 osd.1 since back 2024-09-12T02:50:14.749696+0000 front 2024-09-12T02:50:14.749454+0000 (oldest deadline 2024-09-12T02:50:42.950102+0000) 2024-09-12T02:50:55.764 INFO:journalctl@ceph.osd.11.smithi172.stdout:Sep 12 02:50:55 smithi172 ceph-4954ed46-70ae-11ef-bcea-c7b262605968-osd-11[61129]: 2024-09-12T02:50:55.341+0000 7ff146fac640 -1 osd.11 112 heartbeat_check: no reply from 172.21.15.172:6804 osd.2 since back 2024-09-12T02:50:22.950505+0000 front 2024-09-12T02:50:22.950558+0000 (oldest deadline 2024-09-12T02:50:48.850680+0000) 2024-09-12T02:50:55.948 INFO:journalctl@ceph.osd.7.smithi044.stdout:Sep 12 02:50:55 smithi044 ceph-4954ed46-70ae-11ef-bcea-c7b262605968-osd-7[52975]: 2024-09-12T02:50:55.589+0000 7fa72d8ab640 -1 osd.7 112 heartbeat_check: no reply from 172.21.15.44:6804 osd.1 since back 2024-09-12T02:50:16.881229+0000 front 2024-09-12T02:50:16.881275+0000 (oldest deadline 2024-09-12T02:50:41.581336+0000) 2024-09-12T02:50:55.948 INFO:journalctl@ceph.osd.7.smithi044.stdout:Sep 12 02:50:55 smithi044 ceph-4954ed46-70ae-11ef-bcea-c7b262605968-osd-7[52975]: 2024-09-12T02:50:55.589+0000 7fa72d8ab640 -1 osd.7 112 heartbeat_check: no reply from 172.21.15.172:6804 osd.2 since back 2024-09-12T02:50:25.682202+0000 front 2024-09-12T02:50:25.682302+0000 (oldest deadline 2024-09-12T02:50:46.782200+0000) 2024-09-12T02:50:55.949 INFO:journalctl@ceph.osd.10.smithi044.stdout:Sep 12 02:50:55 smithi044 ceph-4954ed46-70ae-11ef-bcea-c7b262605968-osd-10[59969]: 2024-09-12T02:50:55.661+0000 7faa46dc6640 -1 osd.10 112 heartbeat_check: no reply from 172.21.15.39:6806 osd.0 since back 2024-09-12T02:50:05.367150+0000 front 2024-09-12T02:50:05.367381+0000 (oldest deadline 2024-09-12T02:50:31.267058+0000) 2024-09-12T02:50:55.949 INFO:journalctl@ceph.osd.10.smithi044.stdout:Sep 12 02:50:55 smithi044 ceph-4954ed46-70ae-11ef-bcea-c7b262605968-osd-10[59969]: 2024-09-12T02:50:55.661+0000 7faa46dc6640 -1 osd.10 112 heartbeat_check: no reply from 172.21.15.44:6804 osd.1 since back 2024-09-12T02:50:17.969767+0000 front 2024-09-12T02:50:17.969892+0000 (oldest deadline 2024-09-12T02:50:40.270033+0000) 2024-09-12T02:50:55.949 INFO:journalctl@ceph.osd.10.smithi044.stdout:Sep 12 02:50:55 smithi044 ceph-4954ed46-70ae-11ef-bcea-c7b262605968-osd-10[59969]: 2024-09-12T02:50:55.661+0000 7faa46dc6640 -1 osd.10 112 heartbeat_check: no reply from 172.21.15.172:6804 osd.2 since back 2024-09-12T02:50:25.972029+0000 front 2024-09-12T02:50:25.972168+0000 (oldest deadline 2024-09-12T02:50:47.671992+0000) 2024-09-12T02:50:56.350 INFO:journalctl@ceph.osd.6.smithi039.stdout:Sep 12 02:50:55 smithi039 ceph-4954ed46-70ae-11ef-bcea-c7b262605968-osd-6[57154]: 2024-09-12T02:50:55.906+0000 7fd24d600640 -1 osd.6 112 heartbeat_check: no reply from 172.21.15.44:6804 osd.1 since back 2024-09-12T02:50:16.719479+0000 front 2024-09-12T02:50:16.719575+0000 (oldest deadline 2024-09-12T02:50:42.619403+0000) 2024-09-12T02:50:56.350 INFO:journalctl@ceph.osd.6.smithi039.stdout:Sep 12 02:50:55 smithi039 ceph-4954ed46-70ae-11ef-bcea-c7b262605968-osd-6[57154]: 2024-09-12T02:50:55.906+0000 7fd24d600640 -1 osd.6 112 heartbeat_check: no reply from 172.21.15.172:6804 osd.2 since back 2024-09-12T02:50:26.021392+0000 front 2024-09-12T02:50:26.021171+0000 (oldest deadline 2024-09-12T02:50:47.720855+0000) 2024-09-12T02:50:56.350 INFO:journalctl@ceph.osd.6.smithi039.stdout:Sep 12 02:50:55 smithi039 ceph-4954ed46-70ae-11ef-bcea-c7b262605968-osd-6[57154]: 2024-09-12T02:50:55.906+0000 7fd24d600640 -1 osd.6 112 heartbeat_check: no reply from 172.21.15.39:6814 osd.3 since back 2024-09-12T02:50:33.522761+0000 front 2024-09-12T02:50:33.522861+0000 (oldest deadline 2024-09-12T02:50:55.822895+0000) 2024-09-12T02:50:56.350 INFO:journalctl@ceph.osd.9.smithi039.stdout:Sep 12 02:50:56 smithi039 ceph-4954ed46-70ae-11ef-bcea-c7b262605968-osd-9[63678]: 2024-09-12T02:50:56.116+0000 7f6d17a00640 -1 osd.9 112 heartbeat_check: no reply from 172.21.15.39:6806 osd.0 since back 2024-09-12T02:50:08.761527+0000 front 2024-09-12T02:50:08.761556+0000 (oldest deadline 2024-09-12T02:50:34.061510+0000) 2024-09-12T02:50:56.350 INFO:journalctl@ceph.osd.9.smithi039.stdout:Sep 12 02:50:56 smithi039 ceph-4954ed46-70ae-11ef-bcea-c7b262605968-osd-9[63678]: 2024-09-12T02:50:56.116+0000 7f6d17a00640 -1 osd.9 112 heartbeat_check: no reply from 172.21.15.44:6804 osd.1 since back 2024-09-12T02:50:14.062055+0000 front 2024-09-12T02:50:14.062119+0000 (oldest deadline 2024-09-12T02:50:38.761988+0000) 2024-09-12T02:50:56.350 INFO:journalctl@ceph.osd.9.smithi039.stdout:Sep 12 02:50:56 smithi039 ceph-4954ed46-70ae-11ef-bcea-c7b262605968-osd-9[63678]: 2024-09-12T02:50:56.116+0000 7f6d17a00640 -1 osd.9 112 heartbeat_check: no reply from 172.21.15.172:6804 osd.2 since back 2024-09-12T02:50:24.663318+0000 front 2024-09-12T02:50:24.663548+0000 (oldest deadline 2024-09-12T02:50:48.763108+0000) 2024-09-12T02:50:56.351 INFO:journalctl@ceph.osd.9.smithi039.stdout:Sep 12 02:50:56 smithi039 ceph-4954ed46-70ae-11ef-bcea-c7b262605968-osd-9[63678]: 2024-09-12T02:50:56.116+0000 7f6d17a00640 -1 osd.9 112 heartbeat_check: no reply from 172.21.15.39:6814 osd.3 since back 2024-09-12T02:50:33.464166+0000 front 2024-09-12T02:50:33.464108+0000 (oldest deadline 2024-09-12T02:50:55.164319+0000) 2024-09-12T02:50:56.665 INFO:journalctl@ceph.osd.11.smithi172.stdout:Sep 12 02:50:56 smithi172 ceph-4954ed46-70ae-11ef-bcea-c7b262605968-osd-11[61129]: 2024-09-12T02:50:56.321+0000 7ff146fac640 -1 osd.11 112 heartbeat_check: no reply from 172.21.15.39:6806 osd.0 since back 2024-09-12T02:50:09.449223+0000 front 2024-09-12T02:50:09.449210+0000 (oldest deadline 2024-09-12T02:50:34.748980+0000) 2024-09-12T02:50:56.665 INFO:journalctl@ceph.osd.11.smithi172.stdout:Sep 12 02:50:56 smithi172 ceph-4954ed46-70ae-11ef-bcea-c7b262605968-osd-11[61129]: 2024-09-12T02:50:56.321+0000 7ff146fac640 -1 osd.11 112 heartbeat_check: no reply from 172.21.15.44:6804 osd.1 since back 2024-09-12T02:50:14.749696+0000 front 2024-09-12T02:50:14.749454+0000 (oldest deadline 2024-09-12T02:50:42.950102+0000) 2024-09-12T02:50:56.665 INFO:journalctl@ceph.osd.11.smithi172.stdout:Sep 12 02:50:56 smithi172 ceph-4954ed46-70ae-11ef-bcea-c7b262605968-osd-11[61129]: 2024-09-12T02:50:56.321+0000 7ff146fac640 -1 osd.11 112 heartbeat_check: no reply from 172.21.15.172:6804 osd.2 since back 2024-09-12T02:50:22.950505+0000 front 2024-09-12T02:50:22.950558+0000 (oldest deadline 2024-09-12T02:50:48.850680+0000) 2024-09-12T02:50:56.665 INFO:journalctl@ceph.osd.8.smithi172.stdout:Sep 12 02:50:56 smithi172 ceph-4954ed46-70ae-11ef-bcea-c7b262605968-osd-8[54149]: 2024-09-12T02:50:56.289+0000 7f07cfc64640 -1 osd.8 112 heartbeat_check: no reply from 172.21.15.44:6804 osd.1 since back 2024-09-12T02:50:15.561581+0000 front 2024-09-12T02:50:15.561700+0000 (oldest deadline 2024-09-12T02:50:41.362274+0000) 2024-09-12T02:50:56.665 INFO:journalctl@ceph.osd.8.smithi172.stdout:Sep 12 02:50:56 smithi172 ceph-4954ed46-70ae-11ef-bcea-c7b262605968-osd-8[54149]: 2024-09-12T02:50:56.289+0000 7f07cfc64640 -1 osd.8 112 heartbeat_check: no reply from 172.21.15.172:6804 osd.2 since back 2024-09-12T02:50:26.063273+0000 front 2024-09-12T02:50:26.063310+0000 (oldest deadline 2024-09-12T02:50:49.563398+0000) 2024-09-12T02:50:56.665 INFO:journalctl@ceph.osd.8.smithi172.stdout:Sep 12 02:50:56 smithi172 ceph-4954ed46-70ae-11ef-bcea-c7b262605968-osd-8[54149]: 2024-09-12T02:50:56.289+0000 7f07cfc64640 -1 osd.8 112 heartbeat_check: no reply from 172.21.15.39:6814 osd.3 since back 2024-09-12T02:50:31.864441+0000 front 2024-09-12T02:50:31.864414+0000 (oldest deadline 2024-09-12T02:50:55.364332+0000) 2024-09-12T02:50:56.949 INFO:journalctl@ceph.osd.7.smithi044.stdout:Sep 12 02:50:56 smithi044 ceph-4954ed46-70ae-11ef-bcea-c7b262605968-osd-7[52975]: 2024-09-12T02:50:56.627+0000 7fa72d8ab640 -1 osd.7 112 heartbeat_check: no reply from 172.21.15.44:6804 osd.1 since back 2024-09-12T02:50:16.881229+0000 front 2024-09-12T02:50:16.881275+0000 (oldest deadline 2024-09-12T02:50:41.581336+0000) 2024-09-12T02:50:56.949 INFO:journalctl@ceph.osd.7.smithi044.stdout:Sep 12 02:50:56 smithi044 ceph-4954ed46-70ae-11ef-bcea-c7b262605968-osd-7[52975]: 2024-09-12T02:50:56.627+0000 7fa72d8ab640 -1 osd.7 112 heartbeat_check: no reply from 172.21.15.172:6804 osd.2 since back 2024-09-12T02:50:25.682202+0000 front 2024-09-12T02:50:25.682302+0000 (oldest deadline 2024-09-12T02:50:46.782200+0000) 2024-09-12T02:50:56.949 INFO:journalctl@ceph.osd.7.smithi044.stdout:Sep 12 02:50:56 smithi044 ceph-4954ed46-70ae-11ef-bcea-c7b262605968-osd-7[52975]: 2024-09-12T02:50:56.627+0000 7fa72d8ab640 -1 osd.7 112 heartbeat_check: no reply from 172.21.15.39:6814 osd.3 since back 2024-09-12T02:50:32.083235+0000 front 2024-09-12T02:50:32.083253+0000 (oldest deadline 2024-09-12T02:50:56.183208+0000) 2024-09-12T02:50:56.949 INFO:journalctl@ceph.osd.10.smithi044.stdout:Sep 12 02:50:56 smithi044 ceph-4954ed46-70ae-11ef-bcea-c7b262605968-osd-10[59969]: 2024-09-12T02:50:56.645+0000 7faa46dc6640 -1 osd.10 112 heartbeat_check: no reply from 172.21.15.39:6806 osd.0 since back 2024-09-12T02:50:05.367150+0000 front 2024-09-12T02:50:05.367381+0000 (oldest deadline 2024-09-12T02:50:31.267058+0000) 2024-09-12T02:50:56.949 INFO:journalctl@ceph.osd.10.smithi044.stdout:Sep 12 02:50:56 smithi044 ceph-4954ed46-70ae-11ef-bcea-c7b262605968-osd-10[59969]: 2024-09-12T02:50:56.645+0000 7faa46dc6640 -1 osd.10 112 heartbeat_check: no reply from 172.21.15.44:6804 osd.1 since back 2024-09-12T02:50:17.969767+0000 front 2024-09-12T02:50:17.969892+0000 (oldest deadline 2024-09-12T02:50:40.270033+0000) 2024-09-12T02:50:56.949 INFO:journalctl@ceph.osd.10.smithi044.stdout:Sep 12 02:50:56 smithi044 ceph-4954ed46-70ae-11ef-bcea-c7b262605968-osd-10[59969]: 2024-09-12T02:50:56.645+0000 7faa46dc6640 -1 osd.10 112 heartbeat_check: no reply from 172.21.15.172:6804 osd.2 since back 2024-09-12T02:50:25.972029+0000 front 2024-09-12T02:50:25.972168+0000 (oldest deadline 2024-09-12T02:50:47.671992+0000) 2024-09-12T02:50:57.349 INFO:journalctl@ceph.osd.6.smithi039.stdout:Sep 12 02:50:56 smithi039 ceph-4954ed46-70ae-11ef-bcea-c7b262605968-osd-6[57154]: 2024-09-12T02:50:56.938+0000 7fd24d600640 -1 osd.6 112 heartbeat_check: no reply from 172.21.15.44:6804 osd.1 since back 2024-09-12T02:50:16.719479+0000 front 2024-09-12T02:50:16.719575+0000 (oldest deadline 2024-09-12T02:50:42.619403+0000) 2024-09-12T02:50:57.350 INFO:journalctl@ceph.osd.6.smithi039.stdout:Sep 12 02:50:56 smithi039 ceph-4954ed46-70ae-11ef-bcea-c7b262605968-osd-6[57154]: 2024-09-12T02:50:56.938+0000 7fd24d600640 -1 osd.6 112 heartbeat_check: no reply from 172.21.15.172:6804 osd.2 since back 2024-09-12T02:50:26.021392+0000 front 2024-09-12T02:50:26.021171+0000 (oldest deadline 2024-09-12T02:50:47.720855+0000) 2024-09-12T02:50:57.350 INFO:journalctl@ceph.osd.6.smithi039.stdout:Sep 12 02:50:56 smithi039 ceph-4954ed46-70ae-11ef-bcea-c7b262605968-osd-6[57154]: 2024-09-12T02:50:56.938+0000 7fd24d600640 -1 osd.6 112 heartbeat_check: no reply from 172.21.15.39:6814 osd.3 since back 2024-09-12T02:50:33.522761+0000 front 2024-09-12T02:50:33.522861+0000 (oldest deadline 2024-09-12T02:50:55.822895+0000) 2024-09-12T02:50:57.350 INFO:journalctl@ceph.osd.9.smithi039.stdout:Sep 12 02:50:57 smithi039 ceph-4954ed46-70ae-11ef-bcea-c7b262605968-osd-9[63678]: 2024-09-12T02:50:57.091+0000 7f6d17a00640 -1 osd.9 112 heartbeat_check: no reply from 172.21.15.39:6806 osd.0 since back 2024-09-12T02:50:08.761527+0000 front 2024-09-12T02:50:08.761556+0000 (oldest deadline 2024-09-12T02:50:34.061510+0000) 2024-09-12T02:50:57.350 INFO:journalctl@ceph.osd.9.smithi039.stdout:Sep 12 02:50:57 smithi039 ceph-4954ed46-70ae-11ef-bcea-c7b262605968-osd-9[63678]: 2024-09-12T02:50:57.091+0000 7f6d17a00640 -1 osd.9 112 heartbeat_check: no reply from 172.21.15.44:6804 osd.1 since back 2024-09-12T02:50:14.062055+0000 front 2024-09-12T02:50:14.062119+0000 (oldest deadline 2024-09-12T02:50:38.761988+0000) 2024-09-12T02:50:57.350 INFO:journalctl@ceph.osd.9.smithi039.stdout:Sep 12 02:50:57 smithi039 ceph-4954ed46-70ae-11ef-bcea-c7b262605968-osd-9[63678]: 2024-09-12T02:50:57.091+0000 7f6d17a00640 -1 osd.9 112 heartbeat_check: no reply from 172.21.15.172:6804 osd.2 since back 2024-09-12T02:50:24.663318+0000 front 2024-09-12T02:50:24.663548+0000 (oldest deadline 2024-09-12T02:50:48.763108+0000) 2024-09-12T02:50:57.350 INFO:journalctl@ceph.osd.9.smithi039.stdout:Sep 12 02:50:57 smithi039 ceph-4954ed46-70ae-11ef-bcea-c7b262605968-osd-9[63678]: 2024-09-12T02:50:57.091+0000 7f6d17a00640 -1 osd.9 112 heartbeat_check: no reply from 172.21.15.39:6814 osd.3 since back 2024-09-12T02:50:33.464166+0000 front 2024-09-12T02:50:33.464108+0000 (oldest deadline 2024-09-12T02:50:55.164319+0000) 2024-09-12T02:50:57.764 INFO:journalctl@ceph.osd.8.smithi172.stdout:Sep 12 02:50:57 smithi172 ceph-4954ed46-70ae-11ef-bcea-c7b262605968-osd-8[54149]: 2024-09-12T02:50:57.327+0000 7f07cfc64640 -1 osd.8 112 heartbeat_check: no reply from 172.21.15.44:6804 osd.1 since back 2024-09-12T02:50:15.561581+0000 front 2024-09-12T02:50:15.561700+0000 (oldest deadline 2024-09-12T02:50:41.362274+0000) 2024-09-12T02:50:57.764 INFO:journalctl@ceph.osd.8.smithi172.stdout:Sep 12 02:50:57 smithi172 ceph-4954ed46-70ae-11ef-bcea-c7b262605968-osd-8[54149]: 2024-09-12T02:50:57.327+0000 7f07cfc64640 -1 osd.8 112 heartbeat_check: no reply from 172.21.15.172:6804 osd.2 since back 2024-09-12T02:50:26.063273+0000 front 2024-09-12T02:50:26.063310+0000 (oldest deadline 2024-09-12T02:50:49.563398+0000) 2024-09-12T02:50:57.764 INFO:journalctl@ceph.osd.8.smithi172.stdout:Sep 12 02:50:57 smithi172 ceph-4954ed46-70ae-11ef-bcea-c7b262605968-osd-8[54149]: 2024-09-12T02:50:57.327+0000 7f07cfc64640 -1 osd.8 112 heartbeat_check: no reply from 172.21.15.39:6814 osd.3 since back 2024-09-12T02:50:31.864441+0000 front 2024-09-12T02:50:31.864414+0000 (oldest deadline 2024-09-12T02:50:55.364332+0000) 2024-09-12T02:50:57.764 INFO:journalctl@ceph.osd.11.smithi172.stdout:Sep 12 02:50:57 smithi172 ceph-4954ed46-70ae-11ef-bcea-c7b262605968-osd-11[61129]: 2024-09-12T02:50:57.347+0000 7ff146fac640 -1 osd.11 112 heartbeat_check: no reply from 172.21.15.39:6806 osd.0 since back 2024-09-12T02:50:09.449223+0000 front 2024-09-12T02:50:09.449210+0000 (oldest deadline 2024-09-12T02:50:34.748980+0000) 2024-09-12T02:50:57.764 INFO:journalctl@ceph.osd.11.smithi172.stdout:Sep 12 02:50:57 smithi172 ceph-4954ed46-70ae-11ef-bcea-c7b262605968-osd-11[61129]: 2024-09-12T02:50:57.347+0000 7ff146fac640 -1 osd.11 112 heartbeat_check: no reply from 172.21.15.44:6804 osd.1 since back 2024-09-12T02:50:14.749696+0000 front 2024-09-12T02:50:14.749454+0000 (oldest deadline 2024-09-12T02:50:42.950102+0000) 2024-09-12T02:50:57.764 INFO:journalctl@ceph.osd.11.smithi172.stdout:Sep 12 02:50:57 smithi172 ceph-4954ed46-70ae-11ef-bcea-c7b262605968-osd-11[61129]: 2024-09-12T02:50:57.347+0000 7ff146fac640 -1 osd.11 112 heartbeat_check: no reply from 172.21.15.172:6804 osd.2 since back 2024-09-12T02:50:22.950505+0000 front 2024-09-12T02:50:22.950558+0000 (oldest deadline 2024-09-12T02:50:48.850680+0000) 2024-09-12T02:50:57.949 INFO:journalctl@ceph.osd.7.smithi044.stdout:Sep 12 02:50:57 smithi044 ceph-4954ed46-70ae-11ef-bcea-c7b262605968-osd-7[52975]: 2024-09-12T02:50:57.675+0000 7fa72d8ab640 -1 osd.7 112 heartbeat_check: no reply from 172.21.15.44:6804 osd.1 since back 2024-09-12T02:50:16.881229+0000 front 2024-09-12T02:50:16.881275+0000 (oldest deadline 2024-09-12T02:50:41.581336+0000) 2024-09-12T02:50:57.949 INFO:journalctl@ceph.osd.7.smithi044.stdout:Sep 12 02:50:57 smithi044 ceph-4954ed46-70ae-11ef-bcea-c7b262605968-osd-7[52975]: 2024-09-12T02:50:57.675+0000 7fa72d8ab640 -1 osd.7 112 heartbeat_check: no reply from 172.21.15.172:6804 osd.2 since back 2024-09-12T02:50:25.682202+0000 front 2024-09-12T02:50:25.682302+0000 (oldest deadline 2024-09-12T02:50:46.782200+0000) 2024-09-12T02:50:57.949 INFO:journalctl@ceph.osd.7.smithi044.stdout:Sep 12 02:50:57 smithi044 ceph-4954ed46-70ae-11ef-bcea-c7b262605968-osd-7[52975]: 2024-09-12T02:50:57.675+0000 7fa72d8ab640 -1 osd.7 112 heartbeat_check: no reply from 172.21.15.39:6814 osd.3 since back 2024-09-12T02:50:32.083235+0000 front 2024-09-12T02:50:32.083253+0000 (oldest deadline 2024-09-12T02:50:56.183208+0000) 2024-09-12T02:50:57.949 INFO:journalctl@ceph.osd.10.smithi044.stdout:Sep 12 02:50:57 smithi044 ceph-4954ed46-70ae-11ef-bcea-c7b262605968-osd-10[59969]: 2024-09-12T02:50:57.642+0000 7faa46dc6640 -1 osd.10 112 heartbeat_check: no reply from 172.21.15.39:6806 osd.0 since back 2024-09-12T02:50:05.367150+0000 front 2024-09-12T02:50:05.367381+0000 (oldest deadline 2024-09-12T02:50:31.267058+0000) 2024-09-12T02:50:57.949 INFO:journalctl@ceph.osd.10.smithi044.stdout:Sep 12 02:50:57 smithi044 ceph-4954ed46-70ae-11ef-bcea-c7b262605968-osd-10[59969]: 2024-09-12T02:50:57.642+0000 7faa46dc6640 -1 osd.10 112 heartbeat_check: no reply from 172.21.15.44:6804 osd.1 since back 2024-09-12T02:50:17.969767+0000 front 2024-09-12T02:50:17.969892+0000 (oldest deadline 2024-09-12T02:50:40.270033+0000) 2024-09-12T02:50:57.949 INFO:journalctl@ceph.osd.10.smithi044.stdout:Sep 12 02:50:57 smithi044 ceph-4954ed46-70ae-11ef-bcea-c7b262605968-osd-10[59969]: 2024-09-12T02:50:57.642+0000 7faa46dc6640 -1 osd.10 112 heartbeat_check: no reply from 172.21.15.172:6804 osd.2 since back 2024-09-12T02:50:25.972029+0000 front 2024-09-12T02:50:25.972168+0000 (oldest deadline 2024-09-12T02:50:47.671992+0000) 2024-09-12T02:50:57.949 INFO:journalctl@ceph.osd.10.smithi044.stdout:Sep 12 02:50:57 smithi044 ceph-4954ed46-70ae-11ef-bcea-c7b262605968-osd-10[59969]: 2024-09-12T02:50:57.642+0000 7faa46dc6640 -1 osd.10 112 heartbeat_check: no reply from 172.21.15.39:6814 osd.3 since back 2024-09-12T02:50:31.673509+0000 front 2024-09-12T02:50:31.673612+0000 (oldest deadline 2024-09-12T02:50:56.973525+0000) 2024-09-12T02:50:58.350 INFO:journalctl@ceph.osd.6.smithi039.stdout:Sep 12 02:50:57 smithi039 ceph-4954ed46-70ae-11ef-bcea-c7b262605968-osd-6[57154]: 2024-09-12T02:50:57.909+0000 7fd24d600640 -1 osd.6 112 heartbeat_check: no reply from 172.21.15.44:6804 osd.1 since back 2024-09-12T02:50:16.719479+0000 front 2024-09-12T02:50:16.719575+0000 (oldest deadline 2024-09-12T02:50:42.619403+0000) 2024-09-12T02:50:58.350 INFO:journalctl@ceph.osd.6.smithi039.stdout:Sep 12 02:50:57 smithi039 ceph-4954ed46-70ae-11ef-bcea-c7b262605968-osd-6[57154]: 2024-09-12T02:50:57.909+0000 7fd24d600640 -1 osd.6 112 heartbeat_check: no reply from 172.21.15.172:6804 osd.2 since back 2024-09-12T02:50:26.021392+0000 front 2024-09-12T02:50:26.021171+0000 (oldest deadline 2024-09-12T02:50:47.720855+0000) 2024-09-12T02:50:58.350 INFO:journalctl@ceph.osd.6.smithi039.stdout:Sep 12 02:50:57 smithi039 ceph-4954ed46-70ae-11ef-bcea-c7b262605968-osd-6[57154]: 2024-09-12T02:50:57.909+0000 7fd24d600640 -1 osd.6 112 heartbeat_check: no reply from 172.21.15.39:6814 osd.3 since back 2024-09-12T02:50:33.522761+0000 front 2024-09-12T02:50:33.522861+0000 (oldest deadline 2024-09-12T02:50:55.822895+0000) 2024-09-12T02:50:58.350 INFO:journalctl@ceph.osd.9.smithi039.stdout:Sep 12 02:50:58 smithi039 ceph-4954ed46-70ae-11ef-bcea-c7b262605968-osd-9[63678]: 2024-09-12T02:50:58.115+0000 7f6d17a00640 -1 osd.9 112 heartbeat_check: no reply from 172.21.15.39:6806 osd.0 since back 2024-09-12T02:50:08.761527+0000 front 2024-09-12T02:50:08.761556+0000 (oldest deadline 2024-09-12T02:50:34.061510+0000) 2024-09-12T02:50:58.350 INFO:journalctl@ceph.osd.9.smithi039.stdout:Sep 12 02:50:58 smithi039 ceph-4954ed46-70ae-11ef-bcea-c7b262605968-osd-9[63678]: 2024-09-12T02:50:58.115+0000 7f6d17a00640 -1 osd.9 112 heartbeat_check: no reply from 172.21.15.44:6804 osd.1 since back 2024-09-12T02:50:14.062055+0000 front 2024-09-12T02:50:14.062119+0000 (oldest deadline 2024-09-12T02:50:38.761988+0000) 2024-09-12T02:50:58.350 INFO:journalctl@ceph.osd.9.smithi039.stdout:Sep 12 02:50:58 smithi039 ceph-4954ed46-70ae-11ef-bcea-c7b262605968-osd-9[63678]: 2024-09-12T02:50:58.115+0000 7f6d17a00640 -1 osd.9 112 heartbeat_check: no reply from 172.21.15.172:6804 osd.2 since back 2024-09-12T02:50:24.663318+0000 front 2024-09-12T02:50:24.663548+0000 (oldest deadline 2024-09-12T02:50:48.763108+0000) 2024-09-12T02:50:58.351 INFO:journalctl@ceph.osd.9.smithi039.stdout:Sep 12 02:50:58 smithi039 ceph-4954ed46-70ae-11ef-bcea-c7b262605968-osd-9[63678]: 2024-09-12T02:50:58.115+0000 7f6d17a00640 -1 osd.9 112 heartbeat_check: no reply from 172.21.15.39:6814 osd.3 since back 2024-09-12T02:50:33.464166+0000 front 2024-09-12T02:50:33.464108+0000 (oldest deadline 2024-09-12T02:50:55.164319+0000) 2024-09-12T02:50:58.764 INFO:journalctl@ceph.osd.8.smithi172.stdout:Sep 12 02:50:58 smithi172 ceph-4954ed46-70ae-11ef-bcea-c7b262605968-osd-8[54149]: 2024-09-12T02:50:58.284+0000 7f07cfc64640 -1 osd.8 112 heartbeat_check: no reply from 172.21.15.44:6804 osd.1 since back 2024-09-12T02:50:15.561581+0000 front 2024-09-12T02:50:15.561700+0000 (oldest deadline 2024-09-12T02:50:41.362274+0000) 2024-09-12T02:50:58.764 INFO:journalctl@ceph.osd.8.smithi172.stdout:Sep 12 02:50:58 smithi172 ceph-4954ed46-70ae-11ef-bcea-c7b262605968-osd-8[54149]: 2024-09-12T02:50:58.284+0000 7f07cfc64640 -1 osd.8 112 heartbeat_check: no reply from 172.21.15.172:6804 osd.2 since back 2024-09-12T02:50:26.063273+0000 front 2024-09-12T02:50:26.063310+0000 (oldest deadline 2024-09-12T02:50:49.563398+0000) 2024-09-12T02:50:58.764 INFO:journalctl@ceph.osd.8.smithi172.stdout:Sep 12 02:50:58 smithi172 ceph-4954ed46-70ae-11ef-bcea-c7b262605968-osd-8[54149]: 2024-09-12T02:50:58.284+0000 7f07cfc64640 -1 osd.8 112 heartbeat_check: no reply from 172.21.15.39:6814 osd.3 since back 2024-09-12T02:50:31.864441+0000 front 2024-09-12T02:50:31.864414+0000 (oldest deadline 2024-09-12T02:50:55.364332+0000) 2024-09-12T02:50:58.764 INFO:journalctl@ceph.osd.11.smithi172.stdout:Sep 12 02:50:58 smithi172 ceph-4954ed46-70ae-11ef-bcea-c7b262605968-osd-11[61129]: 2024-09-12T02:50:58.364+0000 7ff146fac640 -1 osd.11 112 heartbeat_check: no reply from 172.21.15.39:6806 osd.0 since back 2024-09-12T02:50:09.449223+0000 front 2024-09-12T02:50:09.449210+0000 (oldest deadline 2024-09-12T02:50:34.748980+0000) 2024-09-12T02:50:58.764 INFO:journalctl@ceph.osd.11.smithi172.stdout:Sep 12 02:50:58 smithi172 ceph-4954ed46-70ae-11ef-bcea-c7b262605968-osd-11[61129]: 2024-09-12T02:50:58.364+0000 7ff146fac640 -1 osd.11 112 heartbeat_check: no reply from 172.21.15.44:6804 osd.1 since back 2024-09-12T02:50:14.749696+0000 front 2024-09-12T02:50:14.749454+0000 (oldest deadline 2024-09-12T02:50:42.950102+0000) 2024-09-12T02:50:58.764 INFO:journalctl@ceph.osd.11.smithi172.stdout:Sep 12 02:50:58 smithi172 ceph-4954ed46-70ae-11ef-bcea-c7b262605968-osd-11[61129]: 2024-09-12T02:50:58.364+0000 7ff146fac640 -1 osd.11 112 heartbeat_check: no reply from 172.21.15.172:6804 osd.2 since back 2024-09-12T02:50:22.950505+0000 front 2024-09-12T02:50:22.950558+0000 (oldest deadline 2024-09-12T02:50:48.850680+0000) 2024-09-12T02:50:58.949 INFO:journalctl@ceph.osd.7.smithi044.stdout:Sep 12 02:50:58 smithi044 ceph-4954ed46-70ae-11ef-bcea-c7b262605968-osd-7[52975]: 2024-09-12T02:50:58.639+0000 7fa72d8ab640 -1 osd.7 112 heartbeat_check: no reply from 172.21.15.44:6804 osd.1 since back 2024-09-12T02:50:16.881229+0000 front 2024-09-12T02:50:16.881275+0000 (oldest deadline 2024-09-12T02:50:41.581336+0000) 2024-09-12T02:50:58.949 INFO:journalctl@ceph.osd.7.smithi044.stdout:Sep 12 02:50:58 smithi044 ceph-4954ed46-70ae-11ef-bcea-c7b262605968-osd-7[52975]: 2024-09-12T02:50:58.639+0000 7fa72d8ab640 -1 osd.7 112 heartbeat_check: no reply from 172.21.15.172:6804 osd.2 since back 2024-09-12T02:50:25.682202+0000 front 2024-09-12T02:50:25.682302+0000 (oldest deadline 2024-09-12T02:50:46.782200+0000) 2024-09-12T02:50:58.949 INFO:journalctl@ceph.osd.7.smithi044.stdout:Sep 12 02:50:58 smithi044 ceph-4954ed46-70ae-11ef-bcea-c7b262605968-osd-7[52975]: 2024-09-12T02:50:58.639+0000 7fa72d8ab640 -1 osd.7 112 heartbeat_check: no reply from 172.21.15.39:6814 osd.3 since back 2024-09-12T02:50:32.083235+0000 front 2024-09-12T02:50:32.083253+0000 (oldest deadline 2024-09-12T02:50:56.183208+0000) 2024-09-12T02:50:58.949 INFO:journalctl@ceph.osd.10.smithi044.stdout:Sep 12 02:50:58 smithi044 ceph-4954ed46-70ae-11ef-bcea-c7b262605968-osd-10[59969]: 2024-09-12T02:50:58.606+0000 7faa46dc6640 -1 osd.10 112 heartbeat_check: no reply from 172.21.15.39:6806 osd.0 since back 2024-09-12T02:50:05.367150+0000 front 2024-09-12T02:50:05.367381+0000 (oldest deadline 2024-09-12T02:50:31.267058+0000) 2024-09-12T02:50:58.949 INFO:journalctl@ceph.osd.10.smithi044.stdout:Sep 12 02:50:58 smithi044 ceph-4954ed46-70ae-11ef-bcea-c7b262605968-osd-10[59969]: 2024-09-12T02:50:58.606+0000 7faa46dc6640 -1 osd.10 112 heartbeat_check: no reply from 172.21.15.44:6804 osd.1 since back 2024-09-12T02:50:17.969767+0000 front 2024-09-12T02:50:17.969892+0000 (oldest deadline 2024-09-12T02:50:40.270033+0000) 2024-09-12T02:50:58.949 INFO:journalctl@ceph.osd.10.smithi044.stdout:Sep 12 02:50:58 smithi044 ceph-4954ed46-70ae-11ef-bcea-c7b262605968-osd-10[59969]: 2024-09-12T02:50:58.606+0000 7faa46dc6640 -1 osd.10 112 heartbeat_check: no reply from 172.21.15.172:6804 osd.2 since back 2024-09-12T02:50:25.972029+0000 front 2024-09-12T02:50:25.972168+0000 (oldest deadline 2024-09-12T02:50:47.671992+0000) 2024-09-12T02:50:58.949 INFO:journalctl@ceph.osd.10.smithi044.stdout:Sep 12 02:50:58 smithi044 ceph-4954ed46-70ae-11ef-bcea-c7b262605968-osd-10[59969]: 2024-09-12T02:50:58.606+0000 7faa46dc6640 -1 osd.10 112 heartbeat_check: no reply from 172.21.15.39:6814 osd.3 since back 2024-09-12T02:50:31.673509+0000 front 2024-09-12T02:50:31.673612+0000 (oldest deadline 2024-09-12T02:50:56.973525+0000) 2024-09-12T02:50:59.178 INFO:journalctl@ceph.osd.6.smithi039.stdout:Sep 12 02:50:58 smithi039 podman[91027]: 2024-09-12 02:50:58.879191452 +0000 UTC m=+5.595761737 container died 70820e943ccf07708ce812ff9e3963184d4f1872d7615396fe6e14f2bf79aa20 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:3be30d720e37ec4df7f667e60f22b4d221c4ce7b408e68b90f9ac10220535e66, name=ceph-4954ed46-70ae-11ef-bcea-c7b262605968-osd-6, org.label-schema.name=CentOS Stream 9 Base Image, maintainer=Guillaume Abrioux , GIT_CLEAN=True, org.label-schema.build-date=20240731, RELEASE=squid-b53b6d3, org.label-schema.schema-version=1.0, GIT_BRANCH=HEAD, ceph=True, io.buildah.version=1.37.2, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, CEPH_POINT_RELEASE=, org.label-schema.license=GPLv2, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.vendor=CentOS) 2024-09-12T02:50:59.178 INFO:journalctl@ceph.osd.9.smithi039.stdout:Sep 12 02:50:59 smithi039 ceph-4954ed46-70ae-11ef-bcea-c7b262605968-osd-9[63678]: 2024-09-12T02:50:59.076+0000 7f6d17a00640 -1 osd.9 112 heartbeat_check: no reply from 172.21.15.39:6806 osd.0 since back 2024-09-12T02:50:08.761527+0000 front 2024-09-12T02:50:08.761556+0000 (oldest deadline 2024-09-12T02:50:34.061510+0000) 2024-09-12T02:50:59.179 INFO:journalctl@ceph.osd.9.smithi039.stdout:Sep 12 02:50:59 smithi039 ceph-4954ed46-70ae-11ef-bcea-c7b262605968-osd-9[63678]: 2024-09-12T02:50:59.076+0000 7f6d17a00640 -1 osd.9 112 heartbeat_check: no reply from 172.21.15.44:6804 osd.1 since back 2024-09-12T02:50:14.062055+0000 front 2024-09-12T02:50:14.062119+0000 (oldest deadline 2024-09-12T02:50:38.761988+0000) 2024-09-12T02:50:59.179 INFO:journalctl@ceph.osd.9.smithi039.stdout:Sep 12 02:50:59 smithi039 ceph-4954ed46-70ae-11ef-bcea-c7b262605968-osd-9[63678]: 2024-09-12T02:50:59.076+0000 7f6d17a00640 -1 osd.9 112 heartbeat_check: no reply from 172.21.15.172:6804 osd.2 since back 2024-09-12T02:50:24.663318+0000 front 2024-09-12T02:50:24.663548+0000 (oldest deadline 2024-09-12T02:50:48.763108+0000) 2024-09-12T02:50:59.179 INFO:journalctl@ceph.osd.9.smithi039.stdout:Sep 12 02:50:59 smithi039 ceph-4954ed46-70ae-11ef-bcea-c7b262605968-osd-9[63678]: 2024-09-12T02:50:59.076+0000 7f6d17a00640 -1 osd.9 112 heartbeat_check: no reply from 172.21.15.39:6814 osd.3 since back 2024-09-12T02:50:33.464166+0000 front 2024-09-12T02:50:33.464108+0000 (oldest deadline 2024-09-12T02:50:55.164319+0000) 2024-09-12T02:50:59.595 INFO:journalctl@ceph.osd.6.smithi039.stdout:Sep 12 02:50:59 smithi039 podman[91027]: 2024-09-12 02:50:59.317909992 +0000 UTC m=+6.034480264 container cleanup 70820e943ccf07708ce812ff9e3963184d4f1872d7615396fe6e14f2bf79aa20 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:3be30d720e37ec4df7f667e60f22b4d221c4ce7b408e68b90f9ac10220535e66, name=ceph-4954ed46-70ae-11ef-bcea-c7b262605968-osd-6, org.label-schema.build-date=20240731, org.label-schema.vendor=CentOS, GIT_CLEAN=True, io.buildah.version=1.37.2, org.label-schema.schema-version=1.0, GIT_BRANCH=HEAD, maintainer=Guillaume Abrioux , org.label-schema.license=GPLv2, ceph=True, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.name=CentOS Stream 9 Base Image, GIT_REPO=git@github.com:ceph/ceph-container.git, RELEASE=squid-b53b6d3, CEPH_POINT_RELEASE=) 2024-09-12T02:50:59.596 INFO:journalctl@ceph.osd.6.smithi039.stdout:Sep 12 02:50:59 smithi039 bash[91027]: ceph-4954ed46-70ae-11ef-bcea-c7b262605968-osd-6 2024-09-12T02:50:59.764 INFO:journalctl@ceph.osd.8.smithi172.stdout:Sep 12 02:50:59 smithi172 ceph-4954ed46-70ae-11ef-bcea-c7b262605968-osd-8[54149]: 2024-09-12T02:50:59.299+0000 7f07cfc64640 -1 osd.8 112 heartbeat_check: no reply from 172.21.15.44:6804 osd.1 since back 2024-09-12T02:50:15.561581+0000 front 2024-09-12T02:50:15.561700+0000 (oldest deadline 2024-09-12T02:50:41.362274+0000) 2024-09-12T02:50:59.764 INFO:journalctl@ceph.osd.8.smithi172.stdout:Sep 12 02:50:59 smithi172 ceph-4954ed46-70ae-11ef-bcea-c7b262605968-osd-8[54149]: 2024-09-12T02:50:59.299+0000 7f07cfc64640 -1 osd.8 112 heartbeat_check: no reply from 172.21.15.172:6804 osd.2 since back 2024-09-12T02:50:26.063273+0000 front 2024-09-12T02:50:26.063310+0000 (oldest deadline 2024-09-12T02:50:49.563398+0000) 2024-09-12T02:50:59.764 INFO:journalctl@ceph.osd.8.smithi172.stdout:Sep 12 02:50:59 smithi172 ceph-4954ed46-70ae-11ef-bcea-c7b262605968-osd-8[54149]: 2024-09-12T02:50:59.299+0000 7f07cfc64640 -1 osd.8 112 heartbeat_check: no reply from 172.21.15.39:6814 osd.3 since back 2024-09-12T02:50:31.864441+0000 front 2024-09-12T02:50:31.864414+0000 (oldest deadline 2024-09-12T02:50:55.364332+0000) 2024-09-12T02:50:59.764 INFO:journalctl@ceph.osd.11.smithi172.stdout:Sep 12 02:50:59 smithi172 ceph-4954ed46-70ae-11ef-bcea-c7b262605968-osd-11[61129]: 2024-09-12T02:50:59.339+0000 7ff146fac640 -1 osd.11 112 heartbeat_check: no reply from 172.21.15.39:6806 osd.0 since back 2024-09-12T02:50:09.449223+0000 front 2024-09-12T02:50:09.449210+0000 (oldest deadline 2024-09-12T02:50:34.748980+0000) 2024-09-12T02:50:59.764 INFO:journalctl@ceph.osd.11.smithi172.stdout:Sep 12 02:50:59 smithi172 ceph-4954ed46-70ae-11ef-bcea-c7b262605968-osd-11[61129]: 2024-09-12T02:50:59.339+0000 7ff146fac640 -1 osd.11 112 heartbeat_check: no reply from 172.21.15.44:6804 osd.1 since back 2024-09-12T02:50:14.749696+0000 front 2024-09-12T02:50:14.749454+0000 (oldest deadline 2024-09-12T02:50:42.950102+0000) 2024-09-12T02:50:59.765 INFO:journalctl@ceph.osd.11.smithi172.stdout:Sep 12 02:50:59 smithi172 ceph-4954ed46-70ae-11ef-bcea-c7b262605968-osd-11[61129]: 2024-09-12T02:50:59.339+0000 7ff146fac640 -1 osd.11 112 heartbeat_check: no reply from 172.21.15.172:6804 osd.2 since back 2024-09-12T02:50:22.950505+0000 front 2024-09-12T02:50:22.950558+0000 (oldest deadline 2024-09-12T02:50:48.850680+0000) 2024-09-12T02:50:59.849 INFO:journalctl@ceph.osd.6.smithi039.stdout:Sep 12 02:50:59 smithi039 podman[91043]: 2024-09-12 02:50:59.594814038 +0000 UTC m=+0.703193231 container remove 70820e943ccf07708ce812ff9e3963184d4f1872d7615396fe6e14f2bf79aa20 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:3be30d720e37ec4df7f667e60f22b4d221c4ce7b408e68b90f9ac10220535e66, name=ceph-4954ed46-70ae-11ef-bcea-c7b262605968-osd-6, RELEASE=squid-b53b6d3, org.label-schema.build-date=20240731, io.buildah.version=1.37.2, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.name=CentOS Stream 9 Base Image, CEPH_POINT_RELEASE=, org.label-schema.vendor=CentOS, org.label-schema.license=GPLv2, GIT_BRANCH=HEAD, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.schema-version=1.0, GIT_CLEAN=True, maintainer=Guillaume Abrioux , ceph=True) 2024-09-12T02:50:59.948 INFO:journalctl@ceph.osd.7.smithi044.stdout:Sep 12 02:50:59 smithi044 ceph-4954ed46-70ae-11ef-bcea-c7b262605968-osd-7[52975]: 2024-09-12T02:50:59.669+0000 7fa72d8ab640 -1 osd.7 112 heartbeat_check: no reply from 172.21.15.44:6804 osd.1 since back 2024-09-12T02:50:16.881229+0000 front 2024-09-12T02:50:16.881275+0000 (oldest deadline 2024-09-12T02:50:41.581336+0000) 2024-09-12T02:50:59.949 INFO:journalctl@ceph.osd.7.smithi044.stdout:Sep 12 02:50:59 smithi044 ceph-4954ed46-70ae-11ef-bcea-c7b262605968-osd-7[52975]: 2024-09-12T02:50:59.669+0000 7fa72d8ab640 -1 osd.7 112 heartbeat_check: no reply from 172.21.15.172:6804 osd.2 since back 2024-09-12T02:50:25.682202+0000 front 2024-09-12T02:50:25.682302+0000 (oldest deadline 2024-09-12T02:50:46.782200+0000) 2024-09-12T02:50:59.949 INFO:journalctl@ceph.osd.7.smithi044.stdout:Sep 12 02:50:59 smithi044 ceph-4954ed46-70ae-11ef-bcea-c7b262605968-osd-7[52975]: 2024-09-12T02:50:59.669+0000 7fa72d8ab640 -1 osd.7 112 heartbeat_check: no reply from 172.21.15.39:6814 osd.3 since back 2024-09-12T02:50:32.083235+0000 front 2024-09-12T02:50:32.083253+0000 (oldest deadline 2024-09-12T02:50:56.183208+0000) 2024-09-12T02:50:59.949 INFO:journalctl@ceph.osd.10.smithi044.stdout:Sep 12 02:50:59 smithi044 ceph-4954ed46-70ae-11ef-bcea-c7b262605968-osd-10[59969]: 2024-09-12T02:50:59.641+0000 7faa46dc6640 -1 osd.10 112 heartbeat_check: no reply from 172.21.15.39:6806 osd.0 since back 2024-09-12T02:50:05.367150+0000 front 2024-09-12T02:50:05.367381+0000 (oldest deadline 2024-09-12T02:50:31.267058+0000) 2024-09-12T02:50:59.949 INFO:journalctl@ceph.osd.10.smithi044.stdout:Sep 12 02:50:59 smithi044 ceph-4954ed46-70ae-11ef-bcea-c7b262605968-osd-10[59969]: 2024-09-12T02:50:59.641+0000 7faa46dc6640 -1 osd.10 112 heartbeat_check: no reply from 172.21.15.44:6804 osd.1 since back 2024-09-12T02:50:17.969767+0000 front 2024-09-12T02:50:17.969892+0000 (oldest deadline 2024-09-12T02:50:40.270033+0000) 2024-09-12T02:50:59.949 INFO:journalctl@ceph.osd.10.smithi044.stdout:Sep 12 02:50:59 smithi044 ceph-4954ed46-70ae-11ef-bcea-c7b262605968-osd-10[59969]: 2024-09-12T02:50:59.641+0000 7faa46dc6640 -1 osd.10 112 heartbeat_check: no reply from 172.21.15.172:6804 osd.2 since back 2024-09-12T02:50:25.972029+0000 front 2024-09-12T02:50:25.972168+0000 (oldest deadline 2024-09-12T02:50:47.671992+0000) 2024-09-12T02:50:59.949 INFO:journalctl@ceph.osd.10.smithi044.stdout:Sep 12 02:50:59 smithi044 ceph-4954ed46-70ae-11ef-bcea-c7b262605968-osd-10[59969]: 2024-09-12T02:50:59.641+0000 7faa46dc6640 -1 osd.10 112 heartbeat_check: no reply from 172.21.15.39:6814 osd.3 since back 2024-09-12T02:50:31.673509+0000 front 2024-09-12T02:50:31.673612+0000 (oldest deadline 2024-09-12T02:50:56.973525+0000) 2024-09-12T02:51:00.466 INFO:journalctl@ceph.osd.6.smithi039.stdout:Sep 12 02:51:00 smithi039 podman[91131]: 2024-09-12 02:51:00.051616674 +0000 UTC m=+0.027479498 image pull 54467abc55f864c4f73dfaf9c6ac3bb3e87b773123d5badaf790bee57321d594 quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:3be30d720e37ec4df7f667e60f22b4d221c4ce7b408e68b90f9ac10220535e66 2024-09-12T02:51:00.466 INFO:journalctl@ceph.osd.6.smithi039.stdout:Sep 12 02:51:00 smithi039 podman[91131]: 2024-09-12 02:51:00.312301313 +0000 UTC m=+0.288164115 container create c327deebded30cab915ad0ce3f9dc7c70c29b931d192da8dbe8150ee3f0fb0fb (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:3be30d720e37ec4df7f667e60f22b4d221c4ce7b408e68b90f9ac10220535e66, name=ceph-4954ed46-70ae-11ef-bcea-c7b262605968-osd-6-deactivate, org.label-schema.build-date=20240731, maintainer=Guillaume Abrioux , io.buildah.version=1.37.2, RELEASE=squid-b53b6d3, GIT_CLEAN=True, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, ceph=True, org.label-schema.vendor=CentOS, CEPH_POINT_RELEASE=, GIT_BRANCH=HEAD, org.label-schema.schema-version=1.0, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.license=GPLv2) 2024-09-12T02:51:00.466 INFO:journalctl@ceph.osd.9.smithi039.stdout:Sep 12 02:51:00 smithi039 ceph-4954ed46-70ae-11ef-bcea-c7b262605968-osd-9[63678]: 2024-09-12T02:51:00.119+0000 7f6d17a00640 -1 osd.9 112 heartbeat_check: no reply from 172.21.15.39:6806 osd.0 since back 2024-09-12T02:50:08.761527+0000 front 2024-09-12T02:50:08.761556+0000 (oldest deadline 2024-09-12T02:50:34.061510+0000) 2024-09-12T02:51:00.467 INFO:journalctl@ceph.osd.9.smithi039.stdout:Sep 12 02:51:00 smithi039 ceph-4954ed46-70ae-11ef-bcea-c7b262605968-osd-9[63678]: 2024-09-12T02:51:00.119+0000 7f6d17a00640 -1 osd.9 112 heartbeat_check: no reply from 172.21.15.44:6804 osd.1 since back 2024-09-12T02:50:14.062055+0000 front 2024-09-12T02:50:14.062119+0000 (oldest deadline 2024-09-12T02:50:38.761988+0000) 2024-09-12T02:51:00.467 INFO:journalctl@ceph.osd.9.smithi039.stdout:Sep 12 02:51:00 smithi039 ceph-4954ed46-70ae-11ef-bcea-c7b262605968-osd-9[63678]: 2024-09-12T02:51:00.119+0000 7f6d17a00640 -1 osd.9 112 heartbeat_check: no reply from 172.21.15.172:6804 osd.2 since back 2024-09-12T02:50:24.663318+0000 front 2024-09-12T02:50:24.663548+0000 (oldest deadline 2024-09-12T02:50:48.763108+0000) 2024-09-12T02:51:00.467 INFO:journalctl@ceph.osd.9.smithi039.stdout:Sep 12 02:51:00 smithi039 ceph-4954ed46-70ae-11ef-bcea-c7b262605968-osd-9[63678]: 2024-09-12T02:51:00.119+0000 7f6d17a00640 -1 osd.9 112 heartbeat_check: no reply from 172.21.15.39:6814 osd.3 since back 2024-09-12T02:50:33.464166+0000 front 2024-09-12T02:50:33.464108+0000 (oldest deadline 2024-09-12T02:50:55.164319+0000) 2024-09-12T02:51:00.764 INFO:journalctl@ceph.osd.8.smithi172.stdout:Sep 12 02:51:00 smithi172 ceph-4954ed46-70ae-11ef-bcea-c7b262605968-osd-8[54149]: 2024-09-12T02:51:00.324+0000 7f07cfc64640 -1 osd.8 112 heartbeat_check: no reply from 172.21.15.44:6804 osd.1 since back 2024-09-12T02:50:15.561581+0000 front 2024-09-12T02:50:15.561700+0000 (oldest deadline 2024-09-12T02:50:41.362274+0000) 2024-09-12T02:51:00.764 INFO:journalctl@ceph.osd.8.smithi172.stdout:Sep 12 02:51:00 smithi172 ceph-4954ed46-70ae-11ef-bcea-c7b262605968-osd-8[54149]: 2024-09-12T02:51:00.324+0000 7f07cfc64640 -1 osd.8 112 heartbeat_check: no reply from 172.21.15.172:6804 osd.2 since back 2024-09-12T02:50:26.063273+0000 front 2024-09-12T02:50:26.063310+0000 (oldest deadline 2024-09-12T02:50:49.563398+0000) 2024-09-12T02:51:00.764 INFO:journalctl@ceph.osd.8.smithi172.stdout:Sep 12 02:51:00 smithi172 ceph-4954ed46-70ae-11ef-bcea-c7b262605968-osd-8[54149]: 2024-09-12T02:51:00.324+0000 7f07cfc64640 -1 osd.8 112 heartbeat_check: no reply from 172.21.15.39:6814 osd.3 since back 2024-09-12T02:50:31.864441+0000 front 2024-09-12T02:50:31.864414+0000 (oldest deadline 2024-09-12T02:50:55.364332+0000) 2024-09-12T02:51:00.764 INFO:journalctl@ceph.osd.11.smithi172.stdout:Sep 12 02:51:00 smithi172 ceph-4954ed46-70ae-11ef-bcea-c7b262605968-osd-11[61129]: 2024-09-12T02:51:00.384+0000 7ff146fac640 -1 osd.11 112 heartbeat_check: no reply from 172.21.15.39:6806 osd.0 since back 2024-09-12T02:50:09.449223+0000 front 2024-09-12T02:50:09.449210+0000 (oldest deadline 2024-09-12T02:50:34.748980+0000) 2024-09-12T02:51:00.764 INFO:journalctl@ceph.osd.11.smithi172.stdout:Sep 12 02:51:00 smithi172 ceph-4954ed46-70ae-11ef-bcea-c7b262605968-osd-11[61129]: 2024-09-12T02:51:00.384+0000 7ff146fac640 -1 osd.11 112 heartbeat_check: no reply from 172.21.15.44:6804 osd.1 since back 2024-09-12T02:50:14.749696+0000 front 2024-09-12T02:50:14.749454+0000 (oldest deadline 2024-09-12T02:50:42.950102+0000) 2024-09-12T02:51:00.764 INFO:journalctl@ceph.osd.11.smithi172.stdout:Sep 12 02:51:00 smithi172 ceph-4954ed46-70ae-11ef-bcea-c7b262605968-osd-11[61129]: 2024-09-12T02:51:00.384+0000 7ff146fac640 -1 osd.11 112 heartbeat_check: no reply from 172.21.15.172:6804 osd.2 since back 2024-09-12T02:50:22.950505+0000 front 2024-09-12T02:50:22.950558+0000 (oldest deadline 2024-09-12T02:50:48.850680+0000) 2024-09-12T02:51:00.849 INFO:journalctl@ceph.osd.6.smithi039.stdout:Sep 12 02:51:00 smithi039 podman[91131]: 2024-09-12 02:51:00.581551575 +0000 UTC m=+0.557414390 container init c327deebded30cab915ad0ce3f9dc7c70c29b931d192da8dbe8150ee3f0fb0fb (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:3be30d720e37ec4df7f667e60f22b4d221c4ce7b408e68b90f9ac10220535e66, name=ceph-4954ed46-70ae-11ef-bcea-c7b262605968-osd-6-deactivate, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.build-date=20240731, org.label-schema.vendor=CentOS, org.label-schema.name=CentOS Stream 9 Base Image, GIT_BRANCH=HEAD, org.label-schema.license=GPLv2, RELEASE=squid-b53b6d3, maintainer=Guillaume Abrioux , CEPH_POINT_RELEASE=, org.label-schema.schema-version=1.0, io.buildah.version=1.37.2, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, GIT_CLEAN=True, ceph=True) 2024-09-12T02:51:00.850 INFO:journalctl@ceph.osd.6.smithi039.stdout:Sep 12 02:51:00 smithi039 podman[91131]: 2024-09-12 02:51:00.588342222 +0000 UTC m=+0.564205031 container start c327deebded30cab915ad0ce3f9dc7c70c29b931d192da8dbe8150ee3f0fb0fb (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:3be30d720e37ec4df7f667e60f22b4d221c4ce7b408e68b90f9ac10220535e66, name=ceph-4954ed46-70ae-11ef-bcea-c7b262605968-osd-6-deactivate, maintainer=Guillaume Abrioux , org.label-schema.license=GPLv2, org.label-schema.vendor=CentOS, org.label-schema.build-date=20240731, org.label-schema.name=CentOS Stream 9 Base Image, GIT_BRANCH=HEAD, GIT_REPO=git@github.com:ceph/ceph-container.git, RELEASE=squid-b53b6d3, GIT_CLEAN=True, CEPH_POINT_RELEASE=, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, io.buildah.version=1.37.2, org.label-schema.schema-version=1.0, ceph=True) 2024-09-12T02:51:00.850 INFO:journalctl@ceph.osd.6.smithi039.stdout:Sep 12 02:51:00 smithi039 podman[91131]: 2024-09-12 02:51:00.664650268 +0000 UTC m=+0.640513084 container attach c327deebded30cab915ad0ce3f9dc7c70c29b931d192da8dbe8150ee3f0fb0fb (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:3be30d720e37ec4df7f667e60f22b4d221c4ce7b408e68b90f9ac10220535e66, name=ceph-4954ed46-70ae-11ef-bcea-c7b262605968-osd-6-deactivate, GIT_CLEAN=True, CEPH_POINT_RELEASE=, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.license=GPLv2, io.buildah.version=1.37.2, org.label-schema.vendor=CentOS, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.name=CentOS Stream 9 Base Image, RELEASE=squid-b53b6d3, GIT_BRANCH=HEAD, ceph=True, org.label-schema.build-date=20240731, maintainer=Guillaume Abrioux , org.label-schema.schema-version=1.0) 2024-09-12T02:51:00.949 INFO:journalctl@ceph.osd.7.smithi044.stdout:Sep 12 02:51:00 smithi044 ceph-4954ed46-70ae-11ef-bcea-c7b262605968-osd-7[52975]: 2024-09-12T02:51:00.710+0000 7fa72d8ab640 -1 osd.7 112 heartbeat_check: no reply from 172.21.15.44:6804 osd.1 since back 2024-09-12T02:50:16.881229+0000 front 2024-09-12T02:50:16.881275+0000 (oldest deadline 2024-09-12T02:50:41.581336+0000) 2024-09-12T02:51:00.949 INFO:journalctl@ceph.osd.7.smithi044.stdout:Sep 12 02:51:00 smithi044 ceph-4954ed46-70ae-11ef-bcea-c7b262605968-osd-7[52975]: 2024-09-12T02:51:00.710+0000 7fa72d8ab640 -1 osd.7 112 heartbeat_check: no reply from 172.21.15.172:6804 osd.2 since back 2024-09-12T02:50:25.682202+0000 front 2024-09-12T02:50:25.682302+0000 (oldest deadline 2024-09-12T02:50:46.782200+0000) 2024-09-12T02:51:00.949 INFO:journalctl@ceph.osd.7.smithi044.stdout:Sep 12 02:51:00 smithi044 ceph-4954ed46-70ae-11ef-bcea-c7b262605968-osd-7[52975]: 2024-09-12T02:51:00.710+0000 7fa72d8ab640 -1 osd.7 112 heartbeat_check: no reply from 172.21.15.39:6814 osd.3 since back 2024-09-12T02:50:32.083235+0000 front 2024-09-12T02:50:32.083253+0000 (oldest deadline 2024-09-12T02:50:56.183208+0000) 2024-09-12T02:51:00.949 INFO:journalctl@ceph.osd.10.smithi044.stdout:Sep 12 02:51:00 smithi044 ceph-4954ed46-70ae-11ef-bcea-c7b262605968-osd-10[59969]: 2024-09-12T02:51:00.672+0000 7faa46dc6640 -1 osd.10 112 heartbeat_check: no reply from 172.21.15.39:6806 osd.0 since back 2024-09-12T02:50:05.367150+0000 front 2024-09-12T02:50:05.367381+0000 (oldest deadline 2024-09-12T02:50:31.267058+0000) 2024-09-12T02:51:00.949 INFO:journalctl@ceph.osd.10.smithi044.stdout:Sep 12 02:51:00 smithi044 ceph-4954ed46-70ae-11ef-bcea-c7b262605968-osd-10[59969]: 2024-09-12T02:51:00.672+0000 7faa46dc6640 -1 osd.10 112 heartbeat_check: no reply from 172.21.15.44:6804 osd.1 since back 2024-09-12T02:50:17.969767+0000 front 2024-09-12T02:50:17.969892+0000 (oldest deadline 2024-09-12T02:50:40.270033+0000) 2024-09-12T02:51:00.949 INFO:journalctl@ceph.osd.10.smithi044.stdout:Sep 12 02:51:00 smithi044 ceph-4954ed46-70ae-11ef-bcea-c7b262605968-osd-10[59969]: 2024-09-12T02:51:00.672+0000 7faa46dc6640 -1 osd.10 112 heartbeat_check: no reply from 172.21.15.172:6804 osd.2 since back 2024-09-12T02:50:25.972029+0000 front 2024-09-12T02:50:25.972168+0000 (oldest deadline 2024-09-12T02:50:47.671992+0000) 2024-09-12T02:51:00.950 INFO:journalctl@ceph.osd.10.smithi044.stdout:Sep 12 02:51:00 smithi044 ceph-4954ed46-70ae-11ef-bcea-c7b262605968-osd-10[59969]: 2024-09-12T02:51:00.672+0000 7faa46dc6640 -1 osd.10 112 heartbeat_check: no reply from 172.21.15.39:6814 osd.3 since back 2024-09-12T02:50:31.673509+0000 front 2024-09-12T02:50:31.673612+0000 (oldest deadline 2024-09-12T02:50:56.973525+0000) 2024-09-12T02:51:01.175 INFO:journalctl@ceph.osd.6.smithi039.stdout:Sep 12 02:51:00 smithi039 podman[91131]: 2024-09-12 02:51:00.851916935 +0000 UTC m=+0.827779738 container died c327deebded30cab915ad0ce3f9dc7c70c29b931d192da8dbe8150ee3f0fb0fb (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:3be30d720e37ec4df7f667e60f22b4d221c4ce7b408e68b90f9ac10220535e66, name=ceph-4954ed46-70ae-11ef-bcea-c7b262605968-osd-6-deactivate, RELEASE=squid-b53b6d3, CEPH_POINT_RELEASE=, GIT_BRANCH=HEAD, io.buildah.version=1.37.2, org.label-schema.build-date=20240731, org.label-schema.vendor=CentOS, ceph=True, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.name=CentOS Stream 9 Base Image, maintainer=Guillaume Abrioux , org.label-schema.license=GPLv2, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, GIT_CLEAN=True, org.label-schema.schema-version=1.0) 2024-09-12T02:51:01.176 INFO:journalctl@ceph.osd.9.smithi039.stdout:Sep 12 02:51:01 smithi039 ceph-4954ed46-70ae-11ef-bcea-c7b262605968-osd-9[63678]: 2024-09-12T02:51:01.078+0000 7f6d17a00640 -1 osd.9 112 heartbeat_check: no reply from 172.21.15.39:6806 osd.0 since back 2024-09-12T02:50:08.761527+0000 front 2024-09-12T02:50:08.761556+0000 (oldest deadline 2024-09-12T02:50:34.061510+0000) 2024-09-12T02:51:01.176 INFO:journalctl@ceph.osd.9.smithi039.stdout:Sep 12 02:51:01 smithi039 ceph-4954ed46-70ae-11ef-bcea-c7b262605968-osd-9[63678]: 2024-09-12T02:51:01.078+0000 7f6d17a00640 -1 osd.9 112 heartbeat_check: no reply from 172.21.15.44:6804 osd.1 since back 2024-09-12T02:50:14.062055+0000 front 2024-09-12T02:50:14.062119+0000 (oldest deadline 2024-09-12T02:50:38.761988+0000) 2024-09-12T02:51:01.176 INFO:journalctl@ceph.osd.9.smithi039.stdout:Sep 12 02:51:01 smithi039 ceph-4954ed46-70ae-11ef-bcea-c7b262605968-osd-9[63678]: 2024-09-12T02:51:01.078+0000 7f6d17a00640 -1 osd.9 112 heartbeat_check: no reply from 172.21.15.172:6804 osd.2 since back 2024-09-12T02:50:24.663318+0000 front 2024-09-12T02:50:24.663548+0000 (oldest deadline 2024-09-12T02:50:48.763108+0000) 2024-09-12T02:51:01.176 INFO:journalctl@ceph.osd.9.smithi039.stdout:Sep 12 02:51:01 smithi039 ceph-4954ed46-70ae-11ef-bcea-c7b262605968-osd-9[63678]: 2024-09-12T02:51:01.078+0000 7f6d17a00640 -1 osd.9 112 heartbeat_check: no reply from 172.21.15.39:6814 osd.3 since back 2024-09-12T02:50:33.464166+0000 front 2024-09-12T02:50:33.464108+0000 (oldest deadline 2024-09-12T02:50:55.164319+0000) 2024-09-12T02:51:01.547 DEBUG:teuthology.orchestra.run.smithi039:> sudo pkill -f 'journalctl -f -n 0 -u ceph-4954ed46-70ae-11ef-bcea-c7b262605968@osd.6.service' 2024-09-12T02:51:01.622 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-09-12T02:51:01.623 INFO:tasks.cephadm.osd.6:Stopped osd.6 2024-09-12T02:51:01.623 INFO:tasks.cephadm.osd.7:Stopping osd.7... 2024-09-12T02:51:01.623 DEBUG:teuthology.orchestra.run.smithi044:> sudo systemctl stop ceph-4954ed46-70ae-11ef-bcea-c7b262605968@osd.7 2024-09-12T02:51:01.764 INFO:journalctl@ceph.osd.8.smithi172.stdout:Sep 12 02:51:01 smithi172 ceph-4954ed46-70ae-11ef-bcea-c7b262605968-osd-8[54149]: 2024-09-12T02:51:01.364+0000 7f07cfc64640 -1 osd.8 112 heartbeat_check: no reply from 172.21.15.44:6804 osd.1 since back 2024-09-12T02:50:15.561581+0000 front 2024-09-12T02:50:15.561700+0000 (oldest deadline 2024-09-12T02:50:41.362274+0000) 2024-09-12T02:51:01.764 INFO:journalctl@ceph.osd.8.smithi172.stdout:Sep 12 02:51:01 smithi172 ceph-4954ed46-70ae-11ef-bcea-c7b262605968-osd-8[54149]: 2024-09-12T02:51:01.364+0000 7f07cfc64640 -1 osd.8 112 heartbeat_check: no reply from 172.21.15.172:6804 osd.2 since back 2024-09-12T02:50:26.063273+0000 front 2024-09-12T02:50:26.063310+0000 (oldest deadline 2024-09-12T02:50:49.563398+0000) 2024-09-12T02:51:01.764 INFO:journalctl@ceph.osd.8.smithi172.stdout:Sep 12 02:51:01 smithi172 ceph-4954ed46-70ae-11ef-bcea-c7b262605968-osd-8[54149]: 2024-09-12T02:51:01.364+0000 7f07cfc64640 -1 osd.8 112 heartbeat_check: no reply from 172.21.15.39:6814 osd.3 since back 2024-09-12T02:50:31.864441+0000 front 2024-09-12T02:50:31.864414+0000 (oldest deadline 2024-09-12T02:50:55.364332+0000) 2024-09-12T02:51:01.764 INFO:journalctl@ceph.osd.11.smithi172.stdout:Sep 12 02:51:01 smithi172 ceph-4954ed46-70ae-11ef-bcea-c7b262605968-osd-11[61129]: 2024-09-12T02:51:01.403+0000 7ff146fac640 -1 osd.11 112 heartbeat_check: no reply from 172.21.15.39:6806 osd.0 since back 2024-09-12T02:50:09.449223+0000 front 2024-09-12T02:50:09.449210+0000 (oldest deadline 2024-09-12T02:50:34.748980+0000) 2024-09-12T02:51:01.764 INFO:journalctl@ceph.osd.11.smithi172.stdout:Sep 12 02:51:01 smithi172 ceph-4954ed46-70ae-11ef-bcea-c7b262605968-osd-11[61129]: 2024-09-12T02:51:01.403+0000 7ff146fac640 -1 osd.11 112 heartbeat_check: no reply from 172.21.15.44:6804 osd.1 since back 2024-09-12T02:50:14.749696+0000 front 2024-09-12T02:50:14.749454+0000 (oldest deadline 2024-09-12T02:50:42.950102+0000) 2024-09-12T02:51:01.764 INFO:journalctl@ceph.osd.11.smithi172.stdout:Sep 12 02:51:01 smithi172 ceph-4954ed46-70ae-11ef-bcea-c7b262605968-osd-11[61129]: 2024-09-12T02:51:01.403+0000 7ff146fac640 -1 osd.11 112 heartbeat_check: no reply from 172.21.15.172:6804 osd.2 since back 2024-09-12T02:50:22.950505+0000 front 2024-09-12T02:50:22.950558+0000 (oldest deadline 2024-09-12T02:50:48.850680+0000) 2024-09-12T02:51:01.941 INFO:journalctl@ceph.osd.7.smithi044.stdout:Sep 12 02:51:01 smithi044 systemd[1]: Stopping Ceph osd.7 for 4954ed46-70ae-11ef-bcea-c7b262605968... 2024-09-12T02:51:01.941 INFO:journalctl@ceph.osd.7.smithi044.stdout:Sep 12 02:51:01 smithi044 ceph-4954ed46-70ae-11ef-bcea-c7b262605968-osd-7[52975]: 2024-09-12T02:51:01.682+0000 7fa72d8ab640 -1 osd.7 112 heartbeat_check: no reply from 172.21.15.44:6804 osd.1 since back 2024-09-12T02:50:16.881229+0000 front 2024-09-12T02:50:16.881275+0000 (oldest deadline 2024-09-12T02:50:41.581336+0000) 2024-09-12T02:51:01.941 INFO:journalctl@ceph.osd.7.smithi044.stdout:Sep 12 02:51:01 smithi044 ceph-4954ed46-70ae-11ef-bcea-c7b262605968-osd-7[52975]: 2024-09-12T02:51:01.682+0000 7fa72d8ab640 -1 osd.7 112 heartbeat_check: no reply from 172.21.15.172:6804 osd.2 since back 2024-09-12T02:50:25.682202+0000 front 2024-09-12T02:50:25.682302+0000 (oldest deadline 2024-09-12T02:50:46.782200+0000) 2024-09-12T02:51:01.941 INFO:journalctl@ceph.osd.7.smithi044.stdout:Sep 12 02:51:01 smithi044 ceph-4954ed46-70ae-11ef-bcea-c7b262605968-osd-7[52975]: 2024-09-12T02:51:01.682+0000 7fa72d8ab640 -1 osd.7 112 heartbeat_check: no reply from 172.21.15.39:6814 osd.3 since back 2024-09-12T02:50:32.083235+0000 front 2024-09-12T02:50:32.083253+0000 (oldest deadline 2024-09-12T02:50:56.183208+0000) 2024-09-12T02:51:01.941 INFO:journalctl@ceph.osd.10.smithi044.stdout:Sep 12 02:51:01 smithi044 ceph-4954ed46-70ae-11ef-bcea-c7b262605968-osd-10[59969]: 2024-09-12T02:51:01.623+0000 7faa46dc6640 -1 osd.10 112 heartbeat_check: no reply from 172.21.15.39:6806 osd.0 since back 2024-09-12T02:50:05.367150+0000 front 2024-09-12T02:50:05.367381+0000 (oldest deadline 2024-09-12T02:50:31.267058+0000) 2024-09-12T02:51:01.942 INFO:journalctl@ceph.osd.10.smithi044.stdout:Sep 12 02:51:01 smithi044 ceph-4954ed46-70ae-11ef-bcea-c7b262605968-osd-10[59969]: 2024-09-12T02:51:01.623+0000 7faa46dc6640 -1 osd.10 112 heartbeat_check: no reply from 172.21.15.44:6804 osd.1 since back 2024-09-12T02:50:17.969767+0000 front 2024-09-12T02:50:17.969892+0000 (oldest deadline 2024-09-12T02:50:40.270033+0000) 2024-09-12T02:51:01.942 INFO:journalctl@ceph.osd.10.smithi044.stdout:Sep 12 02:51:01 smithi044 ceph-4954ed46-70ae-11ef-bcea-c7b262605968-osd-10[59969]: 2024-09-12T02:51:01.623+0000 7faa46dc6640 -1 osd.10 112 heartbeat_check: no reply from 172.21.15.172:6804 osd.2 since back 2024-09-12T02:50:25.972029+0000 front 2024-09-12T02:50:25.972168+0000 (oldest deadline 2024-09-12T02:50:47.671992+0000) 2024-09-12T02:51:01.942 INFO:journalctl@ceph.osd.10.smithi044.stdout:Sep 12 02:51:01 smithi044 ceph-4954ed46-70ae-11ef-bcea-c7b262605968-osd-10[59969]: 2024-09-12T02:51:01.623+0000 7faa46dc6640 -1 osd.10 112 heartbeat_check: no reply from 172.21.15.39:6814 osd.3 since back 2024-09-12T02:50:31.673509+0000 front 2024-09-12T02:50:31.673612+0000 (oldest deadline 2024-09-12T02:50:56.973525+0000) 2024-09-12T02:51:02.198 INFO:journalctl@ceph.osd.7.smithi044.stdout:Sep 12 02:51:01 smithi044 ceph-4954ed46-70ae-11ef-bcea-c7b262605968-osd-7[52975]: 2024-09-12T02:51:01.940+0000 7fa731295640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-osd -n osd.7 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-09-12T02:51:02.199 INFO:journalctl@ceph.osd.7.smithi044.stdout:Sep 12 02:51:01 smithi044 ceph-4954ed46-70ae-11ef-bcea-c7b262605968-osd-7[52975]: 2024-09-12T02:51:01.940+0000 7fa731295640 -1 osd.7 112 *** Got signal Terminated *** 2024-09-12T02:51:02.199 INFO:journalctl@ceph.osd.7.smithi044.stdout:Sep 12 02:51:01 smithi044 ceph-4954ed46-70ae-11ef-bcea-c7b262605968-osd-7[52975]: 2024-09-12T02:51:01.940+0000 7fa731295640 -1 osd.7 112 *** Immediate shutdown (osd_fast_shutdown=true) *** 2024-09-12T02:51:02.350 INFO:journalctl@ceph.osd.9.smithi039.stdout:Sep 12 02:51:02 smithi039 ceph-4954ed46-70ae-11ef-bcea-c7b262605968-osd-9[63678]: 2024-09-12T02:51:02.046+0000 7f6d17a00640 -1 osd.9 112 heartbeat_check: no reply from 172.21.15.39:6806 osd.0 since back 2024-09-12T02:50:08.761527+0000 front 2024-09-12T02:50:08.761556+0000 (oldest deadline 2024-09-12T02:50:34.061510+0000) 2024-09-12T02:51:02.350 INFO:journalctl@ceph.osd.9.smithi039.stdout:Sep 12 02:51:02 smithi039 ceph-4954ed46-70ae-11ef-bcea-c7b262605968-osd-9[63678]: 2024-09-12T02:51:02.046+0000 7f6d17a00640 -1 osd.9 112 heartbeat_check: no reply from 172.21.15.44:6804 osd.1 since back 2024-09-12T02:50:14.062055+0000 front 2024-09-12T02:50:14.062119+0000 (oldest deadline 2024-09-12T02:50:38.761988+0000) 2024-09-12T02:51:02.350 INFO:journalctl@ceph.osd.9.smithi039.stdout:Sep 12 02:51:02 smithi039 ceph-4954ed46-70ae-11ef-bcea-c7b262605968-osd-9[63678]: 2024-09-12T02:51:02.046+0000 7f6d17a00640 -1 osd.9 112 heartbeat_check: no reply from 172.21.15.172:6804 osd.2 since back 2024-09-12T02:50:24.663318+0000 front 2024-09-12T02:50:24.663548+0000 (oldest deadline 2024-09-12T02:50:48.763108+0000) 2024-09-12T02:51:02.350 INFO:journalctl@ceph.osd.9.smithi039.stdout:Sep 12 02:51:02 smithi039 ceph-4954ed46-70ae-11ef-bcea-c7b262605968-osd-9[63678]: 2024-09-12T02:51:02.046+0000 7f6d17a00640 -1 osd.9 112 heartbeat_check: no reply from 172.21.15.39:6814 osd.3 since back 2024-09-12T02:50:33.464166+0000 front 2024-09-12T02:50:33.464108+0000 (oldest deadline 2024-09-12T02:50:55.164319+0000) 2024-09-12T02:51:02.764 INFO:journalctl@ceph.osd.8.smithi172.stdout:Sep 12 02:51:02 smithi172 ceph-4954ed46-70ae-11ef-bcea-c7b262605968-osd-8[54149]: 2024-09-12T02:51:02.364+0000 7f07cfc64640 -1 osd.8 112 heartbeat_check: no reply from 172.21.15.44:6804 osd.1 since back 2024-09-12T02:50:15.561581+0000 front 2024-09-12T02:50:15.561700+0000 (oldest deadline 2024-09-12T02:50:41.362274+0000) 2024-09-12T02:51:02.764 INFO:journalctl@ceph.osd.8.smithi172.stdout:Sep 12 02:51:02 smithi172 ceph-4954ed46-70ae-11ef-bcea-c7b262605968-osd-8[54149]: 2024-09-12T02:51:02.364+0000 7f07cfc64640 -1 osd.8 112 heartbeat_check: no reply from 172.21.15.172:6804 osd.2 since back 2024-09-12T02:50:26.063273+0000 front 2024-09-12T02:50:26.063310+0000 (oldest deadline 2024-09-12T02:50:49.563398+0000) 2024-09-12T02:51:02.764 INFO:journalctl@ceph.osd.8.smithi172.stdout:Sep 12 02:51:02 smithi172 ceph-4954ed46-70ae-11ef-bcea-c7b262605968-osd-8[54149]: 2024-09-12T02:51:02.364+0000 7f07cfc64640 -1 osd.8 112 heartbeat_check: no reply from 172.21.15.39:6814 osd.3 since back 2024-09-12T02:50:31.864441+0000 front 2024-09-12T02:50:31.864414+0000 (oldest deadline 2024-09-12T02:50:55.364332+0000) 2024-09-12T02:51:02.764 INFO:journalctl@ceph.osd.11.smithi172.stdout:Sep 12 02:51:02 smithi172 ceph-4954ed46-70ae-11ef-bcea-c7b262605968-osd-11[61129]: 2024-09-12T02:51:02.362+0000 7ff146fac640 -1 osd.11 112 heartbeat_check: no reply from 172.21.15.39:6806 osd.0 since back 2024-09-12T02:50:09.449223+0000 front 2024-09-12T02:50:09.449210+0000 (oldest deadline 2024-09-12T02:50:34.748980+0000) 2024-09-12T02:51:02.764 INFO:journalctl@ceph.osd.11.smithi172.stdout:Sep 12 02:51:02 smithi172 ceph-4954ed46-70ae-11ef-bcea-c7b262605968-osd-11[61129]: 2024-09-12T02:51:02.362+0000 7ff146fac640 -1 osd.11 112 heartbeat_check: no reply from 172.21.15.44:6804 osd.1 since back 2024-09-12T02:50:14.749696+0000 front 2024-09-12T02:50:14.749454+0000 (oldest deadline 2024-09-12T02:50:42.950102+0000) 2024-09-12T02:51:02.764 INFO:journalctl@ceph.osd.11.smithi172.stdout:Sep 12 02:51:02 smithi172 ceph-4954ed46-70ae-11ef-bcea-c7b262605968-osd-11[61129]: 2024-09-12T02:51:02.362+0000 7ff146fac640 -1 osd.11 112 heartbeat_check: no reply from 172.21.15.172:6804 osd.2 since back 2024-09-12T02:50:22.950505+0000 front 2024-09-12T02:50:22.950558+0000 (oldest deadline 2024-09-12T02:50:48.850680+0000) 2024-09-12T02:51:02.949 INFO:journalctl@ceph.osd.7.smithi044.stdout:Sep 12 02:51:02 smithi044 ceph-4954ed46-70ae-11ef-bcea-c7b262605968-osd-7[52975]: 2024-09-12T02:51:02.675+0000 7fa72d8ab640 -1 osd.7 112 heartbeat_check: no reply from 172.21.15.44:6804 osd.1 since back 2024-09-12T02:50:16.881229+0000 front 2024-09-12T02:50:16.881275+0000 (oldest deadline 2024-09-12T02:50:41.581336+0000) 2024-09-12T02:51:02.949 INFO:journalctl@ceph.osd.7.smithi044.stdout:Sep 12 02:51:02 smithi044 ceph-4954ed46-70ae-11ef-bcea-c7b262605968-osd-7[52975]: 2024-09-12T02:51:02.675+0000 7fa72d8ab640 -1 osd.7 112 heartbeat_check: no reply from 172.21.15.172:6804 osd.2 since back 2024-09-12T02:50:25.682202+0000 front 2024-09-12T02:50:25.682302+0000 (oldest deadline 2024-09-12T02:50:46.782200+0000) 2024-09-12T02:51:02.949 INFO:journalctl@ceph.osd.7.smithi044.stdout:Sep 12 02:51:02 smithi044 ceph-4954ed46-70ae-11ef-bcea-c7b262605968-osd-7[52975]: 2024-09-12T02:51:02.675+0000 7fa72d8ab640 -1 osd.7 112 heartbeat_check: no reply from 172.21.15.39:6814 osd.3 since back 2024-09-12T02:50:32.083235+0000 front 2024-09-12T02:50:32.083253+0000 (oldest deadline 2024-09-12T02:50:56.183208+0000) 2024-09-12T02:51:02.949 INFO:journalctl@ceph.osd.10.smithi044.stdout:Sep 12 02:51:02 smithi044 ceph-4954ed46-70ae-11ef-bcea-c7b262605968-osd-10[59969]: 2024-09-12T02:51:02.664+0000 7faa46dc6640 -1 osd.10 112 heartbeat_check: no reply from 172.21.15.39:6806 osd.0 since back 2024-09-12T02:50:05.367150+0000 front 2024-09-12T02:50:05.367381+0000 (oldest deadline 2024-09-12T02:50:31.267058+0000) 2024-09-12T02:51:02.949 INFO:journalctl@ceph.osd.10.smithi044.stdout:Sep 12 02:51:02 smithi044 ceph-4954ed46-70ae-11ef-bcea-c7b262605968-osd-10[59969]: 2024-09-12T02:51:02.664+0000 7faa46dc6640 -1 osd.10 112 heartbeat_check: no reply from 172.21.15.44:6804 osd.1 since back 2024-09-12T02:50:17.969767+0000 front 2024-09-12T02:50:17.969892+0000 (oldest deadline 2024-09-12T02:50:40.270033+0000) 2024-09-12T02:51:02.949 INFO:journalctl@ceph.osd.10.smithi044.stdout:Sep 12 02:51:02 smithi044 ceph-4954ed46-70ae-11ef-bcea-c7b262605968-osd-10[59969]: 2024-09-12T02:51:02.664+0000 7faa46dc6640 -1 osd.10 112 heartbeat_check: no reply from 172.21.15.172:6804 osd.2 since back 2024-09-12T02:50:25.972029+0000 front 2024-09-12T02:50:25.972168+0000 (oldest deadline 2024-09-12T02:50:47.671992+0000) 2024-09-12T02:51:02.949 INFO:journalctl@ceph.osd.10.smithi044.stdout:Sep 12 02:51:02 smithi044 ceph-4954ed46-70ae-11ef-bcea-c7b262605968-osd-10[59969]: 2024-09-12T02:51:02.664+0000 7faa46dc6640 -1 osd.10 112 heartbeat_check: no reply from 172.21.15.39:6814 osd.3 since back 2024-09-12T02:50:31.673509+0000 front 2024-09-12T02:50:31.673612+0000 (oldest deadline 2024-09-12T02:50:56.973525+0000) 2024-09-12T02:51:03.349 INFO:journalctl@ceph.osd.9.smithi039.stdout:Sep 12 02:51:03 smithi039 ceph-4954ed46-70ae-11ef-bcea-c7b262605968-osd-9[63678]: 2024-09-12T02:51:03.091+0000 7f6d17a00640 -1 osd.9 112 heartbeat_check: no reply from 172.21.15.39:6806 osd.0 since back 2024-09-12T02:50:08.761527+0000 front 2024-09-12T02:50:08.761556+0000 (oldest deadline 2024-09-12T02:50:34.061510+0000) 2024-09-12T02:51:03.350 INFO:journalctl@ceph.osd.9.smithi039.stdout:Sep 12 02:51:03 smithi039 ceph-4954ed46-70ae-11ef-bcea-c7b262605968-osd-9[63678]: 2024-09-12T02:51:03.091+0000 7f6d17a00640 -1 osd.9 112 heartbeat_check: no reply from 172.21.15.44:6804 osd.1 since back 2024-09-12T02:50:14.062055+0000 front 2024-09-12T02:50:14.062119+0000 (oldest deadline 2024-09-12T02:50:38.761988+0000) 2024-09-12T02:51:03.350 INFO:journalctl@ceph.osd.9.smithi039.stdout:Sep 12 02:51:03 smithi039 ceph-4954ed46-70ae-11ef-bcea-c7b262605968-osd-9[63678]: 2024-09-12T02:51:03.091+0000 7f6d17a00640 -1 osd.9 112 heartbeat_check: no reply from 172.21.15.172:6804 osd.2 since back 2024-09-12T02:50:24.663318+0000 front 2024-09-12T02:50:24.663548+0000 (oldest deadline 2024-09-12T02:50:48.763108+0000) 2024-09-12T02:51:03.350 INFO:journalctl@ceph.osd.9.smithi039.stdout:Sep 12 02:51:03 smithi039 ceph-4954ed46-70ae-11ef-bcea-c7b262605968-osd-9[63678]: 2024-09-12T02:51:03.091+0000 7f6d17a00640 -1 osd.9 112 heartbeat_check: no reply from 172.21.15.39:6814 osd.3 since back 2024-09-12T02:50:33.464166+0000 front 2024-09-12T02:50:33.464108+0000 (oldest deadline 2024-09-12T02:50:55.164319+0000) 2024-09-12T02:51:03.764 INFO:journalctl@ceph.osd.8.smithi172.stdout:Sep 12 02:51:03 smithi172 ceph-4954ed46-70ae-11ef-bcea-c7b262605968-osd-8[54149]: 2024-09-12T02:51:03.352+0000 7f07cfc64640 -1 osd.8 112 heartbeat_check: no reply from 172.21.15.44:6804 osd.1 since back 2024-09-12T02:50:15.561581+0000 front 2024-09-12T02:50:15.561700+0000 (oldest deadline 2024-09-12T02:50:41.362274+0000) 2024-09-12T02:51:03.764 INFO:journalctl@ceph.osd.8.smithi172.stdout:Sep 12 02:51:03 smithi172 ceph-4954ed46-70ae-11ef-bcea-c7b262605968-osd-8[54149]: 2024-09-12T02:51:03.352+0000 7f07cfc64640 -1 osd.8 112 heartbeat_check: no reply from 172.21.15.172:6804 osd.2 since back 2024-09-12T02:50:26.063273+0000 front 2024-09-12T02:50:26.063310+0000 (oldest deadline 2024-09-12T02:50:49.563398+0000) 2024-09-12T02:51:03.764 INFO:journalctl@ceph.osd.8.smithi172.stdout:Sep 12 02:51:03 smithi172 ceph-4954ed46-70ae-11ef-bcea-c7b262605968-osd-8[54149]: 2024-09-12T02:51:03.352+0000 7f07cfc64640 -1 osd.8 112 heartbeat_check: no reply from 172.21.15.39:6814 osd.3 since back 2024-09-12T02:50:31.864441+0000 front 2024-09-12T02:50:31.864414+0000 (oldest deadline 2024-09-12T02:50:55.364332+0000) 2024-09-12T02:51:03.764 INFO:journalctl@ceph.osd.11.smithi172.stdout:Sep 12 02:51:03 smithi172 ceph-4954ed46-70ae-11ef-bcea-c7b262605968-osd-11[61129]: 2024-09-12T02:51:03.317+0000 7ff146fac640 -1 osd.11 112 heartbeat_check: no reply from 172.21.15.39:6806 osd.0 since back 2024-09-12T02:50:09.449223+0000 front 2024-09-12T02:50:09.449210+0000 (oldest deadline 2024-09-12T02:50:34.748980+0000) 2024-09-12T02:51:03.764 INFO:journalctl@ceph.osd.11.smithi172.stdout:Sep 12 02:51:03 smithi172 ceph-4954ed46-70ae-11ef-bcea-c7b262605968-osd-11[61129]: 2024-09-12T02:51:03.317+0000 7ff146fac640 -1 osd.11 112 heartbeat_check: no reply from 172.21.15.44:6804 osd.1 since back 2024-09-12T02:50:14.749696+0000 front 2024-09-12T02:50:14.749454+0000 (oldest deadline 2024-09-12T02:50:42.950102+0000) 2024-09-12T02:51:03.764 INFO:journalctl@ceph.osd.11.smithi172.stdout:Sep 12 02:51:03 smithi172 ceph-4954ed46-70ae-11ef-bcea-c7b262605968-osd-11[61129]: 2024-09-12T02:51:03.317+0000 7ff146fac640 -1 osd.11 112 heartbeat_check: no reply from 172.21.15.172:6804 osd.2 since back 2024-09-12T02:50:22.950505+0000 front 2024-09-12T02:50:22.950558+0000 (oldest deadline 2024-09-12T02:50:48.850680+0000) 2024-09-12T02:51:03.949 INFO:journalctl@ceph.osd.7.smithi044.stdout:Sep 12 02:51:03 smithi044 ceph-4954ed46-70ae-11ef-bcea-c7b262605968-osd-7[52975]: 2024-09-12T02:51:03.638+0000 7fa72d8ab640 -1 osd.7 112 heartbeat_check: no reply from 172.21.15.44:6804 osd.1 since back 2024-09-12T02:50:16.881229+0000 front 2024-09-12T02:50:16.881275+0000 (oldest deadline 2024-09-12T02:50:41.581336+0000) 2024-09-12T02:51:03.949 INFO:journalctl@ceph.osd.7.smithi044.stdout:Sep 12 02:51:03 smithi044 ceph-4954ed46-70ae-11ef-bcea-c7b262605968-osd-7[52975]: 2024-09-12T02:51:03.638+0000 7fa72d8ab640 -1 osd.7 112 heartbeat_check: no reply from 172.21.15.172:6804 osd.2 since back 2024-09-12T02:50:25.682202+0000 front 2024-09-12T02:50:25.682302+0000 (oldest deadline 2024-09-12T02:50:46.782200+0000) 2024-09-12T02:51:03.949 INFO:journalctl@ceph.osd.7.smithi044.stdout:Sep 12 02:51:03 smithi044 ceph-4954ed46-70ae-11ef-bcea-c7b262605968-osd-7[52975]: 2024-09-12T02:51:03.638+0000 7fa72d8ab640 -1 osd.7 112 heartbeat_check: no reply from 172.21.15.39:6814 osd.3 since back 2024-09-12T02:50:32.083235+0000 front 2024-09-12T02:50:32.083253+0000 (oldest deadline 2024-09-12T02:50:56.183208+0000) 2024-09-12T02:51:03.949 INFO:journalctl@ceph.osd.10.smithi044.stdout:Sep 12 02:51:03 smithi044 ceph-4954ed46-70ae-11ef-bcea-c7b262605968-osd-10[59969]: 2024-09-12T02:51:03.626+0000 7faa46dc6640 -1 osd.10 112 heartbeat_check: no reply from 172.21.15.39:6806 osd.0 since back 2024-09-12T02:50:05.367150+0000 front 2024-09-12T02:50:05.367381+0000 (oldest deadline 2024-09-12T02:50:31.267058+0000) 2024-09-12T02:51:03.949 INFO:journalctl@ceph.osd.10.smithi044.stdout:Sep 12 02:51:03 smithi044 ceph-4954ed46-70ae-11ef-bcea-c7b262605968-osd-10[59969]: 2024-09-12T02:51:03.626+0000 7faa46dc6640 -1 osd.10 112 heartbeat_check: no reply from 172.21.15.44:6804 osd.1 since back 2024-09-12T02:50:17.969767+0000 front 2024-09-12T02:50:17.969892+0000 (oldest deadline 2024-09-12T02:50:40.270033+0000) 2024-09-12T02:51:03.949 INFO:journalctl@ceph.osd.10.smithi044.stdout:Sep 12 02:51:03 smithi044 ceph-4954ed46-70ae-11ef-bcea-c7b262605968-osd-10[59969]: 2024-09-12T02:51:03.626+0000 7faa46dc6640 -1 osd.10 112 heartbeat_check: no reply from 172.21.15.172:6804 osd.2 since back 2024-09-12T02:50:25.972029+0000 front 2024-09-12T02:50:25.972168+0000 (oldest deadline 2024-09-12T02:50:47.671992+0000) 2024-09-12T02:51:03.949 INFO:journalctl@ceph.osd.10.smithi044.stdout:Sep 12 02:51:03 smithi044 ceph-4954ed46-70ae-11ef-bcea-c7b262605968-osd-10[59969]: 2024-09-12T02:51:03.626+0000 7faa46dc6640 -1 osd.10 112 heartbeat_check: no reply from 172.21.15.39:6814 osd.3 since back 2024-09-12T02:50:31.673509+0000 front 2024-09-12T02:50:31.673612+0000 (oldest deadline 2024-09-12T02:50:56.973525+0000) 2024-09-12T02:51:04.600 INFO:journalctl@ceph.osd.9.smithi039.stdout:Sep 12 02:51:04 smithi039 ceph-4954ed46-70ae-11ef-bcea-c7b262605968-osd-9[63678]: 2024-09-12T02:51:04.128+0000 7f6d17a00640 -1 osd.9 112 heartbeat_check: no reply from 172.21.15.39:6806 osd.0 since back 2024-09-12T02:50:08.761527+0000 front 2024-09-12T02:50:08.761556+0000 (oldest deadline 2024-09-12T02:50:34.061510+0000) 2024-09-12T02:51:04.600 INFO:journalctl@ceph.osd.9.smithi039.stdout:Sep 12 02:51:04 smithi039 ceph-4954ed46-70ae-11ef-bcea-c7b262605968-osd-9[63678]: 2024-09-12T02:51:04.128+0000 7f6d17a00640 -1 osd.9 112 heartbeat_check: no reply from 172.21.15.44:6804 osd.1 since back 2024-09-12T02:50:14.062055+0000 front 2024-09-12T02:50:14.062119+0000 (oldest deadline 2024-09-12T02:50:38.761988+0000) 2024-09-12T02:51:04.600 INFO:journalctl@ceph.osd.9.smithi039.stdout:Sep 12 02:51:04 smithi039 ceph-4954ed46-70ae-11ef-bcea-c7b262605968-osd-9[63678]: 2024-09-12T02:51:04.128+0000 7f6d17a00640 -1 osd.9 112 heartbeat_check: no reply from 172.21.15.172:6804 osd.2 since back 2024-09-12T02:50:24.663318+0000 front 2024-09-12T02:50:24.663548+0000 (oldest deadline 2024-09-12T02:50:48.763108+0000) 2024-09-12T02:51:04.600 INFO:journalctl@ceph.osd.9.smithi039.stdout:Sep 12 02:51:04 smithi039 ceph-4954ed46-70ae-11ef-bcea-c7b262605968-osd-9[63678]: 2024-09-12T02:51:04.128+0000 7f6d17a00640 -1 osd.9 112 heartbeat_check: no reply from 172.21.15.39:6814 osd.3 since back 2024-09-12T02:50:33.464166+0000 front 2024-09-12T02:50:33.464108+0000 (oldest deadline 2024-09-12T02:50:55.164319+0000) 2024-09-12T02:51:04.764 INFO:journalctl@ceph.osd.8.smithi172.stdout:Sep 12 02:51:04 smithi172 ceph-4954ed46-70ae-11ef-bcea-c7b262605968-osd-8[54149]: 2024-09-12T02:51:04.344+0000 7f07cfc64640 -1 osd.8 112 heartbeat_check: no reply from 172.21.15.44:6804 osd.1 since back 2024-09-12T02:50:15.561581+0000 front 2024-09-12T02:50:15.561700+0000 (oldest deadline 2024-09-12T02:50:41.362274+0000) 2024-09-12T02:51:04.764 INFO:journalctl@ceph.osd.8.smithi172.stdout:Sep 12 02:51:04 smithi172 ceph-4954ed46-70ae-11ef-bcea-c7b262605968-osd-8[54149]: 2024-09-12T02:51:04.344+0000 7f07cfc64640 -1 osd.8 112 heartbeat_check: no reply from 172.21.15.172:6804 osd.2 since back 2024-09-12T02:50:26.063273+0000 front 2024-09-12T02:50:26.063310+0000 (oldest deadline 2024-09-12T02:50:49.563398+0000) 2024-09-12T02:51:04.764 INFO:journalctl@ceph.osd.8.smithi172.stdout:Sep 12 02:51:04 smithi172 ceph-4954ed46-70ae-11ef-bcea-c7b262605968-osd-8[54149]: 2024-09-12T02:51:04.344+0000 7f07cfc64640 -1 osd.8 112 heartbeat_check: no reply from 172.21.15.39:6814 osd.3 since back 2024-09-12T02:50:31.864441+0000 front 2024-09-12T02:50:31.864414+0000 (oldest deadline 2024-09-12T02:50:55.364332+0000) 2024-09-12T02:51:04.764 INFO:journalctl@ceph.osd.11.smithi172.stdout:Sep 12 02:51:04 smithi172 ceph-4954ed46-70ae-11ef-bcea-c7b262605968-osd-11[61129]: 2024-09-12T02:51:04.321+0000 7ff146fac640 -1 osd.11 112 heartbeat_check: no reply from 172.21.15.39:6806 osd.0 since back 2024-09-12T02:50:09.449223+0000 front 2024-09-12T02:50:09.449210+0000 (oldest deadline 2024-09-12T02:50:34.748980+0000) 2024-09-12T02:51:04.764 INFO:journalctl@ceph.osd.11.smithi172.stdout:Sep 12 02:51:04 smithi172 ceph-4954ed46-70ae-11ef-bcea-c7b262605968-osd-11[61129]: 2024-09-12T02:51:04.321+0000 7ff146fac640 -1 osd.11 112 heartbeat_check: no reply from 172.21.15.44:6804 osd.1 since back 2024-09-12T02:50:14.749696+0000 front 2024-09-12T02:50:14.749454+0000 (oldest deadline 2024-09-12T02:50:42.950102+0000) 2024-09-12T02:51:04.764 INFO:journalctl@ceph.osd.11.smithi172.stdout:Sep 12 02:51:04 smithi172 ceph-4954ed46-70ae-11ef-bcea-c7b262605968-osd-11[61129]: 2024-09-12T02:51:04.321+0000 7ff146fac640 -1 osd.11 112 heartbeat_check: no reply from 172.21.15.172:6804 osd.2 since back 2024-09-12T02:50:22.950505+0000 front 2024-09-12T02:50:22.950558+0000 (oldest deadline 2024-09-12T02:50:48.850680+0000) 2024-09-12T02:51:04.948 INFO:journalctl@ceph.osd.7.smithi044.stdout:Sep 12 02:51:04 smithi044 ceph-4954ed46-70ae-11ef-bcea-c7b262605968-osd-7[52975]: 2024-09-12T02:51:04.603+0000 7fa72d8ab640 -1 osd.7 112 heartbeat_check: no reply from 172.21.15.44:6804 osd.1 since back 2024-09-12T02:50:16.881229+0000 front 2024-09-12T02:50:16.881275+0000 (oldest deadline 2024-09-12T02:50:41.581336+0000) 2024-09-12T02:51:04.949 INFO:journalctl@ceph.osd.7.smithi044.stdout:Sep 12 02:51:04 smithi044 ceph-4954ed46-70ae-11ef-bcea-c7b262605968-osd-7[52975]: 2024-09-12T02:51:04.603+0000 7fa72d8ab640 -1 osd.7 112 heartbeat_check: no reply from 172.21.15.172:6804 osd.2 since back 2024-09-12T02:50:25.682202+0000 front 2024-09-12T02:50:25.682302+0000 (oldest deadline 2024-09-12T02:50:46.782200+0000) 2024-09-12T02:51:04.949 INFO:journalctl@ceph.osd.7.smithi044.stdout:Sep 12 02:51:04 smithi044 ceph-4954ed46-70ae-11ef-bcea-c7b262605968-osd-7[52975]: 2024-09-12T02:51:04.603+0000 7fa72d8ab640 -1 osd.7 112 heartbeat_check: no reply from 172.21.15.39:6814 osd.3 since back 2024-09-12T02:50:32.083235+0000 front 2024-09-12T02:50:32.083253+0000 (oldest deadline 2024-09-12T02:50:56.183208+0000) 2024-09-12T02:51:04.949 INFO:journalctl@ceph.osd.10.smithi044.stdout:Sep 12 02:51:04 smithi044 ceph-4954ed46-70ae-11ef-bcea-c7b262605968-osd-10[59969]: 2024-09-12T02:51:04.625+0000 7faa46dc6640 -1 osd.10 112 heartbeat_check: no reply from 172.21.15.39:6806 osd.0 since back 2024-09-12T02:50:05.367150+0000 front 2024-09-12T02:50:05.367381+0000 (oldest deadline 2024-09-12T02:50:31.267058+0000) 2024-09-12T02:51:04.949 INFO:journalctl@ceph.osd.10.smithi044.stdout:Sep 12 02:51:04 smithi044 ceph-4954ed46-70ae-11ef-bcea-c7b262605968-osd-10[59969]: 2024-09-12T02:51:04.625+0000 7faa46dc6640 -1 osd.10 112 heartbeat_check: no reply from 172.21.15.44:6804 osd.1 since back 2024-09-12T02:50:17.969767+0000 front 2024-09-12T02:50:17.969892+0000 (oldest deadline 2024-09-12T02:50:40.270033+0000) 2024-09-12T02:51:04.949 INFO:journalctl@ceph.osd.10.smithi044.stdout:Sep 12 02:51:04 smithi044 ceph-4954ed46-70ae-11ef-bcea-c7b262605968-osd-10[59969]: 2024-09-12T02:51:04.625+0000 7faa46dc6640 -1 osd.10 112 heartbeat_check: no reply from 172.21.15.172:6804 osd.2 since back 2024-09-12T02:50:25.972029+0000 front 2024-09-12T02:50:25.972168+0000 (oldest deadline 2024-09-12T02:50:47.671992+0000) 2024-09-12T02:51:04.949 INFO:journalctl@ceph.osd.10.smithi044.stdout:Sep 12 02:51:04 smithi044 ceph-4954ed46-70ae-11ef-bcea-c7b262605968-osd-10[59969]: 2024-09-12T02:51:04.625+0000 7faa46dc6640 -1 osd.10 112 heartbeat_check: no reply from 172.21.15.39:6814 osd.3 since back 2024-09-12T02:50:31.673509+0000 front 2024-09-12T02:50:31.673612+0000 (oldest deadline 2024-09-12T02:50:56.973525+0000) 2024-09-12T02:51:05.599 INFO:journalctl@ceph.osd.9.smithi039.stdout:Sep 12 02:51:05 smithi039 ceph-4954ed46-70ae-11ef-bcea-c7b262605968-osd-9[63678]: 2024-09-12T02:51:05.143+0000 7f6d17a00640 -1 osd.9 112 heartbeat_check: no reply from 172.21.15.39:6806 osd.0 since back 2024-09-12T02:50:08.761527+0000 front 2024-09-12T02:50:08.761556+0000 (oldest deadline 2024-09-12T02:50:34.061510+0000) 2024-09-12T02:51:05.600 INFO:journalctl@ceph.osd.9.smithi039.stdout:Sep 12 02:51:05 smithi039 ceph-4954ed46-70ae-11ef-bcea-c7b262605968-osd-9[63678]: 2024-09-12T02:51:05.143+0000 7f6d17a00640 -1 osd.9 112 heartbeat_check: no reply from 172.21.15.44:6804 osd.1 since back 2024-09-12T02:50:14.062055+0000 front 2024-09-12T02:50:14.062119+0000 (oldest deadline 2024-09-12T02:50:38.761988+0000) 2024-09-12T02:51:05.600 INFO:journalctl@ceph.osd.9.smithi039.stdout:Sep 12 02:51:05 smithi039 ceph-4954ed46-70ae-11ef-bcea-c7b262605968-osd-9[63678]: 2024-09-12T02:51:05.143+0000 7f6d17a00640 -1 osd.9 112 heartbeat_check: no reply from 172.21.15.172:6804 osd.2 since back 2024-09-12T02:50:24.663318+0000 front 2024-09-12T02:50:24.663548+0000 (oldest deadline 2024-09-12T02:50:48.763108+0000) 2024-09-12T02:51:05.600 INFO:journalctl@ceph.osd.9.smithi039.stdout:Sep 12 02:51:05 smithi039 ceph-4954ed46-70ae-11ef-bcea-c7b262605968-osd-9[63678]: 2024-09-12T02:51:05.143+0000 7f6d17a00640 -1 osd.9 112 heartbeat_check: no reply from 172.21.15.39:6814 osd.3 since back 2024-09-12T02:50:33.464166+0000 front 2024-09-12T02:50:33.464108+0000 (oldest deadline 2024-09-12T02:50:55.164319+0000) 2024-09-12T02:51:05.600 INFO:journalctl@ceph.osd.9.smithi039.stdout:Sep 12 02:51:05 smithi039 ceph-4954ed46-70ae-11ef-bcea-c7b262605968-osd-9[63678]: 2024-09-12T02:51:05.143+0000 7f6d17a00640 -1 osd.9 112 heartbeat_check: no reply from 172.21.15.44:6812 osd.4 since back 2024-09-12T02:50:41.566107+0000 front 2024-09-12T02:50:41.565926+0000 (oldest deadline 2024-09-12T02:51:05.065942+0000) 2024-09-12T02:51:05.763 INFO:journalctl@ceph.osd.8.smithi172.stdout:Sep 12 02:51:05 smithi172 ceph-4954ed46-70ae-11ef-bcea-c7b262605968-osd-8[54149]: 2024-09-12T02:51:05.388+0000 7f07cfc64640 -1 osd.8 112 heartbeat_check: no reply from 172.21.15.44:6804 osd.1 since back 2024-09-12T02:50:15.561581+0000 front 2024-09-12T02:50:15.561700+0000 (oldest deadline 2024-09-12T02:50:41.362274+0000) 2024-09-12T02:51:05.764 INFO:journalctl@ceph.osd.8.smithi172.stdout:Sep 12 02:51:05 smithi172 ceph-4954ed46-70ae-11ef-bcea-c7b262605968-osd-8[54149]: 2024-09-12T02:51:05.388+0000 7f07cfc64640 -1 osd.8 112 heartbeat_check: no reply from 172.21.15.172:6804 osd.2 since back 2024-09-12T02:50:26.063273+0000 front 2024-09-12T02:50:26.063310+0000 (oldest deadline 2024-09-12T02:50:49.563398+0000) 2024-09-12T02:51:05.764 INFO:journalctl@ceph.osd.8.smithi172.stdout:Sep 12 02:51:05 smithi172 ceph-4954ed46-70ae-11ef-bcea-c7b262605968-osd-8[54149]: 2024-09-12T02:51:05.388+0000 7f07cfc64640 -1 osd.8 112 heartbeat_check: no reply from 172.21.15.39:6814 osd.3 since back 2024-09-12T02:50:31.864441+0000 front 2024-09-12T02:50:31.864414+0000 (oldest deadline 2024-09-12T02:50:55.364332+0000) 2024-09-12T02:51:05.764 INFO:journalctl@ceph.osd.11.smithi172.stdout:Sep 12 02:51:05 smithi172 ceph-4954ed46-70ae-11ef-bcea-c7b262605968-osd-11[61129]: 2024-09-12T02:51:05.275+0000 7ff146fac640 -1 osd.11 112 heartbeat_check: no reply from 172.21.15.39:6806 osd.0 since back 2024-09-12T02:50:09.449223+0000 front 2024-09-12T02:50:09.449210+0000 (oldest deadline 2024-09-12T02:50:34.748980+0000) 2024-09-12T02:51:05.764 INFO:journalctl@ceph.osd.11.smithi172.stdout:Sep 12 02:51:05 smithi172 ceph-4954ed46-70ae-11ef-bcea-c7b262605968-osd-11[61129]: 2024-09-12T02:51:05.275+0000 7ff146fac640 -1 osd.11 112 heartbeat_check: no reply from 172.21.15.44:6804 osd.1 since back 2024-09-12T02:50:14.749696+0000 front 2024-09-12T02:50:14.749454+0000 (oldest deadline 2024-09-12T02:50:42.950102+0000) 2024-09-12T02:51:05.764 INFO:journalctl@ceph.osd.11.smithi172.stdout:Sep 12 02:51:05 smithi172 ceph-4954ed46-70ae-11ef-bcea-c7b262605968-osd-11[61129]: 2024-09-12T02:51:05.275+0000 7ff146fac640 -1 osd.11 112 heartbeat_check: no reply from 172.21.15.172:6804 osd.2 since back 2024-09-12T02:50:22.950505+0000 front 2024-09-12T02:50:22.950558+0000 (oldest deadline 2024-09-12T02:50:48.850680+0000) 2024-09-12T02:51:05.764 INFO:journalctl@ceph.osd.11.smithi172.stdout:Sep 12 02:51:05 smithi172 ceph-4954ed46-70ae-11ef-bcea-c7b262605968-osd-11[61129]: 2024-09-12T02:51:05.275+0000 7ff146fac640 -1 osd.11 112 heartbeat_check: no reply from 172.21.15.44:6812 osd.4 since back 2024-09-12T02:50:39.054153+0000 front 2024-09-12T02:50:39.054100+0000 (oldest deadline 2024-09-12T02:51:04.354015+0000) 2024-09-12T02:51:05.949 INFO:journalctl@ceph.osd.7.smithi044.stdout:Sep 12 02:51:05 smithi044 ceph-4954ed46-70ae-11ef-bcea-c7b262605968-osd-7[52975]: 2024-09-12T02:51:05.607+0000 7fa72d8ab640 -1 osd.7 112 heartbeat_check: no reply from 172.21.15.44:6804 osd.1 since back 2024-09-12T02:50:16.881229+0000 front 2024-09-12T02:50:16.881275+0000 (oldest deadline 2024-09-12T02:50:41.581336+0000) 2024-09-12T02:51:05.949 INFO:journalctl@ceph.osd.7.smithi044.stdout:Sep 12 02:51:05 smithi044 ceph-4954ed46-70ae-11ef-bcea-c7b262605968-osd-7[52975]: 2024-09-12T02:51:05.607+0000 7fa72d8ab640 -1 osd.7 112 heartbeat_check: no reply from 172.21.15.172:6804 osd.2 since back 2024-09-12T02:50:25.682202+0000 front 2024-09-12T02:50:25.682302+0000 (oldest deadline 2024-09-12T02:50:46.782200+0000) 2024-09-12T02:51:05.949 INFO:journalctl@ceph.osd.7.smithi044.stdout:Sep 12 02:51:05 smithi044 ceph-4954ed46-70ae-11ef-bcea-c7b262605968-osd-7[52975]: 2024-09-12T02:51:05.607+0000 7fa72d8ab640 -1 osd.7 112 heartbeat_check: no reply from 172.21.15.39:6814 osd.3 since back 2024-09-12T02:50:32.083235+0000 front 2024-09-12T02:50:32.083253+0000 (oldest deadline 2024-09-12T02:50:56.183208+0000) 2024-09-12T02:51:05.949 INFO:journalctl@ceph.osd.10.smithi044.stdout:Sep 12 02:51:05 smithi044 ceph-4954ed46-70ae-11ef-bcea-c7b262605968-osd-10[59969]: 2024-09-12T02:51:05.641+0000 7faa46dc6640 -1 osd.10 112 heartbeat_check: no reply from 172.21.15.39:6806 osd.0 since back 2024-09-12T02:50:05.367150+0000 front 2024-09-12T02:50:05.367381+0000 (oldest deadline 2024-09-12T02:50:31.267058+0000) 2024-09-12T02:51:05.949 INFO:journalctl@ceph.osd.10.smithi044.stdout:Sep 12 02:51:05 smithi044 ceph-4954ed46-70ae-11ef-bcea-c7b262605968-osd-10[59969]: 2024-09-12T02:51:05.641+0000 7faa46dc6640 -1 osd.10 112 heartbeat_check: no reply from 172.21.15.44:6804 osd.1 since back 2024-09-12T02:50:17.969767+0000 front 2024-09-12T02:50:17.969892+0000 (oldest deadline 2024-09-12T02:50:40.270033+0000) 2024-09-12T02:51:05.949 INFO:journalctl@ceph.osd.10.smithi044.stdout:Sep 12 02:51:05 smithi044 ceph-4954ed46-70ae-11ef-bcea-c7b262605968-osd-10[59969]: 2024-09-12T02:51:05.641+0000 7faa46dc6640 -1 osd.10 112 heartbeat_check: no reply from 172.21.15.172:6804 osd.2 since back 2024-09-12T02:50:25.972029+0000 front 2024-09-12T02:50:25.972168+0000 (oldest deadline 2024-09-12T02:50:47.671992+0000) 2024-09-12T02:51:05.950 INFO:journalctl@ceph.osd.10.smithi044.stdout:Sep 12 02:51:05 smithi044 ceph-4954ed46-70ae-11ef-bcea-c7b262605968-osd-10[59969]: 2024-09-12T02:51:05.641+0000 7faa46dc6640 -1 osd.10 112 heartbeat_check: no reply from 172.21.15.39:6814 osd.3 since back 2024-09-12T02:50:31.673509+0000 front 2024-09-12T02:50:31.673612+0000 (oldest deadline 2024-09-12T02:50:56.973525+0000) 2024-09-12T02:51:06.514 INFO:journalctl@ceph.osd.8.smithi172.stdout:Sep 12 02:51:06 smithi172 ceph-4954ed46-70ae-11ef-bcea-c7b262605968-osd-8[54149]: 2024-09-12T02:51:06.438+0000 7f07cfc64640 -1 osd.8 112 heartbeat_check: no reply from 172.21.15.44:6804 osd.1 since back 2024-09-12T02:50:15.561581+0000 front 2024-09-12T02:50:15.561700+0000 (oldest deadline 2024-09-12T02:50:41.362274+0000) 2024-09-12T02:51:06.514 INFO:journalctl@ceph.osd.8.smithi172.stdout:Sep 12 02:51:06 smithi172 ceph-4954ed46-70ae-11ef-bcea-c7b262605968-osd-8[54149]: 2024-09-12T02:51:06.438+0000 7f07cfc64640 -1 osd.8 112 heartbeat_check: no reply from 172.21.15.172:6804 osd.2 since back 2024-09-12T02:50:26.063273+0000 front 2024-09-12T02:50:26.063310+0000 (oldest deadline 2024-09-12T02:50:49.563398+0000) 2024-09-12T02:51:06.514 INFO:journalctl@ceph.osd.8.smithi172.stdout:Sep 12 02:51:06 smithi172 ceph-4954ed46-70ae-11ef-bcea-c7b262605968-osd-8[54149]: 2024-09-12T02:51:06.438+0000 7f07cfc64640 -1 osd.8 112 heartbeat_check: no reply from 172.21.15.39:6814 osd.3 since back 2024-09-12T02:50:31.864441+0000 front 2024-09-12T02:50:31.864414+0000 (oldest deadline 2024-09-12T02:50:55.364332+0000) 2024-09-12T02:51:06.515 INFO:journalctl@ceph.osd.11.smithi172.stdout:Sep 12 02:51:06 smithi172 ceph-4954ed46-70ae-11ef-bcea-c7b262605968-osd-11[61129]: 2024-09-12T02:51:06.239+0000 7ff146fac640 -1 osd.11 112 heartbeat_check: no reply from 172.21.15.39:6806 osd.0 since back 2024-09-12T02:50:09.449223+0000 front 2024-09-12T02:50:09.449210+0000 (oldest deadline 2024-09-12T02:50:34.748980+0000) 2024-09-12T02:51:06.515 INFO:journalctl@ceph.osd.11.smithi172.stdout:Sep 12 02:51:06 smithi172 ceph-4954ed46-70ae-11ef-bcea-c7b262605968-osd-11[61129]: 2024-09-12T02:51:06.239+0000 7ff146fac640 -1 osd.11 112 heartbeat_check: no reply from 172.21.15.44:6804 osd.1 since back 2024-09-12T02:50:14.749696+0000 front 2024-09-12T02:50:14.749454+0000 (oldest deadline 2024-09-12T02:50:42.950102+0000) 2024-09-12T02:51:06.515 INFO:journalctl@ceph.osd.11.smithi172.stdout:Sep 12 02:51:06 smithi172 ceph-4954ed46-70ae-11ef-bcea-c7b262605968-osd-11[61129]: 2024-09-12T02:51:06.239+0000 7ff146fac640 -1 osd.11 112 heartbeat_check: no reply from 172.21.15.172:6804 osd.2 since back 2024-09-12T02:50:22.950505+0000 front 2024-09-12T02:50:22.950558+0000 (oldest deadline 2024-09-12T02:50:48.850680+0000) 2024-09-12T02:51:06.515 INFO:journalctl@ceph.osd.11.smithi172.stdout:Sep 12 02:51:06 smithi172 ceph-4954ed46-70ae-11ef-bcea-c7b262605968-osd-11[61129]: 2024-09-12T02:51:06.239+0000 7ff146fac640 -1 osd.11 112 heartbeat_check: no reply from 172.21.15.44:6812 osd.4 since back 2024-09-12T02:50:39.054153+0000 front 2024-09-12T02:50:39.054100+0000 (oldest deadline 2024-09-12T02:51:04.354015+0000) 2024-09-12T02:51:06.600 INFO:journalctl@ceph.osd.9.smithi039.stdout:Sep 12 02:51:06 smithi039 ceph-4954ed46-70ae-11ef-bcea-c7b262605968-osd-9[63678]: 2024-09-12T02:51:06.133+0000 7f6d17a00640 -1 osd.9 112 heartbeat_check: no reply from 172.21.15.39:6806 osd.0 since back 2024-09-12T02:50:08.761527+0000 front 2024-09-12T02:50:08.761556+0000 (oldest deadline 2024-09-12T02:50:34.061510+0000) 2024-09-12T02:51:06.600 INFO:journalctl@ceph.osd.9.smithi039.stdout:Sep 12 02:51:06 smithi039 ceph-4954ed46-70ae-11ef-bcea-c7b262605968-osd-9[63678]: 2024-09-12T02:51:06.133+0000 7f6d17a00640 -1 osd.9 112 heartbeat_check: no reply from 172.21.15.44:6804 osd.1 since back 2024-09-12T02:50:14.062055+0000 front 2024-09-12T02:50:14.062119+0000 (oldest deadline 2024-09-12T02:50:38.761988+0000) 2024-09-12T02:51:06.600 INFO:journalctl@ceph.osd.9.smithi039.stdout:Sep 12 02:51:06 smithi039 ceph-4954ed46-70ae-11ef-bcea-c7b262605968-osd-9[63678]: 2024-09-12T02:51:06.133+0000 7f6d17a00640 -1 osd.9 112 heartbeat_check: no reply from 172.21.15.172:6804 osd.2 since back 2024-09-12T02:50:24.663318+0000 front 2024-09-12T02:50:24.663548+0000 (oldest deadline 2024-09-12T02:50:48.763108+0000) 2024-09-12T02:51:06.601 INFO:journalctl@ceph.osd.9.smithi039.stdout:Sep 12 02:51:06 smithi039 ceph-4954ed46-70ae-11ef-bcea-c7b262605968-osd-9[63678]: 2024-09-12T02:51:06.133+0000 7f6d17a00640 -1 osd.9 112 heartbeat_check: no reply from 172.21.15.39:6814 osd.3 since back 2024-09-12T02:50:33.464166+0000 front 2024-09-12T02:50:33.464108+0000 (oldest deadline 2024-09-12T02:50:55.164319+0000) 2024-09-12T02:51:06.601 INFO:journalctl@ceph.osd.9.smithi039.stdout:Sep 12 02:51:06 smithi039 ceph-4954ed46-70ae-11ef-bcea-c7b262605968-osd-9[63678]: 2024-09-12T02:51:06.133+0000 7f6d17a00640 -1 osd.9 112 heartbeat_check: no reply from 172.21.15.44:6812 osd.4 since back 2024-09-12T02:50:41.566107+0000 front 2024-09-12T02:50:41.565926+0000 (oldest deadline 2024-09-12T02:51:05.065942+0000) 2024-09-12T02:51:06.949 INFO:journalctl@ceph.osd.7.smithi044.stdout:Sep 12 02:51:06 smithi044 ceph-4954ed46-70ae-11ef-bcea-c7b262605968-osd-7[52975]: 2024-09-12T02:51:06.627+0000 7fa72d8ab640 -1 osd.7 112 heartbeat_check: no reply from 172.21.15.44:6804 osd.1 since back 2024-09-12T02:50:16.881229+0000 front 2024-09-12T02:50:16.881275+0000 (oldest deadline 2024-09-12T02:50:41.581336+0000) 2024-09-12T02:51:06.949 INFO:journalctl@ceph.osd.7.smithi044.stdout:Sep 12 02:51:06 smithi044 ceph-4954ed46-70ae-11ef-bcea-c7b262605968-osd-7[52975]: 2024-09-12T02:51:06.627+0000 7fa72d8ab640 -1 osd.7 112 heartbeat_check: no reply from 172.21.15.172:6804 osd.2 since back 2024-09-12T02:50:25.682202+0000 front 2024-09-12T02:50:25.682302+0000 (oldest deadline 2024-09-12T02:50:46.782200+0000) 2024-09-12T02:51:06.949 INFO:journalctl@ceph.osd.7.smithi044.stdout:Sep 12 02:51:06 smithi044 ceph-4954ed46-70ae-11ef-bcea-c7b262605968-osd-7[52975]: 2024-09-12T02:51:06.627+0000 7fa72d8ab640 -1 osd.7 112 heartbeat_check: no reply from 172.21.15.39:6814 osd.3 since back 2024-09-12T02:50:32.083235+0000 front 2024-09-12T02:50:32.083253+0000 (oldest deadline 2024-09-12T02:50:56.183208+0000) 2024-09-12T02:51:06.950 INFO:journalctl@ceph.osd.10.smithi044.stdout:Sep 12 02:51:06 smithi044 ceph-4954ed46-70ae-11ef-bcea-c7b262605968-osd-10[59969]: 2024-09-12T02:51:06.665+0000 7faa46dc6640 -1 osd.10 112 heartbeat_check: no reply from 172.21.15.39:6806 osd.0 since back 2024-09-12T02:50:05.367150+0000 front 2024-09-12T02:50:05.367381+0000 (oldest deadline 2024-09-12T02:50:31.267058+0000) 2024-09-12T02:51:06.950 INFO:journalctl@ceph.osd.10.smithi044.stdout:Sep 12 02:51:06 smithi044 ceph-4954ed46-70ae-11ef-bcea-c7b262605968-osd-10[59969]: 2024-09-12T02:51:06.665+0000 7faa46dc6640 -1 osd.10 112 heartbeat_check: no reply from 172.21.15.44:6804 osd.1 since back 2024-09-12T02:50:17.969767+0000 front 2024-09-12T02:50:17.969892+0000 (oldest deadline 2024-09-12T02:50:40.270033+0000) 2024-09-12T02:51:06.950 INFO:journalctl@ceph.osd.10.smithi044.stdout:Sep 12 02:51:06 smithi044 ceph-4954ed46-70ae-11ef-bcea-c7b262605968-osd-10[59969]: 2024-09-12T02:51:06.665+0000 7faa46dc6640 -1 osd.10 112 heartbeat_check: no reply from 172.21.15.172:6804 osd.2 since back 2024-09-12T02:50:25.972029+0000 front 2024-09-12T02:50:25.972168+0000 (oldest deadline 2024-09-12T02:50:47.671992+0000) 2024-09-12T02:51:06.951 INFO:journalctl@ceph.osd.10.smithi044.stdout:Sep 12 02:51:06 smithi044 ceph-4954ed46-70ae-11ef-bcea-c7b262605968-osd-10[59969]: 2024-09-12T02:51:06.665+0000 7faa46dc6640 -1 osd.10 112 heartbeat_check: no reply from 172.21.15.39:6814 osd.3 since back 2024-09-12T02:50:31.673509+0000 front 2024-09-12T02:50:31.673612+0000 (oldest deadline 2024-09-12T02:50:56.973525+0000) 2024-09-12T02:51:07.350 INFO:journalctl@ceph.osd.9.smithi039.stdout:Sep 12 02:51:07 smithi039 ceph-4954ed46-70ae-11ef-bcea-c7b262605968-osd-9[63678]: 2024-09-12T02:51:07.090+0000 7f6d17a00640 -1 osd.9 112 heartbeat_check: no reply from 172.21.15.39:6806 osd.0 since back 2024-09-12T02:50:08.761527+0000 front 2024-09-12T02:50:08.761556+0000 (oldest deadline 2024-09-12T02:50:34.061510+0000) 2024-09-12T02:51:07.350 INFO:journalctl@ceph.osd.9.smithi039.stdout:Sep 12 02:51:07 smithi039 ceph-4954ed46-70ae-11ef-bcea-c7b262605968-osd-9[63678]: 2024-09-12T02:51:07.090+0000 7f6d17a00640 -1 osd.9 112 heartbeat_check: no reply from 172.21.15.44:6804 osd.1 since back 2024-09-12T02:50:14.062055+0000 front 2024-09-12T02:50:14.062119+0000 (oldest deadline 2024-09-12T02:50:38.761988+0000) 2024-09-12T02:51:07.350 INFO:journalctl@ceph.osd.9.smithi039.stdout:Sep 12 02:51:07 smithi039 ceph-4954ed46-70ae-11ef-bcea-c7b262605968-osd-9[63678]: 2024-09-12T02:51:07.090+0000 7f6d17a00640 -1 osd.9 112 heartbeat_check: no reply from 172.21.15.172:6804 osd.2 since back 2024-09-12T02:50:24.663318+0000 front 2024-09-12T02:50:24.663548+0000 (oldest deadline 2024-09-12T02:50:48.763108+0000) 2024-09-12T02:51:07.350 INFO:journalctl@ceph.osd.9.smithi039.stdout:Sep 12 02:51:07 smithi039 ceph-4954ed46-70ae-11ef-bcea-c7b262605968-osd-9[63678]: 2024-09-12T02:51:07.090+0000 7f6d17a00640 -1 osd.9 112 heartbeat_check: no reply from 172.21.15.39:6814 osd.3 since back 2024-09-12T02:50:33.464166+0000 front 2024-09-12T02:50:33.464108+0000 (oldest deadline 2024-09-12T02:50:55.164319+0000) 2024-09-12T02:51:07.350 INFO:journalctl@ceph.osd.9.smithi039.stdout:Sep 12 02:51:07 smithi039 ceph-4954ed46-70ae-11ef-bcea-c7b262605968-osd-9[63678]: 2024-09-12T02:51:07.090+0000 7f6d17a00640 -1 osd.9 112 heartbeat_check: no reply from 172.21.15.44:6812 osd.4 since back 2024-09-12T02:50:41.566107+0000 front 2024-09-12T02:50:41.565926+0000 (oldest deadline 2024-09-12T02:51:05.065942+0000) 2024-09-12T02:51:07.513 INFO:journalctl@ceph.osd.8.smithi172.stdout:Sep 12 02:51:07 smithi172 ceph-4954ed46-70ae-11ef-bcea-c7b262605968-osd-8[54149]: 2024-09-12T02:51:07.462+0000 7f07cfc64640 -1 osd.8 112 heartbeat_check: no reply from 172.21.15.44:6804 osd.1 since back 2024-09-12T02:50:15.561581+0000 front 2024-09-12T02:50:15.561700+0000 (oldest deadline 2024-09-12T02:50:41.362274+0000) 2024-09-12T02:51:07.514 INFO:journalctl@ceph.osd.8.smithi172.stdout:Sep 12 02:51:07 smithi172 ceph-4954ed46-70ae-11ef-bcea-c7b262605968-osd-8[54149]: 2024-09-12T02:51:07.462+0000 7f07cfc64640 -1 osd.8 112 heartbeat_check: no reply from 172.21.15.172:6804 osd.2 since back 2024-09-12T02:50:26.063273+0000 front 2024-09-12T02:50:26.063310+0000 (oldest deadline 2024-09-12T02:50:49.563398+0000) 2024-09-12T02:51:07.514 INFO:journalctl@ceph.osd.8.smithi172.stdout:Sep 12 02:51:07 smithi172 ceph-4954ed46-70ae-11ef-bcea-c7b262605968-osd-8[54149]: 2024-09-12T02:51:07.462+0000 7f07cfc64640 -1 osd.8 112 heartbeat_check: no reply from 172.21.15.39:6814 osd.3 since back 2024-09-12T02:50:31.864441+0000 front 2024-09-12T02:50:31.864414+0000 (oldest deadline 2024-09-12T02:50:55.364332+0000) 2024-09-12T02:51:07.514 INFO:journalctl@ceph.osd.11.smithi172.stdout:Sep 12 02:51:07 smithi172 ceph-4954ed46-70ae-11ef-bcea-c7b262605968-osd-11[61129]: 2024-09-12T02:51:07.243+0000 7ff146fac640 -1 osd.11 112 heartbeat_check: no reply from 172.21.15.39:6806 osd.0 since back 2024-09-12T02:50:09.449223+0000 front 2024-09-12T02:50:09.449210+0000 (oldest deadline 2024-09-12T02:50:34.748980+0000) 2024-09-12T02:51:07.514 INFO:journalctl@ceph.osd.11.smithi172.stdout:Sep 12 02:51:07 smithi172 ceph-4954ed46-70ae-11ef-bcea-c7b262605968-osd-11[61129]: 2024-09-12T02:51:07.243+0000 7ff146fac640 -1 osd.11 112 heartbeat_check: no reply from 172.21.15.44:6804 osd.1 since back 2024-09-12T02:50:14.749696+0000 front 2024-09-12T02:50:14.749454+0000 (oldest deadline 2024-09-12T02:50:42.950102+0000) 2024-09-12T02:51:07.514 INFO:journalctl@ceph.osd.11.smithi172.stdout:Sep 12 02:51:07 smithi172 ceph-4954ed46-70ae-11ef-bcea-c7b262605968-osd-11[61129]: 2024-09-12T02:51:07.243+0000 7ff146fac640 -1 osd.11 112 heartbeat_check: no reply from 172.21.15.172:6804 osd.2 since back 2024-09-12T02:50:22.950505+0000 front 2024-09-12T02:50:22.950558+0000 (oldest deadline 2024-09-12T02:50:48.850680+0000) 2024-09-12T02:51:07.514 INFO:journalctl@ceph.osd.11.smithi172.stdout:Sep 12 02:51:07 smithi172 ceph-4954ed46-70ae-11ef-bcea-c7b262605968-osd-11[61129]: 2024-09-12T02:51:07.243+0000 7ff146fac640 -1 osd.11 112 heartbeat_check: no reply from 172.21.15.44:6812 osd.4 since back 2024-09-12T02:50:39.054153+0000 front 2024-09-12T02:50:39.054100+0000 (oldest deadline 2024-09-12T02:51:04.354015+0000) 2024-09-12T02:51:07.758 INFO:journalctl@ceph.osd.7.smithi044.stdout:Sep 12 02:51:07 smithi044 podman[72395]: 2024-09-12 02:51:07.467895853 +0000 UTC m=+5.651914209 container died 1d0e8149735b2f622b1d3ac08069d5c2124f94588d37aef34f07f45fb143d896 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:3be30d720e37ec4df7f667e60f22b4d221c4ce7b408e68b90f9ac10220535e66, name=ceph-4954ed46-70ae-11ef-bcea-c7b262605968-osd-7, GIT_CLEAN=True, io.buildah.version=1.37.2, org.label-schema.vendor=CentOS, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.license=GPLv2, GIT_BRANCH=HEAD, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, maintainer=Guillaume Abrioux , org.label-schema.name=CentOS Stream 9 Base Image, RELEASE=squid-b53b6d3, org.label-schema.build-date=20240731, CEPH_POINT_RELEASE=, ceph=True, org.label-schema.schema-version=1.0) 2024-09-12T02:51:07.759 INFO:journalctl@ceph.osd.10.smithi044.stdout:Sep 12 02:51:07 smithi044 ceph-4954ed46-70ae-11ef-bcea-c7b262605968-osd-10[59969]: 2024-09-12T02:51:07.651+0000 7faa46dc6640 -1 osd.10 112 heartbeat_check: no reply from 172.21.15.39:6806 osd.0 since back 2024-09-12T02:50:05.367150+0000 front 2024-09-12T02:50:05.367381+0000 (oldest deadline 2024-09-12T02:50:31.267058+0000) 2024-09-12T02:51:07.759 INFO:journalctl@ceph.osd.10.smithi044.stdout:Sep 12 02:51:07 smithi044 ceph-4954ed46-70ae-11ef-bcea-c7b262605968-osd-10[59969]: 2024-09-12T02:51:07.651+0000 7faa46dc6640 -1 osd.10 112 heartbeat_check: no reply from 172.21.15.44:6804 osd.1 since back 2024-09-12T02:50:17.969767+0000 front 2024-09-12T02:50:17.969892+0000 (oldest deadline 2024-09-12T02:50:40.270033+0000) 2024-09-12T02:51:07.759 INFO:journalctl@ceph.osd.10.smithi044.stdout:Sep 12 02:51:07 smithi044 ceph-4954ed46-70ae-11ef-bcea-c7b262605968-osd-10[59969]: 2024-09-12T02:51:07.651+0000 7faa46dc6640 -1 osd.10 112 heartbeat_check: no reply from 172.21.15.172:6804 osd.2 since back 2024-09-12T02:50:25.972029+0000 front 2024-09-12T02:50:25.972168+0000 (oldest deadline 2024-09-12T02:50:47.671992+0000) 2024-09-12T02:51:07.759 INFO:journalctl@ceph.osd.10.smithi044.stdout:Sep 12 02:51:07 smithi044 ceph-4954ed46-70ae-11ef-bcea-c7b262605968-osd-10[59969]: 2024-09-12T02:51:07.651+0000 7faa46dc6640 -1 osd.10 112 heartbeat_check: no reply from 172.21.15.39:6814 osd.3 since back 2024-09-12T02:50:31.673509+0000 front 2024-09-12T02:50:31.673612+0000 (oldest deadline 2024-09-12T02:50:56.973525+0000) 2024-09-12T02:51:07.759 INFO:journalctl@ceph.osd.10.smithi044.stdout:Sep 12 02:51:07 smithi044 ceph-4954ed46-70ae-11ef-bcea-c7b262605968-osd-10[59969]: 2024-09-12T02:51:07.651+0000 7faa46dc6640 -1 osd.10 112 heartbeat_check: no reply from 172.21.15.44:6812 osd.4 since back 2024-09-12T02:50:42.274445+0000 front 2024-09-12T02:50:42.274407+0000 (oldest deadline 2024-09-12T02:51:06.875067+0000) 2024-09-12T02:51:08.192 INFO:journalctl@ceph.osd.7.smithi044.stdout:Sep 12 02:51:07 smithi044 podman[72395]: 2024-09-12 02:51:07.857384775 +0000 UTC m=+6.041403130 container cleanup 1d0e8149735b2f622b1d3ac08069d5c2124f94588d37aef34f07f45fb143d896 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:3be30d720e37ec4df7f667e60f22b4d221c4ce7b408e68b90f9ac10220535e66, name=ceph-4954ed46-70ae-11ef-bcea-c7b262605968-osd-7, org.label-schema.vendor=CentOS, GIT_BRANCH=HEAD, org.label-schema.name=CentOS Stream 9 Base Image, RELEASE=squid-b53b6d3, org.label-schema.schema-version=1.0, CEPH_POINT_RELEASE=, org.label-schema.build-date=20240731, maintainer=Guillaume Abrioux , GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_CLEAN=True, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, io.buildah.version=1.37.2, org.label-schema.license=GPLv2, ceph=True) 2024-09-12T02:51:08.192 INFO:journalctl@ceph.osd.7.smithi044.stdout:Sep 12 02:51:07 smithi044 bash[72395]: ceph-4954ed46-70ae-11ef-bcea-c7b262605968-osd-7 2024-09-12T02:51:08.350 INFO:journalctl@ceph.osd.9.smithi039.stdout:Sep 12 02:51:08 smithi039 ceph-4954ed46-70ae-11ef-bcea-c7b262605968-osd-9[63678]: 2024-09-12T02:51:08.095+0000 7f6d17a00640 -1 osd.9 112 heartbeat_check: no reply from 172.21.15.39:6806 osd.0 since back 2024-09-12T02:50:08.761527+0000 front 2024-09-12T02:50:08.761556+0000 (oldest deadline 2024-09-12T02:50:34.061510+0000) 2024-09-12T02:51:08.350 INFO:journalctl@ceph.osd.9.smithi039.stdout:Sep 12 02:51:08 smithi039 ceph-4954ed46-70ae-11ef-bcea-c7b262605968-osd-9[63678]: 2024-09-12T02:51:08.095+0000 7f6d17a00640 -1 osd.9 112 heartbeat_check: no reply from 172.21.15.44:6804 osd.1 since back 2024-09-12T02:50:14.062055+0000 front 2024-09-12T02:50:14.062119+0000 (oldest deadline 2024-09-12T02:50:38.761988+0000) 2024-09-12T02:51:08.350 INFO:journalctl@ceph.osd.9.smithi039.stdout:Sep 12 02:51:08 smithi039 ceph-4954ed46-70ae-11ef-bcea-c7b262605968-osd-9[63678]: 2024-09-12T02:51:08.095+0000 7f6d17a00640 -1 osd.9 112 heartbeat_check: no reply from 172.21.15.172:6804 osd.2 since back 2024-09-12T02:50:24.663318+0000 front 2024-09-12T02:50:24.663548+0000 (oldest deadline 2024-09-12T02:50:48.763108+0000) 2024-09-12T02:51:08.350 INFO:journalctl@ceph.osd.9.smithi039.stdout:Sep 12 02:51:08 smithi039 ceph-4954ed46-70ae-11ef-bcea-c7b262605968-osd-9[63678]: 2024-09-12T02:51:08.095+0000 7f6d17a00640 -1 osd.9 112 heartbeat_check: no reply from 172.21.15.39:6814 osd.3 since back 2024-09-12T02:50:33.464166+0000 front 2024-09-12T02:50:33.464108+0000 (oldest deadline 2024-09-12T02:50:55.164319+0000) 2024-09-12T02:51:08.350 INFO:journalctl@ceph.osd.9.smithi039.stdout:Sep 12 02:51:08 smithi039 ceph-4954ed46-70ae-11ef-bcea-c7b262605968-osd-9[63678]: 2024-09-12T02:51:08.095+0000 7f6d17a00640 -1 osd.9 112 heartbeat_check: no reply from 172.21.15.44:6812 osd.4 since back 2024-09-12T02:50:41.566107+0000 front 2024-09-12T02:50:41.565926+0000 (oldest deadline 2024-09-12T02:51:05.065942+0000) 2024-09-12T02:51:08.448 INFO:journalctl@ceph.osd.7.smithi044.stdout:Sep 12 02:51:08 smithi044 podman[72411]: 2024-09-12 02:51:08.191946649 +0000 UTC m=+0.722711798 container remove 1d0e8149735b2f622b1d3ac08069d5c2124f94588d37aef34f07f45fb143d896 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:3be30d720e37ec4df7f667e60f22b4d221c4ce7b408e68b90f9ac10220535e66, name=ceph-4954ed46-70ae-11ef-bcea-c7b262605968-osd-7, org.label-schema.name=CentOS Stream 9 Base Image, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.vendor=CentOS, CEPH_POINT_RELEASE=, org.label-schema.build-date=20240731, io.buildah.version=1.37.2, maintainer=Guillaume Abrioux , org.label-schema.license=GPLv2, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, RELEASE=squid-b53b6d3, GIT_CLEAN=True, GIT_BRANCH=HEAD, ceph=True, org.label-schema.schema-version=1.0) 2024-09-12T02:51:08.764 INFO:journalctl@ceph.osd.8.smithi172.stdout:Sep 12 02:51:08 smithi172 ceph-4954ed46-70ae-11ef-bcea-c7b262605968-osd-8[54149]: 2024-09-12T02:51:08.512+0000 7f07cfc64640 -1 osd.8 112 heartbeat_check: no reply from 172.21.15.44:6804 osd.1 since back 2024-09-12T02:50:15.561581+0000 front 2024-09-12T02:50:15.561700+0000 (oldest deadline 2024-09-12T02:50:41.362274+0000) 2024-09-12T02:51:08.764 INFO:journalctl@ceph.osd.8.smithi172.stdout:Sep 12 02:51:08 smithi172 ceph-4954ed46-70ae-11ef-bcea-c7b262605968-osd-8[54149]: 2024-09-12T02:51:08.512+0000 7f07cfc64640 -1 osd.8 112 heartbeat_check: no reply from 172.21.15.172:6804 osd.2 since back 2024-09-12T02:50:26.063273+0000 front 2024-09-12T02:50:26.063310+0000 (oldest deadline 2024-09-12T02:50:49.563398+0000) 2024-09-12T02:51:08.764 INFO:journalctl@ceph.osd.8.smithi172.stdout:Sep 12 02:51:08 smithi172 ceph-4954ed46-70ae-11ef-bcea-c7b262605968-osd-8[54149]: 2024-09-12T02:51:08.512+0000 7f07cfc64640 -1 osd.8 112 heartbeat_check: no reply from 172.21.15.39:6814 osd.3 since back 2024-09-12T02:50:31.864441+0000 front 2024-09-12T02:50:31.864414+0000 (oldest deadline 2024-09-12T02:50:55.364332+0000) 2024-09-12T02:51:08.764 INFO:journalctl@ceph.osd.8.smithi172.stdout:Sep 12 02:51:08 smithi172 ceph-4954ed46-70ae-11ef-bcea-c7b262605968-osd-8[54149]: 2024-09-12T02:51:08.512+0000 7f07cfc64640 -1 osd.8 112 heartbeat_check: no reply from 172.21.15.44:6812 osd.4 since back 2024-09-12T02:50:42.365825+0000 front 2024-09-12T02:50:42.365874+0000 (oldest deadline 2024-09-12T02:51:07.665896+0000) 2024-09-12T02:51:08.764 INFO:journalctl@ceph.osd.11.smithi172.stdout:Sep 12 02:51:08 smithi172 ceph-4954ed46-70ae-11ef-bcea-c7b262605968-osd-11[61129]: 2024-09-12T02:51:08.269+0000 7ff146fac640 -1 osd.11 112 heartbeat_check: no reply from 172.21.15.39:6806 osd.0 since back 2024-09-12T02:50:09.449223+0000 front 2024-09-12T02:50:09.449210+0000 (oldest deadline 2024-09-12T02:50:34.748980+0000) 2024-09-12T02:51:08.764 INFO:journalctl@ceph.osd.11.smithi172.stdout:Sep 12 02:51:08 smithi172 ceph-4954ed46-70ae-11ef-bcea-c7b262605968-osd-11[61129]: 2024-09-12T02:51:08.269+0000 7ff146fac640 -1 osd.11 112 heartbeat_check: no reply from 172.21.15.44:6804 osd.1 since back 2024-09-12T02:50:14.749696+0000 front 2024-09-12T02:50:14.749454+0000 (oldest deadline 2024-09-12T02:50:42.950102+0000) 2024-09-12T02:51:08.764 INFO:journalctl@ceph.osd.11.smithi172.stdout:Sep 12 02:51:08 smithi172 ceph-4954ed46-70ae-11ef-bcea-c7b262605968-osd-11[61129]: 2024-09-12T02:51:08.269+0000 7ff146fac640 -1 osd.11 112 heartbeat_check: no reply from 172.21.15.172:6804 osd.2 since back 2024-09-12T02:50:22.950505+0000 front 2024-09-12T02:50:22.950558+0000 (oldest deadline 2024-09-12T02:50:48.850680+0000) 2024-09-12T02:51:08.764 INFO:journalctl@ceph.osd.11.smithi172.stdout:Sep 12 02:51:08 smithi172 ceph-4954ed46-70ae-11ef-bcea-c7b262605968-osd-11[61129]: 2024-09-12T02:51:08.269+0000 7ff146fac640 -1 osd.11 112 heartbeat_check: no reply from 172.21.15.44:6812 osd.4 since back 2024-09-12T02:50:39.054153+0000 front 2024-09-12T02:50:39.054100+0000 (oldest deadline 2024-09-12T02:51:04.354015+0000) 2024-09-12T02:51:08.787 INFO:journalctl@ceph.osd.7.smithi044.stdout:Sep 12 02:51:08 smithi044 podman[72503]: 2024-09-12 02:51:08.427083923 +0000 UTC m=+0.016055365 image pull 54467abc55f864c4f73dfaf9c6ac3bb3e87b773123d5badaf790bee57321d594 quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:3be30d720e37ec4df7f667e60f22b4d221c4ce7b408e68b90f9ac10220535e66 2024-09-12T02:51:08.787 INFO:journalctl@ceph.osd.7.smithi044.stdout:Sep 12 02:51:08 smithi044 podman[72503]: 2024-09-12 02:51:08.542829535 +0000 UTC m=+0.131800968 container create ab363fd5fd37ae6085255c6158e052228e4262e200e8b39d8f1c9c0a7fe15794 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:3be30d720e37ec4df7f667e60f22b4d221c4ce7b408e68b90f9ac10220535e66, name=ceph-4954ed46-70ae-11ef-bcea-c7b262605968-osd-7-deactivate, org.label-schema.vendor=CentOS, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.schema-version=1.0, GIT_BRANCH=HEAD, ceph=True, org.label-schema.build-date=20240731, RELEASE=squid-b53b6d3, io.buildah.version=1.37.2, GIT_CLEAN=True, CEPH_POINT_RELEASE=, maintainer=Guillaume Abrioux , org.label-schema.license=GPLv2, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7) 2024-09-12T02:51:08.787 INFO:journalctl@ceph.osd.10.smithi044.stdout:Sep 12 02:51:08 smithi044 ceph-4954ed46-70ae-11ef-bcea-c7b262605968-osd-10[59969]: 2024-09-12T02:51:08.622+0000 7faa46dc6640 -1 osd.10 112 heartbeat_check: no reply from 172.21.15.39:6806 osd.0 since back 2024-09-12T02:50:05.367150+0000 front 2024-09-12T02:50:05.367381+0000 (oldest deadline 2024-09-12T02:50:31.267058+0000) 2024-09-12T02:51:08.787 INFO:journalctl@ceph.osd.10.smithi044.stdout:Sep 12 02:51:08 smithi044 ceph-4954ed46-70ae-11ef-bcea-c7b262605968-osd-10[59969]: 2024-09-12T02:51:08.622+0000 7faa46dc6640 -1 osd.10 112 heartbeat_check: no reply from 172.21.15.44:6804 osd.1 since back 2024-09-12T02:50:17.969767+0000 front 2024-09-12T02:50:17.969892+0000 (oldest deadline 2024-09-12T02:50:40.270033+0000) 2024-09-12T02:51:08.787 INFO:journalctl@ceph.osd.10.smithi044.stdout:Sep 12 02:51:08 smithi044 ceph-4954ed46-70ae-11ef-bcea-c7b262605968-osd-10[59969]: 2024-09-12T02:51:08.622+0000 7faa46dc6640 -1 osd.10 112 heartbeat_check: no reply from 172.21.15.172:6804 osd.2 since back 2024-09-12T02:50:25.972029+0000 front 2024-09-12T02:50:25.972168+0000 (oldest deadline 2024-09-12T02:50:47.671992+0000) 2024-09-12T02:51:08.787 INFO:journalctl@ceph.osd.10.smithi044.stdout:Sep 12 02:51:08 smithi044 ceph-4954ed46-70ae-11ef-bcea-c7b262605968-osd-10[59969]: 2024-09-12T02:51:08.622+0000 7faa46dc6640 -1 osd.10 112 heartbeat_check: no reply from 172.21.15.39:6814 osd.3 since back 2024-09-12T02:50:31.673509+0000 front 2024-09-12T02:50:31.673612+0000 (oldest deadline 2024-09-12T02:50:56.973525+0000) 2024-09-12T02:51:08.787 INFO:journalctl@ceph.osd.10.smithi044.stdout:Sep 12 02:51:08 smithi044 ceph-4954ed46-70ae-11ef-bcea-c7b262605968-osd-10[59969]: 2024-09-12T02:51:08.622+0000 7faa46dc6640 -1 osd.10 112 heartbeat_check: no reply from 172.21.15.44:6812 osd.4 since back 2024-09-12T02:50:42.274445+0000 front 2024-09-12T02:50:42.274407+0000 (oldest deadline 2024-09-12T02:51:06.875067+0000) 2024-09-12T02:51:09.198 INFO:journalctl@ceph.osd.7.smithi044.stdout:Sep 12 02:51:08 smithi044 podman[72503]: 2024-09-12 02:51:08.787307388 +0000 UTC m=+0.376278837 container init ab363fd5fd37ae6085255c6158e052228e4262e200e8b39d8f1c9c0a7fe15794 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:3be30d720e37ec4df7f667e60f22b4d221c4ce7b408e68b90f9ac10220535e66, name=ceph-4954ed46-70ae-11ef-bcea-c7b262605968-osd-7-deactivate, org.label-schema.vendor=CentOS, org.label-schema.license=GPLv2, org.label-schema.schema-version=1.0, org.label-schema.build-date=20240731, org.label-schema.name=CentOS Stream 9 Base Image, RELEASE=squid-b53b6d3, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, ceph=True, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_BRANCH=HEAD, CEPH_POINT_RELEASE=, maintainer=Guillaume Abrioux , io.buildah.version=1.37.2, GIT_CLEAN=True) 2024-09-12T02:51:09.199 INFO:journalctl@ceph.osd.7.smithi044.stdout:Sep 12 02:51:08 smithi044 podman[72503]: 2024-09-12 02:51:08.790639149 +0000 UTC m=+0.379610583 container start ab363fd5fd37ae6085255c6158e052228e4262e200e8b39d8f1c9c0a7fe15794 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:3be30d720e37ec4df7f667e60f22b4d221c4ce7b408e68b90f9ac10220535e66, name=ceph-4954ed46-70ae-11ef-bcea-c7b262605968-osd-7-deactivate, GIT_CLEAN=True, RELEASE=squid-b53b6d3, org.label-schema.build-date=20240731, org.label-schema.name=CentOS Stream 9 Base Image, io.buildah.version=1.37.2, org.label-schema.vendor=CentOS, ceph=True, org.label-schema.license=GPLv2, org.label-schema.schema-version=1.0, GIT_BRANCH=HEAD, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, maintainer=Guillaume Abrioux , CEPH_POINT_RELEASE=, GIT_REPO=git@github.com:ceph/ceph-container.git) 2024-09-12T02:51:09.199 INFO:journalctl@ceph.osd.7.smithi044.stdout:Sep 12 02:51:08 smithi044 podman[72503]: 2024-09-12 02:51:08.862333178 +0000 UTC m=+0.451304628 container attach ab363fd5fd37ae6085255c6158e052228e4262e200e8b39d8f1c9c0a7fe15794 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:3be30d720e37ec4df7f667e60f22b4d221c4ce7b408e68b90f9ac10220535e66, name=ceph-4954ed46-70ae-11ef-bcea-c7b262605968-osd-7-deactivate, CEPH_POINT_RELEASE=, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.license=GPLv2, GIT_BRANCH=HEAD, io.buildah.version=1.37.2, ceph=True, org.label-schema.build-date=20240731, org.label-schema.vendor=CentOS, org.label-schema.name=CentOS Stream 9 Base Image, GIT_CLEAN=True, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, RELEASE=squid-b53b6d3, org.label-schema.schema-version=1.0, maintainer=Guillaume Abrioux ) 2024-09-12T02:51:09.199 INFO:journalctl@ceph.osd.7.smithi044.stdout:Sep 12 02:51:08 smithi044 podman[72503]: 2024-09-12 02:51:08.981259648 +0000 UTC m=+0.570231086 container died ab363fd5fd37ae6085255c6158e052228e4262e200e8b39d8f1c9c0a7fe15794 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:3be30d720e37ec4df7f667e60f22b4d221c4ce7b408e68b90f9ac10220535e66, name=ceph-4954ed46-70ae-11ef-bcea-c7b262605968-osd-7-deactivate, CEPH_POINT_RELEASE=, GIT_CLEAN=True, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.schema-version=1.0, GIT_BRANCH=HEAD, maintainer=Guillaume Abrioux , ceph=True, org.label-schema.build-date=20240731, GIT_REPO=git@github.com:ceph/ceph-container.git, io.buildah.version=1.37.2, RELEASE=squid-b53b6d3, org.label-schema.vendor=CentOS, org.label-schema.license=GPLv2, org.label-schema.name=CentOS Stream 9 Base Image) 2024-09-12T02:51:09.599 INFO:journalctl@ceph.osd.9.smithi039.stdout:Sep 12 02:51:09 smithi039 ceph-4954ed46-70ae-11ef-bcea-c7b262605968-osd-9[63678]: 2024-09-12T02:51:09.109+0000 7f6d17a00640 -1 osd.9 112 heartbeat_check: no reply from 172.21.15.39:6806 osd.0 since back 2024-09-12T02:50:08.761527+0000 front 2024-09-12T02:50:08.761556+0000 (oldest deadline 2024-09-12T02:50:34.061510+0000) 2024-09-12T02:51:09.600 INFO:journalctl@ceph.osd.9.smithi039.stdout:Sep 12 02:51:09 smithi039 ceph-4954ed46-70ae-11ef-bcea-c7b262605968-osd-9[63678]: 2024-09-12T02:51:09.109+0000 7f6d17a00640 -1 osd.9 112 heartbeat_check: no reply from 172.21.15.44:6804 osd.1 since back 2024-09-12T02:50:14.062055+0000 front 2024-09-12T02:50:14.062119+0000 (oldest deadline 2024-09-12T02:50:38.761988+0000) 2024-09-12T02:51:09.600 INFO:journalctl@ceph.osd.9.smithi039.stdout:Sep 12 02:51:09 smithi039 ceph-4954ed46-70ae-11ef-bcea-c7b262605968-osd-9[63678]: 2024-09-12T02:51:09.109+0000 7f6d17a00640 -1 osd.9 112 heartbeat_check: no reply from 172.21.15.172:6804 osd.2 since back 2024-09-12T02:50:24.663318+0000 front 2024-09-12T02:50:24.663548+0000 (oldest deadline 2024-09-12T02:50:48.763108+0000) 2024-09-12T02:51:09.600 INFO:journalctl@ceph.osd.9.smithi039.stdout:Sep 12 02:51:09 smithi039 ceph-4954ed46-70ae-11ef-bcea-c7b262605968-osd-9[63678]: 2024-09-12T02:51:09.109+0000 7f6d17a00640 -1 osd.9 112 heartbeat_check: no reply from 172.21.15.39:6814 osd.3 since back 2024-09-12T02:50:33.464166+0000 front 2024-09-12T02:50:33.464108+0000 (oldest deadline 2024-09-12T02:50:55.164319+0000) 2024-09-12T02:51:09.600 INFO:journalctl@ceph.osd.9.smithi039.stdout:Sep 12 02:51:09 smithi039 ceph-4954ed46-70ae-11ef-bcea-c7b262605968-osd-9[63678]: 2024-09-12T02:51:09.109+0000 7f6d17a00640 -1 osd.9 112 heartbeat_check: no reply from 172.21.15.44:6812 osd.4 since back 2024-09-12T02:50:41.566107+0000 front 2024-09-12T02:50:41.565926+0000 (oldest deadline 2024-09-12T02:51:05.065942+0000) 2024-09-12T02:51:09.699 INFO:journalctl@ceph.osd.10.smithi044.stdout:Sep 12 02:51:09 smithi044 ceph-4954ed46-70ae-11ef-bcea-c7b262605968-osd-10[59969]: 2024-09-12T02:51:09.634+0000 7faa46dc6640 -1 osd.10 112 heartbeat_check: no reply from 172.21.15.39:6806 osd.0 since back 2024-09-12T02:50:05.367150+0000 front 2024-09-12T02:50:05.367381+0000 (oldest deadline 2024-09-12T02:50:31.267058+0000) 2024-09-12T02:51:09.699 INFO:journalctl@ceph.osd.10.smithi044.stdout:Sep 12 02:51:09 smithi044 ceph-4954ed46-70ae-11ef-bcea-c7b262605968-osd-10[59969]: 2024-09-12T02:51:09.634+0000 7faa46dc6640 -1 osd.10 112 heartbeat_check: no reply from 172.21.15.44:6804 osd.1 since back 2024-09-12T02:50:17.969767+0000 front 2024-09-12T02:50:17.969892+0000 (oldest deadline 2024-09-12T02:50:40.270033+0000) 2024-09-12T02:51:09.699 INFO:journalctl@ceph.osd.10.smithi044.stdout:Sep 12 02:51:09 smithi044 ceph-4954ed46-70ae-11ef-bcea-c7b262605968-osd-10[59969]: 2024-09-12T02:51:09.634+0000 7faa46dc6640 -1 osd.10 112 heartbeat_check: no reply from 172.21.15.172:6804 osd.2 since back 2024-09-12T02:50:25.972029+0000 front 2024-09-12T02:50:25.972168+0000 (oldest deadline 2024-09-12T02:50:47.671992+0000) 2024-09-12T02:51:09.699 INFO:journalctl@ceph.osd.10.smithi044.stdout:Sep 12 02:51:09 smithi044 ceph-4954ed46-70ae-11ef-bcea-c7b262605968-osd-10[59969]: 2024-09-12T02:51:09.634+0000 7faa46dc6640 -1 osd.10 112 heartbeat_check: no reply from 172.21.15.39:6814 osd.3 since back 2024-09-12T02:50:31.673509+0000 front 2024-09-12T02:50:31.673612+0000 (oldest deadline 2024-09-12T02:50:56.973525+0000) 2024-09-12T02:51:09.699 INFO:journalctl@ceph.osd.10.smithi044.stdout:Sep 12 02:51:09 smithi044 ceph-4954ed46-70ae-11ef-bcea-c7b262605968-osd-10[59969]: 2024-09-12T02:51:09.634+0000 7faa46dc6640 -1 osd.10 112 heartbeat_check: no reply from 172.21.15.44:6812 osd.4 since back 2024-09-12T02:50:42.274445+0000 front 2024-09-12T02:50:42.274407+0000 (oldest deadline 2024-09-12T02:51:06.875067+0000) 2024-09-12T02:51:09.752 DEBUG:teuthology.orchestra.run.smithi044:> sudo pkill -f 'journalctl -f -n 0 -u ceph-4954ed46-70ae-11ef-bcea-c7b262605968@osd.7.service' 2024-09-12T02:51:09.764 INFO:journalctl@ceph.osd.11.smithi172.stdout:Sep 12 02:51:09 smithi172 ceph-4954ed46-70ae-11ef-bcea-c7b262605968-osd-11[61129]: 2024-09-12T02:51:09.292+0000 7ff146fac640 -1 osd.11 112 heartbeat_check: no reply from 172.21.15.39:6806 osd.0 since back 2024-09-12T02:50:09.449223+0000 front 2024-09-12T02:50:09.449210+0000 (oldest deadline 2024-09-12T02:50:34.748980+0000) 2024-09-12T02:51:09.764 INFO:journalctl@ceph.osd.11.smithi172.stdout:Sep 12 02:51:09 smithi172 ceph-4954ed46-70ae-11ef-bcea-c7b262605968-osd-11[61129]: 2024-09-12T02:51:09.292+0000 7ff146fac640 -1 osd.11 112 heartbeat_check: no reply from 172.21.15.44:6804 osd.1 since back 2024-09-12T02:50:14.749696+0000 front 2024-09-12T02:50:14.749454+0000 (oldest deadline 2024-09-12T02:50:42.950102+0000) 2024-09-12T02:51:09.764 INFO:journalctl@ceph.osd.11.smithi172.stdout:Sep 12 02:51:09 smithi172 ceph-4954ed46-70ae-11ef-bcea-c7b262605968-osd-11[61129]: 2024-09-12T02:51:09.292+0000 7ff146fac640 -1 osd.11 112 heartbeat_check: no reply from 172.21.15.172:6804 osd.2 since back 2024-09-12T02:50:22.950505+0000 front 2024-09-12T02:50:22.950558+0000 (oldest deadline 2024-09-12T02:50:48.850680+0000) 2024-09-12T02:51:09.764 INFO:journalctl@ceph.osd.11.smithi172.stdout:Sep 12 02:51:09 smithi172 ceph-4954ed46-70ae-11ef-bcea-c7b262605968-osd-11[61129]: 2024-09-12T02:51:09.292+0000 7ff146fac640 -1 osd.11 112 heartbeat_check: no reply from 172.21.15.44:6812 osd.4 since back 2024-09-12T02:50:39.054153+0000 front 2024-09-12T02:50:39.054100+0000 (oldest deadline 2024-09-12T02:51:04.354015+0000) 2024-09-12T02:51:09.764 INFO:journalctl@ceph.osd.8.smithi172.stdout:Sep 12 02:51:09 smithi172 ceph-4954ed46-70ae-11ef-bcea-c7b262605968-osd-8[54149]: 2024-09-12T02:51:09.499+0000 7f07cfc64640 -1 osd.8 112 heartbeat_check: no reply from 172.21.15.44:6804 osd.1 since back 2024-09-12T02:50:15.561581+0000 front 2024-09-12T02:50:15.561700+0000 (oldest deadline 2024-09-12T02:50:41.362274+0000) 2024-09-12T02:51:09.764 INFO:journalctl@ceph.osd.8.smithi172.stdout:Sep 12 02:51:09 smithi172 ceph-4954ed46-70ae-11ef-bcea-c7b262605968-osd-8[54149]: 2024-09-12T02:51:09.499+0000 7f07cfc64640 -1 osd.8 112 heartbeat_check: no reply from 172.21.15.172:6804 osd.2 since back 2024-09-12T02:50:26.063273+0000 front 2024-09-12T02:50:26.063310+0000 (oldest deadline 2024-09-12T02:50:49.563398+0000) 2024-09-12T02:51:09.764 INFO:journalctl@ceph.osd.8.smithi172.stdout:Sep 12 02:51:09 smithi172 ceph-4954ed46-70ae-11ef-bcea-c7b262605968-osd-8[54149]: 2024-09-12T02:51:09.499+0000 7f07cfc64640 -1 osd.8 112 heartbeat_check: no reply from 172.21.15.39:6814 osd.3 since back 2024-09-12T02:50:31.864441+0000 front 2024-09-12T02:50:31.864414+0000 (oldest deadline 2024-09-12T02:50:55.364332+0000) 2024-09-12T02:51:09.764 INFO:journalctl@ceph.osd.8.smithi172.stdout:Sep 12 02:51:09 smithi172 ceph-4954ed46-70ae-11ef-bcea-c7b262605968-osd-8[54149]: 2024-09-12T02:51:09.499+0000 7f07cfc64640 -1 osd.8 112 heartbeat_check: no reply from 172.21.15.44:6812 osd.4 since back 2024-09-12T02:50:42.365825+0000 front 2024-09-12T02:50:42.365874+0000 (oldest deadline 2024-09-12T02:51:07.665896+0000) 2024-09-12T02:51:09.793 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-09-12T02:51:09.793 INFO:tasks.cephadm.osd.7:Stopped osd.7 2024-09-12T02:51:09.793 INFO:tasks.cephadm.osd.8:Stopping osd.8... 2024-09-12T02:51:09.793 DEBUG:teuthology.orchestra.run.smithi172:> sudo systemctl stop ceph-4954ed46-70ae-11ef-bcea-c7b262605968@osd.8 2024-09-12T02:51:10.118 INFO:journalctl@ceph.osd.8.smithi172.stdout:Sep 12 02:51:09 smithi172 systemd[1]: Stopping Ceph osd.8 for 4954ed46-70ae-11ef-bcea-c7b262605968... 2024-09-12T02:51:10.472 INFO:journalctl@ceph.osd.11.smithi172.stdout:Sep 12 02:51:10 smithi172 ceph-4954ed46-70ae-11ef-bcea-c7b262605968-osd-11[61129]: 2024-09-12T02:51:10.303+0000 7ff146fac640 -1 osd.11 112 heartbeat_check: no reply from 172.21.15.39:6806 osd.0 since back 2024-09-12T02:50:09.449223+0000 front 2024-09-12T02:50:09.449210+0000 (oldest deadline 2024-09-12T02:50:34.748980+0000) 2024-09-12T02:51:10.472 INFO:journalctl@ceph.osd.11.smithi172.stdout:Sep 12 02:51:10 smithi172 ceph-4954ed46-70ae-11ef-bcea-c7b262605968-osd-11[61129]: 2024-09-12T02:51:10.303+0000 7ff146fac640 -1 osd.11 112 heartbeat_check: no reply from 172.21.15.44:6804 osd.1 since back 2024-09-12T02:50:14.749696+0000 front 2024-09-12T02:50:14.749454+0000 (oldest deadline 2024-09-12T02:50:42.950102+0000) 2024-09-12T02:51:10.472 INFO:journalctl@ceph.osd.11.smithi172.stdout:Sep 12 02:51:10 smithi172 ceph-4954ed46-70ae-11ef-bcea-c7b262605968-osd-11[61129]: 2024-09-12T02:51:10.303+0000 7ff146fac640 -1 osd.11 112 heartbeat_check: no reply from 172.21.15.172:6804 osd.2 since back 2024-09-12T02:50:22.950505+0000 front 2024-09-12T02:50:22.950558+0000 (oldest deadline 2024-09-12T02:50:48.850680+0000) 2024-09-12T02:51:10.472 INFO:journalctl@ceph.osd.11.smithi172.stdout:Sep 12 02:51:10 smithi172 ceph-4954ed46-70ae-11ef-bcea-c7b262605968-osd-11[61129]: 2024-09-12T02:51:10.303+0000 7ff146fac640 -1 osd.11 112 heartbeat_check: no reply from 172.21.15.44:6812 osd.4 since back 2024-09-12T02:50:39.054153+0000 front 2024-09-12T02:50:39.054100+0000 (oldest deadline 2024-09-12T02:51:04.354015+0000) 2024-09-12T02:51:10.473 INFO:journalctl@ceph.osd.8.smithi172.stdout:Sep 12 02:51:10 smithi172 ceph-4954ed46-70ae-11ef-bcea-c7b262605968-osd-8[54149]: 2024-09-12T02:51:10.117+0000 7f07d364e640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-osd -n osd.8 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-09-12T02:51:10.473 INFO:journalctl@ceph.osd.8.smithi172.stdout:Sep 12 02:51:10 smithi172 ceph-4954ed46-70ae-11ef-bcea-c7b262605968-osd-8[54149]: 2024-09-12T02:51:10.117+0000 7f07d364e640 -1 osd.8 112 *** Got signal Terminated *** 2024-09-12T02:51:10.473 INFO:journalctl@ceph.osd.8.smithi172.stdout:Sep 12 02:51:10 smithi172 ceph-4954ed46-70ae-11ef-bcea-c7b262605968-osd-8[54149]: 2024-09-12T02:51:10.117+0000 7f07d364e640 -1 osd.8 112 *** Immediate shutdown (osd_fast_shutdown=true) *** 2024-09-12T02:51:10.473 INFO:journalctl@ceph.osd.8.smithi172.stdout:Sep 12 02:51:10 smithi172 ceph-4954ed46-70ae-11ef-bcea-c7b262605968-osd-8[54149]: 2024-09-12T02:51:10.471+0000 7f07cfc64640 -1 osd.8 112 heartbeat_check: no reply from 172.21.15.44:6804 osd.1 since back 2024-09-12T02:50:15.561581+0000 front 2024-09-12T02:50:15.561700+0000 (oldest deadline 2024-09-12T02:50:41.362274+0000) 2024-09-12T02:51:10.473 INFO:journalctl@ceph.osd.8.smithi172.stdout:Sep 12 02:51:10 smithi172 ceph-4954ed46-70ae-11ef-bcea-c7b262605968-osd-8[54149]: 2024-09-12T02:51:10.471+0000 7f07cfc64640 -1 osd.8 112 heartbeat_check: no reply from 172.21.15.172:6804 osd.2 since back 2024-09-12T02:50:26.063273+0000 front 2024-09-12T02:50:26.063310+0000 (oldest deadline 2024-09-12T02:50:49.563398+0000) 2024-09-12T02:51:10.473 INFO:journalctl@ceph.osd.8.smithi172.stdout:Sep 12 02:51:10 smithi172 ceph-4954ed46-70ae-11ef-bcea-c7b262605968-osd-8[54149]: 2024-09-12T02:51:10.471+0000 7f07cfc64640 -1 osd.8 112 heartbeat_check: no reply from 172.21.15.39:6814 osd.3 since back 2024-09-12T02:50:31.864441+0000 front 2024-09-12T02:50:31.864414+0000 (oldest deadline 2024-09-12T02:50:55.364332+0000) 2024-09-12T02:51:10.473 INFO:journalctl@ceph.osd.8.smithi172.stdout:Sep 12 02:51:10 smithi172 ceph-4954ed46-70ae-11ef-bcea-c7b262605968-osd-8[54149]: 2024-09-12T02:51:10.471+0000 7f07cfc64640 -1 osd.8 112 heartbeat_check: no reply from 172.21.15.44:6812 osd.4 since back 2024-09-12T02:50:42.365825+0000 front 2024-09-12T02:50:42.365874+0000 (oldest deadline 2024-09-12T02:51:07.665896+0000) 2024-09-12T02:51:10.501 INFO:journalctl@ceph.osd.9.smithi039.stdout:Sep 12 02:51:10 smithi039 ceph-4954ed46-70ae-11ef-bcea-c7b262605968-osd-9[63678]: 2024-09-12T02:51:10.156+0000 7f6d17a00640 -1 osd.9 112 heartbeat_check: no reply from 172.21.15.39:6806 osd.0 since back 2024-09-12T02:50:08.761527+0000 front 2024-09-12T02:50:08.761556+0000 (oldest deadline 2024-09-12T02:50:34.061510+0000) 2024-09-12T02:51:10.501 INFO:journalctl@ceph.osd.9.smithi039.stdout:Sep 12 02:51:10 smithi039 ceph-4954ed46-70ae-11ef-bcea-c7b262605968-osd-9[63678]: 2024-09-12T02:51:10.156+0000 7f6d17a00640 -1 osd.9 112 heartbeat_check: no reply from 172.21.15.44:6804 osd.1 since back 2024-09-12T02:50:14.062055+0000 front 2024-09-12T02:50:14.062119+0000 (oldest deadline 2024-09-12T02:50:38.761988+0000) 2024-09-12T02:51:10.502 INFO:journalctl@ceph.osd.9.smithi039.stdout:Sep 12 02:51:10 smithi039 ceph-4954ed46-70ae-11ef-bcea-c7b262605968-osd-9[63678]: 2024-09-12T02:51:10.156+0000 7f6d17a00640 -1 osd.9 112 heartbeat_check: no reply from 172.21.15.172:6804 osd.2 since back 2024-09-12T02:50:24.663318+0000 front 2024-09-12T02:50:24.663548+0000 (oldest deadline 2024-09-12T02:50:48.763108+0000) 2024-09-12T02:51:10.502 INFO:journalctl@ceph.osd.9.smithi039.stdout:Sep 12 02:51:10 smithi039 ceph-4954ed46-70ae-11ef-bcea-c7b262605968-osd-9[63678]: 2024-09-12T02:51:10.156+0000 7f6d17a00640 -1 osd.9 112 heartbeat_check: no reply from 172.21.15.39:6814 osd.3 since back 2024-09-12T02:50:33.464166+0000 front 2024-09-12T02:50:33.464108+0000 (oldest deadline 2024-09-12T02:50:55.164319+0000) 2024-09-12T02:51:10.502 INFO:journalctl@ceph.osd.9.smithi039.stdout:Sep 12 02:51:10 smithi039 ceph-4954ed46-70ae-11ef-bcea-c7b262605968-osd-9[63678]: 2024-09-12T02:51:10.156+0000 7f6d17a00640 -1 osd.9 112 heartbeat_check: no reply from 172.21.15.44:6812 osd.4 since back 2024-09-12T02:50:41.566107+0000 front 2024-09-12T02:50:41.565926+0000 (oldest deadline 2024-09-12T02:51:05.065942+0000) 2024-09-12T02:51:10.948 INFO:journalctl@ceph.osd.10.smithi044.stdout:Sep 12 02:51:10 smithi044 ceph-4954ed46-70ae-11ef-bcea-c7b262605968-osd-10[59969]: 2024-09-12T02:51:10.679+0000 7faa46dc6640 -1 osd.10 112 heartbeat_check: no reply from 172.21.15.39:6806 osd.0 since back 2024-09-12T02:50:05.367150+0000 front 2024-09-12T02:50:05.367381+0000 (oldest deadline 2024-09-12T02:50:31.267058+0000) 2024-09-12T02:51:10.949 INFO:journalctl@ceph.osd.10.smithi044.stdout:Sep 12 02:51:10 smithi044 ceph-4954ed46-70ae-11ef-bcea-c7b262605968-osd-10[59969]: 2024-09-12T02:51:10.679+0000 7faa46dc6640 -1 osd.10 112 heartbeat_check: no reply from 172.21.15.44:6804 osd.1 since back 2024-09-12T02:50:17.969767+0000 front 2024-09-12T02:50:17.969892+0000 (oldest deadline 2024-09-12T02:50:40.270033+0000) 2024-09-12T02:51:10.949 INFO:journalctl@ceph.osd.10.smithi044.stdout:Sep 12 02:51:10 smithi044 ceph-4954ed46-70ae-11ef-bcea-c7b262605968-osd-10[59969]: 2024-09-12T02:51:10.679+0000 7faa46dc6640 -1 osd.10 112 heartbeat_check: no reply from 172.21.15.172:6804 osd.2 since back 2024-09-12T02:50:25.972029+0000 front 2024-09-12T02:50:25.972168+0000 (oldest deadline 2024-09-12T02:50:47.671992+0000) 2024-09-12T02:51:10.949 INFO:journalctl@ceph.osd.10.smithi044.stdout:Sep 12 02:51:10 smithi044 ceph-4954ed46-70ae-11ef-bcea-c7b262605968-osd-10[59969]: 2024-09-12T02:51:10.679+0000 7faa46dc6640 -1 osd.10 112 heartbeat_check: no reply from 172.21.15.39:6814 osd.3 since back 2024-09-12T02:50:31.673509+0000 front 2024-09-12T02:50:31.673612+0000 (oldest deadline 2024-09-12T02:50:56.973525+0000) 2024-09-12T02:51:10.949 INFO:journalctl@ceph.osd.10.smithi044.stdout:Sep 12 02:51:10 smithi044 ceph-4954ed46-70ae-11ef-bcea-c7b262605968-osd-10[59969]: 2024-09-12T02:51:10.679+0000 7faa46dc6640 -1 osd.10 112 heartbeat_check: no reply from 172.21.15.44:6812 osd.4 since back 2024-09-12T02:50:42.274445+0000 front 2024-09-12T02:50:42.274407+0000 (oldest deadline 2024-09-12T02:51:06.875067+0000) 2024-09-12T02:51:11.600 INFO:journalctl@ceph.osd.9.smithi039.stdout:Sep 12 02:51:11 smithi039 ceph-4954ed46-70ae-11ef-bcea-c7b262605968-osd-9[63678]: 2024-09-12T02:51:11.138+0000 7f6d17a00640 -1 osd.9 112 heartbeat_check: no reply from 172.21.15.39:6806 osd.0 since back 2024-09-12T02:50:08.761527+0000 front 2024-09-12T02:50:08.761556+0000 (oldest deadline 2024-09-12T02:50:34.061510+0000) 2024-09-12T02:51:11.600 INFO:journalctl@ceph.osd.9.smithi039.stdout:Sep 12 02:51:11 smithi039 ceph-4954ed46-70ae-11ef-bcea-c7b262605968-osd-9[63678]: 2024-09-12T02:51:11.138+0000 7f6d17a00640 -1 osd.9 112 heartbeat_check: no reply from 172.21.15.44:6804 osd.1 since back 2024-09-12T02:50:14.062055+0000 front 2024-09-12T02:50:14.062119+0000 (oldest deadline 2024-09-12T02:50:38.761988+0000) 2024-09-12T02:51:11.600 INFO:journalctl@ceph.osd.9.smithi039.stdout:Sep 12 02:51:11 smithi039 ceph-4954ed46-70ae-11ef-bcea-c7b262605968-osd-9[63678]: 2024-09-12T02:51:11.138+0000 7f6d17a00640 -1 osd.9 112 heartbeat_check: no reply from 172.21.15.172:6804 osd.2 since back 2024-09-12T02:50:24.663318+0000 front 2024-09-12T02:50:24.663548+0000 (oldest deadline 2024-09-12T02:50:48.763108+0000) 2024-09-12T02:51:11.600 INFO:journalctl@ceph.osd.9.smithi039.stdout:Sep 12 02:51:11 smithi039 ceph-4954ed46-70ae-11ef-bcea-c7b262605968-osd-9[63678]: 2024-09-12T02:51:11.138+0000 7f6d17a00640 -1 osd.9 112 heartbeat_check: no reply from 172.21.15.39:6814 osd.3 since back 2024-09-12T02:50:33.464166+0000 front 2024-09-12T02:50:33.464108+0000 (oldest deadline 2024-09-12T02:50:55.164319+0000) 2024-09-12T02:51:11.600 INFO:journalctl@ceph.osd.9.smithi039.stdout:Sep 12 02:51:11 smithi039 ceph-4954ed46-70ae-11ef-bcea-c7b262605968-osd-9[63678]: 2024-09-12T02:51:11.138+0000 7f6d17a00640 -1 osd.9 112 heartbeat_check: no reply from 172.21.15.44:6812 osd.4 since back 2024-09-12T02:50:41.566107+0000 front 2024-09-12T02:50:41.565926+0000 (oldest deadline 2024-09-12T02:51:05.065942+0000) 2024-09-12T02:51:11.763 INFO:journalctl@ceph.osd.8.smithi172.stdout:Sep 12 02:51:11 smithi172 ceph-4954ed46-70ae-11ef-bcea-c7b262605968-osd-8[54149]: 2024-09-12T02:51:11.477+0000 7f07cfc64640 -1 osd.8 112 heartbeat_check: no reply from 172.21.15.44:6804 osd.1 since back 2024-09-12T02:50:15.561581+0000 front 2024-09-12T02:50:15.561700+0000 (oldest deadline 2024-09-12T02:50:41.362274+0000) 2024-09-12T02:51:11.763 INFO:journalctl@ceph.osd.8.smithi172.stdout:Sep 12 02:51:11 smithi172 ceph-4954ed46-70ae-11ef-bcea-c7b262605968-osd-8[54149]: 2024-09-12T02:51:11.477+0000 7f07cfc64640 -1 osd.8 112 heartbeat_check: no reply from 172.21.15.172:6804 osd.2 since back 2024-09-12T02:50:26.063273+0000 front 2024-09-12T02:50:26.063310+0000 (oldest deadline 2024-09-12T02:50:49.563398+0000) 2024-09-12T02:51:11.764 INFO:journalctl@ceph.osd.8.smithi172.stdout:Sep 12 02:51:11 smithi172 ceph-4954ed46-70ae-11ef-bcea-c7b262605968-osd-8[54149]: 2024-09-12T02:51:11.477+0000 7f07cfc64640 -1 osd.8 112 heartbeat_check: no reply from 172.21.15.39:6814 osd.3 since back 2024-09-12T02:50:31.864441+0000 front 2024-09-12T02:50:31.864414+0000 (oldest deadline 2024-09-12T02:50:55.364332+0000) 2024-09-12T02:51:11.764 INFO:journalctl@ceph.osd.8.smithi172.stdout:Sep 12 02:51:11 smithi172 ceph-4954ed46-70ae-11ef-bcea-c7b262605968-osd-8[54149]: 2024-09-12T02:51:11.477+0000 7f07cfc64640 -1 osd.8 112 heartbeat_check: no reply from 172.21.15.44:6812 osd.4 since back 2024-09-12T02:50:42.365825+0000 front 2024-09-12T02:50:42.365874+0000 (oldest deadline 2024-09-12T02:51:07.665896+0000) 2024-09-12T02:51:11.764 INFO:journalctl@ceph.osd.11.smithi172.stdout:Sep 12 02:51:11 smithi172 ceph-4954ed46-70ae-11ef-bcea-c7b262605968-osd-11[61129]: 2024-09-12T02:51:11.272+0000 7ff146fac640 -1 osd.11 112 heartbeat_check: no reply from 172.21.15.39:6806 osd.0 since back 2024-09-12T02:50:09.449223+0000 front 2024-09-12T02:50:09.449210+0000 (oldest deadline 2024-09-12T02:50:34.748980+0000) 2024-09-12T02:51:11.764 INFO:journalctl@ceph.osd.11.smithi172.stdout:Sep 12 02:51:11 smithi172 ceph-4954ed46-70ae-11ef-bcea-c7b262605968-osd-11[61129]: 2024-09-12T02:51:11.272+0000 7ff146fac640 -1 osd.11 112 heartbeat_check: no reply from 172.21.15.44:6804 osd.1 since back 2024-09-12T02:50:14.749696+0000 front 2024-09-12T02:50:14.749454+0000 (oldest deadline 2024-09-12T02:50:42.950102+0000) 2024-09-12T02:51:11.764 INFO:journalctl@ceph.osd.11.smithi172.stdout:Sep 12 02:51:11 smithi172 ceph-4954ed46-70ae-11ef-bcea-c7b262605968-osd-11[61129]: 2024-09-12T02:51:11.272+0000 7ff146fac640 -1 osd.11 112 heartbeat_check: no reply from 172.21.15.172:6804 osd.2 since back 2024-09-12T02:50:22.950505+0000 front 2024-09-12T02:50:22.950558+0000 (oldest deadline 2024-09-12T02:50:48.850680+0000) 2024-09-12T02:51:11.764 INFO:journalctl@ceph.osd.11.smithi172.stdout:Sep 12 02:51:11 smithi172 ceph-4954ed46-70ae-11ef-bcea-c7b262605968-osd-11[61129]: 2024-09-12T02:51:11.272+0000 7ff146fac640 -1 osd.11 112 heartbeat_check: no reply from 172.21.15.44:6812 osd.4 since back 2024-09-12T02:50:39.054153+0000 front 2024-09-12T02:50:39.054100+0000 (oldest deadline 2024-09-12T02:51:04.354015+0000) 2024-09-12T02:51:11.948 INFO:journalctl@ceph.osd.10.smithi044.stdout:Sep 12 02:51:11 smithi044 ceph-4954ed46-70ae-11ef-bcea-c7b262605968-osd-10[59969]: 2024-09-12T02:51:11.682+0000 7faa46dc6640 -1 osd.10 112 heartbeat_check: no reply from 172.21.15.39:6806 osd.0 since back 2024-09-12T02:50:05.367150+0000 front 2024-09-12T02:50:05.367381+0000 (oldest deadline 2024-09-12T02:50:31.267058+0000) 2024-09-12T02:51:11.949 INFO:journalctl@ceph.osd.10.smithi044.stdout:Sep 12 02:51:11 smithi044 ceph-4954ed46-70ae-11ef-bcea-c7b262605968-osd-10[59969]: 2024-09-12T02:51:11.682+0000 7faa46dc6640 -1 osd.10 112 heartbeat_check: no reply from 172.21.15.44:6804 osd.1 since back 2024-09-12T02:50:17.969767+0000 front 2024-09-12T02:50:17.969892+0000 (oldest deadline 2024-09-12T02:50:40.270033+0000) 2024-09-12T02:51:11.949 INFO:journalctl@ceph.osd.10.smithi044.stdout:Sep 12 02:51:11 smithi044 ceph-4954ed46-70ae-11ef-bcea-c7b262605968-osd-10[59969]: 2024-09-12T02:51:11.682+0000 7faa46dc6640 -1 osd.10 112 heartbeat_check: no reply from 172.21.15.172:6804 osd.2 since back 2024-09-12T02:50:25.972029+0000 front 2024-09-12T02:50:25.972168+0000 (oldest deadline 2024-09-12T02:50:47.671992+0000) 2024-09-12T02:51:11.949 INFO:journalctl@ceph.osd.10.smithi044.stdout:Sep 12 02:51:11 smithi044 ceph-4954ed46-70ae-11ef-bcea-c7b262605968-osd-10[59969]: 2024-09-12T02:51:11.682+0000 7faa46dc6640 -1 osd.10 112 heartbeat_check: no reply from 172.21.15.39:6814 osd.3 since back 2024-09-12T02:50:31.673509+0000 front 2024-09-12T02:50:31.673612+0000 (oldest deadline 2024-09-12T02:50:56.973525+0000) 2024-09-12T02:51:11.949 INFO:journalctl@ceph.osd.10.smithi044.stdout:Sep 12 02:51:11 smithi044 ceph-4954ed46-70ae-11ef-bcea-c7b262605968-osd-10[59969]: 2024-09-12T02:51:11.682+0000 7faa46dc6640 -1 osd.10 112 heartbeat_check: no reply from 172.21.15.44:6812 osd.4 since back 2024-09-12T02:50:42.274445+0000 front 2024-09-12T02:50:42.274407+0000 (oldest deadline 2024-09-12T02:51:06.875067+0000) 2024-09-12T02:51:12.350 INFO:journalctl@ceph.osd.9.smithi039.stdout:Sep 12 02:51:12 smithi039 ceph-4954ed46-70ae-11ef-bcea-c7b262605968-osd-9[63678]: 2024-09-12T02:51:12.132+0000 7f6d17a00640 -1 osd.9 112 heartbeat_check: no reply from 172.21.15.39:6806 osd.0 since back 2024-09-12T02:50:08.761527+0000 front 2024-09-12T02:50:08.761556+0000 (oldest deadline 2024-09-12T02:50:34.061510+0000) 2024-09-12T02:51:12.350 INFO:journalctl@ceph.osd.9.smithi039.stdout:Sep 12 02:51:12 smithi039 ceph-4954ed46-70ae-11ef-bcea-c7b262605968-osd-9[63678]: 2024-09-12T02:51:12.132+0000 7f6d17a00640 -1 osd.9 112 heartbeat_check: no reply from 172.21.15.44:6804 osd.1 since back 2024-09-12T02:50:14.062055+0000 front 2024-09-12T02:50:14.062119+0000 (oldest deadline 2024-09-12T02:50:38.761988+0000) 2024-09-12T02:51:12.350 INFO:journalctl@ceph.osd.9.smithi039.stdout:Sep 12 02:51:12 smithi039 ceph-4954ed46-70ae-11ef-bcea-c7b262605968-osd-9[63678]: 2024-09-12T02:51:12.132+0000 7f6d17a00640 -1 osd.9 112 heartbeat_check: no reply from 172.21.15.172:6804 osd.2 since back 2024-09-12T02:50:24.663318+0000 front 2024-09-12T02:50:24.663548+0000 (oldest deadline 2024-09-12T02:50:48.763108+0000) 2024-09-12T02:51:12.350 INFO:journalctl@ceph.osd.9.smithi039.stdout:Sep 12 02:51:12 smithi039 ceph-4954ed46-70ae-11ef-bcea-c7b262605968-osd-9[63678]: 2024-09-12T02:51:12.132+0000 7f6d17a00640 -1 osd.9 112 heartbeat_check: no reply from 172.21.15.39:6814 osd.3 since back 2024-09-12T02:50:33.464166+0000 front 2024-09-12T02:50:33.464108+0000 (oldest deadline 2024-09-12T02:50:55.164319+0000) 2024-09-12T02:51:12.350 INFO:journalctl@ceph.osd.9.smithi039.stdout:Sep 12 02:51:12 smithi039 ceph-4954ed46-70ae-11ef-bcea-c7b262605968-osd-9[63678]: 2024-09-12T02:51:12.132+0000 7f6d17a00640 -1 osd.9 112 heartbeat_check: no reply from 172.21.15.44:6812 osd.4 since back 2024-09-12T02:50:41.566107+0000 front 2024-09-12T02:50:41.565926+0000 (oldest deadline 2024-09-12T02:51:05.065942+0000) 2024-09-12T02:51:12.763 INFO:journalctl@ceph.osd.8.smithi172.stdout:Sep 12 02:51:12 smithi172 ceph-4954ed46-70ae-11ef-bcea-c7b262605968-osd-8[54149]: 2024-09-12T02:51:12.455+0000 7f07cfc64640 -1 osd.8 112 heartbeat_check: no reply from 172.21.15.44:6804 osd.1 since back 2024-09-12T02:50:15.561581+0000 front 2024-09-12T02:50:15.561700+0000 (oldest deadline 2024-09-12T02:50:41.362274+0000) 2024-09-12T02:51:12.763 INFO:journalctl@ceph.osd.8.smithi172.stdout:Sep 12 02:51:12 smithi172 ceph-4954ed46-70ae-11ef-bcea-c7b262605968-osd-8[54149]: 2024-09-12T02:51:12.455+0000 7f07cfc64640 -1 osd.8 112 heartbeat_check: no reply from 172.21.15.172:6804 osd.2 since back 2024-09-12T02:50:26.063273+0000 front 2024-09-12T02:50:26.063310+0000 (oldest deadline 2024-09-12T02:50:49.563398+0000) 2024-09-12T02:51:12.764 INFO:journalctl@ceph.osd.8.smithi172.stdout:Sep 12 02:51:12 smithi172 ceph-4954ed46-70ae-11ef-bcea-c7b262605968-osd-8[54149]: 2024-09-12T02:51:12.455+0000 7f07cfc64640 -1 osd.8 112 heartbeat_check: no reply from 172.21.15.39:6814 osd.3 since back 2024-09-12T02:50:31.864441+0000 front 2024-09-12T02:50:31.864414+0000 (oldest deadline 2024-09-12T02:50:55.364332+0000) 2024-09-12T02:51:12.764 INFO:journalctl@ceph.osd.8.smithi172.stdout:Sep 12 02:51:12 smithi172 ceph-4954ed46-70ae-11ef-bcea-c7b262605968-osd-8[54149]: 2024-09-12T02:51:12.455+0000 7f07cfc64640 -1 osd.8 112 heartbeat_check: no reply from 172.21.15.44:6812 osd.4 since back 2024-09-12T02:50:42.365825+0000 front 2024-09-12T02:50:42.365874+0000 (oldest deadline 2024-09-12T02:51:07.665896+0000) 2024-09-12T02:51:12.764 INFO:journalctl@ceph.osd.11.smithi172.stdout:Sep 12 02:51:12 smithi172 ceph-4954ed46-70ae-11ef-bcea-c7b262605968-osd-11[61129]: 2024-09-12T02:51:12.306+0000 7ff146fac640 -1 osd.11 112 heartbeat_check: no reply from 172.21.15.39:6806 osd.0 since back 2024-09-12T02:50:09.449223+0000 front 2024-09-12T02:50:09.449210+0000 (oldest deadline 2024-09-12T02:50:34.748980+0000) 2024-09-12T02:51:12.764 INFO:journalctl@ceph.osd.11.smithi172.stdout:Sep 12 02:51:12 smithi172 ceph-4954ed46-70ae-11ef-bcea-c7b262605968-osd-11[61129]: 2024-09-12T02:51:12.306+0000 7ff146fac640 -1 osd.11 112 heartbeat_check: no reply from 172.21.15.44:6804 osd.1 since back 2024-09-12T02:50:14.749696+0000 front 2024-09-12T02:50:14.749454+0000 (oldest deadline 2024-09-12T02:50:42.950102+0000) 2024-09-12T02:51:12.764 INFO:journalctl@ceph.osd.11.smithi172.stdout:Sep 12 02:51:12 smithi172 ceph-4954ed46-70ae-11ef-bcea-c7b262605968-osd-11[61129]: 2024-09-12T02:51:12.306+0000 7ff146fac640 -1 osd.11 112 heartbeat_check: no reply from 172.21.15.172:6804 osd.2 since back 2024-09-12T02:50:22.950505+0000 front 2024-09-12T02:50:22.950558+0000 (oldest deadline 2024-09-12T02:50:48.850680+0000) 2024-09-12T02:51:12.764 INFO:journalctl@ceph.osd.11.smithi172.stdout:Sep 12 02:51:12 smithi172 ceph-4954ed46-70ae-11ef-bcea-c7b262605968-osd-11[61129]: 2024-09-12T02:51:12.306+0000 7ff146fac640 -1 osd.11 112 heartbeat_check: no reply from 172.21.15.44:6812 osd.4 since back 2024-09-12T02:50:39.054153+0000 front 2024-09-12T02:50:39.054100+0000 (oldest deadline 2024-09-12T02:51:04.354015+0000) 2024-09-12T02:51:12.949 INFO:journalctl@ceph.osd.10.smithi044.stdout:Sep 12 02:51:12 smithi044 ceph-4954ed46-70ae-11ef-bcea-c7b262605968-osd-10[59969]: 2024-09-12T02:51:12.646+0000 7faa46dc6640 -1 osd.10 112 heartbeat_check: no reply from 172.21.15.39:6806 osd.0 since back 2024-09-12T02:50:05.367150+0000 front 2024-09-12T02:50:05.367381+0000 (oldest deadline 2024-09-12T02:50:31.267058+0000) 2024-09-12T02:51:12.949 INFO:journalctl@ceph.osd.10.smithi044.stdout:Sep 12 02:51:12 smithi044 ceph-4954ed46-70ae-11ef-bcea-c7b262605968-osd-10[59969]: 2024-09-12T02:51:12.646+0000 7faa46dc6640 -1 osd.10 112 heartbeat_check: no reply from 172.21.15.44:6804 osd.1 since back 2024-09-12T02:50:17.969767+0000 front 2024-09-12T02:50:17.969892+0000 (oldest deadline 2024-09-12T02:50:40.270033+0000) 2024-09-12T02:51:12.949 INFO:journalctl@ceph.osd.10.smithi044.stdout:Sep 12 02:51:12 smithi044 ceph-4954ed46-70ae-11ef-bcea-c7b262605968-osd-10[59969]: 2024-09-12T02:51:12.646+0000 7faa46dc6640 -1 osd.10 112 heartbeat_check: no reply from 172.21.15.172:6804 osd.2 since back 2024-09-12T02:50:25.972029+0000 front 2024-09-12T02:50:25.972168+0000 (oldest deadline 2024-09-12T02:50:47.671992+0000) 2024-09-12T02:51:12.949 INFO:journalctl@ceph.osd.10.smithi044.stdout:Sep 12 02:51:12 smithi044 ceph-4954ed46-70ae-11ef-bcea-c7b262605968-osd-10[59969]: 2024-09-12T02:51:12.646+0000 7faa46dc6640 -1 osd.10 112 heartbeat_check: no reply from 172.21.15.39:6814 osd.3 since back 2024-09-12T02:50:31.673509+0000 front 2024-09-12T02:50:31.673612+0000 (oldest deadline 2024-09-12T02:50:56.973525+0000) 2024-09-12T02:51:12.949 INFO:journalctl@ceph.osd.10.smithi044.stdout:Sep 12 02:51:12 smithi044 ceph-4954ed46-70ae-11ef-bcea-c7b262605968-osd-10[59969]: 2024-09-12T02:51:12.646+0000 7faa46dc6640 -1 osd.10 112 heartbeat_check: no reply from 172.21.15.44:6812 osd.4 since back 2024-09-12T02:50:42.274445+0000 front 2024-09-12T02:50:42.274407+0000 (oldest deadline 2024-09-12T02:51:06.875067+0000) 2024-09-12T02:51:13.599 INFO:journalctl@ceph.osd.9.smithi039.stdout:Sep 12 02:51:13 smithi039 ceph-4954ed46-70ae-11ef-bcea-c7b262605968-osd-9[63678]: 2024-09-12T02:51:13.124+0000 7f6d17a00640 -1 osd.9 112 heartbeat_check: no reply from 172.21.15.39:6806 osd.0 since back 2024-09-12T02:50:08.761527+0000 front 2024-09-12T02:50:08.761556+0000 (oldest deadline 2024-09-12T02:50:34.061510+0000) 2024-09-12T02:51:13.600 INFO:journalctl@ceph.osd.9.smithi039.stdout:Sep 12 02:51:13 smithi039 ceph-4954ed46-70ae-11ef-bcea-c7b262605968-osd-9[63678]: 2024-09-12T02:51:13.124+0000 7f6d17a00640 -1 osd.9 112 heartbeat_check: no reply from 172.21.15.44:6804 osd.1 since back 2024-09-12T02:50:14.062055+0000 front 2024-09-12T02:50:14.062119+0000 (oldest deadline 2024-09-12T02:50:38.761988+0000) 2024-09-12T02:51:13.600 INFO:journalctl@ceph.osd.9.smithi039.stdout:Sep 12 02:51:13 smithi039 ceph-4954ed46-70ae-11ef-bcea-c7b262605968-osd-9[63678]: 2024-09-12T02:51:13.124+0000 7f6d17a00640 -1 osd.9 112 heartbeat_check: no reply from 172.21.15.172:6804 osd.2 since back 2024-09-12T02:50:24.663318+0000 front 2024-09-12T02:50:24.663548+0000 (oldest deadline 2024-09-12T02:50:48.763108+0000) 2024-09-12T02:51:13.600 INFO:journalctl@ceph.osd.9.smithi039.stdout:Sep 12 02:51:13 smithi039 ceph-4954ed46-70ae-11ef-bcea-c7b262605968-osd-9[63678]: 2024-09-12T02:51:13.124+0000 7f6d17a00640 -1 osd.9 112 heartbeat_check: no reply from 172.21.15.39:6814 osd.3 since back 2024-09-12T02:50:33.464166+0000 front 2024-09-12T02:50:33.464108+0000 (oldest deadline 2024-09-12T02:50:55.164319+0000) 2024-09-12T02:51:13.600 INFO:journalctl@ceph.osd.9.smithi039.stdout:Sep 12 02:51:13 smithi039 ceph-4954ed46-70ae-11ef-bcea-c7b262605968-osd-9[63678]: 2024-09-12T02:51:13.124+0000 7f6d17a00640 -1 osd.9 112 heartbeat_check: no reply from 172.21.15.44:6812 osd.4 since back 2024-09-12T02:50:41.566107+0000 front 2024-09-12T02:50:41.565926+0000 (oldest deadline 2024-09-12T02:51:05.065942+0000) 2024-09-12T02:51:13.600 INFO:journalctl@ceph.osd.9.smithi039.stdout:Sep 12 02:51:13 smithi039 ceph-4954ed46-70ae-11ef-bcea-c7b262605968-osd-9[63678]: 2024-09-12T02:51:13.124+0000 7f6d17a00640 -1 osd.9 112 heartbeat_check: no reply from 172.21.15.172:6812 osd.5 since back 2024-09-12T02:50:46.667755+0000 front 2024-09-12T02:50:46.667507+0000 (oldest deadline 2024-09-12T02:51:12.567249+0000) 2024-09-12T02:51:13.763 INFO:journalctl@ceph.osd.11.smithi172.stdout:Sep 12 02:51:13 smithi172 ceph-4954ed46-70ae-11ef-bcea-c7b262605968-osd-11[61129]: 2024-09-12T02:51:13.341+0000 7ff146fac640 -1 osd.11 112 heartbeat_check: no reply from 172.21.15.39:6806 osd.0 since back 2024-09-12T02:50:09.449223+0000 front 2024-09-12T02:50:09.449210+0000 (oldest deadline 2024-09-12T02:50:34.748980+0000) 2024-09-12T02:51:13.763 INFO:journalctl@ceph.osd.11.smithi172.stdout:Sep 12 02:51:13 smithi172 ceph-4954ed46-70ae-11ef-bcea-c7b262605968-osd-11[61129]: 2024-09-12T02:51:13.341+0000 7ff146fac640 -1 osd.11 112 heartbeat_check: no reply from 172.21.15.44:6804 osd.1 since back 2024-09-12T02:50:14.749696+0000 front 2024-09-12T02:50:14.749454+0000 (oldest deadline 2024-09-12T02:50:42.950102+0000) 2024-09-12T02:51:13.764 INFO:journalctl@ceph.osd.11.smithi172.stdout:Sep 12 02:51:13 smithi172 ceph-4954ed46-70ae-11ef-bcea-c7b262605968-osd-11[61129]: 2024-09-12T02:51:13.341+0000 7ff146fac640 -1 osd.11 112 heartbeat_check: no reply from 172.21.15.172:6804 osd.2 since back 2024-09-12T02:50:22.950505+0000 front 2024-09-12T02:50:22.950558+0000 (oldest deadline 2024-09-12T02:50:48.850680+0000) 2024-09-12T02:51:13.764 INFO:journalctl@ceph.osd.11.smithi172.stdout:Sep 12 02:51:13 smithi172 ceph-4954ed46-70ae-11ef-bcea-c7b262605968-osd-11[61129]: 2024-09-12T02:51:13.341+0000 7ff146fac640 -1 osd.11 112 heartbeat_check: no reply from 172.21.15.44:6812 osd.4 since back 2024-09-12T02:50:39.054153+0000 front 2024-09-12T02:50:39.054100+0000 (oldest deadline 2024-09-12T02:51:04.354015+0000) 2024-09-12T02:51:13.764 INFO:journalctl@ceph.osd.8.smithi172.stdout:Sep 12 02:51:13 smithi172 ceph-4954ed46-70ae-11ef-bcea-c7b262605968-osd-8[54149]: 2024-09-12T02:51:13.449+0000 7f07cfc64640 -1 osd.8 112 heartbeat_check: no reply from 172.21.15.44:6804 osd.1 since back 2024-09-12T02:50:15.561581+0000 front 2024-09-12T02:50:15.561700+0000 (oldest deadline 2024-09-12T02:50:41.362274+0000) 2024-09-12T02:51:13.764 INFO:journalctl@ceph.osd.8.smithi172.stdout:Sep 12 02:51:13 smithi172 ceph-4954ed46-70ae-11ef-bcea-c7b262605968-osd-8[54149]: 2024-09-12T02:51:13.449+0000 7f07cfc64640 -1 osd.8 112 heartbeat_check: no reply from 172.21.15.172:6804 osd.2 since back 2024-09-12T02:50:26.063273+0000 front 2024-09-12T02:50:26.063310+0000 (oldest deadline 2024-09-12T02:50:49.563398+0000) 2024-09-12T02:51:13.764 INFO:journalctl@ceph.osd.8.smithi172.stdout:Sep 12 02:51:13 smithi172 ceph-4954ed46-70ae-11ef-bcea-c7b262605968-osd-8[54149]: 2024-09-12T02:51:13.449+0000 7f07cfc64640 -1 osd.8 112 heartbeat_check: no reply from 172.21.15.39:6814 osd.3 since back 2024-09-12T02:50:31.864441+0000 front 2024-09-12T02:50:31.864414+0000 (oldest deadline 2024-09-12T02:50:55.364332+0000) 2024-09-12T02:51:13.764 INFO:journalctl@ceph.osd.8.smithi172.stdout:Sep 12 02:51:13 smithi172 ceph-4954ed46-70ae-11ef-bcea-c7b262605968-osd-8[54149]: 2024-09-12T02:51:13.449+0000 7f07cfc64640 -1 osd.8 112 heartbeat_check: no reply from 172.21.15.44:6812 osd.4 since back 2024-09-12T02:50:42.365825+0000 front 2024-09-12T02:50:42.365874+0000 (oldest deadline 2024-09-12T02:51:07.665896+0000) 2024-09-12T02:51:13.764 INFO:journalctl@ceph.osd.8.smithi172.stdout:Sep 12 02:51:13 smithi172 ceph-4954ed46-70ae-11ef-bcea-c7b262605968-osd-8[54149]: 2024-09-12T02:51:13.449+0000 7f07cfc64640 -1 osd.8 112 heartbeat_check: no reply from 172.21.15.172:6812 osd.5 since back 2024-09-12T02:50:47.666475+0000 front 2024-09-12T02:50:47.666517+0000 (oldest deadline 2024-09-12T02:51:12.966644+0000) 2024-09-12T02:51:13.948 INFO:journalctl@ceph.osd.10.smithi044.stdout:Sep 12 02:51:13 smithi044 ceph-4954ed46-70ae-11ef-bcea-c7b262605968-osd-10[59969]: 2024-09-12T02:51:13.631+0000 7faa46dc6640 -1 osd.10 112 heartbeat_check: no reply from 172.21.15.39:6806 osd.0 since back 2024-09-12T02:50:05.367150+0000 front 2024-09-12T02:50:05.367381+0000 (oldest deadline 2024-09-12T02:50:31.267058+0000) 2024-09-12T02:51:13.949 INFO:journalctl@ceph.osd.10.smithi044.stdout:Sep 12 02:51:13 smithi044 ceph-4954ed46-70ae-11ef-bcea-c7b262605968-osd-10[59969]: 2024-09-12T02:51:13.631+0000 7faa46dc6640 -1 osd.10 112 heartbeat_check: no reply from 172.21.15.44:6804 osd.1 since back 2024-09-12T02:50:17.969767+0000 front 2024-09-12T02:50:17.969892+0000 (oldest deadline 2024-09-12T02:50:40.270033+0000) 2024-09-12T02:51:13.949 INFO:journalctl@ceph.osd.10.smithi044.stdout:Sep 12 02:51:13 smithi044 ceph-4954ed46-70ae-11ef-bcea-c7b262605968-osd-10[59969]: 2024-09-12T02:51:13.631+0000 7faa46dc6640 -1 osd.10 112 heartbeat_check: no reply from 172.21.15.172:6804 osd.2 since back 2024-09-12T02:50:25.972029+0000 front 2024-09-12T02:50:25.972168+0000 (oldest deadline 2024-09-12T02:50:47.671992+0000) 2024-09-12T02:51:13.949 INFO:journalctl@ceph.osd.10.smithi044.stdout:Sep 12 02:51:13 smithi044 ceph-4954ed46-70ae-11ef-bcea-c7b262605968-osd-10[59969]: 2024-09-12T02:51:13.631+0000 7faa46dc6640 -1 osd.10 112 heartbeat_check: no reply from 172.21.15.39:6814 osd.3 since back 2024-09-12T02:50:31.673509+0000 front 2024-09-12T02:50:31.673612+0000 (oldest deadline 2024-09-12T02:50:56.973525+0000) 2024-09-12T02:51:13.949 INFO:journalctl@ceph.osd.10.smithi044.stdout:Sep 12 02:51:13 smithi044 ceph-4954ed46-70ae-11ef-bcea-c7b262605968-osd-10[59969]: 2024-09-12T02:51:13.631+0000 7faa46dc6640 -1 osd.10 112 heartbeat_check: no reply from 172.21.15.44:6812 osd.4 since back 2024-09-12T02:50:42.274445+0000 front 2024-09-12T02:50:42.274407+0000 (oldest deadline 2024-09-12T02:51:06.875067+0000) 2024-09-12T02:51:13.949 INFO:journalctl@ceph.osd.10.smithi044.stdout:Sep 12 02:51:13 smithi044 ceph-4954ed46-70ae-11ef-bcea-c7b262605968-osd-10[59969]: 2024-09-12T02:51:13.631+0000 7faa46dc6640 -1 osd.10 112 heartbeat_check: no reply from 172.21.15.172:6812 osd.5 since back 2024-09-12T02:50:46.875759+0000 front 2024-09-12T02:50:46.875831+0000 (oldest deadline 2024-09-12T02:51:12.775550+0000) 2024-09-12T02:51:14.600 INFO:journalctl@ceph.osd.9.smithi039.stdout:Sep 12 02:51:14 smithi039 ceph-4954ed46-70ae-11ef-bcea-c7b262605968-osd-9[63678]: 2024-09-12T02:51:14.168+0000 7f6d17a00640 -1 osd.9 112 heartbeat_check: no reply from 172.21.15.39:6806 osd.0 since back 2024-09-12T02:50:08.761527+0000 front 2024-09-12T02:50:08.761556+0000 (oldest deadline 2024-09-12T02:50:34.061510+0000) 2024-09-12T02:51:14.600 INFO:journalctl@ceph.osd.9.smithi039.stdout:Sep 12 02:51:14 smithi039 ceph-4954ed46-70ae-11ef-bcea-c7b262605968-osd-9[63678]: 2024-09-12T02:51:14.168+0000 7f6d17a00640 -1 osd.9 112 heartbeat_check: no reply from 172.21.15.44:6804 osd.1 since back 2024-09-12T02:50:14.062055+0000 front 2024-09-12T02:50:14.062119+0000 (oldest deadline 2024-09-12T02:50:38.761988+0000) 2024-09-12T02:51:14.600 INFO:journalctl@ceph.osd.9.smithi039.stdout:Sep 12 02:51:14 smithi039 ceph-4954ed46-70ae-11ef-bcea-c7b262605968-osd-9[63678]: 2024-09-12T02:51:14.168+0000 7f6d17a00640 -1 osd.9 112 heartbeat_check: no reply from 172.21.15.172:6804 osd.2 since back 2024-09-12T02:50:24.663318+0000 front 2024-09-12T02:50:24.663548+0000 (oldest deadline 2024-09-12T02:50:48.763108+0000) 2024-09-12T02:51:14.600 INFO:journalctl@ceph.osd.9.smithi039.stdout:Sep 12 02:51:14 smithi039 ceph-4954ed46-70ae-11ef-bcea-c7b262605968-osd-9[63678]: 2024-09-12T02:51:14.168+0000 7f6d17a00640 -1 osd.9 112 heartbeat_check: no reply from 172.21.15.39:6814 osd.3 since back 2024-09-12T02:50:33.464166+0000 front 2024-09-12T02:50:33.464108+0000 (oldest deadline 2024-09-12T02:50:55.164319+0000) 2024-09-12T02:51:14.600 INFO:journalctl@ceph.osd.9.smithi039.stdout:Sep 12 02:51:14 smithi039 ceph-4954ed46-70ae-11ef-bcea-c7b262605968-osd-9[63678]: 2024-09-12T02:51:14.168+0000 7f6d17a00640 -1 osd.9 112 heartbeat_check: no reply from 172.21.15.44:6812 osd.4 since back 2024-09-12T02:50:41.566107+0000 front 2024-09-12T02:50:41.565926+0000 (oldest deadline 2024-09-12T02:51:05.065942+0000) 2024-09-12T02:51:14.600 INFO:journalctl@ceph.osd.9.smithi039.stdout:Sep 12 02:51:14 smithi039 ceph-4954ed46-70ae-11ef-bcea-c7b262605968-osd-9[63678]: 2024-09-12T02:51:14.168+0000 7f6d17a00640 -1 osd.9 112 heartbeat_check: no reply from 172.21.15.172:6812 osd.5 since back 2024-09-12T02:50:46.667755+0000 front 2024-09-12T02:50:46.667507+0000 (oldest deadline 2024-09-12T02:51:12.567249+0000) 2024-09-12T02:51:14.763 INFO:journalctl@ceph.osd.11.smithi172.stdout:Sep 12 02:51:14 smithi172 ceph-4954ed46-70ae-11ef-bcea-c7b262605968-osd-11[61129]: 2024-09-12T02:51:14.326+0000 7ff146fac640 -1 osd.11 112 heartbeat_check: no reply from 172.21.15.39:6806 osd.0 since back 2024-09-12T02:50:09.449223+0000 front 2024-09-12T02:50:09.449210+0000 (oldest deadline 2024-09-12T02:50:34.748980+0000) 2024-09-12T02:51:14.764 INFO:journalctl@ceph.osd.11.smithi172.stdout:Sep 12 02:51:14 smithi172 ceph-4954ed46-70ae-11ef-bcea-c7b262605968-osd-11[61129]: 2024-09-12T02:51:14.326+0000 7ff146fac640 -1 osd.11 112 heartbeat_check: no reply from 172.21.15.44:6804 osd.1 since back 2024-09-12T02:50:14.749696+0000 front 2024-09-12T02:50:14.749454+0000 (oldest deadline 2024-09-12T02:50:42.950102+0000) 2024-09-12T02:51:14.764 INFO:journalctl@ceph.osd.11.smithi172.stdout:Sep 12 02:51:14 smithi172 ceph-4954ed46-70ae-11ef-bcea-c7b262605968-osd-11[61129]: 2024-09-12T02:51:14.326+0000 7ff146fac640 -1 osd.11 112 heartbeat_check: no reply from 172.21.15.172:6804 osd.2 since back 2024-09-12T02:50:22.950505+0000 front 2024-09-12T02:50:22.950558+0000 (oldest deadline 2024-09-12T02:50:48.850680+0000) 2024-09-12T02:51:14.764 INFO:journalctl@ceph.osd.11.smithi172.stdout:Sep 12 02:51:14 smithi172 ceph-4954ed46-70ae-11ef-bcea-c7b262605968-osd-11[61129]: 2024-09-12T02:51:14.326+0000 7ff146fac640 -1 osd.11 112 heartbeat_check: no reply from 172.21.15.44:6812 osd.4 since back 2024-09-12T02:50:39.054153+0000 front 2024-09-12T02:50:39.054100+0000 (oldest deadline 2024-09-12T02:51:04.354015+0000) 2024-09-12T02:51:14.764 INFO:journalctl@ceph.osd.8.smithi172.stdout:Sep 12 02:51:14 smithi172 ceph-4954ed46-70ae-11ef-bcea-c7b262605968-osd-8[54149]: 2024-09-12T02:51:14.498+0000 7f07cfc64640 -1 osd.8 112 heartbeat_check: no reply from 172.21.15.44:6804 osd.1 since back 2024-09-12T02:50:15.561581+0000 front 2024-09-12T02:50:15.561700+0000 (oldest deadline 2024-09-12T02:50:41.362274+0000) 2024-09-12T02:51:14.764 INFO:journalctl@ceph.osd.8.smithi172.stdout:Sep 12 02:51:14 smithi172 ceph-4954ed46-70ae-11ef-bcea-c7b262605968-osd-8[54149]: 2024-09-12T02:51:14.498+0000 7f07cfc64640 -1 osd.8 112 heartbeat_check: no reply from 172.21.15.172:6804 osd.2 since back 2024-09-12T02:50:26.063273+0000 front 2024-09-12T02:50:26.063310+0000 (oldest deadline 2024-09-12T02:50:49.563398+0000) 2024-09-12T02:51:14.764 INFO:journalctl@ceph.osd.8.smithi172.stdout:Sep 12 02:51:14 smithi172 ceph-4954ed46-70ae-11ef-bcea-c7b262605968-osd-8[54149]: 2024-09-12T02:51:14.498+0000 7f07cfc64640 -1 osd.8 112 heartbeat_check: no reply from 172.21.15.39:6814 osd.3 since back 2024-09-12T02:50:31.864441+0000 front 2024-09-12T02:50:31.864414+0000 (oldest deadline 2024-09-12T02:50:55.364332+0000) 2024-09-12T02:51:14.764 INFO:journalctl@ceph.osd.8.smithi172.stdout:Sep 12 02:51:14 smithi172 ceph-4954ed46-70ae-11ef-bcea-c7b262605968-osd-8[54149]: 2024-09-12T02:51:14.498+0000 7f07cfc64640 -1 osd.8 112 heartbeat_check: no reply from 172.21.15.44:6812 osd.4 since back 2024-09-12T02:50:42.365825+0000 front 2024-09-12T02:50:42.365874+0000 (oldest deadline 2024-09-12T02:51:07.665896+0000) 2024-09-12T02:51:14.764 INFO:journalctl@ceph.osd.8.smithi172.stdout:Sep 12 02:51:14 smithi172 ceph-4954ed46-70ae-11ef-bcea-c7b262605968-osd-8[54149]: 2024-09-12T02:51:14.498+0000 7f07cfc64640 -1 osd.8 112 heartbeat_check: no reply from 172.21.15.172:6812 osd.5 since back 2024-09-12T02:50:47.666475+0000 front 2024-09-12T02:50:47.666517+0000 (oldest deadline 2024-09-12T02:51:12.966644+0000) 2024-09-12T02:51:14.949 INFO:journalctl@ceph.osd.10.smithi044.stdout:Sep 12 02:51:14 smithi044 ceph-4954ed46-70ae-11ef-bcea-c7b262605968-osd-10[59969]: 2024-09-12T02:51:14.623+0000 7faa46dc6640 -1 osd.10 112 heartbeat_check: no reply from 172.21.15.39:6806 osd.0 since back 2024-09-12T02:50:05.367150+0000 front 2024-09-12T02:50:05.367381+0000 (oldest deadline 2024-09-12T02:50:31.267058+0000) 2024-09-12T02:51:14.949 INFO:journalctl@ceph.osd.10.smithi044.stdout:Sep 12 02:51:14 smithi044 ceph-4954ed46-70ae-11ef-bcea-c7b262605968-osd-10[59969]: 2024-09-12T02:51:14.623+0000 7faa46dc6640 -1 osd.10 112 heartbeat_check: no reply from 172.21.15.44:6804 osd.1 since back 2024-09-12T02:50:17.969767+0000 front 2024-09-12T02:50:17.969892+0000 (oldest deadline 2024-09-12T02:50:40.270033+0000) 2024-09-12T02:51:14.949 INFO:journalctl@ceph.osd.10.smithi044.stdout:Sep 12 02:51:14 smithi044 ceph-4954ed46-70ae-11ef-bcea-c7b262605968-osd-10[59969]: 2024-09-12T02:51:14.623+0000 7faa46dc6640 -1 osd.10 112 heartbeat_check: no reply from 172.21.15.172:6804 osd.2 since back 2024-09-12T02:50:25.972029+0000 front 2024-09-12T02:50:25.972168+0000 (oldest deadline 2024-09-12T02:50:47.671992+0000) 2024-09-12T02:51:14.949 INFO:journalctl@ceph.osd.10.smithi044.stdout:Sep 12 02:51:14 smithi044 ceph-4954ed46-70ae-11ef-bcea-c7b262605968-osd-10[59969]: 2024-09-12T02:51:14.623+0000 7faa46dc6640 -1 osd.10 112 heartbeat_check: no reply from 172.21.15.39:6814 osd.3 since back 2024-09-12T02:50:31.673509+0000 front 2024-09-12T02:50:31.673612+0000 (oldest deadline 2024-09-12T02:50:56.973525+0000) 2024-09-12T02:51:14.949 INFO:journalctl@ceph.osd.10.smithi044.stdout:Sep 12 02:51:14 smithi044 ceph-4954ed46-70ae-11ef-bcea-c7b262605968-osd-10[59969]: 2024-09-12T02:51:14.623+0000 7faa46dc6640 -1 osd.10 112 heartbeat_check: no reply from 172.21.15.44:6812 osd.4 since back 2024-09-12T02:50:42.274445+0000 front 2024-09-12T02:50:42.274407+0000 (oldest deadline 2024-09-12T02:51:06.875067+0000) 2024-09-12T02:51:14.949 INFO:journalctl@ceph.osd.10.smithi044.stdout:Sep 12 02:51:14 smithi044 ceph-4954ed46-70ae-11ef-bcea-c7b262605968-osd-10[59969]: 2024-09-12T02:51:14.623+0000 7faa46dc6640 -1 osd.10 112 heartbeat_check: no reply from 172.21.15.172:6812 osd.5 since back 2024-09-12T02:50:46.875759+0000 front 2024-09-12T02:50:46.875831+0000 (oldest deadline 2024-09-12T02:51:12.775550+0000) 2024-09-12T02:51:15.600 INFO:journalctl@ceph.osd.9.smithi039.stdout:Sep 12 02:51:15 smithi039 ceph-4954ed46-70ae-11ef-bcea-c7b262605968-osd-9[63678]: 2024-09-12T02:51:15.155+0000 7f6d17a00640 -1 osd.9 112 heartbeat_check: no reply from 172.21.15.39:6806 osd.0 since back 2024-09-12T02:50:08.761527+0000 front 2024-09-12T02:50:08.761556+0000 (oldest deadline 2024-09-12T02:50:34.061510+0000) 2024-09-12T02:51:15.600 INFO:journalctl@ceph.osd.9.smithi039.stdout:Sep 12 02:51:15 smithi039 ceph-4954ed46-70ae-11ef-bcea-c7b262605968-osd-9[63678]: 2024-09-12T02:51:15.155+0000 7f6d17a00640 -1 osd.9 112 heartbeat_check: no reply from 172.21.15.44:6804 osd.1 since back 2024-09-12T02:50:14.062055+0000 front 2024-09-12T02:50:14.062119+0000 (oldest deadline 2024-09-12T02:50:38.761988+0000) 2024-09-12T02:51:15.600 INFO:journalctl@ceph.osd.9.smithi039.stdout:Sep 12 02:51:15 smithi039 ceph-4954ed46-70ae-11ef-bcea-c7b262605968-osd-9[63678]: 2024-09-12T02:51:15.155+0000 7f6d17a00640 -1 osd.9 112 heartbeat_check: no reply from 172.21.15.172:6804 osd.2 since back 2024-09-12T02:50:24.663318+0000 front 2024-09-12T02:50:24.663548+0000 (oldest deadline 2024-09-12T02:50:48.763108+0000) 2024-09-12T02:51:15.600 INFO:journalctl@ceph.osd.9.smithi039.stdout:Sep 12 02:51:15 smithi039 ceph-4954ed46-70ae-11ef-bcea-c7b262605968-osd-9[63678]: 2024-09-12T02:51:15.155+0000 7f6d17a00640 -1 osd.9 112 heartbeat_check: no reply from 172.21.15.39:6814 osd.3 since back 2024-09-12T02:50:33.464166+0000 front 2024-09-12T02:50:33.464108+0000 (oldest deadline 2024-09-12T02:50:55.164319+0000) 2024-09-12T02:51:15.600 INFO:journalctl@ceph.osd.9.smithi039.stdout:Sep 12 02:51:15 smithi039 ceph-4954ed46-70ae-11ef-bcea-c7b262605968-osd-9[63678]: 2024-09-12T02:51:15.155+0000 7f6d17a00640 -1 osd.9 112 heartbeat_check: no reply from 172.21.15.44:6812 osd.4 since back 2024-09-12T02:50:41.566107+0000 front 2024-09-12T02:50:41.565926+0000 (oldest deadline 2024-09-12T02:51:05.065942+0000) 2024-09-12T02:51:15.600 INFO:journalctl@ceph.osd.9.smithi039.stdout:Sep 12 02:51:15 smithi039 ceph-4954ed46-70ae-11ef-bcea-c7b262605968-osd-9[63678]: 2024-09-12T02:51:15.155+0000 7f6d17a00640 -1 osd.9 112 heartbeat_check: no reply from 172.21.15.172:6812 osd.5 since back 2024-09-12T02:50:46.667755+0000 front 2024-09-12T02:50:46.667507+0000 (oldest deadline 2024-09-12T02:51:12.567249+0000) 2024-09-12T02:51:15.764 INFO:journalctl@ceph.osd.8.smithi172.stdout:Sep 12 02:51:15 smithi172 podman[73002]: 2024-09-12 02:51:15.486275622 +0000 UTC m=+5.496031679 container died df0d5430fa5331fffeffca7ca4e47dab32aad7b7c3d6c77600e17def707bad9c (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:3be30d720e37ec4df7f667e60f22b4d221c4ce7b408e68b90f9ac10220535e66, name=ceph-4954ed46-70ae-11ef-bcea-c7b262605968-osd-8, GIT_BRANCH=HEAD, org.label-schema.schema-version=1.0, org.label-schema.name=CentOS Stream 9 Base Image, ceph=True, org.label-schema.build-date=20240731, maintainer=Guillaume Abrioux , org.label-schema.vendor=CentOS, CEPH_POINT_RELEASE=, GIT_CLEAN=True, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, GIT_REPO=git@github.com:ceph/ceph-container.git, RELEASE=squid-b53b6d3, io.buildah.version=1.37.2, org.label-schema.license=GPLv2) 2024-09-12T02:51:15.764 INFO:journalctl@ceph.osd.11.smithi172.stdout:Sep 12 02:51:15 smithi172 ceph-4954ed46-70ae-11ef-bcea-c7b262605968-osd-11[61129]: 2024-09-12T02:51:15.305+0000 7ff146fac640 -1 osd.11 112 heartbeat_check: no reply from 172.21.15.39:6806 osd.0 since back 2024-09-12T02:50:09.449223+0000 front 2024-09-12T02:50:09.449210+0000 (oldest deadline 2024-09-12T02:50:34.748980+0000) 2024-09-12T02:51:15.764 INFO:journalctl@ceph.osd.11.smithi172.stdout:Sep 12 02:51:15 smithi172 ceph-4954ed46-70ae-11ef-bcea-c7b262605968-osd-11[61129]: 2024-09-12T02:51:15.305+0000 7ff146fac640 -1 osd.11 112 heartbeat_check: no reply from 172.21.15.44:6804 osd.1 since back 2024-09-12T02:50:14.749696+0000 front 2024-09-12T02:50:14.749454+0000 (oldest deadline 2024-09-12T02:50:42.950102+0000) 2024-09-12T02:51:15.764 INFO:journalctl@ceph.osd.11.smithi172.stdout:Sep 12 02:51:15 smithi172 ceph-4954ed46-70ae-11ef-bcea-c7b262605968-osd-11[61129]: 2024-09-12T02:51:15.305+0000 7ff146fac640 -1 osd.11 112 heartbeat_check: no reply from 172.21.15.172:6804 osd.2 since back 2024-09-12T02:50:22.950505+0000 front 2024-09-12T02:50:22.950558+0000 (oldest deadline 2024-09-12T02:50:48.850680+0000) 2024-09-12T02:51:15.765 INFO:journalctl@ceph.osd.11.smithi172.stdout:Sep 12 02:51:15 smithi172 ceph-4954ed46-70ae-11ef-bcea-c7b262605968-osd-11[61129]: 2024-09-12T02:51:15.305+0000 7ff146fac640 -1 osd.11 112 heartbeat_check: no reply from 172.21.15.44:6812 osd.4 since back 2024-09-12T02:50:39.054153+0000 front 2024-09-12T02:50:39.054100+0000 (oldest deadline 2024-09-12T02:51:04.354015+0000) 2024-09-12T02:51:15.765 INFO:journalctl@ceph.osd.11.smithi172.stdout:Sep 12 02:51:15 smithi172 ceph-4954ed46-70ae-11ef-bcea-c7b262605968-osd-11[61129]: 2024-09-12T02:51:15.305+0000 7ff146fac640 -1 osd.11 112 heartbeat_check: no reply from 172.21.15.172:6812 osd.5 since back 2024-09-12T02:50:49.455828+0000 front 2024-09-12T02:50:49.455854+0000 (oldest deadline 2024-09-12T02:51:14.755884+0000) 2024-09-12T02:51:15.955 INFO:journalctl@ceph.osd.10.smithi044.stdout:Sep 12 02:51:15 smithi044 ceph-4954ed46-70ae-11ef-bcea-c7b262605968-osd-10[59969]: 2024-09-12T02:51:15.595+0000 7faa46dc6640 -1 osd.10 112 heartbeat_check: no reply from 172.21.15.39:6806 osd.0 since back 2024-09-12T02:50:05.367150+0000 front 2024-09-12T02:50:05.367381+0000 (oldest deadline 2024-09-12T02:50:31.267058+0000) 2024-09-12T02:51:15.955 INFO:journalctl@ceph.osd.10.smithi044.stdout:Sep 12 02:51:15 smithi044 ceph-4954ed46-70ae-11ef-bcea-c7b262605968-osd-10[59969]: 2024-09-12T02:51:15.595+0000 7faa46dc6640 -1 osd.10 112 heartbeat_check: no reply from 172.21.15.44:6804 osd.1 since back 2024-09-12T02:50:17.969767+0000 front 2024-09-12T02:50:17.969892+0000 (oldest deadline 2024-09-12T02:50:40.270033+0000) 2024-09-12T02:51:15.956 INFO:journalctl@ceph.osd.10.smithi044.stdout:Sep 12 02:51:15 smithi044 ceph-4954ed46-70ae-11ef-bcea-c7b262605968-osd-10[59969]: 2024-09-12T02:51:15.595+0000 7faa46dc6640 -1 osd.10 112 heartbeat_check: no reply from 172.21.15.172:6804 osd.2 since back 2024-09-12T02:50:25.972029+0000 front 2024-09-12T02:50:25.972168+0000 (oldest deadline 2024-09-12T02:50:47.671992+0000) 2024-09-12T02:51:15.956 INFO:journalctl@ceph.osd.10.smithi044.stdout:Sep 12 02:51:15 smithi044 ceph-4954ed46-70ae-11ef-bcea-c7b262605968-osd-10[59969]: 2024-09-12T02:51:15.595+0000 7faa46dc6640 -1 osd.10 112 heartbeat_check: no reply from 172.21.15.39:6814 osd.3 since back 2024-09-12T02:50:31.673509+0000 front 2024-09-12T02:50:31.673612+0000 (oldest deadline 2024-09-12T02:50:56.973525+0000) 2024-09-12T02:51:15.956 INFO:journalctl@ceph.osd.10.smithi044.stdout:Sep 12 02:51:15 smithi044 ceph-4954ed46-70ae-11ef-bcea-c7b262605968-osd-10[59969]: 2024-09-12T02:51:15.595+0000 7faa46dc6640 -1 osd.10 112 heartbeat_check: no reply from 172.21.15.44:6812 osd.4 since back 2024-09-12T02:50:42.274445+0000 front 2024-09-12T02:50:42.274407+0000 (oldest deadline 2024-09-12T02:51:06.875067+0000) 2024-09-12T02:51:15.956 INFO:journalctl@ceph.osd.10.smithi044.stdout:Sep 12 02:51:15 smithi044 ceph-4954ed46-70ae-11ef-bcea-c7b262605968-osd-10[59969]: 2024-09-12T02:51:15.595+0000 7faa46dc6640 -1 osd.10 112 heartbeat_check: no reply from 172.21.15.172:6812 osd.5 since back 2024-09-12T02:50:46.875759+0000 front 2024-09-12T02:50:46.875831+0000 (oldest deadline 2024-09-12T02:51:12.775550+0000) 2024-09-12T02:51:16.135 INFO:journalctl@ceph.osd.8.smithi172.stdout:Sep 12 02:51:15 smithi172 podman[73002]: 2024-09-12 02:51:15.867335078 +0000 UTC m=+5.877091134 container cleanup df0d5430fa5331fffeffca7ca4e47dab32aad7b7c3d6c77600e17def707bad9c (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:3be30d720e37ec4df7f667e60f22b4d221c4ce7b408e68b90f9ac10220535e66, name=ceph-4954ed46-70ae-11ef-bcea-c7b262605968-osd-8, io.buildah.version=1.37.2, org.label-schema.vendor=CentOS, GIT_CLEAN=True, org.label-schema.build-date=20240731, CEPH_POINT_RELEASE=, RELEASE=squid-b53b6d3, ceph=True, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, GIT_REPO=git@github.com:ceph/ceph-container.git, maintainer=Guillaume Abrioux , org.label-schema.license=GPLv2, GIT_BRANCH=HEAD, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.schema-version=1.0) 2024-09-12T02:51:16.135 INFO:journalctl@ceph.osd.8.smithi172.stdout:Sep 12 02:51:15 smithi172 bash[73002]: ceph-4954ed46-70ae-11ef-bcea-c7b262605968-osd-8 2024-09-12T02:51:16.485 INFO:journalctl@ceph.osd.8.smithi172.stdout:Sep 12 02:51:16 smithi172 podman[73017]: 2024-09-12 02:51:16.135338897 +0000 UTC m=+0.649503070 container remove df0d5430fa5331fffeffca7ca4e47dab32aad7b7c3d6c77600e17def707bad9c (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:3be30d720e37ec4df7f667e60f22b4d221c4ce7b408e68b90f9ac10220535e66, name=ceph-4954ed46-70ae-11ef-bcea-c7b262605968-osd-8, GIT_REPO=git@github.com:ceph/ceph-container.git, RELEASE=squid-b53b6d3, io.buildah.version=1.37.2, maintainer=Guillaume Abrioux , GIT_CLEAN=True, org.label-schema.schema-version=1.0, CEPH_POINT_RELEASE=, org.label-schema.vendor=CentOS, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.build-date=20240731, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, GIT_BRANCH=HEAD, org.label-schema.license=GPLv2, ceph=True) 2024-09-12T02:51:16.486 INFO:journalctl@ceph.osd.11.smithi172.stdout:Sep 12 02:51:16 smithi172 ceph-4954ed46-70ae-11ef-bcea-c7b262605968-osd-11[61129]: 2024-09-12T02:51:16.285+0000 7ff146fac640 -1 osd.11 112 heartbeat_check: no reply from 172.21.15.39:6806 osd.0 since back 2024-09-12T02:50:09.449223+0000 front 2024-09-12T02:50:09.449210+0000 (oldest deadline 2024-09-12T02:50:34.748980+0000) 2024-09-12T02:51:16.486 INFO:journalctl@ceph.osd.11.smithi172.stdout:Sep 12 02:51:16 smithi172 ceph-4954ed46-70ae-11ef-bcea-c7b262605968-osd-11[61129]: 2024-09-12T02:51:16.285+0000 7ff146fac640 -1 osd.11 112 heartbeat_check: no reply from 172.21.15.44:6804 osd.1 since back 2024-09-12T02:50:14.749696+0000 front 2024-09-12T02:50:14.749454+0000 (oldest deadline 2024-09-12T02:50:42.950102+0000) 2024-09-12T02:51:16.486 INFO:journalctl@ceph.osd.11.smithi172.stdout:Sep 12 02:51:16 smithi172 ceph-4954ed46-70ae-11ef-bcea-c7b262605968-osd-11[61129]: 2024-09-12T02:51:16.285+0000 7ff146fac640 -1 osd.11 112 heartbeat_check: no reply from 172.21.15.172:6804 osd.2 since back 2024-09-12T02:50:22.950505+0000 front 2024-09-12T02:50:22.950558+0000 (oldest deadline 2024-09-12T02:50:48.850680+0000) 2024-09-12T02:51:16.486 INFO:journalctl@ceph.osd.11.smithi172.stdout:Sep 12 02:51:16 smithi172 ceph-4954ed46-70ae-11ef-bcea-c7b262605968-osd-11[61129]: 2024-09-12T02:51:16.285+0000 7ff146fac640 -1 osd.11 112 heartbeat_check: no reply from 172.21.15.44:6812 osd.4 since back 2024-09-12T02:50:39.054153+0000 front 2024-09-12T02:50:39.054100+0000 (oldest deadline 2024-09-12T02:51:04.354015+0000) 2024-09-12T02:51:16.486 INFO:journalctl@ceph.osd.11.smithi172.stdout:Sep 12 02:51:16 smithi172 ceph-4954ed46-70ae-11ef-bcea-c7b262605968-osd-11[61129]: 2024-09-12T02:51:16.285+0000 7ff146fac640 -1 osd.11 112 heartbeat_check: no reply from 172.21.15.172:6812 osd.5 since back 2024-09-12T02:50:49.455828+0000 front 2024-09-12T02:50:49.455854+0000 (oldest deadline 2024-09-12T02:51:14.755884+0000) 2024-09-12T02:51:16.600 INFO:journalctl@ceph.osd.9.smithi039.stdout:Sep 12 02:51:16 smithi039 ceph-4954ed46-70ae-11ef-bcea-c7b262605968-osd-9[63678]: 2024-09-12T02:51:16.121+0000 7f6d17a00640 -1 osd.9 112 heartbeat_check: no reply from 172.21.15.39:6806 osd.0 since back 2024-09-12T02:50:08.761527+0000 front 2024-09-12T02:50:08.761556+0000 (oldest deadline 2024-09-12T02:50:34.061510+0000) 2024-09-12T02:51:16.600 INFO:journalctl@ceph.osd.9.smithi039.stdout:Sep 12 02:51:16 smithi039 ceph-4954ed46-70ae-11ef-bcea-c7b262605968-osd-9[63678]: 2024-09-12T02:51:16.121+0000 7f6d17a00640 -1 osd.9 112 heartbeat_check: no reply from 172.21.15.44:6804 osd.1 since back 2024-09-12T02:50:14.062055+0000 front 2024-09-12T02:50:14.062119+0000 (oldest deadline 2024-09-12T02:50:38.761988+0000) 2024-09-12T02:51:16.600 INFO:journalctl@ceph.osd.9.smithi039.stdout:Sep 12 02:51:16 smithi039 ceph-4954ed46-70ae-11ef-bcea-c7b262605968-osd-9[63678]: 2024-09-12T02:51:16.121+0000 7f6d17a00640 -1 osd.9 112 heartbeat_check: no reply from 172.21.15.172:6804 osd.2 since back 2024-09-12T02:50:24.663318+0000 front 2024-09-12T02:50:24.663548+0000 (oldest deadline 2024-09-12T02:50:48.763108+0000) 2024-09-12T02:51:16.600 INFO:journalctl@ceph.osd.9.smithi039.stdout:Sep 12 02:51:16 smithi039 ceph-4954ed46-70ae-11ef-bcea-c7b262605968-osd-9[63678]: 2024-09-12T02:51:16.121+0000 7f6d17a00640 -1 osd.9 112 heartbeat_check: no reply from 172.21.15.39:6814 osd.3 since back 2024-09-12T02:50:33.464166+0000 front 2024-09-12T02:50:33.464108+0000 (oldest deadline 2024-09-12T02:50:55.164319+0000) 2024-09-12T02:51:16.600 INFO:journalctl@ceph.osd.9.smithi039.stdout:Sep 12 02:51:16 smithi039 ceph-4954ed46-70ae-11ef-bcea-c7b262605968-osd-9[63678]: 2024-09-12T02:51:16.121+0000 7f6d17a00640 -1 osd.9 112 heartbeat_check: no reply from 172.21.15.44:6812 osd.4 since back 2024-09-12T02:50:41.566107+0000 front 2024-09-12T02:50:41.565926+0000 (oldest deadline 2024-09-12T02:51:05.065942+0000) 2024-09-12T02:51:16.600 INFO:journalctl@ceph.osd.9.smithi039.stdout:Sep 12 02:51:16 smithi039 ceph-4954ed46-70ae-11ef-bcea-c7b262605968-osd-9[63678]: 2024-09-12T02:51:16.121+0000 7f6d17a00640 -1 osd.9 112 heartbeat_check: no reply from 172.21.15.172:6812 osd.5 since back 2024-09-12T02:50:46.667755+0000 front 2024-09-12T02:50:46.667507+0000 (oldest deadline 2024-09-12T02:51:12.567249+0000) 2024-09-12T02:51:16.764 INFO:journalctl@ceph.osd.8.smithi172.stdout:Sep 12 02:51:16 smithi172 podman[73104]: 2024-09-12 02:51:16.486015845 +0000 UTC m=+0.106521446 container create 39b509b7c9b24d98c10539927fd99a1dc2f546adb715a495ac11af6702897b48 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:3be30d720e37ec4df7f667e60f22b4d221c4ce7b408e68b90f9ac10220535e66, name=ceph-4954ed46-70ae-11ef-bcea-c7b262605968-osd-8-deactivate, org.label-schema.name=CentOS Stream 9 Base Image, CEPH_POINT_RELEASE=, GIT_REPO=git@github.com:ceph/ceph-container.git, io.buildah.version=1.37.2, GIT_CLEAN=True, GIT_BRANCH=HEAD, maintainer=Guillaume Abrioux , org.label-schema.vendor=CentOS, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.license=GPLv2, ceph=True, org.label-schema.build-date=20240731, RELEASE=squid-b53b6d3, org.label-schema.schema-version=1.0) 2024-09-12T02:51:16.765 INFO:journalctl@ceph.osd.8.smithi172.stdout:Sep 12 02:51:16 smithi172 podman[73104]: 2024-09-12 02:51:16.395312913 +0000 UTC m=+0.015818528 image pull 54467abc55f864c4f73dfaf9c6ac3bb3e87b773123d5badaf790bee57321d594 quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:3be30d720e37ec4df7f667e60f22b4d221c4ce7b408e68b90f9ac10220535e66 2024-09-12T02:51:16.765 INFO:journalctl@ceph.osd.8.smithi172.stdout:Sep 12 02:51:16 smithi172 podman[73104]: 2024-09-12 02:51:16.721687015 +0000 UTC m=+0.342192621 container init 39b509b7c9b24d98c10539927fd99a1dc2f546adb715a495ac11af6702897b48 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:3be30d720e37ec4df7f667e60f22b4d221c4ce7b408e68b90f9ac10220535e66, name=ceph-4954ed46-70ae-11ef-bcea-c7b262605968-osd-8-deactivate, GIT_BRANCH=HEAD, GIT_REPO=git@github.com:ceph/ceph-container.git, RELEASE=squid-b53b6d3, CEPH_POINT_RELEASE=, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.schema-version=1.0, GIT_CLEAN=True, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.build-date=20240731, io.buildah.version=1.37.2, maintainer=Guillaume Abrioux , ceph=True, org.label-schema.vendor=CentOS, org.label-schema.license=GPLv2) 2024-09-12T02:51:16.765 INFO:journalctl@ceph.osd.8.smithi172.stdout:Sep 12 02:51:16 smithi172 podman[73104]: 2024-09-12 02:51:16.724861269 +0000 UTC m=+0.345366877 container start 39b509b7c9b24d98c10539927fd99a1dc2f546adb715a495ac11af6702897b48 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:3be30d720e37ec4df7f667e60f22b4d221c4ce7b408e68b90f9ac10220535e66, name=ceph-4954ed46-70ae-11ef-bcea-c7b262605968-osd-8-deactivate, org.label-schema.license=GPLv2, GIT_BRANCH=HEAD, GIT_REPO=git@github.com:ceph/ceph-container.git, ceph=True, RELEASE=squid-b53b6d3, org.label-schema.vendor=CentOS, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, maintainer=Guillaume Abrioux , org.label-schema.name=CentOS Stream 9 Base Image, CEPH_POINT_RELEASE=, GIT_CLEAN=True, org.label-schema.build-date=20240731, io.buildah.version=1.37.2, org.label-schema.schema-version=1.0) 2024-09-12T02:51:16.949 INFO:journalctl@ceph.osd.10.smithi044.stdout:Sep 12 02:51:16 smithi044 ceph-4954ed46-70ae-11ef-bcea-c7b262605968-osd-10[59969]: 2024-09-12T02:51:16.619+0000 7faa46dc6640 -1 osd.10 112 heartbeat_check: no reply from 172.21.15.39:6806 osd.0 since back 2024-09-12T02:50:05.367150+0000 front 2024-09-12T02:50:05.367381+0000 (oldest deadline 2024-09-12T02:50:31.267058+0000) 2024-09-12T02:51:16.949 INFO:journalctl@ceph.osd.10.smithi044.stdout:Sep 12 02:51:16 smithi044 ceph-4954ed46-70ae-11ef-bcea-c7b262605968-osd-10[59969]: 2024-09-12T02:51:16.619+0000 7faa46dc6640 -1 osd.10 112 heartbeat_check: no reply from 172.21.15.44:6804 osd.1 since back 2024-09-12T02:50:17.969767+0000 front 2024-09-12T02:50:17.969892+0000 (oldest deadline 2024-09-12T02:50:40.270033+0000) 2024-09-12T02:51:16.949 INFO:journalctl@ceph.osd.10.smithi044.stdout:Sep 12 02:51:16 smithi044 ceph-4954ed46-70ae-11ef-bcea-c7b262605968-osd-10[59969]: 2024-09-12T02:51:16.619+0000 7faa46dc6640 -1 osd.10 112 heartbeat_check: no reply from 172.21.15.172:6804 osd.2 since back 2024-09-12T02:50:25.972029+0000 front 2024-09-12T02:50:25.972168+0000 (oldest deadline 2024-09-12T02:50:47.671992+0000) 2024-09-12T02:51:16.949 INFO:journalctl@ceph.osd.10.smithi044.stdout:Sep 12 02:51:16 smithi044 ceph-4954ed46-70ae-11ef-bcea-c7b262605968-osd-10[59969]: 2024-09-12T02:51:16.619+0000 7faa46dc6640 -1 osd.10 112 heartbeat_check: no reply from 172.21.15.39:6814 osd.3 since back 2024-09-12T02:50:31.673509+0000 front 2024-09-12T02:50:31.673612+0000 (oldest deadline 2024-09-12T02:50:56.973525+0000) 2024-09-12T02:51:16.949 INFO:journalctl@ceph.osd.10.smithi044.stdout:Sep 12 02:51:16 smithi044 ceph-4954ed46-70ae-11ef-bcea-c7b262605968-osd-10[59969]: 2024-09-12T02:51:16.619+0000 7faa46dc6640 -1 osd.10 112 heartbeat_check: no reply from 172.21.15.44:6812 osd.4 since back 2024-09-12T02:50:42.274445+0000 front 2024-09-12T02:50:42.274407+0000 (oldest deadline 2024-09-12T02:51:06.875067+0000) 2024-09-12T02:51:16.949 INFO:journalctl@ceph.osd.10.smithi044.stdout:Sep 12 02:51:16 smithi044 ceph-4954ed46-70ae-11ef-bcea-c7b262605968-osd-10[59969]: 2024-09-12T02:51:16.619+0000 7faa46dc6640 -1 osd.10 112 heartbeat_check: no reply from 172.21.15.172:6812 osd.5 since back 2024-09-12T02:50:46.875759+0000 front 2024-09-12T02:50:46.875831+0000 (oldest deadline 2024-09-12T02:51:12.775550+0000) 2024-09-12T02:51:17.207 INFO:journalctl@ceph.osd.8.smithi172.stdout:Sep 12 02:51:16 smithi172 podman[73104]: 2024-09-12 02:51:16.805177577 +0000 UTC m=+0.425683186 container attach 39b509b7c9b24d98c10539927fd99a1dc2f546adb715a495ac11af6702897b48 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:3be30d720e37ec4df7f667e60f22b4d221c4ce7b408e68b90f9ac10220535e66, name=ceph-4954ed46-70ae-11ef-bcea-c7b262605968-osd-8-deactivate, maintainer=Guillaume Abrioux , GIT_REPO=git@github.com:ceph/ceph-container.git, ceph=True, RELEASE=squid-b53b6d3, CEPH_POINT_RELEASE=, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.name=CentOS Stream 9 Base Image, GIT_BRANCH=HEAD, GIT_CLEAN=True, io.buildah.version=1.37.2, org.label-schema.schema-version=1.0, org.label-schema.license=GPLv2, org.label-schema.build-date=20240731, org.label-schema.vendor=CentOS) 2024-09-12T02:51:17.208 INFO:journalctl@ceph.osd.8.smithi172.stdout:Sep 12 02:51:16 smithi172 podman[73104]: 2024-09-12 02:51:16.915323518 +0000 UTC m=+0.535829121 container died 39b509b7c9b24d98c10539927fd99a1dc2f546adb715a495ac11af6702897b48 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:3be30d720e37ec4df7f667e60f22b4d221c4ce7b408e68b90f9ac10220535e66, name=ceph-4954ed46-70ae-11ef-bcea-c7b262605968-osd-8-deactivate, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.license=GPLv2, RELEASE=squid-b53b6d3, CEPH_POINT_RELEASE=, org.label-schema.schema-version=1.0, io.buildah.version=1.37.2, maintainer=Guillaume Abrioux , org.label-schema.vendor=CentOS, GIT_CLEAN=True, GIT_BRANCH=HEAD, org.label-schema.name=CentOS Stream 9 Base Image, ceph=True, org.label-schema.build-date=20240731) 2024-09-12T02:51:17.513 INFO:journalctl@ceph.osd.11.smithi172.stdout:Sep 12 02:51:17 smithi172 ceph-4954ed46-70ae-11ef-bcea-c7b262605968-osd-11[61129]: 2024-09-12T02:51:17.331+0000 7ff146fac640 -1 osd.11 112 heartbeat_check: no reply from 172.21.15.39:6806 osd.0 since back 2024-09-12T02:50:09.449223+0000 front 2024-09-12T02:50:09.449210+0000 (oldest deadline 2024-09-12T02:50:34.748980+0000) 2024-09-12T02:51:17.514 INFO:journalctl@ceph.osd.11.smithi172.stdout:Sep 12 02:51:17 smithi172 ceph-4954ed46-70ae-11ef-bcea-c7b262605968-osd-11[61129]: 2024-09-12T02:51:17.331+0000 7ff146fac640 -1 osd.11 112 heartbeat_check: no reply from 172.21.15.44:6804 osd.1 since back 2024-09-12T02:50:14.749696+0000 front 2024-09-12T02:50:14.749454+0000 (oldest deadline 2024-09-12T02:50:42.950102+0000) 2024-09-12T02:51:17.514 INFO:journalctl@ceph.osd.11.smithi172.stdout:Sep 12 02:51:17 smithi172 ceph-4954ed46-70ae-11ef-bcea-c7b262605968-osd-11[61129]: 2024-09-12T02:51:17.331+0000 7ff146fac640 -1 osd.11 112 heartbeat_check: no reply from 172.21.15.172:6804 osd.2 since back 2024-09-12T02:50:22.950505+0000 front 2024-09-12T02:50:22.950558+0000 (oldest deadline 2024-09-12T02:50:48.850680+0000) 2024-09-12T02:51:17.514 INFO:journalctl@ceph.osd.11.smithi172.stdout:Sep 12 02:51:17 smithi172 ceph-4954ed46-70ae-11ef-bcea-c7b262605968-osd-11[61129]: 2024-09-12T02:51:17.331+0000 7ff146fac640 -1 osd.11 112 heartbeat_check: no reply from 172.21.15.44:6812 osd.4 since back 2024-09-12T02:50:39.054153+0000 front 2024-09-12T02:50:39.054100+0000 (oldest deadline 2024-09-12T02:51:04.354015+0000) 2024-09-12T02:51:17.514 INFO:journalctl@ceph.osd.11.smithi172.stdout:Sep 12 02:51:17 smithi172 ceph-4954ed46-70ae-11ef-bcea-c7b262605968-osd-11[61129]: 2024-09-12T02:51:17.331+0000 7ff146fac640 -1 osd.11 112 heartbeat_check: no reply from 172.21.15.172:6812 osd.5 since back 2024-09-12T02:50:49.455828+0000 front 2024-09-12T02:50:49.455854+0000 (oldest deadline 2024-09-12T02:51:14.755884+0000) 2024-09-12T02:51:17.591 DEBUG:teuthology.orchestra.run.smithi172:> sudo pkill -f 'journalctl -f -n 0 -u ceph-4954ed46-70ae-11ef-bcea-c7b262605968@osd.8.service' 2024-09-12T02:51:17.601 INFO:journalctl@ceph.osd.9.smithi039.stdout:Sep 12 02:51:17 smithi039 ceph-4954ed46-70ae-11ef-bcea-c7b262605968-osd-9[63678]: 2024-09-12T02:51:17.113+0000 7f6d17a00640 -1 osd.9 112 heartbeat_check: no reply from 172.21.15.39:6806 osd.0 since back 2024-09-12T02:50:08.761527+0000 front 2024-09-12T02:50:08.761556+0000 (oldest deadline 2024-09-12T02:50:34.061510+0000) 2024-09-12T02:51:17.601 INFO:journalctl@ceph.osd.9.smithi039.stdout:Sep 12 02:51:17 smithi039 ceph-4954ed46-70ae-11ef-bcea-c7b262605968-osd-9[63678]: 2024-09-12T02:51:17.113+0000 7f6d17a00640 -1 osd.9 112 heartbeat_check: no reply from 172.21.15.44:6804 osd.1 since back 2024-09-12T02:50:14.062055+0000 front 2024-09-12T02:50:14.062119+0000 (oldest deadline 2024-09-12T02:50:38.761988+0000) 2024-09-12T02:51:17.601 INFO:journalctl@ceph.osd.9.smithi039.stdout:Sep 12 02:51:17 smithi039 ceph-4954ed46-70ae-11ef-bcea-c7b262605968-osd-9[63678]: 2024-09-12T02:51:17.113+0000 7f6d17a00640 -1 osd.9 112 heartbeat_check: no reply from 172.21.15.172:6804 osd.2 since back 2024-09-12T02:50:24.663318+0000 front 2024-09-12T02:50:24.663548+0000 (oldest deadline 2024-09-12T02:50:48.763108+0000) 2024-09-12T02:51:17.601 INFO:journalctl@ceph.osd.9.smithi039.stdout:Sep 12 02:51:17 smithi039 ceph-4954ed46-70ae-11ef-bcea-c7b262605968-osd-9[63678]: 2024-09-12T02:51:17.113+0000 7f6d17a00640 -1 osd.9 112 heartbeat_check: no reply from 172.21.15.39:6814 osd.3 since back 2024-09-12T02:50:33.464166+0000 front 2024-09-12T02:50:33.464108+0000 (oldest deadline 2024-09-12T02:50:55.164319+0000) 2024-09-12T02:51:17.601 INFO:journalctl@ceph.osd.9.smithi039.stdout:Sep 12 02:51:17 smithi039 ceph-4954ed46-70ae-11ef-bcea-c7b262605968-osd-9[63678]: 2024-09-12T02:51:17.113+0000 7f6d17a00640 -1 osd.9 112 heartbeat_check: no reply from 172.21.15.44:6812 osd.4 since back 2024-09-12T02:50:41.566107+0000 front 2024-09-12T02:50:41.565926+0000 (oldest deadline 2024-09-12T02:51:05.065942+0000) 2024-09-12T02:51:17.601 INFO:journalctl@ceph.osd.9.smithi039.stdout:Sep 12 02:51:17 smithi039 ceph-4954ed46-70ae-11ef-bcea-c7b262605968-osd-9[63678]: 2024-09-12T02:51:17.113+0000 7f6d17a00640 -1 osd.9 112 heartbeat_check: no reply from 172.21.15.172:6812 osd.5 since back 2024-09-12T02:50:46.667755+0000 front 2024-09-12T02:50:46.667507+0000 (oldest deadline 2024-09-12T02:51:12.567249+0000) 2024-09-12T02:51:17.631 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-09-12T02:51:17.631 INFO:tasks.cephadm.osd.8:Stopped osd.8 2024-09-12T02:51:17.632 INFO:tasks.cephadm.osd.9:Stopping osd.9... 2024-09-12T02:51:17.632 DEBUG:teuthology.orchestra.run.smithi039:> sudo systemctl stop ceph-4954ed46-70ae-11ef-bcea-c7b262605968@osd.9 2024-09-12T02:51:17.948 INFO:journalctl@ceph.osd.10.smithi044.stdout:Sep 12 02:51:17 smithi044 ceph-4954ed46-70ae-11ef-bcea-c7b262605968-osd-10[59969]: 2024-09-12T02:51:17.635+0000 7faa46dc6640 -1 osd.10 112 heartbeat_check: no reply from 172.21.15.39:6806 osd.0 since back 2024-09-12T02:50:05.367150+0000 front 2024-09-12T02:50:05.367381+0000 (oldest deadline 2024-09-12T02:50:31.267058+0000) 2024-09-12T02:51:17.948 INFO:journalctl@ceph.osd.10.smithi044.stdout:Sep 12 02:51:17 smithi044 ceph-4954ed46-70ae-11ef-bcea-c7b262605968-osd-10[59969]: 2024-09-12T02:51:17.635+0000 7faa46dc6640 -1 osd.10 112 heartbeat_check: no reply from 172.21.15.44:6804 osd.1 since back 2024-09-12T02:50:17.969767+0000 front 2024-09-12T02:50:17.969892+0000 (oldest deadline 2024-09-12T02:50:40.270033+0000) 2024-09-12T02:51:17.949 INFO:journalctl@ceph.osd.10.smithi044.stdout:Sep 12 02:51:17 smithi044 ceph-4954ed46-70ae-11ef-bcea-c7b262605968-osd-10[59969]: 2024-09-12T02:51:17.635+0000 7faa46dc6640 -1 osd.10 112 heartbeat_check: no reply from 172.21.15.172:6804 osd.2 since back 2024-09-12T02:50:25.972029+0000 front 2024-09-12T02:50:25.972168+0000 (oldest deadline 2024-09-12T02:50:47.671992+0000) 2024-09-12T02:51:17.949 INFO:journalctl@ceph.osd.10.smithi044.stdout:Sep 12 02:51:17 smithi044 ceph-4954ed46-70ae-11ef-bcea-c7b262605968-osd-10[59969]: 2024-09-12T02:51:17.635+0000 7faa46dc6640 -1 osd.10 112 heartbeat_check: no reply from 172.21.15.39:6814 osd.3 since back 2024-09-12T02:50:31.673509+0000 front 2024-09-12T02:50:31.673612+0000 (oldest deadline 2024-09-12T02:50:56.973525+0000) 2024-09-12T02:51:17.949 INFO:journalctl@ceph.osd.10.smithi044.stdout:Sep 12 02:51:17 smithi044 ceph-4954ed46-70ae-11ef-bcea-c7b262605968-osd-10[59969]: 2024-09-12T02:51:17.635+0000 7faa46dc6640 -1 osd.10 112 heartbeat_check: no reply from 172.21.15.44:6812 osd.4 since back 2024-09-12T02:50:42.274445+0000 front 2024-09-12T02:50:42.274407+0000 (oldest deadline 2024-09-12T02:51:06.875067+0000) 2024-09-12T02:51:17.949 INFO:journalctl@ceph.osd.10.smithi044.stdout:Sep 12 02:51:17 smithi044 ceph-4954ed46-70ae-11ef-bcea-c7b262605968-osd-10[59969]: 2024-09-12T02:51:17.635+0000 7faa46dc6640 -1 osd.10 112 heartbeat_check: no reply from 172.21.15.172:6812 osd.5 since back 2024-09-12T02:50:46.875759+0000 front 2024-09-12T02:50:46.875831+0000 (oldest deadline 2024-09-12T02:51:12.775550+0000) 2024-09-12T02:51:18.074 INFO:journalctl@ceph.osd.9.smithi039.stdout:Sep 12 02:51:17 smithi039 systemd[1]: Stopping Ceph osd.9 for 4954ed46-70ae-11ef-bcea-c7b262605968... 2024-09-12T02:51:18.350 INFO:journalctl@ceph.osd.9.smithi039.stdout:Sep 12 02:51:18 smithi039 ceph-4954ed46-70ae-11ef-bcea-c7b262605968-osd-9[63678]: 2024-09-12T02:51:18.073+0000 7f6d1c000640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-osd -n osd.9 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-09-12T02:51:18.350 INFO:journalctl@ceph.osd.9.smithi039.stdout:Sep 12 02:51:18 smithi039 ceph-4954ed46-70ae-11ef-bcea-c7b262605968-osd-9[63678]: 2024-09-12T02:51:18.073+0000 7f6d1c000640 -1 osd.9 112 *** Got signal Terminated *** 2024-09-12T02:51:18.350 INFO:journalctl@ceph.osd.9.smithi039.stdout:Sep 12 02:51:18 smithi039 ceph-4954ed46-70ae-11ef-bcea-c7b262605968-osd-9[63678]: 2024-09-12T02:51:18.073+0000 7f6d1c000640 -1 osd.9 112 *** Immediate shutdown (osd_fast_shutdown=true) *** 2024-09-12T02:51:18.350 INFO:journalctl@ceph.osd.9.smithi039.stdout:Sep 12 02:51:18 smithi039 ceph-4954ed46-70ae-11ef-bcea-c7b262605968-osd-9[63678]: 2024-09-12T02:51:18.082+0000 7f6d17a00640 -1 osd.9 112 heartbeat_check: no reply from 172.21.15.39:6806 osd.0 since back 2024-09-12T02:50:08.761527+0000 front 2024-09-12T02:50:08.761556+0000 (oldest deadline 2024-09-12T02:50:34.061510+0000) 2024-09-12T02:51:18.350 INFO:journalctl@ceph.osd.9.smithi039.stdout:Sep 12 02:51:18 smithi039 ceph-4954ed46-70ae-11ef-bcea-c7b262605968-osd-9[63678]: 2024-09-12T02:51:18.082+0000 7f6d17a00640 -1 osd.9 112 heartbeat_check: no reply from 172.21.15.44:6804 osd.1 since back 2024-09-12T02:50:14.062055+0000 front 2024-09-12T02:50:14.062119+0000 (oldest deadline 2024-09-12T02:50:38.761988+0000) 2024-09-12T02:51:18.350 INFO:journalctl@ceph.osd.9.smithi039.stdout:Sep 12 02:51:18 smithi039 ceph-4954ed46-70ae-11ef-bcea-c7b262605968-osd-9[63678]: 2024-09-12T02:51:18.082+0000 7f6d17a00640 -1 osd.9 112 heartbeat_check: no reply from 172.21.15.172:6804 osd.2 since back 2024-09-12T02:50:24.663318+0000 front 2024-09-12T02:50:24.663548+0000 (oldest deadline 2024-09-12T02:50:48.763108+0000) 2024-09-12T02:51:18.350 INFO:journalctl@ceph.osd.9.smithi039.stdout:Sep 12 02:51:18 smithi039 ceph-4954ed46-70ae-11ef-bcea-c7b262605968-osd-9[63678]: 2024-09-12T02:51:18.082+0000 7f6d17a00640 -1 osd.9 112 heartbeat_check: no reply from 172.21.15.39:6814 osd.3 since back 2024-09-12T02:50:33.464166+0000 front 2024-09-12T02:50:33.464108+0000 (oldest deadline 2024-09-12T02:50:55.164319+0000) 2024-09-12T02:51:18.350 INFO:journalctl@ceph.osd.9.smithi039.stdout:Sep 12 02:51:18 smithi039 ceph-4954ed46-70ae-11ef-bcea-c7b262605968-osd-9[63678]: 2024-09-12T02:51:18.082+0000 7f6d17a00640 -1 osd.9 112 heartbeat_check: no reply from 172.21.15.44:6812 osd.4 since back 2024-09-12T02:50:41.566107+0000 front 2024-09-12T02:50:41.565926+0000 (oldest deadline 2024-09-12T02:51:05.065942+0000) 2024-09-12T02:51:18.350 INFO:journalctl@ceph.osd.9.smithi039.stdout:Sep 12 02:51:18 smithi039 ceph-4954ed46-70ae-11ef-bcea-c7b262605968-osd-9[63678]: 2024-09-12T02:51:18.082+0000 7f6d17a00640 -1 osd.9 112 heartbeat_check: no reply from 172.21.15.172:6812 osd.5 since back 2024-09-12T02:50:46.667755+0000 front 2024-09-12T02:50:46.667507+0000 (oldest deadline 2024-09-12T02:51:12.567249+0000) 2024-09-12T02:51:18.763 INFO:journalctl@ceph.osd.11.smithi172.stdout:Sep 12 02:51:18 smithi172 ceph-4954ed46-70ae-11ef-bcea-c7b262605968-osd-11[61129]: 2024-09-12T02:51:18.377+0000 7ff146fac640 -1 osd.11 112 heartbeat_check: no reply from 172.21.15.39:6806 osd.0 since back 2024-09-12T02:50:09.449223+0000 front 2024-09-12T02:50:09.449210+0000 (oldest deadline 2024-09-12T02:50:34.748980+0000) 2024-09-12T02:51:18.764 INFO:journalctl@ceph.osd.11.smithi172.stdout:Sep 12 02:51:18 smithi172 ceph-4954ed46-70ae-11ef-bcea-c7b262605968-osd-11[61129]: 2024-09-12T02:51:18.377+0000 7ff146fac640 -1 osd.11 112 heartbeat_check: no reply from 172.21.15.44:6804 osd.1 since back 2024-09-12T02:50:14.749696+0000 front 2024-09-12T02:50:14.749454+0000 (oldest deadline 2024-09-12T02:50:42.950102+0000) 2024-09-12T02:51:18.764 INFO:journalctl@ceph.osd.11.smithi172.stdout:Sep 12 02:51:18 smithi172 ceph-4954ed46-70ae-11ef-bcea-c7b262605968-osd-11[61129]: 2024-09-12T02:51:18.377+0000 7ff146fac640 -1 osd.11 112 heartbeat_check: no reply from 172.21.15.172:6804 osd.2 since back 2024-09-12T02:50:22.950505+0000 front 2024-09-12T02:50:22.950558+0000 (oldest deadline 2024-09-12T02:50:48.850680+0000) 2024-09-12T02:51:18.764 INFO:journalctl@ceph.osd.11.smithi172.stdout:Sep 12 02:51:18 smithi172 ceph-4954ed46-70ae-11ef-bcea-c7b262605968-osd-11[61129]: 2024-09-12T02:51:18.377+0000 7ff146fac640 -1 osd.11 112 heartbeat_check: no reply from 172.21.15.44:6812 osd.4 since back 2024-09-12T02:50:39.054153+0000 front 2024-09-12T02:50:39.054100+0000 (oldest deadline 2024-09-12T02:51:04.354015+0000) 2024-09-12T02:51:18.764 INFO:journalctl@ceph.osd.11.smithi172.stdout:Sep 12 02:51:18 smithi172 ceph-4954ed46-70ae-11ef-bcea-c7b262605968-osd-11[61129]: 2024-09-12T02:51:18.377+0000 7ff146fac640 -1 osd.11 112 heartbeat_check: no reply from 172.21.15.172:6812 osd.5 since back 2024-09-12T02:50:49.455828+0000 front 2024-09-12T02:50:49.455854+0000 (oldest deadline 2024-09-12T02:51:14.755884+0000) 2024-09-12T02:51:18.948 INFO:journalctl@ceph.osd.10.smithi044.stdout:Sep 12 02:51:18 smithi044 ceph-4954ed46-70ae-11ef-bcea-c7b262605968-osd-10[59969]: 2024-09-12T02:51:18.618+0000 7faa46dc6640 -1 osd.10 112 heartbeat_check: no reply from 172.21.15.39:6806 osd.0 since back 2024-09-12T02:50:05.367150+0000 front 2024-09-12T02:50:05.367381+0000 (oldest deadline 2024-09-12T02:50:31.267058+0000) 2024-09-12T02:51:18.949 INFO:journalctl@ceph.osd.10.smithi044.stdout:Sep 12 02:51:18 smithi044 ceph-4954ed46-70ae-11ef-bcea-c7b262605968-osd-10[59969]: 2024-09-12T02:51:18.618+0000 7faa46dc6640 -1 osd.10 112 heartbeat_check: no reply from 172.21.15.44:6804 osd.1 since back 2024-09-12T02:50:17.969767+0000 front 2024-09-12T02:50:17.969892+0000 (oldest deadline 2024-09-12T02:50:40.270033+0000) 2024-09-12T02:51:18.949 INFO:journalctl@ceph.osd.10.smithi044.stdout:Sep 12 02:51:18 smithi044 ceph-4954ed46-70ae-11ef-bcea-c7b262605968-osd-10[59969]: 2024-09-12T02:51:18.618+0000 7faa46dc6640 -1 osd.10 112 heartbeat_check: no reply from 172.21.15.172:6804 osd.2 since back 2024-09-12T02:50:25.972029+0000 front 2024-09-12T02:50:25.972168+0000 (oldest deadline 2024-09-12T02:50:47.671992+0000) 2024-09-12T02:51:18.949 INFO:journalctl@ceph.osd.10.smithi044.stdout:Sep 12 02:51:18 smithi044 ceph-4954ed46-70ae-11ef-bcea-c7b262605968-osd-10[59969]: 2024-09-12T02:51:18.618+0000 7faa46dc6640 -1 osd.10 112 heartbeat_check: no reply from 172.21.15.39:6814 osd.3 since back 2024-09-12T02:50:31.673509+0000 front 2024-09-12T02:50:31.673612+0000 (oldest deadline 2024-09-12T02:50:56.973525+0000) 2024-09-12T02:51:18.949 INFO:journalctl@ceph.osd.10.smithi044.stdout:Sep 12 02:51:18 smithi044 ceph-4954ed46-70ae-11ef-bcea-c7b262605968-osd-10[59969]: 2024-09-12T02:51:18.618+0000 7faa46dc6640 -1 osd.10 112 heartbeat_check: no reply from 172.21.15.44:6812 osd.4 since back 2024-09-12T02:50:42.274445+0000 front 2024-09-12T02:50:42.274407+0000 (oldest deadline 2024-09-12T02:51:06.875067+0000) 2024-09-12T02:51:18.949 INFO:journalctl@ceph.osd.10.smithi044.stdout:Sep 12 02:51:18 smithi044 ceph-4954ed46-70ae-11ef-bcea-c7b262605968-osd-10[59969]: 2024-09-12T02:51:18.618+0000 7faa46dc6640 -1 osd.10 112 heartbeat_check: no reply from 172.21.15.172:6812 osd.5 since back 2024-09-12T02:50:46.875759+0000 front 2024-09-12T02:50:46.875831+0000 (oldest deadline 2024-09-12T02:51:12.775550+0000) 2024-09-12T02:51:19.600 INFO:journalctl@ceph.osd.9.smithi039.stdout:Sep 12 02:51:19 smithi039 ceph-4954ed46-70ae-11ef-bcea-c7b262605968-osd-9[63678]: 2024-09-12T02:51:19.104+0000 7f6d17a00640 -1 osd.9 112 heartbeat_check: no reply from 172.21.15.39:6806 osd.0 since back 2024-09-12T02:50:08.761527+0000 front 2024-09-12T02:50:08.761556+0000 (oldest deadline 2024-09-12T02:50:34.061510+0000) 2024-09-12T02:51:19.600 INFO:journalctl@ceph.osd.9.smithi039.stdout:Sep 12 02:51:19 smithi039 ceph-4954ed46-70ae-11ef-bcea-c7b262605968-osd-9[63678]: 2024-09-12T02:51:19.104+0000 7f6d17a00640 -1 osd.9 112 heartbeat_check: no reply from 172.21.15.44:6804 osd.1 since back 2024-09-12T02:50:14.062055+0000 front 2024-09-12T02:50:14.062119+0000 (oldest deadline 2024-09-12T02:50:38.761988+0000) 2024-09-12T02:51:19.600 INFO:journalctl@ceph.osd.9.smithi039.stdout:Sep 12 02:51:19 smithi039 ceph-4954ed46-70ae-11ef-bcea-c7b262605968-osd-9[63678]: 2024-09-12T02:51:19.104+0000 7f6d17a00640 -1 osd.9 112 heartbeat_check: no reply from 172.21.15.172:6804 osd.2 since back 2024-09-12T02:50:24.663318+0000 front 2024-09-12T02:50:24.663548+0000 (oldest deadline 2024-09-12T02:50:48.763108+0000) 2024-09-12T02:51:19.600 INFO:journalctl@ceph.osd.9.smithi039.stdout:Sep 12 02:51:19 smithi039 ceph-4954ed46-70ae-11ef-bcea-c7b262605968-osd-9[63678]: 2024-09-12T02:51:19.104+0000 7f6d17a00640 -1 osd.9 112 heartbeat_check: no reply from 172.21.15.39:6814 osd.3 since back 2024-09-12T02:50:33.464166+0000 front 2024-09-12T02:50:33.464108+0000 (oldest deadline 2024-09-12T02:50:55.164319+0000) 2024-09-12T02:51:19.600 INFO:journalctl@ceph.osd.9.smithi039.stdout:Sep 12 02:51:19 smithi039 ceph-4954ed46-70ae-11ef-bcea-c7b262605968-osd-9[63678]: 2024-09-12T02:51:19.104+0000 7f6d17a00640 -1 osd.9 112 heartbeat_check: no reply from 172.21.15.44:6812 osd.4 since back 2024-09-12T02:50:41.566107+0000 front 2024-09-12T02:50:41.565926+0000 (oldest deadline 2024-09-12T02:51:05.065942+0000) 2024-09-12T02:51:19.600 INFO:journalctl@ceph.osd.9.smithi039.stdout:Sep 12 02:51:19 smithi039 ceph-4954ed46-70ae-11ef-bcea-c7b262605968-osd-9[63678]: 2024-09-12T02:51:19.104+0000 7f6d17a00640 -1 osd.9 112 heartbeat_check: no reply from 172.21.15.172:6812 osd.5 since back 2024-09-12T02:50:46.667755+0000 front 2024-09-12T02:50:46.667507+0000 (oldest deadline 2024-09-12T02:51:12.567249+0000) 2024-09-12T02:51:19.763 INFO:journalctl@ceph.osd.11.smithi172.stdout:Sep 12 02:51:19 smithi172 ceph-4954ed46-70ae-11ef-bcea-c7b262605968-osd-11[61129]: 2024-09-12T02:51:19.421+0000 7ff146fac640 -1 osd.11 112 heartbeat_check: no reply from 172.21.15.39:6806 osd.0 since back 2024-09-12T02:50:09.449223+0000 front 2024-09-12T02:50:09.449210+0000 (oldest deadline 2024-09-12T02:50:34.748980+0000) 2024-09-12T02:51:19.764 INFO:journalctl@ceph.osd.11.smithi172.stdout:Sep 12 02:51:19 smithi172 ceph-4954ed46-70ae-11ef-bcea-c7b262605968-osd-11[61129]: 2024-09-12T02:51:19.421+0000 7ff146fac640 -1 osd.11 112 heartbeat_check: no reply from 172.21.15.44:6804 osd.1 since back 2024-09-12T02:50:14.749696+0000 front 2024-09-12T02:50:14.749454+0000 (oldest deadline 2024-09-12T02:50:42.950102+0000) 2024-09-12T02:51:19.764 INFO:journalctl@ceph.osd.11.smithi172.stdout:Sep 12 02:51:19 smithi172 ceph-4954ed46-70ae-11ef-bcea-c7b262605968-osd-11[61129]: 2024-09-12T02:51:19.421+0000 7ff146fac640 -1 osd.11 112 heartbeat_check: no reply from 172.21.15.172:6804 osd.2 since back 2024-09-12T02:50:22.950505+0000 front 2024-09-12T02:50:22.950558+0000 (oldest deadline 2024-09-12T02:50:48.850680+0000) 2024-09-12T02:51:19.764 INFO:journalctl@ceph.osd.11.smithi172.stdout:Sep 12 02:51:19 smithi172 ceph-4954ed46-70ae-11ef-bcea-c7b262605968-osd-11[61129]: 2024-09-12T02:51:19.421+0000 7ff146fac640 -1 osd.11 112 heartbeat_check: no reply from 172.21.15.44:6812 osd.4 since back 2024-09-12T02:50:39.054153+0000 front 2024-09-12T02:50:39.054100+0000 (oldest deadline 2024-09-12T02:51:04.354015+0000) 2024-09-12T02:51:19.764 INFO:journalctl@ceph.osd.11.smithi172.stdout:Sep 12 02:51:19 smithi172 ceph-4954ed46-70ae-11ef-bcea-c7b262605968-osd-11[61129]: 2024-09-12T02:51:19.421+0000 7ff146fac640 -1 osd.11 112 heartbeat_check: no reply from 172.21.15.172:6812 osd.5 since back 2024-09-12T02:50:49.455828+0000 front 2024-09-12T02:50:49.455854+0000 (oldest deadline 2024-09-12T02:51:14.755884+0000) 2024-09-12T02:51:19.949 INFO:journalctl@ceph.osd.10.smithi044.stdout:Sep 12 02:51:19 smithi044 ceph-4954ed46-70ae-11ef-bcea-c7b262605968-osd-10[59969]: 2024-09-12T02:51:19.668+0000 7faa46dc6640 -1 osd.10 112 heartbeat_check: no reply from 172.21.15.39:6806 osd.0 since back 2024-09-12T02:50:05.367150+0000 front 2024-09-12T02:50:05.367381+0000 (oldest deadline 2024-09-12T02:50:31.267058+0000) 2024-09-12T02:51:19.949 INFO:journalctl@ceph.osd.10.smithi044.stdout:Sep 12 02:51:19 smithi044 ceph-4954ed46-70ae-11ef-bcea-c7b262605968-osd-10[59969]: 2024-09-12T02:51:19.668+0000 7faa46dc6640 -1 osd.10 112 heartbeat_check: no reply from 172.21.15.44:6804 osd.1 since back 2024-09-12T02:50:17.969767+0000 front 2024-09-12T02:50:17.969892+0000 (oldest deadline 2024-09-12T02:50:40.270033+0000) 2024-09-12T02:51:19.949 INFO:journalctl@ceph.osd.10.smithi044.stdout:Sep 12 02:51:19 smithi044 ceph-4954ed46-70ae-11ef-bcea-c7b262605968-osd-10[59969]: 2024-09-12T02:51:19.668+0000 7faa46dc6640 -1 osd.10 112 heartbeat_check: no reply from 172.21.15.172:6804 osd.2 since back 2024-09-12T02:50:25.972029+0000 front 2024-09-12T02:50:25.972168+0000 (oldest deadline 2024-09-12T02:50:47.671992+0000) 2024-09-12T02:51:19.949 INFO:journalctl@ceph.osd.10.smithi044.stdout:Sep 12 02:51:19 smithi044 ceph-4954ed46-70ae-11ef-bcea-c7b262605968-osd-10[59969]: 2024-09-12T02:51:19.668+0000 7faa46dc6640 -1 osd.10 112 heartbeat_check: no reply from 172.21.15.39:6814 osd.3 since back 2024-09-12T02:50:31.673509+0000 front 2024-09-12T02:50:31.673612+0000 (oldest deadline 2024-09-12T02:50:56.973525+0000) 2024-09-12T02:51:19.949 INFO:journalctl@ceph.osd.10.smithi044.stdout:Sep 12 02:51:19 smithi044 ceph-4954ed46-70ae-11ef-bcea-c7b262605968-osd-10[59969]: 2024-09-12T02:51:19.668+0000 7faa46dc6640 -1 osd.10 112 heartbeat_check: no reply from 172.21.15.44:6812 osd.4 since back 2024-09-12T02:50:42.274445+0000 front 2024-09-12T02:50:42.274407+0000 (oldest deadline 2024-09-12T02:51:06.875067+0000) 2024-09-12T02:51:19.949 INFO:journalctl@ceph.osd.10.smithi044.stdout:Sep 12 02:51:19 smithi044 ceph-4954ed46-70ae-11ef-bcea-c7b262605968-osd-10[59969]: 2024-09-12T02:51:19.668+0000 7faa46dc6640 -1 osd.10 112 heartbeat_check: no reply from 172.21.15.172:6812 osd.5 since back 2024-09-12T02:50:46.875759+0000 front 2024-09-12T02:50:46.875831+0000 (oldest deadline 2024-09-12T02:51:12.775550+0000) 2024-09-12T02:51:20.599 INFO:journalctl@ceph.osd.9.smithi039.stdout:Sep 12 02:51:20 smithi039 ceph-4954ed46-70ae-11ef-bcea-c7b262605968-osd-9[63678]: 2024-09-12T02:51:20.113+0000 7f6d17a00640 -1 osd.9 112 heartbeat_check: no reply from 172.21.15.39:6806 osd.0 since back 2024-09-12T02:50:08.761527+0000 front 2024-09-12T02:50:08.761556+0000 (oldest deadline 2024-09-12T02:50:34.061510+0000) 2024-09-12T02:51:20.600 INFO:journalctl@ceph.osd.9.smithi039.stdout:Sep 12 02:51:20 smithi039 ceph-4954ed46-70ae-11ef-bcea-c7b262605968-osd-9[63678]: 2024-09-12T02:51:20.113+0000 7f6d17a00640 -1 osd.9 112 heartbeat_check: no reply from 172.21.15.44:6804 osd.1 since back 2024-09-12T02:50:14.062055+0000 front 2024-09-12T02:50:14.062119+0000 (oldest deadline 2024-09-12T02:50:38.761988+0000) 2024-09-12T02:51:20.600 INFO:journalctl@ceph.osd.9.smithi039.stdout:Sep 12 02:51:20 smithi039 ceph-4954ed46-70ae-11ef-bcea-c7b262605968-osd-9[63678]: 2024-09-12T02:51:20.113+0000 7f6d17a00640 -1 osd.9 112 heartbeat_check: no reply from 172.21.15.172:6804 osd.2 since back 2024-09-12T02:50:24.663318+0000 front 2024-09-12T02:50:24.663548+0000 (oldest deadline 2024-09-12T02:50:48.763108+0000) 2024-09-12T02:51:20.600 INFO:journalctl@ceph.osd.9.smithi039.stdout:Sep 12 02:51:20 smithi039 ceph-4954ed46-70ae-11ef-bcea-c7b262605968-osd-9[63678]: 2024-09-12T02:51:20.113+0000 7f6d17a00640 -1 osd.9 112 heartbeat_check: no reply from 172.21.15.39:6814 osd.3 since back 2024-09-12T02:50:33.464166+0000 front 2024-09-12T02:50:33.464108+0000 (oldest deadline 2024-09-12T02:50:55.164319+0000) 2024-09-12T02:51:20.600 INFO:journalctl@ceph.osd.9.smithi039.stdout:Sep 12 02:51:20 smithi039 ceph-4954ed46-70ae-11ef-bcea-c7b262605968-osd-9[63678]: 2024-09-12T02:51:20.113+0000 7f6d17a00640 -1 osd.9 112 heartbeat_check: no reply from 172.21.15.44:6812 osd.4 since back 2024-09-12T02:50:41.566107+0000 front 2024-09-12T02:50:41.565926+0000 (oldest deadline 2024-09-12T02:51:05.065942+0000) 2024-09-12T02:51:20.600 INFO:journalctl@ceph.osd.9.smithi039.stdout:Sep 12 02:51:20 smithi039 ceph-4954ed46-70ae-11ef-bcea-c7b262605968-osd-9[63678]: 2024-09-12T02:51:20.113+0000 7f6d17a00640 -1 osd.9 112 heartbeat_check: no reply from 172.21.15.172:6812 osd.5 since back 2024-09-12T02:50:46.667755+0000 front 2024-09-12T02:50:46.667507+0000 (oldest deadline 2024-09-12T02:51:12.567249+0000) 2024-09-12T02:51:20.764 INFO:journalctl@ceph.osd.11.smithi172.stdout:Sep 12 02:51:20 smithi172 ceph-4954ed46-70ae-11ef-bcea-c7b262605968-osd-11[61129]: 2024-09-12T02:51:20.453+0000 7ff146fac640 -1 osd.11 112 heartbeat_check: no reply from 172.21.15.39:6806 osd.0 since back 2024-09-12T02:50:09.449223+0000 front 2024-09-12T02:50:09.449210+0000 (oldest deadline 2024-09-12T02:50:34.748980+0000) 2024-09-12T02:51:20.764 INFO:journalctl@ceph.osd.11.smithi172.stdout:Sep 12 02:51:20 smithi172 ceph-4954ed46-70ae-11ef-bcea-c7b262605968-osd-11[61129]: 2024-09-12T02:51:20.453+0000 7ff146fac640 -1 osd.11 112 heartbeat_check: no reply from 172.21.15.44:6804 osd.1 since back 2024-09-12T02:50:14.749696+0000 front 2024-09-12T02:50:14.749454+0000 (oldest deadline 2024-09-12T02:50:42.950102+0000) 2024-09-12T02:51:20.764 INFO:journalctl@ceph.osd.11.smithi172.stdout:Sep 12 02:51:20 smithi172 ceph-4954ed46-70ae-11ef-bcea-c7b262605968-osd-11[61129]: 2024-09-12T02:51:20.453+0000 7ff146fac640 -1 osd.11 112 heartbeat_check: no reply from 172.21.15.172:6804 osd.2 since back 2024-09-12T02:50:22.950505+0000 front 2024-09-12T02:50:22.950558+0000 (oldest deadline 2024-09-12T02:50:48.850680+0000) 2024-09-12T02:51:20.764 INFO:journalctl@ceph.osd.11.smithi172.stdout:Sep 12 02:51:20 smithi172 ceph-4954ed46-70ae-11ef-bcea-c7b262605968-osd-11[61129]: 2024-09-12T02:51:20.453+0000 7ff146fac640 -1 osd.11 112 heartbeat_check: no reply from 172.21.15.44:6812 osd.4 since back 2024-09-12T02:50:39.054153+0000 front 2024-09-12T02:50:39.054100+0000 (oldest deadline 2024-09-12T02:51:04.354015+0000) 2024-09-12T02:51:20.764 INFO:journalctl@ceph.osd.11.smithi172.stdout:Sep 12 02:51:20 smithi172 ceph-4954ed46-70ae-11ef-bcea-c7b262605968-osd-11[61129]: 2024-09-12T02:51:20.453+0000 7ff146fac640 -1 osd.11 112 heartbeat_check: no reply from 172.21.15.172:6812 osd.5 since back 2024-09-12T02:50:49.455828+0000 front 2024-09-12T02:50:49.455854+0000 (oldest deadline 2024-09-12T02:51:14.755884+0000) 2024-09-12T02:51:20.949 INFO:journalctl@ceph.osd.10.smithi044.stdout:Sep 12 02:51:20 smithi044 ceph-4954ed46-70ae-11ef-bcea-c7b262605968-osd-10[59969]: 2024-09-12T02:51:20.642+0000 7faa46dc6640 -1 osd.10 112 heartbeat_check: no reply from 172.21.15.39:6806 osd.0 since back 2024-09-12T02:50:05.367150+0000 front 2024-09-12T02:50:05.367381+0000 (oldest deadline 2024-09-12T02:50:31.267058+0000) 2024-09-12T02:51:20.949 INFO:journalctl@ceph.osd.10.smithi044.stdout:Sep 12 02:51:20 smithi044 ceph-4954ed46-70ae-11ef-bcea-c7b262605968-osd-10[59969]: 2024-09-12T02:51:20.642+0000 7faa46dc6640 -1 osd.10 112 heartbeat_check: no reply from 172.21.15.44:6804 osd.1 since back 2024-09-12T02:50:17.969767+0000 front 2024-09-12T02:50:17.969892+0000 (oldest deadline 2024-09-12T02:50:40.270033+0000) 2024-09-12T02:51:20.949 INFO:journalctl@ceph.osd.10.smithi044.stdout:Sep 12 02:51:20 smithi044 ceph-4954ed46-70ae-11ef-bcea-c7b262605968-osd-10[59969]: 2024-09-12T02:51:20.642+0000 7faa46dc6640 -1 osd.10 112 heartbeat_check: no reply from 172.21.15.172:6804 osd.2 since back 2024-09-12T02:50:25.972029+0000 front 2024-09-12T02:50:25.972168+0000 (oldest deadline 2024-09-12T02:50:47.671992+0000) 2024-09-12T02:51:20.949 INFO:journalctl@ceph.osd.10.smithi044.stdout:Sep 12 02:51:20 smithi044 ceph-4954ed46-70ae-11ef-bcea-c7b262605968-osd-10[59969]: 2024-09-12T02:51:20.642+0000 7faa46dc6640 -1 osd.10 112 heartbeat_check: no reply from 172.21.15.39:6814 osd.3 since back 2024-09-12T02:50:31.673509+0000 front 2024-09-12T02:50:31.673612+0000 (oldest deadline 2024-09-12T02:50:56.973525+0000) 2024-09-12T02:51:20.949 INFO:journalctl@ceph.osd.10.smithi044.stdout:Sep 12 02:51:20 smithi044 ceph-4954ed46-70ae-11ef-bcea-c7b262605968-osd-10[59969]: 2024-09-12T02:51:20.642+0000 7faa46dc6640 -1 osd.10 112 heartbeat_check: no reply from 172.21.15.44:6812 osd.4 since back 2024-09-12T02:50:42.274445+0000 front 2024-09-12T02:50:42.274407+0000 (oldest deadline 2024-09-12T02:51:06.875067+0000) 2024-09-12T02:51:20.949 INFO:journalctl@ceph.osd.10.smithi044.stdout:Sep 12 02:51:20 smithi044 ceph-4954ed46-70ae-11ef-bcea-c7b262605968-osd-10[59969]: 2024-09-12T02:51:20.642+0000 7faa46dc6640 -1 osd.10 112 heartbeat_check: no reply from 172.21.15.172:6812 osd.5 since back 2024-09-12T02:50:46.875759+0000 front 2024-09-12T02:50:46.875831+0000 (oldest deadline 2024-09-12T02:51:12.775550+0000) 2024-09-12T02:51:21.350 INFO:journalctl@ceph.osd.9.smithi039.stdout:Sep 12 02:51:21 smithi039 ceph-4954ed46-70ae-11ef-bcea-c7b262605968-osd-9[63678]: 2024-09-12T02:51:21.090+0000 7f6d17a00640 -1 osd.9 112 heartbeat_check: no reply from 172.21.15.39:6806 osd.0 since back 2024-09-12T02:50:08.761527+0000 front 2024-09-12T02:50:08.761556+0000 (oldest deadline 2024-09-12T02:50:34.061510+0000) 2024-09-12T02:51:21.350 INFO:journalctl@ceph.osd.9.smithi039.stdout:Sep 12 02:51:21 smithi039 ceph-4954ed46-70ae-11ef-bcea-c7b262605968-osd-9[63678]: 2024-09-12T02:51:21.090+0000 7f6d17a00640 -1 osd.9 112 heartbeat_check: no reply from 172.21.15.44:6804 osd.1 since back 2024-09-12T02:50:14.062055+0000 front 2024-09-12T02:50:14.062119+0000 (oldest deadline 2024-09-12T02:50:38.761988+0000) 2024-09-12T02:51:21.350 INFO:journalctl@ceph.osd.9.smithi039.stdout:Sep 12 02:51:21 smithi039 ceph-4954ed46-70ae-11ef-bcea-c7b262605968-osd-9[63678]: 2024-09-12T02:51:21.090+0000 7f6d17a00640 -1 osd.9 112 heartbeat_check: no reply from 172.21.15.172:6804 osd.2 since back 2024-09-12T02:50:24.663318+0000 front 2024-09-12T02:50:24.663548+0000 (oldest deadline 2024-09-12T02:50:48.763108+0000) 2024-09-12T02:51:21.350 INFO:journalctl@ceph.osd.9.smithi039.stdout:Sep 12 02:51:21 smithi039 ceph-4954ed46-70ae-11ef-bcea-c7b262605968-osd-9[63678]: 2024-09-12T02:51:21.090+0000 7f6d17a00640 -1 osd.9 112 heartbeat_check: no reply from 172.21.15.39:6814 osd.3 since back 2024-09-12T02:50:33.464166+0000 front 2024-09-12T02:50:33.464108+0000 (oldest deadline 2024-09-12T02:50:55.164319+0000) 2024-09-12T02:51:21.350 INFO:journalctl@ceph.osd.9.smithi039.stdout:Sep 12 02:51:21 smithi039 ceph-4954ed46-70ae-11ef-bcea-c7b262605968-osd-9[63678]: 2024-09-12T02:51:21.090+0000 7f6d17a00640 -1 osd.9 112 heartbeat_check: no reply from 172.21.15.44:6812 osd.4 since back 2024-09-12T02:50:41.566107+0000 front 2024-09-12T02:50:41.565926+0000 (oldest deadline 2024-09-12T02:51:05.065942+0000) 2024-09-12T02:51:21.350 INFO:journalctl@ceph.osd.9.smithi039.stdout:Sep 12 02:51:21 smithi039 ceph-4954ed46-70ae-11ef-bcea-c7b262605968-osd-9[63678]: 2024-09-12T02:51:21.090+0000 7f6d17a00640 -1 osd.9 112 heartbeat_check: no reply from 172.21.15.172:6812 osd.5 since back 2024-09-12T02:50:46.667755+0000 front 2024-09-12T02:50:46.667507+0000 (oldest deadline 2024-09-12T02:51:12.567249+0000) 2024-09-12T02:51:21.763 INFO:journalctl@ceph.osd.11.smithi172.stdout:Sep 12 02:51:21 smithi172 ceph-4954ed46-70ae-11ef-bcea-c7b262605968-osd-11[61129]: 2024-09-12T02:51:21.482+0000 7ff146fac640 -1 osd.11 112 heartbeat_check: no reply from 172.21.15.39:6806 osd.0 since back 2024-09-12T02:50:09.449223+0000 front 2024-09-12T02:50:09.449210+0000 (oldest deadline 2024-09-12T02:50:34.748980+0000) 2024-09-12T02:51:21.764 INFO:journalctl@ceph.osd.11.smithi172.stdout:Sep 12 02:51:21 smithi172 ceph-4954ed46-70ae-11ef-bcea-c7b262605968-osd-11[61129]: 2024-09-12T02:51:21.482+0000 7ff146fac640 -1 osd.11 112 heartbeat_check: no reply from 172.21.15.44:6804 osd.1 since back 2024-09-12T02:50:14.749696+0000 front 2024-09-12T02:50:14.749454+0000 (oldest deadline 2024-09-12T02:50:42.950102+0000) 2024-09-12T02:51:21.764 INFO:journalctl@ceph.osd.11.smithi172.stdout:Sep 12 02:51:21 smithi172 ceph-4954ed46-70ae-11ef-bcea-c7b262605968-osd-11[61129]: 2024-09-12T02:51:21.482+0000 7ff146fac640 -1 osd.11 112 heartbeat_check: no reply from 172.21.15.172:6804 osd.2 since back 2024-09-12T02:50:22.950505+0000 front 2024-09-12T02:50:22.950558+0000 (oldest deadline 2024-09-12T02:50:48.850680+0000) 2024-09-12T02:51:21.764 INFO:journalctl@ceph.osd.11.smithi172.stdout:Sep 12 02:51:21 smithi172 ceph-4954ed46-70ae-11ef-bcea-c7b262605968-osd-11[61129]: 2024-09-12T02:51:21.482+0000 7ff146fac640 -1 osd.11 112 heartbeat_check: no reply from 172.21.15.44:6812 osd.4 since back 2024-09-12T02:50:39.054153+0000 front 2024-09-12T02:50:39.054100+0000 (oldest deadline 2024-09-12T02:51:04.354015+0000) 2024-09-12T02:51:21.764 INFO:journalctl@ceph.osd.11.smithi172.stdout:Sep 12 02:51:21 smithi172 ceph-4954ed46-70ae-11ef-bcea-c7b262605968-osd-11[61129]: 2024-09-12T02:51:21.482+0000 7ff146fac640 -1 osd.11 112 heartbeat_check: no reply from 172.21.15.172:6812 osd.5 since back 2024-09-12T02:50:49.455828+0000 front 2024-09-12T02:50:49.455854+0000 (oldest deadline 2024-09-12T02:51:14.755884+0000) 2024-09-12T02:51:21.764 INFO:journalctl@ceph.osd.11.smithi172.stdout:Sep 12 02:51:21 smithi172 ceph-4954ed46-70ae-11ef-bcea-c7b262605968-osd-11[61129]: 2024-09-12T02:51:21.482+0000 7ff146fac640 -1 osd.11 112 heartbeat_check: no reply from 172.21.15.39:6822 osd.6 since back 2024-09-12T02:50:54.756477+0000 front 2024-09-12T02:50:54.756555+0000 (oldest deadline 2024-09-12T02:51:20.656467+0000) 2024-09-12T02:51:21.949 INFO:journalctl@ceph.osd.10.smithi044.stdout:Sep 12 02:51:21 smithi044 ceph-4954ed46-70ae-11ef-bcea-c7b262605968-osd-10[59969]: 2024-09-12T02:51:21.628+0000 7faa46dc6640 -1 osd.10 112 heartbeat_check: no reply from 172.21.15.39:6806 osd.0 since back 2024-09-12T02:50:05.367150+0000 front 2024-09-12T02:50:05.367381+0000 (oldest deadline 2024-09-12T02:50:31.267058+0000) 2024-09-12T02:51:21.949 INFO:journalctl@ceph.osd.10.smithi044.stdout:Sep 12 02:51:21 smithi044 ceph-4954ed46-70ae-11ef-bcea-c7b262605968-osd-10[59969]: 2024-09-12T02:51:21.628+0000 7faa46dc6640 -1 osd.10 112 heartbeat_check: no reply from 172.21.15.44:6804 osd.1 since back 2024-09-12T02:50:17.969767+0000 front 2024-09-12T02:50:17.969892+0000 (oldest deadline 2024-09-12T02:50:40.270033+0000) 2024-09-12T02:51:21.949 INFO:journalctl@ceph.osd.10.smithi044.stdout:Sep 12 02:51:21 smithi044 ceph-4954ed46-70ae-11ef-bcea-c7b262605968-osd-10[59969]: 2024-09-12T02:51:21.628+0000 7faa46dc6640 -1 osd.10 112 heartbeat_check: no reply from 172.21.15.172:6804 osd.2 since back 2024-09-12T02:50:25.972029+0000 front 2024-09-12T02:50:25.972168+0000 (oldest deadline 2024-09-12T02:50:47.671992+0000) 2024-09-12T02:51:21.949 INFO:journalctl@ceph.osd.10.smithi044.stdout:Sep 12 02:51:21 smithi044 ceph-4954ed46-70ae-11ef-bcea-c7b262605968-osd-10[59969]: 2024-09-12T02:51:21.628+0000 7faa46dc6640 -1 osd.10 112 heartbeat_check: no reply from 172.21.15.39:6814 osd.3 since back 2024-09-12T02:50:31.673509+0000 front 2024-09-12T02:50:31.673612+0000 (oldest deadline 2024-09-12T02:50:56.973525+0000) 2024-09-12T02:51:21.949 INFO:journalctl@ceph.osd.10.smithi044.stdout:Sep 12 02:51:21 smithi044 ceph-4954ed46-70ae-11ef-bcea-c7b262605968-osd-10[59969]: 2024-09-12T02:51:21.628+0000 7faa46dc6640 -1 osd.10 112 heartbeat_check: no reply from 172.21.15.44:6812 osd.4 since back 2024-09-12T02:50:42.274445+0000 front 2024-09-12T02:50:42.274407+0000 (oldest deadline 2024-09-12T02:51:06.875067+0000) 2024-09-12T02:51:21.949 INFO:journalctl@ceph.osd.10.smithi044.stdout:Sep 12 02:51:21 smithi044 ceph-4954ed46-70ae-11ef-bcea-c7b262605968-osd-10[59969]: 2024-09-12T02:51:21.628+0000 7faa46dc6640 -1 osd.10 112 heartbeat_check: no reply from 172.21.15.172:6812 osd.5 since back 2024-09-12T02:50:46.875759+0000 front 2024-09-12T02:50:46.875831+0000 (oldest deadline 2024-09-12T02:51:12.775550+0000) 2024-09-12T02:51:21.949 INFO:journalctl@ceph.osd.10.smithi044.stdout:Sep 12 02:51:21 smithi044 ceph-4954ed46-70ae-11ef-bcea-c7b262605968-osd-10[59969]: 2024-09-12T02:51:21.628+0000 7faa46dc6640 -1 osd.10 112 heartbeat_check: no reply from 172.21.15.39:6822 osd.6 since back 2024-09-12T02:50:57.277634+0000 front 2024-09-12T02:50:57.277698+0000 (oldest deadline 2024-09-12T02:51:21.377518+0000) 2024-09-12T02:51:22.350 INFO:journalctl@ceph.osd.9.smithi039.stdout:Sep 12 02:51:22 smithi039 ceph-4954ed46-70ae-11ef-bcea-c7b262605968-osd-9[63678]: 2024-09-12T02:51:22.046+0000 7f6d17a00640 -1 osd.9 112 heartbeat_check: no reply from 172.21.15.39:6806 osd.0 since back 2024-09-12T02:50:08.761527+0000 front 2024-09-12T02:50:08.761556+0000 (oldest deadline 2024-09-12T02:50:34.061510+0000) 2024-09-12T02:51:22.350 INFO:journalctl@ceph.osd.9.smithi039.stdout:Sep 12 02:51:22 smithi039 ceph-4954ed46-70ae-11ef-bcea-c7b262605968-osd-9[63678]: 2024-09-12T02:51:22.046+0000 7f6d17a00640 -1 osd.9 112 heartbeat_check: no reply from 172.21.15.44:6804 osd.1 since back 2024-09-12T02:50:14.062055+0000 front 2024-09-12T02:50:14.062119+0000 (oldest deadline 2024-09-12T02:50:38.761988+0000) 2024-09-12T02:51:22.350 INFO:journalctl@ceph.osd.9.smithi039.stdout:Sep 12 02:51:22 smithi039 ceph-4954ed46-70ae-11ef-bcea-c7b262605968-osd-9[63678]: 2024-09-12T02:51:22.046+0000 7f6d17a00640 -1 osd.9 112 heartbeat_check: no reply from 172.21.15.172:6804 osd.2 since back 2024-09-12T02:50:24.663318+0000 front 2024-09-12T02:50:24.663548+0000 (oldest deadline 2024-09-12T02:50:48.763108+0000) 2024-09-12T02:51:22.350 INFO:journalctl@ceph.osd.9.smithi039.stdout:Sep 12 02:51:22 smithi039 ceph-4954ed46-70ae-11ef-bcea-c7b262605968-osd-9[63678]: 2024-09-12T02:51:22.046+0000 7f6d17a00640 -1 osd.9 112 heartbeat_check: no reply from 172.21.15.39:6814 osd.3 since back 2024-09-12T02:50:33.464166+0000 front 2024-09-12T02:50:33.464108+0000 (oldest deadline 2024-09-12T02:50:55.164319+0000) 2024-09-12T02:51:22.350 INFO:journalctl@ceph.osd.9.smithi039.stdout:Sep 12 02:51:22 smithi039 ceph-4954ed46-70ae-11ef-bcea-c7b262605968-osd-9[63678]: 2024-09-12T02:51:22.046+0000 7f6d17a00640 -1 osd.9 112 heartbeat_check: no reply from 172.21.15.44:6812 osd.4 since back 2024-09-12T02:50:41.566107+0000 front 2024-09-12T02:50:41.565926+0000 (oldest deadline 2024-09-12T02:51:05.065942+0000) 2024-09-12T02:51:22.350 INFO:journalctl@ceph.osd.9.smithi039.stdout:Sep 12 02:51:22 smithi039 ceph-4954ed46-70ae-11ef-bcea-c7b262605968-osd-9[63678]: 2024-09-12T02:51:22.046+0000 7f6d17a00640 -1 osd.9 112 heartbeat_check: no reply from 172.21.15.172:6812 osd.5 since back 2024-09-12T02:50:46.667755+0000 front 2024-09-12T02:50:46.667507+0000 (oldest deadline 2024-09-12T02:51:12.567249+0000) 2024-09-12T02:51:22.764 INFO:journalctl@ceph.osd.11.smithi172.stdout:Sep 12 02:51:22 smithi172 ceph-4954ed46-70ae-11ef-bcea-c7b262605968-osd-11[61129]: 2024-09-12T02:51:22.486+0000 7ff146fac640 -1 osd.11 112 heartbeat_check: no reply from 172.21.15.39:6806 osd.0 since back 2024-09-12T02:50:09.449223+0000 front 2024-09-12T02:50:09.449210+0000 (oldest deadline 2024-09-12T02:50:34.748980+0000) 2024-09-12T02:51:22.764 INFO:journalctl@ceph.osd.11.smithi172.stdout:Sep 12 02:51:22 smithi172 ceph-4954ed46-70ae-11ef-bcea-c7b262605968-osd-11[61129]: 2024-09-12T02:51:22.486+0000 7ff146fac640 -1 osd.11 112 heartbeat_check: no reply from 172.21.15.44:6804 osd.1 since back 2024-09-12T02:50:14.749696+0000 front 2024-09-12T02:50:14.749454+0000 (oldest deadline 2024-09-12T02:50:42.950102+0000) 2024-09-12T02:51:22.764 INFO:journalctl@ceph.osd.11.smithi172.stdout:Sep 12 02:51:22 smithi172 ceph-4954ed46-70ae-11ef-bcea-c7b262605968-osd-11[61129]: 2024-09-12T02:51:22.486+0000 7ff146fac640 -1 osd.11 112 heartbeat_check: no reply from 172.21.15.172:6804 osd.2 since back 2024-09-12T02:50:22.950505+0000 front 2024-09-12T02:50:22.950558+0000 (oldest deadline 2024-09-12T02:50:48.850680+0000) 2024-09-12T02:51:22.764 INFO:journalctl@ceph.osd.11.smithi172.stdout:Sep 12 02:51:22 smithi172 ceph-4954ed46-70ae-11ef-bcea-c7b262605968-osd-11[61129]: 2024-09-12T02:51:22.486+0000 7ff146fac640 -1 osd.11 112 heartbeat_check: no reply from 172.21.15.44:6812 osd.4 since back 2024-09-12T02:50:39.054153+0000 front 2024-09-12T02:50:39.054100+0000 (oldest deadline 2024-09-12T02:51:04.354015+0000) 2024-09-12T02:51:22.764 INFO:journalctl@ceph.osd.11.smithi172.stdout:Sep 12 02:51:22 smithi172 ceph-4954ed46-70ae-11ef-bcea-c7b262605968-osd-11[61129]: 2024-09-12T02:51:22.486+0000 7ff146fac640 -1 osd.11 112 heartbeat_check: no reply from 172.21.15.172:6812 osd.5 since back 2024-09-12T02:50:49.455828+0000 front 2024-09-12T02:50:49.455854+0000 (oldest deadline 2024-09-12T02:51:14.755884+0000) 2024-09-12T02:51:22.764 INFO:journalctl@ceph.osd.11.smithi172.stdout:Sep 12 02:51:22 smithi172 ceph-4954ed46-70ae-11ef-bcea-c7b262605968-osd-11[61129]: 2024-09-12T02:51:22.486+0000 7ff146fac640 -1 osd.11 112 heartbeat_check: no reply from 172.21.15.39:6822 osd.6 since back 2024-09-12T02:50:54.756477+0000 front 2024-09-12T02:50:54.756555+0000 (oldest deadline 2024-09-12T02:51:20.656467+0000) 2024-09-12T02:51:22.948 INFO:journalctl@ceph.osd.10.smithi044.stdout:Sep 12 02:51:22 smithi044 ceph-4954ed46-70ae-11ef-bcea-c7b262605968-osd-10[59969]: 2024-09-12T02:51:22.631+0000 7faa46dc6640 -1 osd.10 112 heartbeat_check: no reply from 172.21.15.39:6806 osd.0 since back 2024-09-12T02:50:05.367150+0000 front 2024-09-12T02:50:05.367381+0000 (oldest deadline 2024-09-12T02:50:31.267058+0000) 2024-09-12T02:51:22.949 INFO:journalctl@ceph.osd.10.smithi044.stdout:Sep 12 02:51:22 smithi044 ceph-4954ed46-70ae-11ef-bcea-c7b262605968-osd-10[59969]: 2024-09-12T02:51:22.631+0000 7faa46dc6640 -1 osd.10 112 heartbeat_check: no reply from 172.21.15.44:6804 osd.1 since back 2024-09-12T02:50:17.969767+0000 front 2024-09-12T02:50:17.969892+0000 (oldest deadline 2024-09-12T02:50:40.270033+0000) 2024-09-12T02:51:22.949 INFO:journalctl@ceph.osd.10.smithi044.stdout:Sep 12 02:51:22 smithi044 ceph-4954ed46-70ae-11ef-bcea-c7b262605968-osd-10[59969]: 2024-09-12T02:51:22.631+0000 7faa46dc6640 -1 osd.10 112 heartbeat_check: no reply from 172.21.15.172:6804 osd.2 since back 2024-09-12T02:50:25.972029+0000 front 2024-09-12T02:50:25.972168+0000 (oldest deadline 2024-09-12T02:50:47.671992+0000) 2024-09-12T02:51:22.949 INFO:journalctl@ceph.osd.10.smithi044.stdout:Sep 12 02:51:22 smithi044 ceph-4954ed46-70ae-11ef-bcea-c7b262605968-osd-10[59969]: 2024-09-12T02:51:22.631+0000 7faa46dc6640 -1 osd.10 112 heartbeat_check: no reply from 172.21.15.39:6814 osd.3 since back 2024-09-12T02:50:31.673509+0000 front 2024-09-12T02:50:31.673612+0000 (oldest deadline 2024-09-12T02:50:56.973525+0000) 2024-09-12T02:51:22.949 INFO:journalctl@ceph.osd.10.smithi044.stdout:Sep 12 02:51:22 smithi044 ceph-4954ed46-70ae-11ef-bcea-c7b262605968-osd-10[59969]: 2024-09-12T02:51:22.631+0000 7faa46dc6640 -1 osd.10 112 heartbeat_check: no reply from 172.21.15.44:6812 osd.4 since back 2024-09-12T02:50:42.274445+0000 front 2024-09-12T02:50:42.274407+0000 (oldest deadline 2024-09-12T02:51:06.875067+0000) 2024-09-12T02:51:22.949 INFO:journalctl@ceph.osd.10.smithi044.stdout:Sep 12 02:51:22 smithi044 ceph-4954ed46-70ae-11ef-bcea-c7b262605968-osd-10[59969]: 2024-09-12T02:51:22.631+0000 7faa46dc6640 -1 osd.10 112 heartbeat_check: no reply from 172.21.15.172:6812 osd.5 since back 2024-09-12T02:50:46.875759+0000 front 2024-09-12T02:50:46.875831+0000 (oldest deadline 2024-09-12T02:51:12.775550+0000) 2024-09-12T02:51:22.949 INFO:journalctl@ceph.osd.10.smithi044.stdout:Sep 12 02:51:22 smithi044 ceph-4954ed46-70ae-11ef-bcea-c7b262605968-osd-10[59969]: 2024-09-12T02:51:22.631+0000 7faa46dc6640 -1 osd.10 112 heartbeat_check: no reply from 172.21.15.39:6822 osd.6 since back 2024-09-12T02:50:57.277634+0000 front 2024-09-12T02:50:57.277698+0000 (oldest deadline 2024-09-12T02:51:21.377518+0000) 2024-09-12T02:51:23.350 INFO:journalctl@ceph.osd.9.smithi039.stdout:Sep 12 02:51:23 smithi039 ceph-4954ed46-70ae-11ef-bcea-c7b262605968-osd-9[63678]: 2024-09-12T02:51:23.014+0000 7f6d17a00640 -1 osd.9 112 heartbeat_check: no reply from 172.21.15.39:6806 osd.0 since back 2024-09-12T02:50:08.761527+0000 front 2024-09-12T02:50:08.761556+0000 (oldest deadline 2024-09-12T02:50:34.061510+0000) 2024-09-12T02:51:23.350 INFO:journalctl@ceph.osd.9.smithi039.stdout:Sep 12 02:51:23 smithi039 ceph-4954ed46-70ae-11ef-bcea-c7b262605968-osd-9[63678]: 2024-09-12T02:51:23.014+0000 7f6d17a00640 -1 osd.9 112 heartbeat_check: no reply from 172.21.15.44:6804 osd.1 since back 2024-09-12T02:50:14.062055+0000 front 2024-09-12T02:50:14.062119+0000 (oldest deadline 2024-09-12T02:50:38.761988+0000) 2024-09-12T02:51:23.350 INFO:journalctl@ceph.osd.9.smithi039.stdout:Sep 12 02:51:23 smithi039 ceph-4954ed46-70ae-11ef-bcea-c7b262605968-osd-9[63678]: 2024-09-12T02:51:23.014+0000 7f6d17a00640 -1 osd.9 112 heartbeat_check: no reply from 172.21.15.172:6804 osd.2 since back 2024-09-12T02:50:24.663318+0000 front 2024-09-12T02:50:24.663548+0000 (oldest deadline 2024-09-12T02:50:48.763108+0000) 2024-09-12T02:51:23.350 INFO:journalctl@ceph.osd.9.smithi039.stdout:Sep 12 02:51:23 smithi039 ceph-4954ed46-70ae-11ef-bcea-c7b262605968-osd-9[63678]: 2024-09-12T02:51:23.014+0000 7f6d17a00640 -1 osd.9 112 heartbeat_check: no reply from 172.21.15.39:6814 osd.3 since back 2024-09-12T02:50:33.464166+0000 front 2024-09-12T02:50:33.464108+0000 (oldest deadline 2024-09-12T02:50:55.164319+0000) 2024-09-12T02:51:23.350 INFO:journalctl@ceph.osd.9.smithi039.stdout:Sep 12 02:51:23 smithi039 ceph-4954ed46-70ae-11ef-bcea-c7b262605968-osd-9[63678]: 2024-09-12T02:51:23.014+0000 7f6d17a00640 -1 osd.9 112 heartbeat_check: no reply from 172.21.15.44:6812 osd.4 since back 2024-09-12T02:50:41.566107+0000 front 2024-09-12T02:50:41.565926+0000 (oldest deadline 2024-09-12T02:51:05.065942+0000) 2024-09-12T02:51:23.350 INFO:journalctl@ceph.osd.9.smithi039.stdout:Sep 12 02:51:23 smithi039 ceph-4954ed46-70ae-11ef-bcea-c7b262605968-osd-9[63678]: 2024-09-12T02:51:23.014+0000 7f6d17a00640 -1 osd.9 112 heartbeat_check: no reply from 172.21.15.172:6812 osd.5 since back 2024-09-12T02:50:46.667755+0000 front 2024-09-12T02:50:46.667507+0000 (oldest deadline 2024-09-12T02:51:12.567249+0000) 2024-09-12T02:51:23.922 INFO:journalctl@ceph.osd.9.smithi039.stdout:Sep 12 02:51:23 smithi039 podman[91246]: 2024-09-12 02:51:23.646786283 +0000 UTC m=+5.714199673 container died 420838e298d7181e0c5be01de946f3be85a6d36ea3f39267586ea60d2897099d (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:3be30d720e37ec4df7f667e60f22b4d221c4ce7b408e68b90f9ac10220535e66, name=ceph-4954ed46-70ae-11ef-bcea-c7b262605968-osd-9, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.vendor=CentOS, io.buildah.version=1.37.2, GIT_BRANCH=HEAD, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.license=GPLv2, CEPH_POINT_RELEASE=, RELEASE=squid-b53b6d3, org.label-schema.build-date=20240731, maintainer=Guillaume Abrioux , org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.schema-version=1.0, ceph=True, GIT_CLEAN=True) 2024-09-12T02:51:23.948 INFO:journalctl@ceph.osd.10.smithi044.stdout:Sep 12 02:51:23 smithi044 ceph-4954ed46-70ae-11ef-bcea-c7b262605968-osd-10[59969]: 2024-09-12T02:51:23.660+0000 7faa46dc6640 -1 osd.10 112 heartbeat_check: no reply from 172.21.15.39:6806 osd.0 since back 2024-09-12T02:50:05.367150+0000 front 2024-09-12T02:50:05.367381+0000 (oldest deadline 2024-09-12T02:50:31.267058+0000) 2024-09-12T02:51:23.949 INFO:journalctl@ceph.osd.10.smithi044.stdout:Sep 12 02:51:23 smithi044 ceph-4954ed46-70ae-11ef-bcea-c7b262605968-osd-10[59969]: 2024-09-12T02:51:23.660+0000 7faa46dc6640 -1 osd.10 112 heartbeat_check: no reply from 172.21.15.44:6804 osd.1 since back 2024-09-12T02:50:17.969767+0000 front 2024-09-12T02:50:17.969892+0000 (oldest deadline 2024-09-12T02:50:40.270033+0000) 2024-09-12T02:51:23.949 INFO:journalctl@ceph.osd.10.smithi044.stdout:Sep 12 02:51:23 smithi044 ceph-4954ed46-70ae-11ef-bcea-c7b262605968-osd-10[59969]: 2024-09-12T02:51:23.660+0000 7faa46dc6640 -1 osd.10 112 heartbeat_check: no reply from 172.21.15.172:6804 osd.2 since back 2024-09-12T02:50:25.972029+0000 front 2024-09-12T02:50:25.972168+0000 (oldest deadline 2024-09-12T02:50:47.671992+0000) 2024-09-12T02:51:23.949 INFO:journalctl@ceph.osd.10.smithi044.stdout:Sep 12 02:51:23 smithi044 ceph-4954ed46-70ae-11ef-bcea-c7b262605968-osd-10[59969]: 2024-09-12T02:51:23.660+0000 7faa46dc6640 -1 osd.10 112 heartbeat_check: no reply from 172.21.15.39:6814 osd.3 since back 2024-09-12T02:50:31.673509+0000 front 2024-09-12T02:50:31.673612+0000 (oldest deadline 2024-09-12T02:50:56.973525+0000) 2024-09-12T02:51:23.949 INFO:journalctl@ceph.osd.10.smithi044.stdout:Sep 12 02:51:23 smithi044 ceph-4954ed46-70ae-11ef-bcea-c7b262605968-osd-10[59969]: 2024-09-12T02:51:23.660+0000 7faa46dc6640 -1 osd.10 112 heartbeat_check: no reply from 172.21.15.44:6812 osd.4 since back 2024-09-12T02:50:42.274445+0000 front 2024-09-12T02:50:42.274407+0000 (oldest deadline 2024-09-12T02:51:06.875067+0000) 2024-09-12T02:51:23.949 INFO:journalctl@ceph.osd.10.smithi044.stdout:Sep 12 02:51:23 smithi044 ceph-4954ed46-70ae-11ef-bcea-c7b262605968-osd-10[59969]: 2024-09-12T02:51:23.660+0000 7faa46dc6640 -1 osd.10 112 heartbeat_check: no reply from 172.21.15.172:6812 osd.5 since back 2024-09-12T02:50:46.875759+0000 front 2024-09-12T02:50:46.875831+0000 (oldest deadline 2024-09-12T02:51:12.775550+0000) 2024-09-12T02:51:23.949 INFO:journalctl@ceph.osd.10.smithi044.stdout:Sep 12 02:51:23 smithi044 ceph-4954ed46-70ae-11ef-bcea-c7b262605968-osd-10[59969]: 2024-09-12T02:51:23.660+0000 7faa46dc6640 -1 osd.10 112 heartbeat_check: no reply from 172.21.15.39:6822 osd.6 since back 2024-09-12T02:50:57.277634+0000 front 2024-09-12T02:50:57.277698+0000 (oldest deadline 2024-09-12T02:51:21.377518+0000) 2024-09-12T02:51:24.014 INFO:journalctl@ceph.osd.11.smithi172.stdout:Sep 12 02:51:23 smithi172 ceph-4954ed46-70ae-11ef-bcea-c7b262605968-osd-11[61129]: 2024-09-12T02:51:23.517+0000 7ff146fac640 -1 osd.11 112 heartbeat_check: no reply from 172.21.15.39:6806 osd.0 since back 2024-09-12T02:50:09.449223+0000 front 2024-09-12T02:50:09.449210+0000 (oldest deadline 2024-09-12T02:50:34.748980+0000) 2024-09-12T02:51:24.014 INFO:journalctl@ceph.osd.11.smithi172.stdout:Sep 12 02:51:23 smithi172 ceph-4954ed46-70ae-11ef-bcea-c7b262605968-osd-11[61129]: 2024-09-12T02:51:23.517+0000 7ff146fac640 -1 osd.11 112 heartbeat_check: no reply from 172.21.15.44:6804 osd.1 since back 2024-09-12T02:50:14.749696+0000 front 2024-09-12T02:50:14.749454+0000 (oldest deadline 2024-09-12T02:50:42.950102+0000) 2024-09-12T02:51:24.014 INFO:journalctl@ceph.osd.11.smithi172.stdout:Sep 12 02:51:23 smithi172 ceph-4954ed46-70ae-11ef-bcea-c7b262605968-osd-11[61129]: 2024-09-12T02:51:23.517+0000 7ff146fac640 -1 osd.11 112 heartbeat_check: no reply from 172.21.15.172:6804 osd.2 since back 2024-09-12T02:50:22.950505+0000 front 2024-09-12T02:50:22.950558+0000 (oldest deadline 2024-09-12T02:50:48.850680+0000) 2024-09-12T02:51:24.014 INFO:journalctl@ceph.osd.11.smithi172.stdout:Sep 12 02:51:23 smithi172 ceph-4954ed46-70ae-11ef-bcea-c7b262605968-osd-11[61129]: 2024-09-12T02:51:23.517+0000 7ff146fac640 -1 osd.11 112 heartbeat_check: no reply from 172.21.15.44:6812 osd.4 since back 2024-09-12T02:50:39.054153+0000 front 2024-09-12T02:50:39.054100+0000 (oldest deadline 2024-09-12T02:51:04.354015+0000) 2024-09-12T02:51:24.014 INFO:journalctl@ceph.osd.11.smithi172.stdout:Sep 12 02:51:23 smithi172 ceph-4954ed46-70ae-11ef-bcea-c7b262605968-osd-11[61129]: 2024-09-12T02:51:23.517+0000 7ff146fac640 -1 osd.11 112 heartbeat_check: no reply from 172.21.15.172:6812 osd.5 since back 2024-09-12T02:50:49.455828+0000 front 2024-09-12T02:50:49.455854+0000 (oldest deadline 2024-09-12T02:51:14.755884+0000) 2024-09-12T02:51:24.014 INFO:journalctl@ceph.osd.11.smithi172.stdout:Sep 12 02:51:23 smithi172 ceph-4954ed46-70ae-11ef-bcea-c7b262605968-osd-11[61129]: 2024-09-12T02:51:23.517+0000 7ff146fac640 -1 osd.11 112 heartbeat_check: no reply from 172.21.15.39:6822 osd.6 since back 2024-09-12T02:50:54.756477+0000 front 2024-09-12T02:50:54.756555+0000 (oldest deadline 2024-09-12T02:51:20.656467+0000) 2024-09-12T02:51:24.213 INFO:journalctl@ceph.osd.9.smithi039.stdout:Sep 12 02:51:24 smithi039 podman[91246]: 2024-09-12 02:51:24.037213895 +0000 UTC m=+6.104627291 container cleanup 420838e298d7181e0c5be01de946f3be85a6d36ea3f39267586ea60d2897099d (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:3be30d720e37ec4df7f667e60f22b4d221c4ce7b408e68b90f9ac10220535e66, name=ceph-4954ed46-70ae-11ef-bcea-c7b262605968-osd-9, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.schema-version=1.0, ceph=True, RELEASE=squid-b53b6d3, GIT_REPO=git@github.com:ceph/ceph-container.git, io.buildah.version=1.37.2, maintainer=Guillaume Abrioux , org.label-schema.license=GPLv2, CEPH_POINT_RELEASE=, org.label-schema.build-date=20240731, GIT_BRANCH=HEAD, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.vendor=CentOS, GIT_CLEAN=True) 2024-09-12T02:51:24.214 INFO:journalctl@ceph.osd.9.smithi039.stdout:Sep 12 02:51:24 smithi039 bash[91246]: ceph-4954ed46-70ae-11ef-bcea-c7b262605968-osd-9 2024-09-12T02:51:24.599 INFO:journalctl@ceph.osd.9.smithi039.stdout:Sep 12 02:51:24 smithi039 podman[91264]: 2024-09-12 02:51:24.213414684 +0000 UTC m=+0.548464423 container remove 420838e298d7181e0c5be01de946f3be85a6d36ea3f39267586ea60d2897099d (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:3be30d720e37ec4df7f667e60f22b4d221c4ce7b408e68b90f9ac10220535e66, name=ceph-4954ed46-70ae-11ef-bcea-c7b262605968-osd-9, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.schema-version=1.0, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.build-date=20240731, org.label-schema.license=GPLv2, CEPH_POINT_RELEASE=, org.label-schema.vendor=CentOS, ceph=True, io.buildah.version=1.37.2, maintainer=Guillaume Abrioux , org.label-schema.name=CentOS Stream 9 Base Image, RELEASE=squid-b53b6d3, GIT_BRANCH=HEAD, GIT_CLEAN=True) 2024-09-12T02:51:24.949 INFO:journalctl@ceph.osd.10.smithi044.stdout:Sep 12 02:51:24 smithi044 ceph-4954ed46-70ae-11ef-bcea-c7b262605968-osd-10[59969]: 2024-09-12T02:51:24.645+0000 7faa46dc6640 -1 osd.10 112 heartbeat_check: no reply from 172.21.15.39:6806 osd.0 since back 2024-09-12T02:50:05.367150+0000 front 2024-09-12T02:50:05.367381+0000 (oldest deadline 2024-09-12T02:50:31.267058+0000) 2024-09-12T02:51:24.949 INFO:journalctl@ceph.osd.10.smithi044.stdout:Sep 12 02:51:24 smithi044 ceph-4954ed46-70ae-11ef-bcea-c7b262605968-osd-10[59969]: 2024-09-12T02:51:24.645+0000 7faa46dc6640 -1 osd.10 112 heartbeat_check: no reply from 172.21.15.44:6804 osd.1 since back 2024-09-12T02:50:17.969767+0000 front 2024-09-12T02:50:17.969892+0000 (oldest deadline 2024-09-12T02:50:40.270033+0000) 2024-09-12T02:51:24.949 INFO:journalctl@ceph.osd.10.smithi044.stdout:Sep 12 02:51:24 smithi044 ceph-4954ed46-70ae-11ef-bcea-c7b262605968-osd-10[59969]: 2024-09-12T02:51:24.645+0000 7faa46dc6640 -1 osd.10 112 heartbeat_check: no reply from 172.21.15.172:6804 osd.2 since back 2024-09-12T02:50:25.972029+0000 front 2024-09-12T02:50:25.972168+0000 (oldest deadline 2024-09-12T02:50:47.671992+0000) 2024-09-12T02:51:24.949 INFO:journalctl@ceph.osd.10.smithi044.stdout:Sep 12 02:51:24 smithi044 ceph-4954ed46-70ae-11ef-bcea-c7b262605968-osd-10[59969]: 2024-09-12T02:51:24.645+0000 7faa46dc6640 -1 osd.10 112 heartbeat_check: no reply from 172.21.15.39:6814 osd.3 since back 2024-09-12T02:50:31.673509+0000 front 2024-09-12T02:50:31.673612+0000 (oldest deadline 2024-09-12T02:50:56.973525+0000) 2024-09-12T02:51:24.949 INFO:journalctl@ceph.osd.10.smithi044.stdout:Sep 12 02:51:24 smithi044 ceph-4954ed46-70ae-11ef-bcea-c7b262605968-osd-10[59969]: 2024-09-12T02:51:24.645+0000 7faa46dc6640 -1 osd.10 112 heartbeat_check: no reply from 172.21.15.44:6812 osd.4 since back 2024-09-12T02:50:42.274445+0000 front 2024-09-12T02:50:42.274407+0000 (oldest deadline 2024-09-12T02:51:06.875067+0000) 2024-09-12T02:51:24.949 INFO:journalctl@ceph.osd.10.smithi044.stdout:Sep 12 02:51:24 smithi044 ceph-4954ed46-70ae-11ef-bcea-c7b262605968-osd-10[59969]: 2024-09-12T02:51:24.645+0000 7faa46dc6640 -1 osd.10 112 heartbeat_check: no reply from 172.21.15.172:6812 osd.5 since back 2024-09-12T02:50:46.875759+0000 front 2024-09-12T02:50:46.875831+0000 (oldest deadline 2024-09-12T02:51:12.775550+0000) 2024-09-12T02:51:24.949 INFO:journalctl@ceph.osd.10.smithi044.stdout:Sep 12 02:51:24 smithi044 ceph-4954ed46-70ae-11ef-bcea-c7b262605968-osd-10[59969]: 2024-09-12T02:51:24.645+0000 7faa46dc6640 -1 osd.10 112 heartbeat_check: no reply from 172.21.15.39:6822 osd.6 since back 2024-09-12T02:50:57.277634+0000 front 2024-09-12T02:50:57.277698+0000 (oldest deadline 2024-09-12T02:51:21.377518+0000) 2024-09-12T02:51:25.014 INFO:journalctl@ceph.osd.11.smithi172.stdout:Sep 12 02:51:24 smithi172 ceph-4954ed46-70ae-11ef-bcea-c7b262605968-osd-11[61129]: 2024-09-12T02:51:24.537+0000 7ff146fac640 -1 osd.11 112 heartbeat_check: no reply from 172.21.15.39:6806 osd.0 since back 2024-09-12T02:50:09.449223+0000 front 2024-09-12T02:50:09.449210+0000 (oldest deadline 2024-09-12T02:50:34.748980+0000) 2024-09-12T02:51:25.014 INFO:journalctl@ceph.osd.11.smithi172.stdout:Sep 12 02:51:24 smithi172 ceph-4954ed46-70ae-11ef-bcea-c7b262605968-osd-11[61129]: 2024-09-12T02:51:24.537+0000 7ff146fac640 -1 osd.11 112 heartbeat_check: no reply from 172.21.15.44:6804 osd.1 since back 2024-09-12T02:50:14.749696+0000 front 2024-09-12T02:50:14.749454+0000 (oldest deadline 2024-09-12T02:50:42.950102+0000) 2024-09-12T02:51:25.014 INFO:journalctl@ceph.osd.11.smithi172.stdout:Sep 12 02:51:24 smithi172 ceph-4954ed46-70ae-11ef-bcea-c7b262605968-osd-11[61129]: 2024-09-12T02:51:24.537+0000 7ff146fac640 -1 osd.11 112 heartbeat_check: no reply from 172.21.15.172:6804 osd.2 since back 2024-09-12T02:50:22.950505+0000 front 2024-09-12T02:50:22.950558+0000 (oldest deadline 2024-09-12T02:50:48.850680+0000) 2024-09-12T02:51:25.014 INFO:journalctl@ceph.osd.11.smithi172.stdout:Sep 12 02:51:24 smithi172 ceph-4954ed46-70ae-11ef-bcea-c7b262605968-osd-11[61129]: 2024-09-12T02:51:24.537+0000 7ff146fac640 -1 osd.11 112 heartbeat_check: no reply from 172.21.15.44:6812 osd.4 since back 2024-09-12T02:50:39.054153+0000 front 2024-09-12T02:50:39.054100+0000 (oldest deadline 2024-09-12T02:51:04.354015+0000) 2024-09-12T02:51:25.014 INFO:journalctl@ceph.osd.11.smithi172.stdout:Sep 12 02:51:24 smithi172 ceph-4954ed46-70ae-11ef-bcea-c7b262605968-osd-11[61129]: 2024-09-12T02:51:24.537+0000 7ff146fac640 -1 osd.11 112 heartbeat_check: no reply from 172.21.15.172:6812 osd.5 since back 2024-09-12T02:50:49.455828+0000 front 2024-09-12T02:50:49.455854+0000 (oldest deadline 2024-09-12T02:51:14.755884+0000) 2024-09-12T02:51:25.014 INFO:journalctl@ceph.osd.11.smithi172.stdout:Sep 12 02:51:24 smithi172 ceph-4954ed46-70ae-11ef-bcea-c7b262605968-osd-11[61129]: 2024-09-12T02:51:24.537+0000 7ff146fac640 -1 osd.11 112 heartbeat_check: no reply from 172.21.15.39:6822 osd.6 since back 2024-09-12T02:50:54.756477+0000 front 2024-09-12T02:50:54.756555+0000 (oldest deadline 2024-09-12T02:51:20.656467+0000) 2024-09-12T02:51:25.024 INFO:journalctl@ceph.osd.9.smithi039.stdout:Sep 12 02:51:24 smithi039 podman[91352]: 2024-09-12 02:51:24.677579204 +0000 UTC m=+0.027254676 image pull 54467abc55f864c4f73dfaf9c6ac3bb3e87b773123d5badaf790bee57321d594 quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:3be30d720e37ec4df7f667e60f22b4d221c4ce7b408e68b90f9ac10220535e66 2024-09-12T02:51:25.024 INFO:journalctl@ceph.osd.9.smithi039.stdout:Sep 12 02:51:24 smithi039 podman[91352]: 2024-09-12 02:51:24.781094348 +0000 UTC m=+0.130769820 container create a28a53935bdc8e9428425c3ae0573bbd17dcd5b950fc108a9af618bdfed78b52 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:3be30d720e37ec4df7f667e60f22b4d221c4ce7b408e68b90f9ac10220535e66, name=ceph-4954ed46-70ae-11ef-bcea-c7b262605968-osd-9-deactivate, org.label-schema.schema-version=1.0, ceph=True, GIT_BRANCH=HEAD, RELEASE=squid-b53b6d3, GIT_REPO=git@github.com:ceph/ceph-container.git, io.buildah.version=1.37.2, org.label-schema.name=CentOS Stream 9 Base Image, GIT_CLEAN=True, org.label-schema.vendor=CentOS, maintainer=Guillaume Abrioux , CEPH_POINT_RELEASE=, org.label-schema.build-date=20240731, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.license=GPLv2) 2024-09-12T02:51:25.024 INFO:journalctl@ceph.osd.9.smithi039.stdout:Sep 12 02:51:25 smithi039 podman[91352]: 2024-09-12 02:51:25.017131308 +0000 UTC m=+0.366806783 container init a28a53935bdc8e9428425c3ae0573bbd17dcd5b950fc108a9af618bdfed78b52 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:3be30d720e37ec4df7f667e60f22b4d221c4ce7b408e68b90f9ac10220535e66, name=ceph-4954ed46-70ae-11ef-bcea-c7b262605968-osd-9-deactivate, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.schema-version=1.0, ceph=True, org.label-schema.license=GPLv2, RELEASE=squid-b53b6d3, io.buildah.version=1.37.2, GIT_REPO=git@github.com:ceph/ceph-container.git, CEPH_POINT_RELEASE=, GIT_CLEAN=True, GIT_BRANCH=HEAD, maintainer=Guillaume Abrioux , org.label-schema.vendor=CentOS, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.build-date=20240731) 2024-09-12T02:51:25.024 INFO:journalctl@ceph.osd.9.smithi039.stdout:Sep 12 02:51:25 smithi039 podman[91352]: 2024-09-12 02:51:25.023958174 +0000 UTC m=+0.373633646 container start a28a53935bdc8e9428425c3ae0573bbd17dcd5b950fc108a9af618bdfed78b52 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:3be30d720e37ec4df7f667e60f22b4d221c4ce7b408e68b90f9ac10220535e66, name=ceph-4954ed46-70ae-11ef-bcea-c7b262605968-osd-9-deactivate, ceph=True, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.license=GPLv2, io.buildah.version=1.37.2, RELEASE=squid-b53b6d3, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_BRANCH=HEAD, CEPH_POINT_RELEASE=, GIT_CLEAN=True, org.label-schema.vendor=CentOS, org.label-schema.name=CentOS Stream 9 Base Image, maintainer=Guillaume Abrioux , org.label-schema.schema-version=1.0, org.label-schema.build-date=20240731) 2024-09-12T02:51:25.292 INFO:journalctl@ceph.osd.9.smithi039.stdout:Sep 12 02:51:25 smithi039 podman[91352]: 2024-09-12 02:51:25.125637675 +0000 UTC m=+0.475313157 container attach a28a53935bdc8e9428425c3ae0573bbd17dcd5b950fc108a9af618bdfed78b52 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:3be30d720e37ec4df7f667e60f22b4d221c4ce7b408e68b90f9ac10220535e66, name=ceph-4954ed46-70ae-11ef-bcea-c7b262605968-osd-9-deactivate, GIT_BRANCH=HEAD, org.label-schema.license=GPLv2, CEPH_POINT_RELEASE=, org.label-schema.name=CentOS Stream 9 Base Image, maintainer=Guillaume Abrioux , org.label-schema.build-date=20240731, org.label-schema.schema-version=1.0, GIT_CLEAN=True, ceph=True, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, RELEASE=squid-b53b6d3, io.buildah.version=1.37.2, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.vendor=CentOS) 2024-09-12T02:51:25.599 INFO:journalctl@ceph.osd.9.smithi039.stdout:Sep 12 02:51:25 smithi039 podman[91352]: 2024-09-12 02:51:25.292659562 +0000 UTC m=+0.642335039 container died a28a53935bdc8e9428425c3ae0573bbd17dcd5b950fc108a9af618bdfed78b52 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:3be30d720e37ec4df7f667e60f22b4d221c4ce7b408e68b90f9ac10220535e66, name=ceph-4954ed46-70ae-11ef-bcea-c7b262605968-osd-9-deactivate, org.label-schema.schema-version=1.0, RELEASE=squid-b53b6d3, org.label-schema.name=CentOS Stream 9 Base Image, CEPH_POINT_RELEASE=, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.build-date=20240731, ceph=True, maintainer=Guillaume Abrioux , GIT_CLEAN=True, io.buildah.version=1.37.2, org.label-schema.vendor=CentOS, GIT_BRANCH=HEAD, org.label-schema.license=GPLv2) 2024-09-12T02:51:25.948 INFO:journalctl@ceph.osd.10.smithi044.stdout:Sep 12 02:51:25 smithi044 ceph-4954ed46-70ae-11ef-bcea-c7b262605968-osd-10[59969]: 2024-09-12T02:51:25.638+0000 7faa46dc6640 -1 osd.10 112 heartbeat_check: no reply from 172.21.15.39:6806 osd.0 since back 2024-09-12T02:50:05.367150+0000 front 2024-09-12T02:50:05.367381+0000 (oldest deadline 2024-09-12T02:50:31.267058+0000) 2024-09-12T02:51:25.949 INFO:journalctl@ceph.osd.10.smithi044.stdout:Sep 12 02:51:25 smithi044 ceph-4954ed46-70ae-11ef-bcea-c7b262605968-osd-10[59969]: 2024-09-12T02:51:25.638+0000 7faa46dc6640 -1 osd.10 112 heartbeat_check: no reply from 172.21.15.44:6804 osd.1 since back 2024-09-12T02:50:17.969767+0000 front 2024-09-12T02:50:17.969892+0000 (oldest deadline 2024-09-12T02:50:40.270033+0000) 2024-09-12T02:51:25.949 INFO:journalctl@ceph.osd.10.smithi044.stdout:Sep 12 02:51:25 smithi044 ceph-4954ed46-70ae-11ef-bcea-c7b262605968-osd-10[59969]: 2024-09-12T02:51:25.638+0000 7faa46dc6640 -1 osd.10 112 heartbeat_check: no reply from 172.21.15.172:6804 osd.2 since back 2024-09-12T02:50:25.972029+0000 front 2024-09-12T02:50:25.972168+0000 (oldest deadline 2024-09-12T02:50:47.671992+0000) 2024-09-12T02:51:25.949 INFO:journalctl@ceph.osd.10.smithi044.stdout:Sep 12 02:51:25 smithi044 ceph-4954ed46-70ae-11ef-bcea-c7b262605968-osd-10[59969]: 2024-09-12T02:51:25.638+0000 7faa46dc6640 -1 osd.10 112 heartbeat_check: no reply from 172.21.15.39:6814 osd.3 since back 2024-09-12T02:50:31.673509+0000 front 2024-09-12T02:50:31.673612+0000 (oldest deadline 2024-09-12T02:50:56.973525+0000) 2024-09-12T02:51:25.949 INFO:journalctl@ceph.osd.10.smithi044.stdout:Sep 12 02:51:25 smithi044 ceph-4954ed46-70ae-11ef-bcea-c7b262605968-osd-10[59969]: 2024-09-12T02:51:25.638+0000 7faa46dc6640 -1 osd.10 112 heartbeat_check: no reply from 172.21.15.44:6812 osd.4 since back 2024-09-12T02:50:42.274445+0000 front 2024-09-12T02:50:42.274407+0000 (oldest deadline 2024-09-12T02:51:06.875067+0000) 2024-09-12T02:51:25.949 INFO:journalctl@ceph.osd.10.smithi044.stdout:Sep 12 02:51:25 smithi044 ceph-4954ed46-70ae-11ef-bcea-c7b262605968-osd-10[59969]: 2024-09-12T02:51:25.638+0000 7faa46dc6640 -1 osd.10 112 heartbeat_check: no reply from 172.21.15.172:6812 osd.5 since back 2024-09-12T02:50:46.875759+0000 front 2024-09-12T02:50:46.875831+0000 (oldest deadline 2024-09-12T02:51:12.775550+0000) 2024-09-12T02:51:25.949 INFO:journalctl@ceph.osd.10.smithi044.stdout:Sep 12 02:51:25 smithi044 ceph-4954ed46-70ae-11ef-bcea-c7b262605968-osd-10[59969]: 2024-09-12T02:51:25.638+0000 7faa46dc6640 -1 osd.10 112 heartbeat_check: no reply from 172.21.15.39:6822 osd.6 since back 2024-09-12T02:50:57.277634+0000 front 2024-09-12T02:50:57.277698+0000 (oldest deadline 2024-09-12T02:51:21.377518+0000) 2024-09-12T02:51:26.014 INFO:journalctl@ceph.osd.11.smithi172.stdout:Sep 12 02:51:25 smithi172 ceph-4954ed46-70ae-11ef-bcea-c7b262605968-osd-11[61129]: 2024-09-12T02:51:25.577+0000 7ff146fac640 -1 osd.11 112 heartbeat_check: no reply from 172.21.15.39:6806 osd.0 since back 2024-09-12T02:50:09.449223+0000 front 2024-09-12T02:50:09.449210+0000 (oldest deadline 2024-09-12T02:50:34.748980+0000) 2024-09-12T02:51:26.014 INFO:journalctl@ceph.osd.11.smithi172.stdout:Sep 12 02:51:25 smithi172 ceph-4954ed46-70ae-11ef-bcea-c7b262605968-osd-11[61129]: 2024-09-12T02:51:25.577+0000 7ff146fac640 -1 osd.11 112 heartbeat_check: no reply from 172.21.15.44:6804 osd.1 since back 2024-09-12T02:50:14.749696+0000 front 2024-09-12T02:50:14.749454+0000 (oldest deadline 2024-09-12T02:50:42.950102+0000) 2024-09-12T02:51:26.014 INFO:journalctl@ceph.osd.11.smithi172.stdout:Sep 12 02:51:25 smithi172 ceph-4954ed46-70ae-11ef-bcea-c7b262605968-osd-11[61129]: 2024-09-12T02:51:25.577+0000 7ff146fac640 -1 osd.11 112 heartbeat_check: no reply from 172.21.15.172:6804 osd.2 since back 2024-09-12T02:50:22.950505+0000 front 2024-09-12T02:50:22.950558+0000 (oldest deadline 2024-09-12T02:50:48.850680+0000) 2024-09-12T02:51:26.014 INFO:journalctl@ceph.osd.11.smithi172.stdout:Sep 12 02:51:25 smithi172 ceph-4954ed46-70ae-11ef-bcea-c7b262605968-osd-11[61129]: 2024-09-12T02:51:25.577+0000 7ff146fac640 -1 osd.11 112 heartbeat_check: no reply from 172.21.15.44:6812 osd.4 since back 2024-09-12T02:50:39.054153+0000 front 2024-09-12T02:50:39.054100+0000 (oldest deadline 2024-09-12T02:51:04.354015+0000) 2024-09-12T02:51:26.014 INFO:journalctl@ceph.osd.11.smithi172.stdout:Sep 12 02:51:25 smithi172 ceph-4954ed46-70ae-11ef-bcea-c7b262605968-osd-11[61129]: 2024-09-12T02:51:25.577+0000 7ff146fac640 -1 osd.11 112 heartbeat_check: no reply from 172.21.15.172:6812 osd.5 since back 2024-09-12T02:50:49.455828+0000 front 2024-09-12T02:50:49.455854+0000 (oldest deadline 2024-09-12T02:51:14.755884+0000) 2024-09-12T02:51:26.014 INFO:journalctl@ceph.osd.11.smithi172.stdout:Sep 12 02:51:25 smithi172 ceph-4954ed46-70ae-11ef-bcea-c7b262605968-osd-11[61129]: 2024-09-12T02:51:25.577+0000 7ff146fac640 -1 osd.11 112 heartbeat_check: no reply from 172.21.15.39:6822 osd.6 since back 2024-09-12T02:50:54.756477+0000 front 2024-09-12T02:50:54.756555+0000 (oldest deadline 2024-09-12T02:51:20.656467+0000) 2024-09-12T02:51:26.027 DEBUG:teuthology.orchestra.run.smithi039:> sudo pkill -f 'journalctl -f -n 0 -u ceph-4954ed46-70ae-11ef-bcea-c7b262605968@osd.9.service' 2024-09-12T02:51:26.104 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-09-12T02:51:26.104 INFO:tasks.cephadm.osd.9:Stopped osd.9 2024-09-12T02:51:26.104 INFO:tasks.cephadm.osd.10:Stopping osd.10... 2024-09-12T02:51:26.104 DEBUG:teuthology.orchestra.run.smithi044:> sudo systemctl stop ceph-4954ed46-70ae-11ef-bcea-c7b262605968@osd.10 2024-09-12T02:51:26.435 INFO:journalctl@ceph.osd.10.smithi044.stdout:Sep 12 02:51:26 smithi044 systemd[1]: Stopping Ceph osd.10 for 4954ed46-70ae-11ef-bcea-c7b262605968... 2024-09-12T02:51:26.699 INFO:journalctl@ceph.osd.10.smithi044.stdout:Sep 12 02:51:26 smithi044 ceph-4954ed46-70ae-11ef-bcea-c7b262605968-osd-10[59969]: 2024-09-12T02:51:26.434+0000 7faa4a7b0640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-osd -n osd.10 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-09-12T02:51:26.699 INFO:journalctl@ceph.osd.10.smithi044.stdout:Sep 12 02:51:26 smithi044 ceph-4954ed46-70ae-11ef-bcea-c7b262605968-osd-10[59969]: 2024-09-12T02:51:26.434+0000 7faa4a7b0640 -1 osd.10 112 *** Got signal Terminated *** 2024-09-12T02:51:26.699 INFO:journalctl@ceph.osd.10.smithi044.stdout:Sep 12 02:51:26 smithi044 ceph-4954ed46-70ae-11ef-bcea-c7b262605968-osd-10[59969]: 2024-09-12T02:51:26.434+0000 7faa4a7b0640 -1 osd.10 112 *** Immediate shutdown (osd_fast_shutdown=true) *** 2024-09-12T02:51:26.699 INFO:journalctl@ceph.osd.10.smithi044.stdout:Sep 12 02:51:26 smithi044 ceph-4954ed46-70ae-11ef-bcea-c7b262605968-osd-10[59969]: 2024-09-12T02:51:26.602+0000 7faa46dc6640 -1 osd.10 112 heartbeat_check: no reply from 172.21.15.39:6806 osd.0 since back 2024-09-12T02:50:05.367150+0000 front 2024-09-12T02:50:05.367381+0000 (oldest deadline 2024-09-12T02:50:31.267058+0000) 2024-09-12T02:51:26.699 INFO:journalctl@ceph.osd.10.smithi044.stdout:Sep 12 02:51:26 smithi044 ceph-4954ed46-70ae-11ef-bcea-c7b262605968-osd-10[59969]: 2024-09-12T02:51:26.602+0000 7faa46dc6640 -1 osd.10 112 heartbeat_check: no reply from 172.21.15.44:6804 osd.1 since back 2024-09-12T02:50:17.969767+0000 front 2024-09-12T02:50:17.969892+0000 (oldest deadline 2024-09-12T02:50:40.270033+0000) 2024-09-12T02:51:26.699 INFO:journalctl@ceph.osd.10.smithi044.stdout:Sep 12 02:51:26 smithi044 ceph-4954ed46-70ae-11ef-bcea-c7b262605968-osd-10[59969]: 2024-09-12T02:51:26.602+0000 7faa46dc6640 -1 osd.10 112 heartbeat_check: no reply from 172.21.15.172:6804 osd.2 since back 2024-09-12T02:50:25.972029+0000 front 2024-09-12T02:50:25.972168+0000 (oldest deadline 2024-09-12T02:50:47.671992+0000) 2024-09-12T02:51:26.699 INFO:journalctl@ceph.osd.10.smithi044.stdout:Sep 12 02:51:26 smithi044 ceph-4954ed46-70ae-11ef-bcea-c7b262605968-osd-10[59969]: 2024-09-12T02:51:26.602+0000 7faa46dc6640 -1 osd.10 112 heartbeat_check: no reply from 172.21.15.39:6814 osd.3 since back 2024-09-12T02:50:31.673509+0000 front 2024-09-12T02:50:31.673612+0000 (oldest deadline 2024-09-12T02:50:56.973525+0000) 2024-09-12T02:51:26.699 INFO:journalctl@ceph.osd.10.smithi044.stdout:Sep 12 02:51:26 smithi044 ceph-4954ed46-70ae-11ef-bcea-c7b262605968-osd-10[59969]: 2024-09-12T02:51:26.602+0000 7faa46dc6640 -1 osd.10 112 heartbeat_check: no reply from 172.21.15.44:6812 osd.4 since back 2024-09-12T02:50:42.274445+0000 front 2024-09-12T02:50:42.274407+0000 (oldest deadline 2024-09-12T02:51:06.875067+0000) 2024-09-12T02:51:26.699 INFO:journalctl@ceph.osd.10.smithi044.stdout:Sep 12 02:51:26 smithi044 ceph-4954ed46-70ae-11ef-bcea-c7b262605968-osd-10[59969]: 2024-09-12T02:51:26.602+0000 7faa46dc6640 -1 osd.10 112 heartbeat_check: no reply from 172.21.15.172:6812 osd.5 since back 2024-09-12T02:50:46.875759+0000 front 2024-09-12T02:50:46.875831+0000 (oldest deadline 2024-09-12T02:51:12.775550+0000) 2024-09-12T02:51:26.699 INFO:journalctl@ceph.osd.10.smithi044.stdout:Sep 12 02:51:26 smithi044 ceph-4954ed46-70ae-11ef-bcea-c7b262605968-osd-10[59969]: 2024-09-12T02:51:26.602+0000 7faa46dc6640 -1 osd.10 112 heartbeat_check: no reply from 172.21.15.39:6822 osd.6 since back 2024-09-12T02:50:57.277634+0000 front 2024-09-12T02:50:57.277698+0000 (oldest deadline 2024-09-12T02:51:21.377518+0000) 2024-09-12T02:51:26.915 INFO:journalctl@ceph.osd.11.smithi172.stdout:Sep 12 02:51:26 smithi172 ceph-4954ed46-70ae-11ef-bcea-c7b262605968-osd-11[61129]: 2024-09-12T02:51:26.596+0000 7ff146fac640 -1 osd.11 112 heartbeat_check: no reply from 172.21.15.39:6806 osd.0 since back 2024-09-12T02:50:09.449223+0000 front 2024-09-12T02:50:09.449210+0000 (oldest deadline 2024-09-12T02:50:34.748980+0000) 2024-09-12T02:51:26.915 INFO:journalctl@ceph.osd.11.smithi172.stdout:Sep 12 02:51:26 smithi172 ceph-4954ed46-70ae-11ef-bcea-c7b262605968-osd-11[61129]: 2024-09-12T02:51:26.596+0000 7ff146fac640 -1 osd.11 112 heartbeat_check: no reply from 172.21.15.44:6804 osd.1 since back 2024-09-12T02:50:14.749696+0000 front 2024-09-12T02:50:14.749454+0000 (oldest deadline 2024-09-12T02:50:42.950102+0000) 2024-09-12T02:51:26.915 INFO:journalctl@ceph.osd.11.smithi172.stdout:Sep 12 02:51:26 smithi172 ceph-4954ed46-70ae-11ef-bcea-c7b262605968-osd-11[61129]: 2024-09-12T02:51:26.596+0000 7ff146fac640 -1 osd.11 112 heartbeat_check: no reply from 172.21.15.172:6804 osd.2 since back 2024-09-12T02:50:22.950505+0000 front 2024-09-12T02:50:22.950558+0000 (oldest deadline 2024-09-12T02:50:48.850680+0000) 2024-09-12T02:51:26.915 INFO:journalctl@ceph.osd.11.smithi172.stdout:Sep 12 02:51:26 smithi172 ceph-4954ed46-70ae-11ef-bcea-c7b262605968-osd-11[61129]: 2024-09-12T02:51:26.596+0000 7ff146fac640 -1 osd.11 112 heartbeat_check: no reply from 172.21.15.44:6812 osd.4 since back 2024-09-12T02:50:39.054153+0000 front 2024-09-12T02:50:39.054100+0000 (oldest deadline 2024-09-12T02:51:04.354015+0000) 2024-09-12T02:51:26.915 INFO:journalctl@ceph.osd.11.smithi172.stdout:Sep 12 02:51:26 smithi172 ceph-4954ed46-70ae-11ef-bcea-c7b262605968-osd-11[61129]: 2024-09-12T02:51:26.596+0000 7ff146fac640 -1 osd.11 112 heartbeat_check: no reply from 172.21.15.172:6812 osd.5 since back 2024-09-12T02:50:49.455828+0000 front 2024-09-12T02:50:49.455854+0000 (oldest deadline 2024-09-12T02:51:14.755884+0000) 2024-09-12T02:51:26.915 INFO:journalctl@ceph.osd.11.smithi172.stdout:Sep 12 02:51:26 smithi172 ceph-4954ed46-70ae-11ef-bcea-c7b262605968-osd-11[61129]: 2024-09-12T02:51:26.596+0000 7ff146fac640 -1 osd.11 112 heartbeat_check: no reply from 172.21.15.39:6822 osd.6 since back 2024-09-12T02:50:54.756477+0000 front 2024-09-12T02:50:54.756555+0000 (oldest deadline 2024-09-12T02:51:20.656467+0000) 2024-09-12T02:51:27.949 INFO:journalctl@ceph.osd.10.smithi044.stdout:Sep 12 02:51:27 smithi044 ceph-4954ed46-70ae-11ef-bcea-c7b262605968-osd-10[59969]: 2024-09-12T02:51:27.597+0000 7faa46dc6640 -1 osd.10 112 heartbeat_check: no reply from 172.21.15.39:6806 osd.0 since back 2024-09-12T02:50:05.367150+0000 front 2024-09-12T02:50:05.367381+0000 (oldest deadline 2024-09-12T02:50:31.267058+0000) 2024-09-12T02:51:27.949 INFO:journalctl@ceph.osd.10.smithi044.stdout:Sep 12 02:51:27 smithi044 ceph-4954ed46-70ae-11ef-bcea-c7b262605968-osd-10[59969]: 2024-09-12T02:51:27.597+0000 7faa46dc6640 -1 osd.10 112 heartbeat_check: no reply from 172.21.15.44:6804 osd.1 since back 2024-09-12T02:50:17.969767+0000 front 2024-09-12T02:50:17.969892+0000 (oldest deadline 2024-09-12T02:50:40.270033+0000) 2024-09-12T02:51:27.949 INFO:journalctl@ceph.osd.10.smithi044.stdout:Sep 12 02:51:27 smithi044 ceph-4954ed46-70ae-11ef-bcea-c7b262605968-osd-10[59969]: 2024-09-12T02:51:27.597+0000 7faa46dc6640 -1 osd.10 112 heartbeat_check: no reply from 172.21.15.172:6804 osd.2 since back 2024-09-12T02:50:25.972029+0000 front 2024-09-12T02:50:25.972168+0000 (oldest deadline 2024-09-12T02:50:47.671992+0000) 2024-09-12T02:51:27.949 INFO:journalctl@ceph.osd.10.smithi044.stdout:Sep 12 02:51:27 smithi044 ceph-4954ed46-70ae-11ef-bcea-c7b262605968-osd-10[59969]: 2024-09-12T02:51:27.597+0000 7faa46dc6640 -1 osd.10 112 heartbeat_check: no reply from 172.21.15.39:6814 osd.3 since back 2024-09-12T02:50:31.673509+0000 front 2024-09-12T02:50:31.673612+0000 (oldest deadline 2024-09-12T02:50:56.973525+0000) 2024-09-12T02:51:27.949 INFO:journalctl@ceph.osd.10.smithi044.stdout:Sep 12 02:51:27 smithi044 ceph-4954ed46-70ae-11ef-bcea-c7b262605968-osd-10[59969]: 2024-09-12T02:51:27.597+0000 7faa46dc6640 -1 osd.10 112 heartbeat_check: no reply from 172.21.15.44:6812 osd.4 since back 2024-09-12T02:50:42.274445+0000 front 2024-09-12T02:50:42.274407+0000 (oldest deadline 2024-09-12T02:51:06.875067+0000) 2024-09-12T02:51:27.949 INFO:journalctl@ceph.osd.10.smithi044.stdout:Sep 12 02:51:27 smithi044 ceph-4954ed46-70ae-11ef-bcea-c7b262605968-osd-10[59969]: 2024-09-12T02:51:27.597+0000 7faa46dc6640 -1 osd.10 112 heartbeat_check: no reply from 172.21.15.172:6812 osd.5 since back 2024-09-12T02:50:46.875759+0000 front 2024-09-12T02:50:46.875831+0000 (oldest deadline 2024-09-12T02:51:12.775550+0000) 2024-09-12T02:51:27.949 INFO:journalctl@ceph.osd.10.smithi044.stdout:Sep 12 02:51:27 smithi044 ceph-4954ed46-70ae-11ef-bcea-c7b262605968-osd-10[59969]: 2024-09-12T02:51:27.597+0000 7faa46dc6640 -1 osd.10 112 heartbeat_check: no reply from 172.21.15.39:6822 osd.6 since back 2024-09-12T02:50:57.277634+0000 front 2024-09-12T02:50:57.277698+0000 (oldest deadline 2024-09-12T02:51:21.377518+0000) 2024-09-12T02:51:28.014 INFO:journalctl@ceph.osd.11.smithi172.stdout:Sep 12 02:51:27 smithi172 ceph-4954ed46-70ae-11ef-bcea-c7b262605968-osd-11[61129]: 2024-09-12T02:51:27.584+0000 7ff146fac640 -1 osd.11 112 heartbeat_check: no reply from 172.21.15.39:6806 osd.0 since back 2024-09-12T02:50:09.449223+0000 front 2024-09-12T02:50:09.449210+0000 (oldest deadline 2024-09-12T02:50:34.748980+0000) 2024-09-12T02:51:28.014 INFO:journalctl@ceph.osd.11.smithi172.stdout:Sep 12 02:51:27 smithi172 ceph-4954ed46-70ae-11ef-bcea-c7b262605968-osd-11[61129]: 2024-09-12T02:51:27.584+0000 7ff146fac640 -1 osd.11 112 heartbeat_check: no reply from 172.21.15.44:6804 osd.1 since back 2024-09-12T02:50:14.749696+0000 front 2024-09-12T02:50:14.749454+0000 (oldest deadline 2024-09-12T02:50:42.950102+0000) 2024-09-12T02:51:28.014 INFO:journalctl@ceph.osd.11.smithi172.stdout:Sep 12 02:51:27 smithi172 ceph-4954ed46-70ae-11ef-bcea-c7b262605968-osd-11[61129]: 2024-09-12T02:51:27.584+0000 7ff146fac640 -1 osd.11 112 heartbeat_check: no reply from 172.21.15.172:6804 osd.2 since back 2024-09-12T02:50:22.950505+0000 front 2024-09-12T02:50:22.950558+0000 (oldest deadline 2024-09-12T02:50:48.850680+0000) 2024-09-12T02:51:28.014 INFO:journalctl@ceph.osd.11.smithi172.stdout:Sep 12 02:51:27 smithi172 ceph-4954ed46-70ae-11ef-bcea-c7b262605968-osd-11[61129]: 2024-09-12T02:51:27.584+0000 7ff146fac640 -1 osd.11 112 heartbeat_check: no reply from 172.21.15.44:6812 osd.4 since back 2024-09-12T02:50:39.054153+0000 front 2024-09-12T02:50:39.054100+0000 (oldest deadline 2024-09-12T02:51:04.354015+0000) 2024-09-12T02:51:28.014 INFO:journalctl@ceph.osd.11.smithi172.stdout:Sep 12 02:51:27 smithi172 ceph-4954ed46-70ae-11ef-bcea-c7b262605968-osd-11[61129]: 2024-09-12T02:51:27.584+0000 7ff146fac640 -1 osd.11 112 heartbeat_check: no reply from 172.21.15.172:6812 osd.5 since back 2024-09-12T02:50:49.455828+0000 front 2024-09-12T02:50:49.455854+0000 (oldest deadline 2024-09-12T02:51:14.755884+0000) 2024-09-12T02:51:28.015 INFO:journalctl@ceph.osd.11.smithi172.stdout:Sep 12 02:51:27 smithi172 ceph-4954ed46-70ae-11ef-bcea-c7b262605968-osd-11[61129]: 2024-09-12T02:51:27.584+0000 7ff146fac640 -1 osd.11 112 heartbeat_check: no reply from 172.21.15.39:6822 osd.6 since back 2024-09-12T02:50:54.756477+0000 front 2024-09-12T02:50:54.756555+0000 (oldest deadline 2024-09-12T02:51:20.656467+0000) 2024-09-12T02:51:28.948 INFO:journalctl@ceph.osd.10.smithi044.stdout:Sep 12 02:51:28 smithi044 ceph-4954ed46-70ae-11ef-bcea-c7b262605968-osd-10[59969]: 2024-09-12T02:51:28.574+0000 7faa46dc6640 -1 osd.10 112 heartbeat_check: no reply from 172.21.15.39:6806 osd.0 since back 2024-09-12T02:50:05.367150+0000 front 2024-09-12T02:50:05.367381+0000 (oldest deadline 2024-09-12T02:50:31.267058+0000) 2024-09-12T02:51:28.949 INFO:journalctl@ceph.osd.10.smithi044.stdout:Sep 12 02:51:28 smithi044 ceph-4954ed46-70ae-11ef-bcea-c7b262605968-osd-10[59969]: 2024-09-12T02:51:28.574+0000 7faa46dc6640 -1 osd.10 112 heartbeat_check: no reply from 172.21.15.44:6804 osd.1 since back 2024-09-12T02:50:17.969767+0000 front 2024-09-12T02:50:17.969892+0000 (oldest deadline 2024-09-12T02:50:40.270033+0000) 2024-09-12T02:51:28.949 INFO:journalctl@ceph.osd.10.smithi044.stdout:Sep 12 02:51:28 smithi044 ceph-4954ed46-70ae-11ef-bcea-c7b262605968-osd-10[59969]: 2024-09-12T02:51:28.574+0000 7faa46dc6640 -1 osd.10 112 heartbeat_check: no reply from 172.21.15.172:6804 osd.2 since back 2024-09-12T02:50:25.972029+0000 front 2024-09-12T02:50:25.972168+0000 (oldest deadline 2024-09-12T02:50:47.671992+0000) 2024-09-12T02:51:28.949 INFO:journalctl@ceph.osd.10.smithi044.stdout:Sep 12 02:51:28 smithi044 ceph-4954ed46-70ae-11ef-bcea-c7b262605968-osd-10[59969]: 2024-09-12T02:51:28.574+0000 7faa46dc6640 -1 osd.10 112 heartbeat_check: no reply from 172.21.15.39:6814 osd.3 since back 2024-09-12T02:50:31.673509+0000 front 2024-09-12T02:50:31.673612+0000 (oldest deadline 2024-09-12T02:50:56.973525+0000) 2024-09-12T02:51:28.949 INFO:journalctl@ceph.osd.10.smithi044.stdout:Sep 12 02:51:28 smithi044 ceph-4954ed46-70ae-11ef-bcea-c7b262605968-osd-10[59969]: 2024-09-12T02:51:28.574+0000 7faa46dc6640 -1 osd.10 112 heartbeat_check: no reply from 172.21.15.44:6812 osd.4 since back 2024-09-12T02:50:42.274445+0000 front 2024-09-12T02:50:42.274407+0000 (oldest deadline 2024-09-12T02:51:06.875067+0000) 2024-09-12T02:51:28.949 INFO:journalctl@ceph.osd.10.smithi044.stdout:Sep 12 02:51:28 smithi044 ceph-4954ed46-70ae-11ef-bcea-c7b262605968-osd-10[59969]: 2024-09-12T02:51:28.574+0000 7faa46dc6640 -1 osd.10 112 heartbeat_check: no reply from 172.21.15.172:6812 osd.5 since back 2024-09-12T02:50:46.875759+0000 front 2024-09-12T02:50:46.875831+0000 (oldest deadline 2024-09-12T02:51:12.775550+0000) 2024-09-12T02:51:28.949 INFO:journalctl@ceph.osd.10.smithi044.stdout:Sep 12 02:51:28 smithi044 ceph-4954ed46-70ae-11ef-bcea-c7b262605968-osd-10[59969]: 2024-09-12T02:51:28.574+0000 7faa46dc6640 -1 osd.10 112 heartbeat_check: no reply from 172.21.15.39:6822 osd.6 since back 2024-09-12T02:50:57.277634+0000 front 2024-09-12T02:50:57.277698+0000 (oldest deadline 2024-09-12T02:51:21.377518+0000) 2024-09-12T02:51:29.013 INFO:journalctl@ceph.osd.11.smithi172.stdout:Sep 12 02:51:28 smithi172 ceph-4954ed46-70ae-11ef-bcea-c7b262605968-osd-11[61129]: 2024-09-12T02:51:28.535+0000 7ff146fac640 -1 osd.11 112 heartbeat_check: no reply from 172.21.15.39:6806 osd.0 since back 2024-09-12T02:50:09.449223+0000 front 2024-09-12T02:50:09.449210+0000 (oldest deadline 2024-09-12T02:50:34.748980+0000) 2024-09-12T02:51:29.014 INFO:journalctl@ceph.osd.11.smithi172.stdout:Sep 12 02:51:28 smithi172 ceph-4954ed46-70ae-11ef-bcea-c7b262605968-osd-11[61129]: 2024-09-12T02:51:28.535+0000 7ff146fac640 -1 osd.11 112 heartbeat_check: no reply from 172.21.15.44:6804 osd.1 since back 2024-09-12T02:50:14.749696+0000 front 2024-09-12T02:50:14.749454+0000 (oldest deadline 2024-09-12T02:50:42.950102+0000) 2024-09-12T02:51:29.014 INFO:journalctl@ceph.osd.11.smithi172.stdout:Sep 12 02:51:28 smithi172 ceph-4954ed46-70ae-11ef-bcea-c7b262605968-osd-11[61129]: 2024-09-12T02:51:28.535+0000 7ff146fac640 -1 osd.11 112 heartbeat_check: no reply from 172.21.15.172:6804 osd.2 since back 2024-09-12T02:50:22.950505+0000 front 2024-09-12T02:50:22.950558+0000 (oldest deadline 2024-09-12T02:50:48.850680+0000) 2024-09-12T02:51:29.014 INFO:journalctl@ceph.osd.11.smithi172.stdout:Sep 12 02:51:28 smithi172 ceph-4954ed46-70ae-11ef-bcea-c7b262605968-osd-11[61129]: 2024-09-12T02:51:28.535+0000 7ff146fac640 -1 osd.11 112 heartbeat_check: no reply from 172.21.15.44:6812 osd.4 since back 2024-09-12T02:50:39.054153+0000 front 2024-09-12T02:50:39.054100+0000 (oldest deadline 2024-09-12T02:51:04.354015+0000) 2024-09-12T02:51:29.014 INFO:journalctl@ceph.osd.11.smithi172.stdout:Sep 12 02:51:28 smithi172 ceph-4954ed46-70ae-11ef-bcea-c7b262605968-osd-11[61129]: 2024-09-12T02:51:28.535+0000 7ff146fac640 -1 osd.11 112 heartbeat_check: no reply from 172.21.15.172:6812 osd.5 since back 2024-09-12T02:50:49.455828+0000 front 2024-09-12T02:50:49.455854+0000 (oldest deadline 2024-09-12T02:51:14.755884+0000) 2024-09-12T02:51:29.014 INFO:journalctl@ceph.osd.11.smithi172.stdout:Sep 12 02:51:28 smithi172 ceph-4954ed46-70ae-11ef-bcea-c7b262605968-osd-11[61129]: 2024-09-12T02:51:28.535+0000 7ff146fac640 -1 osd.11 112 heartbeat_check: no reply from 172.21.15.39:6822 osd.6 since back 2024-09-12T02:50:54.756477+0000 front 2024-09-12T02:50:54.756555+0000 (oldest deadline 2024-09-12T02:51:20.656467+0000) 2024-09-12T02:51:29.949 INFO:journalctl@ceph.osd.10.smithi044.stdout:Sep 12 02:51:29 smithi044 ceph-4954ed46-70ae-11ef-bcea-c7b262605968-osd-10[59969]: 2024-09-12T02:51:29.591+0000 7faa46dc6640 -1 osd.10 112 heartbeat_check: no reply from 172.21.15.39:6806 osd.0 since back 2024-09-12T02:50:05.367150+0000 front 2024-09-12T02:50:05.367381+0000 (oldest deadline 2024-09-12T02:50:31.267058+0000) 2024-09-12T02:51:29.949 INFO:journalctl@ceph.osd.10.smithi044.stdout:Sep 12 02:51:29 smithi044 ceph-4954ed46-70ae-11ef-bcea-c7b262605968-osd-10[59969]: 2024-09-12T02:51:29.591+0000 7faa46dc6640 -1 osd.10 112 heartbeat_check: no reply from 172.21.15.44:6804 osd.1 since back 2024-09-12T02:50:17.969767+0000 front 2024-09-12T02:50:17.969892+0000 (oldest deadline 2024-09-12T02:50:40.270033+0000) 2024-09-12T02:51:29.949 INFO:journalctl@ceph.osd.10.smithi044.stdout:Sep 12 02:51:29 smithi044 ceph-4954ed46-70ae-11ef-bcea-c7b262605968-osd-10[59969]: 2024-09-12T02:51:29.591+0000 7faa46dc6640 -1 osd.10 112 heartbeat_check: no reply from 172.21.15.172:6804 osd.2 since back 2024-09-12T02:50:25.972029+0000 front 2024-09-12T02:50:25.972168+0000 (oldest deadline 2024-09-12T02:50:47.671992+0000) 2024-09-12T02:51:29.949 INFO:journalctl@ceph.osd.10.smithi044.stdout:Sep 12 02:51:29 smithi044 ceph-4954ed46-70ae-11ef-bcea-c7b262605968-osd-10[59969]: 2024-09-12T02:51:29.591+0000 7faa46dc6640 -1 osd.10 112 heartbeat_check: no reply from 172.21.15.39:6814 osd.3 since back 2024-09-12T02:50:31.673509+0000 front 2024-09-12T02:50:31.673612+0000 (oldest deadline 2024-09-12T02:50:56.973525+0000) 2024-09-12T02:51:29.949 INFO:journalctl@ceph.osd.10.smithi044.stdout:Sep 12 02:51:29 smithi044 ceph-4954ed46-70ae-11ef-bcea-c7b262605968-osd-10[59969]: 2024-09-12T02:51:29.591+0000 7faa46dc6640 -1 osd.10 112 heartbeat_check: no reply from 172.21.15.44:6812 osd.4 since back 2024-09-12T02:50:42.274445+0000 front 2024-09-12T02:50:42.274407+0000 (oldest deadline 2024-09-12T02:51:06.875067+0000) 2024-09-12T02:51:29.949 INFO:journalctl@ceph.osd.10.smithi044.stdout:Sep 12 02:51:29 smithi044 ceph-4954ed46-70ae-11ef-bcea-c7b262605968-osd-10[59969]: 2024-09-12T02:51:29.591+0000 7faa46dc6640 -1 osd.10 112 heartbeat_check: no reply from 172.21.15.172:6812 osd.5 since back 2024-09-12T02:50:46.875759+0000 front 2024-09-12T02:50:46.875831+0000 (oldest deadline 2024-09-12T02:51:12.775550+0000) 2024-09-12T02:51:29.949 INFO:journalctl@ceph.osd.10.smithi044.stdout:Sep 12 02:51:29 smithi044 ceph-4954ed46-70ae-11ef-bcea-c7b262605968-osd-10[59969]: 2024-09-12T02:51:29.591+0000 7faa46dc6640 -1 osd.10 112 heartbeat_check: no reply from 172.21.15.39:6822 osd.6 since back 2024-09-12T02:50:57.277634+0000 front 2024-09-12T02:50:57.277698+0000 (oldest deadline 2024-09-12T02:51:21.377518+0000) 2024-09-12T02:51:30.013 INFO:journalctl@ceph.osd.11.smithi172.stdout:Sep 12 02:51:29 smithi172 ceph-4954ed46-70ae-11ef-bcea-c7b262605968-osd-11[61129]: 2024-09-12T02:51:29.513+0000 7ff146fac640 -1 osd.11 112 heartbeat_check: no reply from 172.21.15.39:6806 osd.0 since back 2024-09-12T02:50:09.449223+0000 front 2024-09-12T02:50:09.449210+0000 (oldest deadline 2024-09-12T02:50:34.748980+0000) 2024-09-12T02:51:30.014 INFO:journalctl@ceph.osd.11.smithi172.stdout:Sep 12 02:51:29 smithi172 ceph-4954ed46-70ae-11ef-bcea-c7b262605968-osd-11[61129]: 2024-09-12T02:51:29.513+0000 7ff146fac640 -1 osd.11 112 heartbeat_check: no reply from 172.21.15.44:6804 osd.1 since back 2024-09-12T02:50:14.749696+0000 front 2024-09-12T02:50:14.749454+0000 (oldest deadline 2024-09-12T02:50:42.950102+0000) 2024-09-12T02:51:30.014 INFO:journalctl@ceph.osd.11.smithi172.stdout:Sep 12 02:51:29 smithi172 ceph-4954ed46-70ae-11ef-bcea-c7b262605968-osd-11[61129]: 2024-09-12T02:51:29.513+0000 7ff146fac640 -1 osd.11 112 heartbeat_check: no reply from 172.21.15.172:6804 osd.2 since back 2024-09-12T02:50:22.950505+0000 front 2024-09-12T02:50:22.950558+0000 (oldest deadline 2024-09-12T02:50:48.850680+0000) 2024-09-12T02:51:30.014 INFO:journalctl@ceph.osd.11.smithi172.stdout:Sep 12 02:51:29 smithi172 ceph-4954ed46-70ae-11ef-bcea-c7b262605968-osd-11[61129]: 2024-09-12T02:51:29.513+0000 7ff146fac640 -1 osd.11 112 heartbeat_check: no reply from 172.21.15.44:6812 osd.4 since back 2024-09-12T02:50:39.054153+0000 front 2024-09-12T02:50:39.054100+0000 (oldest deadline 2024-09-12T02:51:04.354015+0000) 2024-09-12T02:51:30.014 INFO:journalctl@ceph.osd.11.smithi172.stdout:Sep 12 02:51:29 smithi172 ceph-4954ed46-70ae-11ef-bcea-c7b262605968-osd-11[61129]: 2024-09-12T02:51:29.513+0000 7ff146fac640 -1 osd.11 112 heartbeat_check: no reply from 172.21.15.172:6812 osd.5 since back 2024-09-12T02:50:49.455828+0000 front 2024-09-12T02:50:49.455854+0000 (oldest deadline 2024-09-12T02:51:14.755884+0000) 2024-09-12T02:51:30.014 INFO:journalctl@ceph.osd.11.smithi172.stdout:Sep 12 02:51:29 smithi172 ceph-4954ed46-70ae-11ef-bcea-c7b262605968-osd-11[61129]: 2024-09-12T02:51:29.513+0000 7ff146fac640 -1 osd.11 112 heartbeat_check: no reply from 172.21.15.39:6822 osd.6 since back 2024-09-12T02:50:54.756477+0000 front 2024-09-12T02:50:54.756555+0000 (oldest deadline 2024-09-12T02:51:20.656467+0000) 2024-09-12T02:51:30.764 INFO:journalctl@ceph.osd.11.smithi172.stdout:Sep 12 02:51:30 smithi172 ceph-4954ed46-70ae-11ef-bcea-c7b262605968-osd-11[61129]: 2024-09-12T02:51:30.501+0000 7ff146fac640 -1 osd.11 112 heartbeat_check: no reply from 172.21.15.39:6806 osd.0 since back 2024-09-12T02:50:09.449223+0000 front 2024-09-12T02:50:09.449210+0000 (oldest deadline 2024-09-12T02:50:34.748980+0000) 2024-09-12T02:51:30.764 INFO:journalctl@ceph.osd.11.smithi172.stdout:Sep 12 02:51:30 smithi172 ceph-4954ed46-70ae-11ef-bcea-c7b262605968-osd-11[61129]: 2024-09-12T02:51:30.501+0000 7ff146fac640 -1 osd.11 112 heartbeat_check: no reply from 172.21.15.44:6804 osd.1 since back 2024-09-12T02:50:14.749696+0000 front 2024-09-12T02:50:14.749454+0000 (oldest deadline 2024-09-12T02:50:42.950102+0000) 2024-09-12T02:51:30.764 INFO:journalctl@ceph.osd.11.smithi172.stdout:Sep 12 02:51:30 smithi172 ceph-4954ed46-70ae-11ef-bcea-c7b262605968-osd-11[61129]: 2024-09-12T02:51:30.501+0000 7ff146fac640 -1 osd.11 112 heartbeat_check: no reply from 172.21.15.172:6804 osd.2 since back 2024-09-12T02:50:22.950505+0000 front 2024-09-12T02:50:22.950558+0000 (oldest deadline 2024-09-12T02:50:48.850680+0000) 2024-09-12T02:51:30.764 INFO:journalctl@ceph.osd.11.smithi172.stdout:Sep 12 02:51:30 smithi172 ceph-4954ed46-70ae-11ef-bcea-c7b262605968-osd-11[61129]: 2024-09-12T02:51:30.501+0000 7ff146fac640 -1 osd.11 112 heartbeat_check: no reply from 172.21.15.44:6812 osd.4 since back 2024-09-12T02:50:39.054153+0000 front 2024-09-12T02:50:39.054100+0000 (oldest deadline 2024-09-12T02:51:04.354015+0000) 2024-09-12T02:51:30.764 INFO:journalctl@ceph.osd.11.smithi172.stdout:Sep 12 02:51:30 smithi172 ceph-4954ed46-70ae-11ef-bcea-c7b262605968-osd-11[61129]: 2024-09-12T02:51:30.501+0000 7ff146fac640 -1 osd.11 112 heartbeat_check: no reply from 172.21.15.172:6812 osd.5 since back 2024-09-12T02:50:49.455828+0000 front 2024-09-12T02:50:49.455854+0000 (oldest deadline 2024-09-12T02:51:14.755884+0000) 2024-09-12T02:51:30.764 INFO:journalctl@ceph.osd.11.smithi172.stdout:Sep 12 02:51:30 smithi172 ceph-4954ed46-70ae-11ef-bcea-c7b262605968-osd-11[61129]: 2024-09-12T02:51:30.501+0000 7ff146fac640 -1 osd.11 112 heartbeat_check: no reply from 172.21.15.39:6822 osd.6 since back 2024-09-12T02:50:54.756477+0000 front 2024-09-12T02:50:54.756555+0000 (oldest deadline 2024-09-12T02:51:20.656467+0000) 2024-09-12T02:51:30.764 INFO:journalctl@ceph.osd.11.smithi172.stdout:Sep 12 02:51:30 smithi172 ceph-4954ed46-70ae-11ef-bcea-c7b262605968-osd-11[61129]: 2024-09-12T02:51:30.501+0000 7ff146fac640 -1 osd.11 112 heartbeat_check: no reply from 172.21.15.44:6820 osd.7 since back 2024-09-12T02:51:04.057786+0000 front 2024-09-12T02:51:04.057894+0000 (oldest deadline 2024-09-12T02:51:29.957694+0000) 2024-09-12T02:51:30.948 INFO:journalctl@ceph.osd.10.smithi044.stdout:Sep 12 02:51:30 smithi044 ceph-4954ed46-70ae-11ef-bcea-c7b262605968-osd-10[59969]: 2024-09-12T02:51:30.585+0000 7faa46dc6640 -1 osd.10 112 heartbeat_check: no reply from 172.21.15.39:6806 osd.0 since back 2024-09-12T02:50:05.367150+0000 front 2024-09-12T02:50:05.367381+0000 (oldest deadline 2024-09-12T02:50:31.267058+0000) 2024-09-12T02:51:30.949 INFO:journalctl@ceph.osd.10.smithi044.stdout:Sep 12 02:51:30 smithi044 ceph-4954ed46-70ae-11ef-bcea-c7b262605968-osd-10[59969]: 2024-09-12T02:51:30.585+0000 7faa46dc6640 -1 osd.10 112 heartbeat_check: no reply from 172.21.15.44:6804 osd.1 since back 2024-09-12T02:50:17.969767+0000 front 2024-09-12T02:50:17.969892+0000 (oldest deadline 2024-09-12T02:50:40.270033+0000) 2024-09-12T02:51:30.949 INFO:journalctl@ceph.osd.10.smithi044.stdout:Sep 12 02:51:30 smithi044 ceph-4954ed46-70ae-11ef-bcea-c7b262605968-osd-10[59969]: 2024-09-12T02:51:30.585+0000 7faa46dc6640 -1 osd.10 112 heartbeat_check: no reply from 172.21.15.172:6804 osd.2 since back 2024-09-12T02:50:25.972029+0000 front 2024-09-12T02:50:25.972168+0000 (oldest deadline 2024-09-12T02:50:47.671992+0000) 2024-09-12T02:51:30.949 INFO:journalctl@ceph.osd.10.smithi044.stdout:Sep 12 02:51:30 smithi044 ceph-4954ed46-70ae-11ef-bcea-c7b262605968-osd-10[59969]: 2024-09-12T02:51:30.585+0000 7faa46dc6640 -1 osd.10 112 heartbeat_check: no reply from 172.21.15.39:6814 osd.3 since back 2024-09-12T02:50:31.673509+0000 front 2024-09-12T02:50:31.673612+0000 (oldest deadline 2024-09-12T02:50:56.973525+0000) 2024-09-12T02:51:30.949 INFO:journalctl@ceph.osd.10.smithi044.stdout:Sep 12 02:51:30 smithi044 ceph-4954ed46-70ae-11ef-bcea-c7b262605968-osd-10[59969]: 2024-09-12T02:51:30.585+0000 7faa46dc6640 -1 osd.10 112 heartbeat_check: no reply from 172.21.15.44:6812 osd.4 since back 2024-09-12T02:50:42.274445+0000 front 2024-09-12T02:50:42.274407+0000 (oldest deadline 2024-09-12T02:51:06.875067+0000) 2024-09-12T02:51:30.949 INFO:journalctl@ceph.osd.10.smithi044.stdout:Sep 12 02:51:30 smithi044 ceph-4954ed46-70ae-11ef-bcea-c7b262605968-osd-10[59969]: 2024-09-12T02:51:30.585+0000 7faa46dc6640 -1 osd.10 112 heartbeat_check: no reply from 172.21.15.172:6812 osd.5 since back 2024-09-12T02:50:46.875759+0000 front 2024-09-12T02:50:46.875831+0000 (oldest deadline 2024-09-12T02:51:12.775550+0000) 2024-09-12T02:51:30.949 INFO:journalctl@ceph.osd.10.smithi044.stdout:Sep 12 02:51:30 smithi044 ceph-4954ed46-70ae-11ef-bcea-c7b262605968-osd-10[59969]: 2024-09-12T02:51:30.585+0000 7faa46dc6640 -1 osd.10 112 heartbeat_check: no reply from 172.21.15.39:6822 osd.6 since back 2024-09-12T02:50:57.277634+0000 front 2024-09-12T02:50:57.277698+0000 (oldest deadline 2024-09-12T02:51:21.377518+0000) 2024-09-12T02:51:32.014 INFO:journalctl@ceph.osd.11.smithi172.stdout:Sep 12 02:51:31 smithi172 ceph-4954ed46-70ae-11ef-bcea-c7b262605968-osd-11[61129]: 2024-09-12T02:51:31.547+0000 7ff146fac640 -1 osd.11 112 heartbeat_check: no reply from 172.21.15.39:6806 osd.0 since back 2024-09-12T02:50:09.449223+0000 front 2024-09-12T02:50:09.449210+0000 (oldest deadline 2024-09-12T02:50:34.748980+0000) 2024-09-12T02:51:32.014 INFO:journalctl@ceph.osd.11.smithi172.stdout:Sep 12 02:51:31 smithi172 ceph-4954ed46-70ae-11ef-bcea-c7b262605968-osd-11[61129]: 2024-09-12T02:51:31.547+0000 7ff146fac640 -1 osd.11 112 heartbeat_check: no reply from 172.21.15.44:6804 osd.1 since back 2024-09-12T02:50:14.749696+0000 front 2024-09-12T02:50:14.749454+0000 (oldest deadline 2024-09-12T02:50:42.950102+0000) 2024-09-12T02:51:32.014 INFO:journalctl@ceph.osd.11.smithi172.stdout:Sep 12 02:51:31 smithi172 ceph-4954ed46-70ae-11ef-bcea-c7b262605968-osd-11[61129]: 2024-09-12T02:51:31.547+0000 7ff146fac640 -1 osd.11 112 heartbeat_check: no reply from 172.21.15.172:6804 osd.2 since back 2024-09-12T02:50:22.950505+0000 front 2024-09-12T02:50:22.950558+0000 (oldest deadline 2024-09-12T02:50:48.850680+0000) 2024-09-12T02:51:32.014 INFO:journalctl@ceph.osd.11.smithi172.stdout:Sep 12 02:51:31 smithi172 ceph-4954ed46-70ae-11ef-bcea-c7b262605968-osd-11[61129]: 2024-09-12T02:51:31.547+0000 7ff146fac640 -1 osd.11 112 heartbeat_check: no reply from 172.21.15.44:6812 osd.4 since back 2024-09-12T02:50:39.054153+0000 front 2024-09-12T02:50:39.054100+0000 (oldest deadline 2024-09-12T02:51:04.354015+0000) 2024-09-12T02:51:32.014 INFO:journalctl@ceph.osd.11.smithi172.stdout:Sep 12 02:51:31 smithi172 ceph-4954ed46-70ae-11ef-bcea-c7b262605968-osd-11[61129]: 2024-09-12T02:51:31.547+0000 7ff146fac640 -1 osd.11 112 heartbeat_check: no reply from 172.21.15.172:6812 osd.5 since back 2024-09-12T02:50:49.455828+0000 front 2024-09-12T02:50:49.455854+0000 (oldest deadline 2024-09-12T02:51:14.755884+0000) 2024-09-12T02:51:32.014 INFO:journalctl@ceph.osd.11.smithi172.stdout:Sep 12 02:51:31 smithi172 ceph-4954ed46-70ae-11ef-bcea-c7b262605968-osd-11[61129]: 2024-09-12T02:51:31.547+0000 7ff146fac640 -1 osd.11 112 heartbeat_check: no reply from 172.21.15.39:6822 osd.6 since back 2024-09-12T02:50:54.756477+0000 front 2024-09-12T02:50:54.756555+0000 (oldest deadline 2024-09-12T02:51:20.656467+0000) 2024-09-12T02:51:32.014 INFO:journalctl@ceph.osd.11.smithi172.stdout:Sep 12 02:51:31 smithi172 ceph-4954ed46-70ae-11ef-bcea-c7b262605968-osd-11[61129]: 2024-09-12T02:51:31.547+0000 7ff146fac640 -1 osd.11 112 heartbeat_check: no reply from 172.21.15.44:6820 osd.7 since back 2024-09-12T02:51:04.057786+0000 front 2024-09-12T02:51:04.057894+0000 (oldest deadline 2024-09-12T02:51:29.957694+0000) 2024-09-12T02:51:32.178 INFO:journalctl@ceph.osd.10.smithi044.stdout:Sep 12 02:51:31 smithi044 podman[72617]: 2024-09-12 02:51:31.905765653 +0000 UTC m=+5.592982883 container died bb8ceaa43dd41ea1fb237bb17115618c85dcf18d83e7cc05cf0121b38a397c29 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:3be30d720e37ec4df7f667e60f22b4d221c4ce7b408e68b90f9ac10220535e66, name=ceph-4954ed46-70ae-11ef-bcea-c7b262605968-osd-10, io.buildah.version=1.37.2, GIT_CLEAN=True, GIT_REPO=git@github.com:ceph/ceph-container.git, ceph=True, org.label-schema.build-date=20240731, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.license=GPLv2, GIT_BRANCH=HEAD, org.label-schema.schema-version=1.0, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, RELEASE=squid-b53b6d3, maintainer=Guillaume Abrioux , CEPH_POINT_RELEASE=, org.label-schema.vendor=CentOS) 2024-09-12T02:51:32.449 INFO:journalctl@ceph.osd.10.smithi044.stdout:Sep 12 02:51:32 smithi044 podman[72617]: 2024-09-12 02:51:32.268356018 +0000 UTC m=+5.955573247 container cleanup bb8ceaa43dd41ea1fb237bb17115618c85dcf18d83e7cc05cf0121b38a397c29 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:3be30d720e37ec4df7f667e60f22b4d221c4ce7b408e68b90f9ac10220535e66, name=ceph-4954ed46-70ae-11ef-bcea-c7b262605968-osd-10, maintainer=Guillaume Abrioux , CEPH_POINT_RELEASE=, org.label-schema.name=CentOS Stream 9 Base Image, io.buildah.version=1.37.2, org.label-schema.schema-version=1.0, org.label-schema.build-date=20240731, GIT_CLEAN=True, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, RELEASE=squid-b53b6d3, GIT_BRANCH=HEAD, GIT_REPO=git@github.com:ceph/ceph-container.git, ceph=True, org.label-schema.license=GPLv2, org.label-schema.vendor=CentOS) 2024-09-12T02:51:32.449 INFO:journalctl@ceph.osd.10.smithi044.stdout:Sep 12 02:51:32 smithi044 bash[72617]: ceph-4954ed46-70ae-11ef-bcea-c7b262605968-osd-10 2024-09-12T02:51:32.837 INFO:journalctl@ceph.osd.10.smithi044.stdout:Sep 12 02:51:32 smithi044 podman[72634]: 2024-09-12 02:51:32.528120361 +0000 UTC m=+0.618872279 container remove bb8ceaa43dd41ea1fb237bb17115618c85dcf18d83e7cc05cf0121b38a397c29 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:3be30d720e37ec4df7f667e60f22b4d221c4ce7b408e68b90f9ac10220535e66, name=ceph-4954ed46-70ae-11ef-bcea-c7b262605968-osd-10, ceph=True, GIT_REPO=git@github.com:ceph/ceph-container.git, maintainer=Guillaume Abrioux , org.label-schema.name=CentOS Stream 9 Base Image, io.buildah.version=1.37.2, GIT_BRANCH=HEAD, org.label-schema.schema-version=1.0, RELEASE=squid-b53b6d3, org.label-schema.vendor=CentOS, GIT_CLEAN=True, org.label-schema.build-date=20240731, org.label-schema.license=GPLv2, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, CEPH_POINT_RELEASE=) 2024-09-12T02:51:33.014 INFO:journalctl@ceph.osd.11.smithi172.stdout:Sep 12 02:51:32 smithi172 ceph-4954ed46-70ae-11ef-bcea-c7b262605968-osd-11[61129]: 2024-09-12T02:51:32.583+0000 7ff146fac640 -1 osd.11 112 heartbeat_check: no reply from 172.21.15.39:6806 osd.0 since back 2024-09-12T02:50:09.449223+0000 front 2024-09-12T02:50:09.449210+0000 (oldest deadline 2024-09-12T02:50:34.748980+0000) 2024-09-12T02:51:33.014 INFO:journalctl@ceph.osd.11.smithi172.stdout:Sep 12 02:51:32 smithi172 ceph-4954ed46-70ae-11ef-bcea-c7b262605968-osd-11[61129]: 2024-09-12T02:51:32.583+0000 7ff146fac640 -1 osd.11 112 heartbeat_check: no reply from 172.21.15.44:6804 osd.1 since back 2024-09-12T02:50:14.749696+0000 front 2024-09-12T02:50:14.749454+0000 (oldest deadline 2024-09-12T02:50:42.950102+0000) 2024-09-12T02:51:33.014 INFO:journalctl@ceph.osd.11.smithi172.stdout:Sep 12 02:51:32 smithi172 ceph-4954ed46-70ae-11ef-bcea-c7b262605968-osd-11[61129]: 2024-09-12T02:51:32.583+0000 7ff146fac640 -1 osd.11 112 heartbeat_check: no reply from 172.21.15.172:6804 osd.2 since back 2024-09-12T02:50:22.950505+0000 front 2024-09-12T02:50:22.950558+0000 (oldest deadline 2024-09-12T02:50:48.850680+0000) 2024-09-12T02:51:33.014 INFO:journalctl@ceph.osd.11.smithi172.stdout:Sep 12 02:51:32 smithi172 ceph-4954ed46-70ae-11ef-bcea-c7b262605968-osd-11[61129]: 2024-09-12T02:51:32.583+0000 7ff146fac640 -1 osd.11 112 heartbeat_check: no reply from 172.21.15.44:6812 osd.4 since back 2024-09-12T02:50:39.054153+0000 front 2024-09-12T02:50:39.054100+0000 (oldest deadline 2024-09-12T02:51:04.354015+0000) 2024-09-12T02:51:33.014 INFO:journalctl@ceph.osd.11.smithi172.stdout:Sep 12 02:51:32 smithi172 ceph-4954ed46-70ae-11ef-bcea-c7b262605968-osd-11[61129]: 2024-09-12T02:51:32.583+0000 7ff146fac640 -1 osd.11 112 heartbeat_check: no reply from 172.21.15.172:6812 osd.5 since back 2024-09-12T02:50:49.455828+0000 front 2024-09-12T02:50:49.455854+0000 (oldest deadline 2024-09-12T02:51:14.755884+0000) 2024-09-12T02:51:33.014 INFO:journalctl@ceph.osd.11.smithi172.stdout:Sep 12 02:51:32 smithi172 ceph-4954ed46-70ae-11ef-bcea-c7b262605968-osd-11[61129]: 2024-09-12T02:51:32.583+0000 7ff146fac640 -1 osd.11 112 heartbeat_check: no reply from 172.21.15.39:6822 osd.6 since back 2024-09-12T02:50:54.756477+0000 front 2024-09-12T02:50:54.756555+0000 (oldest deadline 2024-09-12T02:51:20.656467+0000) 2024-09-12T02:51:33.014 INFO:journalctl@ceph.osd.11.smithi172.stdout:Sep 12 02:51:32 smithi172 ceph-4954ed46-70ae-11ef-bcea-c7b262605968-osd-11[61129]: 2024-09-12T02:51:32.583+0000 7ff146fac640 -1 osd.11 112 heartbeat_check: no reply from 172.21.15.44:6820 osd.7 since back 2024-09-12T02:51:04.057786+0000 front 2024-09-12T02:51:04.057894+0000 (oldest deadline 2024-09-12T02:51:29.957694+0000) 2024-09-12T02:51:33.147 INFO:journalctl@ceph.osd.10.smithi044.stdout:Sep 12 02:51:32 smithi044 podman[72720]: 2024-09-12 02:51:32.837167287 +0000 UTC m=+0.113033821 container create 8003ef4ef7ed80d0e946521d5e0f8d1cdefc060607e4261e1abbcf38a18a1fd3 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:3be30d720e37ec4df7f667e60f22b4d221c4ce7b408e68b90f9ac10220535e66, name=ceph-4954ed46-70ae-11ef-bcea-c7b262605968-osd-10-deactivate, org.label-schema.build-date=20240731, io.buildah.version=1.37.2, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, maintainer=Guillaume Abrioux , GIT_BRANCH=HEAD, org.label-schema.name=CentOS Stream 9 Base Image, GIT_CLEAN=True, RELEASE=squid-b53b6d3, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.vendor=CentOS, org.label-schema.license=GPLv2, org.label-schema.schema-version=1.0, CEPH_POINT_RELEASE=, ceph=True) 2024-09-12T02:51:33.147 INFO:journalctl@ceph.osd.10.smithi044.stdout:Sep 12 02:51:32 smithi044 podman[72720]: 2024-09-12 02:51:32.739965868 +0000 UTC m=+0.015832412 image pull 54467abc55f864c4f73dfaf9c6ac3bb3e87b773123d5badaf790bee57321d594 quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:3be30d720e37ec4df7f667e60f22b4d221c4ce7b408e68b90f9ac10220535e66 2024-09-12T02:51:33.449 INFO:journalctl@ceph.osd.10.smithi044.stdout:Sep 12 02:51:33 smithi044 podman[72720]: 2024-09-12 02:51:33.147705825 +0000 UTC m=+0.423572369 container init 8003ef4ef7ed80d0e946521d5e0f8d1cdefc060607e4261e1abbcf38a18a1fd3 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:3be30d720e37ec4df7f667e60f22b4d221c4ce7b408e68b90f9ac10220535e66, name=ceph-4954ed46-70ae-11ef-bcea-c7b262605968-osd-10-deactivate, GIT_BRANCH=HEAD, org.label-schema.name=CentOS Stream 9 Base Image, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, RELEASE=squid-b53b6d3, ceph=True, org.label-schema.schema-version=1.0, io.buildah.version=1.37.2, org.label-schema.build-date=20240731, org.label-schema.vendor=CentOS, GIT_REPO=git@github.com:ceph/ceph-container.git, CEPH_POINT_RELEASE=, GIT_CLEAN=True, org.label-schema.license=GPLv2, maintainer=Guillaume Abrioux ) 2024-09-12T02:51:33.449 INFO:journalctl@ceph.osd.10.smithi044.stdout:Sep 12 02:51:33 smithi044 podman[72720]: 2024-09-12 02:51:33.15112329 +0000 UTC m=+0.426989826 container start 8003ef4ef7ed80d0e946521d5e0f8d1cdefc060607e4261e1abbcf38a18a1fd3 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:3be30d720e37ec4df7f667e60f22b4d221c4ce7b408e68b90f9ac10220535e66, name=ceph-4954ed46-70ae-11ef-bcea-c7b262605968-osd-10-deactivate, GIT_CLEAN=True, RELEASE=squid-b53b6d3, GIT_BRANCH=HEAD, org.label-schema.name=CentOS Stream 9 Base Image, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, CEPH_POINT_RELEASE=, org.label-schema.vendor=CentOS, ceph=True, io.buildah.version=1.37.2, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.build-date=20240731, org.label-schema.license=GPLv2, org.label-schema.schema-version=1.0, maintainer=Guillaume Abrioux ) 2024-09-12T02:51:33.449 INFO:journalctl@ceph.osd.10.smithi044.stdout:Sep 12 02:51:33 smithi044 podman[72720]: 2024-09-12 02:51:33.23101292 +0000 UTC m=+0.506879474 container attach 8003ef4ef7ed80d0e946521d5e0f8d1cdefc060607e4261e1abbcf38a18a1fd3 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:3be30d720e37ec4df7f667e60f22b4d221c4ce7b408e68b90f9ac10220535e66, name=ceph-4954ed46-70ae-11ef-bcea-c7b262605968-osd-10-deactivate, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_BRANCH=HEAD, org.label-schema.vendor=CentOS, maintainer=Guillaume Abrioux , GIT_CLEAN=True, ceph=True, io.buildah.version=1.37.2, org.label-schema.schema-version=1.0, RELEASE=squid-b53b6d3, org.label-schema.build-date=20240731, CEPH_POINT_RELEASE=, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.license=GPLv2, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7) 2024-09-12T02:51:33.449 INFO:journalctl@ceph.osd.10.smithi044.stdout:Sep 12 02:51:33 smithi044 podman[72720]: 2024-09-12 02:51:33.337610242 +0000 UTC m=+0.613476786 container died 8003ef4ef7ed80d0e946521d5e0f8d1cdefc060607e4261e1abbcf38a18a1fd3 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:3be30d720e37ec4df7f667e60f22b4d221c4ce7b408e68b90f9ac10220535e66, name=ceph-4954ed46-70ae-11ef-bcea-c7b262605968-osd-10-deactivate, GIT_CLEAN=True, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, CEPH_POINT_RELEASE=, org.label-schema.vendor=CentOS, org.label-schema.schema-version=1.0, io.buildah.version=1.37.2, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.name=CentOS Stream 9 Base Image, maintainer=Guillaume Abrioux , RELEASE=squid-b53b6d3, ceph=True, org.label-schema.build-date=20240731, GIT_BRANCH=HEAD, org.label-schema.license=GPLv2) 2024-09-12T02:51:34.013 INFO:journalctl@ceph.osd.11.smithi172.stdout:Sep 12 02:51:33 smithi172 ceph-4954ed46-70ae-11ef-bcea-c7b262605968-osd-11[61129]: 2024-09-12T02:51:33.600+0000 7ff146fac640 -1 osd.11 112 heartbeat_check: no reply from 172.21.15.39:6806 osd.0 since back 2024-09-12T02:50:09.449223+0000 front 2024-09-12T02:50:09.449210+0000 (oldest deadline 2024-09-12T02:50:34.748980+0000) 2024-09-12T02:51:34.014 INFO:journalctl@ceph.osd.11.smithi172.stdout:Sep 12 02:51:33 smithi172 ceph-4954ed46-70ae-11ef-bcea-c7b262605968-osd-11[61129]: 2024-09-12T02:51:33.600+0000 7ff146fac640 -1 osd.11 112 heartbeat_check: no reply from 172.21.15.44:6804 osd.1 since back 2024-09-12T02:50:14.749696+0000 front 2024-09-12T02:50:14.749454+0000 (oldest deadline 2024-09-12T02:50:42.950102+0000) 2024-09-12T02:51:34.014 INFO:journalctl@ceph.osd.11.smithi172.stdout:Sep 12 02:51:33 smithi172 ceph-4954ed46-70ae-11ef-bcea-c7b262605968-osd-11[61129]: 2024-09-12T02:51:33.600+0000 7ff146fac640 -1 osd.11 112 heartbeat_check: no reply from 172.21.15.172:6804 osd.2 since back 2024-09-12T02:50:22.950505+0000 front 2024-09-12T02:50:22.950558+0000 (oldest deadline 2024-09-12T02:50:48.850680+0000) 2024-09-12T02:51:34.014 INFO:journalctl@ceph.osd.11.smithi172.stdout:Sep 12 02:51:33 smithi172 ceph-4954ed46-70ae-11ef-bcea-c7b262605968-osd-11[61129]: 2024-09-12T02:51:33.600+0000 7ff146fac640 -1 osd.11 112 heartbeat_check: no reply from 172.21.15.44:6812 osd.4 since back 2024-09-12T02:50:39.054153+0000 front 2024-09-12T02:50:39.054100+0000 (oldest deadline 2024-09-12T02:51:04.354015+0000) 2024-09-12T02:51:34.014 INFO:journalctl@ceph.osd.11.smithi172.stdout:Sep 12 02:51:33 smithi172 ceph-4954ed46-70ae-11ef-bcea-c7b262605968-osd-11[61129]: 2024-09-12T02:51:33.600+0000 7ff146fac640 -1 osd.11 112 heartbeat_check: no reply from 172.21.15.172:6812 osd.5 since back 2024-09-12T02:50:49.455828+0000 front 2024-09-12T02:50:49.455854+0000 (oldest deadline 2024-09-12T02:51:14.755884+0000) 2024-09-12T02:51:34.014 INFO:journalctl@ceph.osd.11.smithi172.stdout:Sep 12 02:51:33 smithi172 ceph-4954ed46-70ae-11ef-bcea-c7b262605968-osd-11[61129]: 2024-09-12T02:51:33.600+0000 7ff146fac640 -1 osd.11 112 heartbeat_check: no reply from 172.21.15.39:6822 osd.6 since back 2024-09-12T02:50:54.756477+0000 front 2024-09-12T02:50:54.756555+0000 (oldest deadline 2024-09-12T02:51:20.656467+0000) 2024-09-12T02:51:34.014 INFO:journalctl@ceph.osd.11.smithi172.stdout:Sep 12 02:51:33 smithi172 ceph-4954ed46-70ae-11ef-bcea-c7b262605968-osd-11[61129]: 2024-09-12T02:51:33.600+0000 7ff146fac640 -1 osd.11 112 heartbeat_check: no reply from 172.21.15.44:6820 osd.7 since back 2024-09-12T02:51:04.057786+0000 front 2024-09-12T02:51:04.057894+0000 (oldest deadline 2024-09-12T02:51:29.957694+0000) 2024-09-12T02:51:34.087 DEBUG:teuthology.orchestra.run.smithi044:> sudo pkill -f 'journalctl -f -n 0 -u ceph-4954ed46-70ae-11ef-bcea-c7b262605968@osd.10.service' 2024-09-12T02:51:34.127 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-09-12T02:51:34.127 INFO:tasks.cephadm.osd.10:Stopped osd.10 2024-09-12T02:51:34.127 INFO:tasks.cephadm.osd.11:Stopping osd.11... 2024-09-12T02:51:34.127 DEBUG:teuthology.orchestra.run.smithi172:> sudo systemctl stop ceph-4954ed46-70ae-11ef-bcea-c7b262605968@osd.11 2024-09-12T02:51:34.428 INFO:journalctl@ceph.osd.11.smithi172.stdout:Sep 12 02:51:34 smithi172 systemd[1]: Stopping Ceph osd.11 for 4954ed46-70ae-11ef-bcea-c7b262605968... 2024-09-12T02:51:34.428 INFO:journalctl@ceph.osd.11.smithi172.stdout:Sep 12 02:51:34 smithi172 ceph-4954ed46-70ae-11ef-bcea-c7b262605968-osd-11[61129]: 2024-09-12T02:51:34.427+0000 7ff14a996640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-osd -n osd.11 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-09-12T02:51:34.428 INFO:journalctl@ceph.osd.11.smithi172.stdout:Sep 12 02:51:34 smithi172 ceph-4954ed46-70ae-11ef-bcea-c7b262605968-osd-11[61129]: 2024-09-12T02:51:34.427+0000 7ff14a996640 -1 osd.11 112 *** Got signal Terminated *** 2024-09-12T02:51:34.763 INFO:journalctl@ceph.osd.11.smithi172.stdout:Sep 12 02:51:34 smithi172 ceph-4954ed46-70ae-11ef-bcea-c7b262605968-osd-11[61129]: 2024-09-12T02:51:34.427+0000 7ff14a996640 -1 osd.11 112 *** Immediate shutdown (osd_fast_shutdown=true) *** 2024-09-12T02:51:34.764 INFO:journalctl@ceph.osd.11.smithi172.stdout:Sep 12 02:51:34 smithi172 ceph-4954ed46-70ae-11ef-bcea-c7b262605968-osd-11[61129]: 2024-09-12T02:51:34.557+0000 7ff146fac640 -1 osd.11 112 heartbeat_check: no reply from 172.21.15.39:6806 osd.0 since back 2024-09-12T02:50:09.449223+0000 front 2024-09-12T02:50:09.449210+0000 (oldest deadline 2024-09-12T02:50:34.748980+0000) 2024-09-12T02:51:34.764 INFO:journalctl@ceph.osd.11.smithi172.stdout:Sep 12 02:51:34 smithi172 ceph-4954ed46-70ae-11ef-bcea-c7b262605968-osd-11[61129]: 2024-09-12T02:51:34.557+0000 7ff146fac640 -1 osd.11 112 heartbeat_check: no reply from 172.21.15.44:6804 osd.1 since back 2024-09-12T02:50:14.749696+0000 front 2024-09-12T02:50:14.749454+0000 (oldest deadline 2024-09-12T02:50:42.950102+0000) 2024-09-12T02:51:34.764 INFO:journalctl@ceph.osd.11.smithi172.stdout:Sep 12 02:51:34 smithi172 ceph-4954ed46-70ae-11ef-bcea-c7b262605968-osd-11[61129]: 2024-09-12T02:51:34.557+0000 7ff146fac640 -1 osd.11 112 heartbeat_check: no reply from 172.21.15.172:6804 osd.2 since back 2024-09-12T02:50:22.950505+0000 front 2024-09-12T02:50:22.950558+0000 (oldest deadline 2024-09-12T02:50:48.850680+0000) 2024-09-12T02:51:34.764 INFO:journalctl@ceph.osd.11.smithi172.stdout:Sep 12 02:51:34 smithi172 ceph-4954ed46-70ae-11ef-bcea-c7b262605968-osd-11[61129]: 2024-09-12T02:51:34.557+0000 7ff146fac640 -1 osd.11 112 heartbeat_check: no reply from 172.21.15.44:6812 osd.4 since back 2024-09-12T02:50:39.054153+0000 front 2024-09-12T02:50:39.054100+0000 (oldest deadline 2024-09-12T02:51:04.354015+0000) 2024-09-12T02:51:34.764 INFO:journalctl@ceph.osd.11.smithi172.stdout:Sep 12 02:51:34 smithi172 ceph-4954ed46-70ae-11ef-bcea-c7b262605968-osd-11[61129]: 2024-09-12T02:51:34.557+0000 7ff146fac640 -1 osd.11 112 heartbeat_check: no reply from 172.21.15.172:6812 osd.5 since back 2024-09-12T02:50:49.455828+0000 front 2024-09-12T02:50:49.455854+0000 (oldest deadline 2024-09-12T02:51:14.755884+0000) 2024-09-12T02:51:34.764 INFO:journalctl@ceph.osd.11.smithi172.stdout:Sep 12 02:51:34 smithi172 ceph-4954ed46-70ae-11ef-bcea-c7b262605968-osd-11[61129]: 2024-09-12T02:51:34.557+0000 7ff146fac640 -1 osd.11 112 heartbeat_check: no reply from 172.21.15.39:6822 osd.6 since back 2024-09-12T02:50:54.756477+0000 front 2024-09-12T02:50:54.756555+0000 (oldest deadline 2024-09-12T02:51:20.656467+0000) 2024-09-12T02:51:34.764 INFO:journalctl@ceph.osd.11.smithi172.stdout:Sep 12 02:51:34 smithi172 ceph-4954ed46-70ae-11ef-bcea-c7b262605968-osd-11[61129]: 2024-09-12T02:51:34.557+0000 7ff146fac640 -1 osd.11 112 heartbeat_check: no reply from 172.21.15.44:6820 osd.7 since back 2024-09-12T02:51:04.057786+0000 front 2024-09-12T02:51:04.057894+0000 (oldest deadline 2024-09-12T02:51:29.957694+0000) 2024-09-12T02:51:36.014 INFO:journalctl@ceph.osd.11.smithi172.stdout:Sep 12 02:51:35 smithi172 ceph-4954ed46-70ae-11ef-bcea-c7b262605968-osd-11[61129]: 2024-09-12T02:51:35.538+0000 7ff146fac640 -1 osd.11 112 heartbeat_check: no reply from 172.21.15.39:6806 osd.0 since back 2024-09-12T02:50:09.449223+0000 front 2024-09-12T02:50:09.449210+0000 (oldest deadline 2024-09-12T02:50:34.748980+0000) 2024-09-12T02:51:36.014 INFO:journalctl@ceph.osd.11.smithi172.stdout:Sep 12 02:51:35 smithi172 ceph-4954ed46-70ae-11ef-bcea-c7b262605968-osd-11[61129]: 2024-09-12T02:51:35.538+0000 7ff146fac640 -1 osd.11 112 heartbeat_check: no reply from 172.21.15.44:6804 osd.1 since back 2024-09-12T02:50:14.749696+0000 front 2024-09-12T02:50:14.749454+0000 (oldest deadline 2024-09-12T02:50:42.950102+0000) 2024-09-12T02:51:36.014 INFO:journalctl@ceph.osd.11.smithi172.stdout:Sep 12 02:51:35 smithi172 ceph-4954ed46-70ae-11ef-bcea-c7b262605968-osd-11[61129]: 2024-09-12T02:51:35.538+0000 7ff146fac640 -1 osd.11 112 heartbeat_check: no reply from 172.21.15.172:6804 osd.2 since back 2024-09-12T02:50:22.950505+0000 front 2024-09-12T02:50:22.950558+0000 (oldest deadline 2024-09-12T02:50:48.850680+0000) 2024-09-12T02:51:36.014 INFO:journalctl@ceph.osd.11.smithi172.stdout:Sep 12 02:51:35 smithi172 ceph-4954ed46-70ae-11ef-bcea-c7b262605968-osd-11[61129]: 2024-09-12T02:51:35.538+0000 7ff146fac640 -1 osd.11 112 heartbeat_check: no reply from 172.21.15.44:6812 osd.4 since back 2024-09-12T02:50:39.054153+0000 front 2024-09-12T02:50:39.054100+0000 (oldest deadline 2024-09-12T02:51:04.354015+0000) 2024-09-12T02:51:36.014 INFO:journalctl@ceph.osd.11.smithi172.stdout:Sep 12 02:51:35 smithi172 ceph-4954ed46-70ae-11ef-bcea-c7b262605968-osd-11[61129]: 2024-09-12T02:51:35.538+0000 7ff146fac640 -1 osd.11 112 heartbeat_check: no reply from 172.21.15.172:6812 osd.5 since back 2024-09-12T02:50:49.455828+0000 front 2024-09-12T02:50:49.455854+0000 (oldest deadline 2024-09-12T02:51:14.755884+0000) 2024-09-12T02:51:36.014 INFO:journalctl@ceph.osd.11.smithi172.stdout:Sep 12 02:51:35 smithi172 ceph-4954ed46-70ae-11ef-bcea-c7b262605968-osd-11[61129]: 2024-09-12T02:51:35.538+0000 7ff146fac640 -1 osd.11 112 heartbeat_check: no reply from 172.21.15.39:6822 osd.6 since back 2024-09-12T02:50:54.756477+0000 front 2024-09-12T02:50:54.756555+0000 (oldest deadline 2024-09-12T02:51:20.656467+0000) 2024-09-12T02:51:36.014 INFO:journalctl@ceph.osd.11.smithi172.stdout:Sep 12 02:51:35 smithi172 ceph-4954ed46-70ae-11ef-bcea-c7b262605968-osd-11[61129]: 2024-09-12T02:51:35.538+0000 7ff146fac640 -1 osd.11 112 heartbeat_check: no reply from 172.21.15.44:6820 osd.7 since back 2024-09-12T02:51:04.057786+0000 front 2024-09-12T02:51:04.057894+0000 (oldest deadline 2024-09-12T02:51:29.957694+0000) 2024-09-12T02:51:36.966 INFO:journalctl@ceph.osd.11.smithi172.stdout:Sep 12 02:51:36 smithi172 ceph-4954ed46-70ae-11ef-bcea-c7b262605968-osd-11[61129]: 2024-09-12T02:51:36.534+0000 7ff146fac640 -1 osd.11 112 heartbeat_check: no reply from 172.21.15.39:6806 osd.0 since back 2024-09-12T02:50:09.449223+0000 front 2024-09-12T02:50:09.449210+0000 (oldest deadline 2024-09-12T02:50:34.748980+0000) 2024-09-12T02:51:36.966 INFO:journalctl@ceph.osd.11.smithi172.stdout:Sep 12 02:51:36 smithi172 ceph-4954ed46-70ae-11ef-bcea-c7b262605968-osd-11[61129]: 2024-09-12T02:51:36.534+0000 7ff146fac640 -1 osd.11 112 heartbeat_check: no reply from 172.21.15.44:6804 osd.1 since back 2024-09-12T02:50:14.749696+0000 front 2024-09-12T02:50:14.749454+0000 (oldest deadline 2024-09-12T02:50:42.950102+0000) 2024-09-12T02:51:36.966 INFO:journalctl@ceph.osd.11.smithi172.stdout:Sep 12 02:51:36 smithi172 ceph-4954ed46-70ae-11ef-bcea-c7b262605968-osd-11[61129]: 2024-09-12T02:51:36.534+0000 7ff146fac640 -1 osd.11 112 heartbeat_check: no reply from 172.21.15.172:6804 osd.2 since back 2024-09-12T02:50:22.950505+0000 front 2024-09-12T02:50:22.950558+0000 (oldest deadline 2024-09-12T02:50:48.850680+0000) 2024-09-12T02:51:36.966 INFO:journalctl@ceph.osd.11.smithi172.stdout:Sep 12 02:51:36 smithi172 ceph-4954ed46-70ae-11ef-bcea-c7b262605968-osd-11[61129]: 2024-09-12T02:51:36.534+0000 7ff146fac640 -1 osd.11 112 heartbeat_check: no reply from 172.21.15.44:6812 osd.4 since back 2024-09-12T02:50:39.054153+0000 front 2024-09-12T02:50:39.054100+0000 (oldest deadline 2024-09-12T02:51:04.354015+0000) 2024-09-12T02:51:36.966 INFO:journalctl@ceph.osd.11.smithi172.stdout:Sep 12 02:51:36 smithi172 ceph-4954ed46-70ae-11ef-bcea-c7b262605968-osd-11[61129]: 2024-09-12T02:51:36.534+0000 7ff146fac640 -1 osd.11 112 heartbeat_check: no reply from 172.21.15.172:6812 osd.5 since back 2024-09-12T02:50:49.455828+0000 front 2024-09-12T02:50:49.455854+0000 (oldest deadline 2024-09-12T02:51:14.755884+0000) 2024-09-12T02:51:36.967 INFO:journalctl@ceph.osd.11.smithi172.stdout:Sep 12 02:51:36 smithi172 ceph-4954ed46-70ae-11ef-bcea-c7b262605968-osd-11[61129]: 2024-09-12T02:51:36.534+0000 7ff146fac640 -1 osd.11 112 heartbeat_check: no reply from 172.21.15.39:6822 osd.6 since back 2024-09-12T02:50:54.756477+0000 front 2024-09-12T02:50:54.756555+0000 (oldest deadline 2024-09-12T02:51:20.656467+0000) 2024-09-12T02:51:36.967 INFO:journalctl@ceph.osd.11.smithi172.stdout:Sep 12 02:51:36 smithi172 ceph-4954ed46-70ae-11ef-bcea-c7b262605968-osd-11[61129]: 2024-09-12T02:51:36.534+0000 7ff146fac640 -1 osd.11 112 heartbeat_check: no reply from 172.21.15.44:6820 osd.7 since back 2024-09-12T02:51:04.057786+0000 front 2024-09-12T02:51:04.057894+0000 (oldest deadline 2024-09-12T02:51:29.957694+0000) 2024-09-12T02:51:38.014 INFO:journalctl@ceph.osd.11.smithi172.stdout:Sep 12 02:51:37 smithi172 ceph-4954ed46-70ae-11ef-bcea-c7b262605968-osd-11[61129]: 2024-09-12T02:51:37.539+0000 7ff146fac640 -1 osd.11 112 heartbeat_check: no reply from 172.21.15.39:6806 osd.0 since back 2024-09-12T02:50:09.449223+0000 front 2024-09-12T02:50:09.449210+0000 (oldest deadline 2024-09-12T02:50:34.748980+0000) 2024-09-12T02:51:38.014 INFO:journalctl@ceph.osd.11.smithi172.stdout:Sep 12 02:51:37 smithi172 ceph-4954ed46-70ae-11ef-bcea-c7b262605968-osd-11[61129]: 2024-09-12T02:51:37.539+0000 7ff146fac640 -1 osd.11 112 heartbeat_check: no reply from 172.21.15.44:6804 osd.1 since back 2024-09-12T02:50:14.749696+0000 front 2024-09-12T02:50:14.749454+0000 (oldest deadline 2024-09-12T02:50:42.950102+0000) 2024-09-12T02:51:38.014 INFO:journalctl@ceph.osd.11.smithi172.stdout:Sep 12 02:51:37 smithi172 ceph-4954ed46-70ae-11ef-bcea-c7b262605968-osd-11[61129]: 2024-09-12T02:51:37.539+0000 7ff146fac640 -1 osd.11 112 heartbeat_check: no reply from 172.21.15.172:6804 osd.2 since back 2024-09-12T02:50:22.950505+0000 front 2024-09-12T02:50:22.950558+0000 (oldest deadline 2024-09-12T02:50:48.850680+0000) 2024-09-12T02:51:38.015 INFO:journalctl@ceph.osd.11.smithi172.stdout:Sep 12 02:51:37 smithi172 ceph-4954ed46-70ae-11ef-bcea-c7b262605968-osd-11[61129]: 2024-09-12T02:51:37.539+0000 7ff146fac640 -1 osd.11 112 heartbeat_check: no reply from 172.21.15.44:6812 osd.4 since back 2024-09-12T02:50:39.054153+0000 front 2024-09-12T02:50:39.054100+0000 (oldest deadline 2024-09-12T02:51:04.354015+0000) 2024-09-12T02:51:38.015 INFO:journalctl@ceph.osd.11.smithi172.stdout:Sep 12 02:51:37 smithi172 ceph-4954ed46-70ae-11ef-bcea-c7b262605968-osd-11[61129]: 2024-09-12T02:51:37.539+0000 7ff146fac640 -1 osd.11 112 heartbeat_check: no reply from 172.21.15.172:6812 osd.5 since back 2024-09-12T02:50:49.455828+0000 front 2024-09-12T02:50:49.455854+0000 (oldest deadline 2024-09-12T02:51:14.755884+0000) 2024-09-12T02:51:38.015 INFO:journalctl@ceph.osd.11.smithi172.stdout:Sep 12 02:51:37 smithi172 ceph-4954ed46-70ae-11ef-bcea-c7b262605968-osd-11[61129]: 2024-09-12T02:51:37.539+0000 7ff146fac640 -1 osd.11 112 heartbeat_check: no reply from 172.21.15.39:6822 osd.6 since back 2024-09-12T02:50:54.756477+0000 front 2024-09-12T02:50:54.756555+0000 (oldest deadline 2024-09-12T02:51:20.656467+0000) 2024-09-12T02:51:38.015 INFO:journalctl@ceph.osd.11.smithi172.stdout:Sep 12 02:51:37 smithi172 ceph-4954ed46-70ae-11ef-bcea-c7b262605968-osd-11[61129]: 2024-09-12T02:51:37.539+0000 7ff146fac640 -1 osd.11 112 heartbeat_check: no reply from 172.21.15.44:6820 osd.7 since back 2024-09-12T02:51:04.057786+0000 front 2024-09-12T02:51:04.057894+0000 (oldest deadline 2024-09-12T02:51:29.957694+0000) 2024-09-12T02:51:38.764 INFO:journalctl@ceph.osd.11.smithi172.stdout:Sep 12 02:51:38 smithi172 ceph-4954ed46-70ae-11ef-bcea-c7b262605968-osd-11[61129]: 2024-09-12T02:51:38.491+0000 7ff146fac640 -1 osd.11 112 heartbeat_check: no reply from 172.21.15.39:6806 osd.0 since back 2024-09-12T02:50:09.449223+0000 front 2024-09-12T02:50:09.449210+0000 (oldest deadline 2024-09-12T02:50:34.748980+0000) 2024-09-12T02:51:38.764 INFO:journalctl@ceph.osd.11.smithi172.stdout:Sep 12 02:51:38 smithi172 ceph-4954ed46-70ae-11ef-bcea-c7b262605968-osd-11[61129]: 2024-09-12T02:51:38.491+0000 7ff146fac640 -1 osd.11 112 heartbeat_check: no reply from 172.21.15.44:6804 osd.1 since back 2024-09-12T02:50:14.749696+0000 front 2024-09-12T02:50:14.749454+0000 (oldest deadline 2024-09-12T02:50:42.950102+0000) 2024-09-12T02:51:38.764 INFO:journalctl@ceph.osd.11.smithi172.stdout:Sep 12 02:51:38 smithi172 ceph-4954ed46-70ae-11ef-bcea-c7b262605968-osd-11[61129]: 2024-09-12T02:51:38.491+0000 7ff146fac640 -1 osd.11 112 heartbeat_check: no reply from 172.21.15.172:6804 osd.2 since back 2024-09-12T02:50:22.950505+0000 front 2024-09-12T02:50:22.950558+0000 (oldest deadline 2024-09-12T02:50:48.850680+0000) 2024-09-12T02:51:38.764 INFO:journalctl@ceph.osd.11.smithi172.stdout:Sep 12 02:51:38 smithi172 ceph-4954ed46-70ae-11ef-bcea-c7b262605968-osd-11[61129]: 2024-09-12T02:51:38.491+0000 7ff146fac640 -1 osd.11 112 heartbeat_check: no reply from 172.21.15.44:6812 osd.4 since back 2024-09-12T02:50:39.054153+0000 front 2024-09-12T02:50:39.054100+0000 (oldest deadline 2024-09-12T02:51:04.354015+0000) 2024-09-12T02:51:38.764 INFO:journalctl@ceph.osd.11.smithi172.stdout:Sep 12 02:51:38 smithi172 ceph-4954ed46-70ae-11ef-bcea-c7b262605968-osd-11[61129]: 2024-09-12T02:51:38.491+0000 7ff146fac640 -1 osd.11 112 heartbeat_check: no reply from 172.21.15.172:6812 osd.5 since back 2024-09-12T02:50:49.455828+0000 front 2024-09-12T02:50:49.455854+0000 (oldest deadline 2024-09-12T02:51:14.755884+0000) 2024-09-12T02:51:38.765 INFO:journalctl@ceph.osd.11.smithi172.stdout:Sep 12 02:51:38 smithi172 ceph-4954ed46-70ae-11ef-bcea-c7b262605968-osd-11[61129]: 2024-09-12T02:51:38.491+0000 7ff146fac640 -1 osd.11 112 heartbeat_check: no reply from 172.21.15.39:6822 osd.6 since back 2024-09-12T02:50:54.756477+0000 front 2024-09-12T02:50:54.756555+0000 (oldest deadline 2024-09-12T02:51:20.656467+0000) 2024-09-12T02:51:38.765 INFO:journalctl@ceph.osd.11.smithi172.stdout:Sep 12 02:51:38 smithi172 ceph-4954ed46-70ae-11ef-bcea-c7b262605968-osd-11[61129]: 2024-09-12T02:51:38.491+0000 7ff146fac640 -1 osd.11 112 heartbeat_check: no reply from 172.21.15.44:6820 osd.7 since back 2024-09-12T02:51:04.057786+0000 front 2024-09-12T02:51:04.057894+0000 (oldest deadline 2024-09-12T02:51:29.957694+0000) 2024-09-12T02:51:38.765 INFO:journalctl@ceph.osd.11.smithi172.stdout:Sep 12 02:51:38 smithi172 ceph-4954ed46-70ae-11ef-bcea-c7b262605968-osd-11[61129]: 2024-09-12T02:51:38.491+0000 7ff146fac640 -1 osd.11 112 heartbeat_check: no reply from 172.21.15.172:6820 osd.8 since back 2024-09-12T02:51:14.058584+0000 front 2024-09-12T02:51:14.058617+0000 (oldest deadline 2024-09-12T02:51:37.558655+0000) 2024-09-12T02:51:40.044 INFO:journalctl@ceph.osd.11.smithi172.stdout:Sep 12 02:51:39 smithi172 podman[73219]: 2024-09-12 02:51:39.78948472 +0000 UTC m=+5.454378461 container died 4b56ef31936e86d82ab288b831ee706e5f186dceb164bc8ce40b4686ca593c84 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:3be30d720e37ec4df7f667e60f22b4d221c4ce7b408e68b90f9ac10220535e66, name=ceph-4954ed46-70ae-11ef-bcea-c7b262605968-osd-11, CEPH_POINT_RELEASE=, GIT_BRANCH=HEAD, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.build-date=20240731, org.label-schema.license=GPLv2, io.buildah.version=1.37.2, maintainer=Guillaume Abrioux , ceph=True, RELEASE=squid-b53b6d3, org.label-schema.schema-version=1.0, org.label-schema.vendor=CentOS, GIT_CLEAN=True, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.name=CentOS Stream 9 Base Image) 2024-09-12T02:51:40.311 INFO:journalctl@ceph.osd.11.smithi172.stdout:Sep 12 02:51:40 smithi172 podman[73219]: 2024-09-12 02:51:40.134832086 +0000 UTC m=+5.799725834 container cleanup 4b56ef31936e86d82ab288b831ee706e5f186dceb164bc8ce40b4686ca593c84 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:3be30d720e37ec4df7f667e60f22b4d221c4ce7b408e68b90f9ac10220535e66, name=ceph-4954ed46-70ae-11ef-bcea-c7b262605968-osd-11, org.label-schema.vendor=CentOS, maintainer=Guillaume Abrioux , GIT_CLEAN=True, GIT_BRANCH=HEAD, org.label-schema.name=CentOS Stream 9 Base Image, io.buildah.version=1.37.2, ceph=True, org.label-schema.schema-version=1.0, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.build-date=20240731, CEPH_POINT_RELEASE=, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, RELEASE=squid-b53b6d3, org.label-schema.license=GPLv2) 2024-09-12T02:51:40.311 INFO:journalctl@ceph.osd.11.smithi172.stdout:Sep 12 02:51:40 smithi172 bash[73219]: ceph-4954ed46-70ae-11ef-bcea-c7b262605968-osd-11 2024-09-12T02:51:40.730 INFO:journalctl@ceph.osd.11.smithi172.stdout:Sep 12 02:51:40 smithi172 podman[73234]: 2024-09-12 02:51:40.310977845 +0000 UTC m=+0.513973065 container remove 4b56ef31936e86d82ab288b831ee706e5f186dceb164bc8ce40b4686ca593c84 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:3be30d720e37ec4df7f667e60f22b4d221c4ce7b408e68b90f9ac10220535e66, name=ceph-4954ed46-70ae-11ef-bcea-c7b262605968-osd-11, io.buildah.version=1.37.2, maintainer=Guillaume Abrioux , org.label-schema.vendor=CentOS, GIT_CLEAN=True, RELEASE=squid-b53b6d3, CEPH_POINT_RELEASE=, org.label-schema.schema-version=1.0, org.label-schema.name=CentOS Stream 9 Base Image, GIT_BRANCH=HEAD, GIT_REPO=git@github.com:ceph/ceph-container.git, ceph=True, org.label-schema.build-date=20240731, org.label-schema.license=GPLv2, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7) 2024-09-12T02:51:41.014 INFO:journalctl@ceph.osd.11.smithi172.stdout:Sep 12 02:51:40 smithi172 podman[73323]: 2024-09-12 02:51:40.633283432 +0000 UTC m=+0.016100700 image pull 54467abc55f864c4f73dfaf9c6ac3bb3e87b773123d5badaf790bee57321d594 quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:3be30d720e37ec4df7f667e60f22b4d221c4ce7b408e68b90f9ac10220535e66 2024-09-12T02:51:41.014 INFO:journalctl@ceph.osd.11.smithi172.stdout:Sep 12 02:51:40 smithi172 podman[73323]: 2024-09-12 02:51:40.744965385 +0000 UTC m=+0.127782631 container create 1ec3b5cf8be97b533df2d47dfbdea43e2a1c315328453dfd66eabfb8536cdc4e (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:3be30d720e37ec4df7f667e60f22b4d221c4ce7b408e68b90f9ac10220535e66, name=ceph-4954ed46-70ae-11ef-bcea-c7b262605968-osd-11-deactivate, maintainer=Guillaume Abrioux , ceph=True, org.label-schema.name=CentOS Stream 9 Base Image, GIT_CLEAN=True, GIT_BRANCH=HEAD, CEPH_POINT_RELEASE=, org.label-schema.build-date=20240731, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.license=GPLv2, org.label-schema.vendor=CentOS, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.schema-version=1.0, RELEASE=squid-b53b6d3, io.buildah.version=1.37.2) 2024-09-12T02:51:41.014 INFO:journalctl@ceph.osd.11.smithi172.stdout:Sep 12 02:51:40 smithi172 podman[73323]: 2024-09-12 02:51:40.955814958 +0000 UTC m=+0.338632214 container init 1ec3b5cf8be97b533df2d47dfbdea43e2a1c315328453dfd66eabfb8536cdc4e (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:3be30d720e37ec4df7f667e60f22b4d221c4ce7b408e68b90f9ac10220535e66, name=ceph-4954ed46-70ae-11ef-bcea-c7b262605968-osd-11-deactivate, GIT_CLEAN=True, org.label-schema.schema-version=1.0, CEPH_POINT_RELEASE=, org.label-schema.build-date=20240731, io.buildah.version=1.37.2, org.label-schema.vendor=CentOS, org.label-schema.license=GPLv2, ceph=True, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.name=CentOS Stream 9 Base Image, RELEASE=squid-b53b6d3, GIT_BRANCH=HEAD, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, maintainer=Guillaume Abrioux ) 2024-09-12T02:51:41.014 INFO:journalctl@ceph.osd.11.smithi172.stdout:Sep 12 02:51:40 smithi172 podman[73323]: 2024-09-12 02:51:40.959194364 +0000 UTC m=+0.342011611 container start 1ec3b5cf8be97b533df2d47dfbdea43e2a1c315328453dfd66eabfb8536cdc4e (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:3be30d720e37ec4df7f667e60f22b4d221c4ce7b408e68b90f9ac10220535e66, name=ceph-4954ed46-70ae-11ef-bcea-c7b262605968-osd-11-deactivate, RELEASE=squid-b53b6d3, GIT_CLEAN=True, io.buildah.version=1.37.2, maintainer=Guillaume Abrioux , org.label-schema.build-date=20240731, org.label-schema.schema-version=1.0, org.label-schema.license=GPLv2, ceph=True, CEPH_POINT_RELEASE=, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.name=CentOS Stream 9 Base Image, GIT_BRANCH=HEAD, org.label-schema.vendor=CentOS, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7) 2024-09-12T02:51:41.433 INFO:journalctl@ceph.osd.11.smithi172.stdout:Sep 12 02:51:41 smithi172 podman[73323]: 2024-09-12 02:51:41.041980034 +0000 UTC m=+0.424797292 container attach 1ec3b5cf8be97b533df2d47dfbdea43e2a1c315328453dfd66eabfb8536cdc4e (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:3be30d720e37ec4df7f667e60f22b4d221c4ce7b408e68b90f9ac10220535e66, name=ceph-4954ed46-70ae-11ef-bcea-c7b262605968-osd-11-deactivate, org.label-schema.license=GPLv2, CEPH_POINT_RELEASE=, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.schema-version=1.0, GIT_CLEAN=True, GIT_BRANCH=HEAD, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.build-date=20240731, org.label-schema.vendor=CentOS, maintainer=Guillaume Abrioux , ceph=True, org.label-schema.name=CentOS Stream 9 Base Image, RELEASE=squid-b53b6d3, io.buildah.version=1.37.2) 2024-09-12T02:51:41.433 INFO:journalctl@ceph.osd.11.smithi172.stdout:Sep 12 02:51:41 smithi172 podman[73323]: 2024-09-12 02:51:41.14784857 +0000 UTC m=+0.530665819 container died 1ec3b5cf8be97b533df2d47dfbdea43e2a1c315328453dfd66eabfb8536cdc4e (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:3be30d720e37ec4df7f667e60f22b4d221c4ce7b408e68b90f9ac10220535e66, name=ceph-4954ed46-70ae-11ef-bcea-c7b262605968-osd-11-deactivate, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_CLEAN=True, io.buildah.version=1.37.2, GIT_BRANCH=HEAD, RELEASE=squid-b53b6d3, org.label-schema.vendor=CentOS, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.build-date=20240731, CEPH_POINT_RELEASE=, ceph=True, org.label-schema.schema-version=1.0, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, maintainer=Guillaume Abrioux , org.label-schema.license=GPLv2) 2024-09-12T02:51:41.708 DEBUG:teuthology.orchestra.run.smithi172:> sudo pkill -f 'journalctl -f -n 0 -u ceph-4954ed46-70ae-11ef-bcea-c7b262605968@osd.11.service' 2024-09-12T02:51:41.746 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-09-12T02:51:41.746 INFO:tasks.cephadm.osd.11:Stopped osd.11 2024-09-12T02:51:41.747 INFO:tasks.cephadm.mds.a:Stopping mds.a... 2024-09-12T02:51:41.747 DEBUG:teuthology.orchestra.run.smithi039:> sudo systemctl stop ceph-4954ed46-70ae-11ef-bcea-c7b262605968@mds.a 2024-09-12T02:51:42.100 INFO:journalctl@ceph.mds.a.smithi039.stdout:Sep 12 02:51:41 smithi039 systemd[1]: Stopping Ceph mds.a for 4954ed46-70ae-11ef-bcea-c7b262605968... 2024-09-12T02:51:42.533 INFO:journalctl@ceph.mds.a.smithi039.stdout:Sep 12 02:51:42 smithi039 ceph-4954ed46-70ae-11ef-bcea-c7b262605968-mds-a[70722]: 2024-09-12T02:51:42.184+0000 7ff79da00640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-mds -n mds.a -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-09-12T02:51:42.533 INFO:journalctl@ceph.mds.a.smithi039.stdout:Sep 12 02:51:42 smithi039 ceph-4954ed46-70ae-11ef-bcea-c7b262605968-mds-a[70722]: 2024-09-12T02:51:42.184+0000 7ff79da00640 -1 mds.a *** got signal Terminated *** 2024-09-12T02:51:46.516 INFO:journalctl@ceph.mds.a.smithi039.stdout:Sep 12 02:51:46 smithi039 podman[91466]: 2024-09-12 02:51:46.194952513 +0000 UTC m=+4.133039144 container died 47f9ba6d6ffa82ef102bf2d190d7cb4146b3d5b945afe4ab164067752ea7e1ce (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:3be30d720e37ec4df7f667e60f22b4d221c4ce7b408e68b90f9ac10220535e66, name=ceph-4954ed46-70ae-11ef-bcea-c7b262605968-mds-a, org.label-schema.vendor=CentOS, ceph=True, org.label-schema.license=GPLv2, maintainer=Guillaume Abrioux , org.label-schema.build-date=20240731, RELEASE=squid-b53b6d3, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.schema-version=1.0, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_BRANCH=HEAD, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, GIT_CLEAN=True, io.buildah.version=1.37.2, CEPH_POINT_RELEASE=) 2024-09-12T02:51:46.808 INFO:journalctl@ceph.mds.a.smithi039.stdout:Sep 12 02:51:46 smithi039 podman[91466]: 2024-09-12 02:51:46.630762379 +0000 UTC m=+4.568849008 container cleanup 47f9ba6d6ffa82ef102bf2d190d7cb4146b3d5b945afe4ab164067752ea7e1ce (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:3be30d720e37ec4df7f667e60f22b4d221c4ce7b408e68b90f9ac10220535e66, name=ceph-4954ed46-70ae-11ef-bcea-c7b262605968-mds-a, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.schema-version=1.0, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, RELEASE=squid-b53b6d3, GIT_CLEAN=True, ceph=True, maintainer=Guillaume Abrioux , org.label-schema.build-date=20240731, io.buildah.version=1.37.2, CEPH_POINT_RELEASE=, GIT_BRANCH=HEAD, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.vendor=CentOS, org.label-schema.license=GPLv2) 2024-09-12T02:51:46.808 INFO:journalctl@ceph.mds.a.smithi039.stdout:Sep 12 02:51:46 smithi039 bash[91466]: ceph-4954ed46-70ae-11ef-bcea-c7b262605968-mds-a 2024-09-12T02:51:47.065 INFO:journalctl@ceph.mds.a.smithi039.stdout:Sep 12 02:51:46 smithi039 podman[91489]: 2024-09-12 02:51:46.8069816 +0000 UTC m=+0.597842264 container remove 47f9ba6d6ffa82ef102bf2d190d7cb4146b3d5b945afe4ab164067752ea7e1ce (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:3be30d720e37ec4df7f667e60f22b4d221c4ce7b408e68b90f9ac10220535e66, name=ceph-4954ed46-70ae-11ef-bcea-c7b262605968-mds-a, ceph=True, org.label-schema.license=GPLv2, GIT_CLEAN=True, org.label-schema.name=CentOS Stream 9 Base Image, io.buildah.version=1.37.2, maintainer=Guillaume Abrioux , RELEASE=squid-b53b6d3, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.schema-version=1.0, CEPH_POINT_RELEASE=, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.build-date=20240731, org.label-schema.vendor=CentOS, GIT_BRANCH=HEAD) 2024-09-12T02:51:47.074 DEBUG:teuthology.orchestra.run.smithi039:> sudo pkill -f 'journalctl -f -n 0 -u ceph-4954ed46-70ae-11ef-bcea-c7b262605968@mds.a.service' 2024-09-12T02:51:47.146 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-09-12T02:51:47.147 INFO:tasks.cephadm.mds.a:Stopped mds.a 2024-09-12T02:51:47.147 INFO:tasks.cephadm.mds.d:Stopping mds.d... 2024-09-12T02:51:47.147 DEBUG:teuthology.orchestra.run.smithi039:> sudo systemctl stop ceph-4954ed46-70ae-11ef-bcea-c7b262605968@mds.d 2024-09-12T02:51:47.349 INFO:journalctl@ceph.mds.d.smithi039.stdout:Sep 12 02:51:47 smithi039 systemd[1]: Stopping Ceph mds.d for 4954ed46-70ae-11ef-bcea-c7b262605968... 2024-09-12T02:51:47.850 INFO:journalctl@ceph.mds.d.smithi039.stdout:Sep 12 02:51:47 smithi039 ceph-4954ed46-70ae-11ef-bcea-c7b262605968-mds-d[69556]: 2024-09-12T02:51:47.587+0000 7fdb4b600640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-mds -n mds.d -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-09-12T02:51:47.850 INFO:journalctl@ceph.mds.d.smithi039.stdout:Sep 12 02:51:47 smithi039 ceph-4954ed46-70ae-11ef-bcea-c7b262605968-mds-d[69556]: 2024-09-12T02:51:47.587+0000 7fdb4b600640 -1 mds.d *** got signal Terminated *** 2024-09-12T02:51:50.850 INFO:journalctl@ceph.mds.d.smithi039.stdout:Sep 12 02:51:50 smithi039 podman[91597]: 2024-09-12 02:51:50.593809829 +0000 UTC m=+3.172753224 container died f31fd87cec948a9209584a190e2f47d5b97f2fcfe939ab578562deb9c49bfebb (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:3be30d720e37ec4df7f667e60f22b4d221c4ce7b408e68b90f9ac10220535e66, name=ceph-4954ed46-70ae-11ef-bcea-c7b262605968-mds-d, org.label-schema.build-date=20240731, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, maintainer=Guillaume Abrioux , org.label-schema.license=GPLv2, org.label-schema.vendor=CentOS, ceph=True, CEPH_POINT_RELEASE=, GIT_CLEAN=True, org.label-schema.schema-version=1.0, GIT_REPO=git@github.com:ceph/ceph-container.git, RELEASE=squid-b53b6d3, io.buildah.version=1.37.2, org.label-schema.name=CentOS Stream 9 Base Image, GIT_BRANCH=HEAD) 2024-09-12T02:51:51.194 INFO:journalctl@ceph.mds.d.smithi039.stdout:Sep 12 02:51:51 smithi039 podman[91597]: 2024-09-12 02:51:51.009692474 +0000 UTC m=+3.588635868 container cleanup f31fd87cec948a9209584a190e2f47d5b97f2fcfe939ab578562deb9c49bfebb (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:3be30d720e37ec4df7f667e60f22b4d221c4ce7b408e68b90f9ac10220535e66, name=ceph-4954ed46-70ae-11ef-bcea-c7b262605968-mds-d, org.label-schema.schema-version=1.0, ceph=True, org.label-schema.build-date=20240731, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.vendor=CentOS, CEPH_POINT_RELEASE=, GIT_CLEAN=True, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.license=GPLv2, GIT_REPO=git@github.com:ceph/ceph-container.git, io.buildah.version=1.37.2, GIT_BRANCH=HEAD, maintainer=Guillaume Abrioux , RELEASE=squid-b53b6d3) 2024-09-12T02:51:51.194 INFO:journalctl@ceph.mds.d.smithi039.stdout:Sep 12 02:51:51 smithi039 bash[91597]: ceph-4954ed46-70ae-11ef-bcea-c7b262605968-mds-d 2024-09-12T02:51:51.447 INFO:journalctl@ceph.mds.d.smithi039.stdout:Sep 12 02:51:51 smithi039 podman[91608]: 2024-09-12 02:51:51.194367901 +0000 UTC m=+0.588784664 container remove f31fd87cec948a9209584a190e2f47d5b97f2fcfe939ab578562deb9c49bfebb (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:3be30d720e37ec4df7f667e60f22b4d221c4ce7b408e68b90f9ac10220535e66, name=ceph-4954ed46-70ae-11ef-bcea-c7b262605968-mds-d, GIT_BRANCH=HEAD, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.build-date=20240731, ceph=True, GIT_CLEAN=True, org.label-schema.schema-version=1.0, GIT_REPO=git@github.com:ceph/ceph-container.git, maintainer=Guillaume Abrioux , org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.vendor=CentOS, io.buildah.version=1.37.2, org.label-schema.license=GPLv2, CEPH_POINT_RELEASE=, RELEASE=squid-b53b6d3) 2024-09-12T02:51:51.466 DEBUG:teuthology.orchestra.run.smithi039:> sudo pkill -f 'journalctl -f -n 0 -u ceph-4954ed46-70ae-11ef-bcea-c7b262605968@mds.d.service' 2024-09-12T02:51:51.536 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-09-12T02:51:51.536 INFO:tasks.cephadm.mds.d:Stopped mds.d 2024-09-12T02:51:51.536 INFO:tasks.cephadm.mds.g:Stopping mds.g... 2024-09-12T02:51:51.536 DEBUG:teuthology.orchestra.run.smithi039:> sudo systemctl stop ceph-4954ed46-70ae-11ef-bcea-c7b262605968@mds.g 2024-09-12T02:51:51.849 INFO:journalctl@ceph.mds.g.smithi039.stdout:Sep 12 02:51:51 smithi039 systemd[1]: Stopping Ceph mds.g for 4954ed46-70ae-11ef-bcea-c7b262605968... 2024-09-12T02:51:52.356 INFO:journalctl@ceph.mds.g.smithi039.stdout:Sep 12 02:51:52 smithi039 ceph-4954ed46-70ae-11ef-bcea-c7b262605968-mds-g[70317]: 2024-09-12T02:51:52.092+0000 7fd84b200640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-mds -n mds.g -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-09-12T02:51:52.479 INFO:journalctl@ceph.mds.g.smithi039.stdout:Sep 12 02:51:52 smithi039 ceph-4954ed46-70ae-11ef-bcea-c7b262605968-mds-g[70317]: 2024-09-12T02:51:52.092+0000 7fd84b200640 -1 mds.g *** got signal Terminated *** 2024-09-12T02:51:54.241 INFO:journalctl@ceph.mds.g.smithi039.stdout:Sep 12 02:51:53 smithi039 podman[91718]: 2024-09-12 02:51:53.93112792 +0000 UTC m=+2.113596201 container died 13f74e89fc496bea7df398119551da5461ea3af6d9f0a2d55d421de84fbd9f14 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:3be30d720e37ec4df7f667e60f22b4d221c4ce7b408e68b90f9ac10220535e66, name=ceph-4954ed46-70ae-11ef-bcea-c7b262605968-mds-g, org.label-schema.schema-version=1.0, maintainer=Guillaume Abrioux , GIT_BRANCH=HEAD, RELEASE=squid-b53b6d3, io.buildah.version=1.37.2, GIT_CLEAN=True, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.name=CentOS Stream 9 Base Image, CEPH_POINT_RELEASE=, ceph=True, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.license=GPLv2, org.label-schema.build-date=20240731, org.label-schema.vendor=CentOS) 2024-09-12T02:51:54.599 INFO:journalctl@ceph.mds.g.smithi039.stdout:Sep 12 02:51:54 smithi039 podman[91718]: 2024-09-12 02:51:54.355841909 +0000 UTC m=+2.538310189 container cleanup 13f74e89fc496bea7df398119551da5461ea3af6d9f0a2d55d421de84fbd9f14 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:3be30d720e37ec4df7f667e60f22b4d221c4ce7b408e68b90f9ac10220535e66, name=ceph-4954ed46-70ae-11ef-bcea-c7b262605968-mds-g, RELEASE=squid-b53b6d3, org.label-schema.license=GPLv2, ceph=True, org.label-schema.build-date=20240731, CEPH_POINT_RELEASE=, GIT_REPO=git@github.com:ceph/ceph-container.git, io.buildah.version=1.37.2, org.label-schema.schema-version=1.0, org.label-schema.vendor=CentOS, GIT_CLEAN=True, maintainer=Guillaume Abrioux , org.label-schema.name=CentOS Stream 9 Base Image, GIT_BRANCH=HEAD, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7) 2024-09-12T02:51:54.600 INFO:journalctl@ceph.mds.g.smithi039.stdout:Sep 12 02:51:54 smithi039 bash[91718]: ceph-4954ed46-70ae-11ef-bcea-c7b262605968-mds-g 2024-09-12T02:51:54.988 INFO:journalctl@ceph.mds.g.smithi039.stdout:Sep 12 02:51:54 smithi039 podman[91730]: 2024-09-12 02:51:54.698638883 +0000 UTC m=+0.749284488 container remove 13f74e89fc496bea7df398119551da5461ea3af6d9f0a2d55d421de84fbd9f14 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:3be30d720e37ec4df7f667e60f22b4d221c4ce7b408e68b90f9ac10220535e66, name=ceph-4954ed46-70ae-11ef-bcea-c7b262605968-mds-g, GIT_CLEAN=True, CEPH_POINT_RELEASE=, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.name=CentOS Stream 9 Base Image, GIT_BRANCH=HEAD, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.license=GPLv2, maintainer=Guillaume Abrioux , org.label-schema.build-date=20240731, RELEASE=squid-b53b6d3, ceph=True, org.label-schema.vendor=CentOS, io.buildah.version=1.37.2, org.label-schema.schema-version=1.0) 2024-09-12T02:51:55.021 DEBUG:teuthology.orchestra.run.smithi039:> sudo pkill -f 'journalctl -f -n 0 -u ceph-4954ed46-70ae-11ef-bcea-c7b262605968@mds.g.service' 2024-09-12T02:51:55.090 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-09-12T02:51:55.090 INFO:tasks.cephadm.mds.g:Stopped mds.g 2024-09-12T02:51:55.090 INFO:tasks.cephadm.mds.j:Stopping mds.j... 2024-09-12T02:51:55.091 DEBUG:teuthology.orchestra.run.smithi039:> sudo systemctl stop ceph-4954ed46-70ae-11ef-bcea-c7b262605968@mds.j 2024-09-12T02:51:55.349 INFO:journalctl@ceph.mds.j.smithi039.stdout:Sep 12 02:51:55 smithi039 systemd[1]: Stopping Ceph mds.j for 4954ed46-70ae-11ef-bcea-c7b262605968... 2024-09-12T02:51:55.849 INFO:journalctl@ceph.mds.j.smithi039.stdout:Sep 12 02:51:55 smithi039 ceph-4954ed46-70ae-11ef-bcea-c7b262605968-mds-j[69192]: 2024-09-12T02:51:55.487+0000 7f0fbfa00640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-mds -n mds.j -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-09-12T02:51:55.850 INFO:journalctl@ceph.mds.j.smithi039.stdout:Sep 12 02:51:55 smithi039 ceph-4954ed46-70ae-11ef-bcea-c7b262605968-mds-j[69192]: 2024-09-12T02:51:55.487+0000 7f0fbfa00640 -1 mds.j *** got signal Terminated *** 2024-09-12T02:51:56.802 INFO:journalctl@ceph.mds.j.smithi039.stdout:Sep 12 02:51:56 smithi039 podman[91838]: 2024-09-12 02:51:56.529499219 +0000 UTC m=+1.155901075 container died 80f513251c79309e69ebff41206476219bd1a40ee22e746486eac8e1e57f55e9 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:3be30d720e37ec4df7f667e60f22b4d221c4ce7b408e68b90f9ac10220535e66, name=ceph-4954ed46-70ae-11ef-bcea-c7b262605968-mds-j, GIT_CLEAN=True, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.license=GPLv2, org.label-schema.schema-version=1.0, org.label-schema.vendor=CentOS, CEPH_POINT_RELEASE=, GIT_BRANCH=HEAD, io.buildah.version=1.37.2, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, GIT_REPO=git@github.com:ceph/ceph-container.git, ceph=True, RELEASE=squid-b53b6d3, maintainer=Guillaume Abrioux , org.label-schema.build-date=20240731) 2024-09-12T02:51:57.065 INFO:journalctl@ceph.mds.j.smithi039.stdout:Sep 12 02:51:57 smithi039 podman[91838]: 2024-09-12 02:51:57.043091166 +0000 UTC m=+1.669493022 container cleanup 80f513251c79309e69ebff41206476219bd1a40ee22e746486eac8e1e57f55e9 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:3be30d720e37ec4df7f667e60f22b4d221c4ce7b408e68b90f9ac10220535e66, name=ceph-4954ed46-70ae-11ef-bcea-c7b262605968-mds-j, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.schema-version=1.0, GIT_BRANCH=HEAD, RELEASE=squid-b53b6d3, maintainer=Guillaume Abrioux , org.label-schema.license=GPLv2, org.label-schema.vendor=CentOS, io.buildah.version=1.37.2, CEPH_POINT_RELEASE=, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.build-date=20240731, ceph=True, GIT_CLEAN=True, org.label-schema.name=CentOS Stream 9 Base Image) 2024-09-12T02:51:57.065 INFO:journalctl@ceph.mds.j.smithi039.stdout:Sep 12 02:51:57 smithi039 bash[91838]: ceph-4954ed46-70ae-11ef-bcea-c7b262605968-mds-j 2024-09-12T02:51:57.539 INFO:journalctl@ceph.mds.j.smithi039.stdout:Sep 12 02:51:57 smithi039 podman[91851]: 2024-09-12 02:51:57.235813433 +0000 UTC m=+0.700323839 container remove 80f513251c79309e69ebff41206476219bd1a40ee22e746486eac8e1e57f55e9 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:3be30d720e37ec4df7f667e60f22b4d221c4ce7b408e68b90f9ac10220535e66, name=ceph-4954ed46-70ae-11ef-bcea-c7b262605968-mds-j, GIT_BRANCH=HEAD, GIT_REPO=git@github.com:ceph/ceph-container.git, RELEASE=squid-b53b6d3, ceph=True, org.label-schema.vendor=CentOS, org.label-schema.schema-version=1.0, io.buildah.version=1.37.2, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, maintainer=Guillaume Abrioux , org.label-schema.license=GPLv2, org.label-schema.name=CentOS Stream 9 Base Image, CEPH_POINT_RELEASE=, GIT_CLEAN=True, org.label-schema.build-date=20240731) 2024-09-12T02:51:57.559 DEBUG:teuthology.orchestra.run.smithi039:> sudo pkill -f 'journalctl -f -n 0 -u ceph-4954ed46-70ae-11ef-bcea-c7b262605968@mds.j.service' 2024-09-12T02:51:57.630 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-09-12T02:51:57.631 INFO:tasks.cephadm.mds.j:Stopped mds.j 2024-09-12T02:51:57.631 INFO:tasks.cephadm.mds.b:Stopping mds.b... 2024-09-12T02:51:57.631 DEBUG:teuthology.orchestra.run.smithi044:> sudo systemctl stop ceph-4954ed46-70ae-11ef-bcea-c7b262605968@mds.b 2024-09-12T02:51:57.948 INFO:journalctl@ceph.mds.b.smithi044.stdout:Sep 12 02:51:57 smithi044 systemd[1]: Stopping Ceph mds.b for 4954ed46-70ae-11ef-bcea-c7b262605968... 2024-09-12T02:51:58.352 INFO:journalctl@ceph.mds.b.smithi044.stdout:Sep 12 02:51:57 smithi044 ceph-4954ed46-70ae-11ef-bcea-c7b262605968-mds-b[65334]: 2024-09-12T02:51:57.952+0000 7f2056da6640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-mds -n mds.b -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-09-12T02:51:58.352 INFO:journalctl@ceph.mds.b.smithi044.stdout:Sep 12 02:51:57 smithi044 ceph-4954ed46-70ae-11ef-bcea-c7b262605968-mds-b[65334]: 2024-09-12T02:51:57.952+0000 7f2056da6640 -1 mds.b *** got signal Terminated *** 2024-09-12T02:52:02.303 INFO:journalctl@ceph.mds.b.smithi044.stdout:Sep 12 02:52:01 smithi044 podman[72822]: 2024-09-12 02:52:01.960377803 +0000 UTC m=+4.135663298 container died 77d1fe5b803d91e2bdf13ee4c4d19d323882ce09afdd5067c5939e34c96b942f (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:3be30d720e37ec4df7f667e60f22b4d221c4ce7b408e68b90f9ac10220535e66, name=ceph-4954ed46-70ae-11ef-bcea-c7b262605968-mds-b, maintainer=Guillaume Abrioux , GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.license=GPLv2, org.label-schema.name=CentOS Stream 9 Base Image, ceph=True, RELEASE=squid-b53b6d3, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, GIT_BRANCH=HEAD, org.label-schema.schema-version=1.0, org.label-schema.vendor=CentOS, CEPH_POINT_RELEASE=, GIT_CLEAN=True, io.buildah.version=1.37.2, org.label-schema.build-date=20240731) 2024-09-12T02:52:02.586 INFO:journalctl@ceph.mds.b.smithi044.stdout:Sep 12 02:52:02 smithi044 podman[72822]: 2024-09-12 02:52:02.377078377 +0000 UTC m=+4.552363862 container cleanup 77d1fe5b803d91e2bdf13ee4c4d19d323882ce09afdd5067c5939e34c96b942f (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:3be30d720e37ec4df7f667e60f22b4d221c4ce7b408e68b90f9ac10220535e66, name=ceph-4954ed46-70ae-11ef-bcea-c7b262605968-mds-b, org.label-schema.license=GPLv2, RELEASE=squid-b53b6d3, GIT_BRANCH=HEAD, org.label-schema.schema-version=1.0, org.label-schema.vendor=CentOS, CEPH_POINT_RELEASE=, GIT_CLEAN=True, org.label-schema.name=CentOS Stream 9 Base Image, ceph=True, org.label-schema.build-date=20240731, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, maintainer=Guillaume Abrioux , GIT_REPO=git@github.com:ceph/ceph-container.git, io.buildah.version=1.37.2) 2024-09-12T02:52:02.586 INFO:journalctl@ceph.mds.b.smithi044.stdout:Sep 12 02:52:02 smithi044 bash[72822]: ceph-4954ed46-70ae-11ef-bcea-c7b262605968-mds-b 2024-09-12T02:52:02.811 DEBUG:teuthology.orchestra.run.smithi044:> sudo pkill -f 'journalctl -f -n 0 -u ceph-4954ed46-70ae-11ef-bcea-c7b262605968@mds.b.service' 2024-09-12T02:52:02.846 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-09-12T02:52:02.846 INFO:tasks.cephadm.mds.b:Stopped mds.b 2024-09-12T02:52:02.846 INFO:tasks.cephadm.mds.e:Stopping mds.e... 2024-09-12T02:52:02.847 DEBUG:teuthology.orchestra.run.smithi044:> sudo systemctl stop ceph-4954ed46-70ae-11ef-bcea-c7b262605968@mds.e 2024-09-12T02:52:03.173 INFO:journalctl@ceph.mds.e.smithi044.stdout:Sep 12 02:52:02 smithi044 systemd[1]: Stopping Ceph mds.e for 4954ed46-70ae-11ef-bcea-c7b262605968... 2024-09-12T02:52:03.448 INFO:journalctl@ceph.mds.e.smithi044.stdout:Sep 12 02:52:03 smithi044 ceph-4954ed46-70ae-11ef-bcea-c7b262605968-mds-e[64730]: 2024-09-12T02:52:03.172+0000 7f96b9636640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-mds -n mds.e -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-09-12T02:52:03.449 INFO:journalctl@ceph.mds.e.smithi044.stdout:Sep 12 02:52:03 smithi044 ceph-4954ed46-70ae-11ef-bcea-c7b262605968-mds-e[64730]: 2024-09-12T02:52:03.172+0000 7f96b9636640 -1 mds.e *** got signal Terminated *** 2024-09-12T02:52:06.941 INFO:journalctl@ceph.mds.e.smithi044.stdout:Sep 12 02:52:06 smithi044 podman[72957]: 2024-09-12 02:52:06.566923587 +0000 UTC m=+3.493659044 container died 12f1740ebc2ca4f2b7675792f9d17ff64c031d6b814d216d1579ca0ab43b585f (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:3be30d720e37ec4df7f667e60f22b4d221c4ce7b408e68b90f9ac10220535e66, name=ceph-4954ed46-70ae-11ef-bcea-c7b262605968-mds-e, GIT_CLEAN=True, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, io.buildah.version=1.37.2, org.label-schema.vendor=CentOS, CEPH_POINT_RELEASE=, ceph=True, org.label-schema.build-date=20240731, org.label-schema.license=GPLv2, maintainer=Guillaume Abrioux , GIT_BRANCH=HEAD, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.name=CentOS Stream 9 Base Image, RELEASE=squid-b53b6d3, org.label-schema.schema-version=1.0) 2024-09-12T02:52:07.198 INFO:journalctl@ceph.mds.e.smithi044.stdout:Sep 12 02:52:07 smithi044 podman[72957]: 2024-09-12 02:52:07.039260386 +0000 UTC m=+3.965995842 container cleanup 12f1740ebc2ca4f2b7675792f9d17ff64c031d6b814d216d1579ca0ab43b585f (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:3be30d720e37ec4df7f667e60f22b4d221c4ce7b408e68b90f9ac10220535e66, name=ceph-4954ed46-70ae-11ef-bcea-c7b262605968-mds-e, GIT_BRANCH=HEAD, GIT_CLEAN=True, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.license=GPLv2, org.label-schema.name=CentOS Stream 9 Base Image, maintainer=Guillaume Abrioux , CEPH_POINT_RELEASE=, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, RELEASE=squid-b53b6d3, org.label-schema.schema-version=1.0, ceph=True, org.label-schema.build-date=20240731, org.label-schema.vendor=CentOS, io.buildah.version=1.37.2) 2024-09-12T02:52:07.198 INFO:journalctl@ceph.mds.e.smithi044.stdout:Sep 12 02:52:07 smithi044 bash[72957]: ceph-4954ed46-70ae-11ef-bcea-c7b262605968-mds-e 2024-09-12T02:52:07.428 DEBUG:teuthology.orchestra.run.smithi044:> sudo pkill -f 'journalctl -f -n 0 -u ceph-4954ed46-70ae-11ef-bcea-c7b262605968@mds.e.service' 2024-09-12T02:52:07.461 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-09-12T02:52:07.461 INFO:tasks.cephadm.mds.e:Stopped mds.e 2024-09-12T02:52:07.461 INFO:tasks.cephadm.mds.h:Stopping mds.h... 2024-09-12T02:52:07.461 DEBUG:teuthology.orchestra.run.smithi044:> sudo systemctl stop ceph-4954ed46-70ae-11ef-bcea-c7b262605968@mds.h 2024-09-12T02:52:07.698 INFO:journalctl@ceph.mds.h.smithi044.stdout:Sep 12 02:52:07 smithi044 systemd[1]: Stopping Ceph mds.h for 4954ed46-70ae-11ef-bcea-c7b262605968... 2024-09-12T02:52:08.198 INFO:journalctl@ceph.mds.h.smithi044.stdout:Sep 12 02:52:07 smithi044 ceph-4954ed46-70ae-11ef-bcea-c7b262605968-mds-h[65035]: 2024-09-12T02:52:07.784+0000 7f10319db640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-mds -n mds.h -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-09-12T02:52:08.199 INFO:journalctl@ceph.mds.h.smithi044.stdout:Sep 12 02:52:07 smithi044 ceph-4954ed46-70ae-11ef-bcea-c7b262605968-mds-h[65035]: 2024-09-12T02:52:07.784+0000 7f10319db640 -1 mds.h *** got signal Terminated *** 2024-09-12T02:52:10.828 INFO:journalctl@ceph.mds.h.smithi044.stdout:Sep 12 02:52:10 smithi044 podman[73078]: 2024-09-12 02:52:10.571542294 +0000 UTC m=+2.895681826 container died 6a8800c1dc396dfc2f246d28c7fc7ff09898e6512da784fe60ef012a22f8ef11 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:3be30d720e37ec4df7f667e60f22b4d221c4ce7b408e68b90f9ac10220535e66, name=ceph-4954ed46-70ae-11ef-bcea-c7b262605968-mds-h, GIT_REPO=git@github.com:ceph/ceph-container.git, RELEASE=squid-b53b6d3, org.label-schema.vendor=CentOS, io.buildah.version=1.37.2, CEPH_POINT_RELEASE=, maintainer=Guillaume Abrioux , GIT_BRANCH=HEAD, org.label-schema.license=GPLv2, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, GIT_CLEAN=True, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.schema-version=1.0, org.label-schema.build-date=20240731, ceph=True) 2024-09-12T02:52:11.198 INFO:journalctl@ceph.mds.h.smithi044.stdout:Sep 12 02:52:10 smithi044 podman[73078]: 2024-09-12 02:52:10.909705406 +0000 UTC m=+3.233844936 container cleanup 6a8800c1dc396dfc2f246d28c7fc7ff09898e6512da784fe60ef012a22f8ef11 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:3be30d720e37ec4df7f667e60f22b4d221c4ce7b408e68b90f9ac10220535e66, name=ceph-4954ed46-70ae-11ef-bcea-c7b262605968-mds-h, maintainer=Guillaume Abrioux , io.buildah.version=1.37.2, org.label-schema.build-date=20240731, RELEASE=squid-b53b6d3, org.label-schema.name=CentOS Stream 9 Base Image, GIT_BRANCH=HEAD, org.label-schema.license=GPLv2, GIT_CLEAN=True, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.vendor=CentOS, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, ceph=True, org.label-schema.schema-version=1.0, CEPH_POINT_RELEASE=) 2024-09-12T02:52:11.199 INFO:journalctl@ceph.mds.h.smithi044.stdout:Sep 12 02:52:10 smithi044 bash[73078]: ceph-4954ed46-70ae-11ef-bcea-c7b262605968-mds-h 2024-09-12T02:52:11.473 INFO:journalctl@ceph.mds.h.smithi044.stdout:Sep 12 02:52:11 smithi044 podman[73090]: 2024-09-12 02:52:11.219244809 +0000 UTC m=+0.650516785 container remove 6a8800c1dc396dfc2f246d28c7fc7ff09898e6512da784fe60ef012a22f8ef11 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:3be30d720e37ec4df7f667e60f22b4d221c4ce7b408e68b90f9ac10220535e66, name=ceph-4954ed46-70ae-11ef-bcea-c7b262605968-mds-h, org.label-schema.license=GPLv2, org.label-schema.vendor=CentOS, org.label-schema.schema-version=1.0, ceph=True, org.label-schema.build-date=20240731, org.label-schema.name=CentOS Stream 9 Base Image, CEPH_POINT_RELEASE=, GIT_CLEAN=True, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, GIT_BRANCH=HEAD, GIT_REPO=git@github.com:ceph/ceph-container.git, maintainer=Guillaume Abrioux , RELEASE=squid-b53b6d3, io.buildah.version=1.37.2) 2024-09-12T02:52:11.493 DEBUG:teuthology.orchestra.run.smithi044:> sudo pkill -f 'journalctl -f -n 0 -u ceph-4954ed46-70ae-11ef-bcea-c7b262605968@mds.h.service' 2024-09-12T02:52:11.525 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-09-12T02:52:11.525 INFO:tasks.cephadm.mds.h:Stopped mds.h 2024-09-12T02:52:11.525 INFO:tasks.cephadm.mds.k:Stopping mds.k... 2024-09-12T02:52:11.525 DEBUG:teuthology.orchestra.run.smithi044:> sudo systemctl stop ceph-4954ed46-70ae-11ef-bcea-c7b262605968@mds.k 2024-09-12T02:52:11.822 INFO:journalctl@ceph.mds.k.smithi044.stdout:Sep 12 02:52:11 smithi044 systemd[1]: Stopping Ceph mds.k for 4954ed46-70ae-11ef-bcea-c7b262605968... 2024-09-12T02:52:12.199 INFO:journalctl@ceph.mds.k.smithi044.stdout:Sep 12 02:52:11 smithi044 ceph-4954ed46-70ae-11ef-bcea-c7b262605968-mds-k[64414]: 2024-09-12T02:52:11.821+0000 7f2233d46640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-mds -n mds.k -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-09-12T02:52:12.199 INFO:journalctl@ceph.mds.k.smithi044.stdout:Sep 12 02:52:11 smithi044 ceph-4954ed46-70ae-11ef-bcea-c7b262605968-mds-k[64414]: 2024-09-12T02:52:11.821+0000 7f2233d46640 -1 mds.k *** got signal Terminated *** 2024-09-12T02:52:14.822 INFO:journalctl@ceph.mds.k.smithi044.stdout:Sep 12 02:52:14 smithi044 podman[73200]: 2024-09-12 02:52:14.568716768 +0000 UTC m=+2.825501823 container died d6812fe96b08a3e7c327c4452a62d760a2092dfb323fd0b2acd5f69fdc9dda24 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:3be30d720e37ec4df7f667e60f22b4d221c4ce7b408e68b90f9ac10220535e66, name=ceph-4954ed46-70ae-11ef-bcea-c7b262605968-mds-k, ceph=True, io.buildah.version=1.37.2, org.label-schema.name=CentOS Stream 9 Base Image, CEPH_POINT_RELEASE=, maintainer=Guillaume Abrioux , GIT_BRANCH=HEAD, RELEASE=squid-b53b6d3, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, GIT_CLEAN=True, org.label-schema.vendor=CentOS, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.build-date=20240731, org.label-schema.license=GPLv2, org.label-schema.schema-version=1.0) 2024-09-12T02:52:15.080 INFO:journalctl@ceph.mds.k.smithi044.stdout:Sep 12 02:52:14 smithi044 podman[73200]: 2024-09-12 02:52:14.921637202 +0000 UTC m=+3.178422248 container cleanup d6812fe96b08a3e7c327c4452a62d760a2092dfb323fd0b2acd5f69fdc9dda24 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:3be30d720e37ec4df7f667e60f22b4d221c4ce7b408e68b90f9ac10220535e66, name=ceph-4954ed46-70ae-11ef-bcea-c7b262605968-mds-k, org.label-schema.license=GPLv2, org.label-schema.schema-version=1.0, io.buildah.version=1.37.2, GIT_BRANCH=HEAD, ceph=True, GIT_CLEAN=True, org.label-schema.name=CentOS Stream 9 Base Image, maintainer=Guillaume Abrioux , org.label-schema.vendor=CentOS, org.label-schema.build-date=20240731, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, CEPH_POINT_RELEASE=, GIT_REPO=git@github.com:ceph/ceph-container.git, RELEASE=squid-b53b6d3) 2024-09-12T02:52:15.081 INFO:journalctl@ceph.mds.k.smithi044.stdout:Sep 12 02:52:14 smithi044 bash[73200]: ceph-4954ed46-70ae-11ef-bcea-c7b262605968-mds-k 2024-09-12T02:52:15.296 DEBUG:teuthology.orchestra.run.smithi044:> sudo pkill -f 'journalctl -f -n 0 -u ceph-4954ed46-70ae-11ef-bcea-c7b262605968@mds.k.service' 2024-09-12T02:52:15.327 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-09-12T02:52:15.328 INFO:tasks.cephadm.mds.k:Stopped mds.k 2024-09-12T02:52:15.328 INFO:tasks.cephadm.mds.c:Stopping mds.c... 2024-09-12T02:52:15.328 DEBUG:teuthology.orchestra.run.smithi172:> sudo systemctl stop ceph-4954ed46-70ae-11ef-bcea-c7b262605968@mds.c 2024-09-12T02:52:15.675 INFO:journalctl@ceph.mds.c.smithi172.stdout:Sep 12 02:52:15 smithi172 systemd[1]: Stopping Ceph mds.c for 4954ed46-70ae-11ef-bcea-c7b262605968... 2024-09-12T02:52:15.931 INFO:journalctl@ceph.mds.c.smithi172.stdout:Sep 12 02:52:15 smithi172 ceph-4954ed46-70ae-11ef-bcea-c7b262605968-mds-c[66220]: 2024-09-12T02:52:15.673+0000 7f5652735640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-mds -n mds.c -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-09-12T02:52:15.931 INFO:journalctl@ceph.mds.c.smithi172.stdout:Sep 12 02:52:15 smithi172 ceph-4954ed46-70ae-11ef-bcea-c7b262605968-mds-c[66220]: 2024-09-12T02:52:15.673+0000 7f5652735640 -1 mds.c *** got signal Terminated *** 2024-09-12T02:52:18.891 INFO:journalctl@ceph.mds.c.smithi172.stdout:Sep 12 02:52:18 smithi172 podman[73426]: 2024-09-12 02:52:18.571262614 +0000 UTC m=+3.049047978 container died ff35a3c0915dbbcb3e6d43664cc1a0cba42f46a9c4b717a7267132ce259629c1 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:3be30d720e37ec4df7f667e60f22b4d221c4ce7b408e68b90f9ac10220535e66, name=ceph-4954ed46-70ae-11ef-bcea-c7b262605968-mds-c, org.label-schema.license=GPLv2, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_CLEAN=True, io.buildah.version=1.37.2, GIT_BRANCH=HEAD, maintainer=Guillaume Abrioux , org.label-schema.name=CentOS Stream 9 Base Image, CEPH_POINT_RELEASE=, RELEASE=squid-b53b6d3, ceph=True, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.build-date=20240731, org.label-schema.vendor=CentOS, org.label-schema.schema-version=1.0) 2024-09-12T02:52:19.216 INFO:journalctl@ceph.mds.c.smithi172.stdout:Sep 12 02:52:18 smithi172 podman[73426]: 2024-09-12 02:52:18.982024269 +0000 UTC m=+3.459809705 container cleanup ff35a3c0915dbbcb3e6d43664cc1a0cba42f46a9c4b717a7267132ce259629c1 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:3be30d720e37ec4df7f667e60f22b4d221c4ce7b408e68b90f9ac10220535e66, name=ceph-4954ed46-70ae-11ef-bcea-c7b262605968-mds-c, GIT_REPO=git@github.com:ceph/ceph-container.git, io.buildah.version=1.37.2, ceph=True, org.label-schema.vendor=CentOS, GIT_BRANCH=HEAD, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.license=GPLv2, org.label-schema.build-date=20240731, RELEASE=squid-b53b6d3, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.schema-version=1.0, GIT_CLEAN=True, maintainer=Guillaume Abrioux , CEPH_POINT_RELEASE=) 2024-09-12T02:52:19.216 INFO:journalctl@ceph.mds.c.smithi172.stdout:Sep 12 02:52:18 smithi172 bash[73426]: ceph-4954ed46-70ae-11ef-bcea-c7b262605968-mds-c 2024-09-12T02:52:19.355 DEBUG:teuthology.orchestra.run.smithi172:> sudo pkill -f 'journalctl -f -n 0 -u ceph-4954ed46-70ae-11ef-bcea-c7b262605968@mds.c.service' 2024-09-12T02:52:19.391 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-09-12T02:52:19.392 INFO:tasks.cephadm.mds.c:Stopped mds.c 2024-09-12T02:52:19.392 INFO:tasks.cephadm.mds.f:Stopping mds.f... 2024-09-12T02:52:19.392 DEBUG:teuthology.orchestra.run.smithi172:> sudo systemctl stop ceph-4954ed46-70ae-11ef-bcea-c7b262605968@mds.f 2024-09-12T02:52:19.764 INFO:journalctl@ceph.mds.f.smithi172.stdout:Sep 12 02:52:19 smithi172 systemd[1]: Stopping Ceph mds.f for 4954ed46-70ae-11ef-bcea-c7b262605968... 2024-09-12T02:52:19.764 INFO:journalctl@ceph.mds.f.smithi172.stdout:Sep 12 02:52:19 smithi172 ceph-4954ed46-70ae-11ef-bcea-c7b262605968-mds-f[65921]: 2024-09-12T02:52:19.702+0000 7f818938f640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-mds -n mds.f -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-09-12T02:52:19.764 INFO:journalctl@ceph.mds.f.smithi172.stdout:Sep 12 02:52:19 smithi172 ceph-4954ed46-70ae-11ef-bcea-c7b262605968-mds-f[65921]: 2024-09-12T02:52:19.702+0000 7f818938f640 -1 mds.f *** got signal Terminated *** 2024-09-12T02:52:22.844 INFO:journalctl@ceph.mds.f.smithi172.stdout:Sep 12 02:52:22 smithi172 podman[73560]: 2024-09-12 02:52:22.567988714 +0000 UTC m=+2.960178888 container died 054236d1dd920da392122c3235d9c817469fc161ad25a013954e28a900f7dd6f (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:3be30d720e37ec4df7f667e60f22b4d221c4ce7b408e68b90f9ac10220535e66, name=ceph-4954ed46-70ae-11ef-bcea-c7b262605968-mds-f, GIT_BRANCH=HEAD, org.label-schema.vendor=CentOS, org.label-schema.name=CentOS Stream 9 Base Image, ceph=True, GIT_REPO=git@github.com:ceph/ceph-container.git, maintainer=Guillaume Abrioux , org.label-schema.license=GPLv2, io.buildah.version=1.37.2, CEPH_POINT_RELEASE=, GIT_CLEAN=True, RELEASE=squid-b53b6d3, org.label-schema.schema-version=1.0, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.build-date=20240731) 2024-09-12T02:52:23.203 INFO:journalctl@ceph.mds.f.smithi172.stdout:Sep 12 02:52:22 smithi172 podman[73560]: 2024-09-12 02:52:22.926812404 +0000 UTC m=+3.319002566 container cleanup 054236d1dd920da392122c3235d9c817469fc161ad25a013954e28a900f7dd6f (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:3be30d720e37ec4df7f667e60f22b4d221c4ce7b408e68b90f9ac10220535e66, name=ceph-4954ed46-70ae-11ef-bcea-c7b262605968-mds-f, org.label-schema.build-date=20240731, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, ceph=True, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.license=GPLv2, org.label-schema.schema-version=1.0, GIT_BRANCH=HEAD, GIT_CLEAN=True, GIT_REPO=git@github.com:ceph/ceph-container.git, io.buildah.version=1.37.2, maintainer=Guillaume Abrioux , org.label-schema.vendor=CentOS, CEPH_POINT_RELEASE=, RELEASE=squid-b53b6d3) 2024-09-12T02:52:23.203 INFO:journalctl@ceph.mds.f.smithi172.stdout:Sep 12 02:52:22 smithi172 bash[73560]: ceph-4954ed46-70ae-11ef-bcea-c7b262605968-mds-f 2024-09-12T02:52:23.337 DEBUG:teuthology.orchestra.run.smithi172:> sudo pkill -f 'journalctl -f -n 0 -u ceph-4954ed46-70ae-11ef-bcea-c7b262605968@mds.f.service' 2024-09-12T02:52:23.370 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-09-12T02:52:23.370 INFO:tasks.cephadm.mds.f:Stopped mds.f 2024-09-12T02:52:23.370 INFO:tasks.cephadm.mds.i:Stopping mds.i... 2024-09-12T02:52:23.370 DEBUG:teuthology.orchestra.run.smithi172:> sudo systemctl stop ceph-4954ed46-70ae-11ef-bcea-c7b262605968@mds.i 2024-09-12T02:52:23.513 INFO:journalctl@ceph.mds.i.smithi172.stdout:Sep 12 02:52:23 smithi172 systemd[1]: Stopping Ceph mds.i for 4954ed46-70ae-11ef-bcea-c7b262605968... 2024-09-12T02:52:24.013 INFO:journalctl@ceph.mds.i.smithi172.stdout:Sep 12 02:52:23 smithi172 ceph-4954ed46-70ae-11ef-bcea-c7b262605968-mds-i[66523]: 2024-09-12T02:52:23.695+0000 7f7829e47640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-mds -n mds.i -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-09-12T02:52:24.014 INFO:journalctl@ceph.mds.i.smithi172.stdout:Sep 12 02:52:23 smithi172 ceph-4954ed46-70ae-11ef-bcea-c7b262605968-mds-i[66523]: 2024-09-12T02:52:23.695+0000 7f7829e47640 -1 mds.i *** got signal Terminated *** 2024-09-12T02:52:26.763 INFO:journalctl@ceph.mds.i.smithi172.stdout:Sep 12 02:52:26 smithi172 podman[73683]: 2024-09-12 02:52:26.583817736 +0000 UTC m=+2.993191567 container died 54587d5ab57b91b41bf8171ec3e7cb6f0689d1dcdf1cad753e71853b3bf3dc23 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:3be30d720e37ec4df7f667e60f22b4d221c4ce7b408e68b90f9ac10220535e66, name=ceph-4954ed46-70ae-11ef-bcea-c7b262605968-mds-i, org.label-schema.license=GPLv2, GIT_BRANCH=HEAD, RELEASE=squid-b53b6d3, GIT_CLEAN=True, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.schema-version=1.0, org.label-schema.build-date=20240731, maintainer=Guillaume Abrioux , GIT_REPO=git@github.com:ceph/ceph-container.git, ceph=True, io.buildah.version=1.37.2, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.vendor=CentOS, CEPH_POINT_RELEASE=) 2024-09-12T02:52:27.190 INFO:journalctl@ceph.mds.i.smithi172.stdout:Sep 12 02:52:26 smithi172 podman[73683]: 2024-09-12 02:52:26.947165448 +0000 UTC m=+3.356539277 container cleanup 54587d5ab57b91b41bf8171ec3e7cb6f0689d1dcdf1cad753e71853b3bf3dc23 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:3be30d720e37ec4df7f667e60f22b4d221c4ce7b408e68b90f9ac10220535e66, name=ceph-4954ed46-70ae-11ef-bcea-c7b262605968-mds-i, maintainer=Guillaume Abrioux , GIT_CLEAN=True, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.build-date=20240731, CEPH_POINT_RELEASE=, io.buildah.version=1.37.2, RELEASE=squid-b53b6d3, org.label-schema.schema-version=1.0, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_BRANCH=HEAD, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.vendor=CentOS, org.label-schema.license=GPLv2, ceph=True) 2024-09-12T02:52:27.190 INFO:journalctl@ceph.mds.i.smithi172.stdout:Sep 12 02:52:26 smithi172 bash[73683]: ceph-4954ed46-70ae-11ef-bcea-c7b262605968-mds-i 2024-09-12T02:52:27.321 DEBUG:teuthology.orchestra.run.smithi172:> sudo pkill -f 'journalctl -f -n 0 -u ceph-4954ed46-70ae-11ef-bcea-c7b262605968@mds.i.service' 2024-09-12T02:52:27.353 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-09-12T02:52:27.353 INFO:tasks.cephadm.mds.i:Stopped mds.i 2024-09-12T02:52:27.354 INFO:tasks.cephadm.mds.l:Stopping mds.l... 2024-09-12T02:52:27.354 DEBUG:teuthology.orchestra.run.smithi172:> sudo systemctl stop ceph-4954ed46-70ae-11ef-bcea-c7b262605968@mds.l 2024-09-12T02:52:27.513 INFO:journalctl@ceph.mds.l.smithi172.stdout:Sep 12 02:52:27 smithi172 systemd[1]: Stopping Ceph mds.l for 4954ed46-70ae-11ef-bcea-c7b262605968... 2024-09-12T02:52:28.013 INFO:journalctl@ceph.mds.l.smithi172.stdout:Sep 12 02:52:27 smithi172 ceph-4954ed46-70ae-11ef-bcea-c7b262605968-mds-l[65622]: 2024-09-12T02:52:27.666+0000 7f105ff33640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-mds -n mds.l -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-09-12T02:52:28.014 INFO:journalctl@ceph.mds.l.smithi172.stdout:Sep 12 02:52:27 smithi172 ceph-4954ed46-70ae-11ef-bcea-c7b262605968-mds-l[65622]: 2024-09-12T02:52:27.666+0000 7f105ff33640 -1 mds.l *** got signal Terminated *** 2024-09-12T02:52:30.842 INFO:journalctl@ceph.mds.l.smithi172.stdout:Sep 12 02:52:30 smithi172 podman[73803]: 2024-09-12 02:52:30.577566206 +0000 UTC m=+3.005269823 container died 0d261ee5edd65a9add2f207901d0126d4109c62517aeffcc6779f7edc4585b57 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:3be30d720e37ec4df7f667e60f22b4d221c4ce7b408e68b90f9ac10220535e66, name=ceph-4954ed46-70ae-11ef-bcea-c7b262605968-mds-l, ceph=True, org.label-schema.vendor=CentOS, RELEASE=squid-b53b6d3, CEPH_POINT_RELEASE=, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_BRANCH=HEAD, org.label-schema.schema-version=1.0, org.label-schema.name=CentOS Stream 9 Base Image, io.buildah.version=1.37.2, maintainer=Guillaume Abrioux , org.label-schema.build-date=20240731, GIT_CLEAN=True, org.label-schema.license=GPLv2) 2024-09-12T02:52:31.201 INFO:journalctl@ceph.mds.l.smithi172.stdout:Sep 12 02:52:30 smithi172 podman[73803]: 2024-09-12 02:52:30.933596564 +0000 UTC m=+3.361300178 container cleanup 0d261ee5edd65a9add2f207901d0126d4109c62517aeffcc6779f7edc4585b57 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:3be30d720e37ec4df7f667e60f22b4d221c4ce7b408e68b90f9ac10220535e66, name=ceph-4954ed46-70ae-11ef-bcea-c7b262605968-mds-l, GIT_CLEAN=True, org.label-schema.vendor=CentOS, CEPH_POINT_RELEASE=, GIT_REPO=git@github.com:ceph/ceph-container.git, RELEASE=squid-b53b6d3, GIT_BRANCH=HEAD, maintainer=Guillaume Abrioux , org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.build-date=20240731, ceph=True, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.schema-version=1.0, io.buildah.version=1.37.2, org.label-schema.license=GPLv2) 2024-09-12T02:52:31.201 INFO:journalctl@ceph.mds.l.smithi172.stdout:Sep 12 02:52:30 smithi172 bash[73803]: ceph-4954ed46-70ae-11ef-bcea-c7b262605968-mds-l 2024-09-12T02:52:31.353 DEBUG:teuthology.orchestra.run.smithi172:> sudo pkill -f 'journalctl -f -n 0 -u ceph-4954ed46-70ae-11ef-bcea-c7b262605968@mds.l.service' 2024-09-12T02:52:31.384 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-09-12T02:52:31.385 INFO:tasks.cephadm.mds.l:Stopped mds.l 2024-09-12T02:52:31.385 DEBUG:teuthology.orchestra.run.smithi039:> sudo /home/ubuntu/cephtest/cephadm rm-cluster --fsid 4954ed46-70ae-11ef-bcea-c7b262605968 --force --keep-logs 2024-09-12T02:52:31.668 INFO:teuthology.orchestra.run.smithi039.stdout:Deleting cluster with fsid: 4954ed46-70ae-11ef-bcea-c7b262605968 2024-09-12T02:52:35.691 DEBUG:teuthology.orchestra.run.smithi044:> sudo /home/ubuntu/cephtest/cephadm rm-cluster --fsid 4954ed46-70ae-11ef-bcea-c7b262605968 --force --keep-logs 2024-09-12T02:52:35.900 INFO:teuthology.orchestra.run.smithi044.stdout:Deleting cluster with fsid: 4954ed46-70ae-11ef-bcea-c7b262605968 2024-09-12T02:52:38.255 DEBUG:teuthology.orchestra.run.smithi172:> sudo /home/ubuntu/cephtest/cephadm rm-cluster --fsid 4954ed46-70ae-11ef-bcea-c7b262605968 --force --keep-logs 2024-09-12T02:52:38.458 INFO:teuthology.orchestra.run.smithi172.stdout:Deleting cluster with fsid: 4954ed46-70ae-11ef-bcea-c7b262605968 2024-09-12T02:52:40.928 DEBUG:teuthology.orchestra.run.smithi039:> sudo rm -f /etc/ceph/ceph.conf /etc/ceph/ceph.client.admin.keyring 2024-09-12T02:52:40.993 DEBUG:teuthology.orchestra.run.smithi044:> sudo rm -f /etc/ceph/ceph.conf /etc/ceph/ceph.client.admin.keyring 2024-09-12T02:52:41.025 DEBUG:teuthology.orchestra.run.smithi172:> sudo rm -f /etc/ceph/ceph.conf /etc/ceph/ceph.client.admin.keyring 2024-09-12T02:52:41.052 INFO:tasks.cephadm:Archiving crash dumps... 2024-09-12T02:52:41.054 DEBUG:teuthology.misc:Transferring archived files from smithi039:/var/lib/ceph/4954ed46-70ae-11ef-bcea-c7b262605968/crash to /home/teuthworker/archive/teuthology-2024-09-11_21:24:17-fs-squid-distro-default-smithi/7901615/remote/smithi039/crash 2024-09-12T02:52:41.055 DEBUG:teuthology.orchestra.run.smithi039:> sudo tar c -f - -C /var/lib/ceph/4954ed46-70ae-11ef-bcea-c7b262605968/crash -- . 2024-09-12T02:52:41.121 INFO:teuthology.orchestra.run.smithi039.stderr:tar: /var/lib/ceph/4954ed46-70ae-11ef-bcea-c7b262605968/crash: Cannot open: No such file or directory 2024-09-12T02:52:41.122 INFO:teuthology.orchestra.run.smithi039.stderr:tar: Error is not recoverable: exiting now 2024-09-12T02:52:41.125 DEBUG:teuthology.misc:Transferring archived files from smithi044:/var/lib/ceph/4954ed46-70ae-11ef-bcea-c7b262605968/crash to /home/teuthworker/archive/teuthology-2024-09-11_21:24:17-fs-squid-distro-default-smithi/7901615/remote/smithi044/crash 2024-09-12T02:52:41.125 DEBUG:teuthology.orchestra.run.smithi044:> sudo tar c -f - -C /var/lib/ceph/4954ed46-70ae-11ef-bcea-c7b262605968/crash -- . 2024-09-12T02:52:41.163 INFO:teuthology.orchestra.run.smithi044.stderr:tar: /var/lib/ceph/4954ed46-70ae-11ef-bcea-c7b262605968/crash: Cannot open: No such file or directory 2024-09-12T02:52:41.163 INFO:teuthology.orchestra.run.smithi044.stderr:tar: Error is not recoverable: exiting now 2024-09-12T02:52:41.165 DEBUG:teuthology.misc:Transferring archived files from smithi172:/var/lib/ceph/4954ed46-70ae-11ef-bcea-c7b262605968/crash to /home/teuthworker/archive/teuthology-2024-09-11_21:24:17-fs-squid-distro-default-smithi/7901615/remote/smithi172/crash 2024-09-12T02:52:41.166 DEBUG:teuthology.orchestra.run.smithi172:> sudo tar c -f - -C /var/lib/ceph/4954ed46-70ae-11ef-bcea-c7b262605968/crash -- . 2024-09-12T02:52:41.200 INFO:teuthology.orchestra.run.smithi172.stderr:tar: /var/lib/ceph/4954ed46-70ae-11ef-bcea-c7b262605968/crash: Cannot open: No such file or directory 2024-09-12T02:52:41.200 INFO:teuthology.orchestra.run.smithi172.stderr:tar: Error is not recoverable: exiting now 2024-09-12T02:52:41.201 INFO:tasks.cephadm:Checking cluster log for badness... 2024-09-12T02:52:41.201 DEBUG:teuthology.orchestra.run.smithi039:> sudo egrep '\[ERR\]|\[WRN\]|\[SEC\]' /var/log/ceph/4954ed46-70ae-11ef-bcea-c7b262605968/ceph.log | egrep -v '\(MDS_ALL_DOWN\)' | egrep -v '\(MDS_UP_LESS_THAN_MAX\)' | egrep -v FS_DEGRADED | egrep -v FS_INLINE_DATA_DEPRECATED | egrep -v FS_WITH_FAILED_MDS | egrep -v MDS_ALL_DOWN | egrep -v MDS_DAMAGE | egrep -v MDS_DEGRADED | egrep -v MDS_FAILED | egrep -v MDS_INSUFFICIENT_STANDBY | egrep -v MDS_UP_LESS_THAN_MAX | egrep -v 'online, but wants' | egrep -v 'filesystem is online with fewer MDS than max_mds' | egrep -v POOL_APP_NOT_ENABLED | egrep -v 'do not have an application enabled' | egrep -v 'overall HEALTH_' | egrep -v 'Replacing daemon' | egrep -v 'deprecated feature inline_data' | egrep -v 'overall HEALTH_' | egrep -v '\(OSD_DOWN\)' | egrep -v '\(OSD_' | egrep -v 'but it is still running' | egrep -v 'is not responding' | egrep -v MON_DOWN | egrep -v PG_AVAILABILITY | egrep -v PG_DEGRADED | egrep -v 'Reduced data availability' | egrep -v 'Degraded data redundancy' | head -n 1 2024-09-12T02:52:41.281 INFO:tasks.cephadm:Compressing logs... 2024-09-12T02:52:41.282 DEBUG:teuthology.orchestra.run.smithi039:> time sudo find /var/log/ceph /var/log/rbd-target-api -name '*.log' -print0 | sudo xargs --max-args=1 --max-procs=0 --verbose -0 --no-run-if-empty -- gzip -5 --verbose -- 2024-09-12T02:52:41.286 DEBUG:teuthology.orchestra.run.smithi044:> time sudo find /var/log/ceph /var/log/rbd-target-api -name '*.log' -print0 | sudo xargs --max-args=1 --max-procs=0 --verbose -0 --no-run-if-empty -- gzip -5 --verbose -- 2024-09-12T02:52:41.288 DEBUG:teuthology.orchestra.run.smithi172:> time sudo find /var/log/ceph /var/log/rbd-target-api -name '*.log' -print0 | sudo xargs --max-args=1 --max-procs=0 --verbose -0 --no-run-if-empty -- gzip -5 --verbose -- 2024-09-12T02:52:41.312 INFO:teuthology.orchestra.run.smithi172.stderr:find: ‘/var/log/rbd-target-api’gzip -5 --verbose -- /var/log/ceph/4954ed46-70ae-11ef-bcea-c7b262605968/ceph-volume.log 2024-09-12T02:52:41.312 INFO:teuthology.orchestra.run.smithi172.stderr:: No such file or directory 2024-09-12T02:52:41.313 INFO:teuthology.orchestra.run.smithi172.stderr:gzip -5 --verbose -- /var/log/ceph/4954ed46-70ae-11ef-bcea-c7b262605968/ceph.audit.log 2024-09-12T02:52:41.313 INFO:teuthology.orchestra.run.smithi172.stderr:gzip -5 --verbose -- /var/log/ceph/4954ed46-70ae-11ef-bcea-c7b262605968/ceph-mds.i.log 2024-09-12T02:52:41.314 INFO:teuthology.orchestra.run.smithi172.stderr:/var/log/ceph/4954ed46-70ae-11ef-bcea-c7b262605968/ceph-volume.log: /var/log/ceph/4954ed46-70ae-11ef-bcea-c7b262605968/ceph.audit.log: gzip -5 --verbose -- /var/log/ceph/4954ed46-70ae-11ef-bcea-c7b262605968/ceph-mon.c.log 2024-09-12T02:52:41.314 INFO:teuthology.orchestra.run.smithi172.stderr:/var/log/ceph/4954ed46-70ae-11ef-bcea-c7b262605968/ceph-mds.i.log: gzip -5 --verbose -- /var/log/ceph/4954ed46-70ae-11ef-bcea-c7b262605968/ceph.cephadm.log 2024-09-12T02:52:41.316 INFO:teuthology.orchestra.run.smithi172.stderr:gzip -5 --verbose -- /var/log/ceph/4954ed46-70ae-11ef-bcea-c7b262605968/ceph-osd.11.log 2024-09-12T02:52:41.316 INFO:teuthology.orchestra.run.smithi172.stderr:/var/log/ceph/4954ed46-70ae-11ef-bcea-c7b262605968/ceph-mon.c.log: /var/log/ceph/4954ed46-70ae-11ef-bcea-c7b262605968/ceph.cephadm.log: gzip -5 --verbose -- /var/log/ceph/4954ed46-70ae-11ef-bcea-c7b262605968/ceph-osd.2.log 2024-09-12T02:52:41.316 INFO:teuthology.orchestra.run.smithi172.stderr: 82.0% -- replaced with /var/log/ceph/4954ed46-70ae-11ef-bcea-c7b262605968/ceph.cephadm.log.gz 2024-09-12T02:52:41.316 INFO:teuthology.orchestra.run.smithi172.stderr:/var/log/ceph/4954ed46-70ae-11ef-bcea-c7b262605968/ceph-osd.11.log: gzip -5 --verbose -- /var/log/ceph/4954ed46-70ae-11ef-bcea-c7b262605968/ceph-osd.5.log 2024-09-12T02:52:41.316 INFO:teuthology.orchestra.run.smithi172.stderr:gzip -5/var/log/ceph/4954ed46-70ae-11ef-bcea-c7b262605968/ceph-osd.2.log: --verbose -- /var/log/ceph/4954ed46-70ae-11ef-bcea-c7b262605968/ceph.log 2024-09-12T02:52:41.316 INFO:teuthology.orchestra.run.smithi172.stderr:/var/log/ceph/4954ed46-70ae-11ef-bcea-c7b262605968/ceph-osd.5.log: gzip -5 --verbose -- /var/log/ceph/4954ed46-70ae-11ef-bcea-c7b262605968/ceph-mds.l.log 2024-09-12T02:52:41.316 INFO:teuthology.orchestra.run.smithi172.stderr:/var/log/ceph/4954ed46-70ae-11ef-bcea-c7b262605968/ceph.log: 90.4% -- replaced with /var/log/ceph/4954ed46-70ae-11ef-bcea-c7b262605968/ceph.audit.log.gz 2024-09-12T02:52:41.318 INFO:teuthology.orchestra.run.smithi044.stderr:find: ‘/var/log/rbd-target-api’: No such file or directory 2024-09-12T02:52:41.318 INFO:teuthology.orchestra.run.smithi044.stderr:gzip -5 --verbose -- /var/log/ceph/4954ed46-70ae-11ef-bcea-c7b262605968/ceph-osd.10.log 2024-09-12T02:52:41.318 INFO:teuthology.orchestra.run.smithi044.stderr:gzip -5 --verbose -- /var/log/ceph/4954ed46-70ae-11ef-bcea-c7b262605968/ceph-osd.1.log 2024-09-12T02:52:41.318 INFO:teuthology.orchestra.run.smithi044.stderr:/var/log/ceph/4954ed46-70ae-11ef-bcea-c7b262605968/ceph-osd.10.log: gzip -5 --verbose -- /var/log/ceph/4954ed46-70ae-11ef-bcea-c7b262605968/ceph-osd.7.log 2024-09-12T02:52:41.318 INFO:teuthology.orchestra.run.smithi044.stderr:/var/log/ceph/4954ed46-70ae-11ef-bcea-c7b262605968/ceph-osd.1.log: gzip -5 --verbose -- /var/log/ceph/4954ed46-70ae-11ef-bcea-c7b262605968/ceph-volume.log 2024-09-12T02:52:41.318 INFO:teuthology.orchestra.run.smithi044.stderr:/var/log/ceph/4954ed46-70ae-11ef-bcea-c7b262605968/ceph-osd.7.log: gzip -5 --verbose -- /var/log/ceph/4954ed46-70ae-11ef-bcea-c7b262605968/ceph-mds.b.log 2024-09-12T02:52:41.321 INFO:teuthology.orchestra.run.smithi172.stderr: 87.4% -- replaced with /var/log/ceph/4954ed46-70ae-11ef-bcea-c7b262605968/ceph.log.gz 2024-09-12T02:52:41.322 INFO:teuthology.orchestra.run.smithi172.stderr:gzip -5 --verbose -- /var/log/ceph/4954ed46-70ae-11ef-bcea-c7b262605968/ceph-osd.8.log 2024-09-12T02:52:41.322 INFO:teuthology.orchestra.run.smithi172.stderr:/var/log/ceph/4954ed46-70ae-11ef-bcea-c7b262605968/ceph-mds.l.log: gzip -5 --verbose -- /var/log/ceph/4954ed46-70ae-11ef-bcea-c7b262605968/ceph-mgr.z.log 2024-09-12T02:52:41.322 INFO:teuthology.orchestra.run.smithi044.stderr:/var/log/ceph/4954ed46-70ae-11ef-bcea-c7b262605968/ceph-volume.log: gzip -5 --verbose -- /var/log/ceph/4954ed46-70ae-11ef-bcea-c7b262605968/ceph-mds.k.log 2024-09-12T02:52:41.322 INFO:teuthology.orchestra.run.smithi044.stderr:/var/log/ceph/4954ed46-70ae-11ef-bcea-c7b262605968/ceph-mds.b.log: gzip -5 --verbose -- /var/log/ceph/4954ed46-70ae-11ef-bcea-c7b262605968/ceph-osd.4.log 2024-09-12T02:52:41.322 INFO:teuthology.orchestra.run.smithi044.stderr:/var/log/ceph/4954ed46-70ae-11ef-bcea-c7b262605968/ceph-mds.k.log: gzip -5 --verbose -- /var/log/ceph/4954ed46-70ae-11ef-bcea-c7b262605968/ceph.audit.log 2024-09-12T02:52:41.322 INFO:teuthology.orchestra.run.smithi044.stderr:/var/log/ceph/4954ed46-70ae-11ef-bcea-c7b262605968/ceph-osd.4.log: gzip -5 --verbose -- /var/log/ceph/4954ed46-70ae-11ef-bcea-c7b262605968/ceph.cephadm.log 2024-09-12T02:52:41.322 INFO:teuthology.orchestra.run.smithi044.stderr:/var/log/ceph/4954ed46-70ae-11ef-bcea-c7b262605968/ceph.audit.log: 90.3% -- replaced with /var/log/ceph/4954ed46-70ae-11ef-bcea-c7b262605968/ceph.audit.log.gz 2024-09-12T02:52:41.323 INFO:teuthology.orchestra.run.smithi044.stderr:gzip -5 --verbose -- /var/log/ceph/4954ed46-70ae-11ef-bcea-c7b262605968/ceph-mgr.y.log 2024-09-12T02:52:41.323 INFO:teuthology.orchestra.run.smithi044.stderr:/var/log/ceph/4954ed46-70ae-11ef-bcea-c7b262605968/ceph.cephadm.log: 82.0% -- replaced with /var/log/ceph/4954ed46-70ae-11ef-bcea-c7b262605968/ceph.cephadm.log.gz 2024-09-12T02:52:41.324 INFO:teuthology.orchestra.run.smithi044.stderr:gzip -5 --verbose -- /var/log/ceph/4954ed46-70ae-11ef-bcea-c7b262605968/ceph.log 2024-09-12T02:52:41.327 INFO:teuthology.orchestra.run.smithi172.stderr:/var/log/ceph/4954ed46-70ae-11ef-bcea-c7b262605968/ceph-osd.8.log: 90.8% -- replaced with /var/log/ceph/4954ed46-70ae-11ef-bcea-c7b262605968/ceph-volume.log.gz 2024-09-12T02:52:41.327 INFO:teuthology.orchestra.run.smithi172.stderr:gzip -5 --verbose -- /var/log/ceph/4954ed46-70ae-11ef-bcea-c7b262605968/ceph-mds.c.log 2024-09-12T02:52:41.331 INFO:teuthology.orchestra.run.smithi044.stderr:/var/log/ceph/4954ed46-70ae-11ef-bcea-c7b262605968/ceph-mgr.y.log: 90.9% -- replaced with /var/log/ceph/4954ed46-70ae-11ef-bcea-c7b262605968/ceph-volume.log.gz 2024-09-12T02:52:41.335 INFO:teuthology.orchestra.run.smithi044.stderr: 91.9% -- replaced with /var/log/ceph/4954ed46-70ae-11ef-bcea-c7b262605968/ceph-mgr.y.log.gz 2024-09-12T02:52:41.335 INFO:teuthology.orchestra.run.smithi044.stderr:gzip -5 --verbose -- /var/log/ceph/4954ed46-70ae-11ef-bcea-c7b262605968/ceph-mds.h.log 2024-09-12T02:52:41.335 INFO:teuthology.orchestra.run.smithi044.stderr:gzip -5 --verbose -- /var/log/ceph/4954ed46-70ae-11ef-bcea-c7b262605968/ceph-mon.b.log 2024-09-12T02:52:41.336 INFO:teuthology.orchestra.run.smithi039.stderr:find: ‘/var/log/rbd-target-api’: No such file or directory 2024-09-12T02:52:41.336 INFO:teuthology.orchestra.run.smithi039.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.log 2024-09-12T02:52:41.337 INFO:teuthology.orchestra.run.smithi039.stderr:gzip -5 --verbose -- /var/log/ceph/4954ed46-70ae-11ef-bcea-c7b262605968/ceph-osd.0.log 2024-09-12T02:52:41.338 INFO:teuthology.orchestra.run.smithi039.stderr:/var/log/ceph/ceph-client.admin.log: gzip -5 --verbose -- /var/log/ceph/4954ed46-70ae-11ef-bcea-c7b262605968/ceph-osd.9.log 2024-09-12T02:52:41.338 INFO:teuthology.orchestra.run.smithi172.stderr:/var/log/ceph/4954ed46-70ae-11ef-bcea-c7b262605968/ceph-mgr.z.log: 92.0% -- replaced with /var/log/ceph/4954ed46-70ae-11ef-bcea-c7b262605968/ceph-mgr.z.log.gz 2024-09-12T02:52:41.339 INFO:teuthology.orchestra.run.smithi172.stderr:gzip -5 --verbose -- /var/log/ceph/4954ed46-70ae-11ef-bcea-c7b262605968/ceph-mds.f.log 2024-09-12T02:52:41.340 INFO:teuthology.orchestra.run.smithi044.stderr:/var/log/ceph/4954ed46-70ae-11ef-bcea-c7b262605968/ceph.log: /var/log/ceph/4954ed46-70ae-11ef-bcea-c7b262605968/ceph-mds.h.log: 87.4% -- replaced with /var/log/ceph/4954ed46-70ae-11ef-bcea-c7b262605968/ceph.log.gz 2024-09-12T02:52:41.340 INFO:teuthology.orchestra.run.smithi044.stderr:gzip -5 --verbose -- /var/log/ceph/4954ed46-70ae-11ef-bcea-c7b262605968/ceph-mds.e.log 2024-09-12T02:52:41.341 INFO:teuthology.orchestra.run.smithi039.stderr:/var/log/ceph/4954ed46-70ae-11ef-bcea-c7b262605968/ceph-osd.0.log: gzip -5 --verbose -- /var/log/ceph/4954ed46-70ae-11ef-bcea-c7b262605968/ceph-volume.log 2024-09-12T02:52:41.341 INFO:teuthology.orchestra.run.smithi039.stderr:/var/log/ceph/4954ed46-70ae-11ef-bcea-c7b262605968/ceph-osd.9.log: 92.4% -- replaced with /var/log/ceph/ceph-client.admin.log.gz 2024-09-12T02:52:41.341 INFO:teuthology.orchestra.run.smithi039.stderr:gzip -5 --verbose -- /var/log/ceph/4954ed46-70ae-11ef-bcea-c7b262605968/ceph.audit.log 2024-09-12T02:52:41.341 INFO:teuthology.orchestra.run.smithi039.stderr:/var/log/ceph/4954ed46-70ae-11ef-bcea-c7b262605968/ceph-volume.log: gzip -5 --verbose -- /var/log/ceph/4954ed46-70ae-11ef-bcea-c7b262605968/ceph-mds.a.log 2024-09-12T02:52:41.342 INFO:teuthology.orchestra.run.smithi039.stderr:/var/log/ceph/4954ed46-70ae-11ef-bcea-c7b262605968/ceph.audit.log: gzip -5 --verbose -- /var/log/ceph/4954ed46-70ae-11ef-bcea-c7b262605968/ceph.cephadm.log 2024-09-12T02:52:41.342 INFO:teuthology.orchestra.run.smithi039.stderr:/var/log/ceph/4954ed46-70ae-11ef-bcea-c7b262605968/ceph-mds.a.log: gzip -5 --verbose -- /var/log/ceph/4954ed46-70ae-11ef-bcea-c7b262605968/ceph-mon.a.log 2024-09-12T02:52:41.344 INFO:teuthology.orchestra.run.smithi039.stderr:/var/log/ceph/4954ed46-70ae-11ef-bcea-c7b262605968/ceph.cephadm.log: gzip -5 --verbose -- /var/log/ceph/4954ed46-70ae-11ef-bcea-c7b262605968/ceph-mds.g.log 2024-09-12T02:52:41.345 INFO:teuthology.orchestra.run.smithi039.stderr: 84.4% 90.2% -- replaced with /var/log/ceph/4954ed46-70ae-11ef-bcea-c7b262605968/ceph.audit.log.gz 2024-09-12T02:52:41.345 INFO:teuthology.orchestra.run.smithi039.stderr: -- replaced with /var/log/ceph/4954ed46-70ae-11ef-bcea-c7b262605968/ceph.cephadm.log.gz 2024-09-12T02:52:41.345 INFO:teuthology.orchestra.run.smithi039.stderr:/var/log/ceph/4954ed46-70ae-11ef-bcea-c7b262605968/ceph-mon.a.log: gzip -5 --verbose -- /var/log/ceph/4954ed46-70ae-11ef-bcea-c7b262605968/ceph-osd.6.log 2024-09-12T02:52:41.346 INFO:teuthology.orchestra.run.smithi039.stderr:gzip -5 --verbose -- /var/log/ceph/4954ed46-70ae-11ef-bcea-c7b262605968/ceph.log 2024-09-12T02:52:41.350 INFO:teuthology.orchestra.run.smithi039.stderr:/var/log/ceph/4954ed46-70ae-11ef-bcea-c7b262605968/ceph-mds.g.log: /var/log/ceph/4954ed46-70ae-11ef-bcea-c7b262605968/ceph-osd.6.log: /var/log/ceph/4954ed46-70ae-11ef-bcea-c7b262605968/ceph.log: gzip -5 --verbose -- /var/log/ceph/4954ed46-70ae-11ef-bcea-c7b262605968/ceph-mds.d.log 2024-09-12T02:52:41.352 INFO:teuthology.orchestra.run.smithi039.stderr:gzip -5 --verbose -- /var/log/ceph/4954ed46-70ae-11ef-bcea-c7b262605968/ceph-mgr.x.log 2024-09-12T02:52:41.352 INFO:teuthology.orchestra.run.smithi172.stderr:/var/log/ceph/4954ed46-70ae-11ef-bcea-c7b262605968/ceph-mds.c.log: gzip -5 --verbose -- /var/log/ceph/cephadm.log 2024-09-12T02:52:41.352 INFO:teuthology.orchestra.run.smithi039.stderr: 94.5% -- replaced with /var/log/ceph/4954ed46-70ae-11ef-bcea-c7b262605968/ceph-mds.g.log.gz 2024-09-12T02:52:41.353 INFO:teuthology.orchestra.run.smithi044.stderr:/var/log/ceph/4954ed46-70ae-11ef-bcea-c7b262605968/ceph-mon.b.log: gzip -5 --verbose -- /var/log/ceph/cephadm.log 2024-09-12T02:52:41.354 INFO:teuthology.orchestra.run.smithi039.stderr:/var/log/ceph/4954ed46-70ae-11ef-bcea-c7b262605968/ceph-mds.d.log: gzip -5 --verbose -- /var/log/ceph/4954ed46-70ae-11ef-bcea-c7b262605968/ceph-mds.j.log 2024-09-12T02:52:41.355 INFO:teuthology.orchestra.run.smithi039.stderr: 87.3%gzip -5 --verbose -- /var/log/ceph/4954ed46-70ae-11ef-bcea-c7b262605968/ceph-osd.3.log 2024-09-12T02:52:41.356 INFO:teuthology.orchestra.run.smithi039.stderr: -- replaced with /var/log/ceph/4954ed46-70ae-11ef-bcea-c7b262605968/ceph.log.gz 2024-09-12T02:52:41.357 INFO:teuthology.orchestra.run.smithi039.stderr:/var/log/ceph/4954ed46-70ae-11ef-bcea-c7b262605968/ceph-mgr.x.log: 90.9% -- replaced with /var/log/ceph/4954ed46-70ae-11ef-bcea-c7b262605968/ceph-volume.log.gz 2024-09-12T02:52:41.357 INFO:teuthology.orchestra.run.smithi039.stderr:gzip -5 --verbose -- /var/log/ceph/cephadm.log 2024-09-12T02:52:41.369 INFO:teuthology.orchestra.run.smithi039.stderr:/var/log/ceph/4954ed46-70ae-11ef-bcea-c7b262605968/ceph-mds.j.log: /var/log/ceph/4954ed46-70ae-11ef-bcea-c7b262605968/ceph-osd.3.log: /var/log/ceph/cephadm.log: 93.6% -- replaced with /var/log/ceph/cephadm.log.gz 2024-09-12T02:52:41.370 INFO:teuthology.orchestra.run.smithi044.stderr:/var/log/ceph/4954ed46-70ae-11ef-bcea-c7b262605968/ceph-mds.e.log: /var/log/ceph/cephadm.log: 91.8% -- replaced with /var/log/ceph/cephadm.log.gz 2024-09-12T02:52:41.371 INFO:teuthology.orchestra.run.smithi039.stderr: 94.6% -- replaced with /var/log/ceph/4954ed46-70ae-11ef-bcea-c7b262605968/ceph-mds.j.log.gz 2024-09-12T02:52:41.386 INFO:teuthology.orchestra.run.smithi172.stderr:/var/log/ceph/4954ed46-70ae-11ef-bcea-c7b262605968/ceph-mds.f.log: /var/log/ceph/cephadm.log: 92.3% -- replaced with /var/log/ceph/cephadm.log.gz 2024-09-12T02:52:41.387 INFO:teuthology.orchestra.run.smithi172.stderr: 92.9% -- replaced with /var/log/ceph/4954ed46-70ae-11ef-bcea-c7b262605968/ceph-mds.i.log.gz 2024-09-12T02:52:41.389 INFO:teuthology.orchestra.run.smithi044.stderr: 94.5% -- replaced with /var/log/ceph/4954ed46-70ae-11ef-bcea-c7b262605968/ceph-mds.k.log.gz 2024-09-12T02:52:41.389 INFO:teuthology.orchestra.run.smithi172.stderr: 94.5% -- replaced with /var/log/ceph/4954ed46-70ae-11ef-bcea-c7b262605968/ceph-mds.l.log.gz 2024-09-12T02:52:41.402 INFO:teuthology.orchestra.run.smithi039.stderr: 94.4% -- replaced with /var/log/ceph/4954ed46-70ae-11ef-bcea-c7b262605968/ceph-mds.a.log.gz 2024-09-12T02:52:41.413 INFO:teuthology.orchestra.run.smithi044.stderr: 93.0% -- replaced with /var/log/ceph/4954ed46-70ae-11ef-bcea-c7b262605968/ceph-mds.h.log.gz 2024-09-12T02:52:41.413 INFO:teuthology.orchestra.run.smithi172.stderr: 92.8% -- replaced with /var/log/ceph/4954ed46-70ae-11ef-bcea-c7b262605968/ceph-mds.c.log.gz 2024-09-12T02:52:41.431 INFO:teuthology.orchestra.run.smithi039.stderr: 94.6% -- replaced with /var/log/ceph/4954ed46-70ae-11ef-bcea-c7b262605968/ceph-mds.d.log.gz 2024-09-12T02:52:41.446 INFO:teuthology.orchestra.run.smithi172.stderr: 92.9% -- replaced with /var/log/ceph/4954ed46-70ae-11ef-bcea-c7b262605968/ceph-mds.f.log.gz 2024-09-12T02:52:41.575 INFO:teuthology.orchestra.run.smithi044.stderr: 94.1% -- replaced with /var/log/ceph/4954ed46-70ae-11ef-bcea-c7b262605968/ceph-mds.e.log.gz 2024-09-12T02:52:41.674 INFO:teuthology.orchestra.run.smithi172.stderr: 91.8% -- replaced with /var/log/ceph/4954ed46-70ae-11ef-bcea-c7b262605968/ceph-mon.c.log.gz 2024-09-12T02:52:41.787 INFO:teuthology.orchestra.run.smithi044.stderr: 91.8% -- replaced with /var/log/ceph/4954ed46-70ae-11ef-bcea-c7b262605968/ceph-mon.b.log.gz 2024-09-12T02:52:41.791 INFO:teuthology.orchestra.run.smithi039.stderr: 90.2% -- replaced with /var/log/ceph/4954ed46-70ae-11ef-bcea-c7b262605968/ceph-mgr.x.log.gz 2024-09-12T02:52:42.332 INFO:teuthology.orchestra.run.smithi172.stderr: 91.7% -- replaced with /var/log/ceph/4954ed46-70ae-11ef-bcea-c7b262605968/ceph-osd.11.log.gz 2024-09-12T02:52:42.355 INFO:teuthology.orchestra.run.smithi039.stderr: 92.1% -- replaced with /var/log/ceph/4954ed46-70ae-11ef-bcea-c7b262605968/ceph-osd.6.log.gz 2024-09-12T02:52:42.585 INFO:teuthology.orchestra.run.smithi039.stderr: 90.5% -- replaced with /var/log/ceph/4954ed46-70ae-11ef-bcea-c7b262605968/ceph-mon.a.log.gz 2024-09-12T02:52:42.586 INFO:teuthology.orchestra.run.smithi172.stderr: 91.9% -- replaced with /var/log/ceph/4954ed46-70ae-11ef-bcea-c7b262605968/ceph-osd.8.log.gz 2024-09-12T02:52:42.615 INFO:teuthology.orchestra.run.smithi044.stderr: 92.1% -- replaced with /var/log/ceph/4954ed46-70ae-11ef-bcea-c7b262605968/ceph-osd.1.log.gz 2024-09-12T02:52:42.786 INFO:teuthology.orchestra.run.smithi039.stderr: 92.0% -- replaced with /var/log/ceph/4954ed46-70ae-11ef-bcea-c7b262605968/ceph-osd.9.log.gz 2024-09-12T02:52:42.869 INFO:teuthology.orchestra.run.smithi044.stderr: 91.6% -- replaced with /var/log/ceph/4954ed46-70ae-11ef-bcea-c7b262605968/ceph-osd.7.log.gz 2024-09-12T02:52:43.036 INFO:teuthology.orchestra.run.smithi039.stderr: 93.1% -- replaced with /var/log/ceph/4954ed46-70ae-11ef-bcea-c7b262605968/ceph-osd.3.log.gz 2024-09-12T02:52:43.066 INFO:teuthology.orchestra.run.smithi172.stderr: 91.8% -- replaced with /var/log/ceph/4954ed46-70ae-11ef-bcea-c7b262605968/ceph-osd.5.log.gz 2024-09-12T02:52:43.092 INFO:teuthology.orchestra.run.smithi039.stderr: 93.2% -- replaced with /var/log/ceph/4954ed46-70ae-11ef-bcea-c7b262605968/ceph-osd.0.log.gz 2024-09-12T02:52:43.095 INFO:teuthology.orchestra.run.smithi039.stderr: 2024-09-12T02:52:43.095 INFO:teuthology.orchestra.run.smithi039.stderr:real 0m1.780s 2024-09-12T02:52:43.095 INFO:teuthology.orchestra.run.smithi039.stderr:user 0m7.110s 2024-09-12T02:52:43.095 INFO:teuthology.orchestra.run.smithi039.stderr:sys 0m0.659s 2024-09-12T02:52:43.141 INFO:teuthology.orchestra.run.smithi172.stderr: 91.6% -- replaced with /var/log/ceph/4954ed46-70ae-11ef-bcea-c7b262605968/ceph-osd.2.log.gz 2024-09-12T02:52:43.141 INFO:teuthology.orchestra.run.smithi172.stderr: 2024-09-12T02:52:43.141 INFO:teuthology.orchestra.run.smithi172.stderr:real 0m1.836s 2024-09-12T02:52:43.141 INFO:teuthology.orchestra.run.smithi172.stderr:user 0m6.308s 2024-09-12T02:52:43.141 INFO:teuthology.orchestra.run.smithi172.stderr:sys 0m0.232s 2024-09-12T02:52:43.246 INFO:teuthology.orchestra.run.smithi044.stderr: 92.9% -- replaced with /var/log/ceph/4954ed46-70ae-11ef-bcea-c7b262605968/ceph-mds.b.log.gz 2024-09-12T02:52:43.248 INFO:teuthology.orchestra.run.smithi044.stderr: 93.1% -- replaced with /var/log/ceph/4954ed46-70ae-11ef-bcea-c7b262605968/ceph-osd.4.log.gz 2024-09-12T02:52:43.318 INFO:teuthology.orchestra.run.smithi044.stderr: 91.8% -- replaced with /var/log/ceph/4954ed46-70ae-11ef-bcea-c7b262605968/ceph-osd.10.log.gz 2024-09-12T02:52:43.320 INFO:teuthology.orchestra.run.smithi044.stderr: 2024-09-12T02:52:43.320 INFO:teuthology.orchestra.run.smithi044.stderr:real 0m2.017s 2024-09-12T02:52:43.320 INFO:teuthology.orchestra.run.smithi044.stderr:user 0m9.223s 2024-09-12T02:52:43.321 INFO:teuthology.orchestra.run.smithi044.stderr:sys 0m0.319s 2024-09-12T02:52:43.321 INFO:tasks.cephadm:Archiving logs... 2024-09-12T02:52:43.321 DEBUG:teuthology.misc:Transferring archived files from smithi039:/var/log/ceph to /home/teuthworker/archive/teuthology-2024-09-11_21:24:17-fs-squid-distro-default-smithi/7901615/remote/smithi039/log 2024-09-12T02:52:43.322 DEBUG:teuthology.orchestra.run.smithi039:> sudo tar c -f - -C /var/log/ceph -- . 2024-09-12T02:52:44.295 DEBUG:teuthology.misc:Transferring archived files from smithi044:/var/log/ceph to /home/teuthworker/archive/teuthology-2024-09-11_21:24:17-fs-squid-distro-default-smithi/7901615/remote/smithi044/log 2024-09-12T02:52:44.296 DEBUG:teuthology.orchestra.run.smithi044:> sudo tar c -f - -C /var/log/ceph -- . 2024-09-12T02:52:45.572 DEBUG:teuthology.misc:Transferring archived files from smithi172:/var/log/ceph to /home/teuthworker/archive/teuthology-2024-09-11_21:24:17-fs-squid-distro-default-smithi/7901615/remote/smithi172/log 2024-09-12T02:52:45.573 DEBUG:teuthology.orchestra.run.smithi172:> sudo tar c -f - -C /var/log/ceph -- . 2024-09-12T02:52:46.590 INFO:tasks.cephadm:Removing cluster... 2024-09-12T02:52:46.591 DEBUG:teuthology.orchestra.run.smithi039:> sudo /home/ubuntu/cephtest/cephadm rm-cluster --fsid 4954ed46-70ae-11ef-bcea-c7b262605968 --force 2024-09-12T02:52:46.876 INFO:teuthology.orchestra.run.smithi039.stdout:Deleting cluster with fsid: 4954ed46-70ae-11ef-bcea-c7b262605968 2024-09-12T02:52:47.327 DEBUG:teuthology.orchestra.run.smithi044:> sudo /home/ubuntu/cephtest/cephadm rm-cluster --fsid 4954ed46-70ae-11ef-bcea-c7b262605968 --force 2024-09-12T02:52:47.536 INFO:teuthology.orchestra.run.smithi044.stdout:Deleting cluster with fsid: 4954ed46-70ae-11ef-bcea-c7b262605968 2024-09-12T02:52:47.799 DEBUG:teuthology.orchestra.run.smithi172:> sudo /home/ubuntu/cephtest/cephadm rm-cluster --fsid 4954ed46-70ae-11ef-bcea-c7b262605968 --force 2024-09-12T02:52:47.998 INFO:teuthology.orchestra.run.smithi172.stdout:Deleting cluster with fsid: 4954ed46-70ae-11ef-bcea-c7b262605968 2024-09-12T02:52:48.258 INFO:tasks.cephadm:Removing cephadm ... 2024-09-12T02:52:48.258 DEBUG:teuthology.orchestra.run.smithi039:> rm -rf /home/ubuntu/cephtest/cephadm 2024-09-12T02:52:48.297 DEBUG:teuthology.orchestra.run.smithi044:> rm -rf /home/ubuntu/cephtest/cephadm 2024-09-12T02:52:48.313 DEBUG:teuthology.orchestra.run.smithi172:> rm -rf /home/ubuntu/cephtest/cephadm 2024-09-12T02:52:48.329 INFO:tasks.cephadm:Teardown complete 2024-09-12T02:52:48.330 DEBUG:teuthology.run_tasks:Unwinding manager install 2024-09-12T02:52:48.341 INFO:teuthology.task.install.util:Removing shipped files: /home/ubuntu/cephtest/valgrind.supp /usr/bin/daemon-helper /usr/bin/adjust-ulimits /usr/bin/stdin-killer... 2024-09-12T02:52:48.341 DEBUG:teuthology.orchestra.run.smithi039:> sudo rm -f -- /home/ubuntu/cephtest/valgrind.supp /usr/bin/daemon-helper /usr/bin/adjust-ulimits /usr/bin/stdin-killer 2024-09-12T02:52:48.345 DEBUG:teuthology.orchestra.run.smithi044:> sudo rm -f -- /home/ubuntu/cephtest/valgrind.supp /usr/bin/daemon-helper /usr/bin/adjust-ulimits /usr/bin/stdin-killer 2024-09-12T02:52:48.356 DEBUG:teuthology.orchestra.run.smithi172:> sudo rm -f -- /home/ubuntu/cephtest/valgrind.supp /usr/bin/daemon-helper /usr/bin/adjust-ulimits /usr/bin/stdin-killer 2024-09-12T02:52:48.472 DEBUG:teuthology.run_tasks:Unwinding manager clock 2024-09-12T02:52:48.481 INFO:teuthology.task.clock:Checking final clock skew... 2024-09-12T02:52:48.482 DEBUG:teuthology.orchestra.run.smithi039:> PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2024-09-12T02:52:48.486 DEBUG:teuthology.orchestra.run.smithi044:> PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2024-09-12T02:52:48.488 DEBUG:teuthology.orchestra.run.smithi172:> PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2024-09-12T02:52:48.500 INFO:teuthology.orchestra.run.smithi044.stderr:bash: line 1: ntpq: command not found 2024-09-12T02:52:48.502 INFO:teuthology.orchestra.run.smithi172.stderr:bash: line 1: ntpq: command not found 2024-09-12T02:52:48.505 INFO:teuthology.orchestra.run.smithi044.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2024-09-12T02:52:48.505 INFO:teuthology.orchestra.run.smithi044.stdout:=============================================================================== 2024-09-12T02:52:48.505 INFO:teuthology.orchestra.run.smithi044.stdout:^* hv01.front.sepia.ceph.com 3 6 377 5 -3220us[-3226us] +/- 52ms 2024-09-12T02:52:48.505 INFO:teuthology.orchestra.run.smithi044.stdout:^+ hv02.front.sepia.ceph.com 3 6 377 64 +1693us[+1688us] +/- 61ms 2024-09-12T02:52:48.505 INFO:teuthology.orchestra.run.smithi044.stdout:^+ hv03.front.sepia.ceph.com 3 6 377 63 +3331us[+3325us] +/- 88ms 2024-09-12T02:52:48.505 INFO:teuthology.orchestra.run.smithi044.stdout:^? hv04.front.sepia.ceph.com 0 9 0 - +0ns[ +0ns] +/- 0ns 2024-09-12T02:52:48.506 INFO:teuthology.orchestra.run.smithi172.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2024-09-12T02:52:48.506 INFO:teuthology.orchestra.run.smithi172.stdout:=============================================================================== 2024-09-12T02:52:48.506 INFO:teuthology.orchestra.run.smithi172.stdout:^* hv01.front.sepia.ceph.com 3 6 377 63 -3280us[-3282us] +/- 51ms 2024-09-12T02:52:48.507 INFO:teuthology.orchestra.run.smithi172.stdout:^+ hv02.front.sepia.ceph.com 3 6 377 1 +1596us[+1596us] +/- 62ms 2024-09-12T02:52:48.507 INFO:teuthology.orchestra.run.smithi172.stdout:^+ hv03.front.sepia.ceph.com 3 6 377 64 +3225us[+3224us] +/- 88ms 2024-09-12T02:52:48.507 INFO:teuthology.orchestra.run.smithi172.stdout:^? hv04.front.sepia.ceph.com 0 9 0 - +0ns[ +0ns] +/- 0ns 2024-09-12T02:52:48.516 INFO:teuthology.orchestra.run.smithi039.stderr:bash: line 1: ntpq: command not found 2024-09-12T02:52:48.523 INFO:teuthology.orchestra.run.smithi039.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2024-09-12T02:52:48.523 INFO:teuthology.orchestra.run.smithi039.stdout:=============================================================================== 2024-09-12T02:52:48.523 INFO:teuthology.orchestra.run.smithi039.stdout:^* hv01.front.sepia.ceph.com 3 6 377 2 -3192us[-3222us] +/- 52ms 2024-09-12T02:52:48.523 INFO:teuthology.orchestra.run.smithi039.stdout:^+ hv02.front.sepia.ceph.com 3 6 377 3 +1711us[+1681us] +/- 62ms 2024-09-12T02:52:48.523 INFO:teuthology.orchestra.run.smithi039.stdout:^+ hv03.front.sepia.ceph.com 3 6 377 2 +3312us[+3312us] +/- 89ms 2024-09-12T02:52:48.523 INFO:teuthology.orchestra.run.smithi039.stdout:^? hv04.front.sepia.ceph.com 0 9 0 - +0ns[ +0ns] +/- 0ns 2024-09-12T02:52:48.524 DEBUG:teuthology.run_tasks:Unwinding manager ansible.cephlab 2024-09-12T02:52:48.537 INFO:teuthology.task.ansible:Skipping ansible cleanup... 2024-09-12T02:52:48.537 DEBUG:teuthology.run_tasks:Unwinding manager selinux 2024-09-12T02:52:48.547 DEBUG:teuthology.orchestra.run.smithi039:> mkdir /home/ubuntu/cephtest/archive/audit && sudo cp /var/log/audit/audit.log /home/ubuntu/cephtest/archive/audit && sudo chown $USER /home/ubuntu/cephtest/archive/audit/audit.log && gzip /home/ubuntu/cephtest/archive/audit/audit.log 2024-09-12T02:52:48.695 DEBUG:teuthology.orchestra.run.smithi044:> mkdir /home/ubuntu/cephtest/archive/audit && sudo cp /var/log/audit/audit.log /home/ubuntu/cephtest/archive/audit && sudo chown $USER /home/ubuntu/cephtest/archive/audit/audit.log && gzip /home/ubuntu/cephtest/archive/audit/audit.log 2024-09-12T02:52:48.766 DEBUG:teuthology.orchestra.run.smithi172:> mkdir /home/ubuntu/cephtest/archive/audit && sudo cp /var/log/audit/audit.log /home/ubuntu/cephtest/archive/audit && sudo chown $USER /home/ubuntu/cephtest/archive/audit/audit.log && gzip /home/ubuntu/cephtest/archive/audit/audit.log 2024-09-12T02:52:48.835 DEBUG:teuthology.orchestra.run.smithi039:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av -e 'comm="dmidecode"' -e chronyd.service -e 'name="cephtest"' -e scontext=system_u:system_r:nrpe_t:s0 -e scontext=system_u:system_r:pcp_pmlogger_t -e scontext=system_u:system_r:pcp_pmcd_t:s0 -e 'comm="rhsmd"' -e scontext=system_u:system_r:syslogd_t:s0 -e tcontext=system_u:system_r:nrpe_t:s0 -e 'comm="updatedb"' -e 'comm="smartd"' -e 'comm="rhsmcertd-worke"' -e 'comm="setroubleshootd"' -e 'comm="rpm"' -e tcontext=system_u:object_r:container_runtime_exec_t:s0 -e 'comm="ksmtuned"' -e 'comm="sssd"' -e 'comm="sss_cache"' -e context=system_u:system_r:NetworkManager_dispatcher_t:s0 -e context=system_u:system_r:getty_t:s0 -e scontext=system_u:system_r:logrotate_t:s0 -e scontext=system_u:system_r:getty_t:s0 2024-09-12T02:52:48.896 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-12T02:52:48.897 DEBUG:teuthology.orchestra.run.smithi044:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av -e 'comm="dmidecode"' -e chronyd.service -e 'name="cephtest"' -e scontext=system_u:system_r:nrpe_t:s0 -e scontext=system_u:system_r:pcp_pmlogger_t -e scontext=system_u:system_r:pcp_pmcd_t:s0 -e 'comm="rhsmd"' -e scontext=system_u:system_r:syslogd_t:s0 -e tcontext=system_u:system_r:nrpe_t:s0 -e 'comm="updatedb"' -e 'comm="smartd"' -e 'comm="rhsmcertd-worke"' -e 'comm="setroubleshootd"' -e 'comm="rpm"' -e tcontext=system_u:object_r:container_runtime_exec_t:s0 -e 'comm="ksmtuned"' -e 'comm="sssd"' -e 'comm="sss_cache"' -e context=system_u:system_r:NetworkManager_dispatcher_t:s0 -e context=system_u:system_r:getty_t:s0 -e scontext=system_u:system_r:logrotate_t:s0 -e scontext=system_u:system_r:getty_t:s0 2024-09-12T02:52:48.927 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-12T02:52:48.927 DEBUG:teuthology.orchestra.run.smithi172:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av -e 'comm="dmidecode"' -e chronyd.service -e 'name="cephtest"' -e scontext=system_u:system_r:nrpe_t:s0 -e scontext=system_u:system_r:pcp_pmlogger_t -e scontext=system_u:system_r:pcp_pmcd_t:s0 -e 'comm="rhsmd"' -e scontext=system_u:system_r:syslogd_t:s0 -e tcontext=system_u:system_r:nrpe_t:s0 -e 'comm="updatedb"' -e 'comm="smartd"' -e 'comm="rhsmcertd-worke"' -e 'comm="setroubleshootd"' -e 'comm="rpm"' -e tcontext=system_u:object_r:container_runtime_exec_t:s0 -e 'comm="ksmtuned"' -e 'comm="sssd"' -e 'comm="sss_cache"' -e context=system_u:system_r:NetworkManager_dispatcher_t:s0 -e context=system_u:system_r:getty_t:s0 -e scontext=system_u:system_r:logrotate_t:s0 -e scontext=system_u:system_r:getty_t:s0 2024-09-12T02:52:48.955 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-12T02:52:48.956 DEBUG:teuthology.run_tasks:Unwinding manager pcp 2024-09-12T02:52:48.967 DEBUG:teuthology.run_tasks:Unwinding manager internal.timer 2024-09-12T02:52:49.008 INFO:teuthology.task.internal:Duration was 2043.096500 seconds 2024-09-12T02:52:49.008 DEBUG:teuthology.run_tasks:Unwinding manager internal.syslog 2024-09-12T02:52:49.018 INFO:teuthology.task.internal.syslog:Shutting down syslog monitoring... 2024-09-12T02:52:49.019 DEBUG:teuthology.orchestra.run.smithi039:> sudo rm -f -- /etc/rsyslog.d/80-cephtest.conf && sudo service rsyslog restart 2024-09-12T02:52:49.023 DEBUG:teuthology.orchestra.run.smithi044:> sudo rm -f -- /etc/rsyslog.d/80-cephtest.conf && sudo service rsyslog restart 2024-09-12T02:52:49.025 DEBUG:teuthology.orchestra.run.smithi172:> sudo rm -f -- /etc/rsyslog.d/80-cephtest.conf && sudo service rsyslog restart 2024-09-12T02:52:49.064 INFO:teuthology.orchestra.run.smithi044.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2024-09-12T02:52:49.065 INFO:teuthology.orchestra.run.smithi172.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2024-09-12T02:52:49.107 INFO:teuthology.orchestra.run.smithi039.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2024-09-12T02:52:49.557 INFO:teuthology.task.internal.syslog:Checking logs for errors... 2024-09-12T02:52:49.557 DEBUG:teuthology.task.internal.syslog:Checking ubuntu@smithi039.front.sepia.ceph.com 2024-09-12T02:52:49.557 DEBUG:teuthology.orchestra.run.smithi039:> egrep --binary-files=text '\bBUG\b|\bINFO\b|\bDEADLOCK\b' /home/ubuntu/cephtest/archive/syslog/kern.log | grep -v 'task .* blocked for more than .* seconds' | grep -v 'lockdep is turned off' | grep -v 'trying to register non-static key' | grep -v 'DEBUG: fsize' | grep -v CRON | grep -v 'BUG: bad unlock balance detected' | grep -v 'inconsistent lock state' | grep -v '*** DEADLOCK ***' | grep -v 'INFO: possible irq lock inversion dependency detected' | grep -v 'INFO: NMI handler (perf_event_nmi_handler) took too long to run' | grep -v 'INFO: recovery required on readonly' | grep -v 'ceph-create-keys: INFO' | grep -v INFO:ceph-create-keys | grep -v 'Loaded datasource DataSourceOpenStack' | grep -v 'container-storage-setup: INFO: Volume group backing root filesystem could not be determined' | egrep -v '\bsalt-master\b|\bsalt-minion\b|\bsalt-api\b' | grep -v ceph-crash | egrep -v '\btcmu-runner\b.*\bINFO\b' | head -n 1 2024-09-12T02:52:49.611 DEBUG:teuthology.task.internal.syslog:Checking ubuntu@smithi044.front.sepia.ceph.com 2024-09-12T02:52:49.611 DEBUG:teuthology.orchestra.run.smithi044:> egrep --binary-files=text '\bBUG\b|\bINFO\b|\bDEADLOCK\b' /home/ubuntu/cephtest/archive/syslog/kern.log | grep -v 'task .* blocked for more than .* seconds' | grep -v 'lockdep is turned off' | grep -v 'trying to register non-static key' | grep -v 'DEBUG: fsize' | grep -v CRON | grep -v 'BUG: bad unlock balance detected' | grep -v 'inconsistent lock state' | grep -v '*** DEADLOCK ***' | grep -v 'INFO: possible irq lock inversion dependency detected' | grep -v 'INFO: NMI handler (perf_event_nmi_handler) took too long to run' | grep -v 'INFO: recovery required on readonly' | grep -v 'ceph-create-keys: INFO' | grep -v INFO:ceph-create-keys | grep -v 'Loaded datasource DataSourceOpenStack' | grep -v 'container-storage-setup: INFO: Volume group backing root filesystem could not be determined' | egrep -v '\bsalt-master\b|\bsalt-minion\b|\bsalt-api\b' | grep -v ceph-crash | egrep -v '\btcmu-runner\b.*\bINFO\b' | head -n 1 2024-09-12T02:52:49.643 DEBUG:teuthology.task.internal.syslog:Checking ubuntu@smithi172.front.sepia.ceph.com 2024-09-12T02:52:49.643 DEBUG:teuthology.orchestra.run.smithi172:> egrep --binary-files=text '\bBUG\b|\bINFO\b|\bDEADLOCK\b' /home/ubuntu/cephtest/archive/syslog/kern.log | grep -v 'task .* blocked for more than .* seconds' | grep -v 'lockdep is turned off' | grep -v 'trying to register non-static key' | grep -v 'DEBUG: fsize' | grep -v CRON | grep -v 'BUG: bad unlock balance detected' | grep -v 'inconsistent lock state' | grep -v '*** DEADLOCK ***' | grep -v 'INFO: possible irq lock inversion dependency detected' | grep -v 'INFO: NMI handler (perf_event_nmi_handler) took too long to run' | grep -v 'INFO: recovery required on readonly' | grep -v 'ceph-create-keys: INFO' | grep -v INFO:ceph-create-keys | grep -v 'Loaded datasource DataSourceOpenStack' | grep -v 'container-storage-setup: INFO: Volume group backing root filesystem could not be determined' | egrep -v '\bsalt-master\b|\bsalt-minion\b|\bsalt-api\b' | grep -v ceph-crash | egrep -v '\btcmu-runner\b.*\bINFO\b' | head -n 1 2024-09-12T02:52:49.669 INFO:teuthology.task.internal.syslog:Compressing syslogs... 2024-09-12T02:52:49.670 DEBUG:teuthology.orchestra.run.smithi039:> find /home/ubuntu/cephtest/archive/syslog -name '*.log' -print0 | sudo xargs -0 --no-run-if-empty -- gzip -- 2024-09-12T02:52:49.673 DEBUG:teuthology.orchestra.run.smithi044:> find /home/ubuntu/cephtest/archive/syslog -name '*.log' -print0 | sudo xargs -0 --no-run-if-empty -- gzip -- 2024-09-12T02:52:49.685 DEBUG:teuthology.orchestra.run.smithi172:> find /home/ubuntu/cephtest/archive/syslog -name '*.log' -print0 | sudo xargs -0 --no-run-if-empty -- gzip -- 2024-09-12T02:52:49.735 INFO:teuthology.task.internal.syslog:Gathering journactl -b0... 2024-09-12T02:52:49.735 DEBUG:teuthology.orchestra.run.smithi039:> sudo journalctl -b0 | gzip -9 > /home/ubuntu/cephtest/archive/syslog/journalctl-b0.gz 2024-09-12T02:52:49.739 DEBUG:teuthology.orchestra.run.smithi044:> sudo journalctl -b0 | gzip -9 > /home/ubuntu/cephtest/archive/syslog/journalctl-b0.gz 2024-09-12T02:52:49.751 DEBUG:teuthology.orchestra.run.smithi172:> sudo journalctl -b0 | gzip -9 > /home/ubuntu/cephtest/archive/syslog/journalctl-b0.gz 2024-09-12T02:52:50.467 DEBUG:teuthology.run_tasks:Unwinding manager internal.sudo 2024-09-12T02:52:50.478 INFO:teuthology.task.internal:Restoring /etc/sudoers... 2024-09-12T02:52:50.479 DEBUG:teuthology.orchestra.run.smithi039:> sudo mv -f /etc/sudoers.orig.teuthology /etc/sudoers 2024-09-12T02:52:50.535 DEBUG:teuthology.orchestra.run.smithi044:> sudo mv -f /etc/sudoers.orig.teuthology /etc/sudoers 2024-09-12T02:52:50.561 DEBUG:teuthology.orchestra.run.smithi172:> sudo mv -f /etc/sudoers.orig.teuthology /etc/sudoers 2024-09-12T02:52:50.587 DEBUG:teuthology.run_tasks:Unwinding manager internal.coredump 2024-09-12T02:52:50.598 DEBUG:teuthology.orchestra.run.smithi039:> sudo sysctl -w kernel.core_pattern=core && sudo bash -c 'for f in `find /home/ubuntu/cephtest/archive/coredump -type f`; do file $f | grep -q systemd-sysusers && rm $f || true ; done' && rmdir --ignore-fail-on-non-empty -- /home/ubuntu/cephtest/archive/coredump 2024-09-12T02:52:50.603 DEBUG:teuthology.orchestra.run.smithi044:> sudo sysctl -w kernel.core_pattern=core && sudo bash -c 'for f in `find /home/ubuntu/cephtest/archive/coredump -type f`; do file $f | grep -q systemd-sysusers && rm $f || true ; done' && rmdir --ignore-fail-on-non-empty -- /home/ubuntu/cephtest/archive/coredump 2024-09-12T02:52:50.605 DEBUG:teuthology.orchestra.run.smithi172:> sudo sysctl -w kernel.core_pattern=core && sudo bash -c 'for f in `find /home/ubuntu/cephtest/archive/coredump -type f`; do file $f | grep -q systemd-sysusers && rm $f || true ; done' && rmdir --ignore-fail-on-non-empty -- /home/ubuntu/cephtest/archive/coredump 2024-09-12T02:52:50.626 INFO:teuthology.orchestra.run.smithi044.stdout:kernel.core_pattern = core 2024-09-12T02:52:50.651 INFO:teuthology.orchestra.run.smithi172.stdout:kernel.core_pattern = core 2024-09-12T02:52:50.670 INFO:teuthology.orchestra.run.smithi039.stdout:kernel.core_pattern = core 2024-09-12T02:52:50.700 DEBUG:teuthology.orchestra.run.smithi039:> test -e /home/ubuntu/cephtest/archive/coredump 2024-09-12T02:52:50.733 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-12T02:52:50.734 DEBUG:teuthology.orchestra.run.smithi044:> test -e /home/ubuntu/cephtest/archive/coredump 2024-09-12T02:52:50.748 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-12T02:52:50.749 DEBUG:teuthology.orchestra.run.smithi172:> test -e /home/ubuntu/cephtest/archive/coredump 2024-09-12T02:52:50.763 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-12T02:52:50.764 DEBUG:teuthology.run_tasks:Unwinding manager internal.archive 2024-09-12T02:52:50.775 INFO:teuthology.task.internal:Transferring archived files... 2024-09-12T02:52:50.776 DEBUG:teuthology.misc:Transferring archived files from smithi039:/home/ubuntu/cephtest/archive to /home/teuthworker/archive/teuthology-2024-09-11_21:24:17-fs-squid-distro-default-smithi/7901615/remote/smithi039 2024-09-12T02:52:50.776 DEBUG:teuthology.orchestra.run.smithi039:> sudo tar c -f - -C /home/ubuntu/cephtest/archive -- . 2024-09-12T02:52:50.852 DEBUG:teuthology.misc:Transferring archived files from smithi044:/home/ubuntu/cephtest/archive to /home/teuthworker/archive/teuthology-2024-09-11_21:24:17-fs-squid-distro-default-smithi/7901615/remote/smithi044 2024-09-12T02:52:50.853 DEBUG:teuthology.orchestra.run.smithi044:> sudo tar c -f - -C /home/ubuntu/cephtest/archive -- . 2024-09-12T02:52:50.890 DEBUG:teuthology.misc:Transferring archived files from smithi172:/home/ubuntu/cephtest/archive to /home/teuthworker/archive/teuthology-2024-09-11_21:24:17-fs-squid-distro-default-smithi/7901615/remote/smithi172 2024-09-12T02:52:50.890 DEBUG:teuthology.orchestra.run.smithi172:> sudo tar c -f - -C /home/ubuntu/cephtest/archive -- . 2024-09-12T02:52:50.926 INFO:teuthology.task.internal:Removing archive directory... 2024-09-12T02:52:50.926 DEBUG:teuthology.orchestra.run.smithi039:> rm -rf -- /home/ubuntu/cephtest/archive 2024-09-12T02:52:50.931 DEBUG:teuthology.orchestra.run.smithi044:> rm -rf -- /home/ubuntu/cephtest/archive 2024-09-12T02:52:50.933 DEBUG:teuthology.orchestra.run.smithi172:> rm -rf -- /home/ubuntu/cephtest/archive 2024-09-12T02:52:50.976 DEBUG:teuthology.run_tasks:Unwinding manager internal.archive_upload 2024-09-12T02:52:50.992 INFO:teuthology.task.internal:Not uploading archives. 2024-09-12T02:52:50.992 DEBUG:teuthology.run_tasks:Unwinding manager internal.base 2024-09-12T02:52:51.003 INFO:teuthology.task.internal:Tidying up after the test... 2024-09-12T02:52:51.003 DEBUG:teuthology.orchestra.run.smithi039:> find /home/ubuntu/cephtest -ls ; rmdir -- /home/ubuntu/cephtest 2024-09-12T02:52:51.007 DEBUG:teuthology.orchestra.run.smithi044:> find /home/ubuntu/cephtest -ls ; rmdir -- /home/ubuntu/cephtest 2024-09-12T02:52:51.009 DEBUG:teuthology.orchestra.run.smithi172:> find /home/ubuntu/cephtest -ls ; rmdir -- /home/ubuntu/cephtest 2024-09-12T02:52:51.022 INFO:teuthology.orchestra.run.smithi044.stdout: 262165 4 drwxr-xr-x 2 ubuntu ubuntu 4096 Sep 12 02:52 /home/ubuntu/cephtest 2024-09-12T02:52:51.031 INFO:teuthology.orchestra.run.smithi172.stdout: 262165 4 drwxr-xr-x 2 ubuntu ubuntu 4096 Sep 12 02:52 /home/ubuntu/cephtest 2024-09-12T02:52:51.038 INFO:teuthology.orchestra.run.smithi039.stdout: 393233 4 drwxr-xr-x 2 ubuntu ubuntu 4096 Sep 12 02:52 /home/ubuntu/cephtest 2024-09-12T02:52:51.040 DEBUG:teuthology.run_tasks:Unwinding manager kernel 2024-09-12T02:52:51.051 DEBUG:teuthology.run_tasks:Unwinding manager console_log 2024-09-12T02:52:51.076 INFO:teuthology.run:Summary data: client.0-kernel-sha1: 2ca44a2f35ca8f36983aaaa46d49312239ef519a description: fs/workload/{0-centos_9.stream begin/{0-install 1-cephadm 2-logrotate 3-modules} clusters/1a11s-mds-1c-client-3node conf/{client mds mgr mon osd} mount/kclient/{base/{mount-syntax/{v2} mount overrides/{distro/testing/k-testing ms-die-on-skipped}} ms_mode/legacy wsync/no} objectstore-ec/bluestore-ec-root omap_limit/10 overrides/{cephsqlite-timeout frag ignorelist_health ignorelist_wrongly_marked_down osd-asserts pg_health session_timeout} ranks/multi/{balancer/random export-check n/5 replication/always} standby-replay tasks/{0-subvolume/{with-quota} 1-check-counter 2-scrub/no 3-snaps/yes 4-flush/no 5-quiesce/no 6-workunit/fs/test_o_trunc}} duration: 2043.0964999198914 flavor: default owner: scheduled_teuthology@teuthology success: true 2024-09-12T02:52:51.076 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-09-12T02:52:51.173 INFO:teuthology.run:pass